Striatal dopamine D1 receptors are involved in the dissociation of learning based on reward-magnitude

Parallel executive pallio-motor loops in the pigeon brain

A core component of the avian pallial cognitive network is the multimodal nidopallium caudolaterale (NCL) that is considered to be analogous to the mammalian prefrontal cortex (PFC). The NCL plays a key role in a multitude of executive tasks such as working memory, decision-making during navigation, and extinction learning in complex learning environments. Like the PFC, the NCL is positioned at the transition from ascending sensory to descending motor systems. For the latter, it sends descending premotor projections to the intermediate arcopallium (AI) and the medial striatum (MSt). To gain detailed insight into the organization of these projections, we conducted several retrograde and anterograde tracing experiments. First, we tested whether NCL neurons projecting to AI (NCLarco neurons) and MSt (NCLMSt neurons) are constituted by a single neuronal population with bifurcating neurons, or whether they form two distinct populations. Here, we found two distinct projection patterns to both target areas that were associated with different morphologies. Second, we revealed a weak topographic projection toward the medial and lateral striatum and a strong topographic projection toward AI with clearly distinguishable sensory termination fields. Third, we investigated the relationship between the descending NCL pathways to the arcopallium with those from the hyperpallium apicale, which harbors a second major descending pathway of the avian pallium. We embed our findings within a system of parallel pallio-motor loops that carry information from separate sensory modalities to different subpallial systems. Our results also provide insights into the evolution of the avian motor system from which, possibly, the song system has emerged.

Visual categories and concepts in the avian brain

Birds are excellent model organisms to study perceptual categorization and concept formation. The renewed focus on avian neuroscience has sparked an explosion of new data in the field. At the same time, our understanding of sensory and particularly visual structures in the avian brain has shifted fundamentally. These recent discoveries have revealed how categorization is mediated in the avian brain and has generated a theoretical framework that goes beyond the realm of birds. We review the contribution of avian categorization research-at the methodical, behavioral, and neurobiological levels. To this end, we first introduce avian categorization from a behavioral perspective and the common elements model of categorization. Second, we describe the functional and structural organization of the avian visual system, followed by an overview of recent anatomical discoveries and the new perspective on the avian 'visual cortex'. Third, we focus on the neurocomputational basis of perceptual categorization in the bird's visual system. Fourth, an overview of the avian prefrontal cortex and the prefrontal contribution to perceptual categorization is provided. The fifth section outlines how asymmetries of the visual system contribute to categorization. Finally, we present a mechanistic view of the neural principles of avian visual categorization and its putative extension to concept learning.

Constitutive gene expression differs in three brain regions important for cognition in neophobic and non-neophobic house sparrows (Passer domesticus)

Neophobia (aversion to new objects, food, and environments) is a personality trait that affects the ability of wildlife to adapt to new challenges and opportunities. Despite the ubiquity and importance of this trait, the molecular mechanisms underlying repeatable individual differences in neophobia in wild animals are poorly understood. We evaluated wild-caught house sparrows (Passer domesticus) for neophobia in the lab using novel object tests. We then selected a subset of neophobic and non-neophobic individuals (n = 3 of each, all females) and extracted RNA from four brain regions involved in learning, memory, threat perception, and executive function: striatum, caudal dorsomedial hippocampus, medial ventral arcopallium, and caudolateral nidopallium (NCL). Our analysis of differentially expressed genes (DEGs) used 11,889 gene regions annotated in the house sparrow reference genome for which we had an average of 25.7 million mapped reads/sample. PERMANOVA identified significant effects of brain region, phenotype (neophobic vs. non-neophobic), and a brain region by phenotype interaction. Comparing neophobic and non-neophobic birds revealed constitutive differences in DEGs in three of the four brain regions examined: hippocampus (12% of the transcriptome significantly differentially expressed), striatum (4%) and NCL (3%). DEGs included important known neuroendocrine mediators of learning, memory, executive function, and anxiety behavior, including serotonin receptor 5A, dopamine receptors 1, 2 and 5 (downregulated in neophobic birds), and estrogen receptor beta (upregulated in neophobic birds). These results suggest that some of the behavioral differences between phenotypes may be due to underlying gene expression differences in the brain. The large number of DEGs in neophobic and non-neophobic birds also implies that there are major differences in neural function between the two phenotypes that could affect a wide variety of behavioral traits beyond neophobia.

A test of context and sex-dependent dopaminergic effects on the behavior of a gregarious bird, the common waxbill Estrilda astrild

The Dopaminergic (DAergic) system has well known influences on behavioral and cognitive functions. Previous work with common waxbills (Estrilda astrild) reported context-specific DAergic effects that could have been due to social environment. Manipulating the dopamine D2-like receptor family (D2R) pathways had opposed effects on behavior depending on whether waxbills were tested alone or in a small cage with a mirror as social stimulus. Since waxbills are highly gregarious, it was hypothesized that being alone or perceiving to have a companion might explain this context-dependence. To test context-dependent DAergic effects, we compared behavioral effects of D2R manipulation in waxbills in the same familiar environment, but either alone or with a familiar, same-sex companion. We found that D2R agonism decreased movement and feeding, similarly to previous results when testing waxbills alone. However, contrary to the hypothesis of dependence on social context, we found that the behavioral effects of the D2R agonist were unchanged when waxbills were tested with a companion. The context-dependence reported earlier might thus be due to other factors, such as the stress of being in a novel environment (small cage) or with an unfamiliar social stimulus (mirror image). In tests with a companion, we also found a sex-specific social effect of D2R manipulation: D2R blocking tended to decrease aggression in males but to increase in females. Together with past work, our results suggest that DAergic effects on behavior involve different types of context- or sex-dependence.

How foraging works: Uncertainty magnifies food-seeking motivation

Food uncertainty has the effect of invigorating food-related responses. Psychologists have noted that mammals and birds respond more to a conditioned stimulus that unreliably predicts food delivery, and ecologists have shown that animals (especially small passerines) consume and/or hoard more food and can get fatter when access to that resource is unpredictable. Are these phenomena related? We think they are. Psychologists have proposed several mechanistic interpretations, while ecologists have suggested a functional interpretation: The effect of unpredictability on fat reserves and hoarding behavior is an evolutionary strategy acting against the risk of starvation when food is in short supply. Both perspectives are complementary, and we argue that the psychology of incentive motivational processes can shed some light on the causal mechanisms leading animals to seek and consume more food under uncertainty in the wild. Our theoretical approach is in agreement with neuroscientific data relating to the role of dopamine, a neurotransmitter strongly involved in incentive motivation, and its plausibility has received some explanatory and predictive value with respect to Pavlovian phenomena. Overall, we argue that the occasional and unavoidable absence of food rewards has motivational effects (called incentive hope) that facilitate foraging effort. We show that this hypothesis is computationally tenable, leading foragers in an unpredictable environment to consume more food items and to have higher long-term energy storage than foragers in a predictable environment.

Striatal dopamine D1 receptor suppression impairs reward-associative learning

Dopamine (DA) is required for reinforcement learning. Hence, disruptions in DA signaling may contribute to the learning deficits associated with psychiatric disorders. The DA D1 receptor (D1R) has been linked to learning and is a target for cognitive/motivational enhancement in patients with schizophrenia. Separating the striatal D1R contribution to learning vs. motivation, however, has been challenging. We suppressed striatal D1R expression in mice using a D1R-targeting short hairpin RNA (shRNA), delivered locally to the striatum via an adeno-associated virus (AAV). We then assessed reward- and punishment-associative learning using a probabilistic learning task and motivation using a progressive-ratio breakpoint procedure. We confirmed suppression of striatal D1Rs immunohistochemically and by testing locomotor activity after the administration of (+)-doxanthrine, a full D1R agonist, in control mice and those treated with the D1RshRNA. D1RshRNA-treated mice exhibited impaired reward-associative learning, while punishment-associative learning was spared. This deficit was unrelated to general learning impairments or amotivation, because the D1shRNA-treated mice exhibited normal Barnes maze learning and normal motivation in the progressive-ratio breakpoint procedure. Suppression of striatal D1Rs selectively impaired reward-associative learning whereas punishment-associative learning, aversion-motivated learning, and appetitive motivation were spared. Because patients with schizophrenia exhibit similar reward-associative learning deficits, D1R-targeted treatments should be investigated to improve reward learning in these patients.

Dopamine modulation of learning and memory in the prefrontal cortex: insights from studies in primates, rodents, and birds

In this review, we provide a brief overview over the current knowledge about the role of dopamine transmission in the prefrontal cortex during learning and memory. We discuss work in humans, monkeys, rats, and birds in order to provide a basis for comparison across species that might help identify crucial features and constraints of the dopaminergic system in executive function. Computational models of dopamine function are introduced to provide a framework for such a comparison. We also provide a brief evolutionary perspective showing that the dopaminergic system is highly preserved across mammals. Even birds, following a largely independent evolution of higher cognitive abilities, have evolved a comparable dopaminergic system. Finally, we discuss the unique advantages and challenges of using different animal models for advancing our understanding of dopamine function in the healthy and diseased brain.

Competitor suppresses neuronal representation of food reward in the nucleus accumbens/medial striatum of domestic chicks

To investigate the role of social contexts in controlling the neuronal representation of food reward, we recorded single neuron activity in the medial striatum/nucleus accumbens of domestic chicks and examined whether activities differed between two blocks with different contexts. Chicks were trained in an operant task to associate light-emitting diode color cues with three trial types that differed in the type of food reward: no reward (S-), a small reward/short-delay option (SS), and a large reward/long-delay alternative (LL). Amount and duration of reward were set such that both of SS and LL were chosen roughly equally. Neurons showing distinct cue-period activity in rewarding trials (SS and LL) were identified during an isolation block, and activity patterns were compared with those recorded from the same neuron during a subsequent pseudo-competition block in which another chick was allowed to forage in the same area, but was separated by a transparent window. In some neurons, cue-period activity was lower in the pseudo-competition block, and the difference was not ascribed to the number of repeated trials. Comparison at neuronal population level revealed statistically significant suppression in the pseudo-competition block in both SS and LL trials, suggesting that perceived competition generally suppressed the representation of cue-associated food reward. The delay- and reward-period activities, however, did not significantly different between blocks. These results demonstrate that visual perception of a competitive forager per se weakens the neuronal representation of predicted food reward. Possible functional links to impulse control are discussed.