Impairment in a discrimination reversal task after D1 receptor blockade in the pigeon "prefrontal cortex"

Convergent Circuit Computation for Categorization in the Brains of Primates and Songbirds

Categorization is crucial for behavioral flexibility because it enables animals to group stimuli into meaningful classes that can easily be generalized to new circumstances. A most abstract quantitative category is set size, the number of elements in a set. This review explores how categorical number representations are realized by the operations of excitatory and inhibitory neurons in associative telencephalic microcircuits in primates and songbirds. Despite the independent evolution of the primate prefrontal cortex and the avian nidopallium caudolaterale, the neuronal computations of these associative pallial circuits show surprising correspondence. Comparing cellular functions in distantly related taxa can inform about the evolutionary principles of circuit computations for cognition in distinctly but convergently realized brain structures.

Behavioral Training Related Neurotransmitter Receptor Expression Dynamics in the Nidopallium Caudolaterale and the Hippocampal Formation of Pigeons

Learning and memory are linked to dynamic changes at the level of synapses in brain areas that are involved in cognitive tasks. For example, changes in neurotransmitter receptors are prerequisite for tuning signals along local circuits and long-range networks. However, it is still unclear how a series of learning events promotes plasticity within the system of neurotransmitter receptors and their subunits to shape information processing at the neuronal level. Therefore, we investigated the expression of different glutamatergic NMDA (GRIN) and AMPA (GRIA) receptor subunits, the GABAergic GABARG2 subunit, dopaminergic DRD1, serotonergic 5HTR1A and noradrenergic ADRA1A receptors in the pigeon’s brain. We studied the nidopallium caudolaterale, the avian analogue of the prefrontal cortex, and the hippocampal formation, after training the birds in a rewarded stimulus-response association (SR) task and in a simultaneous-matching-to-sample (SMTS) task. The results show that receptor expression changed differentially after behavioral training compared to an untrained control group. In the nidopallium caudolaterale, GRIN2B, GRIA3, GRIA4, DRD1D, and ADRA1A receptor expression was altered after SR training and remained constantly decreased after the SMTS training protocol, while GRIA2 and DRD1A decreased only under the SR condition. In the hippocampal formation, GRIN2B decreased and GABARG2 receptor expression increased after SR training. After SMTS sessions, GRIN2B remained decreased, GABARG2 remained increased if compared to the control group. None of the investigated receptors differed directly between both conditions, although differentially altered. The changes in both regions mostly occur in favor of the stimulus response task. Thus, the present data provide evidence that neurotransmitter receptor expression dynamics play a role in the avian prefrontal cortex and the hippocampal formation for behavioral training and is uniquely, regionally and functionally associated to cognitive processes including learning and memory.

Dopamine in the songbird auditory cortex shapes auditory preference

Vocal communication signals can provide listeners with information about the signaler and elicit motivated responses. Auditory cortical and mesolimbic reward circuits are often considered to have distinct roles in these processes, with auditory cortical circuits responsible for detecting and discriminating sounds and mesolimbic circuits responsible for ascribing salience and modulating preference for those sounds. Here, we investigated whether dopamine within auditory cortical circuits themselves can shape the incentive salience of a vocal signal. Female zebra finches demonstrate natural preferences for vocal signals produced by males ("songs"), and we found that brief pairing of passive song playback with pharmacological dopamine manipulations in the secondary auditory cortex significantly altered song preferences. In particular, pairing passive song playback with retrodialysis of dopamine agonists into the auditory cortex enhanced preferences for less-preferred songs. Plasticity of song preferences by dopamine persisted for at least 1 week and was mediated by D1 receptors. In contrast, song preferences were not shaped by norepinephrine. In line with this, while we found that the ventral tegmental area, substantia nigra pars compacta, and locus coeruleus all project to the secondary auditory cortex, only dopamine-producing neurons in the ventral tegmental area differentially responded to preferred versus less-preferred songs. In contrast, norepinephrine neurons in the locus coeruleus increased expression of activity-dependent neural markers for both preferred and less-preferred songs. These data suggest that dopamine acting directly in sensory-processing areas can shape the incentive salience of communication signals.

Nuclear organization and morphology of catecholaminergic neurons and certain pallial terminal networks in the brain of the Nile crocodile, Crocodylus niloticus

In the current study, we use tyrosine hydroxylase (TH) immunohistochemistry to detail the nuclear parcellation and cellular morphology of neurons belonging to the catecholaminergic system in the brain of the Nile crocodile. In general, our results are similar to that found in another crocodilian (the spectacled caiman) and indeed other vertebrates, but certain differences of both evolutionary and functional significance were noted. TH immunopositive (TH+) neurons forming distinct nuclei were observed in the olfactory bulb (A16), hypothalamus (A11, A13-15), midbrain (A8-A10), pons (A5-A7) and medulla oblongata (area postrema, C1, C2, A1, A2), encompassing the more commonly observed nuclear complexes of this system across vertebrates. In addition, TH + neurons forming distinct nuclei not commonly identified in vertebrates were observed in the anterior olfactory nucleus, the pretectal nuclear complex, adjacent to the posterior commissure, and within nucleus laminaris, nucleus magnocellularis lateralis and the lateral vestibular nucleus. Palely stained TH + neurons were observed in some of the serotonergic nuclei, including the medial and lateral divisions of the superior raphe nucleus and the inferior raphe and inferior reticular nucleus, but not in other serotonergic nuclei. In birds, a high density of TH + fibres and pericellular baskets in the dorsal ventricular ridge marks the location of the nidopallium caudolaterale (NCL), a putative avian analogue of mammalian prefrontal cortex. In the dorsal ventricular ridge (DVR) of the crocodile a small region in the caudolateral anterior DVR (ADVRcl) revealed a slightly higher density of TH + fibres and some pericellular baskets (formed by only few TH + fibres). These results are discussed in an evolutionary and functional framework.

Existence of working memory in teleosts: Establishment of the delayed matching-to-sample task in adult zebrafish

Operant conditioning is a powerful tool to study animal perception and cognition. Compared to mammals and birds, there are very few behavioral studies using operant conditioning paradigm in teleosts. Here we aim to establish matching-to-sample task (MTS) in adult zebrafish, using visual cues (colors) as discriminative stimuli. Unlike simple one-to-one color-reward association learning, MTS requires ability for context integration. In this study, zebrafish learned to perform the simultaneous-matching-to-sample (SMTS) within 15 sessions. After the SMTS training, working memory was tested by inserting a delay period (delayed matching-to-sample; DMTS). Zebrafish could perform the DMTS with a delay of at least 3-4 seconds. They could also learn to perform the DMTS even with a delay period from the beginning of the training session. These results strongly suggest that adult zebrafish possess working memory. However, our study also indicates limitations of zebrafish in cognitive flexibility or attention: they could perform SMTS/DMTS only in a certain set-up. The presence of working memory without the mesencephalic dopamine neurons indicates the convergent evolution of this function in amniotes and teleosts.

The expression of tyrosine hydroxylase and DARPP-32 in the house crow (Corvus splendens) brain

Birds of the family Corvidae which includes diverse species such as crows, rooks, ravens, magpies, jays, and jackdaws are known for their amazing abilities at problem-solving. Since the catecholaminergic system, especially the neurotransmitter dopamine, plays a role in cognition, we decided to study the distribution of tyrosine hydroxylase (TH), the rate-limiting enzyme in the synthesis of catecholamines in the brain of house crows (Corvus splendens). We also studied the expression of DARPP-32 (dopamine and cAMP-regulated phosphoprotein), which is expressed in dopaminoceptive neurons. Our results demonstrated that as in other avian species, the expression of both TH and DARPP-32 was highest in the house crow striatum. The caudolateral nidopallium (NCL, the avian analogue of the mammalian prefrontal cortex) could be differentiated from the surrounding pallial regions based on a larger number of TH-positive "baskets" of fibers around neurons in this region and greater intensity of DARPP-32 staining in the neuropil in this region. House crows also possessed distinct nuclei in their brains which corresponded to song control regions in other songbirds. Whereas immunoreactivity for TH was higher in the vocal control region Area X compared to the surrounding MSt (medial striatum) in house crows, staining in RA and HVC was not as prominent. Furthermore, the arcopallial song control regions RA (nucleus robustus arcopallialis) and AId (intermediate arcopallium) were strikingly negative for DARPP-32 staining, in contrast to the surrounding arcopallium. Patterns of immunoreactivity for TH and DARPP-32 in "limbic" areas such as the hippocampus, septum, and extended amygdala have also been described.

Dopaminergic impact on local and global cortical circuit processing during learning

We have learned to detect, predict and behaviorally respond to important changes in our environment on short and longer time scales. Therefore, brains of humans and higher animals build upon a perceptual and semantic salience stored in their memories mainly generated by associative reinforcement learning. Functionally, the brain needs to extract and amplify a small number of features of sensory input with behavioral relevance to a particular situation in order to guide behavior. In this review, I argue that dopamine action, particularly in sensory cortex, orchestrates layer-dependent local and long-range cortical circuits integrating sensory associated bottom-up and semantically relevant top-down information, respectively. Available evidence reveals that dopamine thereby controls both the selection of perceptually or semantically salient signals as well as feedback processing from higher-order areas in the brain. Sensory cortical dopamine thereby governs the integration of selected sensory information within a behavioral context. This review proposes that dopamine enfolds this function by temporally distinct actions on particular layer-dependent local and global cortical circuits underlying the integration of sensory, and non-sensory cognitive and behavioral variables.

Role of dopamine D2 receptors in optimizing choice strategy in a dynamic and uncertain environment

In order to investigate roles of dopamine receptor subtypes in reward-based learning, we examined choice behavior of dopamine D1 and D2 receptor-knockout (D1R-KO and D2R-KO, respectively) mice in an instrumental learning task with progressively increasing reversal frequency and a dynamic two-armed bandit task. Performance of D2R-KO mice was progressively impaired in the former as the frequency of reversal increased and profoundly impaired in the latter even with prolonged training, whereas D1R-KO mice showed relatively minor performance deficits. Choice behavior in the dynamic two-armed bandit task was well explained by a hybrid model including win-stay-lose-switch and reinforcement learning terms. A model-based analysis revealed increased win-stay, but impaired value updating and decreased value-dependent action selection in D2R-KO mice, which were detrimental to maximizing rewards in the dynamic two-armed bandit task. These results suggest an important role of dopamine D2 receptors in learning from past choice outcomes for rapid adjustment of choice behavior in a dynamic and uncertain environment.

Dopamine modulation of learning and memory in the prefrontal cortex: insights from studies in primates, rodents, and birds

In this review, we provide a brief overview over the current knowledge about the role of dopamine transmission in the prefrontal cortex during learning and memory. We discuss work in humans, monkeys, rats, and birds in order to provide a basis for comparison across species that might help identify crucial features and constraints of the dopaminergic system in executive function. Computational models of dopamine function are introduced to provide a framework for such a comparison. We also provide a brief evolutionary perspective showing that the dopaminergic system is highly preserved across mammals. Even birds, following a largely independent evolution of higher cognitive abilities, have evolved a comparable dopaminergic system. Finally, we discuss the unique advantages and challenges of using different animal models for advancing our understanding of dopamine function in the healthy and diseased brain.

Discrimination: from behaviour to brain

Discrimination is a skill needed by many organisms for survival: decisions about food, shelter, and mate selection all require the ability to distinguish among stimuli. This article reviews the how and why of discrimination and how researchers may exploit this natural skill in the laboratory to learn more about what features of stimuli animals use to discriminate. The paper then discusses the possible neurophysiological basis of discrimination and proposes a model, based on one of stimulus-association put forth by Beninger and Gerdjikov (2004) [Beninger, R.J., Gerdjikov, T.V., 2004. The role of signaling molecules in reward-related incentive learning. Neurotox. Res., 6, 91-104], to account for the role of dopamine in how an animal learns to discriminate rewarded from non-rewarded stimuli.

Cognitive ornithology: the evolution of avian intelligence

Comparative psychologists interested in the evolution of intelligence have focused their attention on social primates, whereas birds tend to be used as models of associative learning. However, corvids and parrots, which have forebrains relatively the same size as apes, live in complex social groups and have a long developmental period before becoming independent, have demonstrated ape-like intelligence. Although, ornithologists have documented thousands of hours observing birds in their natural habitat, they have focused their attention on avian behaviour and ecology, rather than intelligence. This review discusses recent studies of avian cognition contrasting two different approaches; the anthropocentric approach and the adaptive specialization approach. It is argued that the most productive method is to combine the two approaches. This is discussed with respects to recent investigations of two supposedly unique aspects of human cognition; episodic memory and theory of mind. In reviewing the evidence for avian intelligence, corvids and parrots appear to be cognitively superior to other birds and in many cases even apes. This suggests that complex cognition has evolved in species with very different brains through a process of convergent evolution rather than shared ancestry, although the notion that birds and mammals may share common neural connectivity patterns is discussed.

The avian 'prefrontal cortex' and cognition

Both mammals and birds can flexibly organize their behavior over time. In mammals, the mental operations generating this ability are called executive functions and are associated with the prefrontal cortex. The corresponding structure in birds is the nidopallium caudolaterale. Anatomical, neurochemical, electrophysiological and behavioral studies show these structures to be highly similar. The avian forebrain displays no lamination that corresponds to the mammalian neocortex, hence lamination does not seem to be a requirement for higher cognitive functions. Because all other aspects of the neural architecture of the mammalian and the avian prefrontal areas are extremely comparable, the freedom to create different neural architectures that generate prefrontal functions seems to be very limited.

Neural correlates of executive control in the avian brain

Executive control, the ability to plan one's behaviour to achieve a goal, is a hallmark of frontal lobe function in humans and other primates. In the current study we report neural correlates of executive control in the avian nidopallium caudolaterale, a region analogous to the mammalian prefrontal cortex. Homing pigeons (Columba livia) performed a working memory task in which cues instructed them whether stimuli should be remembered or forgotten. When instructed to remember, many neurons showed sustained activation throughout the memory period. When instructed to forget, the sustained activation was abolished. Consistent with the neural data, the behavioural data showed that memory performance was high after instructions to remember, and dropped to chance after instructions to forget. Our findings indicate that neurons in the avian nidopallium caudolaterale participate in one of the core forms of executive control, the control of what should be remembered and what should be forgotten. This form of executive control is fundamental not only to working memory, but also to all cognition.

Avian and mammalian "prefrontal cortices": limited degrees of freedom in the evolution of the neural mechanisms of goal-state maintenance

Is it possible to produce the same cognitive function with different brain organizations? This question is approached for working memory, a cognitive entity that is equally organized in birds and mammals. The critical forebrain structure for working memory is the nidopallium caudolaterale (NCL) in birds and the prefrontal cortex (PFC) in mammals. Although both structures share a large number of neural architectural features, they are probably not homologous but represent a remarkable case of convergent evolution. In reviewing the neuronal mechanisms for working memory in birds and mammals it becomes apparent that the similarities of NCL and PFC extend from the neuronal activation patterns during memory tasks down to the biophysical mechanisms of synaptic currents. Both in mammals and birds, dopamine acts via D1-receptors to tune preactivated neurons into sustained high-frequency patterns with which goal states can be held over time until an appropriate response can be generated. The degrees of freedom to create different neural architectures to solve the problem of 'stimulus maintenance' seem to be very small.

Maintenance in working memory or response selection? Functions of NMDA receptors in the pigeon "prefrontal cortex"

The prefrontal cortex is involved in various aspects of working memory like stimulus maintenance and response selection functions. Neurobehavioral studies and neurocomputational models assume a role for NMDA receptors in prefrontal cortex for maintenance processes, while our previous studies on NMDA receptors in the avian prefrontal cortex-analogue, the nidopallium caudolaterale (NCL), showed them to be involved in response selection functions. Various tasks used in PFC-related research address in fact both functions, so they cannot disambiguate their separate contributions to performance. In order to investigate the role of NMDA receptors in avian NCL for stimulus maintenance and response selection, we trained pigeons in a delayed matching-to sample (DMTS) task, requiring both functions, and a simultaneous matching to sample (SMTS) task, requiring only response selection. After reaching criterion, pigeons had to perform the tasks alternately under local NMDA receptor blockade in NCL (DL-AP5) and after infusion of vehicle (saline solution). Blockade of NCL-based NMDA receptors led to significant increases in error rates in both DMTS and SMTS--compared with the same subjects' performance during training and in the control condition. However, there was no additional increase in errors due to the additional maintenance component, so the impairment appears to be due to deficits in adequate selection of responses, the function necessary for both tasks. We conclude that NMDA receptors in the pigeon NCL participate in response selection rather than stimulus maintenance in tasks requiring the processing of context information.

Haloperidol impairs auditory filial imprinting and modulates monoaminergic neurotransmission in an imprinting-relevant forebrain area of the domestic chick

In vivo microdialysis and behavioural studies in the domestic chick have shown that glutamatergic as well as monoaminergic neurotransmission in the medio-rostral neostriatum/hyperstriatum ventrale (MNH) is altered after auditory filial imprinting. In the present study, using pharmaco-behavioural and in vivo microdialysis approaches, the role of dopaminergic neurotransmission in this juvenile learning event was further evaluated. The results revealed that: (i) the systemic application of the potent dopamine receptor antagonist haloperidol (7.5 mg/kg) strongly impairs auditory filial imprinting; (ii) systemic haloperidol induces a tetrodotoxin-sensitive increase of extracellular levels of the dopamine metabolite, homovanillic acid, in the MNH, whereas the levels of glutamate, taurine and the serotonin metabolite, 5-hydroxyindole-3-acetic acid, remain unchanged; (iii) haloperidol (0.01, 0.1, 1 mm) infused locally into the MNH increases glutamate, taurine and 5- hydroxyindole-3-acetic acid levels in a dose-dependent manner, whereas homovanillic acid levels remain unchanged; (iv) systemic haloperidol infusion reinforces the N-methyl-d-aspartate receptor-mediated inhibitory modulation of the dopaminergic neurotransmission within the MNH. These results indicate that the modulation of dopaminergic function and its interaction with other neurotransmitter systems in a higher associative forebrain region of the juvenile avian brain displays similar neurochemical characteristics as the adult mammalian prefrontal cortex. Furthermore, we were able to show that the pharmacological manipulation of monoaminergic regulatory mechanisms interferes with learning and memory formation, events which in a similar fashion might occur in young or adult mammals.

Impaired learning of a color reversal task after NMDA receptor blockade in the pigeon (Columba livia) associative forebrain (neostriatum caudolaterale)

The neostriatum caudolaterale (NCL) in the pigeon (Columba livia) forebrain is a multisensory associative area and a functional equivalent to the mammalian prefrontal cortex (PFC). To investigate the role of N-methyl-D-aspartate (NMDA) receptors in the NCL for learning flexibility, the authors trained pigeons in a color reversal task while locally blocking NMDA receptors with D,L-2-2-amino-5-phosphonovalerate (AP-5). Controls received saline injections. AP-5-treated pigeons made significantly more errors and showed significantly stronger perseveration in a learning strategy applied by both groups but were unimpaired in initial learning. Results indicate that NMDA receptors in the NCL are necessary for efficient performance in this PFC-sensitive task, and that they are involved in extinction of obsolete information rather than in acquiring new information.

Electrophysiological and morphological properties of cell types in the chick neostriatum caudolaterale

The neostriatum caudolaterale, in the chick also referred to as dorsocaudal neostriatal complex, is a polymodal associative area in the forebrain of birds that is involved in sensorimotor integration and memory processes. We have used whole-cell patch-clamp recordings in chick brain slices to characterize the principal cell types of the neostriatum caudolaterale. Electrophysiological properties distinguished four classes of neurons. The morphological characteristics of these classes were examined by intracellular injection of Lucifer Yellow. Type I neurons characteristically fired a brief burst of action potentials. Morphologically, type I neurons had large somata and thick dendrites with many spines. Type II neurons were characterized by a repetitive firing pattern with conspicuous frequency adaptation. Type II neurons also had large somata and thick dendrites with many spines. There was no clear morphological distinction between type I and type II neurons. Type III neurons showed high-frequency firing with little accommodation and a prominent time-dependent inward rectification. They had thin, sparsely spiny dendrites and extensive local axonal arborizations. Electrophysiological and morphological properties indicated them as being interneurons. Type IV neurons had a longer action potential duration, a larger input resistance, and a longer membrane time constant than the other classes. Type IV neurons had small somata and short dendrites with few spines. The long axon collaterals of neurons in all spiny cell classes (types I, II, IV) followed similar patterns, suggesting that neurons from all these types can contribute to the projections of the neostriatum caudolaterale to sensory, limbic and motor areas. The electrophysiological and anatomical characterization of the major classes of neurons in the caudal forebrain of the chick provides a framework for the investigation of sensorimotor integration and learning at the cellular level in birds.

Functional aspects of dopamine metabolism in the putative prefrontal cortex analogue and striatum of pigeons (Columba livia)

Dopamine (DA) in mammalian associative structures, such as the prefrontal cortex (PFC), plays a prominent role in learning and memory processes, and its homeostasis differs from that of DA in the striatum, a sensorimotor region. The neostriatum caudolaterale (NCL) of birds resembles the mammalian PFC according to connectional, electrophysiological, and behavioral data. In the present study, DA regulation in the associative NCL and the striatal lobus parolfactorius (LPO) of pigeons was compared to uncover possible differences corresponding to those between mammalian PFC and striatum. Extracellular levels of DA and its metabolites (homovanillic acid [HVA], dihydroxyphenylacetic acid [DOPAC]) and the serotonin metabolite 5-hydroxyindoleacetic acid (5-HIAA) were investigated by in vivo microdialysis of urethane-anesthetized pigeons under basal conditions and after systemic administration of D-amphetamine. DA was reliably determined only in LPO dialysates, and DA metabolite levels were significantly higher in LPO than in NCL. The HVA/DOPAC ratio, indicating extracellular lifetime of DA, was more than twice as high in NCL than in LPO dialysates. After amphetamine, DA increased in LPO while still being undetectable in NCL, and DA metabolites decreased in both regions. 5-HIAA slightly decreased in NCL dialysates. Amphetamine effects were delayed in NCL compared with the striatum. In conclusion, effects of amphetamine on the pigeon's ascending monoamine systems resemble those found in mammals, suggesting similar regulatory properties. The neurochemical differences between NCL and LPO parallel those between associative regions, such as PFC and dorsal striatum in mammals. They may reflect weaker regulation of extracellular DA, favoring DAergic volume transmission, in associative than striatal forebrain regions.