Excitotoxic lesions of the medial striatum delay extinction of a reinforcement color discrimination operant task in domestic chicks; a functional role of reward anticipation

Activation of the Nucleus Taeniae of the Amygdala by Umami Taste in Domestic Chicks (Gallus gallus)

In chickens, the sense of taste plays an important role in detecting nutrients and choosing feed. The molecular mechanisms underlying the taste-sensing system of chickens are well studied, but the neural mechanisms underlying taste reactivity have received less attention. Here we report the short-term taste behaviour of chickens towards umami and bitter (quinine) taste solutions and the associated neural activity in the nucleus taeniae of the amygdala, nucleus accumbens and lateral septum. We found that chickens had more contact with and drank greater volumes of umami than bitter or a water control, and that chicks displayed increased head shaking in response to bitter compared to the other tastes. We found that there was a higher neural activity, measured as c-Fos activation, in response to umami taste in the right hemisphere of the nucleus taeniae of the amygdala. In the left hemisphere, there was a higher c-Fos activation of the nucleus taeniae of the amygdala in response to bitter than in the right hemisphere. Our findings provide clear evidence that chickens respond differently to umami and bitter tastes, that there is a lateralised response to tastes at the neural level, and reveals a new function of the avian nucleus taeniae of the amygdala as a region processing reward information.

Four eyes match better than two: Sharing of precise patch-use time among socially foraging domestic chicks

To examine how resource competition contributes to patch-use behaviour, we examined domestic chicks foraging in an I-shaped maze equipped with two terminal feeders. In a variable interval schedule, one feeder supplied grains three times more frequently than the other, and the sides were reversed midway through the experiment. The maze was partitioned into two lanes by a transparent wall, so that chicks fictitiously competed without actual interference. Stay time at feeders was compared among three groups. The "single" group contained control chicks; the "pair" group comprised the pairs of chicks tested in the fictitious competition; "mirror" included single chicks accompanied by their respective mirror images. Both "pair" and "mirror" chicks showed facilitated running. In terms of the patch-use ratio, "pair" chicks showed precise matching at approximately 3:1 with significant mutual dependence, whereas "single" and "mirror" chicks showed a comparable under-matching. The facilitated running increased visits to feeders, but failed to predict the patch-use ratio of the subject. At the reversal, quick switching occurred similarly in all groups, but the "pair" chicks revealed a stronger memory-based matching. Perceived competition therefore contributes to precise matching and lasting memory of the better feeder, in a manner dissociated from socially facilitated food search.

Striatal and Tegmental Neurons Code Critical Signals for Temporal-Difference Learning of State Value in Domestic Chicks

To ensure survival, animals must update the internal representations of their environment in a trial-and-error fashion. Psychological studies of associative learning and neurophysiological analyses of dopaminergic neurons have suggested that this updating process involves the temporal-difference (TD) method in the basal ganglia network. However, the way in which the component variables of the TD method are implemented at the neuronal level is unclear. To investigate the underlying neural mechanisms, we trained domestic chicks to associate color cues with food rewards. We recorded neuronal activities from the medial striatum or tegmentum in a freely behaving condition and examined how reward omission changed neuronal firing. To compare neuronal activities with the signals assumed in the TD method, we simulated the behavioral task in the form of a finite sequence composed of discrete steps of time. The three signals assumed in the simulated task were the prediction signal, the target signal for updating, and the TD-error signal. In both the medial striatum and tegmentum, the majority of recorded neurons were categorized into three types according to their fitness for three models, though these neurons tended to form a continuum spectrum without distinct differences in the firing rate. Specifically, two types of striatal neurons successfully mimicked the target signal and the prediction signal. A linear summation of these two types of striatum neurons was a good fit for the activity of one type of tegmental neurons mimicking the TD-error signal. The present study thus demonstrates that the striatum and tegmentum can convey the signals critically required for the TD method. Based on the theoretical and neurophysiological studies, together with tract-tracing data, we propose a novel model to explain how the convergence of signals represented in the striatum could lead to the computation of TD error in tegmental dopaminergic neurons.

The metabotropic glutamate receptor, mGlu5, is required for extinction learning that occurs in the absence of a context change

The metabotropic glutamate (mGlu) receptors and, in particular, mGlu5 are crucially involved in multiple forms of synaptic plasticity that are believed to underlie explicit memory. MGlu5 is also required for information transfer through neuronal oscillations and for spatial memory. Furthermore, mGlu5 is involved in extinction of implicit forms of learning. This places this receptor in a unique position with regard to information encoding. Here, we explored the role of this receptor in context-dependent extinction learning under constant, or changed, contextual conditions. Animals were trained over 3 days to take a left turn under 25% reward probability in a T-maze with a distinct floor pattern (Context A). On Day 4, they experienced either a floor pattern change (Context B) or the same floor pattern (Context A) in the absence of reward. After acquisition of the task, the animals were returned to the maze once more on Day 5 (Context A, no reward). Treatment with the mGlu5 antagonist, 2-methyl-6-(phenylethynyl) pyridine, before maze exposure on Day 4 completely inhibited extinction learning in the AAA paradigm but had no effect in the ABA paradigm. A subsequent return to the original context (A, on Day 5) revealed successful extinction in the AAA paradigm, but impairment of extinction in the ABA paradigm. These data support that although extinction learning in a new context is unaffected by mGlu5 antagonism, extinction of the consolidated context is impaired. This suggests that mGlu5 is intrinsically involved in enabling learning that once-relevant information is no longer valid.

Competitor suppresses neuronal representation of food reward in the nucleus accumbens/medial striatum of domestic chicks

To investigate the role of social contexts in controlling the neuronal representation of food reward, we recorded single neuron activity in the medial striatum/nucleus accumbens of domestic chicks and examined whether activities differed between two blocks with different contexts. Chicks were trained in an operant task to associate light-emitting diode color cues with three trial types that differed in the type of food reward: no reward (S-), a small reward/short-delay option (SS), and a large reward/long-delay alternative (LL). Amount and duration of reward were set such that both of SS and LL were chosen roughly equally. Neurons showing distinct cue-period activity in rewarding trials (SS and LL) were identified during an isolation block, and activity patterns were compared with those recorded from the same neuron during a subsequent pseudo-competition block in which another chick was allowed to forage in the same area, but was separated by a transparent window. In some neurons, cue-period activity was lower in the pseudo-competition block, and the difference was not ascribed to the number of repeated trials. Comparison at neuronal population level revealed statistically significant suppression in the pseudo-competition block in both SS and LL trials, suggesting that perceived competition generally suppressed the representation of cue-associated food reward. The delay- and reward-period activities, however, did not significantly different between blocks. These results demonstrate that visual perception of a competitive forager per se weakens the neuronal representation of predicted food reward. Possible functional links to impulse control are discussed.

Neuro-economics in chicks: foraging choices based on amount, delay and cost

Studies on the foraging choices are reviewed, with an emphasis on the neural representations of elementary factors of food (i.e., amount, delay and consumption time) in the avian brain. Domestic chicks serve as an ideal animal model in this respect, as they quickly associate cue colors with subsequently supplied food rewards, and their choices are quantitatively linked with the rewards. When a pair of such color cues was simultaneously presented, the trained chicks reliably made choices according to the profitability of food associated with each color. Two forebrain regions are involved in distinct aspects of choices; i.e., nucleus accumbens-medial striatum (Ac-MSt) and arcopallium intermedium (AI), an association area in the lateral forebrain. Localized lesions of Ac-MSt enhanced delay aversion, and the ablated chicks made impulsive choices of immediate reward more frequently than sham controls. On the other hand, lesions of AI enhanced consumption-time aversion, and the ablated chicks shifted their choices toward easily consumable reward with their impulsiveness unchanged; delay and consumption time are thus doubly dissociated. Furthermore, chicks showed distinct patterns of risk-sensitive choices depending on the factor that varied at trials. Risk aversion occurred when food amount varied, whereas consistent risk sensitivity was not found when the delay varied; amount and delay were not interchangeable. Choices are thus deviated from those predicted as optima. Instead, factors such as amount, delay and consumption time could be separately represented and processed to yield economically sub-optimal choices.

Neural correlates of the proximity and quantity of anticipated food rewards in the ventral striatum of domestic chicks

To identify the neuro-cognitive substrates of valuation and choice, we analysed the neural correlates of anticipated food rewards in the ventral striatum of freely behaving chicks. One-week-old chicks were trained in a color-discrimination task using four color cues (red, yellow, green and blue), each of which was associated with a different food reward. Choosing a red bead was immediately rewarded with a large amount of food, choosing a yellow bead resulted in an immediate-small food reward, and choosing a green bead resulted in a late-large food reward. We selected chicks that consistently chose a large and immediate food reward (red over yellow, and red over green), with the proximity of the food valued higher than the size of the food reward (yellow over green). Of the 47 neurons recorded from the ventral striatum of these chicks, 20 neurons selectively showed cue-period responses to cues associated with food rewards. Five of these 20 neurons responded differentially during the cue period according to the expected delay to reward, and were thus assumed to code for the proximity of the reward. Additionally, three other neurons responded to the quantity of the reward. Furthermore, in the post-operant delay period, many of these 20 neurons showed reward-related activities that were linked to the proximity or presence of the food reward. We therefore propose that impulsive choice and behavioral perseveration observed after lesions of the ventral striatum could be due to impaired anticipation of rewards in the cue and delay periods, respectively.

Differential distribution of L-aspartate- and L-glutamate-immunoreactive structures in the arcopallium and medial striatum of the domestic chick (Gallus domesticus)

The role of amino acid neurotransmitters in learning and memory is well established. We investigated the putative role of L-aspartate as a neurotransmitter in the arcopallial-medial striatal pathway, which is known to be involved in passive avoidance learning in domestic chicks. Double immunocytochemistry against L-aspartate and L-glutamate was performed at both light and electron microscopic levels. L-aspartate- and L-glutamate-immunoreactive neurons in the arcopallium and posterior amygdaloid pallium were identified and counted by using fluorescence microscopy and confocal laser scanning microscopy. Most labeled neurons of arcopallium were enriched in glutamate as well as aspartate. However, the arcopallium and posterior amygdaloid pallium differed from a neighboring telencephalic region (nidopallium; formerly neostriatum) by containing a substantial proportion of cells singly labeled for L-aspartate (15%, vs. 5.3% in the nidopallium). Aspartate-labeled neurons constitute approximately 20%, 25%, 42%, and 28% of total in the posterior amygdaloid pallium and the medial, dorsal, and anterior arcopallia, respectively. Immunoelectron microscopy showed that L-aspartate was enriched in terminals of the medial striatum. The labeled terminals had clear and round vesicles and asymmetric junctions; similar to those immunoreactive to L-glutamate. Axon terminals singly labeled for L-aspartate made up 17% of the total. In addition, 7% of neuronal perikarya and 26% of all dendritic profiles appeared to be labeled specifically with L-aspartate but not L-glutamate. The results indicate that L-aspartate may play a specific role (as distinct from that of L-glutamate) in the intrinsic and extrinsic circuits instrumental in avian learning and memory.

Localized lesions of ventral striatum, but not arcopallium, enhanced impulsiveness in choices based on anticipated spatial proximity of food rewards in domestic chicks

The effects of bilateral chemical lesions of the ventral striatum (nucleus accumbens and the surrounding areas in the medial striatum) and arcopallium (major descending area of the avian telencephalon) were examined in 1-2-weeks old domestic chicks. Using a Y-maze, we analyzed the lesion effects on the choices that subject chicks made in two tasks with identical economical consequences, i.e., a small-and-close food reward vs. a large-and-distant food reward. In task 1, red, yellow, and green beads were associated with a feeder placed at various distances from the chicks; chicks thus anticipated the spatial proximity of food by the bead's color, whereas the quantity of the food was fixed. In task 2, red and yellow flags on the feeders were associated with various amount of food; the chicks thus anticipated the quantity of food by the flag's color, whereas the proximity of the reward could be directly visually determined. In task 1, bilateral lesions of the ventral striatum (but not the arcopallium) enhanced the impulsiveness of the chicks' choices, suggesting that choices based on the anticipated proximity were selectively changed. In task 2, similar lesions of the ventral striatum did not change choices. In both experiments, motor functions of the chicks remained unchanged, suggesting that the lesions did not affect the foraging efficiency, i.e., objective values of food. Neural correlates of anticipated food rewards in the ventral striatum (but not those in the arcopallium) could allow chicks to invest appropriate amount of work-cost in approaching distant food resources.