The relationship between learning performance and dopamine in the prefrontal cortex of the rat

Microglial Pruning of Synapses in the Prefrontal Cortex During Adolescence

Exaggerated synaptic elimination in the prefrontal cortex (PFC) during adolescence has been suggested to contribute to the neuropathological changes of schizophrenia. Recent data indicate that microglia (MG) sculpt synapses during early postnatal development. However, it is not known if MG contribute to the structural maturation of the PFC, which has a protracted postnatal development. We determined if MG are involved in developmentally specific synapse elimination in the PFC, focusing on adolescence. Layer 5 PFC pyramidal cells (PCs) were intracellularly filled with Lucifer Yellow for dendritic spine measurements in postnatal day (P) 24, P30, P35, P39, and P50 rats. In the contralateral PFC we evaluated if MG engulfed presynaptic (glutamatergic) and postsynaptic (dendritic spines) elements. Dendritic spine density increased from P24 to P35, when spine density peaked. There was a significant increase in MG engulfment of spines at P39 relative to earlier ages; this subsided by P50. MG also phagocytosed presynaptic glutamatergic terminals. These data indicate that MG transiently prune synapses of PFC PCs during adolescence, when the symptoms of schizophrenia typically first appear. An increase in MG-mediated synaptic remodeling of PFC PCs may contribute to the structural changes observed in schizophrenia.

Dopaminergic impact on local and global cortical circuit processing during learning

We have learned to detect, predict and behaviorally respond to important changes in our environment on short and longer time scales. Therefore, brains of humans and higher animals build upon a perceptual and semantic salience stored in their memories mainly generated by associative reinforcement learning. Functionally, the brain needs to extract and amplify a small number of features of sensory input with behavioral relevance to a particular situation in order to guide behavior. In this review, I argue that dopamine action, particularly in sensory cortex, orchestrates layer-dependent local and long-range cortical circuits integrating sensory associated bottom-up and semantically relevant top-down information, respectively. Available evidence reveals that dopamine thereby controls both the selection of perceptually or semantically salient signals as well as feedback processing from higher-order areas in the brain. Sensory cortical dopamine thereby governs the integration of selected sensory information within a behavioral context. This review proposes that dopamine enfolds this function by temporally distinct actions on particular layer-dependent local and global cortical circuits underlying the integration of sensory, and non-sensory cognitive and behavioral variables.

Learning a new behavioral strategy in the shuttle-box increases prefrontal dopamine

Using microdialysis from medial prefrontal cortex of gerbils during aversive auditory conditioning in the shuttle-box we have previously shown a transient increase of dopamine efflux correlated with the establishment of avoidance behavior. We hypothesized that the acquisition of a new behavioral strategy is generally accompanied by this extra prefrontal dopamine release. The present experiment aimed at further testing this hypothesis. In a pre-training period in the shuttle-box the gerbils acquired an active avoidance response by generalizing two different tone signals to a GO-meaning (change of shuttle-box compartment). Thereafter, they were subjected in relearning sessions to differentially associate the known tone stimuli with GO- and NOGO- (no change of shuttle-box compartment) conditions, respectively. The following formation of discrimination behavior led to a similar extra dopamine increase as found during establishment of the avoidance strategy. This significant enhancement was limited to rapidly relearning individuals. Furthermore, the dopamine increase attenuated in these animals with increasing performance during the course of the discrimination training, similar to the retrieval stage of the avoidance strategy. Therefore, the dopamine system seems to be critically involved in the initial formation of associations for new behavioral strategies, i.e. learning. We assume that the prefrontal dopamine increase during initial learning of the complex discrimination behavior indicates an involvement of working memory principles and a goal-directed formation of a behavioral strategy.

Dissociation between mesocortical dopamine release and fear-related behaviours in two psychogenetically selected lines of rats that differ in coping strategies to aversive conditions

The mesocortical and mesolimbic dopaminergic (DAergic) pathways are activated by either aversive or rewarding stimuli. The functional tone of these DAergic neurons also increases during the execution of cognitive tasks. The present study was designed to examine the relationship between mesocortical and mesolimbic DAergic function and the expression of fear-related behaviours as compared with attention- and cognition-related mechanisms (e.g. coping strategies), in response to aversive conditions. To this aim, we used two psychogenetically selected rat lines, Roman high-avoidance (RHA/Verh) and Roman low-avoidance (RLA/Verh), which display drastically different emotion- and coping-related behaviours in response to stressors: RLA/Verh rats are 'reactive copers' and more fearful than RHA/Verh rats, which are 'proactive copers'. Brain dialysis experiments demonstrated that tail-pinch (TP) and the anxiogenic compounds pentylenetetrazol (PTZ) and ZK 93426 increased DA output in the medial prefrontal cortex (PFCX) of RHA/Verh but not RLA/Verh, rats. In contrast, in the shell compartment of the nucleus accumbens (NAC shell), TP caused a small increase in DA output only in RLA/Verh rats, whereas PTZ and ZK 93426 had no significant effect on either line. RHA/Verh rats displayed more robust and longer lasting coping activity and less frequent freezing and self-grooming episodes than did RLA/Verh rats after TP, PTZ or ZK 93426. This dissociation between fear-related behaviour and cortical DAergic activation argues against the view that the latter may be involved in the control of fear-like responses. We therefore propose that the activation of mesocortical DAergic projections by aversive stimuli underlies the cognitive mechanisms that are triggered in an attempt to gain control over the stressor.

Immunohistochemical assessment of mesotelencephalic dopamine activity during the acquisition and expression of Pavlovian versus instrumental behaviours

Dopaminergic activity during Pavlovian or instrumental learning in key target regions of the mesotelencephalic dopamine system was investigated immunohistochemically using antibodies raised against glutaraldehyde-conjugated dopamine. Experiment 1 examined dopamine immunoreactivity during acquisition of a Pavlovian conditioned-approach response. Observations were taken at three stages of learning: initial, intermediate and asymptotic; each with a conditioned stimulus+ (CS+) group for whom visual or auditory stimuli immediately preceded an unconditioned stimulus (sucrose), and a conditioned stimulus- (CS-) group for whom stimuli and the unconditioned stimulus were unpaired. Animals learned to approach the alcove during CS+ presentations, whilst approach behaviour of the CS- group remained low. In general, target regions exhibiting a dopaminergic reaction responded maximally during the intermediate stage of acquisition, and were less responsive initially, and not responsive at all at asymptote. Specifically, the pattern of dopaminergic response was: shell more than core of the nucleus accumbens; prefrontal cortex, central and basolateral nuclei of the amygdala also significantly responsive. Mediodorsal and laterodorsal striatal regions were reactive only very early in training. Experiment 2 examined dopaminergic reaction following acquisition of a novel conditioned instrumental response. The conditioned response+ (CR+) group responded at a much higher rate on the lever for which unconditioned stimulus-associated stimuli were presented, than on the control lever. The conditioned response- (CR-) group responded at a low rate on both levers. In contrast with experiment 1, the most responsive regions were the core of the nucleus accumbens, medial prefrontal cortex and basolateral area of the amygdala. Thus, the acquisition, but not expression of Pavlovian associations activated dopamine within several key target regions of the mesotelencephalic dopamine system, and preferentially within the shell rather than core of the nucleus accumbens. By contrast, acquisition of a novel instrumental response preferentially activated the core of the nucleus accumbens, and basolateral area of the amygdala. These data carry significant implications for the potential role of these regions in learning and memory.

Psychomotor and cognitive effects of piribedil, a dopamine agonist, in young healthy volunteers

Piribedil is a dopamine agonist acting on D2 and D3 central nervous system dopamine receptors. This drug has been administered to 12 young healthy male volunteers (age 22 +/- 2 years) according to a single center randomized, double-blind, two ways cross-over, placebo controlled trial, including a washout period of one week. Placebo and piribedil were administered by a single intravenous infusion over 2 h (3 mg). Psychomotor performance and cognitive functions were assessed through a standardized and computerized psychometric tests battery and a continuous electroencephalogram (EEG) mapping. Piribedil improved simple reaction time (P=0.02), immediate (P=0.045 and 0.004), and delayed free recall (P=0.05), dual coding test (P=0.02) and increased theta and fast beta waves on the EEG (P < 0.05 and 0.001, respectively). No deleterious effect was observed on the tests exploring attention and concentration via the other procedures. It is concluded that a single intravenous perfusion of piribedil 3 mg improves alertness and the information processing speed within the central nervous system, in healthy volunteers.

Activation of the dopaminergic system of medial prefrontal cortex of gerbils during formation of relevant associations for the avoidance strategy in the shuttle-box

1. A detailed analysis of behavior is a prerequisite for identification of components of information processing during learning. 2. Components of shuttle-box learning like the signal detection and signal evaluation can be differentiated using behavioral events such as the attention response and the orienting response. 3. Chiefly during evaluation of signal meaning in the acquisition phase of the avoidance strategy the extracellular DA is increased in mPFC. 4. The kinetics of prefrontal dopaminergic activation from trial to trial depends on the stage of avoidance learning. 5. The increase of DA in mPFC can be an indicator for the involvement of working memory principles in signal evaluation stages of conditioning.

Impairment in a discrimination reversal task after D1 receptor blockade in the pigeon "prefrontal cortex"

Dopamine (DA) is known to modulate cognitive functions of the prefrontal cortex (PFC) of mammals, especially via D1 receptor mechanisms. Like the PFC, the neostriatum caudolaterale (NCL) of birds is characterized by dopaminergic input, and NLC and PFC lesions cause similar deficits. The significance of DA in a color discrimination reversal was assessed by evaluating the effects of bilateral infusions of the D1 receptor antagonist SCH 23390 into the NCL of pigeons (Columba livia). Reversal deficits were qualitatively similar to those in mammals. At a low dose, perseveration occurred predominantly to the incorrect stimulus. Higher doses caused additional spatial perseveration. The data demonstrate, for the first time, that D1 receptor mechanisms in the NCL of pigeons contribute substantially to its function in cognitive processes. Thus, the avian NCL and mammalian PFC could represent functionally equivalent neural networks under control of the DA system.

Stages of avoidance strategy formation in gerbils are correlated with dopaminergic transmission activity

This detailed analysis of behavior is aimed at the differentiation of the components of information processing during associative conditioning. In gerbils, the influences of various acquired non-avoidance strategies as pre-experience were studied during the learning of a standard avoidance task in the same shuttle-box. Identical cue stimuli, frequency-modulated tones as conditioned stimuli and electric footshocks as unconditioned stimuli, were used in various behavioral tasks. In addition to common parameters such as avoidance performance and reaction times, behavioral events such as the attention response and the orienting response were quantified. Thereby, components of shuttle-box learning such as signal detection and signal evaluation were found to be affected by pre-experience-dependent dynamics. Using a microdialysis technique during avoidance learning in the shuttle-box, we found that only strategy formation was correlated with high dopamine levels in medial prefrontal cortex. The increase in dopamine in medial prefrontal cortex may be an indicator of the involvement of working memory principles in signal evaluation stages of conditioning.

Spatial learning deficit in dopamine D(1) receptor knockout mice

Dopamine D(1) receptors are expressed in the hippocampus and prefrontal cortex, suggesting a role in cognition. Dopamine D(1) receptor-deficient mice (D(1)-/-) were used to investigate the role of this receptor in spatial learning and memory. Using the Morris water maze, mice were trained to locate a hidden platform. Subsequently, the platform was removed from the maze and mice were scored for the percentage of time spent in the target quadrant and the number of crossings through the target position. D(1)-/- mice had significantly longer escape latencies compared to wild-type (D(1)+/+) and heterozygous (D(1)+/-) littermates and showed absence of spatial bias during the probe trials. In a visually cued task, D(1)-/- mice performed better than on the hidden platform trials, but maintained slightly higher escape latencies than D(1)+/+ and D(1)+/- mice. Naive D(1)-/- mice exposed only to the cued task eventually acquired identical escape latencies as the D(1)+/+ and D(1)+/- mice. Sensorimotor reflexes, locomotor activity, spontaneous alternation and contextual learning were not different among the groups. These results indicate that D(1)-/- mice have a deficit in spatial learning without visual or motor impairment, suggesting that dopamine D(1) receptors are involved in at least one form of the cognitive processes.

Increase of extracellular dopamine in prefrontal cortex of gerbils during acquisition of the avoidance strategy in the shuttle-box

We examined whether extracellular dopamine (DA) increase in medial prefrontal cortex is correlated with the establishment or with the retrieval of an auditory avoidance strategy in a shuttle-box. Using microdialysis from right medial prefrontal cortex (mPFC) in combination with behavioral measures, gerbils were trained on a tone-footshock combination in two sessions on two successive days. Sessions in each animal involving avoidance strategy formation and avoidance strategy retrieval were differentiated post hoc by using the percentage of conditioned responses (CR) and other behavioral measures of training sessions. It was found that exclusively strategy formation correlated with high DA levels in mPFC.

Dopamine and acetylcholine elevation on lever-press acquisition in rat prefrontal cortex

To determine whether the rat medial prefrontal cortex (PFC) is involved in acquiring operant learning, we observed changes in extracellular concentration of dopamine (DA) and acetylcholine (ACh) in the rat medial PFC during lever-press acquisition (acquisition group) or retrieval (retention group) using in vivo microdialysis. We found that DA or ACh elevation related to acquisition occurred. DA elevation was observed in the acquisition group only. These results indicate that the medical PFC is related to acquisition, and suggest that interaction between DA and ACh may be involved in learning acquisition.

Evidence for striatal dopamine release during a video game

Dopaminergic neurotransmission may be involved in learning, reinforcement of behaviour, attention, and sensorimotor integration. Binding of the radioligand 11C-labelled raclopride to dopamine D2 receptors is sensitive to levels of endogenous dopamine, which can be released by pharmacological challenge. Here we use 11C-labelled raclopride and positron emission tomography scans to provide evidence that endogenous dopamine is released in the human striatum during a goal-directed motor task, namely a video game. Binding of raclopride to dopamine receptors in the striatum was significantly reduced during the video game compared with baseline levels of binding, consistent with increased release and binding of dopamine to its receptors. The reduction in binding of raclopride in the striatum positively correlated with the performance level during the task and was greatest in the ventral striatum. These results show, to our knowledge for the first time, behavioural conditions under which dopamine is released in humans, and illustrate the ability of positron emission tomography to detect neurotransmitter fluxes in vivo during manipulations of behaviour.

Dopamine and the mechanisms of cognition: Part I. A neural network model predicting dopamine effects on selective attention

BACKGROUND

Dopamine affects neural information processing, cognition, and behavior; however, the mechanisms through which these three levels of function are affected have remained unspecified. We present a parallel-distributed processing model of dopamine effects on neural ensembles that accounts for effects on human performance in a selective attention task.

METHODS

Task performance is stimulated using principles and mechanisms that capture salient aspects of information processing in neural ensembles. Dopamine effects are simulated as a change in gain of neural assemblies in the area of release.

RESULTS

The model leads to different predictions as a function of the hypothesized location of dopamine effects. Motor system effects are simulated as a change in gain over the response layer of the model. This induces speeding of reaction times but an impairment of accuracy. Cognitive attentional effects are simulated as a change in gain over the attention layer. This induces a speeding of reaction times and an improvement of accuracy, especially at very fast reaction times and when processing of the stimulus requires selective attention.

CONCLUSIONS

A computer simulation using widely accepted principles of processing in neural ensembles can account for reaction time distributions and time-accuracy curves in a selective attention task. The simulation can be used to generate predictions about the effects of dopamine agonists on performance. An empirical study evaluating these predictions is described in a companion paper.

Dopamine and the mechanisms of cognition: Part II. D-amphetamine effects in human subjects performing a selective attention task

BACKGROUND

A neural network computer model described in a companion paper predicted the effects of increased dopamine transmission on selective attention under two different hypotheses.

METHODS

To evaluate these predictions we conducted an empirical study in human subjects of D-amphetamine effects on performance of the Eriksen response competition task. Ten healthy volunteers were tested before and after placebo or D-amphetamine in a double-blind cross-over design.

RESULTS

D-amphetamine induced a speeding of reaction time overall and an improvement of accuracy at fast reaction times but only in the task condition requiring selective attention.

CONCLUSIONS

This pattern of results conforms to the prediction of the model under the hypothesis that D-amphetamine primarily affects dopamine transmission in cognitive rather than motor networks. This suggests that the principles embodied in parallel distributed processing models of task performance may be sufficient to predict and explain specific behavioral effects of some drug actions in the central nervous system.