Neuronal coding of prediction errors

Regulation of firing of dopaminergic neurons and control of goal-directed behaviors

There are several brain regions that have been implicated in the control of motivated behavior and whose disruption leads to the pathophysiology observed in major psychiatric disorders. These systems include the ventral hippocampus, which is involved in context and focus on tasks, the amygdala, which mediates emotional behavior, and the prefrontal cortex, which modulates activity throughout the limbic system to enable behavioral flexibility. Each of these systems has overlapping projections to the nucleus accumbens, where these inputs are integrated under the modulatory influence of dopamine. Here, we provide a systems-oriented approach to interpreting the function of the dopamine system, its modulation of limbic-cortical interactions and how disruptions within this system might underlie the pathophysiology of schizophrenia and drug abuse.

Calculating utility: preclinical evidence for cost-benefit analysis by mesolimbic dopamine

RATIONALE

Throughout our lives we constantly assess the costs and benefits of the possible future outcomes of our actions and use this information to guide behavior. There is accumulating evidence that dopamine contributes to a fundamental component of this computation-how rewards are compared with the costs incurred when obtaining them.

OBJECTIVE

We review the evidence for dopamine's role in cost-benefit decision making and outline a simple mathematical framework in which to represent the interactions between rewards, costs, behavioral state and dopamine.

CONCLUSIONS

Dopamine's effects on cost-benefit decision making can be modeled using simple utility-function curves. This approach provides a useful framework for modeling existing data and generating experimental hypotheses that can be objectively and quantitatively tested by observing choice behavior without the necessity to account for subjective psychological states such as pleasure or desire. We suggest that dopamine plays a key role in overcoming response costs and enabling high-effort behaviors. A particularly important anatomical site of this action is the core of the nucleus accumbens. Here, dopamine is able to modulate activity originating from the frontal cortical systems that also assess costs and rewards. Internal deprivation states (e.g., hunger and thirst) also help to energize goal-seeking behaviors, probably in part by their rich influence on dopamine, which can in turn modify decision making policies.

Experience-dependent effects of cocaine self-administration/conditioning on prefrontal and accumbens dopamine responses

Experiments were performed to examine the effects of cocaine self-administration and conditioning experience on operant behavior, locomotor activity, and nucleus accumbens (NAcc) and prefrontal cortex (PFC) dopamine (DA) responses. Sensory cues were paired with alternating cocaine and nonreinforcement during 12 (limited training) or 40 (long-term training) daily operant sessions. After limited training, NAcc DA responses to cocaine were significantly enhanced in the presence of cocaine-associated cues compared with nonreward cues and significantly depressed after cocaine-paired cues accompanied a nonreinforced lever response. PFC DA levels were generally nonresponsive to cues after the same training duration. However, after long-term training, cocaine-associated cues increased the magnitude of cocaine-stimulated PFC DA levels significantly over levels observed with nonreinforcement cues. Conversely, conditioned cues no longer influenced NAcc DA levels after long-term training. In addition, cocaine-stimulated locomotor activity was enhanced by cocaine-paired cues after long-term, but not after limited, training. Findings demonstrate that cue-induced cocaine expectation exerts a significant impact on dopaminergic and behavioral systems, progressing from mesolimbic to mesocortical regions and from latent to patent behaviors as cocaine and associative experiences escalate.

Target selection signals for arm reaching in the posterior parietal cortex

The selection of visual stimuli as a target for a motor action may depend on external as well as internal variables. The parietal reach region (PRR) in the posterior parietal cortex plays an important role in the transformation of visual information into reach movement plans. We asked how neurons in PRR of macaque monkeys reflect the decision process of selecting one of two visual stimuli as a target for a reach movement. Spiking activity was recorded while the animal performed a free-choice task with one target presented in the preferred direction and the other in the off direction of the cell. Stimulus-onset asynchrony (SOA) was adjusted to ensure that both targets were selected equally often and the amount of reward was fixed. Neural activity in PRR was action specific for arm reaching and reflected the timing of the SOA as well as the selection of reach targets. In individual trials, activity was strongly linked to the choice of the animal, and, for the majority of cells, target selections could be predicted from activity in the stimulation or planning period, i.e., before the movement started. Many neurons were gain modulated by the fixation position, but gain modulation did not influence the target selection process directly. Finally, it was found that target selection for saccade movements was only weakly represented in PRR. These findings suggest that PRR is involved in decision making for reach movements and that separate cortical networks exist for target selection of different types of action.

Efficient reinforcement learning: computational theories, neuroscience and robotics

Reinforcement learning algorithms have provided some of the most influential computational theories for behavioral learning that depends on reward and penalty. After briefly reviewing supporting experimental data, this paper tackles three difficult theoretical issues that remain to be explored. First, plain reinforcement learning is much too slow to be considered a plausible brain model. Second, although the temporal-difference error has an important role both in theory and in experiments, how to compute it remains an enigma. Third, function of all brain areas, including the cerebral cortex, cerebellum, brainstem and basal ganglia, seems to necessitate a new computational framework. Computational studies that emphasize meta-parameters, hierarchy, modularity and supervised learning to resolve these issues are reviewed here, together with the related experimental data.

Blocking of conditioning to a cocaine-paired stimulus: testing the hypothesis that cocaine perpetually produces a signal of larger-than-expected reward

According to a recent account of addiction, dopaminergic effects of drugs like cocaine mimic the neuronal signal that occurs when a natural reward has a larger value than expected. Consequently, the drug's expected reward value increases with each administration, leading to an over-selection of drug-seeking behavior. One prediction of this hypothesis is that the blocking effect, a cornerstone of contemporary learning theory, should not occur with drug reinforcers. To test this prediction, two groups of rats were trained to self-administer cocaine with a nose-poking response. For 5 sessions, a tone was paired with each self-administered injection (blocking group), or no stimulus was paired with injection (non-blocking group). Then, in both groups, the tone and a light were both paired with each injection for 5 sessions. In subsequent testing, the light functioned as a conditioned reinforcer for a new response (lever-pressing) in the non-blocking group, but not the blocking group. Thus, contrary to prediction, pre-training with the tone blocked conditioning to the light. Although these results fail to support a potentially powerful explanation of addiction, they are consistent with the fact that most conditioning and learning phenomena that occur with non-drug reinforcers can also be demonstrated with drug reinforcers.

The psychological science of addiction

AIM

To discuss the contributions and future course of the psychological science of addiction.

BACKGROUND

The psychology of addiction includes a tremendous range of scientific activity, from the basic experimental laboratory through increasingly broad relational contexts, including patient-practitioner interactions, families, social networks, institutional settings, economics and culture. Some of the contributions discussed here include applications of behavioral principles, cognitive and behavioral neuroscience and the development and evaluation of addiction treatment. Psychology has at times been guilty of proliferating theories with relatively little pruning, and of overemphasizing intrapersonal explanations for human behavior. However, at its best, defined as the science of the individual in context, psychology is an integrated discipline using diverse methods well-suited to capture the multi-dimensional nature of addictive behavior.

CONCLUSIONS

Psychology has a unique ability to integrate basic experimental and applied clinical science and to apply the knowledge gained from multiple levels of analysis to the pragmatic goal of reducing the prevalence of addiction.

Event perception: a mind-brain perspective

People perceive and conceive of activity in terms of discrete events. Here the authors propose a theory according to which the perception of boundaries between events arises from ongoing perceptual processing and regulates attention and memory. Perceptual systems continuously make predictions about what will happen next. When transient errors in predictions arise, an event boundary is perceived. According to the theory, the perception of events depends on both sensory cues and knowledge structures that represent previously learned information about event parts and inferences about actors' goals and plans. Neurological and neurophysiological data suggest that representations of events may be implemented by structures in the lateral prefrontal cortex and that perceptual prediction error is calculated and evaluated by a processing pathway, including the anterior cingulate cortex and subcortical neuromodulatory systems.

Memory influences on hippocampal and striatal neural codes: effects of a shift between task rules

Interactions with neocortical memory systems may facilitate flexible information processing by hippocampus. We sought direct evidence for such memory influences by recording hippocampal neural responses to a change in cognitive strategy. Well-trained rats switched (within a single recording session) between the use of place and response strategies to solve a plus maze task. Maze and extramaze environments were constant throughout testing. Place fields demonstrated (in-field) firing rate and location-based reorganization [Leutgeb, S., Leutgeb, J. K., Barnes, C. A., Moser, E. I., McNaughton, B. L., & Moser, M. B. (2005). Independent codes for spatial and episodic memory in hippocampal neuronal ensembles. Science, 309, 619-623] after a task switch, suggesting that hippocampus encoded each phase of testing as a different context, or episode. The task switch also resulted in qualitative and quantitative changes to discharge that were correlated with an animal's velocity or acceleration of movement. Thus, the effects of a strategy switch extended beyond the spatial domain, and the movement correlates were not passive reflections of the current behavioral state. To determine whether hippocampal neural responses were unique, striatal place and movement-correlated neurons were simultaneously recorded with hippocampal neurons. Striatal place and movement cells exhibited a response profile that was similar, but not identical, to that observed for hippocampus after a strategy switch. Thus, retrieval of a different memory led both neural systems to represent a different context. However, hippocampus may play a special (though not exclusive) role in flexible spatial processing since correlated firing amongst cell pairs was highest when rats successfully switched between two spatial tasks. Correlated firing by striatal cell pairs increased following any strategy switch, supporting the view that striatum codes change in reinforcement contingencies.

A conductor hidden in the orchestra? Role of the habenular complex in monoamine transmission and cognition

Influences of the habenular complex on electrophysiological and neurochemical aspects of brain functioning are well known. However, its role in cognition has been sparsely investigated until recently. The habenular complex, composed of medial and lateral subdivisions, is a node linking the forebrain with midbrain and hindbrain structures. The lateral habenula is the principal actor in this direct dialogue, while the medial habenula mostly conveys information to the interpeduncular nucleus before this modulates further regions. Here we describe neuroanatomical and physiological aspects of the habenular complex, and its role in cognitive processes, including new behavioral, electrophysiological and imaging findings. Habenular complex lesions result in deficits in learning, memory and attention, some of which decline during repeated testing, while others become worse, consistent with multiple roles in cognition. The habenular complex is particularly responsive to feedback about errors. Electrophysiological studies indicate a role in metaplasticity, the modulation of neuroplasticity. These studies thus reveal important roles of the habenular complex in learning, memory and attention.

Noradrenergic projections to the song control nucleus area X of the medial striatum in male zebra finches (Taeniopygia guttata)

There is considerable functional evidence implicating norepinephrine in modulating activity in the vocal control circuit of songbirds. However, our knowledge of noradrenergic inputs to the song system is incomplete. In this study, cholera toxin subunit B (CTB) injections into area X revealed projections from the noradrenergic nuclei locus coeruleus and subcoeruleus, and injections of biotinylated dextran amines into these noradrenergic nuclei labeled fibers in area X. The nonreciprocity of this connection was demonstrated by the absence of retrogradely labeled cells in area X following injections of CTB into the locus coeruleus. Additionally, we found novel inputs to area X from the nidopallium and arcopallium, the mesencephalic central gray, and the dorsolateralis anterior (DLL) and posterior (DLP) lateralis in the thalamus. Area X can be clearly distinguished from the surrounding medial striatum based on cytoarchitectural and chemical neuroanatomical criteria. We show here that neuromodulatory inputs to area X however, exhibit a considerable degree of overlap with the surrounding area. This finding suggests that regional specificity in neuromodulator action is most likely afforded by a specialization in receptor density and enzyme distribution rather than projections from the synthesizing nuclei. Our results extend current knowledge about noradrenergic projections to specialized nuclei of the song control circuit and provide neuroanatomical evidence for the functional action of norepinephrine-modulating context-dependent ZENK expression in area X. Furthermore, the novel projections to area X from telencephalic and thalamic areas could be new and interesting nodes in the striatopallidothalamic loop spanning the songbird brain.

Mother-infant bonding and the evolution of mammalian social relationships

A wide variety of maternal, social and sexual bonding strategies have been described across mammalian species, including humans. Many of the neural and hormonal mechanisms that underpin the formation and maintenance of these bonds demonstrate a considerable degree of evolutionary conservation across a representative range of these species. However, there is also a considerable degree of diversity in both the way these mechanisms are activated and in the behavioural responses that result. In the majority of small-brained mammals (including rodents), the formation of a maternal or partner preference bond requires individual recognition by olfactory cues, activation of neural mechanisms concerned with social reward by these cues and gender-specific hormonal priming for behavioural output. With the evolutionary increase of neocortex seen in monkeys and apes, there has been a corresponding increase in the complexity of social relationships and bonding strategies together with a significant redundancy in hormonal priming for motivated behaviour. Olfactory recognition and olfactory inputs to areas of the brain concerned with social reward are downregulated and recognition is based on integration of multimodal sensory cues requiring an expanded neocortex, particularly the association cortex. This emancipation from olfactory and hormonal determinants of bonding has been succeeded by the increased importance of social learning that is necessitated by living in a complex social world and, especially in humans, a world that is dominated by cultural inheritance.

The short-latency dopamine signal: a role in discovering novel actions?

An influential concept in contemporary computational neuroscience is the reward prediction error hypothesis of phasic dopaminergic function. It maintains that midbrain dopaminergic neurons signal the occurrence of unpredicted reward, which is used in appetitive learning to reinforce existing actions that most often lead to reward. However, the availability of limited afferent sensory processing and the precise timing of dopaminergic signals suggest that they might instead have a central role in identifying which aspects of context and behavioural output are crucial in causing unpredicted events.

Leptin receptor signaling in midbrain dopamine neurons regulates feeding

The leptin hormone is critical for normal food intake and metabolism. While leptin receptor (Lepr) function has been well studied in the hypothalamus, the functional relevance of Lepr expression in the ventral tegmental area (VTA) has not been investigated. The VTA contains dopamine neurons that are important in modulating motivated behavior, addiction, and reward. Here, we show that VTA dopamine neurons express Lepr mRNA and respond to leptin with activation of an intracellular JAK-STAT pathway and a reduction in firing rate. Direct administration of leptin to the VTA caused decreased food intake while long-term RNAi-mediated knockdown of Lepr in the VTA led to increased food intake, locomotor activity, and sensitivity to highly palatable food. These data support a critical role for VTA Lepr in regulating feeding behavior and provide functional evidence for direct action of a peripheral metabolic signal on VTA dopamine neurons.

Dopaminergic modulation of the persistence of one-trial hippocampus-dependent memory

The persistence of new memory traces in the hippocampus, encoded following appropriate activation of glutamatergic receptors and the induction of synaptic plasticity, can be influenced by heterosynaptic activation of neuromodulatory brain systems. We therefore investigated the effects of a hippocampus-specific blockade of dopamine D1/D5 receptors on the persistence of spatial memory encoded in one trial using a delayed matching-to-place (DMP) task in a watermaze in which rats learn a new escape location each day. A within-subjects design was used such that both short (20 min) and long (6 h) retention intervals, and both drug (SCH23390, a D1/D5 receptor antagonist) and vehicle (aCSF) infusions were tested on different days in the same animals. Bilateral intrahippocampal infusion of SCH23390 (5 microg in 1 microL per side) prior to trial 1 (encoding) caused a differential impairment as a function of memory delay-with no effect during trial 2 (memory retrieval) after a 20-min interval, but a block of memory at 6 h. Further experiments revealed that infusion of SCH23390 immediately after trial 1 had no effect on retention 6 h later, and the poor memory seen at long retention intervals when the drug was present at encoding was not due to a state-dependent failure of retrieval. These results suggest that activation of D1/D5 receptors during memory encoding is necessary for the formation of a persistent memory trace in the hippocampus. The complementary effects of D1/D5 receptor blockade on the persistence of LTP and the duration of memory are consistent with the idea that changes in synaptic strength underlie memory.

Dissociable systems for gain- and loss-related value predictions and errors of prediction in the human brain

Midbrain dopaminergic neurons projecting to the ventral striatum code for reward magnitude and probability during reward anticipation and then indicate the difference between actual and predicted outcome. It has been questioned whether such a common system for the prediction and evaluation of reward exists in humans. Using functional magnetic resonance imaging and a guessing task in two large cohorts, we are able to confirm ventral striatal responses coding both reward probability and magnitude during anticipation, permitting the local computation of expected value (EV). However, the ventral striatum only represented the gain-related part of EV (EV+). At reward delivery, the same area shows a reward probability and magnitude-dependent prediction error signal, best modeled as the difference between actual outcome and EV+. In contrast, loss-related expected value (EV-) and the associated prediction error was represented in the amygdala. Thus, the ventral striatum and the amygdala distinctively process the value of a prediction and subsequently compute a prediction error for gains and losses, respectively. Therefore, a homeostatic balance of both systems might be important for generating adequate expectations under uncertainty. Prevalence of either part might render expectations more positive or negative, which could contribute to the pathophysiology of mood disorders like major depression.

Dopamine and reward: comment on Hernandez et al. (2006)

Many lines of evidence suggest that the dopaminergic projection from the midbrain tegmentum to the forebrain must play a critical role in mediating the behavioral effects of natural and artificial rewards, with brain stimulation reward and addictive drugs included in the latter category. However, a closer look reveals many incongruities. The work of G. Hernandez et al. (2006) resolves several puzzles. It implies that the dopaminergic projection does not carry the signal that encodes the magnitude of a brain stimulation reward. It suggests that the elevation in the tonic levels of dopamine consequent on brain stimulation reward modulates the registration of the magnitude of the reward. This reconciles the psychophysical evidence with the pharmacological, electrophysiological, and anatomical evidence. However, some serious puzzles do remain.

Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning

The brain's most difficult computation in decision-making learning is searching for essential information related to rewards among vast multimodal inputs and then integrating it into beneficial behaviors. Contextual cues consisting of limbic, cognitive, visual, auditory, somatosensory, and motor signals need to be associated with both rewards and actions by utilizing an internal representation such as reward prediction and reward prediction error. Previous studies have suggested that a suitable brain structure for such integration is the neural circuitry associated with multiple cortico-striatal loops. However, computational exploration still remains into how the information in and around these multiple closed loops can be shared and transferred. Here, we propose a "heterarchical reinforcement learning" model, where reward prediction made by more limbic and cognitive loops is propagated to motor loops by spiral projections between the striatum and substantia nigra, assisted by cortical projections to the pedunculopontine tegmental nucleus, which sends excitatory input to the substantia nigra. The model makes several fMRI-testable predictions of brain activity during stimulus-action-reward association learning. The caudate nucleus and the cognitive cortical areas are correlated with reward prediction error, while the putamen and motor-related areas are correlated with stimulus-action-dependent reward prediction. Furthermore, a heterogeneous activity pattern within the striatum is predicted depending on learning difficulty, i.e., the anterior medial caudate nucleus will be correlated more with reward prediction error when learning becomes difficult, while the posterior putamen will be correlated more with stimulus-action-dependent reward prediction in easy learning. Our fMRI results revealed that different cortico-striatal loops are operating, as suggested by the proposed model.

Retrograde endocannabinoid signaling in the cerebellar cortex

The regulation of Purkinje cell activity is important for motor behavior and motor learning. As the sole output cell of the cerebellar cortex, Purkinje cell firing is controlled by parallel fibers and climbing fiber synapses, and by inhibitory interneurons. Depolarization of Purkinje cells evokes endocannabinoid release that activates cannabinoid CB1 receptors expressed on boutons of its synaptic inputs to transiently decrease neurotransmitter release. In addition, associative activation of the excitatory inputs can liberate endocannabinoids to decrease synaptic strength for a prolonged duration. Here we review the different mechanisms of evoking endocannabinoid release and discuss the physiological role of endocannabinoids in mediating global modulation of synaptic strength, localized short-term associative plasticity and cerebellar long term depression.

Imaging valuation models in human choice

To make a decision, a system must assign value to each of its available choices. In the human brain, one approach to studying valuation has used rewarding stimuli to map out brain responses by varying the dimension or importance of the rewards. However, theoretical models have taught us that value computations are complex, and so reward probes alone can give only partial information about neural responses related to valuation. In recent years, computationally principled models of value learning have been used in conjunction with noninvasive neuroimaging to tease out neural valuation responses related to reward-learning and decision-making. We restrict our review to the role of these models in a new generation of experiments that seeks to build on a now-large body of diverse reward-related brain responses. We show that the models and the measurements based on them point the way forward in two important directions: the valuation of time and the valuation of fictive experience.

Substantia nigra pars compacta is critical to both the acquisition and expression of learned orienting of rats

Novel events produce characteristic orienting responses (ORs), which typically habituate rapidly with repeated stimulus presentation. However, they may re-emerge if those stimuli become predictors of biologically significant events. This acquisition of conditioned ORs may reflect a broader range of enhancements in top-down attentional processing of cues that predict important consequences. Previous research from this laboratory showed that a neural circuit that includes the amygdala central nucleus (CeA), substantia nigra pars compacta (SNc) and dorsolateral striatum (DLS) is essential for the learning and expression of one example of conditioned orienting, the rearing of rats to visual stimuli paired with food. Other studies showed that the CeA is critical to the acquisition of these conditioned ORs, but not their expression, and that normal DLS function is required for the expression of previously acquired conditioned ORs, but not for learning itself. The experiments reported here considered the roles of the SNc in conditioned orienting by examining the effects of transient inactivation of the SNc during the acquisition of new associations and during the expression of previous learning. SNc function was critical to both the acquisition and expression of conditioned ORs but not to the display of unconditioned ORs or the learning and expression of conditioned responses directed to the food source. Together with our previous findings, these results suggest that the SNc is trained by the CeA during learning and maintains acquired information so that it may modulate DLS sensory-motor function at the time of action.

Multimodal sensory integration in insects--towards insect brain control architectures

Although a variety of basic insect behaviours have inspired successful robot implementations, more complex capabilities in these 'simple' animals are often overlooked. By reviewing the general architecture of their nervous systems, we gain insight into how they are able to integrate behaviours, perform pattern recognition, context-dependent learning, and combine many sensory inputs in tasks such as navigation. We review in particular what is known about two specific 'higher' areas in the insect brain, the mushroom bodies and the central complex, and how they are involved in controlling an insect's behaviour. While much of the functional interpretation of this information is still speculative, it nevertheless suggests some promising new approaches to obtaining adaptive behaviour in robots.

Neural systems implicated in delayed and probabilistic reinforcement

This review considers the theoretical problems facing agents that must learn and choose on the basis of reward or reinforcement that is uncertain or delayed, in implicit or procedural (stimulus-response) representational systems and in explicit or declarative (action-outcome-value) representational systems. Individual differences in sensitivity to delays and uncertainty may contribute to impulsivity and risk taking. Learning and choice with delayed and uncertain reinforcement are related but in some cases dissociable processes. The contributions to delay and uncertainty discounting of neuromodulators including serotonin, dopamine, and noradrenaline, and of specific neural structures including the nucleus accumbens core, nucleus accumbens shell, orbitofrontal cortex, basolateral amygdala, anterior cingulate cortex, medial prefrontal (prelimbic/infralimbic) cortex, insula, subthalamic nucleus, and hippocampus are examined.

More attention must be paid: The neurobiology of attentional effort

Increases in attentional effort are defined as the motivated activation of attentional systems in response to detrimental challenges on attentional performance, such as the presentation of distractors, prolonged time-on-task, changing target stimulus characteristics and stimulus presentation parameters, circadian phase shifts, stress or sickness. Increases in attentional effort are motivated by the expected performance outcome; in the absence of such motivation, attentional performance continues to decline or may cease altogether. The beneficial effects of increased attentional effort are due in part to the activation of top-down mechanisms that act to optimize input detection and processing, thereby stabilizing or recovering attentional performance in response to challenges. Following a description of the psychological construct "attentional effort", evidence is reviewed indicating that increases in the activity of cortical cholinergic inputs represent a major component of the neuronal circuitry mediating increases in attentional effort. A neuronal model describes how error detection and reward loss, indicating declining performance, are integrated with motivational mechanisms on the basis of neuronal circuits between prefrontal/anterior cingulate and mesolimbic regions. The cortical cholinergic input system is activated by projections of mesolimbic structures to the basal forebrain cholinergic system. In prefrontal regions, increases in cholinergic activity are hypothesized to contribute to the activation of the anterior attention system and associated executive functions, particularly the top-down optimization of input processing in sensory regions. Moreover, and influenced in part by prefrontal projections to the basal forebrain, increases in cholinergic activity in sensory and other posterior cortical regions contribute directly to the modification of receptive field properties or the suppression of contextual information and, therefore, to the mediation of top-down effects. The definition of attentional effort as a cognitive incentive, and the description of a neuronal circuitry model that integrates brain systems involved in performance monitoring, the processing of incentives, activation of attention systems and modulation of input functions, suggest that 'attentional effort' represents a viable construct for cognitive neuroscience research.

Adaptation in the Auditory Space Map of the Barn Owl

Auditory neurons in the owl’s external nucleus of the inferior colliculus (ICX) integrate information across frequency channels to create a map of auditory space. This study describes a powerful, sound-driven adaptation of unit responsiveness in the ICX and explores the implications of this adaptation for sensory processing. Adaptation in the ICX was analyzed by presenting lightly anesthetized owls with sequential pairs of dichotic noise bursts. Adaptation occurred in response even to weak, threshold-level sounds and remained strong for more than 100 ms after stimulus offset. Stimulation by one range of sound frequencies caused adaptation that generalized across the entire broad range of frequencies to which these units responded. Identical stimuli were used to test adaptation in the lateral shell of the central nucleus of the inferior colliculus (ICCls), which provides input directly to the ICX. Compared with ICX adaptation, adaptation in the ICCls was substantially weaker, shorter lasting, and far more frequency specific, suggesting that part of the adaptation observed in the ICX was attributable to processes resident to the ICX. The sharp tuning of ICX neurons to space, along with their broad tuning to frequency, allows ICX adaptation to preserve a representation of stimulus location, regardless of the frequency content of the sound. The ICX is known to be a site of visually guided auditory map plasticity. ICX adaptation could play a role in this cross-modal plasticity by providing a short-term memory of the representation of auditory localization cues that could be compared with later-arriving, visual–spatial information from bimodal stimuli.

A clustered plasticity model of long-term memory engrams

Long-term memory and its putative synaptic correlates the late phases of both long-term potentiation and long-term depression require enhanced protein synthesis. On the basis of recent data on translation-dependent synaptic plasticity and on the supralinear effect of activation of nearby synapses on action potential generation, we propose a model for the formation of long-term memory engrams at the single neuron level. In this model, which we call clustered plasticity, local translational enhancement, along with synaptic tagging and capture, facilitates the formation of long-term memory engrams through bidirectional synaptic weight changes among synapses within a dendritic branch.

Role of substantia nigra-amygdala connections in surprise-induced enhancement of attention

Coding of prediction error by midbrain dopamine neurons has been examined extensively in the framework of associative learning theory. Most of this research has focused on the role of prediction error in determining the reinforcement value of unconditioned stimuli: poorly predicted ("surprising") outcomes are more effective reinforcers and produce a greater dopamine response than well predicted outcomes. However, surprise also enhances attention to cues that signal poorly predicted outcomes. Previous reports from our laboratories demonstrated that circuitry, including the amygdala central nucleus (CeA), the cholinergic neurons of the substantia innominata/nucleus basalis region, and their innervation of the posterior parietal cortex, is critical to these surprise-induced enhancements of attention in associative learning. The present study considered the origin of prediction error information important for the operation of this system by examining the effects of disrupting communication between the midbrain substantia nigra pars compacta (SNc) and the CeA. Rats received unilateral lesions of the SNc and lesions of the CeA in either the contralateral or ipsilateral hemisphere. Contralateral lesions eliminated the surprise-induced enhancement of attention and learning that was displayed by rats with ipsilateral control lesions. These results show that SNc-CeA communication is critical to mechanisms by which the coding of prediction error by midbrain dopamine neurons is translated into enhancement of attention and learning modulated by the cholinergic system.

Envisioning the reward

The primary visual cortex (area V1) is for vision. At least, that is what most researchers believe. However, in a recent issue of Science, Shuler and Bear demonstrate a correlate of reward timing in area V1. This surprising result indicates that brain circuits for reward processing are more extensive than expected and that area V1 has more functionality than previously thought.

Extending the effects of spike-timing-dependent plasticity to behavioral timescales

Activity-dependent modification of synaptic strengths due to spike-timing-dependent plasticity (STDP) is sensitive to correlations between pre- and postsynaptic firing over timescales of tens of milliseconds. Temporal associations typically encountered in behavioral tasks involve times on the order of seconds. To relate the learning of such temporal associations to STDP, we must account for this large discrepancy in timescales. We show that the gap between synaptic and behavioral timescales can be bridged if the stimuli being associated generate sustained responses that vary appropriately in time. Synapses between neurons that fire this way can be modified by STDP in a manner that depends on the temporal ordering of events separated by several seconds even though the underlying plasticity has a much smaller temporal window.

Place learning in the Morris water task: making the memory stick

Although the Morris water task has been used in hundreds of studies of place learning, there have been no systematic studies of retention of the place memory. We report that retention, as measured by selective search behavior on a probe trial, is excellent when the retention interval is short (5-10 min). However, performance rapidly deteriorates, so that by approximately 4 h the search is no longer selective. Additional experiments revealed that selective search at longer retention intervals was improved by inserting gaps between blocks of training trials, but this effect was a non-monotonic function of the interval separating trial blocks. Our experiments also revealed that the location of the first block of trials (Room A or Room B) was irrelevant to long-term retention. A memory modulation theoretical framework may provide a useful way to understand these findings.

Single-trial learning of novel stimuli by individual neurons of the human hippocampus-amygdala complex

The ability to distinguish novel from familiar stimuli allows nervous systems to rapidly encode significant events following even a single exposure to a stimulus. This detection of novelty is necessary for many types of learning. Neurons in the medial temporal lobe (MTL) are critically involved in the acquisition of long-term declarative memories. During a learning task, we recorded from individual MTL neurons in vivo using microwire electrodes implanted in human epilepsy surgery patients. We report here the discovery of two classes of neurons in the hippocampus and amygdala that exhibit single-trial learning: novelty and familiarity detectors, which show a selective increase in firing for new and old stimuli, respectively. The neurons retain memory for the stimulus for 24 hr. Thus, neurons in the MTL contain information sufficient for reliable novelty-familiarity discrimination and also show rapid plasticity as a result of single-trial learning.

Predicting danger: the nature, consequences, and neural mechanisms of predictive fear learning

The ability to detect and learn about the predictive relations existing between events in the world is essential for adaptive behavior. It allows us to use past events to predict the future and to adjust our behavior accordingly. Pavlovian fear conditioning allows anticipation of sources of danger in the environment. It guides attention away from poorer predictors toward better predictors of danger and elicits defensive behavior appropriate to these threats. This article reviews the differences between learning about predictive relations and learning about contiguous relations in Pavlovian fear conditioning. It then describes behavioral approaches to the study of these differences and to the examination of subtle variations in the nature and consequences of predictive learning. Finally, it reviews recent data from rodent and human studies that have begun to identify the neural mechanisms for direct and indirect predictive fear learning.

Different roles for amygdala central nucleus and substantia innominata in the surprise-induced enhancement of learning

Within most modern learning theories, the discrepancy between expected and obtained outcomes ("prediction error" or "surprise") is a critical determinant of the acquisition of learned associations. The results of studies from many laboratories show that the surprising omission of an expected event may enhance attention to stimuli that remain present, such that subsequent learning about those stimuli is enhanced. A series of reports from our laboratories demonstrated that these surprise-induced enhancements of stimulus associability depend on circuitry that includes the amygdala central nucleus (CeA), the cholinergic neurons in the sublenticular substantia innominata/nucleus basalis magnocellularis (SI/nBM), as well as certain cortical projections of these latter neurons. In this study, we found very different roles for CeA and SI/nBM in surprise-induced enhancements of stimulus associability. In four experiments that used transient inactivation techniques, we found that surprise-induced enhancement of subsequent learning about a stimulus depended on intact CeA function at the time of surprise but not when more rapid learning was subsequently expressed. In contrast, normal SI/nBM function was critical to the expression of enhanced learning but was not necessary when surprise was induced. These data suggest that these two components of the so-called "extended amygdala" serve distinct roles in the encoding and retrieval of information used in modulating attention to stimuli in associative learning. Additional circuitry linking these brain regions may also be important in the maintenance of that information.

Symbols as self-emergent entities in an optimization process of feature extraction and predictions

In the mammalian cortex the early sensory processing can be characterized as feature extraction resulting in local and analogue low-level representations. As a direct consequence, these map directly to the environment, but interpretation under natural conditions is ambiguous. In contrast, high-level representations for cognitive processing, e.g. language, require symbolic representations characterized by expression and syntax. The representations are binary, structured and disambiguated. However, do these fundamental functional distinctions translate into a fundamental distinction of the respective brain areas and their anatomical and physiological properties? Here we argue that the distinction between early sensory processing and higher cognitive functions may not be based on structural differences of cortical areas; instead similar learning principles acting on input signals with different statistics give rise to the observed variations of function. Firstly, we give an account of present research describing neuronal properties at early stages of sensory systems as a consequence of an optimization process over the set of natural stimuli. Secondly, addressing a stage following early visual processing we suggest to extend the unsupervised learning scheme by including predictive processes. These contain the widely used objective of temporal coherence as a special case and are a powerful approach to resolve ambiguities. Furthermore, in combination with a prior on the bandwidth of information exchange between units it leads to a condensation of information. Thirdly, as a crucial step, not only are predictive units optimized, but the selectivity of the feature extractors are adapted to allow optimal predictability. Thus, over and beyond making useful predictions, we propose that the predictability of a stimulus be in itself a selection criterion for further processing. In a hierarchical system the combined optimization process leads to entities that represent condensed pieces of knowledge and that are not analogue anymore. Instead, these entities work as arguments in a framework of transformations that realize predictions. Thus, the criteria of predictability and condensation in an optimization of sensory representations relate directly to the two defining properties of symbols of expression and syntax. In this paper, we sketch an unsupervised learning process that gradually transforms analogue local representations into discrete binary representations by means of four hypotheses. We propose that in this optimization process acting in a hierarchical system, entities emerge at, higher levels that fulfil the criteria defining symbols, instantiating qualitatively different representations at similarly structured low and high levels.

Noradrenaline and dopamine elevations in the rat prefrontal cortex in spatial working memory

The role of prefrontal cortical dopamine (DA) in the modulation of working memory functions is well documented, but substantial evidence indicates that the locus ceruleus noradrenergic system also modulates working memory via actions within the prefrontal cortex (PFC). This study shows that PFC noradrenaline (NA) and DA dialysate levels phasically increase when rats perform correctly in a delayed alternation task in a T-maze, a test of spatial working memory. However, NA levels were markedly enhanced in animals trained to alternate compared with rats that acquired the spatial information about the location of food in the maze but were untrained to make a choice to obtain the reward. In contrast, PFC DA elevations occurred independently of whether the animal had acquired the trial-specific information for correct task execution. The contribution of anticipatory responses to catecholamine efflux was also evaluated by exposing rats to an environment signaling the presence of the reward in the successive alternation task. No conditioned NA efflux was observed in either group. In contrast, in both groups, DA efflux increased in the anticipatory phase of the test to the same levels of those reached during the task. These data provide the first direct evidence for a selective activation of PFC NA transmission during a spatial working memory task. We propose that, in the working memory task, DA is primarily associated with reward expectancy, whereas NA is involved in the active maintenance of the information about a goal and the rules to achieve it.

An event-related functional magnetic resonance imaging study of voluntary and stimulus-driven orienting of attention

Attention can be voluntarily directed to a location or automatically summoned to a location by a salient stimulus. We compared the effects of voluntary and stimulus-driven shifts of spatial attention on the blood oxygenation level-dependent signal in humans, using a method that separated preparatory activity related to the initial shift of attention from the subsequent activity caused by target presentation. Voluntary shifts produced greater preparatory activity than stimulus-driven shifts in the frontal eye field (FEF) and intraparietal sulcus, core regions of the dorsal frontoparietal attention network, demonstrating their special role in the voluntary control of attention. Stimulus-driven attentional shifts to salient color singletons recruited occipitotemporal regions, sensitive to color information and part of the dorsal network, including the FEF, suggesting a partly overlapping circuit for endogenous and exogenous orienting. The right temporoparietal junction (TPJ), a core region of the ventral frontoparietal attention network, was strongly modulated by stimulus-driven attentional shifts to behaviorally relevant stimuli, such as targets at unattended locations. However, the TPJ did not respond to salient, task-irrelevant color singletons, indicating that behavioral relevance is critical for TPJ modulation during stimulus-driven orienting. Finally, both ventral and dorsal regions were modulated during reorienting but significantly only by reorienting after voluntary shifts, suggesting the importance of a mismatch between expectation and sensory input.

Behavioral theories and the neurophysiology of reward

The functions of rewards are based primarily on their effects on behavior and are less directly governed by the physics and chemistry of input events as in sensory systems. Therefore, the investigation of neural mechanisms underlying reward functions requires behavioral theories that can conceptualize the different effects of rewards on behavior. The scientific investigation of behavioral processes by animal learning theory and economic utility theory has produced a theoretical framework that can help to elucidate the neural correlates for reward functions in learning, goal-directed approach behavior, and decision making under uncertainty. Individual neurons can be studied in the reward systems of the brain, including dopamine neurons, orbitofrontal cortex, and striatum. The neural activity can be related to basic theoretical terms of reward and uncertainty, such as contiguity, contingency, prediction error, magnitude, probability, expected value, and variance.

SK channels control the firing pattern of midbrain dopaminergic neurons in vivo

A vast body of experimental in vitro work and modelling studies suggests that the firing pattern and/or rate of a majority of midbrain dopaminergic neurons may be controlled in part by Ca2+-activated K+ channels of the SK type. However, due to the lack of suitable tools, in vivo evidence is lacking. We have taken advantage of the development of the water-soluble, medium potency SK blocker N-methyl-laudanosine (CH3-L) to test this hypothesis in anaesthetized rats. In the lateral ventral tegmental area, CH3-L iontophoresis onto dopaminergic neurons significantly increased the coefficient of variation of their interspike intervals and the percentage of spikes generated in bursts as compared to the control condition. The effect of CH3-L persisted in the presence of a specific GABA(A) antagonist, suggesting a direct effect. It was robust and reversible, and was also observed in the substantia nigra. Control experiments demonstrated that the effect of CH3-L could be entirely ascribed to its blockade of SK channels. On the other hand, the firing pattern of noradrenergic neurons was much less affected by CH3-L. We provide here the first demonstration of a major role of SK channels in the control of the switch between tonic and burst firing of dopaminergic neurons in physiological conditions. This study also suggests a new strategy to develop modulators of the dopaminergic (DA) system, which could be of interest in the treatment of Parkinson's disease, and perhaps other diseases in which DA pathways are dysfunctional.

Basal ganglia orient eyes to reward

Expectation of reward motivates our behaviors and influences our decisions. Indeed, neuronal activity in many brain areas is modulated by expected reward. However, it is still unclear where and how the reward-dependent modulation of neuronal activity occurs and how the reward-modulated signal is transformed into motor outputs. Recent studies suggest an important role of the basal ganglia. Sensorimotor/cognitive activities of neurons in the basal ganglia are strongly modulated by expected reward. Through their abundant outputs to the brain stem motor areas and the thalamocortical circuits, the basal ganglia appear capable of producing body movements based on expected reward. A good behavioral measure to test this hypothesis is saccadic eye movement because its brain stem mechanism has been extensively studied. Studies from our laboratory suggest that the basal ganglia play a key role in guiding the gaze to the location where reward is available. Neurons in the caudate nucleus and the substantia nigra pars reticulata are extremely sensitive to the positional difference in expected reward, which leads to a bias in excitability between the superior colliculi such that the saccade to the to-be-rewarded position occurs more quickly. It is suggested that the reward modulation occurs in the caudate where cortical inputs carrying spatial signals and dopaminergic inputs carrying reward-related signals are integrated. These data support a specific form of reinforcement learning theories, but also suggest further refinement of the theory.

A subpopulation of neurons in the medial prefrontal cortex encodes emotional learning with burst and frequency codes through a dopamine D4 receptor-dependent basolateral amygdala input

The basolateral nucleus of the amygdala (BLA) and medial prefrontal cortex (mPFC) are involved importantly in the processing and encoding of emotionally salient learned associations. Here, we examined the possible role of the mPFC in the acquisition and encoding of emotional associative learning at the behavioral and single-neuron level. A subpopulation of neurons in the mPFC that received monosynaptic and orthodromic inputs from the BLA demonstrated strong associative responding to odors paired previously with footshock by increasing spontaneous activity and bursting activity. This occurred specifically in response to postconditioning presentations of the footshock-paired odors but not to odors presented in the absence of footshock. In contrast, mPFC neurons that failed to respond to BLA stimulation showed no associative responding. Systemic or intra-mPFC blockade of dopamine (DA) D4 receptors prevented this emotional associative learning in neurons of the mPFC and blocked the expression of olfactory conditioned fear. These results demonstrate that individual neurons in the mPFC that receive a functional input from the BLA actively encode emotional learning and that this process depends on DA D4 receptor stimulation in the mPFC.

Dopamine D1 activation shortens the duration of phases in stereotyped grooming sequences

Rats frequently emit grooming actions in a highly stereotyped, syntactic chain in which three distinct phases of facially directed forearm movements are sequentially emitted in a rule-governed pattern and followed by body-directed licking. The present study evaluated the effects of the full dopamine D1 agonist, SKF 81297, and the partial dopamine D1 agonist, SKF 38393, on the duration of individual phases of stereotyped grooming chains. We found that systemic administration of SKF 81297 significantly shortened grooming chain duration. An examination of the fine temporal structure of syntactic grooming chain actions showed that duration changes were correlated with decreased numbers of actions in phases I and IV of the chain. Phases II and III were not changed in duration, although there were some structural distortions introduced. The partial D1 agonist, SKF 38393, had no effect on duration or number of component actions in the grooming chain. Based on these results, we hypothesize that the timing of syntactic grooming phase transitions may involve a D1-mediated internal clock process that is altered by full D1 agonist activation. By this model, SKF 81297 increases the speed of the clock used for the temporal control of grooming actions, and thus shortens phase durations.

Different Neural Correlates of Reward Expectation and Reward Expectation Error in the Putamen and Caudate Nucleus During Stimulus-Action-Reward Association Learning

To select appropriate behaviors leading to rewards, the brain needs to learn associations among sensory stimuli, selected behaviors, and rewards. Recent imaging and neural-recording studies have revealed that the dorsal striatum plays an important role in learning such stimulus-action-reward associations. However, the putamen and caudate nucleus are embedded in distinct cortico-striatal loop circuits, predominantly connected to motor-related cerebral cortical areas and frontal association areas, respectively. This difference in their cortical connections suggests that the putamen and caudate nucleus are engaged in different functional aspects of stimulus-action-reward association learning. To determine whether this is the case, we conducted an event-related and computational model–based functional MRI (fMRI) study with a stochastic decision-making task in which a stimulus-action-reward association must be learned. A simple reinforcement learning model not only reproduced the subject's action selections reasonably well but also allowed us to quantitatively estimate each subject's temporal profiles of stimulus-action-reward association and reward-prediction error during learning trials. These two internal representations were used in the fMRI correlation analysis. The results revealed that neural correlates of the stimulus-action-reward association reside in the putamen, whereas a correlation with reward-prediction error was found largely in the caudate nucleus and ventral striatum. These nonuniform spatiotemporal distributions of neural correlates within the dorsal striatum were maintained consistently at various levels of task difficulty, suggesting a functional difference in the dorsal striatum between the putamen and caudate nucleus during stimulus-action-reward association learning.

Neural systems of reinforcement for drug addiction: from actions to habits to compulsion

Drug addiction is increasingly viewed as the endpoint of a series of transitions from initial drug use--when a drug is voluntarily taken because it has reinforcing, often hedonic, effects--through loss of control over this behavior, such that it becomes habitual and ultimately compulsive. Here we discuss evidence that these transitions depend on interactions between pavlovian and instrumental learning processes. We hypothesize that the change from voluntary drug use to more habitual and compulsive drug use represents a transition at the neural level from prefrontal cortical to striatal control over drug seeking and drug taking behavior as well as a progression from ventral to more dorsal domains of the striatum, involving its dopaminergic innervation. These neural transitions may themselves depend on the neuroplasticity in both cortical and striatal structures that is induced by chronic self-administration of drugs.

Cooperative glutamatergic and cholinergic mechanisms generate short-term modifications of synaptic effectiveness in prepositus hypoglossi neurons

To maintain horizontal eye position on a visual target after a saccade, extraocular motoneurons need a persistent (tonic) neural activity, called "eye-position signal," generated by prepositus hypoglossi (PH) neurons. We have shown previously in vitro and in vivo that this neural activity depends, among others mechanisms, on the interplay of glutamatergic transmission and cholinergic synaptically triggered depolarization. Here, we used rat sagittal brainstem slices, including PH nucleus and paramedian pontine reticular formation (PPRF). We made intracellular recordings of PH neurons and studied their synaptic activation from PPRF neurons. Train stimulation of the PPRF area evoked a cholinergic-sustained depolarization of PH neurons that outlasted the stimulus. EPSPs evoked in PH neurons by single pulses applied to the PPRF presented a short-term potentiation (STP) after train stimulation. APV (an NMDA-receptor blocker) or chelerythrine (a protein kinase-C inhibitor) had no effect on the sustained depolarization, but they did block the evoked STP, whereas pirenzepine (an M1 muscarinic antagonist) blocked both the sustained depolarization and the STP of PH neurons. Thus, electrical stimulation of the PPRF area activates both glutamatergic and cholinergic axons terminating in the PH nucleus, the latter producing a sustained depolarization probably involved in the genesis of the persistent neural activity required for eye fixation. M1-receptor activation seems to evoke a STP of PH neurons via NMDA receptors. Such STP could be needed for the stabilization of the neural network involved in the generation of position signals necessary for eye fixation after a saccade.

Enhanced conditioning produced by surprising increases in reinforcer value are unaffected by lesions of the amygdala central nucleus

In many experimental settings, lesions of the central nucleus of the amygdala (CN) interfere with surprise-induced enhancement of event processing. In those settings, surprise was produced by omitting an expected event. This experiment examined the effects of CN lesions on enhanced learning after surprise was induced by presenting an unexpected event. After extensive light-food pellet pairings, a light-noise compound was paired with food pellets, and a sucrose solution was unexpectedly delivered after the food. Relative to a control condition, this manipulation enhanced the formation of associations between the auditory conditioned stimulus and food, in both sham- and CN-lesioned rats. These results indicate that CN circuitry implicated in surprise-induced increases in event processing is preferentially engaged when expected events are omitted, and not when unexpected events are presented.

Opioid receptors in the midbrain periaqueductal gray regulate prediction errors during Pavlovian fear conditioning

The authors used a within-subject blocking design to study the role of ventrolateral periaqueductal gray (v1PAG) opioid receptors in regulating prediction errors during Pavlovian fear conditioning. In Stage I, the authors trained rats to fear conditioned stimulus (CS) A by pairing it with shock. In Stage II, CSA and CSB were co-presented and followed with shock. Two novel stimuli, CSC and CSD, were also co-presented and followed with shock in Stage II. CSA blocked fear from accruing to CSB. Blocking was prevented by systemic pretreatment with naloxone. Blocking was also prevented in a dose-dependent and neuroanatomically specific fashion by vlPAG infusions of the micro-opioid receptor antagonist CTAP. These experiments show that v1PAG micro-opioid receptors contribute to Pavlovian fear learning by regulating predictive error.

Neurophysiological theory of Kamin blocking in fear conditioning

Kamin blocking in fear conditioning is thought to reflect diminished processing of the unconditional stimulus (US) in the presence of a conditional stimulus (CS-super(+)) that was previously paired with this US. According to Fanselow's (1998) hypothesis, the CS-super(+) drives output from the amygdala that ultimately produces analgesia by causing opiate release onto afferent pain circuits. This hypothesis was explored quantitatively through neurophysiological simulations. The results suggest that opiate-mediated, negative-feedback control of US processing is too slow for efficient blocking of cue conditioning. The reason is that conditioning-produced synaptic modifications can be induced before the opiate-mediated inhibition has any substantial effect on US processing. The results suggest the existence of an additional, faster-acting, inhibitory neurotransmitter in the blocking circuit.

A direct projection from superior colliculus to substantia nigra pars compacta in the cat

Dopaminergic neurons exhibit a short-latency, phasic response to unexpected, biologically salient stimuli. The midbrain superior colliculus also is sensitive to such stimuli, exhibits sensory responses with latencies reliably less than those of dopaminergic neurons, and, in rat, has been shown to send direct projections to regions of the substantia nigra and ventral tegmental area containing dopaminergic neurons (e.g. pars compacta). Recent electrophysiological and electrochemical evidence also suggests that tectonigral connections may be critical for relaying short-latency (<100 ms) visual information to midbrain dopaminergic neurons. By investigating the tectonigral projection in the cat, the present study sought to establish whether this pathway is a specialization of the rodent, or whether it may be a more general feature of mammalian neuroanatomy. Anterogradely and retrogradely transported anatomical tracers were injected into the superior colliculus and substantia nigra pars compacta, respectively, of adult cats. In the anterograde experiments, abundant fibers and terminals labeled with either biotinylated dextran amine or Phaseolus vulgaris leucoagglutinin were seen in close association with tyrosine hydroxylase-positive (dopaminergic) somata and processes in substantia nigra pars compacta and the ventral tegmental area. In the retrograde experiments, injections of biotinylated dextran amine into substantia nigra produced significant retrograde labeling of tectonigral neurons of origin in the intermediate and deep layers of the ipsilateral superior colliculus. Approximately half of these biotinylated dextran amine-labeled neurons were, in each case, shown to be immunopositive for the calcium binding proteins, parvalbumin or calbindin. Significantly, virtually no retrogradely labeled neurons were found either in the superficial layers of the superior colliculus or among the large tecto-reticulospinal output neurons. Taken in conjunction with recent data in the rat, the results of this study suggest that the tectonigral projection may be a common feature of mammalian midbrain architecture. As such, it may represent an additional route by which short-latency sensory information can influence basal ganglia function.

Dopaminergic neurones: much more than dopamine?

Midbrain dopaminergic (DA) neurones sustain important physiological functions such as control of motricity, signalling of the error in prediction of rewards and modulation of emotions and cognition. Moreover, their degeneration leads to Parkinson's disease and they may be dysfunctional in other pathological states, such as schizophrenia and drug abuse. A subset of DA neurones has been known for many years to contain releasable peptides such as neurotensin and cholecystokinin. However, recent experimental evidence indicates that the phenotype of DA neurones may be much more diverse, since it is suggested that, under certain conditions, they may also release glutamate, cannabinoids and even serotonin.