Striatal action-learning based on dopamine concentration

Fast Hebbian plasticity and working memory

Theories and models of working memory (WM) were at least since the mid-1990s dominated by the persistent activity hypothesis. The past decade has seen rising concerns about the shortcomings of sustained activity as the mechanism for short-term maintenance of WM information in the light of accumulating experimental evidence for so-called activity-silent WM and the fundamental difficulty in explaining robust multi-item WM. In consequence, alternative theories are now explored mostly in the direction of fast synaptic plasticity as the underlying mechanism. The question of non-Hebbian vs Hebbian synaptic plasticity emerges naturally in this context. In this review, we focus on fast Hebbian plasticity and trace the origins of WM theories and models building on this form of associative learning.

Reinforcement learning approaches to hippocampus-dependent flexible spatial navigation

Humans and non-human animals show great flexibility in spatial navigation, including the ability to return to specific locations based on as few as one single experience. To study spatial navigation in the laboratory, watermaze tasks, in which rats have to find a hidden platform in a pool of cloudy water surrounded by spatial cues, have long been used. Analogous tasks have been developed for human participants using virtual environments. Spatial learning in the watermaze is facilitated by the hippocampus. In particular, rapid, one-trial, allocentric place learning, as measured in the delayed-matching-to-place variant of the watermaze task, which requires rodents to learn repeatedly new locations in a familiar environment, is hippocampal dependent. In this article, we review some computational principles, embedded within a reinforcement learning framework, that utilise hippocampal spatial representations for navigation in watermaze tasks. We consider which key elements underlie their efficacy, and discuss their limitations in accounting for hippocampus-dependent navigation, both in terms of behavioural performance (i.e. how well do they reproduce behavioural measures of rapid place learning) and neurobiological realism (i.e. how well do they map to neurobiological substrates involved in rapid place learning). We discuss how an actor-critic architecture, enabling simultaneous assessment of the value of the current location and of the optimal direction to follow, can reproduce one-trial place learning performance as shown on watermaze and virtual delayed-matching-to-place tasks by rats and humans, respectively, if complemented with map-like place representations. The contribution of actor-critic mechanisms to delayed-matching-to-place performance is consistent with neurobiological findings implicating the striatum and hippocampo-striatal interaction in delayed-matching-to-place performance, given that the striatum has been associated with actor-critic mechanisms. Moreover, we illustrate that hierarchical computations embedded within an actor-critic architecture may help to account for aspects of flexible spatial navigation. The hierarchical reinforcement learning approach separates trajectory control via a temporal-difference error from goal selection via a goal prediction error and may account for flexible, trial-specific, navigation to familiar goal locations, as required in some arm-maze place memory tasks, although it does not capture one-trial learning of new goal locations, as observed in open field, including watermaze and virtual, delayed-matching-to-place tasks. Future models of one-shot learning of new goal locations, as observed on delayed-matching-to-place tasks, should incorporate hippocampal plasticity mechanisms that integrate new goal information with allocentric place representation, as such mechanisms are supported by substantial empirical evidence.

CK1δ over-expressing mice display ADHD-like behaviors, frontostriatal neuronal abnormalities and altered expressions of ADHD-candidate genes

The cognitive mechanisms underlying attention-deficit hyperactivity disorder (ADHD), a highly heritable disorder with an array of candidate genes and unclear genetic architecture, remain poorly understood. We previously demonstrated that mice overexpressing CK1δ (CK1δ OE) in the forebrain show hyperactivity and ADHD-like pharmacological responses to D-amphetamine. Here, we demonstrate that CK1δ OE mice exhibit impaired visual attention and a lack of D-amphetamine-induced place preference, indicating a disruption of the dopamine-dependent reward pathway. We also demonstrate the presence of abnormalities in the frontostriatal circuitry, differences in synaptic ultra-structures by electron microscopy, as well as electrophysiological perturbations of both glutamatergic and GABAergic transmission, as observed by altered frequency and amplitude of mEPSCs and mIPSCs. Furthermore, gene expression profiling by next-generation sequencing alone, or in combination with bacTRAP technology to study specifically Drd1a versus Drd2 medium spiny neurons, revealed that developmental CK1δ OE alters transcriptional homeostasis in the striatum, including specific alterations in Drd1a versus Drd2 neurons. These results led us to perform a fine molecular characterization of targeted gene networks and pathway analysis. Importantly, a large fraction of 92 genes identified by GWAS studies as associated with ADHD in humans are significantly altered in our mouse model. The multiple abnormalities described here might be responsible for synaptic alterations and lead to complex behavioral abnormalities. Collectively, CK1δ OE mice share characteristics typically associated with ADHD and should represent a valuable model to investigate the disease in vivo.

Beyond Reward Prediction Errors: Human Striatum Updates Rule Values During Learning

Humans naturally group the world into coherent categories defined by membership rules. Rules can be learned implicitly by building stimulus-response associations using reinforcement learning or by using explicit reasoning. We tested if the striatum, in which activation reliably scales with reward prediction error, would track prediction errors in a task that required explicit rule generation. Using functional magnetic resonance imaging during a categorization task, we show that striatal responses to feedback scale with a "surprise" signal derived from a Bayesian rule-learning model and are inconsistent with RL prediction error. We also find that striatum and caudal inferior frontal sulcus (cIFS) are involved in updating the likelihood of discriminative rules. We conclude that the striatum, in cooperation with the cIFS, is involved in updating the values assigned to categorization rules when people learn using explicit reasoning.

Role of Nitric Oxide on Dopamine Release and Morphine-Dependency

The catastrophic effects of opioids use on public health and the economy are documented clearly in numerous studies. Repeated morphine administration can lead to either a decrease (tolerance) or an increase (sensitization) in its behavioral and rewarding effects. Morphine-induced sensitization is a major problem and plays an important role in abuse of the opioid drugs. Studies reported that morphine may exert its effects by the release of nitric oxide (NO). NO is a potent neuromodulator, which is produced by nitric oxide synthase (NOS). However, the exact role of NO in the opioid-induced sensitization is unknown. In this study, we reviewed the role of NO on opioid-induced sensitization in 2 important, rewarding regions of the brain: nucleus accumbens and ventral tegmentum. In addition, we focused on the contribution of NO on opioid-induced sensitization in the limbic system.

Long-Term Supplementation with Beta Serum Concentrate (BSC), a Complex of Milk Lipids, during Post-Natal Brain Development Improves Memory in Rats

We have previously reported that the supplementation of ganglioside-enriched complex-milk-lipids improves cognitive function and that a phospholipid-enriched complex-milk-lipid prevents age-related cognitive decline in rats. This current study evaluated the effects of post-natal supplementation of ganglioside- and phospholipid-enriched complex-milk-lipids beta serum concentrate (BSC) on cognitive function in young rats. The diet of male rats was supplemented with either gels formulated BSC (n = 16) or blank gels (n = 16) from post-natal day 10 to day 70. Memory and anxiety-like behaviors were evaluated using the Morris water maze, dark–light boxes, and elevated plus maze tests. Neuroplasticity and white matter were measured using immunohistochemical staining. The overall performance in seven-day acquisition trials was similar between the groups. Compared with the control group, BSC supplementation reduced the latency to the platform during day one of the acquisition tests. Supplementation improved memory by showing reduced latency and improved path efficiency to the platform quadrant, and smaller initial heading error from the platform zone. Supplemented rats showed an increase in striatal dopamine terminals and hippocampal glutamate receptors. Thus BSC supplementation during post-natal brain development improved learning and memory, independent from anxiety. The moderately enhanced neuroplasticity in dopamine and glutamate may be biological changes underlying the improved cognitive function.

Supplementation with complex milk lipids during brain development promotes neuroplasticity without altering myelination or vascular density

Background

Supplementation with complex milk lipids (CML) during postnatal brain development has been shown to improve spatial reference learning in rats.

Objective

The current study examined histo-biological changes in the brain following CML supplementation and their relationship to the observed improvements in memory.

Design

The study used the brain tissues from the rats (male Wistar, 80 days of age) after supplementing with either CML or vehicle during postnatal day 10–80. Immunohistochemical staining of synaptophysin, glutamate receptor-1, myelin basic protein, isolectin B-4, and glial fibrillary acidic protein was performed. The average area and the density of the staining and the numbers of astrocytes and capillaries were assessed and analysed.

Results

Compared with control rats, CML supplementation increased the average area of synaptophysin staining and the number of GFAP astrocytes in the CA3 sub-region of the hippocampus (p<0.01), but not in the CA4 sub-region. The supplementation also led to an increase in dopamine output in the striatum that was related to nigral dopamine expression (p<0.05), but did not alter glutamate receptors, myelination or vascular density.

Conclusion

CML supplementation may enhance neuroplasticity in the CA3 sub-regions of the hippocampus. The brain regions-specific increase of astrocyte may indicate a supporting role for GFAP in synaptic plasticity. CML supplementation did not associate with postnatal white matter development or vascular remodelling.

Differential effects of dopamine signalling on long-term memory formation and consolidation in rodent brain

Background

Using auditory discrimination learning in gerbils, we have previously shown that activation of auditory-cortical D1/D5 dopamine receptors facilitates mTOR-mediated, protein synthesis-dependent mechanisms of memory consolidation and anterograde memory formation. To understand molecular mechanisms of this facilitatory effect, we tested the impact of local pharmacological activation of different D1/D5 dopamine receptor signalling modes in the auditory cortex. To this end, protein patterns in soluble and synaptic protein-enriched fractions from cortical, hippocampal and striatal brain regions of ligand- and vehicle-treated gerbils were analysed by 2D gel electrophoresis and mass spectrometry 24 h after intervention.

Results

After auditory-cortical injection of SKF38393 – a D1/D5 dopamine receptor-selective agonist reported to activate the downstream effectors adenylyl cyclase and phospholipase C – prominent proteomic alterations compared to vehicle-treated controls appeared in the auditory cortex, striatum, and hippocampus, whereas only minor changes were detectable in the frontal cortex. In contrast, auditory-cortical injection of SKF83959 – a D1/D5 agonist reported to preferentially stimulate phospholipase C – induced pronounced changes in the frontal cortex. At the molecular level, we detected altered regulation of cytoskeletal and scaffolding proteins, changes in proteins with functions in energy metabolism, local protein synthesis, and synaptic signalling. Interestingly, abundance and/or subcellular localisation of the predominantly presynaptic protein α-synuclein displayed dopaminergic regulation. To assess the role of α-synuclein for dopaminergic mechanisms of memory modulation, we tested the impact of post-conditioning systemic pharmacological activation of different D1/D5 dopamine receptor signalling modes on auditory discrimination learning in α-synuclein-mutant mice. In C57BL/6JOlaHsd mice, bearing a spontaneous deletion of the α-synuclein-encoding gene, but not in the related substrains C57BL/6JCrl and C57BL/6JRccHsd, adenylyl cyclase-mediated signalling affected acquisition rates over future learning episodes, whereas phospholipase C-mediated signalling affected final memory performance.

Conclusions

Dopamine signalling modes via D1/D5 receptors in the auditory cortex differentially impact protein profiles related to rearrangement of cytomatrices, energy metabolism, and synaptic neurotransmission in cortical, hippocampal, and basal brain structures. Altered dopamine neurotransmission in α-synuclein-deficient mice revealed that distinct D1/D5 receptor signalling modes may control different aspects of memory consolidation.

Electronic supplementary material

The online version of this article (doi:10.1186/s12953-015-0069-2) contains supplementary material, which is available to authorized users.

The role of prediction and outcomes in adaptive cognitive control

Humans adaptively perform actions to achieve their goals. This flexible behaviour requires two core abilities: the ability to anticipate the outcomes of candidate actions and the ability to select and implement actions in a goal-directed manner. The ability to predict outcomes has been extensively researched in reinforcement learning paradigms, but this work has often focused on simple actions that are not embedded in hierarchical and sequential structures that are characteristic of goal-directed human behaviour. On the other hand, the ability to select actions in accordance with high-level task goals, particularly in the presence of alternative responses and salient distractors, has been widely researched in cognitive control paradigms. Cognitive control research, however, has often paid less attention to the role of action outcomes. The present review attempts to bridge these accounts by proposing an outcome-guided mechanism for selection of extended actions. Our proposal builds on constructs from the hierarchical reinforcement learning literature, which emphasises the concept of reaching and evaluating informative states, i.e., states that constitute subgoals in complex actions. We develop an account of the neural mechanisms that allow outcome-guided action selection to be achieved in a network that relies on projections from cortical areas to the basal ganglia and back-projections from the basal ganglia to the cortex. These cortico-basal ganglia-thalamo-cortical 'loops' allow convergence - and thus integration - of information from non-adjacent cortical areas (for example between sensory and motor representations). This integration is essential in action sequences, for which achieving an anticipated sensory state signals the successful completion of an action. We further describe how projection pathways within the basal ganglia allow selection between representations, which may pertain to movements, actions, or extended action plans. The model lastly envisages a role for hierarchical projections from the striatum to dopaminergic midbrain areas that enable more rostral frontal areas to bias the selection of inputs from more posterior frontal areas via their respective representations in the basal ganglia.

Dopamine modulation of learning and memory in the prefrontal cortex: insights from studies in primates, rodents, and birds

In this review, we provide a brief overview over the current knowledge about the role of dopamine transmission in the prefrontal cortex during learning and memory. We discuss work in humans, monkeys, rats, and birds in order to provide a basis for comparison across species that might help identify crucial features and constraints of the dopaminergic system in executive function. Computational models of dopamine function are introduced to provide a framework for such a comparison. We also provide a brief evolutionary perspective showing that the dopaminergic system is highly preserved across mammals. Even birds, following a largely independent evolution of higher cognitive abilities, have evolved a comparable dopaminergic system. Finally, we discuss the unique advantages and challenges of using different animal models for advancing our understanding of dopamine function in the healthy and diseased brain.

Midbrain dopamine neurons sustain inhibitory transmission using plasma membrane uptake of GABA, not synthesis

Synaptic transmission between midbrain dopamine neurons and target neurons in the striatum is essential for the selection and reinforcement of movements. Recent evidence indicates that nigrostriatal dopamine neurons inhibit striatal projection neurons by releasing a neurotransmitter that activates GABA_A receptors. Here, we demonstrate that this phenomenon extends to mesolimbic afferents, and confirm that the released neurotransmitter is GABA. However, the GABA synthetic enzymes GAD65 and GAD67 are not detected in midbrain dopamine neurons. Instead, these cells express the membrane GABA transporters mGAT1 (Slc6a1) and mGAT4 (Slc6a11) and inhibition of these transporters prevents GABA co-release. These findings therefore indicate that GABA co-release is a general feature of midbrain dopaminergic neurons that relies on GABA uptake from the extracellular milieu as opposed to de novo synthesis. This atypical mechanism may confer dopaminergic neurons the flexibility to differentially control GABAergic transmission in a target-dependent manner across their extensive axonal arbors.

DOI:http://dx.doi.org/10.7554/eLife.01936.001

The electrical signals that are fired along neurons cannot be transmitted across the small gaps, called synapses that are found between neurons. Instead, the neuron sending the signal releases chemicals called neurotransmitters into the synapse. These neurotransmitters bind to receptor proteins on the surface of the second neuron and control how it fires.

A neurotransmitter called dopamine plays a key role in the circuits of the brain that control how we learn certain tasks involving movement. In particular, two populations of neurons from the midbrain that release dopamine target the striatum, an area of the brain that is responsible for motor control. These neurons also release other neurotransmitters, but the identity of these other chemicals is not known, and the details of the interaction between the neurons and the striatum are poorly understood.

Previous research showed that some of the midbrain neurons activate receptors that normally respond to a neurotransmitter called gamma-aminobutyric acid (GABA). However, several different chemicals can trigger this receptor. Using a range of techniques, Tritsch et al. now confirm that dopamine neurons release GABA alongside dopamine, and that this applies to both sets of the dopamine-producing neurons that feed into the striatum.

Some neurons can manufacture GABA from amino acids found in their internal fluid. However, Tritsch et al. could not detect the enzymes needed for this reaction in dopamine-producing neurons. Instead, these neurons contain proteins that can transport GABA across the cell membrane, which suggests that the neurons collect GABA from the extracellular fluid that surrounds them.

DOI:http://dx.doi.org/10.7554/eLife.01936.002

To treat a psychopath

Some people are now quite optimistic about the possibility of treating psychopathy with drugs that directly modulate brain function. I argue that this optimism is misplaced. Psychopathy is a global disorder in an individual's worldview, including his social and moral outlook. Because of the unity of this Weltanschauung, it is unlikely to be treatable in a piecemeal fashion. Recent neuroscientific methods do not give us much hope that we can replace, in a wholesale manner, problematic views of the world with more socially desirable ones. There are, therefore, principled reasons that psychopathy is so singularly treatment resistant.

Explaining human recreational use of 'pesticides': The neurotoxin regulation model of substance use vs. the hijack model and implications for age and sex differences in drug consumption

Most globally popular drugs are plant neurotoxins or their close chemical analogs. These compounds evolved to deter, not reward or reinforce, consumption. Moreover, they reliably activate virtually all toxin defense mechanisms, and are thus correctly identified by human neurophysiology as toxins. Acute drug toxicity must therefore play a more central role in drug use theory. We accordingly challenge the popular idea that the rewarding and reinforcing properties of drugs "hijack" the brain, and propose instead that the brain evolved to carefully regulate neurotoxin consumption to minimize fitness costs and maximize fitness benefits. This perspective provides a compelling explanation for the dramatic changes in substance use that occur during the transition from childhood to adulthood, and for pervasive sex differences in substance use: because nicotine and many other plant neurotoxins are teratogenic, children, and to a lesser extent women of childbearing age, evolved to avoid ingesting them. However, during the course of human evolution many adolescents and adults reaped net benefits from regulated intake of plant neurotoxins.

Evaluating the role of the alpha-7 nicotinic acetylcholine receptor in the pathophysiology and treatment of schizophrenia

The group of schizophrenia disorders affects approximately 1% of the population and has both genetic and environmental etiologies. Sufferers report various behavioral abnormalities including hallucinations and delusions (positive symptoms), reduced joy and amotivation (negative symptoms), plus inattention and poor learning (cognitive deficits). Despite the heterogeneous symptoms experienced, most patients smoke. The self-medication hypothesis posits that patients smoke to alleviate symptoms, consistent with evidence for nicotine-induced enhancement of cognition. While nicotine acts on multiple nicotinic acetylcholine receptors (nAChRs), the primary target of research is often the homomeric α7 nAChR. Given genetic linkages between schizophrenia and this receptor, its association with P50 sensory gating deficits, and its reduced expression in post-mortem brains, many have attempted to develop α7 nAChR ligands for treating schizophrenia. Recent evidence that ligands can be orthosteric agonists or positive allosteric modulators (PAMs) has revitalized the hope for treatment discovery. Herein, we present evidence regarding: (1) pathophysiological alterations of α7 nAChRs that might occur in patients; (2) mechanistic evidence for the normal action of α7 nAChRs; (3) preclinical studies using α7 nAChR orthosteric agonists and type I/II PAMs; and (4) where successful translational testing has occurred for particular compounds, detailing what is still required. We report that the accumulating evidence is positive, but that greater work is required using positron emission tomography to understand current alterations in α7 nAChR expression and their relationship to symptoms. Finally, cross-species behavioral tasks should be used more regularly to determine the predictive efficacy of treatments.

Molecular and cellular mechanisms of dopamine-mediated behavioral plasticity in the striatum

The striatum is the input structure of the basal ganglia system. By integrating glutamatergic signals from cortical and subcortical regions and dopaminergic signals from mesolimbic nuclei the striatum functions as an important neural substrate for procedural and motor learning as well as for reward-guided behaviors. In addition, striatal activity is significantly altered in pathological conditions in which either a loss of dopamine innervation (Parkinson's disease) or aberrant dopamine-mediated signaling (drug addiction and L-DOPA induced dyskinesia) occurs. Here we discuss cellular mechanisms of striatal synaptic plasticity and aspects of cell signaling underlying striatum-dependent behavior, with a major focus on the neuromodulatory action of the endocannabinoid system and on the role of the Ras-ERK cascade.

Reward learning as a potential target for pharmacological augmentation of cognitive remediation for schizophrenia: a roadmap for preclinical development

Rationale: Impaired cognitive abilities are a key characteristic of schizophrenia. Although currently approved pharmacological treatments have demonstrated efficacy for positive symptoms, to date no pharmacological treatments successfully reverse cognitive dysfunction in these patients. Cognitively-based interventions such as cognitive remediation (CR) and other psychosocial interventions however, may improve some of the cognitive and functional deficits of schizophrenia. Given that these treatments are time-consuming and labor-intensive, maximizing their effectiveness is a priority. Augmenting psychosocial interventions with pharmacological treatments may be a viable strategy for reducing the impact of cognitive deficits in patients with schizophrenia.

Objective: We propose a strategy to develop pharmacological treatments that can enhance the reward-related learning processes underlying successful skill-learning in psychosocial interventions. Specifically, we review clinical and preclinical evidence and paradigms that can be utilized to develop these pharmacological augmentation strategies. Prototypes for this approach include dopamine D1 receptor and α7 nicotinic acetylcholine receptor agonists as attractive targets to specifically enhance reward-related learning during CR.

Conclusion: The approach outlined here could be used broadly to develop pharmacological augmentation strategies across a number of cognitive domains underlying successful psychosocial treatment.

Physiological basis for emotional modulation of memory circuits by the amygdala

Classical experiments have demonstrated that the amygdala facilitates synaptic plasticity in other brain structures (e.g. hippocampus, basal ganglia) believed to constitute the storage sites for various types of memory. Here, we summarize new developments in our understanding of how the amygdala facilitates the formation of emotional memories. Recent insights into this question have come from studies relying on simultaneous recording of neurons in multiple brain regions during learning. This approach has revealed that in emotionally arousing conditions, whether positively or negatively valenced, the amygdala allows incoming information to be processed more efficiently in distributed cerebral networks. This review also highlights the need to understand how different brain regions act in parallel to efficiently achieve one goal.

Learning-dependent plasticity in human auditory cortex during appetitive operant conditioning

Animal experiments provide evidence that learning to associate an auditory stimulus with a reward causes representational changes in auditory cortex. However, most studies did not investigate the temporal formation of learning-dependent plasticity during the task but rather compared auditory cortex receptive fields before and after conditioning. We here present a functional magnetic resonance imaging study on learning-related plasticity in the human auditory cortex during operant appetitive conditioning. Participants had to learn to associate a specific category of frequency-modulated tones with a reward. Only participants who learned this association developed learning-dependent plasticity in left auditory cortex over the course of the experiment. No differential responses to reward predicting and nonreward predicting tones were found in auditory cortex in nonlearners. In addition, learners showed similar learning-induced differential responses to reward-predicting and nonreward-predicting tones in the ventral tegmental area and the nucleus accumbens, two core regions of the dopaminergic neurotransmitter system. This may indicate a dopaminergic influence on the formation of learning-dependent plasticity in auditory cortex, as it has been suggested by previous animal studies.

Roles of D1-like dopamine receptors in the nucleus accumbens and dorsolateral striatum in conditioned avoidance responses

RATIONALE

Aversively motivated learning is more poorly understood than appetitively motivated learning in many aspects, including the role of dopamine receptors in different regions of the striatum.

OBJECTIVES

The present study investigated the roles of the D1-like DA receptors in the nucleus accumbens (NAc) and dorsolateral striatum (DLS) on learning and performance of conditioned avoidance responses (CARs).

METHODS

Adult male Wistar rats received intraperitoneal (i.p.), intra-NAc, or intra-DLS injections of the D1 dopamine receptor agonist SKF 81297 or the D1 receptor antagonist SCH 23390 20 min before or immediately after a training session in the CAR task two-way active avoidance, carried out 24 h before a test session.

RESULTS

Pre-training administration of SCH 23390, but not SKF 81297, caused a significant decrease in the number of CARs in the test, but not in the training session, when injected into the DLS, or in either session when injected into the NAc. It also caused a significant increase in the number of escape failures in the training session when injected into the NAc. Systemic administration caused a combination of these effects. Post-training administrations of these drugs caused no significant effect.

CONCLUSIONS

The results suggest that the D1-like receptors in the NAc and DLS play important, though different, roles in learning and performance of CAR.

Nitric oxide donors enhance the frequency dependence of dopamine release in nucleus accumbens

Dopamine (DA) neurotransmission in the nucleus accumbens (NAc) is critically involved in normal as well as maladaptive motivated behaviors including drug addiction. Whether the striatal neuromodulator nitric oxide (NO) influences DA release in NAc is unknown. We investigated whether exogenous NO modulates DA transmission in NAc core and how this interaction varies depending on the frequency of presynaptic activation. We detected DA with cyclic voltammetry at carbon-fiber microelectrodes in mouse NAc in slices following stimuli spanning a full range of DA neuron firing frequencies (1-100 Hz). NO donors 3-morpholinosydnonimine hydrochloride (SIN-1) or z-1-[N-(3-ammoniopropyl)-N-(n-propyl)amino]diazen-1-ium-1,2-diolate (PAPA/NONOate) enhanced DA release with increasing stimulus frequency. This NO-mediated enhancement of frequency sensitivity of DA release was not prevented by inhibition of soluble guanylyl cyclase (sGC), DA transporters, or large conductance Ca(2+)-activated K(+) channels, and did not require glutamatergic or GABAergic input. However, experiments to identify whether frequency-dependent NO effects were mediated via changes in powerful acetylcholine-DA interactions revealed multiple components to NO modulation of DA release. In the presence of a nicotinic receptor antagonist (dihydro-β-erythroidine), NO donors increased DA release in a frequency-independent manner. These data suggest that NO in the NAc can modulate DA release through multiple GC-independent neuronal mechanisms whose net outcome varies depending on the activity in DA neurons and accumbal cholinergic interneurons. In the presence of accumbal acetylcholine, NO promotes the sensitivity of DA release to presynaptic activation, but with reduced acetylcholine input, NO will promote DA release in an activity-independent manner through a direct action on dopaminergic terminals.

Pathological basal ganglia activity in movement disorders

Our understanding of the pathophysiology of movement disorders and associated changes in basal ganglia activities has significantly changed during the last few decades. This process began with the development of detailed anatomical models of the basal ganglia, followed by studies of basal ganglia activity patterns in animal models of common movement disorders and electrophysiological recordings in movement disorder patients undergoing functional neurosurgical procedures. These investigations first resulted in an appreciation of global activity changes in the basal ganglia in parkinsonism and other disorders, and later in the detailed description of pathological basal ganglia activity patterns, specifically burst patterns and oscillatory synchronous discharge of basal ganglia neurons. In this review, we critically summarize our current knowledge of the pathological discharge patterns of basal ganglia neurons in Parkinson's disease, dystonia, and dyskinesias.

From reinforcement learning models to psychiatric and neurological disorders

Over the last decade and a half, reinforcement learning models have fostered an increasingly sophisticated understanding of the functions of dopamine and cortico-basal ganglia-thalamo-cortical (CBGTC) circuits. More recently, these models, and the insights that they afford, have started to be used to understand important aspects of several psychiatric and neurological disorders that involve disturbances of the dopaminergic system and CBGTC circuits. We review this approach and its existing and potential applications to Parkinson's disease, Tourette's syndrome, attention-deficit/hyperactivity disorder, addiction, schizophrenia and preclinical animal models used to screen new antipsychotic drugs. The approach's proven explanatory and predictive power bodes well for the continued growth of computational psychiatry and computational neurology.

Eyes on me: an fMRI study of the effects of social gaze on action control

Previous evidence suggests that 'social gaze' can not only cause shifts in attention, but also can change the perception of objects located in the direction of gaze and how these objects will be manipulated by an observer. These findings implicate differences in the neural networks sub-serving action control driven by social cues as compared with nonsocial cues. Here, we sought to explore this hypothesis by using functional magnetic resonance imaging and a stimulus-response compatibility paradigm in which participants were asked to generate spatially congruent or incongruent motor responses to both social and nonsocial stimuli. Data analysis revealed recruitment of a dorsal frontoparietal network and the locus coeruleus for the generation of incongruent motor responses, areas previously implicated in controlling attention. As a correlate for the effect of 'social gaze' on action control, an interaction effect was observed for incongruent responses to social stimuli in sub-cortical structures, anterior cingulate and inferior frontal cortex. Our results, therefore, suggest that performing actions in a--albeit minimal--social context significantly changes the neural underpinnings of action control and recruits brain regions previously implicated in action monitoring, the reorienting of attention and social cognition.

Functional disconnection of the substantia nigra pars compacta from the pedunculopontine nucleus impairs learning of a conditioned avoidance task

The pedunculopontine tegmental nucleus (PPTg) targets nuclei in the basal ganglia, including the substantia nigra pars compacta (SNc), in which neuronal loss occurs in Parkinson's disease, a condition in which patients show cognitive as well as motor disturbances. Partial loss and functional abnormalities of neurons in the PPTg are also associated with Parkinson's disease. We hypothesized that the interaction of PPTg and SNc might be important for cognitive impairments and so investigated whether disrupting the connections between the PPTg and SNc impaired learning of a conditioned avoidance response (CAR) by male Wistar rats. The following groups were tested: PPTg unilateral; SNc unilateral; PPTg-SNc ipsilateral (ipsilateral lesions in PPTg and SNc); PPTg-SNc contralateral (contralateral lesions in PPTg and SNc); sham lesions (of each type). SNc lesions were made with 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine HCl (MPTP, 0.6micromol); PPTg lesions with ibotenate (24nmol). After recovery, all rats underwent 50-trial sessions of 2-way active avoidance conditioning for 3 consecutive days. Rats with unilateral lesions in PPTg or SNc learnt this, however rats with contralateral (but not ipsilateral) combined lesions in both structures presented no sign of learning. This effect was not likely to be due to sensorimotor impairment because lesions did not affect reaction time to the tone or footshock during conditioning. However, an increased number of non-responses were observed in the rats with contralateral lesions. The results support the hypothesis that a functional interaction between PPTg and SNc is needed for CAR learning and performance.

Forebrain overexpression of CK1delta leads to down-regulation of dopamine receptors and altered locomotor activity reminiscent of ADHD

Dopamine neurotransmission controls motor and perseverative behavior, is mediated by protein phosphorylation, and may be perturbed in disorders of attention and hyperactivity. To assess the role of casein kinase I (CK1) in the regulation of dopamine signaling, we generated a genetically modified mouse line that overexpresses CK1delta (CK1delta OE) specifically in the forebrain. Overexpression was confirmed both at the mRNA and at the protein levels. Under basal conditions, CK1delta OE mice exhibited horizontal and vertical hyperactivity, reduced anxiety, and nesting behavior deficiencies. The CK1delta OE mice also presented paradoxical responses to dopamine receptor stimulation, showing hypoactivity following injection of d-amphetamine or methylphenidate, indicating that CK1 activity has a profound effect on dopamine signaling in vivo. Interestingly, CK1delta overexpression led to significantly reduced D1R and D2R dopamine receptor levels. All together, under basal conditions and in response to drug stimulation, the behavioral phenotype of CK1delta OE mice is reminiscent of the symptoms and drug responses observed in attention-deficit/hyperactivity disorder and therefore the CK1delta OE mice appear to be a model for this disorder.