Dynamic Nigrostriatal Dopamine Biases Action Selection

Dopamine dynamics are dispensable for movement but promote reward responses

Dopamine signalling modes differ in kinetics and spatial patterns of receptor activation1,2. How these modes contribute to motor function, motivation and learning has long been debated3-21. Here we show that action-potential-induced dopamine release is dispensable for movement initiation but supports reward-oriented behaviour. We generated mice with dopamine-neuron-specific knockout of the release site organizer protein RIM to disrupt action-potential-induced dopamine release. In these mice, rapid in vivo dopamine dynamics were strongly impaired, but baseline dopamine persisted and fully supported spontaneous movement. Conversely, reserpine-mediated dopamine depletion or blockade of dopamine receptors disrupted movement initiation. The dopamine precursor L-DOPA reversed reserpine-induced bradykinesia without restoring fast dopamine dynamics, a result that substantiated the conclusion that these dynamics are dispensable for movement initiation. In contrast to spontaneous movement, reward-oriented behaviour was impaired in dopamine-neuron-specific RIM knockout mice. In conditioned place preference and two-odour discrimination tasks, the mice effectively learned to distinguish the cues, which indicates that reward-based learning persists after RIM ablation. However, the performance vigour was reduced. During probabilistic cue-reward association, dopamine dynamics and conditioned responses assessed through anticipatory licking were disrupted. These results demonstrate that action-potential-induced dopamine release is dispensable for motor function and subsecond precision of movement initiation but promotes motivation and performance during reward-guided behaviours.

Abnormalities in static and dynamic intrinsic neural activity and neurotransmitters in first-episode OCD

BACKGROUND

Obsessive-compulsive disorder (OCD) is a disabling disorder in which the temporal variability of regional brain connectivity is not well understood. The aim of this study was to investigate alterations in static and dynamic intrinsic neural activity (INA) in first-episode OCD and whether these changes have the potential to reflect neurotransmitters.

METHODS

A total of 95 first-episode OCD patients and 106 matched healthy controls (HCs) were included in this study. Based on resting-state functional magnetic resonance imaging (rs-fMRI), the static and dynamic local connectivity coherence (calculated by static and dynamic regional homogeneity, sReHo and dReHo) were compared between the two groups. Furthermore, correlations between abnormal INA and PET- and SPECT-derived maps were performed to examine specific neurotransmitter system changes underlying INA abnormalities in OCD.

RESULTS

Compared with HCs, OCD showed decreased sReHo and dReHo values in left superior, middle temporal gyrus (STG/MTG), left Heschl gyrus (HES), left putamen, left insula, bilateral paracentral lobular (PCL), right postcentral gyrus (PoCG), right precentral gyrus (PreCG), left precuneus and right supplementary motor area (SMA). Decreased dReHo values were also found in left PoCG, left PreCG, left SMA and left middle cingulate cortex (MCC). Meanwhile, alterations in INA present in brain regions were correlated with dopamine system (D2, FDOPA), norepinephrine transporter (NAT) and the vesicular acetylcholine transporter (VAChT) maps.

CONCLUSION

Static and dynamic INA abnormalities exist in first-episode OCD, having the potential to reveal the molecular characteristics. The results help to further understand the pathophysiological mechanism and provide alternative therapeutic targets of OCD.

Constraints on the subsecond modulation of striatal dynamics by physiological dopamine signaling

Dopaminergic neurons play a crucial role in associative learning, but their capacity to regulate behavior on subsecond timescales remains debated. It is thought that dopaminergic neurons drive certain behaviors by rapidly modulating striatal spiking activity; however, a view has emerged that only artificially high (that is, supra-physiological) dopamine signals alter behavior on fast timescales. This raises the possibility that moment-to-moment striatal spiking activity is not strongly shaped by dopamine signals in the physiological range. To test this, we transiently altered dopamine levels while monitoring spiking responses in the ventral striatum of behaving mice. These manipulations led to only weak changes in striatal activity, except when dopamine release exceeded reward-matched levels. These findings suggest that dopaminergic neurons normally play a minor role in the subsecond modulation of striatal dynamics in relation to other inputs and demonstrate the importance of discerning dopaminergic neuron contributions to brain function under physiological and potentially nonphysiological conditions.

Complementary cognitive roles for D2-MSNs and D1-MSNs during interval timing

The role of striatal pathways in cognitive processing is unclear. We studied dorsomedial striatal cognitive processing during interval timing, an elementary cognitive task that requires mice to estimate intervals of several seconds and involves working memory for temporal rules as well as attention to the passage of time. We harnessed optogenetic tagging to record from striatal D2-dopamine receptor-expressing medium spiny neurons (D2-MSNs) in the indirect pathway and from D1-dopamine receptor-expressing MSNs (D1-MSNs) in the direct pathway. We found that D2-MSNs and D1-MSNs exhibited distinct dynamics over temporal intervals as quantified by principal component analyses and trial-by-trial generalized linear models. MSN recordings helped construct and constrain a four-parameter drift-diffusion computational model. This model predicted that disrupting either D2-MSNs or D1-MSNs would increase interval timing response times and alter MSN firing. In line with this prediction, we found that optogenetic inhibition or pharmacological disruption of either D2-MSNs or D1-MSNs increased interval timing response times. Pharmacologically disrupting D2-MSNs or D1-MSNs also changed MSN dynamics and degraded trial-by-trial temporal decoding. Together, our findings demonstrate that D2-MSNs and D1-MSNs make complementary contributions to interval timing despite opposing dynamics, implying that striatal direct and indirect pathways work together to shape temporal control of action. These data provide novel insight into basal ganglia cognitive operations beyond movement and have implications for human striatal diseases and therapies targeting striatal pathways.

Explaining dopamine through prediction errors and beyond

The most influential account of phasic dopamine holds that it reports reward prediction errors (RPEs). The RPE-based interpretation of dopamine signaling is, in its original form, probably too simple and fails to explain all the properties of phasic dopamine observed in behaving animals. This Perspective helps to resolve some of the conflicting interpretations of dopamine that currently exist in the literature. We focus on the following three empirical challenges to the RPE theory of dopamine: why does dopamine (1) ramp up as animals approach rewards, (2) respond to sensory and motor features and (3) influence action selection? We argue that the prediction error concept, once it has been suitably modified and generalized based on an analysis of each computational problem, answers each challenge. Nonetheless, there are a number of additional empirical findings that appear to demand fundamentally different theoretical explanations beyond encoding RPE. Therefore, looking forward, we discuss the prospects for a unifying theory that respects the diversity of dopamine signaling and function as well as the complex circuitry that both underlies and responds to dopaminergic transmission.

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward rewards. Dopamine (DA) neurons in the ventral tegmental area (VTA) and substantia nigra (SNc) are crucial for this process, via engagement of a reciprocally connected network with their striatal targets. Critically, it remains unknown how dopamine neuron activity itself engages dopamine signals throughout the striatum, across learning. Here, we investigated how optogenetic Pavlovian cue conditioning of VTA or SNc dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. Although VTA stimulation-evoked robust dopamine release in NAc core, shell, and DMS, predictive cues preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS. Despite the development of vigorous movement late in training, conditioned dopamine signals did not emerge in the DLS, even during Pavlovian conditioning with SNc dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show a broad dissociation in the fundamental prediction and reward-related information generated by VTA and SNc dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale adaptations across the striatal network emerge during learning to coordinate behavior.

Dopamine Dysregulation in Reward and Autism Spectrum Disorder

Autism spectrum disorder (ASD) is primarily characterized by core deficits in social skills, communication, and cognition and by repetitive stereotyped behaviors. These manifestations are variable between individuals, and ASD pathogenesis is complex, with over a thousand implicated genes, many epigenetic factors, and multiple environmental influences. The mesolimbic dopamine (DA) mediated brain reward system is held to play a key role, but the rapidly expanding literature reveals intricate, nuanced signaling involving a wide array of mesolimbic loci, neurotransmitters and receptor subtypes, and neuronal variants. How altered DA signaling may constitute a downstream convergence of the manifold causal origins of ASD is not well understood. A clear working framework of ASD pathogenesis may help delineate common stages and potential diagnostic and interventional opportunities. Hence, we summarize the known natural history of ASD in the context of emerging data and perspectives to update ASD reward signaling. Then, against this backdrop, we proffer a provisional framework that organizes ASD pathogenesis into successive levels, including (1) genetic and epigenetic changes, (2) disrupted mesolimbic reward signaling pathways, (3) dysregulated neurotransmitter/DA signaling, and finally, (4) altered neurocognitive and social behavior and possible antagonist/agonist based ASD interventions. This subdivision of ASD into a logical progression of potentially addressable parts may help facilitate the rational formulation of diagnostics and targeted treatments.

Rethinking dopamine-guided action sequence learning

As opposed to those requiring a single action for reward acquisition, tasks necessitating action sequences demand that animals learn action elements and their sequential order and sustain the behaviour until the sequence is completed. With repeated learning, animals not only exhibit precise execution of these sequences but also demonstrate enhanced smoothness and efficiency. Previous research has demonstrated that midbrain dopamine and its major projection target, the striatum, play crucial roles in these processes. Recent studies have shown that dopamine from the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA) serve distinct functions in action sequence learning. The distinct contributions of dopamine also depend on the striatal subregions, namely the ventral, dorsomedial and dorsolateral striatum. Here, we have reviewed recent findings on the role of striatal dopamine in action sequence learning, with a focus on recent rodent studies.

Dopamine activity in the nigrostriatal pathway alters cue-induced risky choice patterns in female rats

Deficits in cost/benefit decision making is a critical risk factor for gambling disorder. Reward-paired cues may play an important role, as these stimuli can enhance risk preference in rats. Despite extensive research implicating the dorsal striatum in the compulsive aspects of addiction, the role of nigrostriatal dopaminergic activity in cue-induced risk preference remains unclear, particularly in females. Accordingly, we examined the effects of manipulating the dopaminergic nigrostriatal pathway on cue-induced risky choice in female rats. TH:Cre rats were trained on the cued version of the rat Gambling Task. This task was designed such that maximal reward is attained by avoiding the high-risk, high-reward options and instead favouring the options associated with lower per-trial gains, as they feature less frequent and shorter time-out penalties. Adding reward-paired audiovisual cues to the task leads to greater risky choice on average. To assess the role of the nigrostriatal pathway, a viral vector carrying either Cre-dependent inhibitory or excitatory DREADD was infused into the substantia nigra. Rats then received clozapine-N-oxide either during task acquisition or after a stable performance baseline was reached. Inhibition of this pathway accelerated the development of risk preference in early sessions and increased risky choice during performance, but long-term inhibition actually improved decision making. Activation of this pathway had minimal effects. These results provide evidence for the involvement of the dopaminergic nigrostriatal pathway in cue-induced risk preference in females, therefore shedding light on its role in cost/benefit decision-making deficits and expanding our knowledge of the female dopaminergic system.

Dopamine neurons drive spatiotemporally heterogeneous striatal dopamine signals during learning

Environmental cues, through Pavlovian learning, become conditioned stimuli that invigorate and guide animals toward acquisition of rewards. Dopamine neurons in the ventral tegmental area (VTA) and substantia nigra (SNC) are crucial for this process. Dopamine neurons are embedded in a reciprocally connected network with their striatal targets, the functional organization of which remains poorly understood. Here, we investigated how learning during optogenetic Pavlovian cue conditioning of VTA or SNC dopamine neurons directs cue-evoked behavior and shapes subregion-specific striatal dopamine dynamics. We used a fluorescent dopamine biosensor to monitor dopamine in the nucleus accumbens (NAc) core and shell, dorsomedial striatum (DMS), and dorsolateral striatum (DLS). We demonstrate spatially heterogeneous, learning-dependent dopamine changes across striatal regions. While VTA stimulation evoked robust dopamine release in NAc core, shell, and DMS, cues predictive of this activation preferentially recruited dopamine release in NAc core, starting early in training, and DMS, late in training. Corresponding negative prediction error signals, reflecting a violation in the expectation of dopamine neuron activation, only emerged in the NAc core and DMS, and not the shell. Despite development of vigorous movement late in training, conditioned dopamine signals did not similarly emerge in the DLS, even during Pavlovian conditioning with SNC dopamine neuron activation, which elicited robust DLS dopamine release. Together, our studies show broad dissociation in the fundamental prediction and reward-related information generated by different dopamine neuron populations and signaled by dopamine across the striatum. Further, they offer new insight into how larger-scale plasticity across the striatal network emerges during Pavlovian learning to coordinate behavior.

Sub-second and multi-second dopamine dynamics underlie variability in human time perception

Timing behaviour and the perception of time are fundamental to cognitive and emotional processes in humans. In non-human model organisms, the neuromodulator dopamine has been associated with variations in timing behaviour, but the connection between variations in dopamine levels and the human experience of time has not been directly assessed. Here, we report how dopamine levels in human striatum, measured with sub-second temporal resolution during awake deep brain stimulation surgery, relate to participants' perceptual judgements of time intervals. Fast, phasic, dopaminergic signals were associated with underestimation of temporal intervals, whereas slower, tonic, decreases in dopamine were associated with poorer temporal precision. Our findings suggest a delicate and complex role for the dynamics and tone of dopaminergic signals in the conscious experience of time in humans.

Computational insights on asymmetrical D1 and D2 receptor-mediated chunking: implications for OCD and Schizophrenia

Repetitive thoughts and motor programs including perseveration are bridge symptoms characteristic of obsessive compulsive disorder (OCD), schizophrenia and in the co-morbid overlap of these conditions. The above pathologies are sensitive to altered activation and kinetics of dopamine D 1 and D 2 receptors that differently influence sequence learning and recall. Recognizing start and stop elements of motor and cognitive behaviors has crucial importance. During chunking, frequent components of temporal strings are concatenated into single units. We extended a published computational model (Asabuki et al. 2018), where two populations of neurons are connected and simulated in a reservoir computing framework. These neural pools were adopted to represent D1 and D2 striatal neuronal populations. We investigated how specific neural and striatal circuit parameters can influence start/stop signaling and found that asymmetric intra-network connection probabilities, synaptic weights and differential time constants may contribute to signaling of start/stop elements within learned sequences. Asymmetric coupling between the striatal D 1 and D 2 neural populations was also demonstrated to be beneficial. Our modeling results predict that dynamical differences between the two dopaminergic striatal populations and the interaction between them may play complementary roles in chunk boundary signaling. Start and stop dichotomies can arise from the larger circuit dynamics as well, since neural and intra-striatal connections only partially support a clear division of labor.

Sensory Reinforced Corticostriatal Plasticity

BACKGROUND

Regional changes in corticostriatal transmission induced by phasic dopaminergic signals are an essential feature of the neural network responsible for instrumental reinforcement during discovery of an action. However, the timing of signals that are thought to contribute to the induction of corticostriatal plasticity is difficult to reconcile within the framework of behavioural reinforcement learning, because the reinforcer is normally delayed relative to the selection and execution of causally-related actions.

OBJECTIVE

While recent studies have started to address the relevance of delayed reinforcement signals and their impact on corticostriatal processing, our objective was to establish a model in which a sensory reinforcer triggers appropriately delayed reinforcement signals relayed to the striatum via intact neuronal pathways and to investigate the effects on corticostriatal plasticity.

METHODS

We measured corticostriatal plasticity with electrophysiological recordings using a light flash as a natural sensory reinforcer, and pharmacological manipulations were applied in an in vivo anesthetized rat model preparation.

RESULTS

We demonstrate that the spiking of striatal neurons evoked by single-pulse stimulation of the motor cortex can be potentiated by a natural sensory reinforcer, operating through intact afferent pathways, with signal timing approximating that required for behavioural reinforcement. The pharmacological blockade of dopamine receptors attenuated the observed potentiation of corticostriatal neurotransmission.

CONCLUSION

This novel in vivo model of corticostriatal plasticity offers a behaviourally relevant framework to address the physiological, anatomical, cellular, and molecular bases of instrumental reinforcement learning.

Characterization of striatal dopamine projections across striatal subregions in behavioral flexibility

Behavioural flexibility is key to survival in a dynamic environmentWhile flexible, goal-directed behaviours are initially dependent on dorsomedial striatum, they become dependent on lateral striatum as behaviours become inflexible. Similarly, lesions of dopamine terminals in lateral striatum disrupt the development of inflexible habits. This work suggests that dopamine release in lateral striatum may drive inflexible behaviours, though few studies have investigated a causative role of subpopulations of striatal dopamine terminals in reversal learning, a measure of flexibility. Here, we performed two optogenetic experiments to activate dopamine terminals in dorsomedial (DMS), dorsolateral (DLS) or ventral (nucleus accumbens [NAc]) striatum in DAT-Cre mice that expressed channelrhodopsin-2 via viral injection (Experiment I) or through transgenic breeding with an Ai32 reporter line (Experiment II) to determine how specific dopamine subpopulations impact reversal learning. Mice performed a reversal task in which they self-stimulated DMS, DLS, or NAc dopamine terminals by pressing one of two levers before action-outcome lever contingencies were reversed. Largely consistent with presumed ventromedial/lateral striatal function, we found that mice self-stimulating medial dopamine terminals reversed lever preference following contingency reversal, while mice self-stimulating NAc showed parial flexibility, and DLS self-stimulation resulted in impaired reversal. Impairments in DLS mice were characterized by more regressive errors and reliance on lose-stay strategies following reversal, as well as reduced within-session learning, suggesting reward insensitivity and overreliance on previously learned actions. This study supports a model of striatal function in which DMS and ventral dopamine facilitate goal-directed responding, and DLS dopamine supports more inflexible responding.

Involvement of A13 dopaminergic neurons in prehensile movements but not reward in the rat

Tyrosine hydroxylase (TH)-containing neurons of the dopamine (DA) cell group A13 are well positioned to impact known DA-related functions as their descending projections innervate target regions that regulate vigilance, sensory integration, and motor execution. Despite this connectivity, little is known regarding the functionality of A13-DA circuits. Using TH-specific loss-of-function methodology and techniques to monitor population activity in transgenic rats in vivo, we investigated the contribution of A13-DA neurons in reward and movement-related actions. Our work demonstrates a role for A13-DA neurons in grasping and handling of objects but not reward. A13-DA neurons responded strongly when animals grab and manipulate food items, whereas their inactivation or degeneration prevented animals from successfully doing so-a deficit partially attributed to a reduction in grip strength. By contrast, there was no relation between A13-DA activity and food-seeking behavior when animals were tested on a reward-based task that did not include a reaching/grasping response. Motivation for food was unaffected, as goal-directed behavior for food items was in general intact following A13 neuronal inactivation/degeneration. An anatomical investigation confirmed that A13-DA neurons project to the superior colliculus (SC) and also demonstrated a novel A13-DA projection to the reticular formation (RF). These results establish a functional role for A13-DA neurons in prehensile actions that are uncoupled from the motivational factors that contribute to the initiation of forelimb movements and help position A13-DA circuits into the functional framework regarding centrally located DA populations and their ability to coordinate movement.

Ontogeny of working memory and behavioural flexibility in the free movement pattern (FMP) Y-maze in zebrafish

The acquisition of executive skills such as working memory, decision-making and adaptive responding occur at different stages of central nervous system development. Zebrafish (Danio rerio) are increasingly used in behavioural neuroscience for complex behavioural tasks, and there is a critical need to understand the ontogeny of their executive functions. Zebrafish across developmental stages (4, 7, 14, 30 and 90 days post fertilisation (dpf)), were assessed to track development of working memory (WM) and behavioural flexibility (BF) using the free movement pattern Y-maze (FMP Y-maze). Several differences in both WM and BF were identified during the transition from yolk-dependent to independent feeding. Specifically, WM is evident in all age groups, even from 4 dpf. However, BF is not developed until larvae start free feeding, and show significant improvement thereafter, with young adults (90 dpf) demonstrating the most well-defined BF. We demonstrate, for the first time, objective WM processes in 4 dpf zebrafish larvae. This suggests that those wishing to study WM in zebrafish may be able to do so from 4 dpf, thus drastically increasing throughput. In addition, we show that zebrafish follow distinct stages of cognitive development and age-related changes during the early developmental period. Finally, our findings indicate distinct WM and BF mechanisms, which may be useful to study for translational purposes.

Multiple dynamic interactions from basal ganglia direct and indirect pathways mediate action selection

The basal ganglia are known to be essential for action selection. However, the functional role of basal ganglia direct and indirect pathways in action selection remains unresolved. Here, by employing cell-type-specific neuronal recording and manipulation in mice trained in a choice task, we demonstrate that multiple dynamic interactions from the direct and indirect pathways control the action selection. While the direct pathway regulates the behavioral choice in a linear manner, the indirect pathway exerts a nonlinear inverted-U-shaped control over action selection, depending on the inputs and the network state. We propose a new center (direct)-surround (indirect)-context (indirect) 'Triple-control' functional model of basal ganglia, which can replicate the physiological and behavioral experimental observations that cannot be simply explained by either the traditional 'Go/No-go' or more recent 'Co-activation' model. These findings have important implications on understanding the basal ganglia circuitry and action selection in health and disease.

Multiple dynamic interactions from basal ganglia direct and indirect pathways mediate action selection

The basal ganglia are known to be essential for action selection. However, the functional role of basal ganglia direct and indirect pathways in action selection remains unresolved. Here by employing cell-type-specific neuronal recording and manipulation in mice trained in a choice task, we demonstrate that multiple dynamic interactions from the direct and indirect pathways control the action selection. While the direct pathway regulates the behavioral choice in a linear manner, the indirect pathway exerts a nonlinear inverted-U-shaped control over action selection, depending on the inputs and the network state. We propose a new center (direct) - surround (indirect) - context (indirect) "Triple-control" functional model of basal ganglia, which can replicate the physiological and behavioral experimental observations that cannot be simply explained by either the traditional "Go/No-go" or more recent "Co-activation" model. These findings have important implications on understanding the basal ganglia circuitry and action selection in health and disease.

Rethinking the network determinants of motor disability in Parkinson's disease

For roughly the last 30 years, the notion that striatal dopamine (DA) depletion was the critical determinant of network pathophysiology underlying the motor symptoms of Parkinson's disease (PD) has dominated the field. While the basal ganglia circuit model underpinning this hypothesis has been of great heuristic value, the hypothesis itself has never been directly tested. Moreover, studies in the last couple of decades have made it clear that the network model underlying this hypothesis fails to incorporate key features of the basal ganglia, including the fact that DA acts throughout the basal ganglia, not just in the striatum. Underscoring this point, recent work using a progressive mouse model of PD has shown that striatal DA depletion alone is not sufficient to induce parkinsonism and that restoration of extra-striatal DA signaling attenuates parkinsonian motor deficits once they appear. Given the broad array of discoveries in the field, it is time for a new model of the network determinants of motor disability in PD.

Activating the dorsomedial and ventral midbrain projections to the striatum differentially impairs goal-directed action in male mice

The cognitive symptoms of schizophrenia are wide ranging and include impaired goal-directed action. This could be driven by an increase in dopamine transmission in the dorsomedial striatum, a pathophysiological hallmark of schizophrenia. Although commonly associated with psychotic symptoms, dopamine signalling in this region also modulates associative learning that aids in the execution of actions. To gain a better understanding of the role of subcortical dopamine in learning and decision-making, we assessed goal-directed action in male mice using the cross-species outcome-specific devaluation task (ODT). First, we administered systemic amphetamine during training to determine the impact of altered dopaminergic signaling on associative learning. Second, we used pathway-specific chemogenetic approaches to activate the dorsomedial and ventral striatal pathways (that originate in the midbrain) to separately assess learning and performance. Amphetamine treatment during learning led to a dose-dependent impairment in goal-directed action. Activation of both striatal pathways during learning also impaired performance. However, when these pathways were activated during choice, only activation of the ventral pathway impaired goal-directed action. This suggests that elevated transmission in the dorsomedial striatal pathway impairs associative learning processes that guide the goal-directed execution of actions. By contrast, elevated transmission of the ventral striatal pathway disrupts the encoding of outcome values that are important for both associative learning and choice performance. These findings highlight the differential roles of the dorsomedial and ventral inputs into the striatum in goal-directed action and provides insight into how striatal dopamine signaling may contribute to the cognitive problems in those with schizophrenia.

Spontaneous behaviour is structured by reinforcement without explicit reward

Spontaneous animal behaviour is built from action modules that are concatenated by the brain into sequences1,2. However, the neural mechanisms that guide the composition of naturalistic, self-motivated behaviour remain unknown. Here we show that dopamine systematically fluctuates in the dorsolateral striatum (DLS) as mice spontaneously express sub-second behavioural modules, despite the absence of task structure, sensory cues or exogenous reward. Photometric recordings and calibrated closed-loop optogenetic manipulations during open field behaviour demonstrate that DLS dopamine fluctuations increase sequence variation over seconds, reinforce the use of associated behavioural modules over minutes, and modulate the vigour with which modules are expressed, without directly influencing movement initiation or moment-to-moment kinematics. Although the reinforcing effects of optogenetic DLS dopamine manipulations vary across behavioural modules and individual mice, these differences are well predicted by observed variation in the relationships between endogenous dopamine and module use. Consistent with the possibility that DLS dopamine fluctuations act as a teaching signal, mice build sequences during exploration as if to maximize dopamine. Together, these findings suggest a model in which the same circuits and computations that govern action choices in structured tasks have a key role in sculpting the content of unconstrained, high-dimensional, spontaneous behaviour.

Temporal scaling and computing time in neural circuits: Should we stop watching the clock and look for its gears?

Timing underlies a variety of functions, from walking to perceiving causality. Neural timing models typically fall into one of two categories-"ramping" and "population-clock" theories. According to ramping models, individual neurons track time by gradually increasing or decreasing their activity as an event approaches. To time different intervals, ramping neurons adjust their slopes, ramping steeply for short intervals and vice versa. In contrast, according to "population-clock" models, multiple neurons track time as a group, and each neuron can fire nonlinearly. As each neuron changes its rate at each point in time, a distinct pattern of activity emerges across the population. To time different intervals, the brain learns the population patterns that coincide with key events. Both model categories have empirical support. However, they often differ in plausibility when applied to certain behavioral effects. Specifically, behavioral data indicate that the timing system has a rich computational capacity, allowing observers to spontaneously compute novel intervals from previously learned ones. In population-clock theories, population patterns map to time arbitrarily, making it difficult to explain how different patterns can be computationally combined. Ramping models are viewed as more plausible, assuming upstream circuits can set the slope of ramping neurons according to a given computation. Critically, recent studies suggest that neurons with nonlinear firing profiles often scale to time different intervals-compressing for shorter intervals and stretching for longer ones. This "temporal scaling" effect has led to a hybrid-theory where, like a population-clock model, population patterns encode time, yet like a ramping neuron adjusting its slope, the speed of each neuron's firing adapts to different intervals. Here, we argue that these "relative" population-clock models are as computationally plausible as ramping theories, viewing population-speed and ramp-slope adjustments as equivalent. Therefore, we view identifying these "speed-control" circuits as a key direction for evaluating how the timing system performs computations. Furthermore, temporal scaling highlights that a key distinction between different neural models is whether they propose an absolute or relative time-representation. However, we note that several behavioral studies suggest the brain processes both scales, cautioning against a dichotomy.

The neural bases for timing of durations

Durations are defined by a beginning and an end, and a major distinction is drawn between durations that start in the present and end in the future ('prospective timing') and durations that start in the past and end either in the past or the present ('retrospective timing'). Different psychological processes are thought to be engaged in each of these cases. The former is thought to engage a clock-like mechanism that accurately tracks the continuing passage of time, whereas the latter is thought to engage a reconstructive process that utilizes both temporal and non-temporal information from the memory of past events. We propose that, from a biological perspective, these two forms of duration 'estimation' are supported by computational processes that are both reliant on population state dynamics but are nevertheless distinct. Prospective timing is effectively carried out in a single step where the ongoing dynamics of population activity directly serve as the computation of duration, whereas retrospective timing is carried out in two steps: the initial generation of population state dynamics through the process of event segmentation and the subsequent computation of duration utilizing the memory of those dynamics.

A tissue-like neurotransmitter sensor for the brain and gut

Neurotransmitters play essential roles in regulating neural circuit dynamics both in the central nervous system as well as at the peripheral, including the gastrointestinal tract^1-3. Their real-time monitoring will offer critical information for understanding neural function and diagnosing disease^1-3. However, bioelectronic tools to monitor the dynamics of neurotransmitters in vivo, especially in the enteric nervous systems, are underdeveloped. This is mainly owing to the limited availability of biosensing tools that are capable of examining soft, complex and actively moving organs. Here we introduce a tissue-mimicking, stretchable, neurochemical biological interface termed NeuroString, which is prepared by laser patterning of a metal-complexed polyimide into an interconnected graphene/nanoparticle network embedded in an elastomer. NeuroString sensors allow chronic in vivo real-time, multichannel and multiplexed monoamine sensing in the brain of behaving mouse, as well as measuring serotonin dynamics in the gut without undesired stimulations and perturbing peristaltic movements. The described elastic and conformable biosensing interface has broad potential for studying the impact of neurotransmitters on gut microbes, brain-gut communication and may ultimately be extended to biomolecular sensing in other soft organs across the body.

Dopamine modulates visual threat processing in the superior colliculus via D2 receptors

Innate defensive responses, unlearned behaviors improving individuals’ chances of survival, have been found to involve the dopamine (DA) system. In the superior colliculus (SC), known for its role in defensive behaviors to visual threats, neurons expressing dopaminergic receptors of type 1 (Drd1+) and of type 2 (Drd2+) have been identified. We hypothesized that SC neurons expressing dopaminergic receptors may play a role in promoting innate defensive responses. Optogenetic activation of SC Drd2+ neurons, but not Drd1+ neurons, triggered defensive behaviors. Chemogenetic inhibition of SC Drd2+ neurons decreased looming-induced defensive behaviors, as well as pretreatment with the pharmacological Drd2+ agonist quinpirole, suggesting an essential role of Drd2 receptors in the regulation of innate defensive behavior. Input and output viral tracing revealed SC Drd2+ neurons mainly receive moderate inputs from the locus coeruleus (LC). Our results suggest a sophisticated regulatory role of DA and its receptor system in innate defensive behavior.

•

Optogenetic activation of SC Drd2 + neurons, but not Drd1 + , induces defensive behaviors

•

Repeated activation of SC Drd2 + provokes aversive memory and depression-like behavior

•

Chemogenetic and pharmacological inhibition of SC Drd2 + impaired defensive behaviors

•

Monosynaptic tracing revealed SC Drd2 + neurons mainly receive TH + projections from LC

Simultaneous Measurement of Striatal Dopamine and Hydrogen Peroxide Transients Associated with L-DOPA Induced Rotation in Hemiparkinsonian Rats

Parkinson's disease (PD) is a neurodegenerative disorder commonly treated with levodopa (L-DOPA), which eventually induces abnormal involuntary movements (AIMs). The neurochemical contributors to these dyskinesias are unknown; however, several lines of evidence indicate an interplay of dopamine (DA) and oxidative stress. Here, DA and hydrogen peroxide (H2O2) were simultaneously monitored at discrete recording sites in the dorsal striata of hemiparkinsonian rats using fast-scan cyclic voltammetry. Mass spectrometry imaging validated the lesions. Hemiparkinsonian rats exhibited classic L-DOPA-induced AIMs and rotations as well as increased DA and H2O2 tone over saline controls after 1 week of treatment. By week 3, DA tone remained elevated beyond that of controls, but H2O2 tone was largely normalized. At this time point, rapid chemical transients were time-locked with spontaneous bouts of rotation. Striatal H2O2 rapidly increased with the initiation of contraversive rotational behaviors in lesioned L-DOPA animals, in both hemispheres. DA signals simultaneously decreased with rotation onset. The results support a role for these striatal neuromodulators in the adaptive changes that occur with L-DOPA treatment in PD and reveal a precise interplay between DA and H2O2 in the initiation of involuntary locomotion.

Linking Pain and Motor Control: Conceptualization of Movement Deficits in Patients With Painful Conditions

When people experience or expect pain, they move differently. Pain-altered movement strategies, collectively described here as pain-related movement dysfunction (PRMD), may persist well after pain resolves and, ultimately, may result in altered kinematics and kinetics, future reinjury, and disability. Although PRMD may manifest as abnormal movements that are often evident in clinical assessment, the underlying mechanisms are complex, engaging sensory-perceptual, cognitive, psychological, and motor processes. Motor control theories provide a conceptual framework to determine, assess, and target processes that contribute to normal and abnormal movement and thus are important for physical therapy and rehabilitation practice. Contemporary understanding of motor control has evolved from reflex-based understanding to a more complex task-dependent interaction between cognitive and motor systems, each with distinct neuroanatomic substrates. Though experts have recognized the importance of motor control in the management of painful conditions, there is no comprehensive framework that explicates the processes engaged in the control of goal-directed actions, particularly in the presence of pain. This Perspective outlines sensory-perceptual, cognitive, psychological, and motor processes in the contemporary model of motor control, describing the neural substrates underlying each process and highlighting how pain and anticipation of pain influence motor control processes and consequently contribute to PRMD. Finally, potential lines of future inquiry-grounded in the contemporary model of motor control-are outlined to advance understanding and improve the assessment and treatment of PRMD.

IMPACT

This Perspective proposes that approaching PRMD from a contemporary motor control perspective will uncover key mechanisms, identify treatment targets, inform assessments, and innovate treatments across sensory-perceptual, cognitive, and motor domains, all of which have the potential to improve movement and functional outcomes in patients with painful conditions.

Coincidence of cholinergic pauses, dopaminergic activation and depolarisation of spiny projection neurons drives synaptic plasticity in the striatum

Dopamine-dependent long-term plasticity is believed to be a cellular mechanism underlying reinforcement learning. In response to reward and reward-predicting cues, phasic dopamine activity potentiates the efficacy of corticostriatal synapses on spiny projection neurons (SPNs). Since phasic dopamine activity also encodes other behavioural variables, it is unclear how postsynaptic neurons identify which dopamine event is to induce long-term plasticity. Additionally, it is unknown how phasic dopamine released from arborised axons can potentiate targeted striatal synapses through volume transmission. To examine these questions we manipulated striatal cholinergic interneurons (ChIs) and dopamine neurons independently in two distinct in vivo paradigms. We report that long-term potentiation (LTP) at corticostriatal synapses with SPNs is dependent on the coincidence of pauses in ChIs and phasic dopamine activation, critically accompanied by SPN depolarisation. Thus, the ChI pause defines the time window for phasic dopamine to induce plasticity, while depolarisation of SPNs constrains the synapses eligible for plasticity.

Secondary auditory cortex mediates a sensorimotor mechanism for action timing

The ability to accurately determine when to perform an action is a fundamental brain function and vital to adaptive behavior. The behavioral mechanism and neural circuit for action timing, however, remain largely unknown. Using a new, self-paced action timing task in mice, we found that deprivation of auditory, but not somatosensory or visual input, disrupts learned action timing. The hearing effect was dependent on the auditory feedback derived from the animal's own actions, rather than passive environmental cues. Neuronal activity in the secondary auditory cortex was found to be both correlated with and necessary for the proper execution of learned action timing. Closed-loop, action-dependent optogenetic stimulation of the specific task-related neuronal population within the secondary auditory cortex rescued the key features of learned action timing under auditory deprivation. These results unveil a previously underappreciated sensorimotor mechanism in which the secondary auditory cortex transduces self-generated audiomotor feedback to control action timing.

Ginsenoside Rg1 Plays a Neuroprotective Role in Regulating the Iron-Regulated Proteins and Against Lipid Peroxidation in Oligodendrocytes

Parkinson's disease (PD) is the second most common neurodegenerative disorder. Progressive loss of dopaminergic neurons in the substantia nigra (SN) is one of the major pathological changes. However, the reasons for the dopaminergic neuron loss are still ambiguous and further studies are needed to evaluate the in-depth mechanisms of neuron death. Oxidative stress is a significant factor causing neuronal damage. Dopaminergic neurons in the SN are susceptible to oxidative stress, which is closely associated with iron dyshomeostasis in the brain. Ginsenoside Rg1 from ginseng plays a crucial role in neuroprotective effects through anti-inflammation and attenuating the aggregation of abnormal α-synuclein. In our study, we established a chronic PD mouse model by 1-methyl-4-phenyl-1, 2, 3, 6-tetrahydropyridine combined with probenecid and explored the effect of Rg1 on the oxidative stress and brain iron homeostasis. Rg1 was verified to improve the level of tyrosine hydroxylase and anti-oxidant stress. In addition, Rg1 maintained the iron-regulated protein homeostasis by increasing the expression of ferritin heavy chain and decreasing ferritin light chain in oligodendrocytes, especially the mature oligodendrocytes (OLs). Furthermore, Rg1 had a positive effect on the myelin sheath protection and increased the number of mature oligodendrocytes, proved by the increased staining of myelin basic protein and CC-1. In conclusion, Rg1 could play a neuroprotective role through remitting the iron-regulated protein dyshomeostasis by ferritin and against lipid peroxidation stress in oligodendrocytes.

Gut Barrier Dysfunction and Type 2 Immunity: Implications for Compulsive Behavior

To date, much of the focus of gut-brain axis research has been on gut microbiota regulation of anxiety and stress-related behaviors. Much less attention has been directed to potential connections between gut microbiota and compulsive behavior. Here, we discuss a potential link between gut barrier dysfunction and compulsive behavior that is mediated through "type 2" rather than "type 1" inflammation. We examine connections between compulsive behavior and type 2 inflammation in Tourette syndrome, obsessive-compulsive disorder, autism, addiction, and post-traumatic stress disorder. Next, we discuss potential connections between gut barrier dysfunction, type 2 inflammation, and compulsive behavior. We posit a potential mechanism whereby gut barrier dysfunction-associated type 2 inflammation may drive compulsive behavior through histamine regulation of dopamine neurotransmission. Finally, we discuss the possibility of exploiting the greater accessibility of the gut relative to the brain in identifying targets to treat compulsive behavior disorders.

Slowly evolving dopaminergic activity modulates the moment-to-moment probability of reward-related self-timed movements

Clues from human movement disorders have long suggested that the neurotransmitter dopamine plays a role in motor control, but how the endogenous dopaminergic system influences movement is unknown. Here we examined the relationship between dopaminergic signaling and the timing of reward-related movements in mice. Animals were trained to initiate licking after a self-timed interval following a start-timing cue; reward was delivered in response to movements initiated after a criterion time. The movement time was variable from trial-to-trial, as expected from previous studies. Surprisingly, dopaminergic signals ramped-up over seconds between the start-timing cue and the self-timed movement, with variable dynamics that predicted the movement/reward time on single trials. Steeply rising signals preceded early lick-initiation, whereas slowly rising signals preceded later initiation. Higher baseline signals also predicted earlier self-timed movements. Optogenetic activation of dopamine neurons during self-timing did not trigger immediate movements, but rather caused systematic early-shifting of movement initiation, whereas inhibition caused late-shifting, as if modulating the probability of movement. Consistent with this view, the dynamics of the endogenous dopaminergic signals quantitatively predicted the moment-by-moment probability of movement initiation on single trials. We propose that ramping dopaminergic signals, likely encoding dynamic reward expectation, can modulate the decision of when to move.

Neural Circuitry of Salience and Reward Processing in Psychosis

The processing of salient and rewarding stimuli is integral to engaging our attention, stimulating anticipation for future events, and driving goal-directed behaviors. Widespread impairments in these processes are observed in psychosis, which may be associated with worse functional outcomes or mechanistically linked to the development of symptoms. Here, we summarize the current knowledge of behavioral and functional neuroimaging in salience, prediction error, and reward. Although each is a specific process, they are situated in multiple feedback and feedforward systems integral to decision making and cognition more generally. We argue that the origin of salience and reward processing dysfunctions may be centered in the subcortex during the earliest stages of psychosis, with cortical abnormalities being initially more spared but becoming more prominent in established psychotic illness/schizophrenia. The neural circuits underpinning salience and reward processing may provide targets for delaying or preventing progressive behavioral and neurobiological decline.

Nigrostriatal dopamine signals sequence-specific action-outcome prediction errors

Dopamine has been suggested to encode cue-reward prediction errors during Pavlovian conditioning, signaling discrepancies between actual versus expected reward predicted by the cues.^1-5 While this theory has been widely applied to reinforcement learning concerning instrumental actions, whether dopamine represents action-outcome prediction errors and how it controls sequential behavior remain largely unknown. The vast majority of previous studies examining dopamine responses primarily have used discrete reward-predictive stimuli,^1-15 whether Pavlovian conditioned stimuli for which no action is required to earn reward or explicit discriminative stimuli that essentially instruct an animal how and when to respond for reward. Here, by training mice to perform optogenetic intracranial self-stimulation, we examined how self-initiated goal-directed behavior influences nigrostriatal dopamine transmission during single and sequential instrumental actions, in behavioral contexts with minimal overt changes in the animal's external environment. We found that dopamine release evoked by direct optogenetic stimulation was dramatically reduced when delivered as the consequence of the animal's own action, relative to non-contingent passive stimulation. This dopamine suppression generalized to food rewards was specific to the reinforced action, was temporally restricted to counteract the expected outcome, and exhibited sequence-selectivity consistent with hierarchical control of sequential behavior. These findings demonstrate that nigrostriatal dopamine signals sequence-specific prediction errors in action-outcome associations, with fundamental implications for reinforcement learning and instrumental behavior in health and disease.

Understanding identification-based trust in the light of affiliative bonding: Meta-analytic neuroimaging evidence

Trust is vital for establishing social relationships and is a crucial precursor for affiliative bonds. Investigations explored the neuropsychological bases of trust separately (e.g., measured by the trust game) and affiliative bonding (e.g., measured by parental care, pair-bonding, or friendship). However, direct empirical support for the shared neural mechanisms between trust and affiliative bonding is missing. Here, we conducted a coordinate-based meta-analysis on functional magnetic resonance imaging studies on interpersonal trust and affiliative bonding using the activation likelihood estimation method. Our results demonstrated that decisions to trust strangers in repeated interactions (i.e., identification-based trust) engaged the ventral striatum (vSTR, part of the mesolimbic dopaminergic pathway), likely signaling the reward anticipation. Further, both feedbacks in repeated interactions and affiliative bonding engaged the dorsal striatum (dSTR, part of the nigrostriatal dopaminergic pathway), likely encoding learning dynamics. Our findings suggest that identification-based trust can be understood in the light of affiliative bonding, involving the mesocorticolimbic "reward" pathway (vSTR) and nigrostriatal "habit formation" pathway (dSTR) in building and sustaining social relationships.

Dopamine Axons in Dorsal Striatum Encode Contralateral Visual Stimuli and Choices

The striatum plays critical roles in visually-guided decision-making and receives dense axonal projections from midbrain dopamine neurons. However, the roles of striatal dopamine in visual decision-making are poorly understood. We trained male and female mice to perform a visual decision task with asymmetric reward payoff, and we recorded the activity of dopamine axons innervating striatum. Dopamine axons in the dorsomedial striatum (DMS) responded to contralateral visual stimuli and contralateral rewarded actions. Neural responses to contralateral stimuli could not be explained by orienting behavior such as eye movements. Moreover, these contralateral stimulus responses persisted in sessions where the animals were instructed to not move to obtain reward, further indicating that these signals are stimulus-related. Lastly, we show that DMS dopamine signals were qualitatively different from dopamine signals in the ventral striatum (VS), which responded to both ipsilateral and contralateral stimuli, conforming to canonical prediction error signaling under sensory uncertainty. Thus, during visual decisions, DMS dopamine encodes visual stimuli and rewarded actions in a lateralized fashion, and could facilitate associations between specific visual stimuli and actions.SIGNIFICANCE STATEMENT While the striatum is central to goal-directed behavior, the precise roles of its rich dopaminergic innervation in perceptual decision-making are poorly understood. We found that in a visual decision task, dopamine axons in the dorsomedial striatum (DMS) signaled stimuli presented contralaterally to the recorded hemisphere, as well as the onset of rewarded actions. Stimulus-evoked signals persisted in a no-movement task variant. We distinguish the patterns of these signals from those in the ventral striatum (VS). Our results contribute to the characterization of region-specific dopaminergic signaling in the striatum and highlight a role in stimulus-action association learning.

Neural Representation of Costs and Rewards in Decision Making

Decision making is crucial for animal survival because the choices they make based on their current situation could influence their future rewards and could have potential costs. This review summarises recent developments in decision making, discusses how rewards and costs could be encoded in the brain, and how different options are compared such that the most optimal one is chosen. The reward and cost are mainly encoded by the forebrain structures (e.g., anterior cingulate cortex, orbitofrontal cortex), and their value is updated through learning. The recent development on dopamine and the lateral habenula's role in reporting prediction errors and instructing learning will be emphasised. The importance of dopamine in powering the choice and accounting for the internal state will also be discussed. While the orbitofrontal cortex is the place where the state values are stored, the anterior cingulate cortex is more important when the environment is volatile. All of these structures compare different attributes of the task simultaneously, and the local competition of different neuronal networks allows for the selection of the most appropriate one. Therefore, the total value of the task is not encoded as a scalar quantity in the brain but, instead, as an emergent phenomenon, arising from the computation at different brain regions.

Chronic Augmentation of Endocannabinoid Levels Persistently Increases Dopaminergic Encoding of Reward Cost and Motivation

Motivational deficits characterized by an unwillingness to overcome effortful costs are a common feature of neuropsychiatric and neurologic disorders that are insufficiently understood and treated. Dopamine (DA) signaling in the nucleus accumbens (NAc) facilitates goal-seeking, but how NAc DA release encodes motivationally salient stimuli to influence effortful investment is not clear. Using fast-scan cyclic voltammetry in male and female mice, we find that NAc DA release diametrically responds to cues signaling increasing cost of reward, while DA release to the reward itself is unaffected by its cost. Because endocannabinoid (eCB) signaling facilitates goal seeking and NAc DA release, we further investigated whether repeated augmentation of the eCB 2-arachidonoylglycerol with a low dose of a monoacylglycerol lipase (MAGL) inhibitor facilitates motivation and DA signaling without the development of tolerance. We find that chronic MAGL treatment stably facilitates goal seeking and DA encoding of prior reward cost, providing critical insight into the neurobiological mechanisms of a viable treatment for motivational deficits.SIGNIFICANCE STATEMENT Decades of work has established a fundamental role for dopamine neurotransmission in motivated behavior and cue-reward learning, but how dopaminergic encoding of cues associates with motivated action has remained unclear. Specifically, how dopamine neurons signal future and prior reward cost, and whether this can be modified to influence motivational set points is not known. The current study provides important insight into how dopamine neurons encode motivationally relevant stimuli to influence goal-directed action and supports cannabinoid-based therapies for treatment of motivational disorders.

Reactivating a positive feedback loop VTA-BLA-NAc circuit associated with positive experience ameliorates the attenuated reward sensitivity induced by chronic stress

Both genetic predisposition and life events, particularly life stress, are thought to increase the risk for depression. Reward sensitivity appears to be attenuated in major depressive disorder (MDD), suggesting deficits in reward processing in these patients. We identified the VTA-BLA-NAc circuit as being activated by sex reward, and the VTA neurons that respond to sex reward are mostly dopaminergic. Acute or chronic reactivation of this circuit ameliorates the reward insensitivity induced by chronic restraint stress. Our histological and electrophysiological results show that the VTA neuron subpopulation responding to restraint stress, predominantly GABAergic neurons, inhibits the responsiveness of VTA dopaminergic neurons to reward stimuli, which is probably the mechanism by which stress modulates the reward processing neural circuits and subsequently disrupts reward-related behaviours. Furthermore, we found that the VTA-BLA-NAc circuit is a positive feedback loop. Blocking the projections from the BLA to the NAc associated with sex reward increases the excitability of VTA GABAergic neurons and decreases the excitability of VTA dopaminergic neurons, while activating this pathway decreases the excitability of VTA GABAergic neurons and increases the excitability of VTA dopaminergic neurons, which may be the cellular mechanism by which the VTA-BLA-NAc circuit associated with sex reward ameliorates the attenuated reward sensitivity induced by chronic stress.

Dopaminergic Dysregulation in Syndromic Autism Spectrum Disorders: Insights From Genetic Mouse Models

Autism spectrum disorder (ASD) is a neurodevelopmental disorder defined by altered social interaction and communication, and repetitive, restricted, inflexible behaviors. Approximately 1.5-2% of the general population meet the diagnostic criteria for ASD and several brain regions including the cortex, amygdala, cerebellum and basal ganglia have been implicated in ASD pathophysiology. The midbrain dopamine system is an important modulator of cellular and synaptic function in multiple ASD-implicated brain regions via anatomically and functionally distinct dopaminergic projections. The dopamine hypothesis of ASD postulates that dysregulation of dopaminergic projection pathways could contribute to the behavioral manifestations of ASD, including altered reward value of social stimuli, changes in sensorimotor processing, and motor stereotypies. In this review, we examine the support for the idea that cell-autonomous changes in dopaminergic function are a core component of ASD pathophysiology. We discuss the human literature supporting the involvement of altered dopamine signaling in ASD including genetic, brain imaging and pharmacologic studies. We then focus on genetic mouse models of syndromic neurodevelopmental disorders in which single gene mutations lead to increased risk for ASD. We highlight studies that have directly examined dopamine neuron number, morphology, physiology, or output in these models. Overall, we find considerable support for the idea that the dopamine system may be dysregulated in syndromic ASDs; however, there does not appear to be a consistent signature and some models show increased dopaminergic function, while others have deficient dopamine signaling. We conclude that dopamine dysregulation is common in syndromic forms of ASD but that the specific changes may be unique to each genetic disorder and may not account for the full spectrum of ASD-related manifestations.

Bidirectional role of microtubule dynamics in the acquisition and maintenance of temporal information in dorsolateral striatum

Accurate and precise timing is crucial for complex and purposeful behaviors, such as foraging for food or playing a musical instrument. The brain is capable of processing temporal information in a coordinated manner, as if it contains an 'internal clock'. Similar to the need for the brain to orient itself in space in order to understand its surroundings, temporal orientation and tracking is an essential component of cognition as well. While there have been multiple models explaining the neural correlates of timing, independent lines of research appear to converge on the conclusion that populations of neurons in the dorsal striatum encode information relating to where a subject is in time relative to an anticipated goal. Similar to other learning processes, acquisition and maintenance of this temporal information is dependent on synaptic plasticity. Microtubules are cytoskeletal proteins that have been implicated in synaptic plasticity mechanisms and therefore are considered key elements in learning and memory. In this study, we investigated the role of microtubule dynamics in temporal learning by local infusions of microtubule stabilizing and destabilizing agents into the dorsolateral striatum. Our results suggested a bidirectional role for microtubules in timing, such that microtubule stabilization improves the maintenance of learned target durations, but impairs the acquisition of a novel duration. On the other hand, microtubule destabilization enhances the acquisition of novel target durations, while compromising the maintenance of previously learned durations. These findings suggest that microtubule dynamics plays an important role in synaptic plasticity mechanisms in the dorsolateral striatum, which in turn modulates temporal learning and time perception.

Association of the OPRM1 A118G polymorphism and Pavlovian-to-instrumental transfer: Clinical relevance for alcohol dependence

BACKGROUND

Pavlovian-to-instrumental transfer (PIT) quantifies the extent to which a stimulus that has been associated with reward or punishment alters operant behaviour. In alcohol dependence (AD), the PIT effect serves as a paradigmatic model of cue-induced relapse. Preclinical studies have suggested a critical role of the opioid system in modulating Pavlovian-instrumental interactions. The A118G polymorphism of the OPRM1 gene affects opioid receptor availability and function. Furthermore, this polymorphism interacts with cue-induced approach behaviour and is a potential biomarker for pharmacological treatment response in AD. In this study, we tested whether the OPRM1 polymorphism is associated with the PIT effect and relapse in AD.

METHODS

Using a PIT task, we examined three independent samples: young healthy subjects (N = 161), detoxified alcohol-dependent patients (N = 186) and age-matched healthy controls (N = 105). We used data from a larger study designed to assess the role of learning mechanisms in the development and maintenance of AD. Subjects were genotyped for the A118G (rs1799971) polymorphism of the OPRM1 gene. Relapse was assessed after three months.

RESULTS

In all three samples, participants with the minor OPRM1 G-Allele (G+ carriers) showed increased expression of the PIT effect in the absence of learning differences. Relapse was not associated with the OPRM1 polymorphism. Instead, G+ carriers displaying increased PIT effects were particularly prone to relapse.

CONCLUSION

These results support a role for the opioid system in incentive salience motivation. Furthermore, they inform a mechanistic model of aberrant salience processing and are in line with the pharmacological potential of opioid receptor targets in the treatment of AD.

Dorsal striatum and the temporal expectancy of an aversive event in Pavlovian odor fear learning

Interval timing, the ability to encode and retrieve the memory of intervals from seconds to minutes, guides fundamental animal behaviors across the phylogenetic tree. In Pavlovian fear conditioning, an initially neutral stimulus (conditioned stimulus, CS) predicts the arrival of an aversive unconditioned stimulus (US, generally a mild foot-shock) at a fixed time interval. Although some studies showed that temporal relations between CS and US events are learned from the outset of conditioning, the question of the memory of time and its underlying neural network in fear conditioning is still poorly understood. The aim of the present study was to investigate the role of the dorsal striatum in timing intervals in odor fear conditioning in male rats. To assess the animal's interval timing ability in this paradigm, we used the respiratory frequency. This enabled us to detect the emergence of temporal patterns related to the odor-shock time interval from the early stage of learning, confirming that rats are able to encode the odor-shock time interval after few training trials. We carried out reversible inactivation of the dorsal striatum before the acquisition session and before a shift in the learned time interval, and measured the effects of this treatment on the temporal pattern of the respiratory rate. In addition, using intracerebral microdialysis, we monitored extracellular dopamine level in the dorsal striatum throughout odor-shock conditioning and in response to a shift of the odor-shock time interval. Contrary to our initial predictions based on the existing literature on interval timing, we found evidence suggesting that transient inactivation of the dorsal striatum may favor a more precocious buildup of the respiratory frequency's temporal pattern during the odor-shock interval in a manner that reflected the duration of the interval. Our data further suggest that the conditioning and the learning of a novel time interval were associated with a decrease in dopamine level in the dorsal striatum, but not in the nucleus accumbens. These findings prompt a reassessment of the role of the striatum and striatal dopamine in interval timing, at least when considering Pavlovian aversive conditioning.

The role of dopamine in action control: Insights from medication effects in Parkinson's disease

Parkinson's disease (PD) is a neurological disorder associated primarily with overt motor symptoms. Several studies show that PD is additionally accompanied by impairments in covert cognitive processes underlying goal-directed motor functioning (e.g., action planning, conflict adaptation, inhibition), and that dopaminergic medication may modulate these action control components. In this review we aim to leverage findings from studies in this domain to elucidate the role of dopamine (DA) in action control. A qualitative review of studies that investigated the effects of medication status (on vs. off) on action control in PD suggests a component-specific role for DA in action control, although the expression of medication effects depends on characteristics of both the patients and experimental tasks used to measure action control. We discuss these results in the light of findings from other research lines examining the role of DA in action control (e.g., animal research, pharmacology), and recommend that future studies use multi-method, within-subject approaches to model DA effects on action control across different components as well as underlying striatal pathways (ventral vs. dorsal).

Tonic firing mode of midbrain dopamine neurons continuously tracks reward values changing moment-by-moment

Animal behavior is regulated based on the values of future rewards. The phasic activity of midbrain dopamine neurons signals these values. Because reward values often change over time, even on a subsecond-by-subsecond basis, appropriate behavioral regulation requires continuous value monitoring. However, the phasic dopamine activity, which is sporadic and has a short duration, likely fails continuous monitoring. Here, we demonstrate a tonic firing mode of dopamine neurons that effectively tracks changing reward values. We recorded dopamine neuron activity in monkeys during a Pavlovian procedure in which the value of a cued reward gradually increased or decreased. Dopamine neurons tonically increased and decreased their activity as the reward value changed. This tonic activity was evoked more strongly by non-burst spikes than burst spikes producing a conventional phasic activity. Our findings suggest that dopamine neurons change their firing mode to effectively signal reward values in a given situation.

Rational inattention and tonic dopamine

Slow-timescale (tonic) changes in dopamine (DA) contribute to a wide variety of processes in reinforcement learning, interval timing, and other domains. Furthermore, changes in tonic DA exert distinct effects depending on when they occur (e.g., during learning vs. performance) and what task the subject is performing (e.g., operant vs. classical conditioning). Two influential theories of tonic DA-the average reward theory and the Bayesian theory in which DA controls precision-have each been successful at explaining a subset of empirical findings. But how the same DA signal performs two seemingly distinct functions without creating crosstalk is not well understood. Here we reconcile the two theories under the unifying framework of 'rational inattention,' which (1) conceptually links average reward and precision, (2) outlines how DA manipulations affect this relationship, and in so doing, (3) captures new empirical phenomena. In brief, rational inattention asserts that agents can increase their precision in a task (and thus improve their performance) by paying a cognitive cost. Crucially, whether this cost is worth paying depends on average reward availability, reported by DA. The monotonic relationship between average reward and precision means that the DA signal contains the information necessary to retrieve the precision. When this information is needed after the task is performed, as presumed by Bayesian inference, acute manipulations of DA will bias behavior in predictable ways. We show how this framework reconciles a remarkably large collection of experimental findings. In reinforcement learning, the rational inattention framework predicts that learning from positive and negative feedback should be enhanced in high and low DA states, respectively, and that DA should tip the exploration-exploitation balance toward exploitation. In interval timing, this framework predicts that DA should increase the speed of the internal clock and decrease the extent of interference by other temporal stimuli during temporal reproduction (the central tendency effect). Finally, rational inattention makes the new predictions that these effects should be critically dependent on the controllability of rewards, that post-reward delays in intertemporal choice tasks should be underestimated, and that average reward manipulations should affect the speed of the clock-thus capturing empirical findings that are unexplained by either theory alone. Our results suggest that a common computational repertoire may underlie the seemingly heterogeneous roles of DA.

Dopamine as a Multifunctional Neurotransmitter in Gastropod Molluscs: An Evolutionary Hypothesis

AbstractThe catecholamine 3,4-dihydroxyphenethylamine, or dopamine, acts as a neurotransmitter across a broad phylogenetic spectrum. Functions attributed to dopamine in the mammalian brain include regulation of motor circuits, valuation of sensory stimuli, and mediation of reward or reinforcement signals. Considerable evidence also supports a neurotransmitter role for dopamine in gastropod molluscs, and there is growing appreciation for its potential common functions across phylogeny. This article reviews evidence for dopamine's transmitter role in the nervous systems of gastropods. The functional properties of identified dopaminergic neurons in well-characterized neural circuits suggest a hypothetical incremental sequence by which dopamine accumulated its diverse roles. The successive acquisition of dopamine functions is proposed in the context of gastropod feeding behavior: (1) sensation of potential nutrients, (2) activation of motor circuits, (3) selection of motor patterns from multifunctional circuits, (4) valuation of sensory stimuli with reference to internal state, (5) association of motor programs with their outcomes, and (6) coincidence detection between sensory stimuli and their consequences. At each stage of this sequence, it is proposed that existing functions of dopaminergic neurons favored their recruitment to fulfill additional information processing demands. Common functions of dopamine in other intensively studied groups, ranging from mammals and insects to nematodes, suggest an ancient origin for this progression.

Precisely timed dopamine signals establish distinct kinematic representations of skilled movements

Brain dopamine is critical for normal motor control, as evidenced by its importance in Parkinson Disease and related disorders. Current hypotheses are that dopamine influences motor control by 'invigorating' movements and regulating motor learning. Most evidence for these aspects of dopamine function comes from simple tasks (e.g. lever pressing). Therefore, the influence of dopamine on motor skills requiring multi-joint coordination is unknown. To determine the effects of precisely timed dopamine manipulations on the performance of a complex, finely coordinated dexterous skill, we optogenetically stimulated or inhibited midbrain dopamine neurons as rats performed a skilled reaching task. We found that reach kinematics and coordination between gross and fine movements progressively changed with repeated manipulations. However, once established, rats transitioned abruptly between aberrant and baseline reach kinematics in a dopamine-dependent manner. These results suggest that precisely timed dopamine signals have immediate and long-term influences on motor skill performance, distinct from simply 'invigorating' movement.

In-silico prediction of the beta carboline alkaloids Harmine and Harmaline as potent drug candidates for the treatment of Parkinson's disease

BACKGROUND

Parkinson's disease (PD) is a progressive neurodegenerative disease manifested by core symptoms of loss of motor control and postural instability. Loss of dopaminergic neurons is the cause of PD, thus enhancing dopamine level by pharmacological treatment is one of the key treatment strategies for PD. However, limitations of current treatment strategies open the possibility of novel drug candidates for the treatment of PD.

OBJECTIVE

To investigate the anti-PD potential of Harmine and Harmaline. We aim to evaluate the therapeutic potential of Harmine and Harmaline by in-silico approaches; molecular docking, pharmacokinetic and Prediction of Activity Spectra for Substances (PASS) analysis were used for evaluating the therapeutic potential of Harmine and Harmaline and standard drug levodopa (L-DOPA).

METHODS

Auto dock vina was used for molecular docking of all three compounds against D2- and D3- dopamine receptors. The pharmacokinetics (PKs) and toxicity profile were predicted by pkCSM and the pharmacological activity was predicted by PASS analysis.

RESULTS

Molecular docking showed a higher binding affinity of Harmine and Harmaline as compared to L-DOPA, and these results were supported by in-silico pharmacokinetic and toxicity profiling. Moreover, PASS analysis showed anti-PD activi-ty of Harmine and Harmaline.

CONCLUSION

Harmine and Harmaline exhibit higher binding affinity towards D2- and D3- dopamine receptors compared to L-DOPA, and PKs and toxicity profile support their potential as drug candidates for PD therapy.

Dopamine D2 receptor signaling on iMSNs is required for initiation and vigor of learned actions

Striatal dopamine D2 receptors (D2Rs) are important for motor output. Selective deletion of D2Rs from indirect pathway-projecting medium spiny neurons (iMSNs) impairs locomotor activities in a task-specific manner. However, the role of D2Rs in the initiation of motor actions in reward seeking and taking is not fully understood, and there is little information about how receptors contribute under different task demands and with different outcome types. The iMSN-D2Rs modulate neuronal activity and synaptic transmission, exerting control on circuit functions that may play distinct roles in action learning and performance. Selective deletion of D2Rs on iMSNs resulted in slower action initiation and response rate in an instrumental conditioning task, but only when performance demand was increased. The iMSN-Drd2KO mice were also slower to initiate swimming in a T-maze procedural learning task but were unimpaired in cognitive function and behavioral flexibility. In contrast, in a Pavlovian discrimination learning task, iMSN-Drd2KO mice exhibited normal acquisition and extinction of rewarded responding. The iMSN-Drd2KO mice showed performance deficits at all phases of rotarod skill learning. These findings reveal that dopamine modulation through iMSN-D2Rs influences the ability to self-initiate actions, as well as the willingness and/or vigor with which these responses are performed. However, these receptors seem to have little influence on simple associative learning or on stimulus-driven responding. The loss of normal D2R roles may contribute to disorders in which impaired dopamine signaling leads to hypokinesia or impaired initiation of specific voluntary actions.