Neural Circuitry of Reward Prediction Error

A Basal Ganglia Circuit Sufficient to Guide Birdsong Learning

Learning vocal behaviors, like speech and birdsong, is thought to rely on continued performance evaluation. Whether candidate performance evaluation circuits in the brain are sufficient to guide vocal learning is not known. Here, we test the sufficiency of VTA projections to the vocal basal ganglia in singing zebra finches, a songbird species that learns to produce a complex and stereotyped multi-syllabic courtship song during development. We optogenetically manipulate VTA axon terminals in singing birds contingent on how the pitch of an individual song syllable is naturally performed. We find that optical inhibition and excitation of VTA terminals are each sufficient to reliably guide learned changes in song. Inhibition and excitation have opponent effects on future performances of targeted song syllables, consistent with positive and negative reinforcement of performance outcomes. These findings define a central role for reinforcement mechanisms in learning vocalizations and demonstrate minimal circuit elements for learning vocal behaviors. VIDEO ABSTRACT.

Nucleus Accumbens Subnuclei Regulate Motivated Behavior via Direct Inhibition and Disinhibition of VTA Dopamine Subpopulations

Mesolimbic dopamine (DA) neurons play a central role in motivation and reward processing. Although the activity of these mesolimbic DA neurons is controlled by afferent inputs, little is known about the circuits in which they are embedded. Using retrograde tracing, electrophysiology, optogenetics, and behavioral assays, we identify principles of afferent-specific control in the mesolimbic DA system. Neurons in the medial shell subdivision of the nucleus accumbens (NAc) exert direct inhibitory control over two separate populations of mesolimbic DA neurons by activating different GABA receptor subtypes. In contrast, NAc lateral shell neurons mainly synapse onto ventral tegmental area (VTA) GABA neurons, resulting in disinhibition of DA neurons that project back to the NAc lateral shell. Lastly, we establish a critical role for NAc subregion-specific input to the VTA underlying motivated behavior. Collectively, our results suggest a distinction in the incorporation of inhibitory inputs between different subtypes of mesolimbic DA neurons.

Dopamine and Acetylcholine, a Circuit Point of View in Parkinson's Disease

Data from the World Health Organization (National Institute on Aging, 2011) and the National Institutes of Health (He et al., 2016) predicts that while today the worldwide population over 65 years of age is estimated around 8.5%, this number will reach an astounding 17% by 2050. In this framework, solving current neurodegenerative diseases primarily associated with aging becomes more pressing than ever. In 2017, we celebrate a grim 200th anniversary since the very first description of Parkinson’s disease (PD) and its related symptomatology. Two centuries after this debilitating disease was first identified, finding a cure remains a hopeful goal rather than an attainable objective on the horizon. Tireless work has provided insight into the characterization and progression of the disease down to a molecular level. We now know that the main motor deficits associated with PD arise from the almost total loss of dopaminergic cells in the substantia nigra pars compacta. A concomitant loss of cholinergic cells entails a cognitive decline in these patients, and current therapies are only partially effective, often inducing side-effects after a prolonged treatment. This review covers some of the recent developments in the field of Basal Ganglia (BG) function in physiology and pathology, with a particular focus on the two main neuromodulatory systems known to be severely affected in PD, highlighting some of the remaining open question from three main stand points:

- Heterogeneity of midbrain dopamine neurons.

- Pairing of dopamine (DA) sub-circuits.

- Dopamine-Acetylcholine (ACh) interaction.

A vast amount of knowledge has been accumulated over the years from experimental conditions, but very little of it is reflected or used at a translational or clinical level. An initiative to implement the knowledge that is emerging from circuit-based approaches to tackle neurodegenerative disorders like PD will certainly be tremendously beneficial.

Two-photon imaging in mice shows striosomes and matrix have overlapping but differential reinforcement-related responses

Striosomes were discovered several decades ago as neurochemically identified zones in the striatum, yet technical hurdles have hampered the study of the functions of these striatal compartments. Here we used 2-photon calcium imaging in neuronal birthdate-labeled Mash1-CreER;Ai14 mice to image simultaneously the activity of striosomal and matrix neurons as mice performed an auditory conditioning task. With this method, we identified circumscribed zones of tdTomato-labeled neuropil that correspond to striosomes as verified immunohistochemically. Neurons in both striosomes and matrix responded to reward-predicting cues and were active during or after consummatory licking. However, we found quantitative differences in response strength: striosomal neurons fired more to reward-predicting cues and encoded more information about expected outcome as mice learned the task, whereas matrix neurons were more strongly modulated by recent reward history. These findings open the possibility of harnessing in vivo imaging to determine the contributions of striosomes and matrix to striatal circuit function.