Singing-related neural activity distinguishes four classes of putative striatal neurons in the songbird basal ganglia

Music and Brain Circuitry: Strategies for Strengthening Evidence-Based Research for Music-Based Interventions

The neuroscience of music and music-based interventions (MBIs) is a fascinating but challenging research field. While music is a ubiquitous component of every human society, MBIs may encompass listening to music, performing music, music-based movement, undergoing music education and training, or receiving treatment from music therapists. Unraveling the brain circuits activated and influenced by MBIs may help us gain better understanding of the therapeutic and educational values of MBIs by gathering strong research evidence. However, the complexity and variety of MBIs impose unique research challenges. This article reviews the recent endeavor led by the National Institutes of Health to support evidence-based research of MBIs and their impact on health and diseases. It also highlights fundamental challenges and strategies of MBI research with emphases on the utilization of animal models, human brain imaging and stimulation technologies, behavior and motion capturing tools, and computational approaches. It concludes with suggestions of basic requirements when studying MBIs and promising future directions to further strengthen evidence-based research on MBIs in connections with brain circuitry.SIGNIFICANCE STATEMENT Music and music-based interventions (MBI) engage a wide range of brain circuits and hold promising therapeutic potentials for a variety of health conditions. Comparative studies using animal models have helped in uncovering brain circuit activities involved in rhythm perception, while human imaging, brain stimulation, and motion capture technologies have enabled neural circuit analysis underlying the effects of MBIs on motor, affective/reward, and cognitive function. Combining computational analysis, such as prediction method, with mechanistic studies in animal models and humans may unravel the complexity of MBIs and their effects on health and disease.

Durations of preparatory motor activity in the avian basal ganglia for songs and calls in a species of songbirds

Male songbirds are highly motivated to sing undirected song (US) as juveniles during song learning, and as adults. Given that singing US is a self-driven, elaborated behavior, we would expect to see preparatory activity in the striatal area prior to vocalization, and this preparatory activity could have different characteristics compared to activity driven by calls. In general, songs are longer, complex and influenced by learning while calls are shorter, simpler, and less influenced by experience. The present study recorded neural activity in Area X, a nucleus of the basal ganglia, in male Java sparrows (Lonchura oryzivora) in a sound-proof box and analyzed differences in activity change before US and trill-calls. Trill-calls were often emitted in social arousal, but occasionally emitted when alone. We saw a gradual increase in firing rate for about 2.3seconds prior to the onset of US, and a shorter increase of about 1.3seconds in firing rate prior to the onset of trill-calls. The results reveal that initiating US may be influenced by a prolonged and specific activity increase in the extent that is not seen with trill-calls. Results suggest that direct or indirect projections to Area X, which may reflect motivational state, could be the cause of this activity change.

Neural correlates of vocal initiation in the VTA/SNc of juvenile male zebra finches

Initiation and execution of complex learned vocalizations such as human speech and birdsong depend on multiple brain circuits. In songbirds, neurons in the motor cortices and basal ganglia circuitry exhibit preparatory activity before initiation of song, and that activity is thought to play an important role in successful song performance. However, it remains unknown where a start signal for song is represented in the brain and how such a signal would lead to appropriate vocal initiation. To test whether neurons in the midbrain ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) show activity related to song initiation, we carried out extracellular recordings of VTA/SNc single units in singing juvenile male zebra finches. We found that a subset of VTA/SNc units exhibit phasic activity precisely time-locked to the onset of the song bout, and that the activity occurred specifically at the beginning of song. These findings suggest that phasic activity in the VTA/SNc represents a start signal that triggers song vocalization.

Deafening-induced rapid changes to spine synaptic connectivity in the adult avian vocal basal ganglia

The basal ganglia have been implicated in auditory-dependent vocal learning and plasticity in human and songbirds, but the underlying neural phenotype remains to be clarified. Here, using confocal imaging and three-dimensional electron microscopy, we investigated striatal structural plasticity in response to hearing loss in Area X, the avian vocal basal ganglia, in adult male zebra finch (Taeniopygia guttata). We observed a rapid elongation of dendritic spines, by approximately 13%, by day 3 after deafening, and a considerable increase in spine synapse density, by approximately 61%, by day 14 after deafening, compared with the controls with an intact cochlea. These findings reveal structural sensitivity of Area X to auditory deprivation and suggest that this striatal plasticity might contribute to deafening-induced changes to learned vocal behavior.

New roles for dopamine in motor skill acquisition: lessons from primates, rodents, and songbirds

Motor learning is a core aspect of human life and appears to be ubiquitous throughout the animal kingdom. Dopamine, a neuromodulator with a multifaceted role in synaptic plasticity, may be a key signaling molecule for motor skill learning. Though typically studied in the context of reward-based associative learning, dopamine appears to be necessary for some types of motor learning. Mesencephalic dopamine structures are highly conserved among vertebrates, as are some of their primary targets within the basal ganglia, a subcortical circuit important for motor learning and motor control. With a focus on the benefits of cross-species comparisons, this review examines how "model-free" and "model-based" computational frameworks for understanding dopamine's role in associative learning may be applied to motor learning. The hypotheses that dopamine could drive motor learning either by functioning as a reward prediction error, through passive facilitating of normal basal ganglia activity, or through other mechanisms are examined in light of new studies using humans, rodents, and songbirds. Additionally, new paradigms that could enhance our understanding of dopamine's role in motor learning by bridging the gap between the theoretical literature on motor learning in humans and other species are discussed.

Movement signaling in ventral pallidum and dopaminergic midbrain is gated by behavioral state in singing birds

Movement-related neuronal discharge in ventral tegmental area (VTA) and ventral pallidum (VP) is inconsistently observed across studies. One possibility is that some neurons are movement related and others are not. Another possibility is that the precise behavioral conditions matter-that a single neuron can be movement related under certain behavioral states but not others. We recorded single VTA and VP neurons in birds transitioning between singing and nonsinging states while monitoring body movement with microdrive-mounted accelerometers. Many VP and VTA neurons exhibited body movement-locked activity exclusively when the bird was not singing. During singing, VP and VTA neurons could switch off their tuning to body movement and become instead precisely time-locked to specific song syllables. These changes in neuronal tuning occurred rapidly at state boundaries. Our findings show that movement-related activity in limbic circuits can be gated by behavioral context.NEW & NOTEWORTHY Neural signals in the limbic system have long been known to represent body movements as well as reward. Here, we show that single neurons dramatically change their tuning from movement to song timing when a bird starts to sing.

Actor-critic reinforcement learning in the songbird

It feels rewarding to ace your opponent on match point. Here, we propose common mechanisms underlie reward and performance learning. First, when a singing bird unexpectedly hits the right note, its dopamine (DA) neurons are activated as when a thirsty monkey receives an unexpected juice reward. Second, these DA signals reinforce vocal variations much as they reinforce stimulus-response associations. Third, limbic inputs to DA neurons signal the predicted quality of song syllables much like they signal the predicted reward value of a place or a stimulus during foraging. Finally, songbirds may solve difficult problems in reinforcement learning - such as credit assignment and catastrophic forgetting - with node perturbation and consolidation of reinforced vocal patterns in motor cortical circuits. Consolidation occurs downstream of a canonical 'actor-critic' circuit motif that learns to maximize performance quality in essentially the same way it learns to maximize reward: by computing and learning from prediction errors.

Hidden neural states underlie canary song syntax

Coordinated skills such as speech or dance involve sequences of actions that follow syntactic rules in which transitions between elements depend on the identity and order of past actions. Canary songs are comprised of repeated syllables, called phrases, and the ordering of these phrases follows long-range rules¹, where the choice of what to sing depends on song structure many seconds prior. The neural substrates that support these long-range correlations are unknown. Using miniature head-mounted microscopes and cell-type-specific genetic tools, we observed neural activity in the premotor nucleus HVC^2–4 as canaries explore various phrase sequences in their repertoire. We find neurons that encode past transitions, extending over 4 phrases and spanning up to 4 seconds and 40 syllables. These neurons preferentially encode past actions rather than future actions, can reflect more than a single song history, and occur mostly during the rare phrases that involve history-dependent transitions in song. These findings demonstrate that HVC dynamics includes “hidden states” not reflected in ongoing behavior – states that carry information about prior actions. These states provide a possible substrate to control syntax transitions governed by long-range rules.

ZEBrA: Zebra finch Expression Brain Atlas-A resource for comparative molecular neuroanatomy and brain evolution studies

An in-depth understanding of the genetics and evolution of brain function and behavior requires a detailed mapping of gene expression in functional brain circuits across major vertebrate clades. Here we present the Zebra finch Expression Brain Atlas (ZEBrA; www.zebrafinchatlas.org, RRID: SCR_012988), a web-based resource that maps the expression of genes linked to a broad range of functions onto the brain of zebra finches. ZEBrA is a first of its kind gene expression brain atlas for a bird species and a first for any sauropsid. ZEBrA's >3,200 high-resolution digital images of in situ hybridized sections for ~650 genes (as of June 2019) are presented in alignment with an annotated histological atlas and can be browsed down to cellular resolution. An extensive relational database connects expression patterns to information about gene function, mouse expression patterns and phenotypes, and gene involvement in human diseases and communication disorders. By enabling brain-wide gene expression assessments in a bird, ZEBrA provides important substrates for comparative neuroanatomy and molecular brain evolution studies. ZEBrA also provides unique opportunities for linking genetic pathways to vocal learning and motor control circuits, as well as for novel insights into the molecular basis of sex steroids actions, brain dimorphisms, reproductive and social behaviors, sleep function, and adult neurogenesis, among many fundamental themes.

MIN1PIPE: A Miniscope 1-Photon-Based Calcium Imaging Signal Extraction Pipeline

In vivo calcium imaging using a 1-photon-based miniscope and a microendoscopic lens enables studies of neural activities in freely behaving animals. However, the high and fluctuating background, the inevitable movements and distortions of imaging field, and the extensive spatial overlaps of fluorescent signals emitted from imaged neurons inherent in this 1-photon imaging method present major challenges for extracting neuronal signals reliably and automatically from the raw imaging data. Here, we develop a unifying algorithm called the miniscope 1-photon imaging pipeline (MIN1PIPE), which contains several stand-alone modules and can handle a wide range of imaging conditions and qualities with minimal parameter tuning and automatically and accurately isolate spatially localized neural signals. We have quantitatively compared MIN1PIPE with other existing partial methods using both synthetic and real datasets obtained from different animal models and show that MIN1PIPE has superior efficiency and precision in analyzing noisy miniscope calcium imaging data.

Exploring the molecular basis of neuronal excitability in a vocal learner

BACKGROUND

Vocal learning, the ability to learn to produce vocalizations through imitation, relies on specialized brain circuitry known in songbirds as the song system. While the connectivity and various physiological properties of this system have been characterized, the molecular genetic basis of neuronal excitability in song nuclei remains understudied. We have focused our efforts on examining voltage-gated ion channels to gain insight into electrophysiological and functional features of vocal nuclei. A previous investigation of potassium channel genes in zebra finches (Taeniopygia guttata) revealed evolutionary modifications unique to songbirds, as well as transcriptional specializations in the song system [Lovell PV, Carleton JB, Mello CV. BMC Genomics 14:470 2013]. Here, we expand this approach to sodium, calcium, and chloride channels along with their modulatory subunits using comparative genomics and gene expression analysis encompassing microarrays and in situ hybridization.

RESULTS

We found 23 sodium, 38 calcium, and 33 chloride channel genes (HGNC-based classification) in the zebra finch genome, several of which were previously unannotated. We determined 15 genes are missing relative to mammals, including several genes (CLCAs, BEST2) linked to olfactory transduction. The majority of sodium and calcium but few chloride channels showed differential expression in the song system, among them SCN8A and CACNA1E in the direct motor pathway, and CACNG4 and RYR2 in the anterior forebrain pathway. In several cases, we noted a seemingly coordinated pattern across multiple nuclei (SCN1B, SCN3B, SCN4B, CACNB4) or sparse expression (SCN1A, CACNG5, CACNA1B).

CONCLUSION

The gene families examined are highly conserved between avian and mammalian lineages. Several cases of differential expression likely support high-frequency and burst firing in specific song nuclei, whereas cases of sparse patterns of expression may contribute to the unique electrophysiological signatures of distinct cell populations. These observations lay the groundwork for manipulations to determine how ion channels contribute to the neuronal excitability properties of vocal learning systems.

Songbird Ventral Pallidum Sends Diverse Performance Error Signals to Dopaminergic Midbrain

Motor skills improve with practice, requiring outcomes to be evaluated against ever-changing performance benchmarks, yet it remains unclear how performance error signals are computed. Here, we show that the songbird ventral pallidum (VP) is required for song learning and sends diverse song timing and performance error signals to the ventral tegmental area (VTA). Viral tracing revealed inputs to VP from auditory and vocal motor thalamus, auditory and vocal motor cortex, and VTA. Our findings show that VP circuits, commonly associated with hedonic functions, signal performance error during motor sequence learning.

A subcortical circuit linking the cerebellum to the basal ganglia engaged in vocal learning

Speech is a complex sensorimotor skill, and vocal learning involves both the basal ganglia and the cerebellum. These subcortical structures interact indirectly through their respective loops with thalamo-cortical and brainstem networks, and directly via subcortical pathways, but the role of their interaction during sensorimotor learning remains undetermined. While songbirds and their song-dedicated basal ganglia-thalamo-cortical circuitry offer a unique opportunity to study subcortical circuits involved in vocal learning, the cerebellar contribution to avian song learning remains unknown. We demonstrate that the cerebellum provides a strong input to the song-related basal ganglia nucleus in zebra finches. Cerebellar signals are transmitted to the basal ganglia via a disynaptic connection through the thalamus and then conveyed to their cortical target and to the premotor nucleus controlling song production. Finally, cerebellar lesions impair juvenile song learning, opening new opportunities to investigate how subcortical interactions between the cerebellum and basal ganglia contribute to sensorimotor learning.

Singing activity-driven Arc expression associated with vocal acoustic plasticity in juvenile songbird

Learned vocalization, including birdsong and human speech, is acquired through self‐motivated vocal practice during the sensitive period of vocal learning. The zebra finch (Taeniopygia guttata) develops a song characterized by vocal variability and crystallizes a defined song pattern as adulthood. However, it remains unknown how vocal variability is regulated with diurnal singing during the sensorimotor learning period. Here, we investigated the expression of activity‐dependent neuroplasticity‐related gene Arc during the early plastic song phase to examine its potential association with vocal plasticity. We first confirmed that multiple acoustic features of syllables in the plastic song were dramatically and simultaneously modulated during the first 3 hr of singing in a day and the altered features were maintained until sleep. In a concurrent manner, Arc was intensely induced during morning singing and a subsequent attenuation during afternoon singing in the robust nucleus of the arcopallium (RA) and the interfacial nucleus of the nidopallium (NIf). The singing‐driven Arc expression was not altered by circadian rhythm, but rather reduced during the day as juveniles produced more songs. Song stabilization accelerated by testosterone administration in juveniles was accompanied with attenuation of Arc induction in RA and NIf. In contrast, although early‐deafened birds produced highly unstable song even at adulthood, singing‐driven Arc expression was not different between intact and early‐deafened adults. These results suggest a potential functional link between Arc expression in RA and NIf and vocal plasticity during the sensorimotor phase of song learning. Nonetheless, Arc expression did not reflect the quality of bird's own song or auditory feedback.

Expression of the potassium-chloride co-transporter, KCC2, within the avian song system

Songbirds learn to produce vocalizations early in life by listening to, then copying the songs of conspecific males. The anterior forebrain pathway, homologous to a basal ganglia-forebrain circuit, is essential for song learning. The projection between the striato-pallidal structure, Area X, and the medial portion of the dorsolateral thalamic nucleus (DLM) is strongly hyperpolarizing in adults, due to a very negative chloride reversal potential (Person & Perkel, Neuron 46:129-140, 2005). The chloride reversal potential is determined, in part, by the expression level of a neuron-specific potassium-chloride cotransporter, KCC2, which is developmentally upregulated in mammals. To determine whether a similar upregulation in KCC2 expression occurs at the Area X to DLM synapse during development, we examined the expression level of KCC2 in adult zebra finches across the song system as well as during development in the Area X - DLM synapse. We demonstrate that KCC2 is expressed in a subset of neurons throughout the song system, including HVC (used as a proper name), robust nucleus of the arcopallium (RA), lateral magnocellular nucleus of the anterior nidopallium (LMAN), Area X, and DLM. The majority of pallidal-like projection neurons in Area X showed KCC2 immunoreactivity. In adults, KCC2 expression was robust within DLM, and was upregulated between 14 and 24 days post hatching, before the onset of song learning. Light and electron microscopic analysis indicated that KCC2 immunoreactivity is strongly associated with the plasma membrane. Thus, in the song system as in the mammalian brain, KCC2 expression is well placed to modulate the GABAA reversal potential.

Maturation, Behavioral Activation, and Connectivity of Adult-Born Medium Spiny Neurons in a Striatal Song Nucleus

Neurogenesis continues in the adult songbird brain. Many telencephalic song control regions incorporate new neurons into their existing circuits in adulthood. One song nucleus that receives many new neurons is Area X. Because this striatal region is crucial for song learning and song maintenance the recruitment of new neurons into Area X could influence these processes. As an entry point into addressing this possibility, we investigated the maturation and connectivity within the song circuit and behavioral activation of newly generated Area X neurons. Using BrdU birth dating and virally mediated GFP expression we followed adult-generated neurons from their place of birth in the ventricle to their place of incorporation into Area X. We show that newborn neurons receive glutamatergic input from pallial/cortical song nuclei. Additionally, backfills revealed that the new neurons connect to pallidal-like projection neurons that innervate the thalamus. Using in situ hybridization, we found that new neurons express the mRNA for D1- and D2-type dopamine receptors. Employing DARPP-32 (dopamine and cAMP-regulated phosphoprotein of 32 kDa) and EGR-1 (early growth response protein 1) as markers for neural maturation and activation, we established that at 42 days after labeling approximately 80% of new neurons were mature medium spiny neurons (MSNs) and could be activated by singing behavior. Finally, we compared the MSN density in Area X of birds up to seven years of age and found a significant increase with age, indicating that new neurons are constantly added to the nucleus. In summary, we provide evidence that newborn MSNs in Area X constantly functionally integrate into the circuit and are thus likely to play a role in the maintenance and regulation of adult song.

To transduce a zebra finch: interrogating behavioral mechanisms in a model system for speech

The ability to alter neuronal gene expression, either to affect levels of endogenous molecules or to express exogenous ones, is a powerful tool for linking brain and behavior. Scientists continue to finesse genetic manipulation in mice. Yet mice do not exhibit every behavior of interest. For example, Mus musculus do not readily imitate sounds, a trait known as vocal learning and a feature of speech. In contrast, thousands of bird species exhibit this ability. The circuits and underlying molecular mechanisms appear similar between disparate avian orders and are shared with humans. An advantage of studying vocal learning birds is that the neurons dedicated to this trait are nested within the surrounding brain regions, providing anatomical targets for relating brain and behavior. In songbirds, these nuclei are known as the song control system. Molecular function can be interrogated in non-traditional model organisms by exploiting the ability of viruses to insert genetic material into neurons to drive expression of experimenter-defined genes. To date, the use of viruses in the song control system is limited. Here, we review prior successes and test additional viruses for their capacity to transduce basal ganglia song control neurons. These findings provide a roadmap for troubleshooting the use of viruses in animal champions of fascinating behaviors—nowhere better featured than at the 12th International Congress!

Automated synaptic connectivity inference for volume electron microscopy

Teravoxel volume electron microscopy data sets from neural tissue can now be acquired in weeks, but data analysis requires years of manual labor. We developed the SyConn framework, which uses deep convolutional neural networks and random forest classifiers to infer a richly annotated synaptic connectivity matrix from manual neurite skeleton reconstructions by automatically identifying mitochondria, synapses and their types, axons, dendrites, spines, myelin, somata and cell types. We tested our approach on serial block-face electron microscopy data sets from zebrafish, mouse and zebra finch, and computed the synaptic wiring of songbird basal ganglia. We found that, for example, basal-ganglia cell types with high firing rates in vivo had higher densities of mitochondria and vesicles and that synapse sizes and quantities scaled systematically, depending on the innervated postsynaptic cell types.

Singing modulates parvalbumin interneurons throughout songbird forebrain vocal control circuitry

Across species, the performance of vocal signals can be modulated by the social environment. Zebra finches, for example, adjust their song performance when singing to females ('female-directed' or FD song) compared to when singing in isolation ('undirected' or UD song). These changes are salient, as females prefer the FD song over the UD song. Despite the importance of these performance changes, the neural mechanisms underlying this social modulation remain poorly understood. Previous work in finches has established that expression of the immediate early gene EGR1 is increased during singing and modulated by social context within the vocal control circuitry. Here, we examined whether particular neural subpopulations within those vocal control regions exhibit similar modulations of EGR1 expression. We compared EGR1 expression in neurons expressing parvalbumin (PV), a calcium buffer that modulates network plasticity and homeostasis, among males that performed FD song, males that produced UD song, or males that did not sing. We found that, overall, singing but not social context significantly affected EGR1 expression in PV neurons throughout the vocal control nuclei. We observed differences in EGR1 expression between two classes of PV interneurons in the basal ganglia nucleus Area X. Additionally, we found that singing altered the amount of PV expression in neurons in HVC and Area X and that distinct PV interneuron types in Area X exhibited different patterns of modulation by singing. These data indicate that throughout the vocal control circuitry the singing-related regulation of EGR1 expression in PV neurons may be less influenced by social context than in other neuron types and raise the possibility of cell-type specific differences in plasticity and calcium buffering.

Dopamine neurons encode performance error in singing birds

Many behaviors are learned through trial and error by matching performance to internal goals. Yet neural mechanisms of performance evaluation remain poorly understood. We recorded basal ganglia-projecting dopamine neurons in singing zebra finches as we controlled perceived song quality with distorted auditory feedback. Dopamine activity was phasically suppressed after distorted syllables, consistent with a worse-than-predicted outcome, and was phasically activated at the precise moment of the song when a predicted distortion did not occur, consistent with a better-than-predicted outcome. Error response magnitude depended on distortion probability. Thus, dopaminergic error signals can evaluate behaviors that are not learned for reward and are instead learned by matching performance outcomes to internal goals.

Social context differentially modulates activity of two interneuron populations in an avian basal ganglia nucleus

Basal ganglia circuits are critical for the modulation of motor performance across behavioral states. In zebra finches, a cortical-basal ganglia circuit dedicated to singing is necessary for males to adjust their song performance and transition between spontaneous singing, when they are alone ("undirected" song), and a performance state, when they sing to a female ("female-directed" song). However, we know little about the role of different basal ganglia cell types in this behavioral transition or the degree to which behavioral context modulates the activity of different neuron classes. To investigate whether interneurons in the songbird basal ganglia encode information about behavioral state, I recorded from two interneuron types, fast-spiking interneurons (FSI) and external pallidal (GPe) neurons, in the songbird basal ganglia nucleus area X during both female-directed and undirected singing. Both cell types exhibited higher firing rates, more frequent bursting, and greater trial-by-trial variability in firing when male zebra finches produced undirected songs compared with when they produced female-directed songs. However, the magnitude and direction of changes to the firing rate, bursting, and variability of spiking between when birds sat silently and when they sang undirected and female-directed song varied between FSI and GPe neurons. These data indicate that social modulation of activity important for eliciting changes in behavioral state is present in multiple cell types within area X and suggests that social interactions may adjust circuit dynamics during singing at multiple points within the circuit.

A Distributed Recurrent Network Contributes to Temporally Precise Vocalizations

How do forebrain and brainstem circuits interact to produce temporally precise and reproducible behaviors? Birdsong is an elaborate, temporally precise, and stereotyped vocal behavior controlled by a network of forebrain and brainstem nuclei. An influential idea is that song premotor neurons in a forebrain nucleus (HVC) form a synaptic chain that dictates song timing in a top-down manner. Here we combine physiological, dynamical, and computational methods to show that song timing is not generated solely by a mechanism localized to HVC but instead is the product of a distributed and recurrent synaptic network spanning the forebrain and brainstem, of which HVC is a component.

Focal expression of mutant huntingtin in the songbird basal ganglia disrupts cortico-basal ganglia networks and vocal sequences

The basal ganglia (BG) promote complex sequential movements by helping to select elementary motor gestures appropriate to a given behavioral context. Indeed, Huntington's disease (HD), which causes striatal atrophy in the BG, is characterized by hyperkinesia and chorea. How striatal cell loss alters activity in the BG and downstream motor cortical regions to cause these disorganized movements remains unknown. Here, we show that expressing the genetic mutation that causes HD in a song-related region of the songbird BG destabilizes syllable sequences and increases overall vocal activity, but leave the structure of individual syllables intact. These behavioral changes are paralleled by the selective loss of striatal neurons and reduction of inhibitory synapses on pallidal neurons that serve as the BG output. Chronic recordings in singing birds revealed disrupted temporal patterns of activity in pallidal neurons and downstream cortical neurons. Moreover, reversible inactivation of the cortical neurons rescued the disorganized vocal sequences in transfected birds. These findings shed light on a key role of temporal patterns of cortico-BG activity in the regulation of complex motor sequences and show how a genetic mutation alters cortico-BG networks to cause disorganized movements.

Reduced vocal variability in a zebra finch model of dopamine depletion: implications for Parkinson disease

Midbrain dopamine (DA) modulates the activity of basal ganglia circuitry important for motor control in a variety of species. In songbirds, DA underlies motivational behavior including reproductive drive and is implicated as a gatekeeper for neural activity governing vocal variability. In the zebra finch, Taeniopygia guttata, DA levels increase in Area X, a song-dedicated subregion of the basal ganglia, when a male bird sings his courtship song to a female (female-directed; FD). Levels remain stable when he sings a less stereotyped version that is not directed toward a conspecific (undirected; UD). Here, we used a mild dose of the neurotoxin 6-hydroxydopamine (6-OHDA) to reduce presynaptic DA input to Area X and characterized the effects on FD and UD behaviors. Immunoblots were used to quantify levels of tyrosine hydroxylase (TH) as a biomarker for DA afferent loss in vehicle- and 6-OHDA-injected birds. Following 6-OHDA administration, TH signals were lower in Area X but not in an adjacent subregion, ventral striatal-pallidum (VSP). A postsynaptic marker of DA signaling was unchanged in both regions. These observations suggest that effects were specific to presynaptic afferents of vocal basal ganglia. Concurrently, vocal variability was reduced during UD but not FD song. Similar decreases in vocal variability are observed in patients with Parkinson disease (PD), but the link to DA loss is not well-understood. The 6-OHDA songbird model offers a unique opportunity to further examine how DA loss in cortico-basal ganglia pathways affects vocal control.

Origins of basal ganglia output signals in singing juvenile birds

Across species, complex circuits inside the basal ganglia (BG) converge on pallidal output neurons that exhibit movement-locked firing patterns. Yet the origins of these firing patterns remain poorly understood. In songbirds during vocal babbling, BG output neurons homologous to those found in the primate internal pallidal segment are uniformly activated in the tens of milliseconds prior to syllable onsets. To test the origins of this remarkably homogenous BG output signal, we recorded from diverse upstream BG cell types during babbling. Prior to syllable onsets, at the same time that internal pallidal segment-like neurons were activated, putative medium spiny neurons, fast spiking and tonically active interneurons also exhibited transient rate increases. In contrast, pallidal neurons homologous to those found in primate external pallidal segment exhibited transient rate decreases. To test origins of these signals, we performed recordings following lesion of corticostriatal inputs from premotor nucleus HVC. HVC lesions largely abolished these syllable-locked signals. Altogether, these findings indicate a striking homogeneity of syllable timing signals in the songbird BG during babbling and are consistent with a role for the indirect and hyperdirect pathways in transforming cortical inputs into BG outputs during an exploratory behavior.

Emergence of context-dependent variability across a basal ganglia network

Context dependence is a key feature of cortical-basal ganglia circuit activity, and in songbirds the cortical outflow of a basal ganglia circuit specialized for song, LMAN, shows striking increases in trial-by-trial variability and bursting when birds sing alone rather than to females. To reveal where this variability and its social regulation emerge, we recorded stepwise from corticostriatal (HVC) neurons and their target spiny and pallidal neurons in Area X. We find that corticostriatal and spiny neurons both show precise singing-related firing across both social settings. Pallidal neurons, in contrast, exhibit markedly increased trial-by-trial variation when birds sing alone, created by highly variable pauses in firing. This variability persists even when recurrent inputs from LMAN are ablated. These data indicate that variability and its context sensitivity emerge within the basal ganglia network, suggest a network mechanism for this emergence, and highlight variability generation and regulation as basal ganglia functions.

Food rewards modulate the activity of song neurons in Bengalese finches

Vocal learning, a critical component of speech acquisition, is a rare trait in animals. Songbirds are a well-established animal model in vocal learning research; male birds acquire novel vocal patterns and have a well-developed 'song system' in the brain. Although this system is unique to songbirds, anatomical and physiological studies have reported similarities between the song system and the thalamo-cortico-basal ganglia circuit that is conserved among reptiles, birds, and mammals. Here, we focused on the similarity of the neural response between these two systems while animals were engaging in operant tasks. Neurons in the basal ganglia of vertebrates are activated in response to food rewards and reward predictions in behavioral tasks. A striatal nucleus in the avian song system, Area X, is necessary for vocal learning and is considered specialized for singing. We found that the spiking activity of singing-related Area X neurons was modulated by food rewards and reward signals in an operant task. As previous studies showed that Area X is not critical for general cognitive tasks, the role of Area X in general learning might be limited and vestigial. However, our results provide a new viewpoint to investigate the independence of the vocal learning system from neural systems involved in other cognitive tasks.

Differential androgen receptor expression and DNA methylation state in striatum song nucleus Area X between wild and domesticated songbird strains

In songbirds, a specialized neural system, the song system, is responsible for acquisition and expression of species-specific vocal patterns. We report evidence for differential gene expression between wild and domesticated strains having different learned vocal phenotypes. A domesticated strain of the wild white-rumped munia, the Bengalese finch, has a distinct song pattern with a more complicated syntax than the wild strain. We identified differential androgen receptor (AR) expression in basal ganglia nucleus Area X GABAergic neurons between the two strains, and within different domesticated populations. Differences in AR expression were correlated with the mean coefficient of variation of the inter-syllable duration in the two strains. Differential AR expression in Area X was observed before the initiation of singing, suggesting that inherited and/or early developmental mechanisms may affect expression within and between strains. However, there were no distinct differences in regions upstream of the AR start codon among all the birds in the study. In contrast, an epigenetic modification, DNA methylation state in regions upstream of AR in Area X, was observed to differ between strains and within domesticated populations. These results provide insight into the molecular basis of behavioral evolution through the regulation of hormone-related genes and demonstrate the potential association between epigenetic modifications and behavioral phenotype regulation.

Design and assembly of an ultra-light motorized microdrive for chronic neural recordings in small animals

The ability to chronically record from populations of neurons in freely behaving animals has proven an invaluable tool for dissecting the function of neural circuits underlying a variety of natural behaviors, including navigation(1) , decision making (2,3), and the generation of complex motor sequences(4,5,6). Advances in precision machining has allowed for the fabrication of light-weight devices suitable for chronic recordings in small animals, such as mice and songbirds. The ability to adjust the electrode position with small remotely controlled motors has further increased the recording yield in various behavioral contexts by reducing animal handling.(6,7) Here we describe a protocol to build an ultra-light motorized microdrive for long-term chronic recordings in small animals. Our design evolved from an earlier published version(7), and has been adapted for ease-of use and cost-effectiveness to be more practical and accessible to a wide array of researchers. This proven design (8,9,10,11) allows for fine, remote positioning of electrodes over a range of ~ 5 mm and weighs less than 750 mg when fully assembled. We present the complete protocol for how to build and assemble these drives, including 3D CAD drawings for all custom microdrive components.

Integration of cortical and pallidal inputs in the basal ganglia-recipient thalamus of singing birds

The basal ganglia-recipient thalamus receives inhibitory inputs from the pallidum and excitatory inputs from cortex, but it is unclear how these inputs interact during behavior. We recorded simultaneously from thalamic neurons and their putative synaptically connected pallidal inputs in singing zebra finches. We find, first, that each pallidal spike produces an extremely brief (∼5 ms) pulse of inhibition that completely suppresses thalamic spiking. As a result, thalamic spikes are entrained to pallidal spikes with submillisecond precision. Second, we find that the number of thalamic spikes that discharge within a single pallidal interspike interval (ISI) depends linearly on the duration of that interval but does not depend on pallidal activity prior to the interval. In a detailed biophysical model, our results were not easily explained by the postinhibitory "rebound" mechanism previously observed in anesthetized birds and in brain slices, nor could most of our data be characterized as "gating" of excitatory transmission by inhibitory pallidal input. Instead, we propose a novel "entrainment" mechanism of pallidothalamic transmission that highlights the importance of an excitatory conductance that drives spiking, interacting with brief pulses of pallidal inhibition. Building on our recent finding that cortical inputs can drive syllable-locked rate modulations in thalamic neurons during singing, we report here that excitatory inputs affect thalamic spiking in two ways: by shortening the latency of a thalamic spike after a pallidal spike and by increasing thalamic firing rates within individual pallidal ISIs. We present a unifying biophysical model that can reproduce all known modes of pallidothalamic transmission--rebound, gating, and entrainment--depending on the amount of excitation the thalamic neuron receives.

Oculomotor learning revisited: a model of reinforcement learning in the basal ganglia incorporating an efference copy of motor actions

In its simplest formulation, reinforcement learning is based on the idea that if an action taken in a particular context is followed by a favorable outcome, then, in the same context, the tendency to produce that action should be strengthened, or reinforced. While reinforcement learning forms the basis of many current theories of basal ganglia (BG) function, these models do not incorporate distinct computational roles for signals that convey context, and those that convey what action an animal takes. Recent experiments in the songbird suggest that vocal-related BG circuitry receives two functionally distinct excitatory inputs. One input is from a cortical region that carries context information about the current “time” in the motor sequence. The other is an efference copy of motor commands from a separate cortical brain region that generates vocal variability during learning. Based on these findings, I propose here a general model of vertebrate BG function that combines context information with a distinct motor efference copy signal. The signals are integrated by a learning rule in which efference copy inputs gate the potentiation of context inputs (but not efference copy inputs) onto medium spiny neurons in response to a rewarded action. The hypothesis is described in terms of a circuit that implements the learning of visually guided saccades. The model makes testable predictions about the anatomical and functional properties of hypothesized context and efference copy inputs to the striatum from both thalamic and cortical sources.

The avian subpallium: new insights into structural and functional subdivisions occupying the lateral subpallial wall and their embryological origins

The subpallial region of the avian telencephalon contains neural systems whose functions are critical to the survival of individual vertebrates and their species. The subpallial neural structures can be grouped into five major functional systems, namely the dorsal somatomotor basal ganglia; ventral viscerolimbic basal ganglia; subpallial extended amygdala including the central and medial extended amygdala and bed nuclei of the stria terminalis; basal telencephalic cholinergic and non-cholinergic corticopetal systems; and septum. The paper provides an overview of the major developmental, neuroanatomical and functional characteristics of the first four of these neural systems, all of which belong to the lateral telencephalic wall. The review particularly focuses on new findings that have emerged since the identity, extent and terminology for the regions were considered by the Avian Brain Nomenclature Forum. New terminology is introduced as appropriate based on the new findings. The paper also addresses regional similarities and differences between birds and mammals, and notes areas where gaps in knowledge occur for birds.

Phasic basal ganglia activity associated with high-gamma oscillation during sleep in a songbird

The basal ganglia is thought to be critical for motor control and learning in mammals. In specific basal ganglia regions, gamma frequency oscillations occur during various behavioral states, including sleeping periods. Given the critical role of sleep in regulating vocal plasticity of songbirds, we examined the presence of such oscillations in the basal ganglia. In the song system nucleus Area X, epochs of high-gamma frequency (80-160 Hz) oscillation of local field potential during sleep were associated with phasic increases of neural activity. While birds were awake, activity of the same neurons increased specifically when birds were singing. Furthermore, during sleep there was a clear tendency for phase locking of spikes to these oscillations. Such patterned activity in the sleeping songbird basal ganglia could play a role in off-line processing of song system motor networks.

Common features of neural activity during singing and sleep periods in a basal ganglia nucleus critical for vocal learning in a juvenile songbird

Reactivations of waking experiences during sleep have been considered fundamental neural processes for memory consolidation. In songbirds, evidence suggests the importance of sleep-related neuronal activity in song system motor pathway nuclei for both juvenile vocal learning and maintenance of adult song. Like those in singing motor nuclei, neurons in the basal ganglia nucleus Area X, part of the basal ganglia-thalamocortical circuit essential for vocal plasticity, exhibit singing-related activity. It is unclear, however, whether Area X neurons show any distinctive spiking activity during sleep similar to that during singing. Here we demonstrate that, during sleep, Area X pallidal neurons exhibit phasic spiking activity, which shares some firing properties with activity during singing. Shorter interspike intervals that almost exclusively occurred during singing in awake periods were also observed during sleep. The level of firing variability was consistently higher during singing and sleep than during awake non-singing states. Moreover, deceleration of firing rate, which is considered to be an important firing property for transmitting signals from Area X to the thalamic nucleus DLM, was observed mainly during sleep as well as during singing. These results suggest that songbird basal ganglia circuitry may be involved in the off-line processing potentially critical for vocal learning during sensorimotor learning phase.

A hypothesis for basal ganglia-dependent reinforcement learning in the songbird

Most of our motor skills are not innately programmed, but are learned by a combination of motor exploration and performance evaluation, suggesting that they proceed through a reinforcement learning (RL) mechanism. Songbirds have emerged as a model system to study how a complex behavioral sequence can be learned through an RL-like strategy. Interestingly, like motor sequence learning in mammals, song learning in birds requires a basal ganglia (BG)-thalamocortical loop, suggesting common neural mechanisms. Here, we outline a specific working hypothesis for how BG-forebrain circuits could utilize an internally computed reinforcement signal to direct song learning. Our model includes a number of general concepts borrowed from the mammalian BG literature, including a dopaminergic reward prediction error and dopamine-mediated plasticity at corticostriatal synapses. We also invoke a number of conceptual advances arising from recent observations in the songbird. Specifically, there is evidence for a specialized cortical circuit that adds trial-to-trial variability to stereotyped cortical motor programs, and a role for the BG in "biasing" this variability to improve behavioral performance. This BG-dependent "premotor bias" may in turn guide plasticity in downstream cortical synapses to consolidate recently learned song changes. Given the similarity between mammalian and songbird BG-thalamocortical circuits, our model for the role of the BG in this process may have broader relevance to mammalian BG function.

Vocal babbling in songbirds requires the basal ganglia-recipient motor thalamus but not the basal ganglia

Young songbirds produce vocal "babbling," and the variability of their songs is thought to underlie a process of trial-and-error vocal learning. It is known that this exploratory variability requires the "cortical" component of a basal ganglia (BG) thalamocortical loop, but less understood is the role of the BG and thalamic components in this behavior. We found that large bilateral lesions to the songbird BG homolog Area X had little or no effect on song variability during vocal babbling. In contrast, lesions to the BG-recipient thalamic nucleus DLM (medial portion of the dorsolateral thalamus) largely abolished normal vocal babbling in young birds and caused a dramatic increase in song stereotypy. These findings support the idea that the motor thalamus plays a key role in the expression of exploratory juvenile behaviors during learning.

Endocannabinoids mediate synaptic plasticity at glutamatergic synapses on spiny neurons within a basal ganglia nucleus necessary for song learning

Activation of type 1 cannabinoid receptors (CB(1)R) in many central nervous system structures induces both short- and long-term changes in synaptic transmission. Within mammalian striatum, endocannabinoids (eCB) are one of several mechanisms that induce synaptic plasticity at glutamatergic terminals onto medium spiny neurons. Striatal synaptic plasticity may contribute a critical component of adaptive motor coordination and procedural learning. Songbirds are advantageous for studying the neural mechanisms of motor learning because they possess a neural pathway necessary for song learning and adult song plasticity that includes a striato-pallidal nucleus, area X (homologous to a portion of mammalian basal ganglia). Recent findings suggest that eCBs contribute to vocal development. For example, dense CB(1)R expression in song control nuclei peaks around the closure of the sensori-motor integration phase of song development. Also, systemic administration of a CB(1)R agonist during vocal development impairs song learning. Here we test whether activation of CB(1)R alters excitatory synaptic input on spiny neurons in area X of adult male zebra finches. Application of the CB(1)R agonist WIN55212-2 decreased excitatory postsynaptic current (EPSC) amplitude; that decrease was blocked by the CB(1)R antagonist AM251. Guided by eCB experiments in mammalian striatum, we tested and verified that at least two mechanisms indirectly activate CB(1)Rs through eCBs in area X. First, activation of group I metabotropic glutamate receptors with the agonist 3,5-dihydroxyphenylglycine (DHPG) induced a CB(1)R-mediated reduction in EPSC amplitude. Second, we observed that a 10 s postsynaptic depolarization induced a calcium-mediated, eCB-dependent decrease in synaptic strength that resisted rescue with late CB(1)R blockade. Together, these results show that eCB modulation occurs at inputs to area X spiny neurons and could influence motor learning and production.

Singing-related neural activity distinguishes two putative pallidal cell types in the songbird basal ganglia: comparison to the primate internal and external pallidal segments

The songbird area X is a basal ganglia homolog that contains two pallidal cell types-local neurons that project within the basal ganglia and output neurons that project to the thalamus. Based on these projections, it has been proposed that these classes are structurally homologous to the primate external (GPe) and internal (GPi) pallidal segments. To test the hypothesis that the two area X pallidal types are functionally homologous to GPe and GPi neurons, we recorded from neurons in area X of singing juvenile male zebra finches, and directly compared their firing patterns to neurons recorded in the primate pallidus. In area X, we found two cell classes that exhibited high firing (HF) rates (>60 Hz) characteristic of pallidal neurons. HF-1 neurons, like most GPe neurons we examined, exhibited large firing rate modulations, including bursts and long pauses. In contrast, HF-2 neurons, like GPi neurons, discharged continuously without bursts or long pauses. To test whether HF-2 neurons were the output neurons that project to the thalamus, we next recorded directly from pallidal axon terminals in thalamic nucleus DLM, and found that all terminals exhibited singing-related firing patterns indistinguishable from HF-2 neurons. Our data show that singing-related neural activity distinguishes two putative pallidal cell types in area X: thalamus-projecting neurons that exhibit activity similar to the primate GPi, and non-thalamus-projecting neurons that exhibit activity similar to the primate GPe. These results suggest that song learning in birds and motor learning in mammals use conserved basal ganglia signaling strategies.