Vocal babbling in songbirds requires the basal ganglia-recipient motor thalamus but not the basal ganglia

A predisposed motor bias shapes individuality in vocal learning

The development of individuality during learned behavior is a common trait observed across animal species; however, the underlying biological mechanisms remain understood. Similar to human speech, songbirds develop individually unique songs with species-specific traits through vocal learning. In this study, we investigate the developmental and molecular mechanisms underlying individuality in vocal learning by utilizing F1 hybrid songbirds (Taeniopygia guttata cross with Taeniopygia bichenovii), taking an integrating approach combining experimentally controlled systematic song tutoring, unbiased discriminant analysis of song features, and single-cell transcriptomics. When tutoring with songs from both parental species, F1 hybrid individuals exhibit evident diversity in their acquired songs. Approximately 30% of F1 hybrids selectively learn either song of the two parental species, while others develop merged songs that combine traits from both species. Vocal acoustic biases during vocal babbling initially appear as individual differences in songs among F1 juveniles and are maintained through the sensitive period of song vocal learning. These vocal acoustic biases emerge independently of the initial auditory experience of hearing the biological father's and passive tutored songs. We identify individual differences in transcriptional signatures in a subset of cell types, including the glutamatergic neurons projecting from the cortical vocal output nucleus to the hypoglossal nuclei, which are associated with variations of vocal acoustic features. These findings suggest that a genetically predisposed vocal motor bias serves as the initial origin of individual variation in vocal learning, influencing learning constraints and preferences.

Anterior forebrain pathway in parrots is necessary for producing learned vocalizations with individual signatures

Parrots have enormous vocal imitation capacities and produce individually unique vocal signatures. Like songbirds, parrots have a nucleated neural song system with distinct anterior (AFP) and posterior forebrain pathways (PFP). To test if song systems of parrots and songbirds, which diverged over 50 million years ago, have a similar functional organization, we first established a neuroscience-compatible call-and-response behavioral paradigm to elicit learned contact calls in budgerigars (Melopsittacus undulatus). Using variational autoencoder-based machine learning methods, we show that contact calls within affiliated groups converge but that individuals maintain unique acoustic features, or vocal signatures, even after call convergence. Next, we transiently inactivated the outputs of AFP to test if learned vocalizations can be produced by the PFP alone. As in songbirds, AFP inactivation had an immediate effect on vocalizations, consistent with a premotor role. But in contrast to songbirds, where the isolated PFP is sufficient to produce stereotyped and acoustically normal vocalizations, isolation of the budgerigar PFP caused a degradation of call acoustic structure, stereotypy, and individual uniqueness. Thus, the contribution of AFP and the capacity of isolated PFP to produce learned vocalizations have diverged substantially between songbirds and parrots, likely driven by their distinct behavioral ecology and neural connectivity.

Divergent projections from locus coeruleus to the corticobasal ganglia system and ventral tegmental area of the adult male zebra finch

The locus coeruleus (LC) is a small noradrenergic brainstem nucleus that plays a central role in regulating arousal, attention, and performance. In the mammalian brain, individual LC neurons make divergent axonal projections to different brain regions, which are distinguished in part by which noradrenaline (NA) receptor subtypes they express. Here, we sought to determine whether similar organizational features characterize LC projections to corticobasal ganglia (CBG) circuitry in the zebra finch song system, with a focus on the basal ganglia nucleus Area X, the thalamic nucleus DLM, as well as the cortical nuclei HVC, LMAN, and RA. Single and dual retrograde tracer injections reveal that single LC-NA neurons make divergent projections to LMAN and Area X, as well as to the dopaminergic VTA/SNc complex that innervates this CBG circuit. Moreover, in situ hybridization revealed that differential expression of mRNA encoding α2A and α2C adrenoreceptors distinguishes LC-recipient CBG song nuclei. Therefore, LC-NA signaling in the zebra finch CBG circuit employs a similar strategy as in mammals, which could allow a relatively small number of LC neurons to exert widespread yet distinct effects across multiple brain regions.

Generative models of birdsong learning link circadian fluctuations in song variability to changes in performance

Learning skilled behaviors requires intensive practice over days, months, or years. Behavioral hallmarks of practice include exploratory variation and long-term improvements, both of which can be impacted by circadian processes. During weeks of vocal practice, the juvenile male zebra finch transforms highly variable and simple song into a stable and precise copy of an adult tutor's complex song. Song variability and performance in juvenile finches also exhibit circadian structure that could influence this long-term learning process. In fact, one influential study reported juvenile song regresses towards immature performance overnight, while another suggested a more complex pattern of overnight change. However, neither of these studies thoroughly examined how circadian patterns of variability may structure the production of more or less mature songs. Here we relate the circadian dynamics of song maturation to circadian patterns of song variation, leveraging a combination of data-driven approaches. In particular we analyze juvenile singing in learned feature space that supports both data-driven measures of song maturity and generative developmental models of song production. These models reveal that circadian fluctuations in variability lead to especially regressive morning variants even without overall overnight regression, and highlight the utility of data-driven generative models for untangling these contributions.

Metastable attractors explain the variable timing of stable behavioral action sequences

The timing of self-initiated actions shows large variability even when they are executed in stable, well-learned sequences. Could this mix of reliability and stochasticity arise within the same neural circuit? We trained rats to perform a stereotyped sequence of self-initiated actions and recorded neural ensemble activity in secondary motor cortex (M2), which is known to reflect trial-by-trial action-timing fluctuations. Using hidden Markov models, we established a dictionary between activity patterns and actions. We then showed that metastable attractors, representing activity patterns with a reliable sequential structure and large transition timing variability, could be produced by reciprocally coupling a high-dimensional recurrent network and a low-dimensional feedforward one. Transitions between attractors relied on correlated variability in this mesoscale feedback loop, predicting a specific structure of low-dimensional correlations that were empirically verified in M2 recordings. Our results suggest a novel mesoscale network motif based on correlated variability supporting naturalistic animal behavior.

Intrinsic motivation for singing in songbirds is enhanced by temporary singing suppression and regulated by dopamine

Behaviors driven by intrinsic motivation are critical for development and optimization of physical and brain functions, but their underlying mechanisms are not well studied due to the complexity and autonomy of the behavior. Songbirds, such as zebra finches, offer a unique opportunity to study neural substrates of intrinsic motivation because they spontaneously produce many renditions of songs with highly-quantifiable structure for vocal practice, even in the absence of apparent recipients (“undirected singing”). Neural substrates underlying intrinsic motivation for undirected singing are still poorly understood partly because singing motivation cannot be easily manipulated due to its autonomy. Also, undirected singing itself acts as an internal reward, which could increase singing motivation, leading to difficulty in measuring singing motivation independent of singing-associated reward. Here, we report a simple procedure to easily manipulate and quantify intrinsic motivation for undirected singing independent of singing-associated reward. We demonstrate that intrinsic motivation for undirected singing is dramatically enhanced by temporary suppression of singing behavior and the degree of enhancement depends on the duration of suppression. Moreover, by examining latencies to the first song following singing suppression as a measure of singing motivation independent of singing-associated reward, we demonstrate that intrinsic singing motivation is critically regulated by dopamine through D2 receptors. These results provide a simple experimental tool to manipulate and measure the intrinsic motivation for undirected singing and illustrate the importance of zebra finches as a model system to study the neural basis of intrinsically-motivated behaviors.

What Is the Role of Thalamostriatal Circuits in Learning Vocal Sequences?

Basal ganglia (BG) circuits integrate sensory and motor-related information from the cortex, thalamus, and midbrain to guide learning and production of motor sequences. Birdsong, like speech, is comprised of precisely sequenced vocal elements. Learning song sequences during development relies on Area X, a vocalization related region in the medial striatum of the songbird BG. Area X receives inputs from cortical-like pallial song circuits and midbrain dopaminergic circuits and sends projections to the thalamus. It has recently been shown that thalamic circuits also send substantial projections back to Area X. Here, we outline a gated-reinforcement learning model for how Area X may use signals conveyed by thalamostriatal inputs to direct song learning. Integrating conceptual advances from recent mammalian and songbird literature, we hypothesize that thalamostriatal pathways convey signals linked to song syllable onsets and offsets and influence striatal circuit plasticity via regulation of cholinergic interneurons (ChIs). We suggest that syllable sequence associated vocal-motor information from the thalamus drive precisely timed pauses in ChIs activity in Area X. When integrated with concurrent corticostriatal and dopaminergic input, this circuit helps regulate plasticity on medium spiny neurons (MSNs) and the learning of syllable sequences. We discuss new approaches that can be applied to test core ideas of this model and how associated insights may provide a framework for understanding the function of BG circuits in learning motor sequences.

Differential development of myelin in zebra finch song nuclei

Songbirds learn vocalizations by hearing and practicing songs. As song develops, the tempo becomes faster and more precise. In the songbird brain, discrete nuclei form interconnected myelinated circuits that control song acquisition and production. The myelin sheath increases the speed of action potential propagation by insulating the axons of neurons and by reducing membrane capacitance. As the brain develops, myelin increases in density, but the time course of myelin development across discrete song nuclei has not been systematically studied in a quantitative fashion. We tested the hypothesis that myelination develops differentially across time and song nuclei. We examined myelin development in the brains of the zebra finch (Taeniopygia guttata) from chick at posthatch day (d) 8 to adult (up to 147 d) in five major song nuclei: HVC (proper name), robust nucleus of the arcopallium (RA), Area X, lateral magnocellular nucleus of the anterior nidopallium, and medial portion of the dorsolateral thalamic nucleus (DLM). All of these nuclei showed an increase in the density of myelination during development but at different rates and to different final degrees. Exponential curve fits revealed that DLM showed earlier myelination than other nuclei, and HVC showed the slowest myelination of song nuclei. Together, these data show differential maturation of myelination in different portions of the song system. Such differential maturation would be well placed to play a role in regulating the development of learned song.

Specificity in sociogenomics: Identifying causal relationships between genes and behavior

There has been rapid growth in the use of transcriptomic analyses to study the interplay between gene expression and behavior. Experience can modify gene expression in the brain, leading to changes in internal state and behavioral displays, while gene expression variation between species is thought to specify many innate behavior differences. However, providing a causal association between a gene and a given behavior remains challenging as it is difficult to determine when and where a gene contributes to the function of a behaviorally-relevant neuronal population. Moreover, given that there are fewer genetic tools available for non-traditional model organisms, transcriptomic approaches have been largely limited to profiling of bulk tissue, which can obscure the contributions of subcortical brain regions implicated in multiple behaviors. Here, we discuss how emerging single cell technologies combined with methods offering additional spatial and connectivity information can give us insight about the genetic profile of specific cells involved in the neural circuit of target social behaviors. We also emphasize how these techniques are broadly adaptable to non-traditional model organisms. We propose that, ultimately, a combination of these approaches applied throughout development will be key to discerning how genes shape the formation of social behavior circuits.

Multidimensional Tuning in Motor Cortical Neurons during Active Behavior

A region within songbird cortex, dorsal intermediate arcopallium (AId), is functionally analogous to motor cortex in mammals and has been implicated in song learning during development. Non-vocal factors such as visual and social cues are known to mediate song learning and performance, yet previous chronic-recording studies of regions important for song behavior have focused exclusively on neural activity in relation to song production. Thus, we have little understanding of the range of non-vocal information that single neurons may encode. We made chronic recordings in AId of freely behaving juvenile zebra finches and evaluated neural activity during diverse motor behaviors throughout entire recording sessions, including song production as well as hopping, pecking, preening, fluff-ups, beak interactions, scratching, and stretching. These movements are part of natural behavioral repertoires and are important components of both song learning and courtship behavior. A large population of AId neurons showed significant modulation of activity during singing. In addition, single neurons demonstrated heterogeneous response patterns during multiple movements (including excitation during one movement type and suppression during another), and some neurons showed differential activity depending on the context in which movements occurred. Moreover, we found evidence of neurons that did not respond during discrete movements but were nonetheless modulated during active behavioral states compared with quiescence. Our results suggest that AId neurons process both vocal and non-vocal information, highlighting the importance of considering the variety of multimodal factors that can contribute to vocal motor learning during development.

The Avian Basal Ganglia Are a Source of Rapid Behavioral Variation That Enables Vocal Motor Exploration

The basal ganglia (BG) participate in aspects of reinforcement learning that require evaluation and selection of motor programs associated with improved performance. However, whether the BG additionally contribute to behavioral variation ("motor exploration") that forms the substrate for such learning remains unclear. In songbirds, a tractable system for studying BG-dependent skill learning, a role for the BG in generating exploratory variability, has been challenged by the finding that lesions of Area X, the song-specific component of the BG, have no lasting effects on several forms of vocal variability that have been studied. Here we demonstrate that lesions of Area X in adult male zebra finches (Taeniopygia gutatta) permanently eliminate rapid within-syllable variation in fundamental frequency (FF), which can act as motor exploration to enable reinforcement-driven song learning. In addition, we found that this within-syllable variation is elevated in juveniles and in adults singing alone, conditions that have been linked to enhanced song plasticity and elevated neural variability in Area X. Consistent with a model that variability is relayed from Area X, via its cortical target, the lateral magnocellular nucleus of the anterior nidopallium (LMAN), to influence song motor circuitry, we found that lesions of LMAN also eliminate within-syllable variability. Moreover, we found that electrical perturbation of LMAN can drive fluctuations in FF that mimic naturally occurring within-syllable variability. Together, these results demonstrate that the BG are a central source of rapid behavioral variation that can serve as motor exploration for vocal learning.SIGNIFICANCE STATEMENT Many complex motor skills, such as speech, are not innately programmed but are learned gradually through trial and error. Learning involves generating exploratory variability in action ("motor exploration") and evaluating subsequent performance to acquire motor programs that lead to improved performance. Although it is well established that the basal ganglia (BG) process signals relating to action evaluation and selection, whether and how the BG promote exploratory motor variability remain unclear. We investigated this question in songbirds, which learn to produce complex vocalizations through trial and error. In contrast with previous studies that did not find effects of BG lesions on vocal motor variability, we demonstrate that the BG are an essential source of rapid behavioral variation linked to vocal learning.

Vocal learning in songbirds requires cholinergic signaling in a motor cortex-like nucleus

Cholinergic inputs to cortex modulate plasticity and sensory processing, yet little is known about their role in motor control. Here, we show that cholinergic signaling in a songbird vocal motor cortical area, the robust nucleus of the arcopallium (RA), is required for song learning. Reverse microdialysis of nicotinic and muscarinic receptor antagonists into RA in juvenile birds did not significantly affect syllable timing or acoustic structure during vocal babbling. However, chronic blockade over weeks reduced singing quantity and impaired learning, resulting in an impoverished song with excess variability, abnormal acoustic features, and reduced similarity to tutor song. The demonstration that cholinergic signaling in a motor cortical area is required for song learning motivates the songbird as a tractable model system to identify roles of the basal forebrain cholinergic system in motor control. NEW & NOTEWORTHY Cholinergic inputs to cortex are evolutionarily conserved and implicated in sensory processing and synaptic plasticity. However, functions of cholinergic signals in motor areas are understudied and poorly understood. Here, we show that cholinergic signaling in a songbird vocal motor cortical area is not required for normal vocal variability during babbling but is essential for developmental song learning. Cholinergic modulation of motor cortex is thus required for learning but not for the ability to sing.

Place preference and vocal learning rely on distinct reinforcers in songbirds

In reinforcement learning (RL) agents are typically tasked with maximizing a single objective function such as reward. But it remains poorly understood how agents might pursue distinct objectives at once. In machines, multiobjective RL can be achieved by dividing a single agent into multiple sub-agents, each of which is shaped by agent-specific reinforcement, but it remains unknown if animals adopt this strategy. Here we use songbirds to test if navigation and singing, two behaviors with distinct objectives, can be differentially reinforced. We demonstrate that strobe flashes aversively condition place preference but not song syllables. Brief noise bursts aversively condition song syllables but positively reinforce place preference. Thus distinct behavior-generating systems, or agencies, within a single animal can be shaped by correspondingly distinct reinforcement signals. Our findings suggest that spatially segregated vocal circuits can solve a credit assignment problem associated with multiobjective learning.

Bidirectional scaling of vocal variability by an avian cortico-basal ganglia circuit

Behavioral variability is thought to be critical for trial and error learning, but where such motor exploration is generated in the central nervous system is unclear. The zebra finch songbird species offers a highly appropriate model in which to address this question. The male song is amenable to detailed measurements of variability, while the brain contains an identified cortico-basal ganglia loop that underlies this behavior. We used pharmacogenetic interventions to separately interrogate cortical and basal ganglia nodes of zebra finch song control circuitry. We show that bidirectional manipulations of each node produce near mirror image changes in vocal control: Cortical activity promotes song variability, whereas basal ganglia activity promotes song stability. Furthermore, female conspecifics can detect these pharmacogenetically elicited changes in song quality. Our results indicate that cortex and striatopallidum can jointly and reciprocally affect behaviorally relevant levels of vocal variability, and point to endogenous mechanisms for its control.

Dopaminergic modulation of basal ganglia output through coupled excitation-inhibition

Learning and maintenance of skilled movements require exploration of motor space and selection of appropriate actions. Vocal learning and social context-dependent plasticity in songbirds depend on a basal ganglia circuit, which actively generates vocal variability. Dopamine in the basal ganglia reduces trial-to-trial neural variability when the bird engages in courtship song. Here, we present evidence for a unique, tonically active, excitatory interneuron in the songbird basal ganglia that makes strong synaptic connections onto output pallidal neurons, often linked in time with inhibitory events. Dopamine receptor activity modulates the coupling of these excitatory and inhibitory events in vitro, which results in a dynamic change in the synchrony of a modeled population of basal ganglia output neurons receiving excitatory and inhibitory inputs. The excitatory interneuron thus serves as one biophysical mechanism for the introduction or modulation of neural variability in this circuit.

Overexpression of human NR2B receptor subunit in LMAN causes stuttering and song sequence changes in adult zebra finches

Zebra finches (Taeniopygia guttata) learn to produce songs in a manner reminiscent of spoken language development in humans. One candidate gene implicated in influencing learning is the N-methyl-D-aspartate (NMDA) subtype 2B glutamate receptor (NR2B). Consistent with this idea, NR2B levels are high in the song learning nucleus LMAN (lateral magnocellular nucleus of the anterior nidopallium) during juvenile vocal learning, and decreases to low levels in adults after learning is complete and the song becomes more stereotyped. To test for the role of NR2B in generating song plasticity, we manipulated NR2B expression in LMAN of adult male zebra finches by increasing its protein levels to those found in juvenile birds, using a lentivirus containing the full-length coding sequence of the human NR2B subunit. We found that increased NR2B expression in adult LMAN induced increases in song sequence diversity and slower song tempo more similar to juvenile songs, but also increased syllable repetitions similar to stuttering. We did not observe these effects in control birds with overexpression of NR2B outside of LMAN or with the green fluorescent protein (GFP) in LMAN. Our results suggest that low NR2B subunit expression in adult LMAN is important in conserving features of stereotyped adult courtship song.

A rhythm landscape approach to the developmental dynamics of birdsong

Unlike simple biological rhythms, the rhythm of the oscine bird song is a learned time series of diverse sounds that change dynamically during vocal ontogeny. How to quantify rhythm development is one of the most important challenges in behavioural biology. Here, we propose a simple method, called ‘rhythm landscape’, to visualize and quantify how rhythm structure, which is measured as durational patterns of sounds and silences, emerges and changes over development. Applying this method to the development of Bengalese finch songs, we show that the rhythm structure begins with a broadband rhythm that develops into diverse rhythms largely through branching from precursors. Furthermore, an information-theoretic measure, the Jensen–Shannon divergence, was used to characterize the crystallization process of birdsong rhythm, which started with a high rate of rhythm change and progressed to a stage of slow refinement. This simple method provides a useful description of rhythm development, thereby helping to reveal key temporal constraints on complex biological rhythms.

Familial bias and auditory feedback regulation of vocal babbling patterns during early song development

Learned vocalizations are a crucial acoustic biosignal conveying individual traits in many species. Songbirds learn song patterns by listening to a tutor song and performing vocal practice during a sensitive developmental period. However, when and how individual differences in song patterns develop remain unknown. Here, we report that individual differences in vocal output exist even at the earliest song development stage, called subsong. Experiments involving the manipulation of both breeding pairs and song tutoring conditions revealed that the parental pair combination contributes to generating familial differences in syllable duration and variability in the subsong of offspring. Furthermore, after deafening, juveniles immediately changed their subsong by shortening the syllable durations but maintained the individual variability of their subsong temporal patterns, suggesting both auditory-sensitive modification and independent intrinsic regulation of vocal output. These results indicate that the temporal patterns of subsong are not merely disordered vocalization but are regulated by familial bias with sensitivity to auditory feedback, thus generating individual variability at the initiation of vocal development.

A hypothesis on improving foreign accents by optimizing variability in vocal learning brain circuits

Rapid vocal motor learning is observed when acquiring a language in early childhood, or learning to speak another language later in life. Accurate pronunciation is one of the hardest things for late learners to master and they are almost always left with a non-native accent. Here, I propose a novel hypothesis that this accent could be improved by optimizing variability in vocal learning brain circuits during learning. Much of the neurobiology of human vocal motor learning has been inferred from studies on songbirds. Jarvis (2004) proposed the hypothesis that as in songbirds there are two pathways in humans: one for learning speech (the striatal vocal learning pathway), and one for production of previously learnt speech (the motor pathway). Learning new motor sequences necessary for accurate non-native pronunciation is challenging and I argue that in late learners of a foreign language the vocal learning pathway becomes inactive prematurely. The motor pathway is engaged once again and learners maintain their original native motor patterns for producing speech, resulting in speaking with a foreign accent. Further, I argue that variability in neural activity within vocal motor circuitry generates vocal variability that supports accurate non-native pronunciation. Recent theoretical and experimental work on motor learning suggests that variability in the motor movement is necessary for the development of expertise. I propose that there is little trial-by-trial variability when using the motor pathway. When using the vocal learning pathway variability gradually increases, reflecting an exploratory phase in which learners try out different ways of pronouncing words, before decreasing and stabilizing once the “best” performance has been identified. The hypothesis proposed here could be tested using behavioral interventions that optimize variability and engage the vocal learning pathway for longer, with the prediction that this would allow learners to develop new motor patterns that result in more native-like pronunciation.

Corticostriatal dynamics encode the refinement of specific behavioral variability during skill learning

Learning to perform a complex motor task requires the optimization of specific behavioral features to cope with task constraints. We show that when mice learn a novel motor paradigm they differentially refine specific behavioral features. Animals trained to perform progressively faster sequences of lever presses to obtain reinforcement reduced variability in sequence frequency, but increased variability in an orthogonal feature (sequence duration). Trial-to-trial variability of the activity of motor cortex and striatal projection neurons was higher early in training and subsequently decreased with learning, without changes in average firing rate. As training progressed, variability in corticostriatal activity became progressively more correlated with behavioral variability, but specifically with variability in frequency. Corticostriatal plasticity was required for the reduction in frequency variability, but not for variability in sequence duration. These data suggest that during motor learning corticostriatal dynamics encode the refinement of specific behavioral features that change the probability of obtaining outcomes.

DOI:http://dx.doi.org/10.7554/eLife.09423.001

Learning a new motor skill typically involves a degree of trial and error. Movements that achieve the desired outcome—from catching a ball to playing scales—are repeated and refined until they can be produced on demand. This process is made more difficult as the activity of individual neurons and muscle fibers can vary at random, and this reduces the ability to reproduce a given movement precisely and reliably.

It has been suggested that the motor system overcomes this problem by identifying those parts of a task that are essential for achieving the end goal, and then focusing resources on reducing the variability in the performance of those parts alone. Santos et al. now provide direct evidence in support of this proposal by recording the activity of neurons in motor regions of the mouse brain as the animals learn a lever pressing task.

By giving mice a food reward each time they pressed the lever four times in a row, Santos et al. trained the animals to press the lever in bouts. The experiment was then slightly modified, so that the mice had to perform the four lever presses more rapidly in order to earn their reward. Consistent with predictions, the average speed of lever pressing initially varied greatly, but this variability decreased as the animals learned the task. By contrast, the total duration of individual bouts of lever pressing—which depends largely on the number of times the mice press the lever—was just as variable after training as before.

A similar pattern emerged for the activity of individual motor neurons in the mouse brain. Whereas their activity initially varied greatly, this variability decreased over training. Moreover, it became increasingly linked to the variability in the speed of lever pressing, but not with the variability in the duration of individual bouts.

The work of Santos et al. has thus shown in real time how the motor system focuses its efforts on reducing variability in those specific parts of a task that are essential for achieving a goal. Without a process called corticostriatal plasticity, by which the motor system adapts, mice could not refine this variability.

DOI:http://dx.doi.org/10.7554/eLife.09423.002

Origins of basal ganglia output signals in singing juvenile birds

Across species, complex circuits inside the basal ganglia (BG) converge on pallidal output neurons that exhibit movement-locked firing patterns. Yet the origins of these firing patterns remain poorly understood. In songbirds during vocal babbling, BG output neurons homologous to those found in the primate internal pallidal segment are uniformly activated in the tens of milliseconds prior to syllable onsets. To test the origins of this remarkably homogenous BG output signal, we recorded from diverse upstream BG cell types during babbling. Prior to syllable onsets, at the same time that internal pallidal segment-like neurons were activated, putative medium spiny neurons, fast spiking and tonically active interneurons also exhibited transient rate increases. In contrast, pallidal neurons homologous to those found in primate external pallidal segment exhibited transient rate decreases. To test origins of these signals, we performed recordings following lesion of corticostriatal inputs from premotor nucleus HVC. HVC lesions largely abolished these syllable-locked signals. Altogether, these findings indicate a striking homogeneity of syllable timing signals in the songbird BG during babbling and are consistent with a role for the indirect and hyperdirect pathways in transforming cortical inputs into BG outputs during an exploratory behavior.

Basal ganglia function, stuttering, sequencing, and repair in adult songbirds

A pallial-basal-ganglia-thalamic-pallial loop in songbirds is involved in vocal motor learning. Damage to its basal ganglia part, Area X, in adult zebra finches has been noted to have no strong effects on song and its function is unclear. Here we report that neurotoxic damage to adult Area X induced changes in singing tempo and global syllable sequencing in all animals, and considerably increased syllable repetition in birds whose song motifs ended with minor repetitions before lesioning. This stuttering-like behavior started at one month, and improved over six months. Unexpectedly, the lesioned region showed considerable recovery, including immigration of newly generated or repaired neurons that became active during singing. The timing of the recovery and stuttering suggest that immature recovering activity of the circuit might be associated with stuttering. These findings indicate that even after juvenile learning is complete, the adult striatum plays a role in higher level organization of learned vocalizations.

Two neural streams, one voice: pathways for theme and variation in the songbird brain

Birdsong offers a unique model system to understand how a developing brain - once given a set of purely acoustic targets - teaches itself the vocal-tract gestures necessary to imitate those sounds. Like human infants, to juvenile male zebra finches (Taeniopygia guttata) falls the burden of initiating the vocal-motor learning of adult sounds. In both species, adult caregivers provide only a set of sounds to be imitated, with little or no information about the vocal-tract gestures used to produce the sounds. Here, we focus on the central control of birdsong and review the recent discovery that zebra finch song is under dual premotor control. Distinct forebrain pathways for structured (theme) and unstructured (variation) singing not only raise new questions about mechanisms of sensory-motor integration, but also provide a fascinating new research opportunity. A cortical locus for a motor memory of the learned song is now firmly established, meaning that anatomical, physiological, and computational approaches are poised to reveal the neural mechanisms used by the brain to compose the songs of birds.

Vocal motor changes beyond the sensitive period for song plasticity

Behavior is critically shaped during sensitive periods in development. Birdsong is a learned vocal behavior that undergoes dramatic plasticity during a sensitive period of sensorimotor learning. During this period, juvenile songbirds engage in vocal practice to shape their vocalizations into relatively stereotyped songs. By the time songbirds reach adulthood, their songs are relatively stable and thought to be "crystallized." Recent studies, however, highlight the potential for adult song plasticity and suggest that adult song could naturally change over time. As such, we investigated the degree to which temporal and spectral features of song changed over time in adult Bengalese finches. We observed that the sequencing and timing of song syllables became more stereotyped over time. Increases in the stereotypy of syllable sequencing were due to the pruning of infrequently produced transitions and, to a lesser extent, increases in the prevalence of frequently produced transitions. Changes in song tempo were driven by decreases in the duration and variability of intersyllable gaps. In contrast to significant changes to temporal song features, we found little evidence that the spectral structure of adult song syllables changed over time. These data highlight differences in the degree to which temporal and spectral features of adult song change over time and support evidence for distinct mechanisms underlying the control of syllable sequencing, timing, and structure. Furthermore, the observed changes to temporal song features are consistent with a Hebbian framework of behavioral plasticity and support the notion that adult song should be considered a form of vocal practice.

A role for descending auditory cortical projections in songbird vocal learning

Many learned motor behaviors are acquired by comparing ongoing behavior with an internal representation of correct performance, rather than using an explicit external reward. For example, juvenile songbirds learn to sing by comparing their song with the memory of a tutor song. At present, the brain regions subserving song evaluation are not known. In this study, we report several findings suggesting that song evaluation involves an avian 'cortical' area previously shown to project to the dopaminergic midbrain and other downstream targets. We find that this ventral portion of the intermediate arcopallium (AIV) receives inputs from auditory cortical areas, and that lesions of AIV result in significant deficits in vocal learning. Additionally, AIV neurons exhibit fast responses to disruptive auditory feedback presented during singing, but not during nonsinging periods. Our findings suggest that auditory cortical areas may guide learning by transmitting song evaluation signals to the dopaminergic midbrain and/or other subcortical targets.

Emergence of context-dependent variability across a basal ganglia network

Context dependence is a key feature of cortical-basal ganglia circuit activity, and in songbirds the cortical outflow of a basal ganglia circuit specialized for song, LMAN, shows striking increases in trial-by-trial variability and bursting when birds sing alone rather than to females. To reveal where this variability and its social regulation emerge, we recorded stepwise from corticostriatal (HVC) neurons and their target spiny and pallidal neurons in Area X. We find that corticostriatal and spiny neurons both show precise singing-related firing across both social settings. Pallidal neurons, in contrast, exhibit markedly increased trial-by-trial variation when birds sing alone, created by highly variable pauses in firing. This variability persists even when recurrent inputs from LMAN are ablated. These data indicate that variability and its context sensitivity emerge within the basal ganglia network, suggest a network mechanism for this emergence, and highlight variability generation and regulation as basal ganglia functions.

Models of vocal learning in the songbird: Historical frameworks and the stabilizing critic

Birdsong is a form of sensorimotor learning that involves a mirror-like system that activates with both song hearing and production. Early models of song learning, based on behavioral measures, identified key features of vocal plasticity, such as the requirements for memorization of a tutor song and auditory feedback during song practice. The concept of a comparator, which compares the memory of the tutor song to auditory feedback, featured prominently. Later models focused on linking anatomically-defined neural modules to behavioral concepts, such as the comparator. Exploiting the anatomical modularity of the songbird brain, localized lesions illuminated mechanisms of the neural song system. More recent models have integrated neuronal mechanisms identified in other systems with observations in songbirds. While these models explain multiple aspects of song learning, they must incorporate computational elements based on unknown biological mechanisms to bridge the motor-to-sensory delay and/or transform motor signals into the sensory domain. Here, I introduce the stabilizing critic hypothesis, which enables sensorimotor learning by (1) placing a purely sensory comparator afferent of the song system and (2) endowing song system disinhibitory interneuron networks with the capacity both to bridge the motor-sensory delay through prolonged bursting and to stabilize song segments selectively based on the comparator signal. These proposed networks stabilize an otherwise variable signal generated by both putative mirror neurons and a cortical-basal ganglia-thalamic loop. This stabilized signal then temporally converges with a matched premotor signal in the efferent song motor cortex, promoting spike-timing-dependent plasticity in the premotor circuitry and behavioral song learning.

The shape of the human language-ready brain

Our core hypothesis is that the emergence of our species-specific language-ready brain ought to be understood in light of the developmental changes expressed at the levels of brain morphology and neural connectivity that occurred in our species after the split from Neanderthals–Denisovans and that gave us a more globular braincase configuration. In addition to changes at the cortical level, we hypothesize that the anatomical shift that led to globularity also entailed significant changes at the subcortical level. We claim that the functional consequences of such changes must also be taken into account to gain a fuller understanding of our linguistic capacity. Here we focus on the thalamus, which we argue is central to language and human cognition, as it modulates fronto-parietal activity. With this new neurobiological perspective in place, we examine its possible molecular basis. We construct a candidate gene set whose members are involved in the development and connectivity of the thalamus, in the evolution of the human head, and are known to give rise to language-associated cognitive disorders. We submit that the new gene candidate set opens up new windows into our understanding of the genetic basis of our linguistic capacity. Thus, our hypothesis aims at generating new testing grounds concerning core aspects of language ontogeny and phylogeny.

A variability-generating circuit goes awry in a songbird model of the FOXP2 speech disorder

FOXP2 mutations cause a monogenic speech disorder in humans. In this issue of Neuron, Murugan et al. (2013) show that knockdown of FoxP2 in the songbird basal ganglia causes abnormal vocal variability and excess bursting in a frontal cortical nucleus.

The role of efference copy in striatal learning

Reinforcement learning requires the convergence of signals representing context, action, and reward. While models of basal ganglia function have well-founded hypotheses about the neural origin of signals representing context and reward, the function and origin of signals representing action are less clear. Recent findings suggest that exploratory or variable behaviors are initiated by a wide array of 'action-generating' circuits in the midbrain, brainstem, and cortex. Thus, in order to learn, the striatum must incorporate an efference copy of action decisions made in these action-generating circuits. Here we review several recent neural models of reinforcement learning that emphasize the role of efference copy signals. Also described are ideas about how these signals might be integrated with inputs signaling context and reward.

Motor thalamus integration of cortical, cerebellar and basal ganglia information: implications for normal and parkinsonian conditions

Motor thalamus (Mthal) is implicated in the control of movement because it is strategically located between motor areas of the cerebral cortex and motor-related subcortical structures, such as the cerebellum and basal ganglia (BG). The role of BG and cerebellum in motor control has been extensively studied but how Mthal processes inputs from these two networks is unclear. Specifically, there is considerable debate about the role of BG inputs on Mthal activity. This review summarizes anatomical and physiological knowledge of the Mthal and its afferents and reviews current theories of Mthal function by discussing the impact of cortical, BG and cerebellar inputs on Mthal activity. One view is that Mthal activity in BG and cerebellar-receiving territories is primarily "driven" by glutamatergic inputs from the cortex or cerebellum, respectively, whereas BG inputs are modulatory and do not strongly determine Mthal activity. This theory is steeped in the assumption that the Mthal processes information in the same way as sensory thalamus, through interactions of modulatory inputs with a single driver input. Another view, from BG models, is that BG exert primary control on the BG-receiving Mthal so it effectively relays information from BG to cortex. We propose a new "super-integrator" theory where each Mthal territory processes multiple driver or driver-like inputs (cortex and BG, cortex and cerebellum), which are the result of considerable integrative processing. Thus, BG and cerebellar Mthal territories assimilate motivational and proprioceptive motor information previously integrated in cortico-BG and cortico-cerebellar networks, respectively, to develop sophisticated motor signals that are transmitted in parallel pathways to cortical areas for optimal generation of motor programmes. Finally, we briefly review the pathophysiological changes that occur in the BG in parkinsonism and generate testable hypotheses about how these may affect processing of inputs in the Mthal.

Basal ganglia output to the thalamus: still a paradox

The basal ganglia (BG)-recipient thalamus controls motor output but it remains unclear how its activity is regulated. Several studies report that thalamic activation occurs via disinhibition during pauses in the firing of inhibitory pallidal inputs from the BG. Other studies indicate that thalamic spiking is triggered by pallidal inputs via post-inhibitory 'rebound' calcium spikes. Finally excitatory cortical inputs can drive thalamic activity, which becomes entrained, or time-locked, to pallidal spikes. We present a unifying framework where these seemingly distinct results arise from a continuum of thalamic firing 'modes' controlled by excitatory inputs. We provide a mechanistic explanation for paradoxical pallidothalamic coactivations observed during behavior that raises new questions about what information is integrated in the thalamus to control behavior.

Differential contributions of basal ganglia and thalamus to song initiation, tempo, and structure

Basal ganglia-thalamocortical circuits are multistage loops critical to motor behavior, but the contributions of individual components to overall circuit function remain unclear. We addressed these issues in a songbird basal ganglia-thalamocortical circuit (the anterior forebrain pathway, AFP) specialized for singing and critical for vocal plasticity. The major known afferent to the AFP is the premotor cortical nucleus, HVC. Surprisingly, previous studies found that lesions of HVC alter song but do not eliminate the ability of the AFP to drive song production. We therefore used this AFP-driven song to investigate the role of basal ganglia and thalamus in vocal structure, tempo, and initiation. We found that lesions of the striatopallidal component (Area X) slowed song and simplified its acoustic structure. Elimination of the thalamic component (DLM) further simplified the acoustic structure of song and regularized its rhythm but also dramatically reduced song production. The acoustic structure changes imply that sequential stages of the AFP each add complexity to song, but the effects of DLM lesions on song initiation suggest that thalamus is a locus of additional inputs important to initiation. Together, our results highlight the cumulative contribution of stages of a basal ganglia-thalamocortical circuit to motor output along with distinct involvement of thalamus in song initiation or "gating."

Translating birdsong: songbirds as a model for basic and applied medical research

Songbirds, long of interest to basic neuroscience, have great potential as a model system for translational neuroscience. Songbirds learn their complex vocal behavior in a manner that exemplifies general processes of perceptual and motor skill learning and, more specifically, resembles human speech learning. Song is subserved by circuitry that is specialized for vocal learning and production but that has strong similarities to mammalian brain pathways. The combination of highly quantifiable behavior and discrete neural substrates facilitates understanding links between brain and behavior, both in normal states and in disease. Here we highlight (a) behavioral and mechanistic parallels between birdsong and aspects of speech and social communication, including insights into mirror neurons, the function of auditory feedback, and genes underlying social communication disorders, and (b) contributions of songbirds to understanding cortical-basal ganglia circuit function and dysfunction, including the possibility of harnessing adult neurogenesis for brain repair.

The basal ganglia is necessary for learning spectral, but not temporal, features of birdsong

Executing a motor skill requires the brain to control which muscles to activate at what times. How these aspects of control-motor implementation and timing-are acquired, and whether the learning processes underlying them differ, is not well understood. To address this, we used a reinforcement learning paradigm to independently manipulate both spectral and temporal features of birdsong, a complex learned motor sequence, while recording and perturbing activity in underlying circuits. Our results uncovered a striking dissociation in how neural circuits underlie learning in the two domains. The basal ganglia was required for modifying spectral, but not temporal, structure. This functional dissociation extended to the descending motor pathway, where recordings from a premotor cortex analog nucleus reflected changes to temporal, but not spectral, structure. Our results reveal a strategy in which the nervous system employs different and largely independent circuits to learn distinct aspects of a motor skill.

Calbindin expression in developing striatum of zebra finches and its relation to the formation of area X

A sexually dimorphic network of brain regions controls learning and production of song in zebra finches. How this specialized song system evolved is unknown. To start addressing this question, we focused on developmental differences between the sexes, using the expression of the calcium-binding protein calbindin (CB) during embryonic to adult stages to map out the early development of Area X, a male-specific striatal structure. We related this pattern to the expression of three transcription factors, Pax6 and Islet1 to delineate the striatal radial domains, and Nkx2.1 as a marker for cells of pallidal origin. An incipient Area X-CB+ domain became discernable at embryonic day 13 in the Islet1-ventral striatal field. This region contained many Nkx2.1-expressing cells with a morphology characteristic of migrating cells. Eight days after hatching (PHD) CB staining clearly delineated Area X. Another CB+ structure formed around PHD5 at the subpallial/pallial boundary. We call it the CB+striatal capsule (CB-StC) and discuss its relation with the previously described striatal capsule in vertebrates. The CB cell population in both Area X and CB-StC, but not in the surrounding striatum, colocalized with the striatal medium spiny neurons (MSNs) marker, D1-receptor associated signaling protein dopamine-and-cAMP-regulated phosphoprotein of 32 kDa, DARPP32. In females, CB-positive cells were also present in the rostral striatum but did not coalesce into an Area X-like structure. We discuss possible reasons for CB expression in MSNs in songbirds and mammals, but not described in chicken striatum.

Task-related "cortical" bursting depends critically on basal ganglia input and is linked to vocal plasticity

Basal ganglia-thalamocortical circuits are critical for motor control and motor learning. Classically, basal ganglia nuclei are thought to regulate motor behavior by increasing or decreasing cortical firing rates, and basal ganglia diseases are assumed to reflect abnormal overall activity levels. More recent studies suggest instead that motor disorders derive from abnormal firing patterns, and have led to the hypothesis that surgical treatments, such as pallidotomy, act primarily by eliminating pathological firing patterns. Surprisingly little is known, however, about how the basal ganglia normally influence task-related cortical activity to regulate motor behavior, and how lesions of the basal ganglia influence cortical firing properties. Here, we investigated these questions in a songbird circuit that has striking homologies to mammalian basal ganglia-thalamocortical circuits but is specialized for singing. The "cortical" outflow nucleus of this circuit is required for song plasticity and normally exhibits increased firing during singing and song-locked burst firing. We found that lesions of the striato-pallidal nucleus in this circuit prevented hearing-dependent song changes. These basal ganglia lesions also stripped the cortical outflow neurons of their patterned burst firing during singing, without changing their spontaneous or singing-related firing rates. Taken together, these results suggest that the basal ganglia are essential not for normal cortical firing rates but for driving task-specific cortical firing patterns, including bursts. Moreover, such patterned bursting appears critical for motor plasticity. Our findings thus provide support for therapies that aim to treat basal ganglia movement disorders by normalizing firing patterns.

Development of temporal structure in zebra finch song

Zebra finch song has provided an excellent case study in the neural basis of sequence learning, with a high degree of temporal precision and tight links with precisely timed bursting in forebrain neurons. To examine the development of song timing, we measured the following four aspects of song temporal structure at four age ranges between 65 and 375 days posthatch: the mean durations of song syllables and the silent gaps between them, timing variability linked to song tempo, timing variability expressed independently across syllables and gaps, and transition probabilities between consecutive syllable pairs. We found substantial increases in song tempo between 65 and 85 days posthatch, due almost entirely to a shortening of gaps. We also found a decrease in tempo variability, also specific to gaps. Both the magnitude of the increase in tempo and the decrease in tempo variability were correlated on gap-by-gap basis with increases in the reliability of corresponding syllable transitions. Syllables had no systematic increase in tempo or decrease in tempo variability. In contrast to tempo parameters, both syllables and gaps showed an early sharp reduction in independent variability followed by continued reductions over the first year. The data suggest that links between syllable-based representations are strengthened during the later parts of the traditional period of song learning and that song rhythm continues to become more regular throughout the first year of life. Similar learning patterns have been identified in human sequence learning, suggesting a potentially rich area of comparative research.

Integration of cortical and pallidal inputs in the basal ganglia-recipient thalamus of singing birds

The basal ganglia-recipient thalamus receives inhibitory inputs from the pallidum and excitatory inputs from cortex, but it is unclear how these inputs interact during behavior. We recorded simultaneously from thalamic neurons and their putative synaptically connected pallidal inputs in singing zebra finches. We find, first, that each pallidal spike produces an extremely brief (∼5 ms) pulse of inhibition that completely suppresses thalamic spiking. As a result, thalamic spikes are entrained to pallidal spikes with submillisecond precision. Second, we find that the number of thalamic spikes that discharge within a single pallidal interspike interval (ISI) depends linearly on the duration of that interval but does not depend on pallidal activity prior to the interval. In a detailed biophysical model, our results were not easily explained by the postinhibitory "rebound" mechanism previously observed in anesthetized birds and in brain slices, nor could most of our data be characterized as "gating" of excitatory transmission by inhibitory pallidal input. Instead, we propose a novel "entrainment" mechanism of pallidothalamic transmission that highlights the importance of an excitatory conductance that drives spiking, interacting with brief pulses of pallidal inhibition. Building on our recent finding that cortical inputs can drive syllable-locked rate modulations in thalamic neurons during singing, we report here that excitatory inputs affect thalamic spiking in two ways: by shortening the latency of a thalamic spike after a pallidal spike and by increasing thalamic firing rates within individual pallidal ISIs. We present a unifying biophysical model that can reproduce all known modes of pallidothalamic transmission--rebound, gating, and entrainment--depending on the amount of excitation the thalamic neuron receives.

Dopamine regulation of human speech and bird song: a critical review

To understand the neural basis of human speech control, extensive research has been done using a variety of methodologies in a range of experimental models. Nevertheless, several critical questions about learned vocal motor control still remain open. One of them is the mechanism(s) by which neurotransmitters, such as dopamine, modulate speech and song production. In this review, we bring together the two fields of investigations of dopamine action on voice control in humans and songbirds, who share similar behavioral and neural mechanisms for speech and song production. While human studies investigating the role of dopamine in speech control are limited to reports in neurological patients, research on dopaminergic modulation of bird song control has recently expanded our views on how this system might be organized. We discuss the parallels between bird song and human speech from the perspective of dopaminergic control as well as outline important differences between these species.

Specialized motor-driven dusp1 expression in the song systems of multiple lineages of vocal learning birds

Mechanisms for the evolution of convergent behavioral traits are largely unknown. Vocal learning is one such trait that evolved multiple times and is necessary in humans for the acquisition of spoken language. Among birds, vocal learning is evolved in songbirds, parrots, and hummingbirds. Each time similar forebrain song nuclei specialized for vocal learning and production have evolved. This finding led to the hypothesis that the behavioral and neuroanatomical convergences for vocal learning could be associated with molecular convergence. We previously found that the neural activity-induced gene dual specificity phosphatase 1 (dusp1) was up-regulated in non-vocal circuits, specifically in sensory-input neurons of the thalamus and telencephalon; however, dusp1 was not up-regulated in higher order sensory neurons or motor circuits. Here we show that song motor nuclei are an exception to this pattern. The song nuclei of species from all known vocal learning avian lineages showed motor-driven up-regulation of dusp1 expression induced by singing. There was no detectable motor-driven dusp1 expression throughout the rest of the forebrain after non-vocal motor performance. This pattern contrasts with expression of the commonly studied activity-induced gene egr1, which shows motor-driven expression in song nuclei induced by singing, but also motor-driven expression in adjacent brain regions after non-vocal motor behaviors. In the vocal non-learning avian species, we found no detectable vocalizing-driven dusp1 expression in the forebrain. These findings suggest that independent evolutions of neural systems for vocal learning were accompanied by selection for specialized motor-driven expression of the dusp1 gene in those circuits. This specialized expression of dusp1 could potentially lead to differential regulation of dusp1-modulated molecular cascades in vocal learning circuits.

Oculomotor learning revisited: a model of reinforcement learning in the basal ganglia incorporating an efference copy of motor actions

In its simplest formulation, reinforcement learning is based on the idea that if an action taken in a particular context is followed by a favorable outcome, then, in the same context, the tendency to produce that action should be strengthened, or reinforced. While reinforcement learning forms the basis of many current theories of basal ganglia (BG) function, these models do not incorporate distinct computational roles for signals that convey context, and those that convey what action an animal takes. Recent experiments in the songbird suggest that vocal-related BG circuitry receives two functionally distinct excitatory inputs. One input is from a cortical region that carries context information about the current “time” in the motor sequence. The other is an efference copy of motor commands from a separate cortical brain region that generates vocal variability during learning. Based on these findings, I propose here a general model of vertebrate BG function that combines context information with a distinct motor efference copy signal. The signals are integrated by a learning rule in which efference copy inputs gate the potentiation of context inputs (but not efference copy inputs) onto medium spiny neurons in response to a rewarded action. The hypothesis is described in terms of a circuit that implements the learning of visually guided saccades. The model makes testable predictions about the anatomical and functional properties of hypothesized context and efference copy inputs to the striatum from both thalamic and cortical sources.

Vocal exploration is locally regulated during song learning

Exploratory variability is essential for sensorimotor learning, but it is not known how and at what timescales it is regulated. We manipulated song learning in zebra finches to experimentally control the requirements for vocal exploration in different parts of their song. We first trained birds to perform a one-syllable song, and once they mastered it, we added a new syllable to the song model. Remarkably, when practicing the modified song, birds rapidly alternated between high and low acoustic variability to confine vocal exploration to the newly added syllable. Furthermore, even within syllables, acoustic variability changed independently across song elements that were only milliseconds apart. Analysis of the entire vocal output during learning revealed that the variability of each song element decreased as it approached the target, correlating with momentary local distance from the target and less so with the overall distance within a syllable. We conclude that vocal error is computed locally in subsyllabic timescales and that song elements can be learned and crystallized independently. Songbirds have dedicated brain circuitry for vocal babbling in the anterior forebrain pathway (AFP), which generates exploratory song patterns that drive premotor neurons at the song nucleus RA. We hypothesize that either AFP adjusts the gain of vocal exploration in fine timescales or that the sensitivity of RA premotor neurons to AFP/HVC inputs varies across song elements.

A cortical motor nucleus drives the basal ganglia-recipient thalamus in singing birds

The pallido-recipient thalamus transmits information from the basal ganglia (BG) to the cortex and plays a critical role motor initiation and learning. Thalamic activity is strongly inhibited by pallidal inputs from the BG, but the role of non-pallidal inputs, such as excitatory inputs from cortex, is unclear. We have recorded simultaneously from presynaptic pallidal axon terminals and postsynaptic thalamocortical neurons in a BG-recipient thalamic nucleus necessary for vocal variability and learning in zebra finches. We found that song-locked rate modulations in the thalamus could not be explained by pallidal inputs alone, and persisted following pallidal lesion. Instead, thalamic activity was likely driven by inputs from a motor ‘cortical’ nucleus also necessary for singing. These findings suggest a role for cortical inputs to the pallido-recipient thalamus in driving premotor signals important for exploratory behavior and learning.

Two distinct modes of forebrain circuit dynamics underlie temporal patterning in the vocalizations of young songbirds

Accurate timing is a critical aspect of motor control, yet the temporal structure of many mature behaviors emerges during learning from highly variable exploratory actions. How does a developing brain acquire the precise control of timing in behavioral sequences? To investigate the development of timing, we analyzed the songs of young juvenile zebra finches. These highly variable vocalizations, akin to human babbling, gradually develop into temporally stereotyped adult songs. We find that the durations of syllables and silences in juvenile singing are formed by a mixture of two distinct modes of timing: a random mode producing broadly distributed durations early in development, and a stereotyped mode underlying the gradual emergence of stereotyped durations. Using lesions, inactivations, and localized brain cooling, we investigated the roles of neural dynamics within two premotor cortical areas in the production of these temporal modes. We find that LMAN (lateral magnocellular nucleus of the nidopallium) is required specifically for the generation of the random mode of timing and that mild cooling of LMAN causes an increase in the durations produced by this mode. On the contrary, HVC (used as a proper name) is required specifically for producing the stereotyped mode of timing, and its cooling causes a slowing of all stereotyped components. These results show that two neural pathways contribute to the timing of juvenile songs and suggest an interesting organization in the forebrain, whereby different brain areas are specialized for the production of distinct forms of neural dynamics.

A hypothesis for basal ganglia-dependent reinforcement learning in the songbird

Most of our motor skills are not innately programmed, but are learned by a combination of motor exploration and performance evaluation, suggesting that they proceed through a reinforcement learning (RL) mechanism. Songbirds have emerged as a model system to study how a complex behavioral sequence can be learned through an RL-like strategy. Interestingly, like motor sequence learning in mammals, song learning in birds requires a basal ganglia (BG)-thalamocortical loop, suggesting common neural mechanisms. Here, we outline a specific working hypothesis for how BG-forebrain circuits could utilize an internally computed reinforcement signal to direct song learning. Our model includes a number of general concepts borrowed from the mammalian BG literature, including a dopaminergic reward prediction error and dopamine-mediated plasticity at corticostriatal synapses. We also invoke a number of conceptual advances arising from recent observations in the songbird. Specifically, there is evidence for a specialized cortical circuit that adds trial-to-trial variability to stereotyped cortical motor programs, and a role for the BG in "biasing" this variability to improve behavioral performance. This BG-dependent "premotor bias" may in turn guide plasticity in downstream cortical synapses to consolidate recently learned song changes. Given the similarity between mammalian and songbird BG-thalamocortical circuits, our model for the role of the BG in this process may have broader relevance to mammalian BG function.