Two distinct modes of forebrain circuit dynamics underlie temporal patterning in the vocalizations of young songbirds

Lesions in a songbird vocal circuit increase variability in song syntax

Complex skills like speech and dance are composed of ordered sequences of simpler elements, but the neuronal basis for the syntactic ordering of actions is poorly understood. Birdsong is a learned vocal behavior composed of syntactically ordered syllables, controlled in part by the songbird premotor nucleus HVC (proper name). Here, we test whether one of HVC's recurrent inputs, mMAN (medial magnocellular nucleus of the anterior nidopallium), contributes to sequencing in adult male Bengalese finches (Lonchura striata domestica). Bengalese finch song includes several patterns: (1) chunks, comprising stereotyped syllable sequences; (2) branch points, where a given syllable can be followed probabilistically by multiple syllables; and (3) repeat phrases, where individual syllables are repeated variable numbers of times. We found that following bilateral lesions of mMAN, acoustic structure of syllables remained largely intact, but sequencing became more variable, as evidenced by 'breaks' in previously stereotyped chunks, increased uncertainty at branch points, and increased variability in repeat numbers. Our results show that mMAN contributes to the variable sequencing of vocal elements in Bengalese finch song and demonstrate the influence of recurrent projections to HVC. Furthermore, they highlight the utility of species with complex syntax in investigating neuronal control of ordered sequences.

Let's talk about sex: Mechanisms of neural sexual differentiation in Bilateria

In multicellular organisms, sexed gonads have evolved that facilitate release of sperm versus eggs, and bilaterian animals purposefully combine their gametes via mating behaviors. Distinct neural circuits have evolved that control these physically different mating events for animals producing eggs from ovaries versus sperm from testis. In this review, we will describe the developmental mechanisms that sexually differentiate neural circuits across three major clades of bilaterian animals-Ecdysozoa, Deuterosomia, and Lophotrochozoa. While many of the mechanisms inducing somatic and neuronal sex differentiation across these diverse organisms are clade-specific rather than evolutionarily conserved, we develop a common framework for considering the developmental logic of these events and the types of neuronal differences that produce sex-differentiated behaviors. This article is categorized under: Congenital Diseases > Stem Cells and Development Neurological Diseases > Stem Cells and Development.

Numerical study of a convective cooling strategy for increasing safe power levels in two-photon brain imaging

Two-photon excitation fluorescence microscopy has become an effective tool for tracking neural activity in the brain at high resolutions thanks to its intrinsic optical sectioning and deep penetration capabilities. However, advanced two-photon microscopy modalities enabling high-speed and/or deep-tissue imaging necessitate high average laser powers, thus increasing the susceptibility of tissue heating due to out-of-focus absorption. Despite cooling the cranial window by maintaining the objective at a fixed temperature, average laser powers exceeding 100-200 mW have been shown to exhibit the potential for altering physiological responses of the brain. This paper proposes an enhanced cooling technique for inducing a laminar flow to the objective immersion layer while implementing duty cycles. Through a numerical study, we analyze the efficacy of heat dissipation of the proposed method and compare it with that of the conventional, fixed-temperature objective cooling technique. The results show that improved cooling could be achieved by choosing appropriate flow rates and physiologically relevant immersion cooling temperatures, potentially increasing safe laser power levels by up to three times (3×). The proposed active cooling method can provide an opportunity for faster scan speeds and enhanced signals in nonlinear deep brain imaging.

Anterior forebrain pathway in parrots is necessary for producing learned vocalizations with individual signatures

Parrots have enormous vocal imitation capacities and produce individually unique vocal signatures. Like songbirds, parrots have a nucleated neural song system with distinct anterior (AFP) and posterior forebrain pathways (PFP). To test if song systems of parrots and songbirds, which diverged over 50 million years ago, have a similar functional organization, we first established a neuroscience-compatible call-and-response behavioral paradigm to elicit learned contact calls in budgerigars (Melopsittacus undulatus). Using variational autoencoder-based machine learning methods, we show that contact calls within affiliated groups converge but that individuals maintain unique acoustic features, or vocal signatures, even after call convergence. Next, we transiently inactivated the outputs of AFP to test if learned vocalizations can be produced by the PFP alone. As in songbirds, AFP inactivation had an immediate effect on vocalizations, consistent with a premotor role. But in contrast to songbirds, where the isolated PFP is sufficient to produce stereotyped and acoustically normal vocalizations, isolation of the budgerigar PFP caused a degradation of call acoustic structure, stereotypy, and individual uniqueness. Thus, the contribution of AFP and the capacity of isolated PFP to produce learned vocalizations have diverged substantially between songbirds and parrots, likely driven by their distinct behavioral ecology and neural connectivity.

Songbird mesostriatal dopamine pathways are spatially segregated before the onset of vocal learning

Diverse dopamine (DA) pathways send distinct reinforcement signals to different striatal regions. In adult songbirds, a DA pathway from the ventral tegmental area (VTA) to Area X, the striatal nucleus of the song system, carries singing-related performance error signals important for learning. Meanwhile, a parallel DA pathway to a medial striatal area (MST) arises from a distinct group of neighboring DA neurons that lack connectivity to song circuits and do not encode song error. To test if the structural and functional segregation of these two pathways depends on singing experience, we carried out anatomical studies early in development before the onset of song learning. We find that distinct VTA neurons project to either Area X or MST in juvenile birds before the onset of substantial vocal practice. Quantitative comparisons of early juveniles (30-35 days post hatch), late juveniles (60-65 dph), and adult (>90 dph) brains revealed an outsized expansion of Area X-projecting neurons relative to MST-projecting neurons in VTA over development. These results show that a mesostriatal DA system dedicated to social communication can exist and be spatially segregated before the onset of vocal practice and associated sensorimotor experience.

Generating variability from motor primitives during infant locomotor development

Motor variability is a fundamental feature of developing systems allowing motor exploration and learning. In human infants, leg movements involve a small number of basic coordination patterns called locomotor primitives, but whether and when motor variability could emerge from these primitives remains unknown. Here we longitudinally followed 18 infants on 2-3 time points between birth (~4 days old) and walking onset (~14 months old) and recorded the activity of their leg muscles during locomotor or rhythmic movements. Using unsupervised machine learning, we show that the structure of trial-to-trial variability changes during early development. In the neonatal period, infants own a minimal number of motor primitives but generate a maximal motor variability across trials thanks to variable activations of these primitives. A few months later, toddlers generate significantly less variability despite the existence of more primitives due to more regularity within their activation. These results suggest that human neonates initiate motor exploration as soon as birth by variably activating a few basic locomotor primitives that later fraction and become more consistently activated by the motor system.

Nicotinic acetylcholine receptors in a songbird brain

Nicotinic acetylcholine receptors (nAChRs) are ligand-gated ion channels that mediate fast synaptic transmission and cell signaling, which contribute to learning, memory, and the execution of motor skills. Birdsong is a complex learned motor skill in songbirds. Although the existence of 15 nAChR subunits has been predicted in the avian genome, their expression patterns and potential contributions to song learning and production have not been comprehensively investigated. Here, we cloned all the 15 nAChR subunits (ChrnA1-10, B2-4, D, and G) from the zebra finch brain and investigated the mRNA expression patterns in the neural pathways responsible for the learning and production of birdsong during a critical period of song learning. Although there were no detectable hybridization signals for ChrnA1, A6, A9, and A10, the other 11 nAChR subunits were uniquely expressed in one or more major subdivisions in the song nuclei of the songbird brain. Of these 11 subunits, ChrnA3-5, A7, and B2 were differentially regulated in the song nuclei compared with the surrounding anatomically related regions. ChrnA5 was upregulated during the critical period of song learning in the lateral magnocellular nucleus of the anterior nidopallium. Furthermore, single-cell RNA sequencing revealed ChrnA7 and B2 to be the major subunits expressed in neurons of the vocal motor nuclei HVC and robust nucleus of the arcopallium, indicating the potential existence of ChrnA7-homomeric and ChrnB2-heteromeric nAChRs in limited cell populations. These results suggest that relatively limited types of nAChR subunits provide functional contributions to song learning and production in songbirds.

Resurgent Na+ currents promote ultrafast spiking in projection neurons that drive fine motor control

The underlying mechanisms that promote precise spiking in upper motor neurons controlling fine motor skills are not well understood. Here we report that projection neurons in the adult zebra finch song nucleus RA display robust high-frequency firing, ultra-narrow spike waveforms, superfast Na⁺ current inactivation kinetics, and large resurgent Na⁺ currents (I_NaR). These properties of songbird pallial motor neurons closely resemble those of specialized large pyramidal neurons in mammalian primary motor cortex. They emerge during the early phases of song development in males, but not females, coinciding with a complete switch of Na+ channel subunit expression from Navβ3 to Navβ4. Dynamic clamping and dialysis of Navβ4's C-terminal peptide into juvenile RA neurons provide evidence that Navβ4, and its associated I_NaR, promote neuronal excitability. We thus propose that I_NaR modulates the excitability of upper motor neurons that are required for the execution of fine motor skills.

Plasticity of stereotyped birdsong driven by chronic manipulation of cortical-basal ganglia activity

Cortical-basal ganglia (CBG) circuits are critical for motor learning and performance, and are a major site of pathology. In songbirds, a CBG circuit regulates moment-by-moment variability in song and also enables song plasticity. Studies have shown that variable burst firing in LMAN, the output nucleus of this CBG circuit, actively drives acute song variability, but whether and how LMAN drives long-lasting changes in song remains unclear. Here, we ask whether chronic pharmacological augmentation of LMAN bursting is sufficient to drive plasticity in birds singing stereotyped songs. We show that altered LMAN activity drives cumulative changes in acoustic structure, timing, and sequencing over multiple days, and induces repetitions and silent pauses reminiscent of human stuttering. Changes persisted when LMAN was subsequently inactivated, indicating plasticity in song motor regions. Following cessation of pharmacological treatment, acoustic features and song sequence gradually recovered to their baseline values over a period of days to weeks. Together, our findings show that augmented bursting in CBG circuitry drives plasticity in well-learned motor skills, and may inform treatments for basal ganglia movement disorders.

Actor-critic reinforcement learning in the songbird

It feels rewarding to ace your opponent on match point. Here, we propose common mechanisms underlie reward and performance learning. First, when a singing bird unexpectedly hits the right note, its dopamine (DA) neurons are activated as when a thirsty monkey receives an unexpected juice reward. Second, these DA signals reinforce vocal variations much as they reinforce stimulus-response associations. Third, limbic inputs to DA neurons signal the predicted quality of song syllables much like they signal the predicted reward value of a place or a stimulus during foraging. Finally, songbirds may solve difficult problems in reinforcement learning - such as credit assignment and catastrophic forgetting - with node perturbation and consolidation of reinforced vocal patterns in motor cortical circuits. Consolidation occurs downstream of a canonical 'actor-critic' circuit motif that learns to maximize performance quality in essentially the same way it learns to maximize reward: by computing and learning from prediction errors.

Printable microscale interfaces for long-term peripheral nerve mapping and precision control

The nascent field of bioelectronic medicine seeks to decode and modulate peripheral nervous system signals to obtain therapeutic control of targeted end organs and effectors. Current approaches rely heavily on electrode-based devices, but size scalability, material and microfabrication challenges, limited surgical accessibility, and the biomechanically dynamic implantation environment are significant impediments to developing and deploying peripheral interfacing technologies. Here, we present a microscale implantable device - the nanoclip - for chronic interfacing with fine peripheral nerves in small animal models that begins to meet these constraints. We demonstrate the capability to make stable, high signal-to-noise ratio recordings of behaviorally-linked nerve activity over multi-week timescales. In addition, we show that multi-channel, current-steering-based stimulation within the confines of the small device can achieve multi-dimensional control of a small nerve. These results highlight the potential of new microscale design and fabrication techniques for realizing viable devices for long-term peripheral interfacing.

Network dynamics underlie learning and performance of birdsong

Understanding the sensorimotor control of the endless variety of human speech patterns stands as one of the apex problems in neuroscience. The capacity to learn - through imitation - to rapidly sequence vocal sounds in meaningful patterns is clearly one of the most derived of human behavioral traits. Selection pressure produced an analogous capacity in numerous species of vocal-learning birds, and due to an increasing appreciation for the cognitive and computational flexibility of avian cortex and basal ganglia, a general understanding of the forebrain network that supports the learning and production of birdsong is beginning to emerge. Here, we review recent advances in experimental studies of the zebra finch (Taeniopygia guttata), which offer new insights into the network dynamics that support this surprising analogue of human speech learning and production.

The Development of Structured Vocalizations in Songbirds and Humans: A Comparative Analysis

Humans and songbirds face a common challenge: acquiring the complex vocal repertoire of their social group. Although humans are thought to be unique in their ability to convey symbolic meaning through speech, speech and birdsong are comparable in their acoustic complexity and the mastery with which the vocalizations of adults are acquired by young individuals. In this review, we focus on recent advances in the study of vocal development in humans and songbirds that shed new light on the emergence of distinct structural levels of vocal behavior and point to new possible parallels between both groups.

Functional imaging of visual cortical layers and subplate in awake mice with optimized three-photon microscopy

Two-photon microscopy is used to image neuronal activity, but has severe limitations for studying deeper cortical layers. Here, we developed a custom three-photon microscope optimized to image a vertical column of the cerebral cortex > 1 mm in depth in awake mice with low (<20 mW) average laser power. Our measurements of physiological responses and tissue-damage thresholds define pulse parameters and safety limits for damage-free three-photon imaging. We image functional visual responses of neurons expressing GCaMP6s across all layers of the primary visual cortex (V1) and in the subplate. These recordings reveal diverse visual selectivity in deep layers: layer 5 neurons are more broadly tuned to visual stimuli, whereas mean orientation selectivity of layer 6 neurons is slightly sharper, compared to neurons in other layers. Subplate neurons, located in the white matter below cortical layer 6 and characterized here for the first time, show low visual responsivity and broad orientation selectivity.

Two-photon microscopy is a powerful tool for studying neuronal activity but cannot easily image deeper cortical layers. Here, the authors design a custom microscope for three-photon microscopy and use it to reveal response properties of layer 5, 6, and subplate visual cortical neurons.

Vocal learning in songbirds requires cholinergic signaling in a motor cortex-like nucleus

Cholinergic inputs to cortex modulate plasticity and sensory processing, yet little is known about their role in motor control. Here, we show that cholinergic signaling in a songbird vocal motor cortical area, the robust nucleus of the arcopallium (RA), is required for song learning. Reverse microdialysis of nicotinic and muscarinic receptor antagonists into RA in juvenile birds did not significantly affect syllable timing or acoustic structure during vocal babbling. However, chronic blockade over weeks reduced singing quantity and impaired learning, resulting in an impoverished song with excess variability, abnormal acoustic features, and reduced similarity to tutor song. The demonstration that cholinergic signaling in a motor cortical area is required for song learning motivates the songbird as a tractable model system to identify roles of the basal forebrain cholinergic system in motor control. NEW & NOTEWORTHY Cholinergic inputs to cortex are evolutionarily conserved and implicated in sensory processing and synaptic plasticity. However, functions of cholinergic signals in motor areas are understudied and poorly understood. Here, we show that cholinergic signaling in a songbird vocal motor cortical area is not required for normal vocal variability during babbling but is essential for developmental song learning. Cholinergic modulation of motor cortex is thus required for learning but not for the ability to sing.

Neural activity in cortico-basal ganglia circuits of juvenile songbirds encodes performance during goal-directed learning

Cortico-basal ganglia circuits are thought to mediate goal-directed learning by a process of outcome evaluation to gradually select appropriate motor actions. We investigated spiking activity in core and shell subregions of the cortical nucleus LMAN during development as juvenile zebra finches are actively engaged in evaluating feedback of self-generated behavior in relation to their memorized tutor song (the goal). Spiking patterns of single neurons in both core and shell subregions during singing correlated with acoustic similarity to tutor syllables, suggesting a process of outcome evaluation. Both core and shell neurons encoded tutor similarity via either increases or decreases in firing rate, although only shell neurons showed a significant association at the population level. Tutor similarity predicted firing rates most strongly during early stages of learning, and shell but not core neurons showed decreases in response variability across development, suggesting that the activity of shell neurons reflects the progression of learning.

Building a state space for song learning

The songbird system has shed light on how the brain produces precisely timed behavioral sequences, and how the brain implements reinforcement learning (RL). RL is a powerful strategy for learning what action to produce in each state, but requires a unique representation of the states involved in the task. Songbird RL circuitry is thought to operate using a representation of each moment within song syllables, consistent with the sparse sequential bursting of neurons in premotor cortical nucleus HVC. However, such sparse sequences are not present in very young birds, which sing highly variable syllables of random lengths. Here, we review and expand upon a model for how the songbird brain could construct latent sequences to support RL, in light of new data elucidating connections between HVC and auditory cortical areas. We hypothesize that learning occurs via four distinct plasticity processes: 1) formation of 'tutor memory' sequences in auditory areas; 2) formation of appropriately-timed latent HVC sequences, seeded by inputs from auditory areas spontaneously replaying the tutor song; 3) strengthening, during spontaneous replay, of connections from HVC to auditory neurons of corresponding timing in the 'tutor memory' sequence, aligning auditory and motor representations for subsequent song evaluation; and 4) strengthening of connections from premotor neurons to motor output neurons that produce the desired sounds, via well-described song RL circuitry.

Songbirds work around computational complexity by learning song vocabulary independently of sequence

While acquiring motor skills, animals transform their plastic motor sequences to match desired targets. However, because both the structure and temporal position of individual gestures are adjustable, the number of possible motor transformations increases exponentially with sequence length. Identifying the optimal transformation towards a given target is therefore a computationally intractable problem. Here we show an evolutionary workaround for reducing the computational complexity of song learning in zebra finches. We prompt juveniles to modify syllable phonology and sequence in a learned song to match a newly introduced target song. Surprisingly, juveniles match each syllable to the most spectrally similar sound in the target, regardless of its temporal position, resulting in unnecessary sequence errors, that they later try to correct. Thus, zebra finches prioritize efficient learning of syllable vocabulary, at the cost of inefficient syntax learning. This strategy provides a non-optimal but computationally manageable solution to the task of vocal sequence learning.

Rhythmic Continuous-Time Coding in the Songbird Analog of Vocal Motor Cortex

Songbirds learn and produce complex sequences of vocal gestures. Adult birdsong requires premotor nucleus HVC, in which projection neurons (PNs) burst sparsely at stereotyped times in the song. It has been hypothesized that PN bursts, as a population, form a continuous sequence, while a different model of HVC function proposes that both HVC PN and interneuron activity is tightly organized around motor gestures. Using a large dataset of PNs and interneurons recorded in singing birds, we test several predictions of these models. We find that PN bursts in adult birds are continuously and nearly uniformly distributed throughout song. However, we also find that PN and interneuron firing rates exhibit significant 10-Hz rhythmicity locked to song syllables, peaking prior to syllable onsets and suppressed prior to offsets-a pattern that predominates PN and interneuron activity in HVC during early stages of vocal learning.

Rhythmic syllable-related activity in a songbird motor thalamic nucleus necessary for learned vocalizations

Birdsong is a complex behavior that exhibits hierarchical organization. While the representation of singing behavior and its hierarchical organization has been studied in some detail in avian cortical premotor circuits, our understanding of the role of the thalamus in adult birdsong is incomplete. Using a combination of behavioral and electrophysiological studies, we seek to expand on earlier work showing that the thalamic nucleus Uvaeformis (Uva) is necessary for the production of stereotyped, adult song in zebra finch (Taeniopygia guttata). We confirm that complete bilateral lesions of Uva abolish singing in the ‘directed’ social context, but find that in the ‘undirected’ social context, such lesions result in highly variable vocalizations similar to early babbling song in juvenile birds. Recordings of neural activity in Uva reveal strong syllable-related modulation, maximally active prior to syllable onsets and minimally active prior to syllable offsets. Furthermore, both song and Uva activity exhibit a pronounced coherent modulation at 10Hz—a pattern observed in downstream premotor areas in adult and, even more prominently, in juvenile birds. These findings are broadly consistent with the idea that Uva is critical in the sequential activation of behavioral modules in HVC.

Dopaminergic modulation of basal ganglia output through coupled excitation-inhibition

Learning and maintenance of skilled movements require exploration of motor space and selection of appropriate actions. Vocal learning and social context-dependent plasticity in songbirds depend on a basal ganglia circuit, which actively generates vocal variability. Dopamine in the basal ganglia reduces trial-to-trial neural variability when the bird engages in courtship song. Here, we present evidence for a unique, tonically active, excitatory interneuron in the songbird basal ganglia that makes strong synaptic connections onto output pallidal neurons, often linked in time with inhibitory events. Dopamine receptor activity modulates the coupling of these excitatory and inhibitory events in vitro, which results in a dynamic change in the synchrony of a modeled population of basal ganglia output neurons receiving excitatory and inhibitory inputs. The excitatory interneuron thus serves as one biophysical mechanism for the introduction or modulation of neural variability in this circuit.

A canonical neural mechanism for behavioral variability

The ability to generate variable movements is essential for learning and adjusting complex behaviours. This variability has been linked to the temporal irregularity of neuronal activity in the central nervous system. However, how neuronal irregularity actually translates into behavioural variability is unclear. Here we combine modelling, electrophysiological and behavioural studies to address this issue. We demonstrate that a model circuit comprising topographically organized and strongly recurrent neural networks can autonomously generate irregular motor behaviours. Simultaneous recordings of neurons in singing finches reveal that neural correlations increase across the circuit driving song variability, in agreement with the model predictions. Analysing behavioural data, we find remarkable similarities in the babbling statistics of 5-6-month-old human infants and juveniles from three songbird species and show that our model naturally accounts for these 'universal' statistics.

Toward an Integration of Deep Learning and Neuroscience

Neuroscience has focused on the detailed implementation of computation, studying neural codes, dynamics and circuits. In machine learning, however, artificial neural networks tend to eschew precisely designed codes, dynamics or circuits in favor of brute force optimization of a cost function, often using simple and relatively uniform initial architectures. Two recent developments have emerged within machine learning that create an opportunity to connect these seemingly divergent perspectives. First, structured architectures are used, including dedicated systems for attention, recursion and various forms of short- and long-term memory storage. Second, cost functions and training procedures have become more complex and are varied across layers and over time. Here we think about the brain in terms of these ideas. We hypothesize that (1) the brain optimizes cost functions, (2) the cost functions are diverse and differ across brain locations and over development, and (3) optimization operates within a pre-structured architecture matched to the computational problems posed by behavior. In support of these hypotheses, we argue that a range of implementations of credit assignment through multiple layers of neurons are compatible with our current knowledge of neural circuitry, and that the brain's specialized systems can be interpreted as enabling efficient optimization for specific problem classes. Such a heterogeneously optimized system, enabled by a series of interacting cost functions, serves to make learning data-efficient and precisely targeted to the needs of the organism. We suggest directions by which neuroscience could seek to refine and test these hypotheses.

A rhythm landscape approach to the developmental dynamics of birdsong

Unlike simple biological rhythms, the rhythm of the oscine bird song is a learned time series of diverse sounds that change dynamically during vocal ontogeny. How to quantify rhythm development is one of the most important challenges in behavioural biology. Here, we propose a simple method, called ‘rhythm landscape’, to visualize and quantify how rhythm structure, which is measured as durational patterns of sounds and silences, emerges and changes over development. Applying this method to the development of Bengalese finch songs, we show that the rhythm structure begins with a broadband rhythm that develops into diverse rhythms largely through branching from precursors. Furthermore, an information-theoretic measure, the Jensen–Shannon divergence, was used to characterize the crystallization process of birdsong rhythm, which started with a high rate of rhythm change and progressed to a stage of slow refinement. This simple method provides a useful description of rhythm development, thereby helping to reveal key temporal constraints on complex biological rhythms.

Brain heating induced by near-infrared lasers during multiphoton microscopy

Two-photon imaging and optogenetic stimulation rely on high illumination powers, particularly for state-of-the-art applications that target deeper structures, achieve faster measurements, or probe larger brain areas. However, little information is available on heating and resulting damage induced by high-power illumination in the brain. In the current study we used thermocouple probes and quantum dot nanothermometers to measure temperature changes induced by two-photon microscopy in the neocortex of awake and anaesthetized mice. We characterized heating as a function of wavelength, exposure time, and distance from the center of illumination. Although total power is highest near the surface of the brain, heating was most severe hundreds of micrometers below the focal plane, due to heat dissipation through the cranial window. Continuous illumination of a 1-mm(2) area produced a peak temperature increase of ∼1.8°C/100 mW. Continuous illumination with powers above 250 mW induced lasting damage, detected with immunohistochemistry against Iba1, glial fibrillary acidic protein, heat shock proteins, and activated caspase-3. Higher powers were usable in experiments with limited duty ratios, suggesting an approach to mitigate damage in high-power microscopy experiments.

Growth and splitting of neural sequences in songbird vocal development

Neural sequences are a fundamental feature of brain dynamics underlying diverse behaviors, but the mechanisms by which they develop during learning remain unknown. Songbirds learn vocalizations composed of syllables; in adult birds, each syllable is produced by a different sequence of action potential bursts in the premotor cortical area HVC. Here we carried out recordings of large populations of HVC neurons in singing juvenile birds throughout learning to examine the emergence of neural sequences. Early in vocal development, HVC neurons begin producing rhythmic bursts, temporally locked to a ‘prototype’ syllable. Different neurons are active at different latencies relative to syllable onset to form a continuous sequence. Through development, as new syllables emerge from the prototype syllable, initially highly overlapping burst sequences become increasingly distinct. We propose a mechanistic model in which multiple neural sequences can emerge from the growth and splitting of a common precursor sequence.

Forebrain circuits underlying the social modulation of vocal communication signals

Across vertebrate species, signalers alter the structure of their communication signals based on the social context. For example, male Bengalese finches produce faster and more stereotyped songs when directing song to females (female-directed [FD] song) than when singing in isolation (undirected [UD] song), and such changes have been found to increase the attractiveness of a male's song. Despite the importance of such social influences, little is known about the mechanisms underlying the social modulation of communication signals. To this end, we analyzed differences in immediate early gene (EGR-1) expression when Bengalese finches produced FD or UD song. Relative to silent birds, EGR-1 expression was elevated in birds producing either FD or UD song throughout vocal control circuitry, including the interface nucleus of the nidopallium (NIf), HVC, the robust nucleus of the arcopallium (RA), Area X, and the lateral magnocellular nucleus of the anterior nidopallium (LMAN). Moreover, EGR-1 expression was higher in HVC, RA, Area X, and LMAN in males producing UD song than in males producing FD song, indicating that social context modulated EGR-1 expression in these areas. However, EGR-1 expression was not significantly different between males producing FD or UD song in NIf, the primary vocal motor input into HVC, suggesting that context-dependent changes could arise de novo in HVC. The pattern of context-dependent differences in EGR-1 expression in the Bengalese finch was highly similar to that in the zebra finch and suggests that social context affects song structure by modulating activity throughout vocal control nuclei.

Origins of basal ganglia output signals in singing juvenile birds

Across species, complex circuits inside the basal ganglia (BG) converge on pallidal output neurons that exhibit movement-locked firing patterns. Yet the origins of these firing patterns remain poorly understood. In songbirds during vocal babbling, BG output neurons homologous to those found in the primate internal pallidal segment are uniformly activated in the tens of milliseconds prior to syllable onsets. To test the origins of this remarkably homogenous BG output signal, we recorded from diverse upstream BG cell types during babbling. Prior to syllable onsets, at the same time that internal pallidal segment-like neurons were activated, putative medium spiny neurons, fast spiking and tonically active interneurons also exhibited transient rate increases. In contrast, pallidal neurons homologous to those found in primate external pallidal segment exhibited transient rate decreases. To test origins of these signals, we performed recordings following lesion of corticostriatal inputs from premotor nucleus HVC. HVC lesions largely abolished these syllable-locked signals. Altogether, these findings indicate a striking homogeneity of syllable timing signals in the songbird BG during babbling and are consistent with a role for the indirect and hyperdirect pathways in transforming cortical inputs into BG outputs during an exploratory behavior.

Regulatory mechanisms of testosterone-stimulated song in the sensorimotor nucleus HVC of female songbirds

Background

In male birds, influence of the sex steroid hormone testosterone and its estrogenic metabolites on seasonal song behavior has been demonstrated for many species. In contrast, female song was only recently recognized to be widespread among songbird species, and to date, sex hormone effects on singing and brain regions controlling song development and production (song control nuclei) have been studied in females almost exclusively using domesticated canaries (Serinus canaria). However, domesticated female canaries hardly sing at all in normal circumstances and exhibit only very weak, if any, song seasonally under the natural photoperiod. By contrast, adult female European robins (Erithacus rubecula) routinely sing during the winter season, a time when they defend feeding territories and show elevated circulating testosterone levels. We therefore used wild female European robins captured in the fall to examine the effects of testosterone administration on song as well as on the anatomy and the transcriptome of the song control nucleus HVC (sic). The results obtained from female robins were compared to outcomes of a similar experiment done in female domesticated canaries.

Results

Testosterone treatment induced abundant song in female robins. Examination of HVC transcriptomes and histological analyses of song control nuclei showed testosterone-induced differentiation processes related to neuron growth and spacing, angiogenesis and neuron projection morphogenesis. Similar effects were found in female canaries treated with testosterone. In contrast, the expression of genes related to synaptic transmission was not enhanced in the HVC of testosterone treated female robins but was strongly up-regulated in female canaries. A comparison of the testosterone-stimulated transcriptomes indicated that brain-derived neurotrophic factor (BDNF) likely functions as a common mediator of the testosterone effects in HVC.

Conclusions

Testosterone-induced singing of female robins correlated with cellular differentiation processes in the HVC that were partially similar to those seen in the HVC of testosterone-treated female canaries. Other modes of testosterone action, notably related to synaptic transmission, appeared to be regulated in a more species-specific manner in the female HVC. Divergent effects of testosterone on the HVC of different species might be related to differences between species in regulatory mechanisms of the singing behavior.

Electronic supplementary material

The online version of this article (doi:10.1186/s12868-014-0128-0) contains supplementary material, which is available to authorized users.

Long-distance retinoid signaling in the zebra finch brain

All-trans retinoic acid (ATRA), the main active metabolite of vitamin A, is a powerful signaling molecule that regulates large-scale morphogenetic processes during vertebrate embryonic development, but is also involved post-natally in regulating neural plasticity and cognition. In songbirds, it plays an important role in the maturation of learned song. The distribution of the ATRA-synthesizing enzyme, zRalDH, and of ATRA receptors (RARs) have been described, but information on the distribution of other components of the retinoid signaling pathway is still lacking. To address this gap, we have determined the expression patterns of two obligatory RAR co-receptors, the retinoid X receptors (RXR) α and γ, and of the three ATRA-degrading cytochromes CYP26A1, CYP26B1, and CYP26C1. We have also studied the distribution of zRalDH protein using immunohistochemistry, and generated a refined map of ATRA localization, using a modified reporter cell assay to examine entire brain sections. Our results show that (1) ATRA is more broadly distributed in the brain than previously predicted by the spatially restricted distribution of zRalDH transcripts. This could be due to long-range transport of zRalDH enzyme between different nuclei of the song system: Experimental lesions of putative zRalDH peptide source regions diminish ATRA-induced transcription in target regions. (2) Four telencephalic song nuclei express different and specific subsets of retinoid-related receptors and could be targets of retinoid regulation; in the case of the lateral magnocellular nucleus of the anterior nidopallium (lMAN), receptor expression is dynamically regulated in a circadian and age-dependent manner. (3) High-order auditory areas exhibit a complex distribution of transcripts representing ATRA synthesizing and degrading enzymes and could also be a target of retinoid signaling. Together, our survey across multiple connected song nuclei and auditory brain regions underscores the prominent role of retinoid signaling in modulating the circuitry that underlies the acquisition and production of learned vocalizations.

Vocal learning beyond imitation: mechanisms of adaptive vocal development in songbirds and human infants

Studies of vocal learning in songbirds typically focus on the acquisition of sensory templates for song imitation and on the consequent process of matching song production to templates. However, functional vocal development also requires the capacity to adaptively diverge from sensory templates, and to flexibly assemble vocal units. Examples of adaptive divergence include the corrective imitation of abnormal songs, and the decreased tendency to copy over-abundant syllables. Such frequency-dependent effects might mirror tradeoffs between the assimilation of group identity (culture) while establishing individual and flexibly expressive songs. Intriguingly, although the requirements for vocal plasticity vary across songbirds, and more so between birdsong and language, the capacity to flexibly assemble vocal sounds develops in a similar, stepwise manner across species. Therefore, universal features of vocal learning go well beyond the capacity to imitate.

Vocal motor changes beyond the sensitive period for song plasticity

Behavior is critically shaped during sensitive periods in development. Birdsong is a learned vocal behavior that undergoes dramatic plasticity during a sensitive period of sensorimotor learning. During this period, juvenile songbirds engage in vocal practice to shape their vocalizations into relatively stereotyped songs. By the time songbirds reach adulthood, their songs are relatively stable and thought to be "crystallized." Recent studies, however, highlight the potential for adult song plasticity and suggest that adult song could naturally change over time. As such, we investigated the degree to which temporal and spectral features of song changed over time in adult Bengalese finches. We observed that the sequencing and timing of song syllables became more stereotyped over time. Increases in the stereotypy of syllable sequencing were due to the pruning of infrequently produced transitions and, to a lesser extent, increases in the prevalence of frequently produced transitions. Changes in song tempo were driven by decreases in the duration and variability of intersyllable gaps. In contrast to significant changes to temporal song features, we found little evidence that the spectral structure of adult song syllables changed over time. These data highlight differences in the degree to which temporal and spectral features of adult song change over time and support evidence for distinct mechanisms underlying the control of syllable sequencing, timing, and structure. Furthermore, the observed changes to temporal song features are consistent with a Hebbian framework of behavioral plasticity and support the notion that adult song should be considered a form of vocal practice.

Dynamic sensory cues shape song structure in Drosophila

The generation of acoustic communication signals is widespread across the animal kingdom, and males of many species, including Drosophilidae, produce patterned courtship songs to increase their chance of success with a female. For some animals, song structure can vary considerably from one rendition to the next; neural noise within pattern generating circuits is widely assumed to be the primary source of such variability, and statistical models that incorporate neural noise are successful at reproducing the full variation present in natural songs. In direct contrast, here we demonstrate that much of the pattern variability in Drosophila courtship song can be explained by taking into account the dynamic sensory experience of the male. In particular, using a quantitative behavioural assay combined with computational modelling, we find that males use fast modulations in visual and self-motion signals to pattern their songs, a relationship that we show is evolutionarily conserved. Using neural circuit manipulations, we also identify the pathways involved in song patterning choices and show that females are sensitive to song features. Our data not only demonstrate that Drosophila song production is not a fixed action pattern, but establish Drosophila as a valuable new model for studies of rapid decision-making under both social and naturalistic conditions.

Dynamic sensory cues shape song structure in Drosophila

The generation of acoustic communication signals is widespread across the animal kingdom, and males of many species, including Drosophilidae, produce patterned courtship songs to increase their chance of success with a female. For some animals, song structure can vary considerably from one rendition to the next; neural noise within pattern generating circuits is widely assumed to be the primary source of such variability, and statistical models that incorporate neural noise are successful at reproducing the full variation present in natural songs. In direct contrast, here we demonstrate that much of the pattern variability in Drosophila courtship song can be explained by taking into account the dynamic sensory experience of the male. In particular, using a quantitative behavioural assay combined with computational modelling, we find that males use fast modulations in visual and self-motion signals to pattern their songs, a relationship that we show is evolutionarily conserved. Using neural circuit manipulations, we also identify the pathways involved in song patterning choices and show that females are sensitive to song features. Our data not only demonstrate that Drosophila song production is not a fixed action pattern, but establish Drosophila as a valuable new model for studies of rapid decision-making under both social and naturalistic conditions.

The role of efference copy in striatal learning

Reinforcement learning requires the convergence of signals representing context, action, and reward. While models of basal ganglia function have well-founded hypotheses about the neural origin of signals representing context and reward, the function and origin of signals representing action are less clear. Recent findings suggest that exploratory or variable behaviors are initiated by a wide array of 'action-generating' circuits in the midbrain, brainstem, and cortex. Thus, in order to learn, the striatum must incorporate an efference copy of action decisions made in these action-generating circuits. Here we review several recent neural models of reinforcement learning that emphasize the role of efference copy signals. Also described are ideas about how these signals might be integrated with inputs signaling context and reward.

Disconnection of a basal ganglia circuit in juvenile songbirds attenuates the spectral differentiation of song syllables

Similar to language acquisition by human infants, juvenile male zebra finches (Taeniopygia guttata) imitate an adult (tutor) song by transitioning from repetitive production of one or two undifferentiated protosyllables to the sequential production of a larger and spectrally heterogeneous set of syllables. The primary motor region that controls learned song is driven by a confluence of input from two premotor pathways: a posterior pathway that encodes the adult song syllables and an anterior pathway that includes a basal ganglia (BG)-thalamo-cortical circuit. Similar to mammalian motor-learning systems, the songbird BG circuit is thought to be necessary for shaping juvenile vocal behaviour (undifferentiated protosyllables) toward specific targets (the tutor's song syllables). Here, we tested the hypothesis that anterior pathway activity contributes to the process of protosyllable differentiation. Bilateral ablation of lateral magnocellular nucleus of the anterior nidopallium (LMAN) was used to disconnect BG circuitry at ages before protosyllable production and differentiation. Comparison to surgical controls revealed that protosyllables fail to differentiate in birds that received juvenile LMAN ablation--the adult songs of birds with >80% bilateral LMAN ablation consisted of only one or two syllables produced with the repetitive form and spectral structure that characterizes undifferentiated protosyllables in normal juveniles. Our findings support a role for BG circuitry in shaping juvenile vocal behaviour toward the acoustic structure of the tutor song and suggest that posterior pathway function remains in an immature "default" state when developmental interaction with the anterior pathway is reduced or eliminated.

Differential androgen receptor expression and DNA methylation state in striatum song nucleus Area X between wild and domesticated songbird strains

In songbirds, a specialized neural system, the song system, is responsible for acquisition and expression of species-specific vocal patterns. We report evidence for differential gene expression between wild and domesticated strains having different learned vocal phenotypes. A domesticated strain of the wild white-rumped munia, the Bengalese finch, has a distinct song pattern with a more complicated syntax than the wild strain. We identified differential androgen receptor (AR) expression in basal ganglia nucleus Area X GABAergic neurons between the two strains, and within different domesticated populations. Differences in AR expression were correlated with the mean coefficient of variation of the inter-syllable duration in the two strains. Differential AR expression in Area X was observed before the initiation of singing, suggesting that inherited and/or early developmental mechanisms may affect expression within and between strains. However, there were no distinct differences in regions upstream of the AR start codon among all the birds in the study. In contrast, an epigenetic modification, DNA methylation state in regions upstream of AR in Area X, was observed to differ between strains and within domesticated populations. These results provide insight into the molecular basis of behavioral evolution through the regulation of hormone-related genes and demonstrate the potential association between epigenetic modifications and behavioral phenotype regulation.

At the interface of the auditory and vocal motor systems: NIf and its role in vocal processing, production and learning

Communication between auditory and vocal motor nuclei is essential for vocal learning. In songbirds, the nucleus interfacialis of the nidopallium (NIf) is part of a sensorimotor loop, along with auditory nucleus avalanche (Av) and song system nucleus HVC, that links the auditory and song systems. Most of the auditory information comes through this sensorimotor loop, with the projection from NIf to HVC representing the largest single source of auditory information to the song system. In addition to providing the majority of HVC's auditory input, NIf is also the primary driver of spontaneous activity and premotor-like bursting during sleep in HVC. Like HVC and RA, two nuclei critical for song learning and production, NIf exhibits behavioral-state dependent auditory responses and strong motor bursts that precede song output. NIf also exhibits extended periods of fast gamma oscillations following vocal production. Based on the converging evidence from studies of physiology and functional connectivity it would be reasonable to expect NIf to play an important role in the learning, maintenance, and production of song. Surprisingly, however, lesions of NIf in adult zebra finches have no effect on song production or maintenance. Only the plastic song produced by juvenile zebra finches during the sensorimotor phase of song learning is affected by NIf lesions. In this review, we carefully examine what is known about NIf at the anatomical, physiological, and behavioral levels. We reexamine conclusions drawn from previous studies in the light of our current understanding of the song system, and establish what can be said with certainty about NIf's involvement in song learning, maintenance, and production. Finally, we review recent theories of song learning integrating possible roles for NIf within these frameworks and suggest possible parallels between NIf and sensorimotor areas that form part of the neural circuitry for speech processing in humans.

Development of temporal structure in zebra finch song

Zebra finch song has provided an excellent case study in the neural basis of sequence learning, with a high degree of temporal precision and tight links with precisely timed bursting in forebrain neurons. To examine the development of song timing, we measured the following four aspects of song temporal structure at four age ranges between 65 and 375 days posthatch: the mean durations of song syllables and the silent gaps between them, timing variability linked to song tempo, timing variability expressed independently across syllables and gaps, and transition probabilities between consecutive syllable pairs. We found substantial increases in song tempo between 65 and 85 days posthatch, due almost entirely to a shortening of gaps. We also found a decrease in tempo variability, also specific to gaps. Both the magnitude of the increase in tempo and the decrease in tempo variability were correlated on gap-by-gap basis with increases in the reliability of corresponding syllable transitions. Syllables had no systematic increase in tempo or decrease in tempo variability. In contrast to tempo parameters, both syllables and gaps showed an early sharp reduction in independent variability followed by continued reductions over the first year. The data suggest that links between syllable-based representations are strengthened during the later parts of the traditional period of song learning and that song rhythm continues to become more regular throughout the first year of life. Similar learning patterns have been identified in human sequence learning, suggesting a potentially rich area of comparative research.

Oculomotor learning revisited: a model of reinforcement learning in the basal ganglia incorporating an efference copy of motor actions

In its simplest formulation, reinforcement learning is based on the idea that if an action taken in a particular context is followed by a favorable outcome, then, in the same context, the tendency to produce that action should be strengthened, or reinforced. While reinforcement learning forms the basis of many current theories of basal ganglia (BG) function, these models do not incorporate distinct computational roles for signals that convey context, and those that convey what action an animal takes. Recent experiments in the songbird suggest that vocal-related BG circuitry receives two functionally distinct excitatory inputs. One input is from a cortical region that carries context information about the current “time” in the motor sequence. The other is an efference copy of motor commands from a separate cortical brain region that generates vocal variability during learning. Based on these findings, I propose here a general model of vertebrate BG function that combines context information with a distinct motor efference copy signal. The signals are integrated by a learning rule in which efference copy inputs gate the potentiation of context inputs (but not efference copy inputs) onto medium spiny neurons in response to a rewarded action. The hypothesis is described in terms of a circuit that implements the learning of visually guided saccades. The model makes testable predictions about the anatomical and functional properties of hypothesized context and efference copy inputs to the striatum from both thalamic and cortical sources.

Striatal dopamine modulates song spectral but not temporal features through D1 receptors

The activity of midbrain dopaminergic neurons and their projection to the basal ganglia (BG) are thought to play a critical role in the acquisition of motor skills through reinforcement learning, as well as in the expression of learned motor behaviors. The precise role of BG dopamine (DA) in mediating and modulating motor performance and learning, however, remains unclear. In songbirds, a specialized portion of the BG is responsible for song learning and plasticity. Previously we found that DA acts on D1 receptors in Area X to modulate the BG output signal and thereby trigger changes in song variability. Here, we investigate the effect of D1 receptor blockade in the BG on song behavior in the zebra finch. We report that this manipulation abolishes social context-dependent changes in variability not only in harmonic stacks, but also in other types of syllables. However, song timing seems not to be modulated by this BG DA signal. Indeed, injections of a D1 antagonist in the BG altered neither song duration nor the change of song duration with social context. Finally, D1 receptor activation in the BG was not necessary for the modulation of other features of song, such as the number of introductory notes or motif repetitions. Together, our results suggest that activation of D1 receptors in the BG is necessary for the modulation of fine acoustic features of song with social context, while it is not involved in the regulation of song timing and structure at a larger time scale.

A cortical motor nucleus drives the basal ganglia-recipient thalamus in singing birds

The pallido-recipient thalamus transmits information from the basal ganglia (BG) to the cortex and plays a critical role motor initiation and learning. Thalamic activity is strongly inhibited by pallidal inputs from the BG, but the role of non-pallidal inputs, such as excitatory inputs from cortex, is unclear. We have recorded simultaneously from presynaptic pallidal axon terminals and postsynaptic thalamocortical neurons in a BG-recipient thalamic nucleus necessary for vocal variability and learning in zebra finches. We found that song-locked rate modulations in the thalamus could not be explained by pallidal inputs alone, and persisted following pallidal lesion. Instead, thalamic activity was likely driven by inputs from a motor ‘cortical’ nucleus also necessary for singing. These findings suggest a role for cortical inputs to the pallido-recipient thalamus in driving premotor signals important for exploratory behavior and learning.

A hypothesis for basal ganglia-dependent reinforcement learning in the songbird

Most of our motor skills are not innately programmed, but are learned by a combination of motor exploration and performance evaluation, suggesting that they proceed through a reinforcement learning (RL) mechanism. Songbirds have emerged as a model system to study how a complex behavioral sequence can be learned through an RL-like strategy. Interestingly, like motor sequence learning in mammals, song learning in birds requires a basal ganglia (BG)-thalamocortical loop, suggesting common neural mechanisms. Here, we outline a specific working hypothesis for how BG-forebrain circuits could utilize an internally computed reinforcement signal to direct song learning. Our model includes a number of general concepts borrowed from the mammalian BG literature, including a dopaminergic reward prediction error and dopamine-mediated plasticity at corticostriatal synapses. We also invoke a number of conceptual advances arising from recent observations in the songbird. Specifically, there is evidence for a specialized cortical circuit that adds trial-to-trial variability to stereotyped cortical motor programs, and a role for the BG in "biasing" this variability to improve behavioral performance. This BG-dependent "premotor bias" may in turn guide plasticity in downstream cortical synapses to consolidate recently learned song changes. Given the similarity between mammalian and songbird BG-thalamocortical circuits, our model for the role of the BG in this process may have broader relevance to mammalian BG function.