A Basal Ganglia Circuit Sufficient to Guide Birdsong Learning

Genomic loss of GPR108 disrupts AAV transduction in birds

The G protein-coupled receptor 108 (GPR108) gene encodes a protein factor identified as critical for adeno-associated virus (AAV) entry into mammalian cells, but whether it is universally involved in AAV transduction is unknown. Remarkably, we have discovered that GPR108 is absent in the genomes of birds and in most other sauropsids, providing a likely explanation for the overall lower AAV transduction efficacy of common AAV serotypes in birds compared to mammals. Importantly, transgenic expression of human GPR108 and manipulation of related glycan binding sites in the viral capsid significantly boost AAV transduction in zebra finch cells. These findings contribute to a more in depth understanding of the mechanisms and evolution of AAV transduction, with potential implications for the design of efficient tools for gene manipulation in experimental animal models, and a range of gene therapy applications in humans.

All-optical presynaptic plasticity induction by photoactivated adenylyl cyclase targeted to axon terminals

Intracellular signaling plays essential roles in various cell types. In the central nervous system, signaling cascades are strictly regulated in a spatiotemporally specific manner to govern brain function; for example, presynaptic cyclic adenosine monophosphate (cAMP) can enhance the probability of neurotransmitter release. In the last decade, channelrhodopsin-2 has been engineered for subcellular targeting using localization tags, but optogenetic tools for intracellular signaling are not well developed. Therefore, we engineered a selective presynaptic fusion tag for photoactivated adenylyl cyclase (bPAC-Syn1a) and found its high localization at presynaptic terminals. Furthermore, an all-optical electrophysiological method revealed rapid and robust short-term potentiation by bPAC-Syn1a at brain stem-amygdala synapses in acute brain slices. Additionally, bPAC-Syn1a modulated mouse immobility behavior. These results indicate that bPAC-Syn1a can manipulate presynaptic cAMP signaling in vitro and in vivo. The all-optical manipulation technique developed in this study can help further elucidate the dynamic regulation of various cellular functions.

The role of cerebellum in learned vocal communication in adult songbirds

Injury, tumors, ischemia, and lesions in the cerebellum show the involvement of this region in human speech. The association of the cerebellum with learned birdsong has only been identified recently. Cerebellar dysfunction in young songbirds causes learning disabilities, but its role in adult songbirds has not been established. The aim of this study was to investigate the role of the deep cerebellar nuclei (DCN) in adult birdsong. We created bilateral excitotoxic lesions in the DCN of adult male zebra finches (Taeniopygia guttata) and recorded their songs for up to 4 months. Using magnetic resonance imaging (MRI) and immunohistochemistry, we validated the lesion efficacy. We found that the song duration significantly increased from 14 weeks post-op; the increase in duration was caused by a greater number of introductory notes as well as a greater number of syllables sung after the introductory notes. On the other hand, the motif duration decreased from 8 weeks after DCN lesions were induced, which was due to faster singing of syllables, not changes in inter-syllable interval length. DCN lesions also caused a decrease in the fundamental frequency of syllables. In summary, we showed that DCN lesions influence the temporal and acoustic features of birdsong. These results suggest that the cerebellum influences singing in adult songbirds.

Parallel executive pallio-motor loops in the pigeon brain

A core component of the avian pallial cognitive network is the multimodal nidopallium caudolaterale (NCL) that is considered to be analogous to the mammalian prefrontal cortex (PFC). The NCL plays a key role in a multitude of executive tasks such as working memory, decision-making during navigation, and extinction learning in complex learning environments. Like the PFC, the NCL is positioned at the transition from ascending sensory to descending motor systems. For the latter, it sends descending premotor projections to the intermediate arcopallium (AI) and the medial striatum (MSt). To gain detailed insight into the organization of these projections, we conducted several retrograde and anterograde tracing experiments. First, we tested whether NCL neurons projecting to AI (NCLarco neurons) and MSt (NCLMSt neurons) are constituted by a single neuronal population with bifurcating neurons, or whether they form two distinct populations. Here, we found two distinct projection patterns to both target areas that were associated with different morphologies. Second, we revealed a weak topographic projection toward the medial and lateral striatum and a strong topographic projection toward AI with clearly distinguishable sensory termination fields. Third, we investigated the relationship between the descending NCL pathways to the arcopallium with those from the hyperpallium apicale, which harbors a second major descending pathway of the avian pallium. We embed our findings within a system of parallel pallio-motor loops that carry information from separate sensory modalities to different subpallial systems. Our results also provide insights into the evolution of the avian motor system from which, possibly, the song system has emerged.

Role of the basal ganglia in innate and learned behavioural sequences

Integrating individual actions into coherent, organised behavioural units, a process called chunking, is a fundamental, evolutionarily conserved process that renders actions automatic. In vertebrates, evidence points to the basal ganglia - a complex network believed to be involved in action selection - as a key component of action sequence encoding, although the underlying mechanisms are only just beginning to be understood. Central pattern generators control many innate automatic behavioural sequences that form some of the most basic behaviours in an animal's repertoire, and in vertebrates, brainstem and spinal pattern generators are under the control of higher order structures such as the basal ganglia. Evidence suggests that the basal ganglia play a crucial role in the concatenation of simpler behaviours into more complex chunks, in the context of innate behavioural sequences such as chain grooming in rats, as well as sequences in which innate capabilities and learning interact such as birdsong, and sequences that are learned from scratch, such as lever press sequences in operant behaviour. It has been proposed that the role of the striatum, the largest input structure of the basal ganglia, might lie in selecting and allowing the relevant central pattern generators to gain access to the motor system in the correct order, while inhibiting other behaviours. As behaviours become more complex and flexible, the pattern generators seem to become more dependent on descending signals. Indeed, during learning, the striatum itself may adopt the functional characteristics of a higher order pattern generator, facilitated at the microcircuit level by striatal neuropeptides.

Songbird mesostriatal dopamine pathways are spatially segregated before the onset of vocal learning

Diverse dopamine (DA) pathways send distinct reinforcement signals to different striatal regions. In adult songbirds, a DA pathway from the ventral tegmental area (VTA) to Area X, the striatal nucleus of the song system, carries singing-related performance error signals important for learning. Meanwhile, a parallel DA pathway to a medial striatal area (MST) arises from a distinct group of neighboring DA neurons that lack connectivity to song circuits and do not encode song error. To test if the structural and functional segregation of these two pathways depends on singing experience, we carried out anatomical studies early in development before the onset of song learning. We find that distinct VTA neurons project to either Area X or MST in juvenile birds before the onset of substantial vocal practice. Quantitative comparisons of early juveniles (30-35 days post hatch), late juveniles (60-65 dph), and adult (>90 dph) brains revealed an outsized expansion of Area X-projecting neurons relative to MST-projecting neurons in VTA over development. These results show that a mesostriatal DA system dedicated to social communication can exist and be spatially segregated before the onset of vocal practice and associated sensorimotor experience.

Barasertib impedes chondrocyte senescence and alleviates osteoarthritis by mitigating the destabilization of heterochromatin induced by AURKB

Osteoarthritis (OA) is a common joint disease characterized by progressive cartilage loss that causes disability worldwide. The accumulation of senescent chondrocytes in aging human cartilage contributes to the high incidence of OA. Heterochromatin instability, the hallmark and driving factor of senescence, regulates the expression of the senescence-associated secretory phenotype that induces inflammation and cartilage destruction. However, the role of heterochromatin instability in OA progression remains unclear. In this work, we identified AURKB as a key senescence-associated chromatin regulator using bioinformatics methods. We found that AURKB was upregulated in OA cartilage and chondrocytes exposed to abnormal mechanical strain. Overexpression of AURKB could cause senescence and heterochromatin instability. Furthermore, the AURKB inhibitor Barasertib reversed senescence and heterochromatin instability in chondrocytes and alleviated OA in a rat model. Mechanistically, abnormal mechanical strain increased AURKB levels through the Piezo1/Ca2+ signaling axis. Blocking Piezo1/Ca2+ signaling by short interfering RNA against Piezo1 and Ca2+ chelator BAPTA could reduce the expression of AURKB and alleviate senescence in chondrocytes exposed to abnormal mechanical strain. In conclusion, our data confirmed that abnormal mechanical strain increases the expression of AURKB by activating the Piezo1/Ca2+ signaling axis, leading to destabilized heterochromatin and senescence in chondrocytes, whereas Barasertib consolidates heterochromatin, counteracts senescence and alleviates OA.

Divergent projections from locus coeruleus to the corticobasal ganglia system and ventral tegmental area of the adult male zebra finch

The locus coeruleus (LC) is a small noradrenergic brainstem nucleus that plays a central role in regulating arousal, attention, and performance. In the mammalian brain, individual LC neurons make divergent axonal projections to different brain regions, which are distinguished in part by which noradrenaline (NA) receptor subtypes they express. Here, we sought to determine whether similar organizational features characterize LC projections to corticobasal ganglia (CBG) circuitry in the zebra finch song system, with a focus on the basal ganglia nucleus Area X, the thalamic nucleus DLM, as well as the cortical nuclei HVC, LMAN, and RA. Single and dual retrograde tracer injections reveal that single LC-NA neurons make divergent projections to LMAN and Area X, as well as to the dopaminergic VTA/SNc complex that innervates this CBG circuit. Moreover, in situ hybridization revealed that differential expression of mRNA encoding α2A and α2C adrenoreceptors distinguishes LC-recipient CBG song nuclei. Therefore, LC-NA signaling in the zebra finch CBG circuit employs a similar strategy as in mammals, which could allow a relatively small number of LC neurons to exert widespread yet distinct effects across multiple brain regions.

Dynamic modulation of subthalamic nucleus activity facilitates adaptive behavior

Adapting actions to changing goals and environments is central to intelligent behavior. There is evidence that the basal ganglia play a crucial role in reinforcing or adapting actions depending on their outcome. However, the corresponding electrophysiological correlates in the basal ganglia and the extent to which these causally contribute to action adaptation in humans is unclear. Here, we recorded electrophysiological activity and applied bursts of electrical stimulation to the subthalamic nucleus, a core area of the basal ganglia, in 16 patients with Parkinson's disease (PD) on medication using temporarily externalized deep brain stimulation (DBS) electrodes. Patients as well as 16 age- and gender-matched healthy participants attempted to produce forces as close as possible to a target force to collect a maximum number of points. The target force changed over trials without being explicitly shown on the screen so that participants had to infer target force based on the feedback they received after each movement. Patients and healthy participants were able to adapt their force according to the feedback they received (P < 0.001). At the neural level, decreases in subthalamic beta (13 to 30 Hz) activity reflected poorer outcomes and stronger action adaptation in 2 distinct time windows (Pcluster-corrected < 0.05). Stimulation of the subthalamic nucleus reduced beta activity and led to stronger action adaptation if applied within the time windows when subthalamic activity reflected action outcomes and adaptation (Pcluster-corrected < 0.05). The more the stimulation volume was connected to motor cortex, the stronger was this behavioral effect (Pcorrected = 0.037). These results suggest that dynamic modulation of the subthalamic nucleus and interconnected cortical areas facilitates adaptive behavior.

A custom-made AAV1 variant (AAV1-T593K) enables efficient transduction of Japanese quail neurons in vitro and in vivo

The widespread use of rodents in neuroscience has prompted the development of optimized viral variants for transduction of brain cells, in vivo. However, many of the viruses developed are less efficient in other model organisms, with birds being among the most resistant to transduction by current viral tools. Resultantly, the use of genetically-encoded tools and methods in avian species is markedly lower than in rodents; likely holding the field back. We sought to bridge this gap by developing custom viruses towards the transduction of brain cells of the Japanese quail. We first develop a protocol for culturing primary neurons and glia from quail embryos, followed by characterization of cultures via immunostaining, single cell mRNA sequencing, patch clamp electrophysiology and calcium imaging. We then leveraged the cultures for the rapid screening of various viruses, only to find that all yielded poor to no infection of cells in vitro. However, few infected neurons were obtained by AAV1 and AAV2. Scrutiny of the sequence of the AAV receptor found in quails led us to rationally design a custom-made AAV variant (AAV1-T593K; AAV1*) that exhibits improved transduction efficiencies in vitro and in vivo (14- and five-fold, respectively). Together, we present unique culturing method, transcriptomic profiles of quail's brain cells and a custom-tailored AAV1 for transduction of quail neurons in vitro and in vivo.

Spontaneous behaviour is structured by reinforcement without explicit reward

Spontaneous animal behaviour is built from action modules that are concatenated by the brain into sequences1,2. However, the neural mechanisms that guide the composition of naturalistic, self-motivated behaviour remain unknown. Here we show that dopamine systematically fluctuates in the dorsolateral striatum (DLS) as mice spontaneously express sub-second behavioural modules, despite the absence of task structure, sensory cues or exogenous reward. Photometric recordings and calibrated closed-loop optogenetic manipulations during open field behaviour demonstrate that DLS dopamine fluctuations increase sequence variation over seconds, reinforce the use of associated behavioural modules over minutes, and modulate the vigour with which modules are expressed, without directly influencing movement initiation or moment-to-moment kinematics. Although the reinforcing effects of optogenetic DLS dopamine manipulations vary across behavioural modules and individual mice, these differences are well predicted by observed variation in the relationships between endogenous dopamine and module use. Consistent with the possibility that DLS dopamine fluctuations act as a teaching signal, mice build sequences during exploration as if to maximize dopamine. Together, these findings suggest a model in which the same circuits and computations that govern action choices in structured tasks have a key role in sculpting the content of unconstrained, high-dimensional, spontaneous behaviour.

Birdsong

Have your ever felt as happy as a lark, feathered your nest or taken someone under your wing? As we watch birds, we cannot help but be struck by their uncannily familiar behaviors - singing, nest building, caring for their young - to name just a few. Songbirds - the oscine suborder of perching birds that constitute roughly half (∼4,000) of all known avian species - are noted for the songs that males and sometimes both sexes in this group sing to court mates and defend territory from rivals. Birdsongs contain several to many acoustically distinct syllables, typically organized into a stereotyped phrase, and span the same audio bandwidth that we exploit for speech and music, making them easy for us to hear and appreciate. Consequently, eavesdropping humans long ago detected the most striking parallel between songbirds and humans: juvenile songbirds learn to sing in a manner similar to a child learning to speak.

Shared mechanisms of auditory and non-auditory vocal learning in the songbird brain

Songbirds and humans share the ability to adaptively modify their vocalizations based on sensory feedback. Prior studies have focused primarily on the role that auditory feedback plays in shaping vocal output throughout life. In contrast, it is unclear how non-auditory information drives vocal plasticity. Here, we first used a reinforcement learning paradigm to establish that somatosensory feedback (cutaneous electrical stimulation) can drive vocal learning in adult songbirds. We then assessed the role of a songbird basal ganglia thalamocortical pathway critical to auditory vocal learning in this novel form of vocal plasticity. We found that both this circuit and its dopaminergic inputs are necessary for non-auditory vocal learning, demonstrating that this pathway is critical for guiding adaptive vocal changes based on both auditory and somatosensory signals. The ability of this circuit to use both auditory and somatosensory information to guide vocal learning may reflect a general principle for the neural systems that support vocal plasticity across species.

Optogenetics at the presynapse

Optogenetic actuators enable highly precise spatiotemporal interrogation of biological processes at levels ranging from the subcellular to cells, circuits and behaving organisms. Although their application in neuroscience has traditionally focused on the control of spiking activity at the somatodendritic level, the scope of optogenetic modulators for direct manipulation of presynaptic functions is growing. Presynaptically localized opsins combined with light stimulation at the terminals allow light-mediated neurotransmitter release, presynaptic inhibition, induction of synaptic plasticity and specific manipulation of individual components of the presynaptic machinery. Here, we describe presynaptic applications of optogenetic tools in the context of the unique cell biology of axonal terminals, discuss their potential shortcomings and outline future directions for this rapidly developing research area.

Calcium-binding proteins typify the dopaminergic neuronal subtypes in the ventral tegmental area of zebra finch, Taeniopygia guttata

Calcium-binding proteins (CBPs) regulate neuronal function in midbrain dopamine (DA)-ergic neurons in mammals by buffering and sensing the intracellular Ca²⁺ , and vesicular release. In birds, the equivalent set of neurons are important in song learning, directed singing, courtship, and energy balance, yet the status of CBPs in these neurons is unknown. Herein, for the first time, we probe the nature of CBPs, namely, Calbindin-, Calretinin-, Parvalbumin-, and Secretagogin-expressing DA neurons in the ventral tegmental area (VTA) and substantia nigra (SN) in the midbrain of zebra finch, Taeniopygia guttata. qRT-PCR analysis of ventral midbrain tissue fragment revealed higher Calbindin- and Calretinin-mRNA levels compared to Parvalbumin and Secretagogin. Application of immunofluorescence showed CBP-immunoreactive (-i) neurons in VTA (anterior [VTAa], mid [VTAm], caudal [VTAc]), SN (compacta [SNc], and reticulata [SNr]). Compared to VTAa, higher Calbindin- and Parvalbumin-immunoreactivity (-ir), and lower Calretinin-ir were observed in VTAm and VTAc. Secretagogin-ir was highly localized to VTAa. In SN, Calbindin- and Calretinin-ir were higher in SNc, SNr was Parvalbumin enriched, and Secretagogin-ir was not detected. Weak, moderate, and intense tyrosine hydroxylase (TH)-i VTA neurons were demarcated as subtypes 1, 2, and 3, respectively. While subtype 1 TH-i neurons were neither Calbindin- nor Calretinin-i, ∼80 and ∼65% subtype 2 and ∼30 and ∼45% subtype 3 TH-i neurons co-expressed Calbindin and Calretinin, respectively. All TH-i neuronal subtypes co-expressed Parvalbumin with reciprocal relationship with TH-ir. We suggest that the CBPs may determine VTA DA neuronal heterogeneity and differentially regulate their activity in T. guttata.

Effect of Darkness on Intrinsic Motivation for Undirected Singing in Bengalese Finch (Lonchura striata Domestica): A Comparative Study With Zebra Finch (Taeniopygia guttata)

The zebra finch (ZF) and the Bengalese finch (BF) are animal models that have been commonly used for neurobiological studies on vocal learning. Although they largely share the brain structure for vocal learning and production, BFs produce more complex and variable songs than ZFs, providing a great opportunity for comparative studies to understand how animals learn and control complex motor behaviors. Here, we performed a comparative study between the two species by focusing on intrinsic motivation for non-courtship singing (“undirected singing”), which is critical for the development and maintenance of song structure. A previous study has demonstrated that ZFs dramatically increase intrinsic motivation for undirected singing when singing is temporarily suppressed by a dark environment. We found that the same procedure in BFs induced the enhancement of intrinsic singing motivation to much smaller degrees than that in ZFs. Moreover, unlike ZFs that rarely sing in dark conditions, substantial portion of BFs exhibited frequent singing in darkness, implying that such “dark singing” may attenuate the enhancement of intrinsic singing motivation during dark periods. In addition, measurements of blood corticosterone levels in dark and light conditions provided evidence that although BFs have lower stress levels than ZFs in dark conditions, such lower stress levels in BFs are not the major factor responsible for their frequent dark singing. Our findings highlight behavioral and physiological differences in spontaneous singing behaviors of BFs and ZFs and provide new insights into the interactions between singing motivation, ambient light, and environmental stress.

Dopamine neurons evaluate natural fluctuations in performance quality

Many motor skills are learned by comparing ongoing behavior to internal performance benchmarks. Dopamine neurons encode performance error in behavioral paradigms where error is externally induced, but it remains unknown whether dopamine also signals the quality of natural performance fluctuations. Here, we record dopamine neurons in singing birds and examine how spontaneous dopamine spiking activity correlates with natural fluctuations in ongoing song. Antidromically identified basal ganglia-projecting dopamine neurons correlate with recent, and not future, song variations, consistent with a role in evaluation, not production. Furthermore, maximal dopamine spiking occurs at a single vocal target, consistent with either actively maintaining the existing song or shifting the song to a nearby form. These data show that spontaneous dopamine spiking can evaluate natural behavioral fluctuations unperturbed by experimental events such as cues or rewards.

Learning and producing skilled behavior requires an internal measure of performance. Duffy et al. examine dopamine neurons’ relationship to natural song in singing birds. Spontaneous dopamine activity correlates with song fluctuations in a manner consistent with evaluation of natural behavioral variations, independent of external perturbations, cues, or rewards.

The Role of the Endogenous Opioid System in the Vocal Behavior of Songbirds and Its Possible Role in Vocal Learning

The opioid system in the brain is responsible for processing affective states such as pain, pleasure, and reward. It consists of three main receptors, mu- (μ-ORs), delta- (δ-ORs), and kappa- (κ-ORs), and their ligands – the endogenous opioid peptides. Despite their involvement in the reward pathway, and a signaling mechanism operating in synergy with the dopaminergic system, fewer reports focus on the role of these receptors in higher cognitive processes. Whereas research on opioids is predominated by studies on their addictive properties and role in pain pathways, recent studies suggest that these receptors may be involved in learning. Rodents deficient in δ-ORs were poor at recognizing the location of novel objects in their surroundings. Furthermore, in chicken, learning to avoid beads coated with a bitter chemical from those without the coating was modulated by δ-ORs. Similarly, μ-ORs facilitate long term potentiation in hippocampal CA3 neurons in mammals, thereby having a positive impact on spatial learning. Whereas these studies have explored the role of opioid receptors on learning using reward/punishment-based paradigms, the role of these receptors in natural learning processes, such as vocal learning, are yet unexplored. In this review, we explore studies that have established the expression pattern of these receptors in different brain regions of birds, with an emphasis on songbirds which are model systems for vocal learning. We also review the role of opioid receptors in modulating the cognitive processes associated with vocalizations in birds. Finally, we discuss the role of these receptors in regulating the motivation to vocalize, and a possible role in modulating vocal learning.

Songbird subthalamic neurons project to dopaminergic midbrain and exhibit singing-related activity

Skill learning requires motor output to be evaluated against internal performance benchmarks. In songbirds, ventral tegmental area (VTA) dopamine neurons (DA) signal performance errors important for learning, but it remains unclear which brain regions project to VTA and how these inputs may contribute to DA error signaling. Here, we find that the songbird subthalamic nucleus (STN) projects to VTA and that STN microstimulation can excite VTA neurons. We also discover that STN receives inputs from motor cortical, auditory cortical, and ventral pallidal brain regions previously implicated in song evaluation. In the first neural recordings from songbird STN, we discover that the activity of most STN neurons is associated with body movements and not singing, but a small fraction of neurons exhibits precise song timing and performance error signals. Our results place the STN in a pathway important for song learning, but not song production, and expand the territories of songbird brain potentially associated with song learning.NEW & NOTEWORTHY Songbird subthalamic (STN) neurons exhibit singing-related signals and are interconnected with the motor cortical nucleus, auditory pallium, ventral pallidum, and ventral tegmental area, areas important for song generation and learning.

Neural correlates of vocal initiation in the VTA/SNc of juvenile male zebra finches

Initiation and execution of complex learned vocalizations such as human speech and birdsong depend on multiple brain circuits. In songbirds, neurons in the motor cortices and basal ganglia circuitry exhibit preparatory activity before initiation of song, and that activity is thought to play an important role in successful song performance. However, it remains unknown where a start signal for song is represented in the brain and how such a signal would lead to appropriate vocal initiation. To test whether neurons in the midbrain ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) show activity related to song initiation, we carried out extracellular recordings of VTA/SNc single units in singing juvenile male zebra finches. We found that a subset of VTA/SNc units exhibit phasic activity precisely time-locked to the onset of the song bout, and that the activity occurred specifically at the beginning of song. These findings suggest that phasic activity in the VTA/SNc represents a start signal that triggers song vocalization.

Computational benefits of structural plasticity, illustrated in songbirds

The plasticity of nervous systems allows animals to quickly adapt to a changing environment. In particular, the structural plasticity of brain networks is often critical to the development of the central nervous system and the acquisition of complex behaviors. As an example, structural plasticity is central to the development of song-related brain circuits and may be critical for song acquisition in juvenile songbirds. Here, we review current evidences for structural plasticity and their significance from a computational point of view. We start by reviewing evidence for structural plasticity across species and categorizing them along the spatial axes as well as the along the time course during development. We introduce the vocal learning circuitry in zebra finches, as a useful example of structural plasticity, and use this specific case to explore the possible contributions of structural plasticity to computational models. Finally, we discuss current modeling studies incorporating structural plasticity and unexplored questions which are raised by such models.

Neural dynamics underlying birdsong practice and performance

Musical and athletic skills are learned and maintained through intensive practice to enable precise and reliable performance for an audience. Consequently, understanding such complex behaviours requires insight into how the brain functions during both practice and performance. Male zebra finches learn to produce courtship songs that are more varied when alone and more stereotyped in the presence of females1. These differences are thought to reflect song practice and performance, respectively2,3, providing a useful system in which to explore how neurons encode and regulate motor variability in these two states. Here we show that calcium signals in ensembles of spiny neurons (SNs) in the basal ganglia are highly variable relative to their cortical afferents during song practice. By contrast, SN calcium signals are strongly suppressed during female-directed performance, and optogenetically suppressing SNs during practice strongly reduces vocal variability. Unsupervised learning methods4,5 show that specific SN activity patterns map onto distinct song practice variants. Finally, we establish that noradrenergic signalling reduces vocal variability by directly suppressing SN activity. Thus, SN ensembles encode and drive vocal exploration during practice, and the noradrenergic suppression of SN activity promotes stereotyped and precise song performance for an audience.

Intrinsic motivation for singing in songbirds is enhanced by temporary singing suppression and regulated by dopamine

Behaviors driven by intrinsic motivation are critical for development and optimization of physical and brain functions, but their underlying mechanisms are not well studied due to the complexity and autonomy of the behavior. Songbirds, such as zebra finches, offer a unique opportunity to study neural substrates of intrinsic motivation because they spontaneously produce many renditions of songs with highly-quantifiable structure for vocal practice, even in the absence of apparent recipients (“undirected singing”). Neural substrates underlying intrinsic motivation for undirected singing are still poorly understood partly because singing motivation cannot be easily manipulated due to its autonomy. Also, undirected singing itself acts as an internal reward, which could increase singing motivation, leading to difficulty in measuring singing motivation independent of singing-associated reward. Here, we report a simple procedure to easily manipulate and quantify intrinsic motivation for undirected singing independent of singing-associated reward. We demonstrate that intrinsic motivation for undirected singing is dramatically enhanced by temporary suppression of singing behavior and the degree of enhancement depends on the duration of suppression. Moreover, by examining latencies to the first song following singing suppression as a measure of singing motivation independent of singing-associated reward, we demonstrate that intrinsic singing motivation is critically regulated by dopamine through D2 receptors. These results provide a simple experimental tool to manipulate and measure the intrinsic motivation for undirected singing and illustrate the importance of zebra finches as a model system to study the neural basis of intrinsically-motivated behaviors.

Deafening-induced rapid changes to spine synaptic connectivity in the adult avian vocal basal ganglia

The basal ganglia have been implicated in auditory-dependent vocal learning and plasticity in human and songbirds, but the underlying neural phenotype remains to be clarified. Here, using confocal imaging and three-dimensional electron microscopy, we investigated striatal structural plasticity in response to hearing loss in Area X, the avian vocal basal ganglia, in adult male zebra finch (Taeniopygia guttata). We observed a rapid elongation of dendritic spines, by approximately 13%, by day 3 after deafening, and a considerable increase in spine synapse density, by approximately 61%, by day 14 after deafening, compared with the controls with an intact cochlea. These findings reveal structural sensitivity of Area X to auditory deprivation and suggest that this striatal plasticity might contribute to deafening-induced changes to learned vocal behavior.

What Is the Role of Thalamostriatal Circuits in Learning Vocal Sequences?

Basal ganglia (BG) circuits integrate sensory and motor-related information from the cortex, thalamus, and midbrain to guide learning and production of motor sequences. Birdsong, like speech, is comprised of precisely sequenced vocal elements. Learning song sequences during development relies on Area X, a vocalization related region in the medial striatum of the songbird BG. Area X receives inputs from cortical-like pallial song circuits and midbrain dopaminergic circuits and sends projections to the thalamus. It has recently been shown that thalamic circuits also send substantial projections back to Area X. Here, we outline a gated-reinforcement learning model for how Area X may use signals conveyed by thalamostriatal inputs to direct song learning. Integrating conceptual advances from recent mammalian and songbird literature, we hypothesize that thalamostriatal pathways convey signals linked to song syllable onsets and offsets and influence striatal circuit plasticity via regulation of cholinergic interneurons (ChIs). We suggest that syllable sequence associated vocal-motor information from the thalamus drive precisely timed pauses in ChIs activity in Area X. When integrated with concurrent corticostriatal and dopaminergic input, this circuit helps regulate plasticity on medium spiny neurons (MSNs) and the learning of syllable sequences. We discuss new approaches that can be applied to test core ideas of this model and how associated insights may provide a framework for understanding the function of BG circuits in learning motor sequences.

Unilateral vocal nerve resection alters neurogenesis in the avian song system in a region-specific manner

New neurons born in the adult brain undergo a critical period soon after migration to their site of incorporation. During this time, the behavior of the animal may influence the survival or culling of these cells. In the songbird song system, earlier work suggested that adult-born neurons may be retained in the song motor pathway nucleus HVC with respect to motor progression toward a target song during juvenile song learning, seasonal song restructuring, and experimentally manipulated song variability. However, it is not known whether the quality of song per se, without progressive improvement, may also influence new neuron survival. To test this idea, we experimentally altered song acoustic structure by unilateral denervation of the syrinx, causing a poor quality song. We found no effect of aberrant song on numbers of new neurons in HVC, suggesting that song quality does not influence new neuron culling in this region. However, aberrant song resulted in the loss of left-side dominance in new neurons in the auditory region caudomedial nidopallium (NCM), and a bilateral decrease in new neurons in the basal ganglia nucleus Area X. Thus new neuron culling may be influenced by behavioral feedback in accordance with the function of new neurons within that region. We propose that studying the effects of singing behaviors on new neurons across multiple brain regions that differentially subserve singing may give rise to general rules underlying the regulation of new neuron survival across taxa and brain regions more broadly.

Dopamine Modulation of Motor and Sensory Cortical Plasticity among Vertebrates

Goal-directed learning is a key contributor to evolutionary fitness in animals. The neural mechanisms that mediate learning often involve the neuromodulator dopamine. In higher order cortical regions, most of what is known about dopamine's role is derived from brain regions involved in motivation and decision-making, while significantly less is known about dopamine's potential role in motor and/or sensory brain regions to guide performance. Research on rodents and primates represents over 95% of publications in the field, while little beyond basic anatomy is known in other vertebrate groups. This significantly limits our general understanding of how dopamine signaling systems have evolved as organisms adapt to their environments. This review takes a pan-vertebrate view of the literature on the role of dopamine in motor/sensory cortical regions, highlighting, when available, research on non-mammalian vertebrates. We provide a broad perspective on dopamine function and emphasize that dopamine-induced plasticity mechanisms are widespread across all cortical systems and associated with motor and sensory adaptations. The available evidence illustrates that there is a strong anatomical basis-dopamine fibers and receptor distributions-to hypothesize that pallial dopamine effects are widespread among vertebrates. Continued research progress in non-mammalian species will be crucial to further our understanding of how the dopamine system evolved to shape the diverse array of brain structures and behaviors among the vertebrate lineage.

Neurogenomic insights into the behavioral and vocal development of the zebra finch

The zebra finch (Taeniopygia guttata) is a socially monogamous and colonial opportunistic breeder with pronounced sexual differences in singing and plumage coloration. Its natural history has led to it becoming a model species for research into sex differences in vocal communication, as well as behavioral, neural and genomic studies of imitative auditory learning. As scientists tap into the genetic and behavioral diversity of both wild and captive lineages, the zebra finch will continue to inform research into culture, learning, and social bonding, as well as adaptability to a changing climate.

One-to-one innervation of vocal muscles allows precise control of birdsong

The motor control resolution of any animal behavior is limited to the minimal force step available when activating muscles, which is set by the number and size distribution of motor units (MUs) and muscle-specific force. Birdsong is an excellent model system for understanding acquisition and maintenance of complex fine motor skills, but we know surprisingly little about how the motor pool controlling the syrinx is organized and how MU recruitment drives changes in vocal output. Here we developed an experimental paradigm to measure MU size distribution using spatiotemporal imaging of intracellular calcium concentration in cross-sections of living intact syrinx muscles. We combined these measurements with muscle stress and an in vitro syrinx preparation to determine the control resolution of fundamental frequency (f_o), a key vocal parameter, in zebra finches. We show that syringeal muscles have extremely small MUs, with 40%-50% innervating ≤3 and 13%-17% innervating a single muscle fiber. Combined with the lowest specific stress (5 mN/mm²) known to skeletal vertebrate muscle, small force steps by the major f_o controlling muscle provide control of 50-mHz to 7.3-Hz steps per MU. We show that the song system has the highest motor control resolution possible in the vertebrate nervous system and suggest this evolved due to strong selection on fine gradation of vocal output. Furthermore, we propose that high-resolution motor control was a key feature contributing to the radiation of songbirds that allowed diversification of song and speciation by vocal space expansion.

New roles for dopamine in motor skill acquisition: lessons from primates, rodents, and songbirds

Motor learning is a core aspect of human life and appears to be ubiquitous throughout the animal kingdom. Dopamine, a neuromodulator with a multifaceted role in synaptic plasticity, may be a key signaling molecule for motor skill learning. Though typically studied in the context of reward-based associative learning, dopamine appears to be necessary for some types of motor learning. Mesencephalic dopamine structures are highly conserved among vertebrates, as are some of their primary targets within the basal ganglia, a subcortical circuit important for motor learning and motor control. With a focus on the benefits of cross-species comparisons, this review examines how "model-free" and "model-based" computational frameworks for understanding dopamine's role in associative learning may be applied to motor learning. The hypotheses that dopamine could drive motor learning either by functioning as a reward prediction error, through passive facilitating of normal basal ganglia activity, or through other mechanisms are examined in light of new studies using humans, rodents, and songbirds. Additionally, new paradigms that could enhance our understanding of dopamine's role in motor learning by bridging the gap between the theoretical literature on motor learning in humans and other species are discussed.

Expression of FoxP2 in the basal ganglia regulates vocal motor sequences in the adult songbird

Disruption of the transcription factor FoxP2, which is enriched in the basal ganglia, impairs vocal development in humans and songbirds. The basal ganglia are important for the selection and sequencing of motor actions, but the circuit mechanisms governing accurate sequencing of learned vocalizations are unknown. Here, we show that expression of FoxP2 in the basal ganglia is vital for the fluent initiation and termination of birdsong, as well as the maintenance of song syllable sequencing in adulthood. Knockdown of FoxP2 imbalances dopamine receptor expression across striatal direct-like and indirect-like pathways, suggesting a role of dopaminergic signaling in regulating vocal motor sequencing. Confirming this prediction, we show that phasic dopamine activation, and not inhibition, during singing drives repetition of song syllables, thus also impairing fluent initiation and termination of birdsong. These findings demonstrate discrete circuit origins for the dysfluent repetition of vocal elements in songbirds, with implications for speech disorders.

Movement signaling in ventral pallidum and dopaminergic midbrain is gated by behavioral state in singing birds

Movement-related neuronal discharge in ventral tegmental area (VTA) and ventral pallidum (VP) is inconsistently observed across studies. One possibility is that some neurons are movement related and others are not. Another possibility is that the precise behavioral conditions matter-that a single neuron can be movement related under certain behavioral states but not others. We recorded single VTA and VP neurons in birds transitioning between singing and nonsinging states while monitoring body movement with microdrive-mounted accelerometers. Many VP and VTA neurons exhibited body movement-locked activity exclusively when the bird was not singing. During singing, VP and VTA neurons could switch off their tuning to body movement and become instead precisely time-locked to specific song syllables. These changes in neuronal tuning occurred rapidly at state boundaries. Our findings show that movement-related activity in limbic circuits can be gated by behavioral context.NEW & NOTEWORTHY Neural signals in the limbic system have long been known to represent body movements as well as reward. Here, we show that single neurons dramatically change their tuning from movement to song timing when a bird starts to sing.

An engineered channelrhodopsin optimized for axon terminal activation and circuit mapping

Optogenetic tools such as channelrhodopsin-2 (ChR2) enable the manipulation and mapping of neural circuits. However, ChR2 variants selectively transported down a neuron’s long-range axonal projections for precise presynaptic activation remain lacking. As a result, ChR2 activation is often contaminated by the spurious activation of en passant fibers that compromise the accurate interpretation of functional effects. Here, we explored the engineering of a ChR2 variant specifically localized to presynaptic axon terminals. The metabotropic glutamate receptor 2 (mGluR2) C-terminal domain fused with a proteolytic motif and axon-targeting signal (mGluR2-PA tag) localized ChR2-YFP at axon terminals without disturbing normal transmission. mGluR2-PA-tagged ChR2 evoked transmitter release in distal projection areas enabling lower levels of photostimulation. Circuit connectivity mapping in vivo with the Spike Collision Test revealed that mGluR2-PA-tagged ChR2 is useful for identifying axonal projection with significant reduction in the polysynaptic excess noise. These results suggest that the mGluR2-PA tag helps actuate trafficking to the axon terminal, thereby providing abundant possibilities for optogenetic experiments.

Hamada et al. engineer and utilise a channelrhodopsin-2 variant that is localized to presynaptic axon terminals. They demonstrate its use for circuitry mapping in vivo and thus provide a useful tool for future optogenetic experiments

Wireless battery free fully implantable multimodal recording and neuromodulation tools for songbirds

Wireless battery free and fully implantable tools for the interrogation of the central and peripheral nervous system have quantitatively expanded the capabilities to study mechanistic and circuit level behavior in freely moving rodents. The light weight and small footprint of such devices enables full subdermal implantation that results in the capability to perform studies with minimal impact on subject behavior and yields broad application in a range of experimental paradigms. While these advantages have been successfully proven in rodents that move predominantly in 2D, the full potential of a wireless and battery free device can be harnessed with flying species, where interrogation with tethered devices is very difficult or impossible. Here we report on a wireless, battery free and multimodal platform that enables optogenetic stimulation and physiological temperature recording in a highly miniaturized form factor for use in songbirds. The systems are enabled by behavior guided primary antenna design and advanced energy management to ensure stable optogenetic stimulation and thermography throughout 3D experimental arenas. Collectively, these design approaches quantitatively expand the use of wireless subdermally implantable neuromodulation and sensing tools to species previously excluded from in vivo real time experiments.

Capturing the Effects of Domestication on Vocal Learning Complexity

Domesticated and vocal learning species can serve as informative model organisms for the reduction of reactive aggression and emergence of speech in our lineage. Amidst mounting evidence that domestication modifies vocal repertoires across different species, we focus on the domesticated Bengalese finch, which has a more complex song than the wild-type white-rumped munia. Our explanation for this effect revolves around the glutamate neurotransmitter system. Glutamate signaling (i) is implicated in birdsong learning, (ii) controls dopamine activity in neural circuits crucial for vocal learning, (iii) is disproportionately targeted in the evolution of domesticates, and (iv) regulates stress responses and aggressive behaviors attenuated under domestication. We propose that attenuated excitation of stress-related neural circuits potentiates vocal learning via altered dopaminergic signaling.

Autism-linked gene FoxP1 selectively regulates the cultural transmission of learned vocalizations

Autism spectrum disorders (ASDs) are characterized by impaired learning of social skills and language. Memories of how parents and other social models behave are used to guide behavioral learning. How ASD-linked genes affect the intertwined aspects of observational learning and behavioral imitation is not known. Here, we examine how disrupted expression of the ASD gene FOXP1, which causes severe impairments in speech and language learning, affects the cultural transmission of birdsong between adult and juvenile zebra finches. FoxP1 is widely expressed in striatal-projecting forebrain mirror neurons. Knockdown of FoxP1 in this circuit prevents juvenile birds from forming memories of an adult song model but does not interrupt learning how to vocally imitate a previously memorized song. This selective learning deficit is associated with potent disruptions to experience-dependent structural and synaptic plasticity in mirror neurons. Thus, FoxP1 regulates the ability to form memories essential to the cultural transmission of behavior.

AAV1 is the optimal viral vector for optogenetic experiments in pigeons (Columba livia)

Although optogenetics has revolutionized rodent neuroscience, it is still rarely used in other model organisms as the efficiencies of viral gene transfer differ between species and comprehensive viral transduction studies are rare. However, for comparative research, birds offer valuable model organisms as they have excellent visual and cognitive capabilities. Therefore, the following study establishes optogenetics in pigeons on histological, physiological, and behavioral levels. We show that AAV1 is the most efficient viral vector in various brain regions and leads to extensive anterograde and retrograde ChR2 expression when combined with the CAG promoter. Furthermore, transient optical stimulation of ChR2 expressing cells in the entopallium decreases pigeons' contrast sensitivity during a grayscale discrimination task. This finding demonstrates causal evidence for the involvement of the entopallium in contrast perception as well as a proof of principle for optogenetics in pigeons and provides the groundwork for various other methods that rely on viral gene transfer in birds.

Actor-critic reinforcement learning in the songbird

It feels rewarding to ace your opponent on match point. Here, we propose common mechanisms underlie reward and performance learning. First, when a singing bird unexpectedly hits the right note, its dopamine (DA) neurons are activated as when a thirsty monkey receives an unexpected juice reward. Second, these DA signals reinforce vocal variations much as they reinforce stimulus-response associations. Third, limbic inputs to DA neurons signal the predicted quality of song syllables much like they signal the predicted reward value of a place or a stimulus during foraging. Finally, songbirds may solve difficult problems in reinforcement learning - such as credit assignment and catastrophic forgetting - with node perturbation and consolidation of reinforced vocal patterns in motor cortical circuits. Consolidation occurs downstream of a canonical 'actor-critic' circuit motif that learns to maximize performance quality in essentially the same way it learns to maximize reward: by computing and learning from prediction errors.

Sensory substitution reveals a manipulation bias

Sensory substitution is a promising therapeutic approach for replacing a missing or diseased sensory organ by translating inaccessible information into another sensory modality. However, many substitution systems are not well accepted by subjects. To explore the effect of sensory substitution on voluntary action repertoires and their associated affective valence, we study deaf songbirds to which we provide visual feedback as a substitute of auditory feedback. Surprisingly, deaf birds respond appetitively to song-contingent binary visual stimuli. They skillfully adapt their songs to increase the rate of visual stimuli, showing that auditory feedback is not required for making targeted changes to vocal repertoires. We find that visually instructed song learning is basal-ganglia dependent. Because hearing birds respond aversively to the same visual stimuli, sensory substitution reveals a preference for actions that elicit sensory feedback over actions that do not, suggesting that substitution systems should be designed to exploit the drive to manipulate.

Fast Retrograde Access to Projection Neuron Circuits Underlying Vocal Learning in Songbirds

Understanding the structure and function of neural circuits underlying speech and language is a vital step toward better treatments for diseases of these systems. Songbirds, among the few animal orders that share with humans the ability to learn vocalizations from a conspecific, have provided many insights into the neural mechanisms of vocal development. However, research into vocal learning circuits has been hindered by a lack of tools for rapid genetic targeting of specific neuron populations to meet the quick pace of developmental learning. Here, we present a viral tool that enables fast and efficient retrograde access to projection neuron populations. In zebra finches, Bengalese finches, canaries, and mice, we demonstrate fast retrograde labeling of cortical or dopaminergic neurons. We further demonstrate the suitability of our construct for detailed morphological analysis, for in vivo imaging of calcium activity, and for multi-color brainbow labeling.

Düring et al. describe a fast and efficient viral vector to dissect structure and function of neural circuits underlying learned vocalizations in songbirds. The AAV variant provides retrograde access to projection neuron circuits, including dopaminergic pathways in songbirds and additionally in mice, and allows for retrograde calcium imaging and multispectral brainbow labeling.

Social context-dependent singing alters molecular markers of synaptic plasticity signaling in finch basal ganglia Area X

Vocal communication is a crucial skill required throughout life. However, there is a critical gap in our understanding of the underlying molecular brain mechanisms, thereby motivating our use of the zebra finch songbird model. Adult male zebra finches show differences in neural activity patterns in song-dedicated brain nuclei when they sing in two distinct social contexts: a male singing by himself (undirected, UD) and a male singing to a female (female-directed, FD). In our prior work, we showed that in song-dedicated basal ganglia Area X, protein levels of a N-methyl-D-aspartate receptor subtype 2B (NMDAR2B) increased with more UD song and decreased with more FD song. We hypothesized that molecules downstream of this receptor would show differential protein expression levels in Area X between UD and FD song. Specifically, we investigated calcium/calmodulin dependent protein kinase II beta (CaMKIIB), homer scaffold protein 1 (HOMER1), serine/threonine protein kinase (Akt), and mechanistic target of rapamycin kinase (mTOR) following singing and non-singing states in Area X. We show relationships between social context and protein levels. HOMER1 protein levels decreased with time spent singing FD song, and mTOR protein levels decreased with the amount of and time spent singing FD song. For both HOMER1 and mTOR, there were no differences with the amount of UD song. With time spent singing UD, CaMKIIB protein levels trended in a U-shaped curve whereas Akt protein levels trended down. Both molecules showed no change with FD song. Our results support differential involvement of molecules in synaptic plasticity pathways between UD and FD song behaviors.

Serotonin Expression in the Song Circuitry of Adult Male Zebra Finches

Serotonin is an important neurotransmitter of the brain, but its role in song control remains to be fully demonstrated. Using male zebra finches (Taeniopygia guttata) that have song learning and production capabilities, we analysed the serotonin expression levels in the song nuclei and adjacent areas (peri-song nuclei) using immunohistochemistry. Key song nuclei were identified using combinations of Hoechst, choline acetyltransferase, and a neurofilament (NN18) marker in reference to the ZEBrA atlas. Mean serotonin expression was highest in interfacial nucleus (Nif) and lower in the other song nuclei in the following order (in order of highest first): interfacial nucleus (Nif) > Area X > dorsomedial part of the intercollicular nucelus (DM) > robust nucleus of the archistriatum (RA) > lateral magnocellular nucleus of the anterior neostriatum (LMAN) > ventral respiratory group (VRG) > dorsolateral nucleus of the medial thalamus (DLM) > the nucleus HVC (proper name) > tracheosyringeal motor nucleus (nXIIts). However, the mean serotonin expression (in order of highest first) in the peri-song nuclei regions was: peri-DM > peri-nXIIts > supra-peri-HVC > peri-RA > peri-DLM > peri-Area X > infra-peri-HVC > peri-VRG > peri-LMAN > peri-Nif. Interestingly, serotoninergic fibers immunostained for serotonin or the serotonin transporter can be found as a basket-like peri-neuronal structure surrounding cholinergic cell bodies, and appear to form contacts onto dopaminergic neurones. In summary, serotonin fibers are present at discrete song nuclei, and peri-song nuclei regions, which suggest serotonin may have a direct and/or modulatory role in song control.

Arousal State-Dependent Alterations in Neural Activity in the Zebra Finch VTA/SNc

Sleep-wake behaviors are important for survival and highly conserved among animal species. A growing body of evidence indicates that the midbrain dopaminergic system is associated with sleep-wake regulation in mammals. Songbirds exhibit mammalian-like sleep structures, and neurons in the midbrain ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) possess physiological properties similar to those in mammals. However, it remains uncertain whether the neurons in the songbird VTA/SNc are associated with sleep-wake regulation. Here, we show that VTA/SNc neurons in zebra finches exhibit arousal state-dependent alterations in spontaneous neural activity. By recording extracellular single-unit activity from anesthetized or freely behaving zebra finches, we found that VTA/SNc neurons exhibited increased firing rates during wakefulness, and the same population of neurons displayed reduced firing rates during anesthesia and slow-wave sleep. These results suggest that the songbird VTA/SNc is associated with the regulation of sleep and wakefulness along with other arousal regulatory systems. These findings raise the possibility that fundamental neural mechanisms of sleep-wake behaviors are evolutionarily conserved between birds and mammals.

Network dynamics underlie learning and performance of birdsong

Understanding the sensorimotor control of the endless variety of human speech patterns stands as one of the apex problems in neuroscience. The capacity to learn - through imitation - to rapidly sequence vocal sounds in meaningful patterns is clearly one of the most derived of human behavioral traits. Selection pressure produced an analogous capacity in numerous species of vocal-learning birds, and due to an increasing appreciation for the cognitive and computational flexibility of avian cortex and basal ganglia, a general understanding of the forebrain network that supports the learning and production of birdsong is beginning to emerge. Here, we review recent advances in experimental studies of the zebra finch (Taeniopygia guttata), which offer new insights into the network dynamics that support this surprising analogue of human speech learning and production.

Optimal spectral templates for triggered feedback experiments

In the field of songbird neuroscience, researchers have used playback of aversive noise bursts to drive changes in song behavior for specific syllables within a bird’s song. Typically, a short (~5–10 msec) slice of the syllable is selected for targeting and the average spectrum of the slice is used as a template. Sounds that are sufficiently close to the template are considered a match. If other syllables have portions that are spectrally similar to the target, false positive errors will weaken the operant contingency. We present a gradient descent method for template optimization that increases the separation in distance between target and distractors slices, greatly improving targeting accuracy. Applied to songs from five adult Bengalese finches, the fractional reduction in errors for sub-syllabic slices was 51.54±22.92%. At the level of song syllables, we use an error metric that controls for the vastly greater number of distractors vs. target syllables. Setting 5% average error (misses + false positives) as a minimal performance criterion, the number of targetable syllables increased from 3 to 16 out of 61 syllables. At 10% error, targetable syllables increased from 11 to 26. By using simple and robust linear discriminant methods, the algorithm reaches near asymptotic performance when using 10 songs as training data, and the error increases by <2.3% on average when using only a single song for training. Targeting is temporally precise, with average jitter of 3.33 msec for the 16 accurately targeted syllables. Because the algorithm is concerned only with the problem of template selection, it can be used as a simple and robust front end for existing hardware and software implementations for triggered feedback.

Inception of memories that guide vocal learning in the songbird

Animals learn many complex behaviors by emulating the behavior of more experienced individuals. This essential, yet still poorly understood, form of learning relies on the ability to encode lasting memories of observed behaviors. We identified a vocal-motor pathway in the zebra finch where memories that guide learning of song-element durations can be implanted. Activation of synapses in this pathway seeds memories that guide learning of song-element duration and can override learning from social interactions with other individuals. Genetic lesions of this circuit after memory formation, however, do not disrupt subsequent song imitation, which suggests that these memories are stored at downstream synapses. Thus, activity at these sensorimotor synapses can bypass learning from auditory and social experience and embed memories that guide learning of song timing.

Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity

Animals infer when and where a reward is available from experience with informative sensory stimuli and their own actions. In vertebrates, this is thought to depend upon the release of dopamine from midbrain dopaminergic neurons. Studies of the role of dopamine have focused almost exclusively on their encoding of informative sensory stimuli; however, many dopaminergic neurons are active just prior to movement initiation, even in the absence of sensory stimuli. How should current frameworks for understanding the role of dopamine incorporate these observations? To address this question, we review recent anatomical and functional evidence for action-related dopamine signaling. We conclude by proposing a framework in which dopaminergic neurons encode subjective signals of action initiation to solve an internal credit assignment problem.