Variable sequencing is actively maintained in a well learned motor skill

Goal-directed and flexible modulation of syllable sequence within birdsong

Songs constitute a complex system of vocal signals for inter-individual communication in songbirds. Here, we elucidate the flexibility which songbirds exhibit in the organizing and sequencing of syllables within their songs. Utilizing a newly devised song decoder for quasi-real-time annotation, we execute an operant conditioning paradigm, with rewards contingent upon specific syllable syntax. Our analysis reveals that birds possess the capacity to modify the contents of their songs, adjust the repetition length of particular syllables and employing specific motifs. Notably, birds altered their syllable sequence in a goal-directed manner to obtain rewards. We demonstrate that such modulation occurs within a distinct song segment, with adjustments made within 10 minutes after cue presentation. Additionally, we identify the involvement of the parietal-basal ganglia pathway in orchestrating these flexible modulations of syllable sequences. Our findings unveil an unappreciated aspect of songbird communication, drawing parallels with human speech.

Lesions in a songbird vocal circuit increase variability in song syntax

Complex skills like speech and dance are composed of ordered sequences of simpler elements, but the neuronal basis for the syntactic ordering of actions is poorly understood. Birdsong is a learned vocal behavior composed of syntactically ordered syllables, controlled in part by the songbird premotor nucleus HVC (proper name). Here, we test whether one of HVC's recurrent inputs, mMAN (medial magnocellular nucleus of the anterior nidopallium), contributes to sequencing in adult male Bengalese finches (Lonchura striata domestica). Bengalese finch song includes several patterns: (1) chunks, comprising stereotyped syllable sequences; (2) branch points, where a given syllable can be followed probabilistically by multiple syllables; and (3) repeat phrases, where individual syllables are repeated variable numbers of times. We found that following bilateral lesions of mMAN, acoustic structure of syllables remained largely intact, but sequencing became more variable, as evidenced by 'breaks' in previously stereotyped chunks, increased uncertainty at branch points, and increased variability in repeat numbers. Our results show that mMAN contributes to the variable sequencing of vocal elements in Bengalese finch song and demonstrate the influence of recurrent projections to HVC. Furthermore, they highlight the utility of species with complex syntax in investigating neuronal control of ordered sequences.

Reversible inhibition of the basal ganglia prolongs repetitive vocalization but only weakly affects sequencing at branch points in songbirds

Although vocal signals, including languages and songbird syllables, are composed of a finite number of acoustic elements, diverse vocal sequences are composed of a combination of these elements, which are linked together by syntactic rules. However, the neural basis of syntactic vocalization generation remains poorly understood. Here, we report that inhibition using tetrodotoxin (TTX) and manipulations of gamma-aminobutyric acid (GABA) receptors within the basal ganglia Area X or lateral magnocellular nucleus of the anterior neostriatum (LMAN) alter and prolong repetitive vocalization in Bengalese finches (Lonchura striata var. domestica). These results suggest that repetitive vocalizations are modulated by the basal ganglia and not solely by higher motor cortical neurons. These data highlight the importance of neural circuits, including the basal ganglia, in the production of stereotyped repetitive vocalizations and demonstrate that dynamic disturbances within the basal ganglia circuitry can differentially affect the repetitive temporal features of songs.

Effect of Darkness on Intrinsic Motivation for Undirected Singing in Bengalese Finch (Lonchura striata Domestica): A Comparative Study With Zebra Finch (Taeniopygia guttata)

The zebra finch (ZF) and the Bengalese finch (BF) are animal models that have been commonly used for neurobiological studies on vocal learning. Although they largely share the brain structure for vocal learning and production, BFs produce more complex and variable songs than ZFs, providing a great opportunity for comparative studies to understand how animals learn and control complex motor behaviors. Here, we performed a comparative study between the two species by focusing on intrinsic motivation for non-courtship singing (“undirected singing”), which is critical for the development and maintenance of song structure. A previous study has demonstrated that ZFs dramatically increase intrinsic motivation for undirected singing when singing is temporarily suppressed by a dark environment. We found that the same procedure in BFs induced the enhancement of intrinsic singing motivation to much smaller degrees than that in ZFs. Moreover, unlike ZFs that rarely sing in dark conditions, substantial portion of BFs exhibited frequent singing in darkness, implying that such “dark singing” may attenuate the enhancement of intrinsic singing motivation during dark periods. In addition, measurements of blood corticosterone levels in dark and light conditions provided evidence that although BFs have lower stress levels than ZFs in dark conditions, such lower stress levels in BFs are not the major factor responsible for their frequent dark singing. Our findings highlight behavioral and physiological differences in spontaneous singing behaviors of BFs and ZFs and provide new insights into the interactions between singing motivation, ambient light, and environmental stress.

Automated annotation of birdsong with a neural network that segments spectrograms

Songbirds provide a powerful model system for studying sensory-motor learning. However, many analyses of birdsong require time-consuming, manual annotation of its elements, called syllables. Automated methods for annotation have been proposed, but these methods assume that audio can be cleanly segmented into syllables, or they require carefully tuning multiple statistical models. Here we present TweetyNet: a single neural network model that learns how to segment spectrograms of birdsong into annotated syllables. We show that TweetyNet mitigates limitations of methods that rely on segmented audio. We also show that TweetyNet performs well across multiple individuals from two species of songbirds, Bengalese finches and canaries. Lastly, we demonstrate that using TweetyNet we can accurately annotate very large datasets containing multiple days of song, and that these predicted annotations replicate key findings from behavioral studies. In addition, we provide open-source software to assist other researchers, and a large dataset of annotated canary song that can serve as a benchmark. We conclude that TweetyNet makes it possible to address a wide range of new questions about birdsong.

Vocal Learning and Behaviors in Birds and Human Bilinguals: Parallels, Divergences and Directions for Research

Comparisons between the communication systems of humans and animals are instrumental in contextualizing speech and language into an evolutionary and biological framework and for illuminating mechanisms of human communication. As a complement to previous work that compares developmental vocal learning and use among humans and songbirds, in this article we highlight phenomena associated with vocal learning subsequent to the development of primary vocalizations (i.e., the primary language (L1) in humans and the primary song (S1) in songbirds). By framing avian “second-song” (S2) learning and use within the human second-language (L2) context, we lay the groundwork for a scientifically-rich dialogue between disciplines. We begin by summarizing basic birdsong research, focusing on how songs are learned and on constraints on learning. We then consider commonalities in vocal learning across humans and birds, in particular the timing and neural mechanisms of learning, variability of input, and variability of outcomes. For S2 and L2 learning outcomes, we address the respective roles of age, entrenchment, and social interactions. We proceed to orient current and future birdsong inquiry around foundational features of human bilingualism: L1 effects on the L2, L1 attrition, and L1<–>L2 switching. Throughout, we highlight characteristics that are shared across species as well as the need for caution in interpreting birdsong research. Thus, from multiple instructive perspectives, our interdisciplinary dialogue sheds light on biological and experiential principles of L2 acquisition that are informed by birdsong research, and leverages well-studied characteristics of bilingualism in order to clarify, contextualize, and further explore S2 learning and use in songbirds.

Measuring context dependency in birdsong using artificial neural networks

Context dependency is a key feature in sequential structures of human language, which requires reference between words far apart in the produced sequence. Assessing how long the past context has an effect on the current status provides crucial information to understand the mechanism for complex sequential behaviors. Birdsongs serve as a representative model for studying the context dependency in sequential signals produced by non-human animals, while previous reports were upper-bounded by methodological limitations. Here, we newly estimated the context dependency in birdsongs in a more scalable way using a modern neural-network-based language model whose accessible context length is sufficiently long. The detected context dependency was beyond the order of traditional Markovian models of birdsong, but was consistent with previous experimental investigations. We also studied the relation between the assumed/auto-detected vocabulary size of birdsong (i.e., fine- vs. coarse-grained syllable classifications) and the context dependency. It turned out that the larger vocabulary (or the more fine-grained classification) is assumed, the shorter context dependency is detected.

Plasticity of stereotyped birdsong driven by chronic manipulation of cortical-basal ganglia activity

Cortical-basal ganglia (CBG) circuits are critical for motor learning and performance, and are a major site of pathology. In songbirds, a CBG circuit regulates moment-by-moment variability in song and also enables song plasticity. Studies have shown that variable burst firing in LMAN, the output nucleus of this CBG circuit, actively drives acute song variability, but whether and how LMAN drives long-lasting changes in song remains unclear. Here, we ask whether chronic pharmacological augmentation of LMAN bursting is sufficient to drive plasticity in birds singing stereotyped songs. We show that altered LMAN activity drives cumulative changes in acoustic structure, timing, and sequencing over multiple days, and induces repetitions and silent pauses reminiscent of human stuttering. Changes persisted when LMAN was subsequently inactivated, indicating plasticity in song motor regions. Following cessation of pharmacological treatment, acoustic features and song sequence gradually recovered to their baseline values over a period of days to weeks. Together, our findings show that augmented bursting in CBG circuitry drives plasticity in well-learned motor skills, and may inform treatments for basal ganglia movement disorders.

Songbirds can learn flexible contextual control over syllable sequencing

The flexible control of sequential behavior is a fundamental aspect of speech, enabling endless reordering of a limited set of learned vocal elements (syllables or words). Songbirds are phylogenetically distant from humans but share both the capacity for vocal learning and neural circuitry for vocal control that includes direct pallial-brainstem projections. Based on these similarities, we hypothesized that songbirds might likewise be able to learn flexible, moment-by-moment control over vocalizations. Here, we demonstrate that Bengalese finches (Lonchura striata domestica), which sing variable syllable sequences, can learn to rapidly modify the probability of specific sequences (e.g. ‘ab-c’ versus ‘ab-d’) in response to arbitrary visual cues. Moreover, once learned, this modulation of sequencing occurs immediately following changes in contextual cues and persists without external reinforcement. Our findings reveal a capacity in songbirds for learned contextual control over syllable sequencing that parallels human cognitive control over syllable sequencing in speech.

Human speech and birdsong share numerous parallels. Both humans and birds learn their vocalizations during critical phases early in life, and both learn by imitating adults. Moreover, both humans and songbirds possess specific circuits in the brain that connect the forebrain to midbrain vocal centers.

Humans can flexibly control what they say and how by reordering a fixed set of syllables into endless combinations, an ability critical to human speech and language. Birdsongs also vary depending on their context, and melodies to seduce a mate will be different from aggressive songs to warn other males to stay away. However, so far it was unclear whether songbirds are also capable of modifying songs independent of social or other naturally relevant contexts.

To test whether birds can control their songs in a purposeful way, Veit et al. trained adult male Bengalese finches to change the sequence of their songs in response to random colored lights that had no natural meaning to the birds. A specific computer program was used to detect different variations on a theme that the bird naturally produced (for example, “ab-c” versus “ab-d”), and rewarded birds for singing one sequence when the light was yellow, and the other when it was green. Gradually, the finches learned to modify their songs and were able to switch between the appropriate sequences as soon as the light cues changed. This ability persisted for days, even without any further training.

This suggests that songbirds can learn to flexibly and purposefully modify the way in which they sequence the notes in their songs, in a manner that parallels how humans control syllable sequencing in speech. Moreover, birds can learn to do this ‘on command’ in response to an arbitrarily chosen signal, even if it is not something that would impact their song in nature.

Songbirds are an important model to study brain circuits involved in vocal learning. They are one of the few animals that, like humans, learn their vocalizations by imitating conspecifics. The finding that they can also flexibly control vocalizations may help shed light on the interactions between cognitive processing and sophisticated vocal learning abilities.

Optimal spectral templates for triggered feedback experiments

In the field of songbird neuroscience, researchers have used playback of aversive noise bursts to drive changes in song behavior for specific syllables within a bird’s song. Typically, a short (~5–10 msec) slice of the syllable is selected for targeting and the average spectrum of the slice is used as a template. Sounds that are sufficiently close to the template are considered a match. If other syllables have portions that are spectrally similar to the target, false positive errors will weaken the operant contingency. We present a gradient descent method for template optimization that increases the separation in distance between target and distractors slices, greatly improving targeting accuracy. Applied to songs from five adult Bengalese finches, the fractional reduction in errors for sub-syllabic slices was 51.54±22.92%. At the level of song syllables, we use an error metric that controls for the vastly greater number of distractors vs. target syllables. Setting 5% average error (misses + false positives) as a minimal performance criterion, the number of targetable syllables increased from 3 to 16 out of 61 syllables. At 10% error, targetable syllables increased from 11 to 26. By using simple and robust linear discriminant methods, the algorithm reaches near asymptotic performance when using 10 songs as training data, and the error increases by <2.3% on average when using only a single song for training. Targeting is temporally precise, with average jitter of 3.33 msec for the 16 accurately targeted syllables. Because the algorithm is concerned only with the problem of template selection, it can be used as a simple and robust front end for existing hardware and software implementations for triggered feedback.

Statistical learning for vocal sequence acquisition in a songbird

Birdsong is a learned communicative behavior that consists of discrete acoustic elements (“syllables”) that are sequenced in a controlled manner. While the learning of the acoustic structure of syllables has been extensively studied, relatively little is known about sequence learning in songbirds. Statistical learning could contribute to the acquisition of vocal sequences, and we investigated the nature and extent of sequence learning at various levels of song organization in the Bengalese finch, Lonchura striata var. domestica. We found that, under semi-natural conditions, pupils (sons) significantly reproduced the sequence statistics of their tutor’s (father’s) songs at multiple levels of organization (e.g., syllable repertoire, prevalence, and transitions). For example, the probability of syllable transitions at “branch points” (relatively complex sequences that are followed by multiple types of transitions) were significantly correlated between the songs of tutors and pupils. We confirmed the contribution of learning to sequence similarities between fathers and sons by experimentally tutoring juvenile Bengalese finches with the songs of unrelated tutors. We also discovered that the extent and fidelity of sequence similarities between tutors and pupils were significantly predicted by the prevalence of sequences in the tutor’s song and that distinct types of sequence modifications (e.g., syllable additions or deletions) followed distinct patterns. Taken together, these data provide compelling support for the role of statistical learning in vocal production learning and identify factors that could modulate the extent of vocal sequence learning.

Manipulations of inhibition in cortical circuitry differentially affect spectral and temporal features of Bengalese finch song

The interplay between inhibition and excitation can regulate behavioral expression and control, including the expression of communicative behaviors like birdsong. Computational models postulate varying degrees to which inhibition within vocal motor circuitry influences birdsong, but few studies have tested these models by manipulating inhibition. Here we enhanced and attenuated inhibition in the cortical nucleus HVC (used as proper name) of Bengalese finches (Lonchura striata var. domestica). Enhancement of inhibition (with muscimol) in HVC dose-dependently reduced the amount of song produced. Infusions of higher concentrations of muscimol caused some birds to produce spectrally degraded songs, whereas infusions of lower doses of muscimol led to the production of relatively normal (nondegraded) songs. However, the spectral and temporal structures of these nondegraded songs were significantly different from songs produced under control conditions. In particular, muscimol infusions decreased the frequency and amplitude of syllables, increased various measures of acoustic entropy, and increased the variability of syllable structure. Muscimol also increased sequence durations and the variability of syllable timing and syllable sequencing. Attenuation of inhibition (with bicuculline) in HVC led to changes to song distinct from and often opposite to enhancing inhibition. For example, in contrast to muscimol, bicuculline infusions increased syllable amplitude, frequency, and duration and decreased the variability of acoustic features. However, like muscimol, bicuculline increased the variability of syllable sequencing. These data highlight the importance of inhibition to the production of stereotyped vocalizations and demonstrate that changes to neural dynamics within cortical circuitry can differentially affect spectral and temporal features of song.NEW & NOTEWORTHY We reveal that manipulations of inhibition in the cortical nucleus HVC affect the structure, timing, and sequencing of syllables in Bengalese finch song. Enhancing and blocking inhibition led to opposite changes to the acoustic structure and timing of vocalizations, but both caused similar changes to vocal sequencing. These data provide support for computational models of song control but also motivate refinement of existing models to account for differential effects on syllable structure, timing, and sequencing.

Developmental modulation and predictability of age-dependent vocal plasticity in adult zebra finches

Predicting the nature of behavioral plasticity can provide insight into mechanisms of behavioral expression and control. Songbirds like the zebra finch rely on vocal signals for communication, and the performance of these signals demonstrate considerable plasticity over development. Traditionally, these signals were thought to be fixed in adulthood, but recent studies have revealed significant age-dependent changes to spectral and temporal features of song in adult songbirds. A number of age-dependent changes to song resemble acute changes to adult song performance across social contexts (e.g., when an adult male sings to a female relative to when he sings in isolation). The ability of variation in social context-dependent changes to predict variation in age-dependent plasticity would suggest shared mechanisms, but little is known about this predictability. In addition, although developmental experiences can shape adult plasticity, little is known about the extent to which social interactions during development affect age-dependent change to adult song. To this end, we systematically analyzed age- and context-dependent changes to adult zebra finch song, and then examined the degree to which age-dependent changes varied across birds that were social or non-socially tutored birds and to which social context-dependent changes predicted age-dependent changes. Non-socially tutored birds showed more dramatic changes to the broad structure of their motif over time than socially tutored birds, but non-socially and socially tutored birds did not differ in the extent of changes to various spectral and temporal features of song. Overall, we found that adult zebra finches produced longer and more spectrally stereotyped songs when they were older than when they were younger. Moreover, regardless of developmental tutoring, individual variation in age-dependent changes to song bout duration and syllable repetition were predicted by variation in social context-dependent changes to these features. These data indicate that social experiences during development can shape some aspects of adult plasticity and that acute context-dependent and long-term age-dependent changes to some song features could be mediated by modifications within similar neural substrates.

The Development of Structured Vocalizations in Songbirds and Humans: A Comparative Analysis

Humans and songbirds face a common challenge: acquiring the complex vocal repertoire of their social group. Although humans are thought to be unique in their ability to convey symbolic meaning through speech, speech and birdsong are comparable in their acoustic complexity and the mastery with which the vocalizations of adults are acquired by young individuals. In this review, we focus on recent advances in the study of vocal development in humans and songbirds that shed new light on the emergence of distinct structural levels of vocal behavior and point to new possible parallels between both groups.

Draft genome assembly of the Bengalese finch, Lonchura striata domestica, a model for motor skill variability and learning

Background

Vocal learning in songbirds has emerged as a powerful model for sensorimotor learning. Neurobehavioral studies of Bengalese finch (Lonchura striata domestica) song, naturally more variable and plastic than songs of other finch species, have demonstrated the importance of behavioral variability for initial learning, maintenance, and plasticity of vocalizations. However, the molecular and genetic underpinnings of this variability and the learning it supports are poorly understood.

Findings

To establish a platform for the molecular analysis of behavioral variability and plasticity, we generated an initial draft assembly of the Bengalese finch genome from a single male animal to 151× coverage and an N50 of 3.0 MB. Furthermore, we developed an initial set of gene models using RNA-seq data from 8 samples that comprise liver, muscle, cerebellum, brainstem/midbrain, and forebrain tissue from juvenile and adult Bengalese finches of both sexes.

Conclusions

We provide a draft Bengalese finch genome and gene annotation to facilitate the study of the molecular-genetic influences on behavioral variability and the process of vocal learning. These data will directly support many avenues for the identification of genes involved in learning, including differential expression analysis, comparative genomic analysis (through comparison to existing avian genome assemblies), and derivation of genetic maps for linkage analysis. Bengalese finch gene models and sequences will be essential for subsequent manipulation (molecular or genetic) of genes and gene products, enabling novel mechanistic investigations into the role of variability in learned behavior.

Continuous Time Representations of Song in Zebra Finches

Neurons in the songbird nucleus HVC produce premotor bursts time locked to song with millisecond precision. In this issue of Neuron, Lynch et al. (2016) and Picardo et al. (2016) provide convincing evidence that the population of these bursts contain a continuous representation of time throughout song.

Timing during transitions in Bengalese finch song: implications for motor sequencing

To investigate mechanisms of action sequencing, we examined the relationship between timing and sequencing of syllables in Bengalese finch song. An individual's song comprises acoustically distinct syllables organized into probabilistic sequences: a given syllable potentially can transition to several different syllables (divergence points), and several different syllables can transition to a given syllable (convergence points). In agreement with previous studies, we found that more probable transitions at divergence points occur with shorter intersyllable gaps. One intuition for this relationship is that selection between syllables reflects a competitive branching process, in which stronger links to one syllable lead to both higher probabilities and shorter latencies for transitions to that syllable vs. competing alternatives. However, we found that simulations of competitive race models result in overlapping winning-time distributions for competing outcomes and fail to replicate the strong negative correlation between probability and gap duration found in song data. Further investigation of song structure revealed strong positive correlation between gap durations for transitions that share a common convergent point. Such transitions are not related by a common competitive process, but instead reflect a common terminal syllable. In contrast to gap durations, transition probabilities were not correlated at convergence points. Together, our data suggest that syllable selection happens early during the gap, with gap timing determined chiefly by the latency to syllable initiation. This may result from a process in which probabilistic sequencing is first stabilized, followed by a shortening of the latency to syllables that are sung more often.NEW & NOTEWORTHY Bengalese finch songs consist of probabilistic sequences of syllables. Previous studies revealed a strong negative correlation between transition probability and the duration of intersyllable gaps. We show here that the negative correlation is inconsistent with previous suggestions that timing at syllable transitions is governed by a race between competing alternatives. Rather, the data suggest that syllable selection happens early during the gap, with gap timing determined chiefly by the latency to syllable initiation.

Advantages of comparative studies in songbirds to understand the neural basis of sensorimotor integration

Sensorimotor integration is the process through which the nervous system creates a link between motor commands and associated sensory feedback. This process allows for the acquisition and refinement of many behaviors, including learned communication behaviors such as speech and birdsong. Consequently, it is important to understand fundamental mechanisms of sensorimotor integration, and comparative analyses of this process can provide vital insight. Songbirds offer a powerful comparative model system to study how the nervous system links motor and sensory information for learning and control. This is because the acquisition, maintenance, and control of birdsong critically depend on sensory feedback. Furthermore, there is an incredible diversity of song organizations across songbird species, ranging from songs with simple, stereotyped sequences to songs with complex sequencing of vocal gestures, as well as a wide diversity of song repertoire sizes. Despite this diversity, the neural circuitry for song learning, control, and maintenance remains highly similar across species. Here, we highlight the utility of songbirds for the analysis of sensorimotor integration and the insights about mechanisms of sensorimotor integration gained by comparing different songbird species. Key conclusions from this comparative analysis are that variation in song sequence complexity seems to covary with the strength of feedback signals in sensorimotor circuits and that sensorimotor circuits contain distinct representations of elements in the vocal repertoire, possibly enabling evolutionary variation in repertoire sizes. We conclude our review by highlighting important areas of research that could benefit from increased comparative focus, with particular emphasis on the integration of new technologies.

Maturation-dependent control of vocal temporal plasticity in a songbird

Birdsong is a unique model to address learning mechanisms of the timing control of sequential behaviors, with characteristic temporal structures consisting of serial sequences of brief vocal elements (syllables) and silent intervals (gaps). Understanding the neural mechanisms for plasticity of such sequential behavior should be aided by characterization of its developmental changes. Here, we assessed the level of acute vocal plasticity between young and adult Bengalese finches, and also quantified developmental change in variability of temporal structure. Acute plasticity was tested by delivering aversive noise bursts contingent on duration of a target gap, such that birds could avoid the noise by modifying their song. We found that temporal variability of song features decreased with birds' maturation. Noise-avoidance experiments demonstrated that maximal changes of gap durations were larger in young that in adult birds. After these young birds matured, the maximal change decreased to a similar level as adults. The variability of these target gaps also decreased as the birds matured. Such parallel changes suggest that the level of acute temporal plasticity could be predicted from ongoing temporal variability. Further, we found that young birds gradually began to stop their song at the target gap and restart from the introductory part of song, whereas adults did not. According to a synaptic chain model for timing sequence generation in premotor nuclei, adult learning would be interpreted as adaptive changes in conduction delays between chain-to-chain connections, whereas the learning of young birds could mainly depend on changes of the connections. © 2017 Wiley Periodicals, Inc. Develop Neurobiol 77: 995-1006, 2017.

Temperature Manipulation in Songbird Brain Implicates the Premotor Nucleus HVC in Birdsong Syntax

Variable motor sequences of animals are often structured and can be described by probabilistic transition rules between action elements. Examples include the songs of many songbird species such as the Bengalese finch, which consist of stereotypical syllables sequenced according to probabilistic rules (song syntax). The neural mechanisms behind such rules are poorly understood. Here, we investigate where the song syntax is encoded in the brain of the Bengalese finch by rapidly and reversibly manipulating the temperature in the song production pathway. Cooling the premotor nucleus HVC (proper name) slows down the song tempo, consistent with the idea that HVC controls moment-to-moment timings of acoustic features in the syllables. More importantly, cooling HVC alters the transition probabilities between syllables. Cooling HVC reduces the number of repetitions of long-repeated syllables and increases the randomness of syllable sequences. In contrast, cooling the downstream motor area RA (robust nucleus of the acropallium), which is critical for singing, does not affect the song syntax. Unilateral cooling of HVC shows that control of syllables is mostly lateralized to the left HVC, whereas transition probabilities between the syllables can be affected by cooling HVC in either hemisphere to varying degrees. These results show that HVC is a key site for encoding song syntax in the Bengalese finch. HVC is thus involved both in encoding timings within syllables and in sequencing probabilistic transitions between syllables. Our finding suggests that probabilistic selections and fine-grained timings of action elements can be integrated within the same neural circuits.SIGNIFICANCE STATEMENT Many animal behaviors such as birdsong consist of variable sequences of discrete actions. Where and how the probabilistic rules of such sequences are encoded in the brain is poorly understood. We locally and reversibly cooled brain areas in songbirds during singing. Mild cooling of area HVC in the Bengalese finch brain-a premotor area homologous to the mammalian premotor cortex-alters the statistics of the syllable sequences, suggesting that HVC is critical for birdsong sequences. HVC is also known for controlling moment-to-moment timings within syllables. Our results show that timing and probabilistic sequencing of actions can share the same neural circuits in local brain areas.

The Effects of Pitch Shifts on Delay-Induced Changes in Vocal Sequencing in a Songbird

Like human speech, vocal behavior in songbirds depends critically on auditory feedback. In both humans and songbirds, vocal skills are acquired by a process of imitation whereby current vocal production is compared to an acoustic target. Similarly, performance in adulthood relies strongly on auditory feedback, and online manipulations of auditory signals can dramatically alter acoustic production even after vocalizations have been well learned. Artificially delaying auditory feedback can disrupt both speech and birdsong, and internal delays in auditory feedback have been hypothesized as a cause of vocal dysfluency in persons who stutter. Furthermore, in both song and speech, online shifts of the pitch (fundamental frequency) of auditory feedback lead to compensatory changes in vocal pitch for small perturbations, but larger pitch shifts produce smaller changes in vocal output. Intriguingly, large pitch shifts can partially restore normal speech in some dysfluent speakers, suggesting that the effects of auditory feedback delays might be ameliorated by online pitch manipulations. Although birdsong provides a promising model system for understanding speech production, the interactions between sensory feedback delays and pitch shifts have not yet been assessed in songbirds. To investigate this, we asked whether the addition of a pitch shift modulates delay-induced changes in Bengalese finch song, hypothesizing that pitch shifts would reduce the effects of feedback delays. Compared with the effects of delays alone, combined delays and pitch shifts resulted in a significant reduction in behavioral changes in one type of sequencing (branch points) but not another (distribution of repeated syllables).

Auditory-induced neural dynamics in sensory-motor circuitry predict learned temporal and sequential statistics of birdsong

Predicting future events is a critical computation for both perception and behavior. Despite the essential nature of this computation, there are few studies demonstrating neural activity that predicts specific events in learned, probabilistic sequences. Here, we test the hypotheses that the dynamics of internally generated neural activity are predictive of future events and are structured by the learned temporal-sequential statistics of those events. We recorded neural activity in Bengalese finch sensory-motor area HVC in response to playback of sequences from individuals' songs, and examined the neural activity that continued after stimulus offset. We found that the strength of response to a syllable in the sequence depended on the delay at which that syllable was played, with a maximal response when the delay matched the intersyllable gap normally present for that specific syllable during song production. Furthermore, poststimulus neural activity induced by sequence playback resembled the neural response to the next syllable in the sequence when that syllable was predictable, but not when the next syllable was uncertain. Our results demonstrate that the dynamics of internally generated HVC neural activity are predictive of the learned temporal-sequential structure of produced song and that the strength of this prediction is modulated by uncertainty.

Social Memory Formation Rapidly and Differentially Affects the Motivation and Performance of Vocal Communication Signals in the Bengalese Finch (Lonchura striata var. domestica)

Cognitive processes like the formation of social memories can shape the nature of social interactions between conspecifics. Male songbirds use vocal signals during courtship interactions with females, but the degree to which social memory and familiarity influences the likelihood and structure of male courtship song remains largely unknown. Using a habituation-dishabituation paradigm, we found that a single, brief (<30 s) exposure to a female led to the formation of a short-term memory for that female: adult male Bengalese finches were significantly less likely to produce courtship song to an individual female when re-exposed to her 5 min later (i.e., habituation). Familiarity also rapidly decreased the duration of courtship songs but did not affect other measures of song performance (e.g., song tempo and the stereotypy of syllable structure and sequencing). Consistent with a contribution of social memory to the decrease in courtship song with repeated exposures to the same female, the likelihood that male Bengalese finches produced courtship song increased when they were exposed to a different female (i.e., dishabituation). Three consecutive exposures to individual females also led to the formation of a longer-term memory that persisted over days. Specifically, when courtship song production was assessed 2 days after initial exposures to females, males produced fewer and shorter courtship songs to familiar females than to unfamiliar females. Measures of song performance, however, were not different between courtship songs produced to familiar and unfamiliar females. The formation of a longer-term memory for individual females seemed to require at least three exposures because males did not differentially produce courtship song to unfamiliar females and females that they had been exposed to only once or twice. Taken together, these data indicate that brief exposures to individual females led to the rapid formation and persistence of social memories and support the existence of distinct mechanisms underlying the motivation to produce and the performance of courtship song.

Complexity, Predictability and Time Homogeneity of Syntax in the Songs of Cassin's Vireo (Vireo cassinii)

Many species of animals deliver vocalizations in sequences presumed to be governed by internal rules, though the nature and complexity of these syntactical rules have been investigated in relatively few species. Here I present an investigation into the song syntax of fourteen male Cassin's Vireos (Vireo cassinii), a species whose song sequences are highly temporally structured. I compare their song sequences to three candidate models of varying levels of complexity-zero-order, first-order and second-order Markov models-and employ novel methods to interpolate between these three models. A variety of analyses, including sequence simulations, Fisher's exact tests, and model likelihood analyses, showed that the songs of this species are too complex to be described by a zero-order or first-order Markov model. The model that best fit the data was intermediate in complexity between a first- and second-order model, though I also present evidence that some transition probabilities are conditioned on up to three preceding phrases. In addition, sequences were shown to be predictable with more than 54% accuracy overall, and predictability was positively correlated with the rate of song delivery. An assessment of the time homogeneity of syntax showed that transition probabilities between phrase types are largely stable over time, but that there was some evidence for modest changes in syntax within and between breeding seasons, a finding that I interpret to represent changes in breeding stage and social context rather than irreversible, secular shifts in syntax over time. These findings constitute a valuable addition to our understanding of bird song syntax in free-living birds, and will contribute to future attempts to understand the evolutionary importance of bird song syntax in avian communication.

Relationship between the Sequencing and Timing of Vocal Motor Elements in Birdsong

Accurate coordination of the sequencing and timing of motor gestures is important for the performance of complex and evolutionarily relevant behaviors. However, the degree to which motor sequencing and timing are related remains largely unknown. Birdsong is a communicative behavior that consists of discrete vocal motor elements (‘syllables’) that are sequenced and timed in a precise manner. To reveal the relationship between syllable sequencing and timing, we analyzed how variation in the probability of syllable transitions at branch points, nodes in song with variable sequencing across renditions, correlated with variation in the duration of silent gaps between syllable transitions (‘gap durations’) for adult Bengalese finch song. We observed a significant negative relationship between transition probability and gap duration: more prevalent transitions were produced with shorter gap durations. We then assessed the degree to which long-term age-dependent changes and acute context-dependent changes to syllable sequencing and timing followed this inverse relationship. Age- but not context-dependent changes to syllable sequencing and timing were inversely related. On average, gap durations at branch points decreased with age, and the magnitude of this decrease was greater for transitions that increased in prevalence than for transitions that decreased in prevalence. In contrast, there was no systematic relationship between acute context-dependent changes to syllable sequencing and timing. Gap durations at branch points decreased when birds produced female-directed courtship song compared to when they produced undirected song, and the magnitude of this decrease was not related to the direction and magnitude of changes to transition probabilities. These analyses suggest that neural mechanisms that regulate syllable sequencing could similarly control syllable timing but also highlight mechanisms that can independently regulate syllable sequencing and timing.

Variability in the temporal parameters in the song of the Bengalese finch (Lonchura striata var. domestica)

Birdsong provides a unique model for studying the control mechanisms of complex sequential behaviors. The present study aimed to demonstrate that multiple factors affect temporal control in the song production. We analyzed the song of Bengalese finches in various time ranges to address factors that affected the duration of acoustic elements (notes) and silent intervals (gaps). The gaps showed more jitter across song renditions than did notes. Gaps had longer duration in branching points of song sequence than in stereotypic transitions, and the duration of a gap was correlated with the duration of the note that preceded the gap. When looking at the variation among song renditions, we found notable factors in three time ranges: within-day drift, within-bout changes, and local jitter. Note durations shortened over time from morning to evening. Within each song bout note durations lengthened as singing progressed, while gap durations lengthened only during the late part of song bout. Further analysis after removing these drift factors confirmed that the jitter remained in local song sequences. These results suggest distinct sources of temporal variability exist at multiple levels on the basis of this note-gap relationship, and that song comprised a mixture of these sources.

An Adapting Auditory-motor Feedback Loop Can Contribute to Generating Vocal Repetition

Consecutive repetition of actions is common in behavioral sequences. Although integration of sensory feedback with internal motor programs is important for sequence generation, if and how feedback contributes to repetitive actions is poorly understood. Here we study how auditory feedback contributes to generating repetitive syllable sequences in songbirds. We propose that auditory signals provide positive feedback to ongoing motor commands, but this influence decays as feedback weakens from response adaptation during syllable repetitions. Computational models show that this mechanism explains repeat distributions observed in Bengalese finch song. We experimentally confirmed two predictions of this mechanism in Bengalese finches: removal of auditory feedback by deafening reduces syllable repetitions; and neural responses to auditory playback of repeated syllable sequences gradually adapt in sensory-motor nucleus HVC. Together, our results implicate a positive auditory-feedback loop with adaptation in generating repetitive vocalizations, and suggest sensory adaptation is important for feedback control of motor sequences.

Repetitions are common in animal vocalizations. Songs of many songbirds contain syllables that repeat a variable number of times, with non-Markovian distributions of repeat counts. The neural mechanism underlying such syllable repetitions is unknown. In this work, we show that auditory feedback plays an important role in sustaining syllable repetitions in the Bengalese finch. Deafening reduces syllable repetitions and skews the repeat number distribution towards short repeats. These effects are explained with our computational model, which suggests that syllable repeats are initially sustained by auditory feedback to the neural networks that drive the syllable production. The feedback strength weakens as the syllable repeats, increasing the likelihood that the syllable repetition stops. Neural recordings confirm such adaptation of auditory feedback to the auditory-motor circuit in the Bengalese finch. Our results suggests that sensory feedback can directly impact repetitions in motor sequences, and may provide insights into neural mechanisms of speech disorders such as stuttering.

Predicting plasticity: acute context-dependent changes to vocal performance predict long-term age-dependent changes

Understanding the factors that predict and guide variation in behavioral change can lend insight into mechanisms of motor plasticity and individual differences in behavior. The performance of adult birdsong changes with age in a manner that is similar to rapid context-dependent changes to song. To reveal mechanisms of vocal plasticity, we analyzed the degree to which variation in the direction and magnitude of age-dependent changes to Bengalese finch song could be predicted by variation in context-dependent changes. Using a repeated-measures design, we found that variation in age-dependent changes to the timing, sequencing, and structure of vocal elements ("syllables") was significantly predicted by variation in context-dependent changes. In particular, the degree to which the duration of intersyllable gaps, syllable sequencing at branch points, and fundamental frequency of syllables within spontaneous [undirected (UD)] songs changed over time was correlated with the degree to which these features changed from UD song to female-directed (FD) song in young-adult finches (FDyoung). As such, the structure of some temporal features of UD songs converged over time onto the structure of FDyoung songs. This convergence suggested that the FDyoung song could serve as a stable target for vocal motor plasticity. Consequently, we analyzed the stability of FD song and found that the temporal structure of FD song changed significantly over time in a manner similar to UD song. Because FD song is considered a state of heightened performance, these data suggest that age-dependent changes could reflect practice-related improvements in vocal motor performance.

Role of the site of synaptic competition and the balance of learning forces for Hebbian encoding of probabilistic Markov sequences

The majority of distinct sensory and motor events occur as temporally ordered sequences with rich probabilistic structure. Sequences can be characterized by the probability of transitioning from the current state to upcoming states (forward probability), as well as the probability of having transitioned to the current state from previous states (backward probability). Despite the prevalence of probabilistic sequencing of both sensory and motor events, the Hebbian mechanisms that mold synapses to reflect the statistics of experienced probabilistic sequences are not well understood. Here, we show through analytic calculations and numerical simulations that Hebbian plasticity (correlation, covariance, and STDP) with pre-synaptic competition can develop synaptic weights equal to the conditional forward transition probabilities present in the input sequence. In contrast, post-synaptic competition can develop synaptic weights proportional to the conditional backward probabilities of the same input sequence. We demonstrate that to stably reflect the conditional probability of a neuron's inputs and outputs, local Hebbian plasticity requires balance between competitive learning forces that promote synaptic differentiation and homogenizing learning forces that promote synaptic stabilization. The balance between these forces dictates a prior over the distribution of learned synaptic weights, strongly influencing both the rate at which structure emerges and the entropy of the final distribution of synaptic weights. Together, these results demonstrate a simple correspondence between the biophysical organization of neurons, the site of synaptic competition, and the temporal flow of information encoded in synaptic weights by Hebbian plasticity while highlighting the utility of balancing learning forces to accurately encode probability distributions, and prior expectations over such probability distributions.

Forebrain circuits underlying the social modulation of vocal communication signals

Across vertebrate species, signalers alter the structure of their communication signals based on the social context. For example, male Bengalese finches produce faster and more stereotyped songs when directing song to females (female-directed [FD] song) than when singing in isolation (undirected [UD] song), and such changes have been found to increase the attractiveness of a male's song. Despite the importance of such social influences, little is known about the mechanisms underlying the social modulation of communication signals. To this end, we analyzed differences in immediate early gene (EGR-1) expression when Bengalese finches produced FD or UD song. Relative to silent birds, EGR-1 expression was elevated in birds producing either FD or UD song throughout vocal control circuitry, including the interface nucleus of the nidopallium (NIf), HVC, the robust nucleus of the arcopallium (RA), Area X, and the lateral magnocellular nucleus of the anterior nidopallium (LMAN). Moreover, EGR-1 expression was higher in HVC, RA, Area X, and LMAN in males producing UD song than in males producing FD song, indicating that social context modulated EGR-1 expression in these areas. However, EGR-1 expression was not significantly different between males producing FD or UD song in NIf, the primary vocal motor input into HVC, suggesting that context-dependent changes could arise de novo in HVC. The pattern of context-dependent differences in EGR-1 expression in the Bengalese finch was highly similar to that in the zebra finch and suggests that social context affects song structure by modulating activity throughout vocal control nuclei.

Long-distance retinoid signaling in the zebra finch brain

All-trans retinoic acid (ATRA), the main active metabolite of vitamin A, is a powerful signaling molecule that regulates large-scale morphogenetic processes during vertebrate embryonic development, but is also involved post-natally in regulating neural plasticity and cognition. In songbirds, it plays an important role in the maturation of learned song. The distribution of the ATRA-synthesizing enzyme, zRalDH, and of ATRA receptors (RARs) have been described, but information on the distribution of other components of the retinoid signaling pathway is still lacking. To address this gap, we have determined the expression patterns of two obligatory RAR co-receptors, the retinoid X receptors (RXR) α and γ, and of the three ATRA-degrading cytochromes CYP26A1, CYP26B1, and CYP26C1. We have also studied the distribution of zRalDH protein using immunohistochemistry, and generated a refined map of ATRA localization, using a modified reporter cell assay to examine entire brain sections. Our results show that (1) ATRA is more broadly distributed in the brain than previously predicted by the spatially restricted distribution of zRalDH transcripts. This could be due to long-range transport of zRalDH enzyme between different nuclei of the song system: Experimental lesions of putative zRalDH peptide source regions diminish ATRA-induced transcription in target regions. (2) Four telencephalic song nuclei express different and specific subsets of retinoid-related receptors and could be targets of retinoid regulation; in the case of the lateral magnocellular nucleus of the anterior nidopallium (lMAN), receptor expression is dynamically regulated in a circadian and age-dependent manner. (3) High-order auditory areas exhibit a complex distribution of transcripts representing ATRA synthesizing and degrading enzymes and could also be a target of retinoid signaling. Together, our survey across multiple connected song nuclei and auditory brain regions underscores the prominent role of retinoid signaling in modulating the circuitry that underlies the acquisition and production of learned vocalizations.

Variations on a theme: Songbirds, variability, and sensorimotor error correction

Songbirds provide a powerful animal model for investigating how the brain uses sensory feedback to correct behavioral errors. Here, we review a recent study in which we used online manipulations of auditory feedback to quantify the relationship between sensory error size, motor variability, and vocal plasticity. We found that although inducing small auditory errors evoked relatively large compensatory changes in behavior, as error size increased the magnitude of error correction declined. Furthermore, when we induced large errors such that auditory signals no longer overlapped with the baseline distribution of feedback, the magnitude of error correction approached zero. This pattern suggests a simple and robust strategy for the brain to maintain the accuracy of learned behaviors by evaluating sensory signals relative to the previously experienced distribution of feedback. Drawing from recent studies of auditory neurophysiology and song discrimination, we then speculate as to the mechanistic underpinnings of the results obtained in our behavioral experiments. Finally, we review how our own and other studies exploit the strengths of the songbird system, both in the specific context of vocal systems and more generally as a model of the neural control of complex behavior.

Vocal motor changes beyond the sensitive period for song plasticity

Behavior is critically shaped during sensitive periods in development. Birdsong is a learned vocal behavior that undergoes dramatic plasticity during a sensitive period of sensorimotor learning. During this period, juvenile songbirds engage in vocal practice to shape their vocalizations into relatively stereotyped songs. By the time songbirds reach adulthood, their songs are relatively stable and thought to be "crystallized." Recent studies, however, highlight the potential for adult song plasticity and suggest that adult song could naturally change over time. As such, we investigated the degree to which temporal and spectral features of song changed over time in adult Bengalese finches. We observed that the sequencing and timing of song syllables became more stereotyped over time. Increases in the stereotypy of syllable sequencing were due to the pruning of infrequently produced transitions and, to a lesser extent, increases in the prevalence of frequently produced transitions. Changes in song tempo were driven by decreases in the duration and variability of intersyllable gaps. In contrast to significant changes to temporal song features, we found little evidence that the spectral structure of adult song syllables changed over time. These data highlight differences in the degree to which temporal and spectral features of adult song change over time and support evidence for distinct mechanisms underlying the control of syllable sequencing, timing, and structure. Furthermore, the observed changes to temporal song features are consistent with a Hebbian framework of behavioral plasticity and support the notion that adult song should be considered a form of vocal practice.