Inhibition within a premotor circuit controls the timing of vocal turn-taking in zebra finches

Disinhibition enables vocal repertoire expansion after a critical period

The efficiency of motor skill acquisition is age-dependent, making it increasingly challenging to learn complex manoeuvres later in life. Zebra finches, for instance, acquire a complex vocal motor programme during a developmental critical period after which the learned song is essentially impervious to modification. Although inhibitory interneurons are implicated in critical period closure, it is unclear whether manipulating them can reopen heightened motor plasticity windows. Using pharmacology and a cell-type specific optogenetic approach, we manipulated inhibitory neuron activity in a premotor area of adult zebra finches beyond their critical period. When exposed to auditory stimulation in the form of novel songs, manipulated birds added new vocal syllables to their stable song sequence. By lifting inhibition in a premotor area during sensory experience, we reintroduced vocal plasticity, promoting an expansion of the syllable repertoire without compromising pre-existing song production. Our findings provide insights into motor skill learning capacities, offer potential for motor recovery after injury, and suggest avenues for treating neurodevelopmental disorders involving inhibitory dysfunctions.

A neuroethological view of the multifaceted sensory influences on birdsong

Learning and execution of complex motor skills are often modulated by sensory feedback and contextual cues arriving across multiple sensory modalities. Vocal motor behaviors, in particular, are primarily influenced by auditory inputs, both during learning and mature vocal production. The importance of auditory input in shaping vocal output has been investigated in several songbird species that acquire their adult song based on auditory exposure to a tutor during development. Recent studies have highlighted the influences of stimuli arriving through other sensory channels in juvenile song learning and in adult song production. Here, we review changes induced by diverse sensory stimuli during the song learning process and the production of adult song, considering the neuroethological significance of sensory channels in different species of songbirds. Additionally, we highlight advances, open questions, and possible future approaches for understanding the neural circuits that enable the multimodal shaping of singing behavior.

Goal-directed and flexible modulation of syllable sequence within birdsong

Songs constitute a complex system of vocal signals for inter-individual communication in songbirds. Here, we elucidate the flexibility which songbirds exhibit in the organizing and sequencing of syllables within their songs. Utilizing a newly devised song decoder for quasi-real-time annotation, we execute an operant conditioning paradigm, with rewards contingent upon specific syllable syntax. Our analysis reveals that birds possess the capacity to modify the contents of their songs, adjust the repetition length of particular syllables and employing specific motifs. Notably, birds altered their syllable sequence in a goal-directed manner to obtain rewards. We demonstrate that such modulation occurs within a distinct song segment, with adjustments made within 10 minutes after cue presentation. Additionally, we identify the involvement of the parietal-basal ganglia pathway in orchestrating these flexible modulations of syllable sequences. Our findings unveil an unappreciated aspect of songbird communication, drawing parallels with human speech.

Wild nightingales flexibly match whistle pitch in real time

Interactive vocal communication, similar to a human conversation, requires flexible and real-time changes to vocal output in relation to preceding auditory stimuli. These vocal adjustments are essential to ensuring both the suitable timing and content of the interaction. Precise timing of dyadic vocal exchanges has been investigated in a variety of species, including humans. In contrast, the ability of non-human animals to accurately adjust specific spectral features of vocalization extemporaneously in response to incoming auditory information is less well studied. One spectral feature of acoustic signals is the fundamental frequency, which we perceive as pitch. Many animal species can discriminate between sound frequencies, but real-time detection and reproduction of an arbitrary pitch have only been observed in humans. Here, we show that nightingales in the wild can match the pitch of whistle songs while singing in response to conspecifics or pitch-controlled whistle playbacks. Nightingales matched whistles across their entire pitch production range indicating that they can flexibly tune their vocal output along a wide continuum. Prompt whistle pitch matches were more precise than delayed ones, suggesting the direct mapping of auditory information onto a motor command to achieve online vocal replication of a heard pitch. Although nightingales' songs follow annual cycles of crystallization and deterioration depending on breeding status, the observed pitch-matching behavior is present year-round, suggesting a stable neural circuit independent of seasonal changes in physiology. Our findings represent the first case of non-human instantaneous vocal imitation of pitch, highlighting a promising model for understanding sensorimotor transformation within an interactive context. VIDEO ABSTRACT.

A neural hub for holistic courtship displays

Courtship displays often involve the concerted production of several distinct courtship behaviors. The neural circuits that enable the concerted production of the component behaviors of a courtship display are not well understood. Here, we identify a midbrain cell group (A11) that enables male zebra finches to produce their learned songs in concert with various other behaviors, including female-directed orientation, pursuit, and calling. Anatomical mapping reveals that A11 is at the center of a complex network including the song premotor nucleus HVC as well as brainstem regions crucial to calling and locomotion. Notably, lesioning A11 terminals in HVC blocked female-directed singing but did not interfere with female-directed calling, orientation, or pursuit. In contrast, lesioning A11 cell bodies strongly reduced and often abolished all female-directed courtship behaviors. However, males with either type of lesion still produced songs when in social isolation. Lastly, imaging calcium-related activity in A11 terminals in HVC showed that during courtship, A11 signals HVC about female-directed calls and during female-directed singing, about the transition from simpler introductory notes to the acoustically more complex syllables that depend intimately on HVC for their production. These results show how a brain region important to reproduction in both birds and mammals enables holistic courtship displays in male zebra finches, which include learning songs, calls, and other non-vocal behaviors.

Neural correlates of cognitively controlled vocalizations in a corvid songbird

The neuronal basis of the songbird's song system is well understood. However, little is known about the neuronal correlates of the executive control of songbird vocalizations. Here, we record single-unit activity from the pallial endbrain region "nidopallium caudolaterale" (NCL) of crows that vocalize to the presentation of a visual go-cue but refrain from vocalizing during trials without a go-cue. We find that the preparatory activity of single vocalization-correlated neurons, but also of the entire population of NCL neurons, before vocal onset predicts whether or not the crows will produce an instructed vocalization. Fluctuations in baseline neuronal activity prior to the go-cue influence the premotor activity of such vocalization-correlated neurons and seemingly bias the crows' decision to vocalize. Neuronal response modulation significantly differs between volitional and task-unrelated vocalizations. This suggests that the NCL can take control over the vocal motor network during the production of volitional vocalizations in a corvid songbird.

Neural mechanisms for turn-taking in duetting plain-tailed wrens

Recent studies conducted in the natural habitats of songbirds have provided new insights into the neural mechanisms of turn-taking. For example, female and male plain-tailed wrens (Pheugopedius euophrys) sing a duet that is so precisely timed it sounds as if a single bird is singing. In this review, we discuss our studies examining the sensory and motor cues that pairs of wrens use to coordinate the rapid alternation of syllable production. Our studies included behavioral measurements of freely-behaving wrens in their natural habitat and neurophysiological experiments conducted in awake and anesthetized individuals at field sites in Ecuador. These studies show that each partner has a pattern-generating circuit in their brain that is linked via acoustic feedback between individuals. A similar control strategy has been described in another species of duetting songbird, white-browed sparrow-weavers (Plocepasser mahali). Interestingly, the combination of neurophysiological results from urethane-anesthetized and awake wrens suggest a role for inhibition in coordinating the timing of turn-taking. Finally, we highlight some of the unique challenges of conducting these experiments at remote field sites.

Driving singing behaviour in songbirds using a multi-modal, multi-agent virtual environment

Interactive biorobotics provides unique experimental potential to study the mechanisms underlying social communication but is limited by our ability to build expressive robots that exhibit the complex behaviours of birds and small mammals. An alternative to physical robots is to use virtual environments. Here, we designed and built a modular, audio-visual 2D virtual environment that allows multi-modal, multi-agent interaction to study mechanisms underlying social communication. The strength of the system is an implementation based on event processing that allows for complex computation. We tested this system in songbirds, which provide an exceptionally powerful and tractable model system to study social communication. We show that pair-bonded zebra finches (Taeniopygia guttata) communicating through the virtual environment exhibit normal call timing behaviour, males sing female directed song and both males and females display high-intensity courtship behaviours to their mates. These results suggest that the environment provided is sufficiently natural to elicit these behavioral responses. Furthermore, as an example of complex behavioral annotation, we developed a fully unsupervised song motif detector and used it to manipulate the virtual social environment of male zebra finches based on the number of motifs sung. Our virtual environment represents a first step in real-time automatic behaviour annotation and animal–computer interaction using higher level behaviours such as song. Our unsupervised acoustic analysis eliminates the need for annotated training data thus reducing labour investment and experimenter bias.

Interhemispheric Brain Communication and the Evolution of Turn-Taking in Mammals

In the last 20 years, research on turn-taking and duetting has flourished in at least three, historically separate disciplines: animal behavior, language sciences, and music cognition. While different in scope and methods, all three ultimately share one goal—namely the understanding of timed interactions among conspecifics. In this perspective, we aim at connecting turn-taking and duetting across species from a neural perspective. While we are still far from a defined neuroethology of turn-taking, we argue that the human neuroscience of turn-taking and duetting can inform animal bioacoustics. For this, we focus on a particular concept, interhemispheric connectivity, and its main white-matter substrate, the corpus callosum. We provide an overview of the role of corpus callosum in human neuroscience and interactive music and speech. We hypothesize its mechanistic connection to turn-taking and duetting in our species, and a potential translational link to mammalian research. We conclude by illustrating empirical venues for neuroethological research of turn-taking and duetting in mammals.

A feedforward inhibitory premotor circuit for auditory-vocal interactions in zebra finches

Significance During conversations, we frequently alternate between listening and speaking. This involves withholding responses while the other person is vocalizing and rapidly initiating a reply once they stop. Similar exchanges also occur in other animals, such as songbirds, yet little is known about how brain areas responsible for vocal production are influenced by areas dedicated to listening. Here, we combined neural recordings and mathematical modeling of a sensorimotor circuit to show that input-dependent inhibition can both suppress vocal responses and regulate the onset latencies of vocalizations. Our resulting model provides a simple generalizable circuit mechanism by which inhibition precisely times vocal output and integrates auditory input within a premotor nucleus.

Developmental Plasticity in Primate Coordinated Song: Parallels and Divergences With Duetting Songbirds

Homeothermic animals (birds and mammals) are prime model systems for investigating the developmental plasticity and neural mechanisms of vocal duetting, a cooperative acoustic signal that prevails in family-living and pair-bonded species including humans. This review focuses on the nature of this trait and its nurturing during ontogeny and extending into adulthood. I begin by outlining the underpinning concepts of duet codes and pair-specific answering rules as used by birds to develop their learned coordinated song, driven by a complex interaction between self-generated and socially mediated auditory feedback. The more tractable avian model of duetting helps identify research gaps in singing primates that also use duetting as a type of intraspecific vocal interaction. Nevertheless, it has become clear that primate coordinated song—whether overlapping or antiphonal—is subject to some degree of vocal flexibility. This is reflected in the ability of lesser apes, titi monkeys, tarsiers, and lemurs to adjust the structure and timing of their calls through (1) social influence, (2) coordinated duetting both before and after mating, (3) the repair of vocal mistakes, (4) the production of heterosexual song early in life, (5) vocal accommodation in call rhythm, (6) conditioning, and (7) innovation. Furthermore, experimental work on the neural underpinnings of avian and mammalian antiphonal duets point to a hierarchical (cortico-subcortical) control mechanism that regulates, via inhibition, the temporal segregation of rapid vocal exchanges. I discuss some weaknesses in this growing field of research and highlight prospective avenues for future investigation.

Reciprocal processes of sensory perception and social bonding: an integrated social-sensory framework of social behavior

Organisms filter the complexity of natural stimuli through their individual sensory and perceptual systems. Such perceptual filtering is particularly important for social stimuli. A shared "social umwelt" allows individuals to respond appropriately to the expected diversity of cues and signals during social interactions. In this way, the behavioral and neurobiological mechanisms of sociality and social bonding cannot be disentangled from perceptual mechanisms and sensory processing. While a degree of embeddedness between social and sensory processes is clear, our dominant theoretical frameworks favor treating the social and sensory processes as distinct. An integrated social-sensory framework has the potential to greatly expand our understanding of the mechanisms underlying individual variation in social bonding and sociality more broadly. Here we leverage what is known about sensory processing and pair bonding in two common study systems with significant species differences in their umwelt (rodent chemosensation and avian acoustic communication). We primarily highlight that (1) communication is essential for pair bond formation and maintenance, (2) the neural circuits underlying perception, communication and social bonding are integrated, and (3) candidate neuromodulatory mechanisms that regulate pair bonding also impact communication and perception. Finally, we propose approaches and frameworks that more fully integrate sensory processing, communication, and social bonding across levels of analysis: behavioral, neurobiological, and genomic. This perspective raises two key questions: (1) how is social bonding shaped by differences in sensory processing?, and (2) to what extent is sensory processing and the saliency of signals shaped by social interactions and emerging relationships?

Fast and accurate annotation of acoustic signals with deep neural networks

Acoustic signals serve communication within and across species throughout the animal kingdom. Studying the genetics, evolution, and neurobiology of acoustic communication requires annotating acoustic signals: segmenting and identifying individual acoustic elements like syllables or sound pulses. To be useful, annotations need to be accurate, robust to noise, and fast.

We here introduce DeepAudioSegmenter (DAS), a method that annotates acoustic signals across species based on a deep-learning derived hierarchical presentation of sound. We demonstrate the accuracy, robustness, and speed of DAS using acoustic signals with diverse characteristics from insects, birds, and mammals. DAS comes with a graphical user interface for annotating song, training the network, and for generating and proofreading annotations. The method can be trained to annotate signals from new species with little manual annotation and can be combined with unsupervised methods to discover novel signal types. DAS annotates song with high throughput and low latency for experimental interventions in realtime. Overall, DAS is a universal, versatile, and accessible tool for annotating acoustic communication signals.

Linking the genomic signatures of human beat synchronization and learned song in birds

The development of rhythmicity is foundational to communicative and social behaviours in humans and many other species, and mechanisms of synchrony could be conserved across species. The goal of the current paper is to explore evolutionary hypotheses linking vocal learning and beat synchronization through genomic approaches, testing the prediction that genetic underpinnings of birdsong also contribute to the aetiology of human interactions with musical beat structure. We combined state-of-the-art-genomic datasets that account for underlying polygenicity of these traits: birdsong genome-wide transcriptomics linked to singing in zebra finches, and a human genome-wide association study of beat synchronization. Results of competitive gene set analysis revealed that the genetic architecture of human beat synchronization is significantly enriched for birdsong genes expressed in songbird Area X (a key nucleus for vocal learning, and homologous to human basal ganglia). These findings complement ethological and neural evidence of the relationship between vocal learning and beat synchronization, supporting a framework of some degree of common genomic substrates underlying rhythm-related behaviours in two clades, humans and songbirds (the largest evolutionary radiation of vocal learners). Future cross-species approaches investigating the genetic underpinnings of beat synchronization in a broad evolutionary context are discussed. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.

The singing question: re-conceptualizing birdsong

Birdsong has been the subject of broad research from a variety of sub-disciplines and has taught us much about the evolution, function, and mechanisms driving animal communication and cognition. Typically, birdsong refers to the specialized vocalizations produced by oscines. Historically, much of the research on birdsong was conducted in north temperate regions (specifically in Europe and North America) leading to multiple biases. Due to these historic biases these vocalizations are generally considered to be highly sexually dimorphic, heavily shaped by sexual selection and essential for courtship and territoriality. Song is also typically defined as a learned trait shaped by cultural evolution. Together, this framework focuses research specifically on males, particularly during the north temperate breeding season - reflecting and thereby reinforcing this framework. The physiological underpinnings of song often emphasize the role of the hypothalamic-pituitary-gonadal axis (associated with breeding changes) and the song control system (underlying vocal learning). Over the years there has been great debate over which features of song are essential to the definition of birdsong, which features apply broadly to contexts outside males in the north temperate region, and over the importance of having a definition at all. Importantly, the definitions we use can both guide and limit the progress of research. Here, we describe the history of these definitions, and how these definitions have directed and restricted research to focus on male song in sexually selected contexts. Additionally, we highlight the gaps in our scientific knowledge, especially with respect to the function and physiological mechanisms underlying song in females and in winter, as well as in non-seasonally breeding species. Furthermore, we highlight the problems with using complexity and learning as dichotomous variables to categorize songs and calls. Across species, no one characteristic of song - sexual dimorphism, seasonality, complexity, sexual selection, learning - consistently delineates song from other songbird vocal communication. We provide recommendations for next steps to build an inclusive information framework that will allow researchers to explore nuances in animal communication and promote comparative research. Specifically, we recommend that researchers should operationalize the axis of variation most relevant to their study/species by identifying their specific question and the variable(s) of focus (e.g. seasonality). Researchers should also identify the axis (axes) of variation (e.g. degree of control by testosterone) most relevant to their study and use language consistent with the question and axis (axes) of variation (e.g. control by testosterone in the seasonal vocal production of birds).

Functional and evolutionary parallels between birdsong and human musicality

Here, we compare birdsong and human musicality using insights from songbird neuroethology and evolution. For example, neural recordings during songbird duetting and other coordinated vocal behaviors could inform mechanistic hypotheses regarding human brain function during music-making. Furthermore, considering songbird evolution as a model system suggests that selection favoring certain culturally transmitted behaviors can indirectly select for associated underlying neural functions.

Vocal learning and flexible rhythm pattern perception are linked: Evidence from songbirds

We can recognize the cadence of a friend’s voice or the rhythm of a familiar song across a wide range of tempi. This shows that our perception of temporal patterns relies strongly on the relative timing of events rather than on specific absolute durations. This tendency is foundational to speech and music perception, but to what extent is it shared by other species? We hypothesize that animals that learn their vocalizations are more likely to share this tendency. Here, we show that a vocal learning songbird robustly recognizes a basic rhythmic pattern independent of rate. Our findings pave the way for neurobiological studies to identify how the brain represents and perceives the temporal structure of auditory sequences.

Rhythm perception is fundamental to speech and music. Humans readily recognize a rhythmic pattern, such as that of a familiar song, independently of the tempo at which it occurs. This shows that our perception of auditory rhythms is flexible, relying on global relational patterns more than on the absolute durations of specific time intervals. Given that auditory rhythm perception in humans engages a complex auditory–motor cortical network even in the absence of movement and that the evolution of vocal learning is accompanied by strengthening of forebrain auditory–motor pathways, we hypothesize that vocal learning species share our perceptual facility for relational rhythm processing. We test this by asking whether the best-studied animal model for vocal learning, the zebra finch, can recognize a fundamental rhythmic pattern—equal timing between event onsets (isochrony)—based on temporal relations between intervals rather than on absolute durations. Prior work suggests that vocal nonlearners (pigeons and rats) are quite limited in this regard and are biased to attend to absolute durations when listening to rhythmic sequences. In contrast, using naturalistic sounds at multiple stimulus rates, we show that male zebra finches robustly recognize isochrony independent of absolute time intervals, even at rates distant from those used in training. Our findings highlight the importance of comparative studies of rhythmic processing and suggest that vocal learning species are promising animal models for key aspects of human rhythm perception. Such models are needed to understand the neural mechanisms behind the positive effect of rhythm on certain speech and movement disorders.

Songbirds can learn flexible contextual control over syllable sequencing

The flexible control of sequential behavior is a fundamental aspect of speech, enabling endless reordering of a limited set of learned vocal elements (syllables or words). Songbirds are phylogenetically distant from humans but share both the capacity for vocal learning and neural circuitry for vocal control that includes direct pallial-brainstem projections. Based on these similarities, we hypothesized that songbirds might likewise be able to learn flexible, moment-by-moment control over vocalizations. Here, we demonstrate that Bengalese finches (Lonchura striata domestica), which sing variable syllable sequences, can learn to rapidly modify the probability of specific sequences (e.g. ‘ab-c’ versus ‘ab-d’) in response to arbitrary visual cues. Moreover, once learned, this modulation of sequencing occurs immediately following changes in contextual cues and persists without external reinforcement. Our findings reveal a capacity in songbirds for learned contextual control over syllable sequencing that parallels human cognitive control over syllable sequencing in speech.

Human speech and birdsong share numerous parallels. Both humans and birds learn their vocalizations during critical phases early in life, and both learn by imitating adults. Moreover, both humans and songbirds possess specific circuits in the brain that connect the forebrain to midbrain vocal centers.

Humans can flexibly control what they say and how by reordering a fixed set of syllables into endless combinations, an ability critical to human speech and language. Birdsongs also vary depending on their context, and melodies to seduce a mate will be different from aggressive songs to warn other males to stay away. However, so far it was unclear whether songbirds are also capable of modifying songs independent of social or other naturally relevant contexts.

To test whether birds can control their songs in a purposeful way, Veit et al. trained adult male Bengalese finches to change the sequence of their songs in response to random colored lights that had no natural meaning to the birds. A specific computer program was used to detect different variations on a theme that the bird naturally produced (for example, “ab-c” versus “ab-d”), and rewarded birds for singing one sequence when the light was yellow, and the other when it was green. Gradually, the finches learned to modify their songs and were able to switch between the appropriate sequences as soon as the light cues changed. This ability persisted for days, even without any further training.

This suggests that songbirds can learn to flexibly and purposefully modify the way in which they sequence the notes in their songs, in a manner that parallels how humans control syllable sequencing in speech. Moreover, birds can learn to do this ‘on command’ in response to an arbitrarily chosen signal, even if it is not something that would impact their song in nature.

Songbirds are an important model to study brain circuits involved in vocal learning. They are one of the few animals that, like humans, learn their vocalizations by imitating conspecifics. The finding that they can also flexibly control vocalizations may help shed light on the interactions between cognitive processing and sophisticated vocal learning abilities.

Neurophysiological coordination of duet singing

Coordination of behavior for cooperative performances often relies on linkages mediated by sensory cues exchanged between participants. How neurophysiological responses to sensory information affect motor programs to coordinate behavior between individuals is not known. We investigated how plain-tailed wrens (Pheugopedius euophrys) use acoustic feedback to coordinate extraordinary duet performances in which females and males rapidly take turns singing. We made simultaneous neurophysiological recordings in a song control area "HVC" in pairs of singing wrens at a field site in Ecuador. HVC is a premotor area that integrates auditory feedback and is necessary for song production. We found that spiking activity of HVC neurons in each sex increased for production of its own syllables. In contrast, hearing sensory feedback produced by the bird's partner decreased HVC activity during duet singing, potentially coordinating HVC premotor activity in each bird through inhibition. When birds sang alone, HVC neurons in females but not males were inhibited by hearing the partner bird. When birds were anesthetized with urethane, which antagonizes GABAergic (γ-aminobutyric acid) transmission, HVC neurons were excited rather than inhibited, suggesting a role for GABA in the coordination of duet singing. These data suggest that HVC integrates information across partners during duets and that rapid turn taking may be mediated, in part, by inhibition.

Neurotelemetry Reveals Putative Predictive Activity in HVC during Call-Based Vocal Communications in Zebra Finches

Premotor predictions facilitate vocal interactions. Here, we study such mechanisms in the forebrain nucleus HVC (proper name), a cortex-like sensorimotor area of songbirds, otherwise known for being essential for singing in zebra finches. To study the role of the HVC in calling interactions between male and female mates, we used wireless telemetric systems for simultaneous measurement of neuronal activity of male zebra finches and vocalizations of males and females that freely interact with each other. In a non-social context, male HVC neurons displayed stereotypic premotor activity in relation to active calling and showed auditory-evoked activity to hearing of played-back female calls. In a social context, HVC neurons displayed auditory-evoked activity to hearing of female calls only if that neuron showed activity preceding the upcoming female calls. We hypothesize that this activity preceding the auditory-evoked activity in the male HVC represents a neural correlate of behavioral anticipation, predictive activity that helps to coordinate vocal communication between social partners.SIGNIFICANCE STATEMENT Most social-living vertebrates produce large numbers of calls per day, and the calls have prominent roles in social interactions. Here, we show neuronal mechanisms that are active during call-based vocal communication of zebra finches, a highly social songbird species. HVC, a forebrain nucleus known for its importance in control of learned vocalizations of songbirds, displays predictive activity that may enable the male to adjust his own calling pattern to produce very fast sequences of male female call exchanges.