Waltzing Taeniopygia: integration of courtship song and dance in the domesticated Australian zebra finch

Alteration of the temporal association between courtship audio and visual components affects female sexual response

Some multimodal signals-that is, occurring in more than one sensory modality-appear to carry additional information which is not present when component signals are presented separately. To understand the function of male ring dove's (Streptopelia risoria) multimodal courtship, we used audiovisual playback of male displays to investigate female response to stimuli differing in their audiovisual timing. From natural courtship recordings, we created a shifted stimulus where audio was shifted relative to video by a fixed value and a jittered stimulus, where each call was moved randomly along the visual channel. We presented 3 groups of females with the same stimulus type, that is, control, shifted, and jittered, for 7 days. We recorded their behavior and assessed pre- and post-test blood estradiol concentration. We found that playback exposure increased estradiol levels, confirming that this technique can be efficiently used to study doves' sexual communication. Additionally, chasing behavior (indicating sexual stimulation) increased over experimental days only in the control condition, suggesting a role of multimodal timing on female response. This stresses the importance of signal configuration in multimodal communication, as additional information is likely to be contained in the temporal association between modalities.

Neural circuits: How the songbird brain orchestrates courtship displays

Volitional production of complex behaviors can be motivated by intrinsic rewards and also by extrinsic cues, like social engagement. A new study has revealed the neural circuit permitting social motivation to release multi-component courtship behaviors in a songbird, specifically the zebra finch.

A neural hub for holistic courtship displays

Courtship displays often involve the concerted production of several distinct courtship behaviors. The neural circuits that enable the concerted production of the component behaviors of a courtship display are not well understood. Here, we identify a midbrain cell group (A11) that enables male zebra finches to produce their learned songs in concert with various other behaviors, including female-directed orientation, pursuit, and calling. Anatomical mapping reveals that A11 is at the center of a complex network including the song premotor nucleus HVC as well as brainstem regions crucial to calling and locomotion. Notably, lesioning A11 terminals in HVC blocked female-directed singing but did not interfere with female-directed calling, orientation, or pursuit. In contrast, lesioning A11 cell bodies strongly reduced and often abolished all female-directed courtship behaviors. However, males with either type of lesion still produced songs when in social isolation. Lastly, imaging calcium-related activity in A11 terminals in HVC showed that during courtship, A11 signals HVC about female-directed calls and during female-directed singing, about the transition from simpler introductory notes to the acoustically more complex syllables that depend intimately on HVC for their production. These results show how a brain region important to reproduction in both birds and mammals enables holistic courtship displays in male zebra finches, which include learning songs, calls, and other non-vocal behaviors.

Can you hear/see me? Multisensory integration of signals does not always facilitate mate choice

Females of many species choose mates using multiple sensory modalities. Multimodal noise may arise, however, in dense aggregations of animals communicating via multiple sensory modalities. Some evidence suggests multimodal signals may not always improve receiver decision-making performance. When sensory systems process input from multimodal signal sources, multimodal noise may arise and potentially complicate decision-making due to the demands on cognitive integration tasks. We tested female túngara frog, Physalaemus (=Engystomops) pustulosus, responses to male mating signals in noise from multiple sensory modalities (acoustic and visual). Noise treatments were partitioned into three categories: acoustic, visual, and multimodal. We used natural calls from conspecifics and heterospecifics for acoustic noise. Robotic frogs were employed as either visual signal components (synchronous vocal sac inflation with call) or visual noise (asynchronous vocal sac inflation with call). Females expressed a preference for the typically more attractive call in the presence of unimodal noise. However, during multimodal signal and noise treatments (robofrogs employed with background noise), females failed to express a preference for the typically attractive call in the presence of conspecific chorus noise. We found that social context and temporal synchrony of multimodal signaling components are important for multimodal communication. Our results demonstrate that multimodal signals have the potential to increase the complexity of the sensory scene and reduce the efficacy of female decision making.

A juvenile locomotor program promotes vocal learning in zebra finches

The evolution and development of complex, learned motor skills are thought to be closely associated with other locomotor movement and cognitive functions. However, it remains largely unknown how different neuromuscular programs may interconnect during the protracted developmental process. Here we use a songbird to examine the behavioral and neural substrates between the development of locomotor movement and vocal-motor learning. Juvenile songbirds escalate their locomotor activity during the sensitive period for vocal learning, followed by a surge of vocal practice. Individual variability of locomotor production is positively correlated with precision of tutor imitation and duration of multi-syllable sequences. Manipulation of juvenile locomotion significantly impacts the precision of vocal imitation and neural plasticity. The locomotor program developed during the sensitive period of vocal learning may enrich the neural substrates that promote the subsequent development of vocal learning.

Increased movement is associated with improved vocal activity in young zebra finches, while reducing locomotion leads to poor vocal learning. These results suggest that exercise in juvenile birds may actually promote their ability to learn and produce songs.

Inter-sexual multimodal communication during mating in wild geladas: the leading role of females

Female primates can emit vocalizations associated with mating that can function as honest signals of fertility. Here, we investigated the role of mating calls and visual signals in female geladas (Theropithecus gelada). Because females have a central role in the gelada society and seem to solicit sexual interactions, we answered whether they emit vocalizations in conjunction with gazing to increase mating success probability. Before and during copulations, females can emit pre-copulation calls and copulation calls. For the first time, we identified a new female vocalization emitted at the final stage of copulations (end-copulation call), possibly marking the occurrence of ejaculation. We found that longer pre-copulation call sequences were followed by both prolonged copulations and the presence of end-copulation calls, thus suggesting that females use pre-copulation calls to ensure successful copula completion. Moreover, we found that different combinations of female vocal types and gazing had different effects on male vocal behavior and motivation to complete the copula. The analysis of the vocal and visual signals revealed a complex inter-sexual multimodal chattering with the leading role of females in the signal exchange. Such chattering, led by females, modulates male sexual arousal, thus increasing the probability of the copula success.

Covariation among multimodal components in the courtship display of the túngara frog

Communication systems often include a variety of components, including those that span modalities, which may facilitate detection and decision-making. For example, female túngara frogs and fringe-lipped bats generally rely on acoustic mating signals to find male túngara frogs in a mating or foraging context, respectively. However, two additional cues (vocal sac inflation and water ripples) can enhance detection and choice behavior. To date, we do not know the natural variation and covariation of these three components. To address this, we made detailed recordings of calling males, including call amplitude, vocal sac volume and water ripple height, in 54 frogs (2430 calls). We found that all three measures correlated, with the strongest association between the vocal sac volume and call amplitude. We also found that multimodal models predicted the mass of calling males better than unimodal models. These results demonstrate how multimodal components of a communication system relate to each other and provide an important foundation for future studies on how receivers integrate and compare complex displays.

Songbirds can learn flexible contextual control over syllable sequencing

The flexible control of sequential behavior is a fundamental aspect of speech, enabling endless reordering of a limited set of learned vocal elements (syllables or words). Songbirds are phylogenetically distant from humans but share both the capacity for vocal learning and neural circuitry for vocal control that includes direct pallial-brainstem projections. Based on these similarities, we hypothesized that songbirds might likewise be able to learn flexible, moment-by-moment control over vocalizations. Here, we demonstrate that Bengalese finches (Lonchura striata domestica), which sing variable syllable sequences, can learn to rapidly modify the probability of specific sequences (e.g. ‘ab-c’ versus ‘ab-d’) in response to arbitrary visual cues. Moreover, once learned, this modulation of sequencing occurs immediately following changes in contextual cues and persists without external reinforcement. Our findings reveal a capacity in songbirds for learned contextual control over syllable sequencing that parallels human cognitive control over syllable sequencing in speech.

Human speech and birdsong share numerous parallels. Both humans and birds learn their vocalizations during critical phases early in life, and both learn by imitating adults. Moreover, both humans and songbirds possess specific circuits in the brain that connect the forebrain to midbrain vocal centers.

Humans can flexibly control what they say and how by reordering a fixed set of syllables into endless combinations, an ability critical to human speech and language. Birdsongs also vary depending on their context, and melodies to seduce a mate will be different from aggressive songs to warn other males to stay away. However, so far it was unclear whether songbirds are also capable of modifying songs independent of social or other naturally relevant contexts.

To test whether birds can control their songs in a purposeful way, Veit et al. trained adult male Bengalese finches to change the sequence of their songs in response to random colored lights that had no natural meaning to the birds. A specific computer program was used to detect different variations on a theme that the bird naturally produced (for example, “ab-c” versus “ab-d”), and rewarded birds for singing one sequence when the light was yellow, and the other when it was green. Gradually, the finches learned to modify their songs and were able to switch between the appropriate sequences as soon as the light cues changed. This ability persisted for days, even without any further training.

This suggests that songbirds can learn to flexibly and purposefully modify the way in which they sequence the notes in their songs, in a manner that parallels how humans control syllable sequencing in speech. Moreover, birds can learn to do this ‘on command’ in response to an arbitrarily chosen signal, even if it is not something that would impact their song in nature.

Songbirds are an important model to study brain circuits involved in vocal learning. They are one of the few animals that, like humans, learn their vocalizations by imitating conspecifics. The finding that they can also flexibly control vocalizations may help shed light on the interactions between cognitive processing and sophisticated vocal learning abilities.

Tap dancers in the wild: field observations of multimodal courtship displays in socially monogamous songbirds

Multimodal signaling systems are shaped not only by a signaler’s physical abilities but also by external factors such as the position of signal receivers and the properties of the medium through which the signals are transmitted. To fully understand the evolution and function of multimodal communication, it is essential to investigate the behavior in the wild. Here, I present evidence that socially monogamous songbirds perform complex courtship displays that can produce multimodal and multicomponent signals in wild conditions. Cordon-bleus (Uraeginthus spp.) are socially monogamous songbirds from East Africa. Both sexes of cordon-bleus perform multimodal courtship displays by holding a piece of nest material, bobbing up and down, and singing. My previous laboratory study using high-speed video cameras revealed that courtship bobbing includes multiple rapid steps similar to human tap-dancing, which presumably contributes to producing non-vocal sounds and/or vibrations in addition to visual signals. As a result of field observation and behavioral analysis, I found that wild cordon-bleus perform tap-dance like displays just as captive cordon-bleus. I also observed that wild cordon-bleus produced non-vocal sounds and shook branches during courtship, which can contribute to multimodal signal production (i.e., visual, acoustic, and vibrational signals). My findings imply that the courtship displays of cordon-bleus are an ideal candidate for investigating the role and function of multimodal communication in animals, and demonstrate the importance of further quantitative studies in both laboratory and field.

Visually attending to a video together facilitates great ape social closeness

Humans create social closeness with one another through a variety of shared social activities in which they align their emotions or mental states towards an external stimulus such as dancing to music together, playing board games together or even engaging in minimal shared experiences such as watching a movie together. Although these specific behaviours would seem to be uniquely human, it is unclear whether the underlying psychology is unique to the species, or if other species might possess some form of this psychological mechanism as well. Here we show that great apes who have visually attended to a video together with a human (study 1) and a conspecific (study 2) subsequently approach that individual faster (study 1) or spend more time in their proximity (study 2) than when they had attended to something different. Our results suggest that one of the most basic mechanisms of human social bonding-feeling closer to those with whom we act or attend together-is present in both humans and great apes, and thus has deeper evolutionary roots than previously suspected.

Vocal and locomotor coordination develops in association with the autonomic nervous system

In adult animals, movement and vocalizations are coordinated, sometimes facilitating, and at other times inhibiting, each other. What is missing is how these different domains of motor control become coordinated over the course of development. We investigated how postural-locomotor behaviors may influence vocal development, and the role played by physiological arousal during their interactions. Using infant marmoset monkeys, we densely sampled vocal, postural and locomotor behaviors and estimated arousal fluctuations from electrocardiographic measures of heart rate. We found that vocalizations matured sooner than postural and locomotor skills, and that vocal-locomotor coordination improved with age and during elevated arousal levels. These results suggest that postural-locomotor maturity is not required for vocal development to occur, and that infants gradually improve coordination between vocalizations and body movement through a process that may be facilitated by arousal level changes.

Early-life lessons of the courtship dance in a dance-duetting songbird, the Java sparrow

Vocal learners, such as songbirds, must practise singing in a developmentally sensitive period to master songs. Yet, knowledge remains limited about the development of visual displays in birds, even when courtship includes well-coordinated vocalizations (songs) and body motions. The Java sparrow (Lonchura oryzivora) is a species of songbird that exhibits a courtship duet dancing exchange between the sexes, with this behaviour driving mating success. In this study, juvenile male Java sparrows were observed in captivity, showing that they repeatedly practise the courtship dance in their early life. We called it 'practice', as juvenile birds frequently dance towards family members or other juveniles well before sexual maturation. Based on our observation that dance motor performance increased with age, we propose that the practice is needed for motor learning. In addition, it could also be important for establishing vocal-motional coordination or socialization. Older juveniles gradually became capable of singing and dancing simultaneously, and participated in duet dancing more often. We also found that repeated encounters with the same individual promote dance movement. Though our results do not show how much social experiences account for the development of dance communication, early-life dance practising might influence future reproductive success, like song practising does.

The Genetics of Mating Song Evolution Underlying Rapid Speciation: Linking Quantitative Variation to Candidate Genes for Behavioral Isolation

Differences in mating behaviors evolve early during speciation, eventually contributing to reproductive barriers between species. Knowledge of the genetic and genomic basis of these behaviors is therefore integral to a causal understanding of speciation. Acoustic behaviors are often part of the mating ritual in animal species. The temporal rhythms of mating songs are notably species-specific in many vertebrates and arthropods and often underlie assortative mating. Despite discoveries of mutations that disrupt the temporal rhythm of these songs, we know surprisingly little about genes affecting naturally occurring variation in the temporal pattern of singing behavior. In the rapidly speciating Hawaiian cricket genus Laupala, the striking species variation in song rhythms constitutes a behavioral barrier to reproduction between species. Here, we mapped the largest-effect locus underlying interspecific variation in song rhythm between two Laupala species to a narrow genomic region, wherein we find no known candidate genes affecting song temporal rhythm in Drosophila Whole-genome sequencing, gene prediction, and functional annotation of this region reveal an exciting and promising candidate gene, the putative cyclic nucleotide-gated ion channel-like gene, for natural variation in mating behavior. Identification and molecular characterization of the candidate gene reveals a nonsynonymous mutation in a conserved binding domain, suggesting that ion channels are important targets of selection on rhythmic signaling during establishment of behavioral isolation and rapid speciation.

Violation of the Unity Assumption Disrupts Temporal Ventriloquism Effect in Starlings

When stimuli from different sensory modalities are received, they may be combined by the brain to form a multisensory percept. One key mechanism for multisensory binding is the unity assumption under which multisensory stimuli that share certain physical properties like temporal and/or spatial correspondence are grouped together as deriving from one object. In humans, evidence for a role of the unity assumption has been found in spatial tasks and also in temporal tasks using stimuli that share physical properties (speech-related stimuli, musical and synesthetically congruent stimuli). In our study, we investigate the role of the unity assumption in an animal model in a temporal order judgment task. When subjects are asked to indicate which of two spatially separated visual stimuli appeared first in time, performance improves when the visual stimuli are paired (in time) with spatially non-informative acoustic cues, a phenomenon known as the temporal ventriloquism effect. Here, we show that European starlings perform better when one singleton acoustic cue is paired with the first visual stimulus as compared to pairing with the second visual stimulus. This shows, in combination with our previous study, that a non-informative singleton acoustic cue, when temporally paired with the first visual stimulus, triggers alerting while, when temporally pairing with the second visual stimulus, it prevents a temporal ventriloquism effect because the unity assumption is violated. Thus, the unity assumption influences sensory perception not only in humans but also in an animal model. The importance of the unity assumption in this task supports the idea that the temporal ventriloquism effect, similar to the spatial ventriloquism effect, is based on multisensory binding and integration but not on alerting effects.

Low-cost synchronization of high-speed audio and video recordings in bio-acoustic experiments

In this paper, we present a method for synchronizing high-speed audio and video recordings of bio-acoustic experiments. By embedding a random signal into the recorded video and audio data, robust synchronization of a diverse set of sensor streams can be performed without the need to keep detailed records. The synchronization can be performed using recording devices without dedicated synchronization inputs. We demonstrate the efficacy of the approach in two sets of experiments: behavioral experiments on different species of echolocating bats and the recordings of field crickets. We present the general operating principle of the synchronization method, discuss its synchronization strength and provide insights into how to construct such a device using off-the-shelf components.

Early-life immune activation increases song complexity and alters phenotypic associations between sexual ornaments

Early-life adversity can have long-lasting effects on physiological, behavioural, cognitive, and somatic processes. Consequently, these effects may alter an organism's life-history strategy and reproductive tactics.In response to early-life immune activation, we quantified levels of the acute phase protein haptoglobin (Hp) during development in male zebra finches (Taeniopygia guttata). Then, we examined the long-term impacts of early-life immune activation on an important static sexual signal, song complexity, as well as effects of early-life immune activation on the relationship between song complexity and a dynamic sexual signal, beak colouration. Finally, we performed mate-choice trials to determine if male early-life experience impacted female preference.Challenge with keyhole limpet hemocyanin (KLH) resulted in increased song complexity compared to lipopolysaccharide (LPS) treatment or the control. Hp levels were inversely correlated with song complexity. Moreover, KLH-treatment resulted in negative associations between the two sexual signals (beak colouration and song complexity). Females demonstrated some preference for KLH-treated males over controls and for control males over LPS-treated males in mate choice trials.Developmental immune activation has variable effects on the expression of secondary sexual traits in adulthood, including enhancing the expression of some traits. Because developmental levels of Hp and adult song complexity were correlated, future studies should explore a potential role for exposure to inflammation during development on song learning.Early-life adversity may differentially impact static versus dynamic signals. The use of phenotypic correlations can be a powerful tool for examining the impact of early-life experience on the associations among different traits, including sexual signals.

Regularities in zebra finch song beyond the repeated motif

The proliferation of birdsong research into the neural mechanisms of vocal learning is indebted to the remarkable stereotypy of the zebra finch's song motif. Motifs are composed of several syllables, which birds learn to produce in a fixed order. But at a higher level of organization-the bout-zebra finch song is no longer stereotyped. Song bouts include several repetitions of the motif, which are often linked by a variable number of short "connector" vocalizations. In this conceptual methods paper, we show that combinatorial analysis alone yields an incomplete description of this bout-level structure. In contrast, studying birdsong as a time-varying analog signal can reveal patterns of flexibility in the rhythmic organization of song bouts. Visualizing large song-samples in sorted raster plots shows that motifs are strung together via two distinct categories of connections: tight or loose. Loose connections allow considerable timing variation across renditions. Even among co-tutored birds that acquired similar motifs, we observe strong individual variability in rhythms and temporal plasticity of song bouts. These findings suggest that vocal flexibility could potentially allow individuals to express a variety of behavioral states through their songs, even in species that sing only a single stereotyped motif.

Cortical inter-hemispheric circuits for multimodal vocal learning in songbirds

Vocal learning in songbirds and humans is strongly influenced by social interactions based on sensory inputs from several modalities. Songbird vocal learning is mediated by cortico-basal ganglia circuits that include the SHELL region of lateral magnocellular nucleus of the anterior nidopallium (LMAN), but little is known concerning neural pathways that could integrate multimodal sensory information with SHELL circuitry. In addition, cortical pathways that mediate the precise coordination between hemispheres required for song production have been little studied. In order to identify candidate mechanisms for multimodal sensory integration and bilateral coordination for vocal learning in zebra finches, we investigated the anatomical organization of two regions that receive input from SHELL: the dorsal caudolateral nidopallium (dNCL_SHELL ) and a region within the ventral arcopallium (Av). Anterograde and retrograde tracing experiments revealed a topographically organized inter-hemispheric circuit: SHELL and dNCL_SHELL , as well as adjacent nidopallial areas, send axonal projections to ipsilateral Av; Av in turn projects to contralateral SHELL, dNCL_SHELL , and regions of nidopallium adjacent to each. Av on each side also projects directly to contralateral Av. dNCL_SHELL and Av each integrate inputs from ipsilateral SHELL with inputs from sensory regions in surrounding nidopallium, suggesting that they function to integrate multimodal sensory information with song-related responses within LMAN-SHELL during vocal learning. Av projections share this integrated information from the ipsilateral hemisphere with contralateral sensory and song-learning regions. Our results suggest that the inter-hemispheric pathway through Av may function to integrate multimodal sensory feedback with vocal-learning circuitry and coordinate bilateral vocal behavior.

Mating success follows duet dancing in the Java sparrow

Mutual interactions between sexes have multiple signalling functions. Duet singing in songbirds is related to mutual mate guarding, joint resource defence, and signalling commitment. Coordinated visual displays of mating pairs are thought to perform similar functions, but are less well understood. The current study evaluated mutual interactions in an Estrildid species to explore the relative importance of duet dancing and male singing in mating success of pairs in a first encounter. When Java sparrows (Lonchura oryzivora) court prospective mates, only males sing. However, both males and females perform courtship dances, often in a duet-like manner. These dances are typically terminated by female copulation solicitation displays (CSDs). In the current study, we observed higher mating success when courtship dances were mutually exchanged, and when males sang. However, the sex initiating the courtship did not affect mating success. Most females produced CSDs after duet dancing but before hearing the entire song, indicating that duet dancing played a crucial role in mating. This finding highlights an unexplored aspect of duetting behaviour in the process of mutual mate choice. These results conflict with the majority of past songbird research, which has interpreted songs as primary behavioural sexual signals.

Brains for birds and babies: Neural parallels between birdsong and speech acquisition

Language as a computational cognitive mechanism appears to be unique to the human species. However, there are remarkable behavioral similarities between song learning in songbirds and speech acquisition in human infants that are absent in non-human primates. Here we review important neural parallels between birdsong and speech. In both cases there are separate but continually interacting neural networks that underlie vocal production, sensorimotor learning, and auditory perception and memory. As in the case of human speech, neural activity related to birdsong learning is lateralized, and mirror neurons linking perception and performance may contribute to sensorimotor learning. In songbirds that are learning their songs, there is continual interaction between secondary auditory regions and sensorimotor regions, similar to the interaction between Wernicke's and Broca's areas in human infants acquiring speech and language. Taken together, song learning in birds and speech acquisition in humans may provide useful insights into the evolution and mechanisms of auditory-vocal learning.

"Bird Song Metronomics": Isochronous Organization of Zebra Finch Song Rhythm

The human capacity for speech and vocal music depends on vocal imitation. Songbirds, in contrast to non-human primates, share this vocal production learning with humans. The process through which birds and humans learn many of their vocalizations as well as the underlying neural system exhibit a number of striking parallels and have been widely researched. In contrast, rhythm, a key feature of language, and music, has received surprisingly little attention in songbirds. Investigating temporal periodicity in bird song has the potential to inform the relationship between neural mechanisms and behavioral output and can also provide insight into the biology and evolution of musicality. Here we present a method to analyze birdsong for an underlying rhythmic regularity. Using the intervals from one note onset to the next as input, we found for each bird an isochronous sequence of time stamps, a “signal-derived pulse,” or pulse^S, of which a subset aligned with all note onsets of the bird's song. Fourier analysis corroborated these results. To determine whether this finding was just a byproduct of the duration of notes and intervals typical for zebra finches but not dependent on the individual duration of elements and the sequence in which they are sung, we compared natural songs to models of artificial songs. Note onsets of natural song deviated from the pulse^S significantly less than those of artificial songs with randomized note and gap durations. Thus, male zebra finch song has the regularity required for a listener to extract a perceived pulse (pulse^P), as yet untested. Strikingly, in our study, pulses^S that best fit note onsets often also coincided with the transitions between sub-note elements within complex notes, corresponding to neuromuscular gestures. Gesture durations often equaled one or more pulse^S periods. This suggests that gesture duration constitutes the basic element of the temporal hierarchy of zebra finch song rhythm, an interesting parallel to the hierarchically structured components of regular rhythms in human music.