Characterizing the rhythm and tempo of sound production by singing whales

Cetaceans are the next frontier for vocal rhythm research

While rhythm can facilitate and enhance many aspects of behavior, its evolutionary trajectory in vocal communication systems remains enigmatic. We can trace evolutionary processes by investigating rhythmic abilities in different species, but research to date has largely focused on songbirds and primates. We present evidence that cetaceans-whales, dolphins, and porpoises-are a missing piece of the puzzle for understanding why rhythm evolved in vocal communication systems. Cetaceans not only produce rhythmic vocalizations but also exhibit behaviors known or thought to play a role in the evolution of different features of rhythm. These behaviors include vocal learning abilities, advanced breathing control, sexually selected vocal displays, prolonged mother-infant bonds, and behavioral synchronization. The untapped comparative potential of cetaceans is further enhanced by high interspecific diversity, which generates natural ranges of vocal and social complexity for investigating various evolutionary hypotheses. We show that rhythm (particularly isochronous rhythm, when sounds are equally spaced in time) is prevalent in cetacean vocalizations but is used in different contexts by baleen and toothed whales. We also highlight key questions and research areas that will enhance understanding of vocal rhythms across taxa. By coupling an infraorder-level taxonomic assessment of vocal rhythm production with comparisons to other species, we illustrate how broadly comparative research can contribute to a more nuanced understanding of the prevalence, evolution, and possible functions of rhythm in animal communication.

Caller identification and characterization of individual humpback whale acoustic behaviour

Acoustic recording tags provide fine-scale data linking acoustic signalling with individual behaviour; however, when an animal is in a group, it is challenging to tease apart calls of conspecifics and identify which individuals produce each call. This, in turn, prohibits a robust assessment of individual acoustic behaviour including call rates and silent periods, call bout production within and between individuals, and caller location. To overcome this challenge, we simultaneously instrumented small groups of humpback whales on a western North Atlantic feeding ground with sound and movement recording tags. This approach enabled a comparison of the relative amplitude of each call across individuals to infer caller identity for 97% of calls. We recorded variable call rates across individuals (mean = 23 calls/h) and groups (mean = 55 calls/h). Calls were produced throughout dives, and most calls were produced in bouts with short inter-call intervals of 2.2 s. Most calls received a likely response from a conspecific within 100 s. This caller identification (ID) method facilitates studying both individual- and group-level acoustic behaviour, yielding novel results about the nature of sequence production and vocal exchanges in humpback whale social calls. Future studies can expand on these caller ID methods for understanding intra-group communication across taxa.

Interactive bioacoustic playback as a tool for detecting and exploring nonhuman intelligence: "conversing" with an Alaskan humpback whale

Here we report on a rare and opportunistic acoustic turn-taking with an adult female humpback whale, known as Twain, in Southeast Alaska. Post hoc acoustic and statistical analyses of a 20-min acoustic exchange between the broadcast of a recorded contact call, known as a 'whup/throp', with call responses by Twain revealed an intentional human-whale acoustic (and behavioral) interaction. Our results show that Twain participated both physically and acoustically in three phases of interaction (Phase 1: Engagement, Phase 2: Agitation, Phase 3: Disengagement), independently determined by blind observers reporting on surface behavior and respiratory activity of the interacting whale. A close examination of both changes to the latency between Twain's calls and the temporal matching to the latency of the exemplar across phases indicated that Twain was actively engaged in the exchange during Phase 1 (Engagement), less so during Phase 2 (Agitation), and disengaged during Phase 3 (Disengagement). These results, while preliminary, point to several key considerations for effective playback design, namely the importance of salient, dynamic and adaptive playbacks, that should be utilized in experimentation with whales and other interactive nonhuman species.

Comment on: "Variability in humpback whale songs reveals how individuals can be distinctive when sharing a complex vocal display" [J. Acoust. Soc. Am. 153, 2238-2250 (2023)]

Lamoni, Garland, Allen, Coxon, Noad, and Rendell [(2023). J. Acoust. Soc. Am. 153, 2238-2250] analyzed variations in humpback whale song structure to assess how individual singers can produce distinctive patterns that communicate desirable individual qualities to potential mates. Their analyses revealed that singers rarely produced individually specific sound patterns and that singers varied subjectively distinctive structural features of songs differently across years. These findings provide the strongest evidence to date that singing humpback whales are not varying song structure in ways that reliably reveal individual singers' physical or cognitive characteristics. Surprisingly, the authors appear to reach the opposite conclusion. Objective strategies for quantitatively comparing song properties are crucial for evaluating competing hypotheses regarding the nature and function of humpback whale songs, but the value of such strategies is reduced when the objectivity of the analyses is suspect and when negative evidence is framed as supporting prior beliefs.

The Development of Speaking and Singing in Infants May Play a Role in Genomics and Dementia in Humans

The development of the central auditory system, including the auditory cortex and other areas involved in processing sound, is shaped by genetic and environmental factors, enabling infants to learn how to speak. Before explaining hearing in humans, a short overview of auditory dysfunction is provided. Environmental factors such as exposure to sound and language can impact the development and function of the auditory system sound processing, including discerning in speech perception, singing, and language processing. Infants can hear before birth, and sound exposure sculpts their developing auditory system structure and functions. Exposing infants to singing and speaking can support their auditory and language development. In aging humans, the hippocampus and auditory nuclear centers are affected by neurodegenerative diseases such as Alzheimer's, resulting in memory and auditory processing difficulties. As the disease progresses, overt auditory nuclear center damage occurs, leading to problems in processing auditory information. In conclusion, combined memory and auditory processing difficulties significantly impact people's ability to communicate and engage with their societal essence.

Intra-individual variation in the songs of humpback whales suggests they are sonically searching for conspecifics

Observations of animals' vocal actions can provide important clues about how they communicate and about how they perceive and react to changing situations. Here, analyses of consecutive songs produced by singing humpback whales recorded off the coast of Hawaii revealed that singers constantly vary the acoustic qualities of their songs within prolonged song sessions. Unlike the progressive changes in song structure that singing humpback whales make across months and years, intra-individual acoustic variations within song sessions appear to be largely stochastic. Additionally, four sequentially produced song components (or "themes") were each found to vary in unique ways. The most extensively used theme was highly variable in overall duration within and across song sessions, but varied relatively little in frequency content. In contrast, the remaining themes varied greatly in frequency content, but showed less variation in duration. Analyses of variations in the amount of time singers spent producing the four themes suggest that the mechanisms that determine when singers transition between themes may be comparable to those that control when terrestrial animals move their eyes to fixate on different positions as they examine visual scenes. The dynamic changes that individual whales make to songs within song sessions are counterproductive if songs serve mainly to provide conspecifics with indications of a singer's fitness. Instead, within-session changes to the acoustic features of songs may serve to enhance a singer's capacity to echoically detect, localize, and track conspecifics from long distances.

Cognitive control of song production by humpback whales

Singing humpback whales are highly versatile vocalizers, producing complex sequences of sounds that they vary throughout adulthood. Past analyses of humpback whale song have emphasized yearly variations in structural features of songs made collectively by singers within a population with comparatively little attention given to the ways that individual singers vary consecutive songs. As a result, many researchers describe singing by humpback whales as a process in which singers produce sequences of repeating sound patterns. Here, we show that such characterizations misrepresent the degree to which humpback whales flexibly and dynamically control the production of sounds and sound patterns within song sessions. Singers recorded off the coast of Hawaii continuously morphed units along multiple acoustic dimensions, with the degree and direction of morphing varying across parallel streams of successive units. Individual singers also produced multiple phrase variants (structurally similar, but acoustically distinctive sequences) within song sessions. The precision with which individual singers maintained some acoustic properties of phrases and morphing trajectories while flexibly changing others suggests that singing humpback whales actively select and adjust acoustic elements of their songs in real time rather than simply repeating stereotyped sound patterns within song sessions.

All units are equal in humpback whale songs, but some are more equal than others

Flexible production and perception of vocalizations is linked to an impressive array of cognitive capacities including language acquisition by humans, song learning by birds, biosonar in bats, and vocal imitation by cetaceans. Here, we characterize a portion of the repertoire of one of the most impressive vocalizers in nature: the humpback whale. Qualitative and quantitative analyses of sounds (units) produced by humpback whales revealed that singers gradually morphed streams of units along multiple acoustic dimensions within songs, maintaining the continuity of spectral content across subjectively dissimilar unit "types." Singers consistently produced some unit forms more frequently and intensely than others, suggesting that units are functionally heterogeneous. The precision with which singing humpback whales continuously adjusted the acoustic characteristics of units shows that they possess exquisite vocal control mechanisms and vocal flexibility beyond what is seen in most animals other than humans. The gradual morphing of units within songs that we observed is inconsistent with past claims that humpback whales construct songs from a fixed repertoire of discrete unit types. These findings challenge the results of past studies based on fixed-unit classification methods and argue for the development of new metrics for characterizing the graded structure of units. The specific vocal variations that singers produced suggest that humpback whale songs are unlikely to provide detailed information about a singer's reproductive fitness, but can reveal the precise locations and movements of singers from long distances and may enhance the effectiveness of units as sonar signals.

Vocal learning and flexible rhythm pattern perception are linked: Evidence from songbirds

We can recognize the cadence of a friend’s voice or the rhythm of a familiar song across a wide range of tempi. This shows that our perception of temporal patterns relies strongly on the relative timing of events rather than on specific absolute durations. This tendency is foundational to speech and music perception, but to what extent is it shared by other species? We hypothesize that animals that learn their vocalizations are more likely to share this tendency. Here, we show that a vocal learning songbird robustly recognizes a basic rhythmic pattern independent of rate. Our findings pave the way for neurobiological studies to identify how the brain represents and perceives the temporal structure of auditory sequences.

Rhythm perception is fundamental to speech and music. Humans readily recognize a rhythmic pattern, such as that of a familiar song, independently of the tempo at which it occurs. This shows that our perception of auditory rhythms is flexible, relying on global relational patterns more than on the absolute durations of specific time intervals. Given that auditory rhythm perception in humans engages a complex auditory–motor cortical network even in the absence of movement and that the evolution of vocal learning is accompanied by strengthening of forebrain auditory–motor pathways, we hypothesize that vocal learning species share our perceptual facility for relational rhythm processing. We test this by asking whether the best-studied animal model for vocal learning, the zebra finch, can recognize a fundamental rhythmic pattern—equal timing between event onsets (isochrony)—based on temporal relations between intervals rather than on absolute durations. Prior work suggests that vocal nonlearners (pigeons and rats) are quite limited in this regard and are biased to attend to absolute durations when listening to rhythmic sequences. In contrast, using naturalistic sounds at multiple stimulus rates, we show that male zebra finches robustly recognize isochrony independent of absolute time intervals, even at rates distant from those used in training. Our findings highlight the importance of comparative studies of rhythmic processing and suggest that vocal learning species are promising animal models for key aspects of human rhythm perception. Such models are needed to understand the neural mechanisms behind the positive effect of rhythm on certain speech and movement disorders.

Bidirectional Interactions With Humpback Whale Singer Using Concrete Sound Elements

We describe an art–science project called “Feral Interactions—The Answer of the Humpback Whale” inspired by humpback whale songs and interactions between individuals based on mutual influences, learning process, or ranking in the dominance hierarchy. The aim was to build new sounds that can be used to initiate acoustic interactions with these whales, not in a one-way direction, as playbacks do, but in real interspecies exchanges. Thus, we investigated how the humpback whales generate sounds in order to better understand their abilities and limits. By carefully listening to their emitted vocalizations, we also describe their acoustic features and temporal structure, in a scientific way and also with a musical approach as it is done with musique concrète, in order to specify the types and the morphologies of whale sounds. The idea is to highlight the most precise information to generate our own sounds that will be suggested to the whales. Based on the approach developed in musique concrète, similarities with the sounds produced by bassoon were identified and then were processed to become “concrete sound elements.” This analysis also brought us to design a new music interface that allows us to create adapted musical phrases in real-time. With this approach, interactions will be possible in both directions, from and to whales.

Spectral interleaving by singing humpback whales: Signs of sonar

The duplex sonar model of humpback whale song proposes that broadband units within songs function differently from narrowband units. Specifically, this model suggests that singing humpback whales interleave constant frequency (CF) units, which can generate prolonged reverberation focused at specific frequencies, with less reverberant broadband units that minimally overlap with the focal frequencies of preceding and following CF units (referred to as spectral interleaving) to increase the efficacy of song as a sonar source. Here, it is shown that singers recorded off the coast of Hawaii in 2015 devoted most of their time singing to spectrally interleaving broadband elements of units around quasi-CF components that consistently generated persistent reverberant tails. Singers maintained reverberant CF streams in specific frequency bands when units contained broadband elements and when singers switched from producing pairs of alternating reverberant units to producing a single reverberant unit. Additionally, singers showed the ability to flexibly control where acoustic energy was concentrated within broadband components in ways that minimized spectral overlap with the focal frequencies of reverberant tails. The consistency and precision with which singing humpback whales interleaved broadband and reverberant CF elements of units confirm two novel predictions of the duplex sonar model.

Song Morphing by Humpback Whales: Cultural or Epiphenomenal?

Singing humpback whales (Megaptera noavaengliae) collectively and progressively change the sounds and patterns they produce within their songs throughout their lives. The dynamic modifications that humpback whales make to their songs are often cited as an impressive example of cultural transmission through vocal learning in a non-human. Some elements of song change challenge this interpretation, however, including: (1) singers often incrementally and progressively morph phrases within and across songs as time passes, with trajectories of change being comparable across multiple time scales; (2) acoustically isolated subpopulations singing similar songs morph the acoustic properties of songs in similar ways; and (3) complex sound patterns, including phrases, themes, and whole songs, recur across years and populations. These properties of song dynamics suggest that singing humpback whales may be modulating song features in response to local conditions and genetic predispositions rather than socially learning novel sound patterns by copying other singers. Experimental and observational tests of key predictions of these alternative hypotheses are critical to identifying how and why singing humpback whales constantly change their songs.

Comparison of methods for rhythm analysis of complex animals' acoustic signals

Analyzing the rhythm of animals' acoustic signals is of interest to a growing number of researchers: evolutionary biologists want to disentangle how these structures evolved and what patterns can be found, and ecologists and conservation biologists aim to discriminate cryptic species on the basis of parameters of acoustic signals such as temporal structures. Temporal structures are also relevant for research on vocal production learning, a part of which is for the animal to learn a temporal structure. These structures, in other words, these rhythms, are the topic of this paper. How can they be investigated in a meaningful, comparable and universal way? Several approaches exist. Here we used five methods to compare their suitability and interpretability for different questions and datasets and test how they support the reproducibility of results and bypass biases. Three very different datasets with regards to recording situation, length and context were analyzed: two social vocalizations of Neotropical bats (multisyllabic, medium long isolation calls of Saccopteryx bilineata, and monosyllabic, very short isolation calls of Carollia perspicillata) and click trains of sperm whales, Physeter macrocephalus. Techniques to be compared included Fourier analysis with a newly developed goodness-of-fit value, a generate-and-test approach where data was overlaid with varying artificial beats, and the analysis of inter-onset-intervals and calculations of a normalized Pairwise Variability Index (nPVI). We discuss the advantages and disadvantages of the methods and we also show suggestions on how to best visualize rhythm analysis results. Furthermore, we developed a decision tree that will enable researchers to select a suitable and comparable method on the basis of their data.

The Sonar Model for Humpback Whale Song Revised

Why do humpback whales sing? This paper considers the hypothesis that humpback whales may use song for long range sonar. Given the vocal and social behavior of humpback whales, in several cases it is not apparent how they monitor the movements of distant whales or prey concentrations. Unless distant animals produce sounds, humpback whales are unlikely to be aware of their presence or actions. Some field observations are strongly suggestive of the use of song as sonar. Humpback whales sometimes stop singing and then rapidly approach distant whales in cases where sound production by those whales is not apparent, and singers sometimes alternately sing and swim while attempting to intercept another whale that is swimming evasively. In the evolutionary development of modern cetaceans, perceptual mechanisms have shifted from reliance on visual scanning to the active generation and monitoring of echoes. It is hypothesized that as the size and distance of relevant events increased, humpback whales developed adaptive specializations for long-distance echolocation. Differences between use of songs by humpback whales and use of sonar by other echolocating species are discussed, as are similarities between bat echolocation and singing by humpback whales. Singing humpback whales are known to emit sounds intense enough to generate echoes at long ranges, and to flexibly control the timing and qualities of produced sounds. The major problem for the hypothesis is the lack of recordings of echoes from other whales arriving at singers immediately before they initiate actions related to those whales. An earlier model of echoic processing by singing humpback whales is here revised to incorporate recent discoveries. According to the revised model, both direct echoes from targets and modulations in song-generated reverberation can provide singers with information that can help them make decisions about future actions related to mating, traveling, and foraging. The model identifies acoustic and structural features produced by singing humpback whales that may facilitate a singer's ability to interpret changes in echoic scenes and suggests that interactive signal coordination by singing whales may help them to avoid mutual interference. Specific, testable predictions of the model are presented.