An introduction to multimodal communication

Individual and ecological heterogeneity promote complex communication in social vertebrate group decisions

To receive the benefits of social living, individuals must make effective group decisions that enable them to achieve behavioural coordination and maintain cohesion. However, heterogeneity in the physical and social environments surrounding group decision-making contexts can increase the level of difficulty social organisms face in making decisions. Groups that live in variable physical environments (high ecological heterogeneity) can experience barriers to information transfer and increased levels of ecological uncertainty. In addition, in groups with large phenotypic variation (high individual heterogeneity), individuals can have substantial conflicts of interest regarding the timing and nature of activities, making it difficult for them to coordinate their behaviours or reach a consensus. In such cases, active communication can increase individuals' abilities to achieve coordination, such as by facilitating the transfer and aggregation of information about the environment or individual behavioural preferences. Here, we review the role of communication in vertebrate group decision-making and its relationship to heterogeneity in the ecological and social environment surrounding group decision-making contexts. We propose that complex communication has evolved to facilitate decision-making in specific socio-ecological contexts, and we provide a framework for studying this topic and testing related hypotheses as part of future research in this area. This article is part of the theme issue 'The power of sound: unravelling how acoustic communication shapes group dynamics'.

Multimodal communication and audience directedness in the greeting behaviour of semi-captive African savannah elephants

Many species communicate by combining signals into multimodal combinations. Elephants live in multi-level societies where individuals regularly separate and reunite. Upon reunion, elephants often engage in elaborate greeting rituals, where they use vocalisations and body acts produced with different body parts and of various sensory modalities (e.g., audible, tactile). However, whether these body acts represent communicative gestures and whether elephants combine vocalisations and gestures during greeting is still unknown. Here we use separation-reunion events to explore the greeting behaviour of semi-captive elephants (Loxodonta africana). We investigate whether elephants use silent-visual, audible, and tactile gestures directing them at their audience based on their state of visual attention and how they combine these gestures with vocalisations during greeting. We show that elephants select gesture modality appropriately according to their audience's visual attention, suggesting evidence of first-order intentional communicative use. We further show that elephants integrate vocalisations and gestures into different combinations and orders. The most frequent combination consists of rumble vocalisations with ear-flapping gestures, used most often between females. By showing that a species evolutionarily distant to our own primate lineage shows sensitivity to their audience's visual attention in their gesturing and combines gestures with vocalisations, our study advances our understanding of the emergence of first-order intentionality and multimodal communication across taxa.

Mapping of facial and vocal processing in common marmosets with ultra-high field fMRI

Primate communication relies on multimodal cues, such as vision and audition, to facilitate the exchange of intentions, enable social interactions, avoid predators, and foster group cohesion during daily activities. Understanding the integration of facial and vocal signals is pivotal to comprehend social interaction. In this study, we acquire whole-brain ultra-high field (9.4 T) fMRI data from awake marmosets (Callithrix jacchus) to explore brain responses to unimodal and combined facial and vocal stimuli. Our findings reveal that the multisensory condition not only intensifies activations in the occipito-temporal face patches and auditory voice patches but also engages a more extensive network that includes additional parietal, prefrontal and cingulate areas, compared to the summed responses of the unimodal conditions. By uncovering the neural network underlying multisensory audiovisual integration in marmosets, this study highlights the efficiency and adaptability of the marmoset brain in processing facial and vocal social signals, providing significant insights into primate social communication.

The evolution of decision-making mechanisms under competing demands

Animals in nature are constantly managing multiple demands, and decisions about how to adjust behavior in response to ecologically relevant demands is critical for fitness. Evidence for behavioral correlations across functional contexts (behavioral syndromes) and growing appreciation for shared proximate substrates of behavior prompts novel questions about the existence of distinct neural, molecular, and genetic mechanisms involved in decision-making. Those proximate mechanisms are likely to be an important target of selection, but little is known about how they evolve, their evolutionary history, or where they harbor genetic variation. Herein I provide a conceptual framework for understanding the evolution of mechanisms for decision-making, highlighting insights on decision-making in humans and model organisms, and sketch an emerging synthesis.

A multifaceted framework to establish the presence of meaning in non-human communication

Does non-human communication, like language, involve meaning? This question guides our focus through an interdisciplinary review of the theories and terminology used to study meaning across disciplines and species. Until now, it has been difficult to apply the concept of meaning to communication in non-humans. This is partly because of the varied approaches to the study of meaning. Additionally, while there is a scholarly acknowledgement of potential meaning in non-human cognition, there is also scepticism when the topic of communication arises. We organise some of the key literature into a coherent framework that can bridge disciplines and species, to ensure that aspects of meaning are accurately and fairly compared. We clarify the growing view in the literature that, rather than requiring multiple definitions or being split into different types, meaning is a multifaceted yet still unified concept. In so doing, we propose that meaning is an umbrella term. Meaning cannot be summed up with a short definition or list of features, but involves multiple complexities that are outlined in our framework. Specifically, three global facets are needed to describe meaning: a Signal Meaning Facet, an Interactant Meaning Facet, and a Resultant Meaning Facet. Most importantly, we show that such analyses are possible to apply as much to non-humans as to humans. We also emphasise that meaning nuances differ among non-human species, making a dichotomous approach to meaning questionable. Instead, we show that a multifaceted approach to meaning establishes how meaning appears within highly diverse examples of non-human communication, in ways consistent with the phenomenon's presence in human non-verbal communication and language(s). Therefore, without further recourse to 'functional' approaches that circumvent the critical question of whether any non-human meaning exists, we show that the concept of meaning is suitable for evolutionary biologists, behavioural ecologists, and others to study, to establish exactly which species exhibit meaning in their communication and in what ways.

Sensory collectives in natural systems

Groups of animals inhabit vastly different sensory worlds, or umwelten, which shape fundamental aspects of their behaviour. Yet the sensory ecology of species is rarely incorporated into the emerging field of collective behaviour, which studies the movements, population-level behaviours, and emergent properties of animal groups. Here, we review the contributions of sensory ecology and collective behaviour to understanding how animals move and interact within the context of their social and physical environments. Our goal is to advance and bridge these two areas of inquiry and highlight the potential for their creative integration. To achieve this goal, we organise our review around the following themes: (1) identifying the promise of integrating collective behaviour and sensory ecology; (2) defining and exploring the concept of a 'sensory collective'; (3) considering the potential for sensory collectives to shape the evolution of sensory systems; (4) exploring examples from diverse taxa to illustrate neural circuits involved in sensing and collective behaviour; and (5) suggesting the need for creative conceptual and methodological advances to quantify 'sensescapes'. In the final section, (6) applications to biological conservation, we argue that these topics are timely, given the ongoing anthropogenic changes to sensory stimuli (e.g. via light, sound, and chemical pollution) which are anticipated to impact animal collectives and group-level behaviour and, in turn, ecosystem composition and function. Our synthesis seeks to provide a forward-looking perspective on how sensory ecologists and collective behaviourists can both learn from and inspire one another to advance our understanding of animal behaviour, ecology, adaptation, and evolution.

Sensory integration of danger and safety cues may explain the fear of a quiet coyote

Sensory integration theory predicts natural selection should favour adaptive responses of animals to multiple forms of information, yet empirical tests of this prediction are rare, particularly in free-living mammals. Studying indirect predator cues offers a salient opportunity to inquire about multimodal risk assessment and its potentially interactive effects on prey responses. Here we exposed California ground squirrels from two study sites (that differ in human and domestic dog activity) to acoustic and/or olfactory predator cues to reveal divergent patterns of signal dominance. Olfactory information most strongly predicted space use within the testing arena. That is, individuals, especially those at the human-impacted site, avoided coyote urine, a danger cue that may communicate the proximity of a coyote. By contrast, subjects allocated less time to risk-sensitive behaviours when exposed to acoustic cues. Specifically, although individuals were consistent in their behavioural responses across trials, 'quiet coyotes' (urine without calls) significantly increased the behavioural reactivity of prey, likely because coyotes rarely vocalize when hunting. More broadly, our findings highlight the need to consider the evolution of integrated fear responses and contribute to an emerging understanding of how animals integrate multiple forms of information to trade off between danger and safety cues in a changing world.

Comment on 'Parasite defensive limb movements enhance acoustic signal attraction in male little torrent frogs'

Zhao et al. recently reported results which, they claim, suggest that sexual selection produces the multimodal displays seen in little torrent frogs (Amolops torrentis) by co-opting limb movements that originally evolved to support parasite defense (Zhao et al., 2022). Here, we explain why we believe this conclusion to be premature.

Object use in communication of semi-wild chimpanzees

Object interactions play an important role in human communication but the extent to which nonhuman primates incorporate objects in their social interactions remains unknown. To better understand the evolution of object use, this study explored how objects are used in social interactions in semi-wild chimpanzees (Pan troglodytes). We used an observational approach focusing on naturally occurring object actions where we examined their use and tested whether the production of object actions was influenced by the recipients' visual attention as well as by colony membership. The results show that chimpanzees adjusted both the type of object used, and the modality of object actions to match the visual attention of the recipient, as well as colony differences in the use of targeted object actions. These results provide empirical evidence highlighting that chimpanzees use objects in diverse ways to communicate with conspecifics and that their use may be shaped by social factors, contributing to our understanding of the evolution of human nonverbal communication, language, and tool use.

Alteration of the temporal association between courtship audio and visual components affects female sexual response

Some multimodal signals-that is, occurring in more than one sensory modality-appear to carry additional information which is not present when component signals are presented separately. To understand the function of male ring dove's (Streptopelia risoria) multimodal courtship, we used audiovisual playback of male displays to investigate female response to stimuli differing in their audiovisual timing. From natural courtship recordings, we created a shifted stimulus where audio was shifted relative to video by a fixed value and a jittered stimulus, where each call was moved randomly along the visual channel. We presented 3 groups of females with the same stimulus type, that is, control, shifted, and jittered, for 7 days. We recorded their behavior and assessed pre- and post-test blood estradiol concentration. We found that playback exposure increased estradiol levels, confirming that this technique can be efficiently used to study doves' sexual communication. Additionally, chasing behavior (indicating sexual stimulation) increased over experimental days only in the control condition, suggesting a role of multimodal timing on female response. This stresses the importance of signal configuration in multimodal communication, as additional information is likely to be contained in the temporal association between modalities.

Systems biology as a framework to understand the physiological and endocrine bases of behavior and its evolution-From concepts to a case study in birds

Organismal behavior, with its tremendous complexity and diversity, is generated by numerous physiological systems acting in coordination. Understanding how these systems evolve to support differences in behavior within and among species is a longstanding goal in biology that has captured the imagination of researchers who work on a multitude of taxa, including humans. Of particular importance are the physiological determinants of behavioral evolution, which are sometimes overlooked because we lack a robust conceptual framework to study mechanisms underlying adaptation and diversification of behavior. Here, we discuss a framework for such an analysis that applies a "systems view" to our understanding of behavioral control. This approach involves linking separate models that consider behavior and physiology as their own networks into a singular vertically integrated behavioral control system. In doing so, hormones commonly stand out as the links, or edges, among nodes within this system. To ground our discussion, we focus on studies of manakins (Pipridae), a family of Neotropical birds. These species have numerous physiological and endocrine specializations that support their elaborate reproductive displays. As a result, manakins provide a useful example to help imagine and visualize the way systems concepts can inform our appreciation of behavioral evolution. In particular, manakins help clarify how connectedness among physiological systems-which is maintained through endocrine signaling-potentiate and/or constrain the evolution of complex behavior to yield behavioral differences across taxa. Ultimately, we hope this review will continue to stimulate thought, discussion, and the emergence of research focused on integrated phenotypes in behavioral ecology and endocrinology.

Production of multimodal signals to assert social dominance in white-lipped peccary (Tayassu pecari)

In this study we aimed to examine whether the 'redundancy' (a backup function to ensure the signal transmission) or 'multiple messages' (sensory communication system in combination) hypothesis would explain the function of multimodal communication of white-lipped peccaries (Tayassu pecari-WLPs). We also aimed to assess the individual factors (the social rank and sex of the sender) influencing the production of, and responses to unimodal and multimodal signals. We determined the social rank of 21 WLPs living in two captive groups and quantified the production of unimodal and multimodal signals when displaying threatening and submissive behaviors. WLPs most often produce multimodal signals independent of a previous unimodal signal failure, which suggests that they were adding more information, such as the sender's size, rather than merely increasing efficacy by engaging a different receiver's sensory channel. There was no effect of the sender's sex in the production of, and responses to, multimodal signals. However, the higher the sender's social rank, the greater the production of multimodal signals when WLPs were displaying threatening behaviors; whereas the lower the sender's social rank, the greater the production of multimodal signals when displaying submission behaviors. Multimodal signals elicited more non-aggressive responses than did the unimodal signals when displaying a threat. Moreover, the higher the sender's social rank, the greater the occurrence of non-aggressive responses to multimodal signals when displaying a threat; whereas the opposite occurred when displaying submission. Our findings support the 'multiple messages' hypothesis to explain the function of multimodal signaling during agonistic interactions in WLPs. Additionally, both the production of, and responses to, multimodal signals are related to the sender's social rank. These results allow us to suggest that the production of multimodal signals may have a key role in mitigating conflict and thus promoting group cohesion among white-lipped peccaries.

Tactics of evasion: strategies used by signallers to deter eavesdropping enemies from exploiting communication systems

Eavesdropping predators, parasites and parasitoids exploit signals emitted by their prey and hosts for detection, assessment, localization and attack, and in the process impose strong selective pressures on the communication systems of the organisms they exploit. Signallers have evolved numerous anti-eavesdropper strategies to mitigate the trade-off between the costs imposed from signal exploitation and the need for conspecific communication. Eavesdropper strategies fall along a continuum from opportunistic to highly specialized, and the tightness of the eavesdropper-signaller relationship results in differential pressures on communication systems. A wide variety of anti-eavesdropper strategies mitigate the trade-off between eavesdropper exploitation and conspecific communication. Antagonistic selection from eavesdroppers can result in diverse outcomes including modulation of signalling displays, signal structure, and evolutionary loss or gain of a signal from a population. These strategies often result in reduced signal conspicuousness and in decreased signal ornamentation. Eavesdropping enemies, however, can also promote signal ornamentation. While less common, this alternative outcome offers a unique opportunity to dissect the factors that may lead to different evolutionary pathways. In addition, contrary to traditional assumptions, no sensory modality is completely 'safe' as eavesdroppers are ubiquitous and have a broad array of sensory filters that allow opportunity for signal exploitation. We discuss how anthropogenic change affects interactions between eavesdropping enemies and their victims as it rapidly modifies signalling environments and community composition. Drawing on diverse research from a range of taxa and sensory modalities, we synthesize current knowledge on anti-eavesdropper strategies, discuss challenges in this field and highlight fruitful new directions for future research. Ultimately, this review offers a conceptual framework to understand the diverse strategies used by signallers to communicate under the pressure imposed by their eavesdropping enemies.

Behind the mask(ing): how frogs cope with noise

Albert Feng was a pioneer in the field of auditory neuroethology who used frogs to investigate the neural basis of spectral and temporal processing and directional hearing. Among his many contributions was connecting neural mechanisms for sound pattern recognition and localization to the problems of auditory masking that frogs encounter when communicating in noisy, real-world environments. Feng's neurophysiological studies of auditory processing foreshadowed and inspired subsequent behavioral investigations of auditory masking in frogs. For frogs, vocal communication frequently occurs in breeding choruses, where males form dense aggregations and produce loud species-specific advertisement calls to attract potential mates and repel competitive rivals. In this review, we aim to highlight how Feng's research advanced our understanding of how frogs cope with noise. We structure our narrative around three themes woven throughout Feng's research-spectral, temporal, and directional processing-to illustrate how frogs can mitigate problems of auditory masking by exploiting frequency separation between signals and noise, temporal fluctuations in noise amplitude, and spatial separation between signals and noise. We conclude by proposing future research that would build on Feng's considerable legacy to advance our understanding of hearing and sound communication in frogs and other vertebrates.

Socially transferred materials: why and how to study them

When biological material is transferred from one individual's body to another, as in ejaculate, eggs, and milk, secondary donor-produced molecules are often transferred along with the main cargo, and influence the physiology and fitness of the receiver. Both social and solitary animals exhibit such social transfers at certain life stages. The secondary, bioactive, and transfer-supporting components in socially transferred materials have evolved convergently to the point where they are used in applications across taxa and type of transfer. The composition of these materials is typically highly dynamic and context dependent, and their components drive the physiological and behavioral evolution of many taxa. Our establishment of the concept of socially transferred materials unifies this multidisciplinary topic and will benefit both theory and applications.

Chasing Flies: The Use of Wingbeat Frequency as a Communication Cue in Calyptrate Flies (Diptera: Calyptratae)

The incidental sound produced by the oscillation of insect wings during flight provides an opportunity for species identification. Calyptrate flies include some of the fastest and most agile flying insects, capable of rapid changes in direction and the fast pursuit of conspecifics. This flight pattern makes the continuous and close recording of their wingbeat frequency difficult and limited to confined specimens. Advances in sound editor and analysis software, however, have made it possible to isolate low amplitude sounds using noise reduction and pitch detection algorithms. To explore differences in wingbeat frequency between genera and sex, 40 specimens of three-day old Sarcophaga crassipalpis, Lucilia sericata, Calliphora dubia, and Musca vetustissima were individually recorded in free flight in a temperature-controlled room. Results showed significant differences in wingbeat frequency between the four species and intersexual differences for each species. Discriminant analysis classifying the three carrion flies resulted in 77.5% classified correctly overall, with the correct classification of 82.5% of S. crassipalpis, 60% of C. dubia, and 90% of L. sericata, when both mean wingbeat frequency and sex were included. Intersexual differences were further demonstrated by male flies showing significantly higher variability than females in three of the species. These observed intergeneric and intersexual differences in wingbeat frequency start the discussion on the use of the metric as a communication signal by this taxon. The success of the methodology demonstrated differences at the genus level and encourages the recording of additional species and the use of wingbeat frequency as an identification tool for these flies.

Long-distance vocalizations of spotted hyenas contain individual, but not group, signatures

In animal societies, identity signals are common, mediate interactions within groups, and allow individuals to discriminate group-mates from out-group competitors. However, individual recognition becomes increasingly challenging as group size increases and as signals must be transmitted over greater distances. Group vocal signatures may evolve when successful in-group/out-group distinctions are at the crux of fitness-relevant decisions, but group signatures alone are insufficient when differentiated within-group relationships are important for decision-making. Spotted hyenas are social carnivores that live in stable clans of less than 125 individuals composed of multiple unrelated matrilines. Clan members cooperate to defend resources and communal territories from neighbouring clans and other mega carnivores; this collective defence is mediated by long-range (up to 5 km range) recruitment vocalizations, called whoops. Here, we use machine learning to determine that spotted hyena whoops contain individual but not group signatures, and that fundamental frequency features which propagate well are critical for individual discrimination. For effective clan-level cooperation, hyenas face the cognitive challenge of remembering and recognizing individual voices at long range. We show that serial redundancy in whoop bouts increases individual classification accuracy and thus extended call bouts used by hyenas probably evolved to overcome the challenges of communicating individual identity at long distance.

Reality and illusion: the assessment of angular separation of multi-modal signallers in a duetting bird

The spatial distribution of cooperating individuals plays a strategic role in territorial interactions of many group-living animals, and can indicate group cohesion. Vocalizations are commonly used to judge the distribution of signallers, but the spatial resolution of sounds is poor. Many species therefore accompany calls with movement; however, little is known about the role of audio-visual perception in natural interactions. We studied the effect of angular separation on the efficacy of multimodal duets in the Australian magpie-lark, Grallina cyanoleuca. We tested specifically whether conspicuous wing movements, which typically accompany duets, affect responses to auditory angular separation. Multimodal playbacks of duets using robotic models and speakers showed that birds relied primarily on acoustic cues when visual and auditory angular separations were congruent, but used both modalities to judge separation between the signallers when modalities were spatially incongruent. The visual component modified the effect of acoustic separation: robotic models that were apart weakened the response when speakers were together, while models that were together strengthened responses when speakers were apart. Our results show that responses are stronger when signallers are together, and suggest that males were are able to bind information cross-modally on the senders' spatial location, which is consistent with a multisensory illusion.

Olfactory Inspection of Female Reproductive States in Chimpanzees

In mammalian species, olfactory cues are important for within and between species communication. These cues can be part of multimodal signals indicating, for example, female fertility potentially perceived by male conspecifics. However, a large gap exists in our understanding of multimodal signaling in non-human catarrhines. Chimpanzees (Pan troglodytes) live in fission-fusion societies, mate promiscuously and express high levels of male-male competition. Females show a striking visual signal, an exaggerated sexual swelling, known to be a proxy of ovulation, while the maximum swelling is not matching the exact time of ovulation. The question remains if males use additional olfactory cues when being able to approach females closely. This would allow males to pinpoint the exact timing of ovulation and could be one reason why high-ranking males sire offspring more successfully than other males. Here, we present the first systematic test of such multimodal signaling by investigating male sniffing behavior directed to females in relation to their fertility in a group of 13 captive chimpanzees. Our results show that male sniffing behavior significantly increased with female swelling size, with female age as well as when fewer male competitors were present. Hence, odors might be part of a multimodal fertility cue, supporting the idea that males monitor both visual and olfactory cues to gain comprehensive information on female fertility.

Uncovering ‘Hidden’ Signals: Previously Presumed Visual Signals Likely Generate Air Particle Movement

Wolf spiders within the genus Schizocosa have become a model system for exploring the form and function of multimodal communication. In terms of male signaling, much past research has focused on the role and importance of dynamic and static visual and substrate-borne vibratory communication. Studies on S. retrorsa, however, have found that female-male pairs were able to successfully mate in the absence of both visual and vibratory stimuli, suggesting a reduced or non-existent role of these signaling modalities in this species. Given these prior findings, it has been suggested that S. retrorsa males may utilize an additional signaling modality during courtship—air particle movement, often referred to as near-field sound—which they likely produce with rapid leg waving and receive using thin filiform sensory hairs called trichobothria. In this study, we tested the role of air-particle movement in mating success by conducting two independent sets of mating trials with randomly paired S. retrorsa females and males in the dark and on granite (i.e., without visual or vibratory signals) in two different signaling environments—(i) without (“No Noise”) and (ii) with (“Noise”) introduced air-particle movement intended to disrupt signaling in that modality. We also ran foraging trials in No Noise/Noise environments to explore the impact of our treatments on overall behavior. Across both mating experiments, our treatments significantly impacted mating success, with more mating in the No Noise signaling environments compared to the Noise environments. The rate of leg waving—a previously assumed visual dynamic movement that has also been shown to be able to produce air particle displacement—was higher in the No Noise than Noise environments. Across both treatments, males with higher rates of leg waving had higher mating success. In contrast to mating trials results, foraging success was not influenced by Noise. Our results indicate that artificially induced air particle movement disrupts successful mating and alters male courtship signaling but does not interfere with a female’s ability to receive and assess the rate of male leg waving.

Towards an understanding of multimodal traits of female reproduction in chimpanzees

Although primates have long been regarded as microsmatic, recent studies indicate that olfaction is an important sensory mode of primate communication, e.g., in the context of reproduction. However, large gaps remain in our understanding of primate olfactory traits, especially in the great apes. Female chimpanzees (Pan troglodytes) possess an exaggerated sexual swelling, which is an imprecise signal of fertility that is thought to serve to confuse paternity. However, some high-ranking males that copulate most frequently on the days when females are most fertile seem to have more precise information on the timing of ovulation, which suggests the existence of an olfactory fertility trait. In order to examine, and provide evidence for, fertility-related chemical information in female chimpanzees, we used gas chromatography-mass spectrometry to analyze the chemical composition of female body odor collected across the menstrual cycle during various stages of sexual swelling (97 samples of six females). The chemical composition was significantly affected by swelling stage, and eight substances were detected that were strongly related to the latter. The existence of an additional, olfactory, fertility trait may help males to fine-tune their sexual behavior or allow females to strengthen concealment of the exact timing of ovulation, and needs to be further investigated in follow-up studies. The results of our study provide much-needed evidence for the existence of an olfactory cue related to reproduction in chimpanzees, and form a basis for future studies on the interplay between visual and olfactory information on female fertility.

Mother-pup recognition mechanisms in Australia sea lion (Neophoca cinerea) using uni- and multi-modal approaches

Communication is the process by which one emitter conveys information to one or several receivers to induce a response (behavioral or physiological) by the receiver. Communication plays a major role in various biological functions and may involve signals and cues from different sensory modalities. Traditionally, investigations of animal communication focused on a single sensory modality, yet communication is often multimodal. As these different processes may be quite complex and therefore difficult to disentangle, one approach is to first study each sensorial modality separately. With this refined understanding of individual senses, revealing how they interact becomes possible as the characteristics and properties of each modality can be accounted for, making a multimodal approach feasible. Using this framework, researchers undertook systematic, experimental investigations on mother-pup recognition processes in a colonial pinniped species, the Australian sea lion Neophoca cinerea. The research first assessed the abilities of mothers and pups to identify each other by their voice using playback experiments. Second, they assessed whether visual cues are used by both mothers and pups to distinguish them from conspecifics, and/or whether females discriminate the odor of their filial pup from those from non-filial pups. Finally, to understand if the information transmitted by different sensory modalities is analyzed synergistically or if there is a hierarchy among the sensory modalities, experiments were performed involving different sensory cues simultaneously. These findings are discussed with regards to the active space of each sensory cue, and of the potential enhancements that may arise by assessing information from different modalities.

Frog embryos use multiple levels of temporal pattern in risk assessment for vibration-cued escape hatching

Stereotyped signals can be a fast, effective means of communicating danger, but animals assessing predation risk must often use more variable incidental cues. Red eyed-treefrog, Agalychnis callidryas, embryos hatch prematurely to escape from egg predators, cued by vibrations in attacks, but benign rain generates vibrations with overlapping properties. Facing high false-alarm costs, embryos use multiple vibration properties to inform hatching, including temporal pattern elements such as pulse durations and inter-pulse intervals. However, measures of snake and rain vibration as simple pulse-interval patterns are a poor match to embryo behavior. We used vibration playbacks to assess if embryos use a second level of temporal pattern, long gaps within a rhythmic pattern, as indicators of risks. Long vibration-free periods are common during snake attacks but absent from hard rain. Long gaps after a few initial vibrations increase the hatching response to a subsequent vibration series. Moreover, vibration patterns as short as three pulses, separated by long periods of silence, can induce as much hatching as rhythmic pulse series with five times more vibration. Embryos can retain information that increases hatching over at least 45 s of silence. This work highlights that embryo behavior is contextually modulated in complex ways. Identical vibration pulses, pulse groups, and periods of silence can be treated as risk cues in some contexts and not in others. Embryos employ a multi-faceted decision-making process to effectively distinguish between risk cues and benign stimuli.

Cross-modal facilitation of auditory discrimination in a frog

Stimulation in one sensory modality can affect perception in a separate modality, resulting in diverse effects including illusions in humans. This can also result in cross-modal facilitation, a process where sensory performance in one modality is improved by stimulation in another modality. For instance, a simple sound can improve performance in a visual task in both humans and cats. However, the range of contexts and underlying mechanisms that evoke such facilitation effects remain poorly understood. Here, we demonstrated cross-modal stimulation in wild-caught túngara frogs, a species with well-studied acoustic preferences in females. We first identified that a combined visual and seismic cue (vocal sac movement and water ripple) was behaviourally relevant for females choosing between two courtship calls in a phonotaxis assay. We then found that this combined cross-modal stimulus rescued a species-typical acoustic preference in the presence of background noise that otherwise abolished the preference. These results highlight how cross-modal stimulation can prime attention in receivers to improve performance during decision-making. With this, we provide the foundation for future work uncovering the processes and conditions that promote cross-modal facilitation effects.

Parasite defensive limb movements enhance acoustic signal attraction in male little torrent frogs

Many animals rely on complex signals that target multiple senses to attract mates and repel rivals. These multimodal displays can however also attract unintended receivers, which can be an important driver of signal complexity. Despite being taxonomically widespread, we often lack insight into how multimodal signals evolve from unimodal signals and in particular what roles unintended eavesdroppers play. Here, we assess whether the physical movements of parasite defense behavior increase the complexity and attractiveness of an acoustic sexual signal in the little torrent frog (Amolops torrentis). Calling males of this species often display limb movements in order to defend against blood-sucking parasites such as frog-biting midges that eavesdrop on their acoustic signal. Through mate choice tests we show that some of these midge-evoked movements influence female preference for acoustic signals. Our data suggest that midge-induced movements may be incorporated into a sexual display, targeting both hearing and vision in the intended receiver. Females may play an important role in incorporating these multiple components because they prefer signals which combine multiple modalities. Our results thus help to understand the relationship between natural and sexual selection pressure operating on signalers and how in turn this may influence multimodal signal evolution.

A Feline Semiochemical Composition Influences the Cat's Toileting Location Choice

Unwanted toileting is amongst the most undesirable behaviors in domestic cats and can lead to conflicts between cats and the communities they are living in. This study aimed to confirm the effect of a semiochemical composition, reconstituted volatile fraction derived from cat anal glands, on the elimination behavior of domestic cats. A total of 31 cats were tested individually, for 23 h, in a blinded randomized choice test, with two litter trays, one sprayed with the treatment and the other with the control. Parameters included elimination weight, urine only weight, the record of the elimination type and counting of urine spots and stools, exploration duration of each litter tray, and first and second choice of litter tray to eliminate. Across all parameters, cats urinated and defecated significantly less in the litter tray where the semiochemical composition was sprayed than in the litter tray where the control was sprayed (for example: elimination weight p < 0.0001; urine only weight p < 0.0001; exploration duration p < 0.0001, and first elimination choice p < 0.0001). These results demonstrate that a semiochemical composition-derived from cat anal glands significantly decreases elimination at the location where it is sprayed. Future research is warranted to explore the possibility to manage unwanted toileting using this semiochemical composition.

Influencing Elimination Location in the Domestic Cat: A Semiochemical Approach

Simple Summary

In the domestic cat, elimination at an inappropriate location is considered by cat owners and non-cat owners as an undesirable behaviour. The aim of the study was to assess the effects of a composition derived from cat anal glands on the elimination behaviour of domestic cats in a cattery setting. The study was conducted in four catteries housing 33 cats, using 37 litter trays. The data collection lasted two weeks, each litter tray receiving one treatment on the first week and the other treatment on the second week. The parameters studied included daily elimination (urine plus stools) weight, urine weight, stool weight, elimination type and urine/stool quantity scoring. Four out of the six parameters studied showed a treatment effect, consistently in favour of cats defecating significantly less in the litter trays sprayed with the treatment versus litter trays sprayed with the control. These results demonstrate that a composition originating from cat anal glands influences cats’ defecation location.

Abstract

In the domestic cat, elimination at an inappropriate location is considered by cat owners and non-cat owners as an undesirable behaviour. The aim of the study was to assess the effect of a semiochemical formulation, reconstituted volatile fraction of cat anal gland secretions on the elimination behaviour of domestic cats. The study was conducted in four catteries, which housed 33 cats, using 37 litter trays and followed a randomised crossover design using the litter tray as the experimental unit. The parameters studied included daily elimination (urine plus stools) weight, urine weight, stool weight, elimination type and urine/stool quantity scoring. The parameters were analysed using GLMM with SAS 9.4 software. Four out of the six parameters studied showed a treatment effect, consistently in favour of cats defecating significantly less in the litter trays sprayed with the treatment versus litter trays sprayed with the control (elimination weight p = 0.0199; elimination type p = 0.0251; stool weight p = 0.0005 and stool quantity p = 0.003). These results demonstrate that an intraspecific semiochemical message originating from cat anal glands influences cats’ defecation location.

A comprehensive overview of the effects of urbanisation on sexual selection and sexual traits

Urbanisation can affect mating opportunities and thereby alter inter- and intra-sexual selection pressures on sexual traits. Biotic and abiotic urban conditions can influence an individual's success in pre- and post-copulatory mating, for example through impacts on mate attraction and mate preference, fertilisation success, resource competition or rival interactions. Divergent sexual selection pressures can lead to differences in behavioural, physiological, morphological or life-history traits between urban and non-urban populations, ultimately driving adaptation and speciation. Most studies on urban sexual selection and mating interactions report differences between urban and non-urban populations or correlations between sexual traits and factors associated with increased urbanisation, such as pollution, food availability and risk of predation and parasitism. Here we review the literature on sexual selection and sexual traits in relation to urbanisation or urban-associated conditions. We provide an extensive list of abiotic and biotic factors that can influence processes involved in mating interactions, such as signal production and transmission, mate choice and mating opportunities. We discuss all relevant data through the lens of two, non-mutually exclusive theories on sexual selection, namely indicator and sensory models. Where possible, we indicate whether these models provide the same or different predictions regarding urban-adapted sexual signals and describe different experimental designs that can be useful for the different models as well as to investigate the drivers of sexual selection. We argue that we lack a good understanding of: (i) the factors driving urban sexual selection; (ii) whether reported changes in traits result in adaptive benefits; and (iii) whether these changes reflect a short-term ecological, or long-term evolutionary response. We highlight that urbanisation provides a unique opportunity to study the process and outcomes of sexual selection, but that this requires a highly integrative approach combining experimental and observational work.

The face is central to primate multicomponent signals

A wealth of experimental and observational evidence suggests that faces have become increasingly important in the communication system of primates over evolutionary time and that both the static and moveable aspects of faces convey considerable information. Therefore, whenever there is a visual component to any multicomponent signal the face is potentially relevant. However, the role of the face is not always considered in primate multicomponent communication research. We review the literature and make a case for greater focus on the face going forward. We propose that the face can be overlooked for two main reasons: first, due to methodological difficulty. Examination of multicomponent signals in primates is difficult, so scientists tend to examine a limited number of signals in combination. Detailed examination of the subtle and dynamic components of facial signals is particularly hard to achieve in studies of primates. Second, due to a common assumption that the face contains “emotional” content. A priori categorisation of facial behavior as “emotional” ignores the potentially communicative and predictive information present in the face that might contribute to signals. In short, we argue that the face is central to multicomponent signals (and also many multimodal signals) and suggest future directions for investigating this phenomenon.

Facial expressions elicit multiplexed perceptions of emotion categories and dimensions

Human facial expressions are complex, multi-component signals that can communicate rich information about emotions,1-5 including specific categories, such as "anger," and broader dimensions, such as "negative valence, high arousal."6-8 An enduring question is how this complex signaling is achieved. Communication theory predicts that multi-component signals could transmit each type of emotion information-i.e., specific categories and broader dimensions-via the same or different facial signal components, with implications for elucidating the system and ontology of facial expression communication.9 We addressed this question using a communication-systems-based method that agnostically generates facial expressions and uses the receiver's perceptions to model the specific facial signal components that represent emotion category and dimensional information to them.10-12 First, we derived the facial expressions that elicit the perception of emotion categories (i.e., the six classic emotions13 plus 19 complex emotions3) and dimensions (i.e., valence and arousal) separately, in 60 individual participants. Comparison of these facial signals showed that they share subsets of components, suggesting that specific latent signals jointly represent-i.e., multiplex-categorical and dimensional information. Further examination revealed these specific latent signals and the joint information they represent. Our results-based on white Western participants, same-ethnicity face stimuli, and commonly used English emotion terms-show that facial expressions can jointly represent specific emotion categories and broad dimensions to perceivers via multiplexed facial signal components. Our results provide insights into the ontology and system of facial expression communication and a new information-theoretic framework that can characterize its complexities.

When does reputation lie? Dynamic feedbacks between costly signals, social capital and social prominence

Performing a dramatic act of religious devotion, creating an art exhibit, or releasing a new product are all examples of public acts that signal quality and contribute to building a reputation. Signalling theory predicts that these public displays can reliably reveal quality. However, data from ethnographic work in South India suggests that more prominent individuals gain more from reputation-building religious acts than more marginalized individuals. To understand this phenomenon, we extend signalling theory to include variation in people's social prominence or social capital, first with an analytical model and then with an agent-based model. We consider two ways in which social prominence/capital may alter signalling: (i) it impacts observers' priors, and (ii) it alters the signallers' pay-offs. These two mechanisms can result in both a 'reputational shield,' where low quality individuals are able to 'pass' as high quality thanks to their greater social prominence/capital, and a 'reputational poverty trap,' where high quality individuals are unable to improve their standing owing to a lack of social prominence/capital. These findings bridge the signalling theory tradition prominent in behavioural ecology, anthropology and economics with the work on status hierarchies in sociology, and shed light on the complex ways in which individuals make inferences about others. This article is part of the theme issue 'The language of cooperation: reputation and honest signalling'.

Form and Function Predict Acoustic Transmission Properties of the Songs of Male and Female Canyon Wrens

To function effectively, animal signals must transmit through the environment to receivers, and signal transmission properties depend on signal form. Here we investigated how the transmission of multiple parts of a well-studied signal, bird song, varies between males and females of one species. We hypothesized that male and female songs would have different transmission properties, reflecting known differences in song form and function. We further hypothesized that two parts of male song used differentially in broadcast singing and aggressive contests would transmit differently. Analyses included male and female songs from 20 pairs of canyon wrens (Catherpes mexicanus) played and re-recorded in species-typical habitat. We found that male song cascades used in broadcast singing propagated farther than female songs, with higher signal-to-noise ratios at distance. In contrast, we demonstrated relatively restricted propagation of the two vocalization types typically used in short-distance aggressive signaling, female songs and male “cheet” notes. Of the three tested signals, male “cheet” notes had the shortest modeled propagation distances. Male and female signals blurred similarly, with variable patterns of excess attenuation. Both male song parts showed more consistent transmission across the duration of the signal than did female songs. Song transmission, thus, varied by sex and reflected signal form and use context. Results support the idea that males and females of the same species can show distinctly different signal evolution trajectories. Sexual and social selection pressures can shape sex-specific signal transmission, even when males and females are communicating in shared physical environments.

Musth and sexual selection in elephants: a review of signalling properties and potential fitness consequences

Sexual selection mediated by multimodal signals is common among polygynous species, including seasonally breeding mammals. Indirect benefit models provide plausible explanations for how and why mate selection can occur in the absence of direct benefits. Musth — an asynchronous reproductive state in male elephants — facilitates both inter- and intrasexual selection via indirect benefits, and it is further communicated through a multimodal signal. In this review, we synthesise existing evidence that supports the hypothesis that musth is a multimodal signal subject to sexual selection and that male elephants increase their direct fitness by propagating this signal while females accrue indirect benefits. Musth is characterised by a suite of physiological and behavioural changes, serving to facilitate copulation between the sexes, and via multisensory modalities musth conveys honest information about the condition of a male. Female elephants mate preferentially with musth males, increasing their own fitness in the absence of direct benefits. In addition, musth resolves dynamic dominance hierarchies among male elephants and often eliminates the need for costly physical combat. Future work in this field should investigate potential postcopulatory selection mechanisms in elephants, including sperm competition and cryptic female choice. These topics join other fundamental questions related to sexual selection, signalling, and indirect benefits that are still unanswered in elephants.

Adding colour-realistic video images to audio playbacks increases stimulus engagement but does not enhance vocal learning in zebra finches

Bird song and human speech are learned early in life and for both cases engagement with live social tutors generally leads to better learning outcomes than passive audio-only exposure. Real-world tutor–tutee relations are normally not uni- but multimodal and observations suggest that visual cues related to sound production might enhance vocal learning. We tested this hypothesis by pairing appropriate, colour-realistic, high frame-rate videos of a singing adult male zebra finch tutor with song playbacks and presenting these stimuli to juvenile zebra finches (Taeniopygia guttata). Juveniles exposed to song playbacks combined with video presentation of a singing bird approached the stimulus more often and spent more time close to it than juveniles exposed to audio playback only or audio playback combined with pixelated and time-reversed videos. However, higher engagement with the realistic audio–visual stimuli was not predictive of better song learning. Thus, although multimodality increased stimulus engagement and biologically relevant video content was more salient than colour and movement equivalent videos, the higher engagement with the realistic audio–visual stimuli did not lead to enhanced vocal learning. Whether the lack of three-dimensionality of a video tutor and/or the lack of meaningful social interaction make them less suitable for facilitating song learning than audio–visual exposure to a live tutor remains to be tested.

Motion: enhancing signals and concealing cues

Animal colour patterns remain a lively focus of evolutionary and behavioural ecology, despite the considerable conceptual and technical developments over the last four decades. Nevertheless, our current understanding of the function and efficacy of animal colour patterns remains largely shaped by a focus on stationary animals, typically in a static background. Yet, this rarely reflects the natural world: most animals are mobile in their search for food and mates, and their surrounding environment is usually dynamic. Thus, visual signalling involves not only animal colour patterns, but also the patterns of animal motion and behaviour, often in the context of a potentially dynamic background. While motion can reveal information about the signaller by attracting attention or revealing signaller attributes, motion can also be a means of concealing cues, by reducing the likelihood of detection (motion camouflage, motion masquerade and flicker-fusion effect) or the likelihood of capture following detection (motion dazzle and confusion effect). The interaction between the colour patterns of the animal and its local environment is further affected by the behaviour of the individual. Our review details how motion is intricately linked to signalling and suggests some avenues for future research.

This Review has an associated Future Leader to Watch interview with the first author.

Summary: While motion can reveal information about the signaller, motion can also be a means of concealing cues by reducing the likelihood of detection or the likelihood of capture following detection.

Multicomponent and multisensory communicative acts in orang-utans may serve different functions

From early infancy, human face-to-face communication is multimodal, comprising a plethora of interlinked communicative and sensory modalities. Although there is also growing evidence for this in nonhuman primates, previous research rarely disentangled production from perception of signals. Consequently, the functions of integrating articulators (i.e. production organs involved in multicomponent acts) and sensory channels (i.e. modalities involved in multisensory acts) remain poorly understood. Here, we studied close-range social interactions within and beyond mother-infant pairs of Bornean and Sumatran orang-utans living in wild and captive settings, to examine use of and responses to multicomponent and multisensory communication. From the perspective of production, results showed that multicomponent acts were used more than the respective unicomponent acts when the presumed goal did not match the dominant outcome for a specific communicative act, and were more common among non-mother-infant dyads and Sumatran orang-utans. From the perception perspective, we found that multisensory acts were more effective than the respective unisensory acts, and were used more in wild compared to captive populations. We argue that multisensory acts primarily facilitate effectiveness, whereas multicomponent acts become relevant when interaction outcomes are less predictable. These different functions underscore the importance of distinguishing between production and perception in studies of communication.