Primate vocalization, gesture, and the evolution of human language

Gestural communication in wild spider monkeys (Ateles geoffroyi)

Gestures play a central role in the communication systems of several animal families, including primates. In this study, we provide a first assessment of the gestural systems of a Platyrrhine species, Geoffroy's spider monkeys (Ateles geoffroyi). We observed a wild group of 52 spider monkeys and assessed the distribution of visual and tactile gestures in the group, the size of individual repertoires and the intentionality and effectiveness of individuals' gestural production. Our results showed that younger spider monkeys were more likely than older ones to use tactile gestures. In contrast, we found no inter-individual differences in the probability of producing visual gestures. Repertoire size did not vary with age, but the probability of accounting for recipients' attentional state was higher for older monkeys than for younger ones, especially for gestures in the visual modality. Using vocalizations right before the gesture increased the probability of gesturing towards attentive recipients and of receiving a response, although age had no effect on the probability of gestures being responded. Overall, our study provides first evidence of gestural production in a Platyrrhine species, and confirms this taxon as a valid candidate for research on animal communication.

Bodies at play: the role of intercorporeality and bodily affordances in coordinating social play in chimpanzees in the wild

The comparative approach is a crucial method to gain a better understanding of the behavior of living human and nonhuman animals to then draw informed inferences about the behavior of extinct ancestors. One focus has been on disentangling the puzzle of language evolution. Traditionally, studies have predominantly focused on intentionally produced signals in communicative interactions. However, in collaborative and highly dynamic interactions such as play, underlying intentionality is difficult to assess and often interactions are negotiated via body movements rather than signals. This "lack" of signals has led to this dynamic context being widely ignored in comparative studies. The aim of this paper is threefold: First, we will show how comparative research into communication can benefit from taking the intentionality-agnostic standpoint used in conversation analysis. Second, we will introduce the concepts of 'intercorporeality' and 'bodily affordance', and show how they can be applied to the analysis of communicative interactions of nonhuman animals. Third, we will use these concepts to investigate how chimpanzees (Pan troglodytes) initiate, end, and maintain 'contact social play'. Our results showed that bodily affordances are able to capture elements of interactions that more traditional approaches failed to describe. Participants made use of bodily affordances to achieve coordinated engagement in contact social play. Additionally, these interactions could display a sequential organization by which one 'move' by a chimpanzee was responded to with an aligning 'move', which allowed for the co-construction of the activity underway. Overall, the present approach innovates on three fronts: First, it allows for the analysis of interactions that are often ignored because they do not fulfil criteria of intentionality, and/or consist of purely body movements. Second, adopting concepts from research on human interaction enables a better comparison of communicative interactions in other animal species without a too narrow focus on intentional signaling only. Third, adopting a stance from interaction research that highlights how practical action can also be communicative, our results show that chimpanzees can communicate through their embodied actions as well as through signaling. With this first step, we hope to inspire new research into dynamic day-to-day interactions involving both "traditional" signals and embodied actions, which, in turn, can provide insights into evolutionary precursors of human language.

Cleaning up the Brickyard: How Theory and Methodology Shape Experiments in Cognitive Neuroscience of Language

The capacity for language is a defining property of our species, yet despite decades of research, evidence on its neural basis is still mixed and a generalized consensus is difficult to achieve. We suggest that this is partly caused by researchers defining "language" in different ways, with focus on a wide range of phenomena, properties, and levels of investigation. Accordingly, there is very little agreement among cognitive neuroscientists of language on the operationalization of fundamental concepts to be investigated in neuroscientific experiments. Here, we review chains of derivation in the cognitive neuroscience of language, focusing on how the hypothesis under consideration is defined by a combination of theoretical and methodological assumptions. We first attempt to disentangle the complex relationship between linguistics, psychology, and neuroscience in the field. Next, we focus on how conclusions that can be drawn from any experiment are inherently constrained by auxiliary assumptions, both theoretical and methodological, on which the validity of conclusions drawn rests. These issues are discussed in the context of classical experimental manipulations as well as study designs that employ novel approaches such as naturalistic stimuli and computational modeling. We conclude by proposing that a highly interdisciplinary field such as the cognitive neuroscience of language requires researchers to form explicit statements concerning the theoretical definitions, methodological choices, and other constraining factors involved in their work.

Overcoming bias in the comparison of human language and animal communication

Human language is a powerful communicative and cognitive tool. Scholars have long sought to characterize its uniqueness, but each time a property is proposed to set human language apart (e.g., reference, syntax), some (attenuated) version of that property is found in animals. Recently, the uniqueness argument has shifted from linguistic rules to cognitive capacities underlying them. Scholars argue that human language is unique because it relies on ostension and inference, while animal communication depends on simple associations and largely hardwired signals. Such characterizations are often borne out in published data, but these empirical findings are driven by radical differences in the ways animal and human communication are studied. The field of animal communication has been dramatically shaped by the "code model," which imagines communication as involving information packets that are encoded, transmitted, decoded, and interpreted. This framework standardized methods for studying meaning in animal signals, but it does not allow for the nuance, ambiguity, or contextual variation seen in humans. The code model is insidious. It is rarely referenced directly, but it significantly shapes how we study animals. To compare animal communication and human language, we must acknowledge biases resulting from the different theoretical models used. By incorporating new approaches that break away from searching for codes, we may find that animal communication and human language are characterized by differences of degree rather than kind.

In vivo mapping of the deep and superficial white matter connectivity in the chimpanzee brain

Mapping the chimpanzee brain connectome and comparing it to that of humans is key to our understanding of similarities and differences in primate evolution that occurred after the split from their common ancestor around 6 million years ago. In contrast to studies on macaque species' brains, fewer studies have specifically addressed the structural connectivity of the chimpanzee brain and its comparison with the human brain. Most comparative studies in the literature focus on the anatomy of the cortex and deep nuclei to evaluate how their morphology and asymmetry differ from that of the human brain, and some studies have emerged concerning the study of brain connectivity among humans, monkeys, and apes. In this work, we established a new white matter atlas of the deep and superficial white matter structural connectivity in chimpanzees. In vivo anatomical and diffusion-weighted magnetic resonance imaging (MRI) data were collected on a 3-Tesla MRI system from 39 chimpanzees. These datasets were subsequently processed using a novel fiber clustering pipeline adapted to the chimpanzee brain, enabling us to create two novel deep and superficial white matter connectivity atlases representative of the chimpanzee brain. These atlases provide the scientific community with an important and novel set of reference data for understanding the commonalities and differences in structural connectivity between the human and chimpanzee brains. We believe this study to be innovative both in its novel approach and in mapping the superficial white matter bundles in the chimpanzee brain, which will contribute to a better understanding of hominin brain evolution.

Object use in communication of semi-wild chimpanzees

Object interactions play an important role in human communication but the extent to which nonhuman primates incorporate objects in their social interactions remains unknown. To better understand the evolution of object use, this study explored how objects are used in social interactions in semi-wild chimpanzees (Pan troglodytes). We used an observational approach focusing on naturally occurring object actions where we examined their use and tested whether the production of object actions was influenced by the recipients' visual attention as well as by colony membership. The results show that chimpanzees adjusted both the type of object used, and the modality of object actions to match the visual attention of the recipient, as well as colony differences in the use of targeted object actions. These results provide empirical evidence highlighting that chimpanzees use objects in diverse ways to communicate with conspecifics and that their use may be shaped by social factors, contributing to our understanding of the evolution of human nonverbal communication, language, and tool use.

Talking About the Absent and the Abstract: Referential Communication in Language and Gesture

Human language permits us to call to mind objects, events, and ideas that we cannot witness directly, either because they are absent or because they have no physical form (e.g., people we have not met, concepts like justice). What enables language to transmit such knowledge? We propose that a referential link between words, referents, and mental representations of those referents is key. This link enables us to form, access, and modify mental representations even when the referents themselves are absent ("absent reference"). In this review we consider the developmental and evolutionary origins of absent reference, integrating previously disparate literatures on absent reference in language and gesture in very young humans and gesture in nonhuman primates. We first evaluate when and how infants acquire absent reference during the process of language acquisition. With this as a foundation, we consider the evidence for absent reference in gesture in infants and in nonhuman primates. Finally, having woven these literatures together, we highlight new lines of research that promise to sharpen our understanding of the development of reference and its role in learning about the absent and the abstract.

AI and the Doctor Dolittle challenge

Talking to animals is a fundamental human desire. The emergence of powerful AI algorithms, and specifically Large Language Models, has driven many to suggest that we are on the verge of fulfilling this wish. A few large scientific consortia have been formed around this topic and several commercial entities even offer such services. We frame the task of communicating with animals as 'The Doctor Dolittle challenge' and identify three main obstacles on the route to doing so. First, although generative AI models can create novel animal communication samples, it is very difficult to determine their context, and we will forever be biased by our human umwelt when doing so. Second, using AI to extract context in an unsupervised manner must be validated through controlled experiments aiming to measure the animals' response. This is difficult, and moreover, AI algorithms tend to cling on to any available information and are thus prone to finding spurious correlations. And third, animal communication focuses on a restricted set of contexts, such as alarm and courtship, highly limiting our ability to communicate regarding other contexts. Nevertheless, using the tremendous power of novel AI methods to decipher and mimic animal communication is both fascinating and important. We thus define the criteria for passing the Doctor Dolittle challenge and call upon scientists to take on the mission.

Group size and mating system predict sex differences in vocal fundamental frequency in anthropoid primates

Vocalizations differ substantially between the sexes in many primates, and low-frequency male vocalizations may be favored by sexual selection because they intimidate rivals and/or attract mates. Sexual dimorphism in fundamental frequency may be more pronounced in species with more intense male mating competition and in those with large group size, where social knowledge is limited and efficient judgment of potential mates and competitors is crucial. These non-mutually exclusive explanations have not been tested simultaneously across primate species. In a sample of vocalizations (n = 1914 recordings) across 37 anthropoid species, we investigated whether fundamental frequency dimorphism evolved in association with increased intensity of mating competition (H1), large group size (H2), multilevel social organization (H3), a trade-off against the intensity of sperm competition (H4), and/or poor acoustic habitats (H5), controlling for phylogeny and body size dimorphism. We show that fundamental frequency dimorphism increased in evolutionary transitions towards larger group size and polygyny. Findings suggest that low-frequency male vocalizations in primates may have been driven by selection to win mating opportunities by avoiding costly fights and may be more important in larger groups, where limited social knowledge affords advantages to rapid assessment of status and threat potential via conspicuous secondary sexual characteristics.

Neuroendocrine mechanisms contributing to the coevolution of sociality and communication

Communication is inherently social, so signaling systems should evolve with social systems. The 'social complexity hypothesis' posits that social complexity necessitates communicative complexity and is generally supported in vocalizing mammals. This hypothesis, however, has seldom been tested outside the acoustic modality, and comparisons across studies are confounded by varying definitions of complexity. Moreover, proximate mechanisms underlying coevolution of sociality and communication remain largely unexamined. In this review, we argue that to uncover how sociality and communication coevolve, we need to examine variation in the neuroendocrine mechanisms that coregulate social behavior and signal production and perception. Specifically, we focus on steroid hormones, monoamines, and nonapeptides, which modulate both social behavior and sensorimotor circuits and are likely targets of selection during social evolution. Lastly, we highlight weakly electric fishes as an ideal system in which to comparatively address the proximate mechanisms underlying relationships between social and signal diversity in a novel modality.

Comparative physiological anthropogeny: exploring molecular underpinnings of distinctly human phenotypes

Anthropogeny is a classic term encompassing transdisciplinary investigations of the origins of the human species. Comparative anthropogeny is a systematic comparison of humans and other living nonhuman hominids (so-called "great apes"), aiming to identify distinctly human features in health and disease, with the overall goal of explaining human origins. We begin with a historical perspective, briefly describing how the field progressed from the earliest evolutionary insights to the current emphasis on in-depth molecular and genomic investigations of "human-specific" biology and an increased appreciation for cultural impacts on human biology. While many such genetic differences between humans and other hominids have been revealed over the last two decades, this information remains insufficient to explain the most distinctive phenotypic traits distinguishing humans from other living hominids. Here we undertake a complementary approach of "comparative physiological anthropogeny," along the lines of the preclinical medical curriculum, i.e., beginning with anatomy and considering each physiological system and in each case considering genetic and molecular components that are relevant. What is ultimately needed is a systematic comparative approach at all levels from molecular to physiological to sociocultural, building networks of related information, drawing inferences, and generating testable hypotheses. The concluding section will touch on distinctive considerations in the study of human evolution, including the importance of gene-culture interactions.

Life of p: A consonant older than speech

Which sounds composed the first spoken languages? Archetypal sounds are not phylogenetically or archeologically recoverable, but comparative linguistics and primatology provide an alternative approach. Labial articulations are the most common speech sound, being virtually universal across the world's languages. Of all labials, the plosive 'p' sound, as in 'Pablo Picasso', transcribed /p/, is the most predominant voiceless sound globally and one of the first sounds to emerge in human infant canonical babbling. Global omnipresence and ontogenetic precocity imply that /p/-like sounds could predate the first major linguistic diversification event(s) in humans. Indeed, great ape vocal data support this view, namely, the only cultural sound shared across all great ape genera is articulatorily homologous to a rolling or trilled /p/, the 'raspberry'. /p/-like labial sounds represent an 'articulatory attractor' among living hominids and are likely among the oldest phonological features to have ever emerged in linguistic systems.

Testing Hypotheses for the Emergence of Gestural Communication in Great and Small Apes (Pan troglodytes, Pongo abelii, Symphalangus syndactylus)

Gestural communication is crucial for primates. However, little is known about how gestural repertoires emerge through development. We conducted behavioural observations on captive apes, including 18 siamangs (Symphalangus syndactylus), 16 Sumatran orangutans (Pongo abelii), and 19 chimpanzees (Pan troglodytes), to test different hypotheses for the emergence of gestures (i.e., Phylogenetic Ritualization, Ontogenetic Ritualization, Social Negotiation, and Social Transmission hypotheses). Our results showed little variation in individual gestural repertories, and only one idiosyncratic gesture. Moreover, across subjects (N = 53), repertoire size did not increase with age and social centrality. When comparing repertoires across all possible combinations of conspecifics, including apes in different groups (N=273) for the four groups of siamangs and the two of orangutans, repertoire similarity was higher in dyads of the same group than of different groups, but it also increased with more observational effort and lower age difference between group members. Finally, when comparing repertoires across all dyads of conspecifics in the same group (N = 260), we found no differences in repertoire similarity depending on dyadic relationship quality. Overall, these results provide support for the Phylogenetic Ritualization hypothesis, according to which individuals are endowed with complete gestural repertories from birth. These repertoires are largely similar across individuals and groups, although they may be partially refined through social experiences.

Turn-taking skills in mammals: A systematic review into development and acquisition

How human language evolved remains one of the most intriguing questions in science, and different approaches have been used to tackle this question. A recent hypothesis, the Interaction Engine Hypothesis, postulates that language was made possible through the special capacity for social interaction involving different social cognitive skills (e.g., joint attention, common ground) and specific characteristics such as face-to-face interaction, mutual gaze and turn-taking, the exchange of rapid communicative turns. Recently, it has been argued that this turn-taking infrastructure may be a foundational and ancient mechanism of the layered system of language because communicative turn-taking has been found in human infants and across several non-human primate species. Moreover, there is some evidence for turn-taking in different mammalian taxa, especially those capable of vocal learning. Surprisingly, however, the existing studies have mainly focused on turn-taking production of adult individuals, while little is known about its emergence and development in young individuals. Hence, the aim of the current paper was 2-fold: First, we carried out a systematic review of turn-taking development and acquisition in mammals to evaluate possible research bias and existing gaps. Second, we highlight research avenues to spur more research into this domain and investigate if distinct turn-taking elements can be found in other non-human animal species. Since mammals exhibit an extended development period, including learning and strong parental care, they represent an excellent model group in which to investigate the acquisition and development of turn-taking abilities. We performed a systematic review including a wide range of terms and found 21 studies presenting findings on turn-taking abilities in infants and juveniles. Most of these studies were from the last decade, showing an increased interest in this field over the years. Overall, we found a considerable variation in the terminologies and methodological approaches used. In addition, studies investigating turn-taking abilities across different development periods and in relation to different social partners were very rare, thereby hampering direct, systematic comparisons within and across species. Nonetheless, the results of some studies suggested that specific turn-taking elements are innate, while others are acquired during development (e.g., flexibility). Finally, we pinpoint fruitful research avenues and hypotheses to move the field of turn-taking development forward and improve our understanding of the impact of turn-taking on language evolution.

Intentional gestural communication amongst red-capped mangabeys (Cercocebus torquatus)

Apes, human's closest living relatives, are renowned for their intentional and highly flexible use of gestural communication. In stark contrast, evidence for flexible and intentional gestural communication in monkeys is scarce. Here, we investigated the intentionality and flexibility of spontaneous gesture use in red-capped mangabeys (Cercocebus torquatus). We applied established methods used in ape gesture research to analyse whether the body acts produced by a total of 17 individuals living in three different groups in captivity qualified as intentionally produced gesture instances. Results showed that signallers showed all hallmarks of intentionality during the production of 20 out of a total of 21 different types of body acts. These were only produced in the presence of other individuals, and the monkeys showed audience checking, sensitivity to the attentional states of recipients, adjustment of signal modality, and response waiting relative to their production. Moreover, in case of communication failure, the monkeys showed goal persistence, and regarding the production contexts they showed some signs of means-ends dissociation. Therefore, these monkeys are capable of flexible and intentional gestural communication and use this to communicate with conspecifics. Our results corroborate recent findings showing that intentional gestural communication was already present in the monkey lineage of catarrhine primates. We discuss our results in light of the comparative approach towards human language evolution and highlight our finding that these monkeys also showed flexible and intentional use of four 'free' manual gesture types.

The social dynamics of complex gestural communication in great and lesser apes (Pan troglodytes, Pongo abelii, Symphalangus syndactylus)

Gestures play an essential role in primate communication. However, little is known about how complexity of gestural use (in terms of repertoire size, intentional use, flexibility and use of gestural sequences) relates to individual and dyadic measures of sociality and whether more complex gestural use is more effective in eliciting a response. We observed 19 captive chimpanzees (Pan troglodytes), 16 Sumatran orangutans (Pongo abelii) and 18 siamangs (Symphalangus syndactylus) to assess the complexity and effectiveness of their gestural use. We found that, beyond interspecies variation, the number of gesture types used in a dyad was higher when individuals had stronger social bonds; the probability of accounting for others' attention increased with age, especially for visual gestures; and sequences were more likely used by younger or socially less integrated individuals. In terms of effectiveness, older individuals and those using fewer sequences were more likely to be responded to, while across dyads, the probability of obtaining a response was higher when both individuals accounted for the other's attention and when they used fewer sequences. Overall, this confirms the link between sociality and complex gestural use and suggests that more complex forms of communication, at least in terms of intentional use, may be more effective at achieving communicative goals. This article is part of the theme issue 'Cognition, communication and social bonds in primates'.

Great ape communication as contextual social inference: a computational modelling perspective

Human communication has been described as a contextual social inference process. Research into great ape communication has been inspired by this view to look for the evolutionary roots of the social, cognitive and interactional processes involved in human communication. This approach has been highly productive, yet it is partly compromised by the widespread focus on how great apes use and understand individual signals. This paper introduces a computational model that formalizes great ape communication as a multi-faceted social inference process that integrates (a) information contained in the signals that make up an utterance, (b) the relationship between communicative partners and (c) the social context. This model makes accurate qualitative and quantitative predictions about real-world communicative interactions between semi-wild-living chimpanzees. When enriched with a pragmatic reasoning process, the model explains repeatedly reported differences between humans and great apes in the interpretation of ambiguous signals (e.g. pointing or iconic gestures). This approach has direct implications for observational and experimental studies of great ape communication and provides a new tool for theorizing about the evolution of uniquely human communication. This article is part of the theme issue 'Revisiting the human 'interaction engine': comparative approaches to social action coordination'.

Evidence for acoustic discrimination in lemurs: a playback study on wild indris (Indri indri)

Indris (Indri indri) are group-living lemurs which occupy stable territories over several years and perform remarkable long-distance vocal displays. Vocal exchanges between long-term territory neighbours may contribute to assessing reciprocal resource holding potentials, thus adaptively reducing the costs of territorial defence by limiting aggressive escalation. Previous work showed that indris' songs show distinctive acoustic features at individual and group level. However, the possibility that indris use such cues for individual or group-level recognition has never been investigated experimentally. We conducted a playback experiment to test whether indris discriminate between familiar and non-familiar songs. Our rationale lies in the hypothesis of the dear enemy phenomenon, which predicts that territorial animals will show reduced aggression levels towards familiar neighbours compared to novel rivals. We played back stimulus recordings to wild indris from their territory boundaries and examined their responses in terms of vocal and behavioural indicators of willingness to engage in a fight. In line with our predictions, focal animals responded more rapidly and approached more often the speaker in response to playback stimuli of non-familiar individuals than to stimuli of neighbouring groups. These results indicate that indris can discriminate between different classes of intruders based on distinctive acoustic features of their song choruses. We suggest that increased aggression directed towards unfamiliar intruders may be explained by higher threat levels associated with dispersal and group formation dynamics. We further discuss the relevance of these findings in a strepsirrhine primate model for comparative studies of vocal communication and sociality.

Broca area homologue's asymmetry reflects gestural communication lateralisation in monkeys (Papio anubis)

Manual gestures and speech recruit a common neural network, involving Broca’s area in the left hemisphere. Such speech-gesture integration gave rise to theories on the critical role of manual gesturing in the origin of language. Within this evolutionary framework, research on gestural communication in our closer primate relatives has received renewed attention for investigating its potential language-like features. Here, using in vivo anatomical MRI in 50 baboons, we found that communicative gesturing is related to Broca homologue’s marker in monkeys, namely the ventral portion of the Inferior Arcuate sulcus (IA sulcus). In fact, both direction and degree of gestural communication’s handedness – but not handedness for object manipulation are associated and correlated with contralateral depth asymmetry at this exact IA sulcus portion. In other words, baboons that prefer to communicate with their right hand have a deeper left-than-right IA sulcus, than those preferring to communicate with their left hand and vice versa. Interestingly, in contrast to handedness for object manipulation, gestural communication’s lateralisation is not associated to the Central sulcus depth asymmetry, suggesting a double dissociation of handedness’ types between manipulative action and gestural communication. It is thus not excluded that this specific gestural lateralisation signature within the baboons’ frontal cortex might reflect a phylogenetical continuity with language-related Broca lateralisation in humans.

Inferential Communication: Bridging the Gap Between Intentional and Ostensive Communication in Non-human Primates

Communication, when defined as an act intended to affect the psychological state of another individual, demands the use of inference. Either the signaler, the recipient, or both must make leaps of understanding which surpass the semantic information available and draw from pragmatic clues to fully imbue and interpret meaning. While research into human communication and the evolution of language has long been comfortable with mentalistic interpretations of communicative exchanges, including rich attributions of mental state, research into animal communication has balked at theoretical models which describe mentalized cognitive mechanisms. We submit a new theoretical perspective on animal communication: the model of inferential communication. For use when existing proximate models of animal communication are not sufficient to fully explain the complex, flexible, and intentional communication documented in certain species, specifically non-human primates, we present our model as a bridge between shallower, less cognitive descriptions of communicative behavior and the perhaps otherwise inaccessible mentalistic interpretations of communication found in theoretical considerations of human language. Inferential communication is a framework that builds on existing evidence of referentiality, intentionality, and social inference in primates. It allows that they might be capable of applying social inferences to a communicative setting, which could explain some of the cognitive processes that enable the complexity and flexibility of primate communication systems. While historical models of animal communication focus on the means-ends process of behavior and apparent cognitive outcomes, inferential communication invites consideration of the mentalistic processes that must underlie those outcomes. We propose a mentalized approach to questions, investigations, and interpretations of non-human primate communication. We include an overview of both ultimate and proximate models of animal communication, which contextualize the role and utility of our inferential communication model, and provide a detailed breakdown of the possible levels of cognitive complexity which could be investigated using this framework. Finally, we present some possible applications of inferential communication in the field of non-human primate communication and highlight the role it could play in advancing progress toward an increasingly precise understanding of the cognitive capabilities of our closest living relatives.

Sensitivity to the communicative partner's attentional state: A developmental study on mother-infant dyads in wild chimpanzees (Pan troglodytes schweinfurthii)

Gestural communication permeates all domains of chimpanzees' social life and is intentional in use. However, we still have only limited information on how young apes develop the sociocognitive skills needed for intentional communication. In this cross-sectional study, we document the development of behavioral adjustment to the recipient's visual attention-considered a hallmark of intentional communication-in wild immature chimpanzees' gestural communication. We studied 11 immature chimpanzees (Pan troglodytes schweinfurthii): three infants, four juveniles, and four adolescents gesturing towards their mother. We quantified silent-visual, audible, and contact gestures indexed to maternal visual attention and inattention. We investigated unimodal adjustment, defined by the capacity of young chimpanzees to deploy fewer silent-visual signals when their mothers did not show full visual attention towards them as compared with when they did. We then examined cross-modal adjustment, defined as the capacity of chimpanzees to deploy more audible-or-contact gestures than silent-visual gestures in the condition where their mothers did not show full visual attention as compared to when they did. Our results show a gradual decline in the use of silent-visual gestures when the mother is not visually attentive with increasing age. The absence of silent-visual gesture production toward a visually inattentive recipient (complete unimodal adjustment) was not fully in place until adolescence. Immature chimpanzees used more audible-or-contact gestures than silent-visual ones when their mothers did not show visual attention and vice-versa when they did. This cross-modal adjustment was expressed in juveniles and adolescents but not in infants. Overall, this study shows that infant chimpanzees were limited in their sensitivity to maternal attention when gesturing, whereas adolescent chimpanzees adjusted their communication appropriately. Juveniles present an intermediate pattern with cross-modal adjustment preceding unimodal adjustment and with variability in the age of onset.

The origin of language and relative roles of voice and gesture in early communication development

Both vocalization and gesture are universal modes of communication and fundamental features of language development. The gestural origins theory proposes that language evolved out of early gestural use. However, evidence reported here suggests vocalization is much more prominent in early human communication than gesture is. To our knowledge no prior research has investigated the rates of emergence of both gesture and vocalization across the first year in human infants. We evaluated the rates of gestures and speech-like vocalizations (protophones) in 10 infants at 4, 7, and 11 months of age using parent-infant laboratory recordings. We found that infant protophones outnumbered gestures substantially at all three ages, ranging from >35 times more protophones than gestures at 3 months, to >2.5 times more protophones than gestures at 11 months. The results suggest vocalization, not gesture, is the predominant mode of communication in human infants in the first year.

Operationalizing Intentionality in Primate Communication: Social and Ecological Considerations

An intentional transfer of information is central to human communication. When comparing nonhuman primate communication systems to language, a critical challenge is to determine whether a signal is used in intentional, goal-oriented ways. As it is not possible to directly observe psychological states in any species, comparative researchers have inferred intentionality via behavioral markers derived from studies on prelinguistic human children. Recent efforts to increase consistency in nonhuman primate communication studies undervalue the effect of possible sources of bias: some behavioral markers are not generalizable across certain signal types (gestures, vocalizations, and facial expressions), contexts, settings, and species. Despite laudable attempts to operationalize first-order intentionality across signal types, a true “multimodal” approach requires integration across their sensory components (visual-silent, contact, audible), as a signal from a certain type can comprise more than one sensory component. Here we discuss how the study of intentional communication in nonlinguistic systems is hampered by issues of reliability, validity, consistency, and generalizability. We then highlight future research avenues that may help to understand the use of goal-oriented communication by opting, whenever possible, for reliable, valid, and consistent behavioral markers, but also taking into account sampling biases and integrating detailed observations of intraspecific communicative interactions.

Manual Gestures Modulate Early Neural Responses in Loudness Perception

How different sensory modalities interact to shape perception is a fundamental question in cognitive neuroscience. Previous studies in audiovisual interaction have focused on abstract levels such as categorical representation (e.g., McGurk effect). It is unclear whether the cross-modal modulation can extend to low-level perceptual attributes. This study used motional manual gestures to test whether and how the loudness perception can be modulated by visual-motion information. Specifically, we implemented a novel paradigm in which participants compared the loudness of two consecutive sounds whose intensity changes around the just noticeable difference (JND), with manual gestures concurrently presented with the second sound. In two behavioral experiments and two EEG experiments, we investigated our hypothesis that the visual-motor information in gestures would modulate loudness perception. Behavioral results showed that the gestural information biased the judgment of loudness. More importantly, the EEG results demonstrated that early auditory responses around 100 ms after sound onset (N100) were modulated by the gestures. These consistent results in four behavioral and EEG experiments suggest that visual-motor processing can integrate with auditory processing at an early perceptual stage to shape the perception of a low-level perceptual attribute such as loudness, at least under challenging listening conditions.

More than words: word predictability, prosody, gesture and mouth movements in natural language comprehension

The ecology of human language is face-to-face interaction, comprising cues such as prosody, co-speech gestures and mouth movements. Yet, the multimodal context is usually stripped away in experiments as dominant paradigms focus on linguistic processing only. In two studies we presented video-clips of an actress producing naturalistic passages to participants while recording their electroencephalogram. We quantified multimodal cues (prosody, gestures, mouth movements) and measured their effect on a well-established electroencephalographic marker of processing load in comprehension (N400). We found that brain responses to words were affected by informativeness of co-occurring multimodal cues, indicating that comprehension relies on linguistic and non-linguistic cues. Moreover, they were affected by interactions between the multimodal cues, indicating that the impact of each cue dynamically changes based on the informativeness of other cues. Thus, results show that multimodal cues are integral to comprehension, hence, our theories must move beyond the limited focus on speech and linguistic processing.

Hunters and Gatherers of Pictures: Why Photography Has Become a Human Universal

Photography is ubiquitous worldwide. We analyzed why people take, share, and use personal photographs, independent of their specific cultural background. These behaviors are still poorly understood. Experimental research on them is scarce. Smartphone technology and social media have pushed the success of photography, but cannot explain it, as not all smartphone features are widely used just because they are available. We analyzed properties of human nature that have made taking and using photographs functional behaviors. We did this based on the four levels, which Nikolaas Tinbergen suggested for analyzing why animals behave in a particular way. Including findings from multiple disciplines, we developed a novel conceptual framework-the "Mental Utilization Hypothesis of Photography." It suggests that people adopt photography because it matches with core human mental mechanisms mainly from the social domain, and people use photography as a cognitive, primarily social coping strategy. Our framework comprises a range of testable predictions, provides a new theoretical basis for future empirical investigations into photography, and has practical implications. We conclude that photography has become a human universal, which is based on context-sensitive mental predispositions and differentiates itself in the social and societal environment.

Altered Food Habits? Understanding the Feeding Preference of Free-Ranging Gray Langurs Within an Urban Settlement

Urbanization affects concurrent human-animal interactions as a result of altered resource availability and land use pattern, which leads to considerable ecological consequences. While some animals have lost their habitat due to urban encroachment, few of them managed to survive within the urban ecosystem by altering their natural behavioral patterns. The feeding repertoire of folivorous colobines, such as gray langur, largely consists of plant parts. However, these free-ranging langurs tend to be attuned to the processed high-calorie food sources to attain maximum benefits within the concrete jungle having insignificant greenery. Therefore, besides understanding their population dynamics, the effective management of these urbanized, free-ranging, non-human primate populations also depends on their altered feeding habits. Here, we have used a field-based experimental setup that allows gray langurs to choose between processed and unprocessed food options, being independent of any inter-specific conflicts over resources due to food scarcity. The multinomial logit model reveals the choice-based decision-making of these free-ranging gray langurs in an urban settlement of West Bengal, India, where they have not only learned to recognize the human-provisioned processed food items as an alternative food source but also shown a keen interest in it. However, such a mismatch between the generalized feeding behavior of folivorous colobines and their specialized gut physiology reminds us of Liem's paradox and demands considerable scientific attention. While urbanization imposes tremendous survival challenges to these animals, it also opens up for various alternative options for surviving in close proximity to humans which is reflected in this study, and could guide us for the establishment of a sustainable urban ecosystem in the future.

Novel vocalizations are understood across cultures

Linguistic communication requires speakers to mutually agree on the meanings of words, but how does such a system first get off the ground? One solution is to rely on iconic gestures: visual signs whose form directly resembles or otherwise cues their meaning without any previously established correspondence. However, it is debated whether vocalizations could have played a similar role. We report the first extensive cross-cultural study investigating whether people from diverse linguistic backgrounds can understand novel vocalizations for a range of meanings. In two comprehension experiments, we tested whether vocalizations produced by English speakers could be understood by listeners from 28 languages from 12 language families. Listeners from each language were more accurate than chance at guessing the intended referent of the vocalizations for each of the meanings tested. Our findings challenge the often-cited idea that vocalizations have limited potential for iconic representation, demonstrating that in the absence of words people can use vocalizations to communicate a variety of meanings.

The performance of domestic dogs (Canis lupus familiaris) on two versions of the object choice task

Object choice task (OCT) studies are widely used to assess the phylogenetic and ontogenetic distribution of the understanding of communicative cues, with this understanding serving as a proxy for the discernment of communicative intentions. Recent reviews have found systematic procedural and methodological differences in studies which compare performances across species on the OCT. One such difference concerns the spatial configuration of the test set-up, specifically the distances between the two containers (inter-object distance) and the subject-experimenter distance. Here, we tested dogs on two versions of the task: a central version in which the containers were in the subjects' direct line of vision, and a peripheral version in which the position of the containers was distal to the subject. Half of the subjects were tested with a barrier in the testing environment (as nonhuman primates are tested) and the other half without. We found that dogs tested with a barrier performed significantly better in the central version and were more likely to fail to make a choice in the peripheral version. Dogs tested without a barrier showed comparable performance on the two versions. We thus failed to find support for the distraction hypothesis in dogs. We discuss potential explanations for this, highlighting how methodological differences in the presentation of the OCT can influence outcomes in studies using this paradigm.

The Cognitive Philosophy of Communication

Numerous species use different forms of communication in order to successfully interact in their respective environment. This article seeks to elucidate limitations of the classical conduit metaphor by investigating communication from the perspectives of biology and artificial neural networks. First, communication is a biological natural phenomenon, found to be fruitfully grounded in an organism’s embodied structures and memory system, where specific abilities are tied to procedural, semantic, and episodic long-term memory as well as to working memory. Second, the account explicates differences between non-verbal and verbal communication and shows how artificial neural networks can communicate by means of ontologically non-committal modelling. This approach enables new perspectives of communication to emerge regarding both sender and receiver. It is further shown that communication features gradient properties that are plausibly divided into a reflexive and a reflective form, parallel to knowledge and reflection.

The engaging nature of interactive gestures

The social interactions that we experience from early infancy often involve actions that are not strictly instrumental but engage the recipient by eliciting a (complementary) response. Interactive gestures may have privileged access to our perceptual and motor systems either because of their intrinsically engaging nature or as a result of extensive social learning. We compared these two hypotheses in a series of behavioral experiments by presenting individuals with interactive gestures that call for motor responses to complement the interaction ('hand shaking', 'requesting', 'high-five') and with communicative gestures that are equally socially relevant and salient, but do not strictly require a response from the recipient ('Ok', 'Thumbs up', 'Peace'). By means of a spatial compatibility task, we measured the interfering power of these task-irrelevant stimuli on the behavioral responses of individuals asked to respond to a target. Across three experiments, our results showed that the interactive gestures impact on response selection and reduce spatial compatibility effects as compared to the communicative (non-interactive) gestures. Importantly, this effect was independent of the activation of specific social scripts that may interfere with response selection. Overall, our results show that interactive gestures have privileged access to our perceptual and motor systems, possibly because they entail an automatic preparation to respond that involuntary engages the motor system of the observers. We discuss the implications from a developmental and neurophysiological point of view.

Must all signals be evolved? A proposal for a new classification of communicative acts

While signals in evolutionary biology are usually defined as "acts or traits that have evolved because of their effect on others", work on gestures and vocalizations in various animal taxa have revealed population- or even individual-specific meanings of social signals. These results strongly suggest that communicative acts that are like signals with regard to both form and function (meaning) can also be acquired ontogenetically, and we discuss direct evidence for such plasticity in captive settings with rich opportunities for repeated social interactions with the same individuals. Therefore, in addition to evolved signals, we can recognize invented signals that are acquired during ontogeny (either through ontogenetic ritualization or social transmission). Thus, both gestures and vocalizations can be inventions or innate adaptations. We therefore propose to introduce innate versus invented signals as major distinct categories, with invented signals subdivided into dyad-specific and cultural signals. We suggest that elements of some signals may have mixed origins, and propose criteria to recognize acquired features of signals. We also suggest that invented signals may be most common in species with intentional communication, consistent with their ubiquity in humans, and that the ability to produce them was a necessary condition for the evolution of language. This article is categorized under: Cognitive Biology > Evolutionary Roots of Cognition Linguistics > Evolution of Language Psychology > Comparative Psychology.

Linguistic laws in chimpanzee gestural communication

Studies testing linguistic laws outside language have provided important insights into the organization of biological systems. For example, patterns consistent with Zipf's law of abbreviation (which predicts a negative relationship between word length and frequency of use) have been found in the vocal and non-vocal behaviour of a range of animals, and patterns consistent with Menzerath's law (according to which longer sequences are made up of shorter constituents) have been found in primate vocal sequences, and in genes, proteins and genomes. Both laws have been linked to compression-the information theoretic principle of minimizing code length. Here, we present the first test of these laws in animal gestural communication. We initially did not find the negative relationship between gesture duration and frequency of use predicted by Zipf's law of abbreviation, but this relationship was seen in specific subsets of the repertoire. Furthermore, a pattern opposite to that predicted was seen in one subset of gestures-whole body signals. We found a negative correlation between number and mean duration of gestures in sequences, in line with Menzerath's law. These results provide the first evidence that compression underpins animal gestural communication, and highlight an important commonality between primate gesturing and language.

Multimodality and the origin of a novel communication system in face-to-face interaction

Face-to-face communication is multimodal at its core: it consists of a combination of vocal and visual signalling. However, current evidence suggests that, in the absence of an established communication system, visual signalling, especially in the form of visible gesture, is a more powerful form of communication than vocalization and therefore likely to have played a primary role in the emergence of human language. This argument is based on experimental evidence of how vocal and visual modalities (i.e. gesture) are employed to communicate about familiar concepts when participants cannot use their existing languages. To investigate this further, we introduce an experiment where pairs of participants performed a referential communication task in which they described unfamiliar stimuli in order to reduce reliance on conventional signals. Visual and auditory stimuli were described in three conditions: using visible gestures only, using non-linguistic vocalizations only and given the option to use both (multimodal communication). The results suggest that even in the absence of conventional signals, gesture is a more powerful mode of communication compared with vocalization, but that there are also advantages to multimodality compared to using gesture alone. Participants with an option to produce multimodal signals had comparable accuracy to those using only gesture, but gained an efficiency advantage. The analysis of the interactions between participants showed that interactants developed novel communication systems for unfamiliar stimuli by deploying different modalities flexibly to suit their needs and by taking advantage of multimodality when required.

Which way to the dawn of speech?: Reanalyzing half a century of debates and data in light of speech science

Recent articles on primate articulatory abilities are revolutionary regarding speech emergence, a crucial aspect of language evolution, by revealing a human-like system of proto-vowels in nonhuman primates and implicitly throughout our hominid ancestry. This article presents both a schematic history and the state of the art in primate vocalization research and its importance for speech emergence. Recent speech research advances allow more incisive comparison of phylogeny and ontogeny and also an illuminating reinterpretation of vintage primate vocalization data. This review produces three major findings. First, even among primates, laryngeal descent is not uniquely human. Second, laryngeal descent is not required to produce contrasting formant patterns in vocalizations. Third, living nonhuman primates produce vocalizations with contrasting formant patterns. Thus, evidence now overwhelmingly refutes the long-standing laryngeal descent theory, which pushes back "the dawn of speech" beyond ~200 ka ago to over ~20 Ma ago, a difference of two orders of magnitude.

Social and ecological complexity is associated with gestural repertoire size of wild chimpanzees

Increasing our understanding of primate gestural communication can provide new insights into language evolution. A key question in primate communication is the association between the social relationships of primates and their repertoire of gestures. Such analyses can reveal how primates use their repertoire of gestural communication to maintain their networks of family and friends, much as humans use language to maintain their social networks. In this study we examined the association between the repertoire of gestures (overall, manual and bodily gestures, and gestures of different modalities) and social bonds (presence of reciprocated grooming), coordinated behaviors (travel, resting, co‐feeding), and the complexity of ecology (e.g. noise, illumination) and sociality (party size, audience), in wild East African chimpanzees (Pan troglodytes schweinfurthii). A larger repertoire size of manual, visual gestures was associated with the presence of a relationship based on reciprocated grooming and increases in social complexity. A smaller repertoire of manual tactile gestures occurred when the relationship was based on reciprocated grooming. A smaller repertoire of bodily gestures occurred between partners who jointly traveled for longer. Whereas gesture repertoire size was associated with social complexity, complex ecology also influenced repertoire size. The evolution of a large repertoire of manual, visual gestures may have been a key factor that enabled larger social groups to emerge during evolution. Thus, the evolution of the larger brains in hominins may have co‐occurred with an increase in the cognitive complexity underpinning gestural communication and this, in turn, may have enabled hominins to live in more complex social groups.

Becoming human: human infants link language and cognition, but what about the other great apes?

Human language has no parallel elsewhere in the animal kingdom. It is unique not only for its structural complexity but also for its inextricable interface with core cognitive capacities such as object representation, object categorization and abstract rule learning. Here, we (i) review recent evidence documenting how (and how early) language interacts with these core cognitive capacities in the mind of the human infant, and (ii) consider whether this link exists in non-human great apes-our closest genealogical cousins. Research with human infants demonstrates that well before they begin to speak, infants have already forged a link between language and core cognitive capacities. Evident by just three months of age, this language-cognition link unfolds in a rich developmental cascade, with each advance providing the foundation for subsequent, more precise and more powerful links. This link supports our species' capacity to represent and convey abstract concepts and to communicate beyond the immediate here and now. By contrast, although the communication systems of great apes are sophisticated in their own right, there is no conclusive evidence that apes establish reference, convey information declaratively or pass down communicative devices via cultural transmission. Thus, the evidence currently available reinforces the uniqueness of human language and the power of its interface to cognition. This article is part of the theme issue 'What can animal communication teach us about human language?'

Coevolution of language and symbolic meaning: Co-opting meaning underlying the initial arts in early human culture

Many of language's components, including communicating symbolic meaning, have neurobiological roots that go back millions of years in evolutionary time. The intersection with the human social survival strategy spawned additional adaptive meaning systems. Under conditions threatening survival in socially oriented human groups, extra-language meaning systems co-opted and adapted to facilitate unity, including the early formats of the arts. They would have percolated into cultural practice for this social purpose and ultimately survival. With evolutionary pressures tapping into biologically inherited, physiologically functioning sensory-motor pathways, anchored specifically in rhythm cognition and motor synchrony output, initial art practice conveyed symbolic group cohesion through communal, all-inclusive synchronously moving dance formations and rhythmically produced vocal or percussion sounds. As with the sounds of language in the deep past, and numerous other cultural behaviors, such nonmaterial early art formats would not have left marks in the archeological record but their evolutionary driven practice would have contributed to adaptive genetic factors woven into brain-behavior evolution. Their practice is likely to have well predated unearthed art-related objects. Consolidation of evidence and notions from language evolution, genetics, human physiology, comparative animal communication, archeology, and climate history in the distant past of early humans in Africa supports the evolutionary driven practice of initial nonmaterial art formats conveying symbolic expressions optimizing group survival. This article is categorized under: Cognitive Biology > Evolutionary Roots of Cognition Linguistics > Evolution of Language Psychology > Comparative Psychology.

Gestural communication of wild bonnet macaques in the Bandipur National Park, Southern India

Nonhuman primate gestures are believed to be crucial evolutionary precursors of human language. Comparative studies on primate gestures in an evolutionary framework have, however, remained largely restricted to the great apes and the potential flexibility and richness of gestural communication in monkeys, especially in the wild, continue to be virtually unknown. In this paper, we followed several criteria, adapted from ape gesture studies, to identify gestures and evaluate their contexts of usage in the repertoire of wild bonnet macaques Macaca radiata in the Bandipur National Park of southern India. This report is the first of its kind to systematically identify gestures in any wild, non-ape species, thus providing a platform for comparative studies across primate taxa, particularly in our efforts to trace out the phylogenetic origins of language-like markers in the primate lineage, earlier than in the great apes.

Multimodal communication and language origins: integrating gestures and vocalizations

The presence of divergent and independent research traditions in the gestural and vocal domains of primate communication has resulted in major discrepancies in the definition and operationalization of cognitive concepts. However, in recent years, accumulating evidence from behavioural and neurobiological research has shown that both human and non-human primate communication is inherently multimodal. It is therefore timely to integrate the study of gestural and vocal communication. Herein, we review evidence demonstrating that there is no clear difference between primate gestures and vocalizations in the extent to which they show evidence for the presence of key language properties: intentionality, reference, iconicity and turn-taking. We also find high overlap in the neurobiological mechanisms producing primate gestures and vocalizations, as well as in ontogenetic flexibility. These findings confirm that human language had multimodal origins. Nonetheless, we note that in great apes, gestures seem to fulfil a carrying (i.e. predominantly informative) role in close-range communication, whereas the opposite holds for face-to-face interactions of humans. This suggests an evolutionary shift in the carrying role from the gestural to the vocal stream, and we explore this transition in the carrying modality. Finally, we suggest that future studies should focus on the links between complex communication, sociality and cooperative tendency to strengthen the study of language origins.

Reliability of Listener Judgments of Infant Vocal Imitation

There are many theories surrounding infant imitation; however, there is no research to our knowledge evaluating the reliability of listener perception of vocal imitation in prelinguistic infants. This paper evaluates intra- and inter-rater judgments on the degree of "imitativeness" in utterances of infants below 12 months of age. 18 listeners were presented audio segments selected from naturalistic recordings to represent in each case a parent vocal model followed by an infant utterance ranging from low to high degrees of imitativeness. The naturalistic data suggested vocal imitation occurred rarely across the first year, but strong intra- and inter-rater correlations were found for judgments of imitativeness. Our results suggest salience of the infant's vocal imitation despite its rare occurrence as well as active perception by listeners of the imitative signal. We discuss infant vocal imitation as a potential signal of well-being as perceived by caregivers.