The origins of gestures and language: history, current advances and proposed theories

Gestural communication in wild spider monkeys (Ateles geoffroyi)

Gestures play a central role in the communication systems of several animal families, including primates. In this study, we provide a first assessment of the gestural systems of a Platyrrhine species, Geoffroy's spider monkeys (Ateles geoffroyi). We observed a wild group of 52 spider monkeys and assessed the distribution of visual and tactile gestures in the group, the size of individual repertoires and the intentionality and effectiveness of individuals' gestural production. Our results showed that younger spider monkeys were more likely than older ones to use tactile gestures. In contrast, we found no inter-individual differences in the probability of producing visual gestures. Repertoire size did not vary with age, but the probability of accounting for recipients' attentional state was higher for older monkeys than for younger ones, especially for gestures in the visual modality. Using vocalizations right before the gesture increased the probability of gesturing towards attentive recipients and of receiving a response, although age had no effect on the probability of gestures being responded. Overall, our study provides first evidence of gestural production in a Platyrrhine species, and confirms this taxon as a valid candidate for research on animal communication.

Lost in translation: the importance of addressing language inequities in global health security

Language inequities in global health stem from colonial legacies, and global health security is no exception. The International Health Regulations (IHRs), a legally binding framework published by the WHO, lay the foundation for global health security and state the roles and responsibilities States Parties are compelled to follow to improve their capabilities to prevent, detect and respond to potential public health emergencies of international concern. It includes the submission of a mandatory status report that assesses a nation's implementation of IHRs. Known as the States Party Self-Assessment Annual Report (SPAR) tool, WHO has made its guidance document available in all six WHO official languages (Arabic, Chinese, English, French, Russian and Spanish). The Republic of Iraq (Iraq) experienced significant challenges during the completion and submission of the 2022 SPAR. This experience demonstrated that translation of English materials to other languages, such as Arabic, is not prioritised and further underscored how scoring of a country's global health security capacities can be significantly impacted by users' ability to read and comprehend the materials in English. Not only can this lead to inaccurate SPAR scoring, but it can also lead to the improper allocation of resources and prioritisation of policy developments and/or amendments. By drawing attention to this issue, we aim to inform and advocate for global health security decision-makers to consider opportunities for increasing inclusion and accessibility, especially for requirements under legally binding international instruments.

Gesture, spatial cognition and the evolution of language

Human communication displays a striking contrast between the diversity of languages and the universality of the principles underlying their use in conversation. Despite the importance of this interactional base, it is not obvious that it heavily imprints the structure of languages. However, a deep-time perspective suggests that early hominin communication was gestural, in line with all the other Hominidae. This gestural phase of early language development seems to have left its traces in the way in which spatial concepts, implemented in the hippocampus, provide organizing principles at the heart of grammar. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Testing Hypotheses for the Emergence of Gestural Communication in Great and Small Apes (Pan troglodytes, Pongo abelii, Symphalangus syndactylus)

Gestural communication is crucial for primates. However, little is known about how gestural repertoires emerge through development. We conducted behavioural observations on captive apes, including 18 siamangs (Symphalangus syndactylus), 16 Sumatran orangutans (Pongo abelii), and 19 chimpanzees (Pan troglodytes), to test different hypotheses for the emergence of gestures (i.e., Phylogenetic Ritualization, Ontogenetic Ritualization, Social Negotiation, and Social Transmission hypotheses). Our results showed little variation in individual gestural repertories, and only one idiosyncratic gesture. Moreover, across subjects (N = 53), repertoire size did not increase with age and social centrality. When comparing repertoires across all possible combinations of conspecifics, including apes in different groups (N=273) for the four groups of siamangs and the two of orangutans, repertoire similarity was higher in dyads of the same group than of different groups, but it also increased with more observational effort and lower age difference between group members. Finally, when comparing repertoires across all dyads of conspecifics in the same group (N = 260), we found no differences in repertoire similarity depending on dyadic relationship quality. Overall, these results provide support for the Phylogenetic Ritualization hypothesis, according to which individuals are endowed with complete gestural repertories from birth. These repertoires are largely similar across individuals and groups, although they may be partially refined through social experiences.

Turn-taking skills in mammals: A systematic review into development and acquisition

How human language evolved remains one of the most intriguing questions in science, and different approaches have been used to tackle this question. A recent hypothesis, the Interaction Engine Hypothesis, postulates that language was made possible through the special capacity for social interaction involving different social cognitive skills (e.g., joint attention, common ground) and specific characteristics such as face-to-face interaction, mutual gaze and turn-taking, the exchange of rapid communicative turns. Recently, it has been argued that this turn-taking infrastructure may be a foundational and ancient mechanism of the layered system of language because communicative turn-taking has been found in human infants and across several non-human primate species. Moreover, there is some evidence for turn-taking in different mammalian taxa, especially those capable of vocal learning. Surprisingly, however, the existing studies have mainly focused on turn-taking production of adult individuals, while little is known about its emergence and development in young individuals. Hence, the aim of the current paper was 2-fold: First, we carried out a systematic review of turn-taking development and acquisition in mammals to evaluate possible research bias and existing gaps. Second, we highlight research avenues to spur more research into this domain and investigate if distinct turn-taking elements can be found in other non-human animal species. Since mammals exhibit an extended development period, including learning and strong parental care, they represent an excellent model group in which to investigate the acquisition and development of turn-taking abilities. We performed a systematic review including a wide range of terms and found 21 studies presenting findings on turn-taking abilities in infants and juveniles. Most of these studies were from the last decade, showing an increased interest in this field over the years. Overall, we found a considerable variation in the terminologies and methodological approaches used. In addition, studies investigating turn-taking abilities across different development periods and in relation to different social partners were very rare, thereby hampering direct, systematic comparisons within and across species. Nonetheless, the results of some studies suggested that specific turn-taking elements are innate, while others are acquired during development (e.g., flexibility). Finally, we pinpoint fruitful research avenues and hypotheses to move the field of turn-taking development forward and improve our understanding of the impact of turn-taking on language evolution.

The social dynamics of complex gestural communication in great and lesser apes (Pan troglodytes, Pongo abelii, Symphalangus syndactylus)

Gestures play an essential role in primate communication. However, little is known about how complexity of gestural use (in terms of repertoire size, intentional use, flexibility and use of gestural sequences) relates to individual and dyadic measures of sociality and whether more complex gestural use is more effective in eliciting a response. We observed 19 captive chimpanzees (Pan troglodytes), 16 Sumatran orangutans (Pongo abelii) and 18 siamangs (Symphalangus syndactylus) to assess the complexity and effectiveness of their gestural use. We found that, beyond interspecies variation, the number of gesture types used in a dyad was higher when individuals had stronger social bonds; the probability of accounting for others' attention increased with age, especially for visual gestures; and sequences were more likely used by younger or socially less integrated individuals. In terms of effectiveness, older individuals and those using fewer sequences were more likely to be responded to, while across dyads, the probability of obtaining a response was higher when both individuals accounted for the other's attention and when they used fewer sequences. Overall, this confirms the link between sociality and complex gestural use and suggests that more complex forms of communication, at least in terms of intentional use, may be more effective at achieving communicative goals. This article is part of the theme issue 'Cognition, communication and social bonds in primates'.

Visual bodily signals as core devices for coordinating minds in interaction

The view put forward here is that visual bodily signals play a core role in human communication and the coordination of minds. Critically, this role goes far beyond referential and propositional meaning. The human communication system that we consider to be the explanandum in the evolution of language thus is not spoken language. It is, instead, a deeply multimodal, multilayered, multifunctional system that developed-and survived-owing to the extraordinary flexibility and adaptability that it endows us with. Beyond their undisputed iconic power, visual bodily signals (manual and head gestures, facial expressions, gaze, torso movements) fundamentally contribute to key pragmatic processes in modern human communication. This contribution becomes particularly evident with a focus that includes non-iconic manual signals, non-manual signals and signal combinations. Such a focus also needs to consider meaning encoded not just via iconic mappings, since kinematic modulations and interaction-bound meaning are additional properties equipping the body with striking pragmatic capacities. Some of these capacities, or its precursors, may have already been present in the last common ancestor we share with the great apes and may qualify as early versions of the components constituting the hypothesized interaction engine. This article is part of the theme issue 'Revisiting the human 'interaction engine': comparative approaches to social action coordination'.

Birdsong and the Neural Regulation of Positive Emotion

Birds are not commonly admired for emotional expression, and when they are, the focus is typically on negative states; yet vocal behavior is considered a direct reflection of an individual's emotional state. Given that over 4000 species of songbird produce learned, complex, context-specific vocalizations, we make the case that songbirds are conspicuously broadcasting distinct positive emotional states and that hearing songs can also induce positive states in other birds. Studies are reviewed that demonstrate that that the production of sexually motivated song reflects an emotional state of anticipatory reward-seeking (i.e., mate-seeking), while outside the mating context song in gregarious flocks reflects a state of intrinsic reward. Studies are also reviewed that demonstrate that hearing song induces states of positive anticipation and reward. This review brings together numerous studies that highlight a potentially important role for the songbird nucleus accumbens, a region nearly synonymous with reward in mammals, in positive emotional states that underlie singing behavior and responses to song. It is proposed that the nucleus accumbens is part of an evolutionarily conserved circuitry that contributes context-dependently to positive emotional states that motivate and reward singing behavior and responses to song. Neural mechanisms that underlie basic emotions appear to be conserved and similar across vertebrates. Thus, these findings in songbirds have the potential to provide insights into interventions that can restore positive social interactions disrupted by mental health disorders in humans.

The face never lies: facial expressions and mimicry modulate playful interactions in wild geladas

Abstract

Play fighting, the most common form of social play in mammals, is a fertile field to investigate the use of visual signals in animals’ communication systems. Visual signals can be exclusively emitted during play (e.g. play faces, PF, context-dependent signals), or they can be released under several behavioural domains (e.g. lip-smacking, LS, context-independent signals). Rapid facial mimicry (RFM) is the involuntary rapid facial congruent response produced after perceiving others’ facial expressions. RFM leads to behavioural and emotional synchronisation that often translates into the most balanced and longest playful interactions. Here, we investigate the role of playful communicative signals in geladas (Theropithecus gelada). We analysed the role of PF and LS produced by wild immature geladas during play fighting. We found that PFs, but not LS, were particularly frequent during the riskiest interactions such as those including individuals from different groups. Furthermore, we found that RFM (PF→PF) was highest when playful offensive patterns were not biased towards one of the players and when the session was punctuated by LS. Under this perspective, the presence of context-independent signals such as LS may be useful in creating an affiliative mood that enhances communication and facilitates most cooperative interactions. Indeed, we found that sessions punctuated by the highest frequency of RFM and LS were also the longest ones. Whether the complementary use of PF and LS is strategically guided by the audience or is the result of the emotional arousal experienced by players remains to be investigated.

Significance Statement

Facial expressions and their rapid replication by an observer are fundamental communicative tools during social contacts in human and non-human animals. Play fighting is one of the most complex forms of social interactions that can easily lead to misunderstanding if not modulated through an accurate use of social signals. Wild immature geladas are able to manage their play sessions thus limiting the risk of aggressive escalation. While playing with unfamiliar subjects belonging to other groups, they make use of a high number of play faces. Moreover, geladas frequently replicate others’ play faces and emit facial expressions of positive intent (i.e. lip-smacking) when engaging in well-balanced long play sessions. In this perspective, this “playful facial chattering” creates an affiliative mood that enhances communication and facilitates most cooperative interactions.

Context-Dependent Gestural Laterality: A Multifactorial Analysis in Captive Red-Capped Mangabeys

Catarrhine primates gesture preferentially with their right hands, which led to the hypothesis of a gestural origin of human left-hemispheric specialization for language. However, the factors influencing this gestural laterality remain understudied in non-hominoid species, particularly in intraspecific contexts, although it may bring valuable insights into the proximate and ultimate causes of language lateralization. We present here a preliminary investigation of intraspecific gestural laterality in catarrhine monkeys, red-capped mangabeys (Cercocebus torquatus). We described the spontaneous production of brachio-manual intentional gestures in twenty-five captive subjects. Although we did not evidence any significant gestural lateralization neither at the individual- nor population-level, we found that mangabeys preferentially use their right hands to gesture in negative social contexts, such as aggressions, suggesting an effect of emotional lateralization, and that they adapt to the position of their receiver by preferentially using their ipsilateral hand to communicate. These results corroborate previous findings from ape studies. By contrast, factors related to gesture form and socio-demographic characteristics of signaler and receiver did not affect gestural laterality. To understand better the relationships between gestural laterality and brain lateralization from an evolutionary perspective, we suggest that the gestural communication of other monkey species should be examined with a multifactorial approach.

Social pressure drives "conversational rules" in great apes

In the last decade, two hypotheses, one on the evolution of animal vocal communication in general and the other on the origins of human language, have gained ground. The first hypothesis argues that the complexity of communication co-evolved with the complexity of sociality. Species forming larger groups with complex social networks have more elaborate vocal repertoires. The second hypothesis posits that the core of communication is represented not only by what can be expressed by an isolated caller, but also by the way that vocal interactions are structured, language being above all a social act. Primitive forms of conversational rules based on a vocal turn-taking principle are thought to exist in primates. To support and bring together these hypotheses, more comparative studies of socially diverse species at different levels of the primate phylogeny are needed. However, the majority of available studies focus on monkeys, primates that are distant from the human lineage. Great apes represent excellent candidates for such comparative studies because of their phylogenetic proximity to humans and their varied social lives. We propose that studying vocal turn-taking in apes could address several major gaps regarding the social relevance of vocal turn-taking and the evolutionary trajectory of this behaviour among anthropoids. Indeed, how the social structure of a species may influence the vocal interaction patterns observed among group members remains an open question. We gathered data from the literature as well as original unpublished data (where absent in the literature) on four great ape species: chimpanzees Pan troglodytes, bonobos Pan paniscus, western lowland gorillas Gorilla gorilla gorilla and Bornean orang-utans Pongo pygmaeus. We found no clear-cut relationship between classical social complexity metrics (e.g. number of group members, interaction rates) and vocal complexity parameters (e.g. repertoire size, call rates). Nevertheless, the nature of the society (i.e. group composition, diversity and valence of social bonds) and the type of vocal interaction patterns (isolated calling, call overlap, turn-taking-based vocal exchanges) do appear to be related. Isolated calling is the main vocal pattern found in the species with the smallest social networks (orang-utan), while the other species show vocal interactions that are structured according to temporal rules. A high proportion of overlapping vocalisations is found in the most competitive species (chimpanzee), while vocal turn-taking predominates in more tolerant bonobos and gorillas. Also, preferentially interacting individuals and call types used to interact are not randomly distributed. Vocal overlap ('chorusing') and vocal exchange ('conversing') appear as possible social strategies used to advertise/strengthen social bonds. Our analyses highlight that: (i) vocal turn-taking is also observed in non-human great apes, revealing universal rules for conversing that may be deeply rooted in the primate lineage; (ii) vocal interaction patterns match the species' social lifestyle; (iii) although limited to four species here, adopting a targeted comparative approach could help to identify the multiple and subtle factors underlying social and vocal complexity. We believe that vocal interaction patterns form the basis of a promising field of investigation that may ultimately improve our understanding of the socially driven evolution of communication.

Connecting primate gesture to the evolutionary roots of language: A systematic review

Comparative psychology provides important contributions to our understanding of the origins of human language. The presence of common features in human and nonhuman primate communication can be used to suggest the evolutionary trajectories of potential precursors to language. However, to do so effectively, our findings must be comparable across diverse species. This systematic review describes the current landscape of data available from studies of gestural communication in human and nonhuman primates that make an explicit connection to language evolution. We found a similar number of studies on human and nonhuman primates, but that very few studies included data from more than one species. As a result, evolutionary inferences remain restricted to comparison across studies. We identify areas of focus, bias, and apparent gaps within the field. Different domains have been studied in human and nonhuman primates, with relatively few nonhuman primate studies of ontogeny and relatively few human studies of gesture form. Diversity in focus, methods, and socio-ecological context fill important gaps and provide nuanced understanding, but only where the source of any difference between studies is transparent. Many studies provide some definition for their use of gesture; but definitions of gesture, and in particular, criteria for intentional use, are absent in the majority of human studies. We find systematic differences between human and nonhuman primate studies in the research scope, incorporation of other modalities, research setting, and study design. We highlight eight particular areas in a call to action through which we can strengthen our ability to investigate gestural communication's contribution within the evolutionary roots of human language.

Hand Gesture Recognition Using EGaIn-Silicone Soft Sensors

Exploiting hand gestures for non-verbal communication has extraordinary potential in HCI. A data glove is an apparatus widely used to recognize hand gestures. To improve the functionality of the data glove, a highly stretchable and reliable signal-to-noise ratio sensor is indispensable. To do this, the study focused on the development of soft silicone microchannel sensors using a Eutectic Gallium-Indium (EGaIn) liquid metal alloy and a hand gesture recognition system via the proposed data glove using the soft sensor. The EGaIn-silicone sensor was uniquely designed to include two sensing channels to monitor the finger joint movements and to facilitate the EGaIn alloy injection into the meander-type microchannels. We recruited 15 participants to collect hand gesture dataset investigating 12 static hand gestures. The dataset was exploited to estimate the performance of the proposed data glove in hand gesture recognition. Additionally, six traditional classification algorithms were studied. From the results, a random forest shows the highest classification accuracy of 97.3% and a linear discriminant analysis shows the lowest accuracy of 87.4%. The non-linearity of the proposed sensor deteriorated the accuracy of LDA, however, the other classifiers adequately overcame it and performed high accuracies (>90%).

An Eye-Tracking Study on Audiovisual Speech Perception Strategies Adopted by Normal-Hearing and Deaf Adults Under Different Language Familiarities

Purpose The primary purpose of this study was to explore the audiovisual speech perception strategies.80.23.47 adopted by normal-hearing and deaf people in processing familiar and unfamiliar languages. Our primary hypothesis was that they would adopt different perception strategies due to different sensory experiences at an early age, limitations of the physical device, and the developmental gap of language, and others. Method Thirty normal-hearing adults and 33 prelingually deaf adults participated in the study. They were asked to perform judgment and listening tasks while watching videos of a Uygur-Mandarin bilingual speaker in a familiar language (Standard Chinese) or an unfamiliar language (Modern Uygur) while their eye movements were recorded by eye-tracking technology. Results Task had a slight influence on the distribution of selective attention, whereas subject and language had significant influences. To be specific, the normal-hearing and the d10eaf participants mainly gazed at the speaker's eyes and mouth, respectively, in the experiment; moreover, while the normal-hearing participants had to stare longer at the speaker's mouth when they confronted with the unfamiliar language Modern Uygur, the deaf participant did not change their attention allocation pattern when perceiving the two languages. Conclusions Normal-hearing and deaf adults adopt different audiovisual speech perception strategies: Normal-hearing adults mainly look at the eyes, and deaf adults mainly look at the mouth. Additionally, language and task can also modulate the speech perception strategy.