1
|
Holler J. Visual bodily signals as core devices for coordinating minds in interaction. Philos Trans R Soc Lond B Biol Sci 2022; 377:20210094. [PMID: 35876208 PMCID: PMC9310176 DOI: 10.1098/rstb.2021.0094] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Accepted: 01/21/2022] [Indexed: 12/11/2022] Open
Abstract
The view put forward here is that visual bodily signals play a core role in human communication and the coordination of minds. Critically, this role goes far beyond referential and propositional meaning. The human communication system that we consider to be the explanandum in the evolution of language thus is not spoken language. It is, instead, a deeply multimodal, multilayered, multifunctional system that developed-and survived-owing to the extraordinary flexibility and adaptability that it endows us with. Beyond their undisputed iconic power, visual bodily signals (manual and head gestures, facial expressions, gaze, torso movements) fundamentally contribute to key pragmatic processes in modern human communication. This contribution becomes particularly evident with a focus that includes non-iconic manual signals, non-manual signals and signal combinations. Such a focus also needs to consider meaning encoded not just via iconic mappings, since kinematic modulations and interaction-bound meaning are additional properties equipping the body with striking pragmatic capacities. Some of these capacities, or its precursors, may have already been present in the last common ancestor we share with the great apes and may qualify as early versions of the components constituting the hypothesized interaction engine. This article is part of the theme issue 'Revisiting the human 'interaction engine': comparative approaches to social action coordination'.
Collapse
Affiliation(s)
- Judith Holler
- Max-Planck-Institut für Psycholinguistik, Nijmegen, The Netherlands
- Donders Centre for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|
2
|
Bohn M, Liebal K, Oña L, Tessler MH. Great ape communication as contextual social inference: a computational modelling perspective. Philos Trans R Soc Lond B Biol Sci 2022; 377:20210096. [PMID: 35876204 PMCID: PMC9310183 DOI: 10.1098/rstb.2021.0096] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2021] [Accepted: 04/04/2022] [Indexed: 01/03/2023] Open
Abstract
Human communication has been described as a contextual social inference process. Research into great ape communication has been inspired by this view to look for the evolutionary roots of the social, cognitive and interactional processes involved in human communication. This approach has been highly productive, yet it is partly compromised by the widespread focus on how great apes use and understand individual signals. This paper introduces a computational model that formalizes great ape communication as a multi-faceted social inference process that integrates (a) information contained in the signals that make up an utterance, (b) the relationship between communicative partners and (c) the social context. This model makes accurate qualitative and quantitative predictions about real-world communicative interactions between semi-wild-living chimpanzees. When enriched with a pragmatic reasoning process, the model explains repeatedly reported differences between humans and great apes in the interpretation of ambiguous signals (e.g. pointing or iconic gestures). This approach has direct implications for observational and experimental studies of great ape communication and provides a new tool for theorizing about the evolution of uniquely human communication. This article is part of the theme issue 'Revisiting the human 'interaction engine': comparative approaches to social action coordination'.
Collapse
Affiliation(s)
- Manuel Bohn
- Department of Comparative Cultural Psychology, Max Planck Institute for Evolutionary Anthropology, 04103 Leipzig, Germany
| | - Katja Liebal
- Institute of Biology, Leipzig University, 04103 Leipzig, Germany
| | - Linda Oña
- Naturalistic Social Cognition Group, Max Planck Institute for Human Development, 14195 Berlin, Germany
| | - Michael Henry Tessler
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139-4307, USA
| |
Collapse
|
3
|
Smith K. How Language Learning and Language Use Create Linguistic Structure. CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE 2022. [DOI: 10.1177/09637214211068127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Languages persist through a cycle of learning and use: You learn a language through immersion in the language used in your linguistic community, and in using language to communicate, you produce further linguistic data, which other people might learn from in turn. Languages change over historical time as a result of errors and innovations in these processes of learning and use; this article reviews experimental and computational methods that have been developed to test the hypothesis that those same processes of learning and use are responsible for creating the fundamental structural properties shared by all human languages, including some of the design features that make language such a powerful tool for communication.
Collapse
Affiliation(s)
- Kenny Smith
- Centre for Language Evolution, School of Philosophy, Psychology & Language Sciences, University of Edinburgh
| |
Collapse
|
4
|
Fay N, Walker B, Ellison TM, Blundell Z, De Kleine N, Garde M, Lister CJ, Goldin-Meadow S. Gesture is the primary modality for language creation. Proc Biol Sci 2022; 289:20220066. [PMID: 35259991 PMCID: PMC8905156 DOI: 10.1098/rspb.2022.0066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/05/2022] Open
Abstract
How language began is one of the oldest questions in science, but theories remain speculative due to a lack of direct evidence. Here, we report two experiments that generate empirical evidence to inform gesture-first and vocal-first theories of language origin; in each, we tested modern humans' ability to communicate a range of meanings (995 distinct words) using either gesture or non-linguistic vocalization. Experiment 1 is a cross-cultural study, with signal Producers sampled from Australia (n = 30, Mage = 32.63, s.d. = 12.42) and Vanuatu (n = 30, Mage = 32.40, s.d. = 11.76). Experiment 2 is a cross-experiential study in which Producers were either sighted (n = 10, Mage = 39.60, s.d. = 11.18) or severely vision-impaired (n = 10, Mage = 39.40, s.d. = 10.37). A group of undergraduate student Interpreters guessed the meaning of the signals created by the Producers (n = 140). Communication success was substantially higher in the gesture modality than the vocal modality (twice as high overall; 61.17% versus 29.04% success). This was true within cultures, across cultures and even for the signals produced by severely vision-impaired participants. The success of gesture is attributed in part to its greater universality (i.e. similarity in form across different Producers). Our results support the hypothesis that gesture is the primary modality for language creation.
Collapse
Affiliation(s)
- Nicolas Fay
- School of Psychological Science, University of Western Australia, 35 Stirling Highway, Crawley, WA 6009, Australia
| | - Bradley Walker
- School of Psychological Science, University of Western Australia, 35 Stirling Highway, Crawley, WA 6009, Australia
| | - T Mark Ellison
- Collaborative Research Centre for Linguistic Prominence, University of Cologne, Cologne, NRW, Germany
| | - Zachary Blundell
- School of Psychological Science, University of Western Australia, 35 Stirling Highway, Crawley, WA 6009, Australia
| | - Naomi De Kleine
- School of Psychological Science, University of Western Australia, 35 Stirling Highway, Crawley, WA 6009, Australia
| | - Murray Garde
- School of Culture, History and Language, College of Asia and the Pacific, Australian National University, Canberra, ACT, Australia
| | - Casey J Lister
- School of Psychological Science, University of Western Australia, 35 Stirling Highway, Crawley, WA 6009, Australia
| | | |
Collapse
|
5
|
Margiotoudi K, Bohn M, Schwob N, Taglialatela J, Pulvermüller F, Epping A, Schweller K, Allritz M. Bo-NO-bouba-kiki: picture-word mapping but no spontaneous sound symbolic speech-shape mapping in a language trained bonobo. Proc Biol Sci 2022; 289:20211717. [PMID: 35105236 PMCID: PMC8808101 DOI: 10.1098/rspb.2021.1717] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2021] [Accepted: 01/04/2022] [Indexed: 12/11/2022] Open
Abstract
Humans share the ability to intuitively map 'sharp' or 'round' pseudowords, such as 'bouba' versus 'kiki', to abstract edgy versus round shapes, respectively. This effect, known as sound symbolism, appears early in human development. The phylogenetic origin of this phenomenon, however, is unclear: are humans the only species capable of experiencing correspondences between speech sounds and shapes, or could similar effects be observed in other animals? Thus far, evidence from an implicit matching experiment failed to find evidence of this sound symbolic matching in great apes, suggesting its human uniqueness. However, explicit tests of sound symbolism have never been conducted with nonhuman great apes. In the present study, a language-competent bonobo completed a cross-modal matching-to-sample task in which he was asked to match spoken English words to pictures, as well as 'sharp' or 'round' pseudowords to shapes. Sound symbolic trials were interspersed among English words. The bonobo matched English words to pictures with high accuracy, but did not show any evidence of spontaneous sound symbolic matching. Our results suggest that speech exposure/comprehension alone cannot explain sound symbolism. This lends plausibility to the hypothesis that biological differences between human and nonhuman primates could account for the putative human specificity of this effect.
Collapse
Affiliation(s)
- Konstantina Margiotoudi
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt Universität Berlin, Berlin, Germany
- Laboratory of Cognitive Psychology, CNRS and Aix-Marseille University, Marseille, France
| | - Manuel Bohn
- Department of Comparative Cultural Psychology, Max Planck Institute for Evolutionary Anthropology, Leipzig, Germany
| | - Natalie Schwob
- Department of Psychology, The Pennsylvania State University, University Park, PA, USA
| | - Jared Taglialatela
- Ape Cognition and Conservation Initiative, Des Moines, IA, USA
- Department of Ecology, Evolution and Organismal Biology, Kennesaw State University, Kennesaw, GA, USA
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt Universität Berlin, Berlin, Germany
- Einstein Center for Neurosciences Berlin, Berlin, Germany
- Cluster of Excellence ‘Matters of Activity’, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Amanda Epping
- Ape Cognition and Conservation Initiative, Des Moines, IA, USA
| | - Ken Schweller
- Ape Cognition and Conservation Initiative, Des Moines, IA, USA
| | - Matthias Allritz
- School of Psychology and Neuroscience, University of St Andrews, St Andrews, Fife KY16 9JP, UK
| |
Collapse
|
6
|
Kempe V, Gauvrit N, Panayotov N, Cunningham S, Tamariz M. Amount of Learning and Signal Stability Modulate Emergence of Structure and Iconicity in Novel Signaling Systems. Cogn Sci 2021; 45:e13057. [PMID: 34758143 PMCID: PMC9286673 DOI: 10.1111/cogs.13057] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 09/01/2021] [Accepted: 09/21/2021] [Indexed: 11/26/2022]
Abstract
Iterated language learning experiments that explore the emergence of linguistic structure in the laboratory vary considerably in methodological implementation, limiting the generalizability of findings. Most studies also restrict themselves to exploring the emergence of combinatorial and compositional structure in isolation. Here, we use a novel signal space comprising binary auditory and visual sequences and manipulate the amount of learning and temporal stability of these signals. Participants had to learn signals for meanings differing in size, shape, and brightness; their productions in the test phase were transmitted to the next participant. Across transmission chains of 10 generations each, Experiment 1 varied how much learning of auditory signals took place, and Experiment 2 varied temporal stability of visual signals. We found that combinatorial structure emerged only for auditory signals, and iconicity emerged when the amount of learning was reduced, as an opportunity for rote‐memorization hampers the exploration of the iconic affordances of the signal space. In addition, compositionality followed an inverted u‐shaped trajectory raising across several generations before declining again toward the end of the transmission chains. This suggests that detection of systematic form‐meaning linkages requires stable combinatorial units that can guide learners toward the structural properties of signals, but these combinatorial units had not yet emerged in these unfamiliar systems. Our findings underscore the importance of systematically manipulating training conditions and signal characteristics in iterated language learning experiments to study the interactions between the emergence of iconicity, combinatorial and compositional structure in novel signaling systems.
Collapse
Affiliation(s)
- Vera Kempe
- Division of Psychology, Abertay University
| | | | | | | | | |
Collapse
|
7
|
Fröhlich M, Bartolotta N, Fryns C, Wagner C, Momon L, Jaffrezic M, Mitra Setia T, van Noordwijk MA, van Schaik CP. Multicomponent and multisensory communicative acts in orang-utans may serve different functions. Commun Biol 2021; 4:917. [PMID: 34316012 PMCID: PMC8316500 DOI: 10.1038/s42003-021-02429-y] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Accepted: 07/07/2021] [Indexed: 02/07/2023] Open
Abstract
From early infancy, human face-to-face communication is multimodal, comprising a plethora of interlinked communicative and sensory modalities. Although there is also growing evidence for this in nonhuman primates, previous research rarely disentangled production from perception of signals. Consequently, the functions of integrating articulators (i.e. production organs involved in multicomponent acts) and sensory channels (i.e. modalities involved in multisensory acts) remain poorly understood. Here, we studied close-range social interactions within and beyond mother-infant pairs of Bornean and Sumatran orang-utans living in wild and captive settings, to examine use of and responses to multicomponent and multisensory communication. From the perspective of production, results showed that multicomponent acts were used more than the respective unicomponent acts when the presumed goal did not match the dominant outcome for a specific communicative act, and were more common among non-mother-infant dyads and Sumatran orang-utans. From the perception perspective, we found that multisensory acts were more effective than the respective unisensory acts, and were used more in wild compared to captive populations. We argue that multisensory acts primarily facilitate effectiveness, whereas multicomponent acts become relevant when interaction outcomes are less predictable. These different functions underscore the importance of distinguishing between production and perception in studies of communication.
Collapse
Affiliation(s)
- Marlen Fröhlich
- Department of Anthropology, University of Zurich, Zurich, Switzerland.
| | | | - Caroline Fryns
- Department of Anthropology, University of Zurich, Zurich, Switzerland
| | - Colin Wagner
- DEPE-IPHC - Département Ecologie, Physiologie et Ethologie, University of Strasbourg, Strasbourg, France
| | - Laurene Momon
- DEPE-IPHC - Département Ecologie, Physiologie et Ethologie, University of Strasbourg, Strasbourg, France
| | - Marvin Jaffrezic
- DEPE-IPHC - Département Ecologie, Physiologie et Ethologie, University of Strasbourg, Strasbourg, France
| | | | | | - Carel P van Schaik
- Department of Anthropology, University of Zurich, Zurich, Switzerland
- Center for the Interdisciplinary Study of Language Evolution (ISLE), University of Zurich, Zurich, Switzerland
| |
Collapse
|
8
|
Lister CJ, Burtenshaw T, Walker B, Ohan JL, Fay N. A Cross-Sectional Test of Sign Creation by Children in the Gesture and Vocal Modalities. Child Dev 2021; 92:2395-2412. [PMID: 33978241 DOI: 10.1111/cdev.13587] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
Naturalistic studies show that children can create language-like communication systems in the absence of conventional language. However, experimental evidence is mixed. We address this discrepancy using an experimental paradigm that simulates naturalistic sign creation. Specifically, we tested if a sample of 6- to 12-year-old children (52 girls and 56 boys drawn from an urban, predominantly white population in Western Australia) can comprehend and create novel gestural and vocal signs. Experiment 1 tested children's ability to comprehend novel signs. Experiment 2 tested children's ability to create novel signs. Results show that children can comprehend and create gestural and vocal signs, that communication is more successful in the gesture modality, and that older children outperform younger children.
Collapse
|
9
|
Mertens UJ, Rohlfing KJ. Progressive Reduction of Iconic Gestures Contributes to School-Aged Children's Increased Word Production. Front Psychol 2021; 12:651725. [PMID: 33981277 PMCID: PMC8107226 DOI: 10.3389/fpsyg.2021.651725] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2021] [Accepted: 03/30/2021] [Indexed: 11/13/2022] Open
Abstract
The economic principle of communication, according to which successful communication can be reached by least effort, has been studied for verbal communication. With respect to nonverbal behavior, it implies that forms of iconic gestures change over the course of communication and become reduced in the sense of less pronounced. These changes and their effects on learning are currently unexplored in relevant literature. Addressing this research gap, we conducted a word learning study to test the effects of changing gestures on children's slow mapping. We applied a within-subject design and tested 51 children, aged 6.7 years (SD = 0.4), who learned unknown words from a story. The storyteller acted on the basis of two conditions: In one condition, in which half of the target words were presented, the story presentation was enhanced with progressively reduced iconic gestures (PRG); in the other condition, half of the target words were accompanied by fully executed iconic gestures (FEG). To ensure a reliable gesture presentation, children were exposed to a recorded person telling a story in both conditions. We tested the slow mapping effects on children's productive and receptive word knowledge three minutes as well as two to three days after being presented the story. The results suggest that children's production of the target words, but not their understanding thereof, was enhanced by PRG.
Collapse
Affiliation(s)
- Ulrich J Mertens
- Psycholinguistics, Faculty of Arts and Humanities, Paderborn University, Paderborn, Germany
| | - Katharina J Rohlfing
- Psycholinguistics, Faculty of Arts and Humanities, Paderborn University, Paderborn, Germany
| |
Collapse
|
10
|
Lister C, Walker B, Fay N. Innovation and enculturation in child communication: a cross-sectional study. EVOLUTIONARY HUMAN SCIENCES 2020; 2:e56. [PMID: 37588389 PMCID: PMC10427475 DOI: 10.1017/ehs.2020.57] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
Abstract
How can people achieve successful communication when using novel signs? Previous studies show that iconic signs (i.e. signs that directly resemble their referent) enhance communication success. In this paper, we test if enculturated signs (i.e. signs informed by interlocutors' shared culture) also enhance communication success. Children, who have spent less time in their linguistic community, have less cultural knowledge to inform their sign innovation. A natural prediction is that younger children's signs will be less enculturated, more diverse and less successful compared with older children and adults. We examined sign innovation in children aged between 6 and 12 years (N = 54) and adults (N = 18). Sign enculturation, diversity and iconicity were rated. As predicted, younger children innovated less enculturated and more diverse signs, and communicated less successfully than older children and adults. Sign enculturation and iconicity uniquely contributed to communication success. This is the first study to demonstrate that enculturated signs enhance communication.
Collapse
Affiliation(s)
- C.J. Lister
- School of Psychological Science, University of Western Australia, Crawley, WA6009, Australia
| | - B. Walker
- School of Psychological Science, University of Western Australia, Crawley, WA6009, Australia
| | - N. Fay
- School of Psychological Science, University of Western Australia, Crawley, WA6009, Australia
| |
Collapse
|
11
|
Corballis MC. Crossing the Rubicon: Behaviorism, Language, and Evolutionary Continuity. Front Psychol 2020; 11:653. [PMID: 32373020 PMCID: PMC7186390 DOI: 10.3389/fpsyg.2020.00653] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2020] [Accepted: 03/18/2020] [Indexed: 01/09/2023] Open
Abstract
Euan Macphail's work and ideas captured a pivotal time in the late 20th century when behavioral laws were considered to apply equally across vertebrates, implying equal intelligence, but it was also a time when behaviorism was challenged by the view that language was unique to humans, and bestowed a superior mental status. Subsequent work suggests greater continuity between humans and their forebears, challenging the Chomskyan assumption that language evolved in a single step ("the great leap forward") in humans. Language is now understood to be based on an amalgam of cognitive functions, including mental time travel, theory of mind, and what may be more broadly defined as imagination. These functions probably evolved gradually in hominin evolution and are present in varying degrees in non-human species. The blending of language into cognition provides for both interspecies differences in mental function, and continuity between humans and other species. What does seem to be special to humans is the ability to communicate the contents of imagination, although even this is not absolute, and is perhaps less adaptive than we like to think.
Collapse
Affiliation(s)
- Michael C. Corballis
- Faculty of Science, School of Psychology, The University of Auckland, Auckland, New Zealand
| |
Collapse
|