Demonstratives in Spatial Language and Social Interaction: An Interdisciplinary Review

Spatial communication systems across languages reflect universal action constraints

The extent to which languages share properties reflecting the non-linguistic constraints of the speakers who speak them is key to the debate regarding the relationship between language and cognition. A critical case is spatial communication, where it has been argued that semantic universals should exist, if anywhere. Here, using an experimental paradigm able to separate variation within a language from variation between languages, we tested the use of spatial demonstratives-the most fundamental and frequent spatial terms across languages. In n = 874 speakers across 29 languages, we show that speakers of all tested languages use spatial demonstratives as a function of being able to reach or act on an object being referred to. In some languages, the position of the addressee is also relevant in selecting between demonstrative forms. Commonalities and differences across languages in spatial communication can be understood in terms of universal constraints on action shaping spatial language and cognition.

An information-theoretic approach to the typology of spatial demonstratives

We explore systems of spatial deictic words (such as 'here' and 'there') from the perspective of communicative efficiency using typological data from over 200 languages Nintemann et al. (2020). We argue from an information-theoretic perspective that spatial deictic systems balance informativity and complexity in the sense of the Information Bottleneck (Zaslavsky et al., (2018). We find that under an appropriate choice of cost function and need probability over meanings, among all the 21,146 theoretically possible spatial deictic systems, those adopted by real languages lie near an efficient frontier of informativity and complexity. Moreover, we find that the conditions that the need probability and the cost function need to satisfy for this result are consistent with the cognitive science literature on spatial cognition, especially regarding the source-goal asymmetry. We further show that the typological data are better explained by introducing a notion of consistency into the Information Bottleneck framework, which is jointly optimized along with informativity and complexity.

Acquisition of demonstratives in cross-linguistic perspective

This paper examines the acquisition of demonstratives (e.g., that, there) from a cross-linguistic perspective. Although demonstratives are often said to play a crucial role in L1 acquisition, there is little systematic research on this topic. Using extensive corpus data of spontaneous child speech, the paper investigates the emergence and development of demonstratives in three European (English, French, Spanish) and four non-European languages (Japanese, Chinese, Hebrew, Indonesian) between age 1;0 and 6;0. The data show that, across languages, demonstratives are among the earliest and most frequent child words, but their frequency decreases with age and MLU. As children grow older, they tend to use other types of referring terms (e.g., anaphoric pronouns) and other types of spatial expressions (e.g., adpositions). Considering these results, we hypothesize that children shift from using a body-oriented strategy of deictic communication to more abstract and disembodied strategies of encoding reference and space during the preschool years.

Learning to generate pointing gestures in situated embodied conversational agents

One of the main goals of robotics and intelligent agent research is to enable them to communicate with humans in physically situated settings. Human communication consists of both verbal and non-verbal modes. Recent studies in enabling communication for intelligent agents have focused on verbal modes, i.e., language and speech. However, in a situated setting the non-verbal mode is crucial for an agent to adapt flexible communication strategies. In this work, we focus on learning to generate non-verbal communicative expressions in situated embodied interactive agents. Specifically, we show that an agent can learn pointing gestures in a physically simulated environment through a combination of imitation and reinforcement learning that achieves high motion naturalness and high referential accuracy. We compared our proposed system against several baselines in both subjective and objective evaluations. The subjective evaluation is done in a virtual reality setting where an embodied referential game is played between the user and the agent in a shared 3D space, a setup that fully assesses the communicative capabilities of the generated gestures. The evaluations show that our model achieves a higher level of referential accuracy and motion naturalness compared to a state-of-the-art supervised learning motion synthesis model, showing the promise of our proposed system that combines imitation and reinforcement learning for generating communicative gestures. Additionally, our system is robust in a physically-simulated environment thus has the potential of being applied to robots.

Choice of Mandarin Spatial Demonstratives in Distant Interaction

Scholars are divided on whether the Speaker's (S') choice of spatial demonstratives in verbal interaction is ego-centric or not. We studied the choice of "zhe (here)/ na (there)" by a Mandarin S instructing Hearer (H) from a few to dozens of meters. Using within-group and between-group experiments in a picture-description paradigm, we found that both S- and H- distance (Ds and Dh) to the Referent constantly influence S' demonstrative choice, and the social relation as a variable (Relation) between S and H also exerts some influence. Our findings support the idea that spatial reference in verbal interaction is somewhat non-egocentric.

Demonstrative systems: From linguistic typology to social cognition

This study explores the connection between language and social cognition by empirically testing different typological analyses of various demonstrative systems. Linguistic typology classifies demonstrative systems as distance-oriented or person-oriented, depending on whether they indicate the location of a referent relative only to the speaker, or to both the speaker and the listener. From the perspective of social cognition, speakers of languages with person-oriented systems must monitor their listener's spatial location in order to accurately use their demonstratives, while speakers of languages with distance-oriented systems can use demonstratives from their own, egocentric perspective. Resolving an ongoing controversy around the nature of the Spanish demonstrative system, the results of Experiment 1 confirmed that this demonstrative system is person oriented, while the English system is distance oriented. Experiment 2 revealed that not all three-way demonstrative systems are person oriented, with Japanese speakers showing sensitivity to the listener's spatial location, while Turkish speakers did not show such an effect in their demonstrative choice. In Experiment 3, Catalan-Spanish bilinguals showed sensitivity to listener position in their choice of the Spanish distal form, but not in their choice of the medial form. These results were interpreted as a transfer effect from Catalan, which revealed analogous results to English. Experiment 4 investigated the use of demonstratives to redirect a listener's attention to the intended referent, which is a universal function of demonstratives that also hinges on social cognition. Japanese and Spanish speakers chose between their proximal and distal demonstratives flexibly, depending on whether the listener was looking closer or further from the referent, whereas Turkish speakers chose their medial form for attention correction. In conclusion, the results of this study support the view that investigating how speakers of different languages jointly use language and social cognition in communication has the potential to unravel the deep connection between these two fundamentally human capacities.

Children's use of demonstrative words: spatial deictics beyond infancy

Demonstrative words are one of the most important ways of establishing reference in conversation. This work describes Spanish-speaking children's demonstrative production between ages 2 to 10 using data from the CHILDES corpora. Results indicate that children feature all demonstratives in their lexicon - however, the distal term is scarce throughout development. Moreover, patterns of demonstrative use are not adult-like at age 10. We compare adult and child data to conclude that children's development of demonstrative production is largely protracted. Adult use of the distal demonstrative is higher than in young children, although both older children and adults use the medial term ese more than any other demonstratives. In contrast, younger children use proximals relatively more frequently than older children and adults. Suggestions for future research and theoretical implications for the Spanish demonstrative system are discussed.

Learning speaker- and addressee-centered demonstratives in Ticuna

This study investigated the acquisition of demonstratives (e.g., this/that, here/there) by 45 children (1;0 - 4;11) learning Ticuna, an Indigenous Amazonian language with an unusually complex demonstrative system. I analyzed 89 10-minute samples from video recordings of child-caregiver interaction, examining how often children and caregivers produced each demonstrative type, as well as relationships among children's age, children's demonstrative production, and caregivers' production. Caregivers' demonstrative production displayed few relationships with children's age or production. Children produced speaker-proximal and speaker-distal demonstratives (this near me, that far from me) earlier in developmental time than addressee-proximal demonstratives (that near you), and nominal (this/that) demonstratives earlier than locative (here/there) ones. Compared to caregivers, children overused speaker-proximal demonstratives, but used other demonstrative types with adult-like frequency beginning at 2;0. These results support the view that cognitive biases toward egocentric, proximal, and semantically simpler items substantially influence children's acquisition of demonstratives.

Implicit Associations between Adverbs of Place and Actions in the Physical and Digital Space

Neuropsychological, behavioral, and neurophysiological evidence indicates that the coding of space as near and far depends on the involvement of different neuronal circuits. These circuits are recruited on the basis of functional parameters, not of metrical ones, reflecting a general distinction of human behavior, which alternatively attributes to the individual the role of agent or observer. Although much research in cognitive psychology was devoted to demonstrating that language and concepts are rooted in the sensorimotor system, no study has investigated the presence of implicit associations between different adverbs of place (far vs. near) and actions with different functional characteristics. Using a series of Implicit Association Test (IAT) experiments, we tested this possibility for both actions performed in physical space (grasp vs. look at) and those performed when using digital technology (content generation vs. content consumption). For both the physical and digital environments, the results showed an association between the adverb near and actions related to the role of agent, and between the adverb far and actions related to the role of observer. Present findings are the first experimental evidence of an implicit association between different adverbs of place and different actions and of the fact that adverbs of place also apply to the digital environment.