Spatial demonstratives and perceptual space: describing and remembering object location

Graph methods to infer spatial disturbances: Application to Huntington's Disease's speech

OBJECTIVE

Huntington's Disease (HD) is an inherited neurodegenerative disease caused by the mutation of the Htt gene, impacting all aspects of living and functioning. Among cognitive disabilities, spatial capacities are impaired, but their monitoring remains scarce as limited by lengthy experts' assessments. Language offers an alternative medium to evaluate patients' performance in HD. Yet, its capacities to assess HD's spatial abilities are unknown. Here, we aimed to bring proof-of-concept that HD's spatial deficits can be assessed through speech.

METHODS

We developed the Spatial Description Model to graphically represent spatial relations described during the Cookie Theft Picture (CTP) task. We increased the sensitivity of our model by using only sentences with spatial terms, unlike previous studies in Alzheimer's disease. 78 carriers of the mutant Htt, including 56 manifest and 22 premanifest individuals, as well as 25 healthy controls were included from the BIOHD & (NCT01412125) & Repair-HD (NCT03119246) cohorts. The convergence and divergence of the model were validated using the SelfCog battery.

RESULTS

Our Spatial Description Model was the only one among the four assessed approaches, revealing that individuals with manifest HD expressed fewer spatial relations and engaged in less spatial exploration compared to healthy controls. Their graphs correlated with both visuospatial and language SelfCog performances, but not with motor, executive nor memory functions.

CONCLUSIONS

We provide the proof-of-concept using our Spatial Description Model that language can grasp HD patient's spatial disturbances. By adding spatial capabilities to the panel of functions tested by the language, it paves the way for eventual remote clinical application.

Imagery and Verbal Strategies in Spatial Memory for Route and Survey Descriptions

Being able to represent and remember verbally-encoded information about spatial environments from different perspectives is important for numerous daily activities. The present study examined how frequently individuals spontaneously engage in visual mental imagery and verbal rehearsal strategies in memory recall of spatial descriptions, and whether using certain strategies is associated with better recall performance. Memory recall for route (person-centred) and survey (object-centred) spatial descriptions was examined in a sample of 105 neurotypical individuals, who also reported to what extent they used route- and survey-based mental imagery and verbal rehearsal strategies in each description. Results showed that participants favoured a path visualisation strategy to recall the route description and a map visualisation strategy to recall the survey description. Regression models further showed that employing both imagery and verbal strategies was associated with better recall for both route and survey descriptions, although imagery strategies held a higher predictive power. The present findings highlight the fact that the spontaneous use of internal strategies in the form of visual imagery and verbal rehearsal is ubiquitous when recalling spatial descriptions and a core part of efficient spatial memory functioning.

Spatial communication systems across languages reflect universal action constraints

The extent to which languages share properties reflecting the non-linguistic constraints of the speakers who speak them is key to the debate regarding the relationship between language and cognition. A critical case is spatial communication, where it has been argued that semantic universals should exist, if anywhere. Here, using an experimental paradigm able to separate variation within a language from variation between languages, we tested the use of spatial demonstratives-the most fundamental and frequent spatial terms across languages. In n = 874 speakers across 29 languages, we show that speakers of all tested languages use spatial demonstratives as a function of being able to reach or act on an object being referred to. In some languages, the position of the addressee is also relevant in selecting between demonstrative forms. Commonalities and differences across languages in spatial communication can be understood in terms of universal constraints on action shaping spatial language and cognition.

What's your point? Insights from virtual reality on the relation between intention and action in the production of pointing gestures

Human communication involves the process of translating intentions into communicative actions. But how exactly do our intentions surface in the visible communicative behavior we display? Here we focus on pointing gestures, a fundamental building block of everyday communication, and investigate whether and how different types of underlying intent modulate the kinematics of the pointing hand and the brain activity preceding the gestural movement. In a dynamic virtual reality environment, participants pointed at a referent to either share attention with their addressee, inform their addressee, or get their addressee to perform an action. Behaviorally, it was observed that these different underlying intentions modulated how long participants kept their arm and finger still, both prior to starting the movement and when keeping their pointing hand in apex position. In early planning stages, a neurophysiological distinction was observed between a gesture that is used to share attitudes and knowledge with another person versus a gesture that mainly uses that person as a means to perform an action. Together, these findings suggest that our intentions influence our actions from the earliest neurophysiological planning stages to the kinematic endpoint of the movement itself.

An information-theoretic approach to the typology of spatial demonstratives

We explore systems of spatial deictic words (such as 'here' and 'there') from the perspective of communicative efficiency using typological data from over 200 languages Nintemann et al. (2020). We argue from an information-theoretic perspective that spatial deictic systems balance informativity and complexity in the sense of the Information Bottleneck (Zaslavsky et al., (2018). We find that under an appropriate choice of cost function and need probability over meanings, among all the 21,146 theoretically possible spatial deictic systems, those adopted by real languages lie near an efficient frontier of informativity and complexity. Moreover, we find that the conditions that the need probability and the cost function need to satisfy for this result are consistent with the cognitive science literature on spatial cognition, especially regarding the source-goal asymmetry. We further show that the typological data are better explained by introducing a notion of consistency into the Information Bottleneck framework, which is jointly optimized along with informativity and complexity.

The curious origins of ownership

What are the origins of ownership as a conceptual domain? By combining experimental evidence from cognitive science, a theoretical proposal from developmental psychology, and the computational framework of reinforcement learning, I argue that ownership concepts can develop as a by-product of our curiosity-based exploration and become grounded via our experience of control in physical and social environments.

Choice of Mandarin Spatial Demonstratives in Distant Interaction

Scholars are divided on whether the Speaker's (S') choice of spatial demonstratives in verbal interaction is ego-centric or not. We studied the choice of "zhe (here)/ na (there)" by a Mandarin S instructing Hearer (H) from a few to dozens of meters. Using within-group and between-group experiments in a picture-description paradigm, we found that both S- and H- distance (Ds and Dh) to the Referent constantly influence S' demonstrative choice, and the social relation as a variable (Relation) between S and H also exerts some influence. Our findings support the idea that spatial reference in verbal interaction is somewhat non-egocentric.

Children's use of demonstrative words: spatial deictics beyond infancy

Demonstrative words are one of the most important ways of establishing reference in conversation. This work describes Spanish-speaking children's demonstrative production between ages 2 to 10 using data from the CHILDES corpora. Results indicate that children feature all demonstratives in their lexicon - however, the distal term is scarce throughout development. Moreover, patterns of demonstrative use are not adult-like at age 10. We compare adult and child data to conclude that children's development of demonstrative production is largely protracted. Adult use of the distal demonstrative is higher than in young children, although both older children and adults use the medial term ese more than any other demonstratives. In contrast, younger children use proximals relatively more frequently than older children and adults. Suggestions for future research and theoretical implications for the Spanish demonstrative system are discussed.

Learning speaker- and addressee-centered demonstratives in Ticuna

This study investigated the acquisition of demonstratives (e.g., this/that, here/there) by 45 children (1;0 - 4;11) learning Ticuna, an Indigenous Amazonian language with an unusually complex demonstrative system. I analyzed 89 10-minute samples from video recordings of child-caregiver interaction, examining how often children and caregivers produced each demonstrative type, as well as relationships among children's age, children's demonstrative production, and caregivers' production. Caregivers' demonstrative production displayed few relationships with children's age or production. Children produced speaker-proximal and speaker-distal demonstratives (this near me, that far from me) earlier in developmental time than addressee-proximal demonstratives (that near you), and nominal (this/that) demonstratives earlier than locative (here/there) ones. Compared to caregivers, children overused speaker-proximal demonstratives, but used other demonstrative types with adult-like frequency beginning at 2;0. These results support the view that cognitive biases toward egocentric, proximal, and semantically simpler items substantially influence children's acquisition of demonstratives.

The extended development of mapping spatial demonstratives onto space

Spatial demonstratives (this and that in English) convey distance relative to speaker (within reach vs. out of reach) and object characteristics such as ownership. Previous studies indicate that object characteristics affect adult demonstrative choice, for example, greater use of this for owned objects. Here, production of spatial demonstratives was studied developmentally to identify when demonstrative production is sensitive to both distance and ownership. In two experiments, 7-year-olds, 11-year-olds, and adults completed an object location memory task, and a language task eliciting this or that to indicate an object. Results indicate that adult-like demonstrative production starts around 7 years of age and continues to develop beyond 11 years. Nonlinguistic spatial memory did not vary significantly across age groups. Spatial demonstratives encode both semantic and spatial object characteristics throughout development, revealing the fundamental importance of semantic factors for demonstrative production.

From Affordances to Abstract Words: The Flexibility of Sensorimotor Grounding

The sensorimotor system plays a critical role in several cognitive processes. Here, we review recent studies documenting this interplay at different levels. First, we concentrate on studies that have shown how the sensorimotor system is flexibly involved in interactions with objects. We report evidence demonstrating how social context and situations influence affordance activation, and then focus on tactile and kinesthetic components in body-object interactions. Then, we turn to word use, and review studies that have shown that not only concrete words, but also abstract words are grounded in the sensorimotor system. We report evidence that abstract concepts activate the mouth effector more than concrete concepts, and discuss this effect in light of studies on adults, children, and infants. Finally, we pinpoint possible sensorimotor mechanisms at play in the acquisition and use of abstract concepts. Overall, we show that the involvement of the sensorimotor system is flexibly modulated by context, and that its role can be integrated and flanked by that of other systems such as the linguistic system. We suggest that to unravel the role of the sensorimotor system in cognition, future research should fully explore the complexity of this intricate, and sometimes slippery, relation.

A conceptual framework for the study of demonstrative reference

Language allows us to efficiently communicate about the things in the world around us. Seemingly simple words like this and that are a cornerstone of our capability to refer, as they contribute to guiding the attention of our addressee to the specific entity we are talking about. Such demonstratives are acquired early in life, ubiquitous in everyday talk, often closely tied to our gestural communicative abilities, and present in all spoken languages of the world. Based on a review of recent experimental work, here we introduce a new conceptual framework of demonstrative reference. In the context of this framework, we argue that several physical, psychological, and referent-intrinsic factors dynamically interact to influence whether a speaker will use one demonstrative form (e.g., this) or another (e.g., that) in a given setting. However, the relative influence of these factors themselves is argued to be a function of the cultural language setting at hand, the theory-of-mind capacities of the speaker, and the affordances of the specific context in which the speech event takes place. It is demonstrated that the framework has the potential to reconcile findings in the literature that previously seemed irreconcilable. We show that the framework may to a large extent generalize to instances of endophoric reference (e.g., anaphora) and speculate that it may also describe the specific form and kinematics a speaker's pointing gesture takes. Testable predictions and novel research questions derived from the framework are presented and discussed.

Effects of Scale on Multimodal Deixis: Evidence From Quiahije Chatino

As humans interact in the world, they often orient one another's attention to objects through the use of spoken demonstrative expressions and head and/or hand movements to point to the objects. Although indicating behaviors have frequently been studied in lab settings, we know surprisingly little about how demonstratives and pointing are used to coordinate attention in large-scale space and in natural contexts. This study investigates how speakers of Quiahije Chatino, an indigenous language of Mexico, use demonstratives and pointing to give directions to named places in large-scale space across multiple scales (local activity, district, state). The results show that the use and coordination of demonstratives and pointing change as the scale of search space for the target grows. At larger scales, demonstratives and pointing are more likely to occur together, and the two signals appear to manage different aspects of the search for the target: demonstratives orient attention primarily to the gesturing body, while pointing provides cues for narrowing the search space. These findings underscore the distinct contributions of speech and gesture to the linguistic composite, while illustrating the dynamic nature of their interplay.

Abstracts in Spanish and Quiahije Chatino are provided as appendices.

Se incluyen como apéndices resúmenes en español y en el chatino de San Juan Quiahije. Son^G ktyi^C re^C in^H, ngyaq^C ska^E ktyi^C no^E nda^H son^B na^F nga^J no^I ngyaq^C lo^E ktyi^C re^C, ngyaq^C ran^F chaq^E xlya^K qo^E chaq^F jnya^J no^A ndywiq^A renq^A Kchin^A Kyqya^C.

Common Ground in Demonstrative Reference: The Case of Mano (Mande)

That demonstratives often have endophoric functions marking referents outside the physical space of interaction but accessible through cognition, especially memory, is well-known. These functions are often classified as independent from exophoric ones and are typically seen as secondary with respect to spatial deixis. However, data from multiple languages show that cognitive access to referents functions alongside of perceptual access, including vision. Cognitive access is enabled by prior interactions and prior familiarity with the referents. As a result of such interactions, the interlocutors share a great deal of knowledge about the referents, which facilitates reference to objects in the interactive field. The centrality of common ground in reference to an object at the interactive scene challenges the often assumed classification of demonstrative reference into exophoric and endophoric. I illustrate this idea throughout the paper by using first-hand data from Mano, a Mande language of Guinea. Adding another argument in favor of viewing demonstrative reference as a social, interactive process, the Mano data push the idea of salience of non-spatial parameters further and emphasizes the importance of short and long-term interactional history and cultural knowledge both for the choice of demonstratives in exophoric reference and for the structuring of the demonstrative paradigm.

Shrinking Your Deictic System: How Far Can You Go?

Languages around the world differ in terms of the number of adnominal and pronominal demonstratives they require, as well as the factors that impact on their felicitous use. Given this cross-linguistic variation in deictic demonstrative terms, and the features that determine their felicitous use, an open question is how this is accommodated within bilingual cognition and language. In particular, we were interested in the extent to which bilingual language exposure and practice might alter the way in which a bilingual is using deictic demonstratives in their first language. Recent research on language attrition suggests that L2 learning selectively affects aspects of the native language, with some domains of language competence being more vulnerable than others. If demonstratives are basic, and acquired relatively early, they should be less susceptible to change and attrition. This was the hypothesis we went on to test in the current study. We tested two groups of native Spanish speakers, a control group living in Spain and an experimental group living in Norway using the (Spatial) Memory game paradigm. Contra to our expectations, the results indicate a significant difference between the two groups in use of deictic terms, indicative of a change in the preferred number of terms used. This suggests that deictic referential systems may change over time under pressure from bilingual language exposure.

Interpreting Estonian Demonstratives: The Effects of Referent's Distance and Visual Salience

Most of the research done with spatial demonstratives (words such as this, here and that, there) have focused on the production, not the interpretation, of these words. In addition, emphasis has been largely on demonstrative pronouns, leaving demonstrative adverbs with relatively little research attention. The present study explores the interpretation of both demonstrative pronouns and demonstrative adverbs in Estonian—a Finno-Ugric language with two dialectal-specific demonstrative pronoun systems. In the South-Estonian (SE) dialectal region, two demonstrative pronouns, see—“this” and too—“that”, are used. In the North-Estonian (NE) region, only one, see—“this/that”, is used. The aim of this study is twofold. First, we test if the distance and the visual salience of a referent have an effect on the interpretation of demonstratives. Second, we explore if there is a difference in the interpretation of demonstratives between native speakers from SE and NE. We used an interpretation experiment with 30 participants per group (total n = 60) and compared the SE and NE group responses. The results clearly show that the distance of the referent has an effect on how demonstratives are interpreted across the two groups, while the effect of visual salience is inconclusive. There is also a difference in the interpretation of demonstratives between the two dialectal groups. When using the Estonian with an influence of the SE dialect, the NE speakers rely on demonstrative adverbs in interpreting the referential utterance that includes demonstrative pronoun and adverb combinations, whereas the SE speakers also take into account the semantics of demonstrative pronouns. We show that, in addition to an already known difference in the production, there is also a difference in the interpretation of demonstratives between the two groups. In addition, our findings support the recognition that languages that have distance neutral demonstrative pronouns enforce the spatial meaning of a referring utterance by adding demonstrative adverbs. Not only is the interpretation of demonstrative pronouns affected, but the interpretation of demonstrative adverbs as well. The latter shows the importance of studying adverbs also, not just pronouns, and contributes to further knowledge of how demonstratives function.

Demonstratives in Spatial Language and Social Interaction: An Interdisciplinary Review

This paper offers a review of research on demonstratives from an interdisciplinary perspective. In particular, we consider the role of demonstratives in current research on language universals, language evolution, language acquisition, multimodal communication, signed language, language and perception, language in interaction, spatial imagery, and discourse processing. Traditionally, demonstratives are analyzed as a particular class of spatial deictics. Yet, a number of recent studies have argued that space is largely irrelevant to deixis and that demonstratives are primarily used for social and interactive purposes. Synthesizing findings in the literature, we conclude that demonstratives are a very special class of linguistic items that are foundational to both spatial and social aspects of language and cognition.

Targeting in Language: Unifying Deixis and Anaphora

This article proposes that a single cognitive system underlies the two domains of linguistic reference traditionally termed anaphora and deixis. In anaphora, the referent is an element of the current discourse itself, whereas in deixis, the referent is outside the discourse in its spatiotemporal surroundings. This difference between the lexical and the physical has traditionally led to distinct theoretical treatments of such referents. We propose instead that language engages a single linguistic/cognitive system–“targeting”–to single out a referent, whether it is speech-internal or speech-external. To outline this system: As a speaker communicates with a hearer, her attention can come to be on something in the environment–her “target”–that she wants to refer to at a certain point in her discourse. This target can be located near or far in either the speech-external (deictic) or the speech-internal (anaphoric) environment. She thus needs the hearer to know what her intended target is and to have his attention on it jointly with her own at the relevant point in her discourse. The problem, though, is how to bring this about. Language solves this problem through targeting. First, at the intended point in her discourse, the speaker places a “trigger”–one out of a specialized set of mostly closed-class forms. English triggers include this/these, that/those, here, there, yonder, now, then, therefore, thus, so, such, yay, the, personal pronouns, relative pronouns, and tense markers. Next, on hearing the trigger, the hearer undertakes a particular three-stage procedure. In the first stage, he seeks all available “cues” to the target. Such cues belong to 10 distinct categories, representing 10 different sources of information about the target. In the second stage, he combines these cues so as to narrow down to the one intended target and rule out alternative candidates. In the third stage, he maps the concept of the target he has found back onto the original trigger for integration with the sentence’s overall reference. This article is based on the overview portion of a book–The Targeting System of Language, MIT Press, 2018.

Elevation as a Grammatical and Semantic Category of Demonstratives

In this paper I study semantic and pragmatic properties of elevational demonstratives by means of a typological investigation of 50 languages with elevational demonstratives from all across the globe. The four basic verticality values expressed by elevational demonstratives are UP, DOWN, LEVEL, and ACROSS. They can be ordered along the elevational hierarchy (UP/DOWN > LEVEL/ACROSS), which reflects cross-linguistic tendencies in the expression of these values by demonstratives. Elevational values are frequently co-expressed with distance-based meanings of demonstratives, and it is almost always distal demonstratives that express elevation, whereas medial or proximal demonstratives can lack elevational distinctions. This means that elevational demonstratives largely refer to areas outside the peripersonal sphere in a similar way as simple distal demonstratives. In the proximal domain, fine grained semantic distinctions such as those encoded by elevational demonstratives are superfluous since this domain is accessible to the interlocutors who in the default case of a normal conversation are located in close proximity to each other. I then discuss metaphorical extensions of elevational demonstratives to non-spatial uses such as temporal and social deixis. There are a few languages in which elevational demonstratives with the meaning UP express the temporal meaning future, whereas the DOWN demonstratives encode past. This finding is particularly interesting in view of the widely-debated use of Mandarin Chinese spatial terms ‘up’ for past events and ‘down’ for future events, which show the opposite metaphorical extension. I finally examine areal tendencies and potential correlations between elevational demonstratives and the geographical location of speech communities in mountainous areas such as the Himalayas, the Papuan Highlands and the Caucasus. I tentatively conclude that languages spoken in similar topographic environments do not tend to have similar systems of elevational demonstratives if they belong to different language families.

Demonstrative Reference and Semantic Space: A Large-Scale Demonstrative Choice Task Study

Spatial demonstratives (words like this and that) have been thought to primarily be used for carving up space into a peripersonal and extrapersonal domain. However, when given a noun out of context and asked to couple it with a demonstrative, speakers tend to choose this for words denoting manipulable objects (small, harmless, and inanimate), while non-manipulable objects (large, harmful, and animate) are more likely to be coupled with that. Here, we extend these findings using the Demonstrative Choice Task (DCT) procedure and map demonstrative use along a wide spectrum of semantic features. We conducted a large-scale (N = 2197) DCT experiment eliciting demonstratives for 506 words, rated across 65 + 11 perceptually and cognitively relevant semantic dimensions. We replicated the finding that demonstrative choice is influenced by object manipulability. Demonstrative choice was furthermore found to be related to a set of additional semantic factors, including valence, arousal, loudness, motion, time and more generally, the self. Importantly, demonstrative choices were highly structured across participants, as shown by a strong correlation detected in a split-sample comparison of by-word demonstrative choices. We argue that the DCT may be used to map a generalized semantic space anchored in the self of the speaker, the self being an extension of the body beyond physical space into a multidimensional semantic space.

Perspective in the conceptualization of categories

The ability to differently perceive and represent entities depending on their perspective is crucial for humans. We report five experiments that investigate how the different perspectives adopted while experiencing entities are reflected in conceptualizations (towards vs. away, near vs. far, beside vs. above, inside vs. outside and vision vs. audition vs. touch). Different groups of participants generated object properties while imagining the same scenario from different perspectives (e.g. entities coming toward them/going away from them while on a highway overpass). If conceptualizations have perspectives, then participants should produce features from a perspective entrenched in memory that reflects typical interactions with objects, independently of their assigned perspective (entrenched perspective). In addition, the perspective adopted in a given experiment should influence the properties generated (situated perspective). Results across the experiments indicate that conceptualizations contain both entrenched and situational perspectives. While entrenched perspectives emerge from canonical actions typically performed with objects, locations and entities, situational perspectives reflect online adaptations to current task contexts. The implications of the interplay between entrenched and situational perspectives for grounded cognition are discussed.

This is for you: Social modulations of proximal vs. distal space in collaborative interaction

Human spatial representations are shaped by affordances for action offered by the environment. A prototypical example is the organization of space into peripersonal (within reach) and extrapersonal (outside reach) regions, mirrored by proximal (this/here) and distal (that/there) linguistic expressions. The peri-/extrapersonal distinction has been widely investigated in individual contexts, but little is known about how spatial representations are modulated by interaction with other people. Is near/far coding of space dynamically adapted to the position of a partner when space, objects, and action goals are shared? Over two preregistered experiments based on a novel interactive paradigm, we show that, in individual and social contexts involving no direct collaboration, linguistic coding of locations as proximal or distal depends on their distance from the speaker's hand. In contrast, in the context of collaborative interactions involving turn-taking and role reversal, proximal space is shifted towards the partner, and linguistic coding of near space ('this' / 'here') is remapped onto the partner's action space.

Language beyond the language system: Dorsal visuospatial pathways support processing of demonstratives and spatial language during naturalistic fast fMRI

Spatial demonstratives are powerful linguistic tools used to establish joint attention. Identifying the meaning of semantically underspecified expressions like "this one" hinges on the integration of linguistic and visual cues, attentional orienting and pragmatic inference. This synergy between language and extralinguistic cognition is pivotal to language comprehension in general, but especially prominent in demonstratives. In this study, we aimed to elucidate which neural architectures enable this intertwining between language and extralinguistic cognition using a naturalistic fMRI paradigm. In our experiment, 28 participants listened to a specially crafted dialogical narrative with a controlled number of spatial demonstratives. A fast multiband-EPI acquisition sequence (TR = 388 m s) combined with finite impulse response (FIR) modelling of the hemodynamic response was used to capture signal changes at word-level resolution. We found that spatial demonstratives bilaterally engage a network of parietal areas, including the supramarginal gyrus, the angular gyrus, and precuneus, implicated in information integration and visuospatial processing. Moreover, demonstratives recruit frontal regions, including the right FEF, implicated in attentional orienting and reference frames shifts. Finally, using multivariate similarity analyses, we provide evidence for a general involvement of the dorsal ("where") stream in the processing of spatial expressions, as opposed to ventral pathways encoding object semantics. Overall, our results suggest that language processing relies on a distributed architecture, recruiting neural resources for perception, attention, and extra-linguistic aspects of cognition in a dynamic and context-dependent fashion.

Grammar, Gender and Demonstratives in Lateralized Imagery for Sentences

We investigated biases in the organization of imagery by asking participants to make stick-figure drawings of sentences containing a man, a woman and a transitive action (e.g. she kisses that guy). Previous findings show that prominent features of meaning and sentence structure are placed to the left in drawings, according to reading direction (e.g. Stroustrup and Wallentin in Lang Cogn 10(2):193-207, 2018. https://doi.org/10.1017/langcog.2017.19 ). Five hundred thirty participants listened to sentences in Danish and made eight drawings each. We replicated three findings: (1) that the first mentioned element is placed to the left more often, (2) that the agent in the sentence is placed to the left, and (3) that the grammatical subject is placed to the left of the object. We further tested hypotheses related to deixis and gender stereotypes. By adding demonstratives (e.g. Danish equivalents of this and that), that have been found to indicate attentional prominence, we tested the hypothesis that this is also translated into a left-ward bias in the produced drawings. We were unable to find support for this hypothesis. Analyses of gender biases tested the presence of a gender identification and a gender stereotype effect. According to the identification hypothesis, participants should attribute prominence to their own gender and draw it to the left, and according to the stereotype effect participants should be more prone to draw the male character to the left, regardless of own gender. We were not able to find significant support for either of the two gender effects. The combination of replications and null-findings suggest that the left-ward bias in the drawing experiment might be narrowly tied to left-to-right distribution in written language and less to overall prominence. No effect of handedness was observed.

Spatial demonstratives and perceptual space: To reach or not to reach?

There is much debate regarding the relationship between spatial demonstratives ('this' or 'that') and perceptual space. While some have argued for a close mapping between the use of demonstratives and the peripersonal/extrapersonal space distinction (Coventry et al., 2008, 2014; Diessel, 2014), others have argued that distance from a speaker does not affect demonstrative choice (e.g. Kemmerer, 1999; Peeters, Hagoort, & Özyürek, 2015). We investigated the mapping between demonstratives and perceptual space across sagittal and lateral planes. Manipulation of object location on the lateral plane, and the hand used to point at objects (left, right) afforded a critical test of the the mapping between demonstratives and the reachability of objects. Indeed, we found that objects positioned at the same locations were described using this when the hand pointing at the object could reach it. Furthermore, we found no overall effects of handedness or visual field on demonstratives choice. This provides strong support for a mapping between perceptual space and the use of demonstratives. Such a mapping may help explain the influence of other variables on demonstrative choice, including interactive factors.

Space Trumps Time When Talking About Objects

The nature of the relationship between the concepts of space and time in the human mind is much debated. Some claim that space is primary and that it structures time (cf. Lakoff & Johnson, 1980) while others (cf. Walsh, 2003) maintain no difference in status between them. Using fully immersive virtual reality (VR), we examined the influence of object distance and time of appearance on choice of demonstratives (this and that) to refer to objects. Critically, demonstratives can be used spatially (this/that red triangle) and temporally (this/that month). Experiment 1 showed a pattern of demonstrative usage in VR that is consistent with results found in real‐world studies. Experiments 2, 3, and 4 manipulated both when and where objects appeared, providing scenarios where participants were free to use demonstratives in either a temporal or spatial sense. Although we find evidence for time of presentation affecting object mention, the experiments found that demonstrative choice was affected only by distance. These results support the view that spatial uses of demonstratives are privileged over temporal uses.

This shoe, that tiger: Semantic properties reflecting manual affordances of the referent modulate demonstrative use

Demonstrative reference is central to human communication. But what influences our choice of demonstrative forms such as “this” and “that” in discourse? Previous literature has mapped the use of such “proximal” and “distal” demonstratives onto spatial properties of referents, such as their distance from the speaker. We investigated whether object semantics, and specifically functional properties of referents, also influence speakers’ choices of either demonstrative form. Over two experiments, we presented English, Danish and Italian speakers with words denoting animate and inanimate objects, differing in size and harmfulness, and asked them to match them with a proximal or a distal demonstrative. Objects that offer more affordances for manipulation (smaller and harmless) elicited significantly more proximal demonstratives. These effects were stronger for inanimate referents, in line with the predictions of sensory-functional views on object semantics. These results suggest that demonstrative use may be partly grounded on manual affordances, and hints at the possibility of using demonstratives as a proxy to investigate the organization of semantic knowledge.

The (Spatial) Memory Game: Testing the Relationship Between Spatial Language, Object Knowledge, and Spatial Cognition

The memory game paradigm is a behavioral procedure to explore the relationship between language, spatial memory, and object knowledge. Using two different versions of the paradigm, spatial language use and memory for object location are tested under different, experimentally manipulated conditions. This allows us to tease apart proposed models explaining the influence of object knowledge on spatial language (e.g., spatial demonstratives), and spatial memory, as well as understanding the parameters that affect demonstrative choice and spatial memory more broadly. Key to the development of the method was the need to collect data on language use (e.g., spatial demonstratives: "this/that") and spatial memory data under strictly controlled conditions, while retaining a degree of ecological validity. The language version (section 3.1) of the memory game tests how conditions affect language use. Participants refer verbally to objects placed at different locations (e.g., using spatial demonstratives: "this/that red circle"). Different parameters can be experimentally manipulated: the distance from the participant, the position of a conspecific, and for example whether the participant owns, knows, or sees the object while referring to it. The same parameters can be manipulated in the memory version of the memory game (section 3.2). This version tests the effects of the different conditions on object-location memory. Following object placement, participants get 10 seconds to memorize the object's location. After the object and location cues are removed, participants verbally direct the experimenter to move a stick to indicate where the object was. The difference between the memorized and the actual location shows the direction and strength of the memory error, allowing comparisons between the influences of the respective parameters.

Language Use in Joint Action: The Means of Referring Expressions

This study examined how human–human collaboration can be achieved through an exchange of verbal information in exchanging information about the referents in a joint action. Knowing other people’s referential intention is fundamental for joint action. Joint action can be achieved verbally by two types of referring expressions, namely, symbolic and deictic referring expressions. Using corpus data, we extracted nouns as typical symbolic references and demonstratives as typical deictic references. We examined whether the word usage of these terms changed when the robot vehicles controlled by the participants repeatedly performed the same collaborative task. We used a novel virtual space for the task because we wanted to control the common ground shared by the participants. The results of the performance indicate that the task completion became more efficient as the participants repeated the task. The referential word use was reduced in both symbolic and deictic references, and this reduction occurred with a grounding process among the collaborators. The study showed that reduction of referential expressions occurs with the grounding process in human–human collaboration and suggests that appropriate collaborative robot systems must deal with the reduction process of referencing in humans.

Identification of opposites and intermediates by eye and by hand

In this eye-tracking and drawing study, we investigate the perceptual grounding of different types of spatial dimensions such as dense-sparse and top-bottom, focusing both on the participants' experiences of the opposite regions, e.g., O1: dense; O2: sparse, and the region that is experienced as intermediate, e.g., INT: neither dense nor sparse. Six spatial dimensions expected to have three different perceptual structures in terms of the point and range nature of O1, INT and O2 were analysed. Presented with images, the participants were instructed to identify each region (O1, INT, O2), first by looking at the region, and then circumscribing it using the computer mouse. We measured the eye movements, identification times and various characteristics of the drawings such as the relative size of the three regions, overlaps and gaps. Three main results emerged. Firstly, generally speaking, intermediate regions were not different from the poles on any of the indicators: overall identification times, number of fixations, and locations. Some differences emerged with regard to the duration of fixations for point INTs and the number of fixations for range INTs between two range poles (O1, O2). Secondly, the analyses of the fixation locations showed that the poles support the identification of the intermediate region as much as the intermediate region supports the identification of the poles. Finally, the relative size of the three areas selected in the drawing task were consistent with the classification of the regions as points or ranges. The analyses of the gaps and the overlaps between the three areas showed that the intermediate is neither O1 nor O2, but an entity in its own right.

Cues of control modulate the ascription of object ownership

Knowing whether an object is owned and by whom is essential to avoid costly conflicts. We hypothesize that everyday interactions around objects are influenced by a minimal sense of object ownership grounded on respect of possession. In particular, we hypothesize that tracking object ownership can be influenced by any cue that predicts the establishment of individual physical control over objects. To test this hypothesis we used an indirect method to determine whether visual cues of physical control like spatial proximity to an object, temporal priority in seeing it, and touching it influence this minimal sense of object ownership. In Experiment 1 participants were shown a neutral object located on a table, in the reaching space of one of two characters. In Experiment 2 one character was the first to find the object then another character appeared and saw the object. In Experiments 3 and 4, spatial proximity, temporal priority, and touch are pitted against each other to assess their relative weight. After having seen the scenes, participants were required to judge the sensibility of sentences in which ownership of the object was ascribed to one of the two characters. Responses were faster when the objects were located in the reaching space of the character to whom ownership was ascribed in the sentence and when ownership was ascribed to the character who was the first to find the object. When contrasting the relevant cues, results indicate that touch is stronger than temporal priority in modulating the ascription of object ownership. However, all these effects were also influenced by contextual social cues like the gender of both characters and participants, the presence of a third-party observer, and the co-presence of characters. Consistently with our hypothesis, results indicate that many different cues of physical control influence the ascription of ownership in daily social contexts.

Language and memory for object location

In three experiments, we investigated the influence of two types of language on memory for object location: demonstratives (this, that) and possessives (my, your). Participants first read instructions containing demonstratives/possessives to place objects at different locations, and then had to recall those object locations (following object removal). Experiments 1 and 2 tested contrasting predictions of two possible accounts of language on object location memory: the Expectation Model (Coventry, Griffiths, & Hamilton, 2014) and the congruence account (Bonfiglioli, Finocchiaro, Gesierich, Rositani, & Vescovi, 2009). In Experiment 3, the role of attention allocation as a possible mechanism was investigated. Results across all three experiments show striking effects of language on object location memory, with the pattern of data supporting the Expectation Model. In this model, the expected location cued by language and the actual location are concatenated leading to (mis)memory for object location, consistent with models of predictive coding (Bar, 2009; Friston, 2003).