Contextual Integration in Multiparty Audience Design

Keeping track of who knows what in multiparty conversation despite severe memory impairment

Language use has long been understood to be tailored to the intended addressee, a process termed audience design. Audience design is reflected in multiple aspects of language use, including adjustments based on the addressee's knowledge about the topic at hand. In group settings, audience design depends on representations of multiple individuals, each of whom may have different knowledge about the conversational topic. A central question, then, concerns how these representations are encoded and retrieved in multiparty conversation where successful conversation requires keeping track of who knows what. In the present research, we probe the biological memory systems that are involved in this process of multiparty audience design. We present the results of two experiments that compare language use in persons with bilateral hippocampal damage and severe declarative memory impairment (amnesia), and demographically matched neurotypical comparison participants. Participants played a game in which they discussed abstract images with one partner in conversation, and then discussed the images again with the same partner or with a new partner in a three-party conversation. Neurotypical participants' language use reflected newly formed representations of which partner was familiar with which images. Participants with amnesia showed evidence of partner-specific audience design in multiparty conversation but it was attenuated, especially when success required rapid alternations between representations of common ground. The findings suggest partial independence of the formation and use of partner-specific representations from the hippocampal-dependent declarative memory system and highlight the unique contributions of the declarative memory system to flexible and dynamic language use.

Direct and indirect linguistic measures of common ground in dialogue studies involving a matching task: A systematic review

During dialogue, speakers attempt to adapt messages to their addressee appropriately by taking into consideration their common ground (i.e., all the information mutually known by the conversational partners) to ensure successful communication. Knowing and remembering what information is part of the common ground shared with a given partner and using it during dialogue are crucial skills for social interaction. It is therefore important to better understand how we can measure the use of common ground and to identify the potential associated psychological processes. In this context, a systematic review of the literature was performed to list the linguistic measures of common ground found in dialogue studies involving a matching task and to explore any evidence of cognitive and social mechanisms underlying common ground use in this specific experimental setting, particularly in normal aging and in neuropsychological studies. Out of the 23 articles included in this review, we found seven different linguistic measures of common ground that were classified as either a direct measure of common ground (i.e., measures directly performed on the referential content) or an indirect measure of common ground (i.e., measures assessing the general form of the discourse). This review supports the idea that both types of measures should systematically be used while assessing common ground because they may reflect different concepts underpinned by distinct psychological processes. Given the lack of evidence for the implication of other cognitive and social functions in common ground use in studies involving matching tasks, future research is warranted, particularly in the clinical field.

What's your point? Insights from virtual reality on the relation between intention and action in the production of pointing gestures

Human communication involves the process of translating intentions into communicative actions. But how exactly do our intentions surface in the visible communicative behavior we display? Here we focus on pointing gestures, a fundamental building block of everyday communication, and investigate whether and how different types of underlying intent modulate the kinematics of the pointing hand and the brain activity preceding the gestural movement. In a dynamic virtual reality environment, participants pointed at a referent to either share attention with their addressee, inform their addressee, or get their addressee to perform an action. Behaviorally, it was observed that these different underlying intentions modulated how long participants kept their arm and finger still, both prior to starting the movement and when keeping their pointing hand in apex position. In early planning stages, a neurophysiological distinction was observed between a gesture that is used to share attitudes and knowledge with another person versus a gesture that mainly uses that person as a means to perform an action. Together, these findings suggest that our intentions influence our actions from the earliest neurophysiological planning stages to the kinematic endpoint of the movement itself.

A modified procedure for naming 332 pictures and collecting norms: Using tangram pictures in psycholinguistic studies

Tangram pictures are abstract pictures which may be used as stimuli in various fields of experimental psychology and are often used in the field of dialogue psychology. The present study provides the first norms for a set of 332 tangram pictures. These pictures were standardized on a set of variables classically used in the literature on cognitive processes, such as visual perception, language, and memory: name agreement, image agreement, familiarity, visual complexity, image variability, and age of acquisition. Furthermore, norms for concreteness were also provided owing to the influence of this variable on the processes involved in lexical production. Correlational analyses on all variables were performed on the data collected from French native speakers. This new set of standardized pictures constitutes a reliable database for researchers when they select tangram pictures. Given the abstract nature of tangram pictures, this paper also discusses the similarities and differences with the literature on line drawings, and highlights their value for dialogue psychology studies, for psycholinguistics studies, and for cognitive psychology in general.

What is retained about common ground? Distinct effects of linguistic and visual co-presence

Common ground can be mutually established between conversational partners in several ways. We examined whether the modality (visual or linguistic) with which speakers share information with their conversational partners results in memory traces that affect subsequent references addressed to a particular partner. In 32 triads, directors arranged a set of tangram cards with one matcher and then with another, but in different modalities, sharing some cards only linguistically (by describing cards the matcher couldn't see), some only visually (by silently showing them), some both linguistically and visually, and others not at all. Then directors arranged the cards again in separate rounds with each matcher. The modality with which they previously established common ground about a particular card with a particular matcher (e.g., linguistically with one partner and visually with the other) affected subsequent referring: References to cards previously shared only visually included more idea units, words, and reconceptualizations than those shared only linguistically, which in turn included more idea units, words, and reconceptualizations than those shared both linguistically and visually. Moreover, speakers were able to tailor references to the same card appropriately to the distinct modality shared with each addressee. Such gradient, partner-specific adaptation during re-referring suggests that memory encodes rich-enough representations of multimodal shared experiences to effectively cue relevant constraints about the perceptual conditions under which speakers and addressees establish common ground.

Partner-Specific Communication Deficits in Individuals With Alzheimer's Disease

Purpose Speakers adjust referential expressions to the listeners' knowledge while communicating, a phenomenon called "audience design." While individuals with Alzheimer's disease (AD) show difficulties in discourse production, it is unclear whether they exhibit preserved partner-specific audience design. The current study examined if individuals with AD demonstrate partner-specific audience design skills. Method Ten adults with mild-to-moderate AD and 12 healthy older adults performed a referential communication task with two experimenters (E1 and E2). At first, E1 and participants completed an image-sorting task, allowing them to establish shared labels. Then, during testing, both experimenters were present in the room, and participants described images to either E1 or E2 (randomly alternating). Analyses focused on the number of words participants used to describe each image and whether they reused shared labels. Results During testing, participants in both groups produced shorter descriptions when describing familiar images versus new images, demonstrating their ability to learn novel knowledge. When they described familiar images, healthy older adults modified their expressions depending on the current partner's knowledge, producing shorter expressions and more established labels for the knowledgeable partner (E1) versus the naïve partner (E2), but individuals with AD were less likely to do so. Conclusions The current study revealed that both individuals with AD and the control participants were able to acquire novel knowledge, but individuals with AD tended not to flexibly adjust expressions depending on the partner's knowledge state. Conversational inefficiency and difficulties observed in AD may, in part, stem from disrupted audience design skills.