Who Did What to Whom? Children Track Story Referents First in Gesture

Preschool children's discourse competence in different genres and how it relates to iconic gestures

Based on the linguistic analysis of game explanations and retellings, the paper's goal is to investigate the relation of preschool children's situated discourse competence and iconic gestures in different communicative genres, focussing on reinforcing and supplementary speech-gesture-combinations. To this end, a method was developed to evaluate discourse competence as a context-sensitive and interactively embedded phenomenon. The so-called GLOBE-model was adapted to assess discourse competence in relation to interactive scaffolding. The findings show clear links between the children's competence and their parents' scaffolding. We suggest this to be evidence of a fine-tuned interactive support system. The results also indicate strong relations between higher discourse competence and increased frequency of iconic gestures. This applies in particular to reinforcing gestures. The results are interpreted as a confirmation that the speech-gesture system undergoes systematic changes during early childhood, and that gesturing becomes more iconic - and thus more communicative - when discourse competence is growing.

Narrative Abilities at Age 3 Are Associated Positively With Gesture Accuracy but Negatively With Gesture Rate

PURPOSE

Though the frequency of gesture use by infants has been related to the development of different language abilities in the initial stages of language acquisition, less is known about whether this frequency (or "gesture rate") continues to correlate with language measures in later stages of language acquisition, or whether the relation to language skills also depends on the accuracy with which such gestures are produced (or reproduced). This study sets out to explore whether preschoolers' narrative abilities are related to these two variables, namely, gesture rate and gesture accuracy.

METHOD

A total of 31 typically developing 3- to 4-year-old children participated in a multimodal imitation task, a context-based gesture elicitation task, and a narrative retelling task.

RESULTS

Results showed that there was a significant positive correlation between the children's narrative scores and their gesture accuracy scores, whereas higher rates of gesture use did not correlate with higher levels of narrative skill. Further multimodal regression analysis confirmed that gesture accuracy was a positive predictor of narrative performance, and moreover, showed that gesture rate was a negative predictor.

CONCLUSIONS

The fact that both gesture accuracy and gesture rate are strongly and differently linked to oral language abilities supports the claim that language and gesture are highly complex systems, and that complementary measures of gesture performance can help us assess with greater granularity the relationship between gesture and language development. These findings highlight the need to use gesture during clinical assessments as an informative indicator of language development and suggest that future research should further investigate the value of multimodal programs in the treatment of language and communication disorders.

Narrative Performance and Sociopragmatic Abilities in Preschool Children are Linked to Multimodal Imitation Skills

Over recent decades much research has analyzed the relevance of 9- to 20- month-old infants' early imitation skills (object- and language-based imitation) for language development. Yet there have been few systematic comparisons of the joint relevance of these imitative behaviors later on in development. This correlational study investigated whether multimodal imitation (gestural, prosodic, and lexical components) and object-based imitation are related to narratives and sociopragmatics in preschoolers. Thirty-one typically developing 3- to 4-year-old children performed four tasks to assess multimodal imitation, object-based imitation, narrative abilities, and sociopragmatic abilities. Results revealed that both narrative and sociopragmatic skills were significantly related to multimodal imitation, but not to object-based imitation, indicating that preschoolers' ability to imitate socially relevant multimodal cues is strongly related to language and sociocommunicative skills. Therefore, this evidence supports a broader conceptualization of imitation behaviors in the field of language development that systematically integrates prosodic, gestural, and verbal linguistic patterns.

Children Use Non-referential Gestures in Narrative Speech to Mark Discourse Elements Which Update Common Ground

While recent studies have claimed that non-referential gestures (i.e., gestures that do not visually represent any semantic content in speech) are used to mark discourse-new and/or -accessible referents and focused information in adult speech, to our knowledge, no prior investigation has studied the relationship between information structure (IS) and gesture referentiality in children’s narrative speech from a developmental perspective. A longitudinal database consisting of 332 narratives performed by 83 children at two different time points in development was coded for IS and gesture referentiality (i.e., referential and non-referential gestures). Results revealed that at both time points, both referential and non-referential gestures were produced more with information that moves discourse forward (i.e., focus) and predication (i.e., comment) rather than topical or background information. Further, at 7–9 years of age, children tended to use more non-referential gestures to mark focus and comment constituents than referential gestures. In terms of the marking of the newness of discourse referents, non-referential gestures already seem to play a key role at 5–6 years old, whereas referential gestures did not show any patterns. This relationship was even stronger at 7–9 years old. All in all, our findings offer supporting evidence that in contrast with referential gestures, non-referential gestures have been found to play a key role in marking IS, and that the development of this relationship solidifies at a period in development that coincides with a spurt in non-referential gesture production.

Identifying Patterns of Similarities and Differences between Gesture Production and Comprehension in Autism and Typical Development

Production and comprehension of gesture emerge early and are key to subsequent language development in typical development. Compared to typically developing (TD) children, children with autism spectrum disorders (ASD) exhibit difficulties and/or differences in gesture production. However, we do not yet know if gesture production either shows similar patterns to gesture comprehension across different ages and learners, or alternatively, lags behind gesture comprehension, thus mimicking a pattern akin to speech comprehension and production. In this study, we focus on the gestures produced and comprehended by a group of young TD children and children with ASD—comparable in language ability—with the goal to identify whether gesture production and comprehension follow similar patterns between ages and between learners. We elicited production of gesture in a semi-structured parent–child play and comprehension of gesture in a structured experimenter-child play across two studies. We tested whether young TD children (ages 2–4) follow a similar trajectory in their production and comprehension of gesture (Study 1) across ages, and if so, whether this alignment remains similar for verbal children with ASD (M_age = 5 years), comparable to TD children in language ability (Study 2). Our results provided evidence for similarities between gesture production and comprehension across ages and across learners, suggesting that comprehension and production of gesture form a largely integrated system of communication.

Effect of sex and dyad composition on speech and gesture development of singleton and twin children

Children's early vocabulary shows sex differences - with boys having smaller vocabularies than age-comparable girls - a pattern that becomes evident in both singletons and twins. Twins also use fewer words than their singleton peers. However, we know relatively less about sex differences in early gesturing in singletons or twins, and also how singletons and twins might differ in their early gesture use. We examine the patterns of speech and gesture production of singleton and twin children, ages 0;10-to-3;4, during structured parent-child play. Boys and girls - singleton or twin - were similar in speech and gesture production, but singletons used a greater amount and diversity of speech and gestures than twins. There was no effect of twin dyad type (boy-boy, girl-girl, boy-girl) on either speech or gesture production. These results confirm earlier research showing close integration between gesture and speech in singletons in early language development, and further extend these patterns to twin children.

The Predictive Value of Non-Referential Beat Gestures: Early Use in Parent-Child Interactions Predicts Narrative Abilities at 5 Years of Age

A longitudinal study with 45 children (Hispanic, 13%; non-Hispanic, 87%) investigated whether the early production of non-referential beat and flip gestures, as opposed to referential iconic gestures, in parent-child naturalistic interactions from 14 to 58 months old predicts narrative abilities at age 5. Results revealed that only non-referential beats significantly (p < .01) predicted later narrative productions. The pragmatic functions of the children's speech that accompany these gestures were also analyzed in a representative sample of 18 parent-child dyads, revealing that beats were typically associated with biased assertions or questions. These findings show that the early use of beats predicts narrative abilities later in development, and suggest that this relation is likely due to the pragmatic-structuring function that beats reflect in early discourse.

The Value of Non-Referential Gestures: A Systematic Review of Their Cognitive and Linguistic Effects in Children's Language Development

Speakers produce both referential gestures, which depict properties of a referent, and non-referential gestures, which lack semantic content. While a large number of studies have demonstrated the cognitive and linguistic benefits of referential gestures as well as their precursor and predictive role in both typically developing (TD) and non-TD children, less is known about non-referential gestures in cognitive and complex linguistic domains, such as narrative development. This paper is a systematic review and narrative synthesis of the research concerned with assessing the effects of non-referential gestures in such domains. A search of the literature turned up 11 studies, collectively involving 898 2- to 8-year-old TD children. Although they yielded contradictory evidence, pointing to the need for further investigations, the results of the six studies-in which experimental tasks and materials were pragmatically based-revealed that non-referential gestures not only enhance information recall and narrative comprehension but also act as predictors and causal mechanisms for narrative performance. This suggests that their bootstrapping role in language development is due to the fact that they have important discourse-pragmatic functions that help frame discourse. These findings should be of particular interest to teachers and future studies could extend their impact to non-TD children.

Introducing the NEMO-Lowlands iconic gesture dataset, collected through a gameful human-robot interaction

This paper describes a novel dataset of iconic gestures, together with a publicly available robot-based elicitation method to record these gestures, which consists of playing a game of charades with a humanoid robot. The game was deployed at a science museum (NEMO) and a large popular music festival (Lowlands) in the Netherlands. This resulted in recordings of 428 participants, both adults and children, performing 3715 silent iconic gestures for 35 different objects in a naturalistic setting. Our dataset adds to existing collections of iconic gesture recordings in two important ways. First, participants were free to choose how they represented the broad concepts using gestures, and they were asked to perform a second attempt if the robot did not recognize their gesture the first time. This provides insight into potential repair strategies that might be used. Second, by making the interactive game available we enable other researchers to collect additional recordings, for different concepts, and in diverse cultures or contexts. This can be done in a consistent manner because a robot is used as a confederate in the elicitation procedure, which ensures that every data collection session plays out in the same way. The current dataset can be used for research into human gesturing behavior, and as input for the gesture recognition and production capabilities of robots and virtual agents.