Word-object and action-object association learning across early development

Better in sync: Temporal dynamics explain multisensory word-action-object learning in early development

We investigated the temporal impact of multisensory settings on children's learning of word-object and action-object associations at 1- and 2-years of age. Specifically, we examined whether the temporal alignment of words and actions influenced the acquisition of novel word-action-object associations. We used a preferential looking and violation of expectation task in which infants and young children were first presented with two distinct word-object and action-object pairings either in a synchronous (overlapping in time) or sequential manner (one after the other). Findings revealed that 2-year-olds recognized both, action-object and word-object associations when they first saw the word-action-object combinations synchronously, but not sequentially, as evidenced by looking behavior. 1-year-olds did not show evidence for recognition for either of the word-object and action-object pairs, regardless of the initial temporal alignment of these cues. To control for individual differences, we explored factors that might influence associative learning based on parental reports of 1- and 2-year-olds development, however, developmental measures did not explain word-action-object associative learning in either group. We discuss that while young children may benefit from the temporal alignment of multisensory cues as it enables them to actively engage with the multisensory content in real-time, infants may have been overwhelmed by the complexity of this input.

The impact of goal saliency and verbal information on selective imitation in 16- to 18-month-olds

This study aimed to assess which action component (movement or goal) infants prioritize in their imitation behavior when they get information about its relevance from two important sources: perceptual goal saliency and experimenter's verbal information. 16- to 18-month-olds (N = 72) observed how the experimenter moved a toy mouse with a hopping or sliding movement onto one of two empty spaces (low goal saliency) or 2D circles (medium saliency), or inside one of two 3D houses (high saliency). Before the demonstration, the experimenter verbally announced the movement style or the goal. Results showed that verbal action descriptions did not influence infants' imitation. However, matching previous findings, infants imitated the goal more often than the movement in the high-saliency condition, and the movement more often than the goal in the low-saliency condition. Moreover, in the novel medium-saliency condition, infants imitated both components equally often. Thus, selective imitation varied as a function of perceptual goal saliency, but not of verbal cues. This suggests that perceptual features can enhance infants' bottom-up processing and imitation of action components, while the impact of top-down processes based on verbal cues may vary depending on task characteristics and infants' verbal abilities, inducing a need for further research.

Words and arbitrary actions in early object categorization: weak evidence for a word advantage

Both words and gestures have been shown to influence object categorization, often even overriding perceptual similarities to cue category membership. However, gestures are often meaningful to infants while words are arbitrarily related to an object they refer to, more similar to arbitrary actions that can be performed on objects. In this study, we examine how words and arbitrary actions shape category formation. Across three conditions (word cue, action cue, word-action cue), we presented infants (N = 90) with eight videos of single-category objects which vary in colour and other perceptual features. The objects were either accompanied by a word and/or an action that is being performed on the object. Infants in the word and action condition showed a decrease in looking over the course of the familiarization phase indicating habituation to the category, but infants in the word-action condition did not. At test, infants saw a novel object of the just-learned category and a novel object from another category side-by-side on the screen. There was some evidence for an advantage for words in shaping early object categorization, although we note that this was not robust across analyses.

Does Movement Contextually Cue Attention During Novel Word Exposure? A Comparison of Preschool Children With Developmental Language Disorder and With Typical Language

PURPOSE

This study investigated the attentional tendencies of preschool children with developmental language disorder (DLD) and their typical language (TL) peers during a word learning task to examine what visual properties of novel objects capture their attention.

METHOD

Twelve children with DLD and 12 children with TL completed a novel name extension task in which they selected which of three visual characteristics of referent objects (i.e., movement, color, pattern) was relevant during novel word-novel referent pairings. No visual feature was more relevant than the others; consequently, there were no correct and no incorrect responses.

RESULTS

Children with DLD were systematically different from their TL peers in which visual features of objects they attended to during nonword-novel referent pairings in that they selected movement as the relevant feature of novel objects more often than TL children. There was also a significant negative correlation between chronological age and the propensity for movement selections.

CONCLUSIONS

In most cases, word learning involves mapping the auditory signal onto visual information. Identifying what children with DLD naturally attend to when exposed to novel word-novel referent pairings is an important first step in order to better understand how to design effective and efficient word learning interventions with this population.

When "shoe" becomes free from "putting on": The link between early meanings of object words and object-specific actions

Nouns referring to objects dominate children's early vocabulary over verbs referring to actions. However, some scholars have argued that early object-word meanings cannot be easily classified into specific object categories; rather, they have much undifferentiated meanings in which both objects and their specific actions are intertwined. We experimentally investigated this view using a two-alternative forced-choice task involving toddlers aged 18-23 months (n = 69). Both the cross-sectional and longitudinal results suggested that unlike older toddlers, younger ones could not select the correct referents when objects and object-specific actions were presented separately (e.g., "doing a filler action with shoes" vs. "putting on filler objects as if they were shoes") despite being successful when both were matched (e.g., "putting shoes on" vs. "doing a filler action with filler objects"). Additionally, toddlers failed to judge object-word referents solely by object-specific actions. These results indicated that early object-word meanings constitute the undifferentiated fusion of both objects and actions, and they subsequently differentiate into specific object categories independent of actions. Furthermore, the extent of such semantic differentiation is associated with the vocabulary growth of action words, suggesting that object-word meaning differentiation encouraged toddlers to develop new labels that could distinguish specific actions from objects. These findings revealed the uniqueness of young children's object-word comprehension, which is different from that of adults.

How Many Palabras? Codeswitching and Lexical Diversity in Spanish-English Picture Books

Bilingual picture books have been growing in popularity, with caregivers, teachers, and researchers increasingly interested in understanding how picture books might be able to support the learning of words in two languages. In this study, we present the first evaluation of the quantity and quality of text contained within bilingual picture books in English and Spanish targeted to children ages 0–9 and available to parents in the United States. We focus specifically on a sample of codeswitching books (N = 45) which present text in one language embedded in another language. All books were transcribed and evaluated for (1) the number of words and utterances presented in each language; (2) the quality and complexity of text presented in each language; and (3) how switching occurred between the two languages. Results showed that although picture books in our sample presented predominantly English text and more complex English sentences, relatively more unique words were presented in Spanish. Furthermore, picture books in our sample presented frequent switching between languages, particularly within utterances. We suggest that bilingual picture books provide children with potentially enriching yet asymmetrical opportunities for learning in each language.

The temporal structure of naming events differentially affects children's and adults' cross-situational word learning

To acquire novel words, learners often need to integrate information about word meanings across ambiguous learning events distributed in time. How does the temporal structure of those word learning events affect what learners encode? How do the effects of temporal structure differ in children and adults? In the current experiments, we asked how 4- to 7-year-old children's (N = 110) and adults' (N = 90) performance on a cross-situational word learning task is influenced by the temporal distribution of learning events. We tested participants in three training conditions, manipulating the number of trials that separated naming events for specific objects. In the Unstructured condition, the temporal distribution was varied; in the Massed condition, naming events occurred with few interleaved trials; and in the Interleaved condition, naming events occurred with many interleaved trials. Adults showed substantially larger benefits from the Massed condition than children, whereas children were equally successful at learning in the Massed and Interleaved conditions. These results provide evidence that adults differ from children in how they exploit temporal structure during cross-situational word learning.

Consistency of co-occurring actions influences young children's word learning

Communication with young children is often multimodal in nature, involving, for example, language and actions. The simultaneous presentation of information from both domains may boost language learning by highlighting the connection between an object and a word, owing to temporal overlap in the presentation of multimodal input. However, the overlap is not merely temporal but can also covary in the extent to which particular actions co-occur with particular words and objects, e.g. carers typically produce a hopping action when talking about rabbits and a snapping action for crocodiles. The frequency with which actions and words co-occurs in the presence of the referents of these words may also impact young children's word learning. We, therefore, examined the extent to which consistency in the co-occurrence of particular actions and words impacted children's learning of novel word-object associations. Children (18 months, 30 months and 36-48 months) and adults were presented with two novel objects and heard their novel labels while different actions were performed on these objects, such that the particular actions and word-object pairings always co-occurred (Consistent group) or varied across trials (Inconsistent group). At test, participants saw both objects and heard one of the labels to examine whether participants recognized the target object upon hearing its label. Growth curve models revealed that 18-month-olds did not learn words for objects in either condition, and 30-month-old and 36- to 48-month-old children learned words for objects only in the Consistent condition, in contrast to adults who learned words for objects independent of the actions presented. Thus, consistency in the multimodal input influenced word learning in early childhood but not in adulthood. In terms of a dynamic systems account of word learning, our study shows how multimodal learning settings interact with the child's perceptual abilities to shape the learning experience.