Individual differences in nonlinguistic event categorization predict later motion verb comprehension

Assessing receptive verb knowledge in late talkers and autistic children: advances and cautionary tales

PURPOSE

Using eye-tracking, we assessed the receptive verb vocabularies of age-matched late talkers and typically developing children (experiment 1) and autistic preschoolers (experiment 2). We evaluated how many verbs participants knew and how quickly they processed the linguistic prompt. Our goal is to explore how these eye-gaze measures can be operationalized to capture verb knowledge in late talkers and autistic children.

METHOD

Participants previewed two dynamic scenes side-by-side (e.g., "stretching" and "clapping") and were then prompted to find the target verb's referent. Children's eye-gaze behaviors were operationalized using established approaches in the field with modifications in consideration for the type of stimuli (dynamic scenes versus static images) and the populations included. Accuracy was calculated as a proportion of time spent looking to the target, and linguistic processing was operationalized as latency of children's first look to the target.

RESULTS

In experiment 1, there were no group differences in the proportion of verbs known, but late talkers required longer to demonstrate their knowledge than typically developing children. Latency was predicted by age but not language abilities. In experiment 2, autistic children's accuracy and latency were both predicted by receptive language abilities.

CONCLUSION

Eye gaze can be used to assess receptive verb vocabulary in a variety of populations, but in operationalizing gaze behavior, we must account for between- and within-group differences. Bootstrapped cluster-permutation analysis is one way to create individualized measures of children's gaze behavior, but more research is warranted using an individual differences approach with this type of analysis.

Assessing receptive verb knowledge in late talkers and autistic children: Advances and cautionary tales

Purpose

Using eye-tracking, we assessed the receptive verb vocabularies of late talkers and typically developing children (Experiment 1) and autistic preschoolers (Experiment 2). We evaluated how many verbs participants knew and how quickly they processed the linguistic prompt.

Method

Participants previewed two dynamic scenes side-by-side (e.g., "stretching" and "clapping") and were then prompted to find the target verb. Children's eye gaze behaviors were operationalized using established approaches in the field with modifications in consideration for the type of stimuli (dynamic scenes versus static images) and the populations included. Accuracy was calculated as a proportion of time spent looking to the target, and linguistic processing was operationalized as latency of children's first look to the target.

Results

In Experiment 1, there were no group differences in the proportion of verbs known, but late talkers required longer to demonstrate their knowledge than typically developing children. Latency was predicted by age but not language abilities. In Experiment 2, autistic children's accuracy and latency were both predicted by receptive language abilities.

Conclusion

Eye gaze can be used to assess receptive verb vocabulary in a variety of populations, but in operationalizing gaze behavior, we must account for between- and within-group differences. Bootstrapped cluster-permutation analysis is one way to create individualized measures of children's gaze behavior, but more research is warranted using an individual differences approach with this type of analysis. Finally, latency may not be a valid measure for dynamic scene stimuli for children under three years old.

Sensitivity to visual cues within motion events in monolingual and bilingual infants

It is well known that infants undergo developmental change in how they respond to language-relevant visual contrasts. For example, when viewing motion events, infants' sensitivities to background information ("ground-path cues," e.g., whether a background is flat and continuous or bounded) change with age. Prior studies with English and Japanese monolingual infants have demonstrated that 14-month-old infants discriminate between motion events that take place against different ground-paths (e.g., an unbounded field vs a bounded street). By 19 months of age, this sensitivity becomes more selective in monolingual infants; only learners of languages that lexically contrast these categories, such as Japanese, discriminate between such events. In this study, we investigated this progression in bilingual infants. We first replicated past reports of an age-related decline in ground-path sensitivity from 14 to 19 months in English monolingual infants living in a multilingual society. English-Mandarin bilingual infants living in that same society were then tested on discrimination of ground-path cues at 14, 19, and 24 months. Although neither the English nor Mandarin language differentiates motion events based on ground-path cues, bilingual infants demonstrated protracted sensitivity to these cues. Infants exhibited a lack of discrimination at 14 months, followed by discrimination at 19 months and a subsequent decline in discrimination at 24 months. In addition, bilingual infants demonstrated more fine-grained sensitivities to subtle ground cues not observed in monolingual infants.

Early parental causal language input predicts children's later causal verb understanding

How does parental causal input relate to children's later comprehension of causal verbs? Causal constructions in verbs differ across languages. Turkish has both lexical and morphological causatives. We asked whether (1) parental causal language input varied for different types of play (guided vs. free play), (2) early parental causal language input predicted children's causal verb understanding. Twenty-nine infants participated at three timepoints. Parents used lexical causatives more than morphological ones for guided-play for both timepoints, but for free-play, the same difference was only found at Time 2. For Time 3, children were tested on a verb comprehension and a vocabulary task. Morphological causative input, but not lexical causative input, during free-play predicted children's causal verb comprehension. For guided-play, the same relation did not hold. Findings suggest a role of specific types of causal input on children's understanding of causal verbs that are received in certain play contexts.

Consistency and inconsistency in caregiver reporting of vocabulary

Vocabulary checklists completed by caregivers are a common way of measuring children's vocabulary knowledge. We provide evidence from checklist data from 31 children with and without autism spectrum disorder. When asked to report twice about whether or not their child produces a particular word, caregivers are largely consistent in their responses, but where they are inconsistent, these inconsistencies affect verbs more than nouns. This difference holds both for caregivers of children with autism spectrum disorder and caregivers of typically-developing children. We suggest that caregivers may be less sure of their child's knowledge about verbs than nouns. This data converges with prior evidence comparing language samples of words children produce in a recorded interaction with checklist data, and it has implications for how researchers use checklist data in cases where the reliability of estimates of verb knowledge is critical.

Processing Verb Meanings and the Declarative/Procedural Model: A Developmental Study

According to the Declarative/Procedural Model, the lexicon depends on declarative memory while grammar relies on procedural memory. Furthermore, procedural memory underlies the sequential processing of language. Thus, this system is important for predicting the next item in a sentence. Verb processing represents a good candidate to test this assumption. Semantic representations of verbs include information about the protagonists in the situations they refer to. This semantic knowledge is acquired implicitly and used during verb processing, such that the processing of a verb preactivates its typical patients (e.g., the window for break). Thus, determining how the patient typicality effect appears during children’s cognitive development could provide evidence about the memory system that is dedicated to this effect. Two studies are presented in which French children aged 6–10 and adults made grammaticality judgments on 80 auditorily presented sentences. In Experiment 1, the verb was followed by a typical patient or by a less typical patient. In Experiment 2, grammatical sentences were constructed such that the verb was followed either by a typical patient or by a noun that could not be a patient of that verb. The typicality effect occurs in younger children and is interpreted in terms of developmental invariance. We suggest that this effect may depend on procedural memory, in line with studies that showed that meaning is necessary to allow procedural memory to learn the sequence of words in a sentence.

Exploring the Co-occurrence of Manual Verbs and Actions in Early Mother-Child Communication

The embodiment approach has shown that motor neural networks are involved in the processing of action verbs. There is developmental evidence that embodied effects on verb processing are already present in early years. Yet, the ontogenetic origin of this motor reuse in action verbs remains unknown. This longitudinal study investigates the co-occurrence of manual verbs and actions during mother-child daily routines (free play, bathing, and dining) when children were 1 to 2 (Group 1) and 2 to 3 (Group 2) years old. Eight mother-child dyads were video-recorded in 3-month intervals across 12 months (27 recording hours), and the timing of verbs and manual actions (21,876 entries) were coded by independent observers. Results showed that the probability of matched verb-action co-occurrences were much higher (0.80 and 0.77) than that of random co-occurrences (0.13 and 0.15) for Group 1 and Group 2, respectively. The distributions of the verb-action temporal intervals in both groups were quite symmetrical and skewed with the peak corresponding to both 0.00 s synchronic intervals (8% of the cases) and the shortest +5 s interval (40% of the cases). Mother-led instances occurred in both groups whereas child-led instances were restricted to Group 2. Mothers pragmatically aligned their verbal productions, since they repeatedly used (74%) those verbs they shared with their children's repertoire (31%). In conclusion, the early multisensory communicative and manipulative scene affords grounding of verb meanings on the ongoing actions, facilitating verb-action pairing in the realm of social interactions, providing a new dimension to the prevailing solipsistic approach to embodiment.

A shared neural substrate for action verbs and observed actions in human posterior parietal cortex

High-level sensory and motor cortical areas are activated when processing the meaning of language, but it is unknown whether, and how, words share a neural substrate with corresponding sensorimotor representations. We recorded from single neurons in human posterior parietal cortex (PPC) while participants viewed action verbs and corresponding action videos from multiple views. We find that PPC neurons exhibit a common neural substrate for action verbs and observed actions. Further, videos were encoded with mixtures of invariant and idiosyncratic responses across views. Action verbs elicited selective responses from a fraction of these invariant and idiosyncratic neurons, without preference, thus associating with a statistical sampling of the diverse sensory representations related to the corresponding action concept. Controls indicated that the results are not the product of visual imagery or arbitrary learned associations. Our results suggest that language may activate the consolidated visual experience of the reader.

Lexical processing of nouns and verbs at 36 months of age predicts concurrent and later vocabulary and school readiness

Children's lexical processing speed at 18 to 25 months of age has been linked to concurrent and later language abilities. In the current study, we extend this finding to children aged 36 months. Children (N = 126) participated in a lexical processing task in which they viewed two static images on noun trials (e.g., an ear of corn and a hat), or two dynamic video clips on verb trials (e.g., a woman stretching and the same woman clapping), and heard an auditory prompt labeling one of them (e.g., "Where is she stretching?"). They also participated in standard assessments of language and school readiness. The results indicated that lexical processing speed (i.e., how long they required to look to the labeled image or scene) was associated with measures of concurrent receptive vocabulary, as well as receptive vocabulary and school readiness two years later, although the associations are weaker than for younger children.

Crossing to the other side: Language influences children's perception of event components

Infants appear to progress from universal to language-specific event perception. In Japanese, two different verbs describe a person crossing a bounded ground (e.g., street) versus an unbounded ground (e.g., field) while in English, the same verb - crossing - describes both events. Interestingly, Japanese and English 14-month-old infants form categories of Japanese ground distinctions in nonlinguistic events while by 20 months, only Japanese-reared infants retain this ability. Five experiments were conducted to investigate the role that language plays in children's ability to form categories of Japanese ground-path distinctions. Experiments 1a and 1b first replicated and extended prior research (Göksun et al., 2011) by showing that 14-month-old English-reared children formed categories of Japanese ground-path while 23-month-old children did not in the presence of general language. Experiment 2a paired a single novel word with different Japanese ground categories and found that language weakened 14-month-old infants' categorization abilities. Experiment 2b showed that labeling these event types differentially allowed 23-month-olds to recognize the Japanese ground-path distinctions that they otherwise would not have detected. To assess whether language uniquely encouraged categorization of Japanese ground-path in Experiment 2b, two different tones were paired with ground-path categories in Experiment 3. The results of Experiments 2b and 3 suggested that language but not tones encouraged ground-path categorization. This study is among the first to show that language can be used to heighten and weaken children's categorization of "non-native" event components.

An Eye-Tracking Study of Receptive Verb Knowledge in Toddlers

Purpose

We examined receptive verb knowledge in 22- to 24-month-old toddlers with a dynamic video eye-tracking test. The primary goal of the study was to examine the utility of eye-gaze measures that are commonly used to study noun knowledge for studying verb knowledge.

Method

Forty typically developing toddlers participated. They viewed 2 videos side by side (e.g., girl clapping, same girl stretching) and were asked to find one of them (e.g., "Where is she clapping?"). Their eye-gaze, recorded by a Tobii T60XL eye-tracking system, was analyzed as a measure of their knowledge of the verb meanings. Noun trials were included as controls. We examined correlations between eye-gaze measures and score on the MacArthur-Bates Communicative Development Inventories (CDI; Fenson et al., 1994), a standard parent report measure of expressive vocabulary to see how well various eye-gaze measures predicted CDI score.

Results

A common measure of knowledge-a 15% increase in looking time to the target video from a baseline phase to the test phase-did correlate with CDI score but operationalized differently for verbs than for nouns. A 2nd common measure, latency of 1st look to the target, correlated with CDI score for nouns, as in previous work, but did not for verbs. A 3rd measure, fixation density, correlated for both nouns and verbs, although the correlation went in different directions.

Conclusions

The dynamic nature of videos depicting verb knowledge results in differences in eye-gaze as compared to static images depicting nouns. An eye-tracking assessment of verb knowledge is worthwhile to develop. However, the particular dependent measures used may be different than those used for static images and nouns.

Prelinguistic foundations of verb learning: Infants discriminate and categorize dynamic human actions

Action categorization is necessary for human cognition and is foundational to learning verbs, which label categories of actions and events. In two studies using a nonlinguistic preferential looking paradigm, 10- to 12-month-old English-learning infants were tested on their ability to discriminate and categorize a dynamic human manner of motion (i.e., way in which a figure moves; e.g., marching). Study 1 results reveal that infants can discriminate a change in path and actor across instances of the same manner of motion. Study 2 results suggest that infants categorize the manner of motion for dynamic human events even under conditions in which other components of the event change, including the actor's path and the actor. Together, these two studies extend prior research on infant action categorization of animated motion events by providing evidence that infants can categorize dynamic human actions, a skill foundational to the learning of motion verbs.

Individual and developmental differences in preschoolers' categorization biases and vocabulary across tasks

This study bridges prior research on young children's use of taxonomic versus thematic relations to categorize objects with prior research on their use of shared shape versus shared function to categorize artifacts. Specifically, this research examined associations in children's categorization tendencies across these two dichotomies, including assessments of individual differences, developmental trends, and vocabulary level. Preschoolers (3- to 5-year-olds) completed a receptive vocabulary assessment and two match-to-sample tasks: one pitting (superordinate) taxonomic and thematic relations against each other and one pitting shape and function similarity against each other. The results revealed individual and developmental variation in children's cross-task categorization biases, with a predominant tendency to focus on both thematic and function relations that became increasingly stronger with age. In 3- and 5-year-olds, function-based categorization was also positively associated with verb vocabulary. These findings demonstrate an emerging tendency to focus on relational information during the preschool years that, among other learning effects, may benefit verb acquisition. The results are discussed in terms of the real-time processing and developmental factors that might contribute to the development of strategies for learning about objects and categories during early childhood.

Categorization of dynamic realistic motion events: Infants form categories of path before manner

Acquiring verbs and prepositions requires categorization of spatial relations. This study examined whether a ground object differentially influences 13- to 15-month-old English-learning infants' categorization of a figure's path (e.g., around; Experiment 1) and manner (e.g., hopping; Experiment 2) of motion in non-linguistic dynamic realistic events. Furthermore, we tested whether categorizing path is "easier" than categorizing manner. Results revealed that infants categorized path only in the presence of a ground object, validating Talmy's definition of path. In contrast, infants categorized manner only in the absence of a ground object. Finally, infants categorizing path showed stronger novelty preferences than those categorizing manner, supporting a primacy of path. Infants showed sensitivity to event components lexicalized in relational terms.