Toddlers' language-mediated visual search: they need not have the words for it

Sensitivity to Semantic Relationships in U.S. Monolingual English-Speaking Typical Talkers and Late Talkers

PURPOSE

Late talkers (LTs) are a group of children who exhibit delays in language development without a known cause. Although a hallmark of LTs is a reduced expressive vocabulary, little is known about LTs' processing of semantic relations among words in their emerging vocabularies. This study uses an eye-tracking task to compare 2-year-old LTs' and typical talkers' (TTs') sensitivity to semantic relationships among early acquired words.

METHOD

U.S. monolingual English-speaking LTs (n = 21) and TTs (n = 24) completed a looking-while-listening task in which they viewed two images on a screen (e.g., a shirt and a pizza), while they heard words that referred to one of the images (e.g., Look! Shirt!; target-present condition) or a semantically related item (e.g., Look! Hat!; target-absent condition). Children's eye movements (i.e., looks to the target) were monitored to assess their sensitivity to these semantic relationships.

RESULTS

Both LTs and TTs looked longer at the semantically related image than the unrelated image on target-absent trials, demonstrating sensitivity to the taxonomic relationships used in the experiment. There was no significant group difference between LTs and TTs. Both groups also looked more to the target in the target-present condition than in the target-absent condition.

CONCLUSIONS

These results reveal that, despite possessing smaller expressive vocabularies, LTs have encoded semantic relationships in their receptive vocabularies and activate these during real-time language comprehension. This study furthers our understanding of LTs' emerging linguistic systems and language processing skills.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.23303987.

The Development of Color Perception and Cognition

Color is a pervasive feature of our psychological experience, having a role in many aspects of human mind and behavior such as basic vision, scene perception, object recognition, aesthetics, and communication. Understanding how humans encode, perceive, talk about, and use color has been a major interdisciplinary effort. Here, we present the current state of knowledge on how color perception and cognition develop. We cover the development of various aspects of the psychological experience of color, ranging from low-level color vision to perceptual mechanisms such as color constancy to phenomena such as color naming and color preference. We also identify neurodiversity in the development of color perception and cognition and implications for clinical and educational contexts. We discuss the theoretical implications of the research for understanding mature color perception and cognition, for identifying the principles of perceptual and cognitive development, and for fostering a broader debate in the psychological sciences.

Bottom-up processes dominate early word recognition in toddlers

This study set out to investigate whether the 'phonological onset preference effect' often reported in adult studies using the visual world task (i.e., increased attention to an object that is phonologically-related to a spoken-target word, such as boat-bear) is also contingent upon toddler participants having sufficient preview time to inspect the picture stimuli. Picture preview is thought to support the activation of phonological codes which can then be matched to the phonological representations extracted from incoming speech signals and the picture stimuli, supporting the 'phonological mapping hypothesis'. We found that both toddlers and adults were able to show an early phonological onset preference in short preview conditions, though, adults' early phonological onset preferences in the short preview condition was extinguished by the presence of a semantic competitor, replicating previous adult findings (Huettig & McQueen, 2007). Removal of a semantic competitor reinstated the phonological onset preference effect under short preview conditions for adults. Our findings indicate that toddlers are driven more by bottom-up, phonological information when selecting a referent in a visual world task, as compared to adults who are more inclined to exploit top-down, semantic information when directing their attention to a visual object, especially when there is insufficient preview time. We propose that, when implicit naming is improbable in short-preview conditions, a phonological onset preference effect is driven by mapping on the visual-semantic levels, which is more susceptible to top-down influences.

Pragmatic inferences in aging and human-robot communication

Despite the increase in research on older adults' communicative behavior, little work has explored patterns of age-related change in pragmatic inferencing and how these patterns are adapted depending on the situation-specific context. In two eye-tracking experiments, participants followed instructions like "Click on the greenhouse", which were either played over speakers or spoken live by a co-present robot partner. Implicit inferential processes were measured by exploring the extent to which listeners temporarily (mis)understood the unfolding noun to be a modified phrase referring to a competitor object in the display (green hat). This competitor was accompanied by either another member of the same category or an unrelated item (tan hat vs. dice). Experiment 1 (no robot) showed clear evidence of contrastive inferencing in both younger and older adults (more looks to the green hat when the tan hat was also present). Experiment 2 explored the ability to suppress these contrastive inferences when the robot talker was known to lack any color perception, making descriptions like "green hat" implausible. Younger but not older listeners were able to suppress contrastive inferences in this context, suggesting older adults could not keep the relevant limitations in mind and/or were more likely to spontaneously ascribe human attributes to the robot. Together, the findings enhance our understanding of pragmatic inferencing in aging.

A longitudinal study of the role of vocabulary size in priming effects in early childhood

Studies on lexical development in young children often suggest that the organization of the early lexicon may vary with age and increasing vocabulary size. In the current study, we explicitly examined this suggestion in further detail using a longitudinal study of the development of phonological and semantic priming effects in the same group of toddlers at three different ages. In particular, our longitudinal design allows us to disentangle effects of increasing age and vocabulary size on priming and the extent to which vocabulary size may predict later priming effects. We tested phonological and semantic priming effects in monolingual German infants at 18, 21, and 24 months of age. We used the intermodal preferential looking paradigm combined with eye tracking to measure the influence of phonologically and semantic related/unrelated primes on target recognition. We found that phonological priming effects were predicted by participants' current vocabulary size even after controlling for participants' age and participants' early vocabulary size. Semantic priming effects were, in contrast, not predicted by vocabulary size. Finally, we also found a relationship between early phonological priming effects and later semantic priming effects as well as between early semantic priming effects and later phonological priming effects, potentially suggesting (limited) consistency in lexical structure across development. Taken together, these results highlight the important role of vocabulary size in the development of priming effects in early childhood.

Management of Procedural Pain in Children

In recent years, there has been increased interest in the study of pain in children and its treatment. It is known that when facing diagnostic and therapeutic procedures similar to those performed on adults, children either do not receive specific pain treatment or receive it on a significantly lower scale. However, recent research suggests a change in attitude and an improvement in the current treatment of children's pain. Although current knowledge demonstrates the falsity of many preconceived ideas about pain and its management, our results suggest that attitudinal change towards childhood pain remains slow and that real improvement in the training and practical application of the pediatrician who has to treat childhood pain is urgently needed. In this context, this manuscript has prepared standards and guidelines to improve pain management practices in a large number of national and international professional settings.

Perceptual similarity effect in people with Down syndrome

Background The perceptual similarity between two objects, specifically similarity in the shape of the referents, is a crucial element for relating words in earlier stages of development. The role of this perceptual similarity has not been systematically explored in children with Down syndrome (DS). Method: The aim was to explore the role of perceptual similarity in relationships between words in children with DS. Two groups, children with typical development (TD) and children with DS, matched by gender and mental age, participated in a priming task with a preferential looking paradigm. The task presented validated perceptually-related word pairs (prime-target) and perceptually unrelated pairs. In the priming task both groups were asked to look at a target image (e.g. ball) that was perceptually related (e.g. cookie) or unrelated (e.g. skirt) to the prime. Results: Participants from both groups looked more at targets without perceptual similarity than at those with similarity to the prime, suggesting an inhibition effect. Conclusions: This finding suggests the role of visual information, particularly the shape of the referents, in the construction of the lexical system.

The role of colour labels in mediating toddler visual attention

Toddlers, children and adults will spontaneously attend to a semantically- or perceptually-related object when a named target is absent from the visual scene: Upon hearing "strawberry", they will orient to a red plate rather than a yellow one. We examine the role that knowledge of feature labels plays in mediating visual attention to unnamed features. For example, does knowing the word "red", facilitate attending to red objects, though the label is not uttered? We show that toddlers systematically fixate a colour-related object, if and only if they know the name of the colour associated with the named object and the perceptually-related object. These findings suggest that knowledge of perceptual feature labels can play a central role in highlighting salient similarities between objects, both present and absent in the toddler's visual field. We discuss the implications and limitations of these findings beyond the realm of recognition of colour similarities between objects.

Multimodal parent behaviors within joint attention support sustained attention in infants

Parents support and scaffold more mature behaviors in their infants. Recent research suggests that parent-infant joint visual attention may scaffold the development of sustained attention by extending the duration of an infant's attention to an object. The open question concerns the parent behaviors that occur within joint-attention episodes and support infant sustained attention to an object. In the study, parent-infant dyads played with objects on a tabletop while their eye-gaze was recorded with head-mounted eye-trackers. Parent hand contact with the objects as well as speech were coded and analyzed to identify the presence of parent touch and talk during bouts of infant visual attention. This study, consistent with prior research, showed that joint attention is associated with longer infant visual attention. The relevant parent behaviors considered, parent talk and touch, not only were highly likely to occur when both the parent and infant visually attended to the same object, but were also associated with infant attention to an object that was longer than infant attention that did not include these parent behaviors. Parent talk was the most potent behavior that coincided with longer infant looks. In sum, joint attention extends infant attention and joint attention involves more than mutual coordination of eye-gaze, it involves multimodal parent behaviors coordinated with the infant's visual attention. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Mapping language to visual referents: Does the degree of image realism matter?

Studies of real-time spoken language comprehension have shown that listeners rapidly map unfolding speech to available referents in the immediate visual environment. This has been explored using various kinds of 2-dimensional (2D) stimuli, with convenience or availability typically motivating the choice of a particular image type. However, work in other areas has suggested that certain cognitive processes are sensitive to the level of realism in 2D representations. The present study examined the process of mapping language to depictions of objects that are more or less realistic, namely photographs versus clipart images. A custom stimulus set was first created by generating clipart images directly from photographs of real objects. Two visual world experiments were then conducted, varying whether referent identification was driven by noun or verb information. A modest benefit for clipart stimuli was observed during real-time processing, but only for noun-driving mappings. The results are discussed in terms of their implications for studies of visually situated language processing.

Biological origins of color categorization

The biological basis of the commonality in color lexicons across languages has been hotly debated for decades. Prior evidence that infants categorize color could provide support for the hypothesis that color categorization systems are not purely constructed by communication and culture. Here, we investigate the relationship between infants' categorization of color and the commonality across color lexicons, and the potential biological origin of infant color categories. We systematically mapped infants' categorical recognition memory for hue onto a stimulus array used previously to document the color lexicons of 110 nonindustrialized languages. Following familiarization to a given hue, infants' response to a novel hue indicated that their recognition memory parses the hue continuum into red, yellow, green, blue, and purple categories. Infants' categorical distinctions aligned with common distinctions in color lexicons and are organized around hues that are commonly central to lexical categories across languages. The boundaries between infants' categorical distinctions also aligned, relative to the adaptation point, with the cardinal axes that describe the early stages of color representation in retinogeniculate pathways, indicating that infant color categorization may be partly organized by biological mechanisms of color vision. The findings suggest that color categorization in language and thought is partially biologically constrained and have implications for broader debate on how biology, culture, and communication interact in human cognition.

Is a Pink Cow Still a Cow? Individual Differences in Toddlers' Vocabulary Knowledge and Lexical Representations

When a toddler knows a word, what does she actually know? Many categories have multiple relevant properties; for example, shape and color are relevant to membership in the category banana. How do toddlers prioritize these properties when recognizing familiar words, and are there systematic differences among children? In this study, toddlers viewed pairs of objects associated with prototypical colors. On some trials, objects were typically colored (e.g., Holstein cow and pink pig); on other trials, colors were switched (e.g., pink cow and Holstein-patterned pig). On each trial, toddlers were directed to find a target object. Overall, recognition was disrupted when colors were switched, as measured by eye movements. Moreover, individual differences in vocabularies predicted recognition differences: Toddlers who say fewer shape-based words were more disrupted by color switches. "Knowing" a word may not mean the same thing for all toddlers; different toddlers prioritize different facets of familiar objects in their lexical representations.

Blindness to background: an inbuilt bias for visual objects

Sixty-eight 2- to 12-year-olds and 30 adults were shown colorful displays on a touchscreen monitor and trained to point to the location of a named color. Participants located targets near-perfectly when presented with four abutting colored patches. When presented with three colored patches on a colored background, toddlers failed to locate targets in the background. Eye tracking demonstrated that the effect was partially mediated by a tendency not to fixate the background. However, the effect was abolished when the targets were named as nouns, whilst the change to nouns had little impact on eye movement patterns. Our results imply a powerful, inbuilt tendency to attend to objects, which may slow the development of color concepts and acquisition of color words. A video abstract of this article can be viewed at: https://youtu.be/TKO1BPeAiOI. [Correction added on 27 January 2017, after first online publication: The video abstract link was added.].

Predicting visual information during sentence processing: Toddlers activate an object's shape before it is mentioned

We examined the contents of language-mediated prediction in toddlers by investigating the extent to which toddlers are sensitive to visual shape representations of upcoming words. Previous studies with adults suggest limits to the degree to which information about the visual form of a referent is predicted during language comprehension in low constraint sentences. Toddlers (30-month-olds) heard either contextually constraining sentences or contextually neutral sentences as they viewed images that were either identical or shape-related to the heard target label. We observed that toddlers activate shape information of upcoming linguistic input in contextually constraining semantic contexts; hearing a sentence context that was predictive of the target word activated perceptual information that subsequently influenced visual attention toward shape-related targets. Our findings suggest that visual shape is central to predictive language processing in toddlers.

Using Colors to Assess Pain in Toddlers

Self-report, when available, is considered the ideal way to assess the intensity and other aspects of pain in children. However, self-report scales are often too complex cognitively for preschool-aged children (2-4 years). The Rainbow Pain Scale (RPS) was developed to provide individualized self-reported pain ratings for preschool-aged children. The psychometric properties of this scale have yet to be evaluated. To ensure validity, our first step was to compare RPS scores to a well-validated scale in older children who were able to self-report their pain. The purpose of this study was to assess the concurrent validity of the RPS in children aged 5 to 10 years as proof of principle. We compared ratings of 49 children’s pain using the RPS with those on the Faces Pain Scale–Revised (FPS-R). Participants suffering from pain related to cancer and cancer treatment were recruited to complete both scales at 3 time points, during both inpatient and outpatient clinic visits. Pearson’s r and Cohen’s κ were used to evaluate the level of association between the scales. The association between RPS and the FPS-R was greater than .7 at all 3 visits; r = .96 between the scales at the first clinic visit, .97 at the second visit, and .93 at the third visit. Cohen’s κ between scales was 1.0 at the first clinic visit, .95 at the second visit, and .87 at the third visit. The RPS shows excellent concurrent validity with the FPS-R in school-aged children. The next step will be to examine the psychometric properties of the RPS in preschool-aged children.

Words, shape, visual search and visual working memory in 3-year-old children

Do words cue children's visual attention, and if so, what are the relevant mechanisms? Across four experiments, 3-year-old children (N = 163) were tested in visual search tasks in which targets were cued with only a visual preview versus a visual preview and a spoken name. The experiments were designed to determine whether labels facilitated search times and to examine one route through which labels could have their effect: By influencing the visual working memory representation of the target. The targets and distractors were pictures of instances of basic-level known categories and the labels were the common name for the target category. We predicted that the label would enhance the visual working memory representation of the target object, guiding attention to objects that better matched the target representation. Experiments 1 and 2 used conjunctive search tasks, and Experiment 3 varied shape discriminability between targets and distractors. Experiment 4 compared the effects of labels to repeated presentations of the visual target, which should also influence the working memory representation of the target. The overall pattern fits contemporary theories of how the contents of visual working memory interact with visual search and attention, and shows that even in very young children heard words affect the processing of visual information.

Toddlers Activate Lexical Semantic Knowledge in the Absence of Visual Referents: Evidence from Auditory Priming

Language learners rapidly acquire extensive semantic knowledge, but the development of this knowledge is difficult to study, in part because it is difficult to assess young children's lexical semantic representations. In our studies, we solved this problem by investigating lexical semantic knowledge in 24-month-olds using the Head-turn Preference Procedure. In Experiment 1, looking times to a repeating spoken word stimulus (e.g., kitty-kitty-kitty) were shorter for trials preceded by a semantically related word (e.g., dog-dog-dog) than trials preceded by an unrelated word (e.g., juice-juice-juice). Experiment 2 yielded similar results using a method in which pairs of words were presented on the same trial. The studies provide evidence that young children activate of lexical semantic knowledge, and critically, that they do so in the absence of visual referents or sentence contexts. Auditory lexical priming is a promising technique for studying the development and structure of semantic knowledge in young children.

What's in a link: associative and taxonomic priming effects in the infant lexicon

Infants develop a lexical-semantic system of associatively and semantically related words by the end of the second year of life. However, the precise nature of the lexical relationships that underpin the structure-building process remains under-determined. We compare two types of lexical-semantic relationship, associative and taxonomic, using a lexical-priming adaption of the intermodal preferential looking task with 21- and 24-month-olds. Prime-target word pairs were either associatively or taxonomically related or unrelated. A further control condition evaluated the facility of a prime word, in the absence of a target word, to promote target preferences. Twenty-four-month-olds, but not 21-month-old infants, exhibited a priming effect in both associative and taxonomic conditions, pointing to the formation of a lexical-semantic network driven by both associative and taxonomic relatedness late in the second year. The pattern of priming in 24-month-olds indicates the operation of inhibitory processes: unrelated primes interfere with target recognition whereas related primes do not. We argue that taxonomic and associative relationships between words are integral to the emergence of a structured lexicon and discuss the importance of inhibitory mechanisms in shaping early lexical-semantic memory.

Mechanisms and representations of language-mediated visual attention

The experimental investigation of language-mediated visual attention is a promising way to study the interaction of the cognitive systems involved in language, vision, attention, and memory. Here we highlight four challenges for a mechanistic account of this oculomotor behavior: the levels of representation at which language-derived and vision-derived representations are integrated; attentional mechanisms; types of memory; and the degree of individual and group differences. Central points in our discussion are (a) the possibility that local microcircuitries involving feedforward and feedback loops instantiate a common representational substrate of linguistic and non-linguistic information and attention; and (b) that an explicit working memory may be central to explaining interactions between language and visual attention. We conclude that a synthesis of further experimental evidence from a variety of fields of inquiry and the testing of distinct, non-student, participant populations will prove to be critical.