Using saliency maps to separate competing processes in infant visual cognition

Revisiting perceptual sensitivity to non-native speech in a diverse sample of bilinguals

Werker and Tees (1984) prompted decades of research attempting to detail the paths infants take towards specialisation for the sounds of their native language(s). Most of this research has examined the trajectories of monolingual children. However, it has also been proposed that bilinguals, who are exposed to greater phonetic variability than monolinguals and must learn the rules of two languages, may remain perceptually open to non-native language sounds later into life than monolinguals. Using a visual habituation paradigm, the current study tests this question by comparing 15- to 18-month-old monolingual and bilingual children's developmental trajectories for non-native phonetic consonant contrast discrimination. A novel approach to the integration of stimulus presentation software with eye-tracking software was validated for objective measurement of infant looking time. The results did not support the hypothesis of a protracted period of sensitivity to non-native phonetic contrasts in bilingual compared to monolingual infants. Implications for diversification of perceptual narrowing research and implementation of increasingly sensitive measures are discussed.

Developmental differences in the impact of perceptual salience on short-term memory performance and meta-memory skills

In everyday life, individuals are surrounded by many stimuli that compete to access attention and memory. Evidence shows that perceptually salient stimuli have more chances to capture attention resources, thus to be encoded into short-term memory (STM). However, the impact of perceptual salience on STM at different developmental stages is entirely unexplored. Here we assessed STM performance and meta-memory skills of 6, 10, and 18 years-old participants (total N = 169) using a delayed match-to-sample task. On each trial, participants freely explored a complex (cartoon-like) scene for 4 s. After a retention interval of 4 s, they discriminated the same/different position of a target-object extracted from the area of maximal or minimal salience of the initially-explored scene. Then, they provided a confidence judgment of their STM performance, as an index of meta-memory skills. When taking into account 'confident' responses, we found increased STM performance following targets at maximal versus minimal salience only in adult participants. Similarly, only adults showed enhanced meta-memory capabilities following maximal versus minimal salience targets. These findings documented a late development in the impact of perceptual salience on STM performance and in the improvement of metacognitive capabilities to properly judge the content of one's own memory representation.

Developmental changes in natural scene viewing in infancy

We extend decades of research on infants' visual processing by examining their eye gaze during viewing of natural scenes. We examined the eye movements of a racially diverse group of 4- to 12-month-old infants (N = 54; 27 boys; 24 infants were White and not Hispanic, 30 infants were African American, Asian American, mixed race and/or Hispanic) as they viewed images selected from the MIT Saliency Benchmark Project. In general, across this age range infants' fixation distributions became more consistent and more adult-like, suggesting that infants' fixations in natural scenes become increasingly more systematic. Evaluation of infants' fixation patterns with saliency maps generated by different models of physical salience revealed that although over this age range there was an increase in the correlations between infants' fixations and saliency, the amount of variance accounted for by salience actually decreased. At the youngest age, the amount of variance accounted for by salience was very similar to the consistency between infants' fixations, suggesting that the systematicity in these youngest infants' fixations was explained by their attention to physically salient regions. By 12 months, in contrast, the consistency between infants was greater than the variance accounted for by salience, suggesting that the systematicity in older infants' fixations reflected more than their attention to physically salient regions. Together these results show that infants' fixations when viewing natural scenes becomes more systematic and predictable, and that predictability is due to their attention to features other than physical salience. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Top-down knowledge rapidly acquired through abstract rule learning biases subsequent visual attention in 9-month-old infants

Visual attention is an information-gathering mechanism that supports the emergence of complex perceptual and cognitive capacities. Yet, little is known about how the infant brain learns to direct attention to information that is most relevant for learning and behavior. Here we address this gap by examining whether learning a hierarchical rule structure, where there is a higher-order feature that organizes visual inputs into predictable sequences, subsequently biases 9-month-old infants' visual attention to the higher-order visual feature. In Experiment 1, we found that individual differences in infants' ability to structure simple visual inputs into generalizable rules was related to the change in infants' attention biases towards higher-order features. In Experiment 2, we found that increased functional connectivity between the PFC and visual cortex was related to the efficacy of rule learning. Moreover, Granger causality analyses provided exploratory evidence that increased functional connectivity reflected PFC influence over visual cortex. These findings provide new insights into how the infant brain learns to flexibly select features from the cluttered visual world that were previously relevant for learning and behavior.

Infants rapidly detect human faces in complex naturalistic visual scenes

Infants respond preferentially to faces and face-like stimuli from birth, but past research has typically presented faces in isolation or amongst an artificial array of competing objects. In the current study infants aged 3- to 12-months viewed a series of complex visual scenes; half of the scenes contained a person, the other half did not. Infants rapidly detected and oriented to faces in scenes even when they were not visually salient. Although a clear developmental improvement was observed in face detection and interest, all infants displayed sensitivity to the presence of a person in a scene, by displaying eye movements that differed quantifiably across a range of measures when viewing scenes that either did or did not contain a person. We argue that infant's face detection capabilities are ostensibly "better" with naturalistic stimuli and artificial array presentations used in previous studies have underestimated performance.

Impact of Language Experience on Attention to Faces in Infancy: Evidence From Unimodal and Bimodal Bilingual Infants

Faces capture and maintain infants' attention more than other visual stimuli. The present study addresses the impact of early language experience on attention to faces in infancy. It was hypothesized that infants learning two spoken languages (unimodal bilinguals) and hearing infants of Deaf mothers learning British Sign Language and spoken English (bimodal bilinguals) would show enhanced attention to faces compared to monolinguals. The comparison between unimodal and bimodal bilinguals allowed differentiation of the effects of learning two languages, from the effects of increased visual communication in hearing infants of Deaf mothers. Data are presented for two independent samples of infants: Sample 1 included 49 infants between 7 and 10 months (26 monolinguals and 23 unimodal bilinguals), and Sample 2 included 87 infants between 4 and 8 months (32 monolinguals, 25 unimodal bilinguals, and 30 bimodal bilingual infants with a Deaf mother). Eye-tracking was used to analyze infants' visual scanning of complex arrays including a face and four other stimulus categories. Infants from 4 to 10 months (all groups combined) directed their attention to faces faster than to non-face stimuli (i.e., attention capture), directed more fixations to, and looked longer at faces than non-face stimuli (i.e., attention maintenance). Unimodal bilinguals demonstrated increased attention capture and attention maintenance by faces compared to monolinguals. Contrary to predictions, bimodal bilinguals did not differ from monolinguals in attention capture and maintenance by face stimuli. These results are discussed in relation to the language experience of each group and the close association between face processing and language development in social communication.

Infants Distinguish Between Two Events Based on Their Relative Likelihood

Likelihood estimations are crucial for dealing with the uncertainty of life. Here, infants' sensitivity to the difference in likelihood between two events was investigated. Infants aged 6, 12, and 18 months (N = 75) were shown animated movies of a machine simultaneously drawing likely and unlikely samples from a box filled with different colored balls. In different trials, the difference in likelihood between the two samples was manipulated. The infants' looking patterns varied as a function of the magnitude of the difference in likelihood and were modulated by the number of items in the samples. Looking patterns showed qualitative similarities across age groups. This study demonstrates that infants' looking responses are sensitive to the magnitude of the difference in likelihood between two events.

The development of visual search in infancy: Attention to faces versus salience

Four experiments examined how faces compete with physically salient stimuli for the control of attention in 4-, 6-, and 8-month-old infants (N = 117 total). Three computational models were used to quantify physical salience. We presented infants with visual search arrays containing a face and familiar object(s), such as shoes and flowers. Six- and 8-month-old infants looked first and longest at faces; their looking was not strongly influenced by physical salience. In contrast, 4-month-old infants showed a visual preference for the face only when the arrays contained 2 items and the competitor was relatively low in salience. When the arrays contained many items or the only competitor was relatively high in salience, 4-month-old infants' looks were more often directed at the most salient item. Thus, over ages of 4 to 8 months, physical salience has a decreasing influence and faces have an increasing influence on where and how long infants look.

Temporal Attention as a Scaffold for Language Development

Language is one of the most fascinating abilities that humans possess. Infants demonstrate an amazing repertoire of linguistic abilities from very early on and reach an adult-like form incredibly fast. However, language is not acquired all at once but in an incremental fashion. In this article we propose that the attentional system may be one of the sources for this developmental trajectory in language acquisition. At birth, infants are endowed with an attentional system fully driven by salient stimuli in their environment, such as prosodic information (e.g., rhythm or pitch). Early stages of language acquisition could benefit from this readily available, stimulus-driven attention to simplify the complex speech input and allow word segmentation. At later stages of development, infants are progressively able to selectively attend to specific elements while disregarding others. This attentional ability could allow them to learn distant non-adjacent rules needed for morphosyntactic acquisition. Because non-adjacent dependencies occur at distant moments in time, learning these dependencies may require correctly orienting attention in the temporal domain. Here, we gather evidence uncovering the intimate relationship between the development of attention and language. We aim to provide a novel approach to human development, bridging together temporal attention and language acquisition.

A methodological investigation of the Intermodal Preferential Looking paradigm: Methods of analyses, picture selection and data rejection criteria

The Intermodal Preferential Looking paradigm provides a sensitive measure of a child's online word comprehension. To complement existing recommendations (Fernald, Zangl, Portillo, & Marchman, 2008), the present study evaluates the impact of experimental noise generated by two aspects of the visual stimuli on the robustness of familiar word recognition with and without mispronunciations: the presence of a central fixation point and the level of visual noise in the pictures (as measured by luminance saliency). Twenty-month-old infants were presented with a classic word recognition IPL procedure in 3 conditions: without a fixation stimulus (No Fixation - noisiest condition), with a fixation stimulus before trial onset (Fixation, intermediate), and with a fixation stimulus, a neutral background and equally salient images (Fixation Plus - least noisy). Data were systematically analyzed considering a range of data selection criteria and dependent variables (proportion of looking time towards the target, longest look, and time-course analysis). Critically, the expected pronunciation and naming interaction was only found in the Fixation Plus condition. We discuss the impact of data selection criteria and the dependent variable choice on the modulation of these effects across the different conditions.

The contributions of image content and behavioral relevancy to overt attention

During free-viewing of natural scenes, eye movements are guided by bottom-up factors inherent to the stimulus, as well as top-down factors inherent to the observer. The question of how these two different sources of information interact and contribute to fixation behavior has recently received a lot of attention. Here, a battery of 15 visual stimulus features was used to quantify the contribution of stimulus properties during free-viewing of 4 different categories of images (Natural, Urban, Fractal and Pink Noise). Behaviorally relevant information was estimated in the form of topographical interestingness maps by asking an independent set of subjects to click at image regions that they subjectively found most interesting. Using a Bayesian scheme, we computed saliency functions that described the probability of a given feature to be fixated. In the case of stimulus features, the precise shape of the saliency functions was strongly dependent upon image category and overall the saliency associated with these features was generally weak. When testing multiple features jointly, a linear additive integration model of individual saliencies performed satisfactorily. We found that the saliency associated with interesting locations was much higher than any low-level image feature and any pair-wise combination thereof. Furthermore, the low-level image features were found to be maximally salient at those locations that had already high interestingness ratings. Temporal analysis showed that regions with high interestingness ratings were fixated as early as the third fixation following stimulus onset. Paralleling these findings, fixation durations were found to be dependent mainly on interestingness ratings and to a lesser extent on the low-level image features. Our results suggest that both low- and high-level sources of information play a significant role during exploration of complex scenes with behaviorally relevant information being more effective compared to stimulus features.

Infants' selective attention to reliable visual cues in the presence of salient distractors

With many features competing for attention in their visual environment, infants must learn to deploy attention toward informative cues while ignoring distractions. Three eye tracking experiments were conducted to investigate whether 6- and 8-month-olds (total N = 102) would shift attention away from a distractor stimulus to learn a cue-reward relation. While 8-month-olds showed evidence of increasingly selective attention toward the predictive cues, even when the distractors were highly salient, 6-month-olds shifted attention toward the predictive cues only when the distractors were equally (not more) engaging. These experiments suggest that attention in infancy is highly dependent on the relative weightings of predictiveness and visual salience, which may differ across development and context.

An eye tracking investigation of developmental change in bottom-up attention orienting to faces in cluttered natural scenes

This study examined the contribution of visual salience to bottom-up attention orienting to faces in cluttered natural scenes across development. We eye tracked participants 4 months to 24 years of age as they freely viewed 16 natural scenes, all of which had faces in them. In half, the face was also the winner-take-all salient area in the display as determined by the MATLAB SaliencyToolbox. In the other half, a random location was the winner-take-all salient area in the display and the face was visually non-salient. We found that proportion of attended faces, in the first second of scene viewing, improved after the first year. Visually salient faces attracted bottom-up attention orienting more than non-salient faces reliably and robustly only after infancy. Preliminary data indicate that this shift to use of visual salience to guide bottom-up attention orienting after infancy may be a function of stabilization of visual skills. Moreover, sociodemographic factors including number of siblings in the home and family income were agents of developmental change in orienting to faces in cluttered natural scenes in infancy.