Narrowing in face and speech perception in infancy: Developmental change in the relations between domains

Infant sensitivity to mismatches between same/other-race faces and native/non-native speech

Perceptual narrowing typically occurs around 6 months of age, and drastically changes an infant's perception of stimuli such as faces or spoken language according to the frequency with which the infant encounters them. It has already been well established that perceptual narrowing improves the sensitivity of infants to frequently encountered stimuli such as same-race faces and their native language while reducing their sensitivity to other-race faces and non-native languages. However, the effect of perceptual narrowing on the combined perception of face and language stimuli is not well understood. Therefore, to investigate the changes in the sensitivity of infants to matches and mismatches between faces and speech which might occur in the course of perceptual narrowing, we tested 3- and 9-month-old German infants using German faces and German spoken sentences which would be familiar to the infants, as well as completely unfamiliar Chinese faces and French spoken sentences. The infants were tested using an intermodal association paradigm, whereby each infant saw sequences of German or Chinese faces, interspersed with German or French spoken sentences. We analyzed the total looking time of infants in conditions where the faces and spoken sentences were congruent (either both familiar, or both unfamiliar), versus incongruent conditions where only the faces or only the sentences were familiar. We found that while the 9-month-olds looked for similar durations in congruent versus incongruent conditions, the 3-month-olds looked significantly longer during congruent conditions versus incongruent conditions, indicating a greater attentiveness to face-speech matches and mismatches prior to the onset of perceptual narrowing.

Altered development of face recognition among infants born amid the COVID-19 pandemic

To effectively contain the spread of COVID-19, public health agencies mandated special regulations. Although they protected us from COVID-19, these restrictions have inevitably changed the environment around us. It remains unclear how these changes may have affected early cognitive development among infants born during the pandemic. Thus, this study examined how the COVID-19 restrictions have affected infants' face recognition ability, a hallmark of their cognitive capacities. Specifically, we used the familiarization and visual pair comparison paradigm to examine face recognition performance among infants aged 6 to 14 months amid the second wave of the pandemic (February to July 2021). Experiment 1 investigated the recognition of unmasked faces and found that only younger infants, but not older infants, recognized faces by showing a novelty preference. Experiment 2 examined the recognition of faces wearing masks and found that only older infants, but not younger ones, recognized faces by exhibiting a familiarity preference. These results suggest that with limited interactions during the pandemic, infants could have developed an overly specialized face processing ability that failed to recognize the faces of strangers. Moreover, infants could have obtained more information on masked faces during the pandemic and adapted to the current situation. In Expreiment 3, we further confirmed the restriction on infants' interpersonal experiences with a survey conducted both before and during the pandemic. Overall, these findings demonstrated how the pandemic altered early perceptual development and further confirmed that interpersonal experiences during infancy are critical in their cognitive development.

Older infants' social learning behavior under uncertainty is modulated by the interaction of face and speech processing

The origin of face or language influences infants' perceptual processing and social learning behavior. However, it remains unclear how infants' social learning behavior is affected when both information are provided simultaneously. Hence, the current study investigated whether and how infants' social learning in terms of gaze following is influenced by face race and language origin of an interaction partner in an uncertain situation. Our sample consisted of 91 Caucasian infants from German speaking families. They were divided into 2 age groups: Younger infants were 5- to 8-month-old (n = 46) and the older infants 11- to 20-month-old (n = 45). We used a modified online version of the gaze following paradigm by Xiao and colleagues by varying face race (Caucasian, and Asian faces) and language (German and French) of a female actor. We recorded infants looking behavior via webcam and coded it offline. Our results revealed that older but not younger infants were biased to follow the gaze of own-race adults speaking their native language. Our findings show that older infants are clearly influenced by adults' ethnicity and language in social learning situations of uncertainty.

Effects of interracial experience on the race preferences of infants

Over their first year of life, infants express visual preferences for own- versus other-race faces. This developmental transition has primarily been investigated in monoracial societies where infants have limited personal or societal contact with other races. We investigated whether previously reported visual preferences for race generalize to a multiracial society (i.e., Singapore). In addition, we investigated effects of caregiver race on visual preferences for race. In Experiment 1, race preferences were measured at 3, 6, and 9 months of age for own-race (Chinese) versus other-race (Indian) faces in infants with no regular interaction with Indian-race individuals. Singaporean infants displayed a significant visual preference for Indian-race faces at each age group. Furthermore, infants raised with other-race caregivers demonstrated an age-related increase in other-race visual preferences. The visual preferences of infants for other-race faces were predicted by the extent of other-race contact. In Experiment 2, we confirmed that an other-race visual preference was not exclusive to Indian faces in a sample of 6-month-old Singaporean Chinese infants who demonstrated a similar other-race visual preference for Caucasian faces over Chinese faces. Findings are discussed in terms of the influence of other-race contact on visual preferences for race in infants.

The other-race effect on the McGurk effect in infancy

This study investigated the difference in the McGurk effect between own-race-face and other-race-face stimuli among Japanese infants from 5 to 9 months of age. The McGurk effect results from infants using information from a speaker’s face in audiovisual speech integration. We hypothesized that the McGurk effect varies with the speaker’s race because of the other-race effect, which indicates an advantage for own-race faces in our face processing system. Experiment 1 demonstrated the other-race effect on audiovisual speech integration such that the infants ages 5–6 months and 8–9 months are likely to perceive the McGurk effect when observing an own-race-face speaker, but not when observing an other-race-face speaker. Experiment 2 found the other-race effect on audiovisual speech integration regardless of irrelevant speech identity cues. Experiment 3 confirmed the infants’ ability to differentiate two auditory syllables. These results showed that infants are likely to integrate voice with an own-race-face, but not with an other-race-face. This implies the role of experiences with own-race-faces in the development of audiovisual speech integration. Our findings also contribute to the discussion of whether perceptual narrowing is a modality-general, pan-sensory process.

Perceptual narrowing in face- and speech-perception domains in infancy: A longitudinal approach

During the first year of life, infants undergo a process known as perceptual narrowing, which reduces their sensitivity to classes of stimuli which the infants do not encounter in their environment. It has been proposed that perceptual narrowing for faces and speech may be driven by shared domain-general processes. To investigate this theory, our study longitudinally tested 50 German Caucasian infants with respect to these domains first at 6 months of age followed by a second testing at 9 months of age. We used an infant-controlled habituation-dishabituation paradigm to test the infants' ability to discriminate among other-race Asian faces and non-native Cantonese speech tones, as well as same-race Caucasian faces as a control. We found that while at 6 months of age infants could discriminate among all stimuli, by 9 months of age they could no longer discriminate among other-race faces or non-native tones. However, infants could discriminate among same-race stimuli both at 6 and at 9 months of age. These results demonstrate that the same infants undergo perceptual narrowing for both other-race faces and non-native speech tones between the ages of 6 and 9 months. This parallel development of perceptual narrowing occurring in both the face and speech perception modalities over the same period of time lends support to the domain-general theory of perceptual narrowing in face and speech perception.

Language familiarity influences own-race face recognition in 9- and 12-month-old infants

During their first year, infants attune to the faces and language(s) that are frequent in their environment. The present study investigates the impact of language familiarity on how French-learning 9- and 12-month-olds recognize own-race faces. In Experiment 1, infants were familiarized with the talking face of a Caucasian bilingual German-French speaker reciting a nursery rhyme in French (native condition) or in German (non-native condition). In the test phase, infants' face recognition was tested by presenting a picture of the speaker's face they were familiarized with, side by side with a novel face. At 9 and 12 months, neither infants in the native condition nor the ones in the non-native condition clearly recognized the speaker's face. In Experiment 2, we familiarized infants with the still picture of the speaker's face, along with the auditory speech stream. This time, both 9- and 12-month-olds recognized the face of the speaker they had been familiarized with, but only if she spoke in their native language. This study shows that at least from 9 months of age, language modulates the way faces are recognized.

The effect of familiarity on infants' social categorization capacity

Recent studies indicate that a preference for people from one’s own race emerges early in development. Arguably, one potential process contributing to such a bias has to do with the increased discriminability of own- vs. other-race faces–a process commonly attributed to perceptual narrowing of unfamiliar groups’ faces, and analogous to the conceptual homogenization of out-groups. The present studies addressed two implications of perceptual narrowing of other-race faces for infants’ social categorization capacity. In Experiment 1, White 11-month-olds’ (N = 81) looking time at a Black vs. White face was measured under three between-subjects conditions: a baseline “preference” (i.e., without familiarization), after familiarization to Black faces, or after familiarization to White faces. Compared to infants’ a priori looking preferences as revealed in the baseline condition, only when familiarized to Black faces did infants look longer at the "not-familiarized-category" face at test. According to the standard categorization paradigm used, such longer looking time at the novel (i.e., "not-familiarized-category") exemplar at test, indicated that categorization of the familiarized faces had ensued. This is consistent with the idea that prior to their first birthday, infants already tend to represent own-race faces as individuals and other-race faces as a category. If this is the case, then infants might also be less likely to form subordinate categories within other-race than own-race categories. In Experiment 2, infants (N = 34) distinguished between an arbitrary (shirt-color) based sub-categories only when shirt-wearers were White, but not when they were Black. These findings confirm that perceptual narrowing of other-race faces blurs distinctions among members of unfamiliar categories. Consequently, infants: a) readily categorize other-race faces as being of the same kind, and b) find it hard to distinguish between their sub-categories.

The Other-Race-Effect on Audiovisual Speech Integration in Infants: A NIRS Study

Previous studies have revealed perceptual narrowing for the own-race-face in face discrimination, but this phenomenon is poorly understood in face and voice integration. We focused on infants' brain responses to the McGurk effect to examine whether the other-race effect occurs in the activation patterns. In Experiment 1, we conducted fNIRS measurements to find the presence of a mapping of the McGurk effect in Japanese 8- to 9-month-old infants and to examine the difference between the activation patterns in response to own-race-face and other-race-face stimuli. We used two race-face conditions, own-race-face (East Asian) and other-race-face (Caucasian), each of which contained audiovisual-matched and McGurk-type stimuli. While the infants (N = 34) were observing each speech stimulus for each race, we measured cerebral hemoglobin concentrations in bilateral temporal brain regions. The results showed that in the own-race-face condition, audiovisual-matched stimuli induced the activation of the left temporal region, and the McGurk stimuli induced the activation of the bilateral temporal regions. No significant activations were found in the other-race-face condition. These results mean that the McGurk effect occurred only in the own-race-face condition. In Experiment 2, we used a familiarization/novelty preference procedure to confirm that the infants (N = 28) could perceive the McGurk effect in the own-race-face condition but not that of the other-race-face. The behavioral data supported the results of the fNIRS data, implying the presence of narrowing for the own-race face in the McGurk effect. These results suggest that narrowing of the McGurk effect may be involved in the development of relatively high-order processing, such as face-to-face communication with people surrounding the infant. We discuss the hypothesis that perceptual narrowing is a modality-general, pan-sensory process.

The Development of Social Categorization

Social categorization is a universal mechanism for making sense of a vast social world with roots in perceptual, conceptual, and social systems. These systems emerge strikingly early in life and undergo important developmental changes across childhood. The development of social categorization entails identifying which ways of classifying people are culturally meaningful, how these categories might be used to predict, explain, and evaluate the behavior of other people, and how one's own identity relates to these systems of categorization and representation. Social categorization can help children simplify and understand their social environment but has detrimental consequences in the forms of stereotyping, prejudice, and discrimination. Thus, understanding how social categorization develops is a central problem for the cognitive, social, and developmental sciences. This review details the multiple developmental processes that underlie this core psychological capacity.