Effect of partial occlusion on newborns' face preference and recognition

How do human newborns come to understand the multimodal environment?

For a long time, newborns were considered as human beings devoid of perceptual abilities who had to learn with effort everything about their physical and social environment. Extensive empirical evidence gathered in the last decades has systematically invalidated this notion. Despite the relatively immature state of their sensory modalities, newborns have perceptions that are acquired, and are triggered by, their contact with the environment. More recently, the study of the fetal origins of the sensory modes has revealed that in utero all the senses prepare to operate, except for the vision mode, which is only functional starting from the first minutes after birth. This discrepancy between the maturation of the different senses leads to the question of how human newborns come to understand our multimodal and complex environment. More precisely, how the visual mode interacts with the tactile and auditory modes from birth. After having defined the tools that newborns use to interact with other sensory modalities, we review studies across different fields of research such as the intermodal transfer between touch and vision, auditory-visual speech perception, and the existence of links between the dimensions of space, time, and number. Overall, evidence from these studies supports the idea that human newborns are spontaneously driven, and cognitively equipped, to link information collected by the different sensory modes in order to create a representation of a stable world.

Mouth Movements as Possible Cues of Social Interest at Birth: New Evidences for Early Communicative Behaviors

Previous studies evidenced that different interactive contexts modulate the visual attention of newborns. In the present study, we investigated newborns' motor feedback as an additional cue to neonates' expression of interest. Using videos of interactive faces and a familiarization-test procedure, three different groups of newborns were assigned to three different conditions (i.e., one condition with a talking face during familiarization and silently moving faces at test, silently moving/silently moving condition, or talking/static condition). Following studies on neonatal imitation, mouth movements were analyzed as indicators of social interest. We expected the occurrence of mouth movements in the newborns to differ according to different conditions: (a) whether or not the face in front of them was talking and (b) if the person had been already seen or was new. Results revealed that a talking face elicited more motor feedback from the newborns than a silent one and that there was no difference in front of the familiar face or the novel one. Finally, frequencies of mouth movements were greater, and latencies of appearance of the first mouth movement were shorter, in front of a static vs. a dynamic face. These results are congruent with the idea of the existence of "a sense" for interaction at birth, and therefore new approaches in newborn studies are discussed.

Social context influences infants' ability to extract statistical information from a sequence of gestures

Infants' social environment is rich of complex sequences of events and actions. This study investigates whether 12-month-old infants are able to learn statistical regularities from a sequence of human gestures and whether this ability is affected by a social vs non-social context. Using a visual familiarization task, infants were familiarized to a continuous sequence of eight videos in which two women imitated each other performing arm gestures. The sequence of videos in which the two women performed imitative gestures was organized into 4 different gesture units. Videos within a gesture unit had a highly predictable transitional probability, while such transition was less predictable between gesture units. The social context was manipulated varying the mutual gaze of the actors and their body orientation. At test, infants were able to discriminate between the high- and low-predictable gesture units in the social, but not in the non-social condition. Results demonstrate that infants are capable to detect statistical regularities from a sequence of human gestures performed by two different individuals. Moreover, our findings indicate that salient social cues can modulate infants' ability to extract statistical information from a sequence of gestures.

Emotional facial expressions affect visual rule learning in 7- to 8-month-old infants

Rule learning (RL) is an implicit learning mechanism that allows infants to detect and generalize rule-like repetition-based patterns (such as ABB and ABA) from a sequence of elements. Increasing evidence shows that RL operates both in the auditory and the visual domain and is modulated by the perceptual expertise with the to-be-learned stimuli. Yet, whether infants' ability to detect a high-order rule from a sequence of stimuli is affected by affective information remains a largely unexplored issue. Using a visual habituation paradigm, we investigated whether the presence of emotional expressions with a positive and a negative value (i.e., happiness and anger) modulates 7- to 8-month-old infants' ability to learn a rule-like pattern from a sequence of faces of different identities. Results demonstrate that emotional facial expressions (either positive and negative) modulate infants' visual RL mechanism, even though positive and negative facial expressions affect infants' RL in a different manner: while anger disrupts infants' ability to learn the rule-like pattern from a face sequence, in the presence of a happy face infants show a familiarity preference, thus maintaining their learning ability. These findings show that emotional expressions exert an influence on infants' RL abilities, contributing to the investigation on how emotion and cognition interact in face processing during infancy.

The implications of face masks for babies and families during the COVID-19 pandemic: A discussion paper

COVID-19 has changed the way that newborn babies are cared for within the neonatal setting due to the introduction of social distancing and wearing of face masks to limit the spread of the infection. Potential implications exist related to the normal development of bonding and connections with others. This paper discusses the importance of face to face interactions for early attachment between babies and parents within the context of relevant underpinning developmental theory. Mask wearing can also potentially impact relational communication, requiring us to change our current ways of working. Decreasing face to face interactions and relational communication, along with key recommendations for both parents and health professionals are further highlighted to mitigate the potential negative effects of masks on long-term development related to human connection and attachment.

Growing a social brain

It has long been assumed that social animals, such as humans, are born with a brain system that has evolved to support social affiliation. However, the evidence does not necessarily support this assumption. Alternatively, social animals can be defined as those who cannot survive alone and rely on members from their group to regulate their ongoing physiology (or allostasis). The rather simple evolutionary constraint of social dependency for survival can be sufficient to make the social environment vitally salient, and to provide the ultimate driving force for socially crafted brain development and learning. In this Perspective, we propose a framework for sociality and specify a set of hypotheses on the mechanisms of social development and underlying neural systems. The theoretical shift proposed here implies that profound human characteristics, including but not limited to sociality, are acquired at an early age, while social interactions provide key wiring instructions that determine brain development.

The perception of speech modulation cues in lexical tones is guided by early language-specific experience

A number of studies showed that infants reorganize their perception of speech sounds according to their native language categories during their first year of life. Still, information is lacking about the contribution of basic auditory mechanisms to this process. This study aimed to evaluate when native language experience starts to noticeably affect the perceptual processing of basic acoustic cues [i.e., frequency-modulation (FM) and amplitude-modulation information] known to be crucial for speech perception in adults. The discrimination of a lexical-tone contrast (rising versus low) was assessed in 6- and 10-month-old infants learning either French or Mandarin using a visual habituation paradigm. The lexical tones were presented in two conditions designed to either keep intact or to severely degrade the FM and fine spectral cues needed to accurately perceive voice-pitch trajectory. A third condition was designed to assess the discrimination of the same voice-pitch trajectories using click trains containing only the FM cues related to the fundamental-frequency (F0) in French- and Mandarin-learning 10-month-old infants. Results showed that the younger infants of both language groups and the Mandarin-learning 10-month-olds discriminated the intact lexical-tone contrast while French-learning 10-month-olds failed. However, only the French 10-month-olds discriminated degraded lexical tones when FM, and thus voice-pitch cues were reduced. Moreover, Mandarin-learning 10-month-olds were found to discriminate the pitch trajectories as presented in click trains better than French infants. Altogether, these results reveal that the perceptual reorganization occurring during the first year of life for lexical tones is coupled with changes in the auditory ability to use speech modulation cues.

Suprasegmental information affects processing of talking faces at birth

From birth, newborns show a preference for faces talking a native language compared to silent faces. The present study addresses two questions that remained unanswered by previous research: (a) Does the familiarity with the language play a role in this process and (b) Are all the linguistic and paralinguistic cues necessary in this case? Experiment 1 extended newborns' preference for native speakers to non-native ones. Given that fetuses and newborns are sensitive to the prosodic characteristics of speech, Experiments 2 and 3 presented faces talking native and nonnative languages with the speech stream being low-pass filtered. Results showed that newborns preferred looking at a person who talked to them even when only the prosodic cues were provided for both languages. Nonetheless, a familiarity preference for the previously talking face is observed in the "normal speech" condition (i.e., Experiment 1) and a novelty preference in the "filtered speech" condition (Experiments 2 and 3). This asymmetry reveals that newborns process these two types of stimuli differently and that they may already be sensitive to a mismatch between the articulatory movements of the face and the corresponding speech sounds.

How a hat may affect 3-month-olds' recognition of a face: an eye-tracking study

Recent studies have shown that infants' face recognition rests on a robust face representation that is resilient to a variety of facial transformations such as rotations in depth, motion, occlusion or deprivation of inner/outer features. Here, we investigated whether 3-month-old infants' ability to represent the invariant aspects of a face is affected by the presence of an external add-on element, i.e. a hat. Using a visual habituation task, three experiments were carried out in which face recognition was investigated by manipulating the presence/absence of a hat during face encoding (i.e. habituation phase) and face recognition (i.e. test phase). An eye-tracker system was used to record the time infants spent looking at face-relevant information compared to the hat. The results showed that infants' face recognition was not affected by the presence of the external element when the type of the hat did not vary between the habituation and test phases, and when both the novel and the familiar face wore the same hat during the test phase (Experiment 1). Infants' ability to recognize the invariant aspects of a face was preserved also when the hat was absent in the habituation phase and the same hat was shown only during the test phase (Experiment 2). Conversely, when the novel face identity competed with a novel hat, the hat triggered the infants' attention, interfering with the recognition process and preventing the infants' preference for the novel face during the test phase (Experiment 3). Findings from the current study shed light on how faces and objects are processed when they are simultaneously presented in the same visual scene, contributing to an understanding of how infants respond to the multiple and composite information available in their surrounding environment.

Eye-catching odors: olfaction elicits sustained gazing to faces and eyes in 4-month-old infants

This study investigated whether an odor can affect infants' attention to visually presented objects and whether it can selectively direct visual gaze at visual targets as a function of their meaning. Four-month-old infants (n = 48) were exposed to their mother's body odors while their visual exploration was recorded with an eye-movement tracking system. Two groups of infants, who were assigned to either an odor condition or a control condition, looked at a scene composed of still pictures of faces and cars. As expected, infants looked longer at the faces than at the cars but this spontaneous preference for faces was significantly enhanced in presence of the odor. As expected also, when looking at the face, the infants looked longer at the eyes than at any other facial regions, but, again, they looked at the eyes significantly longer in the presence of the odor. Thus, 4-month-old infants are sensitive to the contextual effects of odors while looking at faces. This suggests that early social attention to faces is mediated by visual as well as non-visual cues.

Eye contrast polarity is critical for face recognition by infants

Just as faces share the same basic arrangement of features, with two eyes above a nose above a mouth, human eyes all share the same basic contrast polarity relations, with a sclera lighter than an iris and a pupil, and this is unique among primates. The current study examined whether this bright-dark relationship of sclera to iris plays a critical role in face recognition from early in development. Specifically, we tested face discrimination in 7- and 8-month-old infants while independently manipulating the contrast polarity of the eye region and of the rest of the face. This gave four face contrast polarity conditions: fully positive condition, fully negative condition, positive face with negated eyes ("negative eyes") condition, and negated face with positive eyes ("positive eyes") condition. In a familiarization and novelty preference procedure, we found that 7- and 8-month-olds could discriminate between faces only when the contrast polarity of the eyes was preserved (positive) and that this did not depend on the contrast polarity of the rest of the face. This demonstrates the critical role of eye contrast polarity for face recognition in 7- and 8-month-olds and is consistent with previous findings for adults.

Cues for early social skills: direct gaze modulates newborns' recognition of talking faces

Previous studies showed that, from birth, speech and eye gaze are two important cues in guiding early face processing and social cognition. These studies tested the role of each cue independently; however, infants normally perceive speech and eye gaze together. Using a familiarization-test procedure, we first familiarized newborn infants (n = 24) with videos of unfamiliar talking faces with either direct gaze or averted gaze. Newborns were then tested with photographs of the previously seen face and of a new one. The newborns looked longer at the face that previously talked to them, but only in the direct gaze condition. These results highlight the importance of both speech and eye gaze as socio-communicative cues by which infants identify others. They suggest that gaze and infant-directed speech, experienced together, are powerful cues for the development of early social skills.

Holistic face processing in newborns, 3-month-old infants, and adults: evidence from the composite face effect

Holistic face processing was investigated in newborns, 3-month-old infants, and adults through a modified version of the composite face paradigm and the recording of eye movements. After familiarization to the top portion of a face, participants (N = 70) were shown 2 aligned or misaligned faces, 1 of which comprised the familiar top part. In the aligned condition, no visual preference was found at any group age. In the misaligned condition, 3-month-olds preferred the face stimulus with the familiar top part, adults preferred the face stimulus with the novel one, and newborns did not manifest any visual preference. Results revealed that both infants' and adults' eye movements may be affected by holistic face information and demonstrated holistic face processing in 3-month-olds.

Recognition of unfamiliar talking faces at birth

Sai (2005) investigated the role of speech in newborns’ recognition of their mothers’ faces. Her results revealed that, when presented with both their mother’s face and that of a stranger, newborns preferred looking at their mother only if she had previously talked to them. The present study attempted to extend these findings to any other faces. By using video films, our results revealed that unfamiliar female faces were recognized in the test phase only if they had previously talked to the baby, but not if they had been silent. These results highlight the importance of an early audiovisual perception which already seems to play an important role in face processing at birth.

Influence of eye gaze on spoken word processing: an ERP study with infants

Eye gaze is an important communicative signal, both as mutual eye contact and as referential gaze to objects. To examine whether attention to speech versus nonspeech stimuli in 4- to 5-month-olds (n=15) varies as a function of eye gaze, event-related brain potentials were used. Faces with mutual or averted gaze were presented in combination with forward- or backward-spoken words. Infants rapidly processed gaze and spoken words in combination. A late Slow Wave suggests an interaction of the 2 factors, separating backward-spoken word+direct gaze from all other conditions. An additional experiment (n=15) extended the results to referential gaze. The current findings suggest that interactions between visual and auditory cues are present early in infancy.