Infants' Processing of Featural and Configural Information in the Upper and Lower Halves of the Face

A longitudinal study of the relationship between alcohol-related blackouts and attenuated structural brain development

PURPOSE

Alcohol-related blackouts (ARBs) are common in adolescents and emerging adults. ARBs may also be indicative of persistent, alcohol-related neurocognitive changes. This study explored ARBs as a predictor of altered structural brain development and associated cognitive correlates.

METHODS

Longitudinal growth curve modeling estimated trajectories of brain volume across 6 years in participants from the National Consortium on Alcohol and Neurodevelopment in Adolescence (NCANDA) study (n = 800, 213 with lifetime ARB history). While controlling for demographics and overall alcohol use, ARB history was analyzed as a predictor of brain volume growth in regions associated with alcohol-related cognitive change. Post hoc analyses examined whether ARBs moderated relationships between brain morphology and cognition.

RESULTS

ARBs significantly predicted attenuated development of fusiform gyrus and hippocampal volume at unique timepoints compared to overall alcohol use. Alcohol use without ARBs significantly predicted attenuated fusiform and hippocampal growth at earlier and later timepoints, respectively. Despite altered development in regions associated with memory, ARBs did not significantly moderate relationships between brain volume and cognitive performance.

CONCLUSION

ARBs and overall alcohol use predicted altered brain development in the fusiform gyrus and hippocampus at different timepoints, suggesting ARBs represent a unique marker of neurocognitive risk in younger drinkers.

An investigation on the face inversion effect in deaf children

The face inversion effect is an important indicator of holistic face perception and reflects the developmental level of face processing. This study examined the face inversion effect in deaf or hard of hearing (DHH) children aged 7-17 using the face dimensions task. This task uses photographic images of a face, in which configural and featural information in the eye and mouth regions have been parametrically and independently manipulated. The study aimed to discuss the effect of face inversion on facial processing in DHH children, including two aspects of information processing types (configural versus featural) and processing regions (eyes versus mouth) and compared the results with hearing children. The results revealed that DHH children aged 7-17 years exhibit significant face inversion effect, with disruptions observed in both the featural and configural processing of eyes and mouths when faces were inverted. Configural processing was more affected by inversion than featural processing in all children, with larger differences observed in DHH children than in hearing children. This supports the dual-mode hypothesis of holistic face processing. Age correlations were observed in the sensitivity of DHH children to face inversion effect but not among hearing children. The inversion effect of configural mouth processing decreases with age in DHH children.

Preferential looking to eyes versus mouth in early infancy: heritability and link to concurrent and later development

BACKGROUND

From birth, infants orient preferentially to faces, and when looking at the face, they attend primarily to eyes and mouth. These areas convey different types of information, and earlier research suggests that genetic factors influence the preference for one or the other in young children.

METHODS

In a sample of 535 5-month-old infant twins, we assessed eye (relative to mouth) preference in early infancy, i.e., before neural systems for social communication and language are fully developed. We investigated the contribution of genetic and environmental factors to the preference for looking at eyes, and the association with concurrent traits and follow-up measures.

RESULTS

Eye preference was independent from all other concurrent traits measured, and had a moderate-to-high contribution from genetic influences (A = 0.57; 95% CI: 0.45, 0.66). Preference for eyes at 5 months was associated with higher parent ratings of receptive vocabulary at 14 months. No statistically significant association with later autistic traits was found. Preference for eyes was strikingly stable across different stimulus types (e.g., dynamic vs. still), suggesting that infants' preference at this age does not reflect sensitivity to low-level visual cues.

CONCLUSIONS

These results suggest that individual differences in infants' preferential looking to eyes versus mouth to a substantial degree reflect genetic variation. The findings provide new leads on both the perceptual basis and the developmental consequences of these attentional biases.

Holistic face processing in 4- and 7-month-old infants

Previous studies found an onset of holistic face processing in the age range between 0-4 and 7 months of age. To validate these studies, the present study investigated infants 4 and 7 months of age with a different experimental approach. In a habituation-dishabituation experiment, the infants were tested with stereoscopic stimuli in which stripes floated above a face, thereby occluding some parts of the face (amodal completion condition), and stereoscopic stimuli in which the same face parts floated above stripes (modal completion condition). Research with adults indicates that faces are processed holistically, that is as global wholes, in the amodal, but as independent parts in the modal completion condition, resulting in superior face recognition when the occluding bars are in front of than when they are behind the visible face parts. The present study found that infants regardless of whether they are 4 or 7 months old reliably recognized and differentiated the faces in the amodal but not in the modal completion condition. Moreover, the difference between the experimental conditions was statistically significant. These findings show that approximately at the age of 4-7 months of life, infants begin to holistically unify disjoint face parts into a coherent whole.

Face Processing in Early Development: A Systematic Review of Behavioral Studies and Considerations in Times of COVID-19 Pandemic

Human faces are one of the most prominent stimuli in the visual environment of young infants and convey critical information for the development of social cognition. During the COVID-19 pandemic, mask wearing has become a common practice outside the home environment. With masks covering nose and mouth regions, the facial cues available to the infant are impoverished. The impact of these changes on development is unknown but is critical to debates around mask mandates in early childhood settings. As infants grow, they increasingly interact with a broader range of familiar and unfamiliar people outside the home; in these settings, mask wearing could possibly influence social development. In order to generate hypotheses about the effects of mask wearing on infant social development, in the present work, we systematically review N = 129 studies selected based on the most recent PRISMA guidelines providing a state-of-the-art framework of behavioral studies investigating face processing in early infancy. We focused on identifying sensitive periods during which being exposed to specific facial features or to the entire face configuration has been found to be important for the development of perceptive and socio-communicative skills. For perceptive skills, infants gradually learn to analyze the eyes or the gaze direction within the context of the entire face configuration. This contributes to identity recognition as well as emotional expression discrimination. For socio-communicative skills, direct gaze and emotional facial expressions are crucial for attention engagement while eye-gaze cuing is important for joint attention. Moreover, attention to the mouth is particularly relevant for speech learning. We discuss possible implications of the exposure to masked faces for developmental needs and functions. Providing groundwork for further research, we encourage the investigation of the consequences of mask wearing for infants' perceptive and socio-communicative development, suggesting new directions within the research field.

A regional composite-face effect for species-specific recognition: Upper and lower halves play different roles in holistic processing of monkey faces

Using a composite-face paradigm, we examined the holistic processing induced by Asian faces, Caucasian faces, and monkey faces with human Asian participants in two experiments. In Experiment 1, participants were asked to judge whether the upper halves of two faces successively presented were the same or different. A composite-face effect was found for Asian faces and Caucasian faces, but not for monkey faces. In Experiment 2, participants were asked to judge whether the lower halves of the two faces successively presented were the same or different. A composite-face effect was found for monkey faces as well as for Asian faces and Caucasian faces. Collectively, these results reveal that own-species (i.e., own-race and other-race) faces engage holistic processing in both upper and lower halves of the face, but other-species (i.e., monkey) faces engage holistic processing only when participants are asked to match the lower halves of the face. The findings are discussed in the context of a region-based holistic processing account for the species-specific effect in face recognition.

Functional development of the brain's face-processing system

In the first 20 years of life, the human brain undergoes tremendous growth in size, weight, and synaptic connectedness. Over the same time period, a person achieves remarkable transformations in perception, thought, and behavior. One important area of development is face processing ability, or the ability to quickly and accurately extract extensive information about a person's identity, emotional state, attractiveness, intention, and numerous other types of information that are crucial to everyday social interaction and communication. Associating particular brain changes with specific behavioral and intellectual developments has historically been a serious challenge for researchers. Fortunately, modern neuroimaging is dramatically advancing our ability to make associations between morphological and behavioral developments. In this article, we demonstrate how neuroimaging has revolutionized our understanding of the development of face processing ability to show that this essential perceptual and cognitive skill matures consistently yet slowly over the first two decades of life. In this manner, face processing is a model system of many areas of complex cognitive development. WIREs Cogn Sci 2017, 8:e1423. doi: 10.1002/wcs.1423 For further resources related to this article, please visit the WIREs website.

Perceptual learning and face processing in infancy

Configural information (spacing between features) contributes to face-processing expertise in adulthood. We examined whether infants can be "trained" to process this information. In Experiment 1, 3.5-month-olds failed to discriminate changes in the spacing between facial features. However, in Experiments 2 and 3, infants processed the same information after being primed with faces in which the spacing was repeatedly altered. Experiment 4 found that priming was not effective with inverted faces or with faces depicting changes in features but not relations among features, indicating that the priming exhibited in Experiments 2 and 3 was specific to upright faces depicting spacing changes. Thus, even young infants who do not readily process facial configural information can be induced to do so through priming. These findings suggest that learning to encode critical structural information contributes to the development of face processing expertise.

Memory for complex visual objects but not for allocentric locations during the first year of life

Although human infants demonstrate early competence to retain visual information, memory capacities during infancy remain largely undocumented. In three experiments, we used a Visual Paired Comparison (VPC) task to examine abilities to encode identity (Experiment 1) and spatial properties (Experiments 2a and 2b) of unfamiliar complex visual patterns during the first year of life. In the first experiment, 6- and 9-month-old infants were familiarized with visual arrays composed of four abstract patterns arranged in a square configuration. Recognition memory was evaluated by presenting infants with the familiarized array paired with a novel array composed of four new patterns. The second couple of experiments aimed to examine infant ability to encode the spatial relationships between each pattern of the array (e.g., where is A in the square configuration). The 6-, 9- and 12-month-old infants were tested on a spatial version of the VPC task, in which the novel array was composed of the same patterns than the familiarized array but arranged differently within the square configuration. Results indicated that infants retained the identity of the patterns but not their specific spatial relationships within the square configuration (i.e., allocentric location of the patterns), suggesting either an immaturity of the processes involved in object-to-location binding, or the inappropriateness of unfamiliar complex objects to reveal such early allocentric abilities.

Developmental origins of the face inversion effect

A hallmark of adults' expertise for faces is that they are better at recognizing, discriminating, and processing upright faces compared to inverted faces. We investigate the developmental origins of "the face inversion effect" by reviewing research on infants' perception of upright and inverted faces during the first year of life. We review the effects of inversion on infants' face preference, recognition, processing (holistic and second-order configural), and scanning as well as face-related neural responses. Particular attention is paid to the developmental patterns that emerge within and across these areas of face perception. We conclude that the developmental origins of the inversion effect begin in the first few months of life and grow stronger over the first year, culminating in effects that are commonly thought to indicate adult-like expertise. We posit that by the end of the first year, infants' face-processing system has become specialized to upright faces and a foundation for adults' upright-face expertise has been established. Developmental mechanisms that may facilitate the emergence of this upright-face specialization are discussed, including the roles that physical and social development may play in upright faces' becoming more meaningful to infants during the first year.

The eye-size illusion: psychophysical characteristics, generality, and relation to holistic face processing

Rakover [(2011). In Y. H. Zhang (Ed.), Advances in face image analysis: Techniques and technologies (pp. 316-333). Hershey, PA: IGI Global] observed a novel eye-size illusion: when increasing the size of a face but keeping the size of its eyes unchanged, the eyes are perceived to be smaller than in the original face. Here, we systematically manipulated the face size and found that the magnitude of this illusion linearly changed as a function of the face frame size (experiment 1). Additionally, the same magnitude of an illusion was observed for the perception of the size of the mouth when we changed the face frame but kept the mouth size constant (experiment 2). Further, when the faces and eyes were presented upside down, the magnitude of the illusion was significantly reduced in both Chinese participants (experiment 3) and Caucasian participants (experiment 4). The results suggest that the perception of eye or mouth size occurs in the relational context of the whole face; and when the face is inverted, thereby disrupting holistic processing, the magnitude of the illusion is reduced. We therefore suggest that holistic processing is involved in producing the illusion.

Both children and adults scan faces of own and other races differently

Extensive behavioral and neural evidence suggests that processing of own-race faces differs from that of other-race faces in both adults and infants. However, little research has examined whether and how children scan faces of own and other races differently for face recognition. In this eye-tracking study, Chinese children aged from 4 to 7 years and Chinese adults were asked to remember Chinese and Caucasian faces. None of the participants had any direct contact with foreign individuals. Multi-method analyses of eye-tracking data revealed that regardless of age group, proportional fixation duration on the eyes of Chinese faces was significantly lower than that on the eyes of Caucasian faces, whereas proportional fixation duration on the nose and mouth of Chinese faces was significantly higher than that on the nose and mouth of Caucasian faces. In addition, the amplitude of saccades on Chinese faces was significantly lower than that on Caucasian faces, potentially reflecting finer-grained processing for own-race faces. Moreover, adults' fixation duration/saccade numbers on the whole faces, proportional fixation percentage on the nose, proportional number of saccades between AOIs, and accuracy in recognizing faces were higher than those of children. These results together demonstrate that an abundance of visual experience with own-race faces and a lack of it with other-race faces may result in differential facial scanning in both children and adults. Furthermore, the increased experience of processing faces may result in a more holistic and advanced scanning strategy in Chinese adults.

The effects of information type (features vs. configuration) and location (eyes vs. mouth) on the development of face perception

The goal of the current study was to investigate the development of face processing strategies in a perceptual discrimination task. Children (7-12 years of age) and young adults were administered the Face Dimensions Task. In the Face Dimensions Task, participants were asked to judge whether two simultaneously presented faces were the "same" or "different". For the "same" trials, the two faces were identical. For the "different" trials, the faces differed in either the spacing between the eyes, the spacing between the nose and the mouth, the size of the eyes, or the size of the mouth. The main finding was that 7- to 10-year-old children showed no difference in their ability to discriminate differences in eye size and eye spacing but showed a poor ability to discriminate differences in nose and mouth spacing and, to a lesser extent, mouth size. The developmental lag between nose-mouth discriminations and the other featural and configural discriminations was reduced in older children and eliminated by young adulthood. These results indicate that the type of face information (i.e., configural vs. featural) and its location (i.e., eye vs. mouth) jointly contribute to the development of face perception abilities.

Own- and other-race face scanning in infants: implications for perceptual narrowing

The present study investigated how 6- and 9-month-old Caucasian infants scan Caucasian and Chinese dynamic faces using eye-tracking methodology. Analyses of looking times revealed that with increased age, infants decreased their looking time to other-race noses, while maintaining their looking time for own-race noses. From 6 to 9 months, infants increased their looking time for the eyes of both races of faces. Analyses of scan paths showed that infants were no more likely to shift their fixation between the eyes of own-race faces than other-race faces. Similarity between participants' scan paths suggested that facial information was collected more efficiently for own- versus other-race faces at 9 months of age. Combined with previous eye-tracking studies of infants' face scanning (Liu et al. [2011] Journal of Experimental Child Psychology, 108, 180-189; Wheeler et al. [2011] PLoS ONE, 6, e18621. doi: 10.1371/journal.pone.0018621; Xiao et al. [2013] International Journal of Behavioral Development, 37, 100-105), the findings are interpreted in the context of perceptual narrowing and suggest differential contributions of visual experience, facial physiognomy, and culture in accounting for similarity and difference in infants scanning of own- and other-race faces.

Face engagement during infancy predicts later face recognition ability in younger siblings of children with autism

Face recognition difficulties are frequently documented in children with autism spectrum disorders (ASD). It has been hypothesized that these difficulties result from a reduced interest in faces early in life, leading to decreased cortical specialization and atypical development of the neural circuitry for face processing. However, a recent study by our lab demonstrated that infants at increased familial risk for ASD, irrespective of their diagnostic status at 3 years, exhibit a clear orienting response to faces. The present study was conducted as a follow-up on the same cohort to investigate how measures of early engagement with faces relate to face-processing abilities later in life. We also investigated whether face recognition difficulties are specifically related to an ASD diagnosis, or whether they are present at a higher rate in all those at familial risk. At 3 years we found a reduced ability to recognize unfamiliar faces in the high-risk group that was not specific to those children who received an ASD diagnosis, consistent with face recognition difficulties being an endophenotype of the disorder. Furthermore, we found that longer looking at faces at 7 months was associated with poorer performance on the face recognition task at 3 years in the high-risk group. These findings suggest that longer looking at faces in infants at risk for ASD might reflect early face-processing difficulties and predicts difficulties with recognizing faces later in life.

Perceptual specialization and configural face processing in infancy

Adults' face processing expertise includes sensitivity to second-order configural information (spatial relations among features such as distance between eyes). Prior research indicates that infants process this information in female faces. In the current experiments, 9-month-olds discriminated spacing changes in upright human male and monkey faces but not in inverted faces. However, they failed to process matching changes in upright house stimuli. A similar pattern of performance was exhibited by 5-month-olds. Thus, 5- and 9-month-olds exhibited specialization by processing configural information in upright primate faces but not in houses or inverted faces. This finding suggests that, even early in life, infants treat faces in a special manner by responding to changes in configural information more readily in faces than in non-face stimuli. However, previously reported differences in infants' processing of human versus monkey faces at 9 months of age (but not at younger ages), which have been associated with perceptual narrowing, were not evident in the current study. Thus, perceptual narrowing is not absolute in the sense of loss of the ability to process information from other species' faces at older ages.

Development of face scanning for own- and other-race faces in infancy

The present study investigated whether infants visually scan own- and other-race faces differently as well as how these differences in face scanning develop with age. A multi-method approach was used to analyze the eye-tracking data of 6- and 9-month-old Caucasian infants scanning dynamically displayed own- and other-race faces. We found that 6-month-olds showed differential fixation, fixating significantly more on the left eye and mouth of own-race faces, but more on the nose of other-race faces. Infants at 9 months of age fixated more on the eyes of own-race faces, but more on the mouth of other-race faces. A scan path analysis revealed that infants shifted their attention between the eyes of the own-race faces significantly more frequently than for other-race faces. Overall, younger and older infants responded differentially to own- versus other-race faces not only in the absolute amount of time spent fixating specific features, but also on their fixation shifts between features.

Eye contrast polarity is critical for face recognition by infants

Just as faces share the same basic arrangement of features, with two eyes above a nose above a mouth, human eyes all share the same basic contrast polarity relations, with a sclera lighter than an iris and a pupil, and this is unique among primates. The current study examined whether this bright-dark relationship of sclera to iris plays a critical role in face recognition from early in development. Specifically, we tested face discrimination in 7- and 8-month-old infants while independently manipulating the contrast polarity of the eye region and of the rest of the face. This gave four face contrast polarity conditions: fully positive condition, fully negative condition, positive face with negated eyes ("negative eyes") condition, and negated face with positive eyes ("positive eyes") condition. In a familiarization and novelty preference procedure, we found that 7- and 8-month-olds could discriminate between faces only when the contrast polarity of the eyes was preserved (positive) and that this did not depend on the contrast polarity of the rest of the face. This demonstrates the critical role of eye contrast polarity for face recognition in 7- and 8-month-olds and is consistent with previous findings for adults.

Development of Recognition of Face Parts from Unfamiliar Faces

The present study examined developmental changes in the ability to recognize face parts. In Experiment 1, participants were familiarized with whole faces and given a recognition test with old and new eyes, noses, mouths, inner faces, outer faces, or whole faces. Adults were above chance in their recognition of the eye and mouth regions. However, children did not naturally encode and recognize face parts independently of the entire face. In addition, all age groups showed comparable inner and outer face recognition, except for 8- to 9-year-olds who showed a recognition advantage for outer faces. In Experiment 2, when participants were familiarized with eyes, noses, or mouths and tested with eyes, noses, or mouths, respectively, all ages showed above-chance recognition of eyes and mouths. Thirteen- to 14-year-olds were adult-like in their recognition of the eye region, but mouth recognition continued to develop beyond 14 years of age. Nose recognition was above chance among 13- to 14-year-olds, but recognition scores remained low even in adulthood. The present findings reveal unique developmental trajectories in the use of isolated facial regions in face recognition and suggest that featural cues (as a class) have a different ontogenetic course relative to holistic and configural cues.

Are Faces Special to Infants? An Investigation of Configural and Featural Processing for the Upper and Lower Regions of Houses in 3- to 7-month-olds

Three- to 7-month-olds were administered a house version of the Face Dimensions Test in which the featural and configural information of the upper and lower windows were systematically varied. The Dimensions Test has previously been used to study the processing of face features and their configurations by infants (Quinn & Tanaka, 2009). Just as was the case with faces, infants were shown to be sensitive to configural change in the upper and lower regions and to featural change in the upper region, but not to featural change in the lower region. The outcomes reflect either a face processing system that can generalize broadly to stimuli that are as different from faces as houses or a more general processing system with perceptual operations that can apply to both faces and houses.

Positive, but not negative, facial expressions facilitate 3-month-olds’ recognition of an individual face

The current study examined whether and how the presence of a positive or a negative emotional expression may affect the face recognition process at 3 months of age. Using a familiarization procedure, Experiment 1 demonstrated that positive (i.e., happiness), but not negative (i.e., fear and anger) facial expressions facilitate infants’ ability to recognize an individual face. Experiment 2 showed that the advantage of positive over negative facial expressions is driven by the processing of salient features inherent in the happy expression, rather than by the processing of the configural information conveyed by the entire happy face. Overall, these results support the presence of a mutual interaction between face identity and emotion recognition.

Development of face processing

This article reviews the development of the face-processing system from birth, during infancy and through childhood, until it becomes the sophisticated system observed in adults. We begin by discussing the following major theoretical issues concerning the development of face expertise: (1) nature versus nurture or the role of experience in face processing, (2) level of processing (i.e., global, basic, subordinate, individual) and expertise, and (3) type of processing (i.e., holistic, configural, featural). This general overview will be followed by a closer examination of individual studies that investigate the development of face processing. These studies will include a review of (1) development of differential processing of faces and objects, (2) development of differential processing of faces of different species, (3) developmental changes in processing facial identity, and (4) developmental changes in the categorization of faces. Our review of the developmental literature reveals early competence in face-processing abilities with infants presenting a preference for face stimuli and facial discrimination using featural, configural, and holistic cues. This early competence is then later refined as evidenced by age-related changes throughout childhood. Some of the refinements are likely due to the development of general cognitive abilities, whereas some others may be face-specific. WIREs Cogni Sci 2011 2 666-675 DOI: 10.1002/wcs.146 This article is categorized under: Psychology > Development and Aging.

Similarity and difference in the processing of same- and other-race faces as revealed by eye tracking in 4- to 9-month-olds

Fixation duration for same-race (i.e., Asian) and other-race (i.e., Caucasian) female faces by Asian infant participants between 4 and 9 months of age was investigated with an eye-tracking procedure. The age range tested corresponded with prior reports of processing differences between same- and other-race faces observed in behavioral looking time studies, with preference for same-race faces apparent at 3 months of age and recognition memory differences in favor of same-race faces emerging between 3 and 9 months of age. The eye-tracking results revealed both similarity and difference in infants' processing of own- and other-race faces. There was no overall fixation time difference between same race and other race for the whole face stimuli. In addition, although fixation time was greater for the upper half of the face than for the lower half of the face and trended higher on the right side of the face than on the left side of the face, face race did not impact these effects. However, over the age range tested, there was a gradual decrement in fixation time on the internal features of other-race faces and a maintenance of fixation time on the internal features of same-race faces. Moreover, the decrement in fixation time for the internal features of other-race faces was most prominent on the nose. The findings suggest that (a) same-race preferences may be more readily evidenced in paired comparison testing formats, (b) the behavioral decline in recognition memory for other-race faces corresponds in timing with a decline in fixation on the internal features of other-race faces, and (c) the center of the face (i.e., the nose) is a differential region for processing same- versus other-race faces by Asian infants.