A critical review of the development of face recognition: experience is less important than previously believed

Perceptual narrowing continues throughout childhood: Evidence from specialization of face processing

Face recognition shows a long trajectory of development and is known to be closely associated with the development of social skills. However, it is still debated whether this long trajectory is perceptually based and what the role is of experience-based refinements of face representations throughout development. We examined the effects of short and long-term experienced stimulus history on face processing, using regression biases of face representations towards the experienced mean. Children and adults performed same-different judgments in a serial discrimination task where two consecutive faces were drawn from a distribution of morphed faces. The results show that face recognition continues to improve after 9 years of age, with more pronounced improvements for own-race faces. This increased narrowing with age is also indicated by similar use of stimulus statistics for own-race and other-race faces in children, contrary to the different use of the overall stimulus history for these two face types in adults. Increased face proficiency in adulthood renders the perceptual system less tuned to other-race face statistics. Altogether, the results demonstrate associations between levels of specialization and the extent to which perceptual representations become narrowly tuned with age.

The development of human cortical scene processing

Decades of research have uncovered the neural basis of place (or "scene") processing in adulthood, revealing a set of three regions that respond selectively to visual scene information, each hypothesized to support distinct functions within scene processing (e.g., recognizing a particular kind of place versus navigating through it). Despite this considerable progress, surprisingly little is known about how these cortical regions develop. Here we review the limited evidence to date, highlighting the first few studies exploring the origins of cortical scene processing in infancy, and the several studies addressing when the scene regions reach full maturity, unfortunately with inconsistent findings. This inconsistency likely stems from common pitfalls in pediatric functional magnetic resonance imaging, and accordingly, we discuss how these pitfalls may be avoided. Furthermore, we point out that almost all studies to date have focused only on general scene selectivity and argue that greater insight could be gleaned by instead exploring the more distinct functions of each region, as well as their connectivity. Finally, with this last point in mind, we offer a novel hypothesis that scene regions supporting navigation (including the occipital place area and retrosplenial complex) mature later than those supporting scene categorization (including the parahippocampal place area).

Change detection versus change localization for faces, houses, and words

Holistic processing aids in the discrimination of visually similar objects, but it may also come with a cost. Indeed holistic processing may improve the ability to detect changes to a face while impairing the ability to locate where the changes occur. We investigated the capacity to detect the occurrence of a change versus the capacity to detect the localization of a change for faces, houses, and words. Change detection was better than change localization for faces. Change localization outperformed change detection for houses. For words, there was no difference between detection and localization. We know from previous studies that words are processed holistically. However, being an object of visual expertise processed holistically, visual words are also a linguistic entity. Previously, the word composite effect was found for phonologically consistent words but not for phonologically inconsistent words. Being an object of visual expertise for which linguistic information is important, letter position information, is also crucial. Thus, the importance of localization of letters and features may augment the capacity to localize a change in words making the detection of a change and the detection of localization of a change equivalent.

Dissociable Cognitive Systems for Recognizing Places and Navigating through Them: Developmental and Neuropsychological Evidence

Recent neural evidence suggests that the human brain contains dissociable systems for "scene categorization" (i.e., recognizing a place as a particular kind of place, for example, a kitchen), including the parahippocampal place area, and "visually guided navigation" (e.g., finding our way through a kitchen, not running into the kitchen walls or banging into the kitchen table), including the occipital place area. However, converging behavioral data - for instance, whether scene categorization and visually guided navigation abilities develop along different timelines and whether there is differential breakdown under neurologic deficit - would provide even stronger support for this two-scene-systems hypothesis. Thus, here we tested scene categorization and visually guided navigation abilities in 131 typically developing children between 4 and 9 years of age, as well as 46 adults with Williams syndrome, a developmental disorder with known impairment on "action" tasks, yet relative sparing on "perception" tasks, in object processing. We found that (1) visually guided navigation is later to develop than scene categorization, and (2) Williams syndrome adults are impaired in visually guided navigation, but not scene categorization, relative to mental age-matched children. Together, these findings provide the first developmental and neuropsychological evidence for dissociable cognitive systems for recognizing places and navigating through them.SIGNIFICANCE STATEMENT Two decades ago, Milner and Goodale showed us that identifying objects and manipulating them involve distinct cognitive and neural systems. Recent neural evidence suggests that the same may be true of our interactions with our environment: identifying places and navigating through them are dissociable systems. Here we provide converging behavioral evidence supporting this two-scene-systems hypothesis - finding both differential development and breakdown of "scene categorization" and "visually guided navigation." This finding suggests that the division of labor between perception and action systems is a general organizing principle for the visual system, not just a principle of the object processing system in particular.

Functional MRI responses to naturalistic stimuli are increasingly typical across early childhood

While findings show that throughout development, there are child- and age-specific patterns of brain functioning, there is also evidence for significantly greater inter-individual response variability in young children relative to adults. It is currently unclear whether this increase in functional "typicality" (i.e., inter-individual similarity) is a developmental process that occurs across early childhood, and what changes in BOLD response may be driving changes in typicality. We collected fMRI data from 81 typically developing 4-8-year-old children during passive viewing of age-appropriate television clips and asked whether there is increasing typicality of brain response across this age range. We found that the "increasing typicality" hypothesis was supported across many regions engaged by passive viewing. Post hoc analyses showed that in a priori ROIs related to language and face processing, the strength of the group-average shared component of activity increased with age, with no concomitant decline in residual signal or change in spatial extent or variability. Together, this suggests that increasing inter-individual similarity of functional responses to audiovisual stimuli is an important feature of early childhood functional brain development.

Prosopagnosia does not abolish other-race effects

Healthy observers recognize more accurately same-than other-race faces (i.e., the Same-Race Recognition Advantage - SRRA) but categorize them by race more slowly than other-race faces (i.e., the Other-Race Categorization Advantage - ORCA). Several fMRI studies reported discrepant bilateral activations in the Fusiform Face Area (FFA) and Occipital Face Area (OFA) correlating with both effects. However, due to the very nature and limits of fMRI results, whether these face-sensitive regions play an unequivocal causal role in those other-race effects remains to be clarified. To this aim, we tested PS, a well-studied pure case of acquired prosopagnosia with lesions encompassing the left FFA and the right OFA. PS, healthy age-matched and young adults performed two recognition and three categorization by race tasks, respectively using Western Caucasian and East Asian faces normalized for their low-level properties with and without-external features, as well as in naturalistic settings. As expected, PS was slower and less accurate than the controls. Crucially, however, the magnitudes of her SRRA and ORCA were comparable to the controls in all the tasks. Our data show that prosopagnosia does not abolish other-race effects, as an intact face system, the left FFA and/or right OFA are not critical for eliciting the SRRA and ORCA. Race is a strong visual and social signal that is encoded in a large neural face-sensitive network, robustly tuned for processing same-race faces.

Exploring pattern recognition: what is the relationship between the recognition of words, faces and other objects?

Debate surrounds processes of visual recognition, with no consensus as to whether recognition of distinct object categories (faces, bodies, cars, and words) is domain specific or subserved by domain-general visual recognition mechanisms. Here, we investigated correlations between the performance of 74 participants on recognition tasks for words, faces and other object categories. Participants completed a counter-balanced test battery of the Cambridge Face, Car and Body Parts Memory tests, as well as a standard four category lexical decision task, with response time and recognition accuracy as dependent variables. Results revealed significant correlations across domains for both recognition accuracy and response time, providing some support for domain-general pattern recognition. Further exploration of the data using principal component analysis (PCA) revealed a two-component model for both the response time and accuracy data. However, how the various word and object recognition tasks fitted these components varied considerably but did hint at familiarity/expertise as a common factor. In sum, we argue a complex relationship exists between domain-specific processing and domain-general processing, but that this is shaped by expertise. To further our understanding of pattern recognition, research investigating the recognition of words, faces and other objects in dyslexic individuals is recommended, as is research exploiting neuroimaging methodologies, with excellent temporal resolution, to chart the temporal specifics of different forms of visual pattern recognition.

Face processing in the infant brain after pandemic lockdown

The role of visual experience in the development of face processing has long been debated. We present a new angle on this question through a serendipitous study that cannot easily be repeated. Infants viewed short blocks of faces during fMRI in a repetition suppression task. The same identity was presented multiple times in half of the blocks (repeat condition) and different identities were presented once each in the other half (novel condition). In adults, the fusiform face area (FFA) tends to show greater neural activity for novel versus repeat blocks in such designs, suggesting that it can distinguish same versus different face identities. As part of an ongoing study, we collected data before the COVID-19 pandemic and after an initial local lockdown was lifted. The resulting sample of 12 infants (9-24 months) divided equally into pre- and post-lockdown groups with matching ages and data quantity/quality. The groups had strikingly different FFA responses: pre-lockdown infants showed repetition suppression (novel > repeat), whereas post-lockdown infants showed the opposite (repeat > novel), often referred to as repetition enhancement. These findings provide speculative evidence that altered visual experience during the lockdown, or other correlated environmental changes, may have affected face processing in the infant brain.

Anatomical correlates of category-selective visual regions have distinctive signatures of connectivity in neonates

The ventral visual stream is shaped during development by innate proto-organization within the visual system, such as the strong input from the fovea to the fusiform face area. In adults, category-selective regions have distinct signatures of connectivity to brain regions beyond the visual system, likely reflecting cross-modal and motoric associations. We tested if this long-range connectivity is part of the innate proto-organization, or if it develops with postnatal experience, by using diffusion-weighted imaging to characterize the connectivity of anatomical correlates of category-selective regions in neonates (N = 445), 1-9 month old infants (N = 11), and adults (N = 14). Using the HCP data we identified face- and place- selective regions and a third intermediate region with a distinct profile of selectivity. Using linear classifiers, these regions were found to have distinctive connectivity at birth, to other regions in the visual system and to those outside of it. The results support an extended proto-organization that includes long-range connectivity that shapes, and is shaped by, experience-dependent development.

The relation between holistic processing as measured by three composite tasks and face processing: A latent variable modeling approach

We investigated the relationship between holistic processing and face processing using a latent variables approach. Three versions of the composite paradigm were used to measure holistic processing: Vanderbilt Holistic Face Processing Test, a sequential composite matching task, and a simultaneous composite matching task. Three tasks were used to measure face perception and face memory abilities respectively. We had three pairs of tasks such that within each pair (of memory and perception task), the stimuli involved, the requirement for matching across viewpoints, etc., are the same, such that the only difference is whether perception or memory is taxed. There were no significant correlations between the different versions of the composite task. We discovered no evidence to support a distinction between face perception and face memory, suggesting the existence of a general face processing factor. Finally, there was no evidence that holistic processing (as captured by either of the three composite tasks) is predictive of better face processing per se, casting doubts on the role of holistic processing in differentiating different levels of efficiency in face processing.

Developmental trajectories of expert perception processing of Chinese characters in primary school children

Previous studies have demonstrated that inversion effect and left-side bias are stable expertise markers in Chinese character processing among adults. However, it is less clear how these markers develop early on (i.e., among primary school students). Therefore, this study aimed to investigate the development of the two markers by comparing primary school-aged students of three age groups (Grade 1, Grade 3, and Grade 5) and adults in tests of inversion effect (Experiment 1) and left-sided bias effect (Experiment 2). The results replicated that both effects during Chinese character processing were present among adults. However, more importantly, the effects were different among primary school-aged students in different grades: the inversion effect was found as early as in Grade 1, but the left-side bias effect did not emerge in Grade 1 and as approximated that of adults until Grade 3. The study suggested a potential dissociation in developing different aspects of expertise during Chinese character processing in early childhood.

Configural properties of face portraits change between childhood and adulthood

Adult observers are sensitive to the configuration of facial features within a face, able to distinguish between relative differences in feature spacing, and detecting deviations from typical facial appearance. How does the representation of the typical configuration of facial features develop? While there is a great deal of work describing children’s developing abilities to detect differences in feature spacing across face images, there is substantially less work examining what children think constitutes a typical arrangement of facial features. In the current study, we investigated this issue using a production task in which adults and 5- to 10-year-old children created a face “portrait” by arranging the eyes, nose, and mouth of a standard face within an empty outline. Using this simple task, we found differences in face configuration across age groups, such that children of all ages made far larger errors than adult participants, expanding facial features outward from the center of the face more than adults. These results were not affected by face inversion, potentially implying a domain-general rather than face-specific process. We also found that children of all ages endorsed the correct configuration as a best likeness in a perceptual task. We discuss these results in terms of ongoing debate regarding the extent to which configural processing is a meaningful component of face recognition and the conclusions we can draw from production paradigms as compared to purely perceptual tasks.

Using child-friendly movie stimuli to study the development of face, place, and object regions from age 3 to 12 years

Scanning young children while they watch short, engaging, commercially-produced movies has emerged as a promising approach for increasing data retention and quality. Movie stimuli also evoke a richer variety of cognitive processes than traditional experiments, allowing the study of multiple aspects of brain development simultaneously. However, because these stimuli are uncontrolled, it is unclear how effectively distinct profiles of brain activity can be distinguished from the resulting data. Here we develop an approach for identifying multiple distinct subject-specific Regions of Interest (ssROIs) using fMRI data collected during movie-viewing. We focused on the test case of higher-level visual regions selective for faces, scenes, and objects. Adults (N = 13) were scanned while viewing a 5.6-min child-friendly movie, as well as a traditional localizer experiment with blocks of faces, scenes, and objects. We found that just 2.7 min of movie data could identify subject-specific face, scene, and object regions. While successful, movie-defined ssROIS still showed weaker domain selectivity than traditional ssROIs. Having validated our approach in adults, we then used the same methods on movie data collected from 3 to 12-year-old children (N = 122). Movie response timecourses in 3-year-old children's face, scene, and object regions were already significantly and specifically predicted by timecourses from the corresponding regions in adults. We also found evidence of continued developmental change, particularly in the face-selective posterior superior temporal sulcus. Taken together, our results reveal both early maturity and functional change in face, scene, and object regions, and more broadly highlight the promise of short, child-friendly movies for developmental cognitive neuroscience.

Preschoolers’ Sensitivity to Negative and Positive Emotional Facial Expressions: An ERP Study

The study examined processing differences for facial expressions (happy, angry, or neutral) and their repetition with early (P1, N170) and late (P3) event-related potentials (ERPs) in young children (N = 33). EEG was recorded while children observed sequentially presented pairs of facial expressions, which were either the same (repeated trials) or differed in their emotion (novel trials). We also correlated ERP amplitude differences with parental and child measures of socio-emotional competence (emotion recognition, empathy). P1 amplitudes were increased for angry and happy as compared to neutral expressions. We also detected larger P3 amplitudes for angry expressions as compared to happy or neutral expressions. Repetition effects were evident at early and late processing stages marked by reduced P1 amplitudes for repeated vs. novel happy expressions, but enhanced P3 amplitudes for repeated vs. novel facial expressions. N170 amplitudes were neither modulated by facial expressions nor their repetition. None of the repetition effects were associated with measures of socio-emotional competence. Taken together, negative facial expressions led to increased neural activations in early and later processing stages, indicative of enhanced saliency to potential threating stimuli in young children. Processing of repeated facial expression seem to be differential for early and late neural stages: Reduced activation was detected at early neural processing stages particularly for happy faces, indicative of effective processing for an emotion, which is most familiar within this age range. Contrary to our hypothesis, enhanced activity for repeated vs. novel expression independent of a particular emotion were detected at later processing stages, which may be linked to the creation of new memory traces. Early and late repetition effects are discussed in light of developmental and perceptual differences as well as task-specific load.

Change detection vs. change localization for own-race and other-race faces

The other-race effect (ORE) is a well-known phenomenon in which people discriminate and recognize faces from their ethnic group more accurately than faces from other ethnic groups. Holistic processing, or the mandatory tendency to process all parts of an object together, has been proposed as an explanation for the ORE. According to the holistic perspective of the ORE, other-race faces might be subject to weaker holistic processing than own-race faces. However, evidence for this hypothesis is inconsistent. Although it is generally assumed that holistic processing helps the individuation of objects, holistic processing may also come at a cost. Specifically, holistic processing may reduce the capacity to localize changes in the constituent parts of an object, but not in detecting changes to an object as a whole. In the present study, we examined change detection and change localization accuracy for Caucasian and African faces, and houses. Performance was better for change detection than change localization for Caucasian faces. While clear costs of holistic processing for Caucasian faces were thus found, the difference between change localization and change detection was not obvious for African faces. However, childhood exposure to other-race people correlated with change detection for African faces, but not with change localization for African faces. Our results thus show that holistic processing of other-race faces may depend on early contact with other-race people.

Face masks disrupt holistic processing and face perception in school-age children

Face perception is considered a remarkable visual ability in humans that is subject to a prolonged developmental trajectory. In response to the COVID-19 pandemic, mask-wearing has become mandatory for adults and children alike. Recent research shows that mask-wearing hinders face recognition abilities in adults, but it is unknown if the same holds true in school-age children in whom face perception is not fully developed. Here we tested children (n = 72, ages 6-14 years old) on the Cambridge Face Memory Test - Kids (CFMT-K), a validated measure of face perception performance. Faces were presented with or without masks and across two orientations (upright/inverted). The inclusion of face masks led to a profound deficit in face perception abilities. This decrement was more pronounced in children compared to adults, but only when task difficulty was adjusted across the two age groups. Additionally, children exhibited reliable correlations between age and the CFMT-K score for upright faces for both the mask and no-mask conditions. Finally, as previously observed in adults, children also showed qualitative differences in the processing of masked versus non-masked faces. Specifically, holistic processing, a hallmark of face perception, was disrupted for masked faces as suggested by a reduced face-inversion effect. Together, these findings provide evidence for substantial quantitative and qualitative alterations in the processing of masked faces in school-age children.

Sensitivity to Emotion Intensity and Recognition of Emotion Expression in Neurotypical Children

This study assessed two components of face emotion processing: emotion recognition and sensitivity to intensity of emotion expressions and their relation in children age 4 to 12 (N = 216). Results indicated a slower development in the accurate decoding of low intensity expressions compared to high intensity. Between age 4 and 12, children discriminated high intensity expressions better than low ones. The intensity of expression had a stronger impact on overall face expression recognition. High intensity happiness was better recognized than low intensity up to age 11, while children 4 to 12 had difficulties discriminating between high and low intensity sadness. Our results suggest that sensitivity to low intensity expressions acts as a complementary mediator between age and emotion expression recognition, while this was not the case for the recognition of high intensity expressions. These results could help in the development of specific interventions for populations presenting socio-cognitive and emotion difficulties.

Homogenization of face neural representation during development

Extensive studies have demonstrated that face processing ability develops gradually during development until adolescence. However, the underlying mechanism is unclear. One hypothesis is that children and adults represent faces in qualitatively different fashions with different group templates. An alternative hypothesis emphasizes the development as a quantitative change with a decrease of variation in representations. To test these hypotheses, we used between-participant correlation to measure activation pattern similarity both within and between late-childhood children and adults. We found that activation patterns for faces in the fusiform face area and occipital face area were less similar within the children group than within the adults group, indicating children had a greater variation in representing faces. Interestingly, the activation pattern similarity of children to their own group template was not significantly larger than that to adults' template, suggesting children and adults shared a template in representing faces. Further, the decrease in representation variance was likely a general principle in the ventral visual cortex, as a similar result was observed in a scene-selective region when perceiving scenes. Taken together, our study provides evidence that development of object representation may result from a homogenization process that shifts from greater variance in late-childhood to homogeneity in adults.

Is human face recognition lateralized to the right hemisphere due to neural competition with left-lateralized visual word recognition? A critical review

The right hemispheric lateralization of face recognition, which is well documented and appears to be specific to the human species, remains a scientific mystery. According to a long-standing view, the evolution of language, which is typically substantiated in the left hemisphere, competes with the cortical space in that hemisphere available for visuospatial processes, including face recognition. Over the last decade, a specific hypothesis derived from this view according to which neural competition in the left ventral occipito-temporal cortex with selective representations of letter strings causes right hemispheric lateralization of face recognition, has generated considerable interest and research in the scientific community. Here, a systematic review of studies performed in various populations (infants, children, literate and illiterate adults, left-handed adults) and methodologies (behavior, lesion studies, (intra)electroencephalography, neuroimaging) offers little if any support for this reading lateralized neural competition hypothesis. Specifically, right-lateralized face-selective neural activity already emerges at a few months of age, well before reading acquisition. Moreover, consistent evidence of face recognition performance and its right hemispheric lateralization being modulated by literacy level during development or at adulthood is lacking. Given the absence of solid alternative hypotheses and the key role of neural competition in the sensory-motor cortices for selectivity of representations, learning, and plasticity, a revised language-related neural competition hypothesis for the right hemispheric lateralization of face recognition should be further explored in future research, albeit with substantial conceptual clarification and advances in methodological rigor.

On the relationship between maps and domains in inferotemporal cortex

How does the brain encode information about the environment? Decades of research have led to the pervasive notion that the object-processing pathway in primate cortex consists of multiple areas that are each specialized to process different object categories (such as faces, bodies, hands, non-face objects and scenes). The anatomical consistency and modularity of these regions have been interpreted as evidence that these regions are innately specialized. Here, we propose that ventral-stream modules do not represent clusters of circuits that each evolved to process some specific object category particularly important for survival, but instead reflect the effects of experience on a domain-general architecture that evolved to be able to adapt, within a lifetime, to its particular environment. Furthermore, we propose that the mechanisms underlying the development of domains are both evolutionarily old and universal across cortex. Topographic maps are fundamental, governing the development of specializations across systems, providing a framework for brain organization.

Distorting Face Representations in Newborn Brains

What role does experience play in the development of face recognition? A growing body of evidence indicates that newborn brains need slowly changing visual experiences to develop accurate visual recognition abilities. All of the work supporting this "slowness constraint" on visual development comes from studies testing basic-level object recognition. Here, we present the results of controlled-rearing experiments that provide evidence for a slowness constraint on the development of face recognition, a prototypical subordinate-level object recognition task. We found that (1) newborn chicks can rapidly develop view-invariant face recognition and (2) the development of this ability relies on experience with slowly moving faces. When chicks were reared with quickly moving faces, they built distorted face representations that largely lacked invariance to viewpoint changes, effectively "breaking" their face recognition abilities. These results provide causal evidence that slowly changing visual experiences play a critical role in the development of face recognition, akin to basic-level object recognition. Thus, face recognition is not a hardwired property of vision but is learned rapidly as the visual system adapts to the temporal structure of the animal's visual environment.

Average faces: How does the averaging process change faces physically and perceptually?

Average faces have been used frequently in face recognition studies, either as a theoretical concept (e.g., face norm) or as a tool to manipulate facial attributes (e.g., modifying identity strength). Nonetheless, how the face averaging process- the creation of average faces using an increasing number of faces -changes the resulting averaged faces and our ability to differentiate between them remains to be elucidated. Here we addressed these questions by combining 3D-face averaging, eye-movement tracking, and the computation of image-based face similarity. Participants judged whether two average faces showed the same person while we systematically increased their average level (i.e., number of faces being averaged). Our results showed, with increasing averaging, both a nonlinear increase of the computational similarity between the resulting average faces and a nonlinear decrease of face discrimination performance. Participants' performance dropped from near-ceiling level when two different faces had been averaged together to chance level when 80 faces were mixed. We also found a nonlinear relationship between face similarity and face discrimination performance, which was fitted nicely with an exponential function. Furthermore, when the comparison task became more challenging, participants performed more fixations onto the faces. Nonetheless, the distribution of fixations across facial features (eyes, nose, mouth, and the center area of a face) remained unchanged. These results not only set new constraints on the theoretical characterization of the average face and its role in establishing face norms but also offer practical guidance for creating approximated face norms to manipulate face identity.

Similar use of shape and texture cues for own- and other-race faces during face learning and recognition

Although the other-race effect (ORE; superior recognition of own- relative to other-race faces) is well established, the mechanisms underlying it are not well understood. We examined whether the ORE is attributable to differential use of shape and texture cues for own- vs. other-race faces. Shape cues are particularly important for detecting that an own-race face is unfamiliar, whereas texture cues are more important for recognizing familiar and newly learned own-race faces. We compared the influence of shape and texture cues on Caucasian participants' recognition of Caucasian and East Asian faces using two complementary approaches. In Experiment 1, participants studied veridical, shape-caricatured, or texture-caricatured faces and then were asked to recognize them in an old/new recognition task. In Experiment 2, all study faces were veridical and we independently removed the diagnosticity of shape (or texture) cues in the test phase by replacing original shape (or texture) with average shape (or texture). Despite an overall own-race advantage, participants' use of shape and texture cues was comparable for own- and other-race faces. These results suggest that the other-race effect is not attributable to qualitative differences in the use of shape and texture cues.

Reading: The Confluence of Vision and Language

The scientific study of reading has a rich history that spans disciplines from vision science to linguistics, psychology, cognitive neuroscience, neurology, and education. The study of reading can elucidate important general mechanisms in spatial vision, attentional control, object recognition, and perceptual learning, as well as the principles of plasticity and cortical topography. However, literacy also prompts the development of specific neural circuits to process a unique and artificial stimulus. In this review, we describe the sequence of operations that transforms visual features into language, how the key neural circuits are sculpted by experience during development, and what goes awry in children for whom learning to read is a struggle. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Impaired social attention detected through eye movements in children with early-onset epilepsy

OBJECTIVES

Children with early-onset epilepsy (CWEOE; epilepsy onset before 5 years) exhibit impaired social functioning, but social attention has not yet been examined. In this study we sought to explore visual attention via eye tracking as a component of social attention and examine its relationship with social functioning and Autism Spectrum Disorder (ASD) risk scores.

METHODS

Forty-seven CWEOE (3-63 months) and 41 controls (3-61 months) completed two eye-tracking tasks: (1) preference for social versus nonsocial naturalistic scenes, and (2) face region preference task. ASD risk was measured via the Modified Checklist for Autism in Toddlers or Conners Early Childhood Total Score. Social functioning was assessed via the Greenspan Social-Emotional Growth Chart, or Infant-Toddler Social & Emotional Assessment Competence Scale, or Conners Early Childhood Social Functioning Scale, depending on age. Fixation preferences for social scenes and eyes were compared between groups and evaluated by age and social functioning scores.

RESULTS

Regression analysis revealed that CWEOE viewed the social scene to a significantly less degree than controls. The greatest difference was found between the youngest CWEOE and controls. Fixation duration was independently and significantly related to social functioning scores. There were no significant differences between CWEOE and controls in the face scanning task, and there was no significant relationship between either task and ASD risk scores.

SIGNIFICANCE

CWEOE exhibit task-specific atypical social attention early in the course of the disease. This may be an early marker of impaired social development, and it suggests abnormal social brain development.

Children process faces holistically with the same efficiency as adults

Previous studies had reported qualitatively identical holistic face processing (using the composite task) already in 6-year-olds. In the present study, we evaluated these processes quantitatively by evaluating whether children are less efficient in dealing with and encoding faces. Thus, in the present study we explored the time course of holistic processing in children and adults by manipulating stimulus presentation time. The study composite task was presented for 800 ms. The test composite face was presented either for 183 ms or 800 ms. Our youngest participants, 6-year-olds, process faces holistically with the same efficiency as typical adults.

The Face Module Emerged in a Deep Convolutional Neural Network Selectively Deprived of Face Experience

Can we recognize faces with zero experience on faces? This question is critical because it examines the role of experiences in the formation of domain-specific modules in the brain. Investigation with humans and non-human animals on this issue cannot easily dissociate the effect of the visual experience from that of the hardwired domain-specificity. Therefore, the present study built a model of selective deprivation of the experience on faces with a representative deep convolutional neural network, AlexNet, by removing all images containing faces from its training stimuli. This model did not show significant deficits in face categorization and discrimination, and face-selective modules automatically emerged. However, the deprivation reduced the domain-specificity of the face module. In sum, our study provides empirical evidence on the role of nature vs. nurture in developing the domain-specific modules that domain-specificity may evolve from non-specific experience without genetic predisposition, and is further fine-tuned by domain-specific experience.

Beyond Likert ratings: Improving the robustness of developmental research measurement using best-worst scaling

Some of the ‘best practice’ approaches to ensuring reproducibility of research can be difficult to implement in the developmental and clinical domains, where sample sizes and session lengths are constrained by the practicalities of recruitment and testing. For this reason, an important area of improvement to target is the reliability of measurement. Here we demonstrate that best–worst scaling (BWS) provides a superior alternative to Likert ratings for measuring children’s subjective impressions. Seventy-three children aged 5–6 years rated the trustworthiness of faces using either Likert ratings or BWS over two sessions. Individual children’s ratings in the BWS condition were significantly more consistent from session 1 to session 2 than those in the Likert condition, a finding we also replicate with a large adult sample (N = 72). BWS also produced more reliable ratings at the group level than Likert ratings in the child sample. These findings indicate that BWS is a developmentally appropriate response format that can deliver substantial improvements in reliability of measurement, which can increase our confidence in the robustness of findings with children.

Face and word composite effects are similarly affected by priming of local and global processing

Holistic processing has been shown with both faces and words, but it is unclear how similar their underlying mechanisms are. In this study attention to global and local features was manipulated and the consequences for holistic word and face processing were examined. On each trial participants were presented two Navon figures and told to focus on either the global or the local level. Then they performed a composite task in which they indicated whether the target halves of two sequentially presented faces or words were the same or different, ignoring the irrelevant halves. Similar stronger global priming effects were found for faces and words, indicating that holistic processing for the two types of stimuli were susceptible to attention manipulations to similar degrees, which was confirmed with Bayesian analyses. The findings add to the investigation of the similarity and differences between holistic processing and help reveal those aspects of holistic processing that are domain general and those specific to individual categories.

The Role of Racial and Developmental Experience on Emotional Adaptive Coding in Autism Spectrum Disorder

Sensitivity to emotional face aids in rapid detection and evaluation of others, such that by school-age, children and youth exhibit adult-like patterns when the prolonged viewing of an emotional face distorts the perception of a subsequent face. However, the developmental considerations of this phenomenon (known as emotional adaptive coding) are unclear given ongoing maturational and experiential changes, including the influence of own-race experiences or the lack of face expertise, as is evident in autism spectrum disorder (ASD). This study addressed whether emotional adaptive coding is sensitive to factors of face perception expertise, specifically self-race and developmental experience, in adults (age 19-28 years) and youth (age 10-16 years). Emotional adaptive coding was not influenced by race expertise (i.e., other versus same race identity) in White and Asian adults. Emotional adaptation coding during childhood and adolescence is consistent with adults, though youth with ASD exhibited stronger adaptor after-effects in response to other-race faces, relative to TD youth and adults. By extending prior work to examine the integration of race and emotional adaptive coding in ASD, we discovered that the strength of response in ASD is atypical when viewing other-race faces, which clarifies the role of racial and facial experience on emotional face adaption.

White matter fascicles and cortical microstructure predict reading-related responses in human ventral temporal cortex

Reading-related responses in the lateral ventral temporal cortex (VTC) show a consistent spatial layout across individuals, which is puzzling, since reading skills are acquired during childhood. Here, we tested the hypothesis that white matter fascicles and gray matter microstructure predict the location of reading-related responses in lateral VTC. We obtained functional (fMRI), diffusion (dMRI), and quantitative (qMRI) magnetic resonance imaging data in 30 adults. fMRI was used to map reading-related responses by contrasting responses in a reading task with those in adding and color tasks; dMRI was used to identify the brain's fascicles and to map their endpoint densities in lateral VTC; qMRI was used to measure proton relaxation time (T1), which depends on cortical tissue microstructure. We fit linear models that predict reading-related responses in lateral VTC from endpoint density and T1 and used leave-one-subject-out cross-validation to assess prediction accuracy. Using a subset of our participants (N=10, feature selection set), we find that i) endpoint densities of the arcuate fasciculus (AF), inferior longitudinal fasciculus (ILF), and vertical occipital fasciculus (VOF) are significant predictors of reading-related responses, and ii) cortical T1 of lateral VTC further improves the predictions of the fascicle model. In the remaining participants (N=20, validation set), we show that a linear model that includes T1, AF, ILF and VOF significantly predicts i) the map of reading-related responses across lateral VTC and ii) the location of the visual word form area, a region critical for reading. Overall, our data-driven approach reveals that the AF, ILF, VOF and cortical microstructure have a consistent spatial relationship with an individual's reading-related responses in lateral VTC.

Pareidolias and Creativity in Patients with Mental Disorders

OBJECTIVE

Pareidolias are ilusionary misjudgments and are seen as the result of deliberately or unconsciously caused misinterpretations by the human brain, which tends to complete diffuse and apparently incomplete perceptual images. The psychopathological value of pareidolia in the context of neuropsychiatric diseases has, however, been little researched so far.

METHODS

In this pilot study, a total of 25 patients (mean age 43.3 years, SD 16.2) with an affective disorder or schizophrenic disease (ICD-10: F3.X or F2.X) and 25 healthy volunteers (mean age 46.1 years, SD 15.4) were compared for sociodemographic factors and psychometric findings, as well as pareidolias and creativity.

RESULTS

We found that the patients identified significantly fewer pareidolias than healthy controls (p = 0.002) and that patients with schizophrenia, in particular, had a significantly lower hit rate (p = 0.005). Across the whole group, there were clear positive correlations between pareidolia and high creativity, as well as personality traits such as impulsiveness/spontaneity, extraversion, and conscientiousness.

CONCLUSIONS

Unexpectedly, having less nosology-specific features than individual specific properties such as creativity and extraversion, and especially openness and verbal intelligence, in patients with affective disorder or schizophrenia promotes the recognition of pareidolia as a specific form of illusionary misperception.

The development of race effects in face processing from childhood through adulthood: Neural and behavioral evidence

Most adults are better at recognizing recently encountered faces of their own race, relative to faces of other races. In adults, this race effect in face recognition is associated with differential neural representations of own- and other-race faces in the fusiform face area (FFA), a high-level visual region involved in face recognition. Previous research has linked these differential face representations in adults to viewers' implicit racial associations. However, despite the fact that the FFA undergoes a gradual development which continues well into adulthood, little is known about the developmental time-course of the race effect in FFA responses. Also unclear is how this race effect might relate to the development of face recognition or implicit associations with own- or other-races during childhood and adolescence. To examine the developmental trajectory of these race effects, in a cross-sectional study of European American (EA) children (ages 7-11), adolescents (ages 12-16) and adults (ages 18-35), we evaluated responses to adult African American (AA) and EA face stimuli, using functional magnetic resonance imaging and separate behavioral measures outside the scanner. We found that FFA responses to AA and EA faces differentiated during development from childhood into adulthood; meanwhile, the magnitudes of race effects increased in behavioral measures of face-recognition and implicit racial associations. These three race effects were positively correlated, even after controlling for age. These findings suggest that social and perceptual experiences shape a protracted development of the race effect in face processing that continues well into adulthood.

Depression severity is associated with impaired facial emotion processing in a large international sample

BACKGROUND

Depression is associated with biases in facial emotion processing, which have an impact on the course and treatment of depression. While decades of research have established a negativity bias in processing in depression, there is still a gap in our understanding of how depression severity impacts sensitivity to detecting differences in emotional faces.

METHODS

We examined emotion sensitivity (ES), or the ability to to detect subtle differences in emotional faces, in a large, geographically and culturally diverse, web-based sample (N = 6598, age range = 18-96, 56.50% female, 66% Caucasian). Participants completed ES tasks (fear, anger, or happiness) and a Beck Depression Inventory-II, to determine depression severity.

RESULTS

Depression severity was correlated with overall ES performance as well as ES performance for individual emotions. Higher depression scores were associated with poorer performance in detecting happiness, fear, and anger (ps < .001). Examining performance by region, Eastern countries showed significantly poorer ES performance compared to Western countries, and were significantly more depressed.

LIMITATIONS

Our sample is non-clinical and self-selected.

CONCLUSIONS

This study is an extension of existing research on emotional facial processing, with an approach that takes into consideration the heterogeneity of depression symptoms and corrects psychometric confounds of traditional emotion face processing paradigms. Overall, factors related to severity, task reliability, and facial stimuli should be considered in determining the potential mechanism of facial emotion processing in the onset and course of depression.

Perceived match between own and observed models' bodies: influence of face, viewpoints, and body size

People are generally unable to accurately determine their own body measurements and to translate this knowledge to identifying a model/avatar that best represents their own body. This inability has not only been related to health problems (e.g. anorexia nervosa), but has important practical implications as well (e.g. online retail). Here we aimed to investigate the influence of three basic visual features—face presence, amount of viewpoints, and observed model size—on the perceived match between own and observed models’ bodies and on attitudes towards these models. Models were real-life models (Experiment 1) or avatar models based on participants’ own bodies (Experiment 2). Results in both experiments showed a strong effect of model size, irrespective of participants’ own body measurements. When models were randomly presented one by one, participants gave significantly higher ratings to smaller- compared to bigger-sized models. The reverse was true, however, when participants observed and compared models freely, suggesting that the mode of presentation affected participants’ judgments. Limited evidence was found for an effect of facial presence or amount of viewpoints. These results add evidence to research on visual features affecting the ability to match observed bodies with own body image, which has biological, clinical, and practical implications.

Time-Dependent Negative Effects of Verbal and Non-verbal Suggestions in Surgical Patients-A Study on Arm Muscle Strength

Introduction

The medical environment is full of suggestions that affect patients and their healing. Most of them inadvertently are negative, thus evoking nocebo effects. Recently, we have reported on the effect of such verbal and non-verbal suggestions as well as alternative formulations on maximal muscular arm strength in healthy volunteers. In the present study, we tested the same suggestions in patients at two time points to evaluate nocebo effects in a clinical situation and the impact of the approaching surgery date.

Methods

In 45 patients, maximal muscular strength during arm abduction was measured by dynamometry of the deltoid muscle group. One test was several days before and the second on the evening before surgery. Baseline values were compared to the performance after exposure to 18 verbal and non-verbal suggestions. The sequence of presumably negative and positive suggestions was randomized for each patient in order to avoid cumulation effects of immediate succession of two negatives. State anxiety was evaluated at both time points, and suggestibility was measured after surgery.

Results

Strong and statistically significant weakening effects were observed with all presumed negative suggestions from daily clinical practice including words of encouragement (91.4% of baseline), evaluation of symptoms (89.0%), announcement of a medical intervention (82.8%), a negative memory (86.5%), expectation of an uncertain future (82.8%), and non-verbal signals (87.7–92.2%). In contrast, alternative formulations did not interfere with muscular performance in most cases. A more pronounced effect was observed in the test repeated closer to the date of surgery, accompanied by a 15% higher anxiety level. The increase in anxiety correlated slightly with stronger weakening effects of suggestions, as did suggestibility.

Conclusions

Negative suggestions cause a decrease in arm muscle strength, i.e., a “weakening” of the patient. This effect is enhanced by an increase in anxiety as the time of treatment, like surgery, approaches. The reaction can be avoided by alternative formulations. These nocebo effects that are objectively measured and quantified by a decrease in arm muscle strength are more pronounced in patients, i.e., in a clinical situation, than in healthy volunteers.

The Effect of Perceptual Learning on Face Recognition in Individuals with Central Vision Loss

Purpose

To examine whether perceptual learning can improve face discrimination and recognition in older adults with central vision loss.

Methods

Ten participants with age-related macular degeneration (ARMD) received 5 days of training on a face discrimination task (mean age, 78 ± 10 years). We measured the magnitude of improvements (i.e., a reduction in threshold size at which faces were able to be discriminated) and whether they generalized to an untrained face recognition task. Measurements of visual acuity, fixation stability, and preferred retinal locus were taken before and after training to contextualize learning-related effects. The performance of the ARMD training group was compared to nine untrained age-matched controls (8 = ARMD, 1 = juvenile macular degeneration; mean age, 77 ± 10 years).

Results

Perceptual learning on the face discrimination task reduced the threshold size for face discrimination performance in the trained group, with a mean change (SD) of –32.7% (+15.9%). The threshold for performance on the face recognition task was also reduced, with a mean change (SD) of –22.4% (+2.31%). These changes were independent of changes in visual acuity, fixation stability, or preferred retinal locus. Untrained participants showed no statistically significant reduction in threshold size for face discrimination, with a mean change (SD) of –8.3% (+10.1%), or face recognition, with a mean change (SD) of +2.36% (–5.12%).

Conclusions

This study shows that face discrimination and recognition can be reliably improved in ARMD using perceptual learning. The benefits point to considerable perceptual plasticity in higher-level cortical areas involved in face-processing. This novel finding highlights that a key visual difficulty in those suffering from ARMD is readily amenable to rehabilitation.

The right hemispheric dominance for face perception in preschool children depends on the visual discrimination level

The developmental origin of human adults' right hemispheric dominance in response to face stimuli remains unclear, in particular because young infants' right hemispheric advantage in face-selective response is no longer present in preschool children, before written language acquisition. Here we used fast periodic visual stimulation (FPVS) with scalp electroencephalography (EEG) to test 52 preschool children (5.5 years old) at two different levels of face discrimination: discrimination of faces against objects, measuring face-selectivity, or discrimination between individual faces. While the contrast between faces and nonface objects elicits strictly bilateral occipital responses in children, strengthening previous observations, discrimination of individual faces in the same children reveals a strong right hemispheric lateralization over the occipitotemporal cortex. Picture-plane inversion of the face stimuli significantly decreases the individual discrimination response, although to a much smaller extent than in older children and adults tested with the same paradigm. However, there is only a nonsignificant trend for a decrease in right hemispheric lateralization with inversion. There is no relationship between the right hemispheric lateralization in individual face discrimination and preschool levels of readings abilities. The observed difference in the right hemispheric lateralization obtained in the same population of children with two different paradigms measuring neural responses to faces indicates that the level of visual discrimination is a key factor to consider when making inferences about the development of hemispheric lateralization of face perception in the human brain.

Development of Holistic Face Processing From Childhood and Adolescence to Young Adulthood in Chinese Individuals

Previous studies have indicated that holistic face processing is important for the development of face perception. The purpose of this study was to verify the development trajectory of holistic processing, from older childhood to young adulthood, using the complete composite paradigm. Participants from three different age groups (children, adolescents, young adults) were recruited for this study. The results showed that all groups demonstrated the composite effect with similar magnitude. Furthermore, face processing performance improved with age. These results, together with previous results, imply it is a race-general phenomenon that holistic face processing is similar among older children, adolescents, and young adults.

Developmental changes in orienting towards faces: A behavioral and eye-tracking study

Previous studies show that newborn infants and adults orient their attention preferentially toward human faces. However, the developmental changes of visual attention captured by face stimuli remain unclear, especially when an explicit top-down process is involved. We capitalized on a visual search paradigm to assess how the relative strength of visual attention captured by a non-target face stimulus and explicit attentional control on a target stimulus evolve as search progresses and how this process changes during development. Ninety children aged 5–14 years searched for a target within an array of distractors, which occasionally contained an upright face. To assess the precise picture of developmental changes, we measured: (1) manual responses, such as reaction time and accuracy; and (2) eye movements such as the location of the first fixation, which reflect the attentional profile at the initial stage, and looking times, which reflect the attentional profile at the later period of searching. Both reaction time and accuracy were affected by the presence of the target-unrelated face, though the interference effect was observed consistently across ages. However, developmental changes were captured by the first fixation proportion, suggesting that initial attention was preferentially directed towards the target-unrelated face before 6.9 years of age. Furthermore, prior to 12.8 years of age, the first fixation towards face stimuli was significantly more frequent than for object stimuli. In contrast, the looking time proportion for the face stimuli was significantly higher than that for the objects across all ages. These findings suggest that developmental changes do not influence the later search periods during a trial, but that they influence the initial orienting indexed by the first fixation. Moreover, the manual responses are tightly linked to eye movement behaviors.

Rapid and coarse face detection: With a lack of evidence for a nasal-temporal asymmetry

Humans have structures dedicated to the processing of faces, which include cortical components (e.g., areas in occipital and temporal lobes) and subcortical components (e.g., superior colliculus and amygdala). Although faces are processed more quickly than stimuli from other categories, there is a lack of consensus regarding whether subcortical structures are responsible for rapid face processing. In order to probe this, we exploited the asymmetry in the strength of projections to subcortical structures between the nasal and temporal hemiretina. Participants detected faces from unrecognizable control stimuli and performed the same task for houses. In Experiments 1 and 3, at the fastest reaction times, participants detected faces more accurately than houses. However, there was no benefit of presenting to the subcortical pathway. In Experiment 2, we probed the coarseness of the rapid pathway, making the foil stimuli more similar to faces and houses. This eliminated the rapid detection advantage, suggesting that rapid face processing is limited to coarse representations. In Experiment 4, we sought to determine whether the natural difference between spatial frequencies of faces and houses were driving the effects seen in Experiments 1 and 3. We spatially filtered the faces and houses so that they were matched. Better rapid detection was again found for faces relative to houses, but we found no benefit of preferentially presenting to the subcortical pathway. Taken together, the results of our experiments suggest a coarse rapid detection mechanism, which was not dependent on spatial frequency, with no advantage for presenting preferentially to subcortical structures.

Successful Reorganization of Category-Selective Visual Cortex following Occipito-temporal Lobectomy in Childhood

Investigations of functional (re)organization in children who have undergone large cortical resections offer a unique opportunity to elucidate the nature and extent of cortical plasticity. We report findings from a 3-year investigation of a child, U.D., who underwent surgical removal of the right occipital and posterior temporal lobes at age 6 years 9 months. Relative to controls, post-surgically, U.D. showed age-appropriate intellectual performance and visuoperceptual face and object recognition skills. Using fMRI at five different time points, we observed a persistent hemianopia and no visual field remapping. In category-selective visual cortices, however, object- and scene-selective regions in the intact left hemisphere were stable early on, but regions subserving face and word recognition emerged later and evinced competition for cortical representation. These findings reveal alterations in the selectivity and topography of category-selective regions when confined to a single hemisphere and provide insights into dynamic functional changes in extrastriate cortical architecture.

Developmental Reorganization of the Core and Extended Face Networks Revealed by Global Functional Connectivity

Prior studies on development of functional specialization in human brain mainly focus on age-related increases in regional activation and connectivity among regions. However, a few recent studies on the face network demonstrate age-related decrease in face-specialized activation in the extended face network (EFN), in addition to increase in activation in the core face network (CFN). Here we used a voxel-based global brain connectivity approach to investigate whether development of the face network exhibited both increase and decrease in network connectivity. We found the voxel-wise resting-state functional connectivity (FC) within the CFN increased with age in bilateral posterior superior temporal sulcus, suggesting the integration of the CFN during development. Interestingly, the FC of the voxels in the EFN to the right fusiform face area and occipital face area decreased with age, suggesting that the CFN segregated from the EFN during development. Moreover, the age-related connectivity in the CFN was related to behavioral performance in face processing. Overall, our study demonstrated developmental reorganization of the face network achieved by both integration within the CFN and segregation of the CFN from the EFN, which may account for the simultaneous increases and decreases in neural activation during the development of the face network.

Universal Mechanisms and the Development of the Face Network: What You See Is What You Get

Our assignment was to review the development of the face-processing network, an assignment that carries the presupposition that a face-specific developmental program exists. We hope to cast some doubt on this assumption and instead argue that the development of face processing is guided by the same ubiquitous rules that guide the development of cortex in general.

A critical period for faces: Other-race face recognition is improved by childhood but not adult social contact

Poor recognition of other-race faces is ubiquitous around the world. We resolve a longstanding contradiction in the literature concerning whether interracial social contact improves the other-race effect. For the first time, we measure the age at which contact was experienced. Taking advantage of unusual demographics allowing dissociation of childhood from adult contact, results show sufficient childhood contact eliminated poor other-race recognition altogether (confirming inter-country adoption studies). Critically, however, the developmental window for easy acquisition of other-race faces closed by approximately 12 years of age and social contact as an adult — even over several years and involving many other-race friends — produced no improvement. Theoretically, this pattern of developmental change in plasticity mirrors that found in language, suggesting a shared origin grounded in the functional importance of both skills to social communication. Practically, results imply that, where parents wish to ensure their offspring develop the perceptual skills needed to recognise other-race people easily, childhood experience should be encouraged: just as an English-speaking person who moves to France as a child (but not an adult) can easily become a native speaker of French, we can easily become “native recognisers” of other-race faces via natural social exposure obtained in childhood, but not later.