Meanings, mechanisms, and measures of holistic processing

Perceptual heterogeneity in developmental prosopagnosia is continuous, not categorical

Developmental prosopagnosia (DP) is associated with considerable perceptual heterogeneity, though the nature of this heterogeneity and whether there are discrete subgroups versus continuous deficits remains unclear. Bennetts et al. (2022) recently found that holistic versus featural processing deficits distinguished discrete DP subgroups, but their sample was relatively small (N = 37), and subgroups were defined using a single task. To characterize perceptual heterogeneity in DPs more comprehensively, we administered a broad face perception battery to a large sample of 109 DPs and 134 controls, including validated measures of face matching (Cambridge Face Perception Test - CFPT, Computerized Benton Facial Recognition Test, Same/Different Face Matching Task), holistic processing (Part-Whole Task), and feature processing (Georges Task and Part-Whole part trials). When examining face matching measures, DPs exhibited a similar distribution of performance as controls, though shifted towards impairment by an average of 1.4 SD. We next applied Bennetts (2022) hierarchical clustering approach and k-means clustering to the CFPT upright, inverted, and inversion index measures, similarly finding one group of DPs with poorer inverted face performance and another with a decreased face inversion effect (holistic processing). However, these subgroup differences failed to generalize to other measures of feature and holistic processing beyond the CFPT. We finally ran hierarchical and k-means cluster analyses on our larger battery of face matching, feature, and holistic processing measures. Results clearly showed subgroups with generally better versus worse performance across all measures, with the distinction between groups being somewhat arbitrary. Together, these findings support a continuous account of DP perceptual heterogeneity, with performance differing primarily across all aspects of face perception.

Learned Attentional Strategies in Word Holistic Processing

Previous research has shown that, like faces, words are processed either holistically or through the automatic representation of their parts combined. The automaticity assumed to underlie the holistic processing of words presupposes that individuals have a relatively low level of control over these processes. However, they may also be capable of learning from their environments whether processing words as a whole is the most efficient processing strategy-which would require at least some control over the corresponding processes. In fact, previous research supports this latter account in the context of the holistic processing of faces: when provided a task in which participants should ignore half of a stimuli (the irrelevant part) and pay selective attention to the other half (the target part), the participants become better at ignoring the irrelevant part when it is commonly misleading (i.e., this suggests a response that is different from that of the relevant part in the context of the task). In the present work, we extend these considerations to holistic word processing. Our results support a learned attentional account in the context of holistic word processing. When an irrelevant word part is systematically helpful for the judgment of a target word half, participants engage more in holistic processing (vs. when the irrelevant word half is misleading). This reflects an incidental statistical learning process in which individuals identify the irrelevant word half as either providing helpful or misleading information about the target half.

A preference to look closer to the eyes is associated with a position-invariant face neural code

When looking at faces, humans invariably move their eyes to a consistent preferred first fixation location on the face. While most people have the preferred fixation location just below the eyes, a minority have it between the nose-tip and mouth. Not much is known about whether these long-term differences in the preferred fixation location are associated with distinct neural representations of faces. To study this, we used a gaze-contingent face adaptation aftereffect paradigm to test in two groups of observers, one with their mean preferred fixation location closer to the eyes (upper lookers) and the other closer to the mouth (lower lookers). In this task, participants were required to maintain their gaze at either their own group's mean preferred fixation location or that of the other group during adaptation and testing. The two possible fixation locations were 3.6° apart on the face. We measured the face adaptation aftereffects when the adaptation and testing happened while participants maintained fixation at either the same or different locations on the face. Both groups showed equally strong adaptation effects when the adaptation and testing happened at the same fixation location. Crucially, only the upper lookers showed a partial transfer of the FAE across the two fixation locations, when adaptation occurred at the eyes. Lower lookers showed no spatial transfer of the FAE irrespective of the adaptation position. Given the classic finding that neural tuning is increasingly position invariant as one moves higher in the visual hierarchy, this result suggests that differences in the preferred fixation location are associated with distinct neural representations of faces.

Understanding of facial features in face perception: insights from deep convolutional neural networks

Introduction

Face recognition has been a longstanding subject of interest in the fields of cognitive neuroscience and computer vision research. One key focus has been to understand the relative importance of different facial features in identifying individuals. Previous studies in humans have demonstrated the crucial role of eyebrows in face recognition, potentially even surpassing the importance of the eyes. However, eyebrows are not only vital for face recognition but also play a significant role in recognizing facial expressions and intentions, which might occur simultaneously and influence the face recognition process.

Methods

To address these challenges, our current study aimed to leverage the power of deep convolutional neural networks (DCNNs), an artificial face recognition system, which can be specifically tailored for face recognition tasks. In this study, we investigated the relative importance of various facial features in face recognition by selectively blocking feature information from the input to the DCNN. Additionally, we conducted experiments in which we systematically blurred the information related to eyebrows to varying degrees.

Results

Our findings aligned with previous human research, revealing that eyebrows are the most critical feature for face recognition, followed by eyes, mouth, and nose, in that order. The results demonstrated that the presence of eyebrows was more crucial than their specific high-frequency details, such as edges and textures, compared to other facial features, where the details also played a significant role. Furthermore, our results revealed that, unlike other facial features, the activation map indicated that the significance of eyebrows areas could not be readily adjusted to compensate for the absence of eyebrow information. This finding explains why masking eyebrows led to more significant deficits in face recognition performance. Additionally, we observed a synergistic relationship among facial features, providing evidence for holistic processing of faces within the DCNN.

Discussion

Overall, our study sheds light on the underlying mechanisms of face recognition and underscores the potential of using DCNNs as valuable tools for further exploration in this field.

Opposite size illusions for inverted faces and letters

Words are the primary means by which we communicate meaning and ideas, while faces provide important social cues. Studying visual illusions involving faces and words can elucidate the hierarchical processing of information as different regions of the brain are specialised for face recognition and word processing. A size illusion has previously been demonstrated for faces, whereby an inverted face is perceived as larger than the same stimulus upright. Here, two experiments replicate the face size illusion, and investigate whether the illusion is also present for individual letters (Experiment 1), and visual words and pseudowords (Experiment 2). Results confirm a robust size Illusion for faces. Letters, words and pseudowords and unfamiliar letters all show a reverse size illusion, as we previously demonstrated for human bodies. Overall, results indicate the illusion occurs in early perceptual stages upstream of semantic processing. Results are consistent with the idea of a general-purpose mechanism that encodes curvilinear shapes found in both scripts and our environment. Word and face perception rely on specialised, independent cognitive processes. The underestimation of the size of upright stimuli is specific to faces. Opposite size illusions may reflect differences in how size information is encoded and represented in stimulus-specialised neural networks, resulting in contrasting perceptual effects. Though words and faces differ visually, there is both symmetry and asymmetry in how the brain 'reads' them.

The face inversion effect does not provide a pure measure of holistic face processing

It is widely held that upright faces are processed more holistically than inverted faces and that this difference is reflected in the face inversion effect. It is not clear, however, how the inversion effect can best be measured, whether it is task specific, or even whether it specifically correlates with processing of upright faces. We examined these questions in a large sample (N = 420) who provided data on processing of upright and inverted stimuli in two different tasks with faces and one with objects. We find that the inversion effects are task dependent, and that they do not correlate better among face processing tasks than they do across face and object processing tasks. These findings were obtained regardless of whether inversion effects were measured by means of difference scores or regression. In comparison, only inversion effects based on regression predicted performance with upright faces in tasks other than those the inversion effects were derived from. Critically, however, inversion effects based on regression also predicted performance with inverted faces to a similar degree as they predicted performance with upright faces. Consequently, and contrary to what is commonly assumed, inversion effects do not seem to capture effects specific to holistic processing of upright faces. While the present findings do not bring us closer to an understanding of which changes in cognitive processing are induced by inversion, they do suggest that inversion effects do not reflect a unitary construct; an implicit assumption that seems to characterize much of the research regarding face processing.

A new approach to diagnosing and researching developmental prosopagnosia: Excluded cases are impaired too

Developmental prosopagnosia is characterized by severe, lifelong difficulties when recognizing facial identity. Unfortunately, the most common diagnostic assessment (Cambridge Face Memory Test) misses 50-65% of individuals who believe that they have this condition. This results in such excluded cases' absence from scientific knowledge, effect sizes of impairment potentially overestimated, treatment efficacy underrated, and may elicit in them a negative experience of research. To estimate their symptomology and group-level impairments in face processing, we recruited a large cohort who believes that they have prosopagnosia. Matching prior reports, 56% did not meet criteria on the Cambridge Face Memory Test. However, the severity of their prosopagnosia symptoms and holistic perception deficits were comparable to those who did meet criteria. Excluded cases also exhibited face perception and memory impairments that were roughly one standard deviation below neurotypical norms, indicating the presence of objective problems. As the prosopagnosia index correctly classified virtually every case, we propose it should be the primary method for providing a diagnosis, prior to subtype categorization. We present researchers with a plan on how they can analyze these excluded prosopagnosia cases in their future work without negatively impacting their traditional findings. We anticipate such inclusion will enhance scientific knowledge, more accurately estimate effect sizes of impairments and treatments, and identify commonalities and distinctions between these different forms of prosopagnosia. Owing to their atypicalities in visual perception, we recommend that the prosopagnosia index should be used to screen out potential prosopagnosia cases from broader vision research.

Measuring the Contributions of Perceptual and Attentional Processes in the Complete Composite Face Paradigm

Theories of holistic face processing vary widely with respect to conceptualizations, paradigms, and stimuli. These divergences have left several theoretical questions unresolved. Namely, the role of attention in face perception is understudied. To rectify this gap in the literature, we combined the complete composite face task (allowing for predictions of multiple theoretical conceptualizations and connecting with a large body of research) with a secondary auditory discrimination task at encoding (to avoid a visual perceptual bottleneck). Participants studied upright, intact faces within a continuous recognition paradigm, which intermixes study and test trials at multiple retention intervals. Within subjects, participants studied faces under full or divided attention. Test faces varied with respect to alignment, congruence, and retention intervals. Overall, we observed the predicted beneficial outcomes of holistic processing (e.g., higher discriminability for Congruent, Aligned faces relative to Congruent, Misaligned faces) that persisted across retention intervals and attention. However, we did not observe the predicted detrimental outcomes of holistic processing (e.g., higher discriminability for Incongruent, Misaligned faces relative to Incongruent, Aligned faces). Because the continuous recognition paradigm exerts particularly strong demands on attention, we interpret these findings through the lens of resource dependency and domain specificity.

Navon letters and composite faces: same or different processing mechanisms?

Navon letters and composite faces are two fascinating demonstrations of hierarchical organization in perception. Many researchers believe that the two types of stimuli and their associated tasks gauge comparable holistic mechanisms. This belief is so common that the two paradigms are now being applied in tandem to measure impaired holistic processing in prosopagnosic patients. But are Navon letters and composite faces processed in a similar fashion? In the present study we take a closer look at their apparent affinity. We gain novel insights into their underlying mechanisms by fitting parameters of the linear ballistic accumulator (LBA) model to empirical correct and incorrect response times (RTs). The results reveal major differences in processing between the two tasks. We conclude that despite the presence of a compelling surface similarity, Navon compound letters and composite faces tap into separate psychological processes.

Holistic and featural processing's link to face recognition varies by individual and task

While it is generally accepted that holistic processing facilitates face recognition, recent studies suggest that poor recognition might also arise from imprecise perception of local features in the face. This study aimed to examine to what extent holistic and featural processing relates to individual differences in face recognition ability (FRA), during face learning (Experiment 1) and face recognition (Experiment 2). Participants performed two tasks: (1) The "Cambridge Face Memory Test-Chinese" which measured participants' FRAs, and (2) an "old/new recognition memory test" encompassing whole faces (preserving holistic and featural processing) and faces revealed through a dynamic aperture (impairing holistic processing but preserving featural processing). Our results showed that participants recognised faces more accurately in conditions when holistic information was preserved, than when it is impaired. We also show that the better use of holistic processing during face learning and face recognition was associated with better FRAs. However, enhanced featural processing during recognition, but not during learning, was related to better FRAs. Together, our findings demonstrate that good face recognition depends on distinct roles played by holistic and featural processing at different stages of face recognition.

Change detection versus change localization for faces, houses, and words

Holistic processing aids in the discrimination of visually similar objects, but it may also come with a cost. Indeed holistic processing may improve the ability to detect changes to a face while impairing the ability to locate where the changes occur. We investigated the capacity to detect the occurrence of a change versus the capacity to detect the localization of a change for faces, houses, and words. Change detection was better than change localization for faces. Change localization outperformed change detection for houses. For words, there was no difference between detection and localization. We know from previous studies that words are processed holistically. However, being an object of visual expertise processed holistically, visual words are also a linguistic entity. Previously, the word composite effect was found for phonologically consistent words but not for phonologically inconsistent words. Being an object of visual expertise for which linguistic information is important, letter position information, is also crucial. Thus, the importance of localization of letters and features may augment the capacity to localize a change in words making the detection of a change and the detection of localization of a change equivalent.

Processing objects of perceptual expertise: Differential interhemispheric transmission efficiency but similar transmission direction advantages

Faces and Chinese characters are both objects of perceptual expertise. In this study, we investigated the characteristics of interhemispheric transmission times (IHTTs) in both transmission direction and transmission efficiency during the processing of objects of perceptual expertise. A total of 112 participants engaged in a divided visual field paradigm for faces, Chinese characters, and houses in both upright and inverted orientations. The N170 amplitudes elicited by the objects of perceptual expertise (faces and Chinese characters) involved in this study were larger than those elicited by the non-perceptual expertise objects (houses). We used the latencies of the N170 component of the event-related potential (ERP) recorded in the left and right hemispheres to calculate the IHTTs. For all objects, the N170-related IHTTs from the right to the left hemispheres were shorter than those in the opposite direction. Essentially, the N170-related IHTTs for faces were shorter, that is, more efficient than those for Chinese characters and houses. This result indicates that the IHTTs during perceptual expertise and non-perceptual expertise object processing share a common transmission direction advantage, but transmission efficiency is face-specific.

Chinese holistic processing: Evidence from cognitive mental architecture using Systems Factorial Technology

Previous research has presented conflicting evidence regarding whether Chinese characters are processed holistically. In past work, we applied Systems Factorial Technology (SFT) and discovered that native Chinese speakers exhibited limited capacity when processing characters and words. To pinpoint the source of this limitation, our current research delved further into the mental architecture involved in processing Chinese characters and English words, taking into consideration information from each component. In our current study, participants were directed to make the same/different judgments on characters/words presented sequentially. Our results indicated that participants utilized a parallel self-terminating strategy when both or neither of the left/right components differed (Experiment 1). Faced with the decisional uncertainty that either the left/right component would also differ, most participants processed with a parallel exhaustive architecture, while a few exhibited the coactive architecture (Experiment 2). Taken together, our work provides evidence that in word/character perception, there is weak holistic processing (parallel self-terminating processing) when partial information is sufficient for the decision; robust holistic processing (coactive or parallel exhaustive processing) occurs under decisional uncertainty. Our findings underscore the significant role that the task and presentation context play in visual word processing.

Literacy acquisition facilitates inversion effects for faces with full-, low-, and high-spatial frequency: evidence from illiterate and literate adults

Previous studies have found that literacy acquisition modulates configural face processing (i.e., holistic and second-order configural processing). However, it remains unclear how literacy acquisition impacts the configural processing indexed by the inversion effect of normal or filtered faces. We asked Chinese illiterate and literate adults to judge whether two sequentially-presented stimuli, including faces, houses (experiment 1), and high- or low-pass filtered faces (experiment 2) were identical. Literate adults outperformed illiterate controls in the upright face and house conditions (experiment 1) and the upright high- and low-pass filtered conditions (experiment 2) but not in the inverted conditions. Notably, the size of an inversion effect (i.e., subtracting inverted accuracy from upright accuracy) was greater among literate adults than that among illiterate adults in both experiments. These findings support that literacy acquisition promotes configural face processing.

Looking at the upper facial half enlarges the range of holistic face processing

Previous studies suggested that upper and lower facial halves might be involved in the human holistic face processing differently. In this study, we replicated and extended the finding above. In Experiment 1, we used the standard composite-face task to measure holistic face processing when participants made judgements on the upper and lower facial halves separately. Results showed that the composite-face effect was stronger for the upper facial half compared to the lower half. In Experiment 2, we investigated how facial information was integrated when participants focused on different features, using the perceptual field paradigm. Results showed that: (1) more "peripheral faces" were chosen when participants fixated at the eyes than when they fixated at the mouth; (2) less "peripheral faces" were chosen for inverted faces regardless of the fixated features. Findings from both experiments together indicate that more peripheral facial information were integrated when participants focused on the upper facial half, highlighting the significance of focusing on the upper facial half in face processing.

The role of implicit social bias on holistic processing of out-group faces

Although faces of in-group members are generally thought to be processed holistically, there are mixed findings on whether holistic processing remains robust for faces of out-group members and what factors contribute to holistic processing of out-group faces. This study examined how implicit social bias, experience with out-group members, and ability to process in-group faces holistically might predict the magnitude of holistic processing for faces of two out-groups: other-race and other-age groups. In Experiment 1, Caucasian participants viewed Caucasian (own-race) and East Asian (other-race) faces. In Experiment 2, young adult participants viewed young adult (own-age) and baby (other-age) faces. Each participant completed a composite task with in-group and out-group faces, an implicit association test, and questionnaires about their experience with in-group and out-group members. We found that while the participants had relatively extensive experience with the other-race group, they had limited experience with the other-age group. Nonetheless, implicit social bias was found to positively predict the magnitude of holistic processing for both other-race and other-age faces. Exploratory analyses on the interactions among the predictors suggest that the effect of implicit social bias was primarily observed in participants with strong holistic processing ability of in-group faces but with low level of experience with members of the out-groups. These findings suggest that observers utilize different kinds of information when processing out-group faces, and that social features, such as race or age, are incorporated to influence how out-group faces are processed efficiently.

Tracking the growth of visual evidence in fingerprint comparison tasks

Fingerprint comparisons are extended in time due to the fine details (minutiae) that necessitate multiple eye fixations throughout the comparison. How is evidence accumulated across these multiple regions? The present work measures decisions at multiple points during a comparison to address how feature diagnosticity and image clarity play a role in evidence accumulation. We find that evidence is accumulated at a constant rate over time, with evidence for identification and exclusion accumulated at similar rates. Manipulations of image diagnosticity and image clarity demonstrate two exceptions to this constant rate: Highly diagnostic evidence followed by weak evidence tends to lose the initial benefits of the strong start, and low image clarity at the start of the comparison can be overcome with high image clarity at the end of the comparison. The results suggest that examiners tend to treat each region fairly independently (as demonstrated by linear evidence accumulation), with only weak evidence for hysteresis effects that tend to fade as additional regions are presented. Data from transition probability matrices support an incremental evidence accumulation account, with very little evidence for rapid "aha" moments even for exclusion decisions. The results are consistent with a model in which each fixated region contributes an independent unit of evidence, and these accumulate to form an eventual decision. Fingerprint comparisons do not seem to depend on which regions are selected first, and thus examiners need not worry about finding the most diagnostic region first, but instead focus on conducting a complete analysis of the latent print.

Spotting lesions in thorax X-rays at a glance: holistic processing in radiology

Radiologists often need only a glance to grasp the essence of complex medical images. Here, we use paradigms and manipulations from perceptual learning and expertise fields to elicit mechanisms and limits of holistic processing in radiological expertise. In the first experiment, radiologists were significantly better at categorizing thorax X-rays when they were presented for 200 ms in an upright orientation than when they were presented upside-down. Medical students, in contrast, were guessing in both situations. When the presentation time was increased to 500 ms, allowing for a couple more glances, the radiologists improved their performance on the upright stimuli, but remained at the same level on the inverted presentation. The second experiment circumvented the holistic processing by immediately cueing a tissue within the X-rays, which may or may not contain a nodule. Radiologists were again better than medical students at recognizing whether the cued tissue was a nodule, but this time neither the inverted presentation nor additional time affected their performance. Our study demonstrates that holistic processing is most likely a continuous recurring process which is just as susceptible to the inversion effect as in other expertise domains. More importantly, our study also indicates that holistic-like processing readily occurs in complex stimuli (e.g., whole thorax X-rays) but is more difficult to find in uniform single parts of such stimuli (e.g., nodules).

The mechanisms supporting holistic perception of words and faces are not independent

The question of whether word and face recognition rely on overlapping or dissociable neural and cognitive mechanisms received considerable attention in the literature. In the present work, we presented words (aligned or misaligned) superimposed on faces (aligned or misaligned) and tested the interference from the unattended stimulus category on holistic processing of the attended category. In Experiment 1, we found that holistic face processing is reduced when a face was overlaid with an unattended, aligned word (processed holistically). In Experiment 2, we found a similar reduction of holistic processing for words when a word was superimposed on an unattended, aligned face (processed holistically). This reciprocal interference effect indicates a trade-off in holistic processing of the two stimuli, consistent with the idea that word and face recognition may rely on non-independent, overlapping mechanisms.

Holistic face processing in 4- and 7-month-old infants

Previous studies found an onset of holistic face processing in the age range between 0-4 and 7 months of age. To validate these studies, the present study investigated infants 4 and 7 months of age with a different experimental approach. In a habituation-dishabituation experiment, the infants were tested with stereoscopic stimuli in which stripes floated above a face, thereby occluding some parts of the face (amodal completion condition), and stereoscopic stimuli in which the same face parts floated above stripes (modal completion condition). Research with adults indicates that faces are processed holistically, that is as global wholes, in the amodal, but as independent parts in the modal completion condition, resulting in superior face recognition when the occluding bars are in front of than when they are behind the visible face parts. The present study found that infants regardless of whether they are 4 or 7 months old reliably recognized and differentiated the faces in the amodal but not in the modal completion condition. Moreover, the difference between the experimental conditions was statistically significant. These findings show that approximately at the age of 4-7 months of life, infants begin to holistically unify disjoint face parts into a coherent whole.

The low prevalence effect in fingerprint comparison amongst forensic science trainees and novices

The low prevalence effect is a phenomenon whereby target prevalence affects performance in visual search (e.g., baggage screening) and comparison (e.g., fingerprint examination) tasks, such that people more often fail to detect infrequent target stimuli. For example, when exposed to higher base-rates of 'matching' (i.e., from the same person) than 'non-matching' (i.e., from different people) fingerprint pairs, people more often misjudge 'non-matching' pairs as 'matches'-an error that can falsely implicate an innocent person for a crime they did not commit. In this paper, we investigated whether forensic science training may mitigate the low prevalence effect in fingerprint comparison. Forensic science trainees (n = 111) and untrained novices (n = 114) judged 100 fingerprint pairs as 'matches' or 'non-matches' where the matching pair occurrence was either high (90%) or equal (50%). Some participants were also asked to use a novel feature-comparison strategy as a potential attenuation technique for the low prevalence effect. Regardless of strategy, both trainees and novices were susceptible to the effect, such that they more often misjudged non-matching pairs as matches when non-matches were rare. These results support the robust nature of the low prevalence effect in visual comparison and have important applied implications for forensic decision-making in the criminal justice system.

The relation between holistic processing as measured by three composite tasks and face processing: A latent variable modeling approach

We investigated the relationship between holistic processing and face processing using a latent variables approach. Three versions of the composite paradigm were used to measure holistic processing: Vanderbilt Holistic Face Processing Test, a sequential composite matching task, and a simultaneous composite matching task. Three tasks were used to measure face perception and face memory abilities respectively. We had three pairs of tasks such that within each pair (of memory and perception task), the stimuli involved, the requirement for matching across viewpoints, etc., are the same, such that the only difference is whether perception or memory is taxed. There were no significant correlations between the different versions of the composite task. We discovered no evidence to support a distinction between face perception and face memory, suggesting the existence of a general face processing factor. Finally, there was no evidence that holistic processing (as captured by either of the three composite tasks) is predictive of better face processing per se, casting doubts on the role of holistic processing in differentiating different levels of efficiency in face processing.

Healthy aging impairs face discrimination ability

Face images enable individual identities to be discriminated from one another. We aimed to quantify age-related changes in different aspects of face identity discrimination. Face discrimination sensitivity was measured with a memory-free "odd-one-out" task. Five age groups (N = 15) of healthy adults with normal vision were tested: 20, 50-59, 60-69, 70-79, and 80-89. Sensitivity was measured for full-face images (all features visible), external features (head-shape, hairline), internal features (nose, mouth, eyes, and eyebrows) and closed-contour shapes (control object). Sensitivity to full-faces continuously declined by approximately 13% per decade, after 50 years of age. When age-related differences in visual acuity were controlled, the effect of age on face discrimination sensitivity remained. Sensitivity to face features also deteriorated with age. Although the effect for external features was similar to full-faces, the rate of decline was considerably steeper (approximately 3.7 times) for internal, relative to external, features. In contrast, there was no effect of age on sensitivity to shapes. All age groups demonstrated the same overall pattern of sensitivity to different types of face information. Healthy aging was associated with a continuous decline in sensitivity to both full-faces and face features, although encoding of internal features was disproportionately impaired. This age-related deficit was independent of differences in low-level vision. That sensitivity to shapes was unaffected by age suggests these results cannot be explained by general cognitive decline or lower-level visual deficits. Instead, healthy aging is associated with a specific decline in the mechanisms that underlie face discrimination.

Body Processing in Children and Adolescents with Traumatic Brain Injury: An Exploratory Study

Dysfunctions in body processing have been documented in adults with brain damage, while limited information is available for children. This study aimed to investigate body processing in children and adolescents with traumatic brain injury (TBI) (N = 33), compared to peers with typical development. Two well-known computerized body-representation paradigms, namely Visual Body Recognition and Visuo-spatial Imagery, were administered. Through the first paradigm, the body inversion and composite illusion effects were tested with a matching to sample task as measures of configural and holistic processing of others’ bodies, respectively. The second paradigm investigated with a laterality judgement task the ability to perform first-person and object-based mental spatial transformations of own body and external objects, respectively. Body stimuli did not convey any emotional contents or symbolic meanings. Patients with TBI had difficulties with mental transformations of both body and object stimuli, displaying deficits in motor and visual imagery abilities, not limited to body processing. Therefore, cognitive rehabilitation of body processing in TBI might benefit from the inclusion of both general training on visuo-spatial abilities and specific exercises aimed at boosting visual body perception and motor imagery.

Attentional biases toward real images and drawings of negative faces

The allocation of attention is affected by internal emotional states, such as anxiety and depression. The attention captured by real images of negative faces can be quantified by emotional probe tasks. The present study investigated whether attentional bias toward drawings of negative faces (line drawings and cartoon faces) differs from that of real faces. Non-clinical university students indicated their levels of anxiety and depression via self-report questionnaires, and completed a probe discrimination task under three face image conditions in a between-participants design. Significant correlations were found between bias scores and scores on the self-reported BDI-II under the real face condition. However, two types of face drawings were only weakly correlated with self-report scores. In our probe task to investigate attentional bias to facial stimuli in nonclinical adults, the strength of the relationship between depression and attentional bias to negative face was stronger for real faces than for face drawings.

Face specific inversion effects provide evidence for two subtypes of developmental prosopagnosia

Many studies have attempted to identify the perceptual underpinnings of developmental prosopagnosia (DP). The majority have focused on whether holistic and configural processing mechanisms are impaired in DP. However, previous work suggests that there is substantial heterogeneity in holistic and configural processing within the DP population; further, there is disagreement as to whether any deficits are face-specific or reflect a broader perceptual deficit. This study used a data-driven approach to examine whether there are systematic patterns of variability in DP that reflect different underpinning perceptual deficits. A group of individuals with DP (N = 37) completed a cognitive battery measuring holistic/configural and featural processing in faces and non-face objects. A two-stage cluster analysis on data from the Cambridge Face Perception Test identified two subgroups of DPs. Across several tasks, the first subgroup (N = 21) showed typical patterns of holistic/configural processing (measured via inversion effects); the second (N = 16) was characterised by reduced or abolished inversion effects compared to age-matched control participants (N = 91). The subgroups did not differ on tasks measuring upright face matching, object matching, non-face holistic processing, or composite effects. These findings indicate two separable pathways to face recognition impairment, one characterised by impaired configural processing and the other potentially by impaired featural processing. Comparisons to control participants provide some preliminary evidence that the deficit in featural processing may extend to some non-face stimuli. Our results demonstrate the utility of examining both the variability between and consistency across individuals with DP as a means of illuminating our understanding of face recognition in typical and atypical populations.

A featural account for own-face processing? Looking for support from face inversion, composite face, and part-whole tasks

It is widely accepted that face perception relies on holistic processing. However, this holistic advantage is not always found in the processing of the own face. Our study aimed to explore the role of holistic and featural processing in the identification of the own face, using three standard, but largely independent measures of holistic face processing: the face inversion task, the composite face task, and the part-whole task. Participants were asked to identify their face, a friend’s face, and an unfamiliar face in three different experimental blocks: (a) inverted versus upright; (b) top and bottom halves of the face aligned versus misaligned; and (c) facial features presented in isolation versus whole foil face context. Inverting a face impaired its identification, regardless of the identity. However, alignment effects were only found when identifying a friend or an unfamiliar face. In addition, a stronger feature advantage (i.e., better recognition for isolated features compared to in a whole-face context) was observed for the own face compared to the friend and unfamiliar faces. Altogether, these findings suggest that the own face is processed in a more featural manner but also relies on holistic processing. This work also highlights the importance of taking into consideration that different holistic processing paradigms could tap different forms of holistic processing.

The relationships between reading fluency and different measures of holistic word processing

Recently, paradigms in the face recognition literature have been adopted to reveal holistic processing in word recognition. It is unknown, however, whether different measures of holistic word processing share similar underlying mechanisms, and whether fluent word reading relies on holistic word processing. We measured holistic processing effects in three paradigms (composite, configural sensitivity, part-whole) as well as in reading fluency (3DM task: reading aloud high- and low-frequency words and pseudowords). Bin scores were used to combine accuracy and response time variables in the quest for a more comprehensive, reliable, and valid measure of holistic processing. Weak correlations were found between the different holistic processing measures, with only a significant correlation between the configural sensitivity effect and part-whole effect (r = .32) and a trend of a positive correlation between the word composite effect and configural sensitivity effect (r = .21). Of the three holistic processing measures, only one (part-whole effect) correlated with a lexical access measure of 3DM (r = .23). We also performed a principal component analysis (PCA) of performance in the three lists of 3DM, with the second most probably reflecting lexical access processes. There was a tendency for a positive correlation between part-whole bin measure and Component 2 of PCA. We also found a positive correlation between composite aligned in accuracy and Component 2 of PCA.Our results show that different measures of holistic word processing reflect predominantly different mechanisms, and that differences among normal readers in word reading do not seem to depend highly on holistic processing.

Trailblazers in Neuroscience: Using compositionality to understand how parts combine in whole objects

A fundamental question for any visual system is whether its image representation can be understood in terms of its components. Decomposing any image into components is challenging because there are many possible decompositions with no common dictionary, and enumerating them leads to a combinatorial explosion. Even in perception, many objects are readily seen as containing parts, but there are many exceptions. These exceptions include objects that are not perceived as containing parts, properties like symmetry that cannot be localized to any single part, and also special categories like words and faces whose perception is widely believed to be holistic. Here, I describe a novel approach we have used to address these issues and evaluate compositionality at the behavioral and neural levels. The key design principle is to create a large number of objects by combining a small number of pre-defined components in all possible ways. This allows for building component-based models that explain whole objects using a combination of these components. Importantly, any systematic error in model fits can be used to detect the presence of emergent or holistic properties. Using this approach, we have found that whole object representations are surprisingly predictable from their components, that some components are preferred to others in perception, and that emergent properties can be discovered or explained using compositional models. Thus, compositionality is a powerful approach for understanding how whole objects relate to their parts.

Change detection vs. change localization for own-race and other-race faces

The other-race effect (ORE) is a well-known phenomenon in which people discriminate and recognize faces from their ethnic group more accurately than faces from other ethnic groups. Holistic processing, or the mandatory tendency to process all parts of an object together, has been proposed as an explanation for the ORE. According to the holistic perspective of the ORE, other-race faces might be subject to weaker holistic processing than own-race faces. However, evidence for this hypothesis is inconsistent. Although it is generally assumed that holistic processing helps the individuation of objects, holistic processing may also come at a cost. Specifically, holistic processing may reduce the capacity to localize changes in the constituent parts of an object, but not in detecting changes to an object as a whole. In the present study, we examined change detection and change localization accuracy for Caucasian and African faces, and houses. Performance was better for change detection than change localization for Caucasian faces. While clear costs of holistic processing for Caucasian faces were thus found, the difference between change localization and change detection was not obvious for African faces. However, childhood exposure to other-race people correlated with change detection for African faces, but not with change localization for African faces. Our results thus show that holistic processing of other-race faces may depend on early contact with other-race people.

EXPRESS: Distinct abilities associated with matching same identity faces vs. discriminating different faces: Evidence from individual differences in prosopagnosics and controls

Previous face matching studies provide evidence that matching same identity faces (match trials) and discriminating different face identities (non-match trials) rely on distinct processes. For example, instructional studies geared towards improving face matching in applied settings have often found selective improvements in match or non-match trials only. Additionally, a small study found that developmental prosopagnosics (DPs) have specific deficits in making match but not non-match judgments. In the current study, we sought to replicate this finding in DPs and examine how individual differences across DPs and controls in match vs. non-match performance relate to featural vs. holistic processing abilities. 43 DPs and 27 controls matched face images shown from similar front views or with varied lighting or viewpoint. Participants also performed tasks measuring featural (eyes/mouth) and holistic processing (part-whole task). We found that DPs showed worse overall matching performance than controls and that their relative match vs. non-match deficit depended on image variation condition, indicating that DPs do not consistently show match- or non-match-specific deficits. When examining the association between holistic and featural processing abilities and match vs. non-match trials in the entire group of DPs and controls, we found a very clear dissociation: Match trials significantly correlated with eye processing ability (r=.48) but not holistic processing (r=.11), whereas non-match trials significantly correlated with holistic processing (r=.32) but not eye processing (r=.03). This suggests that matching same identity faces relies more on eye processing while discriminating different faces relies more on holistic processing.

Holistic processing of faces and words predicts reading accuracy and speed in dyslexic readers

We compared the performance of dyslexic and typical readers on two perceptual tasks, the Vanderbilt Holistic Face Processing Task and the Holistic Word Processing Task. Both yield a metric of holistic processing that captures the extent to which participants automatically attend to information that is spatially nearby but irrelevant to the task at hand. Our results show, for the first time, that holistic processing of faces is comparable in dyslexic and typical readers but that dyslexic readers show greater holistic processing of words. Remarkably, we show that these metrics predict the performance of dyslexic readers on a standardized reading task, with more holistic processing in both tasks associated with higher accuracy and speed. In contrast, a more holistic style on the words task predicts less accurate reading of both words and pseudowords for typical readers. We discuss how these findings may guide our conceptualization of the visual deficit in dyslexia.

Faces and words are both associated and dissociated as evidenced by visual problems in dyslexia

Faces and words are traditionally assumed to be independently processed. Dyslexia is also traditionally thought to be a non-visual deficit. Counter to both ideas, face perception deficits in dyslexia have been reported. Others report no such deficits. We sought to resolve this discrepancy. 60 adults participated in the study (24 dyslexic, 36 typical readers). Feature-based processing and configural or global form processing of faces was measured with a face matching task. Opposite laterality effects in these tasks, dependent on left-right orientation of faces, supported that they tapped into separable visual mechanisms. Dyslexic readers tended to be poorer than typical readers at feature-based face matching while no differences were found for global form face matching. We conclude that word and face perception are associated when the latter requires the processing of visual features of a face, while processing the global form of faces apparently shares minimal-if any-resources with visual word processing. The current results indicate that visual word and face processing are both associated and dissociated-but this depends on what visual mechanisms are task-relevant. We suggest that reading deficits could stem from multiple factors, and that one such factor is a problem with feature-based processing of visual objects.

Words as Visual Objects: Neural and Behavioral Evidence for High-Level Visual Impairments in Dyslexia

Developmental dyslexia is defined by reading impairments that are disproportionate to intelligence, motivation, and the educational opportunities considered necessary for reading. Its cause has traditionally been considered to be a phonological deficit, where people have difficulties with differentiating the sounds of spoken language. However, reading is a multidimensional skill and relies on various cognitive abilities. These may include high-level vision—the processes that support visual recognition despite innumerable image variations, such as in viewpoint, position, or size. According to our high-level visual dysfunction hypothesis, reading problems of some people with dyslexia can be a salient manifestation of a more general deficit of high-level vision. This paper provides a perspective on how such non-phonological impairments could, in some cases, cause dyslexia. To argue in favor of this hypothesis, we will discuss work on functional neuroimaging, structural imaging, electrophysiology, and behavior that provides evidence for a link between high-level visual impairment and dyslexia.

Influence of Perceptual Discriminability and Spatial Distance on Holistic Processing of Faces

Background: Holistic processing is defined as the perceptual integration of facial features, and plays an important role in face recognition. While researchers recognize the crucial role played by holistic processing in face perception, a complete delineation of the underlying mechanisms is impending. Very few studies have examined the effects of perceptual discrimination and spatial perception on holistic processing. Hence, the present study aimed to examine the influence of perceptual discrimination and spatial perception on face recognition.

Methods: We conducted two experiments by manipulating the perceptual discriminability of the target (the top-half faces) and non-target face (the bottom-half faces) parts in the composite-face task and examined how perceptual discriminability may affect holistic processing of faces.

Results: The results of Experiment 1 illustrated that holistic processing was modulated by the perceptual discriminability of the face. Furthermore, differential patterns of perceptual discriminability with the target and non-target parts suggested that different mechanisms may be responsible for the influence of target and non-target parts on face perception. The results of Experiment 2 illustrated that holistic processing was modulated by spatial distance between two faces, implicating that feature-by-feature strategy might decrease the magnitude of holistic processing.

Conclusion: The results of the present study suggest that holistic processing may lead to augmented perception effect exaggerating the differences between the two faces and may also be affected by the feature-by-feature strategy.

Whole-object effects in visual word processing: Parallels with and differences from face recognition

Visual words and faces differ in their structural properties, but both are objects of high expertise. Holistic processing is said to characterize expert face recognition, but the extent to which whole-word processes contribute to word recognition is unclear, particularly as word recognition is thought to proceed by a component-based process. We review the evidence for experimental effects in word recognition that parallel those used to support holistic face processing, namely inversion effects, the part-whole task, and composite effects, as well as the status of whole-word processing in pure alexia and developmental dyslexia, contrasts between familiar and unfamiliar languages, and the differences between handwriting and typeset font. The observations support some parallels in whole-object influences between face and visual word recognition, but do not necessarily imply similar expert mechanisms. It remains to be determined whether and how the relative balance between part-based and whole-object processing differs for visual words and faces.

Linear Integration of Sensory Evidence over Space and Time Underlies Face Categorization

Visual object recognition relies on elaborate sensory processes that transform retinal inputs to object representations, but it also requires decision-making processes that read out object representations and function over prolonged time scales. The computational properties of these decision-making processes remain underexplored for object recognition. Here, we study these computations by developing a stochastic multifeature face categorization task. Using quantitative models and tight control of spatiotemporal visual information, we demonstrate that human subjects (five males, eight females) categorize faces through an integration process that first linearly adds the evidence conferred by task-relevant features over space to create aggregated momentary evidence and then linearly integrates it over time with minimum information loss. Discrimination of stimuli along different category boundaries (e.g., identity or expression of a face) is implemented by adjusting feature weights of spatial integration. This linear but flexible integration process over space and time bridges past studies on simple perceptual decisions to complex object recognition behavior.SIGNIFICANCE STATEMENT Although simple perceptual decision-making such as discrimination of random dot motion has been successfully explained as accumulation of sensory evidence, we lack rigorous experimental paradigms to study the mechanisms underlying complex perceptual decision-making such as discrimination of naturalistic faces. We develop a stochastic multifeature face categorization task as a systematic approach to quantify the properties and potential limitations of the decision-making processes during object recognition. We show that human face categorization could be modeled as a linear integration of sensory evidence over space and time. Our framework to study object recognition as a spatiotemporal integration process is broadly applicable to other object categories and bridges past studies of object recognition and perceptual decision-making.

Holistic processing only? The role of the right fusiform face area in radiological expertise

Radiologists can visually detect abnormalities on radiographs within 2s, a process that resembles holistic visual processing of faces. Interestingly, there is empirical evidence using functional magnetic resonance imaging (fMRI) for the involvement of the right fusiform face area (FFA) in visual-expertise tasks such as radiological image interpretation. The speed by which stimuli (e.g., faces, abnormalities) are recognized is an important characteristic of holistic processing. However, evidence for the involvement of the right FFA in holistic processing in radiology comes mostly from short or artificial tasks in which the quick, ‘holistic’ mode of diagnostic processing is not contrasted with the slower ‘search-to-find’ mode. In our fMRI study, we hypothesized that the right FFA responds selectively to the ‘holistic’ mode of diagnostic processing and less so to the ‘search-to-find’ mode. Eleven laypeople and 17 radiologists in training diagnosed 66 radiographs in 2s each (holistic mode) and subsequently checked their diagnosis in an extended (10-s) period (search-to-find mode). During data analysis, we first identified individual regions of interest (ROIs) for the right FFA using a localizer task. Then we employed ROI-based ANOVAs and obtained tentative support for the hypothesis that the right FFA shows more activation for radiologists in training versus laypeople, in particular in the holistic mode (i.e., during 2s trials), and less so in the search-to-find mode (i.e., during 10-s trials). No significant correlation was found between diagnostic performance (diagnostic accuracy) and brain-activation level within the right FFA for both, short-presentation and long-presentation diagnostic trials. Our results provide tentative evidence from a diagnostic-reasoning task that the FFA supports the holistic processing of visual stimuli in participants’ expertise domain.

Peripheral facial features guiding eye movements and reducing fixational variability

Face processing is a fast and efficient process due to its evolutionary and social importance. A majority of people direct their first eye movement to a featureless point just below the eyes that maximizes accuracy in recognizing a person's identity and gender. Yet, the exact properties or features of the face that guide the first eye movements and reduce fixational variability are unknown. Here, we manipulated the presence of the facial features and the spatial configuration of features to investigate their effect on the location and variability of first and second fixations to peripherally presented faces. Our results showed that observers can utilize the face outline, individual facial features, and feature spatial configuration to guide the first eye movements to their preferred point of fixation. The eyes have a preferential role in guiding the first eye movements and reducing fixation variability. Eliminating the eyes or altering their position had the greatest influence on the location and variability of fixations and resulted in the largest detriment to face identification performance. The other internal features (nose and mouth) also contribute to reducing fixation variability. A subsequent experiment measuring detection of single features showed that the eyes have the highest detectability (relative to other features) in the visual periphery providing a strong sensory signal to guide the oculomotor system. Together, the results suggest a flexible multiple-cue approach that might be a robust solution to cope with how the varying eccentricities in the real world influence the ability to resolve individual feature properties and the preferential role of the eyes.

Holistic face processing is influenced by non-conscious visual information

Holistic face processing has been widely implicated in conscious face perception. Yet, little is known about whether holistic face processing occurs when faces are processed unconsciously. The present study used the composite face task and continuous flash suppression (CFS) to inspect whether the processing of target facial information (the top half of a face) is influenced by irrelevant information (the bottom half) that is presented unconsciously. Results of multiple experiments showed that the composite effect was observed in both monocular and CFS conditions, providing the first evidence that the processing of top facial halves is influenced by the aligned bottom halves no matter whether they are presented consciously or unconsciously. However, much of the composite effect for faces without masking was disrupted when bottom facial parts were rendered with CFS. These results suggest that holistic face processing can occur unconsciously, but also highlight the significance of holistic processing of consciously presented faces.

Different measures of holistic face processing tap into distinct but partially overlapping mechanisms

Holistic processing, which includes the integration of facial features and analysis of their relations to one another, is a hallmark of what makes faces 'special'. Various experimental paradigms purport to measure holistic processing but these have often produced inconsistent results. This has led researchers to question the nature and structure of the mechanism(s) underlying holistic processing. Using an individual differences approach, researchers have examined relations between various measures of holistic processing in an attempt to resolve these questions. In keeping with this, we examined relationships between four commonly used measures of holistic face processing in a large group of participants (N = 223): (1) The Face Inversion Effect, (2) the Part Whole Effect (PWE), (3) the Composite Face Effect, and (4) the Configural Featural Detection Task (CFDT). Several novel methodological and analytical elements were introduced, including the use of factor analysis and the inclusion of control conditions to confirm the face specificity of all of the effects measured. The four indexes of holistic processing derived from each measure loaded onto two factors, one encompassing the PWE and the CFDT, and one encompassing the CE. The 16 conditions tested across the four tasks loaded onto four factors, each factor corresponding to a different measure. These results, together with those of other studies, suggest that holistic processing is a multifaceted construct and that different measures tap into distinct but partially overlapping elements of it.

Children process faces holistically with the same efficiency as adults

Previous studies had reported qualitatively identical holistic face processing (using the composite task) already in 6-year-olds. In the present study, we evaluated these processes quantitatively by evaluating whether children are less efficient in dealing with and encoding faces. Thus, in the present study we explored the time course of holistic processing in children and adults by manipulating stimulus presentation time. The study composite task was presented for 800 ms. The test composite face was presented either for 183 ms or 800 ms. Our youngest participants, 6-year-olds, process faces holistically with the same efficiency as typical adults.

Subcortical regions of the human visual system do not process faces holistically

Face perception is considered to be evolutionarily adaptive and conserved across species. While subcortical visual brain areas are implicated in face perception based on existing evidence from phylogenetic and ontogenetic studies, whether these subcortical structures contribute to more complex visual computations such as the holistic processing (HP) of faces in humans is unknown. To address this issue, we used a well-established marker of HP, the composite face effect (CFE), with a group of adult human observers, and presented two sequential faces in a trial monocularly or interocularly using a Wheatstone stereoscope. HP refers to the finding that two identical top (or bottom) halves of a face are judged to be different when their task-irrelevant bottom (or top) halves belong to different faces. Because humans process faces holistically, they are unable to ignore the information from the irrelevant half of the composite face, and this is true to an even greater extent when the two halves of the faces are aligned compared with when they are misaligned ('Alignment effect'). The results revealed the HP effect and also uncovered the Alignment effect, a key marker of the CFE. The findings also indicated a monocular advantage, replicating the known subcortical contribution to face perception. There was, however, no statistically significant difference in the CFE when the images were presented in the monocular versus interocular conditions. These findings indicate that HP is not necessarily mediated by the subcortical visual pathway, and suggest that further investigation of cortical, rather than subcortical, structures might advance our understanding of HP and its role in face processing.

Face and word composite effects are similarly affected by priming of local and global processing

Holistic processing has been shown with both faces and words, but it is unclear how similar their underlying mechanisms are. In this study attention to global and local features was manipulated and the consequences for holistic word and face processing were examined. On each trial participants were presented two Navon figures and told to focus on either the global or the local level. Then they performed a composite task in which they indicated whether the target halves of two sequentially presented faces or words were the same or different, ignoring the irrelevant halves. Similar stronger global priming effects were found for faces and words, indicating that holistic processing for the two types of stimuli were susceptible to attention manipulations to similar degrees, which was confirmed with Bayesian analyses. The findings add to the investigation of the similarity and differences between holistic processing and help reveal those aspects of holistic processing that are domain general and those specific to individual categories.

Do portrait artists have enhanced face processing abilities? Evidence from hidden Markov modeling of eye movements

Recent research has suggested the importance of part-based information in face recognition in addition to global, whole-face information. Nevertheless, face drawing experience was reported to enhance selective attention to the eyes but did not improve face recognition performance, leading to speculations about limited plasticity in adult face recognition. Here we examined the mechanism underlying the limited advantage of face drawing experience in face recognition through the Eye Movement analysis with Hidden Markov Models (EMHMM) approach. We found that portrait artists showed more eyes-focused eye movement patterns and outperformed novices in face matching, and participants' drawing rating was correlated with both eye movement pattern and performance. In contrast, portrait artists did not outperform novices and did not differ from novices in eye movement pattern in either the face recognition or part-whole tasks, although the eyes-focused pattern was associated with better recognition performance and longer response times in the whole condition relative to the part condition. Interestingly, in contrast to the face recognition and part-whole tasks, participants' performance in face matching was predicted by their drawing rating but not eye movement pattern. These results suggested that artists' advantage in face processing is specific to tasks similar to their drawing experience such as face matching, and may be related to their better ability in extracting identity-invariant information between two faces rather than more eyes-focused eye movement patterns.

Patterns of perceptual performance in developmental prosopagnosia: An in-depth case series

Developmental prosopagnosia (DP) is a syndrome characterized by lifelong impairment in face recognition in the absence of brain damage. A key question regarding DP concerns which process(es) might be affected to selectively/disproportionally impair face recognition. We present evidence from a group of DPs, combining an overview of previous results with additional analyses important for understanding their pattern of preserved and impaired perceptual abilities. We argue that for most of these individuals, the common denominator is a deficit in (rapid) processing of global shape information. We conclude that the deficit in this group of DPs is not face-selective, but that it may appear so because faces are more visually similar-and recognized at a more fine-grained level-than objects. Indeed, when the demand on perceptual differentiation and visual similarity are held constant for faces and objects, we find no evidence for a disproportionate deficit for faces in this group of DPs.