When Intuition Fails to Align with Data: A Reply to

Holistic processing and visual characteristics of regulated and spontaneous expressions

The rapid and efficient recognition of facial expressions is crucial for adaptive behaviors, and holistic processing is one of the critical processing methods to achieve this adaptation. Therefore, this study integrated the effects and attentional characteristics of the authenticity of facial expressions on holistic processing. The results show that both regulated and spontaneous expressions were processed holistically. However, the spontaneous expression details did not indicate typical holistic processing, with the congruency effect observed equally for aligned and misaligned conditions. No significant difference between the two expressions was observed in terms of reaction times and eye movement characteristics (i.e., total fixation duration, fixation counts, and first fixation duration). These findings suggest that holistic processing strategies differ between the two expressions. Nevertheless, the difference was not reflected in attentional engagement.

Looking at the upper facial half enlarges the range of holistic face processing

Previous studies suggested that upper and lower facial halves might be involved in the human holistic face processing differently. In this study, we replicated and extended the finding above. In Experiment 1, we used the standard composite-face task to measure holistic face processing when participants made judgements on the upper and lower facial halves separately. Results showed that the composite-face effect was stronger for the upper facial half compared to the lower half. In Experiment 2, we investigated how facial information was integrated when participants focused on different features, using the perceptual field paradigm. Results showed that: (1) more "peripheral faces" were chosen when participants fixated at the eyes than when they fixated at the mouth; (2) less "peripheral faces" were chosen for inverted faces regardless of the fixated features. Findings from both experiments together indicate that more peripheral facial information were integrated when participants focused on the upper facial half, highlighting the significance of focusing on the upper facial half in face processing.

Body Processing in Children and Adolescents with Traumatic Brain Injury: An Exploratory Study

Dysfunctions in body processing have been documented in adults with brain damage, while limited information is available for children. This study aimed to investigate body processing in children and adolescents with traumatic brain injury (TBI) (N = 33), compared to peers with typical development. Two well-known computerized body-representation paradigms, namely Visual Body Recognition and Visuo-spatial Imagery, were administered. Through the first paradigm, the body inversion and composite illusion effects were tested with a matching to sample task as measures of configural and holistic processing of others’ bodies, respectively. The second paradigm investigated with a laterality judgement task the ability to perform first-person and object-based mental spatial transformations of own body and external objects, respectively. Body stimuli did not convey any emotional contents or symbolic meanings. Patients with TBI had difficulties with mental transformations of both body and object stimuli, displaying deficits in motor and visual imagery abilities, not limited to body processing. Therefore, cognitive rehabilitation of body processing in TBI might benefit from the inclusion of both general training on visuo-spatial abilities and specific exercises aimed at boosting visual body perception and motor imagery.

Face specific inversion effects provide evidence for two subtypes of developmental prosopagnosia

Many studies have attempted to identify the perceptual underpinnings of developmental prosopagnosia (DP). The majority have focused on whether holistic and configural processing mechanisms are impaired in DP. However, previous work suggests that there is substantial heterogeneity in holistic and configural processing within the DP population; further, there is disagreement as to whether any deficits are face-specific or reflect a broader perceptual deficit. This study used a data-driven approach to examine whether there are systematic patterns of variability in DP that reflect different underpinning perceptual deficits. A group of individuals with DP (N = 37) completed a cognitive battery measuring holistic/configural and featural processing in faces and non-face objects. A two-stage cluster analysis on data from the Cambridge Face Perception Test identified two subgroups of DPs. Across several tasks, the first subgroup (N = 21) showed typical patterns of holistic/configural processing (measured via inversion effects); the second (N = 16) was characterised by reduced or abolished inversion effects compared to age-matched control participants (N = 91). The subgroups did not differ on tasks measuring upright face matching, object matching, non-face holistic processing, or composite effects. These findings indicate two separable pathways to face recognition impairment, one characterised by impaired configural processing and the other potentially by impaired featural processing. Comparisons to control participants provide some preliminary evidence that the deficit in featural processing may extend to some non-face stimuli. Our results demonstrate the utility of examining both the variability between and consistency across individuals with DP as a means of illuminating our understanding of face recognition in typical and atypical populations.

Distinct neural-behavioral correspondence within face processing and attention networks for the composite face effect

The composite face effect (CFE) is recognized as a hallmark for holistic face processing, but our knowledge remains sparse about its cognitive and neural loci. Using functional magnetic resonance imaging with independent localizer and complete composite face task, we here investigated its neural-behavioral correspondence within face processing and attention networks. Complementing classical comparisons, we adopted a dimensional reduction approach to explore the core cognitive constructs of the behavioral CFE measurement. Our univariate analyses found an alignment effect in regions associated with both the extended face processing network and attention networks. Further representational similarity analyses based on the Euclidian distances among all experimental conditions were used to identify cortical regions with reliable neural-behavioral correspondences. Multidimensional scaling and hierarchical clustering analyses for neural-behavioral correspondence data revealed two principal components underlying the behavioral CFE effect, which fit best to the neural responses in the bilateral insula and medial frontal gyrus. These findings highlight the distinct neurocognitive contributions of both face processing and attentional networks to the behavioral CFE outcome, which bridge the gaps between face recognition and attentional control models.

Holistic face processing is influenced by non-conscious visual information

Holistic face processing has been widely implicated in conscious face perception. Yet, little is known about whether holistic face processing occurs when faces are processed unconsciously. The present study used the composite face task and continuous flash suppression (CFS) to inspect whether the processing of target facial information (the top half of a face) is influenced by irrelevant information (the bottom half) that is presented unconsciously. Results of multiple experiments showed that the composite effect was observed in both monocular and CFS conditions, providing the first evidence that the processing of top facial halves is influenced by the aligned bottom halves no matter whether they are presented consciously or unconsciously. However, much of the composite effect for faces without masking was disrupted when bottom facial parts were rendered with CFS. These results suggest that holistic face processing can occur unconsciously, but also highlight the significance of holistic processing of consciously presented faces.

Investigating holistic face processing within and outside of face-responsive brain regions

It has been shown that human faces are processed holistically (i.e. as indecomposable wholes, rather than by their component parts) and this holistic face processing is linked to brain activity in face-responsive brain regions. Although several brain regions outside of the face-responsive network are also sensitive to relational processing and perceptual grouping, whether these non-face-responsive regions contribute to holistic processing remains unclear. Here, we investigated holistic face processing in the composite face paradigm both within and outside of face-responsive brain regions. We recorded participants' brain activity using fMRI while they performed a composite face task. Behavioural results indicate that participants tend to judge the same top face halves as different when they are aligned with different bottom face halves but not when they are misaligned, demonstrating a composite face effect. Neuroimaging results revealed significant differences in responses to aligned and misaligned faces in the lateral occipital complex (LOC), and trends in the anterior part of the fusiform face area (FFA2) and transverse occipital sulcus (TOS), suggesting that these regions are sensitive to holistic versus part-based face processing. Furthermore, the retrosplenial cortex (RSC) and the parahippocampal place area (PPA) showed a pattern of neural activity consistent with a holistic representation of face identity, which also correlated with the strength of the behavioural composite face effect. These results suggest that neural activity in brain regions both within and outside of the face-responsive network contributes to the composite-face effect.

Premature birth affects visual body representation and body schema in preterm children

Research has demonstrated that from the first six months of life infants show early sensitivity to body visual features and rely on sensorimotor and proprioceptive inputs in forming representations of their own bodies. Premature birth interferes with typical exposition to visual, sensorimotor and proprioceptive stimulation, thus presumably affecting the development of body representations. Here, we tested this hypothesis by comparing the performance of preterm children with that of age-matched full-termchildren in two tasks assessing, respectively, visual body processing and body schema. We found that preterm children had spared configural processing but altered holistic processing of others' bodies and showed a general difficulty in expressing visuospatial judgements on body stimuli. Furthermore, body-centered visuospatial abilities were associated with specific impairments in operating object-based visuospatial transformations. The findings of this study indicate that preterm birth might interfere with the development of body representations at the levels of body visual perceptual processing and of body schema, with effects even on visuo-spatial abilities for non-bodily stimuli. Body-centered rehabilitative interventions should be proposed to preterm children in order to enhance visuo-spatial abilities and higher-level cognitive functions.

Predicting Performances on Processing and Memorizing East Asian Faces from Brain Activities in Face-Selective Regions: A Neurocomputational Approach

For more than two decades, a network of face-selective brain regions has been identified as the core system for face processing, including occipital face area (OFA), fusiform face area (FFA), and posterior region of superior temporal sulcus (pSTS). Moreover, recent studies have suggested that the ventral route of face processing and memory should end at the anterior temporal lobes (i.e., vATLs), which may play an important role bridging face perception and face memory. It is not entirely clear, however, the extent to which neural activities in these face-selective regions can effectively predict behavioral performance on tasks that are frequently used to investigate face processing and face memory test that requires recognition beyond variation in pose and lighting, especially when non-Caucasian East Asian faces are involved. To address these questions, we first identified during a functional scan the core face network by asking participants to perform a one-back task, while viewing either static images or dynamic videos. Dynamic localizers were effective in identifying regions of interest (ROIs) in the core face-processing system. We then correlated the brain activities of core ROIs with performances on face-processing tasks (component, configural, and composite) and face memory test (Taiwanese Face Memory Test, TFMT) and found evidence for limited predictability. We next adopted an multi-voxel pattern analysis (MVPA) approach to further explore the predictability of face-selective brain regions on TFMT performance and found evidence suggesting that a basic visual processing area such as calcarine and an area for structural face processing such as OFA may play an even greater role in memorizing faces. Implications regarding how differences in processing demands between behavioral and neuroimaging tasks and cultural specificity in face-processing and memory strategies among participants may have contributed to the findings reported here are discussed.

Perceptual integration and the composite face effect

The composite face paradigm is widely used to investigate holistic perception of faces. In the paradigm, parts from different faces (usually the top and bottom halves) are recombined. The principal criterion for holistic perception is that responses involving the component parts of composites in which the parts are aligned into a face-like configuration are disrupted compared with the same parts in a misaligned (not face-like) format. This is often taken as evidence that seeing a whole face in the aligned condition interferes with perceiving its separate parts, but the extent to which the effect is perceptually driven remains unclear. We used salient perceptual categories of gender (male or female) and race (Asian or Caucasian appearance) to create composite stimuli from parts of faces that varied orthogonally on these characteristics. In Experiment 1, participants categorised the gender of the parts of aligned composite and misaligned images created from parts with the same (congruent) or different (incongruent) gender and the same (congruent) or different (incongruent) race. In Experiment 2, the same stimuli were used but the task changed to categorising race. In both experiments, there was a strong influence of the task-relevant manipulation on the composite effect, with slower responses to aligned stimuli with incongruent gender in Experiment 1 and incongruent race in Experiment 2. In contrast, the task-irrelevant variable (race in Experiment 1, gender in Experiment 2) did not exert much influence on the composite effect in either experiment. These findings show that although holistic integration of salient visual properties makes a strong contribution to the composite face effect, it clearly also involves targeted processing of an attended visual characteristic.

Early Brain Damage Affects Body Schema and Person Perception Abilities in Children and Adolescents with Spastic Diplegia

Early brain damage leading to cerebral palsy is associated to core motor impairments and also affects cognitive and social abilities. In particular, previous studies have documented specific alterations of perceptual body processing and motor cognition that are associated to unilateral motor deficits in hemiplegic patients. However, little is known about spastic diplegia (SpD), which is characterized by motorial deficits involving both sides of the body and is often associated to visuospatial, attentional, and social perception impairments. Here, we compared the performance of a sample of 30 children and adolescents with SpD (aged 7-18 years) and of a group of age-matched controls with typical development (TD) at two different tasks tapping on body representations. In the first task, we tested visual and motor imagery abilities as assessed, respectively, by the object-based mental rotation of letters and by the first-person transformations for whole-body stimuli. In the second task, we administered an inversion effect/composite illusion task to evaluate the use of configural/holistic processing of others' body. Additionally, we assessed social perception abilities in the SpD sample using the NEPSY-II battery. In line with previously reported visuospatial deficits, a general mental imagery impairment was found in SpD patients when they were engaged in both object-centered and first-person mental transformations. Nevertheless, a specific deficit in operating an own-body transformation emerged. As concerns body perception, while more basic configural processing (i.e., inversion effect) was spared, no evidence for holistic (i.e., composite illusion) body processing was found in the SpD group. NEPSY-II assessment revealed that SpD children were impaired in both the theory of mind and affect recognition subtests. Overall, these findings suggested that early brain lesions and biased embodied experience could affect higher-level motor cognition and perceptual body processing, thus pointing to a strict link between motor deficits, body schema alterations, and person processing difficulties.

Holistic face representation is highly orientation-specific

It has long been argued that face processing requires disproportionate reliance on holistic processing (HP), relative to that required for nonface object recognition. Nevertheless, whether the holistic nature of face perception is achieved via a unique internal representation or by the employment of an automated attention mechanism is still debated. Previous studies had used the face inversion effect (FIE), a unique face-processing marker, or the face composite task, a gold standard paradigm measuring holistic processing, to examine the validity of these two different hypotheses, with some studies combining the two paradigms. However, the results of such studies remain inconclusive, particularly pertaining to the issue of the two proposed HP mechanisms-an internal representation as opposed to an automated attention mechanism. Here, using the complete composite paradigm design, we aimed to examine whether face rotation yields a nonlinear or a linear drop in HP, thus supporting an account that face processing is based either on an orientation-dependent internal representation or on automated attention. Our results reveal that even a relatively small perturbation in face orientation (30 deg away from upright) already causes a sharp decline in HP. These findings support the face internal representation hypothesis and the notion that the holistic processing of faces is highly orientation-specific.

Systems Factorial Technology provides new insights on the other-race effect

The other-race effect refers to the difficulty of discriminating between faces from ethnic and racial groups other than one's own. This effect may be caused by a slow, feature-by-feature, analytic process, whereas the discrimination of own-race faces occurs faster and more holistically. However, this distinction has received inconsistent support. To provide a critical test, we employed Systems Factorial Technology (Townsend & Nozawa in Journal of Mathematical Psychology, 39, 321-359, 1995), which is a powerful tool for analyzing the organization of mental networks underlying perceptual processes. We compared Taiwanese participants' face discriminations of both own-race (Taiwanese woman) and other-race (Caucasian woman) faces according to the faces' nose-to-mouth separation and eye-to-eye separation. We found evidence for weak holistic processing (parallel processing) coupled with the strong analytic property of a self-terminating stopping rule for own-race faces, in contrast to strong analytic processing (serial self-terminating processing) for other-race faces, supporting the holistic/analytic hypothesis.

The development of holistic face processing: An evaluation with the complete design of the composite task

The composite paradigm is widely used to quantify holistic processing (HP) of faces: participants perform a sequential same-different task on one half (e.g., top) of a test-face relative to the corresponding half of a study-face. There is, however, debate regarding the appropriate design in this task. In the partial design, the irrelevant halves (e.g., bottom) of test- and study-faces are always different; an alignment effect indexes HP. In the complete design, besides alignment, congruency between the irrelevant and critical halves of the test-face is manipulated regarding the same/different response status of the study-face. The HP indexed in the complete design does not confound congruency and alignment and has good construct and convergent validities. De Heering, Houthuys, & Rossion (2007) argued that HP is mature as early as 4-year-olds but employed the partial design. Here we revisit this claim, testing four groups of 4- to 9/10 year-old children and two groups of adults. We found evidence of HP only from 6-year-olds on when considering the complete design, whereas significant alignment effects were found in the index adopted in the partial design already in 4-year-olds but which we demonstrate that reflects other factors besides HP, including response bias associated with congruency.

Visual perception and spatial transformation of the body in children and adolescents with brain tumor

Representations of own and others' body play a crucial role in social interaction. While extensive knowledge has been gathered on the neuropsychological deficits affecting body representation in adult brain lesion patients, little is known on how acquired damage to a developing brain may affect this process. We tested it on pediatric brain tumor survivors, comparing the abilities of 30 children and adolescents (aged 8-16 years) surviving from a supratentorial tumor (STT) or an infratentorial tumor (ITT) in two different tasks of body representation. Thirty children with typical development (TD) served as control group. In the first task, we tested configural (body inversion effect) and holistic (composite illusion effect) processing of others' bodies. In the second task, we tested the ability to perform first-person and object-based mental spatial transformations of own body and external objects, respectively. Configural processing was spared in all patients. Conversely, ITT, but not STT patients, were impaired in the holistic processing of body stimuli. STT patients performed overall worse than both controls and ITT patients at mental spatial transformations of both own body and external objects. ITT children presented selective alteration in using the first-person transformation strategies with body stimuli. Results suggest that body-representation abilities may be heavily affected in pediatric brain tumor survivors. STTs may be associated to greater difficulties in mental visuo-spatial transformation abilities, likely reflecting damage to fronto-parietal circuits. Conversely, ITTs may be associated to specific disturbances of visual body perception abilities that require motor simulation processes, reflecting direct or indirect damage to cerebellar areas.

Perceived Race Affects Configural Processing but Not Holistic Processing in the Composite-Face Task

One explanation for the own-race bias in face recognition is the loss of holistic processing for other-race faces. The composite-face task (involving matching the top halves of faces when the bottom halves are either changed or the same) tests holistic processing but it has been inconsistent in revealing other-race effects. Two composite-face experiments are reported using pairs of faces that have common internal features but can be perceived as either being racially Black or White depending on their external features. In Experiment 1 (matching the top halves of faces) holistic processing was found for both face races for White participants (shown by both a mis-alignment advantage when bottom halves were different and also by a congruence-by-alignment interaction in discrimination). Bayesian analysis supported there being no effect of race. However, the size of the simple congruence effect was larger for own- than for other-race faces. Experiment 2 found that this race-by-congruence interaction was not present when matching the bottom halves of faces. The results are interpreted in of terms of the perceived race affecting the processing of second-order relational information rather than holistic processing.

Converging operations and the role of perceptual and decisional influences on the perception of faces: Neural and behavioral evidence

Theoretical analyses suggest that the regularities indicative of holistic processing can be obtained by combinations of perceptual and decisional factors. Kuefner and colleagues used electrophysiological results to suggest that the composite face effect is driven solely by perceptual factors. Two limitations of their approach are (a) it did not involve behavioral measures of perceptual sensitivity or bias, and (b) it is unclear how the measures used in that study are consistent with other measures of perceptual and decisional processing. Eight observers completed three tasks involving the stimuli used by Kuefner et al.. The first was a direct replication. The second was a complete identification task, associated with the perceptual and decisional distinctions formalized in general recognition theory. The third was an implementation of the Eriksen fianker task, which allows for a pattern of results that have been interpreted in terms of perceptual and decisional influences. While the empirical distinctions used by Kuefner et al. were not consistent with either the EEG data from the other tasks or the established behavioral measures of perceptual sensitivity and decisional bias, the inferences drawn from the EEG and behavioral data from those tasks were consistent with one another, underscoring the importance of converging operations.

On Response Bias in the Face Congruency Effect for Internal and External Features

Some years ago Cheung et al. (2008) proposed the complete design (CD) for measuring the failure of selective attention in composite objects. Since the CD is a fully balanced design, analysis of response bias may reveal potential effects of the experimental manipulation, the stimulus material, and/or attributes of the observers. Here we used the CD to prove whether external features modulate perception of internal features with the context congruency paradigm (Nachson et al., 1995; Meinhardt-Injac et al., 2010) in a larger sample of N = 303 subjects. We found a large congruency effect (Cohen's d = 1.78), which was attenuated by face inversion (d = 1.32). The congruency relation also strongly modulated response bias. In incongruent trials the proportion of "different" responses was much larger than in congruent trials (d = 0.79), which was again attenuated by face inversion (d = 0.43). Because in incongruent trials the wholes formed by integrating external and internal features are always different, while in congruent trials same and different wholes occur with the same frequency, a congruency related bias effect is expected from holistic integration. Our results suggest two behavioral markers of holistic processing in the context congruency paradigm: a performance advantage in congruent compared to incongruent trials, and a tendency toward more "different" responses in incongruent, compared to congruent trials. Since the results for both markers differed only quantitatively in upright and inverted presentation, our findings indicate no change of the face processing mode by picture plane rotation. A potential transfer to the composite face paradigm is discussed.

Validation of the Vanderbilt Holistic Face Processing Test

The Vanderbilt Holistic Face Processing Test (VHPT-F) is a new measure of holistic face processing with better psychometric properties relative to prior measures developed for group studies (Richler et al., 2014). In fields where psychologists study individual differences, validation studies are commonplace and the concurrent validity of a new measure is established by comparing it to an older measure with established validity. We follow this approach and test whether the VHPT-F measures the same construct as the composite task, which is group-based measure at the center of the large literature on holistic face processing. In Experiment 1, we found a significant correlation between holistic processing measured in the VHPT-F and the composite task. Although this correlation was small, it was comparable to the correlation between holistic processing measured in the composite task with the same faces, but different target parts (top or bottom), which represents a reasonable upper limit for correlations between the composite task and another measure of holistic processing. These results confirm the validity of the VHPT-F by demonstrating shared variance with another measure of holistic processing based on the same operational definition. These results were replicated in Experiment 2, but only when the demographic profile of our sample matched that of Experiment 1.

The Oxytocin Receptor Gene (OXTR) and Face Recognition

A recent study has linked individual differences in face recognition to rs237887, a single-nucleotide polymorphism (SNP) of the oxytocin receptor gene ( OXTR; Skuse et al., 2014). In that study, participants were assessed using the Warrington Recognition Memory Test for Faces, but performance on Warrington’s test has been shown not to rely purely on face recognition processes. We administered the widely used Cambridge Face Memory Test—a purer test of face recognition—to 370 participants. Performance was not significantly associated with rs237887, with 16 other SNPs of OXTR that we genotyped, or with a further 75 imputed SNPs. We also administered three other tests of face processing (the Mooney Face Test, the Glasgow Face Matching Test, and the Composite Face Test), but performance was never significantly associated with rs237887 or with any of the other genotyped or imputed SNPs, after corrections for multiple testing. In addition, we found no associations between OXTR and Autism-Spectrum Quotient scores.

The Limited Impact of Exposure Duration on Holistic Word Processing

The current study explored the impact of stimuli exposure duration on holistic word processing measured by the complete composite paradigm (CPc paradigm). The participants were asked to match the cued target parts of two characters which were presented for either a long (600 ms) or a short duration (170 ms). They were also tested by two popular versions of the CPc paradigm: the “early-fixed” task where the attention cue was visible from the beginning of each trial at a fixed position, and the “delayed-random” task where the cue showed up after the study character at random locations. The holistic word effect, as indexed by the alignment × congruency interaction, was identified in both tasks and was unaffected by the stimuli duration in both tasks. Meanwhile, the “delayed-random” task did not bring about larger holistic word effect than the “early-fixed” task. These results suggest the exposure duration (from around 150 to 600 ms) has a limited impact on the holistic word effect, and have methodological implications for experiment designs in this field.

The perception of a face can be greater than the sum of its parts

Holistic processing is often used as a construct to characterize face recognition. An important recent study by Gold, Mundy, and Tjan (2012) quantified holistic processing by computing a facial-feature integration index derived from an ideal observer model. This index was mathematically defined as the ratio of the psychophysical contrast sensitivities squared for recognizing a whole face versus the sum of contrast sensitivities squared for individual face parts (left eye, right eye, nose, and mouth). They observed that this index was not significantly different from 1, leading to the provocative conclusion that the perception of a face is no more than the sum of its parts. What may not be obvious to all readers of this work is that these conclusions were based on a collection of faces that shared essentially the same configuration of face parts. We tested whether the facial-feature integration index would also equal 1 when faces have a range of configurations mirroring the range of variability in real-world faces, using the same experimental procedure and calculating the same integration index as Gold et al. When tested on faces with the same configuration, we also observed an integration index similar to what Gold et al. reported. But when tested on faces with variable configurations, we observed an integration index significantly greater than 1. Combing our results with those of Gold et al. further clarifies the theoretical construct of holistic processing in face recognition and what it means for the whole to be greater than the sum of its parts.

The "parts and wholes" of face recognition: A review of the literature

It has been claimed that faces are recognized as a "whole" rather than by the recognition of individual parts. In a paper published in the Quarterly Journal of Experimental Psychology in 1993, Martha Farah and I attempted to operationalize the holistic claim using the part/whole task. In this task, participants studied a face and then their memory presented in isolation and in the whole face. Consistent with the holistic view, recognition of the part was superior when tested in the whole-face condition compared to when it was tested in isolation. The "whole face" or holistic advantage was not found for faces that were inverted, or scrambled, nor for non-face objects, suggesting that holistic encoding was specific to normal, intact faces. In this paper, we reflect on the part/whole paradigm and how it has contributed to our understanding of what it means to recognize a face as a "whole" stimulus. We describe the value of part/whole task for developing theories of holistic and non-holistic recognition of faces and objects. We discuss the research that has probed the neural substrates of holistic processing in healthy adults and people with prosopagnosia and autism. Finally, we examine how experience shapes holistic face recognition in children and recognition of own- and other-race faces in adults. The goal of this article is to summarize the research on the part/whole task and speculate on how it has informed our understanding of holistic face processing.

Real-life experience with personally familiar faces enhances discrimination based on global information

Despite the agreement that experience with faces leads to more efficient processing, the underlying mechanisms remain largely unknown. Building on empirical evidence from unfamiliar face processing in healthy populations and neuropsychological patients, the present experiment tested the hypothesis that personal familiarity is associated with superior discrimination when identity information is derived based on global, as opposed to local facial information. Diagnosticity and availability of local and global information was manipulated through varied physical similarity and spatial resolution of morph faces created from personally familiar or unfamiliar faces. We found that discrimination of subtle changes between highly similar morph faces was unaffected by familiarity. Contrariwise, relatively more pronounced physical (i.e., identity) differences were more efficiently discriminated for personally familiar faces, indicating more efficient processing of global, as opposed to local facial information through real-life experience.

Comparing the role of selective and divided attention in the composite face effect: Insights from Attention Operating Characteristic (AOC) plots and cross-contingency correlations

Composite faces combine the top half of one face with the bottom half of another to create a compelling illusion of a new face. Evidence for holistic processing with composite faces comes primarily from a matching procedure in a selective attention task. In the present study, a dual-task approach has been employed to study whether composite faces reflect genuine holistic (i.e., fusion of parts) or non-holistic processing strategies (i.e., switching, resource sharing). This has been accomplished by applying the Attention Operation Characteristic methodology (AOC, Sperling & Melchner, 1978a, 1978b) and cross-contingency correlations (Bonnel & Prinzmetal, 1998) to composite faces. Overall, the results converged on the following conclusions: (a) observers can voluntarily allocate differential amounts of attention to the top and bottom parts in both spatially aligned and misaligned composite faces, (b) the interaction between composite face halves is due to attentional limitations, not due to switching or fusion strategies, and (c) the processing of aligned and misaligned composite faces is quantitatively and qualitatively similar. Taken together, these results challenge the holistic interpretation of the composite face illusion.

Holistic Processing in the Composite Task Depends on Face Size

Holistic processing is a hallmark of face processing. There is evidence that holistic processing is strongest for faces at identification distance, 2 - 10 meters from the observer. However, this evidence is based on tasks that have been little used in the literature and that are indirect measures of holistic processing. We use the composite task- a well validated and frequently used paradigm - to measure the effect of viewing distance on holistic processing. In line with previous work, we find a congruency x alignment effect that is strongest for faces that are close (2m equivalent distance) than for faces that are further away (24m equivalent distance). In contrast, the alignment effect for same trials, used by several authors to measure holistic processing, produced results that are difficult to interpret. We conclude that our results converge with previous findings providing more direct evidence for an effect of size on holistic processing.

Social presence and the composite face effect

A robust finding in social psychology research is that performance is modulated by the social nature of a given context, promoting social inhibition or facilitation effects. In the present experiment, we examined if and how social presence impacts holistic face perception processes by asking participants, in the presence of others and alone, to perform the composite face task. Results suggest that completing the task in the presence of others (i.e., mere co-action) is associated with better performance in face recognition (less bias and higher discrimination between presented and non-presented targets) and with a reduction in the composite face effect. These results make clear that social presence impact on the composite face effect does not occur because presence increases reliance on holistic processing as a "dominant" well-learned response, but instead, because it increases monitoring of the interference produced by automatic response.

Electrical stimulation over bilateral occipito-temporal regions reduces N170 in the right hemisphere and the composite face effect

Transcranial direct current stimulation (tDCS) is a non-invasive brain stimulation technique that can modulate cortical excitability. Although the clinical value of tDCS has been advocated, the potential of tDCS in cognitive rehabilitation of face processing deficits is less understood. Face processing has been associated with the occipito-temporal cortex (OT). The present study investigated whether face processing in healthy adults can be modulated by applying tDCS over the OT. Experiment 1 investigated whether tDCS can affect N170, a face-sensitive ERP component, with a face orientation judgment task. The N170 in the right hemisphere was reduced in active stimulation conditions compared with the sham stimulation condition for both upright faces and inverted faces. Experiment 2 further demonstrated that tDCS can modulate the composite face effect, a type of holistic processing that reflects the obligatory attention to all parts of a face. The composite face effect was reduced in active stimulation conditions compared with the sham stimulation condition. Additionally, the current polarity did not modulate the effect of tDCS in the two experiments. The present study demonstrates that N170 can be causally manipulated by stimulating the OT with weak currents. Furthermore, our study provides evidence that obligatory attention to all parts of a face can be affected by the commonly used tDCS parameter setting.

The complete design in the composite face paradigm: role of response bias, target certainty, and feedback

Some years ago an improved design (the “complete design”) was proposed to assess the composite face effect in terms of a congruency effect, defined as the performance difference for congruent and incongruent target to no-target relationships (Cheung et al., 2008). In a recent paper Rossion (2013) questioned whether the congruency effect was a valid hallmark of perceptual integration, because it may contain confounds with face-unspecific interference effects. Here we argue that the complete design is well-balanced and allows one to separate face-specific from face-unspecific effects. We used the complete design for a same/different composite stimulus matching task with face and non-face objects (watches). Subjects performed the task with and without trial-by-trial feedback, and with low and high certainty about the target half. Results showed large congruency effects for faces, particularly when subjects were informed late in the trial about which face halves had to be matched. Analysis of response bias revealed that subjects preferred the “different” response in incongruent trials, which is expected when upper and lower face halves are integrated perceptually at the encoding stage. The results pattern was observed in the absence of feedback, while providing feedback generally attenuated the congruency effect, and led to an avoidance of response bias. For watches no or marginal congruency effects and a moderate global “same” bias were observed. We conclude that the congruency effect, when complemented by an evaluation of response bias, is a valid hallmark of feature integration that allows one to separate faces from non-face objects.

Holistic face perception in young and older adults: effects of feedback and attentional demand

Evidence exists for age-related decline in face cognition ability. However, the extents to which attentional demand and flexibility to adapt viewing strategies contribute to age-related decline in face cognition tests is poorly understood. Here, we studied holistic face perception in older (age range 65–78 years, mean age 69.9) and young adults (age range 20–32 years, mean age 23.1) using the complete design for a sequential study-test composite face task (Richler et al., 2008b). Attentional demand was varied using trials that required participants to attend to both face halves and to redirect attention to one face half during the test (high attentional demand), and trials that allowed participants to keep a pre-adjusted focus (low attentional demand). We also varied viewing time and provided trial-by-trial feedback or no feedback. We observed strong composite effects, which were larger for the elderly in all conditions, independent of viewing time. Composite effects were smaller for low attentional demand, and larger for high attentional demand. No age-related differences were found in this respect. Feedback also reduced the composite effects in both age groups. Young adults could benefit from feedback in conditions with low and high attentional demands. Older adults performed better with feedback only in trials with low attentional demand. When attentional demand was high, older adults could no longer use the feedback signal, and performed worse with feedback than without. These findings suggest that older adults tend to use a global focus for faces, albeit piecemeal analysis is required for the task, and have difficulties adapting their viewing strategies when task demands are high. These results are consistent with the idea that elderly rely more on holistic strategies as a means to reduce perceptual and cognitive load when processing resources are limited (Konar et al., 2013).

Impaired holistic processing of left-right composite faces in congenital prosopagnosia

Congenital prosopagnosia (CP) refers to a lifelong impairment in face processing despite normal visual and intellectual skills. Many studies have suggested that the key underlying deficit in CP is one of a failure to engage holistic processing. Moreover, there has been some suggestion that, in normal observers, there may be greater involvement of the right than left hemisphere in holistic processing. To examine the proposed deficit in holistic processing and its potential hemispheric atypicality in CP, we compared the performance of 8 CP individuals with both matched controls and a large group of non-matched controls on a novel, vertical composite task. In this task, participants judged whether a cued half of a face (either left or right half) was the same or different at study and test, and the two face halves could be either aligned or misaligned. The standard index of holistic processing is one in which the unattended face half influences performance on the cued half and this influence is greater in the aligned than in the misaligned condition. Relative to controls, the CP participants, both at a group and at an individual level, did not show holistic processing in the vertical composite task. There was also no difference in performance as a function of hemifield of the cued face half in the CP individuals, and this was true in the control participants, as well. The findings clearly confirm the deficit in holistic processing in CP and reveal the useful application of this novel experimental paradigm to this population and potentially to others as well.

What can individual differences reveal about face processing?

Faces are probably the most widely studied visual stimulus. Most research on face processing has used a group-mean approach that averages behavioral or neural responses to faces across individuals and treats variance between individuals as noise. However, individual differences in face processing can provide valuable information that complements and extends findings from group-mean studies. Here we demonstrate that studies employing an individual differences approach—examining associations and dissociations across individuals—can answer fundamental questions about the way face processing operates. In particular these studies allow us to associate and dissociate the mechanisms involved in face processing, tie behavioral face processing mechanisms to neural mechanisms, link face processing to broader capacities and quantify developmental influences on face processing. The individual differences approach we illustrate here is a powerful method that should be further explored within the domain of face processing as well as fruitfully applied across the cognitive sciences.

A meta-analysis and review of holistic face processing

The concept of holistic processing is a cornerstone of face recognition research, yet central questions related to holistic processing remain unanswered, and debates have thus far failed to reach a resolution despite accumulating empirical evidence. We argue that a considerable source of confusion in this literature stems from a methodological problem. Specifically, 2 measures of holistic processing based on the composite paradigm (complete design and partial design) are used in the literature, but they often lead to qualitatively different results. First, we present a comprehensive review of the work that directly compares the 2 designs, and which clearly favors the complete design over the partial design. Second, we report a meta-analysis of holistic face processing according to both designs and use this as further evidence for one design over the other. The meta-analysis effect size of holistic processing in the complete design is nearly 3 times that of the partial design. Effect sizes were not correlated between measures, consistent with the suggestion that they do not measure the same thing. Our meta-analysis also examines the correlation between conditions in the complete design of the composite task, and suggests that in an individual differences context, little is gained by including a misaligned baseline. Finally, we offer a comprehensive review of the state of knowledge about holistic processing based on evidence gathered from the measure we favor based on the 1st sections of our review-the complete design-and outline outstanding research questions in that new context.

Holistic processing of human body postures: evidence from the composite effect

The perception of socially relevant stimuli (e.g., faces and bodies) has received considerable attention in the vision science community. It is now widely accepted that human faces are processed holistically and not only analytically. One observation that has been taken as evidence for holistic face processing is the face composite effect: two identical top halves of a face tend to be perceived as being different when combined with different bottom halves. This supports the hypothesis that face processing proceeds holistically. Indeed, the interference effect disappears when the two face parts are misaligned (blocking holistic perception). In the present study, we investigated whether there is also a composite effect for the perception of body postures: are two identical body halves perceived as being in different poses when the irrelevant body halves differ from each other? Both a horizontal (i.e., top-bottom body halves; Experiment 1) and a vertical composite effect (i.e., left-right body halves; Experiment 2) were examined by means of a delayed matching-to-sample task. Results of both experiments indicate the existence of a body posture composite effect. This provides evidence for the hypothesis that body postures, as faces, are processed holistically.

Becoming a Lunari or Taiyo expert: learned attention to parts drives holistic processing of faces

Faces are processed holistically, but the locus of holistic processing remains unclear. We created two novel races of faces (Lunaris and Taiyos) to study how experience with face parts influences holistic processing. In Experiment 1, subjects individuated Lunaris wherein the top, bottom, or both face halves contained diagnostic information. Subjects who learned to attend to face parts exhibited no holistic processing. This suggests that individuation only leads to holistic processing when the whole face is attended. In Experiment 2, subjects individuated both Lunaris and Taiyos, with diagnostic information in complementary face halves of the two races. Holistic processing was measured with composites made of either diagnostic or nondiagnostic face parts. Holistic processing was only observed for composites made from diagnostic face parts, demonstrating that holistic processing can occur for diagnostic face parts that were never seen together. These results suggest that holistic processing is an expression of learned attention to diagnostic face parts.