Holistic face perception is modulated by experience-dependent perceptual grouping

Faces do not guide attention in an object-based facilitation manner

Numerous studies on face processing have revealed their special ability to affect attention, but relatively little research has been done on how faces guide spatial attention allocation. To enrich this field, this study resorted to the object-based attention (OBA) effect in a modified double-rectangle paradigm where the rectangles were replaced with human faces and mosaic patterns (non-face objects). Experiment 1 replicated the typical OBA effect in the non-face objects, but this effect was absent in Asian and Caucasian faces. Experiment 2 removed the eye region from Asian faces, but still found no object-based facilitation in the faces without eyes. In Experiment 3, the OBA effect was also observed for faces when the faces disappear a short period before the responses. Overall, these results revealed that when two faces are presented together, they do not exert object-based facilitation regardless of their facial features such as race and the presence of eyes. We argue that the lack of a typical OBA effect is due to the filtering cost induced by the entire face content. This cost slows down the response when attention shifts within a face and results in the absence of object-based facilitation.

Holistic processing and visual characteristics of regulated and spontaneous expressions

The rapid and efficient recognition of facial expressions is crucial for adaptive behaviors, and holistic processing is one of the critical processing methods to achieve this adaptation. Therefore, this study integrated the effects and attentional characteristics of the authenticity of facial expressions on holistic processing. The results show that both regulated and spontaneous expressions were processed holistically. However, the spontaneous expression details did not indicate typical holistic processing, with the congruency effect observed equally for aligned and misaligned conditions. No significant difference between the two expressions was observed in terms of reaction times and eye movement characteristics (i.e., total fixation duration, fixation counts, and first fixation duration). These findings suggest that holistic processing strategies differ between the two expressions. Nevertheless, the difference was not reflected in attentional engagement.

The mechanisms supporting holistic perception of words and faces are not independent

The question of whether word and face recognition rely on overlapping or dissociable neural and cognitive mechanisms received considerable attention in the literature. In the present work, we presented words (aligned or misaligned) superimposed on faces (aligned or misaligned) and tested the interference from the unattended stimulus category on holistic processing of the attended category. In Experiment 1, we found that holistic face processing is reduced when a face was overlaid with an unattended, aligned word (processed holistically). In Experiment 2, we found a similar reduction of holistic processing for words when a word was superimposed on an unattended, aligned face (processed holistically). This reciprocal interference effect indicates a trade-off in holistic processing of the two stimuli, consistent with the idea that word and face recognition may rely on non-independent, overlapping mechanisms.

The time course of holistic processing is similar for face and non-face Gestalt stimuli

There is evidence that holistic processing of faces and other stimuli rich in Gestalt perceptual grouping cues recruit overlapping mechanisms at early processing stages, but not at later stages where faces and objects of expertise likely overlap. This has led to suggestions of dual pathways supporting holistic processing; an early stimulus-based pathway (supporting processing of stimuli rich in perceptual grouping cues) and an experience-based pathway (supporting processing of object of expertise), with both pathways supporting face processing. Holistic processing markers are present when upright faces are presented for as little as 50-ms. If the overlap between holistic processing of faces and stimuli rich in grouping cues occurs early in processing, markers of holistic processing for these Gestalt stimuli should be present as early as those for faces. In Experiment 1, we investigate the time-course of the emergence of holistic processing markers for face and non-face Gestalt stimuli. The emergence of these markers for faces and the Gestalt stimuli was strikingly similar; both emerged with masked presentations as little as 50-ms. In Experiment 2, where the stimulus presentation was not masked, thus the presentation duration, but not the post-presentation perceptual processing, was constrained, patterns of holistic processing for these stimuli still did not diverge. These findings are consistent with an early, and possibly extended, temporal locus for the overlap in the holistic processing of faces and non-face stimuli rich in grouping cues.

Can faces affect object-based attention? Evidence from online experiments

This study tested how human faces affect object-based attention (OBA) through two online experiments in a modified double-rectangle paradigm. The results of Experiment 1 revealed that faces did not elicit the OBA effect as non-face objects, which was caused by a longer response time (RT) when attention is focused on faces relative to non-face objects. In addition, by observing faster RTs when attention was engaged horizontally rather than vertically, we found a significant horizontal attention bias, which might override the OBA effect if vertical rectangles were the only items presented; these results were replicated in Experiment 2 (using only vertical rectangles) after directly measuring horizontal bias and excluding its influence on the OBA effect. This study suggested that faces cannot elicit the same-object advantage in the double-rectangle paradigm and provided a method to measure the OBA effect free from horizontal bias.

Misaligned dynamic faces are processed holistically

It was recently proposed that both experience-driven and object-based perceptual grouping contribute to holistic face processing. We investigated whether motion-as a common fate perceptual grouping cue-could enhance the holistic processing of misaligned faces. We manipulated alignment and motion (dynamic and static) of study and test faces in a modified complete composite task in which the congruency effect was regarded as an indicator of holistic processing. Participants made same-different judgments about the top halves of two sequentially presented composite faces. We observed that when the study faces were dynamic, regardless of whether the test faces were dynamic or static, misaligned-misaligned face pairs were processed holistically. When the study faces were static, misaligned-misaligned face pairs showed no holistic processing, and neither did inverted faces. These results indicate that motion can promote the holistic processing of misaligned faces. Our findings provide important insights into different types of holistic face processing, and we discuss these types as well as their relationships with each other in depth.

The constancy of the holistic processing of unfamiliar faces: Evidence from the study-test consistency effect and the within-person motion and viewpoint invariance

It has been well documented that static face processing is holistic. Faces contain variant (e.g., motion, viewpoint) and invariant (race, sex) features. However, little research has focused on whether holistic face representations are tolerant of within-person variations. The present study thus investigated whether holistic face representations of faces are tolerant of within-person motion and viewpoint variations by manipulating study-test consistency using a complete composite paradigm. Participants were shown two faces sequentially and were asked to judge whether the faces' top halves were identical or different. The first face was a static face or a dynamic face rotated in depth at 30°, 60°, and 90°. The second face was either a different front-view static face (Experiment 1a, study-test inconsistent) or identical to the first face (Experiment 1b, study-test consistent). In Experiment 2, study-test consistency was manipulated within subjects, and inverted faces were included. Our results show that study-test consistency significantly enhanced the holistic processing of upright and inverted faces; this study-test consistency effect and holistic processing were not modulated by motion and viewpoint changes via depth rotation. Interestingly, we found holistic processing for moving study-test consistent inverted faces, but not for static inverted faces. What these results tell us about the nature of holistic face representation is discussed in depth with respect to earlier and current theories on face processing.

Perceptual integration and the composite face effect

The composite face paradigm is widely used to investigate holistic perception of faces. In the paradigm, parts from different faces (usually the top and bottom halves) are recombined. The principal criterion for holistic perception is that responses involving the component parts of composites in which the parts are aligned into a face-like configuration are disrupted compared with the same parts in a misaligned (not face-like) format. This is often taken as evidence that seeing a whole face in the aligned condition interferes with perceiving its separate parts, but the extent to which the effect is perceptually driven remains unclear. We used salient perceptual categories of gender (male or female) and race (Asian or Caucasian appearance) to create composite stimuli from parts of faces that varied orthogonally on these characteristics. In Experiment 1, participants categorised the gender of the parts of aligned composite and misaligned images created from parts with the same (congruent) or different (incongruent) gender and the same (congruent) or different (incongruent) race. In Experiment 2, the same stimuli were used but the task changed to categorising race. In both experiments, there was a strong influence of the task-relevant manipulation on the composite effect, with slower responses to aligned stimuli with incongruent gender in Experiment 1 and incongruent race in Experiment 2. In contrast, the task-irrelevant variable (race in Experiment 1, gender in Experiment 2) did not exert much influence on the composite effect in either experiment. These findings show that although holistic integration of salient visual properties makes a strong contribution to the composite face effect, it clearly also involves targeted processing of an attended visual characteristic.

Global precedence effects account for individual differences in both face and object recognition performance

There has been an increase in studies adopting an individual difference approach to examine visual cognition and in particular in studies trying to relate face recognition performance with measures of holistic processing (the face composite effect and the part-whole effect). In the present study we examine whether global precedence effects, measured by means of non-face stimuli in Navon's paradigm, can also account for individual differences in face recognition and, if so, whether the effect is of similar magnitude for faces and objects. We find evidence that global precedence effects facilitate both face and object recognition, and to a similar extent. Our results suggest that both face and object recognition are characterized by a coarse-to-fine temporal dynamic, where global shape information is derived prior to local shape information, and that the efficiency of face and object recognition is related to the magnitude of the global precedence effect.