Selectivity of Face Perception to Horizontal Information over Lifespan (from 6 to 74 Year Old)

Horizontal face information is the main gateway to the shape and surface cues to familiar face identity

Humans preferentially rely on horizontal cues when recognizing face identity. The reasons for this preference are largely elusive. Past research has proposed the existence of two main sources of face identity information: shape and surface reflectance. The access to surface and shape is disrupted by picture-plane inversion while contrast negation selectively impedes access to surface cues. Our objective was to characterize the shape versus surface nature of the face information conveyed by the horizontal range. To do this, we tracked the effects of inversion and negation in the orientation domain. Participants performed an identity recognition task using orientation-filtered (0° to 150°, 30° steps) pictures of familiar male actors presented either in a natural upright position and contrast polarity, inverted, or negated. We modelled the inversion and negation effects across orientations with a Gaussian function using a Bayesian nonlinear mixed-effects modelling approach. The effects of inversion and negation showed strikingly similar orientation tuning profiles, both peaking in the horizontal range, with a comparable tuning strength. These results suggest that the horizontal preference of human face recognition is due to this range yielding a privileged access to shape and surface cues, i.e. the two main sources of face identity information.

Radial bias in face identification

Human vision in the periphery is most accurate for stimuli that point towards the fovea. This so-called radial bias has been linked with the organization and spatial selectivity of neurons at the lowest levels of the visual system, from retinal ganglion cells onwards. Despite evidence that the human visual system is radially biased, it is not yet known whether this bias persists at higher levels of processing, or whether high-level representations are invariant to this low-level orientation bias. We used the case of face identity recognition to address this question. The specialized high-level mechanisms that support efficient face recognition are highly dependent on horizontally oriented information, which convey the most useful identity cues in the fovea. We show that face selective mechanisms are more sensitive on the horizontal meridian (to the left and right of fixation) compared to the vertical meridian (above and below fixation), suggesting that the horizontal cues in the face are better extracted on the horizontal meridian, where they align with the radial bias. The results demonstrate that the radial bias is maintained at high-level recognition stages and emphasize the importance of accounting for the radial bias in future investigation of visual recognition processes in peripheral vision.

Preference for horizontal information in faces predicts typical variations in face recognition but is not impaired in developmental prosopagnosia

Face recognition is strongly influenced by the processing of orientation structure in the face image. Faces are much easier to recognize when they are filtered to include only horizontally oriented information compared with vertically oriented information. Here, we investigate whether preferences for horizontal information in faces are related to face recognition abilities in a typical sample (Experiment 1), and whether such preferences are lacking in people with developmental prosopagnosia (DP; Experiment 2). Experiment 1 shows that preferences for horizontal face information are linked to face recognition abilities in a typical sample, with weak evidence of face-selective contributions. Experiment 2 shows that preferences for horizontal face information are comparable in control and DP groups. Our study suggests that preferences for horizontal face information are related to variations in face recognition abilities in the typical range, and that these preferences are not aberrant in DP.

Impacts of the COVID-19 pandemic on airline passengers' recovery satisfaction: An experimental study

The COVID-19 pandemic has impacted nearly every country in the world and affected numerous industries. Many businesses stopped or restricted their operations, resulting in service failures. This study aims to investigate the effect of customer participation and service failure on customer recovery satisfaction in the airline industry. The research employed a scenario-based experiment with 180 respondents as the samples. Convenience sampling was adopted. The responses of customer recovery satisfaction were measured on a 7-point Likert scale. Exploratory factor analysis was then used to validate the measurement and a general linear model was carried out to examine the impacts of customer participation and service failure on customer recovery satisfaction. The results showed that when the failure was due to the COVID-19, the highest customer satisfaction occurred when customers jointly participated in service recovery. This study also revealed that increasing customer participation during the service failure due to pilots on strike resulted in decreased customer recovery satisfaction. The current study contributes to the existing literature related to customer participation in service recovery. This research also provides a practical contribution for service managers when designing the level of customer participation in service recovery.

Psychophysical profiles in super-recognizers

Facial identity matching ability varies widely, ranging from prosopagnosic individuals (who exhibit profound impairments in face cognition/processing) to so-called super-recognizers (SRs), possessing exceptional capacities. Yet, despite the often consequential nature of face matching decisions—such as identity verification in security critical settings—ability assessments tendentially rely on simple performance metrics on a handful of heterogeneously related subprocesses, or in some cases only a single measured subprocess. Unfortunately, methodologies of this ilk leave contributions of stimulus information to observed variations in ability largely un(der)specified. Moreover, they are inadequate for addressing the qualitative or quantitative nature of differences between SRs’ abilities and those of the general population. Here, therefore, we sought to investigate individual differences—among SRs identified using a novel conservative diagnostic framework, and neurotypical controls—by systematically varying retinal availability, bandwidth, and orientation of faces’ spatial frequency content in two face matching experiments. Psychophysical evaluations of these parameters’ contributions to ability reveal that SRs more consistently exploit the same spatial frequency information, rather than suggesting qualitatively different profiles between control observers and SRs. These findings stress the importance of optimizing procedures for SR identification, for example by including measures quantifying the consistency of individuals’ behavior.

Face masks reduce emotion-recognition accuracy and perceived closeness

Face masks became the symbol of the global fight against the coronavirus. While face masks' medical benefits are clear, little is known about their psychological consequences. Drawing on theories of the social functions of emotions and rapid trait impressions, we tested hypotheses on face masks' effects on emotion-recognition accuracy and social judgments (perceived trustworthiness, likability, and closeness). Our preregistered study with 191 German adults revealed that face masks diminish people's ability to accurately categorize an emotion expression and make target persons appear less close. Exploratory analyses further revealed that face masks buffered the negative effect of negative (vs. non-negative) emotion expressions on perceptions of trustworthiness, likability, and closeness. Associating face masks with the coronavirus' dangers predicted higher perceptions of closeness for masked but not for unmasked faces. By highlighting face masks' effects on social functioning, our findings inform policymaking and point at contexts where alternatives to face masks are needed.

Children are sensitive to mutual information in intermediate-complexity face and non-face features

Understanding developmental changes in children's use of specific visual information for recognizing object categories is essential for understanding how experience shapes recognition. Research on the development of face recognition has focused on children's use of low-level information (e.g. orientation sub-bands), or high-level information. In face categorization tasks, adults also exhibit sensitivity to intermediate complexity features that are diagnostic of the presence of a face. Do children also use intermediate complexity features for categorizing faces and objects, and, if so, how does their sensitivity to such features change during childhood? Intermediate-complexity features bridge the gap between low- and high-level processing: they have computational benefits for object detection and segmentation, and are known to drive neural responses in the ventral visual system. Here, we have investigated the developmental trajectory of children's sensitivity to diagnostic category information in intermediate-complexity features. We presented children (5–10 years old) and adults with image fragments of faces (Experiment 1) and cars (Experiment 2) varying in their mutual information, which quantifies a fragment's diagnosticity of a specific category. Our goal was to determine whether children were sensitive to the amount of mutual information in these fragments, and if their information usage is different from adults. We found that despite better overall categorization performance in adults, all children were sensitive to fragment diagnosticity in both categories, suggesting that intermediate representations of appearance are established early in childhood. Moreover, children's usage of mutual information was not limited to face fragments, suggesting the extracting intermediate-complexity features is a process that is not specific only to faces. We discuss the implications of our findings for developmental theories of face and object recognition.

Contrast versus identity encoding in the face image follow distinct orientation selectivity profiles

Orientation selectivity is a fundamental property of primary visual encoding. High-level processing stages also show some form of orientation dependence, with face identification preferentially relying on horizontally-oriented information. How high-level orientation tuning emerges from primary orientation biases is unclear. In the same group of participants, we derived the orientation selectivity profile at primary and high-level visual processing stages using a contrast detection and an identity matching task. To capture the orientation selectivity profile, we calculated the difference in performance between all tested orientations (0, 45, 90, and 135°) for each task and for upright and inverted faces, separately. Primary orientation selectivity was characterized by higher sensitivity to oblique as compared to cardinal orientations. The orientation profile of face identification showed superior horizontal sensitivity to face identity. In each task, performance with upright and inverted faces projected onto qualitatively similar a priori models of orientation selectivity. Yet the fact that the orientation selectivity profiles of contrast detection in upright and inverted faces correlated significantly while such correlation was absent for identification indicates a progressive dissociation of orientation selectivity profiles from primary to high-level stages of orientation encoding. Bayesian analyses further indicate a lack of correlation between the orientation selectivity profiles in the contrast detection and face identification tasks, for upright and inverted faces. From these findings, we conclude that orientation selectivity shows distinct profiles at primary and high-level stages of face processing and that a transformation must occur from general cardinal attenuation when processing basic properties of the face image to horizontal tuning when encoding more complex properties such as identity.

Neural Sensitivity to Mutual Information in Intermediate-Complexity Face Features Changes during Childhood

One way in which face recognition develops during infancy and childhood is with regard to the visual information that contributes most to recognition judgments. Adult face recognition depends on critical features spanning a hierarchy of complexity, including low-level, intermediate, and high-level visual information. To date, the development of adult-like information biases for face recognition has focused on low-level features, which are computationally well-defined but low in complexity, and high-level features, which are high in complexity, but not defined precisely. To complement this existing literature, we examined the development of children's neural responses to intermediate-level face features characterized using mutual information. Specifically, we examined children's and adults' sensitivity to varying levels of category diagnosticity at the P100 and N170 components. We found that during middle childhood, sensitivity to mutual information shifts from early components to later ones, which may indicate a critical restructuring of face recognition mechanisms that takes place over several years. This approach provides a useful bridge between the study of low- and high-level visual features for face recognition and suggests many intriguing questions for further investigation.

Classification images characterize age-related deficits in face discrimination

Face perception is impaired in older adults, but the cause of this decline is not well understood. We examined this issue by measuring Classification Images (CIs) in a face discrimination task in younger and older adults. Faces were presented in static, white visual noise, and face contrast was varied with a staircase to maintain an accuracy rate of ≈71%. The noise fields were used to construct a CI using the method described by Nagai et al. (2013) and each observer's CI was cross-correlated with the visual template of a linear ideal discriminator to obtain an estimate of the absolute efficiency of visual processing. Face discrimination thresholds were lower in younger than older adults. Like Sekuler, Gaspar, Gold, and Bennett (2004), we found that CIs from younger adults contained structure near the eyes and brows, suggesting that those observers consistently relied on information conveyed by pixels in those regions of the stimulus. CIs obtained from older adults were noticeably different: CIs from only two older adults exhibited structure near the eye/brow regions, and CIs from the remaining older observers showed no obvious structure. Nevertheless, face discrimination thresholds in both groups were strongly and similarly correlated with the cross-correlation between the CI and the ideal template, suggesting that despite older observers' lack of consistent structure, the CI method is sensitive to between-subject differences in older observers' perceptual strategy.

The development of the own-race advantage in school-age children: A morphing face paradigm

Previous studies examining the other-race effect in school-age children mostly focused on recognition memory performance. Here we investigated perceptual discriminability for Asian-like versus Caucasian-like morph faces in school-age Taiwanese children and adults. One-hundred-and-two 5- to 12-year-old children and twenty-three adults performed a sequential same/different face matching task, where they viewed an Asian- or a Caucasian-parent face followed by either the same parent face or a different morphed face (containing 15%, 30%, 45%, or 60% contribution from the other parent face) and judged if the two faces looked the same. We computed the d’ as the sensitivity index for each age groups. We also analyzed the group mean rejection rates as a function of the morph level and fitted with a cumulative normal distribution function. Results showed that the adults and the oldest 11-12-year-old children exhibited a greater sensitivity (d’) and a smaller discrimination threshold (μ) in the Asian-parent condition than those in the Caucasian-parent condition, indicating the presence of an own-race advantage. On the contrary, 5- to 10-year-old children showed an equal sensitivity and similar discrimination thresholds for both conditions, indicating an absence of the own-race advantage. Moreover, a gradual development in enhancing the discriminability for the Asian-parent condition was observed from age 5 to 12; however, the progression in the Caucasian-parent condition was less apparent. In sum, our findings suggest that expertise in face processing may take the entire childhood to develop, and supports the perceptual learning view of the other-race effect—the own-race advantage seen in adulthood likely reflects a result of prolonged learning specific to faces most commonly seen in one’s visual environment such as own-race faces.

The Bandwidth of Diagnostic Horizontal Structure for Face Identification

Horizontally oriented spatial frequency components are a diagnostic source of face identity information, and sensitivity to this information predicts upright identification accuracy and the magnitude of the face-inversion effect. However, the bandwidth at which this information is conveyed, and the extent to which human tuning matches this distribution of information, has yet to be characterized. We designed a 10-alternative forced choice face identification task in which upright or inverted faces were filtered to retain horizontal or vertical structure. We systematically varied the bandwidth of these filters in 10° steps and replaced the orientation components that were removed from the target face with components from the average of all possible faces. This manipulation created patterns that looked like faces but contained diagnostic information in orientation bands unknown to the observer on any given trial. Further, we quantified human performance relative to the actual information content of our face stimuli using an ideal observer with perfect knowledge of the diagnostic band. We found that the most diagnostic information for face identification is conveyed by a narrow band of orientations along the horizontal meridian, whereas human observers use information from a wide range of orientations.

Body emotion recognition disproportionately depends on vertical orientations during childhood

Children’s ability to recognize emotional expressions from faces and bodies develops during childhood. However, the low-level features that support accurate body emotion recognition during development have not been well characterized. This is in marked contrast to facial emotion recognition, which is known to depend upon specific spatial frequency and orientation sub-bands during adulthood, biases that develop during childhood. Here, we examined whether children’s reliance on vertical vs. horizontal orientation energy for recognizing emotional expressions in static images of bodies changed during middle childhood (5 to 10 years old). We found that while children of all ages had an adult-like bias favoring vertical orientation energy, this effect was larger at younger ages. We conclude that in terms of information use, a key feature of the development of emotion recognition is improved performance with sub-optimal features for recognition – that is, learning to use less diagnostic features of the image is a slower process than learning to use more useful features.

An Own-Age Bias in Recognizing Faces with Horizontal Information

Horizontal information, as a result of a selective filtering process, is essential in younger adults’ (YA) ability to recognize human faces. Obermeyer et al. (2012) recently reported impaired recognition of faces with horizontal information in older adults (OA) suggesting age-variant processing. Two yet unconsidered factors (stimulus age and exposure duration) that may have influenced previous results, were investigated in this study. Forty-seven YA (18–35 years) and 49 OA (62–83 years) were tested in a 2 × 2 × 2 × 2 mixed design with the between-subjects factors age group (YA vs. OA) and stimulus age (young faces vs. older faces) and the within-subjects factors filter [filtered (HF) faces vs. unfiltered faces (UF)] and exposure duration (0.8 s vs. 8 s). Subjects were presented morph videos between pairs of faces: a starting face gradually merged into either the previously encoded target face or a control face. As expected, results showed an increase in recognition sensitivity (d′) with longer exposure duration in YA with both younger and older HF faces. OA, however, were unable to recognize filtered young faces not even with increased exposure duration. Furthermore, only elderly participants showed more accurate recognition with faces of their own age relative to other-age faces (own-age bias, OAB). For YA no OAB was observed. Filtered face recognition was significantly correlated with unfiltered recognition in YA but not in OA. It is concluded, that processing of horizontal information changes at a higher age. Presenting filtered or unfiltered faces both targets convergent face-specific processing only in YA but not in OA.

The orientation selectivity of face identification

Recent work demonstrates that human face identification is most efficient when based on horizontal, rather than vertical, image structure. Because it is unclear how this specialization for upright (compared to inverted) face processing emerges in the visual system, the present study aimed to systematically characterize the orientation sensitivity profile for face identification. With upright faces, identification performance in a delayed match-to-sample task was highest for horizontally filtered images and declined sharply with oblique and vertically filtered images. Performance was well described by a Gaussian function with a bandwidth around 25°. Face inversion reshaped this sensitivity profile dramatically, with a downward shift of the entire tuning curve as well as a reduction in the amplitude of the horizontal peak and a doubling in bandwidth. The use of naturalistic outer contours (vs. a common outline mask) was also found to reshape this sensitivity profile by increasing sensitivity to oblique information in the near-horizontal range. Altogether, although face identification is sharply tuned to horizontal angles, both inversion and outline masking can profoundly reshape this orientation sensitivity profile. This combination of image- and observer-driven effects provides an insight into the functional relationship between orientation-selective processes within primary and high-level stages of the human brain.

Contribution of Neuroimaging Studies to Understanding Development of Human Cognitive Brain Functions

Humans experience significant physical and mental changes from birth to adulthood, and a variety of perceptual, cognitive and motor functions mature over the course of approximately 20 years following birth. To deeply understand such developmental processes, merely studying behavioral changes is not sufficient; simultaneous investigation of the development of the brain may lead us to a more comprehensive understanding. Recent advances in noninvasive neuroimaging technologies largely contribute to this understanding. Here, it is very important to consider the development of the brain from the perspectives of “structure” and “function” because both structure and function of the human brain mature slowly. In this review, we first discuss the process of structural brain development, i.e., how the structure of the brain, which is crucial when discussing functional brain development, changes with age. Second, we introduce some representative studies and the latest studies related to the functional development of the brain, particularly for visual, facial recognition, and social cognition functions, all of which are important for humans. Finally, we summarize how brain science can contribute to developmental study and discuss the challenges that neuroimaging should address in the future.

Three-month-old infants' sensitivity to horizontal information within faces

Horizontal information is crucial to face processing in adults. Yet the ontogeny of this preferential type of processing remains unknown. To clarify this issue, we tested 3-month-old infants' sensitivity to horizontal information within faces. Specifically, infants were exposed to the simultaneous presentation of a face and a car presented in upright or inverted orientation while their looking behavior was recorded. Face and car images were either broadband (UNF) or filtered to only reveal horizontal (H), vertical (V) or this combined information (HV). As expected, infants looked longer at upright faces than at upright cars, but critically, only when horizontal information was preserved in the stimulus (UNF, HV, H). These results first indicate that horizontal information already drives upright face processing at 3 months of age. They also recall the importance, for infants, of some facial features, arranged in a top-heavy configuration, particularly revealed by this band of information. © 2016 Wiley Periodicals, Inc. Dev Psychobiol 58: 536-542, 2016.