The contribution of the fusiform gyrus and superior temporal sulcus in processing facial attractiveness: neuropsychological and neuroimaging evidence

How We Look At Mature Faces-An Eye-Tracking Investigation Into the Perception of Age

BACKGROUND

It is still unclear which facial region contributes most to the perception of an aged face when evaluated by eye-tracking analyses.

OBJECTIVES

The authors sought to apply eye-tracking technology to identify whether mature faces require longer fixation durations than young faces and which facial region contributes most to the perception of a mature face.

METHODS

Eye-tracking analyses were conducted in 74 volunteers (37 males, 37 females; 43 ≤ 40 years, 31 > 40 years) evaluating their gaze pattern and the fixation durations for the entire face and 9 facial subregions. Frontal facial images of 16 younger (<40 years) and older (>40 years) gender-matched individuals were presented in a standardized setting.

RESULTS

Independent of age or gender of the observer, a younger stimulus image was viewed shorter than an older stimulus image with 0.82 (0.63) seconds vs 1.06 (0.73) seconds with P < 0.001. There was no statistically significant difference in their duration of a stable eye fixation when observers inspected a male vs a female stimulus image [0.94 (0.70) seconds vs 0.94 (0.68) seconds; P = 0.657] independent of the observer's age or gender. The facial image that captured the most attention of the observer (rank 9) was the perioral region with 1.61 (0.73) seconds for younger observers and 1.57 (0.73) seconds for older observers.

CONCLUSIONS

It was revealed that the perioral region attracts the most attention of observers and contributes most to an aged facial appearance. Practitioners should be mindful of the importance of the perioral region when designing an aesthetic treatment plan.

Neural systems that facilitate the representation of social rank

Across species, animals organize into social dominance hierarchies that serve to decrease aggression and facilitate survival of the group. Neuroscientists have adopted several model organisms to study dominance hierarchies in the laboratory setting, including fish, reptiles, rodents and primates. We review recent literature across species that sheds light onto how the brain represents social rank to guide socially appropriate behaviour within a dominance hierarchy. First, we discuss how the brain responds to social status signals. Then, we discuss social approach and avoidance learning mechanisms that we propose could drive rank-appropriate behaviour. Lastly, we discuss how the brain represents memories of individuals (social memory) and how this may support the maintenance of unique individual relationships within a social group. This article is part of the theme issue 'The centennial of the pecking order: current state and future prospects for the study of dominance hierarchies'.

Neural responses to facial attractiveness in the judgments of moral goodness and moral beauty

The judgments of moral goodness and moral beauty objectively refer to the perception and evaluation of moral traits, which are generally influenced by facial attractiveness. For centuries, people have equated beauty with the possession of positive qualities, but it is not clear whether the association between beauty and positive qualities exerts a similarly implicit influence on people's responses to moral goodness and moral beauty, how it affects those responses, and what is the neural basis for such an effect. The present study is the first to examine the neural responses to facial attractiveness in the judgments of moral goodness and moral beauty. We found that beautiful faces in both moral judgments activated the left ventral occipitotemporal cortices sensitive to the geometric configuration of the faces, demonstrating that both moral goodness and moral beauty required the automatic visual analysis of geometrical configuration of attractive faces. In addition, compared to beautiful faces during moral goodness judgment, beautiful faces during moral beauty judgment induced unique activity in the ventral medial prefrontal cortex and midline cortical structures involved in the emotional-valenced information about attractive faces. The opposite comparison elicited specific activity in the left superior temporal cortex and premotor area, which play a critical role in the recognition of facial identity. Our results demonstrated that the neural responses to facial attractiveness in the process of higher order moral decision-makings exhibit both task-general and task-specific characteristics. Our findings contribute to the understanding of the essence of the relationship between morality and aesthetics.

From Visual Perception to Aesthetic Appeal: Brain Responses to Aesthetically Appealing Natural Landscape Movies

During aesthetically appealing visual experiences, visual content provides a basis for computation of affectively tinged representations of aesthetic value. How this happens in the brain is largely unexplored. Using engaging video clips of natural landscapes, we tested whether cortical regions that respond to perceptual aspects of an environment (e.g., spatial layout, object content and motion) were directly modulated by rated aesthetic appeal. Twenty-four participants watched a series of videos of natural landscapes while being scanned using functional magnetic resonance imaging (fMRI) and reported both continuous ratings of enjoyment (during the videos) and overall aesthetic judgments (after each video). Although landscape videos engaged a greater expanse of high-level visual cortex compared to that observed for images of landscapes, independently localized category-selective visual regions (e.g., scene-selective parahippocampal place area and motion-selective hMT+) were not significantly modulated by aesthetic appeal. Rather, a whole-brain analysis revealed modulations by aesthetic appeal in ventral (collateral sulcus) and lateral (middle occipital sulcus, posterior middle temporal gyrus) clusters that were adjacent to scene and motion selective regions. These findings suggest that aesthetic appeal per se is not represented in well-characterized feature- and category-selective regions of visual cortex. Rather, we propose that the observed activations reflect a local transformation from a feature-based visual representation to a representation of "elemental affect," computed through information-processing mechanisms that detect deviations from an observer's expectations. Furthermore, we found modulation by aesthetic appeal in subcortical reward structures but not in regions of the default-mode network (DMN) nor orbitofrontal cortex, and only weak evidence for associated changes in functional connectivity. In contrast to other visual aesthetic domains, aesthetically appealing interactions with natural landscapes may rely more heavily on comparisons between ongoing stimulation and well-formed representations of the natural world, and less on top-down processes for resolving ambiguities or assessing self-relevance.

Estimating and inferring the maximum degree of stimulus-locked time-varying brain connectivity networks

Neuroscientists have enjoyed much success in understanding brain functions by constructing brain connectivity networks using data collected under highly controlled experimental settings. However, these experimental settings bear little resemblance to our real-life experience in day-to-day interactions with the surroundings. To address this issue, neuroscientists have been measuring brain activity under natural viewing experiments in which the subjects are given continuous stimuli, such as watching a movie or listening to a story. The main challenge with this approach is that the measured signal consists of both the stimulus-induced signal, as well as intrinsic-neural and nonneuronal signals. By exploiting the experimental design, we propose to estimate stimulus-locked brain networks by treating nonstimulus-induced signals as nuisance parameters. In many neuroscience applications, it is often important to identify brain regions that are connected to many other brain regions during cognitive process. We propose an inferential method to test whether the maximum degree of the estimated network is larger than a prespecific number. We prove that the type I error can be controlled and that the power increases to one asymptotically. Simulation studies are conducted to assess the performance of our method. Finally, we analyze a functional magnetic resonance imaging dataset obtained under the Sherlock Holmes movie stimuli.

Friend effects framework: Contrastive and hierarchical processing in cheerleader effects

Cheerleader effects, group attractiveness effects, and divisive normalization are all characterized by faces appearing more attractive when seen within a group. However, it is possible that your friends could have a detrimental effect upon your attractiveness too: if these group effects arose partly as a contrastive process between your face and your friends, then highly attractive friends may diminish your attractiveness. We confirm this hypothesis across two experiments by showing that the presence of highly attractive friends can indeed make you appear less attractive (i.e., a reverse cheerleader effect), suggesting friend effects are driven in part by a contrastive process against the group. However, these effects are also influenced by your own attractiveness in a fashion that appears consistent with hierarchical encoding, where less attractive targets benefit more from being viewed in an increasingly unattractive group than attractive targets. Our final experiment demonstrates that the company of others not only alters our attractiveness, but also induces shifts in how average or distinctive a target face appears too, with these averageness effects associated with the friend effects observed in our first experiment. We present a Friend Effects Framework within which 'friend effects' is an umbrella term for the positive (e.g., cheerleader effects, group attractiveness effects) and negative (i.e., the reverse cheerleader effect) ways in which hierarchical encoding, group contrastive effects, and other influences of friends can have on your attractiveness.

Observer-Reported Outcomes and Cosmetic Procedures: A Systematic Review

BACKGROUND

Cosmetic procedures have demonstrated beneficial effects on physical appearance based on anatomic markers as well as patient-perceived self-image and quality of life. Recent studies of observer-reported outcomes (OROs) suggest an additional benefit from aesthetic interventions.

OBJECTIVE

The authors aimed to review the evidence of OROs from cosmetic procedures performed on the head and neck.

PATIENTS, METHODS AND MATERIALS

PubMed, Embase, and Cochrane Library databases were searched for relevant studies, yielding 24 included original investigations.

RESULTS

These studies captured 686 total patients, 8,257 observer evaluations, and a variety of interventions including face-lifts, blepharoplasty, rhinoplasty, and minimally invasive treatments including botulinum toxins and hyaluronic acid fillers. Forty-one distinct reported OROs were grouped into 12 descriptive domains. Domains were further grouped into 3 higher-order categories: aesthetics and wellness, social capacities, and skills and competencies. Improved perception after cosmetic intervention is most reproducibly demonstrated for the following ORO domains: age, attractiveness, sociability, relationship success, and occupational and financial competency.

CONCLUSION

The synthesized findings imply a tertiary layer of benefit for cosmetic intervention beyond anatomical and patient-centered outcomes through enhanced perceptions of others. These findings may inform the pre-procedure risk-benefit discussion with patients of cosmetic medicine and drive future research into longitudinal outcomes.

Prosopagnosia and disorders of face processing

Face recognition is a form of expert visual processing. Acquired prosopagnosia is the loss of familiarity for facial identity and has several functional variants, namely apperceptive, amnestic, and associative forms. Acquired forms are usually caused by either occipitotemporal or anterior temporal lesions, right or bilateral in most cases. In addition, there is a developmental form, whose functional and structural origins are still being elucidated. Despite their difficulties with recognizing faces, some of these subjects still show signs of covert recognition, which may have a number of explanations. Other aspects of face perception can be spared in prosopagnosic subjects. Patients with other types of face processing difficulties have been described, including impaired expression processing, impaired lip-reading, false familiarity for faces, and a people-specific amnesia. Recent rehabilitative studies have shown some modest ability to improve face perception in prosopagnosic subjects through perceptual training protocols.

Seeking the "Beauty Center" in the Brain: A Meta-Analysis of fMRI Studies of Beautiful Human Faces and Visual Art

During the past two decades, cognitive neuroscientists have sought to elucidate the common neural basis of the experience of beauty. Still, empirical evidence for such common neural basis of different forms of beauty is not conclusive. To address this question, we performed an activation likelihood estimation (ALE) meta-analysis on the existing neuroimaging studies of beauty appreciation of faces and visual art by nonexpert adults (49 studies, 982 participants, meta-data are available at https://osf.io/s9xds/ ). We observed that perceiving these two forms of beauty activated distinct brain regions: While the beauty of faces convergently activated the left ventral striatum, the beauty of visual art convergently activated the anterior medial prefrontal cortex (aMPFC). However, a conjunction analysis failed to reveal any common brain regions for the beauty of visual art and faces. The implications of these results are discussed.

Review of computational neuroaesthetics: bridging the gap between neuroaesthetics and computer science

The mystery of aesthetics attracts scientists from various research fields. The topic of aesthetics, in combination with other disciplines such as neuroscience and computer science, has brought out the burgeoning fields of neuroaesthetics and computational aesthetics within less than two decades. Despite profound findings are carried out by experimental approaches in neuroaesthetics and by machine learning algorithms in computational neuroaesthetics, these two fields cannot be easily combined to benefit from each other and findings from each field are isolated. Computational neuroaesthetics, which inherits computational approaches from computational aesthetics and experimental approaches from neuroaesthetics, seems to be promising to bridge the gap between neuroaesthetics and computational aesthetics. Here, we review theoretical models and neuroimaging findings about brain activity in neuroaesthetics. Then machine learning algorithms and computational models in computational aesthetics are enumerated. Finally, we introduce studies in computational neuroaesthetics which combine computational models with neuroimaging data to analyze brain connectivity during aesthetic appreciation or give a prediction on aesthetic preference. This paper outlines the rich potential for computational neuroaesthetics to take advantages from both neuroaesthetics and computational aesthetics. We conclude by discussing some of the challenges and potential prospects in computational neuroaesthetics, and highlight issues for future consideration.

Tracking cortical representations of facial attractiveness using time-resolved representational similarity analysis

When we see a face, we rapidly form an impression of its attractiveness. Here, we investigated how rapidly representations of facial attractiveness emerge in the human brain. In an EEG experiment, participants viewed 100 face photographs and rated them for their attractiveness. Using time-resolved representational similarity analysis on the EEG data, we reveal representations of facial attractiveness after 150-200 ms of cortical processing. Interestingly, we show that these representations are related to individual participants' personal attractiveness judgments, suggesting that already early perceptual representations of facial attractiveness convey idiosyncratic attractiveness preferences. Further, we show that these early representations are genuinely related to attractiveness, as they are neither explained by other high-level face attributes, such as face sex or age, nor by features extracted by an artificial deep neural network model of face processing. Together, our results demonstrate early, individually specific, and genuine representations of facial attractiveness, which may underlie fast attractiveness judgments.

Altered spontaneous neuronal activity and functional connectivity pattern in primary angle-closure glaucoma: a resting-state fMRI study

PURPOSE

To explore the alterations of spontaneous neuronal activity and functional connectivity pattern using fractional amplitude of low-frequency fluctuation (fALFF) and functional connectivity (FC) in patients with primary angle-closure glaucoma (PACG) and fALFF relationship with the glaucoma clinical indices.

MATERIALS AND METHODS

Forty-two PACG patients and 21 normal controls were enrolled in this study. Resting-state functional magnetic resonance imaging was firstly analyzed by fALFF and brain regions with altered fALFF between groups were selected as seeds for the further FC analysis. The relationships between fALFF/FC values of abnormal regions and ophthalmological measures, including mean deviation of visual field (MDVF) and retinal nerve fiber layer (RNFL) thickness, were also analyzed.

RESULTS

Compared with NC, PACG had significant lower fALFF values in the left cuneus, left middle temporal gyrus, right middle temporal gyrus, and right precentral gyrus, while higher fALFF values in the bilateral superior frontal gyrus (P < 0.05 after correction). Furthermore, PACG showed increased FC between left cuneus and bilateral superior frontal gyrus/bilateral posterior cingulate gyrus; between left middle temporal gyrus and bilateral superior frontal gyrus; and between right middle temporal gyrus and bilateral insular (P < 0.05 after correction). In addition, in the PACG group, the mean fALFF values of the left cuneus were positively correlated with MDVF (R = 0.419, P = 0.005) and RNFL thickness (R = 0.322, P = 0.038). Meanwhile, the mean fALFF values of bilateral superior frontal gyrus were negatively correlated with MDVF (R = - 0.454, P = 0.003) and RNFL thickness (R = - 0.556, P < 0.001).

CONCLUSIONS

PACG exhibited abnormal spontaneous neural activity and connectivity in several brain regions mainly associated with visual and visual-related functions. In addition, the fALFF values of the left cuneus and bilateral superior frontal gyrus may be complementary biomarkers for assessing the disease severity.

10,000 social brains: Sex differentiation in human brain anatomy

In human and nonhuman primates, sex differences typically explain much interindividual variability. Male and female behaviors may have played unique roles in the likely coevolution of increasing brain volume and more complex social dynamics. To explore possible divergence in social brain morphology between men and women living in different social environments, we applied probabilistic generative modeling to ~10,000 UK Biobank participants. We observed strong volume effects especially in the limbic system but also in regions of the sensory, intermediate, and higher association networks. Sex-specific brain volume effects in the limbic system were linked to the frequency and intensity of social contact, such as indexed by loneliness, household size, and social support. Across the processing hierarchy of neural networks, different conditions for social interplay may resonate in and be influenced by brain anatomy in sex-dependent ways.

The Effects of Facial Attractiveness and Familiarity on Facial Expression Recognition

The classic theory of face perception holds that the invariant (e.g., identity and race) and variant (e.g., expression) dimensions of face information are independent of one another. Two separate neural systems are involved in face processing. However, the dynamic theory of face perception indicates that these two neural systems interact bidirectionally. Accordingly, by using the emotion categorization task and morph movies task, we investigated the influence of facial attractiveness on facial expression recognition and provided further evidence supporting the dynamic theory of face perception in both the static and dynamic contexts. In addition, this research used familiar celebrities (including actors, television personalities, politicians, and comedians) and explored the role of familiarity in face perception. In two experiments, the participants were asked to assess the expressions of faces with different levels of attractiveness and different levels of familiarity. We found that regardless of being in a static or dynamic face situation, happy expressions on attractive faces can be recognized more quickly, highlighting the advantage of happy expression recognition. Moreover, in static and dynamic familiar face situations, familiarity has a greater impact on expression recognition, and the influence of attraction on expression recognition may be weakened or even unaffected. Our results show that facial attractiveness influences the recognition of facial expressions in both static and dynamic contexts and highlight the importance of familiarity in face perception.

Alcohol usage predicts holistic perception: A novel method for exploring addiction

Holistic perception is a special form of automatic and experience dependent processing that prioritises objects of interest through the visual system. We therefore speculated that higher levels of alcohol consumption may be associated with enhanced holistic perception for alcohol cues. In our first experiment, we confirmed this hypothesis by showing that increasing regular alcohol usage was associated with greater holistic perception of alcohol, but not non-alcohol, cues. We replicated this finding in a second experiment, but confirmed drink-specific holistic perception for lager cues was not predicted by experience with that drink, but general alcohol usage. In our final experiment when alcohol images were absent from the task, higher levels of alcohol consumption predicted decreased holistic perception for non-rewarding cues. Alcohol use is therefore linked to inverse alterations in holistic perception for alcohol versus non-alcohol cues, with the latter's effects context dependent. We hypothesise that such inverse relationships may be due to limited cortical resources becoming reutilised for alcohol cues at the expense of other stimuli. Future work will be required to determine holistic perception's role in maintaining addiction, its predictive value in successful abstinence, and its relationship with characteristics of addiction such as cue reactivity, attentional biases and personality traits.

Gender Differences in the Effect of Facial Attractiveness on Perception of Time

Time perception plays a fundamental role in human social activities, and it can be influenced in social situations by various factors, including facial attractiveness. However, in the eyes of observers of different genders, the attractiveness of a face varies. The current study aimed to explore whether gender modulates the effect of facial attractiveness on time perception. To account for individual differences in esthetic standards, the critical stimuli presented to each participant were selected from an image pool based on the participant’s own attractiveness judgments. In Experiment 1, men and women performed a stimuli selection task followed by a temporal reproduction task to measure their time perception of faces of different attractiveness levels and gender. To control for the potential influence of task order, Experiment 2 flipped the order of the selection and temporal tasks. Taken together, the experiments showed that both men and women exhibited longer reproduced durations for attractive opposite-sex faces than for unattractive opposite-sex faces; conversely, in the same-sex face condition, women still exhibited longer reproduced durations for attractive faces than for unattractive faces, whereas the effect of facial attractiveness on time perception among men tended to be smaller or even fail to reach significance. These results suggest that gender differences play an important role in the effect of facial attractiveness on time perception.

Perception and Deception: Human Beauty and the Brain

Human physical characteristics and their perception by the brain are under pressure by natural selection to optimize reproductive success. Men and women have different strategies to appear attractive and have different interests in identifying beauty in people. Nevertheless, men and women from all cultures agree on who is and who is not attractive, and throughout the world attractive people show greater acquisition of resources and greater reproductive success than others. The brain employs at least three modules, composed of interconnected brain regions, to judge facial attractiveness: one for identification, one for interpretation and one for valuing. Key elements that go into the judgment are age and health, as well as symmetry, averageness, face and body proportions, facial color and texture. These elements are all Costly Signals of reproductive fitness because they are difficult to fake. However, people deceive others using tricks such as coloring hair, cosmetics and clothing styles, while at the same time they also focus on detecting fakes. People may also deceive themselves, especially about their own attractiveness, and use self-signally actions to demonstrate to themselves their own true value. The neuroscience of beauty is best understood by considering the evolutionary pressures to maximize reproductive fitness.

Sex and Physiological Cycles Affect the Automatic Perception of Attractive Opposite-Sex Faces: A Visual Mismatch Negativity Study

Facial attractiveness plays important roles in social interaction. Electrophysiological and neuroimaging studies found several brain areas to be differentially responsive to attractive relative to unattractive faces. However, little is known about the time course of the information processing, especially under the unattended condition. Based on a "cross-modal delayed response" paradigm, the present study aimed to explore the automatic mechanism of facial attractiveness processing of females with different physiological cycles and males, respectively, through recording the event-related potentials in response to (un)attractive opposite-sex faces by two experiments. The attractiveness-related visual mismatch negativity (attractiveness vMMN) in posterior scalp distribution was recorded in both the experiments, which indicated that attractive faces could be processed automatically. And high-attractive opposite-sex faces can elicit larger vMMN in males than females in menstrual period in Study 1, but similar as females in ovulatory period in Study 2. Furthermore, by comparison, the latency of attractiveness vMMN in females with the ovulatory period was the longest. These results indicated as follows: (1) Males were more sensitive to attractive female faces, (2) females in ovulatory period were also attracted by the attractive male faces, (3) the long vMMN latency in females during ovulatory period suggested a special reproductive motivation to avoid being tainted by genes, which takes priority over the breeding motivation.

Morphologic Variations of the Collateral Sulcus on the Mediobasal Region of the Temporal Lobe: An Anatomical Study

OBJECTIVE

The fusiform gyrus and the collateral sulcus are the anatomical structures located in the temporobasal region. In this study, the topographic anatomy of the fusiform gyrus and the collateral sulcus is detailed to make a contribution for a successful course of temporal lobe surgery.

METHODS

We studied the basal surface of the temporal lobes of 38 formalin-fixed adult human brain specimens. In the morphometric analysis, the distance between anterior and posterior transverse collateral sulcus and the distance between the occipitotemporal sulcus and fusiform apex were used as parameters. The topographic anatomy of collateral sulcus was identified in detail, and 4 sulcal patterns were used to classify the sulcal arrangement of basal surface of temporal lobe in each hemisphere: type 1, single-branch and unbroken collateral sulcus with no connection; type 2, continuous with the rhinal sulcus; type 3, continuous with the occipitotemporal sulcus and; type 4, continuous with both rhinal and occipitotemporal sulcus.

RESULTS

The current study showed that type 1 was the pattern seen most frequently (42.1%, 16/38), whereas type 4 was the least (7.9%, 3/38). Overall, 63.2% (12/19) of subjects had the same sulcal pattern in both temporal lobes. The morphometric analysis showed that the mean distance between anterior and posterior transverse collateral sulcus was 50 ± 16.2 mm and the mean distance between occipitotemporal sulcus and fusiform apex was 26 ± 8.4 mm.

CONCLUSIONS

The topographic anatomy of the collateral sulcus with its surrounding structures is detailed in this study. This study clarifies and supplements the knowledge presently available to help develop a more feasible surgical concept.

Hierarchical Region-Network Sparsity for High-Dimensional Inference in Brain Imaging

Structured sparsity penalization has recently improved statistical models applied to high-dimensional data in various domains. As an extension to medical imaging, the present work incorporates priors on network hierarchies of brain regions into logistic-regression to distinguish neural activity effects. These priors bridge two separately studied levels of brain architecture: functional segregation into regions and functional integration by networks. Hierarchical region-network priors are shown to better classify and recover 18 psychological tasks than other sparse estimators. Varying the relative importance of region and network structure within the hierarchical tree penalty captured complementary aspects of the neural activity patterns. Local and global priors of neurobiological knowledge are thus demonstrated to offer advantages in generalization performance, sample complexity, and domain interpretability.

Neural correlates of babyish adult face processing in men

The morphological characteristics of an infant's face are collectively referred to as baby schema or babyishness. It has been well established that infant traits are implicitly projected, or overgeneralized, to adults with babyish facial features. However, few studies to date have investigated the neural underpinnings of such overgeneralization. In the present study, we addressed this issue by comparing neural activations elicited by baby-faced and mature-faced adult faces in men using fMRI. We found increased activations in clusters surrounding the bilateral insula, bilateral anterior cingulate cortex, and right inferior frontal gyrus, which have been previously linked to the processing of facial attractiveness and infant-related information. We also discovered increased activation in the left medial prefrontal cortex, which might be related to emotional or empathic responses directed towards baby-faced adults. The activated region also included the left premotor cortex, which presumably reflects an embodied response or approach motivation directed toward infant-related information. Furthermore, the activation level of the left caudate correlated with the salivary concentration of oxytocin. Taken together, these findings indicate that passive viewing of babyish adult faces induces increased responses in neural regions linked to facial attractiveness and infant-related information processing, and that these responses are partially influenced by oxytocinergic factors.

Brain responses to facial attractiveness induced by facial proportions: evidence from an fMRI study

Brain responses to facial attractiveness induced by facial proportions are investigated by using functional magnetic resonance imaging (fMRI), in 41 young adults (22 males and 19 females). The subjects underwent fMRI while they were presented with computer-generated, yet realistic face images, which had varying facial proportions, but the same neutral facial expression, baldhead and skin tone, as stimuli. Statistical parametric mapping with parametric modulation was used to explore the brain regions with the response modulated by facial attractiveness ratings (ARs). The results showed significant linear effects of the ARs in the caudate nucleus and the orbitofrontal cortex for all of the subjects, and a non-linear response profile in the right amygdala for only the male subjects. Furthermore, canonical correlation analysis was used to learn the most relevant facial ratios that were best correlated with facial attractiveness. A regression model on the fMRI-derived facial ratio components demonstrated a strong linear relationship between the visually assessed mean ARs and the predictive ARs. Overall, this study provided, for the first time, direct neurophysiologic evidence of the effects of facial ratios on facial attractiveness and suggested that there are notable gender differences in perceiving facial attractiveness as induced by facial proportions.

Differential Activation Patterns in the Same Brain Region Led to Opposite Emotional States

In human studies, how averaged activation in a brain region relates to human behavior has been extensively investigated. This approach has led to the finding that positive and negative facial preferences are represented by different brain regions. However, using a functional magnetic resonance imaging (fMRI) decoded neurofeedback (DecNef) method, we found that different patterns of neural activations within the cingulate cortex (CC) play roles in representing opposite directions of facial preference. In the present study, while neutrally preferred faces were presented, multi-voxel activation patterns in the CC that corresponded to higher (or lower) preference were repeatedly induced by fMRI DecNef. As a result, previously neutrally preferred faces became more (or less) preferred. We conclude that a different activation pattern in the CC, rather than averaged activation in a different area, represents and suffices to determine positive or negative facial preference. This new approach may reveal the importance of an activation pattern within a brain region in many cognitive functions.

A newly developed fMRI method, decoded neurofeedback (DecNef), reveals that specific activation patterns in the cingulate cortex are largely responsible for determining human facial preferences.

Although it is well studied how averaged activation of a brain region relates to behavior, it is still unclear if specific patterns of activation within regions also relate to cognitive function. In recent years, several methods have been developed for manipulating brain activity in humans. Real-time functional magnetic resonance imaging decoded neurofeedback (fMRI DecNef) is a method that allows the induction of specific patterns of brain activity by measuring the current pattern, comparing this to the pattern to be induced, and giving the subjects feedback on how close the two patterns of neuronal activity are. Using fMRI DecNef, we manipulated the pattern of activation in the cingulate cortex—a part of the cerebral cortex that plays a role in preference to different categories including faces and daily items—and tested whether we could change these preferences. In the experiment, a specific activation pattern in the cingulate cortex corresponding to higher (or lower) preference was induced by fMRI DecNef while subjects were seeing a neutrally preferred face. As a result, these neutrally preferred faces became more (or less) preferred. Our finding suggests that different patterns of activation in the cingulate cortex represent, and are sufficient to determine, different emotional states. Our new approach using fMRI DecNef may reveal the importance of activation patterns within a brain region, rather than activation in a whole region, in many cognitive functions.

Formal Models of the Network Co-occurrence Underlying Mental Operations

Systems neuroscience has identified a set of canonical large-scale networks in humans. These have predominantly been characterized by resting-state analyses of the task-unconstrained, mind-wandering brain. Their explicit relationship to defined task performance is largely unknown and remains challenging. The present work contributes a multivariate statistical learning approach that can extract the major brain networks and quantify their configuration during various psychological tasks. The method is validated in two extensive datasets (n = 500 and n = 81) by model-based generation of synthetic activity maps from recombination of shared network topographies. To study a use case, we formally revisited the poorly understood difference between neural activity underlying idling versus goal-directed behavior. We demonstrate that task-specific neural activity patterns can be explained by plausible combinations of resting-state networks. The possibility of decomposing a mental task into the relative contributions of major brain networks, the "network co-occurrence architecture" of a given task, opens an alternative access to the neural substrates of human cognition.

Individual Aesthetic Preferences for Faces Are Shaped Mostly by Environments, Not Genes

Although certain characteristics of human faces are broadly considered more attractive (e.g., symmetry, averageness), people also routinely disagree with each other on the relative attractiveness of faces. That is, to some significant degree, beauty is in the "eye of the beholder." Here, we investigate the origins of these individual differences in face preferences using a twin design, allowing us to estimate the relative contributions of genetic and environmental variation to individual face attractiveness judgments or face preferences. We first show that individual face preferences (IP) can be reliably measured and are readily dissociable from other types of attractiveness judgments (e.g., judgments of scenes, objects). Next, we show that individual face preferences result primarily from environments that are unique to each individual. This is in striking contrast to individual differences in face identity recognition, which result primarily from variations in genes [1]. We thus complete an etiological double dissociation between two core domains of social perception (judgments of identity versus attractiveness) within the same visual stimulus (the face). At the same time, we provide an example, rare in behavioral genetics, of a reliably and objectively measured behavioral characteristic where variations are shaped mostly by the environment. The large impact of experience on individual face preferences provides a novel window into the evolution and architecture of the social brain, while lending new empirical support to the long-standing claim that environments shape individual notions of what is attractive.

The causal role of the occipital face area (OFA) and lateral occipital (LO) cortex in symmetry perception

Symmetry is an important cue in face and object perception. Here we used fMRI-guided transcranial magnetic stimulation (TMS) to shed light on the role of the occipital face area (OFA), a key region in face processing, and the lateral occipital (LO) cortex, a key area in object processing, in symmetry detection. In the first experiment, we applied TMS over the rightOFA, its left homolog (leftOFA), rightLO, and vertex (baseline) while participants were discriminating between symmetric and asymmetric dot patterns. Stimulation of rightOFA and rightLO impaired performance, causally implicating these two regions in detection of symmetry in low-level dot configurations. TMS over rightLO but not rightOFA also significantly impaired detection of nonsymmetric shapes defined by collinear Gabor patches, demonstrating that rightOFA responds to symmetry but not to all cues mediating figure-ground segregation. The second experiment showed a causal role for rightOFA but not rightLO in facial symmetry detection. Overall, our results demonstrate that both the rightOFA and rightLO are sensitive to symmetry in dot patterns, whereas only rightOFA is causally involved in facial symmetry detection.

Voice Recognition in Face-Blind Patients

Right or bilateral anterior temporal damage can impair face recognition, but whether this is an associative variant of prosopagnosia or part of a multimodal disorder of person recognition is an unsettled question, with implications for cognitive and neuroanatomic models of person recognition. We assessed voice perception and short-term recognition of recently heard voices in 10 subjects with impaired face recognition acquired after cerebral lesions. All 4 subjects with apperceptive prosopagnosia due to lesions limited to fusiform cortex had intact voice discrimination and recognition. One subject with bilateral fusiform and anterior temporal lesions had a combined apperceptive prosopagnosia and apperceptive phonagnosia, the first such described case. Deficits indicating a multimodal syndrome of person recognition were found only in 2 subjects with bilateral anterior temporal lesions. All 3 subjects with right anterior temporal lesions had normal voice perception and recognition, 2 of whom performed normally on perceptual discrimination of faces. This confirms that such lesions can cause a modality-specific associative prosopagnosia.

Assessing facial attractiveness: individual decisions and evolutionary constraints

Background

Several studies showed that facial attractiveness, as a highly salient social cue, influences behavioral responses. It has also been found that attractive faces evoke distinctive neural activation compared to unattractive or neutral faces.

Objectives

Our aim was to design a face recognition task where individual preferences for facial cues are controlled for, and to create conditions that are more similar to natural circumstances in terms of decision making.

Design

In an event-related functional magnetic resonance imaging (fMRI) experiment, subjects were shown attractive and unattractive faces, categorized on the basis of their own individual ratings.

Results

Statistical analysis of all subjects showed elevated brain activation for attractive opposite-sex faces in contrast to less attractive ones in regions that previously have been reported to show enhanced activation with increasing attractiveness level (e.g. the medial and superior occipital gyri, fusiform gyrus, precentral gyrus, and anterior cingular cortex). Besides these, females showed additional brain activation in areas thought to be involved in basic emotions and desires (insula), detection of facial emotions (superior temporal gyrus), and memory retrieval (hippocampus).

Conclusions

From these data, we speculate that because of the risks involving mate choice faced by women during evolutionary times, selection might have preferred the development of an elaborated neural system in females to assess the attractiveness and social value of male faces.

Sex-differences of face coding: evidence from larger right hemispheric M170 in men and dipole source modelling

The processing of faces relies on a specialized neural system comprising bilateral cortical structures with a dominance of the right hemisphere. However, due to inconsistencies of earlier findings as well as more recent results such functional lateralization has become a topic of discussion. In particular, studies employing behavioural tasks and electrophysiological methods indicate a dominance of the right hemisphere during face perception only in men whereas women exhibit symmetric and bilateral face processing. The aim of this study was to further investigate such sex differences in hemispheric processing of personally familiar and opposite-sex faces using whole-head magnetoencephalography (MEG). We found a right-lateralized M170-component in occipito-temporal sensor clusters in men as opposed to a bilateral response in women. Furthermore, the same pattern was obtained in performing dipole localization and determining dipole strength in the M170-timewindow. These results suggest asymmetric involvement of face-responsive neural structures in men and allow to ascribe this asymmetry to the fusiform gyrus. This specifies findings from previous investigations employing event-related potentials (ERP) and LORETA reconstruction methods yielding rather extended bilateral activations showing left asymmetry in women and right lateralization in men. We discuss our finding of an asymmetric fusiform activation pattern in men in terms of holistic face processing during face evaluation and sex differences with regard to visual strategies in general and interest for opposite faces in special. Taken together the pattern of hemispheric specialization observed here yields new insights into sex differences in face perception and entails further questions about interactions between biological sex, psychological gender and influences that might be stimulus-driven or task dependent.

The neural correlates of beauty comparison

Beauty is in the eye of the beholder. How attractive someone is perceived to be depends on the individual or cultural standards to which this person is compared. But although comparisons play a central role in the way people judge the appearance of others, the brain processes underlying attractiveness comparisons remain unknown. In the present experiment, we tested the hypothesis that attractiveness comparisons rely on the same cognitive and neural mechanisms as comparisons of simple nonsocial magnitudes such as size. We recorded brain activity with functional magnetic resonance imaging (fMRI) while participants compared the beauty or height of two women or two dogs. Our data support the hypothesis of a common process underlying these different types of comparisons. First, we demonstrate that the distance effect characteristic of nonsocial comparisons also holds for attractiveness comparisons. Behavioral results indicated, for all our comparisons, longer response times for near than far distances. Second, the neural correlates of these distance effects overlapped in a frontoparietal network known for its involvement in processing simple nonsocial quantities. These results provide evidence for overlapping processes in the comparison of physical attractiveness and nonsocial magnitudes.

Is social categorization based on relational ingroup/outgroup opposition? A meta-analysis

Social categorization is known to be an important part of social cognition. The categorizations we use, despite their multitude, frequently take the form of the general ingroup/outgroup distinction. A meta-analysis of 33 fMRI studies, reporting selective activations to various social groups, was used to identify common neural structures responsible for relational representation of social structure. Activation Likelihood Estimation (ALE) analysis revealed areas in bilateral amygdala, cingulate gyrus, fusiform gyrus, right TPJ and right insula as implementing various aspects of social categorization. Activation of amygdala can be associated with modulation of behavioral response to subjectively significant stimuli. A more ventral part of anterior cingulate cortex (ACC) can be associated with self-referential reasoning about ingroup members while a more dorsal part of ACC is involved in the regulation of emotions toward outgroup members. Right insula can be engaged in the modulation of outgroup avoidance behavior. Fusiform gyrus (FG) appears to be directly involved in social categorization process via top-down modulation of social perception. Yet it is difficult to associate any of the revealed clusters with the relational ingroup/outgroup structure.

The neural correlates of subjective pleasantness

Processing of subjective pleasantness is essential in daily life decision making, particularly in the context of cognitive and environmental factors. Pleasure is mediated by a neural network and this network has been suggested to be the biological basis of pleasure including a whole range of different modalities and domains of pleasantness. This quantitative meta-analysis of brain imaging data focuses on studies 1) based on correlations between self-reported judgements of pleasantness and brain regions and investigates whether 2) immediate (during scanning) versus subsequent judgements (after scanning) differ in brain activity. We investigated concurrence across 40 studies reporting brain regions correlated with self-reported judgements of subjective pleasantness (attractiveness, liking or beauty) by means of activation likelihood estimation (ALE). Positive correlates of subjective pleasantness were found in mOFC, ventromedial prefrontal cortex, left ventral striatum, pregenual cortex, right cerebellum, left thalamus and the mid cingulate cortex. Negative correlates were found in left precentral gyrus, right cerebellum and right inferior frontal gyrus. A comparison of studies with subjective pleasantness judgement during or after scanning revealed no significant differences in brain activation. We conclude that subjective pleasantness judgements are directly related to brain regions that have been described as part of the reward circuitry (mOFC, ventral striatum). The results suggest that the evaluation of likability or pleasure is an automatic process and that it is neither elicited nor enhanced by instructions to report the outcome of these judgements.

The social evaluation of faces: a meta-analysis of functional neuroimaging studies

Neuroscience research on the social evaluation of faces has accumulated over the last decade, yielding divergent results. We used a meta-analytic technique, multi-level kernel density analysis (MKDA), to analyze 29 neuroimaging studies on face evaluation. Across negative face evaluations, we observed the most consistent activations in bilateral amygdala. Across positive face evaluations, we observed the most consistent activations in medial prefrontal cortex, pregenual anterior cingulate cortex (pgACC), medial orbitofrontal cortex (mOFC), left caudate and nucleus accumbens (NAcc). Based on additional analyses comparing linear and non-linear responses, we propose a ventral/dorsal dissociation within the amygdala, wherein separate populations of neurons code for face valence and intensity, respectively. Finally, we argue that some of the differences between studies are attributable to differences in the typicality of face stimuli. Specifically, extremely attractive faces are more likely to elicit responses in NAcc/caudate and mOFC.

Implicitly perceived vocal attractiveness modulates prefrontal cortex activity

Social interactions involve more than "just" language. As important is a more primitive nonlinguistic mode of communication acting in parallel with linguistic processes and driving our decisions to a much higher degree than is generally suspected. Amongst the "honest signals" that influence our behavior is perceived vocal attractiveness. Not only does vocal attractiveness reflect important biological characteristics of the speaker, it also influences our social perceptions according to the "what sounds beautiful is good" phenomenon. Despite the widespread influence of vocal attractiveness on social interactions revealed by behavioral studies, its neural underpinnings are yet unknown. We measured brain activity while participants listened to a series of vocal sounds ("ah") and performed an unrelated task. We found that voice-sensitive auditory and inferior frontal regions were strongly correlated with implicitly perceived vocal attractiveness. While the involvement of auditory areas reflected the processing of acoustic contributors to vocal attractiveness ("distance to mean" and spectrotemporal regularity), activity in inferior prefrontal regions (traditionally involved in speech processes) reflected the overall perceived attractiveness of the voices despite their lack of linguistic content. These results suggest the strong influence of hidden nonlinguistic aspects of communication signals on cerebral activity and provide an objective measure of this influence.

The modular neuroarchitecture of social judgments on faces

Face-derived information on trustworthiness and attractiveness crucially influences social interaction. It is, however, unclear to what degree the functional neuroanatomy of these complex social judgments on faces reflects genuine social versus basic emotional and cognitive processing. To disentangle social from nonsocial contributions, we assessed commonalities and differences between the functional networks activated by judging social (trustworthiness, attractiveness), emotional (happiness), and cognitive (age) facial traits. Relative to happiness and age evaluations, both trustworthiness and attractiveness judgments selectively activated the dorsomedial prefrontal cortex and inferior frontal gyrus, forming a core social cognition network. Moreover, they also elicited a higher amygdalar response than even the emotional control condition. Both social judgments differed, however, in their top-down modulation of face-sensitive regions: trustworthiness judgments recruited the posterior superior temporal sulcus, whereas attractiveness judgments recruited the fusiform gyrus. Social and emotional judgments converged and, therefore, likely interact in the ventromedial prefrontal cortex. Social and age judgments, on the other hand, commonly engaged the anterior insula, inferior parietal cortex, and dorsolateral prefrontal cortex, which appear to subserve more cognitive aspects in social evaluation. These findings demonstrate the modularity of social judgments on human faces by separating the neural correlates of social, face-specific, emotional, and cognitive processing facets.

Haemodynamic Brain Response to Visual Sexual Stimuli is Different between Homosexual and Heterosexual Men

The underlying neurobiological factors involved in sexual orientation are largely unknown. This study investigated whether neural circuits or different cognitive processes accounted for differences in brain activation in 14 heterosexual and 14 homosexual males. Brain scans were undertaken in each subject using functional magnetic resonance imaging while they viewed different sexual stimuli, i.e. heterosexual couple stimuli (HCS), gay couple stimuli (GCS), lesbian couple stimuli (LCS) and neutral stimuli (NS). Ratings of sexual attractiveness of the stimuli were assessed. Subjective sexual arousal was induced by HCS and GCS in heterosexual and homosexual men, respectively. Sexual disgust was induced by GCS and LCS in heterosexual and homosexual men, respectively. Compared with viewing NS, viewing sexual stimuli induced significantly different brain activations, most of which had the characteristics of cognitive processes. These observations suggest that different cognitive patterns may be the major cause of different subjective responses to sexual stimuli between heterosexual and homosexual men.

ALE meta-analysis on facial judgments of trustworthiness and attractiveness

Faces convey a multitude of information in social interaction, among which are trustworthiness and attractiveness. Humans process and evaluate these two dimensions very quickly due to their great adaptive importance. Trustworthiness evaluation is crucial for modulating behavior toward strangers; attractiveness evaluation is a crucial factor for mate selection, possibly providing cues for reproductive success. As both dimensions rapidly guide social behavior, this study tests the hypothesis that both judgments may be subserved by overlapping brain networks. To this end, we conducted an activation likelihood estimation meta-analysis on 16 functional magnetic resonance imaging studies pertaining to facial judgments of trustworthiness and attractiveness. Throughout combined, individual, and conjunction analyses on those two facial judgments, we observed consistent maxima in the amygdala which corroborates our initial hypothesis. This finding supports the contemporary paradigm shift extending the amygdala's role from dominantly processing negative emotional stimuli to processing socially relevant ones. We speculate that the amygdala filters sensory information with evolutionarily conserved relevance. Our data suggest that such a role includes not only "fight-or-flight" decisions but also social behaviors with longer term pay-off schedules, e.g., trustworthiness and attractiveness evaluation.

Remembering beauty: roles of orbitofrontal and hippocampal regions in successful memory encoding of attractive faces

Behavioral data have shown that attractive faces are better remembered but the neural mechanisms of this effect are largely unknown. To investigate this issue, female participants were scanned with event-related functional MRI (fMRI) while rating the attractiveness of male faces. Memory for the faces was tested after fMRI scanning and was used to identify successful encoding activity (subsequent memory paradigm). As expected, attractive faces were remembered better than other faces. The study yielded three main fMRI findings. First, activity in the right orbitofrontal cortex increased linearly as a function of attractiveness ratings. Second, activity in the left hippocampus increased as a function of subsequent memory (subsequent misses<low confidence hits<high confidence hits). Third, functional connectivity between these orbitofrontal and hippocampal regions was stronger during the encoding of attractive than neutral or unattractive faces. These results suggest that better memory for attractive faces reflects greater interaction between a region associated with reward, the orbitofrontal cortex, and a region associated with successful memory encoding, the hippocampus.

Current status and future directions of research on facial attractiveness

The aim of the present paper was to evaluate the current state of knowledge on the perception of facial attractiveness and to assess the opportunity for research on poorly explored issues regarding facial preferences. A theoretical framework of research problems was proposed, within which the current state of knowledge on each topic was estimated. The analysis proved that a disproportional amount of research concerned several topics, while many other topics were addressed by few studies, the results of which being sometimes contradictory. Next, possible obstacles to more comprehensive research are discussed. This leads to the conclusion that the obstacles do not severely hinder investigations of most poorly studied problems. The results of the author's recent studies on some of these topics are also briefly reported. In spite of thousands of studies conducted, facial attractiveness research may be regarded as rather poorly progressed, although prospects for it are good.