1
|
Obwegeser D, Timofte R, Mayer C, Bornstein MM, Schätzle MA, Patcas R. Scoring facial attractiveness with deep convolutional neural networks: How training on standardized images reduces the bias of facial expressions. Orthod Craniofac Res 2024. [PMID: 38825845 DOI: 10.1111/ocr.12820] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/17/2024] [Indexed: 06/04/2024]
Abstract
OBJECTIVE In many medical disciplines, facial attractiveness is part of the diagnosis, yet its scoring might be confounded by facial expressions. The intent was to apply deep convolutional neural networks (CNN) to identify how facial expressions affect facial attractiveness and to explore whether a dedicated training of the CNN is able to reduce the bias of facial expressions. MATERIALS AND METHODS Frontal facial images (n = 840) of 40 female participants (mean age 24.5 years) were taken adapting a neutral facial expression and the six universal facial expressions. Facial attractiveness was computed by means of a face detector, deep convolutional neural networks, standard support vector regression for facial beauty, visual regularized collaborative filtering and a regression technique for handling visual queries without rating history. CNN was first trained on random facial photographs from a dating website and then further trained on the Chicago Face Database (CFD) to increase its suitability to medical conditions. Both algorithms scored every image for attractiveness. RESULTS Facial expressions affect facial attractiveness scores significantly. Scores from CNN additionally trained on CFD had less variability between the expressions (range 54.3-60.9 compared to range: 32.6-49.5) and less variance within the scores (P ≤ .05), but also caused a shift in the ranking of the expressions' facial attractiveness. CONCLUSION Facial expressions confound attractiveness scores. Training on norming images generated scores less susceptible to distortion, but more difficult to interpret. Scoring facial attractiveness based on CNN seems promising, but AI solutions must be developed on CNN trained to recognize facial expressions as distractors.
Collapse
Affiliation(s)
- Dorothea Obwegeser
- Clinic of Orthodontics and Pediatric Dentistry, Center of Dental Medicine, University of Zurich, Zurich, Switzerland
| | - Radu Timofte
- Computer Vision Laboratory, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland
- CAIDAS and Institute of Computer Science, Faculty of Mathematics and Computer Science, University of Wurzburg, Wurzburg, Germany
| | - Christoph Mayer
- Computer Vision Laboratory, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland
| | - Michael M Bornstein
- Department of Oral Health & Medicine, University Center for Dental Medicine Basel UZB, University of Basel, Basel, Switzerland
| | - Marc A Schätzle
- Clinic of Orthodontics and Pediatric Dentistry, Center of Dental Medicine, University of Zurich, Zurich, Switzerland
| | - Raphael Patcas
- Clinic of Orthodontics and Pediatric Dentistry, Center of Dental Medicine, University of Zurich, Zurich, Switzerland
| |
Collapse
|
2
|
Duque A, Picado G, Salgado G, Salgado A, Palacios B, Chaves C. Validation of the Edited Tromsø Infant Faces Database (E-TIF): A study on differences in the processing of children's emotional expressions. Behav Res Methods 2024; 56:2507-2518. [PMID: 37369938 PMCID: PMC10991014 DOI: 10.3758/s13428-023-02163-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/05/2023] [Indexed: 06/29/2023]
Abstract
Images of emotional facial expressions are often used in emotion research, which has promoted the development of different databases. However, most of these standardized sets of images do not include images from infants under 2 years of age, which is relevant for psychology research, especially for perinatal psychology. The present study aims to validate the edited version of the Tromsø Infant Faces Database (E-TIF) in a large sample of participants. The original set of 119 pictures was edited. The pictures were cropped to remove nonrelevant information, fitted in an oval window, and converted to grayscale. Four hundred and eighty participants (72.9% women) took part in the study, rating the images on five dimensions: depicted emotion, clarity, intensity, valence, and genuineness. Valence scores were useful for discriminating between positive, negative, and neutral facial expressions. Results revealed that women were more accurate at recognizing emotions in children. Regarding parental status, parents, in comparison with nonparents, rated neutral expressions as more intense and genuine. They also rated sad, angry, disgusted, and fearful faces as less negative, and happy expressions as less positive. The editing and validation of the E-TIF database offers a useful tool for basic and experimental research in psychology.
Collapse
Affiliation(s)
- Almudena Duque
- Facultad de Psicología, Universidad Pontificia de Salamanca, C/ Compañía 5, 37002, Salamanca, Spain
| | - Gonzalo Picado
- Facultad de Psicología, Universidad Pontificia de Salamanca, C/ Compañía 5, 37002, Salamanca, Spain
| | - Gloria Salgado
- Facultad de Psicología, Universidad Complutense de Madrid, Campus de Somosaguas s/n, 28223, Pozuelo de Alarcón, Spain
| | - Alfonso Salgado
- Facultad de Psicología, Universidad Pontificia de Salamanca, C/ Compañía 5, 37002, Salamanca, Spain
| | - Beatriz Palacios
- Facultad de Psicología, Universidad Pontificia de Salamanca, C/ Compañía 5, 37002, Salamanca, Spain
| | - Covadonga Chaves
- Facultad de Psicología, Universidad Complutense de Madrid, Campus de Somosaguas s/n, 28223, Pozuelo de Alarcón, Spain.
| |
Collapse
|
3
|
Perception of Nasal Aesthetics: Nose or Face? Aesthetic Plast Surg 2022; 46:2931-2937. [PMID: 35641687 DOI: 10.1007/s00266-022-02943-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Accepted: 05/08/2022] [Indexed: 01/01/2023]
Abstract
BACKGROUND Aesthetic assessment of the nose might not be limited to the nose as an isolated facial unit but might be the result of a broader perception of the whole facial image. The aim of this study was to investigate if the aesthetic evaluation of a nose is made by sole observation of the nose or influenced by the other features of the face. METHODS Nose and face photographs of 20 voluntary models were taken from five different angles and merged into a single image of just the noses and whole faces of each model. First the nose and then the face photos were sent to a reviewer group consisting of 100 individuals from different professions to evaluate the nose's beauty on standard questionnaires with a four-week interval to complicate the recall process. RESULTS Aesthetic evaluation of the isolated nose (Group 1) and the nose with the whole face (Group 2) were compared through Visual Analog Scale (VAS) scores ranging from 1 to 10 (1: the least, 10: the highest). The mean VAS score of the Whole Face Group (5.26 ± 1.28) was significantly higher than the score of the Isolated Nose Group (4.50 ± 1.32) (p 0.001). There was no significant difference between the scores of reviewers considering their gender, profession, or experience of having an aesthetic operation previously. CONCLUSION Current study revealed that in the evaluation of the beauty of the nose, the holistic perception of the face is as important as the perfection of the angles and proportions within the nose itself. LEVEL OF EVIDENCE V This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266 .
Collapse
|
4
|
Lin Q, Dong Z, Zheng Q, Wang SJ. The effect of facial attractiveness on micro-expression recognition. Front Psychol 2022; 13:959124. [PMID: 36186390 PMCID: PMC9524498 DOI: 10.3389/fpsyg.2022.959124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 08/11/2022] [Indexed: 11/23/2022] Open
Abstract
Micro-expression (ME) is an extremely quick and uncontrollable facial movement that lasts for 40–200 ms and reveals thoughts and feelings that an individual attempts to cover up. Though much more difficult to detect and recognize, ME recognition is similar to macro-expression recognition in that it is influenced by facial features. Previous studies suggested that facial attractiveness could influence facial expression recognition processing. However, it remains unclear whether facial attractiveness could also influence ME recognition. Addressing this issue, this study tested 38 participants with two ME recognition tasks in a static condition or dynamically. Three different MEs (positive, neutral, and negative) at two attractiveness levels (attractive, unattractive). The results showed that participants recognized MEs on attractive faces much quicker than on unattractive ones, and there was a significant interaction between ME and facial attractiveness. Furthermore, attractive happy faces were recognized faster in both the static and the dynamic conditions, highlighting the happiness superiority effect. Therefore, our results provided the first evidence that facial attractiveness could influence ME recognition in a static condition or dynamically.
Collapse
Affiliation(s)
- Qiongsi Lin
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of the Chinese Academy of Sciences, Beijing, China
| | - Zizhao Dong
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of the Chinese Academy of Sciences, Beijing, China
| | - Qiuqiang Zheng
- Teacher Education Curriculum Center, School of Educational Science, Huizhou University, Huizhou, China
| | - Su-Jing Wang
- Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- Department of Psychology, University of the Chinese Academy of Sciences, Beijing, China
- *Correspondence: Su-Jing Wang
| |
Collapse
|
5
|
Age and gender effects on the human’s ability to decode posed and naturalistic emotional faces. Pattern Anal Appl 2022. [DOI: 10.1007/s10044-021-01049-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
6
|
Cheng Q, Han Z, Liu S, Kong Y, Weng X, Mo L. Neural responses to facial attractiveness in the judgments of moral goodness and moral beauty. Brain Struct Funct 2021; 227:843-863. [PMID: 34767078 DOI: 10.1007/s00429-021-02422-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Accepted: 10/27/2021] [Indexed: 02/05/2023]
Abstract
The judgments of moral goodness and moral beauty objectively refer to the perception and evaluation of moral traits, which are generally influenced by facial attractiveness. For centuries, people have equated beauty with the possession of positive qualities, but it is not clear whether the association between beauty and positive qualities exerts a similarly implicit influence on people's responses to moral goodness and moral beauty, how it affects those responses, and what is the neural basis for such an effect. The present study is the first to examine the neural responses to facial attractiveness in the judgments of moral goodness and moral beauty. We found that beautiful faces in both moral judgments activated the left ventral occipitotemporal cortices sensitive to the geometric configuration of the faces, demonstrating that both moral goodness and moral beauty required the automatic visual analysis of geometrical configuration of attractive faces. In addition, compared to beautiful faces during moral goodness judgment, beautiful faces during moral beauty judgment induced unique activity in the ventral medial prefrontal cortex and midline cortical structures involved in the emotional-valenced information about attractive faces. The opposite comparison elicited specific activity in the left superior temporal cortex and premotor area, which play a critical role in the recognition of facial identity. Our results demonstrated that the neural responses to facial attractiveness in the process of higher order moral decision-makings exhibit both task-general and task-specific characteristics. Our findings contribute to the understanding of the essence of the relationship between morality and aesthetics.
Collapse
Affiliation(s)
- Qiuping Cheng
- School of Psychology, South China Normal University, No. 55 West Zhongshan Avenue, Tianhe District, Guangzhou, 510631, China
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, Guangzhou, China
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, 510631, China
- Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, 510631, China
| | - Zhili Han
- School of Psychology, South China Normal University, No. 55 West Zhongshan Avenue, Tianhe District, Guangzhou, 510631, China
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, 200062, China
- NYU-ECNU Institute of Brain and Cognitive Science, New York University, Shanghai, 200062, China
| | - Shun Liu
- School of Psychology, South China Normal University, No. 55 West Zhongshan Avenue, Tianhe District, Guangzhou, 510631, China
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, Guangzhou, China
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, 510631, China
- Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, 510631, China
| | - Yilong Kong
- School of Music, South China Normal University, Guangzhou, 510631, China
| | - Xuchu Weng
- School of Psychology, South China Normal University, No. 55 West Zhongshan Avenue, Tianhe District, Guangzhou, 510631, China
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, Guangzhou, China
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, 510631, China
- Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, 510631, China
| | - Lei Mo
- School of Psychology, South China Normal University, No. 55 West Zhongshan Avenue, Tianhe District, Guangzhou, 510631, China.
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, Guangzhou, China.
- Center for Studies of Psychological Application, South China Normal University, Guangzhou, 510631, China.
- Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, 510631, China.
| |
Collapse
|
7
|
Manierka MS, Rezaei R, Palacios S, Haigh SM, Hutsler JJ. In the mood to be social: Affective state influences facial emotion recognition in healthy adults. Emotion 2021; 21:1576-1581. [PMID: 34472910 PMCID: PMC8688155 DOI: 10.1037/emo0000999] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
The ability to accurately recognize facial expressions is a key element of social interaction. Facial emotion recognition (FER) assessments show promise as a clinical screening and therapeutic tool, but realizing this potential requires better understanding of the stability of this skill. Transient mood states are known to bias emotion recognition in some contexts and may represent a critical factor impacting FER ability. In particular, it is unclear how natural fluctuations in individuals' mood state over time contribute to specific changes in the ability to recognize facial expressions. The current study tested 55 neurotypical participants across multiple visits using the Emotion Recognition test and found that fluctuations in positive and negative mood state altered recognition of specific emotions. Surprisingly, effects of mood state on emotion recognition were noncongruent; increased positive mood was associated with improved recognition of scared expressions but worsened recognition of happy expressions. Our results suggest that minor fluctuations in mood state in a neurotypical population affect emotion recognition. Therefore, mood should be taken into account by researchers and clinicians assessing FER skills. (PsycInfo Database Record (c) 2021 APA, all rights reserved).
Collapse
|
8
|
Lei Y, He X, Zhao T, Tian Z. Contrast Effect of Facial Attractiveness in Groups. Front Psychol 2020; 11:2258. [PMID: 33041899 PMCID: PMC7523431 DOI: 10.3389/fpsyg.2020.02258] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2020] [Accepted: 08/11/2020] [Indexed: 11/13/2022] Open
Abstract
Research on facial attractiveness is an important part of aesthetics. Most relevant studies in the area have focused on the influence of individual perspectives on facial attractiveness, but it is necessary to consider the effect of contextual information on facial attractiveness. In this study, we examine the influence on attractiveness of special faces in a given group. We define a “special face” as one that is significantly different from other members of the same group in terms of facial attractiveness. We conducted three experiments to explore the influence of different modes of presentation and central positions in a group on the judgment of attractiveness of the special face. The results show the following: (1) When the special face was part of a given group, the subjects made more extreme judgments than without it: that is, they judged the most attractive face as more attractive and the least as less attractive than when faces were presented alone. (2) The subjects rated the most attractive faces lower and the least attractive faces higher when the target faces in the middle of the group than in other positions. The results favored the contrast effect: when the subjects judged the attractiveness of target stimulus, they always compared it with the environment, which then became a reference in this regard. Moreover, the greater the amount of contextual information perceived, the higher the likelihood that assimilation would occur.
Collapse
Affiliation(s)
- Yatian Lei
- School of Psychology, South China Normal University, Guangzhou, China
| | - Xianyou He
- School of Psychology, South China Normal University, Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China.,Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education, Guangzhou, China
| | - Tingting Zhao
- School of Health Management, Guangzhou Medical University, Guangzhou, China
| | - Zuye Tian
- School of Psychology, South China Normal University, Guangzhou, China
| |
Collapse
|
9
|
Research on a Noise Reduction Method Based on Multi-Resolution Singular Value Decomposition. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10041409] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Reducing noise pollution in signals is of great significance in the field of signal detection. In order to reduce the noise in the signal and improve the signal-to-noise ratio (SNR), this paper takes the singular value decomposition theory as the starting point, and constructs various singular value decomposition denoising models with multiple multi-division structures based on the two-division recursion singular value decomposition, and conducts a noise reduction analysis on two experimental signals containing noise of different power. Finally, the SNR and mean square error (MSE) are used as indicators to evaluate the noise reduction effect, it is verified that the two-division recursion singular value decomposition is the optimal noise reduction model. This noise reduction model is then applied to the diagnosis of faulty bearings. By this method, the fault signal is decomposed to reduce noise and the detail signal with maximum kurtosis is extracted for envelope spectrum analysis. Comparison of several traditional signal processing methods such as empirical modal decomposition (EMD), ensemble empirical mode decomposition (EEMD), variational mode decomposition (VMD), wavelet decomposition, etc. The results show that multi-resolution singular value decomposition (MRSVD) has better noise reduction effect and can effectively diagnose faulty bearings. This method is promising and has a good application prospect.
Collapse
|