Perceptions of human attractiveness comprising face and voice cues

The Benefit of Bimodal Training in Voice Learning

It is known that talkers can be recognized by listening to their specific vocal qualities-breathiness and fundamental frequencies. However, talker identification can also occur by focusing on the talkers' unique articulatory style, which is known to be available auditorily and visually and can be shared across modalities. Evidence shows that voices heard while seeing talkers' faces are later recognized better on their own compared to the voices heard alone. The present study investigated whether the facilitation of voice learning through facial cues relies on talker-specific articulatory or nonarticulatory facial information. Participants were initially trained to learn the voices of ten talkers presented either on their own or together with (a) an articulating face, (b) a static face, or (c) an isolated articulating mouth. Participants were then tested on recognizing the voices on their own regardless of their training modality. Consistent with previous research, voices learned with articulating faces were recognized better on their own compared to voices learned alone. However, isolated articulating mouths did not provide an advantage in learning the voices. The results demonstrated that learning voices while seeing faces resulted in better voice learning compared to the voices learned alone.

A test of multimodal communication in humans using 881 judgements of men and women's physical, vocal, and olfactory attractiveness

Human mate value is assessed on numerous variables including, reproductive potential and disease resistance. Many of these variables have been correlated with judgments of physical, vocal, and odor attractiveness. While some researchers posit that attractiveness judgments made across different sensory modalities reflect the same underlying variable(s) (i.e., the information is redundant), others suggest that judgments made in different modalities reflect different variables. Previous studies of human attractiveness indicate that attractiveness judgments of others' faces, bodies, and voices are intercorrelated, which is suggested to support the redundancy hypothesis. Less is known about body odor attractiveness. Only one study has simultaneously investigated the relationships between judgments of body odor, face, and voice attractiveness finding weak positive associations, but small effect sizes. In this study, we empirically investigate the correlation between different modalities of attractiveness in men and women in the largest sample to date (N = 881 ratings). For men, we find no correlations between modalities of attractiveness. However, for women we find odor, face, and voice attractiveness are weakly correlated. Moreover, a general attractiveness factor (i.e., a common underlying variable) modestly contributed to the observed correlations between modality-specific attractiveness judgments, providing some evidence for the redundancy hypothesis.

Making Choices in Discourse: New Alternative Masculinities Opposing the "Warrior's Rest"

Psychology research on men studies, attractiveness, and partner preferences has evolved from the influence of sociobiological perspectives to the role of interactions in shaping election toward sexual–affective relationships and desire toward different kinds of masculinities. However, there is a scientific gap in how language and communicative acts among women influence the kind of partner they feel attracted to and in the reproduction of relationship double standards, like the myth of the “warrior’s rest” where female attractiveness to “bad boys” is encouraged or supported. Some women imitate “the warrior” behavior of men by choosing dominant traditional masculinities (DTM) to have “fun” with and oppressed traditional masculinities (OTM) for “rest” after the “fun” with DTM—choosing an OTM for a stable relationship, but perhaps without passion, while also feeling attraction toward DTM, a response which perpetuates the chauvinist double standard that the feminist movement has condemned when men behave in this sexist way. Through conducting a qualitative study with communicative daily life stories, this article explores, on the one hand, how language and social interaction among women can lead to the reproduction of the DTM role by women and, on the other hand, also how new alternative masculinities (NAM) offer an alternative by explicitly rejecting, through the language of desire, to be the rest for the female warrior, the second fiddle to any woman. This has the potential to become a highly attractive alternative to DTM. Findings provide new knowledge through the analysis of communicative acts and masculinities evidencing the importance of language uses in the reproduction of the double standards in gender relations and to understand how and why these practices are maintained and which kind of language uses can contribute to preventing them. Implications for research and interventions on preventive socialization of gender violence are discussed.

Explaining face-voice matching decisions: The contribution of mouth movements, stimulus effects and response biases

Previous studies have shown that face-voice matching accuracy is more consistently above chance for dynamic (i.e. speaking) faces than for static faces. This suggests that dynamic information can play an important role in informing matching decisions. We initially asked whether this advantage for dynamic stimuli is due to shared information across modalities that is encoded in articulatory mouth movements. Participants completed a sequential face-voice matching task with (1) static images of faces, (2) dynamic videos of faces, (3) dynamic videos where only the mouth was visible, and (4) dynamic videos where the mouth was occluded, in a well-controlled stimulus set. Surprisingly, after accounting for random variation in the data due to design choices, accuracy for all four conditions was at chance. Crucially, however, exploratory analyses revealed that participants were not responding randomly, with different patterns of response biases being apparent for different conditions. Our findings suggest that face-voice identity matching may not be possible with above-chance accuracy but that analyses of response biases can shed light upon how people attempt face-voice matching. We discuss these findings with reference to the differential functional roles for faces and voices recently proposed for multimodal person perception.

Content matters: Cyclic effects on women's voices depend on social context

Women's voices reportedly sound more attractive during the fertile days compared to the non-fertile days of their menstrual cycle. Here we investigated whether the speech content modulates the cyclic changes in women's voices. We asked 72 men and women to rate how interested they were in getting to know the speaker based on her voice. Forty-two naturally cycling women were recorded once during the late follicular phase (high fertility) and once during the luteal phase (low fertility) while speaking sentences of neutral and social content. Listeners were more interested in getting to know the speakers when hearing sentences with social content. Furthermore, raters were more interested in getting to know the speakers when these were recorded in the late follicular than in the luteal phase, but only in sentences with social content. Notably, levels of reproductive hormones (EP ratio) across the cycle phases did not significantly predict the preference for late follicular voices, but echoing the perceptual ratings, there was a significant EP ratio x speech content interaction. Phonetic analyses of mean fundamental frequency (F0) revealed a main effect of menstrual cycle phase and speech content but no interaction. Employing an action-oriented task, the present study extends findings of cycle-dependent voice changes by emphasising that speech content critically modulates fertility effects.

Positive association between facial and vocal femininity/masculinity in women but not in men

Multicomponent stimuli improve information reception. In women, perceived facial and vocal femininity-masculinity (FM) are concordant; however, mixed results are found for men. Some feminine and masculine traits are related to sex hormone action and can indicate reproductive qualities. However, most of the current research about human mate choice focuses on isolated indicators, especially visual assessment of faces. We therefore examined the cross-modal concordance hypothesis by testing correlations between perceptions of FM based on facial, vocal, and behavioral stimuli. Standardized facial pictures, vocal recordings and dance videos of 38 men and 41 women, aged 18-35 years, were rated by 21 male and 43 female students, aged 18-35 years, on 100-point scale (0 = very feminine; 100 = very masculine). All participants were Brazilian students from University of Sao Paulo. In women, facial and vocal FM correlated positively, suggesting concordant information about mate quality. Such results were not found in men, indicating multiple messages, which agree with women's multifaceted preference for male FM. In both sexes, FM of dance did not correlate with voices or faces, indicating different information and distinct process of development. We thus partially supported the cross-modal concordance hypothesis.

Positive association between vocal and facial attractiveness in women but not in men: A cross-cultural study

Various species use multiple sensory modalities in the communication processes. In humans, female facial appearance and vocal display are correlated and it has been suggested that they serve as redundant markers indicating the bearer's reproductive potential and/or residual fertility. In men, evidence for redundancy of facial and vocal attractiveness is ambiguous. We tested the redundancy/multiple signals hypothesis by correlating perceived facial and vocal attractiveness in men and women from two different populations, Brazil and the Czech Republic. We also investigated whether facial and vocal attractiveness are linked to facial morphology. Standardized facial pictures and vocal samples of 86 women (47 from Brazil) and 81 men (41 from Brazil), aged 18-35, were rated for attractiveness by opposite-sex raters. Facial and vocal attractiveness were found to positively correlate in women but not in men. We further applied geometric morphometrics and regressed facial shape coordinates on facial and vocal attractiveness ratings. In women, facial shape was linked to their facial attractiveness but there was no association between facial shape and vocal attractiveness. In men, none of these associations was significant. Having shown that women with more attractive faces possess also more attractive voices, we thus only partly supported the redundant signal hypothesis.

Matching novel face and voice identity using static and dynamic facial images

Research investigating whether faces and voices share common source identity information has offered contradictory results. Accurate face-voice matching is consistently above chance when the facial stimuli are dynamic, but not when the facial stimuli are static. We tested whether procedural differences might help to account for the previous inconsistencies. In Experiment 1, participants completed a sequential two-alternative forced choice matching task. They either heard a voice and then saw two faces or saw a face and then heard two voices. Face-voice matching was above chance when the facial stimuli were dynamic and articulating, but not when they were static. In Experiment 2, we tested whether matching was more accurate when faces and voices were presented simultaneously. The participants saw two face-voice combinations, presented one after the other. They had to decide which combination was the same identity. As in Experiment 1, only dynamic face-voice matching was above chance. In Experiment 3, participants heard a voice and then saw two static faces presented simultaneously. With this procedure, static face-voice matching was above chance. The overall results, analyzed using multilevel modeling, showed that voices and dynamic articulating faces, as well as voices and static faces, share concordant source identity information. It seems, therefore, that above-chance static face-voice matching is sensitive to the experimental procedure employed. In addition, the inconsistencies in previous research might depend on the specific stimulus sets used; our multilevel modeling analyses show that some people look and sound more similar than others.

Are there vocal cues to human developmental stability? Relationships between facial fluctuating asymmetry and voice attractiveness

Fluctuating asymmetry (FA), deviation from perfect bilateral symmetry, is thought to reflect an organism's relative inability to maintain stable morphological development in the face of environmental and genetic stressors. Previous research has documented negative relationships between FA and attractiveness judgments in humans, but scant research has explored relationships between the human voice and this putative marker of genetic quality in either sex. Only one study (and in women only) has explored relationships between vocal attractiveness and asymmetry of the face, a feature-rich trait space central in prior work on human genetic quality and mate choice. We therefore examined this relationship in three studies comprising 231 men and 240 women from two Western samples as well as Hadza hunter-gatherers of Tanzania. Voice recordings were collected and rated for attractiveness, and FA was computed from two-dimensional facial images as well as, for a subset of men, three-dimensional facial scans. Through meta-analysis of our results and those of prior studies, we found a negative association between FA and vocal attractiveness that was highly robust and statistically significant whether we included effect sizes from previously published work, or only those from the present research, and regardless of the inclusion of any individual sample or method of assessing FA (e.g., facial or limb FA). Weighted mean correlations between FA and vocal attractiveness across studies were -.23 for men and -.29 for women. This research thus offers strong support for the hypothesis that voices provide cues to genetic quality in humans.

The effect of inserting an inter-stimulus interval in face-voice matching tasks

Voices and static faces can be matched for identity above chance level. No previous face-voice matching experiments have included an inter-stimulus interval (ISI) exceeding 1 s. We tested whether accurate identity decisions rely on high-quality perceptual representations temporarily stored in sensory memory, and therefore whether the ability to make accurate matching decisions diminishes as the ISI increases. In each trial, participants had to decide whether an unfamiliar face and voice belonged to the same person. The face and voice stimuli were presented simultaneously in Experiment 1, and there was a 5-s ISI in Experiment 2, and a 10-s interval in Experiment 3. The results, analysed using multilevel modelling, revealed that static face-voice matching was significantly above chance level only when the stimuli were presented simultaneously (Experiment 1). The overall bias to respond same identity weakened as the interval increased, suggesting that this bias is explained by temporal contiguity. Taken together, the findings highlight that face-voice matching performance is reliant on comparing fast-decaying, high-quality perceptual representations. The results are discussed in terms of social functioning.

Concordant Cues in Faces and Voices

Information from faces and voices combines to provide multimodal signals about a person. Faces and voices may offer redundant, overlapping (backup signals), or complementary information (multiple messages). This article reports two experiments which investigated the extent to which faces and voices deliver concordant information about dimensions of fitness and quality. In Experiment 1, participants rated faces and voices on scales for masculinity/femininity, age, health, height, and weight. The results showed that people make similar judgments from faces and voices, with particularly strong correlations for masculinity/femininity, health, and height. If, as these results suggest, faces and voices constitute backup signals for various dimensions, it is hypothetically possible that people would be able to accurately match novel faces and voices for identity. However, previous investigations into novel face–voice matching offer contradictory results. In Experiment 2, participants saw a face and heard a voice and were required to decide whether the face and voice belonged to the same person. Matching accuracy was significantly above chance level, suggesting that judgments made independently from faces and voices are sufficiently similar that people can match the two. Both sets of results were analyzed using multilevel modeling and are interpreted as being consistent with the backup signal hypothesis.