Do Voice-Based Judgments of Socially Relevant Speaker Traits Differ Across Speech Types?

PURPOSE

The human voice is a powerful and evolved social tool, with hundreds of studies showing that nonverbal vocal parameters robustly influence listeners' perceptions of socially meaningful speaker traits, ranging from perceived gender and age to attractiveness and trustworthiness. However, these studies have utilized a wide variety of voice stimuli to measure listeners' voice-based judgments of these traits. Here, in the largest scale study known to date, we test whether listeners judge the same unseen speakers differently depending on the complexity of the neutral speech stimulus, from single vowel sounds to a full paragraph.

METHOD

In a playback experiment testing 2,618 listeners, we examine whether commonly studied voice-based judgments of attractiveness, trustworthiness, dominance, likability, femininity/masculinity, and health differ if listeners hear isolated vowels, a series of vowels, single words, single sentences (greeting), counting from 1 to 10, or a full paragraph recited aloud (Rainbow Passage), recorded from the same 208 men and women. Data were collected using a custom-designed interface in which vocalizers and traits were randomly assigned to raters.

RESULTS

Linear-mixed models show that the type of voice stimulus does indeed consistently affect listeners' judgments. Overall, ratings of attractiveness, trustworthiness, dominance, likability, health, masculinity among men, and femininity among women increase as speech duration increases. At the same time, speaker-level regression analyses show that interindividual differences in perceived speaker traits are largely preserved across voice stimuli, especially among those of a similar duration.

CONCLUSIONS

Socially relevant perceptions of speakers are not wholly changed but rather moderated by the length of their speech. Indeed, the same vocalizer is perceived in a similar way regardless of which neutral statements they speak, with the caveat that longer utterances explain the most shared variance in listeners' judgments and elicit the highest ratings on all traits, possibly by providing additional nonverbal information to listeners.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21158890.

The Effects of Pitch Manipulation on Male Ratings of Female Speakers and Their Voices

Vocal and facial cues typically co-occur in natural settings, and multisensory processing of voice and face relies on their synchronous presentation. Psychological research has examined various facial and vocal cues to attractiveness as well as to judgements of sexual dimorphism, health, and age. However, few studies have investigated the interaction of vocal and facial cues in attractiveness judgments under naturalistic conditions using dynamic, ecologically valid stimuli. Here, we used short videos or audio tracks of females speaking full sentences and used a manipulation of voice pitch to investigate cross-modal interactions of voice pitch on facial attractiveness and related ratings. Male participants had to rate attractiveness, femininity, age, and health of synchronized audio-video recordings or voices only, with either original or modified voice pitch. We expected audio stimuli with increased voice pitch to be rated as more attractive, more feminine, healthier, and younger. If auditory judgements cross-modally influence judgements of facial attributes, we additionally expected the voice pitch manipulation to affect ratings of audiovisual stimulus material. We tested 106 male participants in a within-subject design in two sessions. Analyses revealed that voice recordings with increased voice pitch were perceived to be more feminine and younger, but not more attractive or healthier. When coupled with video recordings, increased pitch lowered perceived age of faces, but did not significantly influence perceived attractiveness, femininity, or health. Our results suggest that our manipulation of voice pitch has a measurable impact on judgements of femininity and age, but does not measurably influence vocal and facial attractiveness in naturalistic conditions.

Gender context modulation on the self-enhancement effect of vocal attractiveness evaluation

People evaluated their own voices as sounding more attractive than others rated their voices (i.e., self-enhancement effect from the perspective of the rater, termed "SE_rater"), and people also rated their own voices as more attractive than the voices of others (i.e., self-enhancement effect from the perspective of the voice, termed "SE_voice"). The aim of the present study is to explore whether the gender context (i.e., same-sex and opposite-sex rating context) could influence the SE effect of voice attractiveness evaluation. Male and female participants were asked to rate the attractiveness of their own voices and other participants' voices, either in a same-sex session or an opposite-sex session. The results demonstrated both the SE_rater and SE_voice effect in the same-sex and opposite-sex contexts, for both male and female. More importantly, we found that the SE_rater for the male voices was significantly greater than that for the female voices in the same-sex context whereas no such difference was found in the opposite-sex context. In addition, the SE_voice effect in men was larger in the same-sex context than that in the opposite-sex context whereas the SE_voice in women was smaller in the same-sex context than that in the opposite-sex context. These findings indicated that the self-enhancement effect of vocal attractiveness was modulated by the gender context.

Human voice attractiveness processing: Electrophysiological evidence

Voice attractiveness plays a significant role in social interaction and mate choice. However, how listeners perceive attractive voices and whether this process is mandatory, is poorly understood. The current study explores this question using event-related brain potentials. Participants listened to syllables spoken by male and female voices with high or low attractiveness while completing an implicit (voice un-related) tone detection task or explicitly judging voice attractiveness. In both tasks, attractive male voices elicited a larger N1 than unattractive voices. However, an effect of voice attractiveness on the late positive complex (LPC) was only seen in the explicit task but it was present to both same- and opposite-sex voices. Taken together, voice attractiveness processing during early stages appears to be rapid and mandatory and related to mate selection, whereas during later elaborated processing, voice attractiveness is strategic and aesthetics-based, requiring attentional resources.

Vocal Parameters of Speech and Singing Covary and Are Related to Vocal Attractiveness, Body Measures, and Sociosexuality: A Cross-Cultural Study

Perceived vocal attractiveness and measured sex-dimorphic vocal parameters are both associated with underlying individual qualities. Research tends to focus on speech but singing is another highly evolved communication system that has distinct and universal features with analogs in other species, and it is relevant in mating. Both speaking and singing voice provides relevant information about its producer. We tested whether speech and singing function as "backup signals" that indicate similar underlying qualities. Using a sample of 81 men and 86 women from Brazil and the Czech Republic, we investigated vocal attractiveness rated from speech and singing and its association with fundamental frequency (F0), apparent vocal tract length (VTL), body characteristics, and sociosexuality. F0, VTL, and rated attractiveness of singing and speaking voice strongly correlated within the same individual. Lower-pitched speech in men, higher-pitched speech and singing in women, individuals who like to sing more, and singing of individuals with a higher pitch modulation were perceived as more attractive. In men, physical size positively predicted speech and singing attractiveness. Male speech but not singing attractiveness was associated with higher sociosexuality. Lower-pitched male speech was related to higher sociosexuality, while lower-pitched male singing was linked to lower sociosexuality. Similarly, shorter speech VTL and longer singing VTL predicted higher sociosexuality in women. Different vocal displays function as "backup signals" cueing to attractiveness and body size, but their relation to sexual strategies in men and women differs. Both singing and speech may indicate evolutionarily relevant individual qualities shaped by sexual selection.

Facial Visualizations of Women's Voices Suggest a Cross-Modality Preference for Femininity

Women with higher-pitched voices and more feminine facial features are commonly judged as being more attractive than are women with lower-pitched voices and less feminine faces, possibly because both features are affected by (age-related) variations in endocrine status. These results are primarily derived from investigations of perceptions of variations in single-modality stimuli (i.e., faces or voices) in samples of young adult women. In the present study we sought to test whether male and female perceptions of women's voices affect visual representations of facial femininity. Eighty men and women judged voice recordings of 10 young girls (11–15 years), 10 adult women (19–28 years) and 10 peri-/post-menopausal women (50–64 years) on age, attractiveness, and femininity. Another 80 men and women were asked to indicate the face they think each voice corresponded to using a video that gradually changed from a masculine looking male face into a feminine looking female face. Both male and female participants perceived voices of young girls and adult women to be significantly younger, more attractive and feminine than those of peri-/post-menopausal women. Hearing young girls' and adult women's voices resulted in both men and women selecting faces that differed markedly in apparent femininity from those associated with peri-/post-menopausal women's voices. Voices of young girls had the strongest effect on visualizations of facial femininity. Our results suggest a cross-modal preference for women's vocal and facial femininity, which depends on female age and is independent of the perceiver's sex.