Individual differences in cortisol stress response predict increases in voice pitch during exam stress

Voice-based judgments of sex, height, weight, attractiveness, health, and psychological traits based on free speech versus scripted speech

How do we perceive others based on their voices? This question has attracted research and media attention for decades, producing hundreds of studies showing that the voice is socially and biologically relevant, but these studies vary in methodology and ecological validity. Here we test whether vocalizers producing read versus free speech are judged similarly by listeners on ten biological and/or psychosocial traits. In perception experiments using speech from 208 men and women and ratings from 4,088 listeners, we show that listeners' assessments of vocalizer sex and age are highly accurate, regardless of speech type. Assessments of body size, femininity-masculinity and women's health also did not differ between free and read speech. In contrast, read speech elicited higher ratings of attractiveness, dominance and trustworthiness in both sexes and of health in males compared to free speech. Importantly, these differences were small, and we additionally show moderate to strong correlations between ratings of the same vocalizers based on their read and free speech for all ten traits, indicating that voice-based judgments are highly consistent within speakers, whether or not speech is spontaneous. Our results provide evidence that the human voice can communicate various biological and psychosocial traits via both read and free speech, with theoretical and practical implications.

Human talkers change their voices to elicit specific trait percepts

The voice is a variable and dynamic social tool with functional relevance for self-presentation, for example, during a job interview or courtship. Talkers adjust their voices flexibly to their situational or social environment. Here, we investigated how effectively intentional voice modulations can evoke trait impressions in listeners (Experiment 1), whether these trait impressions are recognizable (Experiment 2), and whether they meaningfully influence social interactions (Experiment 3). We recorded 40 healthy adult speakers' whilst speaking neutrally and whilst producing vocal expressions of six social traits (e.g., likeability, confidence). Multivariate ratings of 40 listeners showed that vocal modulations amplified specific trait percepts (Experiments 1 and 2), which could be explained by two principal components relating to perceived affiliation and competence. Moreover, vocal modulations increased the likelihood of listeners choosing the voice to be suitable for corresponding social goals (i.e., a confident rather than likeable voice to negotiate a promotion, Experiment 3). These results indicate that talkers modulate their voice along a common trait space for social navigation. Moreover, beyond reactive voice changes, vocal behaviour can be strategically used by talkers to communicate subtle information about themselves to listeners. These findings advance our understanding of non-verbal vocal behaviour for social communication.

Comparing accuracy in voice-based assessments of biological speaker traits across speech types

Nonverbal acoustic parameters of the human voice provide cues to a vocaliser's sex, age, and body size that are relevant in human social and sexual communication, and also increasingly so for computer-based voice recognition and synthesis technologies. While studies have shown some capacity in human listeners to gauge these biological traits from unseen speakers, it remains unknown whether speech complexity improves accuracy. Here, in over 200 vocalisers and 1500 listeners of both sexes, we test whether voice-based assessments of sex, age, height and weight vary from isolated vowels and words, to sequences of vowels and words, to full sentences or paragraphs. We show that while listeners judge sex and especially age more accurately as speech complexity increases, accuracy remains high across speech types, even for a single vowel sound. In contrast, the actual heights and weights of vocalisers explain comparatively less variance in listener's assessments of body size, which do not vary systematically by speech type. Our results thus show that while more complex speech can improve listeners' biological assessments, the gain is ecologically small, as listeners already show an impressive capacity to gauge speaker traits from extremely short bouts of standardised speech, likely owing to within-speaker stability in underlying nonverbal vocal parameters such as voice pitch. We discuss the methodological, technological, and social implications of these results.

Do Voice-Based Judgments of Socially Relevant Speaker Traits Differ Across Speech Types?

PURPOSE

The human voice is a powerful and evolved social tool, with hundreds of studies showing that nonverbal vocal parameters robustly influence listeners' perceptions of socially meaningful speaker traits, ranging from perceived gender and age to attractiveness and trustworthiness. However, these studies have utilized a wide variety of voice stimuli to measure listeners' voice-based judgments of these traits. Here, in the largest scale study known to date, we test whether listeners judge the same unseen speakers differently depending on the complexity of the neutral speech stimulus, from single vowel sounds to a full paragraph.

METHOD

In a playback experiment testing 2,618 listeners, we examine whether commonly studied voice-based judgments of attractiveness, trustworthiness, dominance, likability, femininity/masculinity, and health differ if listeners hear isolated vowels, a series of vowels, single words, single sentences (greeting), counting from 1 to 10, or a full paragraph recited aloud (Rainbow Passage), recorded from the same 208 men and women. Data were collected using a custom-designed interface in which vocalizers and traits were randomly assigned to raters.

RESULTS

Linear-mixed models show that the type of voice stimulus does indeed consistently affect listeners' judgments. Overall, ratings of attractiveness, trustworthiness, dominance, likability, health, masculinity among men, and femininity among women increase as speech duration increases. At the same time, speaker-level regression analyses show that interindividual differences in perceived speaker traits are largely preserved across voice stimuli, especially among those of a similar duration.

CONCLUSIONS

Socially relevant perceptions of speakers are not wholly changed but rather moderated by the length of their speech. Indeed, the same vocalizer is perceived in a similar way regardless of which neutral statements they speak, with the caveat that longer utterances explain the most shared variance in listeners' judgments and elicit the highest ratings on all traits, possibly by providing additional nonverbal information to listeners.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21158890.

A rapid, non-invasive method for fatigue detection based on voice information

Fatigue results from a series of physiological and psychological changes due to continuous energy consumption. It can affect the physiological states of operators, thereby reducing their labor capacity. Fatigue can also reduce efficiency and, in serious cases, cause severe accidents. In addition, it can trigger pathological-related changes. By establishing appropriate methods to closely monitor the fatigue status of personnel and relieve the fatigue on time, operation-related injuries can be reduced. Existing fatigue detection methods mostly include subjective methods, such as fatigue scales, or those involving the use of professional instruments, which are more demanding for operators and cannot detect fatigue levels in real time. Speech contains information that can be used as acoustic biomarkers to monitor physiological and psychological statuses. In this study, we constructed a fatigue model based on the method of sleep deprivation by collecting various physiological indexes, such as P300 and glucocorticoid level in saliva, as well as fatigue questionnaires filled by 15 participants under different fatigue procedures and graded the fatigue levels accordingly. We then extracted the speech features at different instances and constructed a model to match the speech features and the degree of fatigue using a machine learning algorithm. Thus, we established a method to rapidly judge the degree of fatigue based on speech. The accuracy of the judgment based on unitary voice could reach 94%, whereas that based on long speech could reach 81%. Our fatigue detection method based on acoustic information can easily and rapidly determine the fatigue levels of the participants. This method can operate in real time and is non-invasive and efficient. Moreover, it can be combined with the advantages of information technology and big data to expand its applicability.

Stress Effects on Pharyngeal Air Pressure and Upper Esophageal Sphincter Pressure During Phonation: The Influence of Vocal Tract Semi-Occlusion

OBJECTIVES/HYPOTHESIS

The objective of this study was to determine whether vocal tract semi-occlusion (SOVT) influenced stress effects on pharyngeal air pressure and upper esophageal sphincter (UES) pressure during phonation. Relationships between dysphonia and stress are well recognized but poorly understood. Stress effects act globally on the body, and may be observed beyond intrinsic laryngeal muscles to include pharyngeal muscles and the UES, which contribute to voice modulation. Phonation with SOVT may provide resistance to stress effects on the vocal tract. We hypothesized that stress effects on pharyngeal air pressure and UES pressure would be measurable with a high-resolution, 360° pressure catheter, and that stress effects would be impacted differently by occlusal and non-occlusal phonatory tasks.

METHODS

Ten healthy adults performed sustained vowel tasks (comfortable /a/, and loud /a/), and SOVT tasks (bilabial fricative and straw phonation). Each task was performed during a baseline condition, and during stress induced through a cold pressor task. Pharyngeal air pressure and UES pressure were measured via high-resolution manometry. Changes in pressure between baseline and stress were compared among phonatory tasks.

RESULTS

Stress-induced changes to UES pressure differed by phonatory task (P < 0.01). Stress increased UES pressures during vowels, but had no effect during bilabial fricative, and decreased UES pressures during straw phonation. Change in UES pressure with stress was greater for comfortable /a/ and loud /a/ than straw phonation (P = 0.048 and P = 0.019, respectively), and was not significantly different between comfortable /a/ or loud /a/ and bilabial fricative. Stress-induced changes in pharyngeal air pressure were not significantly different among tasks.

CONCLUSIONS

These findings help identify possible mechanisms underlying the relationship between stress and voice, and point to the utility of SOVT tasks for training vocal tract resistance to stress. This methodology provides a foundation for measuring changes to extra-laryngeal components of the vocal tract during phonation.

Vocal-Stress Diary: A Longitudinal Investigation of the Association of Everyday Work Stressors and Human Voice Features

The human voice conveys plenty of information about the speaker. A prevalent assumption is that stress-related changes in the human body affect speech production, thus affecting voice features. This suggests that voice data may be an easy-to-capture measure of everyday stress levels and can thus serve as a warning signal of stress-related health consequences. However, previous research is limited (i.e., has induced stress only through artificial tasks or has investigated only short-term or extreme stressors), leaving it open whether everyday work stressors are associated with voice features. Thus, our participants (111 adult working individuals) took part in a 1-week diary study (Sunday until Sunday), in which they provided voice messages and self-report data on daily work stressors. Results showed that work stressors were associated with voice features such as increased speech rate and voice intensity. We discuss theoretical, practical, and ethical implications regarding the voice as an indicator of psychological states.

An Evaluation of Speech-Based Recognition of Emotional and Physiological Markers of Stress

Life in modern societies is fast-paced and full of stress-inducing demands. The development of stress monitoring methods is a growing area of research due to the personal and economic advantages that timely detection provides. Studies have shown that speech-based features can be utilised to robustly predict several physiological markers of stress, including emotional state, continuous heart rate, and the stress hormone, cortisol. In this contribution, we extend previous works by the authors, utilising three German language corpora including more than 100 subjects undergoing a Trier Social Stress Test protocol. We present cross-corpus and transfer learning results which explore the efficacy of the speech signal to predict three physiological markers of stress—sequentially measured saliva-based cortisol, continuous heart rate as beats per minute (BPM), and continuous respiration. For this, we extract several features from audio as well as video and apply various machine learning architectures, including a temporal context-based Long Short-Term Memory Recurrent Neural Network (LSTM-RNN). For the task of predicting cortisol levels from speech, deep learning improves on results obtained by conventional support vector regression—yielding a Spearman correlation coefficient (ρ) of 0.770 and 0.698 for cortisol measurements taken 10 and 20 min after the stress period for the two corpora applicable—showing that audio features alone are sufficient for predicting cortisol, with audiovisual fusion to an extent improving such results. We also obtain a Root Mean Square Error (RMSE) of 38 and 22 BPM for continuous heart rate prediction on the two corpora where this information is available, and a normalised RMSE (NRMSE) of 0.120 for respiration prediction (−10: 10). Both of these continuous physiological signals show to be highly effective markers of stress (based on cortisol grouping analysis), both when available as ground truth and when predicted using speech. This contribution opens up new avenues for future exploration of these signals as proxies for stress in naturalistic settings.

Changes in parameters of biochemical and oxidative stress in university students during and after examinations

The study aimed to evaluate the parameters of lipid peroxidation and antioxidant protection, biochemical parameters, and cortisol and adrenaline content in the blood of students depending on the effect of exam stress. A total of 135 healthy students (72 female (53.3%) and 63 male (46.7%)) aged from 19 to 21 years (mean age 20.16 ± 0.42 years) of the experimental group underwent detailed medical screening and examination before the inclusion in the study. The control group consisted of 30 healthy students (17 female (56.7%) and 13 male (43.3%)) of corresponding age (mean age 20.23 ± 0.54 years), whose medical examination was performed during breaks in the absence of any stress factors. The blood parameters of the experimental group were investigated 1 h before, 1 h after, and 24 h after the exam. The cortisol content in the blood of experimental group students significantly increased 1.37 times (p < 0.05) an hour before the exam and 1.32 times (p < 0.05) an hour after; adrenalin content in blood increased 1.76 times (p < 0.05) and 1.49 times (p < 0.05), respectively. Compared to the control group, intensification of lipid peroxidation processes with a 1.51-fold (p < 0.05) increase in erythrocyte malonic aldehyde content in blood 1 h before and 1.42-fold (p < 0.05) increase an hour after the exam was observed in students due to the effect of exam stress.. Changes in hormonal homeostasis, activation of lipoperoxidation processes with the development of oxidative stress, and the disintegration of antioxidant protection factors are typical for academic stress in students.

Measuring Stress in Health Professionals Over the Phone Using Automatic Speech Analysis During the COVID-19 Pandemic: Observational Pilot Study

Background

During the COVID-19 pandemic, health professionals have been directly confronted with the suffering of patients and their families. By making them main actors in the management of this health crisis, they have been exposed to various psychosocial risks (stress, trauma, fatigue, etc). Paradoxically, stress-related symptoms are often underreported in this vulnerable population but are potentially detectable through passive monitoring of changes in speech behavior.

Objective

This study aims to investigate the use of rapid and remote measures of stress levels in health professionals working during the COVID-19 outbreak. This was done through the analysis of participants’ speech behavior during a short phone call conversation and, in particular, via positive, negative, and neutral storytelling tasks.

Methods

Speech samples from 89 health care professionals were collected over the phone during positive, negative, and neutral storytelling tasks; various voice features were extracted and compared with classical stress measures via standard questionnaires. Additionally, a regression analysis was performed.

Results

Certain speech characteristics correlated with stress levels in both genders; mainly, spectral (ie, formant) features, such as the mel-frequency cepstral coefficient, and prosodic characteristics, such as the fundamental frequency, appeared to be sensitive to stress. Overall, for both male and female participants, using vocal features from the positive tasks for regression yielded the most accurate prediction results of stress scores (mean absolute error 5.31).

Conclusions

Automatic speech analysis could help with early detection of subtle signs of stress in vulnerable populations over the phone. By combining the use of this technology with timely intervention strategies, it could contribute to the prevention of burnout and the development of comorbidities, such as depression or anxiety.

The association between serum cortisol, thyroid profile, paraoxonase activity, arylesterase activity and anthropometric parameters of undergraduate students under examination stress

Stress caused due to examinations during any degree program and at any educational level has been observed at all levels so the present study was conducted to investigate the stress related to final examination in undergraduate students with reference to their academic performance. Fifty-four volunteers were divided into three groups, ( n = 18), according to their academic performance, that is, Group A with low CGPA (⩽2.99), Group B with average CGPA (⩾3.00–3.59) and Group C with high CGPA (⩾3.60) and blood samples (3 ml) were taken at three-time intervals, that is, pre-examination, during examination and post examination time interval, at the Department of Physiology, Government College University, Faisalabad. Anthropometric parameters like height, weight, blood pressure, heart rate and body mass index (BMI) were also determined. Blood cortisol and thyroid hormones (triiodothyronine, T3; thyroxine, T4) and thyroid stimulating hormone (TSH)) were measured using ELISA based technique. Arylesterase activity (ARE) and paraoxonase activity (PON-1) were also measured using colorimetric method. The results showed that overall cortisol level was increased at pre-examination and during examination time intervals as compared to the post examination time interval while PON-1 and ARE were significantly ( p < 0.05) decreased. With regards to T4 and TSH, a non-significant ( p < 0.05) difference was observed in pre and post examination time interval. It could be concluded from the current study that semester system examinations significantly ( p < 0.05) imposed stress in all students group at pre-examination interval as compare to post examination interval and this examination related stress was find more in the students already obtained low CGPA as compared to the other studied groups. Although, a correlation between academic performance and examinations stress in semester system was found but a large scale trial in multiple institutions throughout the Pakistan is required to exclude any socioeconomic factors because Pakistan belongs to developing country.

Human Stress Detection: Cortisol Levels in Stressed Speakers Predict Voice-Based Judgments of Stress

Despite recent evidence of a positive relationship between cortisol levels and voice pitch in stressed speakers, the extent to which human listeners can reliably judge stress from the voice remains unknown. Here, we tested whether voice-based judgments of stress co-vary with the free cortisol levels and vocal parameters of speakers recorded in a real-life stressful situation (oral examination) and baseline (2 weeks prior). Hormone and acoustic analyses indicated elevated salivary cortisol levels and corresponding changes in voice pitch, vocal tract resonances (formants), and speed of speech during stress. In turn, listeners' stress ratings correlated significantly with speakers' cortisol levels. Higher pitched voices were consistently perceived as more stressed; however, the influence of formant frequencies, vocal perturbation and noise parameters on stress ratings varied across contexts, suggesting that listeners utilize different strategies when assessing calm versus stressed speech. These results indicate that nonverbal vocal cues can convey honest information about a speaker's underlying physiological level of stress that listeners can, to some extent, detect and utilize, while underscoring the necessity to control for individual differences in the biological stress response.

Aerodynamic and Acoustic Voice Measures Before and After an Acute Public Speaking Stressor

Purpose The goal of this study was to determine if differences in stress system activation lead to changes in speaking fundamental frequency, average oral airflow, and estimated subglottal pressure before and after an acute, psychosocial stressor. Method Eighteen vocally healthy adult females experienced the Trier Social Stress Test (TSST) to activate the hypothalamic-pituitary-adrenal axis. The TSST includes public speaking and performing mental arithmetic in front of an audience. At seven time points, three before the stressor and four after the stressor, the participants produced /pa/ repetitions, read the Rainbow Passage, and provided a saliva sample. Measures included (a) salivary cortisol level, (b) oral airflow, (c) estimated subglottal pressure, and (d) speaking fundamental frequency from the second sentence of the Rainbow Passage. Results Ten of the 18 participants experienced a hypothalamic-pituitary-adrenal axis response to stress as indicated by a 2.5-nmol/L increase in salivary cortisol from before the TSST to after the TSST. Those who experienced a response to stress had a significantly higher speaking fundamental frequency before and immediately after the stressor than later after the stressor. No other variable varied significantly due to the stressor. Conclusions This study suggests that the idiosyncratic and inconsistent voice changes reported in the literature may be explained by differences in stress system activation. In addition, laryngeal aerodynamic measures appear resilient to changes due to acute stress. Further work is needed to examine the influence of other stress systems and if these findings hold for dysphonic individuals.

Cognitive-Emotional Involvement During Mirror Exposure Is Not Accompanied by Physiological Activation in Binge Eating Disorder

Body image interventions have been shown to reduce self-reported cognitive-emotional facets of body image disturbance in binge eating disorder (BED). However, more objective assessment methods are required to evaluate the effects of these interventions. Therefore, the present study aimed at investigating the usefulness of vocally encoded emotional arousal as physiological correlate of body dissatisfaction during mirror exposure in women with BED. Women with BED (n = 60) and weight-matched controls (CG; n = 60) participated in an experimental thought-sampling procedure including a mirror exposure and a control condition in a repeated-measures design. Fundamental frequency as a vocal correlate of emotional arousal as well as negative, neutral, and positive body-related cognitions during both conditions were analyzed. In line with our hypotheses, the BED group verbalized more negative, and less positive and neutral body-related cognitions during the mirror exposure condition compared to the CG. Contrary to our hypotheses, though, there was a stronger increase in physiological arousal between the control and the mirror exposure condition in the CG relative to the BED group. Furthermore, a significant negative correlation between fundamental frequency and the severity of cognitive-emotional body image disturbances emerged. The findings indicate a cognitive-emotional over-involvement with physical appearance during mirror exposure in women with BED compared to weight-matched controls in the absence of a corresponding physiological pattern. Results are discussed in terms of an impaired ability of women with BED to show adequate physiological responses to body-related stress. In addition, methodological recommendations for future research are presented.

Multimodal stress detection: Testing for covariation in vocal, hormonal and physiological responses to Trier Social Stress Test

Examining the effects of acute stress across multiple modalities (behavioral, physiological, and endocrinological) can increase our understanding of the interplay among stress systems, and may improve the efficacy of stress detection. A multimodal approach also allows for verification of the biological stress response, which can vary between individuals due to myriad internal and external factors, thus allowing for reliable interpretation of behavioral markers of stress. Here, controlling for variables known to affect the magnitude of the stress response, we utilized the Trier Social Stress Test (TSST) to elicit an acute stress response in 80 healthy adult men and women. The TSST involves an interview-style oral presentation and critical social evaluation, and is highly effective in inducing psychosocial stress. Participants completed the study in individual 2 h sessions, during which we collected voice, polygraph and salivary hormone measures in baseline, stress, and relaxation phases. Our results show sizeable systematic increases in voice pitch (mean, minimum and variation in fundamental frequency, F0), hormone levels (cortisol) and decreases in skin temperature and hand movement during psychosocial stress, with striking similarities between men and women. However, cortisol and skin temperature only weakly predicted changes in voice pitch during stress, in either women or men, respectively. Thus, while our results provide compelling evidence that psychosocial stress manifests itself behaviorally by increasing voice pitch and its variability alongside simultaneous activation of physiological and endocrinological stress systems, our results also highlight a relatively weak degree of intra-individual 'response coherence' across these stress systems, with dissociations among different stress measures related most strongly to sex.

Phonetic characteristics of vocalizations during pain

INTRODUCTION AND OBJECTIVES

There have, yet, been only few attempts to phonetically characterize the vocalizations of pain, although there is wide agreement that moaning, groaning, or other nonverbal utterance can be indicative of pain. We studied the production of vowels "u," "a," "i", and "schwa" (central vowel, sounding like a darker "e" as in hesitations like "ehm")-as experimental approximations to natural vocalizations.

METHODS

In 50 students vowel production and self-report ratings were assessed during painful and nonpainful heat stimulation (hot water immersion) as well as during baseline (no-stimulation). The phonetic parameters extracted were pitch (mean F₀), phonatory fluctuations (range F₀) and loudness (acoustic energy level).

RESULTS

Only for the vowels "u" and "schwa," which might be considered best approximations to moaning and groaning, did pitch and loudness increase during pain. Furthermore, changes from nonpainful to painful stimulations in these parameters also significantly predicted concurrent changes in pain ratings.

CONCLUSION

Vocalization characteristics of pain seem to be best described by an increase in pitch and in loudness. Future studies using more specific and comprehensive phonetic analyses will surely help to provide an even more precise characterization of vocalizations because of pain.