Vocal Cues Underlying Youth and Adult Portrayals of Socio-emotional Expressions

A Louder Call for the Integration of Multiple Nonverbal Channels in the Study of Affect

Affective science has increasingly sought to represent emotional experiences multimodally, measuring affect through a combination of self-report ratings, linguistic output, physiological measures, and/or nonverbal expressions. However, despite widespread recognition that non-facial nonverbal cues are an important facet of expressive behavior, measures of nonverbal expressions commonly focus solely on facial movements. This Commentary represents a call for affective scientists to integrate a larger range of nonverbal cues-including gestures, postures, and vocal cues-alongside facial cues in efforts to represent the experience of emotion and its communication. Using the measurement and analysis of vocal cues as an illustrative case, the Commentary considers challenges, potential solutions, and the theoretical and translational significance of working to integrate multiple nonverbal channels in the study of affect.

Functional patterns of neural activation during vocal emotion recognition in youth with and without refractory epilepsy

Epilepsy has been associated with deficits in the social cognitive ability to decode others' nonverbal cues to infer their emotional intent (emotion recognition). Studies have begun to identify potential neural correlates of these deficits, but have focused primarily on one type of nonverbal cue (facial expressions) to the detriment of other crucial social signals that inform the tenor of social interactions (e.g., tone of voice). Less is known about how individuals with epilepsy process these forms of social stimuli, with a particular gap in knowledge about representation of vocal cues in the developing brain. The current study compared vocal emotion recognition skills and functional patterns of neural activation to emotional voices in youth with and without refractory focal epilepsy. We made novel use of inter-subject pattern analysis to determine brain areas in which activation to emotional voices was predictive of epilepsy status. Results indicated that youth with epilepsy were comparatively less able to infer emotional intent in vocal expressions than their typically developing peers. Activation to vocal emotional expressions in regions of the mentalizing and/or default mode network (e.g., right temporo-parietal junction, right hippocampus, right medial prefrontal cortex, among others) differentiated youth with and without epilepsy. These results are consistent with emerging evidence that pediatric epilepsy is associated with altered function in neural networks subserving social cognitive abilities. Our results contribute to ongoing efforts to understand the neural markers of social cognitive deficits in pediatric epilepsy, in order to better tailor and funnel interventions to this group of youth at risk for poor social outcomes.

Longitudinal Change in Neural Response to Vocal Emotion in Adolescence

Adolescence is associated with maturation of function within neural networks supporting the processing of social information. Previous longitudinal studies have established developmental influences on youth’s neural response to facial displays of emotion. Given the increasing recognition of the importance of non-facial cues to social communication, we build on existing work by examining longitudinal change in neural response to vocal expressions of emotion in 8- to 19-year-old youth. Participants completed a vocal emotion recognition task at two timepoints (1 year apart) while undergoing functional magnetic resonance imaging. The right inferior frontal gyrus, right dorsal striatum and right precentral gyrus showed decreases in activation to emotional voices across timepoints, which may reflect focalization of response in these areas. Activation in the dorsomedial prefrontal cortex was positively associated with age but was stable across timepoints. In addition, the slope of change across visits varied as a function of participants’ age in the right temporo-parietal junction (TPJ): this pattern of activation across timepoints and age may reflect ongoing specialization of function across childhood and adolescence. Decreased activation in the striatum and TPJ across timepoints was associated with better emotion recognition accuracy. Findings suggest that specialization of function in social cognitive networks may support the growth of vocal emotion recognition skills across adolescence.

Moral Development in Adolescence

This article provides a selective review of research on moral development in adolescence during the past decade. We begin with introducing key concepts and reviewing critical theoretical advances in the field of adolescent moral development. This includes integrative models to the developmental study of morality and dynamic socialization models of moral development. Next, related major empirical findings are presented on moral emotion-behavior links, morality in intergroup contexts, and the socialization of moral development. Next, methodological innovations are presented, including new techniques to assess and analyze moral emotions and moral behaviors. We conclude by pointing to promising future directions for moral development research and practices aimed at promoting ethical growth and civic responsibility in adolescents around the globe.

Pediatric anxiety associated with altered facial emotion recognition

Multiple psychiatric disorders are associated with difficulties in facial emotion recognition. However, generalized anxiety disorder may be associated with more accurate recognition of others' emotional expressions, particularly expressions of happiness and fear, which index safety and threat. Children aged 9-14 from a community sample (N = 601) completed a facial emotion labeling task. Children's symptoms of depressive and anxiety syndromes were assessed by self- and parent-report. Elevated symptoms of generalized anxiety disorder were associated with more accurate facial emotion recognition (β = 0.16, p = 0.007), specifically recognition of happiness (β = 0.17, p = 0.002) and fear (β = 0.15, p = 0.006). Elevated depressive symptoms were associated with less accurate facial emotion recognition (β = -0.12, p = 0.018), specifically happiness (β = -0.15, p = 0.002). Elevated symptoms of separation anxiety disorder were also associated with less accurate facial emotion recognition (β = -0.16, p = 0.003), specifically happiness (β = -0.15, p = 0.006) and fear (β = -0.15, p = 0.005), which highlights the importance of distinguishing between anxiety syndromes. Results held when adjusting for child age and sex. Evidence that symptoms of generalized anxiety disorder are associated with more accurate recognition of happiness and fear is consistent with theories of heightened social vigilance and support a transdiagnostic role of facial emotion recognition that may inform the psychosocial development of youth with anxiety and depressive symptoms.

Categorization of Vocal Emotion Cues Depends on Distributions of Input

Learners use the distributional properties of stimuli to identify environmentally relevant categories in a range of perceptual domains, including words, shapes, faces, and colors. We examined whether similar processes may also operate on affective information conveyed through the voice. In Experiment 1, we tested how adults (18–22-year-olds) and children (8–10-year-olds) categorized affective states communicated by vocalizations varying continuously from “calm” to “upset.” We found that the threshold for categorizing both verbal (i.e., spoken word) and nonverbal (i.e., a yell) vocalizations as “upset” depended on the statistical distribution of the stimuli participants encountered. In Experiment 2, we replicated and extended these findings in adults using vocalizations that conveyed multiple negative affect states. These results suggest perceivers’ flexibly and rapidly update their interpretation of affective vocal cues based upon context.

Children and adolescents' neural response to emotional faces and voices: Age-related changes in common regions of activation

The perception of facial and vocal emotional expressions engages overlapping regions of the brain. However, at a behavioral level, the ability to recognize the intended emotion in both types of nonverbal cues follows a divergent developmental trajectory throughout childhood and adolescence. The current study a) identified regions of common neural activation to facial and vocal stimuli in 8- to 19-year-old typically-developing adolescents, and b) examined age-related changes in blood-oxygen-level dependent (BOLD) response within these areas. Both modalities elicited activation in an overlapping network of subcortical regions (insula, thalamus, dorsal striatum), visual-motor association areas, prefrontal regions (inferior frontal cortex, dorsomedial prefrontal cortex), and the right superior temporal gyrus. Within these regions, increased age was associated with greater frontal activation to voices, but not faces. Results suggest that processing facial and vocal stimuli elicits activation in common areas of the brain in adolescents, but that age-related changes in response within these regions may vary by modality.

Vocomotor and Social Brain Networks Work Together to Express Social Traits in Voices

Voice modulation is important when navigating social interactions-tone of voice in a business negotiation is very different from that used to comfort an upset child. While voluntary vocal behavior relies on a cortical vocomotor network, social voice modulation may require additional social cognitive processing. Using functional magnetic resonance imaging, we investigated the neural basis for social vocal control and whether it involves an interplay of vocal control and social processing networks. Twenty-four healthy adult participants modulated their voice to express social traits along the dimensions of the social trait space (affiliation and competence) or to express body size (control for vocal flexibility). Naïve listener ratings showed that vocal modulations were effective in evoking social trait ratings along the two primary dimensions of the social trait space. Whereas basic vocal modulation engaged the vocomotor network, social voice modulation specifically engaged social processing regions including the medial prefrontal cortex, superior temporal sulcus, and precuneus. Moreover, these regions showed task-relevant modulations in functional connectivity to the left inferior frontal gyrus, a core vocomotor control network area. These findings highlight the impact of the integration of vocal motor control and social information processing for socially meaningful voice modulation.

Loneliness and the recognition of vocal socioemotional expressions in adolescence

Lonely individuals show increased social monitoring and heightened recognition of negative facial expressions. The current study investigated whether this pattern extends to other nonverbal modalities by examining associations between loneliness and the recognition of vocal emotional expressions. Youth, ages 11-18 years (n = 122), were asked to identify the intended emotion in auditory portrayals of basic emotions (anger, disgust, fear, happiness, sadness) and social expressions (friendliness, meanness). Controlling for social anxiety, age, and gender, links between loneliness and recognition accuracy were emotion-specific: loneliness was associated with poorer recognition of fear, but better recognition of friendliness. Lonely individuals' motivation to avoid threat may interfere with the recognition of fear, but their attunement to affiliative cues may promote the identification of friendliness in affective prosody. Monitoring for social affiliation cues in others' voices might represent an adaptive function of the reconnection system in lonely youth, and be a worthy target for intervention.

Age-related differences in neural activation and functional connectivity during the processing of vocal prosody in adolescence

The ability to recognize others' emotions based on vocal emotional prosody follows a protracted developmental trajectory during adolescence. However, little is known about the neural mechanisms supporting this maturation. The current study investigated age-related differences in neural activation during a vocal emotion recognition (ER) task. Listeners aged 8 to 19 years old completed the vocal ER task while undergoing functional magnetic resonance imaging. The task of categorizing vocal emotional prosody elicited activation primarily in temporal and frontal areas. Age was associated with a) greater activation in regions in the superior, middle, and inferior frontal gyri, b) greater functional connectivity between the left precentral and inferior frontal gyri and regions in the bilateral insula and temporo-parietal junction, and c) greater fractional anisotropy in the superior longitudinal fasciculus, which connects frontal areas to posterior temporo-parietal regions. Many of these age-related differences in brain activation and connectivity were associated with better performance on the ER task. Increased activation in, and connectivity between, areas typically involved in language processing and social cognition may facilitate the development of vocal ER skills in adolescence.

Associations Between Anxious and Depressive Symptoms and the Recognition of Vocal Socioemotional Expressions in Youth

The current study examined the associations between internalizing symptoms and adolescents' recognition of vocal socioemotional expressions produced by youth. Fifty-seven youth (8-17 years old, M = 12.62, SD = 2.66; 29 anxious, 28 nonanxious; 32 female, 25 male) were asked to identify the intended expression in auditory recordings of youth's portrayals of basic emotions and social attitudes. Recognition accuracy increased with age, suggesting that the ability to recognize vocal affect continues to develop into adolescence. Anxiety symptoms were not associated with recognition ability, but youth's depressive symptoms were related to poorer identification of anger and happiness. Youth experiencing symptoms of depression may be likely to misinterpret vocal expressions of happiness and anger.

Categorical emotion recognition from voice improves during childhood and adolescence

Converging evidence demonstrates that emotion processing from facial expressions continues to improve throughout childhood and part of adolescence. Here we investigated whether this is also the case for emotions conveyed by non-linguistic vocal expressions, another key aspect of social interactions. We tested 225 children and adolescents (age 5–17) and 30 adults in a forced-choice labeling task using vocal bursts expressing four basic emotions (anger, fear, happiness and sadness). Mixed-model logistic regressions revealed a small but highly significant change with age, mainly driven by changes in the ability to identify anger and fear. Adult-level of performance was reached between 14 and 15 years of age. Also, across ages, female participants obtained better scores than male participants, with no significant interaction between age and sex effects. These results expand the findings showing that affective prosody understanding improves during childhood; they document, for the first time, continued improvement in vocal affect recognition from early childhood to mid- adolescence, a pivotal period for social maturation.