Pitch underlies activation of the vocal system during affective vocalization

Goal-directed vocal planning in a songbird

Songbirds' vocal mastery is impressive, but to what extent is it a result of practice? Can they, based on experienced mismatch with a known target, plan the necessary changes to recover the target in a practice-free manner without intermittently singing? In adult zebra finches, we drive the pitch of a song syllable away from its stable (baseline) variant acquired from a tutor, then we withdraw reinforcement and subsequently deprive them of singing experience by muting or deafening. In this deprived state, birds do not recover their baseline song. However, they revert their songs toward the target by about 1 standard deviation of their recent practice, provided the sensory feedback during the latter signaled a pitch mismatch with the target. Thus, targeted vocal plasticity does not require immediate sensory experience, showing that zebra finches are capable of goal-directed vocal planning.

Processing negative emotion in two languages of bilinguals: Accommodation and assimilation of the neural pathways based on a meta-analysis

Numerous functional magnetic resonance imaging (fMRI) studies have examined the neural mechanisms of negative emotional words, but scarce evidence is available for the interactions among related brain regions from the functional brain connectivity perspective. Moreover, few studies have addressed the neural networks for negative word processing in bilinguals. To fill this gap, the current study examined the brain networks for processing negative words in the first language (L1) and the second language (L2) with Chinese-English bilinguals. To identify objective indicators associated with negative word processing, we first conducted a coordinate-based meta-analysis on contrasts between negative and neutral words (including 32 contrasts from 1589 participants) using the activation likelihood estimation method. Results showed that the left medial prefrontal cortex (mPFC), the left inferior frontal gyrus (IFG), the left posterior cingulate cortex (PCC), the left amygdala, the left inferior temporal gyrus (ITG), and the left thalamus were involved in processing negative words. Next, these six clusters were used as regions of interest in effective connectivity analyses using extended unified structural equation modeling to pinpoint the brain networks for bilingual negative word processing. Brain network results revealed two pathways for negative word processing in L1: a dorsal pathway consisting of the left IFG, the left mPFC, and the left PCC, and a ventral pathway involving the left amygdala, the left ITG, and the left thalamus. We further investigated the similarity and difference between brain networks for negative word processing in L1 and L2. The findings revealed similarities in the dorsal pathway, as well as differences primarily in the ventral pathway, indicating both neural assimilation and accommodation across processing negative emotion in two languages of bilinguals.

When laughter arrests speech: fMRI-based evidence

Who has not experienced that sensation of losing the power of speech owing to an involuntary bout of laughter? An investigation of this phenomenon affords an insight into the neuronal processes that underlie laughter. In our functional magnetic resonance imaging study, participants were made to laugh by tickling in a first condition; in a second one they were requested to produce vocal utterances under the provocation of laughter by tickling. This investigation reveals increased neuronal activity in the sensorimotor cortex, the anterior cingulate gyrus, the insula, the nucleus accumbens, the hypothalamus and the periaqueductal grey for both conditions, thereby replicating the results of previous studies on ticklish laughter. However, further analysis indicates the activity in the emotion-associated regions to be lower when tickling is accompanied by voluntary vocalization. Here, a typical pattern of activation is identified, including the primary sensory cortex, a ventral area of the anterior insula and the ventral tegmental field, to which belongs to the nucleus ambiguus, namely, the common effector organ for voluntary and involuntary vocalizations. During the conflictual voluntary-vocalization versus laughter experience, the laughter-triggering network appears to rely heavily on a sensory and a deep interoceptive analysis, as well as on motor effectors in the brainstem.

This article is part of the theme issue ‘Cracking the laugh code: laughter through the lens of biology, psychology and neuroscience’.

Individual differences in vocal size exaggeration

The human voice carries socially relevant information such as how authoritative, dominant, and attractive the speaker sounds. However, some speakers may be able to manipulate listeners by modulating the shape and size of their vocal tract to exaggerate certain characteristics of their voice. We analysed the veridical size of speakers’ vocal tracts using real-time magnetic resonance imaging as they volitionally modulated their voice to sound larger or smaller, corresponding changes to the size implied by the acoustics of their voice, and their influence over the perceptions of listeners. Individual differences in this ability were marked, spanning from nearly incapable to nearly perfect vocal modulation, and was consistent across modalities of measurement. Further research is needed to determine whether speakers who are effective at vocal size exaggeration are better able to manipulate their social environment, and whether this variation is an inherited quality of the individual, or the result of life experiences such as vocal training.

Human larynx motor cortices coordinate respiration for vocal-motor control

Vocal flexibility is a hallmark of the human species, most particularly the capacity to speak and sing. This ability is supported in part by the evolution of a direct neural pathway linking the motor cortex to the brainstem nucleus that controls the larynx the primary sound source for communication. Early brain imaging studies demonstrated that larynx motor cortex at the dorsal end of the orofacial division of motor cortex (dLMC) integrated laryngeal and respiratory control, thereby coordinating two major muscular systems that are necessary for vocalization. Neurosurgical studies have since demonstrated the existence of a second larynx motor area at the ventral extent of the orofacial motor division (vLMC) of motor cortex. The vLMC has been presumed to be less relevant to speech motor control, but its functional role remains unknown. We employed a novel ultra-high field (7T) magnetic resonance imaging paradigm that combined singing and whistling simple melodies to localise the larynx motor cortices and test their involvement in respiratory motor control. Surprisingly, whistling activated both 'larynx areas' more strongly than singing despite the reduced involvement of the larynx during whistling. We provide further evidence for the existence of two larynx motor areas in the human brain, and the first evidence that laryngeal-respiratory integration is a shared property of both larynx motor areas. We outline explicit predictions about the descending motor pathways that give these cortical areas access to both the laryngeal and respiratory systems and discuss the implications for the evolution of speech.

Neural Mechanisms of Parental Communicative Adjustments in Spoken Language

During cultural transmission, caregivers typically adjust their form of speech according to the presumed characteristics of an infant/child, a phenomenon known as infant/child directed speech (IDS/CDS) or "parentese." Although ventromedial prefrontal cortex (vmPFC) damage was previously found to be associated with failure in adjusting non-verbal communicative behaviors, little is known about the neural mechanisms of verbal communicative adjustments, such as IDS/CDS. In the current study, 30 healthy mothers with preschool-age children underwent functional magnetic resonance imaging (fMRI) while performing a picture naming task which required them to name an object for either a child or an adult. In the picture naming task, mothers exhibited a longer naming duration in the toward-child condition than the toward-adult control condition. Naming an object for a child, compared with naming it for an adult, resulted in greater involvement in the vmPFC and other regions (e.g., cerebellum) in the global caregiving network. In particular, the vmPFC exhibited task-related deactivation and decreased functional connectivity with the supplementary motor, precentral, postcentral, and supramarginal regions. These findings suggest that the vmPFC, which is included in the default mode network, is involved in optimizing communicative behaviors for the inter-generational transmission of knowledge. This function of the vmPFC may be considered as a prosocial drive to lead to prosocial communicative behaviors depending on the context. This study provides a better understanding of the neural mechanisms involved in communicative adjustments for children and insight into related applied research fields such as parenting, pedagogy, and education.

Vocomotor and Social Brain Networks Work Together to Express Social Traits in Voices

Voice modulation is important when navigating social interactions-tone of voice in a business negotiation is very different from that used to comfort an upset child. While voluntary vocal behavior relies on a cortical vocomotor network, social voice modulation may require additional social cognitive processing. Using functional magnetic resonance imaging, we investigated the neural basis for social vocal control and whether it involves an interplay of vocal control and social processing networks. Twenty-four healthy adult participants modulated their voice to express social traits along the dimensions of the social trait space (affiliation and competence) or to express body size (control for vocal flexibility). Naïve listener ratings showed that vocal modulations were effective in evoking social trait ratings along the two primary dimensions of the social trait space. Whereas basic vocal modulation engaged the vocomotor network, social voice modulation specifically engaged social processing regions including the medial prefrontal cortex, superior temporal sulcus, and precuneus. Moreover, these regions showed task-relevant modulations in functional connectivity to the left inferior frontal gyrus, a core vocomotor control network area. These findings highlight the impact of the integration of vocal motor control and social information processing for socially meaningful voice modulation.

Laughter is in the air: involvement of key nodes of the emotional motor system in the anticipation of tickling

In analogy to the appreciation of humor, that of tickling is based upon the re-interpretation of an anticipated emotional situation. Hence, the anticipation of tickling contributes to the final outburst of ticklish laughter. To localize the neuronal substrates of this process, functional magnetic resonance imaging (fMRI) was conducted on 31 healthy volunteers. The state of anticipation was simulated by generating an uncertainty respecting the onset of manual foot tickling. Anticipation was characterized by an augmented fMRI signal in the anterior insula, the hypothalamus, the nucleus accumbens and the ventral tegmental area, as well as by an attenuated one in the internal globus pallidus. Furthermore, anticipatory activity in the anterior insula correlated positively with the degree of laughter that was produced during tickling. These findings are consistent with an encoding of the expected emotional consequences of tickling and suggest that early regulatory mechanisms influence, automatically, the laughter circuitry at the level of affective and sensory processing. Tickling activated not only those regions of the brain that were involved during anticipation, but also the posterior insula, the anterior cingulate cortex and the periaqueductal gray matter. Sequential or combined anticipatory and tickling-related neuronal activities may adjust emotional and sensorimotor pathways in preparation for the impending laughter response.

Prosody abilities in a large sample of affective and non-affective first episode psychosis patients

OBJECTIVE

Prosody comprehension deficits have been reported in major psychoses. It is still not clear whether these deficits occur at early psychosis stages. The aims of our study were to investigate a) linguistic and emotional prosody comprehension abilities in First Episode Psychosis (FEP) patients compared to healthy controls (HC); b) performance differences between non-affective (FEP-NA) and affective (FEP-A) patients, and c) association between symptoms severity and prosodic features.

METHODS

A total of 208 FEP (156 FEP-NA and 52 FEP-A) patients and 77 HC were enrolled and assessed with the Italian version of the "Protocole Montréal d'Evaluation de la Communication" to evaluate linguistic and emotional prosody comprehension. Clinical variables were assessed with a comprehensive set of standardized measures.

RESULTS

FEP patients displayed significant linguistic and emotional prosody deficits compared to HC, with FEP-NA showing greater impairment than FEP-A. Also, significant correlations between symptom severity and prosodic features in FEP patients were found.

CONCLUSIONS

Our results suggest that prosodic impairments occur at the onset of psychosis being more prominent in FEP-NA and in those with severe psychopathology. These findings further support the hypothesis that aprosodia is a core feature of psychosis.

How does human motor cortex regulate vocal pitch in singers?

Vocal pitch is used as an important communicative device by humans, as found in the melodic dimension of both speech and song. Vocal pitch is determined by the degree of tension in the vocal folds of the larynx, which itself is influenced by complex and nonlinear interactions among the laryngeal muscles. The relationship between these muscles and vocal pitch has been described by a mathematical model in the form of a set of 'control rules'. We searched for the biological implementation of these control rules in the larynx motor cortex of the human brain. We scanned choral singers with functional magnetic resonance imaging as they produced discrete pitches at four different levels across their vocal range. While the locations of the larynx motor activations varied across singers, the activation peaks for the four pitch levels were highly consistent within each individual singer. This result was corroborated using multi-voxel pattern analysis, which demonstrated an absence of patterned activations differentiating any pairing of pitch levels. The complex and nonlinear relationships between the multiple laryngeal muscles that control vocal pitch may obscure the neural encoding of vocal pitch in the brain.

The Functional Neuroanatomy of Lexical Tone Perception: An Activation Likelihood Estimation Meta-Analysis

In tonal language such as Chinese, lexical tone serves as a phonemic feature in determining word meaning. Meanwhile, it is close to prosody in terms of suprasegmental pitch variations and larynx-based articulation. The important yet mixed nature of lexical tone has evoked considerable studies, but no consensus has been reached on its functional neuroanatomy. This meta-analysis aimed at uncovering the neural network of lexical tone perception in comparison with that of phoneme and prosody in a unified framework. Independent Activation Likelihood Estimation meta-analyses were conducted for different linguistic elements: lexical tone by native tonal language speakers, lexical tone by non-tonal language speakers, phoneme, word-level prosody, and sentence-level prosody. Results showed that lexical tone and prosody studies demonstrated more extensive activations in the right than the left auditory cortex, whereas the opposite pattern was found for phoneme studies. Only tonal language speakers consistently recruited the left anterior superior temporal gyrus (STG) for processing lexical tone, an area implicated in phoneme processing and word-form recognition. Moreover, an anterior-lateral to posterior-medial gradient of activation as a function of element timescale was revealed in the right STG, in which the activation for lexical tone lied between that for phoneme and that for prosody. Another topological pattern was shown on the left precentral gyrus (preCG), with the activation for lexical tone overlapped with that for prosody but ventral to that for phoneme. These findings provide evidence that the neural network for lexical tone perception is hybrid with those for phoneme and prosody. That is, resembling prosody, lexical tone perception, regardless of language experience, involved right auditory cortex, with activation localized between sites engaged by phonemic and prosodic processing, suggesting a hierarchical organization of representations in the right auditory cortex. For tonal language speakers, lexical tone additionally engaged the left STG lexical mapping network, consistent with the phonemic representation. Similarly, when processing lexical tone, only tonal language speakers engaged the left preCG site implicated in prosody perception, consistent with tonal language speakers having stronger articulatory representations for lexical tone in the laryngeal sensorimotor network. A dynamic dual-stream model for lexical tone perception was proposed and discussed.

The Control of Vocal Pitch in Human Laryngeal Motor Cortex

In speech, the highly flexible modulation of vocal pitch creates intonation patterns that speakers use to convey linguistic meaning. This human ability is unique among primates. Here, we used high-density cortical recordings directly from the human brain to determine the encoding of vocal pitch during natural speech. We found neural populations in bilateral dorsal laryngeal motor cortex (dLMC) that selectively encoded produced pitch but not non-laryngeal articulatory movements. This neural population controlled short pitch accents to express prosodic emphasis on a word in a sentence. Other larynx cortical representations controlling voicing and longer pitch phrase contours were found at separate sites. dLMC sites also encoded vocal pitch during a non-speech singing task. Finally, direct focal stimulation of dLMC evoked laryngeal movements and involuntary vocalization, confirming its causal role in feedforward control. Together, these results reveal the neural basis for the voluntary control of vocal pitch in human speech. VIDEO ABSTRACT.

Poor neuro-motor tuning of the human larynx: a comparison of sung and whistled pitch imitation

Vocal imitation is a hallmark of human communication that underlies the capacity to learn to speak and sing. Even so, poor vocal imitation abilities are surprisingly common in the general population and even expert vocalists cannot match the precision of a musical instrument. Although humans have evolved a greater degree of control over the laryngeal muscles that govern voice production, this ability may be underdeveloped compared with control over the articulatory muscles, such as the tongue and lips, volitional control of which emerged earlier in primate evolution. Human participants imitated simple melodies by either singing (i.e. producing pitch with the larynx) or whistling (i.e. producing pitch with the lips and tongue). Sung notes were systematically biased towards each individual's habitual pitch, which we hypothesize may act to conserve muscular effort. Furthermore, while participants who sung more precisely also whistled more precisely, sung imitations were less precise than whistled imitations. The laryngeal muscles that control voice production are under less precise control than the oral muscles that are involved in whistling. This imprecision may be due to the relatively recent evolution of volitional laryngeal-motor control in humans, which may be tuned just well enough for the coarse modulation of vocal-pitch in speech.

Prosody production networks are modulated by sensory cues and social context

The neurobiology of emotional prosody production is not well investigated. In particular, the effects of cues and social context are not known. The present study sought to differentiate cued from free emotion generation and the effect of social feedback from a human listener. Online speech filtering enabled functional magnetic resonance imaging during prosodic communication in 30 participants. Emotional vocalizations were (i) free, (ii) auditorily cued, (iii) visually cued or (iv) with interactive feedback. In addition to distributed language networks, cued emotions increased activity in auditory and—in case of visual stimuli—visual cortex. Responses were larger in posterior superior temporal gyrus at the right hemisphere and the ventral striatum when participants were listened to and received feedback from the experimenter. Sensory, language and reward networks contributed to prosody production and were modulated by cues and social context. The right posterior superior temporal gyrus is a central hub for communication in social interactions—in particular for interpersonal evaluation of vocal emotions.

Demonstration and validation of Kernel Density Estimation for spatial meta-analyses in cognitive neuroscience using simulated data

The data presented in this article are related to the research article entitled "Convergence of semantics and emotional expression within the IFG pars orbitalis" (Belyk et al., 2017) [1]. The research article reports a spatial meta-analysis of brain imaging experiments on the perception of semantic compared to emotional communicative signals in humans. This Data in Brief article demonstrates and validates the use of Kernel Density Estimation (KDE) as a novel statistical approach to neuroimaging data. First, we performed a side-by-side comparison of KDE with a previously published meta-analysis that applied activation likelihood estimation, which is the predominant approach to meta-analyses in cognitive neuroscience. Second, we analyzed data simulated with known spatial properties to test the sensitivity of KDE to varying degrees of spatial separation. KDE successfully detected true spatial differences in simulated data and displayed few false positives when no true differences were present. R code to simulate and analyze these data is made publicly available to facilitate the further evaluation of KDE for neuroimaging data and its dissemination to cognitive neuroscientists.