Subcortical processing in auditory communication

Individual connectivity-based parcellations reflect functional properties of human auditory cortex

Neuroimaging studies of the functional organization of human auditory cortex have focused on group-level analyses to identify tendencies that represent the typical brain. Here, we mapped auditory areas of the human superior temporal cortex (STC) in 30 participants by combining functional network analysis and 1-mm isotropic resolution 7T functional magnetic resonance imaging (fMRI). Two resting-state fMRI sessions, and one or two auditory and audiovisual speech localizer sessions, were collected on 3-4 separate days. We generated a set of functional network-based parcellations from these data. Solutions with 4, 6, and 11 networks were selected for closer examination based on local maxima of Dice and Silhouette values. The resulting parcellation of auditory cortices showed high intraindividual reproducibility both between resting state sessions (Dice coefficient: 69-78%) and between resting state and task sessions (Dice coefficient: 62-73%). This demonstrates that auditory areas in STC can be reliably segmented into functional subareas. The interindividual variability was significantly larger than intraindividual variability (Dice coefficient: 57%-68%, p<0.001), indicating that the parcellations also captured meaningful interindividual variability. The individual-specific parcellations yielded the highest alignment with task response topographies, suggesting that individual variability in parcellations reflects individual variability in auditory function. Connectional homogeneity within networks was also highest for the individual-specific parcellations. Furthermore, the similarity in the functional parcellations was not explainable by the similarity of macroanatomical properties of auditory cortex. Our findings suggest that individual-level parcellations capture meaningful idiosyncrasies in auditory cortex organization.

Hidden hearing loss: Fifteen years at a glance

Hearing loss affects approximately 18% of the population worldwide. Hearing difficulties in noisy environments without accompanying audiometric threshold shifts likely affect an even larger percentage of the global population. One of the potential causes of hidden hearing loss is cochlear synaptopathy, the loss of synapses between inner hair cells (IHC) and auditory nerve fibers (ANF). These synapses are the most vulnerable structures in the cochlea to noise exposure or aging. The loss of synapses causes auditory deafferentation, i.e., the loss of auditory afferent information, whose downstream effect is the loss of information that is sent to higher-order auditory processing stages. Understanding the physiological and perceptual effects of this early auditory deafferentation might inform interventions to prevent later, more severe hearing loss. In the past decade, a large body of work has been devoted to better understand hidden hearing loss, including the causes of hidden hearing loss, their corresponding impact on the auditory pathway, and the use of auditory physiological measures for clinical diagnosis of auditory deafferentation. This review synthesizes the findings from studies in humans and animals to answer some of the key questions in the field, and it points to gaps in knowledge that warrant more investigation. Specifically, recent studies suggest that some electrophysiological measures have the potential to function as indicators of hidden hearing loss in humans, but more research is needed for these measures to be included as part of a clinical test battery.

Representation of conspecific vocalizations in amygdala of awake marmosets

Human speech and animal vocalizations are important for social communication and animal survival. Neurons in the auditory pathway are responsive to a range of sounds, from elementary sound features to complex acoustic sounds. For social communication, responses to distinct patterns of vocalization are usually highly specific to an individual conspecific call, in some species. This includes the specificity of sound patterns and embedded biological information. We conducted single-unit recordings in the amygdala of awake marmosets and presented calls used in marmoset communication, calls of other species and calls from specific marmoset individuals. We found that some neurons (47/262) in the amygdala distinguished 'Phee' calls from vocalizations of other animals and other types of marmoset vocalizations. Interestingly, a subset of Phee-responsive neurons (22/47) also exhibited selectivity to one out of the three Phees from two different 'caller' marmosets. Our findings suggest that, while it has traditionally been considered the key structure in the limbic system, the amygdala also represents a critical stage of socially relevant auditory perceptual processing.

Neuro-Navigated rTMS Improves Sleep and Cognitive Impairment via Regulating Sleep-Related Networks' Spontaneous Activity in AD Spectrum Patients

Study Objectives

By examining spontaneous activity changes of sleep-related networks in patients with the Alzheimer's disease (AD) spectrum with or without insomnia disorder (ID) over time via neuro-navigated repetitive transcranial magnetic stimulation (rTMS), we revealed the effect and mechanism of rTMS targeting the left-angular gyrus in improving the comorbidity symptoms of the AD spectrum with ID.

Methods

A total of 34 AD spectrum patients were recruited in this study, including 18 patients with ID and the remaining 16 patients without ID. All of them were measured for cognitive function and sleep by using the cognitive and sleep subscales of the neuropsychiatric inventory. The amplitude of low-frequency fluctuation changes in sleep-related networks was revealed before and after neuro-navigated rTMS treatment between these two groups, and the behavioral significance was further explored.

Results

Affective auditory processing and sensory-motor collaborative sleep-related networks with hypo-spontaneous activity were observed at baseline in the AD spectrum with ID group, while substantial increases in activity were evident at follow-up in these subjects. In addition, longitudinal affective auditory processing, sensory-motor and default mode collaborative sleep-related networks with hyper-spontaneous activity were also revealed at follow-up in the AD spectrum with ID group. In particular, longitudinal changes in sleep-related networks were associated with improvements in sleep quality and episodic memory scores in AD spectrum with ID patients.

Conclusion

We speculated that left angular gyrus-navigated rTMS therapy may enhance the memory function of AD spectrum patients by regulating the spontaneous activity of sleep-related networks, and it was associated with memory consolidation in the hippocampus-cortical circuit during sleep.

Clinical Trial Registration

The study was registered at the Chinese Clinical Trial Registry, registration ID: ChiCTR2100050496, China.

The parental umwelt: Effects of parenthood on sensory processing in rodents

An animal's umwelt, comprising its perception of the sensory environment, which is inherently subjective, can change across the lifespan in accordance with major life events. In mammals, the onset of motherhood, in particular, is associated with a neural and sensory plasticity that alters a mother's detection and use of sensory information such as infant-related sensory stimuli. Although the literature surrounding mammalian mothers is well established, very few studies have addressed the effects of parenthood on sensory plasticity in mammalian fathers. In this review, we summarize the major findings on the effects of parenthood on behavioural and neural responses to sensory stimuli from pups in rodent mothers, with a focus on the olfactory, auditory, and somatosensory systems, as well as multisensory integration. We also review the available literature on sensory plasticity in rodent fathers. Finally, we discuss the importance of sensory plasticity for effective parental care, hormonal modulation of plasticity, and an exploration of temporal, ecological, and life-history considerations of sensory plasticity associated with parenthood. The changes in processing and/or perception of sensory stimuli associated with the onset of parental care may have both transient and long-lasting effects on parental behaviour and cognition in both mothers and fathers; as such, several promising areas of study, such as on the molecular/genetic, neurochemical, and experiential underpinnings of parenthood-related sensory plasticity, as well as determinants of interspecific variation, remain potential avenues for further exploration.

A vocalization-processing network in marmosets

Vocalizations play an important role in the daily life of primates and likely form the basis of human language. Functional imaging studies have demonstrated that listening to voices activates a fronto-temporal voice perception network in human participants. Here, we acquired whole-brain ultrahigh-field (9.4 T) fMRI in awake marmosets (Callithrix jacchus) and demonstrate that these small, highly vocal New World primates possess a similar fronto-temporal network, including subcortical regions, that is activated by the presentation of conspecific vocalizations. The findings suggest that the human voice perception network has evolved from an ancestral vocalization-processing network that predates the separation of New and Old World primates.

Perception of Prosody in Hearing-Impaired Individuals and Users of Hearing Assistive Devices: An Overview of Recent Advances

PURPOSE

Prosody perception is an essential component of speech communication and social interaction through which both linguistic and emotional information are conveyed. Considering the importance of the auditory system in processing prosody-related acoustic features, the aim of this review article is to review the effects of hearing impairment on prosody perception in children and adults. It also assesses the performance of hearing assistive devices in restoring prosodic perception.

METHOD

Following a comprehensive online database search, two lines of inquiry were targeted. The first summarizes recent attempts toward determining the effects of hearing loss and interacting factors such as age and cognitive resources on prosody perception. The second analyzes studies reporting beneficial or detrimental impacts of hearing aids, cochlear implants, and bimodal stimulation on prosodic abilities in people with hearing loss.

RESULTS

The reviewed studies indicate that hearing-impaired individuals vary widely in perceiving affective and linguistic prosody, depending on factors such as hearing loss severity, chronological age, and cognitive status. In addition, most of the emerging information points to limitations of hearing assistive devices in processing and transmitting the acoustic features of prosody.

CONCLUSIONS

The existing literature is incomplete in several respects, including the lack of a consensus on how and to what extent hearing prostheses affect prosody perception, especially the linguistic function of prosody, and a gap in assessing prosody under challenging listening situations such as noise. This review article proposes directions that future research could follow to provide a better understanding of prosody processing in those with hearing impairment, which may help health care professionals and designers of assistive technology to develop innovative diagnostic and rehabilitation tools.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21809772.

Responses in left inferior frontal gyrus are altered for speech-in-noise processing, but not for clear speech in autism

INTRODUCTION

Autistic individuals often have difficulties with recognizing what another person is saying in noisy conditions such as in a crowded classroom or a restaurant. The underlying neural mechanisms of this speech perception difficulty are unclear. In typically developed individuals, three cerebral cortex regions are particularly related to speech-in-noise perception: the left inferior frontal gyrus (IFG), the right insula, and the left inferior parietal lobule (IPL). Here, we tested whether responses in these cerebral cortex regions are altered in speech-in-noise perception in autism.

METHODS

Seventeen autistic adults and 17 typically developed controls (matched pairwise on age, sex, and IQ) performed an auditory-only speech recognition task during functional magnetic resonance imaging (fMRI). Speech was presented either with noise (noise condition) or without noise (no noise condition, i.e., clear speech).

RESULTS

In the left IFG, blood-oxygenation-level-dependent (BOLD) responses were higher in the control compared to the autism group for recognizing speech-in-noise compared to clear speech. For this contrast, both groups had similar response magnitudes in the right insula and left IPL. Additionally, we replicated previous findings that BOLD responses in speech-related and auditory brain regions (including bilateral superior temporal sulcus and Heschl's gyrus) for clear speech were similar in both groups and that voice identity recognition was impaired for clear and noisy speech in autism.

DISCUSSION

Our findings show that in autism, the processing of speech is particularly reduced under noisy conditions in the left IFG-a dysfunction that might be important in explaining restricted speech comprehension in noisy environments.

Eph and ephrin signaling in the development of the central auditory system

Acoustic communication relies crucially on accurate interpretation of information about the intensity, frequency, timing, and location of diverse sound stimuli in the environment. To meet this demand, neurons along different levels of the auditory system form precisely organized neural circuits. The assembly of these precise circuits requires tight regulation and coordination of multiple developmental processes. Several groups of axon guidance molecules have proven critical in controlling these processes. Among them, the family of Eph receptors and their ephrin ligands emerge as one group of key players. They mediate diverse functions at multiple levels of the auditory pathway, including axon guidance and targeting, topographic map formation, as well as cell migration and tissue pattern formation. Here, we review our current knowledge of how Eph and ephrin molecules regulate different processes in the development and maturation of central auditory circuits.

Musical Experience Relates to Insula-Based Functional Connectivity in Older Adults

Engaging in musical activities throughout the lifespan may protect against age-related cognitive decline and modify structural and functional connectivity in the brain. Prior research suggests that musical experience modulates brain regions that integrate different modalities of sensory information, such as the insula. Most of this research has been performed in individuals classified as professional musicians; however, general musical experiences across the lifespan may also confer beneficial effects on brain health in older adults. The current study investigated whether general musical experience, characterized using the Goldsmith Music Sophistication Index (Gold-MSI), was associated with functional connectivity in older adults (age = 65.7 ± 4.4, n = 69). We tested whether Gold-MSI was associated with individual differences in the functional connectivity of three a priori hypothesis-defined seed regions in the insula (i.e., dorsal anterior, ventral anterior, and posterior insula). We found that older adults with more musical experience showed greater functional connectivity between the dorsal anterior insula and the precentral and postcentral gyrus, and between the ventral anterior insula and diverse brain regions, including the insula and prefrontal cortex, and decreased functional connectivity between the ventral anterior insula and thalamus (voxel p < 0.01, cluster FWE p < 0.05). Follow-up correlation analyses showed that the singing ability subscale score was key in driving the association between functional connectivity differences and musical experience. Overall, our findings suggest that musical experience, even among non-professional musicians, is related to functional brain reorganization in older adults.

Impaired Subcortical Processing of Amplitude-Modulated Tones in Mice Deficient for Cacna2d3, a Risk Gene for Autism Spectrum Disorders in Humans

Temporal processing of complex sounds is a fundamental and complex task in hearing and a prerequisite for processing and understanding vocalization, speech, and prosody. Here, we studied response properties of neurons in the inferior colliculus (IC) in mice lacking Cacna2d3, a risk gene for autism spectrum disorders (ASDs). The α₂δ3 auxiliary Ca²⁺ channel subunit encoded by Cacna2d3 is essential for proper function of glutamatergic synapses in the auditory brainstem. Recent evidence has shown that much of auditory feature extraction is performed in the auditory brainstem and IC, including processing of amplitude modulation (AM). We determined both spectral and temporal properties of single- and multi-unit responses in the IC of anesthetized mice. IC units of α₂δ3^−/− mice showed normal tuning properties yet increased spontaneous rates compared with α₂δ3^+/+. When stimulated with AM tones, α₂δ3^−/− units exhibited less precise temporal coding and reduced evoked rates to higher modulation frequencies (f_m). Whereas first spike latencies (FSLs) were increased for only few modulation frequencies, population peak latencies were increased for f_m ranging from 20 to 100 Hz in α₂δ3^−/− IC units. The loss of precision of temporal coding with increasing f_m from 70 to 160 Hz was characterized using a normalized offset-corrected (Pearson-like) correlation coefficient, which appeared more appropriate than the metrics of vector strength. The processing deficits of AM sounds analyzed at the level of the IC indicate that α₂δ3^−/− mice exhibit a subcortical auditory processing disorder (APD). Similar deficits may be present in other mouse models for ASDs.

Altered processing of communication signals in the subcortical auditory sensory pathway in autism

Autism spectrum disorder (ASD) is characterised by social communication difficulties. These difficulties have been mainly explained by cognitive, motivational, and emotional alterations in ASD. The communication difficulties could, however, also be associated with altered sensory processing of communication signals. Here, we assessed the functional integrity of auditory sensory pathway nuclei in ASD in three independent functional magnetic resonance imaging experiments. We focused on two aspects of auditory communication that are impaired in ASD: voice identity perception, and recognising speech‐in‐noise. We found reduced processing in adults with ASD as compared to typically developed control groups (pairwise matched on sex, age, and full‐scale IQ) in the central midbrain structure of the auditory pathway (inferior colliculus [IC]). The right IC responded less in the ASD as compared to the control group for voice identity, in contrast to speech recognition. The right IC also responded less in the ASD as compared to the control group when passively listening to vocal in contrast to non‐vocal sounds. Within the control group, the left and right IC responded more when recognising speech‐in‐noise as compared to when recognising speech without additional noise. In the ASD group, this was only the case in the left, but not the right IC. The results show that communication signal processing in ASD is associated with reduced subcortical sensory functioning in the midbrain. The results highlight the importance of considering sensory processing alterations in explaining communication difficulties, which are at the core of ASD.

Amygdala function in emotion, cognition, and behavior

The amygdala is a core structure in the anterior medial temporal lobe, with an important role in several brain functions involving memory, emotion, perception, social cognition, and even awareness. As a key brain structure for saliency detection, it triggers and controls widespread modulatory signals onto multiple areas of the brain, with a great impact on numerous aspects of adaptive behavior. Here we discuss the neural mechanisms underlying these functions, as established by animal and human research, including insights provided in both healthy and pathological conditions.

OUP accepted manuscript

The waking brain efficiently detects emotional signals to promote survival. However, emotion detection during sleep is poorly understood and may be influenced by individual sleep characteristics or neural reactivity. Notably, dream recall frequency has been associated with stimulus reactivity during sleep, with enhanced stimulus-driven responses in high vs. low recallers. Using electroencephalography (EEG), we characterized the neural responses of healthy individuals to emotional, neutral voices, and control stimuli, both during wakefulness and NREM sleep. Then, we tested how these responses varied with individual dream recall frequency. Event-related potentials (ERPs) differed for emotional vs. neutral voices, both in wakefulness and NREM. Likewise, EEG arousals (sleep perturbations) increased selectively after the emotional voices, indicating emotion reactivity. Interestingly, sleep ERP amplitude and arousals after emotional voices increased linearly with participants’ dream recall frequency. Similar correlations with dream recall were observed for beta and sigma responses, but not for theta. In contrast, dream recall correlations were absent for neutral or control stimuli. Our results reveal that brain reactivity to affective salience is preserved during NREM and is selectively associated to individual memory for dreams. Our findings also suggest that emotion-specific reactivity during sleep, and not generalized alertness, may contribute to the encoding/retrieval of dreams.

Social relationship-dependent neural response to speech in dogs

In humans, social relationship with the speaker affects neural processing of speech, as exemplified by children's auditory and reward responses to their mother's utterances. Family dogs show human analogue attachment behavior towards the owner, and neuroimaging revealed auditory cortex and reward center sensitivity to verbal praises in dog brains. Combining behavioral and non-invasive fMRI data, we investigated the effect of dogs' social relationship with the speaker on speech processing. Dogs listened to praising and neutral speech from their owners and a control person. We found positive correlation between dogs' behaviorally measured attachment scores towards their owners and neural activity increase for the owner's voice in the caudate nucleus; and activity increase in the secondary auditory caudal ectosylvian gyrus and the caudate nucleus for the owner's praise. Through identifying social relationship-dependent neural reward responses, our study reveals similarities in neural mechanisms modulated by infant-mother and dog-owner attachment.

Peripheral Anomalies in USH2A Cause Central Auditory Anomalies in a Mouse Model of Usher Syndrome and CAPD

Central auditory processing disorder (CAPD) is associated with difficulties hearing and processing acoustic information, as well as subsequent impacts on the development of higher-order cognitive processes (i.e., attention and language). Yet CAPD also lacks clear and consistent diagnostic criteria, with widespread clinical disagreement on this matter. As such, identification of biological markers for CAPD would be useful. A recent genome association study identified a potential CAPD risk gene, USH2A. In a homozygous state, this gene is associated with Usher syndrome type 2 (USH2), a recessive disorder resulting in bilateral, high-frequency hearing loss due to atypical cochlear hair cell development. However, children with heterozygous USH2A mutations have also been found to show unexpected low-frequency hearing loss and reduced early vocabulary, contradicting assumptions that the heterozygous (carrier) state is "phenotype free". Parallel evidence has confirmed that heterozygous Ush2a mutations in a transgenic mouse model also cause low-frequency hearing loss (Perrino et al., 2020). Importantly, these auditory processing anomalies were still evident after covariance for hearing loss, suggesting a CAPD profile. Since usherin anomalies occur in the peripheral cochlea and not central auditory structures, these findings point to upstream developmental feedback effects of peripheral sensory loss on high-level processing characteristic of CAPD. In this study, we aimed to expand upon the mouse behavioral battery used in Perrino et al. (2020) by evaluating central auditory brain structures, including the superior olivary complex (SOC) and medial geniculate nucleus (MGN), in heterozygous and homozygous Ush2a mice. We found that heterozygous Ush2a mice had significantly larger SOC volumes while homozygous Ush2a had significantly smaller SOC volumes. Heterozygous mutations did not affect the MGN; however, homozygous Ush2a mutations resulted in a significant shift towards more smaller neurons. These findings suggest that alterations in cochlear development due to USH2A variation can secondarily impact the development of brain regions important for auditory processing ability.

Neurocognitive dynamics of near-threshold voice signal detection and affective voice evaluation

Communication and voice signal detection in noisy environments are universal tasks for many species. The fundamental problem of detecting voice signals in noise (VIN) is underinvestigated especially in its temporal dynamic properties. We investigated VIN as a dynamic signal-to-noise ratio (SNR) problem to determine the neurocognitive dynamics of subthreshold evidence accrual and near-threshold voice signal detection. Experiment 1 showed that dynamic VIN, including a varying SNR and subthreshold sensory evidence accrual, is superior to similar conditions with nondynamic SNRs or with acoustically matched sounds. Furthermore, voice signals with affective meaning have a detection advantage during VIN. Experiment 2 demonstrated that VIN is driven by an effective neural integration in an auditory cortical-limbic network at and beyond the near-threshold detection point, which is preceded by activity in subcortical auditory nuclei. This demonstrates the superior recognition advantage of communication signals in dynamic noise contexts, especially when carrying socio-affective meaning.

Multilevel fMRI adaptation for spoken word processing in the awake dog brain

Human brains process lexical meaning separately from emotional prosody of speech at higher levels of the processing hierarchy. Recently we demonstrated that dog brains can also dissociate lexical and emotional prosodic information in human spoken words. To better understand the neural dynamics of lexical processing in the dog brain, here we used an event-related design, optimized for fMRI adaptation analyses on multiple time scales. We investigated repetition effects in dogs’ neural (BOLD) responses to lexically marked (praise) words and to lexically unmarked (neutral) words, in praising and neutral prosody. We identified temporally and anatomically distinct adaptation patterns. In a subcortical auditory region, we found both short- and long-term fMRI adaptation for emotional prosody, but not for lexical markedness. In multiple cortical auditory regions, we found long-term fMRI adaptation for lexically marked compared to unmarked words. This lexical adaptation showed right-hemisphere bias and was age-modulated in a near-primary auditory region and was independent of prosody in a secondary auditory region. Word representations in dogs’ auditory cortex thus contain more than just the emotional prosody they are typically associated with. These findings demonstrate multilevel fMRI adaptation effects in the dog brain and are consistent with a hierarchical account of spoken word processing.

Auditory processing in the zebra finch midbrain: single unit responses and effect of rearing experience

In birds the auditory system plays a key role in providing the sensory input used to discriminate between conspecific and heterospecific vocal signals. In those species that are known to learn their vocalizations, for example, songbirds, it is generally considered that this ability arises and is manifest in the forebrain, although there is no a priori reason why brainstem components of the auditory system could not also play an important part. To test this assumption, we used groups of normal reared and cross-fostered zebra finches that had previously been shown in behavioural experiments to reduce their preference for conspecific songs subsequent to cross fostering experience with Bengalese finches, a related species with a distinctly different song. The question we asked, therefore, is whether this experiential change also changes the bias in favour of conspecific song displayed by auditory midbrain units of normally raised zebra finches. By recording the responses of single units in MLd to a variety of zebra finch and Bengalese finch songs in both normally reared and cross-fostered zebra finches, we provide a positive answer to this question. That is, the difference in response to conspecific and heterospecific songs seen in normal reared zebra finches is reduced following cross-fostering. In birds the virtual absence of mammalian-like cortical projections upon auditory brainstem nuclei argues against the interpretation that MLd units change, as observed in the present experiments, as a result of top-down influences on sensory processing. Instead, it appears that MLd units can be influenced significantly by sensory inputs arising directly from a change in auditory experience during development.

Human Discrimination and Categorization of Emotions in Voices: A Functional Near-Infrared Spectroscopy (fNIRS) Study

Functional Near-Infrared spectroscopy (fNIRS) is a neuroimaging tool that has been recently used in a variety of cognitive paradigms. Yet, it remains unclear whether fNIRS is suitable to study complex cognitive processes such as categorization or discrimination. Previously, functional imaging has suggested a role of both inferior frontal cortices in attentive decoding and cognitive evaluation of emotional cues in human vocalizations. Here, we extended paradigms used in functional magnetic resonance imaging (fMRI) to investigate the suitability of fNIRS to study frontal lateralization of human emotion vocalization processing during explicit and implicit categorization and discrimination using mini-blocks and event-related stimuli. Participants heard speech-like but semantically meaningless pseudowords spoken in various tones and evaluated them based on their emotional or linguistic content. Behaviorally, participants were faster to discriminate than to categorize; and processed the linguistic faster than the emotional content of stimuli. Interactions between condition (emotion/word), task (discrimination/categorization) and emotion content (anger, fear, neutral) influenced accuracy and reaction time. At the brain level, we found a modulation of the Oxy-Hb changes in IFG depending on condition, task, emotion and hemisphere (right or left), highlighting the involvement of the right hemisphere to process fear stimuli, and of both hemispheres to treat anger stimuli. Our results show that fNIRS is suitable to study vocal emotion evaluation, fostering its application to complex cognitive paradigms.

A neurocognitive model of perceptual decision-making on emotional signals

Humans make various kinds of decisions about which emotions they perceive from others. Although it might seem like a split-second phenomenon, deliberating over which emotions we perceive unfolds across several stages of decisional processing. Neurocognitive models of general perception postulate that our brain first extracts sensory information about the world then integrates these data into a percept and lastly interprets it. The aim of the present study was to build an evidence-based neurocognitive model of perceptual decision-making on others' emotions. We conducted a series of meta-analyses of neuroimaging data spanning 30 years on the explicit evaluations of others' emotional expressions. We find that emotion perception is rather an umbrella term for various perception paradigms, each with distinct neural structures that underline task-related cognitive demands. Furthermore, the left amygdala was responsive across all classes of decisional paradigms, regardless of task-related demands. Based on these observations, we propose a neurocognitive model that outlines the information flow in the brain needed for a successful evaluation of and decisions on other individuals' emotions. HIGHLIGHTS: Emotion classification involves heterogeneous perception and decision-making tasks Decision-making processes on emotions rarely covered by existing emotions theories We propose an evidence-based neuro-cognitive model of decision-making on emotions Bilateral brain processes for nonverbal decisions, left brain processes for verbal decisions Left amygdala involved in any kind of decision on emotions.

Brain Networks of Emotional Prosody Processing

The processing of emotional nonlinguistic information in speech is defined as emotional prosody. This auditory nonlinguistic information is essential in the decoding of social interactions and in our capacity to adapt and react adequately by taking into account contextual information. An integrated model is proposed at the functional and brain levels, encompassing 5 main systems that involve cortical and subcortical neural networks relevant for the processing of emotional prosody in its major dimensions, including perception and sound organization; related action tendencies; and associated values that integrate complex social contexts and ambiguous situations.

Neural Control of Emotional Actions in Response to Affective Vocalizations

Social-emotional cues, such as affective vocalizations and emotional faces, automatically elicit emotional action tendencies. Adaptive social-emotional behavior depends on the ability to control these automatic action tendencies. It remains unknown whether neural control over automatic action tendencies is supramodal or relies on parallel modality-specific neural circuits. Here, we address this largely unexplored issue in humans. We consider neural circuits supporting emotional action control in response to affective vocalizations, using an approach-avoidance task known to reliably index control over emotional action tendencies elicited by emotional faces. We isolate supramodal neural contributions to emotional action control through a conjunction analysis of control-related neural activity evoked by auditory and visual affective stimuli, the latter from a previously published data set obtained in an independent sample. We show that the anterior pFC (aPFC) supports control of automatic action tendencies in a supramodal manner, that is, triggered by either emotional faces or affective vocalizations. When affective vocalizations are heard and emotional control is required, the aPFC supports control through negative functional connectivity with the posterior insula. When emotional faces are seen and emotional control is required, control relies on the same aPFC territory downregulating the amygdala. The findings provide evidence for a novel mechanism of emotional action control with a hybrid hierarchical architecture, relying on a supramodal node (aPFC) implementing an abstract goal by modulating modality-specific nodes (posterior insula, amygdala) involved in signaling motivational significance of either affective vocalizations or faces.

Age-related positivity effect on behavioural responses of dogs to human vocalisations

Age-related changes in the brain can alter how emotions are processed. In humans, valence specific changes in attention and memory were reported with increasing age, i.e. older people are less attentive toward and experience fewer negative emotions, while processing of positive emotions remains intact. Little is yet known about this "positivity effect" in non-human animals. We tested young (n = 21, 1-5 years) and old (n = 19, >10 years) family dogs with positive (laugh), negative (cry), and neutral (hiccup, cough) human vocalisations and investigated age-related differences in their behavioural reactions. Only dogs with intact hearing were analysed and the selected sound samples were balanced regarding mean and fundamental frequencies between valence categories. Compared to young dogs, old individuals reacted slower only to the negative sounds and there was no significant difference in the duration of the reactions between groups. The selective response of the aged dogs to the sound stimuli suggests that the results cannot be explained by general cognitive and/or perceptual decline. and supports the presence of an age-related positivity effect in dogs, too. Similarities in emotional processing between humans and dogs may imply analogous changes in subcortical emotional processing in the canine brain during ageing.

Brain dynamics and connectivity networks under natural auditory stimulation

The analysis of functional magnetic resonance imaging (fMRI) data is challenging when subjects are under exposure to natural sensory stimulation. In this study, a two-stage approach was developed to enable the identification of connectivity networks involved in the processing of information in the brain under natural sensory stimulation. In the first stage, the degree of concordance between the results of inter-subject and intra-subject correlation analyses is assessed statistically. The microstructurally (i.e., cytoarchitectonically) defined brain areas are designated either as concordant in which the results of both correlation analyses are in agreement, or as discordant in which one analysis method shows a higher proportion of supra-threshold voxels than does the other. In the second stage, connectivity networks are identified using the time courses of supra-threshold voxels in brain areas contingent upon the classifications derived in the first stage. In an empirical study, fMRI data were collected from 40 young adults (19 males, average age 22.76 ± 3.25), who underwent auditory stimulation involving sound clips of human voices and animal vocalizations under two operational conditions (i.e., eyes-closed and eyes-open). The operational conditions were designed to assess confounding effects due to auditory instructions or visual perception. The proposed two-stage analysis demonstrated that stress modulation (affective) and language networks in the limbic and cortical structures were respectively engaged during sound stimulation, and presented considerable variability among subjects. The network involved in regulating visuomotor control was sensitive to the eyes-open instruction, and presented only small variations among subjects. A high degree of concordance was observed between the two analyses in the primary auditory cortex which was highly sensitive to the pitch of sound clips. Our results have indicated that brain areas can be identified as concordant or discordant based on the two correlation analyses. This may further facilitate the search for connectivity networks involved in the processing of information under natural sensory stimulation.

Human amygdala response to unisensory and multisensory emotion input: No evidence for superadditivity from intracranial recordings

The amygdala is crucially implicated in processing emotional information from various sensory modalities. However, there is dearth of knowledge concerning the integration and relative time-course of its responses across different channels, i.e., for auditory, visual, and audiovisual input. Functional neuroimaging data in humans point to a possible role of this region in the multimodal integration of emotional signals, but direct evidence for anatomical and temporal overlap of unisensory and multisensory-evoked responses in amygdala is still lacking. We recorded event-related potentials (ERPs) and oscillatory activity from 9 amygdalae using intracranial electroencephalography (iEEG) in patients prior to epilepsy surgery, and compared electrophysiological responses to fearful, happy, or neutral stimuli presented either in voices alone, faces alone, or voices and faces simultaneously delivered. Results showed differential amygdala responses to fearful stimuli, in comparison to neutral, reaching significance 100-200 ms post-onset for auditory, visual and audiovisual stimuli. At later latencies, ∼400 ms post-onset, amygdala response to audiovisual information was also amplified in comparison to auditory or visual stimuli alone. Importantly, however, we found no evidence for either super- or subadditivity effects in any of the bimodal responses. These results suggest, first, that emotion processing in amygdala occurs at globally similar early stages of perceptual processing for auditory, visual, and audiovisual inputs; second, that overall larger responses to multisensory information occur at later stages only; and third, that the underlying mechanisms of this multisensory gain may reflect a purely additive response to concomitant visual and auditory inputs. Our findings provide novel insights on emotion processing across the sensory pathways, and their convergence within the limbic system.

Functional Age-Related Changes Within the Human Auditory System Studied by Audiometric Examination

Age related hearing loss (presbycusis) is one of the most common sensory deficits in the aging population. The main subjective ailment in the elderly is the deterioration of speech understanding, especially in a noisy environment, which cannot solely be explained by increased hearing thresholds. The examination methods used in presbycusis are primarily focused on the peripheral pathologies (e.g., hearing sensitivity measured by hearing thresholds), with only a limited capacity to detect the central lesion. In our study, auditory tests focused on central auditory abilities were used in addition to classical examination tests, with the aim to compare auditory abilities between an elderly group (elderly, mean age 70.4 years) and young controls (young, mean age 24.4 years) with clinically normal auditory thresholds, and to clarify the interactions between peripheral and central auditory impairments. Despite the fact that the elderly were selected to show natural age-related deterioration of hearing (auditory thresholds did not exceed 20 dB HL for main speech frequencies) and with clinically normal speech reception thresholds (SRTs), the detailed examination of their auditory functions revealed deteriorated processing of temporal parameters [gap detection threshold (GDT), interaural time difference (ITD) detection] which was partially responsible for the altered perception of distorted speech (speech in babble noise, gated speech). An analysis of interactions between peripheral and central auditory abilities, showed a stronger influence of peripheral function than temporal processing ability on speech perception in silence in the elderly with normal cognitive function. However, in a more natural environment mimicked by the addition of background noise, the role of temporal processing increased rapidly.

A complementaridade entre sinais PREAUT e IRDI na análise de risco psíquico aos nove meses e sua relação com idade gestacional

RESUMO Objetivo Comparar o nível de concordância estatística entre os Sinais PREAUT e os Indicadores Clínicos de Risco/Referência ao Desenvolvimento Infantil (IRDI) na identificação de risco e analisar a frequência de risco psíquico considerando a variável idade gestacional. Método A amostra total contou com 80 bebês, sendo 55 bebês nascidos a termo e 25 bebês nascidos pré-termo, considerando a idade corrigida. Foram excluídos todos os bebês que apresentaram qualquer espécie de síndrome genética, lesões neurológicas ou déficits sensoriais. O IRDI e os Sinais PREAUT, além de uma entrevista semiestruturada foram utilizados como instrumento de coleta de dados. A análise estatística avaliou o grau de concordância entre os Sinais PREAUT e o IRDI a partir do coeficiente de concordância kappa. Resultados Foi observada uma concordância perfeita na identificação de sujeitos em ambos protocolos aos nove meses, embora essa identificação se dê por sinais fenomênicos distintos. A frequência de risco psíquico em bebês prematuros foi superior (24%) à frequência em bebês nascidos a termo (20%). O risco psíquico foi considerável na amostra estudada aos nove meses (21,25%). Conclusão Houve uma concordância total entre ambos os protocolos na identificação de risco psíquico aos nove meses, cuja frequência foi importante na amostra estudada.

Biased and unbiased perceptual decision-making on vocal emotions

Perceptual decision-making on emotions involves gathering sensory information about the affective state of another person and forming a decision on the likelihood of a particular state. These perceptual decisions can be of varying complexity as determined by different contexts. We used functional magnetic resonance imaging and a region of interest approach to investigate the brain activation and functional connectivity behind two forms of perceptual decision-making. More complex unbiased decisions on affective voices recruited an extended bilateral network consisting of the posterior inferior frontal cortex, the orbitofrontal cortex, the amygdala, and voice-sensitive areas in the auditory cortex. Less complex biased decisions on affective voices distinctly recruited the right mid inferior frontal cortex, pointing to a functional distinction in this region following decisional requirements. Furthermore, task-induced neural connectivity revealed stronger connections between these frontal, auditory, and limbic regions during unbiased relative to biased decision-making on affective voices. Together, the data shows that different types of perceptual decision-making on auditory emotions have distinct patterns of activations and functional coupling that follow the decisional strategies and cognitive mechanisms involved during these perceptual decisions.

Neurocircuitry of impaired affective sound processing: A clinical disorders perspective

Decoding affective meaning from sensory information is central to accurate and adaptive behavior in many natural and social contexts. Human vocalizations (speech and non-speech), environmental sounds (e.g. thunder, noise, or animal sounds) and human-produced sounds (e.g. technical sounds or music) can carry a wealth of important aversive, threatening, appealing, or pleasurable affective information that sometimes implicitly influences and guides our behavior. A deficit in processing such affective information is detrimental to adaptive environmental behavior, psychological well-being, and social interactive abilities. These deficits can originate from a diversity of psychiatric and neurological disorders, and are associated with neural dysfunctions across largely distributed brain networks. Recent neuroimaging studies in psychiatric and neurological patients outline the cortical and subcortical neurocircuitry of the complimentary and differential functional roles for affective sound processing. This points to and confirms a recently proposed distributed network rather than a single brain region underlying affective sound processing, and highlights the notion of a multi-functional process that can be differentially impaired in clinical disorders.

Amygdala structure and core dimensions of the affective personality

While biological models of human personality propose that socio-affective traits and skills are rooted in the structure of the amygdala, empirical evidence remains sparse and inconsistent. Here, we used a comprehensive assessment of the affective personality and tested its association with global, local, and laterality measures of the amygdala structure. Results revealed three broad dimensions of the affective personality that were differentially related to bilateral amygdala structures. Dysfunctional and maladaptive affective traits were associated with a global size and local volume reduction of the amygdala, whereas adaptive emotional skills were linked to an increased size of the left amygdala. Furthermore, reduced asymmetry in the bilateral global amygdala volume was linked to higher affective instability and might be a potential precursor of psychiatric disorders. This study demonstrates that structural amygdala measures provide a neural basis for all major dimensions of the human personality related to adaptive and maladaptive socio-affective functioning.

A comparative neurological approach to emotional expressions in primate vocalizations

Different approaches from different research domains have crystallized debate over primate emotional processing and vocalizations in recent decades. On one side, researchers disagree about whether emotional states or processes in animals truly compare to those in humans. On the other, a long-held assumption is that primate vocalizations are innate communicative signals over which nonhuman primates have limited control and a mirror of the emotional state of the individuals producing them, despite growing evidence of intentional production for some vocalizations. Our goal is to connect both sides of the discussion in deciphering how the emotional content of primate calls compares with emotional vocal signals in humans. We focus particularly on neural bases of primate emotions and vocalizations to identify cerebral structures underlying emotion, vocal production, and comprehension in primates, and discuss whether particular structures or neuronal networks solely evolved for specific functions in the human brain. Finally, we propose a model to classify emotional vocalizations in primates according to four dimensions (learning, control, emotional, meaning) to allow comparing calls across species.

Amygdala and auditory cortex exhibit distinct sensitivity to relevant acoustic features of auditory emotions

Discriminating between auditory signals of different affective value is critical to successful social interaction. It is commonly held that acoustic decoding of such signals occurs in the auditory system, whereas affective decoding occurs in the amygdala. However, given that the amygdala receives direct subcortical projections that bypass the auditory cortex, it is possible that some acoustic decoding occurs in the amygdala as well, when the acoustic features are relevant for affective discrimination. We tested this hypothesis by combining functional neuroimaging with the neurophysiological phenomena of repetition suppression (RS) and repetition enhancement (RE) in human listeners. Our results show that both amygdala and auditory cortex responded differentially to physical voice features, suggesting that the amygdala and auditory cortex decode the affective quality of the voice not only by processing the emotional content from previously processed acoustic features, but also by processing the acoustic features themselves, when these are relevant to the identification of the voice's affective value. Specifically, we found that the auditory cortex is sensitive to spectral high-frequency voice cues when discriminating vocal anger from vocal fear and joy, whereas the amygdala is sensitive to vocal pitch when discriminating between negative vocal emotions (i.e., anger and fear). Vocal pitch is an instantaneously recognized voice feature, which is potentially transferred to the amygdala by direct subcortical projections. These results together provide evidence that, besides the auditory cortex, the amygdala too processes acoustic information, when this is relevant to the discrimination of auditory emotions.

The sound of emotions-Towards a unifying neural network perspective of affective sound processing

Affective sounds are an integral part of the natural and social environment that shape and influence behavior across a multitude of species. In human primates, these affective sounds span a repertoire of environmental and human sounds when we vocalize or produce music. In terms of neural processing, cortical and subcortical brain areas constitute a distributed network that supports our listening experience to these affective sounds. Taking an exhaustive cross-domain view, we accordingly suggest a common neural network that facilitates the decoding of the emotional meaning from a wide source of sounds rather than a traditional view that postulates distinct neural systems for specific affective sound types. This new integrative neural network view unifies the decoding of affective valence in sounds, and ascribes differential as well as complementary functional roles to specific nodes within a common neural network. It also highlights the importance of an extended brain network beyond the central limbic and auditory brain systems engaged in the processing of affective sounds.