Functional neuroanatomy of non-verbal semantic sound processing in humans

Brain functional connectivity patterns associated with symptoms of vestibular migraine

Background

Several functional magnetic resonance imaging (fMRI) investigations of patients with vestibular migraine (VM) have revealed abnormal functionality in different networks, indicating that VM is related to alterations in brain function. We sought to investigate the resting-state functional connectivity (FC) patterns during the interictal period in VM by combining data-driven voxel-wise degree centrality (DC) calculations and seed-based FC analyses, and thereby determine the associations between cerebral function and clinical symptoms.

Methods

Thirty-eight patients with VM and 33 matched normal controls were recruited. DC was calculated and compared between the groups, and the FC of locations showing DC alterations was further tested using a seed-based technique. The participants' clinical indicators were correlated with the DC and FC values of the brain areas.

Results

In contrast to the control group, the VM group showed considerably lower DC values in the bilateral medial prefrontal cortex (mPFC) and significantly higher DC values in the right occipital lobe. In the seed-based FC analyses, patients with VM demonstrated fewer connections of the bilateral mPFC with the bilateral posterior cingulate cortex, right parahippocampus, right cerebellar posterior lobe, bilateral cuneus, and left precuneus. In addition, clinical data from patients, such as pain intensity, episode frequency, and the Dizziness Handicap Inventory score, were negatively related to these FC and DC impairments.

Conclusion

Our findings showed changes in the default mode network and visual cortex in patients with VM, providing further insights into the complexity of the mechanisms underlying VM.

A systematic review and meta-analysis of voxel-based morphometric studies of migraine

OBJECTIVES

To comprehensively summarize and meta-analyze the concurrence across voxel-based morphometric (VBM) neuroimaging studies of migraine.

METHODS

Neuroimaging studies published from origin to August 1, 2021 were searched in six databases including PubMed, Web of Science, Excerpta Medica Database (EMBASE), China National Knowledge Infrastructure (CNKI), Wanfang Database, and Chongqing VIP. Study selection, quality assessment, and data extraction were conducted by two independent researchers. Anisotropic effect size-signed differential mapping (AES-SDM) and activation likelihood estimation (ALE) were used to perform the meta-analysis of available studies reporting whole-brain gray matter (GM) structural data in migraine patients. Clinical variables correlation analysis and migraine subgroup analysis were also conducted.

RESULTS

40 articles were included after the strict screening, containing 1616 migraine patients and 1681 matched healthy subjects (HS) in total. Using the method of AES-SDM, migraine patients showed GM increase in the bilateral amygdala, the bilateral parahippocampus, the bilateral temporal poles, the bilateral superior temporal gyri, the left hippocampus, the right superior frontal gyrus, and the left middle temporal gyrus, as well as GM decrease in the left insula, the bilateral cerebellum (hemispheric lobule IX), the right dorsal medulla, the bilateral rolandic operculum, the right middle frontal gyrus, and the right inferior parietal gyrus. Using the method of ALE, migraine patients showed GM increase in the left parahippocampus and GM decrease in the left insula. The results of correlation analysis showed that many of these brain regions were associated with migraine headache frequency and migraine disease duration. Migraine patients in different subtypes (such as migraine without aura (MwoA), migraine with aura (MwA), episodic migraine (EM), chronic migraine (CM), vestibular migraine (VM), etc.), and in different periods (in the ictal and interictal periods) presented not entirely consistent GM alterations.

CONCLUSION

Migraine patients have GM alterations in multiple brain regions associated with sensation, affection, cognition, and descending modulation aspects of pain. These changes might be a consequence of repeated migraine attacks. Further studies are required to determine how these GM changes can be used to diagnose, monitor disease progression, or exploit potential therapeutic interventions for migraine patients.

Case Report: Semantic Variant Primary Progressive Aphasia With Impaired Verbal Word Discrimination

Some patients with primary progressive aphasia (PPA) present with various types of hearing deficits. Research on the auditory function and speech sounds in PPA, including temporal, phonemic, and prosodic processing, revealed impairment in some of these auditory processes. Many patients with PPA who present with impaired word recognition subsequently developed non-fluent variant PPA. Herein, we present a patient with semantic variant PPA (svPPA) who demonstrated impaired verbal word discrimination. Audiological examinations revealed normal auditory brainstem responses and slightly impaired pure-tone perception. By contrast, verbal word discrimination and monosyllable identification were impaired, and temporal auditory acuity deteriorated. Analyses of brain magnetic resonance images revealed a significant decrease in the gray matter volume in bilateral superior temporal areas, predominantly on the left, compared with those of patients with typical svPPA, which appeared to be associated with impaired word recognition in our patient.

Cytoarchitectonic parcellation and functional characterization of four new areas in the caudal parahippocampal cortex

Brain areas at the parahippocampal gyrus of the temporal–occipital transition region are involved in different functions including processing visual–spatial information and episodic memory. Results of neuroimaging experiments have revealed a differentiated functional parcellation of this region, but its microstructural correlates are less well understood. Here we provide probability maps of four new cytoarchitectonic areas, Ph1, Ph2, Ph3 and CoS1 at the parahippocampal gyrus and collateral sulcus. Areas have been identified based on an observer-independent mapping of serial, cell-body stained histological sections of ten human postmortem brains. They have been registered to two standard reference spaces, and superimposed to capture intersubject variability. The comparison of the maps with functional imaging data illustrates the different involvement of the new areas in a variety of functions. Maps are available as part of Julich-Brain atlas and can be used as anatomical references for future studies to better understand relationships between structure and function of the caudal parahippocampal cortex.

Hearing and orally mimicking different acoustic-semantic categories of natural sound engage distinct left hemisphere cortical regions

Oral mimicry is thought to represent an essential process for the neurodevelopment of spoken language systems in infants, the evolution of language in hominins, and a process that could possibly aid recovery in stroke patients. Using functional magnetic resonance imaging (fMRI), we previously reported a divergence of auditory cortical pathways mediating perception of specific categories of natural sounds. However, it remained unclear if or how this fundamental sensory organization by the brain might relate to motor output, such as sound mimicry. Here, using fMRI, we revealed a dissociation of activated brain regions preferential for hearing with the intent to imitate and the oral mimicry of animal action sounds versus animal vocalizations as distinct acoustic-semantic categories. This functional dissociation may reflect components of a rudimentary cortical architecture that links systems for processing acoustic-semantic universals of natural sound with motor-related systems mediating oral mimicry at a category level. The observation of different brain regions involved in different aspects of oral mimicry may inform targeted therapies for rehabilitation of functional abilities after stroke.

Divergent Human Cortical Regions for Processing Distinct Acoustic-Semantic Categories of Natural Sounds: Animal Action Sounds vs. Vocalizations

A major gap in our understanding of natural sound processing is knowledge of where or how in a cortical hierarchy differential processing leads to categorical perception at a semantic level. Here, using functional magnetic resonance imaging (fMRI) we sought to determine if and where cortical pathways in humans might diverge for processing action sounds vs. vocalizations as distinct acoustic-semantic categories of real-world sound when matched for duration and intensity. This was tested by using relatively less semantically complex natural sounds produced by non-conspecific animals rather than humans. Our results revealed a striking double-dissociation of activated networks bilaterally. This included a previously well described pathway preferential for processing vocalization signals directed laterally from functionally defined primary auditory cortices to the anterior superior temporal gyri, and a less well-described pathway preferential for processing animal action sounds directed medially to the posterior insulae. We additionally found that some of these regions and associated cortical networks showed parametric sensitivity to high-order quantifiable acoustic signal attributes and/or to perceptual features of the natural stimuli, such as the degree of perceived recognition or intentional understanding. Overall, these results supported a neurobiological theoretical framework for how the mammalian brain may be fundamentally organized to process acoustically and acoustic-semantically distinct categories of ethologically valid, real-world sounds.

Language universals engage Broca's area

It is well known that natural languages share certain aspects of their design. For example, across languages, syllables like blif are preferred to lbif. But whether language universals are myths or mentally active constraints—linguistic or otherwise—remains controversial. To address this question, we used fMRI to investigate brain response to four syllable types, arrayed on their linguistic well-formedness (e.g., blif≻bnif≻bdif≻lbif, where ≻ indicates preference). Results showed that syllable structure monotonically modulated hemodynamic response in Broca's area, and its pattern mirrored participants' behavioral preferences. In contrast, ill-formed syllables did not systematically tax sensorimotor regions—while such syllables engaged primary auditory cortex, they tended to deactivate (rather than engage) articulatory motor regions. The convergence between the cross-linguistic preferences and English participants' hemodynamic and behavioral responses is remarkable given that most of these syllables are unattested in their language. We conclude that human brains encode broad restrictions on syllable structure.

The role of the parahippocampal cortex in cognition

The parahippocampal cortex (PHC) has been associated with many cognitive processes, including visuospatial processing and episodic memory. To characterize the role of PHC in cognition, a framework is required that unifies these disparate processes. An overarching account was proposed whereby the PHC is part of a network of brain regions that processes contextual associations. Contextual associations are the principal element underlying many higher-level cognitive processes, and thus are suitable for unifying the PHC literature. Recent findings are reviewed that provide support for the contextual associations account of PHC function. In addition to reconciling a vast breadth of literature, the synthesis presented expands the implications of the proposed account and gives rise to new and general questions about context and cognition.

Role of the left amygdala and right orbital frontal cortex in emotional interference resolution facilitation in working memory

Previous research has shown that emotional information aids conflict resolution in working memory (Levens & Phelps, 2008). Using a Recency-probes working memory (WM) paradigm, Levens and Phelps found that positive and negative emotional stimuli reduced the amount of interference created when information that was once relevant conflicted with currently relevant information, suggesting that emotional information facilitates interference resolution in WM. To determine what regions of the prefrontal cortex (PFC) and temporal lobes are critical to the influence of emotional stimuli on interference resolution, we conducted a Recency-probes emotion paradigm with right and left unilateral frontal and temporal lobe lesion patients. The frontal lobe lesion patient group comprised individuals with unilateral ventral and dorsal PFC lesions. The temporal lobe lesion patient group comprised individuals with lesions of the amygdala and surrounding structures. Results indicate that when the left amygdala is damaged, emotional facilitation of interference resolution is absent (equal emotional and neutral interference levels), when the right orbital frontal cortex (OFC) is damaged, in contrast, emotional interference resolution is impaired (emotional interference levels are higher than neutral levels are). Based on these unique patterns we propose specific contributions for these regions in the emotional facilitation of interference resolution in WM.

Cortical organization of environmental sounds by attribute

Semantic knowledge is supported by a widely distributed neuronal network, with differential patterns of activation depending upon experimental stimulus or task demands. Despite a wide body of knowledge on semantic object processing from the visual modality, the response of this semantic network to environmental sounds remains relatively unknown. Here, we used fMRI to investigate how access to different conceptual attributes from environmental sound input modulates this semantic network. Using a range of living and manmade sounds, we scanned participants whilst they carried out an object attribute verification task. Specifically, we tested visual perceptual, encyclopedic, and categorical attributes about living and manmade objects relative to a high-level auditory perceptual baseline to investigate the differential patterns of response to these contrasting types of object-related attributes, whilst keeping stimulus input constant across conditions. Within the bilateral distributed network engaged for processing environmental sounds across all conditions, we report here a highly significant dissociation within the left hemisphere between the processing of visual perceptual and encyclopedic attributes of objects.

Stimulus complexity and categorical effects in human auditory cortex: an activation likelihood estimation meta-analysis

Investigations of the functional organization of human auditory cortex typically examine responses to different sound categories. An alternative approach is to characterize sounds with respect to their amount of variation in the time and frequency domains (i.e., spectral and temporal complexity). Although the vast majority of published studies examine contrasts between discrete sound categories, an alternative complexity-based taxonomy can be evaluated through meta-analysis. In a quantitative meta-analysis of 58 auditory neuroimaging studies, we examined the evidence supporting current models of functional specialization for auditory processing using grouping criteria based on either categories or spectro-temporal complexity. Consistent with current models, analyses based on typical sound categories revealed hierarchical auditory organization and left-lateralized responses to speech sounds, with high speech sensitivity in the left anterior superior temporal cortex. Classification of contrasts based on spectro-temporal complexity, on the other hand, revealed a striking within-hemisphere dissociation in which caudo-lateral temporal regions in auditory cortex showed greater sensitivity to spectral changes, while anterior superior temporal cortical areas were more sensitive to temporal variation, consistent with recent findings in animal models. The meta-analysis thus suggests that spectro-temporal acoustic complexity represents a useful alternative taxonomy to investigate the functional organization of human auditory cortex.

Insula and orbital frontal cortex activity underlying emotion interference resolution in working memory

Previous research has shown that emotional information aids conflict resolution in working memory [WM; Levens, S. M., & Phelps, E. A. Emotion processing effects on interference resolution in working memory. Journal of Emotion, 8, 267-280, 2008]. Using a recency-probes WM paradigm, it was found that positive and negative emotional stimuli reduced the amount of interference created when information that was once relevant conflicted with currently relevant information. To explore the neural mechanisms behind these facilitation effects, an event-related fMRI version of the recency-probes task was conducted using neutral and arousing positive and negative words as stimuli. Results replicate previous findings showing that the left and right inferior frontal gyrus (IFG) is involved in the interference resolution of neutral information and reveal that the IFG is involved in the interference resolution of emotional information as well. In addition, ROIs in the right and left anterior insula and in the right orbital frontal cortex (OFC) were identified that appear to underlie emotional interference resolution in WM. We conclude that the IFG underlies neutral and emotional interference resolution, and that additional regions of the anterior insula and OFC may contribute to the facilitation of interference resolution for emotional information. These findings clarify the role of the insula and OFC in affective and executive processing, specifically in WM conflict resolution.

Cortical networks representing object categories and high-level attributes of familiar real-world action sounds

In contrast to visual object processing, relatively little is known about how the human brain processes everyday real-world sounds, transforming highly complex acoustic signals into representations of meaningful events or auditory objects. We recently reported a fourfold cortical dissociation for representing action (nonvocalization) sounds correctly categorized as having been produced by human, animal, mechanical, or environmental sources. However, it was unclear how consistent those network representations were across individuals, given potential differences between each participant's degree of familiarity with the studied sounds. Moreover, it was unclear what, if any, auditory perceptual attributes might further distinguish the four conceptual sound-source categories, potentially revealing what might drive the cortical network organization for representing acoustic knowledge. Here, we used functional magnetic resonance imaging to test participants before and after extensive listening experience with action sounds, and tested for cortices that might be sensitive to each of three different high-level perceptual attributes relating to how a listener associates or interacts with the sound source. These included the sound's perceived concreteness, effectuality (ability to be affected by the listener), and spatial scale. Despite some variation of networks for environmental sounds, our results verified the stability of a fourfold dissociation of category-specific networks for real-world action sounds both before and after familiarity training. Additionally, we identified cortical regions parametrically modulated by each of the three high-level perceptual sound attributes. We propose that these attributes contribute to the network-level encoding of category-specific acoustic knowledge representations.

Hearing living symbols and nonliving icons: category specificities in the cognitive processing of environmental sounds

The neurocognitive processing of environmental sounds and linguistic stimuli shares common semantic resources and can lead to the activation of motor programs for the generation of the passively heard sound or speech. We investigated the extent to which the cognition of environmental sounds, like that of language, relies on symbolic mental representations independent of the acoustic input. In a hierarchical sorting task, we found that evaluation of nonliving sounds is consistently biased toward a focus on acoustical information. However, the evaluation of living sounds focuses spontaneously on sound-independent semantic information, but can rely on acoustical information after exposure to a context consisting of nonliving sounds. We interpret these results as support for a robust iconic processing strategy for nonliving sounds and a flexible symbolic processing strategy for living sounds.

Non-verbal sound processing in the primary progressive aphasias

Little is known about the processing of non-verbal sounds in the primary progressive aphasias. Here, we investigated the processing of complex non-verbal sounds in detail, in a consecutive series of 20 patients with primary progressive aphasia [12 with progressive non-fluent aphasia; eight with semantic dementia]. We designed a novel experimental neuropsychological battery to probe complex sound processing at early perceptual, apperceptive and semantic levels, using within-modality response procedures that minimized other cognitive demands and matching tests in the visual modality. Patients with primary progressive aphasia had deficits of non-verbal sound analysis compared with healthy age-matched individuals. Deficits of auditory early perceptual analysis were more common in progressive non-fluent aphasia, deficits of apperceptive processing occurred in both progressive non-fluent aphasia and semantic dementia, and deficits of semantic processing also occurred in both syndromes, but were relatively modality specific in progressive non-fluent aphasia and part of a more severe generic semantic deficit in semantic dementia. Patients with progressive non-fluent aphasia were more likely to show severe auditory than visual deficits as compared to patients with semantic dementia. These findings argue for the existence of core disorders of complex non-verbal sound perception and recognition in primary progressive aphasia and specific disorders at perceptual and semantic levels of cortical auditory processing in progressive non-fluent aphasia and semantic dementia, respectively.

Different categories of living and non-living sound-sources activate distinct cortical networks

With regard to hearing perception, it remains unclear as to whether, or the extent to which, different conceptual categories of real-world sounds and related categorical knowledge are differentially represented in the brain. Semantic knowledge representations are reported to include the major divisions of living versus non-living things, plus more specific categories including animals, tools, biological motion, faces, and places-categories typically defined by their characteristic visual features. Here, we used functional magnetic resonance imaging (fMRI) to identify brain regions showing preferential activity to four categories of action sounds, which included non-vocal human and animal actions (living), plus mechanical and environmental sound-producing actions (non-living). The results showed a striking antero-posterior division in cortical representations for sounds produced by living versus non-living sources. Additionally, there were several significant differences by category, depending on whether the task was category-specific (e.g. human or not) versus non-specific (detect end-of-sound). In general, (1) human-produced sounds yielded robust activation in the bilateral posterior superior temporal sulci independent of task. Task demands modulated activation of left lateralized fronto-parietal regions, bilateral insular cortices, and sub-cortical regions previously implicated in observation-execution matching, consistent with "embodied" and mirror-neuron network representations subserving recognition. (2) Animal action sounds preferentially activated the bilateral posterior insulae. (3) Mechanical sounds activated the anterior superior temporal gyri and parahippocampal cortices. (4) Environmental sounds preferentially activated dorsal occipital and medial parietal cortices. Overall, this multi-level dissociation of networks for preferentially representing distinct sound-source categories provides novel support for grounded cognition models that may underlie organizational principles for hearing perception.

Crinkling and crumpling: an auditory fMRI study of material properties

Knowledge of an object's material composition (i.e., what it is made of) alters how we interact with that object. Seeing the bright glint or hearing the metallic crinkle of a foil plate for example, confers information about that object before we have even touched it. Recent research indicates that the medial aspect of the ventral visual pathway is sensitive to the surface properties of objects. In the present functional magnetic resonance imaging (fMRI) study, we investigated whether the ventral pathway is also sensitive to material properties derived from sound alone. Relative to scrambled material sounds and non-verbal human vocalizations, audio recordings of materials being manipulated (i.e., crumpled) in someone's hands elicited greater BOLD activity in the right parahippocampal cortex of neurologically intact listeners, as well as a cortically blind participant. Additional left inferior parietal lobe activity was also observed in the neurologically intact group. Taken together, these results support a ventro-medial pathway that is specialized for processing the material properties of objects, and suggest that there are sub-regions within this pathway that subserve the processing of acoustically-derived information about material composition.

Probing category selectivity for environmental sounds in the human auditory brain

Earlier studies reported evidence suggesting distinct category-related auditory representations for environmental sounds such as animal vocalizations and tool sounds in superior and middle temporal regions of the temporal lobe. However, the degree of selectivity of these representations remains to be determined. The present study combined functional magnetic resonance imaging (fMRI) adaptation with a silent acquisition protocol to further investigate category-related auditory processing of environmental sounds. To this end, we consecutively presented pairs of sounds taken from the categories 'tool sounds' or 'animal vocalizations' with either the same or different identity/category. We examined the degree of selectivity as evidenced by adaptation effects to both or only one sound category in the course of whole-brain as well as functionally and anatomically constrained region of interest analyses. While most regions predominately in the temporal cortex showed an adaptation to both sound categories, particularly the left superior temporal gyrus (STG) and the left posterior middle temporal gyrus (pMTG) selectively adapted to animal vocalizations and tool sounds, respectively. However, the activation profiles of these regions differed with respect to the general responsiveness to sounds. While tool sounds still produced fMRI signals significantly different from fixation baseline in the STG, this was not the case for animal vocalizations in pMTG. Consistent with the interpretation of STG as an intermediate auditory processing stage, this region might differentiate auditory stimuli into categories based on variations of physical stimulus properties. However, processing in left pMTG seems to be even more restricted to action-related sounds of man-made objects.

The superior temporal sulcus performs a common function for social and speech perception: implications for the emergence of autism

Within the cognitive neuroscience literature, discussion of the functional role of the superior temporal sulcus (STS) has traditionally been divided into two domains; one focuses on its activity during language processing while the other emphasizes its role in biological motion and social attention, such as eye gaze processing. I will argue that a common process underlying both of these functional domains is performed by the STS, namely analyzing changing sequences of input, either in the auditory or visual domain, and interpreting the communicative significance of those inputs. From a developmental perspective, the fact that these two domains share an anatomical substrate suggests the acquisition of social and speech perception may be linked. In addition, I will argue that because of the STS' role in interpreting social and speech input, impairments in STS function may underlie many of the social and language abnormalities seen in autism.