Neuroanatomic Organization of Sound Memory in Humans

The neural basis of complex audiovisual objects maintenances in working memory

Working memory research has primarily concentrated on studying our senses separately; the neural basis of maintaining information from multiple sensory modalities in working memory has been not well elucidated. It is debated whether multisensory information is maintained in the form of modality-specific representations or amodal representations. The present study investigated what brain regions were engaged in both types of complex audiovisual objects maintenances (semantically congruent and incongruent) using functional magnetic resonance imaging and conjunction analysis, and examined in which form to maintain multisensory objects information in working memory. The conjunction analysis showed that there was common brain regions activation involving left parietal cortex (e.g., left angular gyrus, supramarginal gyrus, and precuneus) while maintaining semantically congruent audiovisual object, whereas the common brain regions activation including the bilateral angular, left superior parietal lobule, and left middle temporal gyrus was found during maintaining semantically incongruent audiovisual objects. Importantly, the shared conjoint brain regions activation consists of bilateral angular gyrus and left middle frontal gyrus was observed while maintaining both types of semantically congruent and incongruent complex audiovisual objects. These brain regions may play different role while maintaining these complex multisensory objects, such as supramodel storage per se and intentional attention. The findings of the present studymight support the amodal view that working memory has a central storage system to maintain multisensory information from different sensory inputs.

The Artery of Aphasia, A Uniquely Sensitive Posterior Temporal Middle Cerebral Artery Branch that Supplies Language Areas in the Brain: Anatomy and Report of Four Cases

BACKGROUND

Arterial disruption during brain surgery can cause devastating injuries to wide expanses of white and gray matter beyond the tumor resection cavity. Such damage may occur as a result of disrupting blood flow through en passage arteries. Identification of these arteries is critical to prevent unforeseen neurologic sequelae during brain tumor resection. In this study, we discuss one such artery, termed the artery of aphasia (AoA), which when disrupted can lead to receptive and expressive language deficits.

METHODS

We performed a retrospective review of all patients undergoing an awake craniotomy for resection of a glioma by the senior author from 2012 to 2018. Patients were included if they experienced language deficits secondary to postoperative infarction in the left posterior temporal lobe in the distribution of the AoA. The gross anatomy of the AoA was then compared with activation likelihood estimations of the auditory and semantic language networks using coordinate-based meta-analytic techniques.

RESULTS

We identified 4 patients with left-sided posterior temporal artery infarctions in the distribution of the AoA on diffusion-weighted magnetic resonance imaging. All 4 patients developed substantial expressive and receptive language deficits after surgery. Functional language improvement occurred in only 2/4 patients. Activation likelihood estimations localized parts of the auditory and semantic language networks in the distribution of the AoA.

CONCLUSIONS

The AoA is prone to blood flow disruption despite benign manipulation. Patients seem to have limited capacity for speech recovery after intraoperative ischemia in the distribution of this artery, which supplies parts of the auditory and semantic language networks.

Faster phonological processing and right occipito-temporal coupling in deaf adults signal poor cochlear implant outcome

The outcome of adult cochlear implantation is predicted positively by the involvement of visual cortex in speech processing, and negatively by the cross-modal recruitment of the right temporal cortex during and after deafness. How these two neurofunctional predictors concur to modulate cochlear implant (CI) performance remains unclear. In this fMRI study, we explore the joint involvement of occipital and right hemisphere regions in a visual-based phonological task in post-lingual deafness. Intriguingly, we show that some deaf subjects perform faster than controls. This behavioural effect is associated with reorganized connectivity across bilateral visual, right temporal and left inferior frontal cortices, but with poor CI outcome. Conversely, preserved normal-range reaction times are associated with left-lateralized phonological processing and good CI outcome. These results suggest that following deafness, involvement of visual cortex in the context of reorganized right-lateralized phonological processing compromises its availability for audio-visual synergy during adaptation to CI.

Cochlear implants have variable outcomes for adult deafness. Here the authors show that fast responses and specific recruitment of right temporal cortex on a simple visual rhyming task strongly predicts poor implant performance.

Identifying environmental sounds: a multimodal mapping study

Our environment is full of auditory events such as warnings or hazards, and their correct recognition is essential. We explored environmental sounds (ES) recognition in a series of studies. In study 1 we performed an Activation Likelihood Estimation (ALE) meta-analysis of neuroimaging experiments addressing ES processing to delineate the network of areas consistently involved in ES processing. Areas consistently activated in the ALE meta-analysis were the STG/MTG, insula/rolandic operculum, parahippocampal gyrus and inferior frontal gyrus bilaterally. Some of these areas truly reflect ES processing, whereas others are related to design choices, e.g., type of task, type of control condition, type of stimulus. In study 2 we report on 7 neurosurgical patients with lesions involving the areas which were found to be activated by the ALE meta-analysis. We tested their ES recognition abilities and found an impairment of ES recognition. These results indicate that deficits of ES recognition do not exclusively reflect lesions to the right or to the left hemisphere but both hemispheres are involved. The most frequently lesioned area is the hippocampus/insula/STG. We made sure that any impairment in ES recognition would not be related to language problems, but reflect impaired ES processing. In study 3 we carried out an fMRI study on patients (vs. healthy controls) to investigate how the areas involved in ES might be functionally deregulated because of a lesion. The fMRI evidenced that controls activated the right IFG, the STG bilaterally and the left insula. We applied a multimodal mapping approach and found that, although the meta-analysis showed that part of the left and right STG/MTG activation during ES processing might in part be related to design choices, this area was one of the most frequently lesioned areas in our patients, thus highlighting its causal role in ES processing. We found that the ROIs we drew on the two clusters of activation found in the left and in the right STG overlapped with the lesions of at least 4 out of the 7 patients' lesions, indicating that the lack of STG activation found for patients is related to brain damage and is crucial for explaining the ES deficit.

Multivariate sensitivity to voice during auditory categorization

Past neuroimaging studies have documented discrete regions of human temporal cortex that are more strongly activated by conspecific voice sounds than by nonvoice sounds. However, the mechanisms underlying this voice sensitivity remain unclear. In the present functional MRI study, we took a novel approach to examining voice sensitivity, in which we applied a signal detection paradigm to the assessment of multivariate pattern classification among several living and nonliving categories of auditory stimuli. Within this framework, voice sensitivity can be interpreted as a distinct neural representation of brain activity that correctly distinguishes human vocalizations from other auditory object categories. Across a series of auditory categorization tests, we found that bilateral superior and middle temporal cortex consistently exhibited robust sensitivity to human vocal sounds. Although the strongest categorization was in distinguishing human voice from other categories, subsets of these regions were also able to distinguish reliably between nonhuman categories, suggesting a general role in auditory object categorization. Our findings complement the current evidence of cortical sensitivity to human vocal sounds by revealing that the greatest sensitivity during categorization tasks is devoted to distinguishing voice from nonvoice categories within human temporal cortex.

Neural mechanism of proposer's decision-making in the ultimatum and dictator games

Previous studies have demonstrated that reactions to unfair offers in the ultimatum game are correlated with negative emotion. However, little is known about the difference in neural activity between a proposer's decision-making in the ultimatum game compared with the dictator game. The present functional magnetic resonance imaging study revealed that proposing fair offers in the dictator game elicited greater activation in the right supramarginal gyrus, right medial frontal gyrus and left anterior cingulate cortex compared with proposing fair offers in the ultimatum game in 23 Chinese undergraduate and graduate students from Beijing Normal University in China. However, greater activation was found in the right superior temporal gyrus and left cingulate gyrus for the reverse contrast. The results indicate that proposing fair offers in the dictator game is more strongly associated with cognitive control and conflicting information processing compared with proposing fair offers in the ultimatum game.

Age-related changes in feature-based object memory retrieval as measured by event-related potentials

To investigate neural mechanisms that support semantic functions in aging, we recorded scalp EEG during an object retrieval task in 22 younger and 22 older adults. The task required determining if a particular object could be retrieved when two visual words representing object features were presented. Both age groups had comparable accuracy although response times were longer in older adults. In both groups a left fronto-temporal negative potential occurred at around 750ms during object retrieval, consistent with previous findings (Brier, Maguire, Tillman, Hart, & Kraut, 2008). In only older adults, a later positive frontal potential was found peaking between 800 and 1000ms during no retrieval. These findings suggest younger and older adults employ comparable neural mechanisms when features clearly facilitate retrieval of an object memory, but when features yield no retrieval, older adults use additional neural resources to engage in a more effortful and exhaustive search prior to making a decision.

Thalamic mechanisms in language: a reconsideration based on recent findings and concepts

Recent literature on thalamic aphasia and thalamic activity during neuroimaging is selectively reviewed followed by a consideration of recent anatomic and physiological findings regarding thalamic structure and functions. It is concluded that four related corticothalamic and/or thalamocortical mechanisms impact language processing: (1) selective engagement of task-relevant cortical areas in a heightened state of responsiveness in part through the nucleus reticularis (NR), (2) passing information from one cortical area to another through corticothalamo-cortical mechanisms, (3) sharpening the focus on task-relevant information through corticothalamo-cortical feedback mechanisms, and (4) selection of one language unit over another in the expression of a concept, accomplished in concert with basal ganglia loops. The relationship and interaction of these mechanisms is discussed and integrated with thalamic aphasia and neuroimaging data into a theory of thalamic functions in language.

Semantic memory retrieval circuit: role of pre-SMA, caudate, and thalamus

We propose that pre-supplementary motor area (pre-SMA)-thalamic interactions govern processes fundamental to semantic retrieval of an integrated object memory. At the onset of semantic retrieval, pre-SMA initiates electrical interactions between multiple cortical regions associated with semantic memory subsystems encodings as indexed by an increase in theta-band EEG power. This starts between 100-150 ms after stimulus presentation and is sustained throughout the task. We posit that this activity represents initiation of the object memory search, which continues in searching for an object memory. When the correct memory is retrieved, there is a high beta-band EEG power increase, which reflects communication between pre-SMA and thalamus, designates the end of the search process and resultant in object retrieval from multiple semantic memory subsystems. This high beta signal is also detected in cortical regions. This circuit is modulated by the caudate nuclei to facilitate correct and suppress incorrect target memories.

Abstract encoding of auditory objects in cortical activity patterns

The human brain is thought to process auditory objects along a hierarchical temporal "what" stream that progressively abstracts object information from the low-level structure (e.g., loudness) as processing proceeds along the middle-to-anterior direction. Empirical demonstrations of abstract object encoding, independent of low-level structure, have relied on speech stimuli, and non-speech studies of object-category encoding (e.g., human vocalizations) often lack a systematic assessment of low-level information (e.g., vocalizations are highly harmonic). It is currently unknown whether abstract encoding constitutes a general functional principle that operates for auditory objects other than speech. We combined multivariate analyses of functional imaging data with an accurate analysis of the low-level acoustical information to examine the abstract encoding of non-speech categories. We observed abstract encoding of the living and human-action sound categories in the fine-grained spatial distribution of activity in the middle-to-posterior temporal cortex (e.g., planum temporale). Abstract encoding of auditory objects appears to extend to non-speech biological sounds and to operate in regions other than the anterior temporal lobe. Neural processes for the abstract encoding of auditory objects might have facilitated the emergence of speech categories in our ancestors.

Threat as a feature in visual semantic object memory

Threatening stimuli have been found to modulate visual processes related to perception and attention. The present functional magnetic resonance imaging (fMRI) study investigated whether threat modulates visual object recognition of man-made and naturally occurring categories of stimuli. Compared with nonthreatening pictures, threatening pictures of real items elicited larger fMRI BOLD signal changes in medial visual cortices extending inferiorly into the temporo-occipital (TO) "what" pathways. This region elicited greater signal changes for threatening items compared to nonthreatening from both the natural-occurring and man-made stimulus supraordinate categories, demonstrating a featural component to these visual processing areas. Two additional loci of signal changes within more lateral inferior TO areas (bilateral BA18 and 19 as well as the right ventral temporal lobe) were detected for a category-feature interaction, with stronger responses to man-made (category) threatening (feature) stimuli than to natural threats. The findings are discussed in terms of visual recognition of processing efficiently or rapidly groups of items that confer an advantage for survival.

Bilateral reorganization of posterior temporal cortices in post-lingual deafness and its relation to cochlear implant outcome

Post-lingual deafness induces a decline in the ability to process phonological sounds or evoke phonological representations. This decline is paralleled with abnormally high neural activity in the right posterior superior temporal gyrus/supramarginal gyrus (PSTG/SMG). As this neural plasticity negatively relates to cochlear implantation (CI) success, it appears important to understand its determinants. We addressed the neuro-functional mechanisms underlying this maladaptive phenomenon using behavioral and functional magnetic resonance imaging (fMRI) data acquired in 10 normal-hearing subjects and 10 post-lingual deaf candidates for CI. We compared two memory tasks where subjects had to evoke phonological (speech) and environmental sound representations from visually presented items. We observed dissociations in the dynamics of right versus left PSTG/SMG neural responses as a function of duration of deafness. Responses in the left PSTG/SMG to phonological processing and responses in the right PSTG/SMG to environmental sound imagery both declined. However, abnormally high neural activity was observed in response to phonological visual items in the right PSTG/SMG, i.e., contralateral to the zone where phonological activity decreased. In contrast, no such responses (overactivation) were observed in the left PSTG/SMG in response to environmental sounds. This asymmetry in functional adaptation to deafness suggests that maladaptive reorganization of the right PSTG/SMG region is not due to balanced hemispheric interaction, but to a specific take-over of the right PSTG/SMG region by phonological processing, presumably because speech remains behaviorally more relevant to communication than the processing of environmental sounds. These results demonstrate that cognitive long-term alteration of auditory processing shapes functional cerebral reorganization.

Cortical organization of environmental sounds by attribute

Semantic knowledge is supported by a widely distributed neuronal network, with differential patterns of activation depending upon experimental stimulus or task demands. Despite a wide body of knowledge on semantic object processing from the visual modality, the response of this semantic network to environmental sounds remains relatively unknown. Here, we used fMRI to investigate how access to different conceptual attributes from environmental sound input modulates this semantic network. Using a range of living and manmade sounds, we scanned participants whilst they carried out an object attribute verification task. Specifically, we tested visual perceptual, encyclopedic, and categorical attributes about living and manmade objects relative to a high-level auditory perceptual baseline to investigate the differential patterns of response to these contrasting types of object-related attributes, whilst keeping stimulus input constant across conditions. Within the bilateral distributed network engaged for processing environmental sounds across all conditions, we report here a highly significant dissociation within the left hemisphere between the processing of visual perceptual and encyclopedic attributes of objects.

Altered auditory processing in patients with panic disorder: a pilot study

OBJECTIVES

Clinical and electrophysiological studies suggest that panic disorder (PD) patients show disturbed response inhibition to sensory stimuli. Thus, habituation of neuronal activation after repeated sine tone stimulation was assessed by functional magnetic resonance imaging (fMRI) in patients with PD.

METHODS

Twenty patients with PD and 20 age- and gender-matched healthy controls were assessed by 3T fMRI for auditory habituation. During three stimulation cycles of digitally generated pulsed (ν=5 Hz) 800-Hz sine tones alternating with silent periods, activation of the auditory cortex and other anxiety- or sensory integration-related regions was assessed. Brain activation was further analyzed dependent on functional serotonin transporter (5-HTT) gene variation (5-HTTLPR).

RESULTS

PD patients demonstrated an extended brain activity in the first stimulation block, which normalized during the second stimulation cycle. A positive correlation with anxiety measures (HAMA) and an increased activity of distinct anxiety- or sensory integration-related areas (e.g., BA 22, BA 10) were seen during the third block of auditory stimulation. There was a significant interaction of left amygdala activation and the 5-HTTLPR S allele.

CONCLUSIONS

Our results support the hypothesis of an aberrant processing of sensory information in PD patients. This phenomenon may underlie an enhanced responsiveness to anxiety-relevant or irrelevant stimuli possibly increasing PD vulnerability.

Hearing living symbols and nonliving icons: category specificities in the cognitive processing of environmental sounds

The neurocognitive processing of environmental sounds and linguistic stimuli shares common semantic resources and can lead to the activation of motor programs for the generation of the passively heard sound or speech. We investigated the extent to which the cognition of environmental sounds, like that of language, relies on symbolic mental representations independent of the acoustic input. In a hierarchical sorting task, we found that evaluation of nonliving sounds is consistently biased toward a focus on acoustical information. However, the evaluation of living sounds focuses spontaneously on sound-independent semantic information, but can rely on acoustical information after exposure to a context consisting of nonliving sounds. We interpret these results as support for a robust iconic processing strategy for nonliving sounds and a flexible symbolic processing strategy for living sounds.

Temporal sequence of hemispheric network activation during semantic processing: a functional network connectivity analysis

To explore the temporal sequence of, and the relationship between, the left and right hemispheres (LH and RH) during semantic memory (SM) processing we identified the neural networks involved in the performance of functional MRI semantic object retrieval task (SORT) using group independent component analysis (ICA) in 47 healthy individuals. SORT requires participants to determine whether word pairs describing object features combine to retrieve an object. Functional network connectivity (FNC) was used to assess the correlations between components' time courses. Results showed that semantic left and right hemisphere networks comprise two independent ICA components. The components' time courses were highly correlated and RH activation preceded that of the LH. Moreover, this correlation was significantly stronger in better vs. poorer performers of the SORT. These results indicate an early activation of the RH that is closely followed by activation of the LH, to facilitate performance during word retrieval from SM.

Localization of Broca's Area Using Functional MR Imaging: Quantitative Evaluation of Paradigms

OBJECTIVE

Functional magnetic resonance imaging (fMRI) is frequently used to localize language areas in a non-invasive manner. Various paradigms for presurgical localization of language areas have been developed, but a systematic quantitative evaluation of the efficiency of those paradigms has not been performed. In the present study, the authors analyzed different language paradigms to see which paradigm is most efficient in localizing frontal language areas.

METHODS

Five men and five women with no neurological deficits participated (mean age, 24 years) in this study. All volunteers were right-handed. Each subject performed 4 tasks, including fixation (Fix), sentence reading (SR), pseudoword reading (PR), and word generation (WG). Fixation and pseudoword reading were used as contrasts. The functional area was defined as the area(s) with a t-value of more than 3.92 in fMRI with different tasks. To apply an anatomical constraint, we used a brain atlas mapping system, which is available in AFNI, to define the anatomical frontal language area. The numbers of voxels in overlapped area between anatomical and functional area were individually counted in the frontal expressive language area.

RESULTS

Of the various combinations, the word generation task was most effective in delineating the frontal expressive language area when fixation was used as a contrast (p<0.05). The sensitivity of this test for localizing Broca's area was 81% and specificity was 70%.

CONCLUSION

Word generation versus fixation could effectively and reliably delineate the frontal language area. A customized effective paradigm should be analyzed in order to evaluate various language functions.

Neural substrates of semantic memory

Semantic memory is described as the storage of knowledge, concepts, and information that is common and relatively consistent across individuals (e.g., memory of what is a cup). These memories are stored in multiple sensorimotor modalities and cognitive systems throughout the brain (e.g., how a cup is held and manipulated, the texture of a cup's surface, its shape, its function, that is related to beverages such as coffee, and so on). Our ability to engage in purposeful interactions with our environment is dependent on the ability to understand the meaning and significance of the objects and actions around us that are stored in semantic memory. Theories of the neural basis of the semantic memory of objects have produced sophisticated models that have incorporated to varying degrees the results of cognitive and neural investigations. The models are grouped into those that are (1) cognitive models, where the neural data are used to reveal dissociations in semantic memory after a brain lesion occurs; (2) models that incorporate both cognitive and neuroanatomical information; and (3) models that use cognitive, neuroanatomic, and neurophysiological data. This review highlights the advances and issues that have emerged from these models and points to future directions that provide opportunities to extend these models. The models of object memory generally describe how category and/or feature representations encode for object memory, and the semantic operations engaged in object processing. The incorporation of data derived from multiple modalities of investigation can lead to detailed neural specifications of semantic memory organization. The addition of neurophysiological data can potentially provide further elaboration of models to include semantic neural mechanisms. Future directions should incorporate available and newly developed techniques to better inform the neural underpinning of semantic memory models.