Evaluating the Columnar Stability of Acoustic Processing in the Human Auditory Cortex

Dual Representation of the Auditory Space

Auditory spatial cues contribute to two distinct functions, of which one leads to explicit localization of sound sources and the other provides a location-linked representation of sound objects. Behavioral and imaging studies demonstrated right-hemispheric dominance for explicit sound localization. An early clinical case study documented the dissociation between the explicit sound localizations, which was heavily impaired, and fully preserved use of spatial cues for sound object segregation. The latter involves location-linked encoding of sound objects. We review here evidence pertaining to brain regions involved in location-linked representation of sound objects. Auditory evoked potential (AEP) and functional magnetic resonance imaging (fMRI) studies investigated this aspect by comparing encoding of individual sound objects, which changed their locations or remained stationary. Systematic search identified 1 AEP and 12 fMRI studies. Together with studies of anatomical correlates of impaired of spatial-cue-based sound object segregation after focal brain lesions, the present evidence indicates that the location-linked representation of sound objects involves strongly the left hemisphere and to a lesser degree the right hemisphere. Location-linked encoding of sound objects is present in several early-stage auditory areas and in the specialized temporal voice area. In these regions, emotional valence benefits from location-linked encoding as well.

Neuronal Modeling of Cross-Sensory Visual Evoked Magnetoencephalography Responses in the Auditory Cortex

Previous studies have demonstrated that auditory cortex activity can be influenced by cross-sensory visual inputs. Intracortical laminar recordings in nonhuman primates have suggested a feedforward (FF) type profile for auditory evoked but feedback (FB) type for visual evoked activity in the auditory cortex. To test whether cross-sensory visual evoked activity in the auditory cortex is associated with FB inputs also in humans, we analyzed magnetoencephalography (MEG) responses from eight human subjects (six females) evoked by simple auditory or visual stimuli. In the estimated MEG source waveforms for auditory cortex regions of interest, auditory evoked response showed peaks at 37 and 90 ms and visual evoked response at 125 ms. The inputs to the auditory cortex were modeled through FF- and FB-type connections targeting different cortical layers using the Human Neocortical Neurosolver (HNN), which links cellular- and circuit-level mechanisms to MEG signals. HNN modeling suggested that the experimentally observed auditory response could be explained by an FF input followed by an FB input, whereas the cross-sensory visual response could be adequately explained by just an FB input. Thus, the combined MEG and HNN results support the hypothesis that cross-sensory visual input in the auditory cortex is of FB type. The results also illustrate how the dynamic patterns of the estimated MEG source activity can provide information about the characteristics of the input into a cortical area in terms of the hierarchical organization among areas.

Neuronal modeling of magnetoencephalography responses in auditory cortex to auditory and visual stimuli

Previous studies have demonstrated that auditory cortex activity can be influenced by crosssensory visual inputs. Intracortical recordings in non-human primates (NHP) have suggested a bottom-up feedforward (FF) type laminar profile for auditory evoked but top-down feedback (FB) type for cross-sensory visual evoked activity in the auditory cortex. To test whether this principle applies also to humans, we analyzed magnetoencephalography (MEG) responses from eight human subjects (six females) evoked by simple auditory or visual stimuli. In the estimated MEG source waveforms for auditory cortex region of interest, auditory evoked responses showed peaks at 37 and 90 ms and cross-sensory visual responses at 125 ms. The inputs to the auditory cortex were then modeled through FF and FB type connections targeting different cortical layers using the Human Neocortical Neurosolver (HNN), which consists of a neocortical circuit model linking the cellular- and circuit-level mechanisms to MEG. The HNN models suggested that the measured auditory response could be explained by an FF input followed by an FB input, and the crosssensory visual response by an FB input. Thus, the combined MEG and HNN results support the hypothesis that cross-sensory visual input in the auditory cortex is of FB type. The results also illustrate how the dynamic patterns of the estimated MEG/EEG source activity can provide information about the characteristics of the input into a cortical area in terms of the hierarchical organization among areas.

Acoustic and language-specific sources for phonemic abstraction from speech

Spoken language comprehension requires abstraction of linguistic information from speech, but the interaction between auditory and linguistic processing of speech remains poorly understood. Here, we investigate the nature of this abstraction using neural responses recorded intracranially while participants listened to conversational English speech. Capitalizing on multiple, language-specific patterns where phonological and acoustic information diverge, we demonstrate the causal efficacy of the phoneme as a unit of analysis and dissociate the unique contributions of phonemic and spectrographic information to neural responses. Quantitive higher-order response models also reveal that unique contributions of phonological information are carried in the covariance structure of the stimulus-response relationship. This suggests that linguistic abstraction is shaped by neurobiological mechanisms that involve integration across multiple spectro-temporal features and prior phonological information. These results link speech acoustics to phonology and morphosyntax, substantiating predictions about abstractness in linguistic theory and providing evidence for the acoustic features that support that abstraction.

Multilayer Network Analysis across Cortical Depths in Resting-State 7T fMRI

In graph theory, "multilayer networks" represent systems involving several interconnected topological levels. A neuroscience example is the hierarchy of connections between different cortical depths or "lamina". This hierarchy is becoming non-invasively accessible in humans using ultra-high-resolution functional MRI (fMRI). Here, we applied multilayer graph theory to examine functional connectivity across different cortical depths in humans, using 7T fMRI (1-mm3 voxels; 30 participants). Blood oxygenation level dependent (BOLD) signals were derived from five depths between the white matter and pial surface. We then compared networks where the inter-regional connections were limited to a single cortical depth only ("layer-by-layer matrices") to those considering all possible connections between regions and cortical depths ("multilayer matrix"). We utilized global and local graph theory features that quantitatively characterize network attributes such as network composition, nodal centrality, path-based measures, and hub segregation. Detecting functional differences between cortical depths was improved using multilayer connectomics compared to the layer-by-layer versions. Superficial aspects of the cortex dominated information transfer and deeper aspects clustering. These differences were largest in frontotemporal and limbic brain regions. fMRI functional connectivity across different cortical depths may contain neurophysiologically relevant information. Multilayer connectomics could provide a methodological framework for studies on how information flows across this hierarchy.

Ultra-High Field Imaging of Human Visual Cognition

Functional magnetic resonance imaging (fMRI), the key methodology for mapping the functions of the human brain in a noninvasive manner, is limited by low temporal and spatial resolution. Recent advances in ultra-high field (UHF) fMRI provide a mesoscopic (i.e., submillimeter resolution) tool that allows us to probe laminar and columnar circuits, distinguish bottom-up versus top-down pathways, and map small subcortical areas. We review recent work demonstrating that UHF fMRI provides a robust methodology for imaging the brain across cortical depths and columns that provides insights into the brain's organization and functions at unprecedented spatial resolution, advancing our understanding of the fine-scale computations and interareal communication that support visual cognition.

Cortical depth profiles of auditory and visual 7 T functional MRI responses in human superior temporal areas

Invasive neurophysiological studies in nonhuman primates have shown different laminar activation profiles to auditory vs. visual stimuli in auditory cortices and adjacent polymodal areas. Means to examine the underlying feedforward vs. feedback type influences noninvasively have been limited in humans. Here, using 1-mm isotropic resolution 3D echo-planar imaging at 7 T, we studied the intracortical depth profiles of functional magnetic resonance imaging (fMRI) blood oxygenation level dependent (BOLD) signals to brief auditory (noise bursts) and visual (checkerboard) stimuli. BOLD percent-signal-changes were estimated at 11 equally spaced intracortical depths, within regions-of-interest encompassing auditory (Heschl's gyrus, Heschl's sulcus, planum temporale, and posterior superior temporal gyrus) and polymodal (middle and posterior superior temporal sulcus) areas. Effects of differing BOLD signal strengths for auditory and visual stimuli were controlled via normalization and statistical modeling. The BOLD depth profile shapes, modeled with quadratic regression, were significantly different for auditory vs. visual stimuli in auditory cortices, but not in polymodal areas. The different depth profiles could reflect sensory-specific feedforward versus cross-sensory feedback influences, previously shown in laminar recordings in nonhuman primates. The results suggest that intracortical BOLD profiles can help distinguish between feedforward and feedback type influences in the human brain. Further experimental studies are still needed to clarify how underlying signal strength influences BOLD depth profiles under different stimulus conditions.

Selective attention sharpens population receptive fields in human auditory cortex

Selective attention enables the preferential processing of relevant stimulus aspects. Invasive animal studies have shown that attending a sound feature rapidly modifies neuronal tuning throughout the auditory cortex. Human neuroimaging studies have reported enhanced auditory cortical responses with selective attention. To date, it remains unclear how the results obtained with functional magnetic resonance imaging (fMRI) in humans relate to the electrophysiological findings in animal models. Here we aim to narrow the gap between animal and human research by combining a selective attention task similar in design to those used in animal electrophysiology with high spatial resolution ultra-high field fMRI at 7 Tesla. Specifically, human participants perform a detection task, whereas the probability of target occurrence varies with sound frequency. Contrary to previous fMRI studies, we show that selective attention resulted in population receptive field sharpening, and consequently reduced responses, at the attended sound frequencies. The difference between our results to those of previous fMRI studies supports the notion that the influence of selective attention on auditory cortex is diverse and may depend on context, stimulus, and task.

Using high spatial resolution fMRI to understand representation in the auditory network

Following rapid methodological advances, ultra-high field (UHF) functional and anatomical magnetic resonance imaging (MRI) has been repeatedly and successfully used for the investigation of the human auditory system in recent years. Here, we review this work and argue that UHF MRI is uniquely suited to shed light on how sounds are represented throughout the network of auditory brain regions. That is, the provided gain in spatial resolution at UHF can be used to study the functional role of the small subcortical auditory processing stages and details of cortical processing. Further, by combining high spatial resolution with the versatility of MRI contrasts, UHF MRI has the potential to localize the primary auditory cortex in individual hemispheres. This is a prerequisite to study how sound representation in higher-level auditory cortex evolves from that in early (primary) auditory cortex. Finally, the access to independent signals across auditory cortical depths, as afforded by UHF, may reveal the computations that underlie the emergence of an abstract, categorical sound representation based on low-level acoustic feature processing. Efforts on these research topics are underway. Here we discuss promises as well as challenges that come with studying these research questions using UHF MRI, and provide a future outlook.

LayNii: A software suite for layer-fMRI

High-resolution fMRI in the sub-millimeter regime allows researchers to resolve brain activity across cortical layers and columns non-invasively. While these high-resolution data make it possible to address novel questions of directional information flow within and across brain circuits, the corresponding data analyses are challenged by MRI artifacts, including image blurring, image distortions, low SNR, and restricted coverage. These challenges often result in insufficient spatial accuracy of conventional analysis pipelines. Here we introduce a new software suite that is specifically designed for layer-specific functional MRI: LayNii. This toolbox is a collection of command-line executable programs written in C/C++ and is distributed opensource and as pre-compiled binaries for Linux, Windows, and macOS. LayNii is designed for layer-fMRI data that suffer from SNR and coverage constraints and thus cannot be straightforwardly analyzed in alternative software packages. Some of the most popular programs of LayNii contain 'layerification' and columnarization in the native voxel space of functional data as well as many other layer-fMRI specific analysis tasks: layer-specific smoothing, model-based vein mitigation of GE-BOLD data, quality assessment of artifact dominated sub-millimeter fMRI, as well as analyses of VASO data.

Effects of phase regression on high-resolution functional MRI of the primary visual cortex

High-resolution functional MRI studies have become a powerful tool to non-invasively probe the sub-millimeter functional organization of the human cortex. Advances in MR hardware, imaging techniques and sophisticated post-processing methods have allowed high resolution fMRI to be used in both the clinical and academic neurosciences. However, consensus within the community regarding the use of gradient echo (GE) or spin echo (SE) based acquisition remains largely divided. On one hand, GE provides a high temporal signal-to-noise ratio (tSNR) technique sensitive to both the macro- and micro-vascular signal while SE based methods are more specific to microvasculature but suffer from lower tSNR and specific absorption rate limitations, especially at high field and with short repetition times. Fortunately, the phase of the GE-EPI signal is sensitive to vessel size and this provides a potential avenue to reduce the macrovascular weighting of the signal (phase regression, Menon 2002). In order to determine the efficacy of this technique at high-resolution, phase regression was applied to GE-EPI timeseries and compared to SE-EPI to determine if GE-EPI's specificity to the microvascular compartment improved. To do this, functional data was collected from seven subjects on a neuro-optimized 7 T system at 800 μm isotropic resolution with both GE-EPI and SE-EPI while observing an 8 Hz contrast reversing checkerboard. Phase data from the GE-EPI was used to create a microvasculature-weighted time series (GE-EPI-PR). Anatomical imaging (MP2RAGE) was also collected to allow for surface segmentation so that the functional results could be projected onto a surface. A multi-echo gradient echo sequence was collected and used to identify venous vasculature. The GE-EPI-PR surface activation maps showed a high qualitative similarity with SE-EPI and also produced laminar activity profiles similar to SE-EPI. When the GE-EPI and GE-EPI-PR distributions were compared to SE-EPI it was shown that GE-EPI-PR had similar distribution characteristics to SE-EPI (p < 0.05) across the top 60% of cortex. Furthermore, it was shown that GE-EPI-PR has a higher contrast-to-noise ratio (0.5 ± 0.2, mean ± std. dev. across layers) than SE-EPI (0.27 ± 0.07) demonstrating the technique has higher sensitivity than SE-EPI. Taken together this evidence suggests phase regression is a useful method in low SNR studies such as high-resolution fMRI.

Cortical Stimulation Induces Excitatory Postsynaptic Potentials of Inferior Colliculus Neurons in a Frequency-Specific Manner

Corticofugal modulation of auditory responses in subcortical nuclei has been extensively studied whereas corticofugal synaptic transmission must still be characterized. This study examined postsynaptic potentials of the corticocollicular system, i.e., the projections from the primary auditory cortex (AI) to the central nucleus of the inferior colliculus (ICc) of the midbrain, in anesthetized C57 mice. We used focal electrical stimulation at the microampere level to activate the AI (ES_AI) and in vivo whole-cell current-clamp to record the membrane potentials of ICc neurons. Following the whole-cell patch-clamp recording of 88 ICc neurons, 42 ICc neurons showed ES_AI-evoked changes in the membrane potentials. We found that the ES_AI induced inhibitory postsynaptic potentials in 6 out of 42 ICc neurons but only when the stimulus current was 96 μA or higher. In the remaining 36 ICc neurons, excitatory postsynaptic potentials (EPSPs) were induced at a much lower stimulus current. The 36 ICc neurons exhibiting EPSPs were categorized into physiologically matched neurons (n = 12) when the characteristic frequencies of the stimulated AI and recorded ICc neurons were similar (≤1 kHz) and unmatched neurons (n = 24) when they were different (>1 kHz). Compared to unmatched neurons, matched neurons exhibited a significantly lower threshold of evoking noticeable EPSP, greater EPSP amplitude, and shorter EPSP latency. Our data allow us to propose that corticocollicular synaptic transmission is primarily excitatory and that synaptic efficacy is dependent on the relationship of the frequency tunings between AI and ICc neurons.

Forging a path to mesoscopic imaging success with ultra-high field functional magnetic resonance imaging

Functional magnetic resonance imaging (fMRI) studies with ultra-high field (UHF, 7+ Tesla) technology enable the acquisition of high-resolution images. In this work, we discuss recent achievements in UHF fMRI at the mesoscopic scale, on the order of cortical columns and layers, and examine approaches to addressing common challenges. As researchers push to smaller and smaller voxel sizes, acquisition and analysis decisions have greater potential to degrade spatial accuracy, and UHF fMRI data must be carefully interpreted. We consider the impact of acquisition decisions on the spatial specificity of the MR signal with a representative dataset with 0.8 mm isotropic resolution. We illustrate the trade-offs in contrast with noise ratio and spatial specificity of different acquisition techniques and show that acquisition blurring can increase the effective voxel size by as much as 50% in some dimensions. We further describe how different sources of degradations to spatial resolution in functional data may be characterized. Finally, we emphasize that progress in UHF fMRI depends not only on scientific discovery and technical advancement, but also on informal discussions and documentation of challenges researchers face and overcome in pursuit of their goals. This article is part of the theme issue 'Key relationships between non-invasive functional neuroimaging and the underlying neuronal activity'.

Functional organization of mouse primary auditory cortex in adult C57BL/6 and F1 (CBAxC57) mice

The primary auditory cortex (A1) plays a key role for sound perception since it represents one of the first cortical processing stations for sounds. Recent studies have shown that on the cellular level the frequency organization of A1 is more heterogeneous than previously appreciated. However, many of these studies were performed in mice on the C57BL/6 background which develop high frequency hearing loss with age making them a less optimal choice for auditory research. In contrast, mice on the CBA background retain better hearing sensitivity in old age. Since potential strain differences could exist in A1 organization between strains, we performed comparative analysis of neuronal populations in A1 of adult (~ 10 weeks) C57BL/6 mice and F1 (CBAxC57) mice. We used in vivo 2-photon imaging of pyramidal neurons in cortical layers L4 and L2/3 of awake mouse primary auditory cortex (A1) to characterize the populations of neurons that were active to tonal stimuli. Pure tones recruited neurons of widely ranging frequency preference in both layers and strains with neurons in F1 (CBAxC57) mice exhibiting a wider range of frequency preference particularly to higher frequencies. Frequency selectivity was slightly higher in C57BL/6 mice while neurons in F1 (CBAxC57) mice showed a greater sound-level sensitivity. The spatial heterogeneity of frequency preference was present in both strains with F1 (CBAxC57) mice exhibiting higher tuning diversity across all measured length scales. Our results demonstrate that the tone evoked responses and frequency representation in A1 of adult C57BL/6 and F1 (CBAxC57) mice are largely similar.

The Encoding of Speech Sounds in the Superior Temporal Gyrus

The human superior temporal gyrus (STG) is critical for extracting meaningful linguistic features from speech input. Local neural populations are tuned to acoustic-phonetic features of all consonants and vowels and to dynamic cues for intonational pitch. These populations are embedded throughout broader functional zones that are sensitive to amplitude-based temporal cues. Beyond speech features, STG representations are strongly modulated by learned knowledge and perceptual goals. Currently, a major challenge is to understand how these features are integrated across space and time in the brain during natural speech comprehension. We present a theory that temporally recurrent connections within STG generate context-dependent phonological representations, spanning longer temporal sequences relevant for coherent percepts of syllables, words, and phrases.

Processing complexity increases in superficial layers of human primary auditory cortex

The layers of the neocortex each have a unique anatomical connectivity and functional role. Their exploration in the human brain, however, has been severely restricted by the limited spatial resolution of non-invasive measurement techniques. Here, we exploit the sensitivity and specificity of ultra-high field fMRI at 7 Tesla to investigate responses to natural sounds at deep, middle, and superficial cortical depths of the human auditory cortex. Specifically, we compare the performance of computational models that represent different hypotheses on sound processing inside and outside the primary auditory cortex (PAC). We observe that while BOLD responses in deep and middle PAC layers are equally well represented by a simple frequency model and a more complex spectrotemporal modulation model, responses in superficial PAC are better represented by the more complex model. This indicates an increase in processing complexity in superficial PAC, which remains present throughout cortical depths in the non-primary auditory cortex. These results suggest that a relevant transformation in sound processing takes place between the thalamo-recipient middle PAC layers and superficial PAC. This transformation may be a first computational step towards sound abstraction and perception, serving to form an increasingly more complex representation of the physical input.