Cortical connections of the auditory cortex in marmoset monkeys: core and medial belt regions

Frontal-auditory cortical interactions and sensory prediction during vocal production in marmoset monkeys

The control of speech and vocal production involves the calculation of error between the intended vocal output and the resulting auditory feedback. This model has been supported by evidence that the auditory cortex (AC) is suppressed immediately before and during vocal production yet remains sensitive to differences between vocal output and altered auditory feedback. This suppression has been suggested to be the result of top-down signals about the intended vocal output, potentially originating from frontal cortical (FC) areas. However, whether FC is the source of suppressive and predictive signaling to AC during vocalization remains unknown. Here, we simultaneously recorded neural activity from both AC and FC of marmoset monkeys during self-initiated vocalizations. We found increases in neural activity in both brain areas from 1 to 0.5 s before vocal production (early pre-vocal period), specifically changes in both multi-unit activity and theta-band power. Connectivity analysis using Granger causality demonstrated that FC sends directed signaling to AC during this early pre-vocal period. Importantly, early pre-vocal activity correlated with both vocalization-induced suppression in AC as well as the structure and acoustics of subsequent calls, such as fundamental frequency. Furthermore, bidirectional auditory-frontal interactions emerged during experimentally altered vocal feedback and predicted subsequent compensatory vocal behavior. These results suggest that FC communicates with AC during vocal production, with frontal-to-auditory signals that may reflect the transmission of sensory prediction information before vocalization and bidirectional signaling during vocalization suggestive of error detection that could drive feedback-dependent vocal control.

Reduced Neural Responses to Natural Foreground versus Background Sounds in the Auditory Cortex

In everyday hearing, listeners face the challenge of understanding behaviorally relevant foreground stimuli (speech, vocalizations) in complex backgrounds (environmental, mechanical noise). Prior studies have shown that high-order areas of human auditory cortex (AC) preattentively form an enhanced representation of foreground stimuli in the presence of background noise. This enhancement requires identifying and grouping the features that comprise the background so they can be removed from the foreground representation. To study the cortical computations supporting this process, we recorded single-unit activity in AC of male and female ferrets during the presentation of concurrent natural sounds from these two categories. In contrast to expectations from studies in high-order AC, single-unit responses to foreground sounds were strongly reduced relative to the paired background in primary and secondary AC. The degree of reduction could not be explained by a neuron's preference for the foreground or background stimulus in isolation but could be partially explained by spectrotemporal statistics that distinguish foreground and background categories. Responses to synthesized sounds with statistics either matched or randomized relative to natural sounds showed progressively decreased reduction of foreground responses as natural sound statistics were removed. These results challenge the expectation that cortical foreground representations emerge directly from a mixed representation in the auditory periphery. Instead, they suggest the early AC maintains a robust representation of background noise. Strong background representations may produce a distributed code, facilitating selection of foreground signals from a relatively small subpopulation of AC neurons at later processing stages.

Distributed representations of prediction error signals across the cortical hierarchy are synergistic

A relevant question concerning inter-areal communication in the cortex is whether these interactions are synergistic. Synergy refers to the complementary effect of multiple brain signals conveying more information than the sum of each isolated signal. Redundancy, on the other hand, refers to the common information shared between brain signals. Here, we dissociated cortical interactions encoding complementary information (synergy) from those sharing common information (redundancy) during prediction error (PE) processing. We analyzed auditory and frontal electrocorticography (ECoG) signals in five common awake marmosets performing two distinct auditory oddball tasks and investigated to what extent event-related potentials (ERP) and broadband (BB) dynamics encoded synergistic and redundant information about PE processing. The information conveyed by ERPs and BB signals was synergistic even at lower stages of the hierarchy in the auditory cortex and between auditory and frontal regions. Using a brain-constrained neural network, we simulated the synergy and redundancy observed in the experimental results and demonstrated that the emergence of synergy between auditory and frontal regions requires the presence of strong, long-distance, feedback, and feedforward connections. These results indicate that distributed representations of PE signals across the cortical hierarchy can be highly synergistic.

Superior Attentional Efficiency of Auditory Cue via the Ventral Auditory-thalamic Pathway

Auditory commands are often executed more efficiently than visual commands. However, empirical evidence on the underlying behavioral and neural mechanisms remains scarce. In two experiments, we manipulated the delivery modality of informative cues and the prediction violation effect and found consistently enhanced RT benefits for the matched auditory cues compared with the matched visual cues. At the neural level, when the bottom-up perceptual input matched the prior prediction induced by the auditory cue, the auditory-thalamic pathway was significantly activated. Moreover, the stronger the auditory-thalamic connectivity, the higher the behavioral benefits of the matched auditory cue. When the bottom-up input violated the prior prediction induced by the auditory cue, the ventral auditory pathway was specifically involved. Moreover, the stronger the ventral auditory-prefrontal connectivity, the larger the behavioral costs caused by the violation of the auditory cue. In addition, the dorsal frontoparietal network showed a supramodal function in reacting to the violation of informative cues irrespective of the delivery modality of the cue. Taken together, the results reveal novel behavioral and neural evidence that the superior efficiency of the auditory cue is twofold: The auditory-thalamic pathway is associated with improvements in task performance when the bottom-up input matches the auditory cue, whereas the ventral auditory-prefrontal pathway is involved when the auditory cue is violated.

Frontal-Auditory Cortical Interactions and Sensory Prediction During Vocal Production in Marmoset Monkeys

The control of speech and vocal production involves the calculation of error between the intended vocal output and the resulting auditory feedback. Consistent with this model, recent evidence has demonstrated that the auditory cortex is suppressed immediately before and during vocal production, yet is still sensitive to differences between vocal output and altered auditory feedback. This suppression has been suggested to be the result of top-down signals containing information about the intended vocal output, potentially originating from motor or other frontal cortical areas. However, whether such frontal areas are the source of suppressive and predictive signaling to the auditory cortex during vocalization is unknown. Here, we simultaneously recorded neural activity from both the auditory and frontal cortices of marmoset monkeys while they produced self-initiated vocalizations. We found increases in neural activity in both brain areas preceding the onset of vocal production, notably changes in both multi-unit activity and local field potential theta-band power. Connectivity analysis using Granger causality demonstrated that frontal cortex sends directed signaling to the auditory cortex during this pre-vocal period. Importantly, this pre-vocal activity predicted both vocalization-induced suppression of the auditory cortex as well as the acoustics of subsequent vocalizations. These results suggest that frontal cortical areas communicate with the auditory cortex preceding vocal production, with frontal-auditory signals that may reflect the transmission of sensory prediction information. This interaction between frontal and auditory cortices may contribute to mechanisms that calculate errors between intended and actual vocal outputs during vocal communication.

Age-related changes in the primary auditory cortex of newborn, adults and aging bottlenose dolphins (Tursiops truncatus) are located in the upper cortical layers

Introduction

The auditory system of dolphins and whales allows them to dive in dark waters, hunt for prey well below the limit of solar light absorption, and to communicate with their conspecific. These complex behaviors require specific and sufficient functional circuitry in the neocortex, and vicarious learning capacities. Dolphins are also precocious animals that can hold their breath and swim within minutes after birth. However, diving and hunting behaviors are likely not innate and need to be learned. Our hypothesis is that the organization of the auditory cortex of dolphins grows and mature not only in the early phases of life, but also in adults and aging individuals. These changes may be subtle and involve sub-populations of cells specificall linked to some circuits.

Methods

In the primary auditory cortex of 11 bottlenose dolphins belonging to three age groups (calves, adults, and old animals), neuronal cell shapes were analyzed separately and by cortical layer using custom computer vision and multivariate statistical analysis, to determine potential minute morphological differences across these age groups.

Results

The results show definite changes in interneurons, characterized by round and ellipsoid shapes predominantly located in upper cortical layers. Notably, neonates interneurons exhibited a pattern of being closer together and smaller, developing into a more dispersed and diverse set of shapes in adulthood.

Discussion

This trend persisted in older animals, suggesting a continuous development of connections throughout the life of these marine animals. Our findings further support the proposition that thalamic input reach upper layers in cetaceans, at least within a cortical area critical for their survival. Moreover, our results indicate the likelihood of changes in cell populations occurring in adult animals, prompting the need for characterization.

Change detection in the primate auditory cortex through feedback of prediction error signals

Although cortical feedback signals are essential for modulating feedforward processing, no feedback error signal across hierarchical cortical areas has been reported. Here, we observed such a signal in the auditory cortex of awake common marmoset during an oddball paradigm to induce auditory duration mismatch negativity. Prediction errors to a deviant tone presentation were generated as offset calcium responses of layer 2/3 neurons in the rostral parabelt (RPB) of higher-order auditory cortex, while responses to non-deviant tones were strongly suppressed. Within several hundred milliseconds, the error signals propagated broadly into layer 1 of the primary auditory cortex (A1) and accumulated locally on top of incoming auditory signals. Blockade of RPB activity prevented deviance detection in A1. Optogenetic activation of RPB following tone presentation nonlinearly enhanced A1 tone response. Thus, the feedback error signal is critical for automatic detection of unpredicted stimuli in physiological auditory processing and may serve as backpropagation-like learning.

The neurobiology of vocal communication in marmosets

An increasingly popular animal model for studying the neural basis of social behavior, cognition, and communication is the common marmoset (Callithrix jacchus). Interest in this New World primate across neuroscience is now being driven by their proclivity for prosociality across their repertoire, high volubility, and rapid development, as well as their amenability to naturalistic testing paradigms and freely moving neural recording and imaging technologies. The complement of these characteristics set marmosets up to be a powerful model of the primate social brain in the years to come. Here, we focus on vocal communication because it is the area that has both made the most progress and illustrates the prodigious potential of this species. We review the current state of the field with a focus on the various brain areas and networks involved in vocal perception and production, comparing the findings from marmosets to other animals, including humans.

Metamodal Coupling of Vibrotactile and Auditory Speech Processing Systems through Matched Stimulus Representations

It has been postulated that the brain is organized by "metamodal," sensory-independent cortical modules capable of performing tasks (e.g., word recognition) in both "standard" and novel sensory modalities. Still, this theory has primarily been tested in sensory-deprived individuals, with mixed evidence in neurotypical subjects, thereby limiting its support as a general principle of brain organization. Critically, current theories of metamodal processing do not specify requirements for successful metamodal processing at the level of neural representations. Specification at this level may be particularly important in neurotypical individuals, where novel sensory modalities must interface with existing representations for the standard sense. Here we hypothesized that effective metamodal engagement of a cortical area requires congruence between stimulus representations in the standard and novel sensory modalities in that region. To test this, we first used fMRI to identify bilateral auditory speech representations. We then trained 20 human participants (12 female) to recognize vibrotactile versions of auditory words using one of two auditory-to-vibrotactile algorithms. The vocoded algorithm attempted to match the encoding scheme of auditory speech while the token-based algorithm did not. Crucially, using fMRI, we found that only in the vocoded group did trained-vibrotactile stimuli recruit speech representations in the superior temporal gyrus and lead to increased coupling between them and somatosensory areas. Our results advance our understanding of brain organization by providing new insight into unlocking the metamodal potential of the brain, thereby benefitting the design of novel sensory substitution devices that aim to tap into existing processing streams in the brain.SIGNIFICANCE STATEMENT It has been proposed that the brain is organized by "metamodal," sensory-independent modules specialized for performing certain tasks. This idea has inspired therapeutic applications, such as sensory substitution devices, for example, enabling blind individuals "to see" by transforming visual input into soundscapes. Yet, other studies have failed to demonstrate metamodal engagement. Here, we tested the hypothesis that metamodal engagement in neurotypical individuals requires matching the encoding schemes between stimuli from the novel and standard sensory modalities. We trained two groups of subjects to recognize words generated by one of two auditory-to-vibrotactile transformations. Critically, only vibrotactile stimuli that were matched to the neural encoding of auditory speech engaged auditory speech areas after training. This suggests that matching encoding schemes is critical to unlocking the brain's metamodal potential.

Functional imaging and anatomical connections in squirrel monkeys reveal parietal-frontal circuits underlying eye movements

The posterior parietal cortex (PPC) of squirrel monkeys contains subregions where long trains of intracortical microstimulation evoke complex, behaviorally meaningful movements. Recently, we showed that such stimulation of a part of the PPC in the caudal lateral sulcus (LS) elicits eye movements in these monkeys. Here, we studied the functional and anatomical connections of this oculomotor region we call parietal eye field (PEF) with frontal eye field (FEF) and other cortical regions in 2 squirrel monkeys. We demonstrated these connections with intrinsic optical imaging and injections of anatomical tracers. Optical imaging of frontal cortex during stimulation of the PEF evoked focal functional activation within FEF. Tracing studies confirmed the functional PEF-FEF connections. Moreover, tracer injections revealed PEF connections with other PPC regions on the dorsolateral and medial brain surface, cortex in the caudal LS, and visual and auditory cortical association areas. Subcortical projections of PEF were primarily with superior colliculus, and pontine nuclei as well as nuclei of the dorsal posterior thalamus and caudate. These findings suggest that PEF in squirrel monkey is homologous to lateral intraparietal (LIP) area of macaque, supporting the notion that these brain circuits are organized similarly to mediate ethologically relevant oculomotor behaviors.

Multimodal processing in face-to-face interactions: A bridging link between psycholinguistics and sensory neuroscience

In face-to-face communication, humans are faced with multiple layers of discontinuous multimodal signals, such as head, face, hand gestures, speech and non-speech sounds, which need to be interpreted as coherent and unified communicative actions. This implies a fundamental computational challenge: optimally binding only signals belonging to the same communicative action while segregating signals that are not connected by the communicative content. How do we achieve such an extraordinary feat, reliably, and efficiently? To address this question, we need to further move the study of human communication beyond speech-centred perspectives and promote a multimodal approach combined with interdisciplinary cooperation. Accordingly, we seek to reconcile two explanatory frameworks recently proposed in psycholinguistics and sensory neuroscience into a neurocognitive model of multimodal face-to-face communication. First, we introduce a psycholinguistic framework that characterises face-to-face communication at three parallel processing levels: multiplex signals, multimodal gestalts and multilevel predictions. Second, we consider the recent proposal of a lateral neural visual pathway specifically dedicated to the dynamic aspects of social perception and reconceive it from a multimodal perspective ("lateral processing pathway"). Third, we reconcile the two frameworks into a neurocognitive model that proposes how multiplex signals, multimodal gestalts, and multilevel predictions may be implemented along the lateral processing pathway. Finally, we advocate a multimodal and multidisciplinary research approach, combining state-of-the-art imaging techniques, computational modelling and artificial intelligence for future empirical testing of our model.

Towards a somatosensory theory of speech perception

Speech perception is known to be a multimodal process, relying not only on auditory input but also on the visual system and possibly on the motor system as well. To date there has been little work on the potential involvement of the somatosensory system in speech perception. In the present review, we identify the somatosensory system as another contributor to speech perception. First, we argue that evidence in favor of a motor contribution to speech perception can just as easily be interpreted as showing somatosensory involvement. Second, physiological and neuroanatomical evidence for auditory-somatosensory interactions across the auditory hierarchy indicates the availability of a neural infrastructure that supports somatosensory involvement in auditory processing in general. Third, there is accumulating evidence for somatosensory involvement in the context of speech specifically. In particular, tactile stimulation modifies speech perception, and speech auditory input elicits activity in somatosensory cortical areas. Moreover, speech sounds can be decoded from activity in somatosensory cortex; lesions to this region affect perception, and vowels can be identified based on somatic input alone. We suggest that the somatosensory involvement in speech perception derives from the somatosensory-auditory pairing that occurs during speech production and learning. By bringing together findings from a set of studies that have not been previously linked, the present article identifies the somatosensory system as a presently unrecognized contributor to speech perception.

Cortical adaptation of the night monkey to a nocturnal niche environment: a comparative non-invasive T1w/T2w myelin study

Night monkeys (Aotus) are the only genus of monkeys within the Simian lineage that successfully occupy a nocturnal environmental niche. Their behavior is supported by their sensory organs' distinctive morphological features; however, little is known about their evolutionary adaptations in sensory regions of the cerebral cortex. Here, we investigate this question by exploring the cortical organization of night monkeys using high-resolution in-vivo brain MRI and comparative cortical-surface T1w/T2w myeloarchitectonic mapping. Our results show that the night monkey cerebral cortex has a qualitatively similar but quantitatively different pattern of cortical myelin compared to the diurnal macaque and marmoset monkeys. T1w/T2w myelin and its gradient allowed us to parcellate high myelin areas, including the middle temporal complex (MT +) and auditory cortex, and a low-myelin area, Brodmann area 7 (BA7) in the three species, despite species differences in cortical convolutions. Relative to the total cortical-surface area, those of MT + and the auditory cortex are significantly larger in night monkeys than diurnal monkeys, whereas area BA7 occupies a similar fraction of the cortical sheet in all three species. We propose that the selective expansion of sensory areas dedicated to visual motion and auditory processing in night monkeys may reflect cortical adaptations to a nocturnal environment.

Neuromagnetic representation of melodic contour processing in human auditory cortex

The pattern of ups and downs in a sequence with varying pitch can be heard as a melodic contour. Contrary to single pitch, the neural representation of melodic contour information in the auditory cortex is rarely investigated, and it is not clear whether the processing entails a hemispheric asymmetry. The present magnetoencephalography study assessed the neuromagnetic responses of N = 18 normal-hearing adults to four-note sequences with fixed vs. varying pitch that were presented either monaurally or diotically; data were analyzed using minimum-norm reconstructions. The first note of the sequences elicited prominent transient activity in posterior auditory regions (Planum temporale), especially contralateral to the ear of entry. In contrast, the response to the subsequent notes originated from more anterior areas (Planum polare) and was larger for melodic contours than for fixed pitch sequences, independent from the ear of entry and without hemispheric asymmetry. Together, the results point to a gradient in the early cortical processing of melodic contours, both in spatial and functional terms, where posterior auditory activity reflects the onset of a pitch sequence and anterior activity reflects its subsequent notes, including the difference between sequences with fixed pitch and melodic contours.

Mesoscopic landscape of cortical functions revealed by through-skull wide-field optical imaging in marmoset monkeys

The primate cerebral cortex is organized into specialized areas representing different modalities and functions along a continuous surface. The functional maps across the cortex, however, are often investigated a single modality at a time (e.g., audition or vision). To advance our understanding of the complex landscape of primate cortical functions, here we develop a polarization-gated wide-field optical imaging method for measuring cortical functions through the un-thinned intact skull in awake marmoset monkeys (Callithrix jacchus), a primate species featuring a smooth cortex. Using this method, adjacent auditory, visual, and somatosensory cortices are noninvasively parcellated in individual subjects with detailed tonotopy, retinotopy, and somatotopy. An additional pure-tone-responsive tonotopic gradient is discovered in auditory cortex and a face-patch sensitive to motion in the lower-center visual field is localized near an auditory region representing frequencies of conspecific vocalizations. This through-skull landscape-mapping approach provides new opportunities for understanding how the primate cortex is organized and coordinated to enable real-world behaviors.

Behavioral context affects social signal representations within single primate prefrontal cortex neurons

We tested whether social signal processing in more traditional, head-restrained contexts is representative of the putative natural analog-social communication-by comparing responses to vocalizations within individual neurons in marmoset prefrontal cortex (PFC) across a series of behavioral contexts ranging from traditional to naturalistic. Although vocalization-responsive neurons were evident in all contexts, cross-context consistency was notably limited. A response to these social signals when subjects were head-restrained was not predictive of a comparable neural response to the identical vocalizations during natural communication. This pattern was evident both within individual neurons and at a population level, as PFC activity could be reliably decoded for the behavioral context in which vocalizations were heard. These results suggest that neural representations of social signals in primate PFC are not static but highly flexible and likely reflect how nuances of the dynamic behavioral contexts affect the perception of these signals and what they communicate.

Cerebral cortical processing time is elongated in human brain evolution

An increase in number of neurons is presumed to underlie the enhancement of cognitive abilities in brain evolution. The evolution of human cognition is then expected to have accompanied a prolongation of net neural-processing time due to the accumulation of processing time of individual neurons over an expanded number of neurons. Here, we confirmed this prediction and quantified the amount of prolongation in vivo, using noninvasive measurements of brain responses to sounds in unanesthetized human and nonhuman primates. Latencies of the N1 component of auditory-evoked potentials recorded from the scalp were approximately 40, 50, 60, and 100 ms for the common marmoset, rhesus monkey, chimpanzee, and human, respectively. Importantly, the prominent increase in human N1 latency could not be explained by the physical lengthening of the auditory pathway, and therefore reflected an extended dwell time for auditory cortical processing. A longer time window for auditory cortical processing is advantageous for analyzing time-varying acoustic stimuli, such as those important for speech perception. A novel hypothesis concerning human brain evolution then emerges: the increase in cortical neuronal number widened the timescale of sensory cortical processing, the benefits of which outweighed the disadvantage of slow cognition and reaction.

Common principles in the lateralisation of auditory cortex structure and function for vocal communication in primates and rodents

This review summarises recent findings on the lateralisation of communicative sound processing in the auditory cortex (AC) of humans, non-human primates, and rodents. Functional imaging in humans has demonstrated a left hemispheric preference for some acoustic features of speech, but it is unclear to which degree this is caused by bottom-up acoustic feature selectivity or top-down modulation from language areas. Although non-human primates show a less pronounced functional lateralisation in AC, the properties of AC fields and behavioral asymmetries are qualitatively similar. Rodent studies demonstrate microstructural circuits that might underlie bottom-up acoustic feature selectivity in both hemispheres. Functionally, the left AC in the mouse appears to be specifically tuned to communication calls, whereas the right AC may have a more 'generalist' role. Rodents also show anatomical AC lateralisation, such as differences in size and connectivity. Several of these functional and anatomical characteristics are also lateralized in human AC. Thus, complex vocal communication processing shares common features among rodents and primates. We argue that a synthesis of results from humans, non-human primates, and rodents is necessary to identify the neural circuitry of vocal communication processing. However, data from different species and methods are often difficult to compare. Recent advances may enable better integration of methods across species. Efforts to standardise data formats and analysis tools would benefit comparative research and enable synergies between psychological and biological research in the area of vocal communication processing.

Light microscopic and heterogeneity analysis of astrocytes in the common marmoset brain

Astrocytes are abundant cells of the central nervous system (CNS) and are involved in processes including synapse formation/function, ion homeostasis, neurotransmitter uptake, and neurovascular coupling. Recent evidence indicates that astrocytes show diverse molecular, structural, and physiological properties within the CNS. This heterogeneity is reflected in differences in astrocyte structure, gene expression, functional properties, and responsiveness to injury/pathological conditions. Deeper investigation of astrocytic heterogeneity is needed to understand how astrocytes are configured to enable diverse roles in the CNS. While much has been learned about astrocytic heterogeneity in rodents, much less is known about astrocytic heterogeneity in the primate brain where astrocytes have greater size and complexity. The common marmoset (Callithrix jacchus) is a promising non‐human primate model because of similarities between marmosets and humans with respect to genetics, brain anatomy, and cognition/behavior. Here, we investigated the molecular and structural heterogeneity of marmoset astrocytes using an array of astrocytic markers, multi‐label confocal microscopy, and quantitative analysis. We used male and female marmosets and found that marmoset astrocytes show differences in expression of astrocytic markers in cortex, hippocampus, and cerebellum. These differences were accompanied by intra‐regional variation in expression of markers for glutamate/GABA transporters, and potassium and water channels. Differences in astrocyte structure were also found, along with complex interactions with blood vessels, microglia, and neurons. This study contributes to our knowledge of the cellular and molecular features of marmoset astrocytes and is useful for understanding the complex properties of astrocytes in the primate CNS.

Selective auditory attention within naturalistic scenes modulates reactivity to speech sounds

Rapid recognition and categorization of sounds are essential for humans and animals alike, both for understanding and reacting to our surroundings and for daily communication and social interaction. For humans, perception of speech sounds is of crucial importance. In real life, this task is complicated by the presence of a multitude of meaningful non‐speech sounds. The present behavioural, magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) study was set out to address how attention to speech versus attention to natural non‐speech sounds within complex auditory scenes influences cortical processing. The stimuli were superimpositions of spoken words and environmental sounds, with parametric variation of the speech‐to‐environmental sound intensity ratio. The participants' task was to detect a repetition in either the speech or the environmental sound. We found that specifically when participants attended to speech within the superimposed stimuli, higher speech‐to‐environmental sound ratios resulted in shorter sustained MEG responses and stronger BOLD fMRI signals especially in the left supratemporal auditory cortex and in improved behavioural performance. No such effects of speech‐to‐environmental sound ratio were observed when participants attended to the environmental sound part within the exact same stimuli. These findings suggest stronger saliency of speech compared with other meaningful sounds during processing of natural auditory scenes, likely linked to speech‐specific top‐down and bottom‐up mechanisms activated during speech perception that are needed for tracking speech in real‐life‐like auditory environments.

Visual Influences on Auditory Behavioral, Neural, and Perceptual Processes: A Review

In a naturalistic environment, auditory cues are often accompanied by information from other senses, which can be redundant with or complementary to the auditory information. Although the multisensory interactions derived from this combination of information and that shape auditory function are seen across all sensory modalities, our greatest body of knowledge to date centers on how vision influences audition. In this review, we attempt to capture the state of our understanding at this point in time regarding this topic. Following a general introduction, the review is divided into 5 sections. In the first section, we review the psychophysical evidence in humans regarding vision's influence in audition, making the distinction between vision's ability to enhance versus alter auditory performance and perception. Three examples are then described that serve to highlight vision's ability to modulate auditory processes: spatial ventriloquism, cross-modal dynamic capture, and the McGurk effect. The final part of this section discusses models that have been built based on available psychophysical data and that seek to provide greater mechanistic insights into how vision can impact audition. The second section reviews the extant neuroimaging and far-field imaging work on this topic, with a strong emphasis on the roles of feedforward and feedback processes, on imaging insights into the causal nature of audiovisual interactions, and on the limitations of current imaging-based approaches. These limitations point to a greater need for machine-learning-based decoding approaches toward understanding how auditory representations are shaped by vision. The third section reviews the wealth of neuroanatomical and neurophysiological data from animal models that highlights audiovisual interactions at the neuronal and circuit level in both subcortical and cortical structures. It also speaks to the functional significance of audiovisual interactions for two critically important facets of auditory perception-scene analysis and communication. The fourth section presents current evidence for alterations in audiovisual processes in three clinical conditions: autism, schizophrenia, and sensorineural hearing loss. These changes in audiovisual interactions are postulated to have cascading effects on higher-order domains of dysfunction in these conditions. The final section highlights ongoing work seeking to leverage our knowledge of audiovisual interactions to develop better remediation approaches to these sensory-based disorders, founded in concepts of perceptual plasticity in which vision has been shown to have the capacity to facilitate auditory learning.

Cortical connections of the functional domain for climbing or running in posterior parietal cortex of galagos

Previous studies in prosimian galagos (Otolemur garnetti) have demonstrated that posterior parietal cortex (PPC) is subdivided into several functionally distinct domains, each of which mediates a specific type of complex movements (e.g., reaching, grasping, hand-to-mouth) and has a different pattern of cortical connections. Here we identified a medially located domain in PPC where combined forelimb and hindlimb movements, as if climbing or running, were evoked by long-train intracortical microstimulation. We injected anatomical tracers in this climbing/running domain of PPC to reveal its cortical connections. Our results showed the PPC climbing domain had dense intrinsic connections within rostral PPC and reciprocal connections with forelimb and hindlimb region in primary motor cortex (M1) of the ipsilateral hemisphere. Fewer connections were with dorsal premotor cortex (PMd), supplementary motor (SMA), and cingulate motor (CMA) areas, as well as somatosensory cortex including areas 3a, 3b, and 1-2, secondary somatosensory (S2), parietal ventral (PV), and retroinsular (Ri) areas. The rostral portion of the climbing domain had more connections with primary somatosensory cortex than the caudal portion. Cortical projections were found in functionally matched domains in M1 and premotor cortex (PMC). Similar patterns of connections with fewer labeled neurons and terminals were seen in the contralateral hemisphere. These connection patterns are consistent with the proposed role of the climbing/running domain as part of a parietal-frontal network for combined use of the limbs in locomotion as in climbing and running. The cortical connections identify this action-specific domain in PPC as a more somatosensory driven domain.

Comparative Functional Anatomy of Marmoset Brains

Marmosets and closely related tamarins have become popular models for understanding aspects of human brain organization and function because they are small, reproduce and mature rapidly, and have few cortical fissures so that more cortex is visible and accessible on the surface. They are well suited for studies of development and aging. Because marmosets are highly social primates with extensive vocal communication, marmoset studies can inform theories of the evolution of language in humans. Most importantly, marmosets share basic features of major sensory and motor systems with other primates, including those of macaque monkeys and humans with larger and more complex brains. The early stages of sensory processing, including subcortical nuclei and several cortical levels for the visual, auditory, somatosensory, and motor systems, are highly similar across primates, and thus results from marmosets are relevant for making inferences about how these systems are organized and function in humans. Nevertheless, the structures in these systems are not identical across primate species, and homologous structures are much bigger and therefore function somewhat differently in human brains. In particular, the large human brain has more cortical areas that add to the complexity of information processing and storage, as well as decision-making, while making new abilities possible, such as language. Thus, inferences about human brains based on studies on marmoset brains alone should be made with a bit of caution.

Histology-Based Average Template of the Marmoset Cortex With Probabilistic Localization of Cytoarchitectural Areas

The rapid adoption of marmosets in neuroscience has created a demand for three dimensional (3D) atlases of the brain of this species to facilitate data integration in a common reference space. We report on a new open access template of the marmoset cortex (the Nencki-Monash, or NM template), representing a morphological average of 20 brains of young adult individuals, obtained by 3D reconstructions generated from Nissl-stained serial sections. The method used to generate the template takes into account morphological features of the individual brains, as well as the borders of clearly defined cytoarchitectural areas. This has resulted in a resource which allows direct estimates of the most likely coordinates of each cortical area, as well as quantification of the margins of error involved in assigning voxels to areas, and preserves quantitative information about the laminar structure of the cortex. We provide spatial transformations between the NM and other available marmoset brain templates, thus enabling integration with magnetic resonance imaging (MRI) and tracer-based connectivity data. The NM template combines some of the main advantages of histology-based atlases (e.g. information about the cytoarchitectural structure) with features more commonly associated with MRI-based templates (isotropic nature of the dataset, and probabilistic analyses). The underlying workflow may be found useful in the future development of 3D brain atlases that incorporate information about the variability of areas in species for which it may be impractical to ensure homogeneity of the sample in terms of age, sex and genetic background.

Whole brain mapping of somatosensory responses in awake marmosets investigated with ultra-high-field fMRI

The common marmoset (Callithrix jacchus) is a small-bodied New World primate that is becoming an important model to study brain functions. Despite several studies exploring the somatosensory system of marmosets, all results have come from anesthetized animals using invasive techniques and postmortem analyses. Here, we demonstrate the feasibility for getting high-quality and reproducible somatosensory mapping in awake marmosets with functional magnetic resonance imaging (fMRI). We acquired fMRI sequences in four animals, while they received tactile stimulation (via air-puffs), delivered to the face, arm, or leg. We found a topographic body representation with the leg representation in the most medial part, the face representation in the most lateral part, and the arm representation between leg and face representation within areas 3a, 3b, and 1/2. A similar sequence from leg to face from caudal to rostral sites was identified in areas S2 and PV. By generating functional connectivity maps of seeds defined in the primary and second somatosensory regions, we identified two clusters of tactile representation within the posterior and midcingulate cortex. However, unlike humans and macaques, no clear somatotopic maps were observed. At the subcortical level, we found a somatotopic body representation in the thalamus and, for the first time in marmosets, in the putamen. These maps have similar organizations, as those previously found in Old World macaque monkeys and humans, suggesting that these subcortical somatotopic organizations were already established before Old and New World primates diverged. Our results show the first whole brain mapping of somatosensory responses acquired in a noninvasive way in awake marmosets.NEW & NOTEWORTHY We used somatosensory stimulation combined with functional MRI (fMRI) in awake marmosets to reveal the topographic body representation in areas S1, S2, thalamus, and putamen. We showed the existence of a body representation organization within the thalamus and the cingulate cortex by computing functional connectivity maps from seeds defined in S1/S2, using resting-state fMRI data. This noninvasive approach will be essential for chronic studies by guiding invasive recording and manipulation techniques.

The neural mechanisms of audiotactile binding depend on asynchrony

Asynchrony is a critical cue informing the brain whether sensory signals are caused by a common source and should be integrated or segregated. This psychophysics-electroencephalography (EEG) study investigated the influence of asynchrony on how the brain binds audiotactile (AT) signals to enable faster responses in a redundant target paradigm. Human participants actively responded (psychophysics) or passively attended (EEG) to noise bursts, "taps-to-the-face" and their AT combinations at seven AT asynchronies: 0, ±20, ±70 and ±500 ms. Behaviourally, observers were faster at detecting AT than unisensory stimuli within a temporal integration window: the redundant target effect was maximal for synchronous stimuli and declined within a ≤70 ms AT asynchrony. EEG revealed a cascade of AT interactions that relied on different neural mechanisms depending on AT asynchrony. At small (≤20 ms) asynchronies, AT interactions arose for evoked response potentials (ERPs) at 110 ms and ~400 ms post-stimulus. Selectively at ±70 ms asynchronies, AT interactions were observed for the P200 ERP, theta-band inter-trial coherence (ITC) and power at ~200 ms post-stimulus. In conclusion, AT binding was mediated by distinct neural mechanisms depending on the asynchrony of the AT signals. Early AT interactions in ERPs and theta-band ITC and power were critical for the behavioural response facilitation within a ≤±70 ms temporal integration window.

Differential cortical and subcortical projection targets of subfields in the core region of mouse auditory cortex

The core region of the rodent auditory cortex has two areas: the primary auditory area (A1) and the anterior auditory field (AAF). However, the functional difference between these areas is unclear. To elucidate this issue, here we studied the projections from A1 and AAF in mice using adeno-associated virus (AAV) vectors expressing either a green fluorescent protein or a red fluorescent protein. After mapping A1 and AAF using optical imaging, we injected a distinct AAV vector into each of the two fields at a frequency-matched high-frequency location. We found that A1 and AAF projected commonly to virtually all target areas examined, but each field had its own preference for projection targets. Frontal and parietal regions were the major cortical targets: in the frontal cortex, A1 and AAF showed dominant projections to the anterior cingulate cortex Cg1 and the secondary motor cortex (M2), respectively; in the parietal cortex, A1 and AAF exhibited dense projections to the medial secondary visual cortex and the posterior parietal cortex (PPC), respectively. Although M2 and PPC received considerable input from A1 as well, A1 innervated the medial part whereas AAF innervated the lateral part of these cortical regions. A1 also projected to the orbitofrontal cortex, while AAF also projected to the primary somatosensory cortex and insular auditory cortex. As for subcortical projections, A1 and AAF projected to a common ventromedial region in the caudal striatum with a comparable strength; they also both projected to the medial geniculate body and the inferior colliculus, innervating common and distinct divisions of the nuclei. A1 also projected to visual subcortical structures, such as the superior colliculus and the lateral posterior nucleus of the thalamus, where fibres from AAF were sparse. Our results demonstrate the preference of A1 and AAF for cortical and subcortical targets, and for divisions in individual target. The preference of A1 and AAF for sensory-related structures suggest a role for A1 in providing auditory information for audio-visual association at both the cortical and subcortical level, and a distinct role of AAF in providing auditory information for association with somatomotor information in the cortex.

Corollary Discharge Mechanisms During Vocal Production in Marmoset Monkeys

Interactions between motor systems and sensory processing are ubiquitous throughout the animal kingdom and play an important role in many sensorimotor behaviors, including both human speech and animal vocalization. During vocal production, the auditory system plays important roles in both encoding feedback of produced sounds, allowing one to self-monitor for vocal errors, and simultaneously maintaining sensitivity to the outside acoustic environment. Supporting these roles is an efferent motor-to-sensory signal known as a corollary discharge. This review summarizes recent work on the role of such signaling during vocalization in the marmoset monkey, a nonhuman primate model of social vocal communication.

Cyto- and Myelo-Architecture of the Amygdaloid Complex of the Common Marmoset Monkey (Callithrix jacchus)

The amygdaloid complex (AC) is a heterogeneous aggregate of nuclei located in the rostromedial region of the temporal lobe. In addition to being partly connected among themselves, the AC nuclei are strongly interconnected with the cerebral cortex, striatum, basal forebrain, hypothalamus and brainstem. Animal and human functional studies have established that the AC is a central hub of the neuronal networks supporting emotional responsivity, particularly its negative/aversive components. Dysfunction of AC circuits in humans has been implicated in anxiety, depression, schizophrenia and bipolar disorder. The small New-World marmoset monkey (Callithrix jacchus) has recently become a key model for neuroscience research. However, the nuclear and fiber tract organization of marmoset AC has not been examined in detail. Thus, the extent to which it can be compared to the AC of Old-World (human and macaque) primates is yet unclear. Here, using Nissl and acetylcholinesterase (AChE) histochemical stains as a reference, we analyzed the cytoarchitecture and nuclear parcellation of the marmoset AC. In addition, given the increasing relevance of tractographic localization for high-resolution in vivo imaging studies in non-human primates, we also identified the myelin fiber tracts present within and around the AC as revealed by the Gallyas method. The present study provides a detailed atlas of marmoset AC. Moreover, it reveals that, despite phylogenetic distance and brain size differences, every nucleus and myelinated axon bundle described in human and macaque studies can be confidently recognized in marmosets.

Hierarchy of speech-driven spectrotemporal receptive fields in human auditory cortex

Existing data indicate that cortical speech processing is hierarchically organized. Numerous studies have shown that early auditory areas encode fine acoustic details while later areas encode abstracted speech patterns. However, it remains unclear precisely what speech information is encoded across these hierarchical levels. Estimation of speech-driven spectrotemporal receptive fields (STRFs) provides a means to explore cortical speech processing in terms of acoustic or linguistic information associated with characteristic spectrotemporal patterns. Here, we estimate STRFs from cortical responses to continuous speech in fMRI. Using a novel approach based on filtering randomly-selected spectrotemporal modulations (STMs) from aurally-presented sentences, STRFs were estimated for a group of listeners and categorized using a data-driven clustering algorithm. 'Behavioral STRFs' highlighting STMs crucial for speech recognition were derived from intelligibility judgments. Clustering revealed that STRFs in the supratemporal plane represented a broad range of STMs, while STRFs in the lateral temporal lobe represented circumscribed STM patterns important to intelligibility. Detailed analysis recovered a bilateral organization with posterior-lateral regions preferentially processing STMs associated with phonological information and anterior-lateral regions preferentially processing STMs associated with word- and phrase-level information. Regions in lateral Heschl's gyrus preferentially processed STMs associated with vocalic information (pitch).

Distributed representation of vocalization pitch in marmoset primary auditory cortex

The pitch of vocalizations is a key communication feature aiding recognition of individuals and separating sound sources in complex acoustic environments. The neural representation of the pitch of periodic sounds is well defined. However, many natural sounds, like complex vocalizations, contain rich, aperiodic or not strictly periodic frequency content and/or include high-frequency components, but still evoke a strong sense of pitch. Indeed, such sounds are the rule, not the exception but the cortical mechanisms for encoding pitch of such sounds are unknown. We investigated how neurons in the high-frequency representation of primary auditory cortex (A1) of marmosets encoded changes in pitch of four natural vocalizations, two centred around a dominant frequency similar to the neuron's best sensitivity and two around a much lower dominant frequency. Pitch was varied over a fine range that can be used by marmosets to differentiate individuals. The responses of most high-frequency A1 neurons were sensitive to pitch changes in all four vocalizations, with a smaller proportion of the neurons showing pitch-insensitive responses. Classically defined excitatory drive, from the neuron's monaural frequency response area, predicted responses to changes in vocalization pitch in <30% of neurons suggesting most pitch tuning observed is not simple frequency-level response. Moreover, 39% of A1 neurons showed call-invariant tuning of pitch. These results suggest that distributed activity across A1 can represent the pitch of natural sounds over a fine, functionally relevant range, and exhibits pitch tuning for vocalizations within and outside the classical neural tuning area.

Neuronal Distribution Across the Cerebral Cortex of the Marmoset Monkey (Callithrix jacchus)

Using stereological analysis of NeuN-stained sections, we investigated neuronal density and number of neurons per column throughout the marmoset cortex. Estimates of mean neuronal density encompassed a greater than 3-fold range, from >150 000 neurons/mm3 in the primary visual cortex to ~50 000 neurons/mm3 in the piriform complex. There was a trend for density to decrease from posterior to anterior cortex, but also local gradients, which resulted in a complex pattern; for example, in frontal, auditory, and somatosensory cortex neuronal density tended to increase towards anterior areas. Anterior cingulate, motor, premotor, insular, and ventral temporal areas were characterized by relatively low neuronal densities. Analysis across the depth of the cortex revealed greater laminar variation of neuronal density in occipital, parietal, and inferior temporal areas, in comparison with other regions. Moreover, differences between areas were more pronounced in the supragranular layers than in infragranular layers. Calculations of the number of neurons per unit column revealed a pattern that was distinct from that of neuronal density, including local peaks in the posterior parietal, superior temporal, precuneate, frontopolar, and temporopolar regions. These results suggest that neuronal distribution in adult cortex result from a complex interaction of developmental/ evolutionary determinants and functional requirements.

Functional mapping and effective connectivity of the human operculum

The operculum, defined as the cortex adjacent to the insula, is a large structure encompassing three lobes, with a recognized role in a variety of neurologic and psychiatric conditions. Its complex functions include sensory, motor, autonomic and cognitive processing. In humans, these are extended with the addition of language. These functions are implemented by highly specialized neuronal populations and their widespread connections, which our study aims at mapping in detail. We studied a group of 31 patients that were explored with intracranial electrodes during the pre-surgical workup for drug-resistant epilepsy. We have selected the subset of contacts implanted in non-epileptogenic opercular cortex and we analyzed the neurophysiological and behavioral responses to direct electrical stimulation. The functional mapping was performed by applying 1 Hz and 50 Hz electrical stimulation on 252 contact pairs and recording the threshold for evoking clinical effects. The effective connectivity was assessed using cortico-cortical evoked potentials elicited by single-pulse electrical stimulation in a subset of 19 patients. The locations of the effects grouped in twelve distinct semiological classes were analyzed. The most frequent effects evoked by stimulation of the frontal operculum were language related (29%). The Rolandic area produced most often oropharyngeal symptoms (47%), the parietal operculum produced somatosensory effects (67%), while the temporal evoked auditory (58%) semiology. The connectivity pattern was complex, with these structures having widespread ipsilateral and contralateral projections. The local connections between the opercular subregions and with the insula, as well as with more distant areas like the cingulate gyrus, were distinguished by strength and between-subjects consistency. In conclusion, we demonstrate specific opercular functionality, distinct from the one of the insular cortex. The study is complemented by a literature review on the opercular functional connectome in human and non-human primates.

Effects of Real-Time (Sonification) and Rhythmic Auditory Stimuli on Recovering Arm Function Post Stroke: A Systematic Review and Meta-Analysis

Background: External auditory stimuli have been widely used for recovering arm function post-stroke. Rhythmic and real-time auditory stimuli have been reported to enhance motor recovery by facilitating perceptuomotor representation, cross-modal processing, and neural plasticity. However, a consensus as to their influence for recovering arm function post-stroke is still warranted because of high variability noted in research methods. Objective: A systematic review and meta-analysis was carried out to analyze the effects of rhythmic and real-time auditory stimuli on arm recovery post stroke. Method: Systematic identification of published literature was performed according to PRISMA guidelines, from inception until December 2017, on online databases: Web of science, PEDro, EBSCO, MEDLINE, Cochrane, EMBASE, and PROQUEST. Studies were critically appraised using PEDro scale. Results: Of 1,889 records, 23 studies which involved 585 (226 females/359 males) patients met our inclusion criteria. The meta-analysis revealed beneficial effects of training with both types of auditory inputs for Fugl-Meyer assessment (Hedge's g: 0.79), Stroke impact scale (0.95), elbow range of motion (0.37), and reduction in wolf motor function time test (-0.55). Upon further comparison, a beneficial effect of real-time auditory feedback was found over rhythmic auditory cueing for Fugl-meyer assessment (1.3 as compared to 0.6). Moreover, the findings suggest a training dosage of 30 min to 1 h for at least 3-5 sessions per week with either of the auditory stimuli. Conclusion: This review suggests the application of external auditory stimuli for recovering arm functioning post-stroke.

A "voice patch" system in the primate brain for processing vocal information?

We review behavioural and neural evidence for the processing of information contained in conspecific vocalizations (CVs) in three primate species: humans, macaques and marmosets. We focus on abilities that are present and ecologically relevant in all three species: the detection and sensitivity to CVs; and the processing of identity cues in CVs. Current evidence, although fragmentary, supports the notion of a "voice patch system" in the primate brain analogous to the face patch system of visual cortex: a series of discrete, interconnected cortical areas supporting increasingly abstract representations of the vocal input. A central question concerns the degree to which the voice patch system is conserved in evolution. We outline challenges that arise and suggesting potential avenues for comparing the organization of the voice patch system across primate brains.

Sound Frequency Representation in the Auditory Cortex of the Common Marmoset Visualized Using Optical Intrinsic Signal Imaging

Natural sound is composed of various frequencies. Although the core region of the primate auditory cortex has functionally defined sound frequency preference maps, how the map is organized in the auditory areas of the belt and parabelt regions is not well known. In this study, we investigated the functional organizations of the core, belt, and parabelt regions encompassed by the lateral sulcus and the superior temporal sulcus in the common marmoset (Callithrix jacchus). Using optical intrinsic signal imaging, we obtained evoked responses to band-pass noise stimuli in a range of sound frequencies (0.5-16 kHz) in anesthetized adult animals and visualized the preferred sound frequency map on the cortical surface. We characterized the functionally defined organization using histologically defined brain areas in the same animals. We found tonotopic representation of a set of sound frequencies (low to high) within the primary (A1), rostral (R), and rostrotemporal (RT) areas of the core region. In the belt region, the tonotopic representation existed only in the mediolateral (ML) area. This representation was symmetric with that found in A1 along the border between areas A1 and ML. The functional structure was not very clear in the anterolateral (AL) area. Low frequencies were mainly preferred in the rostrotemplatal (RTL) area, while high frequencies were preferred in the caudolateral (CL) area. There was a portion of the parabelt region that strongly responded to higher sound frequencies (>5.8 kHz) along the border between the rostral parabelt (RPB) and caudal parabelt (CPB) regions.

Intrinsic Connections of the Core Auditory Cortical Regions and Rostral Supratemporal Plane in the Macaque Monkey

In the ventral stream of the primate auditory cortex, cortico-cortical projections emanate from the primary auditory cortex (AI) along 2 principal axes: one mediolateral, the other caudorostral. Connections in the mediolateral direction from core, to belt, to parabelt, have been well described, but less is known about the flow of information along the supratemporal plane (STP) in the caudorostral dimension. Neuroanatomical tracers were injected throughout the caudorostral extent of the auditory core and rostral STP by direct visualization of the cortical surface. Auditory cortical areas were distinguished by SMI-32 immunostaining for neurofilament, in addition to established cytoarchitectonic criteria. The results describe a pathway comprising step-wise projections from AI through the rostral and rostrotemporal fields of the core (R and RT), continuing to the recently identified rostrotemporal polar field (RTp) and the dorsal temporal pole. Each area was strongly and reciprocally connected with the areas immediately caudal and rostral to it, though deviations from strictly serial connectivity were observed. In RTp, inputs converged from core, belt, parabelt, and the auditory thalamus, as well as higher order cortical regions. The results support a rostrally directed flow of auditory information with complex and recurrent connections, similar to the ventral stream of macaque visual cortex.

Development of stereotaxic recording system for awake marmosets (Callithrix jacchus)

The common marmoset has been proposed as a potential alternative to macaque monkey as a primate model for neuroscience and medical research. Here, we have newly developed a stereotaxic neuronal recording system for awake marmosets under the head-fixed condition by modifying that for macaque monkeys. Using this system, we recorded neuronal activity in the cerebral cortex of awake marmosets and successfully identified the primary motor cortex by intracortical microstimulation. Neuronal activities of deep brain structures, such as the basal ganglia, thalamus, and cerebellum, in awake marmosets were also successfully recorded referring to magnetic resonance images. Our system is suitable for functional mapping of the brain, since the large recording chamber allows access to arbitrary regions over almost the entire brain, and the recording electrode can be easily moved stereotaxically from one site to another. In addition, our system is desirable for neuronal recording during task performance to assess motor skills and cognitive function, as the marmoset sits in the marmoset chair and can freely use its hands. Moreover, our system can be used in combination with cutting-edge techniques, such as two-photon imaging and optogenetic manipulation. This recording system will contribute to boosting neuroscience and medical research using marmosets.

Congenital deafness affects deep layers in primary and secondary auditory cortex

Congenital deafness leads to functional deficits in the auditory cortex for which early cochlear implantation can effectively compensate. Most of these deficits have been demonstrated functionally. Furthermore, the majority of previous studies on deafness have involved the primary auditory cortex; knowledge of higher-order areas is limited to effects of cross-modal reorganization. In this study, we compared the cortical cytoarchitecture of four cortical areas in adult hearing and congenitally deaf cats (CDCs): the primary auditory field A1, two secondary auditory fields, namely the dorsal zone and second auditory field (A2); and a reference visual association field (area 7) in the same section stained either using Nissl or SMI-32 antibodies. The general cytoarchitectonic pattern and the area-specific characteristics in the auditory cortex remained unchanged in animals with congenital deafness. Whereas area 7 did not differ between the groups investigated, all auditory fields were slightly thinner in CDCs, this being caused by reduced thickness of layers IV-VI. The study documents that, while the cytoarchitectonic patterns are in general independent of sensory experience, reduced layer thickness is observed in both primary and higher-order auditory fields in layer IV and infragranular layers. The study demonstrates differences in effects of congenital deafness between supragranular and other cortical layers, but similar dystrophic effects in all investigated auditory fields.

Thalamic connections of the core auditory cortex and rostral supratemporal plane in the macaque monkey

In the primate auditory cortex, information flows serially in the mediolateral dimension from core, to belt, to parabelt. In the caudorostral dimension, stepwise serial projections convey information through the primary, rostral, and rostrotemporal (AI, R, and RT) core areas on the supratemporal plane, continuing to the rostrotemporal polar area (RTp) and adjacent auditory-related areas of the rostral superior temporal gyrus (STGr) and temporal pole. In addition to this cascade of corticocortical connections, the auditory cortex receives parallel thalamocortical projections from the medial geniculate nucleus (MGN). Previous studies have examined the projections from MGN to auditory cortex, but most have focused on the caudal core areas AI and R. In this study, we investigated the full extent of connections between MGN and AI, R, RT, RTp, and STGr using retrograde and anterograde anatomical tracers. Both AI and R received nearly 90% of their thalamic inputs from the ventral subdivision of the MGN (MGv; the primary/lemniscal auditory pathway). By contrast, RT received only ∼45% from MGv, and an equal share from the dorsal subdivision (MGd). Area RTp received ∼25% of its inputs from MGv, but received additional inputs from multisensory areas outside the MGN (30% in RTp vs. 1-5% in core areas). The MGN input to RTp distinguished this rostral extension of auditory cortex from the adjacent auditory-related cortex of the STGr, which received 80% of its thalamic input from multisensory nuclei (primarily medial pulvinar). Anterograde tracers identified complementary descending connections by which highly processed auditory information may modulate thalamocortical inputs.

Age-related plasticity of the axon initial segment of cortical pyramidal cells in marmoset monkeys

Structural plasticity of the axon initial segment (AIS), the site of action potential initiation, is observed as part of the normal early development of the cortex, as well as in association with injury and disease. Here, we show that structural AIS plasticity also occurs with normal aging in adult marmosets. Immunohistochemical techniques were used to reveal the extent of the AIS of layer 2/3A pyramidal cells in 8 neocortical areas. We found that the AIS length varied significantly between areas in young adult (2-3 years old) marmosets, with neurons in frontal area 14C having the longest AIS, and those in the primary visual cortex the shortest. Similar interareal differences were observed in aged (12-14 year old) monkeys, but the AIS was significantly shortened in many areas, relative to the corresponding length in young adults. Shortening of the AIS is likely to represent a compensatory response to changes in the excitation-inhibition balance, associated with the loss of GABAergic interneurons in the aged cortex.

Representation of Glossy Material Surface in Ventral Superior Temporal Sulcal Area of Common Marmosets

The common marmoset (Callithrix jacchus) is one of the smallest species of primates, with high visual recognition abilities that allow them to judge the identity and quality of food and objects in their environment. To address the cortical processing of visual information related to material surface features in marmosets, we presented a set of stimuli that have identical three-dimensional shapes (bone, torus or amorphous) but different material appearances (ceramic, glass, fur, leather, metal, stone, wood, or matte) to anesthetized marmoset, and recorded multiunit activities from an area ventral to the superior temporal sulcus (STS) using multi-shanked, and depth resolved multi-electrode array. Out of 143 visually responsive multiunits recorded from four animals, 29% had significant main effect only of the material, 3% only of the shape and 43% of both the material and the shape. Furthermore, we found neuronal cluster(s), in which most cells: (1) showed a significant main effect in material appearance; (2) the best stimulus was a glossy material (glass or metal); and (3) had reduced response to the pixel-shuffled version of the glossy material images. The location of the gloss-selective area was in agreement with previous macaque studies, showing activation in the ventral bank of STS. Our results suggest that perception of gloss is an important ability preserved across wide range of primate species.

Contributions of sensory tuning to auditory-vocal interactions in marmoset auditory cortex

During speech, humans continuously listen to their own vocal output to ensure accurate communication. Such self-monitoring is thought to require the integration of information about the feedback of vocal acoustics with internal motor control signals. The neural mechanism of this auditory-vocal interaction remains largely unknown at the cellular level. Previous studies in naturally vocalizing marmosets have demonstrated diverse neural activities in auditory cortex during vocalization, dominated by a vocalization-induced suppression of neural firing. How underlying auditory tuning properties of these neurons might contribute to this sensory-motor processing is unknown. In the present study, we quantitatively compared marmoset auditory cortex neural activities during vocal production with those during passive listening. We found that neurons excited during vocalization were readily driven by passive playback of vocalizations and other acoustic stimuli. In contrast, neurons suppressed during vocalization exhibited more diverse playback responses, including responses that were not predictable by auditory tuning properties. These results suggest that vocalization-related excitation in auditory cortex is largely a sensory-driven response. In contrast, vocalization-induced suppression is not well predicted by a neuron's auditory responses, supporting the prevailing theory that internal motor-related signals contribute to the auditory-vocal interaction observed in auditory cortex.

Selective Neuronal Activation by Cochlear Implant Stimulation in Auditory Cortex of Awake Primate

Despite the success of cochlear implants (CIs) in human populations, most users perform poorly in noisy environments and music and tonal language perception. How CI devices engage the brain at the single neuron level has remained largely unknown, in particular in the primate brain. By comparing neuronal responses with acoustic and CI stimulation in marmoset monkeys unilaterally implanted with a CI electrode array, we discovered that CI stimulation was surprisingly ineffective at activating many neurons in auditory cortex, particularly in the hemisphere ipsilateral to the CI. Further analyses revealed that the CI-nonresponsive neurons were narrowly tuned to frequency and sound level when probed with acoustic stimuli; such neurons likely play a role in perceptual behaviors requiring fine frequency and level discrimination, tasks that CI users find especially challenging. These findings suggest potential deficits in central auditory processing of CI stimulation and provide important insights into factors responsible for poor CI user performance in a wide range of perceptual tasks.

SIGNIFICANCE STATEMENT

The cochlear implant (CI) is the most successful neural prosthetic device to date and has restored hearing in hundreds of thousands of deaf individuals worldwide. However, despite its huge successes, CI users still face many perceptual limitations, and the brain mechanisms involved in hearing through CI devices remain poorly understood. By directly comparing single-neuron responses to acoustic and CI stimulation in auditory cortex of awake marmoset monkeys, we discovered that neurons unresponsive to CI stimulation were sharply tuned to frequency and sound level. Our results point out a major deficit in central auditory processing of CI stimulation and provide important insights into mechanisms underlying the poor CI user performance in a wide range of perceptual tasks.

Distinct Subthreshold Mechanisms Underlying Rate-Coding Principles in Primate Auditory Cortex

A key computational principle for encoding time-varying signals in auditory and somatosensory cortices of monkeys is the opponent model of rate coding by two distinct populations of neurons. However, the subthreshold mechanisms that give rise to this computation have not been revealed. Because the rate-coding neurons are only observed in awake conditions, it is especially challenging to probe their underlying cellular mechanisms. Using a novel intracellular recording technique that we developed in awake marmosets, we found that the two types of rate-coding neurons in auditory cortex exhibited distinct subthreshold responses. While the positive-monotonic neurons (monotonically increasing firing rate with increasing stimulus repetition frequency) displayed sustained depolarization at high repetition frequency, the negative-monotonic neurons (opposite trend) instead exhibited hyperpolarization at high repetition frequency but sustained depolarization at low repetition frequency. The combination of excitatory and inhibitory subthreshold events allows the cortex to represent time-varying signals through these two opponent neuronal populations.

A dynamical framework to relate perceptual variability with multisensory information processing

Multisensory processing involves participation of individual sensory streams, e.g., vision, audition to facilitate perception of environmental stimuli. An experimental realization of the underlying complexity is captured by the “McGurk-effect”- incongruent auditory and visual vocalization stimuli eliciting perception of illusory speech sounds. Further studies have established that time-delay between onset of auditory and visual signals (AV lag) and perturbations in the unisensory streams are key variables that modulate perception. However, as of now only few quantitative theoretical frameworks have been proposed to understand the interplay among these psychophysical variables or the neural systems level interactions that govern perceptual variability. Here, we propose a dynamic systems model consisting of the basic ingredients of any multisensory processing, two unisensory and one multisensory sub-system (nodes) as reported by several researchers. The nodes are connected such that biophysically inspired coupling parameters and time delays become key parameters of this network. We observed that zero AV lag results in maximum synchronization of constituent nodes and the degree of synchronization decreases when we have non-zero lags. The attractor states of this network can thus be interpreted as the facilitator for stabilizing specific perceptual experience. Thereby, the dynamic model presents a quantitative framework for understanding multisensory information processing.