Efferent cortical connections of multimodal cortex of the superior temporal sulcus in the rhesus monkey

Episodic Memory formation: A review of complex Hippocampus input pathways

Memories of everyday experiences involve the encoding of a rich and dynamic representation of present objects and their contextual features. Traditionally, the resulting mnemonic trace is referred to as Episodic Memory, i.e. the "what", "where" and "when" of a lived episode. The journey for such memory trace encoding begins with the perceptual data of an experienced episode handled in sensory brain regions. The information is then streamed to cortical areas located in the ventral Medio Temporal Lobe, which produces multi-modal representations concerning either the objects (in the Perirhinal cortex) or the spatial and contextual features (in the parahippocampal region) of the episode. Then, this high-level data is gated through the Entorhinal Cortex and forwarded to the Hippocampal Formation, where all the pieces get bound together. Eventually, the resulting encoded neural pattern is relayed back to the Neocortex for a stable consolidation. This review will detail these different stages and provide a systematic overview of the major cortical streams toward the Hippocampus relevant for Episodic Memory encoding.

Dodecyl creatine ester improves cognitive function and identifies key protein drivers including KIF1A and PLCB1 in a mouse model of creatine transporter deficiency

Creatine transporter deficiency (CTD), a leading cause of intellectual disability is a result of the mutation in the gene encoding the creatine transporter SLC6A8, which prevents creatine uptake into the brain, causing mental retardation, expressive speech and language delay, autistic-like behavior and epilepsy. Preclinical in vitro and in vivo data indicate that dodecyl creatine ester (DCE) which increases the creatine brain content, might be a therapeutic option for CTD patients. To gain a better understanding of the pathophysiology and DCE treatment efficacy in CTD, this study focuses on the identification of biomarkers related to cognitive improvement in a Slc6a8 knockout mouse model (Slc6a8−/y) engineered to mimic the clinical features of CTD patients which have low brain creatine content. Shotgun proteomics analysis of 4,035 proteins in four different brain regions; the cerebellum, cortex, hippocampus (associated with cognitive functions) and brain stem, and muscle as a control, was performed in 24 mice. Comparison of the protein abundance in the four brain regions between DCE-treated intranasally Slc6a8−/y mice and wild type and DCE-treated Slc6a8−/y and vehicle group identified 14 biomarkers, shedding light on the mechanism of action of DCE. Integrative bioinformatics and statistical modeling identified key proteins in CTD, including KIF1A and PLCB1. The abundance of these proteins in the four brain regions was significantly correlated with both the object recognition and the Y-maze tests. Our findings suggest a major role for PLCB1, KIF1A, and associated molecules in the pathogenesis of CTD.

Temporopolar regions of the human brain

Following prolonged neglect during the formative decades of behavioural neurology, the temporopolar region has become a site of vibrant research on the neurobiology of cognition and conduct. This turnaround can be attributed to increasing recognition of neurodegenerative diseases that target temporopolar regions for peak destruction. The resultant syndromes include behavioural dementia, associative agnosia, semantic forms of primary progressive aphasia and semantic dementia. Clinicopathological correlations show that object naming and word comprehension are critically dependent on the language-dominant (usually left) temporopolar region, whereas behavioural control and non-verbal object recognition display a more bilateral representation with a rightward bias. Neuroanatomical experiments in macaques and neuroimaging in humans show that the temporoparietal region sits at the confluence of auditory, visual and limbic streams of processing at the downstream (deep) pole of the 'what' pathway. The functional neuroanatomy of this region revolves around three axes, an anterograde horizontal axis from unimodal to heteromodal and paralimbic cortex; a radial axis where visual (ventral), auditory (dorsal) and paralimbic (medial) territories encircle temporopolar cortex and display hemispheric asymmetry; and a vertical depth-of-processing axis for the associative elaboration of words, objects and interoceptive states. One function of this neural matrix is to support the transformation of object and word representations from unimodal percepts to multimodal concepts. The underlying process is likely to start at canonical gateways that successively lead to generic (superordinate), specific (basic) and unique levels of recognition. A first sign of left temporopolar dysfunction takes the form of taxonomic blurring where boundaries among categories are preserved but not boundaries among exemplars of a category. Semantic paraphasias and coordinate errors in word-picture verification tests are consequences of this phenomenon. Eventually, boundaries among categories are also blurred and comprehension impairments become more profound. The medial temporopolar region belongs to the amygdalocentric component of the limbic system and stands to integrate exteroceptive information with interoceptive states underlying social interactions. Review of the pertinent literature shows that word comprehension and conduct impairments caused by temporopolar strokes and temporal lobectomy are far less severe than those seen in temporopolar atrophies. One explanation for this unexpected discrepancy invokes the miswiring of residual temporopolar neurons during the many years of indolently progressive neurodegeneration. According to this hypothesis, the temporopolar regions become not only dysfunctional but also sources of aberrant outputs that interfere with the function of areas elsewhere in the language and paralimbic networks, a juxtaposition not seen in lobectomy or stroke.

Extrahippocampal Radiomics Analysis Can Potentially Identify Laterality in Patients With MRI-Negative Temporal Lobe Epilepsy

Objective: The objective of the study was to investigate whether radiomics features of extrahippocampal regions differ between patients with epilepsy and healthy controls, and whether any differences can identify patients with magnetic resonance imaging (MRI)-negative temporal lobe epilepsy (TLE).

Methods: Data from 36 patients with hippocampal sclerosis (HS) and 50 healthy controls were used to construct a radiomics model. A total of 1,618 radiomics features from the affected hippocampal and extrahippocampal regions were compared with features from healthy controls and the unaffected side of patients. Using a stepwise selection method with a univariate t-test and elastic net penalization, significant predictors for identifying TLE were separately selected for the hippocampus (H+) and extrahippocampal region (H–). Each model was independently validated with an internal set of MRI-negative adult TLE patients (n = 22) and pediatric validation cohort with MRI-negative TLE (n = 20) from another tertiary center; diagnostic performance was calculated using area under the curve (AUC) of the receiver-operating-characteristic curve analysis.

Results: Forty-eight significant H+ radiomic features and 99 significant H– radiomic features were selected from the affected side of patients and used to create a hippocampus model and an extrahippocampal model, respectively. Texture features were the most frequently selected feature. Training set showed slightly higher accuracy between hippocampal (AUC = 0.99) and extrahippocampal model (AUC = 0.97). In the internal validation and external validation sets, the extrahippocampal model (AUC = 0.80 and 0.92, respectively) showed higher diagnostic performance for identifying the affected side of patients than the hippocampus model (AUC = 0.67 and 0.69).

Significance: Radiomics revealed extrahippocampal abnormality in the affected side of patients with TLE and could potentially help to identify MRI-negative TLE.

Classification of Evidence: Class IV Criteria for Rating Diagnostic Accuracy Studies.

Vision perceptually restores auditory spectral dynamics in speech

Visual speech facilitates auditory speech perception, but the visual cues responsible for these benefits and the information they provide remain unclear. Low-level models emphasize basic temporal cues provided by mouth movements, but these impoverished signals may not fully account for the richness of auditory information provided by visual speech. High-level models posit interactions among abstract categorical (i.e., phonemes/visemes) or amodal (e.g., articulatory) speech representations, but require lossy remapping of speech signals onto abstracted representations. Because visible articulators shape the spectral content of speech, we hypothesized that the perceptual system might exploit natural correlations between midlevel visual (oral deformations) and auditory speech features (frequency modulations) to extract detailed spectrotemporal information from visual speech without employing high-level abstractions. Consistent with this hypothesis, we found that the time-frequency dynamics of oral resonances (formants) could be predicted with unexpectedly high precision from the changing shape of the mouth during speech. When isolated from other speech cues, speech-based shape deformations improved perceptual sensitivity for corresponding frequency modulations, suggesting that listeners could exploit this cross-modal correspondence to facilitate perception. To test whether this type of correspondence could improve speech comprehension, we selectively degraded the spectral or temporal dimensions of auditory sentence spectrograms to assess how well visual speech facilitated comprehension under each degradation condition. Visual speech produced drastically larger enhancements during spectral degradation, suggesting a condition-specific facilitation effect driven by cross-modal recovery of auditory speech spectra. The perceptual system may therefore use audiovisual correlations rooted in oral acoustics to extract detailed spectrotemporal information from visual speech.

Correction to: Multi-scale account of the network structure of macaque visual cortex

Unfortunately, some errors slipped into the manuscript, which we correct here.

Directional Visual Motion Is Represented in the Auditory and Association Cortices of Early Deaf Individuals

Individuals who are deaf since early life may show enhanced performance at some visual tasks, including discrimination of directional motion. The neural substrates of such behavioral enhancements remain difficult to identify in humans, although neural plasticity has been shown for early deaf people in the auditory and association cortices, including the primary auditory cortex (PAC) and STS region, respectively. Here, we investigated whether neural responses in auditory and association cortices of early deaf individuals are reorganized to be sensitive to directional visual motion. To capture direction-selective responses, we recorded fMRI responses frequency-tagged to the 0.1-Hz presentation of central directional (100% coherent random dot) motion persisting for 2 sec contrasted with nondirectional (0% coherent) motion for 8 sec. We found direction-selective responses in the STS region in both deaf and hearing participants, but the extent of activation in the right STS region was 5.5 times larger for deaf participants. Minimal but significant direction-selective responses were also found in the PAC of deaf participants, both at the group level and in five of six individuals. In response to stimuli presented separately in the right and left visual fields, the relative activation across the right and left hemispheres was similar in both the PAC and STS region of deaf participants. Notably, the enhanced right-hemisphere activation could support the right visual field advantage reported previously in behavioral studies. Taken together, these results show that the reorganized auditory cortices of early deaf individuals are sensitive to directional motion. Speculatively, these results suggest that auditory and association regions can be remapped to support enhanced visual performance.

Optimization of macaque brain DMRI connectome by neuron tracing and myelin stain data

Accurate assessment of connectional anatomy of primate brains can be an important avenue to better understand the structural and functional organization of brains. To this end, numerous connectome projects have been initiated to create a comprehensive map of the connectional anatomy over a large spatial expanse. Tractography based on diffusion MRI (dMRI) data has been used as a tool by many connectome projects in that it is widely used to visualize axonal pathways and reveal microstructural features on living brains. However, the measures obtained from dMRI are indirect inference of microstructures. This intrinsic limitation reduces the reliability of dMRI in constructing connectomes for brains. In this work, we proposed a framework to increase the accuracy of constructing a dMRI-based connectome on macaque brains by integrating meso-scale connective information from tract-tracing data and micro-scale axonal orientation information from myelin stain data. Our results suggest that this integrative framework could advance the mapping accuracy of dMRI based connections and axonal pathways, and demonstrate the prospect of the proposed framework in constructing a large-scale connectome on living primate brains.

A multi-scale layer-resolved spiking network model of resting-state dynamics in macaque visual cortical areas

Cortical activity has distinct features across scales, from the spiking statistics of individual cells to global resting-state networks. We here describe the first full-density multi-area spiking network model of cortex, using macaque visual cortex as a test system. The model represents each area by a microcircuit with area-specific architecture and features layer- and population-resolved connectivity between areas. Simulations reveal a structured asynchronous irregular ground state. In a metastable regime, the network reproduces spiking statistics from electrophysiological recordings and cortico-cortical interaction patterns in fMRI functional connectivity under resting-state conditions. Stable inter-area propagation is supported by cortico-cortical synapses that are moderately strong onto excitatory neurons and stronger onto inhibitory neurons. Causal interactions depend on both cortical structure and the dynamical state of populations. Activity propagates mainly in the feedback direction, similar to experimental results associated with visual imagery and sleep. The model unifies local and large-scale accounts of cortex, and clarifies how the detailed connectivity of cortex shapes its dynamics on multiple scales. Based on our simulations, we hypothesize that in the spontaneous condition the brain operates in a metastable regime where cortico-cortical projections target excitatory and inhibitory populations in a balanced manner that produces substantial inter-area interactions while maintaining global stability.

The mammalian cortex fulfills its complex tasks by operating on multiple temporal and spatial scales from single cells to entire areas comprising millions of cells. These multi-scale dynamics are supported by specific network structures at all levels of organization. Since models of cortex hitherto tend to concentrate on a single scale, little is known about how cortical structure shapes the multi-scale dynamics of the network. We here present dynamical simulations of a multi-area network model at neuronal and synaptic resolution with population-specific connectivity based on extensive experimental data which accounts for a wide range of dynamical phenomena. Our model elucidates relationships between local and global scales in cortex and provides a platform for future studies of cortical function.

Neural correlates of taste reactivity in autism spectrum disorder

Selective or 'picky' eating habits are common among those with autism spectrum disorder (ASD). These behaviors are often related to aberrant sensory experience in individuals with ASD, including heightened reactivity to food taste and texture. However, very little is known about the neural mechanisms that underlie taste reactivity in ASD. In the present study, food-related neural responses were evaluated in 21 young adult and adolescent males diagnosed with ASD without intellectual disability, and 21 typically-developing (TD) controls. Taste reactivity was assessed using the Adolescent/Adult Sensory Profile, a clinical self-report measure. Functional magnetic resonance imaging was used to evaluate hemodynamic responses to sweet (vs. neutral) tastants and food pictures. Subjects also underwent resting-state functional connectivity scans.The ASD and TD individuals did not differ in their hemodynamic response to gustatory stimuli. However, the ASD subjects, but not the controls, exhibited a positive association between self-reported taste reactivity and the response to sweet tastants within the insular cortex and multiple brain regions associated with gustatory perception and reward. There was a strong interaction between diagnostic group and taste reactivity on tastant response in brain regions associated with ASD pathophysiology, including the bilateral anterior superior temporal sulcus (STS). This interaction of diagnosis and taste reactivity was also observed in the resting state functional connectivity between the anterior STS and dorsal mid-insula (i.e., gustatory cortex).These results suggest that self-reported heightened taste reactivity in ASD is associated with heightened brain responses to food-related stimuli and atypical functional connectivity of primary gustatory cortex, which may predispose these individuals to maladaptive and unhealthy patterns of selective eating behavior.

Trial registration

(clinicaltrials.gov identifier) NCT01031407. Registered: December 14, 2009.

Cross-modal and non-monotonic representations of statistical regularity are encoded in local neural response patterns

Current neurobiological models assign a central role to predictive processes calibrated to environmental statistics. Neuroimaging studies examining the encoding of stimulus uncertainty have relied almost exclusively on manipulations in which stimuli were presented in a single sensory modality, and further assumed that neural responses vary monotonically with uncertainty. This has left a gap in theoretical development with respect to two core issues: (i) are there cross-modal brain systems that encode input uncertainty in way that generalizes across sensory modalities, and (ii) are there brain systems that track input uncertainty in a non-monotonic fashion? We used multivariate pattern analysis to address these two issues using auditory, visual and audiovisual inputs. We found signatures of cross-modal encoding in frontoparietal, orbitofrontal, and association cortices using a searchlight cross-classification analysis where classifiers trained to discriminate levels of uncertainty in one modality were tested in another modality. Additionally, we found widespread systems encoding uncertainty non-monotonically using classifiers trained to discriminate intermediate levels of uncertainty from both the highest and lowest uncertainty levels. These findings comprise the first comprehensive report of cross-modal and non-monotonic neural sensitivity to statistical regularities in the environment, and suggest that conventional paradigms testing for monotonic responses to uncertainty in a single sensory modality may have limited generalizability.

The auditory cortex hosts network nodes influential for emotion processing: An fMRI study on music-evoked fear and joy

Sound is a potent elicitor of emotions. Auditory core, belt and parabelt regions have anatomical connections to a large array of limbic and paralimbic structures which are involved in the generation of affective activity. However, little is known about the functional role of auditory cortical regions in emotion processing. Using functional magnetic resonance imaging and music stimuli that evoke joy or fear, our study reveals that anterior and posterior regions of auditory association cortex have emotion-characteristic functional connectivity with limbic/paralimbic (insula, cingulate cortex, and striatum), somatosensory, visual, motor-related, and attentional structures. We found that these regions have remarkably high emotion-characteristic eigenvector centrality, revealing that they have influential positions within emotion-processing brain networks with “small-world” properties. By contrast, primary auditory fields showed surprisingly strong emotion-characteristic functional connectivity with intra-auditory regions. Our findings demonstrate that the auditory cortex hosts regions that are influential within networks underlying the affective processing of auditory information. We anticipate our results to incite research specifying the role of the auditory cortex—and sensory systems in general—in emotion processing, beyond the traditional view that sensory cortices have merely perceptual functions.

Gender Differences in Food Choice: Effects of Superior Temporal Sulcus Stimulation

The easy availability of food has caused a shift from eating for survival to hedonic eating. Women, compared to men, have shown to respond differently to food cues in the environment on a behavioral and a neural level, in particular to energy rich (compared to low energy) foods. It has been demonstrated that the right posterior superior temporal sulcus (STS) is the only region exhibiting greater activation for high vs. low calorie food choices. In order to test for a possible causal role of STS in food choice, we applied high frequency transcranial random noise stimulation (tRNS) on STS assuming a different response pattern between males and females. Our participants (18 females, 17 males) performed a forced choice task between food pairs matched for individual liking but differed in calorie, during the left STS, right STS stimulation and sham condition. Male participants showed a general preference for low calorie (LC) foods compared to females. In addition, we observed in males, but not in females, an increase of high calorie (HC) food choice during right STS tRNS compared to sham condition and left STS tRNS. Finally, we found an increase of missed choices during right STS stimulation compared to sham condition and left STS stimulation. In conclusion, thanks to tRNS evidence, we both confirm the involvement and suggest a causal role of right posterior STS in feeding behavior. Moreover, we suggest that gender differences exist in STS mechanisms underlying food choice.

Multi-scale account of the network structure of macaque visual cortex

Cortical network structure has been extensively characterized at the level of local circuits and in terms of long-range connectivity, but seldom in a manner that integrates both of these scales. Furthermore, while the connectivity of cortex is known to be related to its architecture, this knowledge has not been used to derive a comprehensive cortical connectivity map. In this study, we integrate data on cortical architecture and axonal tracing data into a consistent multi-scale framework of the structure of one hemisphere of macaque vision-related cortex. The connectivity model predicts the connection probability between any two neurons based on their types and locations within areas and layers. Our analysis reveals regularities of cortical structure. We confirm that cortical thickness decays with cell density. A gradual reduction in neuron density together with the relative constancy of the volume density of synapses across cortical areas yields denser connectivity in visual areas more remote from sensory inputs and of lower structural differentiation. Further, we find a systematic relation between laminar patterns on source and target sides of cortical projections, extending previous findings from combined anterograde and retrograde tracing experiments. Going beyond the classical schemes, we statistically assign synapses to target neurons based on anatomical reconstructions, which suggests that layer 4 neurons receive substantial feedback input. Our derived connectivity exhibits a community structure that corresponds more closely with known functional groupings than previous connectivity maps and identifies layer-specific directional differences in cortico-cortical pathways. The resulting network can form the basis for studies relating structure to neural dynamics in mammalian cortex at multiple scales.

Fundamental Activity Constraints Lead to Specific Interpretations of the Connectome

The continuous integration of experimental data into coherent models of the brain is an increasing challenge of modern neuroscience. Such models provide a bridge between structure and activity, and identify the mechanisms giving rise to experimental observations. Nevertheless, structurally realistic network models of spiking neurons are necessarily underconstrained even if experimental data on brain connectivity are incorporated to the best of our knowledge. Guided by physiological observations, any model must therefore explore the parameter ranges within the uncertainty of the data. Based on simulation results alone, however, the mechanisms underlying stable and physiologically realistic activity often remain obscure. We here employ a mean-field reduction of the dynamics, which allows us to include activity constraints into the process of model construction. We shape the phase space of a multi-scale network model of the vision-related areas of macaque cortex by systematically refining its connectivity. Fundamental constraints on the activity, i.e., prohibiting quiescence and requiring global stability, prove sufficient to obtain realistic layer- and area-specific activity. Only small adaptations of the structure are required, showing that the network operates close to an instability. The procedure identifies components of the network critical to its collective dynamics and creates hypotheses for structural data and future experiments. The method can be applied to networks involving any neuron model with a known gain function.

Anatomic organization of the auditory cortex

The auditory cortex is a network of areas in the part of the brain that receives inputs from the subcortical auditory pathways in the brainstem and thalamus. Through an elaborate network of intrinsic and extrinsic connections, the auditory cortex is thought to bring about the conscious perception of sound and provide a basis for the comprehension and production of meaningful utterances. In this chapter, the organization of auditory cortex is described with an emphasis on its anatomic features and the flow of information within the network. These features are then used to introduce key neurophysiologic concepts that are being intensively studied in humans and animal models. The discussion is presented in the context of our working model of the primate auditory cortex and extensions to humans. The material is presented in the context of six underlying principles, which reflect distinct, but related, aspects of anatomic and physiologic organization: (1) the division of auditory cortex into regions; (2) the subdivision of regions into areas; (3) tonotopic organization of areas; (4) thalamocortical connections; (5) serial and parallel organization of connections; and (6) topographic relationships between auditory and auditory-related areas. Although the functional roles of the various components of this network remain poorly defined, a more complete understanding is emerging from ongoing studies that link auditory behavior to its anatomic and physiologic substrates.

Feedforward and feedback projections of caudal belt and parabelt areas of auditory cortex: refining the hierarchical model

Our working model of the primate auditory cortex recognizes three major regions (core, belt, parabelt), subdivided into thirteen areas. The connections between areas are topographically ordered in a manner consistent with information flow along two major anatomical axes: core-belt-parabelt and caudal-rostral. Remarkably, most of the connections supporting this model were revealed using retrograde tracing techniques. Little is known about laminar circuitry, as anterograde tracing of axon terminations has rarely been used. The purpose of the present study was to examine the laminar projections of three areas of auditory cortex, pursuant to analysis of all areas. The selected areas were: middle lateral belt (ML); caudomedial belt (CM); and caudal parabelt (CPB). Injections of anterograde tracers yielded data consistent with major features of our model, and also new findings that compel modifications. Results supporting the model were: (1) feedforward projection from ML and CM terminated in CPB; (2) feedforward projections from ML and CPB terminated in rostral areas of the belt and parabelt; and (3) feedback projections typified inputs to the core region from belt and parabelt. At odds with the model was the convergence of feedforward inputs into rostral medial belt from ML and CPB. This was unexpected since CPB is at a higher stage of the processing hierarchy, with mainly feedback projections to all other belt areas. Lastly, extending the model, feedforward projections from CM, ML, and CPB overlapped in the temporal parietal occipital area (TPO) in the superior temporal sulcus, indicating significant auditory influence on sensory processing in this region. The combined results refine our working model and highlight the need to complete studies of the laminar inputs to all areas of auditory cortex. Their documentation is essential for developing informed hypotheses about the neurophysiological influences of inputs to each layer and area.

Prediction of antidepressant treatment response from gray matter volume across diagnostic categories

Dysfunctional limbic, paralimbic and prefrontal brain circuits represent neural substrates of major depression that are targeted by pharmacotherapy. In a high resolution structural magnetic resonance imaging (MRI) study we investigated the potential of variability of the cortex volume to predict the response to antidepressant treatment among patients with major depression. We enrolled 167 patients participating in the Munich Antidepressant Response Signature (MARS) study and employed voxel based morphometry to investigate covariation of gray matter (GM) maps with changes of depression severity over 5 weeks. Larger left hippocampal and bilateral posterior cingulate GM volumes and lower right temporolateral GM volumes were associated with beneficial treatment response. Subcallosal/orbitofrontal GM volumes were associated with treatment response mainly through gender-by-region interactions. A hippocampal/temporolateral composite marker proved robust in both first episode and recurrent unipolar patients and in bipolar patients. Compared with 92 healthy controls, abnormally low volumes were only detected in the left hippocampal area, particularly in recurrent unipolar patients. These findings indicate that variability of the cortex volume of specific brain areas is associated with different response to antidepressants. In addition, hippocampal findings recursively link together unfavorable treatment response and progressive hippocampal structural changes in recurrent depression.

Functional activity and effective connectivity of the posterior medial prefrontal cortex during processing of incongruent mental states

The neurocognitive components of Theory of Mind reasoning remain poorly understood. In particular the role of the posterior medial prefrontal cortex in the processing of other's mental states such as beliefs that are incongruent with one's own knowledge of reality is not clear-cut. It is unknown whether this region is involved in computing discrepant mental states or in subsequently resolving a response conflict between the discrepant others' and one's own beliefs. To test this, we adapted a false belief paradigm for the separate inspection of functional brain activity related to (1) the computation of diverging beliefs and (2) the subsequent consideration and selection of another's or one's own belief. Based on statistical parametric findings from functional neuroimaging, we employed dynamic causal modelling combined with Bayesian model selection to further characterize the interplay of resulting brain regions. In the initial computation of diverging beliefs, the posterior medial prefrontal cortex (pMPFC) and the bilateral temporoparietal cortex were crucially involved. The findings suggest that the bilateral temporal cortex engages in the construction and adjustment of diverging mental states by encoding relevant environmental information. The pMPFC inhibits this stimulus-bound processing which helps to compute discrepant mental states and process another's false belief decoupled from one's own perception of reality. In the subsequent question phase the right temporoparietal cortex showed increased activity related to switching to and reconsidering another's beliefs in order to select the correct response.

Plasticity in unimodal and multimodal brain areas reflects multisensory changes in self-face identification

Nothing provides as strong a sense of self as seeing one's face. Nevertheless, it remains unknown how the brain processes the sense of self during the multisensory experience of looking at one's face in a mirror. Synchronized visuo-tactile stimulation on one's own and another's face, an experience that is akin to looking in the mirror but seeing another's face, causes the illusory experience of ownership over the other person's face and changes in self-recognition. Here, we investigate the neural correlates of this enfacement illusion using fMRI. We examine activity in the human brain as participants experience tactile stimulation delivered to their face, while observing either temporally synchronous or asynchronous tactile stimulation delivered to another's face on either a specularly congruent or incongruent location. Activity in the multisensory right temporo-parietal junction, intraparietal sulcus, and the unimodal inferior occipital gyrus showed an interaction between the synchronicity and the congruency of the stimulation and varied with the self-reported strength of the illusory experience, which was recorded after each stimulation block. Our results highlight the important interplay between unimodal and multimodal information processing for self-face recognition, and elucidate the neurobiological basis for the plasticity required for identifying with our continuously changing visual appearance.

Bridging the gap between neuroscientific and psychodynamic models in child and adolescent psychiatry

This article provides a selective review of the neuroscience and child-psychoanalytic literature, focusing on areas of significant overlap and emphasizing comprehensive theories in developmental neuroscience and child psychoanalysis with testable mechanisms of action. Topics include molecular biology and genetics findings relevant to psychotherapy research, neuroimaging findings relevant to psychotherapy, brain regions of interest for psychotherapy, neurobiologic changes caused by psychotherapy, use of neuroimaging to predict treatment outcome, and schemas as a bridging concept between psychodynamic and cognitive neuroscience models. The combined efforts of neuroscientists and psychodynamic clinicians and theorists are needed to unravel the mechanisms of human mental functioning.

Sight and sound converge to form modality-invariant representations in temporoparietal cortex

People can identify objects in the environment with remarkable accuracy, regardless of the sensory modality they use to perceive them. This suggests that information from different sensory channels converges somewhere in the brain to form modality-invariant representations, i.e., representations that reflect an object independently of the modality through which it has been apprehended. In this functional magnetic resonance imaging study of human subjects, we first identified brain areas that responded to both visual and auditory stimuli and then used crossmodal multivariate pattern analysis to evaluate the neural representations in these regions for content specificity (i.e., do different objects evoke different representations?) and modality invariance (i.e., do the sight and the sound of the same object evoke a similar representation?). While several areas became activated in response to both auditory and visual stimulation, only the neural patterns recorded in a region around the posterior part of the superior temporal sulcus displayed both content specificity and modality invariance. This region thus appears to play an important role in our ability to recognize objects in our surroundings through multiple sensory channels and to process them at a supramodal (i.e., conceptual) level.

Beyond the arcuate fasciculus: consensus and controversy in the connectional anatomy of language

The growing consensus that language is distributed into large-scale cortical and subcortical networks has brought with it an increasing focus on the connectional anatomy of language, or how particular fibre pathways connect regions within the language network. Understanding connectivity of the language network could provide critical insights into function, but recent investigations using a variety of methodologies in both humans and non-human primates have provided conflicting accounts of pathways central to language. Some of the pathways classically considered language pathways, such as the arcuate fasciculus, are now argued to be domain-general rather than specialized, which represents a radical shift in perspective. Other pathways described in the non-human primate remain to be verified in humans. In this review, we examine the consensus and controversy in the study of fibre pathway connectivity for language. We focus on seven fibre pathways-the superior longitudinal fasciculus and arcuate fasciculus, the uncinate fasciculus, extreme capsule, middle longitudinal fasciculus, inferior longitudinal fasciculus and inferior fronto-occipital fasciculus-that have been proposed to support language in the human. We examine the methods in humans and non-human primate used to investigate the connectivity of these pathways, the historical context leading to the most current understanding of their anatomy, and the functional and clinical correlates of each pathway with reference to language. We conclude with a challenge for researchers and clinicians to establish a coherent framework within which fibre pathway connectivity can be systematically incorporated to the study of language.

A voxel-based morphometry study of gray and white matter correlates of a need for uniqueness

People appear to derive intrinsic satisfaction from the perception that they are unique, special, and separable from the masses, which is referred to as a need for uniqueness (NFU). NFU is a universal human trait, along with a tendency to conform to the beliefs and attitudes of others and social norms. We used voxel-based morphometry and a questionnaire to determine individual NFU and its association with brain structures in healthy men (94) and women (91; age, 21.3 ± 1.9 years). Individual NFU was associated with smaller gray matter volume of a cluster that included areas in (a) the left middle temporal gyrus, left superior temporal gyrus, and left superior temporal sulcus (STS); (b) the dorsal part of the anterior cingulate gyrus and the anterior part of the middle cingulate gyrus; and (c) the right inferior frontal gyrus and the ventral part of the precentral gyrus. Individual NFU was also associated with larger white matter concentration of a cluster that mainly included the body of the corpus callosum. These findings demonstrated that variations in NFU reflect the gray and white matter structures of focal regions. These findings suggest a biological basis for individual NFU, distributed across different gray and white matter areas of the brain.

The organization of the human striatum estimated by intrinsic functional connectivity

The striatum is connected to the cerebral cortex through multiple anatomical loops that process sensory, limbic, and heteromodal information. Tract-tracing studies in the monkey reveal that these corticostriatal connections form stereotyped patterns in the striatum. Here the organization of the striatum was explored in the human with resting-state functional connectivity MRI (fcMRI). Data from 1,000 subjects were registered with nonlinear deformation of the striatum in combination with surface-based alignment of the cerebral cortex. fcMRI maps derived from seed regions placed in the foot and tongue representations of the motor cortex yielded the expected inverted somatotopy in the putamen. fcMRI maps derived from the supplementary motor area were located medially to the primary motor representation, also consistent with anatomical studies. The topography of the complete striatum was estimated and replicated by assigning each voxel in the striatum to its most strongly correlated cortical network in two independent groups of 500 subjects. The results revealed at least five cortical zones in the striatum linked to sensorimotor, premotor, limbic, and two association networks with a topography globally consistent with monkey anatomical studies. The majority of the human striatum was coupled to cortical association networks. Examining these association networks further revealed details that fractionated the five major networks. The resulting estimates of striatal organization provide a reference for exploring how the striatum contributes to processing motor, limbic, and heteromodal information through multiple large-scale corticostriatal circuits.

Neural correlates of multisensory perceptual learning

The brain's ability to bind incoming auditory and visual stimuli depends critically on the temporal structure of this information. Specifically, there exists a temporal window of audiovisual integration within which stimuli are highly likely to be perceived as part of the same environmental event. Several studies have described the temporal bounds of this window, but few have investigated its malleability. Recently, our laboratory has demonstrated that a perceptual training paradigm is capable of eliciting a 40% narrowing in the width of this window that is stable for at least 1 week after cessation of training. In the current study, we sought to reveal the neural substrates of these changes. Eleven human subjects completed an audiovisual simultaneity judgment training paradigm, immediately before and after which they performed the same task during an event-related 3T fMRI session. The posterior superior temporal sulcus (pSTS) and areas of auditory and visual cortex exhibited robust BOLD decreases following training, and resting state and effective connectivity analyses revealed significant increases in coupling among these cortices after training. These results provide the first evidence of the neural correlates underlying changes in multisensory temporal binding likely representing the substrate for a multisensory temporal binding window.

Neural correlates of multisensory perceptual learning

The brain's ability to bind incoming auditory and visual stimuli depends critically on the temporal structure of this information. Specifically, there exists a temporal window of audiovisual integration within which stimuli are highly likely to be perceived as part of the same environmental event. Several studies have described the temporal bounds of this window, but few have investigated its malleability. Recently, our laboratory has demonstrated that a perceptual training paradigm is capable of eliciting a 40% narrowing in the width of this window that is stable for at least 1 week after cessation of training. In the current study, we sought to reveal the neural substrates of these changes. Eleven human subjects completed an audiovisual simultaneity judgment training paradigm, immediately before and after which they performed the same task during an event-related 3T fMRI session. The posterior superior temporal sulcus (pSTS) and areas of auditory and visual cortex exhibited robust BOLD decreases following training, and resting state and effective connectivity analyses revealed significant increases in coupling among these cortices after training. These results provide the first evidence of the neural correlates underlying changes in multisensory temporal binding likely representing the substrate for a multisensory temporal binding window.

Cortical connections of auditory cortex in marmoset monkeys: lateral belt and parabelt regions

The current working model of primate auditory cortex is constructed from a number of studies of both new and old world monkeys. It includes three levels of processing. A primary level, the core region, is surrounded both medially and laterally by a secondary belt region. A third level of processing, the parabelt region, is located lateral to the belt. The marmoset monkey (Callithrix jacchus jacchus) has become an important model system to study auditory processing, but its anatomical organization has not been fully established. In previous studies, we focused on the architecture and connections of the core and medial belt areas (de la Mothe et al., 2006a, J Comp Neurol 496:27-71; de la Mothe et al., 2006b, J Comp Neurol 496:72-96). In this study, the corticocortical connections of the lateral belt and parabelt were examined in the marmoset. Tracers were injected into both rostral and caudal portions of the lateral belt and parabelt. Both regions revealed topographic connections along the rostrocaudal axis, where caudal areas of injection had stronger connections with caudal areas, and rostral areas of injection with rostral areas. The lateral belt had strong connections with the core, belt, and parabelt, whereas the parabelt had strong connections with the belt but not the core. Label in the core from injections in the parabelt was significantly reduced or absent, consistent with the idea that the parabelt relies mainly on the belt for its cortical input. In addition, the present and previous studies indicate hierarchical principles of anatomical organization in the marmoset that are consistent with those observed in other primates.

Speech versus song: multiple pitch-sensitive areas revealed by a naturally occurring musical illusion

It is normally obvious to listeners whether a human vocalization is intended to be heard as speech or song. However, the 2 signals are remarkably similar acoustically. A naturally occurring boundary case between speech and song has been discovered where a spoken phrase sounds as if it were sung when isolated and repeated. In the present study, an extensive search of audiobooks uncovered additional similar examples, which were contrasted with samples from the same corpus that do not sound like song, despite containing clear prosodic pitch contours. Using functional magnetic resonance imaging, we show that hearing these 2 closely matched stimuli is not associated with differences in response of early auditory areas. Rather, we find that a network of 8 regions, including the anterior superior temporal gyrus (STG) just anterior to Heschl's gyrus and the right midposterior STG, respond more strongly to speech perceived as song than to mere speech. This network overlaps a number of areas previously associated with pitch extraction and song production, confirming that phrases originally intended to be heard as speech can, under certain circumstances, be heard as song. Our results suggest that song processing compared with speech processing makes increased demands on pitch processing and auditory-motor integration.

Structural brain changes in patients with recurrent major depressive disorder presenting with anxiety symptoms

BACKGROUND AND PURPOSE

Major depressive disorder (MDD) presents with extensive clinical heterogeneity. In particular, overlap with anxiety symptoms is common during depressive episodes and as a comorbid disorder. The aim of this study was to test for morphological brain differences between patients having a history of recurrent MDD with, and without, anxiety symptoms (MDD+A and MDD-A).

METHODS

T1-weighted magnetic resonance images of age-, gender- and ethnically matched groups of MDD+A (n= 49) and MDD-A (n= 96) patients were available for voxel-based morphometry analysis of regional gray matter (GM) volume differences. Brain structural images were also contrasted with 183 age-, gender-, and ethnicity-matched healthy controls.

RESULTS

MDD+A patients had greater GM volume (P(FWE) = .002) than MDD-A patients in the right temporal cortex extending from the mid-posterior superior temporal gyrus into the posterior middle and inferior temporal gyrus. The MDD patients together showed lower GM volume than healthy controls in the superior parietal lobe.

CONCLUSIONS

Regional volume differences in patients are consistent with altered neuronal or glial microstructure. The temporolateral cortical differences distinguishing the 2 MDD groups suggest neurobiological differences related to the expression of anxiety symptoms in depression and provide further rationale for considering these groups independently for therapeutic outcomes studies.

Evaluation of inputs to rat primary auditory cortex from the suprageniculate nucleus and extrastriate visual cortex

Evidence indicates that visual stimuli influence cells in the primary auditory cortex. To evaluate potential sources of this visual input and how they enter into the circuitry of the auditory cortex, we examined axonal terminations in the primary auditory cortex from nonprimary extrastriate visual cortex (V2M, V2L) and from the multimodal thalamic suprageniculate nucleus (SG). Gross biocytin/biotinylated dextran amine (BDA) injections into the SG or extrastriate cortex labeled inputs terminating primarily in superficial and deep layers. SG projects primarily to layers I, V, and VI while V2M and V2L project primarily to layers I and VI, with V2L also targeting layers II/III. Layer I inputs differ in that SG terminals are concentrated superficially, V2L are deeper, and V2M are equally distributed throughout. Individual axonal reconstructions document that single axons can 1) innervate multiple layers; 2) run considerable distances in layer I; and 3) run preferentially in the dorsoventral direction similar to isofrequency axes. At the electron microscopic level, SG and V2M terminals 1) are the same size regardless of layer; 2) are non-gamma-aminobutyric acid (GABA)ergic; 3) are smaller than ventral medial geniculate terminals synapsing in layer IV; 4) make asymmetric synapses onto dendrites/spines that 5) are non-GABAergic and 6) are slightly larger in layer I. Thus, both areas provide a substantial feedback-like input with differences that may indicate potentially different roles.

Traumatic brain injury affects the frontomedian cortex--an event-related fMRI study on evaluative judgments

Traumatic brain injuries represent the leading cause of death and disability in young adults in industrialized countries. Recently, it has been suggested that dysfunctions of the frontomedian cortex, which enables social cognition, are responsible for clinical deficits in the long-term. To validate this hypothesis, we examined brain activation in seven young adults suffering from diffuse axonal injury during a cognitive task that specifically depends on frontomedian structures, namely evaluative judgments, contrasted with semantic memory retrieval. Brain activation in patients was compared with healthy age and gender matched control subjects using event-related functional magnetic resonance imaging. Evaluative judgments were related to a neural network discussed in the context of self-referential processing and theory of mind. More precisely, the neural network consisted of frontomedian regions, the temporal pole, and the posterior superior temporal gyrus and sulcus/angular gyrus. Patients showed higher activations in this network and the inferior frontal gyrus, whereas healthy control subjects activated more dopaminergic structures, namely the ventral tegmental area, during evaluative judgments. One possible interpretation of the data is that deficits in the ventral tegmental area, and consequently the mesocorticolimbic projection system, have to be compensated for by higher brain activations in the frontomedian and anterior cingulate cortex in patients with diffuse axonal injury. In conclusion, our study supports the hypothesis that traumatic brain injury is characterized by frontomedian dysfunctions, which may be responsible for clinical deficits in the long-term and which might be modified by rehabilitative strategies in the future.

Pathway-based approaches to imaging genetics association studies: Wnt signaling, GSK3beta substrates and major depression

Several lines of evidence implicate glycogen synthase kinase 3 beta (GSK3beta) in mood disorders. We recently reported associations between GSK3beta polymorphisms and brain structural changes in patients with recurrent major depressive disorder (MDD). Here we provide supporting observations by showing that polymorphisms in additional genes encoding proteins directly related to GSK3beta biological functions are associated with similar regional grey matter (GM) volume changes in MDD patients. We tested specifically for associations with genetic variation in canonical Wnt signaling pathway genes and in genes that encode substrate proteins of GSK3beta. We applied a general linear model with non-stationary cluster-based inference to examine associations between polymorphisms and regional voxel-based morphometry GM volume differences in recurrent MDD patients (n=134) and in age-, gender-, and ethnicity-matched healthy controls (n=144) to test for genotype-by-MDD interactions. We observed associations for polymorphisms in 8/13 canonical Wnt pathway genes and 5/10 GSK3beta substrate genes, predominantly in the temporolateral and medial prefrontal cortices. Similar associations were not found for 100 unrelated polymorphisms tested. This work suggests that identifying SNPs related to genes that encode functionally-interacting proteins that modulate common anatomical regions offers a useful approach to increasing confidence in outcomes from imaging genetics association studies. This is of particular interest when replication datasets are not available. Our observations lend support to the hypothesis that polymorphisms in GSK3beta play a role in MDD susceptibility or expression, in part, by acting via the canonical Wnt signaling pathway and related substrates.

The multisensory roles for auditory cortex in primate vocal communication

Primate vocal communication is a fundamentally multisensory behavior and this will be reflected in the different roles brain regions play in mediating it. Auditory cortex is illustrative, being influenced, I will argue, by the visual, somatosensory, proprioceptive and motor modalities during vocal communication. It is my intention that the data reviewed here suggest that investigating auditory cortex through the lens of a specific behavior may lead to a much clearer picture of its functions and dynamic organization. One possibility is that, beyond its tonotopic and cytoarchitectural organization, the auditory cortex may be organized according to ethologically-relevant actions. Such action-specific representations would be overlayed on top of traditional mapping schemes and would help mediate motor and multisensory processes related to a particular type of behavior.

Conditional selection of contra- and ipsilateral forelimb movements by the dorsal premotor cortex in monkeys

It has been suggested that the dorsal premotor cortex (PMd) may contribute to conditional motor behavior. Thus when a selection is instructed by arbitrary conditional cues, it is possible that the unilateral PMd affects behavior, regardless of which arm, contra- or ipsilateral, is to be used. We examined this possibility by recording neuronal activity and injecting muscimol into the caudal PMd (PMdc) of monkeys while they were performing a reaching task toward visuospatial targets with either the right or left arm, as instructed by low-frequency or high-frequency tone signals. Following the injection of a small amount of muscimol (1 microL; 5 microg/microL) into the unilateral PMdc, monkeys exhibited two major deficits in behavioral performance: 1) erroneous selection of the arm not indicated by the instruction (selection errors) and 2) no movement initiation in response to a visuospatial target cue serving as a trigger signal for reaching within the reaction time limit (movement initiation errors). Errors were observed following unilateral muscimol injection into both right and left PMdc, although selection errors occurred with significantly greater frequency in the arm contralateral to the injection site. By contrast, movement initiation errors were more commonly observed in left-arm trials, regardless of whether the right or left PMdc was inactivated. Notably, errors rarely occurred following a ventral PM muscimol injection. These results suggest that the left and right PMdc cooperate to transform conditional sensory cues into appropriate motor output and can affect both contra- and ipsilateral body movement.

Spatial organization of multisensory responses in temporal association cortex

Neurons in sensory cortices are often topographically organized according to their response preferences. We here show that such an organization of response preferences also exists in multisensory association cortex. Using electrophysiological mappings, we probed the modality preference to auditory and visual stimuli of neurons in the superior temporal association cortex of nonhuman primates. We found that neurons preferring the same modality (auditory or visual) often co-occur in close spatial proximity or occur intermingled with bimodal neurons. Neurons preferring different modalities, in contrast, occur spatially separated. This organization at the scale of individual neurons leads to extended patches of same modality preference when analyzed at the scale of millimeters, revealing larger-scale regions that preferentially respond to the same modality. In addition, we find that neurons exhibiting signs of multisensory interactions, such as superadditive or subadditive response summation, also occur in spatial clusters. Together, these results reveal a spatial organization of modality preferences in a higher association cortex and lend support to the notion that topographical organizations might serve as a general principle of integrating information within and across the sensory modalities.

Perceiving pitch absolutely: comparing absolute and relative pitch possessors in a pitch memory task

BACKGROUND

The perceptual-cognitive mechanisms and neural correlates of Absolute Pitch (AP) are not fully understood. The aim of this fMRI study was to examine the neural network underlying AP using a pitch memory experiment and contrasting two groups of musicians with each other, those that have AP and those that do not.

RESULTS

We found a common activation pattern for both groups that included the superior temporal gyrus (STG) extending into the adjacent superior temporal sulcus (STS), the inferior parietal lobule (IPL) extending into the adjacent intraparietal sulcus (IPS), the posterior part of the inferior frontal gyrus (IFG), the pre-supplementary motor area (pre-SMA), and superior lateral cerebellar regions. Significant between-group differences were seen in the left STS during the early encoding phase of the pitch memory task (more activation in AP musicians) and in the right superior parietal lobule (SPL)/intraparietal sulcus (IPS) during the early perceptual phase (ITP 0-3) and later working memory/multimodal encoding phase of the pitch memory task (more activation in non-AP musicians). Non-significant between-group trends were seen in the posterior IFG (more in AP musicians) and the IPL (more anterior activations in the non-AP group and more posterior activations in the AP group).

CONCLUSION

Since the increased activation of the left STS in AP musicians was observed during the early perceptual encoding phase and since the STS has been shown to be involved in categorization tasks, its activation might suggest that AP musicians involve categorization regions in tonal tasks. The increased activation of the right SPL/IPS in non-AP musicians indicates either an increased use of regions that are part of a tonal working memory (WM) network, or the use of a multimodal encoding strategy such as the utilization of a visual-spatial mapping scheme (i.e., imagining notes on a staff or using a spatial coding for their relative pitch height) for pitch information.

Change-driven cortical activation in multisensory environments: an MEG study

The quick detection of dynamic changes in multisensory environments is essential to survive dangerous events and orient attention to informative events. Previous studies have identified multimodal cortical areas activated by changes of visual, auditory, and tactile stimuli. In the present study, we used magnetoencephalography (MEG) to examine time-varying cortical processes responsive to unexpected unimodal changes during continuous multisensory stimulation. The results showed that there were change-driven cortical responses in multimodal areas, such as the temporo-parietal junction and middle and inferior frontal gyri, regardless of the sensory modalities where the change occurred. These multimodal activations accompanied unimodal activations, both of which in general had some peaks within 300 ms after the changes. Thus, neural processes responsive to unimodal changes in the multisensory environment are distributed at different timing in these cortical areas.

Cognitive humor processing: different logical mechanisms in nonverbal cartoons--an fMRI study

Although recent fMRI studies on humor have begun to elucidate cognitive and affective neural correlates, they weren't able to distinguish between different logical mechanisms or steps of humor processing, i.e., the detection of an incongruity and its resolution. This fMRI study aimed to focus in more detail on cognitive humor processing. In order to investigate pure incongruity resolution without preprocessing steps, nonverbal cartoons differing in their logical mechanisms were contrasted with nonhumorous pictures containing an irresolvable incongruity. The logical mechanisms were: (1) visual puns (visual resemblance, PUNs); (2) semantic cartoons (pure semantic relationships, SEMs); and (3) Theory of Mind cartoons (which require additionally mentalizing abilities, TOMs). Thirty cartoons from each condition were presented to 17 healthy subjects while acquiring fMR images. The results reveal a left-sided network involved in pure incongruity resolution: e.g., temporo-parietal junction, inferior frontal gyrus and ventromedian prefrontal cortex. These areas are also involved in processing of SEMs, whereas PUNs show more activation in the extrastriate cortex and TOMs show more activation in so-called mentalizing areas. Processing of pictures containing an irresolvable incongruity evokes activation in the rostral cingulate zone, which might reflect error processing. We conclude that cognitive processing of different logical mechanisms depends on separate neural networks.

A transition from unimodal to multimodal activations in four sensory modalities in humans: an electrophysiological study

Background

To investigate the long-latency activities common to all sensory modalities, electroencephalographic responses to auditory (1000 Hz pure tone), tactile (electrical stimulation to the index finger), visual (simple figure of a star), and noxious (intra-epidermal electrical stimulation to the dorsum of the hand) stimuli were recorded from 27 scalp electrodes in 14 healthy volunteers.

Results

Results of source modeling showed multimodal activations in the anterior part of the cingulate cortex (ACC) and hippocampal region (Hip). The activity in the ACC was biphasic. In all sensory modalities, the first component of ACC activity peaked 30–56 ms later than the peak of the major modality-specific activity, the second component of ACC activity peaked 117–145 ms later than the peak of the first component, and the activity in Hip peaked 43–77 ms later than the second component of ACC activity.

Conclusion

The temporal sequence of activations through modality-specific and multimodal pathways was similar among all sensory modalities.

Sources of somatosensory input to the caudal belt areas of auditory cortex

The auditory cortex of nonhuman primates is comprised of a constellation of at least twelve interconnected areas distributed across three major regions on the superior temporal gyrus: core, belt, and parabelt. Individual areas are distinguished on the basis of unique profiles comprising architectonic features, thalamic and cortical connections, and neuron response properties. Recent demonstrations of convergent auditory-somatosensory interactions in the caudomedial (CM) and caudolateral (CL) belt areas prompted us to pursue anatomical studies to identify the source(s) of somatic input to auditory cortex. Corticocortical and thalamocortical connections were revealed by injecting neuroanatomical tracers into CM, CL, and adjoining fields of marmoset (Callithrix jacchus jacchus) and macaque (Macaca mulatta) monkeys. In addition to auditory cortex, the cortical connections of CM and CL included somatosensory (retroinsular, Ri; granular insula, Ig) and multisensory areas (temporal parietal occipital, temporal parietal temporal). Thalamic inputs included the medial geniculate complex and several multisensory nuclei (suprageniculate, posterior, limitans, medial pulvinar), but not the ventroposterior complex. Injections of the core (A1, R) and rostromedial areas of auditory cortex revealed sparse multisensory connections. The results suggest that areas Ri and Ig are the principle sources of somatosensory input to the caudal belt, while multisensory regions of cortex and thalamus may also contribute. The present data add to growing evidence of multisensory convergence in cortical areas previously considered to be 'unimodal', and also indicate that auditory cortical areas differ in this respect.

Category-specific responses to faces and objects in primate auditory cortex

Auditory and visual signals often occur together, and the two sensory channels are known to influence each other to facilitate perception. The neural basis of this integration is not well understood, although other forms of multisensory influences have been shown to occur at surprisingly early stages of processing in cortex. Primary visual cortex neurons can show frequency-tuning to auditory stimuli, and auditory cortex responds selectively to certain somatosensory stimuli, supporting the possibility that complex visual signals may modulate early stages of auditory processing. To elucidate which auditory regions, if any, are responsive to complex visual stimuli, we recorded from auditory cortex and the superior temporal sulcus while presenting visual stimuli consisting of various objects, neutral faces, and facial expressions generated during vocalization. Both objects and conspecific faces elicited robust field potential responses in auditory cortex sites, but the responses varied by category: both neutral and vocalizing faces had a highly consistent negative component (N100) followed by a broader positive component (P180) whereas object responses were more variable in time and shape, but could be discriminated consistently from the responses to faces. The face response did not vary within the face category, i.e., for expressive vs. neutral face stimuli. The presence of responses for both objects and neutral faces suggests that auditory cortex receives highly informative visual input that is not restricted to those stimuli associated with auditory components. These results reveal selectivity for complex visual stimuli in a brain region conventionally described as non-visual “unisensory” cortex.

Telencephalon: Neocortex

The neocortex is an ultracomplex, six-layered structure that develops from the dorsal palliai sector of the telencephalic hemispheres (Figs. 2.24, 2.25, 11.1). All mammals, including monotremes and marsupials, possess a neocortex, but in reptiles, i.e. the ancestors of mammals, only a three-layered neocortical primordium is present [509, 511]. The term neocortex refers to its late phylogenetic appearance, in comparison to the “palaeocortical” olfactory cortex and the “archicortical” hippocampal cortex, both of which are present in all amniotes [509].

Do early sensory cortices integrate cross-modal information?

Our different senses provide complementary evidence about the environment and their interaction often aids behavioral performance or alters the quality of the sensory percept. A traditional view defers the merging of sensory information to higher association cortices, and posits that a large part of the brain can be reduced into a collection of unisensory systems that can be studied in isolation. Recent studies, however, challenge this view and suggest that cross-modal interactions can already occur in areas hitherto regarded as unisensory. We review results from functional imaging and electrophysiology exemplifying cross-modal interactions that occur early during the evoked response, and at the earliest stages of sensory cortical processing. Although anatomical studies revealed several potential origins of these cross-modal influences, there is yet no clear relation between particular functional observations and specific anatomical connections. In addition, our view on sensory integration at the neuronal level is coined by many studies on subcortical model systems of sensory integration; yet, the patterns of cross-modal interaction in cortex deviate from these model systems in several ways. Consequently, future studies on cortical sensory integration need to leave the descriptive level and need to incorporate cross-modal influences into models of the organization of sensory processing. Only then will we be able to determine whether early cross-modal interactions truly merit the label sensory integration, and how they increase a sensory system's ability to scrutinize its environment and finally aid behavior.