Effective Connectivity Reveals Largely Independent Parallel Networks of Face and Body Patches

Short-latency preference for faces in primate superior colliculus depends on visual cortex

Face processing is fundamental to primates and has been extensively studied in higher-order visual cortex. Here, we report that visual neurons in the midbrain superior colliculus (SC) of macaque monkeys display a preference for images of faces. This preference emerges within 40 ms of stimulus onset-well before "face patches" in visual cortex-and, at the population level, can be used to distinguish faces from other visual objects with accuracies of ∼80%. This short-latency face preference in SC depends on signals routed through early visual cortex because inactivating the lateral geniculate nucleus, the key relay from retina to cortex, virtually eliminates visual responses in SC, including face-related activity. These results reveal an unexpected circuit in the primate visual system for rapidly detecting faces in the periphery, complementing the higher-order areas needed for recognizing individual faces.

Beyond faces: the contribution of the amygdala to visual processing in the macaque brain

The amygdala is present in a diverse range of vertebrate species, such as lizards, rodents, and primates; however, its structure and connectivity differs across species. The increased connections to visual sensory areas in primate species suggests that understanding the visual selectivity of the amygdala in detail is critical to revealing the principles underlying its function in primate cognition. Therefore, we designed a high-resolution, contrast-agent enhanced, event-related fMRI experiment, and scanned 3 adult rhesus macaques, while they viewed 96 naturalistic stimuli. Half of these stimuli were social (defined by the presence of a conspecific), the other half were nonsocial. We also nested manipulations of emotional valence (positive, neutral, and negative) and visual category (faces, nonfaces, animate, and inanimate) within the stimulus set. The results reveal widespread effects of emotional valence, with the amygdala responding more on average to inanimate objects and animals than faces, bodies, or social agents in this experimental context. These findings suggest that the amygdala makes a contribution to primate vision that goes beyond an auxiliary role in face or social perception. Furthermore, the results highlight the importance of stimulus selection and experimental design when probing the function of the amygdala and other visually responsive brain regions.

Evolutionary continuity and divergence of auditory dorsal and ventral pathways in primates revealed by ultra-high field diffusion MRI

Auditory dorsal and ventral pathways in the human brain play important roles in supporting speech and language processing. However, the evolutionary root of the dual auditory pathways in the primate brain is unclear. By parcellating the auditory cortex of marmosets (a New World monkey species), macaques (an Old World monkey species), and humans using the same individual-based analysis method and tracking the pathways from the auditory cortex based on multi-shell diffusion-weighted MRI (dMRI), homologous auditory dorsal and ventral fiber tracks were identified in these primate species. The ventral pathway was found to be well conserved in all three primate species analyzed but extend to more anterior temporal regions in humans. In contrast, the dorsal pathway showed a divergence between monkey and human brains. First, frontal regions in the human brain have stronger connections to the higher-level auditory regions than to the lower-level auditory regions along the dorsal pathway, while frontal regions in the monkey brain show opposite connection patterns along the dorsal pathway. Second, the left lateralization of the dorsal pathway is only found in humans. Moreover, the connectivity strength of the dorsal pathway in marmosets is more similar to that of humans than macaques. These results demonstrate the continuity and divergence of the dual auditory pathways in the primate brains along the evolutionary path, suggesting that the putative neural networks supporting human speech and language processing might have emerged early in primate evolution.

Short-latency preference for faces in the primate superior colliculus

Face processing is fundamental to primates and has been extensively studied in higher-order visual cortex. Here we report that visual neurons in the midbrain superior colliculus (SC) display a preference for faces, that the preference emerges within 50ms of stimulus onset - well before "face patches" in visual cortex - and that this activity can distinguish faces from other visual objects with accuracies of ~80%. This short-latency preference in SC depends on signals routed through early visual cortex, because inactivating the lateral geniculate nucleus, the key relay from retina to cortex, virtually eliminates visual responses in SC, including face-related activity. These results reveal an unexpected circuit in the primate visual system for rapidly detecting faces in the periphery, complementing the higher-order areas needed for recognizing individual faces.

Uncovering the fast, directional signal flow through the human temporal pole during semantic processing

The temporal pole (TP) plays a central role in semantic memory, yet its neural machinery is unknown. Intracerebral recordings in patients discriminating visually the gender or actions of an actor, yielded gender discrimination responses in the ventrolateral (VL) and tip (T) regions of right TP. Granger causality revealed task-specific signals travelling first forward from VL to T, under control of orbitofrontal cortex (OFC) and neighboring prefrontal cortex, and then, strongly, backwards from T to VL. Many other cortical regions provided inputs to or received outputs from both TP regions, often with longer delays, with ventral temporal afferents to VL signaling the actor's physical appearance. The TP response timing reflected more that of the connections to VL, controlled by OFC, than that of the input leads themselves. Thus, visual evidence for gender categories, collected by VL, activates category labels in T, and consequently, category features in VL, indicating a two-stage representation of semantic categories in TP.

Towards an optimization of functional localizers in non-human primate neuroimaging with (fMRI) frequency-tagging

Non-human primate (NHP) neuroimaging can provide essential insights into the neural basis of human cognitive functions. While functional magnetic resonance imaging (fMRI) localizers can play an essential role in reaching this objective (Russ et al., 2021), they often differ substantially across species in terms of paradigms, measured signals, and data analysis, biasing the comparisons. Here we introduce a functional frequency-tagging face localizer for NHP imaging, successfully developed in humans and outperforming standard face localizers (Gao et al., 2018). FMRI recordings were performed in two awake macaques. Within a rapid 6 Hz stream of natural non-face objects images, human or monkey face stimuli were presented in bursts every 9 s. We also included control conditions with phase-scrambled versions of all images. As in humans, face-selective activity was objectively identified and quantified at the peak of the face-stimulation frequency (0.111 Hz) and its second harmonic (0.222 Hz) in the Fourier domain. Focal activations with a high signal-to-noise ratio were observed in regions previously described as face-selective, mainly in the STS (clusters PL, ML, MF; also, AL, AF), both for human and monkey faces. Robust face-selective activations were also found in the prefrontal cortex of one monkey (PVL and PO clusters). Face-selective neural activity was highly reliable and excluded all contributions from low-level visual cues contained in the amplitude spectrum of the stimuli. These observations indicate that fMRI frequency-tagging provides a highly valuable approach to objectively compare human and monkey visual recognition systems within the same framework.

The contribution of dynamics to macaque body and face patch responses

Previous functional imaging studies demonstrated body-selective patches in the primate visual temporal cortex, comparing activations to static bodies and static images of other categories. However, the use of static instead of dynamic displays of moving bodies may have underestimated the extent of the body patch network. Indeed, body dynamics provide information about action and emotion and may be processed in patches not activated by static images. Thus, to map with fMRI the full extent of the macaque body patch system in the visual temporal cortex, we employed dynamic displays of natural-acting monkey bodies, dynamic monkey faces, objects, and scrambled versions of these videos, all presented during fixation. We found nine body patches in the visual temporal cortex, starting posteriorly in the superior temporal sulcus (STS) and ending anteriorly in the temporal pole. Unlike for static images, body patches were present consistently in both the lower and upper banks of the STS. Overall, body patches showed a higher activation by dynamic displays than by matched static images, which, for identical stimulus displays, was less the case for the neighboring face patches. These data provide the groundwork for future single-unit recording studies to reveal the spatiotemporal features the neurons of these body patches encode. These fMRI findings suggest that dynamics have a stronger contribution to population responses in body than face patches.

A broadly tuned network for affective body language in the macaque brain

Body language is a powerful tool that we use to communicate how we feel, but it is unclear whether other primates also communicate in this way. Here, we use functional magnetic resonance imaging to show that the body-selective patches in macaques are activated by affective body language. Unexpectedly, we found these regions to be tolerant of naturalistic variation in posture as well as species; the bodies of macaques, humans, and domestic cats all evoked a stronger response when they conveyed fear than when they conveyed no affect. Multivariate analyses confirmed that the neural representation of fear-related body expressions was species-invariant. Collectively, these findings demonstrate that, like humans, macaques have body-selective brain regions in the ventral visual pathway for processing affective body language. These data also indicate that representations of body stimuli in these regions are built on the basis of emergent properties, such as socio-affective meaning, and not just putative image properties.

Bidirectional and parallel relationships in macaque face circuit revealed by fMRI and causal pharmacological inactivation

Although the presence of face patches in primate inferotemporal (IT) cortex is well established, the functional and causal relationships among these patches remain elusive. In two monkeys, muscimol was infused sequentially into each patch or pair of patches to assess their respective influence on the remaining IT face network and the amygdala, as determined using fMRI. The results revealed that anterior face patches required input from middle face patches for their responses to both faces and objects, while the face selectivity in middle face patches arose, in part, from top-down input from anterior face patches. Moreover, we uncovered a parallel fundal-lateral functional organization in the IT face network, supporting dual routes (dorsal-ventral) in face processing within IT cortex as well as between IT cortex and the amygdala. Our findings of the causal relationship among the face patches demonstrate that the IT face circuit is organized into multiple functional compartments.

More Than the Face: Representations of Bodies in the Inferior Temporal Cortex

Visual representations of bodies, in addition to those of faces, contribute to the recognition of con- and heterospecifics, to action recognition, and to nonverbal communication. Despite its importance, the neural basis of the visual analysis of bodies has been less studied than that of faces. In this article, I review what is known about the neural processing of bodies, focusing on the macaque temporal visual cortex. Early single-unit recording work suggested that the temporal visual cortex contains representations of body parts and bodies, with the dorsal bank of the superior temporal sulcus representing bodily actions. Subsequent functional magnetic resonance imaging studies in both humans and monkeys showed several temporal cortical regions that are strongly activated by bodies. Single-unit recordings in the macaque body patches suggest that these represent mainly body shape features. More anterior patches show a greater viewpoint-tolerant selectivity for body features, which may reflect a processing principle shared with other object categories, including faces. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Functionally specific and sparse domain-based micro-networks in monkey V1 and V2

The cerebral cortices of human and nonhuman primate brains are characterized by submillimeter functional domains. However, little is known about the connections of single functional domains. Here, in macaque monkey visual cortex, we have developed a targeted focal electrical stimulation method, coupled with functional optical imaging, to map cortical networks with submillimeter precision in vivo. We find that single functional domains are a part of highly specific and sparse intra-areal and inter-areal micro-networks. Across color-related and orientation-related functionalities, these micro-networks exhibit parallel connection patterns, suggesting a common domain-based architecture. Moreover, these micro-networks shift topographically at a submillimeter scale, suggesting that they serve as a fundamental unit for cortical information processing. Our findings establish a domain-based connectional architecture in the primate brain and present new constraints for cortical map representation.

The cortical and subcortical correlates of face pareidolia in the macaque brain

Face detection is a foundational social skill for primates. This vital function is thought to be supported by specialized neural mechanisms; however, although several face-selective regions have been identified in both humans and nonhuman primates, there is no consensus about which region(s) are involved in face detection. Here, we used naturally occurring errors of face detection (i.e. objects with illusory facial features referred to as examples of 'face pareidolia') to identify regions of the macaque brain implicated in face detection. Using whole-brain functional magnetic resonance imaging to test awake rhesus macaques, we discovered that a subset of face-selective patches in the inferior temporal cortex, on the lower lateral edge of the superior temporal sulcus, and the amygdala respond more to objects with illusory facial features than matched non-face objects. Multivariate analyses of the data revealed differences in the representation of illusory faces across the functionally defined regions of interest. These differences suggest that the cortical and subcortical face-selective regions contribute uniquely to the detection of facial features. We conclude that face detection is supported by a multiplexed system in the primate brain.

It is not just the category: behavioral effects of fMRI-guided electrical microstimulation result from a complex interplay of factors

Functional imaging and electrophysiological studies in primates revealed the existence of patches selective for visual categories in the inferior temporal cortex. Understanding the contribution of these patches to perception requires causal techniques that assess the effect of neural activity manipulations on perception. We used electrical microstimulation (EM) to determine the role of body patch activity in visual categorization in macaques. We tested the hypothesis that EM in a body patch would affect the categorization of bodies versus objects but not of other visual categories. We employed low-current EM of an anterior body patch (ASB) in the superior temporal sulcus, which was defined by functional magnetic resonance imaging and verified with electrophysiological recordings in each session. EM of ASB affected body categorization, but the EM effects were more complex than the expected increase of body-related choices: EM affected the categorization of both body and inanimate images and showed interaction with the choice target location, but its effect was location-specific (tested in 1 subject) on a millimeter scale. Our findings suggest that the behavioral effects of EM in a category-selective patch are not merely a manifestation of the category selectivity of the underlying neuronal population but reflect a complex interplay of multiple factors.

The cortical connectome of primate lateral prefrontal cortex

The lateral prefrontal cortex (LPFC) of primates plays an important role in executive control, but how it interacts with the rest of the cortex remains unclear. To address this, we densely mapped the cortical connectome of LPFC, using electrical microstimulation combined with functional MRI (EM-fMRI). We found isomorphic mappings between LPFC and five major processing domains composing most of the cerebral cortex except early sensory and motor areas. An LPFC grid of ∼200 stimulation sites topographically mapped to separate grids of activation sites in the five domains, coarsely resembling how the visual cortex maps the retina. The temporal and parietal maps largely overlapped in LPFC, suggesting topographically organized convergence of the ventral and dorsal streams, and the other maps overlapped at least partially. Thus, the LPFC contains overlapping, millimeter-scale maps that mirror the organization of major cortical processing domains, supporting LPFC's role in coordinating activity within and across these domains.

A Distributed Model of Face and Body Integration

Separated face- and body-responsive brain networks have been identified that show strong responses when observers view faces and bodies. It has been proposed that face and body processing may be initially separated in the lateral occipitotemporal cortex and then combined into a whole person representation in the anterior temporal cortex, or elsewhere in the brain. However, in contrast to this proposal, our recent study identified a common coding of face and body orientation (ie, facing direction) in the lateral occipitotemporal cortex, demonstrating an integration of face and body information at an early stage of face and body processing. These results, in combination with findings that show integration of face and body identity in the lateral occipitotemporal, parahippocampal and superior parietal cortex, and face and body emotional expression in the posterior superior temporal sulcus and medial prefrontal cortex, suggest that face and body integration may be more distributed than previously considered. I propose a new model of face and body integration, where areas at the intersection of face- and body-responsive regions play a role in integrating specific properties of faces and bodies, and distributed regions across the brain contribute to high-level, abstract integration of shared face and body properties.

The neural coding of face and body orientation in occipitotemporal cortex

Face and body orientation convey important information for us to understand other people's actions, intentions and social interactions. It has been shown that several occipitotemporal areas respond differently to faces or bodies of different orientations. However, whether face and body orientation are processed by partially overlapping or completely separate brain networks remains unclear, as the neural coding of face and body orientation is often investigated separately. Here, we recorded participants' brain activity using fMRI while they viewed faces and bodies shown from three different orientations, while attending to either orientation or identity information. Using multivoxel pattern analysis we investigated which brain regions process face and body orientation respectively, and which regions encode both face and body orientation in a stimulus-independent manner. We found that patterns of neural responses evoked by different stimulus orientations in the occipital face area, extrastriate body area, lateral occipital complex and right early visual cortex could generalise across faces and bodies, suggesting a stimulus-independent encoding of person orientation in occipitotemporal cortex. This finding was consistent across functionally defined regions of interest and a whole-brain searchlight approach. The fusiform face area responded to face but not body orientation, suggesting that orientation responses in this area are face-specific. Moreover, neural responses to orientation were remarkably consistent regardless of whether participants attended to the orientation of faces and bodies or not. Together, these results demonstrate that face and body orientation are processed in a partially overlapping brain network, with a stimulus-independent neural code for face and body orientation in occipitotemporal cortex.

One object, two networks? Assessing the relationship between the face and body-selective regions in the primate visual system

Faces and bodies are often treated as distinct categories that are processed separately by face- and body-selective brain regions in the primate visual system. These regions occupy distinct regions of visual cortex and are often thought to constitute independent functional networks. Yet faces and bodies are part of the same object and their presence inevitably covary in naturalistic settings. Here, we re-evaluate both the evidence supporting the independent processing of faces and bodies and the organizational principles that have been invoked to explain this distinction. We outline four hypotheses ranging from completely separate networks to a single network supporting the perception of whole people or animals. The current evidence, especially in humans, is compatible with all of these hypotheses, making it presently unclear how the representation of faces and bodies is organized in the cortex.

Common functional localizers to enhance NHP & cross-species neuroscience imaging research

Functional localizers are invaluable as they can help define regions of interest, provide cross-study comparisons, and most importantly, allow for the aggregation and meta-analyses of data across studies and laboratories. To achieve these goals within the non-human primate (NHP) imaging community, there is a pressing need for the use of standardized and validated localizers that can be readily implemented across different groups. The goal of this paper is to provide an overview of the value of localizer protocols to imaging research and we describe a number of commonly used or novel localizers within NHPs, and keys to implement them across studies. As has been shown with the aggregation of resting-state imaging data in the original PRIME-DE submissions, we believe that the field is ready to apply the same initiative for task-based functional localizers in NHP imaging. By coming together to collect large datasets across research group, implementing the same functional localizers, and sharing the localizers and data via PRIME-DE, it is now possible to fully test their robustness, selectivity and specificity. To do this, we reviewed a number of common localizers and we created a repository of well-established localizer that are easily accessible and implemented through the PRIME-RE platform.

Mapping functional gradients of the striatal circuit using simultaneous microelectric stimulation and ultrahigh-field fMRI in non-human primates

Advances in functional magnetic resonance imaging (fMRI) have significantly enhanced our understanding of the striatal system of both humans and non-human primates (NHP) over the last few decades. However, its circuit-level functional anatomy remains poorly understood, partly because in-vivo fMRI cannot directly perturb a brain system and map its casual input-output relationship. Also, routine 3T fMRI has an insufficient spatial resolution. We performed electrical microstimulation (EM) of the striatum in lightly-anesthetized NHPs while simultaneously mapping whole-brain activation, using contrast-enhanced fMRI at ultra-high-field 7T. By stimulating multiple positions along the striatum's main (dorsal-to-ventral) axis, we revealed its complex functional circuit concerning mutually connected subsystems in both cortical and subcortical areas. Indeed, within the striatum, there were distinct brain activation patterns across different stimulation sites. Specifically, dorsal stimulation revealed a medial-to-lateral elongated shape of activation in upper caudate and putamen areas, whereas ventral stimulation evoked areas confined to the medial and lower caudate. Such dorsoventral gradients also appeared in neocortical and thalamic activations, indicating consistent embedding profiles of the striatal system across the whole brain. These findings reflect different forms of within-circuit and inter-regional neuronal connectivity between the dorsal and ventromedial striatum. These patterns both shared and contrasted with previous anatomical tract-tracing and in-vivo resting-state fMRI studies. Our approach of combining microstimulation and whole-brain fMRI mapping in NHPs provides a unique opportunity to integrate our understanding of a targeted brain area's meso- and macro-scale functional systems.

Separated and overlapping neural coding of face and body identity

Recognising a person's identity often relies on face and body information, and is tolerant to changes in low‐level visual input (e.g., viewpoint changes). Previous studies have suggested that face identity is disentangled from low‐level visual input in the anterior face‐responsive regions. It remains unclear which regions disentangle body identity from variations in viewpoint, and whether face and body identity are encoded separately or combined into a coherent person identity representation. We trained participants to recognise three identities, and then recorded their brain activity using fMRI while they viewed face and body images of these three identities from different viewpoints. Participants' task was to respond to either the stimulus identity or viewpoint. We found consistent decoding of body identity across viewpoint in the fusiform body area, right anterior temporal cortex, middle frontal gyrus and right insula. This finding demonstrates a similar function of fusiform and anterior temporal cortex for bodies as has previously been shown for faces, suggesting these regions may play a general role in extracting high‐level identity information. Moreover, we could decode identity across fMRI activity evoked by faces and bodies in the early visual cortex, right inferior occipital cortex, right parahippocampal cortex and right superior parietal cortex, revealing a distributed network that encodes person identity abstractly. Lastly, identity decoding was consistently better when participants attended to identity, indicating that attention to identity enhances its neural representation. These results offer new insights into how the brain develops an abstract neural coding of person identity, shared by faces and bodies.

Anatomical correlates of face patches in macaque inferotemporal cortex

Primate brains typically have regions within the ventral visual stream that are selectively responsive to faces. In macaques, these face patches are located in similar parts of inferotemporal cortex across individuals although correspondence with particular anatomical features has not been reported previously. Here, using high-resolution functional and anatomical imaging, we show that small "bumps," or buried gyri, along the lower bank of the superior temporal sulcus are predictive of the location of face-selective regions. Recordings from implanted multielectrode arrays verified that these bumps contain face-selective neurons. These bumps were present in monkeys raised without seeing faces and that lack face patches, indicating that these anatomical landmarks are predictive of, but not sufficient for, the presence of face selectivity. These bumps are found across primate species that span taxonomy lines, indicating common evolutionary developmental mechanisms. The bumps emerge during fetal development in macaques, indicating that they arise from general developmental mechanisms that result in the regularity of cortical folding of the entire brain.

Effective Connectivity Reveals an Interconnected Inferotemporal Network for Three-Dimensional Structure Processing

Disparity-defined 3D shape is processed in both the ventral and the dorsal visual stream. The network of cortical areas that is activated during the processing of disparity-defined 3D shape includes, in addition to parietal and premotor areas, three clearly distinct regions in inferotemporal cortex (ITC). To investigate the connectivity of the latter regions, we combined electrical stimulation with fMRI in male macaque monkeys. Electrical stimulation of each of the 3D-structure nodes in ITC mainly elicited increased fMRI activations in the other 3D-structure nodes and more variably in other parts of ventral visual cortex. Importantly, no increased activation was found in parietal areas, nor in PFC, whereas microstimulation in posterior parietal cortex did activate the ITC. Our results indicate that 3D-structure nodes in ITC form a strongly interconnected network, receiving input from parietal areas implicated in 3D-structure processing.SIGNIFICANCE STATEMENT Previous studies combining electrical microstimulation with functional imaging showed an interconnected set of regions in the ventral stream processing faces or bodies, but is has been unclear whether the same is true for other visual categories. Here the authors show that there is a connected system of stereo-selective regions in inferotemporal cortex, receiving input from parietal areas in the dorsal stream.

Parallel Processing of Facial Expression and Head Orientation in the Macaque Brain

When we move the features of our face, or turn our head, we communicate changes in our internal state to the people around us. How this information is encoded and used by an observer's brain is poorly understood. We investigated this issue using a functional MRI adaptation paradigm in awake male macaques. Among face-selective patches of the superior temporal sulcus (STS), we found a double dissociation of areas processing facial expression and those processing head orientation. The face-selective patches in the STS fundus were most sensitive to facial expression, as was the amygdala, whereas those on the lower, lateral edge of the sulcus were most sensitive to head orientation. The results of this study reveal a new dimension of functional organization, with face-selective patches segregating within the STS. The findings thus force a rethinking of the role of the face-processing system in representing subject-directed actions and supporting social cognition.SIGNIFICANCE STATEMENT When we are interacting with another person, we make inferences about their emotional state based on visual signals. For example, when a person's facial expression changes, we are given information about their feelings. While primates are thought to have specialized cortical mechanisms for analyzing the identity of faces, less is known about how these mechanisms unpack transient signals, like expression, that can change from one moment to the next. Here, using an fMRI adaptation paradigm, we demonstrate that while the identity of a face is held constant, there are separate mechanisms in the macaque brain for processing transient changes in the face's expression and orientation. These findings shed new light on the function of the face-processing system during social exchanges.

Combined Neural Tuning in Human Ventral Temporal Cortex Resolves the Perceptual Ambiguity of Morphed 2D Images

We have an amazing ability to categorize objects in the world around us. Nevertheless, how cortical regions in human ventral temporal cortex (VTC), which is critical for categorization, support this behavioral ability, is largely unknown. Here, we examined the relationship between neural responses and behavioral performance during the categorization of morphed silhouettes of faces and hands, which are animate categories processed in cortically adjacent regions in VTC. Our results reveal that the combination of neural responses from VTC face- and body-selective regions more accurately explains behavioral categorization than neural responses from either region alone. Furthermore, we built a model that predicts a person's behavioral performance using estimated parameters of brain-behavior relationships from a different group of people. Moreover, we show that this brain-behavior model generalizes to adjacent face- and body-selective regions in lateral occipitotemporal cortex. Thus, while face- and body-selective regions are located within functionally distinct domain-specific networks, cortically adjacent regions from both networks likely integrate neural responses to resolve competing and perceptually ambiguous information from both categories.

Principles of Intrinsic Motor Cortex Connectivity in Primates

The forelimb representation in motor cortex (M1) is an important model system in contemporary neuroscience. Efforts to understand the organization of the M1 forelimb representation in monkeys have focused on inputs and outputs. In contrast, intrinsic M1 connections remain mostly unexplored, which is surprising given that intra-areal connections universally outnumber extrinsic connections. To address this knowledge gap, we first mapped the M1 forelimb representation with intracortical microstimulation (ICMS) in male squirrel monkeys. Next, we determined the connectivity of individual M1 sites with ICMS + intrinsic signal optical imaging (ISOI). Every stimulation site activated a distinctive pattern of patches (∼0.25 to 1.0 mm radius) that we quantified in relation to the motor map. Arm sites activated patches that were mostly in arm zones. Hand sites followed the same principle, but to a lesser extent. The results collectively indicate that preferential connectivity between functionally matched patches is a prominent organizational principle in M1. Connectivity patterns for a given site were conserved across a range of current amplitudes, train durations, pulse frequencies, and microelectrode depths. In addition, we found close correspondence in somatosensory cortex between connectivity that we revealed with ICMS+ISOI and connections known from tracers. ICMS+ISOI is therefore an effective tool for mapping cortical connectivity and is particularly advantageous for sampling large numbers of sites. This feature was instrumental in revealing the spatial specificity of intrinsic M1 connections, which appear to be woven into the somatotopic organization of the forelimb representation. Such a framework invokes the modular organization well-established for sensory cortical areas.SIGNIFICANCE STATEMENT Intrinsic connections are fundamental to the operations of any cortical area. Surprisingly little is known about the organization of intrinsic connections in motor cortex (M1). We addressed this knowledge gap using intracortical microstimulation (ICMS) concurrently with intrinsic signal optical imaging (ISOI). Quantifying the activation patterns from dozens of M1 sites allowed us to uncover a fundamental principle of M1 organization: M1 patches are preferentially connected with functionally matched patches. Relationship between intrinsic connections and neurophysiological map is well-established for sensory cortical areas, but our study is the first to extend this framework to M1. Microstimulation+imaging opened a unique possibility for investigating the connectivity of dozens of tightly spaced M1 sites, which was the linchpin for uncovering organizational principles.

Localization of movable electrodes in a multi-electrode microdrive in nonhuman primates

BACKGROUND

Recently, large-scale semi-chronic recording systems have been developed, unique in their capability to record simultaneously from multiple individually moveable electrodes. As these recording systems can cover a large area, knowledge of the exact location of each individual electrode is crucial. Currently, the only method of keeping track of electrode depth and thus location is through detailed notebook keeping on neural activity.

NEW METHOD

We have improved the electrode localization by combining pre- and postoperative anatomical magnetic resonance imaging (MRI) scans with high resolution computed tomography (CT) scans throughout the experiment, and validated our method by comparing the resulting location estimates with traditional notebook-keeping. Finally, the actual location of a selection of electrodes was marked at the end of the experiment by creating small metallic depositions using electrical stimulation, and thereby made visible on MRI.

RESULTS

Combining CT scans with a high resolution, artefact reducing sequence during the experiment with a preoperative MRI scan provides crucial information about the exact electrode location of multielectrode arrays with individually moveable electrodes.

COMPARISON WITH EXISTING METHODS

The information obtained from the hybrid CT-MR image and the notes on spiking activity showed a similar pattern, with the clear advantage of the visualization of the exact position of the electrodes using our method.

CONCLUSIONS

The described technique allows for a precise anatomical identification of the recorded brain areas and thus to draw strong conclusions about the role of each targeted cortical area in the behavior under study.

Decoding subcategories of human bodies from both body- and face-responsive cortical regions

Our visual system can easily categorize objects (e.g. faces vs. bodies) and further differentiate them into subcategories (e.g. male vs. female). This ability is particularly important for objects of social significance, such as human faces and bodies. While many studies have demonstrated category selectivity to faces and bodies in the brain, how subcategories of faces and bodies are represented remains unclear. Here, we investigated how the brain encodes two prominent subcategories shared by both faces and bodies, sex and weight, and whether neural responses to these subcategories rely on low-level visual, high-level visual or semantic similarity. We recorded brain activity with fMRI while participants viewed faces and bodies that varied in sex, weight, and image size. The results showed that the sex of bodies can be decoded from both body- and face-responsive brain areas, with the former exhibiting more consistent size-invariant decoding than the latter. Body weight could also be decoded in face-responsive areas and in distributed body-responsive areas, and this decoding was also invariant to image size. The weight of faces could be decoded from the fusiform body area (FBA), and weight could be decoded across face and body stimuli in the extrastriate body area (EBA) and a distributed body-responsive area. The sex of well-controlled faces (e.g. excluding hairstyles) could not be decoded from face- or body-responsive regions. These results demonstrate that both face- and body-responsive brain regions encode information that can distinguish the sex and weight of bodies. Moreover, the neural patterns corresponding to sex and weight were invariant to image size and could sometimes generalize across face and body stimuli, suggesting that such subcategorical information is encoded with a high-level visual or semantic code.

Factors Determining Where Category-Selective Areas Emerge in Visual Cortex

A hallmark of functional localization in the human brain is the presence of areas in visual cortex specialized for representing particular categories such as faces and words. Why do these areas appear where they do during development? Recent findings highlight several general factors to consider when answering this question. Experience-driven category selectivity arises in regions that have: (i) pre-existing selectivity for properties of the stimulus, (ii) are appropriately placed in the computational hierarchy of the visual system, and (iii) exhibit domain-specific patterns of connectivity to nonvisual regions. In other words, cortical location of category selectivity is constrained by what category will be represented, how it will be represented, and why the representation will be used.

Body Patches in Inferior Temporal Cortex Encode Categories with Different Temporal Dynamics

An unresolved question in cognitive neuroscience is how representations of object categories at different levels (basic and superordinate) develop during the course of the neural response within an area. To address this, we decoded categories of different levels from the spiking responses of populations of neurons recorded in two fMRI-defined body patches in the macaque STS. Recordings of the two patches were made in the same animals with the same stimuli. Support vector machine classifiers were trained at brief response epochs and tested at the same or different epochs, thus assessing whether category representations change during the course of the response. In agreement with hierarchical processing within the body patch network, the posterior body patch mid STS body (MSB) showed an earlier onset of categorization compared with the anterior body patch anterior STS body (ASB), irrespective of the categorization level. Decoding of the superordinate body versus nonbody categories was less dynamic in MSB than in ASB, with ASB showing a biphasic temporal pattern. Decoding of the ordinate-level category human versus monkey bodies showed similar temporal patterns in both patches. The decoding onset of superordinate categorizations involving bodies was as early as for basic-level categorization, suggesting that previously reported differences between the onset of basic and superordinate categorizations may depend on the area. The qualitative difference between areas in their dynamics of category representation may hinder the interpretation of decoding dynamics based on EEG or MEG, methods that may mix signals of different areas.

Neural correlates of sparse coding and dimensionality reduction

Supported by recent computational studies, there is increasing evidence that a wide range of neuronal responses can be understood as an emergent property of nonnegative sparse coding (NSC), an efficient population coding scheme based on dimensionality reduction and sparsity constraints. We review evidence that NSC might be employed by sensory areas to efficiently encode external stimulus spaces, by some associative areas to conjunctively represent multiple behaviorally relevant variables, and possibly by the basal ganglia to coordinate movement. In addition, NSC might provide a useful theoretical framework under which to understand the often complex and nonintuitive response properties of neurons in other brain areas. Although NSC might not apply to all brain areas (for example, motor or executive function areas) the success of NSC-based models, especially in sensory areas, warrants further investigation for neural correlates in other regions.

A behavioral face preference deficit in a monkey with an incomplete face patch system

Primates are experts in face perception and naturally show a preference for faces under free-viewing conditions. The primate ventral stream is characterized by a network of face patches that selectively responds to faces, but it remains uncertain how important such parcellation is for face perception. Here we investigated free-viewing behavior in a female monkey who naturally lacks fMRI-defined posterior and middle lateral face patches. We presented a series of content-rich images of scenes that included faces or other objects to that monkey during a free-viewing task and tested a group of 10 control monkeys on the same task for comparison. We found that, compared to controls, the monkey with missing face patches showed a marked reduction of face viewing preference that was most pronounced for the first few fixations. In addition, her gaze fixation patterns were substantially distinct from those of controls, especially for pictures with a face. These data demonstrate an association between the clustering of neurons in face selective patches and a behavioral bias for faces in natural images.

A hierarchical model of social perception: Psychophysical evidence suggests late rather than early integration of visual information from facial expression and body posture

Facial expressions are one of the most important sources of information about another’s emotional states. More recently, other cues such as body posture have been shown to influence how facial expressions are perceived. It has been argued that this biasing effect is underpinned by an early integration of visual information from facial expression and body posture. Here, we replicate this biasing effect, but, using a psychophysical procedure, show that adaptation to facial expressions is unaffected by body context. The integration of face and body information therefore occurs downstream of the sites of adaptation, known to be localised in high-level visual areas of the temporal lobe. Contrary to previous research, our findings thus provide direct evidence for late integration of information from facial expression and body posture. They are consistent with a hierarchical model of social perception, in which social signals from different sources are initially processed independently and in parallel by specialised visual mechanisms. Integration of these different inputs in later stages of the visual system then supports the emergence of the integrated whole-person percept that is consciously experienced.

Effective Connectivity Measured Using Optogenetically Evoked Hemodynamic Signals Exhibits Topography Distinct from Resting State Functional Connectivity in the Mouse

Brain connectomics has expanded from histological assessment of axonal projection connectivity (APC) to encompass resting state functional connectivity (RS-FC). RS-FC analyses are efficient for whole-brain mapping, but attempts to explain aspects of RS-FC (e.g., interhemispheric RS-FC) based on APC have been only partially successful. Neuroimaging with hemoglobin alone lacks specificity for determining how activity in a population of cells contributes to RS-FC. Wide-field mapping of optogenetically defined connectivity could provide insights into the brain's structure-function relationship. We combined optogenetics with optical intrinsic signal imaging to create an efficient, optogenetic effective connectivity (Opto-EC) mapping assay. We examined EC patterns of excitatory neurons in awake, Thy1-ChR2 transgenic mice. These Thy1-based EC (Thy1-EC) patterns were evaluated against RS-FC over the cortex. Compared to RS-FC, Thy1-EC exhibited increased spatial specificity, reduced interhemispheric connectivity in regions with strong RS-FC, and appreciable connection strength asymmetry. Comparing the topography of Thy1-EC and RS-FC patterns to maps of APC revealed that Thy1-EC more closely resembled APC than did RS-FC. The more general method of Opto-EC mapping with hemoglobin can be determined for 100 sites in single animals in under an hour, and is amenable to other neuroimaging modalities. Opto-EC mapping represents a powerful strategy for examining evolving connectivity-related circuit plasticity.

White matter tract anatomy in the rhesus monkey: a fiber dissection study

Brain connectivity in non-human primates (NHPs) has been mainly investigated using tracer techniques and functional connectivity studies. Data on structural connections are scarce and come from diffusion tensor imaging (DTI), since gross anatomical white matter dissection studies in the NHP are lacking. The current study aims to illustrate the course and topography of the major white matter tracts in the macaque using Klingler's fiber dissection. 10 hemispheres obtained from 5 primate brains (Macaca mulatta) were studied according to Klingler's fiber dissection technique. Dissection was performed in a stepwise mesial and lateral fashion exposing the course and topography of the major white matter bundles. Major white matter tracts in the NHP include the corona radiata, tracts of the sagittal stratum, the uncinate fasciculus, the cingulum and the fornix. Callosal fiber topography was homologous to the human brain with leg motor fibers running in the posterior half of the corpus callosum. The relative size of the anterior commissure was larger in the NHP. NHPs and humans share striking homologies with regard to the course and topography of the major white matter tracts.

Frontier of Self and Impact Prediction

The construction of a coherent representation of our body and the mapping of the space immediately surrounding it are of the highest ecological importance. This space has at least three specificities: it is a space where actions are planned in order to interact with our environment; it is a space that contributes to the experience of self and self-boundaries, through tactile processing and multisensory interactions; last, it is a space that contributes to the experience of body integrity against external events. In the last decades, numerous studies have been interested in peripersonal space (PPS), defined as the space directly surrounding us and which we can interact with (for reviews, see Cléry et al., 2015b; de Vignemont and Iannetti, 2015; di Pellegrino and Làdavas, 2015). These studies have contributed to the understanding of how this space is constructed, encoded and modulated. The majority of these studies focused on subparts of PPS (the hand, the face or the trunk) and very few of them investigated the interaction between PPS subparts. In the present review, we summarize the latest advances in this research and we discuss the new perspectives that are set forth for futures investigations on this topic. We describe the most recent methods used to estimate PPS boundaries by the means of dynamic stimuli. We then highlight how impact prediction and approaching stimuli modulate this space by social, emotional and action-related components involving principally a parieto-frontal network. In a next step, we review evidence that there is not a unique representation of PPS but at least three sub-sections (hand, face and trunk PPS). Last, we discuss how these subspaces interact, and we question whether and how bodily self-consciousness (BSC) is functionally and behaviorally linked to PPS.

Representation of multiple objects in macaque category-selective areas

Object recognition in the natural world usually occurs in the presence of multiple surrounding objects, but responses of neurons in inferotemporal (IT) cortex, the large brain area responsible for object recognition, have mostly been studied only to isolated objects. We study rules governing responses to multiple objects by cells in two category-selective regions of macaque IT cortex, the middle lateral face patch (ML) and the middle body patch (MB). We find that responses of single ML and MB cells to pairs of objects can be explained by the widely accepted framework of normalization, with one added ingredient: homogeneous category selectivity of neighboring neurons forming the normalization pool. This rule leads to winner-take-all, contralateral-take-all, or weighted averaging behavior in single cells, depending on the category, spatial configuration, and relative contrast of the two objects. The winner-take-all behavior suggests a potential mechanism for clutter-invariant representation of face and bodies under certain conditions.

Inferotemporal cortex (IT) neurons respond to specific objects but the precise neural mechanisms for clutter-invariant representation is not known. Here the authors show that face and body patch IT neurons respond to multiple objects with winner-take-all, contralateral-take-all or weighted averaging depending on the stimulus properties.

Socio-sexual processing in cortical circuits

How does social and sexual information processing map onto cortical circuits? Addressing this question has been difficult, because of a lack of circuit-oriented social neuroscience and an absence of measurements from interacting brains. Recent work showed social information is already differentially processed in the primary sensory cortices. Converging evidence suggests that prefrontal areas contribute to social interaction processing and determining social hierarchies. In social interactions, we identify gender in split seconds, but after centuries of anatomy we are still unable to distinguish male and female cortices. Novel data reinforce the idea of a bisexual layout of cortical anatomy. Physiological analysis, however, provided evidence for sex differences in cortical processing. Unlike other cortical circuits, sexual processing circuits undergo major rewiring and expansion during puberty and show lasting damage from childhood abuse.

Shape Selectivity of Middle Superior Temporal Sulcus Body Patch Neurons

Functional MRI studies in primates have demonstrated cortical regions that are strongly activated by visual images of bodies. The presence of such body patches in macaques allows characterization of the stimulus selectivity of their single neurons. Middle superior temporal sulcus body (MSB) patch neurons showed similar stimulus selectivity for natural, shaded, and textured images compared with their silhouettes, suggesting that shape is an important determinant of MSB responses. Here, we examined and modeled the shape selectivity of single MSB neurons. We measured the responses of single MSB neurons to a variety of shapes producing a wide range of responses. We used an adaptive stimulus sampling procedure, selecting and modifying shapes based on the responses of the neuron. Forty percent of shapes that produced the maximal response were rated by humans as animal-like, but the top shape of many MSB neurons was not judged as resembling a body. We fitted the shape selectivity of MSB neurons with a model that parameterizes shapes in terms of curvature and orientation of contour segments, with a pixel-based model, and with layers of units of convolutional neural networks (CNNs). The deep convolutional layers of CNNs provided the best goodness-of-fit, with a median explained explainable variance of the neurons’ responses of 77%. The goodness-of-fit increased along the convolutional layers’ hierarchy but was lower for the fully connected layers. Together with demonstrating the successful modeling of single unit shape selectivity with deep CNNs, the data suggest that semantic or category knowledge determines only slightly the single MSB neuron’s shape selectivity.