Development of the macaque face-patch system

Measuring neuroplasticity in human development: the potential to inform the type and timing of mental health interventions

Neuroplasticity during sensitive periods, the molecular and cellular process of enduring neural change in response to external stimuli during windows of high environmental sensitivity, is crucial for adaptation to expected environments and has implications for psychiatry. Animal research has characterized the developmental sequence and neurobiological mechanisms that govern neuroplasticity, yet gaps in our ability to measure neuroplasticity in humans limit the clinical translation of these principles. Here, we present a roadmap for the development and validation of neuroimaging and electrophysiology measures that index neuroplasticity to begin to address these gaps. We argue that validation of measures to track neuroplasticity in humans will elucidate the etiology of mental illness and inform the type and timing of mental health interventions to optimize effectiveness. We outline criteria for evaluating putative neuroimaging measures of plasticity in humans including links to neurobiological mechanisms shown to govern plasticity in animal models, developmental change that reflects heightened early life plasticity, and prediction of neural and/or behavior change. These criteria are applied to three putative measures of neuroplasticity using electroencephalography (gamma oscillations, aperiodic exponent of power/frequency) or functional magnetic resonance imaging (amplitude of low frequency fluctuations). We discuss the use of these markers in psychiatry, envision future uses for clinical and developmental translation, and suggest steps to address the limitations of the current putative neuroimaging measures of plasticity. With additional work, we expect these markers will significantly impact mental health and be used to characterize mechanisms, devise new interventions, and optimize developmental trajectories to reduce psychopathology risk.

Development of Higher-Level Vision: A Network Perspective

Most studies on the development of the visual system have focused on the mechanisms shaping early visual stages up to the level of primary visual cortex (V1). Much less is known about the development of the stages after V1 that handle the higher visual functions fundamental to everyday life. The standard model for the maturation of these areas is that it occurs sequentially, according to the positions of areas in the adult hierarchy. Yet, the existing literature reviewed here paints a different picture, one in which the adult configuration emerges through a sequence of unique network configurations that are not mere partial versions of the adult hierarchy. In addition to studying higher visual development per se to fill major gaps in knowledge, it will be crucial to adopt a network-level perspective in future investigations to unravel normal developmental mechanisms, identify vulnerabilities to developmental disorders, and eventually devise treatments for these disorders.

Innate face-selectivity in the brain of young domestic chicks

Shortly after birth, both naïve animals and newborn babies exhibit a spontaneous attraction to faces and face-like stimuli. While neurons selectively responding to faces have been found in the inferotemporal cortex of adult primates, face-selective domains in the brains of young monkeys seem to develop only later in life after exposure to faces. This has fueled a debate on the role of experience in the development of face-detector mechanisms, since face preferences are well documented in naïve animals, such as domestic chicks reared without exposure to faces. Here, we demonstrate that neurons in a higher-order processing brain area of one-week-old face-naïve domestic chicks selectively respond to a face-like configuration. Our single-cell recordings show that these neurons do not respond to alternative configurations or isolated facial features. Moreover, the population activity of face-selective neurons accurately encoded the face-like stimulus as a unique category. Thus, our findings show that face selectivity is present in the brains of very young animals without preexisting experience.

Inferotemporal face patches are histo-architectonically distinct

An interconnected group of cortical regions distributed across the primate inferotemporal cortex forms a network critical for face perception. Understanding the microarchitecture of this face network can refine mechanistic accounts of how individual areas function and interact to support visual perception. To address this, we acquire a unique dataset in macaque monkeys combining fMRI to localize face patches in vivo and then ex vivo histology to resolve their histo-architecture across cortical depths in the same individuals. Our findings reveal that face patches differ based on cytochrome oxidase (CO) and, to a lesser extent, myelin staining, with the middle lateral (ML) face patch exhibiting pronounced CO staining. Histo-architectonic differences are less pronounced when using probabilistic definitions of face patches, underscoring the importance of precision mapping integrating in vivo and ex vivo measurements in the same individuals. This study indicates that the macaque face patch network is composed of architectonically distinct components.

Developmentally stable representations of naturalistic image structure in macaque visual cortex

To determine whether post-natal improvements in form vision result from changes in mid-level visual cortex, we studied neuronal and behavioral responses to texture stimuli that were matched in local spectral content but varied in "naturalistic" structure. We made longitudinal measurements of visual behavior from 16 to 95 weeks of age, and of neural responses from 20 to 56 weeks. We also measured behavioral and neural responses in near-adult animals more than 3 years old. Behavioral sensitivity reached half-maximum around 25 weeks of age, but neural sensitivities remained stable through all ages tested. Neural sensitivity to naturalistic structure was highest in V4, lower in V2 and inferotemporal cortex (IT), and barely discernible in V1. Our results show a dissociation between stable neural performance and improving behavioral performance, which may reflect improved processing capacity in circuits downstream of visual cortex.

Short-latency preference for faces in primate superior colliculus depends on visual cortex

Face processing is fundamental to primates and has been extensively studied in higher-order visual cortex. Here, we report that visual neurons in the midbrain superior colliculus (SC) of macaque monkeys display a preference for images of faces. This preference emerges within 40 ms of stimulus onset-well before "face patches" in visual cortex-and, at the population level, can be used to distinguish faces from other visual objects with accuracies of ∼80%. This short-latency face preference in SC depends on signals routed through early visual cortex because inactivating the lateral geniculate nucleus, the key relay from retina to cortex, virtually eliminates visual responses in SC, including face-related activity. These results reveal an unexpected circuit in the primate visual system for rapidly detecting faces in the periphery, complementing the higher-order areas needed for recognizing individual faces.

A Whole-Brain Topographic Ontology

It is a common view that the intricate array of specialized domains in the ventral visual pathway is innately prespecified. What this review postulates is that it is not. We explore the origins of domain specificity, hypothesizing that the adult brain emerges from an interplay between a domain-general map-based architecture, shaped by intrinsic mechanisms, and experience. We argue that the most fundamental innate organization of cortex in general, and not just the visual pathway, is a map-based topography that governs how the environment maps onto the brain, how brain areas interconnect, and ultimately, how the brain processes information.

Object recognition in primates: what can early visual areas contribute?

Introduction

If neuroscientists were asked which brain area is responsible for object recognition in primates, most would probably answer infero-temporal (IT) cortex. While IT is likely responsible for fine discriminations, and it is accordingly dominated by foveal visual inputs, there is more to object recognition than fine discrimination. Importantly, foveation of an object of interest usually requires recognizing, with reasonable confidence, its presence in the periphery. Arguably, IT plays a secondary role in such peripheral recognition, and other visual areas might instead be more critical.

Methods

To investigate how signals carried by early visual processing areas (such as LGN and V1) could be used for object recognition in the periphery, we focused here on the task of distinguishing faces from non-faces. We tested how sensitive various models were to nuisance parameters, such as changes in scale and orientation of the image, and the type of image background.

Results

We found that a model of V1 simple or complex cells could provide quite reliable information, resulting in performance better than 80% in realistic scenarios. An LGN model performed considerably worse.

Discussion

Because peripheral recognition is both crucial to enable fine recognition (by bringing an object of interest on the fovea), and probably sufficient to account for a considerable fraction of our daily recognition-guided behavior, we think that the current focus on area IT and foveal processing is too narrow. We propose that rather than a hierarchical system with IT-like properties as its primary aim, object recognition should be seen as a parallel process, with high-accuracy foveal modules operating in parallel with lower-accuracy and faster modules that can operate across the visual field.

Object recognition in primates: What can early visual areas contribute?

If neuroscientists were asked which brain area is responsible for object recognition in primates, most would probably answer infero-temporal (IT) cortex. While IT is likely responsible for fine discriminations, and it is accordingly dominated by foveal visual inputs, there is more to object recognition than fine discrimination. Importantly, foveation of an object of interest usually requires recognizing, with reasonable confidence, its presence in the periphery. Arguably, IT plays a secondary role in such peripheral recognition, and other visual areas might instead be more critical. To investigate how signals carried by early visual processing areas (such as LGN and V1) could be used for object recognition in the periphery, we focused here on the task of distinguishing faces from non-faces. We tested how sensitive various models were to nuisance parameters, such as changes in scale and orientation of the image, and the type of image background. We found that a model of V1 simple or complex cells could provide quite reliable information, resulting in performance better than 80% in realistic scenarios. An LGN model performed considerably worse. Because peripheral recognition is both crucial to enable fine recognition (by bringing an object of interest on the fovea), and probably sufficient to account for a considerable fraction of our daily recognition-guided behavior, we think that the current focus on area IT and foveal processing is too narrow. We propose that rather than a hierarchical system with IT-like properties as its primary aim, object recognition should be seen as a parallel process, with high-accuracy foveal modules operating in parallel with lower-accuracy and faster modules that can operate across the visual field.

Cortical Face-Selective Responses Emerge Early in Human Infancy

In human adults, multiple cortical regions respond robustly to faces, including the occipital face area (OFA) and fusiform face area (FFA), implicated in face perception, and the superior temporal sulcus (STS) and medial prefrontal cortex (MPFC), implicated in higher-level social functions. When in development, does face selectivity arise in each of these regions? Here, we combined two awake infant functional magnetic resonance imaging (fMRI) datasets to create a sample size twice the size of previous reports (n = 65 infants; 2.6-9.6 months). Infants watched movies of faces, bodies, objects, and scenes, while fMRI data were collected. Despite variable amounts of data from each infant, individual subject whole-brain activation maps revealed responses to faces compared to nonface visual categories in the approximate location of OFA, FFA, STS, and MPFC. To determine the strength and nature of face selectivity in these regions, we used cross-validated functional region of interest analyses. Across this larger sample size, face responses in OFA, FFA, STS, and MPFC were significantly greater than responses to bodies, objects, and scenes. Even the youngest infants (2-5 months) showed significantly face-selective responses in FFA, STS, and MPFC, but not OFA. These results demonstrate that face selectivity is present in multiple cortical regions within months of birth, providing powerful constraints on theories of cortical development.

Beyond faces: the contribution of the amygdala to visual processing in the macaque brain

The amygdala is present in a diverse range of vertebrate species, such as lizards, rodents, and primates; however, its structure and connectivity differs across species. The increased connections to visual sensory areas in primate species suggests that understanding the visual selectivity of the amygdala in detail is critical to revealing the principles underlying its function in primate cognition. Therefore, we designed a high-resolution, contrast-agent enhanced, event-related fMRI experiment, and scanned 3 adult rhesus macaques, while they viewed 96 naturalistic stimuli. Half of these stimuli were social (defined by the presence of a conspecific), the other half were nonsocial. We also nested manipulations of emotional valence (positive, neutral, and negative) and visual category (faces, nonfaces, animate, and inanimate) within the stimulus set. The results reveal widespread effects of emotional valence, with the amygdala responding more on average to inanimate objects and animals than faces, bodies, or social agents in this experimental context. These findings suggest that the amygdala makes a contribution to primate vision that goes beyond an auxiliary role in face or social perception. Furthermore, the results highlight the importance of stimulus selection and experimental design when probing the function of the amygdala and other visually responsive brain regions.

Face detection mechanisms: Nature vs. nurture

For many animals, faces are a vitally important visual stimulus. Hence, it is not surprising that face perception has become a very popular research topic in neuroscience, with ca. 2000 papers published every year. As a result, significant progress has been made in understanding the intricate mechanisms underlying this phenomenon. However, the ontogeny of face perception, in particular the role of innate predispositions, remains largely unexplored at the neural level. Several influential studies in monkeys have suggested that seeing faces is necessary for the development of the face-selective brain domains. At the same time, behavioural experiments with newborn human babies and newly-hatched domestic chicks demonstrate that a spontaneous preference towards faces emerges early in life without pre-existing experience. Moreover, we were recently able to record face-selective neural responses in the brain of young, face-naïve chicks, thus demonstrating the existence of an innate face detection mechanism. In this review, we discuss these seemingly contradictory results and propose potential experimental approaches to resolve some of the open questions.

Developmentally stable representations of naturalistic image structure in macaque visual cortex

We studied visual development in macaque monkeys using texture stimuli, matched in local spectral content but varying in "naturalistic" structure. In adult monkeys, naturalistic textures preferentially drive neurons in areas V2 and V4, but not V1. We paired behavioral measurements of naturalness sensitivity with separately-obtained neuronal population recordings from neurons in areas V1, V2, V4, and inferotemporal cortex (IT). We made behavioral measurements from 16 weeks of age and physiological measurements as early as 20 weeks, and continued through 56 weeks. Behavioral sensitivity reached half of maximum at roughly 25 weeks of age. Neural sensitivities remained stable from the earliest ages tested. As in adults, neural sensitivity to naturalistic structure increased from V1 to V2 to V4. While sensitivities in V2 and IT were similar, the dimensionality of the IT representation was more similar to V4's than to V2's.

Toddlers' sensitivity to dominance traits from faces

In adults, seeing individual faces is sufficient to trigger dominance evaluations, even when conflict is absent. From early on, infants represent dyadic dominance relations and they can infer conflict outcomes based on a variety of cues. To date, it is unclear if toddlers also make automatic dominance trait evaluations of individual faces. Here we asked if toddlers are sensitive to dominance traits from faces, and whether their sensitivity depends on their face experience. We employed a visual preference paradigm to study 18- and 24-month-old toddlers' sensitivity to dominance traits from three types of faces: artificial, male, female. When presented with artificial faces (Experiment 1), 18- and 24-month-olds attended longer to the non-dominant faces, but only when they were in upright orientation. For real male faces (Experiment 2), toddlers showed equivalent looking durations to the dominant and non-dominant upright faces. However, when looking at female faces (Experiment 3), toddlers displayed a visual preference for the upright non-dominant faces at 24 months. To our knowledge, this is the first study to show that toddlers already display sensitivity to facial cues of dominance from 18 months of age, at least for artificial face stimuli.

The Wire Is Not the Territory: Understanding Representational Drift in Olfaction With Dynamical Systems Theory

Representational drift is a phenomenon of increasing interest in the cognitive and neural sciences. While investigations are ongoing for other sensory cortices, recent research has demonstrated the pervasiveness in which it occurs in the piriform cortex for olfaction. This gradual weakening and shifting of stimulus-responsive cells has critical implications for sensory stimulus-response models and perceptual decision-making. While representational drift may complicate traditional sensory processing models, it could be seen as an advantage in olfaction, as animals live in environments with constantly changing and unpredictable chemical information. Non-topographical encoding in the olfactory system may aid in contextualizing reactions to promiscuous odor stimuli, facilitating adaptive animal behavior and survival. This article suggests that traditional models of stimulus-(neural) response mapping in olfaction may need to be reevaluated and instead motivates the use of dynamical systems theory as a methodology and conceptual framework.

Short-latency preference for faces in the primate superior colliculus

Face processing is fundamental to primates and has been extensively studied in higher-order visual cortex. Here we report that visual neurons in the midbrain superior colliculus (SC) display a preference for faces, that the preference emerges within 50ms of stimulus onset - well before "face patches" in visual cortex - and that this activity can distinguish faces from other visual objects with accuracies of ~80%. This short-latency preference in SC depends on signals routed through early visual cortex, because inactivating the lateral geniculate nucleus, the key relay from retina to cortex, virtually eliminates visual responses in SC, including face-related activity. These results reveal an unexpected circuit in the primate visual system for rapidly detecting faces in the periphery, complementing the higher-order areas needed for recognizing individual faces.

Spikiness and animacy as potential organizing principles of human ventral visual cortex

Considerable research has been devoted to understanding the fundamental organizing principles of the ventral visual pathway. A recent study revealed a series of 3-4 topographical maps arranged along the macaque inferotemporal (IT) cortex. The maps articulated a two-dimensional space based on the spikiness and animacy of visual objects, with "inanimate-spiky" and "inanimate-stubby" regions of the maps constituting two previously unidentified cortical networks. The goal of our study was to determine whether a similar functional organization might exist in human IT. To address this question, we presented the same object stimuli and images from "classic" object categories (bodies, faces, houses) to humans while recording fMRI activity at 7 Tesla. Contrasts designed to reveal the spikiness-animacy object space evoked extensive significant activation across human IT. However, unlike the macaque, we did not observe a clear sequence of complete maps, and selectivity for the spikiness-animacy space was deeply and mutually entangled with category-selectivity. Instead, we observed multiple new stimulus preferences in category-selective regions, including functional sub-structure related to object spikiness in scene-selective cortex. Taken together, these findings highlight spikiness as a promising organizing principle of human IT and provide new insights into the role of category-selective regions in visual object processing.

Towards an optimization of functional localizers in non-human primate neuroimaging with (fMRI) frequency-tagging

Non-human primate (NHP) neuroimaging can provide essential insights into the neural basis of human cognitive functions. While functional magnetic resonance imaging (fMRI) localizers can play an essential role in reaching this objective (Russ et al., 2021), they often differ substantially across species in terms of paradigms, measured signals, and data analysis, biasing the comparisons. Here we introduce a functional frequency-tagging face localizer for NHP imaging, successfully developed in humans and outperforming standard face localizers (Gao et al., 2018). FMRI recordings were performed in two awake macaques. Within a rapid 6 Hz stream of natural non-face objects images, human or monkey face stimuli were presented in bursts every 9 s. We also included control conditions with phase-scrambled versions of all images. As in humans, face-selective activity was objectively identified and quantified at the peak of the face-stimulation frequency (0.111 Hz) and its second harmonic (0.222 Hz) in the Fourier domain. Focal activations with a high signal-to-noise ratio were observed in regions previously described as face-selective, mainly in the STS (clusters PL, ML, MF; also, AL, AF), both for human and monkey faces. Robust face-selective activations were also found in the prefrontal cortex of one monkey (PVL and PO clusters). Face-selective neural activity was highly reliable and excluded all contributions from low-level visual cues contained in the amplitude spectrum of the stimuli. These observations indicate that fMRI frequency-tagging provides a highly valuable approach to objectively compare human and monkey visual recognition systems within the same framework.

Functional maturation in visual pathways predicts attention to the eyes in infant rhesus macaques: Effects of social status

Differences in looking at the eyes of others are one of the earliest behavioral markers for social difficulties in neurodevelopmental disabilities, including autism. However, it is unknown how early visuo-social experiences relate to the maturation of infant brain networks that process visual social stimuli. We investigated functional connectivity (FC) within the ventral visual object pathway as a contributing neural system. Densely sampled, longitudinal eye-tracking and resting state fMRI (rs-fMRI) data were collected from infant rhesus macaques, an important model of human social development, from birth through 6 months of age. Mean trajectories were fit for both datasets and individual trajectories from subjects with both eye-tracking and rs-fMRI data were used to test for brain-behavior relationships. Exploratory findings showed infants with greater increases in FC between left V1 to V3 visual areas have an earlier increase in eye-looking before 2 months. This relationship was moderated by social status such that infants with low social status had a stronger association between left V1 to V3 connectivity and eye-looking than high status infants. Results indicated that maturation of the visual object pathway may provide an important neural substrate supporting adaptive transitions in social visual attention during infancy.

Progressive neuronal plasticity in primate visual cortex during stimulus familiarization

The primate brain is equipped to learn and remember newly encountered visual stimuli such as faces and objects. In the macaque inferior temporal (IT) cortex, neurons mark the familiarity of a visual stimulus through response modification, often involving a decrease in spiking rate. Here, we investigate the emergence of this neural plasticity by longitudinally tracking IT neurons during several weeks of familiarization with face images. We found that most neurons in the anterior medial (AM) face patch exhibited a gradual decline in their late-phase visual responses to multiple stimuli. Individual neurons varied from days to weeks in their rates of plasticity, with time constants determined by the number of days of exposure rather than the cumulative number of presentations. We postulate that the sequential recruitment of neurons with experience-modified responses may provide an internal and graded measure of familiarity strength, which is a key mnemonic component of visual recognition.

Exploring pattern recognition: what is the relationship between the recognition of words, faces and other objects?

Debate surrounds processes of visual recognition, with no consensus as to whether recognition of distinct object categories (faces, bodies, cars, and words) is domain specific or subserved by domain-general visual recognition mechanisms. Here, we investigated correlations between the performance of 74 participants on recognition tasks for words, faces and other object categories. Participants completed a counter-balanced test battery of the Cambridge Face, Car and Body Parts Memory tests, as well as a standard four category lexical decision task, with response time and recognition accuracy as dependent variables. Results revealed significant correlations across domains for both recognition accuracy and response time, providing some support for domain-general pattern recognition. Further exploration of the data using principal component analysis (PCA) revealed a two-component model for both the response time and accuracy data. However, how the various word and object recognition tasks fitted these components varied considerably but did hint at familiarity/expertise as a common factor. In sum, we argue a complex relationship exists between domain-specific processing and domain-general processing, but that this is shaped by expertise. To further our understanding of pattern recognition, research investigating the recognition of words, faces and other objects in dyslexic individuals is recommended, as is research exploiting neuroimaging methodologies, with excellent temporal resolution, to chart the temporal specifics of different forms of visual pattern recognition.

Visual category representations in the infant brain

Visual categorization is a human core cognitive capacity1,2 that depends on the development of visual category representations in the infant brain.3,4,5,6,7 However, the exact nature of infant visual category representations and their relationship to the corresponding adult form remains unknown.8 Our results clarify the nature of visual category representations from electroencephalography (EEG) data in 6- to 8-month-old infants and their developmental trajectory toward adult maturity in the key characteristics of temporal dynamics,2,9 representational format,10,11,12 and spectral properties.13,14 Temporal dynamics change from slowly emerging, developing representations in infants to quickly emerging, complex representations in adults. Despite those differences, infants and adults already partly share visual category representations. The format of infants' representations is visual features of low to intermediate complexity, whereas adults' representations also encode high-complexity features. Theta band activity contributes to visual category representations in infants, and these representations are shifted to the alpha/beta band in adults. Together, we reveal the developmental neural basis of visual categorization in humans, show how information transmission channels change in development, and demonstrate the power of advanced multivariate analysis techniques in infant EEG research for theory building in developmental cognitive science.

The retrocalcarine sulcus maps different retinotopic representations in macaques and humans

Primate cerebral cortex is highly convoluted with much of the cortical surface buried in sulcal folds. The origins of cortical folding and its functional relevance have been a major focus of systems and cognitive neuroscience, especially when considering stereotyped patterns of cortical folding that are shared across individuals within a primate species and across multiple species. However, foundational questions regarding organizing principles shared across species remain unanswered. Taking a cross-species comparative approach with a careful consideration of historical observations, we investigate cortical folding relative to primary visual cortex (area V1). We identify two macroanatomical structures-the retrocalcarine and external calcarine sulci-in 24 humans and 6 macaque monkeys. We show that within species, these sulci are identifiable in all individuals, fall on a similar part of the V1 retinotopic map, and thus, serve as anatomical landmarks predictive of functional organization. Yet, across species, the underlying eccentricity representations corresponding to these macroanatomical structures differ strikingly across humans and macaques. Thus, the correspondence between retinotopic representation and cortical folding for an evolutionarily old structure like V1 is species-specific and suggests potential differences in developmental and experiential constraints across primates.

Representation of expression and identity by ventral prefrontal neurons

Evidence has suggested that the ventrolateral prefrontal cortex (VLPFC) processes social stimuli, including faces and vocalizations, which are essential for communication. Features embedded within audiovisual stimuli, including emotional expression and caller identity, provide abundant information about an individual's intention, emotional state, motivation, and social status, which are important to encode in a social exchange. However, it is unknown to what extent the VLPFC encodes such features. To investigate the role of VLPFC during social communication, we recorded single-unit activity while rhesus macaques (Macaca mulatta) performed a nonmatch-to-sample task using species-specific face-vocalization stimuli that differed in emotional expression or caller identity. 75% of recorded cells were task-related and of these >70% were responsive during the nonmatch period. A larger proportion of nonmatch cells encoded the stimulus rather than the context of the trial type. A subset of responsive neurons were most commonly modulated by the identity of the nonmatch stimulus and less by the emotional expression, or both features within the face-vocalization stimuli presented during the nonmatch period. Neurons encoding identity were found in VLPFC across a broader region than expression related cells which were confined to only the anterolateral portion of the recording chamber in VLPFC. These findings suggest that, within a working memory paradigm, VLPFC processes features of face and vocal stimuli, such as emotional expression and identity, in addition to task and contextual information. Thus, stimulus and contextual information may be integrated by VLPFC during social communication.

The cortical and subcortical correlates of face pareidolia in the macaque brain

Face detection is a foundational social skill for primates. This vital function is thought to be supported by specialized neural mechanisms; however, although several face-selective regions have been identified in both humans and nonhuman primates, there is no consensus about which region(s) are involved in face detection. Here, we used naturally occurring errors of face detection (i.e. objects with illusory facial features referred to as examples of 'face pareidolia') to identify regions of the macaque brain implicated in face detection. Using whole-brain functional magnetic resonance imaging to test awake rhesus macaques, we discovered that a subset of face-selective patches in the inferior temporal cortex, on the lower lateral edge of the superior temporal sulcus, and the amygdala respond more to objects with illusory facial features than matched non-face objects. Multivariate analyses of the data revealed differences in the representation of illusory faces across the functionally defined regions of interest. These differences suggest that the cortical and subcortical face-selective regions contribute uniquely to the detection of facial features. We conclude that face detection is supported by a multiplexed system in the primate brain.

Social connections predict brain structure in a multidimensional free-ranging primate society

Reproduction and survival in most primate species reflects management of both competitive and cooperative relationships. Here, we investigated the links between neuroanatomy and sociality in free-ranging rhesus macaques. In adults, the number of social partners predicted the volume of the mid-superior temporal sulcus and ventral-dysgranular insula, implicated in social decision-making and empathy, respectively. We found no link between brain structure and other key social variables such as social status or indirect connectedness in adults, nor between maternal social networks or status and dependent infant brain structure. Our findings demonstrate that the size of specific brain structures varies with the number of direct affiliative social connections and suggest that this relationship may arise during development. These results reinforce proposed links between social network size, biological success, and the expansion of specific brain circuits.

Emerged human-like facial expression representation in a deep convolutional neural network

Recent studies found that the deep convolutional neural networks (DCNNs) trained to recognize facial identities spontaneously learned features that support facial expression recognition, and vice versa. Here, we showed that the self-emerged expression-selective units in a VGG-Face trained for facial identification were tuned to distinct basic expressions and, importantly, exhibited hallmarks of human expression recognition (i.e., facial expression confusion and categorical perception). We then investigated whether the emergence of expression-selective units is attributed to either face-specific experience or domain-general processing by conducting the same analysis on a VGG-16 trained for object classification and an untrained VGG-Face without any visual experience, both having the identical architecture with the pretrained VGG-Face. Although similar expression-selective units were found in both DCNNs, they did not exhibit reliable human-like characteristics of facial expression perception. Together, these findings revealed the necessity of domain-specific visual experience of face identity for the development of facial expression perception, highlighting the contribution of nurture to form human-like facial expression perception.

Lateral Habenula Responses During Eye Contact in a Reward Conditioning Task

For many animals, social interaction may have intrinsic reward value over and above its utility as a means to the desired end. Eye contact is the starting point of interactions in many social animals, including primates, and abnormal patterns of eye contact are present in many mental disorders. Whereas abundant previous studies have shown that negative emotions such as fear strongly affect eye contact behavior, modulation of eye contact by reward has received scant attention. Here we recorded eye movement patterns and neural activity in lateral habenula while monkeys viewed faces in the context of Pavlovian and instrumental conditioning tasks. Faces associated with larger rewards spontaneously elicited longer periods of eye contact from the monkeys, even though this behavior was not required or advantaged in the task. Concurrently, lateral habenula neurons were suppressed by faces signaling high value and excited by faces signaling low value. These results suggest that the reward signaling of lateral habenula may contribute to social behavior and disorders, presumably through its connections with the basal ganglia.

Self-tuition as an essential design feature of the brain

We are curious by nature, particularly when young. Evolution has endowed our brain with an inbuilt obligation to educate itself. In this perspectives article, we posit that self-tuition is an evolved principle of vertebrate brain design that is reflected in its basic architecture and critical for its normal development. Self-tuition involves coordination between functionally distinct components of the brain, with one set of areas motivating exploration that leads to the experiences that train another set. We review key hypothalamic and telencephalic structures involved in this interplay, including their anatomical connections and placement within the segmental architecture of conserved forebrain circuits. We discuss the nature of educative behaviours motivated by the hypothalamus, innate stimulus biases, the relationship to survival in early life, and mechanisms by which telencephalic areas gradually accumulate knowledge. We argue that this aspect of brain function is of paramount importance for systems neuroscience, as it confers neural specialization and allows animals to attain far more sophisticated behaviours than would be possible through genetic mechanisms alone. Self-tuition is of particular importance in humans and other primates, whose large brains and complex social cognition rely critically on experience-based learning during a protracted childhood period.

This article is part of the theme issue ‘Systems neuroscience through the lens of evolutionary theory’.

Selective responses to faces, scenes, and bodies in the ventral visual pathway of infants

Three of the most robust functional landmarks in the human brain are the selective responses to faces in the fusiform face area (FFA), scenes in the parahippocampal place area (PPA), and bodies in the extrastriate body area (EBA). Are the selective responses of these regions present early in development or do they require many years to develop? Prior evidence leaves this question unresolved. We designed a new 32-channel infant magnetic resonance imaging (MRI) coil and collected high-quality functional MRI (fMRI) data from infants (2-9 months of age) while they viewed stimuli from four conditions-faces, bodies, objects, and scenes. We find that infants have face-, scene-, and body-selective responses in the location of the adult FFA, PPA, and EBA, respectively, powerfully constraining accounts of cortical development.

Face detection in untrained deep neural networks

Face-selective neurons are observed in the primate visual pathway and are considered as the basis of face detection in the brain. However, it has been debated as to whether this neuronal selectivity can arise innately or whether it requires training from visual experience. Here, using a hierarchical deep neural network model of the ventral visual stream, we suggest a mechanism in which face-selectivity arises in the complete absence of training. We found that units selective to faces emerge robustly in randomly initialized networks and that these units reproduce many characteristics observed in monkeys. This innate selectivity also enables the untrained network to perform face-detection tasks. Intriguingly, we observed that units selective to various non-face objects can also arise innately in untrained networks. Our results imply that the random feedforward connections in early, untrained deep neural networks may be sufficient for initializing primitive visual selectivity.

Cortical recycling in high-level visual cortex during childhood development

Human ventral temporal cortex contains category-selective regions that respond preferentially to ecologically relevant categories such as faces, bodies, places and words and that are causally involved in the perception of these categories. How do these regions develop during childhood? We used functional magnetic resonance imaging to measure longitudinal development of category selectivity in school-age children over 1 to 5 years. We discovered that, from young childhood to the teens, face- and word-selective regions in ventral temporal cortex expand and become more category selective, but limb-selective regions shrink and lose their preference for limbs. Critically, as a child develops, increases in face and word selectivity are directly linked to decreases in limb selectivity, revealing that during childhood, limb selectivity in ventral temporal cortex is repurposed into word and face selectivity. These data provide evidence for cortical recycling during childhood development. This has important implications for understanding typical as well as atypical brain development and necessitates a rethinking of how cortical function develops during childhood.

One object, two networks? Assessing the relationship between the face and body-selective regions in the primate visual system

Faces and bodies are often treated as distinct categories that are processed separately by face- and body-selective brain regions in the primate visual system. These regions occupy distinct regions of visual cortex and are often thought to constitute independent functional networks. Yet faces and bodies are part of the same object and their presence inevitably covary in naturalistic settings. Here, we re-evaluate both the evidence supporting the independent processing of faces and bodies and the organizational principles that have been invoked to explain this distinction. We outline four hypotheses ranging from completely separate networks to a single network supporting the perception of whole people or animals. The current evidence, especially in humans, is compatible with all of these hypotheses, making it presently unclear how the representation of faces and bodies is organized in the cortex.

Naïve and Experienced Honeybee Foragers Learn Normally Configured Flowers More Easily Than Non-configured or Highly Contrasted Flowers

Angiosperms have evolved to attract and/or deter specific pollinators. Flowers provide signals and cues such as scent, colour, size, pattern, and shape, which allow certain pollinators to more easily find and visit the same type of flower. Over evolutionary time, bees and angiosperms have co-evolved resulting in flowers being more attractive to bee vision and preferences, and allowing bees to recognise specific flower traits to make decisions on where to forage. Here we tested whether bees are instinctively tuned to process flower shape by training both flower-experienced and flower-naïve honeybee foragers to discriminate between pictures of two different flower species when images were either normally configured flowers or flowers which were scrambled in terms of spatial configuration. We also tested whether increasing picture contrast, to make flower features more salient, would improve or impair performance. We used four flower conditions: (i) normally configured greyscale flower pictures, (ii) scrambled flower configurations, (iii) high contrast normally configured flowers, and (iv) asymmetrically scrambled flowers. While all flower pictures contained very similar spatial information, both experienced and naïve bees were better able to learn to discriminate between normally configured flowers than between any of the modified versions. Our results suggest that a specialisation in flower recognition in bees is due to a combination of hard-wired neural circuitry and experience-dependent factors.

On the relationship between maps and domains in inferotemporal cortex

How does the brain encode information about the environment? Decades of research have led to the pervasive notion that the object-processing pathway in primate cortex consists of multiple areas that are each specialized to process different object categories (such as faces, bodies, hands, non-face objects and scenes). The anatomical consistency and modularity of these regions have been interpreted as evidence that these regions are innately specialized. Here, we propose that ventral-stream modules do not represent clusters of circuits that each evolved to process some specific object category particularly important for survival, but instead reflect the effects of experience on a domain-general architecture that evolved to be able to adapt, within a lifetime, to its particular environment. Furthermore, we propose that the mechanisms underlying the development of domains are both evolutionarily old and universal across cortex. Topographic maps are fundamental, governing the development of specializations across systems, providing a framework for brain organization.

Reading: The Confluence of Vision and Language

The scientific study of reading has a rich history that spans disciplines from vision science to linguistics, psychology, cognitive neuroscience, neurology, and education. The study of reading can elucidate important general mechanisms in spatial vision, attentional control, object recognition, and perceptual learning, as well as the principles of plasticity and cortical topography. However, literacy also prompts the development of specific neural circuits to process a unique and artificial stimulus. In this review, we describe the sequence of operations that transforms visual features into language, how the key neural circuits are sculpted by experience during development, and what goes awry in children for whom learning to read is a struggle. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Curvilinear features are important for animate/inanimate categorization in macaques

The current experiment investigated the extent to which perceptual categorization of animacy (i.e., the ability to discriminate animate and inanimate objects) is facilitated by image-based features that distinguish the two object categories. We show that, with nominal training, naïve macaques could classify a trial-unique set of 1000 novel images with high accuracy. To test whether image-based features that naturally differ between animate and inanimate objects, such as curvilinear and rectilinear information, contribute to the monkeys’ accuracy, we created synthetic images using an algorithm that distorted the global shape of the original animate/inanimate images while maintaining their intermediate features (Portilla & Simoncelli, 2000). Performance on the synthesized images was significantly above chance and was predicted by the amount of curvilinear information in the images. Our results demonstrate that, without training, macaques can use an intermediate image feature, curvilinearity, to facilitate their categorization of animate and inanimate objects.

Dynamic Suppression of Average Facial Structure Shapes Neural Tuning in Three Macaque Face Patches

The visual perception of identity in humans and other primates is thought to draw upon cortical areas specialized for the analysis of facial structure. A prominent theory of face recognition holds that the brain computes and stores average facial structure, which it then uses to efficiently determine individual identity, though the neural mechanisms underlying this process are controversial. Here, we demonstrate that the dynamic suppression of average facial structure plays a prominent role in the responses of neurons in three fMRI-defined face patches of the macaque. Using photorealistic face stimuli that systematically varied in identity level according to a psychophysically based face space, we found that single units in the AF, AM, and ML face patches exhibited robust tuning around average facial structure. This tuning emerged after the initial excitatory response to the face and was expressed as the selective suppression of sustained responses to low-identity faces. The coincidence of this suppression with increased spike timing synchrony across the population suggests a mechanism of active inhibition underlying this effect. Control experiments confirmed that the diminished responses to low-identity faces were not due to short-term adaptation processes. We propose that the brain's neural suppression of average facial structure facilitates recognition by promoting the extraction of distinctive facial characteristics and suppressing redundant or irrelevant responses across the population.

Anatomical correlates of face patches in macaque inferotemporal cortex

Primate brains typically have regions within the ventral visual stream that are selectively responsive to faces. In macaques, these face patches are located in similar parts of inferotemporal cortex across individuals although correspondence with particular anatomical features has not been reported previously. Here, using high-resolution functional and anatomical imaging, we show that small "bumps," or buried gyri, along the lower bank of the superior temporal sulcus are predictive of the location of face-selective regions. Recordings from implanted multielectrode arrays verified that these bumps contain face-selective neurons. These bumps were present in monkeys raised without seeing faces and that lack face patches, indicating that these anatomical landmarks are predictive of, but not sufficient for, the presence of face selectivity. These bumps are found across primate species that span taxonomy lines, indicating common evolutionary developmental mechanisms. The bumps emerge during fetal development in macaques, indicating that they arise from general developmental mechanisms that result in the regularity of cortical folding of the entire brain.

Visual experience is not necessary for the development of face-selectivity in the lateral fusiform gyrus

The fusiform face area responds selectively to faces and is causally involved in face perception. How does face-selectivity in the fusiform arise in development, and why does it develop so systematically in the same location across individuals? Preferential cortical responses to faces develop early in infancy, yet evidence is conflicting on the central question of whether visual experience with faces is necessary. Here, we revisit this question by scanning congenitally blind individuals with fMRI while they haptically explored 3D-printed faces and other stimuli. We found robust face-selective responses in the lateral fusiform gyrus of individual blind participants during haptic exploration of stimuli, indicating that neither visual experience with faces nor fovea-biased inputs is necessary for face-selectivity to arise in the lateral fusiform gyrus. Our results instead suggest a role for long-range connectivity in specifying the location of face-selectivity in the human brain.

Human and monkey infant attention to dynamic social and nonsocial stimuli

The present study explored behavioral norms for infant social attention in typically developing human and nonhuman primate infants. We examined the normative development of attention to dynamic social and nonsocial stimuli longitudinally in macaques (Macaca mulatta) at 1, 3, and 5 months of age (N = 75) and humans at 2, 4, 6, 8, and 13 months of age (N = 69) using eye tracking. All infants viewed concurrently played silent videos-one social video and one nonsocial video. Both macaque and human infants were faster to look to the social than the nonsocial stimulus, and both species grew faster to orient to the social stimulus with age. Further, macaque infants' social attention increased linearly from 1 to 5 months. In contrast, human infants displayed a nonlinear pattern of social interest, with initially greater attention to the social stimulus, followed by a period of greater interest in the nonsocial stimulus, and then a rise in social interest from 6 to 13 months. Overall, human infants looked longer than macaque infants, suggesting humans have more sustained attention in the first year of life. These findings highlight potential species similarities and differences, and reflect a first step in establishing baseline patterns of early social attention development.

Curvature processing in human visual cortical areas

Curvature is one of many visual features shown to be important for visual perception. We recently showed that curvilinear features provide sufficient information for categorizing animate vs. inanimate objects, while rectilinear features do not (Zachariou et al., 2018). Results from our fMRI study in rhesus monkeys (Yue et al., 2014) have shed light on some of the neural substrates underlying curvature processing by revealing a network of visual cortical patches with a curvature response preference. However, it is unknown whether a similar network exists in human visual cortex. Thus, the current study was designed to investigate cortical areas with a preference for curvature in the human brain using fMRI at 7T. Consistent with our monkey fMRI results, we found a network of curvature preferring cortical patches-some of which overlapped well-known face-selective areas. Moreover, principal component analysis (PCA) using all visually-responsive voxels indicated that curvilinear features of visual stimuli were associated with specific retinotopic regions in visual cortex. Regions associated with positive curvilinear PC values encompassed the central visual field representation of early visual areas and the lateral surface of temporal cortex, while those associated with negative curvilinear PC values encompassed the peripheral visual field representation of early visual areas and the medial surface of temporal cortex. Thus, we found that broad areas of curvature preference, which encompassed face-selective areas, were bound by central visual field representations. Our results support the hypothesis that curvilinearity preference interacts with central-peripheral processing biases as primary features underlying the organization of temporal cortex topography in the adult human brain.

A Naturalistic Dynamic Monkey Head Avatar Elicits Species-Typical Reactions and Overcomes the Uncanny Valley

Research on social perception in monkeys may benefit from standardized, controllable, and ethologically valid renditions of conspecifics offered by monkey avatars. However, previous work has cautioned that monkeys, like humans, show an adverse reaction toward realistic synthetic stimuli, known as the "uncanny valley" effect. We developed an improved naturalistic rhesus monkey face avatar capable of producing facial expressions (fear grin, lip smack and threat), animated by motion capture data of real monkeys. For validation, we additionally created decreasingly naturalistic avatar variants. Eight rhesus macaques were tested on the various videos and avoided looking at less naturalistic avatar variants, but not at the most naturalistic or the most unnaturalistic avatar, indicating an uncanny valley effect for the less naturalistic avatar versions. The avoidance was deepened by motion and accompanied by physiological arousal. Only the most naturalistic avatar evoked facial expressions comparable to those toward the real monkey videos. Hence, our findings demonstrate that the uncanny valley reaction in monkeys can be overcome by a highly naturalistic avatar.

A Nexus Model of Restricted Interests in Autism Spectrum Disorder

Restricted interests (RIs) in autism spectrum disorder (ASD) are clinically impairing interests of unusual focus or intensity. They are a subtype of restricted and repetitive behaviors which are one of two diagnostic criteria for the disorder. Despite the near ubiquity of RIs in ASD, the neural basis for their development is not well understood. However, recent cognitive neuroscience findings from nonclinical samples and from individuals with ASD shed light on neural mechanisms that may explain the emergence of RIs. We propose the nexus model of RIs in ASD, a novel conceptualization of this symptom domain that suggests that RIs may reflect a co-opting of brain systems that typically serve to integrate complex attention, memory, semantic, and social communication functions during development. The nexus model of RIs hypothesizes that when social communicative development is compromised, brain functions typically located within the lateral surface of cortex may expand into social processing brain systems and alter cortical representations of various cognitive functions during development. These changes, in turn, promote the development of RIs as an alternative process mediated by these brain networks. The nexus model of RIs makes testable predictions about reciprocal relations between the impaired development of social communication and the emergence of RIs in ASD and suggests novel avenues for treatment development.

Early developmental changes in visual social engagement in infant rhesus monkeys

Impairments in social interaction in Autism Spectrum Disorder (ASD) differ greatly across individuals and vary throughout an individual’s lifetime. Yet, an important marker of ASD in infancy is deviations in social-visual engagement, such as the reliably detectable early deviations in attention to the eyes or to biological movement (Klin et al., 2015). Given the critical nature of these early developmental periods, understanding its neurobehavioral underpinnings by means of a nonhuman primate model will be instrumental to understanding the pathophysiology of ASD. Like humans, rhesus macaques 1) develop in rich and complex social behaviors, 2) progressively develop social skills throughout infancy, and 3) have high similarities with humans in brain anatomy and cognitive functions (Machado and Bachevalier, 2003). In this study, male infant rhesus macaques living with their mothers in complex social groups were eye-tracked longitudinally from birth to 6 months while viewing full-faced videos of unfamiliar rhesus monkeys differing in age and sex. The results indicated a critical period for the refinement of social skills around 4–8 weeks of age in rhesus macaques. Specifically, infant monkeys’ fixation to the eyes shows an inflection in developmental trajectory, increasing from birth to 8 weeks, decreasing slowly to a trough between 14–18 weeks, before increasing again. These results parallel the developmental trajectory of social visual engagement published in human infants (Jones & Klin, 2013) and suggest the presence of a switch in the critical networks supporting these early developing social skills that is highly conserved between rhesus macaque and human infant development.

Connectivity at the origins of domain specificity in the cortical face and place networks

It is well established that the adult brain contains a mosaic of domain-specific networks. But how do these domain-specific networks develop? Here we tested the hypothesis that the brain comes prewired with connections that precede the development of domain-specific function. Using resting-state fMRI in the youngest sample of newborn humans tested to date, we indeed found that cortical networks that will later develop strong face selectivity (including the "proto" occipital face area and fusiform face area) and scene selectivity (including the "proto" parahippocampal place area and retrosplenial complex) by adulthood, already show domain-specific patterns of functional connectivity as early as 27 d of age (beginning as early as 6 d of age). Furthermore, we asked how these networks are functionally connected to early visual cortex and found that the proto face network shows biased functional connectivity with foveal V1, while the proto scene network shows biased functional connectivity with peripheral V1. Given that faces are almost always experienced at the fovea, while scenes always extend across the entire periphery, these differential inputs may serve to facilitate domain-specific processing in each network after that function develops, or even guide the development of domain-specific function in each network in the first place. Taken together, these findings reveal domain-specific and eccentricity-biased connectivity in the earliest days of life, placing new constraints on our understanding of the origins of domain-specific cortical networks.

Genetic influence is linked to cortical morphology in category-selective areas of visual cortex

Human visual cortex contains discrete areas that respond selectively to specific object categories such as faces, bodies, and places. A long-standing question is whether these areas are shaped by genetic or environmental factors. To address this question, here we analyzed functional MRI data from an unprecedented number (n = 424) of monozygotic (MZ) and dizygotic (DZ) twins. Category-selective maps were more identical in MZ than DZ twins. Within each category-selective area, distinct subregions showed significant genetic influence. Structural MRI analysis revealed that the ‘genetic voxels’ were predominantly located in regions with higher cortical curvature (gyral crowns in face areas and sulcal fundi in place areas). Moreover, we found that cortex was thicker and more myelinated in genetic voxels of face areas, while it was thinner and less myelinated in genetic voxels of place areas. This double dissociation suggests a differential development of face and place areas in cerebral cortex.

It remains unclear whether the functional organization of the visual cortex is shaped by genetic or environmental factors. Using fMRI in twins (n = 424), these authors show that activation patterns in category-selective areas are heritable, and that the genetic effects in these areas are linked to structural properties of cortical tissue.

Successful Reorganization of Category-Selective Visual Cortex following Occipito-temporal Lobectomy in Childhood

Investigations of functional (re)organization in children who have undergone large cortical resections offer a unique opportunity to elucidate the nature and extent of cortical plasticity. We report findings from a 3-year investigation of a child, U.D., who underwent surgical removal of the right occipital and posterior temporal lobes at age 6 years 9 months. Relative to controls, post-surgically, U.D. showed age-appropriate intellectual performance and visuoperceptual face and object recognition skills. Using fMRI at five different time points, we observed a persistent hemianopia and no visual field remapping. In category-selective visual cortices, however, object- and scene-selective regions in the intact left hemisphere were stable early on, but regions subserving face and word recognition emerged later and evinced competition for cortical representation. These findings reveal alterations in the selectivity and topography of category-selective regions when confined to a single hemisphere and provide insights into dynamic functional changes in extrastriate cortical architecture.

The Value of Failure in Science: The Story of Grandmother Cells in Neuroscience

The annals of science are filled with successes. Only in footnotes do we hear about the failures, the cul-de-sacs, and the forgotten ideas. Failure is how research advances. Yet it hardly features in theoretical perspectives on science. That is a mistake. Failures, whether clear-cut or ambiguous, are heuristically fruitful in their own right. Thinking about failure questions our measures of success, including the conceptual foundations of current practice, that can only be transient in an experimental context. This article advances the heuristics of failure analysis, meaning the explicit treatment of certain ideas or models as failures. The value of failures qua being a failure is illustrated with the example of grandmother cells; the contested idea of a hypothetical neuron that encodes a highly specific but complex stimulus, such as the image of one's grandmother. Repeatedly evoked in popular science and maintained in textbooks, there is sufficient reason to critically review the theoretical and empirical background of this idea.