Behavioral and anatomical consequences of early versus late symbol training in macaques

A Whole-Brain Topographic Ontology

It is a common view that the intricate array of specialized domains in the ventral visual pathway is innately prespecified. What this review postulates is that it is not. We explore the origins of domain specificity, hypothesizing that the adult brain emerges from an interplay between a domain-general map-based architecture, shaped by intrinsic mechanisms, and experience. We argue that the most fundamental innate organization of cortex in general, and not just the visual pathway, is a map-based topography that governs how the environment maps onto the brain, how brain areas interconnect, and ultimately, how the brain processes information.

Mechanisms underlying category learning in the human ventral occipito-temporal cortex

The human ventral occipito-temporal cortex (VOTC) has evolved into specialized regions that process specific categories, such as words, tools, and animals. The formation of these areas is driven by bottom-up visual and top-down nonvisual experiences. However, the specific mechanisms through which top-down nonvisual experiences modulate category-specific regions in the VOTC are still unknown. To address this question, we conducted a study in which participants were trained for approximately 13 h to associate three sets of novel meaningless figures with different top-down nonvisual features: the wordlike category with word features, the non-wordlike category with nonword features, and the visual familiarity condition with no nonvisual features. Pre- and post-training functional MRI (fMRI) experiments were used to measure brain activity during stimulus presentation. Our results revealed that training induced a categorical preference for the two training categories within the VOTC. Moreover, the locations of two training category-specific regions exhibited a notable overlap. Remarkably, within the overlapping category-specific region, training resulted in a dissociation in activation intensity and pattern between the two training categories. These findings provide important insights into how different nonvisual categorical information is encoded in the human VOTC.

Rethinking cortical recycling in ventral temporal cortex

High-level visual areas in ventral temporal cortex (VTC) support recognition of important categories, such as faces and words. Word-selective regions are left lateralized and emerge at the onset of reading instruction. Face-selective regions are right lateralized and have been documented in infancy. Prevailing theories suggest that face-selective regions become right lateralized due to competition with word-selective regions in the left hemisphere. However, recent longitudinal studies examining face- and word-selective responses in childhood do not provide support for this theory. Instead, there is evidence that word representations recycle cortex previously involved in processing other stimuli, such as limbs. These findings call for more longitudinal investigations of cortical recycling and a new era of work that links visual experience and behavior with neural responses.

Modeling Biological Face Recognition with Deep Convolutional Neural Networks

Deep convolutional neural networks (DCNNs) have become the state-of-the-art computational models of biological object recognition. Their remarkable success has helped vision science break new ground, and recent efforts have started to transfer this achievement to research on biological face recognition. In this regard, face detection can be investigated by comparing face-selective biological neurons and brain areas to artificial neurons and model layers. Similarly, face identification can be examined by comparing in vivo and in silico multidimensional "face spaces." In this review, we summarize the first studies that use DCNNs to model biological face recognition. On the basis of a broad spectrum of behavioral and computational evidence, we conclude that DCNNs are useful models that closely resemble the general hierarchical organization of face recognition in the ventral visual pathway and the core face network. In two exemplary spotlights, we emphasize the unique scientific contributions of these models. First, studies on face detection in DCNNs indicate that elementary face selectivity emerges automatically through feedforward processing even in the absence of visual experience. Second, studies on face identification in DCNNs suggest that identity-specific experience and generative mechanisms facilitate this particular challenge. Taken together, as this novel modeling approach enables close control of predisposition (i.e., architecture) and experience (i.e., training data), it may be suited to inform long-standing debates on the substrates of biological face recognition.

Eye movements during reading in beginning and skilled readers: Impact of reading level or physiological maturation?

We begin by presenting and examining relevant data in the literature on eye movements in reading, from childhood to adulthood. In particular, we discuss the differences found in eye movements during reading between children in different age groups and with different reading levels and skilled adult readers in terms of word recognition and sentence processing. We then critically discuss two hypotheses that account for the differences between children and adults' eye movement during reading: one being reading age itself - the changes in eye movement patterns in reading are regulated by the level of reading proficiency and its automatization - and the other being the role of maturation of oculomotor control and, consequently, its possible changes in eye movement patterns during reading. Finally, we list gaps in the research field and suggest that future research will benefit from investigating eye movements during reading in ex-illiterate adults who are in the process of learning to read in order to isolate both reading and maturational factors.

Face detection in untrained deep neural networks

Face-selective neurons are observed in the primate visual pathway and are considered as the basis of face detection in the brain. However, it has been debated as to whether this neuronal selectivity can arise innately or whether it requires training from visual experience. Here, using a hierarchical deep neural network model of the ventral visual stream, we suggest a mechanism in which face-selectivity arises in the complete absence of training. We found that units selective to faces emerge robustly in randomly initialized networks and that these units reproduce many characteristics observed in monkeys. This innate selectivity also enables the untrained network to perform face-detection tasks. Intriguingly, we observed that units selective to various non-face objects can also arise innately in untrained networks. Our results imply that the random feedforward connections in early, untrained deep neural networks may be sufficient for initializing primitive visual selectivity.

Anatomy and physiology of word-selective visual cortex: from visual features to lexical processing

Over the past 2 decades, researchers have tried to uncover how the human brain can extract linguistic information from a sequence of visual symbols. The description of how the brain's visual system processes words and enables reading has improved with the progressive refinement of experimental methodologies and neuroimaging techniques. This review provides a brief overview of this research journey. We start by describing classical models of object recognition in non-human primates, which represent the foundation for many of the early models of visual word recognition in humans. We then review functional neuroimaging studies investigating the word-selective regions in visual cortex. This research led to the differentiation of highly specialized areas, which are involved in the analysis of different aspects of written language. We then consider the corresponding anatomical measurements and provide a description of the main white matter pathways carrying neural signals crucial to word recognition. Finally, in an attempt to integrate structural, functional, and electrophysiological findings, we propose a view of visual word recognition, accounting for spatial and temporal facets of word-selective neural processes. This multi-modal perspective on the neural circuitry of literacy highlights the relevance of a posterior-anterior differentiation in ventral occipitotemporal cortex for visual processing of written language and lexical features. It also highlights unanswered questions that can guide us towards future research directions. Bridging measures of brain structure and function will help us reach a more precise understanding of the transformation from vision to language.

Cortical recycling in high-level visual cortex during childhood development

Human ventral temporal cortex contains category-selective regions that respond preferentially to ecologically relevant categories such as faces, bodies, places and words and that are causally involved in the perception of these categories. How do these regions develop during childhood? We used functional magnetic resonance imaging to measure longitudinal development of category selectivity in school-age children over 1 to 5 years. We discovered that, from young childhood to the teens, face- and word-selective regions in ventral temporal cortex expand and become more category selective, but limb-selective regions shrink and lose their preference for limbs. Critically, as a child develops, increases in face and word selectivity are directly linked to decreases in limb selectivity, revealing that during childhood, limb selectivity in ventral temporal cortex is repurposed into word and face selectivity. These data provide evidence for cortical recycling during childhood development. This has important implications for understanding typical as well as atypical brain development and necessitates a rethinking of how cortical function develops during childhood.

Emergence of a compositional neural code for written words: Recycling of a convolutional neural network for reading

The visual word form area (VWFA) is a region of human inferotemporal cortex that emerges at a fixed location in the occipitotemporal cortex during reading acquisition and systematically responds to written words in literate individuals. According to the neuronal recycling hypothesis, this region arises through the repurposing, for letter recognition, of a subpart of the ventral visual pathway initially involved in face and object recognition. Furthermore, according to the biased connectivity hypothesis, its reproducible localization is due to preexisting connections from this subregion to areas involved in spoken-language processing. Here, we evaluate those hypotheses in an explicit computational model. We trained a deep convolutional neural network of the ventral visual pathway, first to categorize pictures and then to recognize written words invariantly for case, font, and size. We show that the model can account for many properties of the VWFA, particularly when a subset of units possesses a biased connectivity to word output units. The network develops a sparse, invariant representation of written words, based on a restricted set of reading-selective units. Their activation mimics several properties of the VWFA, and their lesioning causes a reading-specific deficit. The model predicts that, in literate brains, written words are encoded by a compositional neural code with neurons tuned either to individual letters and their ordinal position relative to word start or word ending or to pairs of letters (bigrams).

On the relationship between maps and domains in inferotemporal cortex

How does the brain encode information about the environment? Decades of research have led to the pervasive notion that the object-processing pathway in primate cortex consists of multiple areas that are each specialized to process different object categories (such as faces, bodies, hands, non-face objects and scenes). The anatomical consistency and modularity of these regions have been interpreted as evidence that these regions are innately specialized. Here, we propose that ventral-stream modules do not represent clusters of circuits that each evolved to process some specific object category particularly important for survival, but instead reflect the effects of experience on a domain-general architecture that evolved to be able to adapt, within a lifetime, to its particular environment. Furthermore, we propose that the mechanisms underlying the development of domains are both evolutionarily old and universal across cortex. Topographic maps are fundamental, governing the development of specializations across systems, providing a framework for brain organization.

Does the temporal cortex make us human? A review of structural and functional diversity of the primate temporal lobe

Temporal cortex is a primate specialization that shows considerable variation in size, morphology, and connectivity across species. Human temporal cortex is involved in many behaviors that are considered especially well developed in humans, including semantic processing, language, and theory of mind. Here, we ask whether the involvement of temporal cortex in these behaviors can be explained in the context of the 'general' primate organization of the temporal lobe or whether the human temporal lobe contains unique specializations indicative of a 'step change' in the lineage leading to modern humans. We propose that many human behaviors can be explained as elaborations of temporal cortex functions observed in other primates. However, changes in temporal lobe white matter suggest increased integration of information within temporal cortex and between posterior temporal cortex and other association areas, which likely enable behaviors not possible in other species.

Distorting Face Representations in Newborn Brains

What role does experience play in the development of face recognition? A growing body of evidence indicates that newborn brains need slowly changing visual experiences to develop accurate visual recognition abilities. All of the work supporting this "slowness constraint" on visual development comes from studies testing basic-level object recognition. Here, we present the results of controlled-rearing experiments that provide evidence for a slowness constraint on the development of face recognition, a prototypical subordinate-level object recognition task. We found that (1) newborn chicks can rapidly develop view-invariant face recognition and (2) the development of this ability relies on experience with slowly moving faces. When chicks were reared with quickly moving faces, they built distorted face representations that largely lacked invariance to viewpoint changes, effectively "breaking" their face recognition abilities. These results provide causal evidence that slowly changing visual experiences play a critical role in the development of face recognition, akin to basic-level object recognition. Thus, face recognition is not a hardwired property of vision but is learned rapidly as the visual system adapts to the temporal structure of the animal's visual environment.

Sensitive Period for Cognitive Repurposing of Human Visual Cortex

Studies of sensory loss are a model for understanding the functional flexibility of human cortex. In congenital blindness, subsets of visual cortex are recruited during higher-cognitive tasks, such as language and math tasks. Is such dramatic functional repurposing possible throughout the lifespan or restricted to sensitive periods in development? We compared visual cortex function in individuals who lost their vision as adults (after age 17) to congenitally blind and sighted blindfolded adults. Participants took part in resting-state and task-based fMRI scans during which they solved math equations of varying difficulty and judged the meanings of sentences. Blindness at any age caused "visual" cortices to synchronize with specific frontoparietal networks at rest. However, in task-based data, visual cortices showed regional specialization for math and language and load-dependent activity only in congenital blindness. Thus, despite the presence of long-range functional connectivity, cognitive repurposing of human cortex is limited by sensitive periods.

Learning to Read Increases the Informativeness of Distributed Ventral Temporal Responses

Becoming a proficient reader requires substantial learning over many years. However, it is unknown how learning to read affects development of distributed visual representations across human ventral temporal cortex (VTC). Using fMRI and a data-driven, computational approach, we quantified the development of distributed VTC responses to characters (pseudowords and numbers) versus other domains in children, preteens, and adults. Results reveal anatomical- and hemisphere-specific development. With development, distributed responses to words and characters became more distinctive and informative in lateral but not medial VTC, and in the left but not right hemisphere. While the development of voxels with both positive and negative preference to words affected distributed information, only development of voxels with positive preference to words (i.e., word-selective) was correlated with reading ability. These data show that developmental increases in informativeness of distributed left lateral VTC responses are related to proficient reading and have important implications for both developmental theories and for elucidating neural mechanisms of reading disabilities.

Visual experience is not necessary for the development of face-selectivity in the lateral fusiform gyrus

The fusiform face area responds selectively to faces and is causally involved in face perception. How does face-selectivity in the fusiform arise in development, and why does it develop so systematically in the same location across individuals? Preferential cortical responses to faces develop early in infancy, yet evidence is conflicting on the central question of whether visual experience with faces is necessary. Here, we revisit this question by scanning congenitally blind individuals with fMRI while they haptically explored 3D-printed faces and other stimuli. We found robust face-selective responses in the lateral fusiform gyrus of individual blind participants during haptic exploration of stimuli, indicating that neither visual experience with faces nor fovea-biased inputs is necessary for face-selectivity to arise in the lateral fusiform gyrus. Our results instead suggest a role for long-range connectivity in specifying the location of face-selectivity in the human brain.

The inferior temporal cortex is a potential cortical precursor of orthographic processing in untrained monkeys

The ability to recognize written letter strings is foundational to human reading, but the underlying neuronal mechanisms remain largely unknown. Recent behavioral research in baboons suggests that non-human primates may provide an opportunity to investigate this question. We recorded the activity of hundreds of neurons in V4 and the inferior temporal cortex (IT) while naïve macaque monkeys passively viewed images of letters, English words and non-word strings, and tested the capacity of those neuronal representations to support a battery of orthographic processing tasks. We found that simple linear read-outs of IT (but not V4) population responses achieved high performance on all tested tasks, even matching the performance and error patterns of baboons on word classification. These results show that the IT cortex of untrained primates can serve as a precursor of orthographic processing, suggesting that the acquisition of reading in humans relies on the recycling of a brain network evolved for other visual functions.

Hemispheric Organization for Visual Object Recognition: A Theoretical Account and Empirical Evidence

Despite the similarity in structure, the hemispheres of the human brain have somewhat different functions. A traditional view of hemispheric organization asserts that there are independent and largely lateralized domain-specific regions in ventral occipitotemporal (VOTC), specialized for the recognition of distinct classes of objects. Here, we offer an alternative account of the organization of the hemispheres, with a specific focus on face and word recognition. This alternative account relies on three computational principles: distributed representations and knowledge, cooperation and competition between representations, and topography and proximity. The crux is that visual recognition results from a network of regions with graded functional specialization that is distributed across both hemispheres. Specifically, the claim is that face recognition, which is acquired relatively early in life, is processed by VOTC regions in both hemispheres. Once literacy is acquired, word recognition, which is co-lateralized with language areas, primarily engages the left VOTC and, consequently, face recognition is primarily, albeit not exclusively, mediated by the right VOTC. We review psychological and neural evidence from a range of studies conducted with normal and brain-damaged adults and children and consider findings which challenge this account. Last, we offer suggestions for future investigations whose findings may further refine this account.

Cognitive control of orofacial motor and vocal responses in the ventrolateral and dorsomedial human frontal cortex

In the primate brain, a set of areas in the ventrolateral frontal (VLF) cortex and the dorsomedial frontal (DMF) cortex appear to control vocalizations. The basic role of this network in the human brain and how it may have evolved to enable complex speech remain unknown. In the present functional neuroimaging study of the human brain, a multidomain protocol was utilized to investigate the roles of the various areas that comprise the VLF-DMF network in learning rule-based cognitive selections between different types of motor actions: manual, orofacial, nonspeech vocal, and speech vocal actions. Ventrolateral area 44 (a key component of the Broca's language production region in the human brain) is involved in the cognitive selection of orofacial, as well as, speech and nonspeech vocal responses; and the midcingulate cortex is involved in the analysis of speech and nonspeech vocal feedback driving adaptation of these responses. By contrast, the cognitive selection of speech vocal information requires this former network and the additional recruitment of area 45 and the presupplementary motor area. We propose that the basic function expressed by the VLF-DMF network is to exert cognitive control of orofacial and vocal acts and, in the language dominant hemisphere of the human brain, has been adapted to serve higher speech function. These results pave the way to understand the potential changes that could have occurred in this network across primate evolution to enable speech production.

The neural mechanisms of face processing: cells, areas, networks, and models

Since its discovery, the face-processing network in the brain of the macaque monkey has emerged as a model system that allowed for major neural mechanisms of face recognition to be identified - with implications for object recognition at large. Populations of face cells encode faces through broad tuning curves, whose shapes change over time. Face representations differ qualitatively across faces areas, and we not only understand the global organization of these specializations, but also some of the transformations between face areas, both feed-forward and feed-back, and the computational principles behind face representations and transformations. Facial information is combined with physical features and mnemonic features in extensions of the core network, which forms an early part of the primate social brain.

Universal Mechanisms and the Development of the Face Network: What You See Is What You Get

Our assignment was to review the development of the face-processing network, an assignment that carries the presupposition that a face-specific developmental program exists. We hope to cast some doubt on this assumption and instead argue that the development of face processing is guided by the same ubiquitous rules that guide the development of cortex in general.

Ventral midbrain stimulation induces perceptual learning and cortical plasticity in primates

Practice improves perception and enhances neural representations of trained visual stimuli, a phenomenon known as visual perceptual learning (VPL). While attention to task-relevant stimuli plays an important role in such learning, Pavlovian stimulus-reinforcer associations are sufficient to drive VPL, even subconsciously. It has been proposed that reinforcement facilitates perceptual learning through the activation of neuromodulatory centers, but this has not been directly confirmed in primates. Here, we paired task-irrelevant visual stimuli with microstimulation of a dopaminergic center, the ventral tegmental area (VTA), in macaques. Pairing VTA microstimulation with a task-irrelevant visual stimulus increased fMRI activity and improved classification of fMRI activity patterns selectively for the microstimulation-paired stimulus. Moreover, pairing VTA microstimulation with a task-irrelevant visual stimulus improved the subject’s capacity to discriminate that stimulus. This is the first causal demonstration of the role of neuromodulatory centers in VPL in primates.

Practice can improve the perception of stimuli used to achieve a task (perceptual learning). Here, the authors show in monkeys that perceptual learning can be produced even for irrelevant stimuli if the stimuli are paired with stimulation of a dopaminergic centre, the ventral tegmental area (VTA).

Extensive childhood experience with Pokémon suggests eccentricity drives organization of visual cortex

The functional organization of human high-level visual cortex, such as the face- and place-selective regions, is strikingly consistent across individuals. An unanswered question in neuroscience concerns which dimensions of visual information constrain the development and topography of this shared brain organization. To answer this question, we used functional magnetic resonance imaging to scan a unique group of adults who, as children, had extensive visual experience with Pokémon. These animal-like, pixelated characters are dissimilar from other ecological categories, such as faces and places, along critical dimensions (foveal bias, rectilinearity, size, animacy). We show not only that adults who have Pokémon experience demonstrate distinct distributed cortical responses to Pokémon, but also that the experienced retinal eccentricity during childhood can predict the locus of Pokémon responses in adulthood. These data demonstrate that inherent functional representations in the visual cortex-retinal eccentricity-combined with consistent viewing behaviour of particular stimuli during childhood result in a shared functional topography in adulthood.

Multi-method brain imaging reveals impaired representations of number as well as altered connectivity in adults with dyscalculia

Two hypotheses have been proposed about the etiology of neurodevelopmental learning disorders, such as dyslexia and dyscalculia: representation impairments and disrupted access to representations. We implemented a multi-method brain imaging approach to directly investigate these representation and access hypotheses in dyscalculia, a highly prevalent but understudied neurodevelopmental disorder in learning to calculate. We combined several magnetic resonance imaging methods and analyses, including univariate and multivariate analyses, functional and structural connectivity. Our sample comprised 24 adults with dyscalculia and 24 carefully matched controls. Results showed a clear deficit in the non-symbolic magnitude representations in parietal, temporal and frontal regions, as well as hyper-connectivity in visual brain regions in adults with dyscalculia. Dyscalculia in adults was thereby related to both impaired number representations and altered connectivity in the brain. We conclude that dyscalculia is related to impaired number representations as well as altered access to these representations.

Symbolic labeling in 5-month-old human infants

Humans' ability to create and manipulate symbolic structures far exceeds that of other animals. We hypothesized that this ability rests on an early capacity to use arbitrary signs to represent any mental representation, even as abstract as an algebraic rule. In three experiments, we collected high-density EEG recordings while 150 5-month-old infants were presented with speech triplets characterized by their abstract syllabic structure-the location of syllable repetition-which predicted a following arbitrary label (e.g., ABA words were followed by a fish picture, AAB words by a lion). After a brief learning phase, EEG responses to novel words revealed that infants built expectations about the upcoming label based on the triplet structure and were surprised when it happened to be incongruent. Preverbal infants were thus able to recode the incoming triplets into abstract mental variables to which arbitrary labels were flexibly assigned. Importantly, infants also generalized to novel trials in which the pairing order was reversed (with the label preceding the auditory structure). Beyond conditioned associations, infants instantly inferred a bidirectional mapping between the abstract structures and the following label, a foundational operation for any symbolic system.

Neuronal Population Responses in the Human Ventral Temporal and Lateral Parietal Cortex during Arithmetic Processing with Digits and Number Words

Past research has identified anatomically specific sites within the posterior inferior temporal gyrus (PITG) and the intraparietal sulcus (IPS) areas that are engaged during arithmetic processing. Although a small region of the PITG (known as the number form area) is selectively engaged in the processing of numerals, its surrounding area is activated during both digit and number word processing. In eight participants with intracranial electrodes, we compared the timing and selectivity of electrophysiological responses in the number form area-surround and IPS regions during arithmetic processing with digits and number words. Our recordings revealed stronger electrophysiological responses in the high-frequency broadband range in both regions to digits than number words, with the difference that number words elicited delayed activity in the IPS but not PITG. Our findings of distinct profiles of responses in the PITG and the IPS to digits compared with number words provide novel information that is relevant to existing theoretical models of mathematical cognition.

The Large-Scale Organization of Object-Responsive Cortex Is Reflected in Resting-State Network Architecture

Neural responses to visually presented objects have a large-scale spatial organization across the cortex, related to the dimensions of animacy and object size. Most proposals about the origins of this organization point to the influence of differential connectivity with other cortical regions as the key organizing force that drives distinctions in object-responsive cortex. To explore this possibility, we used resting-state functional connectivity to examine the relationship between stimulus-evoked organization of objects, and distinctions in functional network architecture. Using a data-driven analysis, we found evidence for three distinct whole-brain resting-state networks that route through object-responsive cortex, and these naturally manifest the tripartite structure of the stimulus-evoked organization. However, object-responsive regions were also highly correlated with each other at rest. Together, these results point to a nested network architecture, with a local interconnected network across object-responsive cortex and distinctive subnetworks that specifically route these key object distinctions to distinct long-range regions. Broadly, these results point to the viability that long-range connections are a driving force of the large-scale organization of object-responsive cortex.

Selective attention without a neocortex

Selective attention refers to the ability to restrict neural processing and behavioral responses to a relevant subset of available stimuli, while simultaneously excluding other valid stimuli from consideration. In primates and other mammals, descriptions of this ability typically emphasize the neural processing that takes place in the cerebral neocortex. However, non-mammals such as birds, reptiles, amphibians and fish, which completely lack a neocortex, also have the ability to selectively attend. In this article, we survey the behavioral evidence for selective attention in non-mammals, and review the midbrain and forebrain structures that are responsible. The ancestral forms of selective attention are presumably selective orienting behaviors, such as prey-catching and predator avoidance. These behaviors depend critically on a set of subcortical structures, including the optic tectum (OT), thalamus and striatum, that are highly conserved across vertebrate evolution. In contrast, the contributions of different pallial regions in the forebrain to selective attention have been subject to more substantial changes and reorganization. This evolutionary perspective makes plain that selective attention is not a function achieved de novo with the emergence of the neocortex, but instead is implemented by circuits accrued and modified over hundreds of millions of years, beginning well before the forebrain contained a neocortex. Determining how older subcortical circuits interact with the more recently evolved components in the neocortex will likely be crucial for understanding the complex properties of selective attention in primates and other mammals, and for identifying the etiology of attention disorders.

Encoding of Spatial Attention by Primate Prefrontal Cortex Neuronal Ensembles

Single neurons in the primate lateral prefrontal cortex (LPFC) encode information about the allocation of visual attention and the features of visual stimuli. However, how this compares to the performance of neuronal ensembles at encoding the same information is poorly understood. Here, we recorded the responses of neuronal ensembles in the LPFC of two macaque monkeys while they performed a task that required attending to one of two moving random dot patterns positioned in different hemifields and ignoring the other pattern. We found single units selective for the location of the attended stimulus as well as for its motion direction. To determine the coding of both variables in the population of recorded units, we used a linear classifier and progressively built neuronal ensembles by iteratively adding units according to their individual performance (best single units), or by iteratively adding units based on their contribution to the ensemble performance (best ensemble). For both methods, ensembles of relatively small sizes (n < 60) yielded substantially higher decoding performance relative to individual single units. However, the decoder reached similar performance using fewer neurons with the best ensemble building method compared with the best single units method. Our results indicate that neuronal ensembles within the LPFC encode more information about the attended spatial and nonspatial features of visual stimuli than individual neurons. They further suggest that efficient coding of attention can be achieved by relatively small neuronal ensembles characterized by a certain relationship between signal and noise correlation structures.

Experience Shapes the Development of Neural Substrates of Face Processing in Human Ventral Temporal Cortex

In adult humans, the ventral temporal cortex (VTC) represents faces in a reproducible topology. However, it is unknown what role visual experience plays in the development of this topology. Using functional magnetic resonance imaging in children and adults, we found a sequential development, in which the topology of face-selective activations across the VTC was matured by age 7, but the spatial extent and degree of face selectivity continued to develop past age 7 into adulthood. Importantly, own- and other-age faces were differentially represented, both in the distributed multivoxel patterns across the VTC, and also in the magnitude of responses of face-selective regions. These results provide strong evidence that experience shapes cortical representations of faces during development from childhood to adulthood. Our findings have important implications for the role of experience and age in shaping the neural substrates of face processing in the human VTC.

The emergence of the visual word form: Longitudinal evolution of category-specific ventral visual areas during reading acquisition

How does education affect cortical organization? All literate adults possess a region specialized for letter strings, the visual word form area (VWFA), within the mosaic of ventral regions involved in processing other visual categories such as objects, places, faces, or body parts. Therefore, the acquisition of literacy may induce a reorientation of cortical maps towards letters at the expense of other categories such as faces. To test this cortical recycling hypothesis, we studied how the visual cortex of individual children changes during the first months of reading acquisition. Ten 6-year-old children were scanned longitudinally 6 or 7 times with functional magnetic resonance imaging (fMRI) before and throughout the first year of school. Subjects were exposed to a variety of pictures (words, numbers, tools, houses, faces, and bodies) while performing an unrelated target-detection task. Behavioral assessment indicated a sharp rise in grapheme-phoneme knowledge and reading speed in the first trimester of school. Concurrently, voxels specific to written words and digits emerged at the VWFA location. The responses to other categories remained largely stable, although right-hemispheric face-related activity increased in proportion to reading scores. Retrospective examination of the VWFA voxels prior to reading acquisition showed that reading encroaches on voxels that are initially weakly specialized for tools and close to but distinct from those responsive to faces. Remarkably, those voxels appear to keep their initial category selectivity while acquiring an additional and stronger responsivity to words. We propose a revised model of the neuronal recycling process in which new visual categories invade weakly specified cortex while leaving previously stabilized cortical responses unchanged.

First-Pass Processing of Value Cues in the Ventral Visual Pathway

Real-world value often depends on subtle, continuously variable visual cues specific to particular object categories, like the tailoring of a suit, the condition of an automobile, or the construction of a house. Here, we used microelectrode recording in behaving monkeys to test two possible mechanisms for category-specific value-cue processing: (1) previous findings suggest that prefrontal cortex (PFC) identifies object categories, and based on category identity, PFC could use top-down attentional modulation to enhance visual processing of category-specific value cues, providing signals to PFC for calculating value, and (2) a faster mechanism would be first-pass visual processing of category-specific value cues, immediately providing the necessary visual information to PFC. This, however, would require learned mechanisms for processing the appropriate cues in a given object category. To test these hypotheses, we trained monkeys to discriminate value in four letter-like stimulus categories. Each category had a different, continuously variable shape cue that signified value (liquid reward amount) as well as other cues that were irrelevant. Monkeys chose between stimuli of different reward values. Consistent with the first-pass hypothesis, we found early signals for category-specific value cues in area TE (the final stage in monkey ventral visual pathway) beginning 81 ms after stimulus onset-essentially at the start of TE responses. Task-related activity emerged in lateral PFC approximately 40 ms later and consisted mainly of category-invariant value tuning. Our results show that, for familiar, behaviorally relevant object categories, high-level ventral pathway cortex can implement rapid, first-pass processing of category-specific value cues.

Development of Neural Sensitivity to Face Identity Correlates with Perceptual Discriminability

Face perception is subserved by a series of face-selective regions in the human ventral stream, which undergo prolonged development from childhood to adulthood. However, it is unknown how neural development of these regions relates to the development of face-perception abilities. Here, we used functional magnetic resonance imaging (fMRI) to measure brain responses of ventral occipitotemporal regions in children (ages, 5-12 years) and adults (ages, 19-34 years) when they viewed faces that parametrically varied in dissimilarity. Since similar faces generate lower responses than dissimilar faces due to fMRI adaptation, this design objectively evaluates neural sensitivity to face identity across development. Additionally, a subset of subjects participated in a behavioral experiment to assess perceptual discriminability of face identity. Our data reveal three main findings: (1) neural sensitivity to face identity increases with age in face-selective but not object-selective regions; (2) the amplitude of responses to faces increases with age in both face-selective and object-selective regions; and (3) perceptual discriminability of face identity is correlated with the neural sensitivity to face identity of face-selective regions. In contrast, perceptual discriminability is not correlated with the amplitude of response in face-selective regions or of responses of object-selective regions. These data suggest that developmental increases in neural sensitivity to face identity in face-selective regions improve perceptual discriminability of faces. Our findings significantly advance the understanding of the neural mechanisms of development of face perception and open new avenues for using fMRI adaptation to study the neural development of high-level visual and cognitive functions more broadly.

SIGNIFICANCE STATEMENT

Face perception, which is critical for daily social interactions, develops from childhood to adulthood. However, it is unknown what developmental changes in the brain lead to improved performance. Using fMRI in children and adults, we find that from childhood to adulthood, neural sensitivity to changes in face identity increases in face-selective regions. Critically, subjects' perceptual discriminability among faces is linked to neural sensitivity: participants with higher neural sensitivity in face-selective regions demonstrate higher perceptual discriminability. Thus, our results suggest that developmental increases in face-selective regions' sensitivity to face identity improve perceptual discrimination of faces. These findings significantly advance understanding of the neural mechanisms underlying the development of face perception and have important implications for assessing both typical and atypical development.

A hierarchical, retinotopic proto-organization of the primate visual system at birth

The adult primate visual system comprises a series of hierarchically organized areas. Each cortical area contains a topographic map of visual space, with different areas extracting different kinds of information from the retinal input. Here we asked to what extent the newborn visual system resembles the adult organization. We find that hierarchical, topographic organization is present at birth and therefore constitutes a proto-organization for the entire primate visual system. Even within inferior temporal cortex, this proto-organization was already present, prior to the emergence of category selectivity (e.g., faces or scenes). We propose that this topographic organization provides the scaffolding for the subsequent development of visual cortex that commences at the onset of visual experience.

Development of the macaque face-patch system

Face recognition is highly proficient in humans and other social primates; it emerges in infancy, but the development of the neural mechanisms supporting this behaviour is largely unknown. We use blood-volume functional MRI to monitor longitudinally the responsiveness to faces, scrambled faces, and objects in macaque inferotemporal cortex (IT) from 1 month to 2 years of age. During this time selective responsiveness to monkey faces emerges. Some functional organization is present at 1 month; face-selective patches emerge over the first year of development, and are remarkably stable once they emerge. Face selectivity is refined by a decreasing responsiveness to non-face stimuli.

Organization of high-level visual cortex in human infants

How much of the structure of the human mind and brain is already specified at birth, and how much arises from experience? In this article, we consider the test case of extrastriate visual cortex, where a highly systematic functional organization is present in virtually every normal adult, including regions preferring behaviourally significant stimulus categories, such as faces, bodies, and scenes. Novel methods were developed to scan awake infants with fMRI, while they viewed multiple categories of visual stimuli. Here we report that the visual cortex of 4–6-month-old infants contains regions that respond preferentially to abstract categories (faces and scenes), with a spatial organization similar to adults. However, precise response profiles and patterns of activity across multiple visual categories differ between infants and adults. These results demonstrate that the large-scale organization of category preferences in visual cortex is adult-like within a few months after birth, but is subsequently refined through development.

Adult visual cortex is organized into regions that respond to categories such as faces and scenes, but it is unclear if this depends on experience. Here, authors measured brain activity in 4–6 month old infants looking at faces and scenes and find that their visual cortex is organized similarly to adults.

Orthographic processing in pigeons (Columba livia)

Learning to read involves the acquisition of letter-sound relationships (i.e., decoding skills) and the ability to visually recognize words (i.e., orthographic knowledge). Although decoding skills are clearly human-unique, given they are seated in language, recent research and theory suggest that orthographic processing may derive from the exaptation or recycling of visual circuits that evolved to recognize everyday objects and shapes in our natural environment. An open question is whether orthographic processing is limited to visual circuits that are similar to our own or a product of plasticity common to many vertebrate visual systems. Here we show that pigeons, organisms that separated from humans more than 300 million y ago, process words orthographically. Specifically, we demonstrate that pigeons trained to discriminate words from nonwords picked up on the orthographic properties that define words and used this knowledge to identify words they had never seen before. In addition, the pigeons were sensitive to the bigram frequencies of words (i.e., the common co-occurrence of certain letter pairs), the edit distance between nonwords and words, and the internal structure of words. Our findings demonstrate that visual systems organizationally distinct from the primate visual system can also be exapted or recycled to process the visual word form.

Anatomical Connections of the Functionally Defined "Face Patches" in the Macaque Monkey

The neural circuits underlying face recognition provide a model for understanding visual object representation, social cognition, and hierarchical information processing. A fundamental piece of information lacking to date is the detailed anatomical connections of the face patches. Here, we injected retrograde tracers into four different face patches (PL, ML, AL, AM) to characterize their anatomical connectivity. We found that the patches are strongly and specifically connected to each other, and individual patches receive inputs from extrastriate cortex, the medial temporal lobe, and three subcortical structures (the pulvinar, claustrum, and amygdala). Inputs from prefrontal cortex were surprisingly weak. Patches were densely interconnected to one another in both feedforward and feedback directions, inconsistent with a serial hierarchy. These results provide the first direct anatomical evidence that the face patches constitute a highly specialized system and suggest that subcortical regions may play a vital role in routing face-related information to subsequent processing stages.

Neuroimaging Evidence of a Bilateral Representation for Visually Presented Numbers

The clustered architecture of the brain for different visual stimulus categories is one of the most fascinating topics in the cognitive neurosciences. Interestingly, recent research suggests the existence of additional regions for newly acquired stimuli such as letters (letter form area; LFA; Thesen et al., 2012) and numbers (visual number form area; NFA; Shum et al., 2013). However, neuroimaging methods thus far have failed to visualize the NFA in healthy participants, likely due to fMRI signal dropout caused by the air/bone interface of the petrous bone (Shum et al., 2013). In the current study, we combined a 64-channel head coil with high spatial resolution, localized shimming, and liberal smoothing, thereby decreasing the signal dropout and increasing the temporal signal-to-noise ratio in the neighborhood of the NFA. We presented subjects with numbers, letters, false numbers, false letters, objects and their Fourier randomized versions. A group analysis showed significant activations in the inferior temporal gyrus at the previously proposed location of the NFA. Crucially, we found the NFA to be present in both hemispheres. Further, we could identify the NFA on the single-subject level in most of our participants. A detailed analysis of the response profile of the NFA in two separate experiments confirmed the whole-brain results since responses to numbers were significantly higher than to any other presented stimulus in both hemispheres. Our results show for the first time the existence and stimulus selectivity of the NFA in the healthy human brain.

SIGNIFICANCE STATEMENT

This fMRI study shows for the first time a cluster of neurons selective for visually presented numbers in healthy human adults. This visual number form area (NFA) was found in both hemispheres. Crucially, numbers have gained importance for humans too recently for neuronal specialization to be established by evolution. Therefore, investigations of this region will greatly advance our understanding of learning and plasticity in the brain. In addition, these results will aid our knowledge regarding related neurological illnesses (e.g., dyscalculia). To overcome the fMRI signal dropout in the neighborhood of the NFA, we combined high spatial resolution with liberal smoothing. We believe that this approach will be useful to the broad neuroimaging community.

The Invariance Hypothesis Implies Domain-Specific Regions in Visual Cortex

Is visual cortex made up of general-purpose information processing machinery, or does it consist of a collection of specialized modules? If prior knowledge, acquired from learning a set of objects is only transferable to new objects that share properties with the old, then the recognition system's optimal organization must be one containing specialized modules for different object classes. Our analysis starts from a premise we call the invariance hypothesis: that the computational goal of the ventral stream is to compute an invariant-to-transformations and discriminative signature for recognition. The key condition enabling approximate transfer of invariance without sacrificing discriminability turns out to be that the learned and novel objects transform similarly. This implies that the optimal recognition system must contain subsystems trained only with data from similarly-transforming objects and suggests a novel interpretation of domain-specific regions like the fusiform face area (FFA). Furthermore, we can define an index of transformation-compatibility, computable from videos, that can be combined with information about the statistics of natural vision to yield predictions for which object categories ought to have domain-specific regions in agreement with the available data. The result is a unifying account linking the large literature on view-based recognition with the wealth of experimental evidence concerning domain-specific regions.

Neural foundations and functional specificity of number representations

Number is a complex category, as with the word "number" we may refer to different entities. First, it is a perceptual property that characterizes any set of individual items, namely its cardinality. The ability to extract the (approximate) cardinality of sets is almost universal in the animal domain and present in humans since birth. In primates, posterior parietal cortex seems to be a crucial site for this ability, even if the degree of selectivity of numerical representations in parietal cortex reported to date appears much lower compared to that of other semantic categories in the ventral stream. Number can also be intended as a mathematical object, which we humans use to count, measure, and order: a (verbal or visual) symbol that stands for the cardinality of a set, the intensity of a continuous quantity or the position of an item on a list. Evidence points to a convergence towards parietal cortex for the semantic coding of numerical symbols and to the bilateral occipitotemporal cortex for the shape coding of Arabic digits and other number symbols.

A vision of graded hemispheric specialization

Understanding the process by which the cerebral hemispheres reach their mature functional organization remains challenging. We propose a theoretical account in which, in the domain of vision, faces and words come to be represented adjacent to retinotopic cortex by virtue of the need to discriminate among homogeneous exemplars. Orthographic representations are further constrained to be proximal to typically left-lateralized language-related information to minimize connectivity length between visual and language areas. As reading is acquired, orthography comes to rely more heavily (albeit not exclusively) on the left fusiform region to bridge vision and language. Consequently, due to competition from emerging word representations, face representations that were initially bilateral become lateralized to the right fusiform region (albeit, again, not exclusively). We review recent research that describes constraints that give rise to this graded hemispheric arrangement. We then summarize empirical evidence from a variety of studies (behavioral, evoked response potential, functional imaging) across different populations (children, adolescents, and adults; left handers and individuals with developmental dyslexia) that supports the claims that hemispheric lateralization is graded rather than binary and that this graded organization emerges dynamically over the course of development. Perturbations of this system either during development or in adulthood provide further insights into the principles governing hemispheric organization.