Temporal Processing Capacity in High-Level Visual Cortex Is Domain Specific

Establishing the functional relevancy of white matter connections in the visual system and beyond

For over a century, researchers have examined the functional relevancy of white matter bundles. Consequently, many large-scale bundles spanning several centimeters have been associated in their entirety with specific brain functions, such as language or attention. However, these coarse structural-functional relationships are at odds with modern understanding of the fine-grained functional organization of human cortex, such as the mosaic of category-selective regions in ventral temporal cortex. Here, we review a multimodal approach that combines fMRI to define functional regions of interest within individual's brains with dMRI tractography to identify the white matter bundles of the same individual. Combining these data allows to determine which subsets of streamlines within a white matter bundle connect to specific functional regions in each individual. That is, this approach identifies the functionally defined white matter sub-bundles of the brain. We argue that this approach not only enhances the accuracy of interpreting the functional relevancy of white matter bundles, but also enables segmentation of these large-scale bundles into meaningful functional units, which can then be linked to behavior with enhanced precision. Importantly, this approach has the potential for making new discoveries of the fine-grained functional relevancy of white matter connections in the visual system and the brain more broadly, akin to the flurry of research that has identified functional regions in cortex.

Texture-like representation of objects in human visual cortex

Humans are exquisitely sensitive to the spatial arrangement of visual features in objects and scenes, but not in visual textures. Category-selective regions in the visual cortex are widely believed to underlie object perception, suggesting such regions should distinguish natural images of objects from synthesized images containing similar visual features in scrambled arrangements. Contrarily, we demonstrate that representations in category-selective cortex do not discriminate natural images from feature-matched scrambles but can discriminate images of different categories, suggesting a texture-like encoding. We find similar insensitivity to feature arrangement in Imagenet-trained deep convolutional neural networks. This suggests the need to reconceptualize the role of category-selective cortex as representing a basis set of complex texture-like features, useful for a myriad of behaviors.

The human visual ability to recognize objects and scenes is widely thought to rely on representations in category-selective regions of the visual cortex. These representations could support object vision by specifically representing objects, or, more simply, by representing complex visual features regardless of the particular spatial arrangement needed to constitute real-world objects, that is, by representing visual textures. To discriminate between these hypotheses, we leveraged an image synthesis approach that, unlike previous methods, provides independent control over the complexity and spatial arrangement of visual features. We found that human observers could easily detect a natural object among synthetic images with similar complex features that were spatially scrambled. However, observer models built from BOLD responses from category-selective regions, as well as a model of macaque inferotemporal cortex and Imagenet-trained deep convolutional neural networks, were all unable to identify the real object. This inability was not due to a lack of signal to noise, as all observer models could predict human performance in image categorization tasks. How then might these texture-like representations in category-selective regions support object perception? An image-specific readout from category-selective cortex yielded a representation that was more selective for natural feature arrangement, showing that the information necessary for natural object discrimination is available. Thus, our results suggest that the role of the human category-selective visual cortex is not to explicitly encode objects but rather to provide a basis set of texture-like features that can be infinitely reconfigured to flexibly learn and identify new object categories.

NeuroGen: Activation optimized image synthesis for discovery neuroscience

Functional MRI (fMRI) is a powerful technique that has allowed us to characterize visual cortex responses to stimuli, yet such experiments are by nature constructed based on a priori hypotheses, limited to the set of images presented to the individual while they are in the scanner, are subject to noise in the observed brain responses, and may vary widely across individuals. In this work, we propose a novel computational strategy, which we call NeuroGen, to overcome these limitations and develop a powerful tool for human vision neuroscience discovery. NeuroGen combines an fMRI-trained neural encoding model of human vision with a deep generative network to synthesize images predicted to achieve a target pattern of macro-scale brain activation. We demonstrate that the reduction of noise that the encoding model provides, coupled with the generative network's ability to produce images of high fidelity, results in a robust discovery architecture for visual neuroscience. By using only a small number of synthetic images created by NeuroGen, we demonstrate that we can detect and amplify differences in regional and individual human brain response patterns to visual stimuli. We then verify that these discoveries are reflected in the several thousand observed image responses measured with fMRI. We further demonstrate that NeuroGen can create synthetic images predicted to achieve regional response patterns not achievable by the best-matching natural images. The NeuroGen framework extends the utility of brain encoding models and opens up a new avenue for exploring, and possibly precisely controlling, the human visual system.

Attention enhances category representations across the brain with strengthened residual correlations to ventral temporal cortex

How does attention enhance neural representations of goal-relevant stimuli while suppressing representations of ignored stimuli across regions of the brain? While prior studies have shown that attention enhances visual responses, we lack a cohesive understanding of how selective attention modulates visual representations across the brain. Here, we used functional magnetic resonance imaging (fMRI) while participants performed a selective attention task on superimposed stimuli from multiple categories and used a data-driven approach to test how attention affects both decodability of category information and residual correlations (after regressing out stimulus-driven variance) with category-selective regions of ventral temporal cortex (VTC). Our data reveal three main findings. First, when two objects are simultaneously viewed, the category of the attended object can be decoded more readily than the category of the ignored object, with the greatest attentional enhancements observed in occipital and temporal lobes. Second, after accounting for the response to the stimulus, the correlation in the residual brain activity between a cortical region and a category-selective region of VTC was elevated when that region’s preferred category was attended vs. ignored, and more so in the right occipital, parietal, and frontal cortices. Third, we found that the stronger the residual correlations between a given region of cortex and VTC, the better visual category information could be decoded from that region. These findings suggest that heightened residual correlations by selective attention may reflect the sharing of information between sensory regions and higher-order cortical regions to provide attentional enhancement of goal-relevant information.

A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence

Extensive sampling of neural activity during rich cognitive phenomena is critical for robust understanding of brain function. Here we present the Natural Scenes Dataset (NSD), in which high-resolution functional magnetic resonance imaging responses to tens of thousands of richly annotated natural scenes were measured while participants performed a continuous recognition task. To optimize data quality, we developed and applied novel estimation and denoising techniques. Simple visual inspections of the NSD data reveal clear representational transformations along the ventral visual pathway. Further exemplifying the inferential power of the dataset, we used NSD to build and train deep neural network models that predict brain activity more accurately than state-of-the-art models from computer vision. NSD also includes substantial resting-state and diffusion data, enabling network neuroscience perspectives to constrain and enhance models of perception and memory. Given its unprecedented scale, quality and breadth, NSD opens new avenues of inquiry in cognitive neuroscience and artificial intelligence.

Face detection in untrained deep neural networks

Face-selective neurons are observed in the primate visual pathway and are considered as the basis of face detection in the brain. However, it has been debated as to whether this neuronal selectivity can arise innately or whether it requires training from visual experience. Here, using a hierarchical deep neural network model of the ventral visual stream, we suggest a mechanism in which face-selectivity arises in the complete absence of training. We found that units selective to faces emerge robustly in randomly initialized networks and that these units reproduce many characteristics observed in monkeys. This innate selectivity also enables the untrained network to perform face-detection tasks. Intriguingly, we observed that units selective to various non-face objects can also arise innately in untrained networks. Our results imply that the random feedforward connections in early, untrained deep neural networks may be sufficient for initializing primitive visual selectivity.

Anatomy and physiology of word-selective visual cortex: from visual features to lexical processing

Over the past 2 decades, researchers have tried to uncover how the human brain can extract linguistic information from a sequence of visual symbols. The description of how the brain's visual system processes words and enables reading has improved with the progressive refinement of experimental methodologies and neuroimaging techniques. This review provides a brief overview of this research journey. We start by describing classical models of object recognition in non-human primates, which represent the foundation for many of the early models of visual word recognition in humans. We then review functional neuroimaging studies investigating the word-selective regions in visual cortex. This research led to the differentiation of highly specialized areas, which are involved in the analysis of different aspects of written language. We then consider the corresponding anatomical measurements and provide a description of the main white matter pathways carrying neural signals crucial to word recognition. Finally, in an attempt to integrate structural, functional, and electrophysiological findings, we propose a view of visual word recognition, accounting for spatial and temporal facets of word-selective neural processes. This multi-modal perspective on the neural circuitry of literacy highlights the relevance of a posterior-anterior differentiation in ventral occipitotemporal cortex for visual processing of written language and lexical features. It also highlights unanswered questions that can guide us towards future research directions. Bridging measures of brain structure and function will help us reach a more precise understanding of the transformation from vision to language.

Cortical recycling in high-level visual cortex during childhood development

Human ventral temporal cortex contains category-selective regions that respond preferentially to ecologically relevant categories such as faces, bodies, places and words and that are causally involved in the perception of these categories. How do these regions develop during childhood? We used functional magnetic resonance imaging to measure longitudinal development of category selectivity in school-age children over 1 to 5 years. We discovered that, from young childhood to the teens, face- and word-selective regions in ventral temporal cortex expand and become more category selective, but limb-selective regions shrink and lose their preference for limbs. Critically, as a child develops, increases in face and word selectivity are directly linked to decreases in limb selectivity, revealing that during childhood, limb selectivity in ventral temporal cortex is repurposed into word and face selectivity. These data provide evidence for cortical recycling during childhood development. This has important implications for understanding typical as well as atypical brain development and necessitates a rethinking of how cortical function develops during childhood.

Words as Visual Objects: Neural and Behavioral Evidence for High-Level Visual Impairments in Dyslexia

Developmental dyslexia is defined by reading impairments that are disproportionate to intelligence, motivation, and the educational opportunities considered necessary for reading. Its cause has traditionally been considered to be a phonological deficit, where people have difficulties with differentiating the sounds of spoken language. However, reading is a multidimensional skill and relies on various cognitive abilities. These may include high-level vision—the processes that support visual recognition despite innumerable image variations, such as in viewpoint, position, or size. According to our high-level visual dysfunction hypothesis, reading problems of some people with dyslexia can be a salient manifestation of a more general deficit of high-level vision. This paper provides a perspective on how such non-phonological impairments could, in some cases, cause dyslexia. To argue in favor of this hypothesis, we will discuss work on functional neuroimaging, structural imaging, electrophysiology, and behavior that provides evidence for a link between high-level visual impairment and dyslexia.

Is Developmental Dyslexia Due to a Visual and Not a Phonological Impairment?

It is a widely held belief that developmental dyslexia (DD) is a phonological disorder in which readers have difficulty associating graphemes with their corresponding phonemes. In contrast, the magnocellular theory of dyslexia assumes that DD is a visual disorder caused by dysfunctional magnocellular neural pathways. The review explores arguments for and against these theories. Recent results have shown that DD is caused by (1) a reduced ability to simultaneously recognize sequences of letters that make up words, (2) longer fixation times required to simultaneously recognize strings of letters, and (3) amplitudes of saccades that do not match the number of simultaneously recognized letters. It was shown that pseudowords that could not be recognized simultaneously were recognized almost without errors when the fixation time was extended. However, there is an individual maximum number of letters that each reader with DD can recognize simultaneously. Findings on the neurobiological basis of temporal summation have shown that a necessary prolongation of fixation times is due to impaired processing mechanisms of the visual system, presumably involving magnocells and parvocells. An area in the mid-fusiform gyrus also appears to play a significant role in the ability to simultaneously recognize words and pseudowords. The results also contradict the assumption that DD is due to a lack of eye movement control. The present research does not support the assumption that DD is caused by a phonological disorder but shows that DD is due to a visual processing dysfunction.

Distinct neural sources underlying visual word form processing as revealed by steady state visual evoked potentials (SSVEP)

EEG has been central to investigations of the time course of various neural functions underpinning visual word recognition. Recently the steady-state visual evoked potential (SSVEP) paradigm has been increasingly adopted for word recognition studies due to its high signal-to-noise ratio. Such studies, however, have been typically framed around a single source in the left ventral occipitotemporal cortex (vOT). Here, we combine SSVEP recorded from 16 adult native English speakers with a data-driven spatial filtering approach—Reliable Components Analysis (RCA)—to elucidate distinct functional sources with overlapping yet separable time courses and topographies that emerge when contrasting words with pseudofont visual controls. The first component topography was maximal over left vOT regions with a shorter latency (approximately 180 ms). A second component was maximal over more dorsal parietal regions with a longer latency (approximately 260 ms). Both components consistently emerged across a range of parameter manipulations including changes in the spatial overlap between successive stimuli, and changes in both base and deviation frequency. We then contrasted word-in-nonword and word-in-pseudoword to test the hierarchical processing mechanisms underlying visual word recognition. Results suggest that these hierarchical contrasts fail to evoke a unitary component that might be reasonably associated with lexical access.

Holistic face recognition is an emergent phenomenon of spatial processing in face-selective regions

Spatial processing by receptive fields is a core property of the visual system. However, it is unknown how spatial processing in high-level regions contributes to recognition behavior. As face inversion is thought to disrupt typical holistic processing of information in faces, we mapped population receptive fields (pRFs) with upright and inverted faces in the human visual system. Here we show that in face-selective regions, but not primary visual cortex, pRFs and overall visual field coverage are smaller and shifted downward in response to face inversion. From these measurements, we successfully predict the relative behavioral detriment of face inversion at different positions in the visual field. This correspondence between neural measurements and behavior demonstrates how spatial processing in face-selective regions may enable holistic perception. These results not only show that spatial processing in high-level visual regions is dynamically used towards recognition, but also suggest a powerful approach for bridging neural computations by receptive fields to behavior.

Cortical Visual Mapping following Ocular Gene Augmentation Therapy for Achromatopsia

The ability of the adult human brain to develop function following correction of congenital deafferentation is controversial. Specifically, cases of recovery from congenital visual deficits are rare. CNGA3-achromatopsia is a congenital hereditary disease caused by cone-photoreceptor dysfunction, leading to impaired acuity, photoaversion, and complete color blindness. Essentially, these patients have rod-driven vision only, seeing the world in blurry shades of gray. We use the uniqueness of this rare disease, in which the cone-photoreceptors and afferent fibers are preserved but do not function, as a model to study cortical visual plasticity. We had the opportunity to study two CNGA3-achromatopsia adults (one female) before and after ocular gene augmentation therapy. Alongside behavioral visual tests, we used novel fMRI-based measurements to assess participants' early visual population receptive-field sizes and color regions. Behaviorally, minor improvements were observed, including reduction in photoaversion, marginal improvement in acuity, and a new ability to detect red color. No improvement was observed in color arrangement tests. Cortically, pretreatment, patients' population-receptive field sizes of early visual areas were untypically large, but were decreased following treatment specifically in the treated eye. We suggest that this demonstrates cortical ability to encode new input, even at adulthood. On the other hand, no activation of color-specific cortical regions was demonstrated in these patients either before or up to 1 year post-treatment. The source of this deficiency might be attributed either to insufficient recovery of cone function at the retinal level or to challenges that the adult cortex faces when computing new cone-derived input to achieve color perception.SIGNIFICANCE STATEMENT The possibility that the adult human brain may regain or develop function following correction of congenital deafferentation has fired the imagination of scientists over the years. In the visual domain, cases of recovery from congenital deficits are rare. Gene therapy visual restoration for congenital CNGA3-achromatopsia, a disease caused by cone photoreceptor dysfunction, gave us the opportunity to examine cortical function, to the best of our knowledge for the first time, both before and after restorative treatment. While behaviorally only minor improvements were observed post-treatment, fMRI analysis, including size algorithms of population-receptive fields, revealed cortical changes, specifically receptive field size decrease in the treated eyes. This suggests that, at least to some degree, the adult cortex is able to encode new input.

Inferior Occipital Gyrus Is Organized along Common Gradients of Spatial and Face-Part Selectivity

The ventral visual stream of the human brain is subdivided into patches with categorical stimulus preferences, like faces or scenes. However, the functional organization within these areas is less clear. Here, we used functional magnetic resonance imaging and vertex-wise tuning models to independently probe spatial and face-part preferences in the inferior occipital gyrus (IOG) of healthy adult males and females. The majority of responses were well explained by Gaussian population tuning curves for both retinotopic location and the preferred relative position within a face. Parameter maps revealed a common gradient of spatial and face-part selectivity, with the width of tuning curves drastically increasing from posterior to anterior IOG. Tuning peaks clustered more idiosyncratically but were also correlated across maps of visual and face space. Preferences for the upper visual field went along with significantly increased coverage of the upper half of the face, matching recently discovered biases in human perception. Our findings reveal a broad range of neural face-part selectivity in IOG, ranging from narrow to "holistic." IOG is functionally organized along this gradient, which in turn is correlated with retinotopy.SIGNIFICANCE STATEMENT Brain imaging has revealed a lot about the large-scale organization of the human brain and visual system. For example, occipital cortex contains map-like representations of the visual field, while neurons in ventral areas cluster into patches with categorical preferences, like faces or scenes. Much less is known about the functional organization within these areas. Here, we focused on a well established face-preferring area-the inferior occipital gyrus (IOG). A novel neuroimaging paradigm allowed us to map the retinotopic and face-part tuning of many recording sites in IOG independently. We found a steep posterior-anterior gradient of decreasing face-part selectivity, which correlated with retinotopy. This suggests the functional role of ventral areas is not uniform and may follow retinotopic "protomaps."

Top-Down Attention Guidance Shapes Action Encoding in the pSTS

The posterior superior temporal sulcus (pSTS) is a brain region characterized by perceptual representations of human body actions that promote the understanding of observed behavior. Increasingly, action observation is recognized as being strongly shaped by the expectations of the observer (Kilner 2011; Koster-Hale and Saxe 2013; Patel et al. 2019). Therefore, to characterize top-down influences on action observation, we evaluated the statistical structure of multivariate activation patterns from the action observation network (AON) while observers attended to the different dimensions of action vignettes (the action kinematics, goal, or identity of avatars jumping or crouching). Decoding accuracy varied as a function of attention instruction in the right pSTS and left inferior frontal cortex (IFC), with the right pSTS classifying actions most accurately when observers attended to the action kinematics and the left IFC classifying most accurately when observed attended to the actor's goal. Functional connectivity also increased between the right pSTS and right IFC when observers attended to the actions portrayed in the vignettes. Our findings are evidence that the attentive state of the viewer modulates sensory representations in the pSTS, consistent with proposals that the pSTS occupies an interstitial zone mediating top-down context and bottom-up perceptual cues during action observation.

Stability of ripple events during task engagement in human hippocampus

High-frequency activity bursts in the hippocampus, known as ripples, are thought to support memory consolidation during “offline” states, such as sleep. Recently, human hippocampal ripples have been observed during “online” episodic memory tasks. It remains unclear whether similar ripple activity occurs during other cognitive states, including different types of episodic memory. However, identifying genuine ripple events in the human hippocampus is challenging. To address these questions, spectro-temporal ripple identification was applied to human hippocampal recordings across a variety of cognitive tasks. Overall, ripple attributes were stable across tasks of visual perception and associative memory, with mean rates lower than offline states of rest and sleep. In contrast, while more complex visual attention tasks did not modulate ripple attributes, rates were enhanced for more complex autobiographical memory conditions. Therefore, hippocampal ripples reliably occur across cognitive states but are specifically enhanced during offline states and complex memory processes, consistent with a role in consolidation.

Hippocampal ripples are high-frequency activity bursts proposed to support “offline” memory consolidation. Chen et al. identify that human hippocampal ripples occur with stable properties across tasks of visual perception and associative memory but are enhanced for autobiographical memory retrieval and non-REM sleep, supporting their “online” role in establishing and strengthening memory traces.

Differential spatial computations in ventral and lateral face-selective regions are scaffolded by structural connections

Face-processing occurs across ventral and lateral visual streams, which are involved in static and dynamic face perception, respectively. However, the nature of spatial computations across streams is unknown. Using functional MRI and population receptive field (pRF) mapping, we measured pRFs in face-selective regions. Results reveal that spatial computations by pRFs in ventral face-selective regions are concentrated around the center of gaze (fovea), but spatial computations in lateral face-selective regions extend peripherally. Diffusion MRI reveals that these differences are mirrored by a preponderance of white matter connections between ventral face-selective regions and foveal early visual cortex (EVC), while connections with lateral regions are distributed more uniformly across EVC eccentricities. These findings suggest a rethinking of spatial computations in face-selective regions, showing that they vary across ventral and lateral streams, and further propose that spatial computations in high-level regions are scaffolded by the fine-grain pattern of white matter connections from EVC.

Moving Toward versus Away from Another: How Body Motion Direction Changes the Representation of Bodies and Actions in the Visual Cortex

Representing multiple agents and their mutual relations is a prerequisite to understand social events such as interactions. Using functional magnetic resonance imaging on human adults, we show that visual areas dedicated to body form and body motion perception contribute to processing social events, by holding the representation of multiple moving bodies and encoding the spatial relations between them. In particular, seeing animations of human bodies facing and moving toward (vs. away from) each other increased neural activity in the body-selective cortex [extrastriate body area (EBA)] and posterior superior temporal sulcus (pSTS) for biological motion perception. In those areas, representation of body postures and movements, as well as of the overall scene, was more accurate for facing body (vs. nonfacing body) stimuli. Effective connectivity analysis with dynamic causal modeling revealed increased coupling between EBA and pSTS during perception of facing body stimuli. The perceptual enhancement of multiple-body scenes featuring cues of interaction (i.e., face-to-face positioning, spatial proximity, and approaching signals) was supported by the participants' better performance in a recognition task with facing body versus nonfacing body stimuli. Thus, visuospatial cues of interaction in multiple-person scenarios affect the perceptual representation of body and body motion and, by promoting functional integration, streamline the process from body perception to action representation.

Clarifying the role of higher-level cortices in resolving perceptual ambiguity using ultra high field fMRI

The brain is organized into distinct, flexible networks. Within these networks, cognitive variables such as attention can modulate sensory representations in accordance with moment-to-moment behavioral requirements. These modulations can be studied by varying task demands; however, the tasks employed are often incongruent with the postulated functions of a sensory system, limiting the characterization of the system in relation to natural behaviors. Here we combine domain-specific task manipulations and ultra-high field fMRI to study the nature of top-down modulations. We exploited faces, a visual category underpinned by a complex cortical network, and instructed participants to perform either a stimulus-relevant/domain-specific or a stimulus-irrelevant task in the scanner. We found that 1. perceptual ambiguity (i.e. difficulty of achieving a stable percept) is encoded in top-down modulations from higher-level cortices; 2. the right inferior-temporal lobe is active under challenging conditions and uniquely encodes trial-by-trial variability in face perception.

White matter fascicles and cortical microstructure predict reading-related responses in human ventral temporal cortex

Reading-related responses in the lateral ventral temporal cortex (VTC) show a consistent spatial layout across individuals, which is puzzling, since reading skills are acquired during childhood. Here, we tested the hypothesis that white matter fascicles and gray matter microstructure predict the location of reading-related responses in lateral VTC. We obtained functional (fMRI), diffusion (dMRI), and quantitative (qMRI) magnetic resonance imaging data in 30 adults. fMRI was used to map reading-related responses by contrasting responses in a reading task with those in adding and color tasks; dMRI was used to identify the brain's fascicles and to map their endpoint densities in lateral VTC; qMRI was used to measure proton relaxation time (T1), which depends on cortical tissue microstructure. We fit linear models that predict reading-related responses in lateral VTC from endpoint density and T1 and used leave-one-subject-out cross-validation to assess prediction accuracy. Using a subset of our participants (N=10, feature selection set), we find that i) endpoint densities of the arcuate fasciculus (AF), inferior longitudinal fasciculus (ILF), and vertical occipital fasciculus (VOF) are significant predictors of reading-related responses, and ii) cortical T1 of lateral VTC further improves the predictions of the fascicle model. In the remaining participants (N=20, validation set), we show that a linear model that includes T1, AF, ILF and VOF significantly predicts i) the map of reading-related responses across lateral VTC and ii) the location of the visual word form area, a region critical for reading. Overall, our data-driven approach reveals that the AF, ILF, VOF and cortical microstructure have a consistent spatial relationship with an individual's reading-related responses in lateral VTC.

A Probabilistic Functional Atlas of Human Occipito-Temporal Visual Cortex

Human visual cortex contains many retinotopic and category-specific regions. These brain regions have been the focus of a large body of functional magnetic resonance imaging research, significantly expanding our understanding of visual processing. As studying these regions requires accurate localization of their cortical location, researchers perform functional localizer scans to identify these regions in each individual. However, it is not always possible to conduct these localizer scans. Here, we developed and validated a functional region of interest (ROI) atlas of early visual and category-selective regions in human ventral and lateral occipito-temporal cortex. Results show that for the majority of functionally defined ROIs, cortex-based alignment results in lower between-subject variability compared to nonlinear volumetric alignment. Furthermore, we demonstrate that 1) the atlas accurately predicts the location of an independent dataset of ventral temporal cortex ROIs and other atlases of place selectivity, motion selectivity, and retinotopy. Next, 2) we show that the majority of voxel within our atlas is responding mostly to the labeled category in a left-out subject cross-validation, demonstrating the utility of this atlas. The functional atlas is publicly available (download.brainvoyager.com/data/visfAtlas.zip) and can help identify the location of these regions in healthy subjects as well as populations (e.g., blind people, infants) in which functional localizers cannot be run.

fMRI-Indexed neural temporal tuning reveals the hierarchical organsiation of the face and person selective network

Recognising and knowing about conspecifics is vital to human interaction and is served in the brain by a well-characterised cortical network. Understanding the temporal dynamics of this network is critical to gaining insight into both hierarchical organisation and regional coordination. Here, we combine the high spatial resolution of fMRI with a paradigm that permits investigation of differential temporal tuning across cortical regions. We cognitively under- and overload the system using the rapid presentation (100-1200msec) of famous faces and buildings. We observed an increase in activity as presentation rates slowed and a negative deflection when inter-stimulus intervals (ISIs) were extended to longer periods. The primary distinction in tuning patterns was between core (perceptual) and extended (non-perceptual) systems but there was also evidence for nested hierarchies within systems, as well as indications of widespread parallel processing. Extended regions demonstrated common temporal tuning across regions which may indicate coordinated activity as they cooperate to manifest the diverse cognitive representation accomplished by this network. With the support of an additional psychophysical study, we demonstrated that ISIs necessary for different levels of semantic access are consistent with temporal tuning patterns. Collectively, these results show that regions of the person-knowledge network operate over different temporal timescales consistent with hierarchical organisation.

Learning to Read Increases the Informativeness of Distributed Ventral Temporal Responses

Becoming a proficient reader requires substantial learning over many years. However, it is unknown how learning to read affects development of distributed visual representations across human ventral temporal cortex (VTC). Using fMRI and a data-driven, computational approach, we quantified the development of distributed VTC responses to characters (pseudowords and numbers) versus other domains in children, preteens, and adults. Results reveal anatomical- and hemisphere-specific development. With development, distributed responses to words and characters became more distinctive and informative in lateral but not medial VTC, and in the left but not right hemisphere. While the development of voxels with both positive and negative preference to words affected distributed information, only development of voxels with positive preference to words (i.e., word-selective) was correlated with reading ability. These data show that developmental increases in informativeness of distributed left lateral VTC responses are related to proficient reading and have important implications for both developmental theories and for elucidating neural mechanisms of reading disabilities.

Sulcal Depth in the Medial Ventral Temporal Cortex Predicts the Location of a Place-Selective Region in Macaques, Children, and Adults

The evolution and development of anatomical-functional relationships in the cerebral cortex is of major interest in neuroscience. Here, we leveraged the fact that a functional region selective for visual scenes is located within a sulcus in the medial ventral temporal cortex (VTC) in both humans and macaques to examine the relationship between sulcal depth and place selectivity in the medial VTC across species and age groups. To do so, we acquired anatomical and functional magnetic resonance imaging scans in 9 macaques, 26 human children, and 28 human adults. Our results revealed a strong structural-functional coupling between sulcal depth and place selectivity across age groups and species in which selectivity was strongest near the deepest sulcal point (the sulcal pit). Interestingly, this coupling between sulcal depth and place selectivity strengthens from childhood to adulthood in humans. Morphological analyses suggest that the stabilization of sulcal-functional coupling in adulthood may be due to sulcal deepening and areal expansion with age as well as developmental differences in cortical curvature at the pial, but not the white matter surfaces. Our results implicate sulcal features as functional landmarks in high-level visual cortex and highlight that sulcal-functional relationships in the medial VTC are preserved between macaques and humans despite differences in cortical folding.

A temporal decomposition method for identifying venous effects in task-based fMRI

The spatial resolution of functional magnetic resonance imaging (fMRI) is fundamentally limited by effects from large draining veins. Here we describe an analysis method that provides data-driven estimates of these effects in task-based fMRI. The method involves fitting a one-dimensional manifold that characterizes variation in response timecourses observed in a given dataset, and then using identified early and late timecourses as basis functions for decomposing responses into components related to the microvasculature (capillaries and small venules) and the macrovasculature (large veins), respectively. We show the removal of late components substantially reduces the superficial cortical depth bias of fMRI responses and helps eliminate artifacts in cortical activity maps. This method provides insight into the origins of the fMRI signal and can be used to improve the spatial accuracy of fMRI.

Dissociated modulations of multivoxel activation patterns in the ventral and dorsal visual pathways by the temporal dynamics of stimuli

INTRODUCTION

Previous studies suggested temporal limitations of visual object identification in the ventral pathway. Moreover, multivoxel pattern analyses (MVPA) of fMRI activation have shown reliable encoding of various object categories including faces and tools in the ventral pathway. By contrast, the dorsal pathway is involved in reaching a target and grasping a tool, and quicker in processing the temporal dynamics of stimulus change. However, little is known about how activation patterns in both pathways may change according to the temporal dynamics of stimulus change.

METHODS

Here, we measured fMRI responses of two consecutive stimuli with varying interstimulus intervals (ISIs), and we compared how the two visual pathways respond to the dynamics of stimuli by using MVPA and information-based searchlight mapping.

RESULTS

We found that the temporal dynamics of stimuli modulate responses of the two visual pathways in opposite directions. Specifically, slower temporal dynamics (longer ISIs) led to greater activity and better MVPA results in the ventral pathway. However, faster temporal dynamics (shorter ISIs) led to greater activity and better MVPA results in the dorsal pathway.

CONCLUSIONS

These results are the first to show how temporal dynamics of stimulus change modulated multivoxel fMRI activation pattern change. And such temporal dynamic response function in different ROIs along the two visual pathways may shed lights on understanding functional relationship and organization of these ROIs.

The occipital face area is causally involved in identity-related visual-semantic associations

Faces are processed in a network of areas within regions of the ventral visual stream. However, familiar faces typically are characterized by additional associated information, such as episodic memories or semantic biographical information as well. The acquisition of such non-sensory, identity-specific knowledge plays a crucial role in our ability to recognize and identify someone we know. The occipital face area (OFA), an early part of the core face-processing network, is recently found to be involved in the formation of identity-specific memory traces but it is currently unclear if this role is limited to unimodal visual information. The current experiments used transcranial magnetic stimulation (TMS) to test whether the OFA is involved in the association of a face with identity-specific semantic information, such as the name or job title of a person. We applied an identity-learning task where unfamiliar faces were presented together with a name and a job title in the first encoding phase. Simultaneously, TMS pulses were applied either to the left or right OFA or to Cz, as a control. In the subsequent retrieval phase, the previously seen faces were presented either with two names or with two job titles and the task of the participants was to select the semantic information previously learned. We found that the stimulation of the right or left OFA reduced subsequent retrieval performance for the face-associated job titles. This suggests a causal role of the OFA in the association of faces and related semantic information. Furthermore, in contrast to prior findings, we did not observe hemispherical differences of the TMS intervention, suggesting a similar role of the left and right OFAs in the formation of the visual-semantic associations. Our results suggest the necessity to reconsider the hierarchical face-perception models and support the distributed and recurrent models.

Multimodal mapping of the face connectome

Face processing supports our ability to recognize friend from foe, form tribes and understand the emotional implications of changes in facial musculature. This skill relies on a distributed network of brain regions, but how these regions interact is poorly understood. Here we integrate anatomical and functional connectivity measurements with behavioural assays to create a global model of the face connectome. We dissect key features, such as the network topology and fibre composition. We propose a neurocognitive model with three core streams; face processing along these streams occurs in a parallel and reciprocal manner. Although long-range fibre paths are important, the face network is dominated by short-range fibres. Finally, we provide evidence that the well-known right lateralization of face processing arises from imbalanced intra- and interhemispheric connections. In summary, the face network relies on dynamic communication across highly structured fibre tracts, enabling coherent face processing that underpins behaviour and cognition.

Ultra-high-resolution fMRI of Human Ventral Temporal Cortex Reveals Differential Representation of Categories and Domains

Human ventral temporal cortex (VTC) is critical for visual recognition. It is thought that this ability is supported by large-scale patterns of activity across VTC that contain information about visual categories. However, it is unknown how category representations in VTC are organized at the submillimeter scale and across cortical depths. To fill this gap in knowledge, we measured BOLD responses in medial and lateral VTC to images spanning 10 categories from five domains (written characters, bodies, faces, places, and objects) at an ultra-high spatial resolution of 0.8 mm using 7 Tesla fMRI in both male and female participants. Representations in lateral VTC were organized most strongly at the general level of domains (e.g., places), whereas medial VTC was also organized at the level of specific categories (e.g., corridors and houses within the domain of places). In both lateral and medial VTC, domain-level and category-level structure decreased with cortical depth, and downsampling our data to standard resolution (2.4 mm) did not reverse differences in representations between lateral and medial VTC. The functional diversity of representations across VTC partitions may allow downstream regions to read out information in a flexible manner according to task demands. These results bridge an important gap between electrophysiological recordings in single neurons at the micron scale in nonhuman primates and standard-resolution fMRI in humans by elucidating distributed responses at the submillimeter scale with ultra-high-resolution fMRI in humans.SIGNIFICANCE STATEMENT Visual recognition is a fundamental ability supported by human ventral temporal cortex (VTC). However, the nature of fine-scale, submillimeter distributed representations in VTC is unknown. Using ultra-high-resolution fMRI of human VTC, we found differential distributed visual representations across lateral and medial VTC. Domain representations (e.g., faces, bodies, places, characters) were most salient in lateral VTC, whereas category representations (e.g., corridors/houses within the domain of places) were equally salient in medial VTC. These results bridge an important gap between electrophysiological recordings in single neurons at a micron scale and fMRI measurements at a millimeter scale.

The Representation of Two-Body Shapes in the Human Visual Cortex

Human social nature has shaped visual perception. A signature of the relationship between vision and sociality is a particular visual sensitivity to social entities such as faces and bodies. We asked whether human vision also exhibits a special sensitivity to spatial relations that reliably correlate with social relations. In general, interacting people are more often situated face-to-face than back-to-back. Using functional MRI and behavioral measures in female and male human participants, we show that visual sensitivity to social stimuli extends to images including two bodies facing toward (vs away from) each other. In particular, the inferior lateral occipital cortex, which is involved in visual-object perception, is organized such that the inferior portion encodes the number of bodies (one vs two) and the superior portion is selectively sensitive to the spatial relation between bodies (facing vs nonfacing). Moreover, functionally localized, body-selective visual cortex responded to facing bodies more strongly than identical, but nonfacing, bodies. In this area, multivariate pattern analysis revealed an accurate representation of body dyads with sharpening of the representation of single-body postures in facing dyads, which demonstrates an effect of visual context on the perceptual analysis of a body. Finally, the cost of body inversion (upside-down rotation) on body recognition, a behavioral signature of a specialized mechanism for body perception, was larger for facing versus nonfacing dyads. Thus, spatial relations between multiple bodies are encoded in regions for body perception and affect the way in which bodies are processed.SIGNIFICANCE STATEMENT Human social nature has shaped visual perception. Here, we show that human vision is not only attuned to socially relevant entities, such as bodies, but also to socially relevant spatial relations between those entities. Body-selective regions of visual cortex respond more strongly to multiple bodies that appear to be interacting (i.e., face-to-face), relative to unrelated bodies, and more accurately represent single body postures in interacting scenarios. Moreover, recognition of facing bodies is particularly susceptible to perturbation by upside-down rotation, indicative of a particular visual sensitivity to the canonical appearance of facing bodies. This encoding of relations between multiple bodies in areas for body-shape recognition suggests that the visual context in which a body is encountered deeply affects its perceptual analysis.

Temporal tuning of repetition suppression across the visual cortex

The visual system adapts to its recent history. A phenomenon related to this is repetition suppression (RS), a reduction in neural responses to repeated compared with nonrepeated visual input. An intriguing hypothesis is that the timescale over which RS occurs across the visual hierarchy is tuned to the temporal statistics of visual input features, which change rapidly in low-level areas but are more stable in higher level areas. Here, we tested this hypothesis by studying the influence of the temporal lag between successive visual stimuli on RS throughout the visual system using functional (f)MRI. Twelve human volunteers engaged in four fMRI sessions in which we characterized the blood oxygen level-dependent response to pairs of repeated and nonrepeated natural images with interstimulus intervals (ISI) ranging from 50 to 1,000 ms to quantify the temporal tuning of RS along the posterior-anterior axis of the visual system. As expected, RS was maximal for short ISIs and decayed with increasing ISI. Crucially, however, and against our hypothesis, RS decayed at a similar rate in early and late visual areas. This finding challenges the prevailing view that the timescale of RS increases along the posterior-anterior axis of the visual system and suggests that RS is not tuned to temporal input regularities.NEW & NOTEWORTHY Visual areas show reduced neural responses to repeated compared with nonrepeated visual input, a phenomenon termed repetition suppression (RS). Here we show that RS decays at a similar rate in low- and high-level visual areas, suggesting that the short-term decay of RS across the visual hierarchy is not tuned to temporal input regularities. This may limit the specificity with which the mechanisms underlying RS could optimize the processing of input features across the visual hierarchy.

Functionally Distinct Gamma Range Activity Revealed by Stimulus Tuning in Human Visual Cortex

Neocortical gamma activity has long been hypothesized as a mechanism for synchronizing brain regions to support visual perception and cognition more broadly. Although early studies focused on narrowband gamma oscillations (∼20-60 Hz), recent work has emphasized a more broadband "high-gamma" response (∼70-150+ Hz). These responses are often conceptually or analytically treated as synonymous markers of gamma activity. Using high-density intracranial recordings from the human visual cortex, we challenge this view by showing distinct spectral, temporal, and functional properties of narrow and broadband gamma. Across four experiments, narrowband gamma was strongly selective for gratings and long-wavelength colors, displaying a delayed response onset, sustained temporal profile, and contrast-dependent peak frequency. In addition, induced narrowband gamma oscillations lacked phase consistency across stimulus repetitions and displayed highly focal inter-site synchronization. In contrast, broadband gamma was consistently observed for all presented stimuli, displaying a rapid response onset, transient temporal profile, and invariant spectral properties. We exploited stimulus tuning to highlight the functional dissociation of these distinct signals, reconciling prior inconsistencies across species and stimuli regarding the ubiquity of visual gamma oscillations during natural vision. The occurrence of visual narrowband gamma oscillations, unlike broadband high gamma, appears contingent on specific structural and chromatic stimulus attributes intersecting with the receptive field. Together, these findings have important implications for the study, analysis, and functional interpretation of neocortical gamma-range activity.

Apparent thinning of human visual cortex during childhood is associated with myelination

Human cortex appears to thin during childhood development. However, the underlying microstructural mechanisms are unknown. Using functional magnetic resonance imaging (fMRI), quantitative MRI (qMRI), and diffusion MRI (dMRI) in children and adults, we tested what quantitative changes occur to gray and white matter in ventral temporal cortex (VTC) from childhood to adulthood, and how these changes relate to cortical thinning. T1 relaxation time from qMRI and mean diffusivity (MD) from dMRI provide independent and complementary measurements of microstructural properties of gray and white matter tissue. In face- and character-selective regions in lateral VTC, T1 and MD decreased from age 5 to adulthood in mid and deep cortex, as well as in their adjacent white matter. T1 reduction also occurred longitudinally in children's brain regions. T1 and MD decreases 1) were consistent with tissue growth related to myelination, which we verified with adult histological myelin stains, and 2) were correlated with apparent cortical thinning. In contrast, in place-selective cortex in medial VTC, we found no development of T1 or MD after age 5, and thickness was related to cortical morphology. These findings suggest that lateral VTC likely becomes more myelinated from childhood to adulthood, affecting the contrast of MR images and, in turn, the apparent gray-white boundary. These findings are important because they suggest that VTC does not thin during childhood but instead gets more myelinated. Our data have broad ramifications for understanding both typical and atypical brain development using advanced in vivo quantitative measurements and clinical conditions implicating myelin.

Neural adaptation to faces reveals racial outgroup homogeneity effects in early perception

The tendency to view members of social outgroups as interchangeable has long been considered a core component of intergroup bias and a precursor to stereotyping and discrimination. However, the early perceptual nature of these intergroup biases is poorly understood. Here, we used a functional MRI adaptation paradigm to assess how face-selective brain regions respond to variation in physical similarity among racial ingroup (White) and outgroup (Black) faces. We conclude that differences emerge in the different tuning properties of early face-selective cortex for racial ingroup and outgroup faces and mirror behavioral differences in memory and perception of racial ingroup versus outgroup faces. These results suggest that outgroup deindividuation emerges at some of the earliest stages of perception.

A hallmark of intergroup biases is the tendency to individuate members of one’s own group but process members of other groups categorically. While the consequences of these biases for stereotyping and discrimination are well-documented, their early perceptual underpinnings remain less understood. Here, we investigated the neural mechanisms of this effect by testing whether high-level visual cortex is differentially tuned in its sensitivity to variation in own-race versus other-race faces. Using a functional MRI adaptation paradigm, we measured White participants’ habituation to blocks of White and Black faces that parametrically varied in their groupwise similarity. Participants showed a greater tendency to individuate own-race faces in perception, showing both greater release from adaptation to unique identities and increased sensitivity in the adaptation response to physical difference among faces. These group differences emerge in the tuning of early face-selective cortex and mirror behavioral differences in the memory and perception of own- versus other-race faces. Our results suggest that biases for other-race faces emerge at some of the earliest stages of sensory perception.

Functionally Separable Font-invariant and Font-sensitive Neural Populations in Occipitotemporal Cortex

Reading relies on the rapid visual recognition of words viewed in a wide variety of fonts. We used fMRI to identify neural populations showing reduced fMRI responses to repeated words displayed in different fonts ("font-invariant" repetition suppression). We also identified neural populations showing greater fMRI responses to words repeated in a changing font as compared with words repeated in the same font ("font-sensitive" release from repetition suppression). We observed font-invariant repetition suppression in two anatomically distinct regions of the left occipitotemporal cortex (OT), a "visual word form area" in mid-fusiform cortex, and a more posterior region in the middle occipital gyrus. In contrast, bilateral shape-selective lateral occipital cortex and posterior fusiform showed considerable sensitivity to font changes during the viewing of repeated words. Although the visual word form area and the left middle occipital gyrus showed some evidence of font sensitivity, both regions showed a relatively greater degree of font invariance than font sensitivity. Our results show that the neural mechanisms in the left OT involved in font-invariant word recognition are anatomically distinct from those sensitive to font-related shape changes. We conclude that font-invariant representation of visual word form is instantiated at multiple levels by anatomically distinct neural mechanisms within the left OT.

Differential sustained and transient temporal processing across visual streams

How do high-level visual regions process the temporal aspects of our visual experience? While the temporal sensitivity of early visual cortex has been studied with fMRI in humans, temporal processing in high-level visual cortex is largely unknown. By modeling neural responses with millisecond precision in separate sustained and transient channels, and introducing a flexible encoding framework that captures differences in neural temporal integration time windows and response nonlinearities, we predict fMRI responses across visual cortex for stimuli ranging from 33 ms to 20 s. Using this innovative approach, we discovered that lateral category-selective regions respond to visual transients associated with stimulus onsets and offsets but not sustained visual information. Thus, lateral category-selective regions compute moment-to-moment visual transitions, but not stable features of the visual input. In contrast, ventral category-selective regions process both sustained and transient components of the visual input. Our model revealed that sustained channel responses to prolonged stimuli exhibit adaptation, whereas transient channel responses to stimulus offsets are surprisingly larger than for stimulus onsets. This large offset transient response may reflect a memory trace of the stimulus when it is no longer visible, whereas the onset transient response may reflect rapid processing of new items. Together, these findings reveal previously unconsidered, fundamental temporal mechanisms that distinguish visual streams in the human brain. Importantly, our results underscore the promise of modeling brain responses with millisecond precision to understand the underlying neural computations.

How does the brain encode the timing of our visual experience? Using functional magnetic resonance imaging (fMRI) and a generative temporal model with millisecond resolution, we discovered that visual regions in the lateral and ventral processing streams fundamentally differ in their temporal processing of the visual input. Regions in lateral temporal cortex process visual transients associated with the beginning and ending of the stimulus, but not its stable aspects. That is, lateral regions appear to compute moment-to-moment changes in the visual input. In contrast, regions in ventral temporal cortex process both stable and transient components of the visual input, even as the response to the former exhibits adaptation. Surprisingly, the model predicts that in ventral regions responses to stimulus endings are larger than beginnings. We suggest that ending responses may reflect a memory trace of the stimulus, when it is no longer visible, and the beginning responses may reflect processing of new inputs. Together, these findings (i) reveal a fundamental temporal mechanism that distinguishes visual streams and (ii) highlight both the importance and utility of modeling brain responses with millisecond precision to understand the temporal dynamics of neural computations in the human brain.

Local Dominant Directional Symmetrical Coding Patterns for Facial Expression Recognition

To overcome the shortcomings of inaccurate textural direction representation and high-computational complexity of Local Binary Patterns (LBPs), we propose a novel feature descriptor named as Local Dominant Directional Symmetrical Coding Patterns (LDDSCPs). Inspired by the directional sensitivity of human visual system, we partition eight convolution masks into two symmetrical groups according to their directions and adopt these two groups to compute the convolution values of each pixel. Then, we encode the dominant direction information of facial expression texture by comparing each pixel's convolution values with the average strength of its belonging group and obtain LDDSCP-1 and LDDSCP-2 codes, respectively. At last, in view of the symmetry of two groups of direction masks, we stack these corresponding histograms of LDDSCP-1 and LDDSCP-2 codes into the ultimate LDDSCP feature vector which has effects on the more precise facial feature description and the lower computational complexity. Experimental results on the JAFFE and Cohn-Kanade databases demonstrate that the proposed LDDSCP feature descriptor compared with LBP, Gabor, and other traditional operators achieves superior performance in recognition rate and computational complexity. Furthermore, it is also no less inferior to some state-of-the-art local descriptors like as LDP, LDNP, es-LBP, and GDP.

Extensive childhood experience with Pokémon suggests eccentricity drives organization of visual cortex

The functional organization of human high-level visual cortex, such as the face- and place-selective regions, is strikingly consistent across individuals. An unanswered question in neuroscience concerns which dimensions of visual information constrain the development and topography of this shared brain organization. To answer this question, we used functional magnetic resonance imaging to scan a unique group of adults who, as children, had extensive visual experience with Pokémon. These animal-like, pixelated characters are dissimilar from other ecological categories, such as faces and places, along critical dimensions (foveal bias, rectilinearity, size, animacy). We show not only that adults who have Pokémon experience demonstrate distinct distributed cortical responses to Pokémon, but also that the experienced retinal eccentricity during childhood can predict the locus of Pokémon responses in adulthood. These data demonstrate that inherent functional representations in the visual cortex-retinal eccentricity-combined with consistent viewing behaviour of particular stimuli during childhood result in a shared functional topography in adulthood.

Parallel spatial channels converge at a bottleneck in anterior word-selective cortex

In most environments, the visual system is confronted with many relevant objects simultaneously. That is especially true during reading. However, behavioral data demonstrate that a serial bottleneck prevents recognition of more than one word at a time. We used fMRI to investigate how parallel spatial channels of visual processing converge into a serial bottleneck for word recognition. Participants viewed pairs of words presented simultaneously. We found that retinotopic cortex processed the two words in parallel spatial channels, one in each contralateral hemisphere. Responses were higher for attended than for ignored words but were not reduced when attention was divided. We then analyzed two word-selective regions along the occipitotemporal sulcus (OTS) of both hemispheres (subregions of the visual word form area, VWFA). Unlike retinotopic regions, each word-selective region responded to words on both sides of fixation. Nonetheless, a single region in the left hemisphere (posterior OTS) contained spatial channels for both hemifields that were independently modulated by selective attention. Thus, the left posterior VWFA supports parallel processing of multiple words. In contrast, activity in a more anterior word-selective region in the left hemisphere (mid OTS) was consistent with a single channel, showing (i) limited spatial selectivity, (ii) no effect of spatial attention on mean response amplitudes, and (iii) sensitivity to lexical properties of only one attended word. Therefore, the visual system can process two words in parallel up to a late stage in the ventral stream. The transition to a single channel is consistent with the observed bottleneck in behavior.

A critical assessment of data quality and venous effects in sub-millimeter fMRI

Advances in hardware, pulse sequences, and reconstruction techniques have made it possible to perform functional magnetic resonance imaging (fMRI) at sub-millimeter resolution while maintaining high spatial coverage and acceptable signal-to-noise ratio. Here, we examine whether sub-millimeter fMRI can be used as a routine method for obtaining accurate measurements of fine-scale local neural activity. We conducted fMRI in human visual cortex during a simple event-related visual experiment (7 T, gradient-echo EPI, 0.8-mm isotropic voxels, 2.2-s sampling rate, 84 slices), and developed analysis and visualization tools to assess the quality of the data. Our results fall along three lines of inquiry. First, we find that the acquired fMRI images, combined with appropriate surface-based processing, provide reliable and accurate measurements of fine-scale blood oxygenation level dependent (BOLD) activity patterns. Second, we show that the highly folded structure of cortex causes substantial biases on spatial resolution and data visualization. Third, we examine the well-recognized issue of venous contributions to fMRI signals. In a systematic assessment of large sections of cortex measured at a fine scale, we show that time-averaged T2*-weighted EPI intensity is a simple, robust marker of venous effects. These venous effects are unevenly distributed across cortex, are more pronounced in gyri and outer cortical depths, and are, to a certain degree, in consistent locations across subjects relative to cortical folding. Furthermore, we show that these venous effects are strongly correlated with BOLD responses evoked by the experiment. We conclude that sub-millimeter fMRI can provide robust information about fine-scale BOLD activity patterns, but special care must be exercised in visualizing and interpreting these patterns, especially with regards to the confounding influence of the brain's vasculature. To help translate these methodological findings to neuroscience research, we provide practical suggestions for both high-resolution and standard-resolution fMRI studies.

Human frontoparietal cortex represents behaviorally relevant target status based on abstract object features

Searching for items that are useful given current goals, or "target" recognition, requires observers to flexibly attend to certain object properties at the expense of others. This could involve focusing on the identity of an object while ignoring identity-preserving transformations such as changes in viewpoint or focusing on its current viewpoint while ignoring its identity. To effectively filter out variation due to the irrelevant dimension, performing either type of task is likely to require high-level, abstract search templates. Past work has found target recognition signals in areas of ventral visual cortex and in subregions of parietal and frontal cortex. However, target status in these tasks is typically associated with the identity of an object, rather than identity-orthogonal properties such as object viewpoint. In this study, we used a task that required subjects to identify novel object stimuli as targets according to either identity or viewpoint, each of which was not predictable from low-level properties such as shape. We performed functional MRI in human subjects of both sexes and measured the strength of target-match signals in areas of visual, parietal, and frontal cortex. Our multivariate analyses suggest that the multiple-demand (MD) network, including subregions of parietal and frontal cortex, encodes information about an object's status as a target in the relevant dimension only, across changes in the irrelevant dimension. Furthermore, there was more target-related information in MD regions on correct compared with incorrect trials, suggesting a strong link between MD target signals and behavior. NEW & NOTEWORTHY Real-world target detection tasks, such as searching for a car in a crowded parking lot, require both flexibility and abstraction. We investigated the neural basis of these abilities using a task that required invariant representations of either object identity or viewpoint. Multivariate decoding analyses of our whole brain functional MRI data reveal that invariant target representations are most pronounced in frontal and parietal regions, and the strength of these representations is associated with behavioral performance.

Embedded word priming elicits enhanced fMRI responses in the visual word form area

Lexical embedding is common in all languages and elicits mutual orthographic interference between an embedded word and its carrier. The neural basis of such interference remains unknown. We employed a novel fMRI prime-target embedded word paradigm to test for involvement of a visual word form area (VWFA) in left ventral occipitotemporal cortex in co-activation of embedded words and their carriers. Based on the results of related fMRI studies we predicted either enhancement or suppression of fMRI responses to embedded words initially viewed as primes, and repeated in the context of target carrier words. Our results clearly showed enhancement of fMRI responses in the VWFA to embedded-carrier word pairs as compared to unrelated prime-target pairs. In contrast to non-visual language-related areas (e.g., left inferior frontal gyrus), enhanced fMRI responses did not occur in the VWFA when embedded-carrier word pairs were restricted to the left visual hemifield. Our finding of fMRI enhancement in the VWFA is novel evidence of its involvement in representational rivalry between orthographically similar words, and the co-activation of embedded words and their carriers.

Word selectivity in high-level visual cortex and reading skill

Word-selective neural responses in human ventral occipito-temporal cortex (VOTC) emerge as children learn to read, creating a visual word form area (VWFA) in the literate brain. It has been suggested that the VWFA arises through competition between pre-existing selectivity for other stimulus categories, changing the topography of VOTC to support rapid word recognition. Here, we hypothesized that competition between words and objects would be resolved as children acquire reading skill. Using functional magnetic resonance imaging (fMRI), we examined the relationship between responses to words and objects in VOTC in two ways. First, we defined the VWFA using a words > objects contrast and found that only skilled readers had a region that responded more to words than objects. Second, we defined the VWFA using a words > faces contrast and examined selectivity for words over objects in this region. We found that word selectivity strongly correlated with reading skill, suggesting reading skill-dependent tuning for words. Furthermore, we found that low word selectivity in struggling readers was not due to a lack of response to words, but to a high response to objects. Our results suggest that the fine-tuning of word-selective responses in VOTC is a critical component of skilled reading.

Converging evidence for functional and structural segregation within the left ventral occipitotemporal cortex in reading

The ventral occipitotemporal cortex (vOTC) is crucial for recognizing visual patterns, and previous evidence suggests that there may be different subregions within the vOTC involved in the rapid identification of word forms. Here, we characterize vOTC reading circuitry using a multimodal approach combining functional, structural, and quantitative MRI and behavioral data. Two main word-responsive vOTC areas emerged: a posterior area involved in visual feature extraction, structurally connected to the intraparietal sulcus via the vertical occipital fasciculus; and an anterior area involved in integrating information with other regions of the language network, structurally connected to the angular gyrus via the posterior arcuate fasciculus. Furthermore, functional activation in these vOTC regions predicted reading behavior outside of the scanner. Differences in the microarchitectonic properties of gray-matter cells in these segregated areas were also observed, in line with earlier cytoarchitectonic evidence. These findings advance our understanding of the vOTC circuitry by linking functional responses to anatomical structure, revealing the pathways of distinct reading-related processes.

Localization and Functional Characterization of an Occipital Visual Word form Sensitive Area

In human occipitotemporal cortex, category-specific processing for visual objects seems to involve pairs of cortical regions, often with one located in the occipital cortex and another more anteriorly. We investigated whether such an arrangement might be the case for visual word processing. In addition to the Visual Word Form Area (VWFA) located in the occipitotemporal sulcus, we observed that another region in occipital lobe with robust responses to written words (Chinese characters). The current fMRI study investigated this area’s precise location and its functional selectivity using Chinese characters and other categories of visual images (cars, chairs and insects). In all the 13 subjects we could identify a cluster of voxels near the inferior occipital gyrus or middle occipital gyrus with stronger responses to Chinese characters than scrambled objects. We tentatively label this area as the Occipital Word Form Sensitive Area (OWA). The OWA’s response amplitudes showed similar preference to written words as the VWFA, with the VWFA showing a higher degree of word selectivity, which was confirmed by the result from spatial patterns of response. These results indicate that the OWA, together with the VWFA, are critical parts of the network for processing and representing the category information for word.

Defining the most probable location of the parahippocampal place area using cortex-based alignment and cross-validation

The parahippocampal place area (PPA) is a widely studied high-level visual region in the human brain involved in place and scene processing. The goal of the present study was to identify the most probable location of place-selective voxels in medial ventral temporal cortex. To achieve this goal, we first used cortex-based alignment (CBA) to create a probabilistic place-selective region of interest (ROI) from one group of 12 participants. We then tested how well this ROI could predict place selectivity in each hemisphere within a new group of 12 participants. Our results reveal that a probabilistic ROI (pROI) generated from one group of 12 participants accurately predicts the location and functional selectivity in individual brains from a new group of 12 participants, despite between subject variability in the exact location of place-selective voxels relative to the folding of parahippocampal cortex. Additionally, the prediction accuracy of our pROI is significantly higher than that achieved by volume-based Talairach alignment. Comparing the location of the pROI of the PPA relative to published data from over 500 participants, including data from the Human Connectome Project, shows a striking convergence of the predicted location of the PPA and the cortical location of voxels exhibiting the highest place selectivity across studies using various methods and stimuli. Specifically, the most predictive anatomical location of voxels exhibiting the highest place selectivity in medial ventral temporal cortex is the junction of the collateral and anterior lingual sulci. Methodologically, we make this pROI freely available (vpnl.stanford.edu/PlaceSelectivity), which provides a means to accurately identify a functional region from anatomical MRI data when fMRI data are not available (for example, in patient populations). Theoretically, we consider different anatomical and functional factors that may contribute to the consistent anatomical location of place selectivity relative to the folding of high-level visual cortex.

A preference for mathematical processing outweighs the selectivity for Arabic numbers in the inferior temporal gyrus

A region in the posterior inferior temporal gyrus (ITG), referred to as the number form area (NFA, here ITG-numbers) has been implicated in the visual processing of Arabic numbers. However, it is unknown if this region is specifically involved in the visual encoding of Arabic numbers per se or in mathematical processing more broadly. Using functional magnetic resonance imaging (fMRI) during experiments that systematically vary tasks and stimuli, we find that mathematical processing, not preference to Arabic numbers, consistently drives both mean and distributed responses in the posterior ITG. While we replicated findings of higher responses in ITG-numbers to numbers than other visual stimuli during a 1-back task, this preference to numbers was abolished when participants engaged in mathematical processing. In contrast, an ITG region (ITG-math) that showed higher responses during an adding task vs. other tasks maintained this preference for mathematical processing across a wide range of stimuli including numbers, number/letter morphs, hands, and dice. Analysis of distributed responses across an anatomically-defined posterior ITG expanse further revealed that mathematical task but not Arabic number form can be successfully and consistently decoded from these distributed responses. Together, our findings suggest that the function of neuronal regions in the posterior ITG goes beyond the specific visual processing of Arabic numbers. We hypothesize that they ascribe numerical content to the visual input, irrespective of the format of the stimulus.

How neuroscience can inform the study of individual differences in cognitive abilities

Theories of human mental abilities should be consistent with what is known in neuroscience. Currently, tests of human mental abilities are modeled by cognitive constructs such as attention, working memory, and speed of information processing. These constructs are in turn related to a single general ability. However, brains are very complex systems and whether most of the variability between the operations of different brains can be ascribed to a single factor is questionable. Research in neuroscience suggests that psychological processes such as perception, attention, decision, and executive control are emergent properties of interacting distributed networks. The modules that make up these networks use similar computational processes that involve multiple forms of neural plasticity, each having different time constants. Accordingly, these networks might best be characterized in terms of the information they process rather than in terms of abstract psychological processes such as working memory and executive control.

Development differentially sculpts receptive fields across early and high-level human visual cortex

Receptive fields (RFs) processing information in restricted parts of the visual field are a key property of visual system neurons. However, how RFs develop in humans is unknown. Using fMRI and population receptive field (pRF) modeling in children and adults, we determine where and how pRFs develop across the ventral visual stream. Here we report that pRF properties in visual field maps, from the first visual area, V1, through the first ventro-occipital area, VO1, are adult-like by age 5. However, pRF properties in face-selective and character-selective regions develop into adulthood, increasing the foveal coverage bias for faces in the right hemisphere and words in the left hemisphere. Eye-tracking indicates that pRF changes are related to changing fixation patterns on words and faces across development. These findings suggest a link between face and word viewing behavior and the differential development of pRFs across visual cortex, potentially due to competition on foveal coverage.

Population receptive fields (pRFs) in the visual system are key information-processors, but how they develop is unknown. Here, authors use fMRI and pRF modeling in children and adults to show that in the ventral stream only pRFs in face- and word-selective regions continue to develop, mirroring changes in viewing behavior.