The retinotopic organization of primate dorsal V4 and surrounding areas: A functional magnetic resonance imaging study in awake monkeys

Topographic organization across foveal visual areas in macaques

Introduction

While the fovea on the retina covers only a small region of the visual field, a significant portion of the visual cortex is dedicated to processing information from the fovea being a critical center for object recognition, motion control, and visually guided attention. Despite its importance, prior functional imaging studies in awake monkeys often focused on the parafoveal visual field, potentially leading to inaccuracies in understanding the brain structure underlying function.

Methods

In this study, our aim is to unveil the neuronal connectivity and topography in the foveal visual cortex in comparison to the parafoveal visual cortex. Using four different types of retrograde tracers, we selectively injected them into the striate cortex (V1) or V4, encompassing the regions between the fovea and parafovea.

Results

V1 and V4 exhibited intense mutual connectivity in the foveal visual field, in contrast to the parafoveal visual field, possibly due to the absence of V3 in the foveal visual field. While previous live brain imaging studies failed to reveal retinotopy in the foveal visual fields, our results indicate that the foveal visual fields have continuous topographic connectivity across V1 through V4, as well as the parafoveal visual fields. Although a simple extension of the retinotopic isoeccentricity maps from V1 to V4 has been suggested from previous fMRI studies, our study demonstrated that V3 and V4 possess gradually smaller topographic maps compared to V1 and V2. Feedback projections to foveal V1 primarily originate from the infragranular layers of foveal V2 and V4, while feedforward projections to foveal V4 arise from both supragranular and infragranular layers of foveal V1 and V2, consistent with previous findings in the parafoveal visual fields.

Discussion

This study provides valuable insights into the connectivity of the foveal visual cortex, which was ambiguous in previous imaging studies.

Representation of Cone-Opponent Color Space in Macaque Early Visual Cortices

In primate vision, the encoding of color perception arises from three types of retinal cone cells (L, M, and S cones). The inputs from these cones are linearly integrated into two cone-opponent channels (cardinal axes) before the lateral geniculate nucleus. In subsequent visual cortical stages, color-preferring neurons cluster into functional domains within "blobs" in V1, "thin/color stripes" in V2, and "color bands" in V4. Here, we hypothesize that, with increasing cortical hierarchy, the functional organization of hue representation becomes more balanced and less dependent on cone opponency. To address this question, we used intrinsic signal optical imaging in macaque V1, V2, and V4 cortices to examine the domain-based representation of specific hues (here referred to as "hue domains") in cone-opponent color space (4 cardinal and 4 intermediate hues). Interestingly, we found that in V1, the relative size of S-cone hue preference domain was significantly smaller than that for other hues. This notable difference was less prominent in V2, and, in V4 was virtually absent, resulting in a more balanced representation of hues. In V2, hue clusters contained sequences of shifting preference, while in V4 the organization of hue clusters was more complex. Pattern classification analysis of these hue maps showed that accuracy of hue classification improved from V1 to V2 to V4. These results suggest that hue representation by domains in the early cortical hierarchy reflects a transformation away from cone-opponency and toward a full-coverage representation of hue.

The retrocalcarine sulcus maps different retinotopic representations in macaques and humans

Primate cerebral cortex is highly convoluted with much of the cortical surface buried in sulcal folds. The origins of cortical folding and its functional relevance have been a major focus of systems and cognitive neuroscience, especially when considering stereotyped patterns of cortical folding that are shared across individuals within a primate species and across multiple species. However, foundational questions regarding organizing principles shared across species remain unanswered. Taking a cross-species comparative approach with a careful consideration of historical observations, we investigate cortical folding relative to primary visual cortex (area V1). We identify two macroanatomical structures-the retrocalcarine and external calcarine sulci-in 24 humans and 6 macaque monkeys. We show that within species, these sulci are identifiable in all individuals, fall on a similar part of the V1 retinotopic map, and thus, serve as anatomical landmarks predictive of functional organization. Yet, across species, the underlying eccentricity representations corresponding to these macroanatomical structures differ strikingly across humans and macaques. Thus, the correspondence between retinotopic representation and cortical folding for an evolutionarily old structure like V1 is species-specific and suggests potential differences in developmental and experiential constraints across primates.

Receptor architecture of macaque and human early visual areas: not equal, but comparable

Existing cytoarchitectonic maps of the human and macaque posterior occipital cortex differ in the number of areas they display, thus hampering identification of homolog structures. We applied quantitative in vitro receptor autoradiography to characterize the receptor architecture of the primary visual and early extrastriate cortex in macaque and human brains, using previously published cytoarchitectonic criteria as starting point of our analysis. We identified 8 receptor architectonically distinct areas in the macaque brain (mV1d, mV1v, mV2d, mV2v, mV3d, mV3v, mV3A, mV4v), and their respective counterpart areas in the human brain (hV1d, hV1v, hV2d, hV2v, hV3d, hV3v, hV3A, hV4v). Mean densities of 14 neurotransmitter receptors were quantified in each area, and ensuing receptor fingerprints used for multivariate analyses. The 1st principal component segregated macaque and human early visual areas differ. However, the 2nd principal component showed that within each species, area-specific differences in receptor fingerprints were associated with the hierarchical processing level of each area. Subdivisions of V2 and V3 were found to cluster together in both species and were segregated from subdivisions of V1 and from V4v. Thus, comparative studies like this provide valuable architectonic insights into how differences in underlying microstructure impact evolutionary changes in functional processing of the primate brain and, at the same time, provide strong arguments for use of macaque monkey brain as a suitable animal model for translational studies.

Myelin densities in retinotopically defined dorsal visual areas of the macaque

The visuotopic organization of dorsal visual cortex rostral to area V2 in primates has been a longstanding source of controversy. Using sub-millimeter phase-encoded retinotopic fMRI mapping, we recently provided evidence for a surprisingly similar visuotopic organization in dorsal visual cortex of macaques compared to previously published maps in New world monkeys (Zhu and Vanduffel, Proc Natl Acad Sci USA 116:2306–2311, 2019). Although individual quadrant representations could be robustly delineated in that study, their grouping into hemifield representations remains a major challenge. Here, we combined in-vivo high-resolution myelin density mapping based on MR imaging (400 µm isotropic resolution) with fine-grained retinotopic fMRI to quantitatively compare myelin densities across retinotopically defined visual areas in macaques. Complementing previously documented differences in populational receptive-field (pRF) size and visual field signs, myelin densities of both quadrants of the dorsolateral posterior area (DLP) and area V3A are significantly different compared to dorsal and ventral area V3. Moreover, no differences in myelin density were observed between the two matching quadrants belonging to areas DLP, V3A, V1, V2 and V4, respectively. This was not the case, however, for the dorsal and ventral quadrants of area V3, which showed significant differences in MR-defined myelin densities, corroborating evidence of previous myelin staining studies. Interestingly, the pRF sizes and visual field signs of both quadrant representations in V3 are not different. Although myelin density correlates with curvature and anticorrelates with cortical thickness when measured across the entire cortex, exactly as in humans, the myelin density results in the visual areas cannot be explained by variability in cortical thickness and curvature between these areas. The present myelin density results largely support our previous model to group the two quadrants of DLP and V3A, rather than grouping DLP- with V3v into a single area VLP, or V3d with V3A+ into DM.

Common functional localizers to enhance NHP & cross-species neuroscience imaging research

Functional localizers are invaluable as they can help define regions of interest, provide cross-study comparisons, and most importantly, allow for the aggregation and meta-analyses of data across studies and laboratories. To achieve these goals within the non-human primate (NHP) imaging community, there is a pressing need for the use of standardized and validated localizers that can be readily implemented across different groups. The goal of this paper is to provide an overview of the value of localizer protocols to imaging research and we describe a number of commonly used or novel localizers within NHPs, and keys to implement them across studies. As has been shown with the aggregation of resting-state imaging data in the original PRIME-DE submissions, we believe that the field is ready to apply the same initiative for task-based functional localizers in NHP imaging. By coming together to collect large datasets across research group, implementing the same functional localizers, and sharing the localizers and data via PRIME-DE, it is now possible to fully test their robustness, selectivity and specificity. To do this, we reviewed a number of common localizers and we created a repository of well-established localizer that are easily accessible and implemented through the PRIME-RE platform.

Visual perceptual learning of a primitive feature in human V1/V2 as a result of unconscious processing, revealed by decoded functional MRI neurofeedback (DecNef)

Although numerous studies have shown that visual perceptual learning (VPL) occurs as a result of exposure to a visual feature in a task-irrelevant manner, the underlying neural mechanism is poorly understood. In a previous psychophysical study (Watanabe et al., 2002), subjects were repeatedly exposed to a task-irrelevant Sekuler motion display that induced the perception of not only the local motions, but also a global motionmoving in the direction of the spatiotemporal average of the local motion vectors. As a result of this exposure, subjects enhanced their sensitivity only to the local moving directions, suggesting that early visual areas (V1/V2) that process local motions are involved in task-irrelevant VPL. However, this hypothesis has never been tested directly using neuronal recordings. Here, we employed a decoded neurofeedback technique (DecNef) using functional magnetic resonance imaging in human subjects to examine the involvement of early visual areas (V1/V2) in task-irrelevant VPL of local motion within a Sekuler motion display. During the DecNef training, subjects were trained to induce the activity patterns in V1/V2 that were similar to those evoked by the actual presentation of the Sekuler motion display. The DecNef training was conducted with neither the actual presentation of the display nor the subjects’ awareness of the purpose of the experiment. After the experiment, subjects reported that they neither perceived nor imagined the trained motion during the DecNef training. As a result of DecNef training, subjects increased their sensitivity to the local motion directions, but not specifically to the global motion direction. Neuronal changes related to DecNef training were confined to V1/V2. These results suggest that V1/V2 are involved in exposure-based task-irrelevant VPL of local motion.

Retinotopic organization of visual cortex in human infants

Vision develops rapidly during infancy, yet how visual cortex is organized during this period is unclear. In particular, it is unknown whether functional maps that organize the mature adult visual cortex are present in the infant striate and extrastriate cortex. Here, we test the functional maturity of infant visual cortex by performing retinotopic mapping with functional magnetic resonance imaging (fMRI). Infants aged 5-23 months had retinotopic maps, with alternating preferences for vertical and horizontal meridians indicating the boundaries of visual areas V1 to V4 and an orthogonal gradient of preferences from high to low spatial frequencies. The presence of multiple visual maps throughout visual cortex in infants indicates a greater maturity of extrastriate cortex than previously appreciated. The areas showed subtle age-related fine-tuning, suggesting that early maturation undergoes continued refinement. This early maturation of area boundaries and tuning may scaffold subsequent developmental changes.

Sensory processing and categorization in cortical and deep neural networks

Many recent advances in artificial intelligence (AI) are rooted in visual neuroscience. However, ideas from more complicated paradigms like decision-making are less used. Although automated decision-making systems are ubiquitous (driverless cars, pilot support systems, medical diagnosis algorithms etc.), achieving human-level performance in decision making tasks is still a challenge. At the same time, these tasks that are hard for AI are easy for humans. Thus, understanding human brain dynamics during these decision-making tasks and modeling them using deep neural networks could improve AI performance. Here we modelled some of the complex neural interactions during a sensorimotor decision making task. We investigated how brain dynamics flexibly represented and distinguished between sensory processing and categorization in two sensory domains: motion direction and color. We used two different approaches for understanding neural representations. We compared brain responses to 1) the geometry of a sensory or category domain (domain selectivity) and 2) predictions from deep neural networks (computation selectivity). Both approaches gave us similar results. This confirmed the validity of our analyses. Using the first approach, we found that neural representations changed depending on context. We then trained deep recurrent neural networks to perform the same tasks as the animals. Using the second approach, we found that computations in different brain areas also changed flexibly depending on context. Color computations appeared to rely more on sensory processing, while motion computations more on abstract categories. Overall, our results shed light to the biological basis of categorization and differences in selectivity and computations in different brain areas. They also suggest a way for studying sensory and categorical representations in the brain: compare brain responses to both a behavioral model and a deep neural network and test if they give similar results.

Homology and Specificity of Natural Sound-Encoding in Human and Monkey Auditory Cortex

Understanding homologies and differences in auditory cortical processing in human and nonhuman primates is an essential step in elucidating the neurobiology of speech and language. Using fMRI responses to natural sounds, we investigated the representation of multiple acoustic features in auditory cortex of awake macaques and humans. Comparative analyses revealed homologous large-scale topographies not only for frequency but also for temporal and spectral modulations. In both species, posterior regions preferably encoded relatively fast temporal and coarse spectral information, whereas anterior regions encoded slow temporal and fine spectral modulations. Conversely, we observed a striking interspecies difference in cortical sensitivity to temporal modulations: While decoding from macaque auditory cortex was most accurate at fast rates (> 30 Hz), humans had highest sensitivity to ~3 Hz, a relevant rate for speech analysis. These findings suggest that characteristic tuning of human auditory cortex to slow temporal modulations is unique and may have emerged as a critical step in the evolution of speech and language.

Area TEO and "Area ?": cytoarchitectonic confusion corrected by connectivity and cortical ablation

Throughout history, researchers who examine the structure and function of the brain debate one another about how cortical areas are defined, as well as how these areas should be named. Different pieces of empirical evidence are used to define brain areas and it is important to preserve the accurate history of this evidence and the timeline of studies that lead to areal definitions that are either still used today or have been modified. As such, this paper traces the early history of a brain area located at the junction between the occipital and temporal lobes of the macaque known as TEO. This historical analysis leads to four main findings. First, even though Bonin and Bailey are credited with the definition of area TEO in 1947, they did not have the cytoarchitectonic evidence to support the distinction of TEO from adjacent areas. Second, the first evidence definitively separating area TEO from TE was actually based on connectivity as identified with strychnine neuronography by Petr et al. in 1949. Third, causal evidence from ablation studies conducted by Iwai and Mishkin (Experimental Neurology 25(4):585-594, 1969) supported this distinction by showing that TEO and TE were functionally distinct from one another. Fourth, researchers in the 1970s began referring to TEO as posterior inferotemporal (PIT) and TE as anterior inferotemporal (AIT), which is an important historical clarification as the PIT/AIT nomenclature is presently attributed to studies conducted more than a decade later. Altogether, this paper aims to preserve the historical origin of area TEO, as well as the empirical evidence that was used to originally differentiate this cortical expanse from surrounding areas.

Reward activations and face fields in monkey cingulate motor areas

Several premotor areas have been identified within primate cingulate cortex; however their function is yet to be uncovered. Recent brain imaging work in humans revealed a topographic anatomofunctional overlap between feedback processing during exploratory behaviors and the corresponding body fields in the rostral cingulate motor area (RCZa), suggesting an embodied representation of feedback. In particular, a face field in RCZa processes juice feedback. Here we tested an extension of the embodied principle in which unexpected or relevant information obtained through the eye or the face would be processed by face fields in cingulate motor areas, and whether this applied to monkey cingulate cortex. We show that activations for juice reward, eye movement, eye blink, and tactile stimulation on the face overlap over two subfields within the cingulate sulcus likely corresponding to the rostral and caudal cingulate motor areas. This suggests that in monkeys as is the case in humans, behaviorally relevant information is processed through multiple cingulate body/effector maps.

NEW & NOTEWORTHY What is the role of cingulate motor areas? In this study we observed in monkeys that, as in humans, neural responses to face-related events, juice reward, eye movement, eye blink, and tactile stimulations, clustered redundantly in two separate cingulate subfields. This suggests that behaviorally relevant information is processed by multiple cingulate effector maps. Importantly, this overlap supports the principle that the cingulate cortex processes feedback based on where it is experienced on the body.

Connectome-scale functional intrinsic connectivity networks in macaques

There have been extensive studies of intrinsic connectivity networks (ICNs) in the human brains using resting-state functional magnetic resonance imaging (fMRI) in the literature. However, the functional organization of ICNs in macaque brains has been less explored so far, despite growing interests in the field. In this work, we propose a computational framework to identify connectome-scale group-wise consistent ICNs in macaques via sparse representation of whole-brain resting-state fMRI data. Experimental results demonstrate that 70 group-wise consistent ICNs are successfully identified in macaque brains via the proposed framework. These 70 ICNs are interpreted based on two publicly available parcellation maps of macaque brains and our work significantly expand currently known macaque ICNs already reported in the literature. In general, this set of connectome-scale group-wise consistent ICNs can potentially benefit a variety of studies in the neuroscience and brain-mapping fields, and they provide a foundation to better understand brain evolution in the future.

Postnatal Development of Intrinsic Horizontal Axons in Macaque Inferior Temporal and Primary Visual Cortices

Two distinct areas along the ventral visual stream of monkeys, the primary visual (V1) and inferior temporal (TE) cortices, exhibit different projection patterns of intrinsic horizontal axons with patchy terminal fields in adult animals. The differences between the patches in these 2 areas may reflect differences in cortical representation and processing of visual information. We studied the postnatal development of patches by injecting an anterograde tracer into TE and V1 in monkeys of various ages. At 1 week of age, labeled patches with distribution patterns reminiscent of those in adults were already present in both areas. The labeling intensity of patches decayed exponentially with projection distance in monkeys of all ages in both areas, but this trend was far less evident in TE. The number and extent of patches gradually decreased with age in V1, but not in TE. In V1, axonal and bouton densities increased postnatally only in patches with short projection distances, whereas in TE this density change occurred in patches with various projection distances. Thus, patches with area-specific distribution patterns are formed early in life, and area-specific postnatal developmental processes shape the connectivity of patches into adulthood.

A brief comparative review of primate posterior parietal cortex: A novel hypothesis on the human toolmaker

The primate visual system contains two major cortical pathways: a ventral-temporal pathway that has been associated with object processing and recognition, and a dorsal-parietal pathway that has been associated with spatial processing and action guidance. Our understanding of the role of the dorsal pathway, in particular, has greatly evolved within the framework of the two-pathway hypothesis since its original conception. Here, we present a comparative review of the primate dorsal pathway in humans and monkeys based on electrophysiological, neuroimaging, neuropsychological, and neuroanatomical studies. We consider similarities and differences across species in terms of the topographic representation of visual space; specificity for eye, reaching, or grasping movements; multi-modal response properties; and the representation of objects and tools. We also review the relative anatomical location of functionally- and topographically-defined regions of the posterior parietal cortex. An emerging theme from this comparative analysis is that non-spatial information is represented to a greater degree, and with increased complexity, in the human dorsal visual system. We propose that non-spatial information in the primate parietal cortex contributes to the perception-to-action system aimed at manipulating objects in peripersonal space. In humans, this network has expanded in multiple ways, including the development of a dorsal object vision system mirroring the complexity of the ventral stream, the integration of object information with parietal working memory systems, and the emergence of tool-specific object representations in the anterior intraparietal sulcus and regions of the inferior parietal lobe. We propose that these evolutionary changes have enabled the emergence of human-specific behaviors, such as the sophisticated use of tools.

Controversies about the visual areas located at the anterior border of area V2 in primates

Anatomical and electrophysiological studies have provided us with detailed information regarding the extent and topography of the primary (V1) and secondary (V2) visual areas in primates. The consensus about the V1 and V2 maps, however, is in sharp contrast with controversies regarding the organization of the cortical areas lying immediately rostral to V2. In this review, we address the contentious issue of the extent of the third visual area (V3). Specifically, we will argue for the existence of both ventral (V3v) and dorsal (V3d) segments of V3, which are located, respectively, adjacent to the anterior border of ventral and dorsal V2. V3v and V3d would together constitute a single functional area with a complete representation of both upper and lower visual hemifields. Another contentious issue is the organization of the parietal-occipital (PO) area, which also borders the rostral edge of the medial portion of dorsal V2. Different from V1, V2, and V3, which exhibit a topography based on the defined lines of isoeccentricity and isopolar representation, area PO only has a systematic representation of polar angles, with an emphasis on the peripheral visual field (isoeccentricity lines are not well defined). Based on the connectivity patterns of area PO with distinct cytochrome oxidase modules in V2, we propose a subdivision of the dorsal stream of visual information processing into lateral and medial domains. In this model, area PO constitutes the first processing instance of the dorsal-medial stream, coding for the full-field flow of visual cues during navigation. Finally, we compare our findings with those in other species of Old and New World monkeys and argue that larger animals, such as macaque and capuchin monkeys, have similar organizations of the areas rostral to V2, which is different from that in smaller New World monkeys.

Neuroimaging Evidence for 2 Types of Plasticity in Association with Visual Perceptual Learning

Visual perceptual learning (VPL) is long-term performance improvement as a result of perceptual experience. It is unclear whether VPL is associated with refinement in representations of the trained feature (feature-based plasticity), improvement in processing of the trained task (task-based plasticity), or both. Here, we provide empirical evidence that VPL of motion detection is associated with both types of plasticity which occur predominantly in different brain areas. Before and after training on a motion detection task, subjects' neural responses to the trained motion stimuli were measured using functional magnetic resonance imaging. In V3A, significant response changes after training were observed specifically to the trained motion stimulus but independently of whether subjects performed the trained task. This suggests that the response changes in V3A represent feature-based plasticity in VPL of motion detection. In V1 and the intraparietal sulcus, significant response changes were found only when subjects performed the trained task on the trained motion stimulus. This suggests that the response changes in these areas reflect task-based plasticity. These results collectively suggest that VPL of motion detection is associated with the 2 types of plasticity, which occur in different areas and therefore have separate mechanisms at least to some degree.

Frequency-dependent spatiotemporal profiles of visual responses recorded with subdural ECoG electrodes in awake monkeys: Differences between high- and low-frequency activity

Electrocorticography (ECoG) constitutes a powerful and promising neural recording modality in humans and animals. ECoG signals are often decomposed into several frequency bands, among which the so-called high-gamma band (80-250Hz) has been proposed to reflect local cortical functions near the cortical surface below the ECoG electrodes. It is typically assumed that the lower the frequency bands, the lower the spatial resolution of the signals; thus, there is not much to gain by analyzing the event-related changes of the ECoG signals in the lower-frequency bands. However, differences across frequency bands have not been systematically investigated. To address this issue, we recorded ECoG activity from two awake monkeys performing a retinotopic mapping task. We characterized the spatiotemporal profiles of the visual responses in the time-frequency domain. We defined the preferred spatial position, receptive field (RF), and response latencies of band-limited power (BLP) (i.e., alpha [3.9-11.7Hz], beta [15.6-23.4Hz], low [30-80Hz] and high [80-250Hz] gamma) for each electrode and compared them across bands and time-domain visual evoked potentials (VEPs). At the population level, we found that the spatial preferences were comparable across bands and VEPs. The high-gamma power showed a smaller RF than the other bands and VEPs. The response latencies for the alpha band were always longer than the latencies for the other bands and fastest in VEPs. Comparing the response profiles in both space and time for each cortical region (V1, V4+, and TEO/TE) revealed regional idiosyncrasies. Although the latencies of visual responses in the beta, low-, and high-gamma bands were almost identical in V1 and V4+, beta and low-gamma BLP occurred about 17ms earlier than high-gamma power in TEO/TE. Furthermore, TEO/TE exhibited a unique pattern in the spatial response profile: the alpha and high-gamma responses tended to prefer the foveal regions, whereas the beta and low-gamma responses preferred the peripheral visual fields with larger RFs. This suggests that neurons in TEO/TE first receive less selective spatial information via beta and low-gamma BLP but later receive more fine-tuned spatial foveal information via high-gamma power. This result is consistent with a hypothesis previously proposed by Nakamura et al. (1993) that states that visual processing in TEO/TE starts with coarse-grained information, which primes subsequent fine-grained information. Collectively, our results demonstrate that ECoG can be a potent tool for investigating the nature of the neural computations in each cortical region that cannot be fully understood by measuring only the spiking activity, through the incorporation of the knowledge of the spatiotemporal characteristics across all frequency bands.

Cortical Connections of the Caudal Portion of Posterior Parietal Cortex in Prosimian Galagos

Posterior parietal cortex (PPC) of prosimian galagos includes a rostral portion (PPCr) where electrical stimulation evokes different classes of complex movements from different subregions, and a caudal portion (PPCc) where such stimulation fails to evoke movements in anesthetized preparations ( Stepniewska, Fang et al. 2009). We placed tracer injections into PPCc to reveal patterns of its cortical connections. There were widespread connections within PPCc as well as connections with PPCr and extrastriate visual areas, including V2 and V3. Weaker connections were with dorsal premotor cortex, and the frontal eye field. The connections of different parts of PPCc with visual areas were roughly retinotopic such that injections to dorsal PPCc labeled more neurons in the dorsal portions of visual areas, representing lower visual quadrant, and injections to ventral PPCc labeled more neurons in ventral portions of these visual areas, representing the upper visual quadrant. We conclude that much of the PPCc contains a crude representation of the contralateral visual hemifield, with inputs largely, but not exclusively, from higher-order visual areas that are considered part of the dorsal visuomotor processing stream. As in galagos, the caudal half of PPC was likely visual in early primates, with the rostral PPC half mediating sensorimotor functions.

Topographic organization of areas V3 and V4 and its relation to supra-areal organization of the primate visual system

Areas V3 and V4 are commonly thought of as individual entities in the primate visual system, based on definition criteria such as their representation of visual space, connectivity, functional response properties, and relative anatomical location in cortex. Yet, large-scale functional and anatomical organization patterns not only emphasize distinctions within each area, but also links across visual cortex. Specifically, the visuotopic organization of V3 and V4 appears to be part of a larger, supra-areal organization, clustering these areas with early visual areas V1 and V2. In addition, connectivity patterns across visual cortex appear to vary within these areas as a function of their supra-areal eccentricity organization. This complicates the traditional view of these regions as individual functional "areas." Here, we will review the criteria for defining areas V3 and V4 and will discuss functional and anatomical studies in humans and monkeys that emphasize the integration of individual visual areas into broad, supra-areal clusters that work in concert for a common computational goal. Specifically, we propose that the visuotopic organization of V3 and V4, which provides the criteria for differentiating these areas, also unifies these areas into the supra-areal organization of early visual cortex. We propose that V3 and V4 play a critical role in this supra-areal organization by filtering information about the visual environment along parallel pathways across higher-order cortex.

Monkey cortex through fMRI glasses

In 1998 several groups reported the feasibility of fMRI experiments in monkeys, with the goal to bridge the gap between invasive nonhuman primate studies and human functional imaging. These studies yielded critical insights in the neuronal underpinnings of the BOLD signal. Furthermore, the technology has been successful in guiding electrophysiological recordings and identifying focal perturbation targets. Finally, invaluable information was obtained concerning human brain evolution. We here provide a comprehensive overview of awake monkey fMRI studies mainly confined to the visual system. We review the latest insights about the topographic organization of monkey visual cortex and discuss the spatial relationships between retinotopy and category- and feature-selective clusters. We briefly discuss the functional layout of parietal and frontal cortex and continue with a summary of some fascinating functional and effective connectivity studies. Finally, we review recent comparative fMRI experiments and speculate about the future of nonhuman primate imaging.

Aging alters visual processing of objects and shapes in inferotemporal cortex in monkeys

Visual perception declines with age. Perceptual deficits may originate not only in the optical system serving vision but also in the neural machinery processing visual information. Since homologies between monkey and human vision permit extrapolation from monkeys to humans, data from young, middle aged and old monkeys were analyzed to show age-related changes in the neuronal activity in the inferotemporal cortex, which is critical for object and shape vision. We found an increased neuronal response latency, and a decrease in the stimulus selectivity in the older animals and suggest that these changes may underlie the perceptual uncertainties found frequently in the elderly.

White matter in the older brain is more plastic than in the younger brain

Visual perceptual learning (VPL) with younger subjects is associated with changes in functional activation of the early visual cortex. Although overall brain properties decline with age, it is unclear whether these declines are associated with visual perceptual learning. Here we use diffusion tensor imaging to test whether changes in white matter are involved in VPL for older adults. After training on a texture discrimination task for three daily sessions, both older and younger subjects show performance improvements. While the older subjects show significant changes in fractional anisotropy (FA) in the white matter beneath the early visual cortex after training, no significant change in FA is observed for younger subjects. These results suggest that the mechanism for VPL in older individuals is considerably different from that in younger individuals and that VPL of older individuals involves reorganization of white matter.

Reduction in the retinotopic early visual cortex with normal aging and magnitude of perceptual learning

Although normal aging is known to reduce cortical structures globally, the effects of aging on local structures and functions of early visual cortex are less understood. Here, using standard retinotopic mapping and magnetic resonance imaging morphologic analyses, we investigated whether aging affects areal size of the early visual cortex, which were retinotopically localized, and whether those morphologic measures were associated with individual performance on visual perceptual learning. First, significant age-associated reduction was found in the areal size of V1, V2, and V3. Second, individual ability of visual perceptual learning was significantly correlated with areal size of V3 in older adults. These results demonstrate that aging changes local structures of the early visual cortex, and the degree of change may be associated with individual visual plasticity.

Curvature-processing network in macaque visual cortex

Our visual environment abounds with curved features. Thus, the goal of understanding visual processing should include the processing of curved features. Using functional magnetic resonance imaging in behaving monkeys, we demonstrated a network of cortical areas selective for the processing of curved features. This network includes three distinct hierarchically organized regions within the ventral visual pathway: a posterior curvature-biased patch (PCP) located in the near-foveal representation of dorsal V4, a middle curvature-biased patch (MCP) located on the ventral lip of the posterior superior temporal sulcus (STS) in area TEO, and an anterior curvature-biased patch (ACP) located just below the STS in anterior area TE. Our results further indicate that the processing of curvature becomes increasingly complex from PCP to ACP. The proximity of the curvature-processing network to the well-known face-processing network suggests a possible functional link between them.

The transition in the ventral stream from feature to real-world entity representations

We propose that the ventral visual pathway of human and non-human primates is organized into three levels: (1) ventral retinotopic cortex including what is known as TEO in the monkey but corresponds to V4A and PITd/v, and the phPIT cluster in humans, (2) area TE in the monkey and its homolog LOC and neighboring fusiform regions, and more speculatively, (3) TGv in the monkey and its possible human equivalent, the temporal pole. We attribute to these levels the visual representations of features, partial real-world entities (RWEs), and known, complete RWEs, respectively. Furthermore, we propose that the middle level, TE and its homolog, is organized into three parallel substreams, lower bank STS, dorsal convexity of TE, and ventral convexity of TE, as are their corresponding human regions. These presumably process shape in depth, 2D shape and material properties, respectively, to construct RWE representations.

Topographic organization in the brain: searching for general principles

The neurons comprising many cortical areas have long been known to be arranged topographically such that nearby neurons have receptive fields at nearby locations in the world. Although this type of organization may be universal in primary sensory and motor cortex, in this review we demonstrate that associative cortical areas may not represent the external world in a complete and continuous fashion. After reviewing evidence for novel principles of topographic organization in macaque lateral intraparietal area (LIP) - one of the most-studied associative areas in the parietal cortex - we explore the implications of these new principles for brain function.

Correspondences between retinotopic areas and myelin maps in human visual cortex

We generated probabilistic area maps and maximum probability maps (MPMs) for a set of 18 retinotopic areas previously mapped in individual subjects (Georgieva et al., 2009 and Kolster et al., 2010) using four different inter-subject registration methods. The best results were obtained using a recently developed multimodal surface matching method. The best set of MPMs had relatively smooth borders between visual areas and group average area sizes that matched the typical size in individual subjects. Comparisons between retinotopic areas and maps of estimated cortical myelin content revealed the following correspondences: (i) areas V1, V2, and V3 are heavily myelinated; (ii) the MT cluster is heavily myelinated, with a peak near the MT/pMSTv border; (iii) a dorsal myelin density peak corresponds to area V3D; (iv) the phPIT cluster is lightly myelinated; and (v) myelin density differs across the four areas of the V3A complex. Comparison of the retinotopic MPM with cytoarchitectonic areas, including those previously mapped to the fs_LR cortical surface atlas, revealed a correspondence between areas V1–3 and hOc1–3, respectively, but little correspondence beyond V3. These results indicate that architectonic and retinotopic areal boundaries are in agreement in some regions, and that retinotopy provides a finer-grained parcellation in other regions. The atlas datasets from this analysis are freely available as a resource for other studies that will benefit from retinotopic and myelin density map landmarks in human visual cortex.

•

Maximum probability maps for 18 retinotopic areas were generated.

•

Multimodal surface matching was used to compare with myelin and cytoarchitectonic maps.

•

Early areas V1–3 areas are heavily myelinated, as are V3D and most of areas MT/pMSTv.

•

The phPIT cluster is lightly myelinated compared to other retinotopic areas.

•

Early areas V1–3 correspond to areas hOc1–3, with little correspondence beyond V3.

Retinotopy versus face selectivity in macaque visual cortex

Retinotopic organization is a ubiquitous property of lower-tier visual cortical areas in human and nonhuman primates. In macaque visual cortex, the retinotopic maps extend to higher-order areas in the ventral visual pathway, including area TEO in the inferior temporal (IT) cortex. Distinct regions within IT cortex are also selective to specific object categories such as faces. Here we tested the topographic relationship between retinotopic maps and face-selective patches in macaque visual cortex using high-resolution fMRI and retinotopic face stimuli. Distinct subregions within face-selective patches showed either (1) a coarse retinotopic map of eccentricity and polar angle, (2) a retinotopic bias to a specific location of visual field, or (3) nonretinotopic selectivity. In general, regions along the lateral convexity of IT cortex showed more overlap between retinotopic maps and face selectivity, compared with regions within the STS. Thus, face patches in macaques can be subdivided into smaller patches with distinguishable retinotopic properties.

The first-night effect suppresses the strength of slow-wave activity originating in the visual areas during sleep

Our visual system is plastic and adaptive in response to the stimuli and environments we experience. Although visual adaptation and plasticity have been extensively studied while participants are awake, little is known about what happens while they are asleep. It has been documented that sleep structure as measured by sleep stages using polysomnography is altered specifically in the first sleep session due to exposure to a new sleep environment, known as the first-night effect (FNE). However, the impact of the FNE on spontaneous oscillations in the visual system is poorly understood. How does the FNE affect the visual system during sleep? To address this question, the present study examined whether the FNE modifies the strength of slow-wave activity (SWA, 1-4Hz)-the dominant spontaneous brain oscillation in slow-wave sleep-in the visual areas. We measured the strength of SWA originating in the visual areas during the first and the second sleep sessions. Magnetoencephalography, polysomnography, and magnetic resonance imaging were used to localize the source of SWA to the visual areas. The visual areas were objectively defined using retinotopic mapping and an automated anatomical parcellation technique. The results showed that the strength of SWA was reduced in the first sleep session in comparison to the second sleep session, especially during slow-wave sleep, in the ventral part of the visual areas. These results suggest that environmental novelty may affect the visual system through suppression of SWA. The impact of the FNE may not be negligible in vision research.

fMRI Cortical Correlates of Spontaneous Eye Blinks in the Nonhuman Primate

Eyeblinks are defined as a rapid closing and opening of the eyelid. Three types of blinks are defined: spontaneous, reflexive, and voluntary. Here, we focus on the cortical correlates of spontaneous blinks, using functional magnetic resonance imaging (fMRI) in the nonhuman primate. Our observations reveal an ensemble of cortical regions processing the somatosensory, proprioceptive, peripheral visual, and possibly nociceptive consequences of blinks. These observations indicate that spontaneous blinks have consequences on the brain beyond the visual cortex, possibly contaminating fMRI protocols that generate in the participants heterogeneous blink behaviors. This is especially the case when these protocols induce (nonunusual) eye fatigue and corneal dryness due to demanding fixation requirements, as is the case here. Importantly, no blink related activations were observed in the prefrontal and parietal blinks motor command areas nor in the prefrontal, parietal, and medial temporal blink suppression areas. This indicates that the absence of activation in these areas is not a signature of the absence of blink contamination in the data. While these observations increase our understanding of the neural bases of spontaneous blinks, they also strongly call for new criteria to identify whether fMRI recordings are contaminated by a heterogeneous blink behavior or not.

Location specific sleep spindle activity in the early visual areas and perceptual learning

Visual perceptual learning (VPL) is consolidated during sleep. However, the underlying neuronal mechanisms of consolidation are not yet fully understood. It has been suggested that the spontaneous brain oscillations that characterize sleep stages are indicative of the consolidation of learning and memory. We investigated whether sleep spindles and/or slow-waves are associated with consolidation of VPL during non-rapid eye movement (NREM) sleep during the first sleep cycle, using magnetoencephalography (MEG), magnetic resonance imaging (MRI), and polysomnography (PSG). We hypothesized that after training, early visual areas will show an increase in slow sigma, fast sigma and/or delta activity, corresponding to slow/fast sleep spindles and slow-waves, respectively. We found that during sleep stage 2, but not during slow-wave sleep, the slow sigma power within the trained region of early visual areas was larger after training compared to baseline, and that the increase was larger in the trained region than in the untrained region. However, neither fast sigma nor delta band power increased significantly after training in either sleep stage. Importantly, performance gains for the trained task were correlated with the difference of power increases in slow sigma activity between the trained and untrained regions. This finding suggests that slow sigma activity plays a critical role in the consolidation of VPL, at least in sleep stage 2 during the first sleep cycle.

Parallel, multi-stage processing of colors, faces and shapes in macaque inferior temporal cortex

Visual-object processing culminates in inferior temporal cortex (IT). To assess the organization of IT, we measured functional magnetic resonance imaging responses in alert monkeys to achromatic images (faces, fruit, bodies and places) and colored gratings. IT contained multiple color-biased regions, which were typically ventral to face patches and yoked to them, spaced regularly at four locations predicted by known anatomy. Color and face selectivity increased for more anterior regions, indicative of a broad hierarchical arrangement. Responses to non-face shapes were found across IT, but were stronger outside color-biased regions and face patches, consistent with multiple parallel streams. IT also contained multiple coarse eccentricity maps: face patches overlapped central representations, color-biased regions spanned mid-peripheral representations and place-biased regions overlapped peripheral representations. These results show that IT comprises parallel, multi-stage processing networks subject to one organizing principle.

Binocular stereoscopy in visual areas V-2, V-3, and V-3A of the macaque monkey

Over 40 years ago, Hubel and Wiesel gave a preliminary report of the first account of cells in monkey cerebral cortex selective for binocular disparity. The cells were located outside of V-1 within a region referred to then as "area 18." A full-length manuscript never followed, because the demarcation of the visual areas within this region had not been fully worked out. Here, we provide a full description of the physiological experiments and identify the locations of the recorded neurons using a contemporary atlas generated by functional magnetic resonance imaging; we also perform an independent analysis of the location of the neurons relative to an anatomical landmark (the base of the lunate sulcus) that is often coincident with the border between V-2 and V-3. Disparity-tuned cells resided not only in V-2, the area now synonymous with area 18, but also in V-3 and probably within V-3A. The recordings showed that the disparity-tuned cells were biased for near disparities, tended to prefer vertical orientations, clustered by disparity preference, and often required stimulation of both eyes to elicit responses, features strongly suggesting a role in stereoscopic depth perception.

Dopaminergic reward signals selectively decrease fMRI activity in primate visual cortex

Stimulus-reward coupling without attention can induce highly specific perceptual learning effects, suggesting that reward triggers selective plasticity within visual cortex. Additionally, dopamine-releasing events-temporally surrounding stimulus-reward associations-selectively enhance memory. These forms of plasticity may be evoked by selective modulation of stimulus representations during dopamine-inducing events. However, it remains to be shown whether dopaminergic signals can selectively modulate visual cortical activity. We measured fMRI activity in monkey visual cortex during reward-only trials apart from intermixed cue-reward trials. Reward without visual stimulation selectively decreased fMRI activity within the cue representations that had been paired with reward during other trials. Behavioral tests indicated that these same uncued reward trials strengthened cue-reward associations. Furthermore, such spatially-specific activity modulations depended on prediction error, as shown by manipulations of reward magnitude, cue-reward probability, cue-reward familiarity, and dopamine signaling. This cue-selective negative reward signal offers a mechanism for selectively gating sensory cortical plasticity.

The ventral visual pathway: an expanded neural framework for the processing of object quality

Since the original characterization of the ventral visual pathway, our knowledge of its neuroanatomy, functional properties, and extrinsic targets has grown considerably. Here we synthesize this recent evidence and propose that the ventral pathway is best understood as a recurrent occipitotemporal network containing neural representations of object quality both utilized and constrained by at least six distinct cortical and subcortical systems. Each system serves its own specialized behavioral, cognitive, or affective function, collectively providing the raison d'être for the ventral visual pathway. This expanded framework contrasts with the depiction of the ventral visual pathway as a largely serial staged hierarchy culminating in singular object representations and more parsimoniously incorporates attentional, contextual, and feedback effects.

FEF-microstimulation causes task-dependent modulation of occipital fMRI activity

Electrical microstimulation of FEF (FEF-EM) modulates neuronal activity in area V4 (Moore and Armstrong, 2003) and elicits functional magnetic resonance imaging (fMRI) activations in visual cortex in a bottom-up dependent manner (Ekstrom et al., 2008). Here we test the hypothesis that FEF-EM-induced modulations of fMRI activity are also function of task demands, which would suggest top-down dependent gating of FEF signals in early visual cortex. We scanned two monkeys performing a visually guided saccade task; a passive fixation task with a very similar visual display; and a passive fixation task without peripheral dots. We found increased effects of FEF-EM on fMRI-activity in visual cortex during saccades compared to fixation, indicating that the FEF-EM induced modulation is task-dependent. Finally, the effect of FEF-EM is mainly present in voxels which were less activated by visual stimuli in the absence of electrical stimulation. Our results show that the FEF-EM-induced pattern of activation in early visual cortex is topographically specific and more pronounced during increased task demands. These results fit with models suggesting that FEF is an important source modulating activity in early sensory cortex and that these influences can be enhanced by coincident bottom-up or top-down signals.

Selective responses to specular surfaces in the macaque visual cortex revealed by fMRI

The surface properties of objects, such as gloss, transparency and texture, provide important information about the material characteristics of objects in our visual environment. However, because there have been few reports on the neuronal responses to surface properties in primates, we still lack information about where and how surface properties are processed in the primate visual cortex. In this study, we used functional magnetic resonance imaging (fMRI) to examine the cortical responses to specular surfaces in the macaque visual cortex. Using computer graphics, we generated images of specular and matte objects and prepared scrambled images by locally randomizing the luminance phases of the images with specular and matte objects. In experiment 1, we contrasted the responses to specular images with those to matte and scrambled images. Activation was observed along the ventral visual pathway, including V1, V2, V3, V4 and the posterior inferior temporal (IT) cortex. In experiment 2, we manipulated the contrasts of images and found that the activation observed in these regions could not be explained solely by the global or local contrasts. These results suggest that image features related to specular surface are processed along the ventral visual pathway from V1 to specific regions in the IT cortex. This is consistent with previous human fMRI experiments that showed surface properties are processed in the ventral visual pathway.

Resetting capacity limitations revealed by long-lasting elimination of attentional blink through training

As with other cognitive phenomena that are based upon the capacity limitations of visual processing, it is thought that attentional blink (AB) cannot be eliminated, even after extensive training. We report in this paper that just 1 h of specific attentional training can completely eliminate AB, and that this effect is robust enough to persist for a few months after training. Results of subsequent behavioral and functional magnetic resonance imaging (fMRI) experiments indicate that this learning effect is associated with improvements in temporal resolution, which are mainly due to processing in the prefrontal areas. Contrary to prior wisdom, we conclude that capacity limitations can be overcome by short-term training.

Toward a unified theory of visual area V4

Visual area V4 is a midtier cortical area in the ventral visual pathway. It is crucial for visual object recognition and has been a focus of many studies on visual attention. However, there is no unifying view of V4's role in visual processing. Neither is there an understanding of how its role in feature processing interfaces with its role in visual attention. This review captures our current knowledge of V4, largely derived from electrophysiological and imaging studies in the macaque monkey. Based on recent discovery of functionally specific domains in V4, we propose that the unifying function of V4 circuitry is to enable selective extraction of specific functional domain-based networks, whether it be by bottom-up specification of object features or by top-down attentionally driven selection.

Behavioral and anatomical consequences of early versus late symbol training in macaques

Distinct brain regions, reproducible from one person to the next, are specialized for processing different kinds of human expertise, such as face recognition and reading. Here, we explore the relationship between age of learning, learning ability, and specialized brain structures. Specifically, we ask whether the existence of reproducible cortical domains necessarily means that certain abilities are innate, or innately easily learned, or whether reproducible domains can be formed, or refined, by interactions between genetic programs and common early experience. Functional MRI showed that intensive early, but not late, experience caused the formation of category-selective regions in macaque temporal lobe for stimuli never naturally encountered by monkeys. And behaviorally, early training produced more fluent processing of these stimuli than the same training in adults. One explanation for these results is that in higher cortical areas, as in early sensory areas, experience drives functional clustering and functional clustering determines how that information is processed.

Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation

It is controversial whether the adult primate early visual cortex is sufficiently plastic to cause visual perceptual learning (VPL). The controversy occurs partially because most VPL studies have examined correlations between behavioral and neural activity changes rather than cause-and-effect relationships. With an online-feedback method that uses decoded functional magnetic resonance imaging (fMRI) signals, we induced activity patterns only in early visual cortex corresponding to an orientation without stimulus presentation or participants' awareness of what was to be learned. The induced activation caused VPL specific to the orientation. These results suggest that early visual areas are so plastic that mere inductions of activity patterns are sufficient to cause VPL. This technique can induce plasticity in a highly selective manner, potentially leading to powerful training and rehabilitative protocols.

The case for primate V3

The visual system in primates is represented by a remarkably large expanse of the cerebral cortex. While more precise investigative studies that can be performed in non-human primates contribute towards understanding the organization of the human brain, there are several issues of visual cortex organization in monkey species that remain unresolved. In all, more than 20 areas comprise the primate visual cortex, yet there is little agreement as to the exact number, size and visual field representation of all but three. A case in point is the third visual area, V3. It is found relatively early in the visual system hierarchy, yet over the last 40 years its organization and even its very existence have been a matter of debate among prominent neuroscientists. In this review, we discuss a large body of recent work that provides straightforward evidence for the existence of V3. In light of this, we then re-examine results from several seminal reports and provide parsimonious re-interpretations in favour of V3. We conclude with analysis of human and monkey functional magnetic resonance imaging literature to make the case that a complete V3 is an organizational feature of all primate species and may play a greater role in the dorsal stream of visual processing.

Functional magnetic resonance imaging of awake monkeys: some approaches for improving imaging quality

Functional magnetic resonance imaging (fMRI) at high magnetic field strength can suffer from serious degradation of image quality because of motion and physiological noise, as well as spatial distortions and signal losses due to susceptibility effects. Overcoming such limitations is essential for sensitive detection and reliable interpretation of fMRI data. These issues are particularly problematic in studies of awake animals. As part of our initial efforts to study functional brain activations in awake, behaving monkeys using fMRI at 4.7 T, we have developed acquisition and analysis procedures to improve image quality with encouraging results. We evaluated the influence of two main variables on image quality. First, we show how important the level of behavioral training is for obtaining good data stability and high temporal signal-to-noise ratios. In initial sessions, our typical scan session lasted 1.5 h, partitioned into short (<10 min) runs. During reward periods and breaks between runs, the monkey exhibited movements resulting in considerable image misregistrations. After a few months of extensive behavioral training, we were able to increase the length of individual runs and the total length of each session. The monkey learned to wait until the end of a block for fluid reward, resulting in longer periods of continuous acquisition. Each additional 60 training sessions extended the duration of each session by 60 min, culminating, after about 140 training sessions, in sessions that last about 4 h. As a result, the average translational movement decreased from over 500 μm to less than 80 μm, a displacement close to that observed in anesthetized monkeys scanned in a 7-T horizontal scanner. Another major source of distortion at high fields arises from susceptibility variations. To reduce such artifacts, we used segmented gradient-echo echo-planar imaging (EPI) sequences. Increasing the number of segments significantly decreased susceptibility artifacts and image distortion. Comparisons of images from functional runs using four segments with those using a single-shot EPI sequence revealed a roughly twofold improvement in functional signal-to-noise-ratio and 50% decrease in distortion. These methods enabled reliable detection of neural activation and permitted blood-oxygenation-level-dependent-based mapping of early visual areas in monkeys using a volume coil. In summary, both extensive behavioral training of monkeys and application of segmented gradient-echo EPI sequence improved signal-to-noise ratio and image quality. Understanding the effects these factors have is important for the application of high field imaging methods to the detection of submillimeter functional structures in the awake monkey brain.

Imaging retinotopic maps in the human brain

A quarter-century ago visual neuroscientists had little information about the number and organization of retinotopic maps in human visual cortex. The advent of functional magnetic resonance imaging (MRI), a non-invasive, spatially-resolved technique for measuring brain activity, provided a wealth of data about human retinotopic maps. Just as there are differences amongst non-human primate maps, the human maps have their own unique properties. Many human maps can be measured reliably in individual subjects during experimental sessions lasting less than an hour. The efficiency of the measurements and the relatively large amplitude of functional MRI signals in visual cortex make it possible to develop quantitative models of functional responses within specific maps in individual subjects. During this last quarter-century, there has also been significant progress in measuring properties of the human brain at a range of length and time scales, including white matter pathways, macroscopic properties of gray and white matter, and cellular and molecular tissue properties. We hope the next 25years will see a great deal of work that aims to integrate these data by modeling the network of visual signals. We do not know what such theories will look like, but the characterization of human retinotopic maps from the last 25years is likely to be an important part of future ideas about visual computations.