Feedback scales the spatial tuning of cortical responses during visual memory

Perception, working memory, and long-term memory each evoke neural responses in visual cortex, suggesting that memory uses encoding mechanisms shared with perception. While previous research has largely focused on how perception and memory are similar, we hypothesized that responses in visual cortex would differ depending on the origins of the inputs. Using fMRI, we quantified spatial tuning in visual cortex while participants (both sexes) viewed, maintained in working memory, or retrieved from long-term memory a peripheral target. In each of these conditions, BOLD responses were spatially tuned and were aligned with the target's polar angle in all measured visual field maps including V1. As expected given the increasing sizes of receptive fields, polar angle tuning during perception increased in width systematically up the visual hierarchy from V1 to V2, V3, hV4, and beyond. In stark contrast, the widths of tuned responses were broad across the visual hierarchy during working memory and long-term memory, matched to the widths in perception in later visual field maps but much broader in V1. This pattern is consistent with the idea that mnemonic responses in V1 stem from top-down sources. Moreover, these tuned responses when biased (clockwise or counterclockwise of target) predicted matched biases in memory, suggesting that the readout of maintained and reinstated mnemonic responses influences memory guided behavior. We conclude that feedback constrains spatial tuning during memory, where earlier visual maps inherit broader tuning from later maps thereby impacting the precision of memory.

Retinal origin of orientation but not direction selective maps in the superior colliculus

Neurons in the mouse superior colliculus ("colliculus") are arranged in ordered spatial maps. While orientation-selective (OS) neurons form a concentric map aligned to the center of vision, direction-selective (DS) neurons are arranged in patches with changing preferences across the visual field. It remains unclear whether these maps are a consequence of feedforward input from the retina or local computations in the colliculus. To determine whether these maps originate in the retina, we mapped the local and global distribution of OS and DS retinal ganglion cell axon boutons using in vivo two-photon calcium imaging. We found that OS boutons formed patches that matched the distribution of OS neurons within the colliculus. DS boutons displayed fewer regional specializations, better reflecting the organization of DS neurons in the retina. Both eyes convey similar orientation but different DS inputs to the colliculus, as shown in recordings from retinal explants. These data demonstrate that orientation and direction maps within the colliculus are independent, where orientation maps are likely inherited from the retina, but direction maps require additional computations.

Interaction between central and peripheral vision: Influence of distance and spatial frequencies

Visual scene perception is based on reciprocal interactions between central and peripheral information. Such interactions are commonly investigated through the semantic congruence effect, which usually reveals a congruence effect of central vision on peripheral vision as strong as the reverse. The aim of the present study was to further investigate the mechanisms underlying central-peripheral visual interactions using a central-peripheral congruence paradigm through three behavioral experiments. We presented simultaneously a central and a peripheral stimulus, that could be either semantically congruent or incongruent. To assess the congruence effect of central vision on peripheral vision, participants had to categorize the peripheral target stimulus while ignoring the central distractor stimulus. To assess the congruence effect of the peripheral vision on central vision, they had to categorize the central target stimulus while ignoring the peripheral distractor stimulus. Experiment 1 revealed that the physical distance between central and peripheral stimuli influences central-peripheral visual interactions: Congruence effect of central vision is stronger when the distance between the target and the distractor is the shortest. Experiments 2 and 3 revealed that the spatial frequency content of distractors also influence central-peripheral interactions: Congruence effect of central vision is observed only when the distractor contained high spatial frequencies while congruence effect of peripheral vision is observed only when the distractor contained low spatial frequencies. These results raise the question of how these influences are exerted (bottom-up vs. top-down) and are discussed based on the retinocortical properties of the visual system and the predictive brain hypothesis.

Cortical field maps across human sensory cortex

Cortical processing pathways for sensory information in the mammalian brain tend to be organized into topographical representations that encode various fundamental sensory dimensions. Numerous laboratories have now shown how these representations are organized into numerous cortical field maps (CMFs) across visual and auditory cortex, with each CFM supporting a specialized computation or set of computations that underlie the associated perceptual behaviors. An individual CFM is defined by two orthogonal topographical gradients that reflect two essential aspects of feature space for that sense. Multiple adjacent CFMs are then organized across visual and auditory cortex into macrostructural patterns termed cloverleaf clusters. CFMs within cloverleaf clusters are thought to share properties such as receptive field distribution, cortical magnification, and processing specialization. Recent measurements point to the likely existence of CFMs in the other senses, as well, with topographical representations of at least one sensory dimension demonstrated in somatosensory, gustatory, and possibly olfactory cortical pathways. Here we discuss the evidence for CFM and cloverleaf cluster organization across human sensory cortex as well as approaches used to identify such organizational patterns. Knowledge of how these topographical representations are organized across cortex provides us with insight into how our conscious perceptions are created from our basic sensory inputs. In addition, studying how these representations change during development, trauma, and disease serves as an important tool for developing improvements in clinical therapies and rehabilitation for sensory deficits.

Trying harder: how cognitive effort sculpts neural representations during working memory

The neural mechanisms by which motivational factors influence cognition remain unknown. Using fMRI, we tested how cognitive effort impacts working memory (WM). Participants were precued whether WM difficulty would be hard or easy. Hard trials demanded more effort as a later decision required finer mnemonic precision. Behaviorally, pupil size was larger and response times were slower on hard trials suggesting our manipulation of effort succeeded. Neurally, we observed robust persistent activity in prefrontal cortex, especially during hard trials. We found strong decoding of location in visual cortex, where accuracy was higher on hard trials. Connecting these across-region effects, we found that the amplitude of delay period activity in frontal cortex predicted decoded accuracy in visual cortex on a trial-wise basis. We conclude that the gain of persistent activity in frontal cortex may be the source of effort-related feedback signals that improve the quality of WM representations stored in visual cortex.

Early visual experience refines the retinotopic organization within and across visual cortical regions

Early visual areas are retinotopically organized in human and non-human primates. Population receptive field (pRF) size increases with eccentricity and from lower- to higher-level visual areas. Furthermore, the cortical magnification factor (CMF), a measure of how much cortical space is devoted to each degree of visual angle, is typically larger for foveal as opposed to peripheral regions of the visual field. Whether this fine-scale organization within and across visual areas depends on early visual experience has yet been unknown. Here, we employed 7T functional magnetic resonance imaging pRF mapping to assess the retinotopic organization of early visual regions (i.e., V1, V2, and V3) in eight sight recovery individuals with a history of congenital blindness until a maximum of 4 years of age. Compared with sighted controls, foveal pRF sizes in these individuals were larger, and pRF sizes did not show the typical increase with eccentricity and down the visual cortical processing stream (V1-V2-V3). Cortical magnification was overall diminished and decreased less from foveal to parafoveal visual field locations. Furthermore, cortical magnification correlated with visual acuity in sight recovery individuals. The results of this study suggest that early visual experience is essential for refining a presumably innate prototypical retinotopic organization in humans within and across visual areas, which seems to be crucial for acquiring full visual capabilities.

Retinotopic connectivity maps of human visual cortex with unconstrained eye movements

Human visual cortex contains topographic visual field maps whose organization can be revealed with retinotopic mapping. Unfortunately, constraints posed by standard mapping hinder its use in patients, atypical subject groups, and individuals at either end of the lifespan. This severely limits the conclusions we can draw about visual processing in such individuals. Here, we present a novel data-driven method to estimate connective fields, resulting in fine-grained maps of the functional connectivity between brain areas. We find that inhibitory connectivity fields accompany, and often surround facilitatory fields. The visual field extent of these inhibitory subfields falls off with cortical magnification. We further show that our method is robust to large eye movements and myopic defocus. Importantly, freed from the controlled stimulus conditions in standard mapping experiments, using entertaining stimuli and unconstrained eye movements our approach can generate retinotopic maps, including the periphery visual field hitherto only possible to map with special stimulus displays. Generally, our results show that the connective field method can gain knowledge about retinotopic architecture of visual cortex in patients and participants where this is at best difficult and confounded, if not impossible, with current methods.

Variability of visual field maps in human early extrastriate cortex challenges the canonical model of organization of V2 and V3

Visual field maps in human early extrastriate areas (V2 and V3) are traditionally thought to form mirror-image representations which surround the primary visual cortex (V1). According to this scheme, V2 and V3 form nearly symmetrical halves with respect to the calcarine sulcus, with the dorsal halves representing lower contralateral quadrants, and the ventral halves representing upper contralateral quadrants. This arrangement is considered to be consistent across individuals, and thus predictable with reasonable accuracy using templates. However, data that deviate from this expected pattern have been observed, but mainly treated as artifactual. Here, we systematically investigate individual variability in the visual field maps of human early visual cortex using the 7T Human Connectome Project (HCP) retinotopy dataset. Our results demonstrate substantial and principled inter-individual variability. Visual field representation in the dorsal portions of V2 and V3 was more variable than in their ventral counterparts, including substantial departures from the expected mirror-symmetrical patterns. In addition, left hemisphere retinotopic maps were more variable than those in the right hemisphere. Surprisingly, only one-third of individuals had maps that conformed to the expected pattern in the left hemisphere. Visual field sign analysis further revealed that in many individuals the area conventionally identified as dorsal V3 shows a discontinuity in the mirror-image representation of the retina, associated with a Y-shaped lower vertical representation. Our findings challenge the current view that inter-individual variability in early extrastriate cortex is negligible, and that the dorsal portions of V2 and V3 are roughly mirror images of their ventral counterparts.

A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision

Objective.We developed a realistic simulation paradigm for cortical prosthetic vision and investigated whether we can improve visual performance using a novel clustering algorithm.Approach.Cortical visual prostheses have been developed to restore sight by stimulating the visual cortex. To investigate the visual experience, previous studies have used uniform phosphene maps, which may not accurately capture generated phosphene map distributions of implant recipients. The current simulation paradigm was based on the Human Connectome Project retinotopy dataset and the placement of implants on the cortices from magnetic resonance imaging scans. Five unique retinotopic maps were derived using this method. To improve performance on these retinotopic maps, we enabled head scanning and a density-based clustering algorithm was then used to relocate centroids of visual stimuli. The impact of these improvements on visual detection performance was tested. Using spatially evenly distributed maps as a control, we recruited ten subjects and evaluated their performance across five sessions on the Berkeley Rudimentary Visual Acuity test and the object recognition task.Main results.Performance on control maps is significantly better than on retinotopic maps in both tasks. Both head scanning and the clustering algorithm showed the potential of improving visual ability across multiple sessions in the object recognition task.Significance.The current paradigm is the first that simulates the experience of cortical prosthetic vision based on brain scans and implant placement, which captures the spatial distribution of phosphenes more realistically. Utilisation of evenly distributed maps may overestimate the performance that visual prosthetics can restore. This simulation paradigm could be used in clinical practice when making plans for where best to implant cortical visual prostheses.

Impaired Direction Selectivity in the Nucleus of the Optic Tract of Albino Mice

Purpose

Human albinos have a low visual acuity. This is partially due to the presence of spontaneous erroneous eye movements called pendular nystagmus. This nystagmus is present in other albino vertebrates and has been hypothesized to be caused by aberrant wiring of retinal ganglion axons to the nucleus of the optic tract (NOT), a part of the accessory optic system involved in the optokinetic response to visual motion. The NOT in pigmented rodents is preferentially responsive to ipsiversive motion (i.e., motion in the contralateral visual field in the temporonasal direction). We compared the response to visual motion in the NOT of albino and pigmented mice to understand if motion coding and preference are impaired in the NOT of albino mice.

Methods

We recorded neuronal spiking activity with Neuropixels probes in the visual cortex and NOT in C57BL/6JRj mice (pigmented) and DBA/1JRj mice with oculocutaneous albinism (albino).

Results

We found that in pigmented mice, NOT is retinotopically organized, and neurons are direction tuned, whereas in albino mice, neuronal tuning is severely impaired. Neurons in the NOT of albino mice do not have a preference for ipsiversive movement. In contrast, neuronal tuning in visual cortex was preserved in albino mice and did not differ significantly from the tuning in pigmented mice.

Conclusions

We propose that excessive interhemispheric crossing of retinal projections in albinos may cause the disrupted left/right direction encoding we found in NOT. This, in turn, impairs the normal horizontal optokinetic reflex and leads to pendular albino nystagmus.

Functional organization of visual responses in the octopus optic lobe

Cephalopods are highly visual animals with camera-type eyes, large brains, and a rich repertoire of visually guided behaviors. However, the cephalopod brain evolved independently from those of other highly visual species, such as vertebrates; therefore, the neural circuits that process sensory information are profoundly different. It is largely unknown how their powerful but unique visual system functions, as there have been no direct neural measurements of visual responses in the cephalopod brain. In this study, we used two-photon calcium imaging to record visually evoked responses in the primary visual processing center of the octopus central brain, the optic lobe, to determine how basic features of the visual scene are represented and organized. We found spatially localized receptive fields for light (ON) and dark (OFF) stimuli, which were retinotopically organized across the optic lobe, demonstrating a hallmark of visual system organization shared across many species. An examination of these responses revealed transformations of the visual representation across the layers of the optic lobe, including the emergence of the OFF pathway and increased size selectivity. We also identified asymmetries in the spatial processing of ON and OFF stimuli, which suggest unique circuit mechanisms for form processing that may have evolved to suit the specific demands of processing an underwater visual scene. This study provides insight into the neural processing and functional organization of the octopus visual system, highlighting both shared and unique aspects, and lays a foundation for future studies of the neural circuits that mediate visual processing and behavior in cephalopods.

Mnemonic representations in human lateral geniculate nucleus

There is a growing appreciation for the role of the thalamus in high-level cognition. Motivated by findings that internal cognitive state drives activity in feedback layers of primary visual cortex (V1) that target the lateral geniculate nucleus (LGN), we investigated the role of LGN in working memory (WM). Specifically, we leveraged model-based neuroimaging approaches to test the hypothesis that human LGN encodes information about spatial locations temporarily encoded in WM. First, we localized and derived a detailed topographic organization in LGN that accords well with previous findings in humans and non-human primates. Next, we used models constructed on the spatial preferences of LGN populations in order to reconstruct spatial locations stored in WM as subjects performed modified memory-guided saccade tasks. We found that population LGN activity faithfully encoded the spatial locations held in memory in all subjects. Importantly, our tasks and models allowed us to dissociate the locations of retinal stimulation and the motor metrics of memory-guided saccades from the maintained spatial locations, thus confirming that human LGN represents true WM information. These findings add LGN to the growing list of subcortical regions involved in WM, and suggest a key pathway by which memories may influence incoming processing at the earliest levels of the visual hierarchy.

Fast Optical Signals for Real-Time Retinotopy and Brain Computer Interface

A brain-computer interface (BCI) allows users to control external devices through brain activity. Portable neuroimaging techniques, such as near-infrared (NIR) imaging, are suitable for this goal. NIR imaging has been used to measure rapid changes in brain optical properties associated with neuronal activation, namely fast optical signals (FOS) with good spatiotemporal resolution. However, FOS have a low signal-to-noise ratio, limiting their BCI application. Here FOS were acquired with a frequency-domain optical system from the visual cortex during visual stimulation consisting of a rotating checkerboard wedge, flickering at 5 Hz. We used measures of photon count (Direct Current, DC light intensity) and time of flight (phase) at two NIR wavelengths (690 nm and 830 nm) combined with a machine learning approach for fast estimation of visual-field quadrant stimulation. The input features of a cross-validated support vector machine classifier were computed as the average modulus of the wavelet coherence between each channel and the average response among all channels in 512 ms time windows. An above chance performance was obtained when differentiating visual stimulation quadrants (left vs. right or top vs. bottom) with the best classification accuracy of ~63% (information transfer rate of ~6 bits/min) when classifying the superior and inferior stimulation quadrants using DC at 830 nm. The method is the first attempt to provide generalizable retinotopy classification relying on FOS, paving the way for the use of FOS in real-time BCI.

Variability of the Surface Area of the V1, V2, and V3 Maps in a Large Sample of Human Observers

How variable is the functionally defined structure of early visual areas in human cortex and how much variability is shared between twins? Here we quantify individual differences in the best understood functionally defined regions of cortex: V1, V2, V3. The Human Connectome Project 7T Retinotopy Dataset includes retinotopic measurements from 181 subjects (109 female, 72 male), including many twins. We trained four "anatomists" to manually define V1-V3 using retinotopic features. These definitions were more accurate than automated anatomical templates and showed that surface areas for these maps varied more than threefold across individuals. This threefold variation was little changed when normalizing visual area size by the surface area of the entire cerebral cortex. In addition to varying in size, we find that visual areas vary in how they sample the visual field. Specifically, the cortical magnification function differed substantially among individuals, with the relative amount of cortex devoted to central vision varying by more than a factor of 2. To complement the variability analysis, we examined the similarity of visual area size and structure across twins. Whereas the twin sample sizes are too small to make precise heritability estimates (50 monozygotic pairs, 34 dizygotic pairs), they nonetheless reveal high correlations, consistent with strong effects of the combination of shared genes and environment on visual area size. Collectively, these results provide the most comprehensive account of individual variability in visual area structure to date, and provide a robust population benchmark against which new individuals and developmental and clinical populations can be compared.SIGNIFICANCE STATEMENT Areas V1, V2, and V3 are among the best studied functionally defined regions in human cortex. Using the largest retinotopy dataset to date, we characterized the variability of these regions across individuals and the similarity between twin pairs. We find that the size of visual areas varies dramatically (up to 3.5×) across healthy young adults, far more than the variability of the cerebral cortex size as a whole. Much of this variability appears to arise from inherited factors, as we find very high correlations in visual area size between monozygotic twin pairs, and lower but still substantial correlations between dizygotic twin pairs. These results provide the most comprehensive assessment of how functionally defined visual cortex varies across the population to date.

Intrasession and Intersession Reproducibility of Artificial Scotoma pRF Mapping Results at Ultra-High Fields

Functional magnetic resonance imaging (fMRI) combined with population receptive field (pRF) mapping allows for associating positions on the visual cortex to areas on the visual field. Apart from applications in healthy subjects, this method can also be used to examine dysfunctions in patients suffering from partial visual field losses. While such objective measurement of visual deficits (scotoma) is of great importance for, e.g., longitudinal studies addressing treatment effects, it requires a thorough assessment of accuracy and reproducibility of the results obtained. In this study, we quantified the reproducibility of pRF mapping results within and across sessions in case of central visual field loss in a group of 15 human subjects. We simulated scotoma by masking a central area of 2° radius from stimulation to establish ground-truth conditions. This study was performed on a 7T ultra-high field MRI scanner for increased sensitivity. We found excellent intrasession and intersession reproducibility for the pRF center position (Spearman correlation coefficients for x, y: >0.95; eccentricity: >0.87; polar angle: >0.98), but only modest reproducibility for pRF size (Spearman correlation coefficients around 0.4). We further examined the scotoma detection performance using an automated method based on a reference dataset acquired with full-field stimulation. For the 2° artificial scotoma, the group-averaged scotoma sizes were estimated at between 1.92° and 2.19° for different sessions. We conclude that pRF mapping of visual field losses yields robust, reproducible measures of retinal function and suggest the use of pRF mapping as an objective method for monitoring visual deficits during therapeutic interventions or disease progression.

Spatial selectivity in adaptation to gaze direction

A person's focus of attention is conveyed by the direction of their eyes and face, providing a simple visual cue fundamental to social interaction. A growing body of research examines the visual mechanisms that encode the direction of another person's gaze as we observe them. Here we investigate the spatial receptive field properties of these mechanisms, by testing the spatial selectivity of sensory adaptation to gaze direction. Human observers were adapted to faces with averted gaze presented in one visual hemifield, then tested in their perception of gaze direction for faces presented in the same or opposite hemifield. Adaptation caused strong, repulsive perceptual aftereffects, but only for faces presented in the same hemifield as the adapter. This occurred even though adapting and test stimuli were in the same external location across saccades. Hence, there was clear evidence for retinotopic adaptation and a relative lack of either spatiotopic or spatially invariant adaptation. These results indicate that adaptable representations of gaze direction in the human visual system have retinotopic spatial receptive fields. This strategy of coding others' direction of gaze with positional specificity relative to one's own eye position may facilitate key functions of gaze perception, such as socially cued shifts in visual attention.

Highly accurate retinotopic maps of the physiological blind spot in human visual cortex

The physiological blind spot is a naturally occurring scotoma corresponding with the optic disc in the retina of each eye. Even during monocular viewing, observers are usually oblivious to the scotoma, in part because the visual system extrapolates information from the surrounding area. Unfortunately, studying this visual field region with neuroimaging has proven difficult, as it occupies only a small part of retinotopic cortex. Here, we used functional magnetic resonance imaging and a novel data-driven method for mapping the retinotopic organization in and around the blind spot representation in V1. Our approach allowed for highly accurate reconstructions of the extent of an observer's blind spot, and out-performed conventional model-based analyses. This method opens exciting opportunities to study the plasticity of receptive fields after visual field loss, and our data add to evidence suggesting that the neural circuitry responsible for impressions of perceptual completion across the physiological blind spot most likely involves regions of extrastriate cortex-beyond V1.

Intra-Areal Visual Topography in Primate Brains Mapped with Probabilistic Tractography of Diffusion-Weighted Imaging

Noninvasive diffusion-weighted magnetic resonance imaging (dMRI) can be used to map the neural connectivity between distinct areas in the intact brain, but the standard resolution achieved fundamentally limits the sensitivity of such maps. We investigated the sensitivity and specificity of high-resolution postmortem dMRI and probabilistic tractography in rhesus macaque brains to produce retinotopic maps of the lateral geniculate nucleus (LGN) and extrastriate cortical visual area V5/MT based on their topographic connections with the previously established functional retinotopic map of primary visual cortex (V1). We also replicated the differential connectivity of magnocellular and parvocellular LGN compartments with V1 across visual field positions. Predicted topographic maps based on dMRI data largely matched the established retinotopy of both LGN and V5/MT. Furthermore, tractography based on in vivo dMRI data from the same macaque brains acquired at standard field strength (3T) yielded comparable topographic maps in many cases. We conclude that tractography based on dMRI is sensitive enough to reveal the intrinsic organization of ordered connections between topographically organized neural structures and their resultant functional organization.

A sinusoidal transformation of the visual field is the basis for periodic maps in area V2

Retinotopic maps of many visual areas are thought to follow the fundamental principles described for the primary visual cortex (V1), where nearby points on the retina map to nearby points on the surface of V1, and orthogonal axes of the retinal surface are represented along orthogonal axes of the cortical surface. Here we demonstrate a striking departure from this mapping in the secondary visual area (V2) of the tree shrew best described as a sinusoidal transformation of the visual field. This sinusoidal topography is ideal for achieving uniform coverage in an elongated area like V2, as predicted by mathematical models designed for wiring minimization, and provides a novel explanation for periodic banded patterns of intra-cortical connections and functional response properties in V2 of tree shrews as well as several other species. Our findings suggest that cortical circuits flexibly implement solutions to sensory surface representation, with dramatic consequences for large-scale cortical organization.

Information Integration and Information Storage in Retinotopic and Non-Retinotopic Sensory Memory

The first stage of the Atkinson–Shiffrin model of human memory is a sensory memory (SM). The visual component of the SM was shown to operate within a retinotopic reference frame. However, a retinotopic SM (rSM) is unable to account for vision under natural viewing conditions because, for example, motion information needs to be analyzed across space and time. For this reason, the SM store of the Atkinson–Shiffrin model has been extended to include a non-retinotopic component (nrSM). In this paper, we analyze findings from two experimental paradigms and show drastically different properties of rSM and nrSM. We show that nrSM involves complex processes such as motion-based reference frames and Gestalt grouping, which establish object identities across space and time. We also describe a quantitative model for nrSM and show drastic differences between the spatio-temporal properties of rSM and nrSM. Since the reference-frame of the latter is non-retinotopic and motion-stream based, we suggest that the spatiotemporal properties of the nrSM are in accordance with the spatiotemporal properties of the motion system. Overall, these findings indicate that, unlike the traditional rSM, which is a relatively passive store, nrSM exhibits sophisticated processing properties to manage the complexities of ecological perception.

Distinct "driving" versus "modulatory" influences of different visual corticothalamic pathways

Higher-order (HO) thalamic nuclei interact extensively and reciprocally with the cerebral cortex. These corticothalamic (CT) interactions are thought to be important for sensation and perception, attention, and many other important brain functions. CT projections to HO thalamic nuclei, such as the visual pulvinar, originate from two different excitatory populations in cortical layers 5 and 6, whereas first-order nuclei (such as the dorsolateral geniculate nucleus; dLGN) only receive layer 6 CT input. It has been proposed that these layer 5 and layer 6 CT pathways have different functional influences on the HO thalamus, but this has never been directly tested. By optogenetically inactivating different CT populations in the primary visual cortex (V1) and recording single-unit activity from V1, dLGN, and pulvinar of awake mice, we demonstrate that layer 5, but not layer 6, CT projections drive visual responses in the pulvinar, even while both pathways provide retinotopic, baseline excitation to their thalamic targets. Inactivating the superior colliculus also suppressed visual responses in the same subregion of the pulvinar, demonstrating that cortical layer 5 and subcortical inputs both contribute to HO visual thalamic activity-even at the level of putative single neurons. Altogether, these results indicate a functional division of "driver" and "modulator" CT pathways from V1 to the visual thalamus in vivo.

Mapping Visual Field Defects With fMRI - Impact of Approach and Experimental Conditions

Current initiatives to restore vision emphasize the need for objective assessments of visual field (VF) defects as pursued with functional magnetic resonance imaging (fMRI) approaches. Here, we compared population receptive field (pRF) mapping-based VF reconstructions to an fMRI method that uses more robust visual stimulation (on-off block design) in combination with individualized anatomy-driven retinotopic atlas-information (atlas-based VF). We investigated participants with sizable peripheral VF-deficits due to advanced glaucoma (n = 4) or retinitis pigmentosa (RP; n = 2) and controls (n = 6) with simulated scotoma. We obtained (1) standard automated perimetry (SAP) data as reference VFs and 3T fMRI data for (2) pRF-mapping [8-direction bar stimulus, fixation color change task] and (3) block-design full-field stimulation [8-direction drifting contrast patterns during (a) passive viewing (PV) and (b) one-back-task (OBT; reporting successions of identical motion directions) to probe the impact of previously reported task-related unspecific visual cortex activations]. Correspondence measures between the SAP and fMRI-based VFs were accuracy, assisted by sensitivity and specificity. We found an accuracy of pRF-based VF from V1 in patients [median: 0.62] that was similar to previous reports and increased by adding V2 and V3 to the analysis [0.74]. In comparison to the pRF-based VF, equivalent accuracies were obtained for the atlas-based VF for both PV [0.67] and, unexpectedly, the OBT [0.59], where, however, unspecific cortical activations were reflected by a reduction in sensitivity [0.71 (PV) and 0.35 (OBT)]. In conclusion, in patients with peripheral VF-defects, we demonstrate that previous fMRI procedures to obtain VF-estimates might be enhanced by: (1) pooling V1-V3 to enhance accuracy; (2) reporting sensitivity and specificity measures to increase transparency of the VF-reconstruction metric; (3) applying atlas-based procedures, if pRF-based VFs are not available or difficult to obtain; and (4) giving, counter-intuitively, preference to PV. These findings are expected to provide guidance to overcome current limitations of translating fMRI-based methods to a clinical work-up.

Spatial modulation of dark versus bright stimulus responses in the mouse visual system

A fundamental task of the visual system is to respond to both increases and decreases of luminance with action potentials (ON and OFF responses1-4). OFF responses are stronger, faster, and more salient than ON responses in primary visual cortex (V1) of both cats5,6 and primates,7,8 but in ferrets9 and mice,10 ON responses can be stronger, weaker,11 or balanced12 in comparison to OFF responses. These discrepancies could arise from differences in species, experimental techniques, or stimulus properties, particularly retinotopic location in the visual field, as has been speculated;9 however, the role of retinotopy for ON/OFF dominance has not been systematically tested across multiple scales of neural activity within species. Here, we measured OFF versus ON responses across large portions of visual space with silicon probe and whole-cell patch-clamp recordings in mouse V1 and lateral geniculate nucleus (LGN). We found that OFF responses dominated in the central visual field, whereas ON and OFF responses were more balanced in the periphery. These findings were consistent across local field potential (LFP), spikes, and subthreshold membrane potential in V1, and were aligned with spatial biases in ON and OFF responses in LGN. Our findings reveal that retinotopy may provide a common organizing principle for spatial modulation of OFF versus ON processing in mammalian visual systems.

Inferior Occipital Gyrus Is Organized along Common Gradients of Spatial and Face-Part Selectivity

The ventral visual stream of the human brain is subdivided into patches with categorical stimulus preferences, like faces or scenes. However, the functional organization within these areas is less clear. Here, we used functional magnetic resonance imaging and vertex-wise tuning models to independently probe spatial and face-part preferences in the inferior occipital gyrus (IOG) of healthy adult males and females. The majority of responses were well explained by Gaussian population tuning curves for both retinotopic location and the preferred relative position within a face. Parameter maps revealed a common gradient of spatial and face-part selectivity, with the width of tuning curves drastically increasing from posterior to anterior IOG. Tuning peaks clustered more idiosyncratically but were also correlated across maps of visual and face space. Preferences for the upper visual field went along with significantly increased coverage of the upper half of the face, matching recently discovered biases in human perception. Our findings reveal a broad range of neural face-part selectivity in IOG, ranging from narrow to "holistic." IOG is functionally organized along this gradient, which in turn is correlated with retinotopy.SIGNIFICANCE STATEMENT Brain imaging has revealed a lot about the large-scale organization of the human brain and visual system. For example, occipital cortex contains map-like representations of the visual field, while neurons in ventral areas cluster into patches with categorical preferences, like faces or scenes. Much less is known about the functional organization within these areas. Here, we focused on a well established face-preferring area-the inferior occipital gyrus (IOG). A novel neuroimaging paradigm allowed us to map the retinotopic and face-part tuning of many recording sites in IOG independently. We found a steep posterior-anterior gradient of decreasing face-part selectivity, which correlated with retinotopy. This suggests the functional role of ventral areas is not uniform and may follow retinotopic "protomaps."

Representation of Contralateral Visual Space in the Human Hippocampus

The initial encoding of visual information primarily from the contralateral visual field is a fundamental organizing principle of the primate visual system. Recently, the presence of such retinotopic sensitivity has been shown to extend well beyond early visual cortex to regions not historically considered retinotopically sensitive. In particular, human scene-selective regions in parahippocampal and medial parietal cortex exhibit prominent biases for the contralateral visual field. Here, we used fMRI to test the hypothesis that the human hippocampus, which is thought to be anatomically connected with these scene-selective regions, would also exhibit a biased representation of contralateral visual space. First, population receptive field (pRF) mapping with scene stimuli revealed strong biases for the contralateral visual field in bilateral hippocampus. Second, the distribution of retinotopic sensitivity suggested a more prominent representation in anterior medial portions of the hippocampus. Finally, the contralateral bias was confirmed in independent data taken from the Human Connectome Project (HCP) initiative. The presence of contralateral biases in the hippocampus, a structure considered by many as the apex of the visual hierarchy, highlights the truly pervasive influence of retinotopy. Moreover, this finding has important implications for understanding how visual information relates to the allocentric global spatial representations known to be encoded therein.SIGNIFICANCE STATEMENT Retinotopic encoding of visual information is an organizing principle of visual cortex. Recent work demonstrates this sensitivity in structures far beyond early visual cortex, including those anatomically connected to the hippocampus. Here, using population receptive field (pRF) modeling in two independent sets of data we demonstrate a consistent bias for the contralateral visual field in bilateral hippocampus. Such a bias highlights the truly pervasive influence of retinotopy, with important implications for understanding how the presence of retinotopy relates to more allocentric spatial representations.

An investigation into the relationship between stimulus property, neural response and its manifestation in the visual evoked potential involving retinal resolution

The visual evoked potential (VEP) has been shown to reflect the size of the neural population activated by a processing mechanism selective to the temporal - and spatial luminance contrast property of a stimulus. We set out to better understand how the factors determining the neural response associated with these mechanisms. To do so we recorded the VEP from 14 healthy volunteers viewing two series of pattern reversing stimuli with identical temporal-and spatial luminance contrast properties. In one series the size of the elements increased towards the edge of the image, in the other it decreased. In the former element size was congruent with receptive field size across eccentricity, in the later it was incongruent. P100 amplitude to the incongruent series exceeded that obtained to the congruent series. Using electric dipoles due the excitatory neural response we accounted for this using dipole cancellation of electric dipoles of opposite polarity originating in supra- and infragranular layers of V1. The phasic neural response in granular lamina of V1 exhibited magnocellular characteristics, the neural response outside of the granular lamina exhibited parvocellular characteristics and was modulated by re-entrant projections. Using electric current density, we identified areas of the dorsal followed by areas of the ventral stream as the source of the re-entrant signal modulating infragranular activity. Our work demonstrates that the VEP does not signal reflect the overall level of a neural response but is the result of an interaction between electric dipoles originating from neural responses in different lamina of V1.

Topographic connectivity reveals task-dependent retinotopic processing throughout the human brain

The human visual system is organized as a hierarchy of maps that share the topography of the retina. Known retinotopic maps have been identified using simple visual stimuli under strict fixation, conditions different from everyday vision which is active, dynamic, and complex. This means that it remains unknown how much of the brain is truly visually organized. Here I demonstrate widespread stable visual organization beyond the traditional visual system, in default-mode network and hippocampus. Detailed topographic connectivity with primary visual cortex during movie-watching, resting-state, and retinotopic-mapping experiments revealed that visual-spatial representations throughout the brain are warped by cognitive state. Specifically, traditionally visual regions alternate with default-mode network and hippocampus in preferentially representing the center of the visual field. This visual role of default-mode network and hippocampus would allow these regions to interface between abstract memories and concrete sensory impressions. Together, these results indicate that visual-spatial organization is a fundamental coding principle that structures the communication between distant brain regions.

A Probabilistic Functional Atlas of Human Occipito-Temporal Visual Cortex

Human visual cortex contains many retinotopic and category-specific regions. These brain regions have been the focus of a large body of functional magnetic resonance imaging research, significantly expanding our understanding of visual processing. As studying these regions requires accurate localization of their cortical location, researchers perform functional localizer scans to identify these regions in each individual. However, it is not always possible to conduct these localizer scans. Here, we developed and validated a functional region of interest (ROI) atlas of early visual and category-selective regions in human ventral and lateral occipito-temporal cortex. Results show that for the majority of functionally defined ROIs, cortex-based alignment results in lower between-subject variability compared to nonlinear volumetric alignment. Furthermore, we demonstrate that 1) the atlas accurately predicts the location of an independent dataset of ventral temporal cortex ROIs and other atlases of place selectivity, motion selectivity, and retinotopy. Next, 2) we show that the majority of voxel within our atlas is responding mostly to the labeled category in a left-out subject cross-validation, demonstrating the utility of this atlas. The functional atlas is publicly available (download.brainvoyager.com/data/visfAtlas.zip) and can help identify the location of these regions in healthy subjects as well as populations (e.g., blind people, infants) in which functional localizers cannot be run.

Projection of Orthogonal Tiling from the Retina to the Visual Cortex

In higher mammals, the primary visual cortex (V1) is organized into diverse tuning maps of visual features. The topography of these maps intersects orthogonally, but it remains unclear how such a systematic relationship can develop. Here, we show that the orthogonal organization already exists in retinal ganglion cell (RGC) mosaics, providing a blueprint of the organization in V1. From analysis of the RGC mosaics data in monkeys and cats, we find that the ON-OFF RGC distance and ON-OFF angle of neighboring RGCs are organized into a topographic tiling across mosaics, analogous to the orthogonal intersection of cortical tuning maps. Our model simulation shows that the ON-OFF distance and angle in RGC mosaics correspondingly initiate ocular dominance/spatial frequency tuning and orientation tuning, resulting in the orthogonal intersection of cortical tuning maps. These findings suggest that the regularly structured ON-OFF patterns mirrored from the retina initiate the uniform representation of combinations of map features over the visual space.

Spatial readout of visual looming in the central brain of Drosophila

Visual systems can exploit spatial correlations in the visual scene by using retinotopy, the organizing principle by which neighboring cells encode neighboring spatial locations. However, retinotopy is often lost, such as when visual pathways are integrated with other sensory modalities. How is spatial information processed outside of strictly visual brain areas? Here, we focused on visual looming responsive LC6 cells in Drosophila, a population whose dendrites collectively cover the visual field, but whose axons form a single glomerulus-a structure without obvious retinotopic organization-in the central brain. We identified multiple cell types downstream of LC6 in the glomerulus and found that they more strongly respond to looming in different portions of the visual field, unexpectedly preserving spatial information. Through EM reconstruction of all LC6 synaptic inputs to the glomerulus, we found that LC6 and downstream cell types form circuits within the glomerulus that enable spatial readout of visual features and contralateral suppression-mechanisms that transform visual information for behavioral control.

Spatially Specific Working Memory Activity in the Human Superior Colliculus

Theoretically, working memory (WM) representations are encoded by population activity of neurons with distributed tuning across the stored feature. Here, we leverage computational neuroimaging approaches to map the topographic organization of human superior colliculus (SC) and model how population activity in SC encodes WM representations. We first modeled receptive field properties of voxels in SC, deriving a detailed topographic organization resembling that of the primate SC. Neural activity within human (5 male and 1 female) SC persisted throughout a retention interval of several types of modified memory-guided saccade tasks. Assuming an underlying neural architecture of the SC based on its retinotopic organization, we used an encoding model to show that the pattern of activity in human SC represents locations stored in WM. Our tasks and models allowed us to dissociate the locations of visual targets and the motor metrics of memory-guided saccades from the spatial locations stored in WM, thus confirming that human SC represents true WM information. These data have several important implications. They add the SC to a growing number of cortical and subcortical brain areas that form distributed networks supporting WM functions. Moreover, they specify a clear neural mechanism by which topographically organized SC encodes WM representations.

SIGNIFICANCE STATEMENT Using computational neuroimaging approaches, we mapped the topographic organization of human superior colliculus (SC) and modeled how population activity in SC encodes working memory (WM) representations, rather than simpler visual or motor properties that have been traditionally associated with the laminar maps in the primate SC. Together, these data both position the human SC into a distributed network of brain areas supporting WM and elucidate the neural mechanisms by which the SC supports WM.

Axonal Projections from Middle Temporal Area to the Pulvinar in the Common Marmoset

The pulvinar, the largest thalamic nucleus in the primate brain, has connections with a variety of cortical areas and is involved in many aspects of higher brain functions. Among cortico-pulvino-cortical systems, the connection between the middle temporal area (MT) and the pulvinar has been thought to contribute significantly to complex motion recognition. Recently, the common marmoset (Callithrix jacchus), has become a valuable model for a variety of neuroscience studies, including visual neuroscience and translational research of neurological and psychiatric disorders. However, information on projections from MT to the pulvinar in the marmoset brain is scant. We addressed this deficiency by injecting sensitive anterograde viral tracers into MT to examine the distribution of labeled terminations in the pulvinar. The injection sites were placed retinotopically according to visual field coordinates mapped by optical intrinsic imaging. All injections produced anterograde terminal labeling, which was densest in the medial nucleus of the inferior pulvinar (PIm), sparser in the central nucleus of the inferior pulvinar, and weakest in the lateral pulvinar. Within each subnucleus, terminations formed separate retinotopic fields. Most labeled terminals were small but these comingled with a few large terminals, distributed mainly in the dorsomedial part of the PIm. Our results further delineate the organization of projections from MT to the pulvinar in the marmoset as forming parallel complex networks, which may differentially contribute to motion processing. It is interesting that the densest projections from MT target the PIm, the subnucleus recently reported to preferentially receive direct retinal projections.

Investigating the Reliability of Population Receptive Field Size Estimates Using fMRI

In functional MRI (fMRI), population receptive field (pRF) models allow a quantitative description of the response as a function of the features of the stimuli that are relevant for each voxel. The most popular pRF model used in fMRI assumes a Gaussian shape in the features space (e.g., the visual field) reducing the description of the voxel’s pRF to the Gaussian mean (the pRF preferred feature) and standard deviation (the pRF size). The estimation of the pRF mean has been proven to be highly reliable. However, the estimate of the pRF size has been shown not to be consistent within and between subjects. While this issue has been noted experimentally, here we use an optimization theory perspective to describe how the inconsistency in estimating the pRF size is linked to an inherent property of the Gaussian pRF model. When fitting such models, the goodness of fit is less sensitive to variations in the pRF size than to variations in the pRF mean. We also show how the same issue can be considered from a bias-variance perspective. We compare different estimation procedures in terms of the reliability of their estimates using simulated and real fMRI data in the visual (using the Human Connectome Project database) and auditory domain. We show that, the reliability of the estimate of the pRF size can be improved considering a linear combination of those pRF models with similar goodness of fit or a permutation based approach. This increase in reliability of the pRF size estimate does not affect the reliability of the estimate of the pRF mean and the prediction accuracy.

Mapping Short Association Fibers in the Early Cortical Visual Processing Stream Using In Vivo Diffusion Tractography

Short association fibers (U-fibers) connect proximal cortical areas and constitute the majority of white matter connections in the human brain. U-fibers play an important role in brain development, function, and pathology but are underrepresented in current descriptions of the human brain connectome, primarily due to methodological challenges in diffusion magnetic resonance imaging (dMRI) of these fibers. High spatial resolution and dedicated fiber and tractography models are required to reliably map the U-fibers. Moreover, limited quantitative knowledge of their geometry and distribution makes validation of U-fiber tractography challenging. Submillimeter resolution diffusion MRI—facilitated by a cutting-edge MRI scanner with 300 mT/m maximum gradient amplitude—was used to map U-fiber connectivity between primary and secondary visual cortical areas (V1 and V2, respectively) in vivo. V1 and V2 retinotopic maps were obtained using functional MRI at 7T. The mapped V1–V2 connectivity was retinotopically organized, demonstrating higher connectivity for retinotopically corresponding areas in V1 and V2 as expected. The results were highly reproducible, as demonstrated by repeated measurements in the same participants and by an independent replication group study. This study demonstrates a robust U-fiber connectivity mapping in vivo and is an important step toward construction of a more complete human brain connectome.

Origins of Functional Organization in the Visual Cortex

How are the complex maps for orientation selectivity (OS) created in the primary visual cortex (V1)? Rodents and rabbits have a random distribution of OS preferences across V1 while in cats, ferrets, and all primates cells with similar OS preferences cluster together into relatively wide cortical columns. Given other clear similarities in the organization of the visual pathways, why is it that maps coding OS preferences are so radically different? Prominent models have been created of cortical OS mapping that incorporate Hebbian plasticity, intracortical interactions, and the properties of growing axons. However, these models suggest that the maps arise primarily through intracortical interactions. Here we focus on several other features of the visual system and brain that may influence V1 structure. These are: eye divergence, the total number of cells in V1, the thalamocortical networks, the topography of the retina and phylogeny. We outline the evidence for and against these factors contributing to map formation. One promising theory is that the central-to-peripheral ratio (CP ratio) of retinal cell density can be used to predict whether or not a species has pinwheel maps. Animals with high CP ratios (>7) have orientation columns while those with low CP ratios (<4) have random OS maps. The CP ratio is related to the total number of cells in cortex, which also appears to be a reasonable contributing factor. However, while these factors correlate with map structure to some extent, there is a gray area where certain species do not fit elegantly into the theory. A problem with the existing literature is that OS maps have been investigated in only a small number of mammals, from a small fraction of the mammalian phylogenetic tree. We suggest four species (agouti, fruit bat, sheep, and wallaby) that have a range of interesting characteristics, which sit at intermediate locations between primates and rodents, that make them good targets for filling in the missing gaps in the literature. We make predictions about the map structures of these species based on the organization of their brains and visual systems and, in doing so, set possible paths for future research.

Retinotopic specializations of cortical and thalamic inputs to area MT

Retinotopic specializations in the ventral visual stream, especially foveal adaptations, provide primates with high-acuity vision in the central visual field. However, visual field specializations have not been studied in the dorsal visual stream, dedicated to processing visual motion and visually guided behaviors. To investigate this, we injected retrograde neuronal tracers occupying the whole visuotopic representation of the middle temporal (MT) visual area in marmoset monkeys and studied the distribution and morphology of the afferent primary visual cortex (V1) projections. Contrary to previous reports, we found a heterogeneous population of V1-MT projecting neurons distributed in layers 3C and 6. In layer 3C, spiny stellate neurons were distributed mainly in foveal representations, while pyramidal morphologies were characteristic of peripheral eccentricities. This primate adaptation of the V1 to MT pathway is arranged in a way that we had not previously understood, with abundant stellate projection neurons in the high-resolution foveal portions, suggesting rapid relay of motion information to visual area MT. We also describe that the medial portion of the inferior pulvinar (PIm), which is the main thalamic input to area MT, shows a retinotopic organization, likely reflecting the importance of this pathway during development and the establishment of area MT topography.

Primary visual cortical thickness in correlation with visual field defects in patients with pituitary macroadenomas: a structural 7-Tesla retinotopic analysis

OBJECTIVE

Vision loss remains a debilitating complication of pituitary adenomas, although there is considerable variability in visual impairment before and after decompression surgery. Growing evidence suggests secondary damage to remote visual structures may contribute to vision loss in patients with chiasmatic compression. The present study leverages ultrahigh field 7-T MRI to study the retinotopic organization of the primary visual cortex (V1), and correlates visual defects with cortical thinning in V1 to characterize consequences of pituitary adenomas on the posterior visual system.

METHODS

Eight patients (4 males and 4 females, mean age 44.3 years) with pituitary adenomas who exhibited chiasmatic compression and visual field defects, as well as 8 matched healthy controls (4 males and 4 females, mean age 43.3 years), were scanned at 7-T MRI for this prospective study. Whole-brain cortical thickness was calculated using an automated algorithm. A previously published surface-based algorithm was applied to associate the eccentricity and polar angle with each position in V1. Cortical thickness was calculated at each point in the retinotopic organization, and a cortical thickness ratio was generated against matched controls for each point in the visual fields. Patients with adenoma additionally underwent neuroophthalmological examination including 24-2 Humphrey automated visual field perimetry. Pattern deviation (PD) of each point in the visual field, i.e., the deviation in point detection compared with neurologically healthy controls, was correlated with cortical thickness at corresponding polar and eccentricity angles in V1.

RESULTS

Whole-brain cortical thickness was successfully derived for all patients and controls. The mean tumor volume was 19.4 cm3. The median global thickness of V1 did not differ between patients (mean ± SD 2.21 ± 0.12 cm), compared with controls (2.06 ± 0.13 cm, p > 0.05). Surface morphometry-based retinotopic maps revealed that all 8 patients with adenoma showed a significant positive correlation between PD and V1 thickness ratios (r values ranged from 0.31 to 0.53, p < 0.05). Mixed-procedure analysis revealed that PD = -8.0719 + 5.5873*[Median V1 Thickness Ratio].

CONCLUSIONS

All 8 patients showed significant positive correlations between V1 thickness and visual defect. These findings provide retinotopic maps of localized V1 cortical neurodegeneration spatially corresponding to impairments in the visual field. These results further characterize changes in the posterior visual pathway associated with chiasmatic compression, and may prove useful in the neuroophthalmological workup for patients with pituitary macroadenoma.

Spatial specificity of alpha oscillations in the human visual system

Alpha oscillations are strongly modulated by spatial attention. To what extent, the generators of cortical alpha oscillations are spatially distributed and have selectivity that can be related to retinotopic organization is a matter of continuous scientific debate. In the present report, neuromagnetic activity was quantified by means of spatial location tuning functions from 30 participants engaged in a visuospatial attention task. A cue presented briefly in one of 16 locations directing covert spatial attention resulted in a robust modulation of posterior alpha oscillations. The distribution of the alpha sources approximated the retinotopic organization of the human visual system known from hemodynamic studies. Better performance in terms of target identification was associated with a more spatially constrained alpha modulation. The present findings demonstrate that the generators of posterior alpha oscillations are retinotopically organized when modulated by spatial attention.

X-Chromosome Insufficiency Alters Receptive Fields across the Human Early Visual Cortex

Here, we investigated processing by receptive fields, a fundamental property of neurons in the visual system, using fMRI and population receptive field (pRF) mapping in 20 human females with monosomic Turner syndrome (TS) (mean age, 10.3 ± 2.0 years) versus 22 age- and sex-matched controls (mean age, 10.4 ± 1.9 years). TS, caused by X-chromosome haploinsufficiency in females, is associated with well-recognized effects on visuospatial processing, parieto-occipital cortical anatomy, and parietal lobe function. However, it is unknown whether these effects are related to altered brain structure and function in early visual areas (V1-V3) versus downstream parietal cortical regions. Results show that girls with TS have the following: (1) smaller volume of V1-V3, (2) lower average pRF eccentricity in early visual areas, and (3) sparser pRF coverage in the periphery of the visual field. Further, we examined whether the lower volume of early visual areas, defined using retinotopic mapping, in TS is due to smaller surface area or thinner cortex. Results show that girls with TS had a general reduction in surface area relative to controls in bilateral V1 and V2. Our data suggest the possibility that the smaller cortical surface area of early visual areas in girls with TS may be associated with a lower number of neurons, which in turn, leads to lesser coverage of the peripheral visual field compared to controls. These results indicate that X-chromosome haploinsufficiency associated with TS affects the functional neuroanatomy of early visual areas, and suggest that investigating pRFs in TS may shed insights into their atypical visuospatial processing.SIGNIFICANCE STATEMENT Turner syndrome is caused by the absence of one of the two X-chromosomes in females. Using functional neuroimaging and population receptive field mapping, we find that chromosome dosage variation (X-monosomy) associated with Turner syndrome affects the functional neuroanatomy of the visual cortex. Specifically, girls with Turner syndrome have smaller early visual areas that provide lesser coverage of the peripheral visual field compared with healthy controls. Our observations provide compelling evidence that the X-chromosome affects not only parietal cortex, as described in previous studies, but also affects early visual areas. These findings suggest a paradigm change in understanding the effect of X-monosomy on the development of visuospatial abilities in humans.

Submillimeter fMRI reveals a layout of dorsal visual cortex in macaques, remarkably similar to New World monkeys

The primate visual system encompasses >30 visual areas. Characterizing each area, and the interactions between them, is a prerequisite to understanding the visual system. This fundamental task, however, requires a precise parcellation of the visual cortex. Nonetheless, already at the earliest visual processing stages, i.e., just rostral to V2, the number and exact definition of areas are heavily contested. Here, we map the macaque visual cortex using fMRI at unprecedented high resolution. We show a substantially different retinotopic organization of dorsal third and fourth visual areas in macaques compared with widely accepted models, yet a remarkably similar layout in Old and New World monkeys. This organization largely reconciles most reported discrepancies concerning the visuotopic organization of nonhuman primate caudo-dorsal occipital cortex.

The macaque dorsal occipital cortex is generally thought to contain an elongated third visual area, V3d, extending along most of the rostral border of area V2. In contrast, our submillimeter retinotopic fMRI maps (0.6-mm isotropic voxels, achieved by implanted phased-array receive coils) consistently show three sectors anterior to V2d. The dorsal (mirror image) sector complies with the traditional V3d definition, and the middle (nonmirror image) sector with V3A. The ventral (mirror image) sector bends away from V2d, as does the ventrolateral posterior area (VLP) in marmosets and the dorsolateral posterior area (DLP) in owl monkeys, and represents the entire contralateral hemifield as V3A does. Its population-receptive field size, however, suggests that this ventral sector is another area at the same hierarchical level as V4d. Hence, contrary to prevailing views, the retinotopic organization of cortex rostral to V2d differs substantially from widely accepted models. Instead, it is evolutionarily largely conserved in Old and New World monkeys given its surprisingly similar overall visuotopic organization.

Bayesian analysis of retinotopic maps

Human visual cortex is organized into multiple retinotopic maps. Characterizing the arrangement of these maps on the cortical surface is essential to many visual neuroscience studies. Typically, maps are obtained by voxel-wise analysis of fMRI data. This method, while useful, maps only a portion of the visual field and is limited by measurement noise and subjective assessment of boundaries. We developed a novel Bayesian mapping approach which combines observation–a subject’s retinotopic measurements from small amounts of fMRI time–with a prior–a learned retinotopic atlas. This process automatically draws areal boundaries, corrects discontinuities in the measured maps, and predicts validation data more accurately than an atlas alone or independent datasets alone. This new method can be used to improve the accuracy of retinotopic mapping, to analyze large fMRI datasets automatically, and to quantify differences in map properties as a function of health, development and natural variation between individuals.

Retinotopic Responses in the Visual Cortex Elicited by Epiretinal Electrical Stimulation in Normal and Retinal Degenerate Rats

Purpose

Electronic retinal prostheses restore vision in people with outer retinal degeneration by electrically stimulating the inner retina. We characterized visual cortex electrophysiologic response elicited by electrical stimulation of retina in normally sighted and retinal degenerate rats.

Methods

Nine normally sighted Long Evans and 11 S334ter line 3 retinal degenerate (rd) rats were used to map cortical responses elicited by epiretinal electrical stimulation in four quadrants of the retina. Six normal and six rd rats were used to compare the dendritic spine density of neurons in the visual cortex.

Results

The rd rats required higher stimulus amplitudes to elicit responses in the visual cortex. The cortical electrically evoked responses (EERs) for both healthy and rd rats show a dose-response characteristic with respect to the stimulus amplitude. The EER maps in healthy rats show retinotopic organization. For rd rats, cortical retinotopy is not well preserved. The neurons in the visual cortex of rd rats show a 10% higher dendritic spine density than in the healthy rats.

Conclusions

Cortical activity maps, produced when epiretinal stimulation is applied to quadrants of the retina, exhibit retinotopy in normal but not rd rats. This is likely due to a combination of degeneration of the retina and increased stimulus thresholds in rd, which broadens the activated area of the retina.

Translational Relevance

Loss of retinotopy is evident in rd rats. If a similar loss of retinotopy is present in humans, retinal prostheses design must include flexibility to account for patient specific variability.

Unexplained Progressive Visual Field Loss in the Presence of Normal Retinotopic Maps

Lesions of primary visual cortex or its primary inputs typically result in retinotopically localized scotomas. Here we present an individual with unexplained visual field loss and deficits in visual perception in the absence of structural damage to the early visual pathway or lesions in visual cortex. The subject, monocular from an early age, underwent repeated perimetry tests over 8 years demonstrating severe anopia of the lower hemifield, and a clockwise progression of the loss through her upper left visual field. Her visual impairment was evident in a number of standardized tests and psychophysics, especially in tasks assessing spatial integration using illusory contours. However, her intellectual ability was intact and her performance in some other tasks assessing color vision or object detection in scenes was normal. We employed functional magnetic resonance imaging (fMRI), electroretinography and visually evoked potentials. Surprisingly, in contrast to the participant's severe anopia, we found no evidence of abnormal function of her early visual pathways. Specifically, we performed retinotopic mapping using population receptive field (pRF) analysis to map the functional organization of visual cortex in the anopic participant and three control participants on two occasions three and a half years apart. Despite the behavioral visual field loss, her retinotopic maps and pRF parameters in visual areas V1-V3 were qualitatively normal. Further behavioral experiments confirmed that this discrepancy was not trivially explained by the difference between stimuli used for retinotopic mapping and perimetry. Structural T1 scans were normal at both time points, and volumetric analysis of white and gray matter tissue on the segmented T1 volumes did not reveal any abnormalities or deterioration over time. Our findings suggest that normal functional organization of early visual cortex without evident structural damage to the early visual pathway as disclosed by the techniques employed in this study does not necessarily guarantee conscious perception across the visual field.

Idiosyncratic, Retinotopic Bias in Face Identification Modulated by Familiarity

The perception of gender and age of unfamiliar faces is reported to vary idiosyncratically across retinal locations such that, for example, the same androgynous face may appear to be male at one location but female at another. Here, we test spatial heterogeneity for the recognition of the identity of personally familiar faces in human participants. We found idiosyncratic biases that were stable within participants and that varied more across locations for low as compared to high familiar faces. These data suggest that like face gender and age, face identity is processed, in part, by independent populations of neurons monitoring restricted spatial regions and that the recognition responses vary for the same face across these different locations. Moreover, repeated and varied social interactions appear to lead to adjustments of these independent face recognition neurons so that the same familiar face is eventually more likely to elicit the same recognition response across widely separated visual field locations. We provide a mechanistic account of this reduced retinotopic bias based on computational simulations.

Local-Global Parcellation of the Human Cerebral Cortex from Intrinsic Functional Connectivity MRI

A central goal in systems neuroscience is the parcellation of the cerebral cortex into discrete neurobiological "atoms". Resting-state functional magnetic resonance imaging (rs-fMRI) offers the possibility of in vivo human cortical parcellation. Almost all previous parcellations relied on 1 of 2 approaches. The local gradient approach detects abrupt transitions in functional connectivity patterns. These transitions potentially reflect cortical areal boundaries defined by histology or visuotopic fMRI. By contrast, the global similarity approach clusters similar functional connectivity patterns regardless of spatial proximity, resulting in parcels with homogeneous (similar) rs-fMRI signals. Here, we propose a gradient-weighted Markov Random Field (gwMRF) model integrating local gradient and global similarity approaches. Using task-fMRI and rs-fMRI across diverse acquisition protocols, we found gwMRF parcellations to be more homogeneous than 4 previously published parcellations. Furthermore, gwMRF parcellations agreed with the boundaries of certain cortical areas defined using histology and visuotopic fMRI. Some parcels captured subareal (somatotopic and visuotopic) features that likely reflect distinct computational units within known cortical areas. These results suggest that gwMRF parcellations reveal neurobiologically meaningful features of brain organization and are potentially useful for future applications requiring dimensionality reduction of voxel-wise fMRI data. Multiresolution parcellations generated from 1489 participants are publicly available (https://github.com/ThomasYeoLab/CBIG/tree/master/stable_projects/brain_parcellation/Schaefer2018_LocalGlobal).

Emergence of symmetry selectivity in the visual areas of the human brain: fMRI responses to symmetry presented in both frontoparallel and slanted planes

Symmetry is effortlessly perceived by humans across changes in viewing geometry. Here, we re-examined the network subserving symmetry processing in the context of up-to-date retinotopic definitions of visual areas. Responses in object selective cortex, as defined by functional localizers, were also examined. We further examined responses to both frontoparallel and slanted symmetry while manipulating attention both toward and away from symmetry. Symmetry-specific responses first emerge in V3 and continue across all downstream areas examined. Of the retinotopic areas, ventral occipital VO1 showed the strongest symmetry response, which was similar in magnitude to the responses observed in object selective cortex. Neural responses were found to increase with both the coherence and folds of symmetry. Compared to passive viewing, drawing attention to symmetry generally increased neural responses and the correspondence of these neural responses with psychophysical performance. Examining symmetry on the slanted plane found responses to again emerge in V3, continue through downstream visual cortex, and be strongest in VO1 and LOB. Both slanted and frontoparallel symmetry evoked similar activity when participants performed a symmetry-related task. However, when a symmetry-unrelated task was performed, fMRI responses to slanted symmetry were reduced relative to their frontoparallel counterparts. These task-related changes provide a neural signature that suggests slant has to be computed ahead of symmetry being appropriately extracted, known as the "normalization" account of symmetry processing. Specifically, our results suggest that normalization occurs naturally when attention is directed toward symmetry and orientation, but becomes interrupted when attention is directed away from these features.

A Retinotopic Spiking Neural Network System for Accurate Recognition of Moving Objects Using NeuCube and Dynamic Vision Sensors

This paper introduces a new system for dynamic visual recognition that combines bio-inspired hardware with a brain-like spiking neural network. The system is designed to take data from a dynamic vision sensor (DVS) that simulates the functioning of the human retina by producing an address event output (spike trains) based on the movement of objects. The system then convolutes the spike trains and feeds them into a brain-like spiking neural network, called NeuCube, which is organized in a three-dimensional manner, representing the organization of the primary visual cortex. Spatio-temporal patterns of the data are learned during a deep unsupervised learning stage, using spike-timing-dependent plasticity. In a second stage, supervised learning is performed to train the network for classification tasks. The convolution algorithm and the mapping into the network mimic the function of retinal ganglion cells and the retinotopic organization of the visual cortex. The NeuCube architecture can be used to visualize the deep connectivity inside the network before, during, and after training and thereby allows for a better understanding of the learning processes. The method was tested on the benchmark MNIST-DVS dataset and achieved a classification accuracy of 92.90%. The paper discusses advantages and limitations of the new method and concludes that it is worth exploring further on different datasets, aiming for advances in dynamic computer vision and multimodal systems that integrate visual, aural, tactile, and other kinds of information in a biologically plausible way.

Development of Concurrent Retinotopic Maps in the Fly Motion Detection Circuit

Understanding how complex brain wiring is produced during development is a daunting challenge. In Drosophila, information from 800 retinal ommatidia is processed in distinct brain neuropiles, each subdivided into 800 matching retinotopic columns. The lobula plate comprises four T4 and four T5 neuronal subtypes. T4 neurons respond to bright edge motion, whereas T5 neurons respond to dark edge motion. Each is tuned to motion in one of the four cardinal directions, effectively establishing eight concurrent retinotopic maps to support wide-field motion. We discovered a mode of neurogenesis where two sequential Notch-dependent divisions of either a horizontal or a vertical progenitor produce matching sets of two T4 and two T5 neurons retinotopically coincident with pairwise opposite direction selectivity. We show that retinotopy is an emergent characteristic of this neurogenic program and derives directly from neuronal birth order. Our work illustrates how simple developmental rules can implement complex neural organization.

Spatial elongation of population receptive field profiles revealed by model-free fMRI back-projection

Estimates of visual field topographies in human visual cortex obtained through fMRI traveling wave techniques usually provide the parameters of population receptive field (pRF) location (polar angle, eccentricity) and receptive field size. These parameters are obtained by fitting the recorded data to a standard model population receptive field. In this work, pRF profiles are measured directly by back-projecting preprocessed fMRI time-series to sweeps of a bar across the visual field in different angles. The current data suggest that the model-free pRF profiles contain information not only about receptive field location and size but also about the pRF shape characteristics. The elongation (ellipticity) of pRFs decreases along the early visual hierarchy to a different degree for the ventral and the dorsal stream. Furthermore, ellipticity changes as a function of eccentricity. pRF orientation shows a high degree of collinearity with its angular position within the visual field. Using model-free pRF measurements, the traveling wave technique provides additional characteristics of pRF topographies that are not restricted to size and provide robust measures within the single subject.

Differential Sampling of Visual Space in Ventral and Dorsal Early Visual Cortex

A fundamental feature of cortical visual processing is the separation of visual processing for the upper and lower visual fields. In early visual cortex (EVC), the upper visual field is processed ventrally, with the lower visual field processed dorsally. This distinction persists into several category-selective regions of occipitotemporal cortex, with ventral and lateral scene-, face-, and object-selective regions biased for the upper and lower visual fields, respectively. Here, using an elliptical population receptive field (pRF) model, we systematically tested the sampling of visual space within ventral and dorsal divisions of human EVC in both male and female participants. We found that (1) pRFs tend to be elliptical and oriented toward the fovea with distinct angular distributions for ventral and dorsal divisions of EVC, potentially reflecting a radial bias; and (2) pRFs in ventral areas were larger (∼1.5×) and more elliptical (∼1.2×) than those in dorsal areas. These differences potentially reflect a tendency for receptive fields in ventral temporal cortex to overlap the fovea with less emphasis on precise localization and isotropic representation of space compared with dorsal areas. Collectively, these findings suggest that ventral and dorsal divisions of EVC sample visual space differently, likely contributing to and/or stemming from the functional differentiation of visual processing observed in higher-level regions of the ventral and dorsal cortical visual pathways.SIGNIFICANCE STATEMENT The processing of visual information from the upper and lower visual fields is separated in visual cortex. Although ventral and dorsal divisions of early visual cortex (EVC) are commonly assumed to sample visual space equivalently, we demonstrate systematic differences using an elliptical population receptive field (pRF) model. Specifically, we demonstrate that (1) ventral and dorsal divisions of EVC exhibit diverging distributions of pRF angle, which are biased toward the fovea; and (2) ventral pRFs exhibit higher aspect ratios and cover larger areas than dorsal pRFs. These results suggest that ventral and dorsal divisions of EVC sample visual space differently and that such differential sampling likely contributes to different functional roles attributed to the ventral and dorsal pathways, such as object recognition and visually guided attention, respectively.