The visual field representation in striate cortex of the macaque monkey: asymmetries, anisotropies, and individual variability

A virtual patient simulation modeling the neural and perceptual effects of human visual cortical stimulation, from pulse trains to percepts

The field of cortical sight restoration prostheses is making rapid progress with three clinical trials of visual cortical prostheses underway. However, as yet, we have only limited insight into the perceptual experiences produced by these implants. Here we describe a computational model or 'virtual patient', based on the neurophysiological architecture of V1, which successfully predicts the perceptual experience of participants across a wide range of previously published human cortical stimulation studies describing the location, size, brightness and spatiotemporal shape of electrically induced percepts in humans. Our simulations suggest that, in the foreseeable future the perceptual quality of cortical prosthetic devices is likely to be limited by the neurophysiological organization of visual cortex, rather than engineering constraints.

Reconfiguration of the visual code and retinal cell type complement in closely related diurnal and nocturnal mice

How does evolution act on neuronal populations to match computational characteristics to functional demands? We address this problem by comparing visual code and retinal cell composition in closely related murid species with different behaviours. Rhabdomys pumilio are diurnal and have substantially thicker inner retina and larger visual thalamus than nocturnal Mus musculus. High-density electrophysiological recordings of visual response features in the dorsal lateral geniculate nucleus (dLGN) reveals that Rhabdomys attains higher spatiotemporal acuity both by denser coverage of the visual scene and a selective expansion of elements of the code characterised by non-linear spatiotemporal summation. Comparative analysis of single cell transcriptomic cell atlases reveals that realignment of the visual code is associated with increased relative abundance of bipolar and ganglion cell types supporting OFF and ON-OFF responses. These findings demonstrate how changes in retinal cell complement can reconfigure the coding of visual information to match changes in visual needs.

Topographic organization across foveal visual areas in macaques

Introduction

While the fovea on the retina covers only a small region of the visual field, a significant portion of the visual cortex is dedicated to processing information from the fovea being a critical center for object recognition, motion control, and visually guided attention. Despite its importance, prior functional imaging studies in awake monkeys often focused on the parafoveal visual field, potentially leading to inaccuracies in understanding the brain structure underlying function.

Methods

In this study, our aim is to unveil the neuronal connectivity and topography in the foveal visual cortex in comparison to the parafoveal visual cortex. Using four different types of retrograde tracers, we selectively injected them into the striate cortex (V1) or V4, encompassing the regions between the fovea and parafovea.

Results

V1 and V4 exhibited intense mutual connectivity in the foveal visual field, in contrast to the parafoveal visual field, possibly due to the absence of V3 in the foveal visual field. While previous live brain imaging studies failed to reveal retinotopy in the foveal visual fields, our results indicate that the foveal visual fields have continuous topographic connectivity across V1 through V4, as well as the parafoveal visual fields. Although a simple extension of the retinotopic isoeccentricity maps from V1 to V4 has been suggested from previous fMRI studies, our study demonstrated that V3 and V4 possess gradually smaller topographic maps compared to V1 and V2. Feedback projections to foveal V1 primarily originate from the infragranular layers of foveal V2 and V4, while feedforward projections to foveal V4 arise from both supragranular and infragranular layers of foveal V1 and V2, consistent with previous findings in the parafoveal visual fields.

Discussion

This study provides valuable insights into the connectivity of the foveal visual cortex, which was ambiguous in previous imaging studies.

Mesoscopic calcium imaging in a head-unrestrained male non-human primate using a lensless microscope

Mesoscopic calcium imaging enables studies of cell-type specific neural activity over large areas. A growing body of literature suggests that neural activity can be different when animals are free to move compared to when they are restrained. Unfortunately, existing systems for imaging calcium dynamics over large areas in non-human primates (NHPs) are table-top devices that require restraint of the animal's head. Here, we demonstrate an imaging device capable of imaging mesoscale calcium activity in a head-unrestrained male non-human primate. We successfully miniaturize our system by replacing lenses with an optical mask and computational algorithms. The resulting lensless microscope can fit comfortably on an NHP, allowing its head to move freely while imaging. We are able to measure orientation columns maps over a 20 mm2 field-of-view in a head-unrestrained macaque. Our work establishes mesoscopic imaging using a lensless microscope as a powerful approach for studying neural activity under more naturalistic conditions.

Mammals Achieve Common Neural Coverage of Visual Scenes Using Distinct Sampling Behaviors

Most vertebrates use head and eye movements to quickly change gaze orientation and sample different portions of the environment with periods of stable fixation. Visual information must be integrated across fixations to construct a complete perspective of the visual environment. In concert with this sampling strategy, neurons adapt to unchanging input to conserve energy and ensure that only novel information from each fixation is processed. We demonstrate how adaptation recovery times and saccade properties interact and thus shape spatiotemporal tradeoffs observed in the motor and visual systems of mice, cats, marmosets, macaques, and humans. These tradeoffs predict that in order to achieve similar visual coverage over time, animals with smaller receptive field sizes require faster saccade rates. Indeed, we find comparable sampling of the visual environment by neuronal populations across mammals when integrating measurements of saccadic behavior with receptive field sizes and V1 neuronal density. We propose that these mammals share a common statistically driven strategy of maintaining coverage of their visual environment over time calibrated to their respective visual system characteristics.

Alterations to foveal crowding with microsaccade preparation

Visual stimuli presented around the time of a saccade have been shown to be perceived differently by the visual system, including a reduction in the harmful impact of flankers (crowding). However, whether the effects observed are due strictly to crowding remains controversial, and the effects have only been measured with large saccades in peripheral vision. Here we investigate how crowded stimuli placed 20 arc minutes from the center of gaze are affected by an upcoming microsaccade. The stimulus consisted of a rotated T of size 6.25 arcminutes that was either unflanked, surrounded by four flankers (Experiment 1), or surrounded by two flankers that were positioned either radially or tangentially (Experiments 2 and 3). In 80 % of trials, subjects made voluntary microsaccades to the target when cued, and in the remaining 20 % of the trials subjects continued to maintain fixation. In Experiments 1 and 2, subjects were required to saccade to the same location as the target, while in Experiment 3 subjects saccaded to a different location ∼ 20 arc min to the upper left of the target. Thus, we provide evidence for two separable pre-saccadic benefits for crowded parafoveal targets: one isotropizes the crowding zone for stimuli presented 200 to 125 ms before microsaccadic onset, and another provides a benefit exclusively for microsaccade targets surrounded by tangential flankers in the presence of imminent microsaccades. Two possible mechanisms are attentional enhancement and predictive remapping of receptive fields, respectively.

Pinging the brain to reveal the hidden attentional priority map using encephalography

Attention has been usefully thought of as organized in priority maps - putative maps of space where attentional priority is weighted across spatial regions in a winner-take-all competition for attentional deployment. Recent work has highlighted the influence of past experiences on the weighting of spatial priority - called selection history. Aside from being distinct from more well-studied, top-down forms of attentional enhancement, little is known about the neural substrates of history-mediated attentional priority. Using a task known to induce statistical learning of target distributions, in an EEG study we demonstrate that this otherwise invisible, latent attentional priority map can be visualized during the intertrial period using a 'pinging' technique in conjunction with multivariate pattern analyses. Our findings not only offer a method of visualizing the history-mediated attentional priority map, but also shed light on the underlying mechanisms allowing our past experiences to influence future behavior.

A 2D Synthesized Image Improves the 3D Search for Foveated Visual Systems

Current medical imaging increasingly relies on 3D volumetric data making it difficult for radiologists to thoroughly search all regions of the volume. In some applications (e.g., Digital Breast Tomosynthesis), the volumetric data is typically paired with a synthesized 2D image (2D-S) generated from the corresponding 3D volume. We investigate how this image pairing affects the search for spatially large and small signals. Observers searched for these signals in 3D volumes, 2D-S images, and while viewing both. We hypothesize that lower spatial acuity in the observers' visual periphery hinders the search for the small signals in the 3D images. However, the inclusion of the 2D-S guides eye movements to suspicious locations, improving the observer's ability to find the signals in 3D. Behavioral results show that the 2D-S, used as an adjunct to the volumetric data, improves the localization and detection of the small (but not large) signal compared to 3D alone. There is a concomitant reduction in search errors as well. To understand this process at a computational level, we implement a Foveated Search Model (FSM) that executes human eye movements and then processes points in the image with varying spatial detail based on their eccentricity from fixations. The FSM predicts human performance for both signals and captures the reduction in search errors when the 2D-S supplements the 3D search. Our experimental and modeling results delineate the utility of 2D-S in 3D search-reduce the detrimental impact of low-resolution peripheral processing by guiding attention to regions of interest, effectively reducing errors.

Mammals achieve common neural coverage of visual scenes using distinct sampling behaviors

Most vertebrates use head and eye movements to quickly change gaze orientation and sample different portions of the environment with periods of stable fixation. Visual information must be integrated across several fixations to construct a more complete perspective of the visual environment. In concert with this sampling strategy, neurons adapt to unchanging input to conserve energy and ensure that only novel information from each fixation is processed. We demonstrate how adaptation recovery times and saccade properties interact, and thus shape spatiotemporal tradeoffs observed in the motor and visual systems of different species. These tradeoffs predict that in order to achieve similar visual coverage over time, animals with smaller receptive field sizes require faster saccade rates. Indeed, we find comparable sampling of the visual environment by neuronal populations across mammals when integrating measurements of saccadic behavior with receptive field sizes and V1 neuronal density. We propose that these mammals share a common statistically driven strategy of maintaining coverage of their visual environment over time calibrated to their respective visual system characteristics.

Polar angle asymmetries in visual perception and neural architecture

Human visual performance changes with visual field location. It is best at the center of gaze and declines with eccentricity, and also varies markedly with polar angle. These perceptual polar angle asymmetries are linked to asymmetries in the organization of the visual system. We review and integrate research quantifying how performance changes with visual field location and how this relates to neural organization at multiple stages of the visual system. We first briefly review how performance varies with eccentricity and the neural foundations of this effect. We then focus on perceptual polar angle asymmetries and their neural foundations. Characterizing perceptual and neural variations across and around the visual field contributes to our understanding of how the brain translates visual signals into neural representations which form the basis of visual perception.

Functional topography of pulvinar-visual cortex networks in macaques revealed by INS-fMRI

The pulvinar in the macaque monkey contains three divisions: the medial pulvinar (PM), the lateral pulvinar (PL), and the inferior pulvinar (PI). Anatomical studies have shown that connections of PM are preferentially distributed to higher association areas, those of PL are biased toward the ventral visual pathway, and those of PI are biased with the dorsal visual pathway. To study functional connections of the pulvinar at mesoscale, we used a novel method called INS-fMRI (infrared neural stimulation and functional magnetic resonance imaging). This method permits studies and comparisons of multiple pulvinar networks within single animals. As previously revealed, stimulations of different sites in PL and PI produced topographically organized focal activations in visual areas V1, V2, and V3. In contrast, PM stimulation elicited little or diffuse response. The relative activations of areas V1, V2, V3A, V3d, V3v, V4, MT, and MST revealed that connections of PL are biased to ventral pathway areas, and those of PI are biased to dorsal areas. Different statistical values of activated blood-oxygen-level-dependent responses produced the same center of activation, indicating stability of connectivity; it also suggests possible dynamics of broad to focal responses from single stimulation sites. These results demonstrate that infrared neural stimulation-induced connectivity is largely consistent with previous anatomical connectivity studies, thereby demonstrating validity of our novel method. In addition, it suggests additional interpretations of functional connectivity to complement anatomical studies.

Distractor-evoked deviation in saccade direction suggests an asymmetric representation of the upper and lower visual fields on oculomotor maps

The programming of rapid eye movements or "saccades" involves a large collection of neural substrates. The subcortical oculomotor center - the superior colliculus (SC) - contains a topographical motor map that encodes saccade vectors. Using a visual distractor task, the present study examined a classic model of the SC motor map, which assumes a symmetrical representation of the upper visual field (UVF) and lower visual field (LVF). Visual distractors are known to attract or repel the saccade trajectory, depending on their angular distance from the target. In the present study, the distractor (if presented) was placed at a location that mirrored the target in the opposite visual field (upper or lower). The symmetrical SC model predicts equivalent directional deviations for saccades into the UVF and LVF. The results, however, showed that the directional deviations evoked by visual distractors were much stronger for saccades directed to the LVF. We argue that this observation is consistent with the recent neurophysiological finding that the LVF is relatively under-represented, as compared to the UVF, in the SC and possibly in other oculomotor centers. We conclude the paper with a suggested revision to the SC model.

Cortical magnification eliminates differences in contrast sensitivity across but not around the visual field

Human visual performance changes dramatically both across (eccentricity) and around (polar angle) the visual field. Performance is better at the fovea, decreases with eccentricity, and is better along the horizontal than vertical meridian and along the lower than the upper vertical meridian. However, all neurophysiological and virtually all behavioral studies of cortical magnification have investigated eccentricity effects without considering polar angle. Most performance differences due to eccentricity are eliminated when stimulus size is cortically magnified (M-scaled) to equate the size of its cortical representation in primary visual cortex (V1). But does cortical magnification underlie performance differences around the visual field? Here, to assess contrast sensitivity, human adult observers performed an orientation discrimination task with constant stimulus size at different locations as well as when stimulus size was M-scaled according to stimulus eccentricity and polar angle location. We found that although M-scaling stimulus size eliminates differences across eccentricity, it does not eliminate differences around the polar angle. This finding indicates that limits in contrast sensitivity across eccentricity and around polar angle of the visual field are mediated by different anatomical and computational constraints.

Visually evoked potentials (VEPs) across the visual field in hearing and deaf cats

Introduction

Congenitally deaf cats perform better on visual localization tasks than hearing cats, and this advantage has been attributed to the posterior auditory field. Successful visual localization requires both visual processing of the target and timely generation of an action to approach the target. Activation of auditory cortex in deaf subjects during visual localization in the peripheral visual field can occur either via bottom-up stimulus-driven and/or top-down goal-directed pathways.

Methods

In this study, we recorded visually evoked potentials (VEPs) in response to a reversing checkerboard stimulus presented in the hemifield contralateral to the recorded hemisphere in both hearing and deaf cats under light anesthesia.

Results

Although VEP amplitudes and latencies were systematically modulated by stimulus eccentricity, we found little evidence of changes in VEP in deaf cats that can explain their behavioral advantage. A statistical trend was observed, showing larger peak amplitudes and shorter peak latencies in deaf subjects for stimuli in the near- and mid-peripheral field. Additionally, latency of the P1 wave component had a larger inter-sweep variation in deaf subjects.

Discussion

Our results suggested that cross-modal plasticity following deafness does not play a major part in cortical processing of the peripheral visual field when the "vision for action" system is not recruited.

Feature representation under crowding in macaque V1 and V4 neuronal populations

Visual perception depends strongly on spatial context. A profound example is visual crowding, whereby the presence of nearby stimuli impairs the discriminability of object features. Despite extensive work on perceptual crowding and the spatial integrative properties of visual cortical neurons, the link between these two aspects of visual processing remains unclear. To understand better the neural basis of crowding, we recorded activity simultaneously from neuronal populations in V1 and V4 of fixating macaque monkeys. We assessed the information available from the measured responses about the orientation of a visual target both for targets presented in isolation and amid distractors. Both single neuron and population responses had less information about target orientation when distractors were present. Information loss was moderate in V1 and more substantial in V4. Information loss could be traced to systematic divisive and additive changes in neuronal tuning. Additive and multiplicative changes in tuning were more severe in V4; in addition, tuning exhibited other, non-affine transformations that were greater in V4, further restricting the ability of a fixed sensory readout strategy to extract accurate feature information across displays. Our results provide a direct test of crowding effects at different stages of the visual hierarchy. They reveal how crowded visual environments alter the spiking activity of cortical populations by which sensory stimuli are encoded and connect these changes to established mechanisms of neuronal spatial integration.

Cortical adaptation of the night monkey to a nocturnal niche environment: a comparative non-invasive T1w/T2w myelin study

Night monkeys (Aotus) are the only genus of monkeys within the Simian lineage that successfully occupy a nocturnal environmental niche. Their behavior is supported by their sensory organs' distinctive morphological features; however, little is known about their evolutionary adaptations in sensory regions of the cerebral cortex. Here, we investigate this question by exploring the cortical organization of night monkeys using high-resolution in-vivo brain MRI and comparative cortical-surface T1w/T2w myeloarchitectonic mapping. Our results show that the night monkey cerebral cortex has a qualitatively similar but quantitatively different pattern of cortical myelin compared to the diurnal macaque and marmoset monkeys. T1w/T2w myelin and its gradient allowed us to parcellate high myelin areas, including the middle temporal complex (MT +) and auditory cortex, and a low-myelin area, Brodmann area 7 (BA7) in the three species, despite species differences in cortical convolutions. Relative to the total cortical-surface area, those of MT + and the auditory cortex are significantly larger in night monkeys than diurnal monkeys, whereas area BA7 occupies a similar fraction of the cortical sheet in all three species. We propose that the selective expansion of sensory areas dedicated to visual motion and auditory processing in night monkeys may reflect cortical adaptations to a nocturnal environment.

Variability of the Surface Area of the V1, V2, and V3 Maps in a Large Sample of Human Observers

How variable is the functionally defined structure of early visual areas in human cortex and how much variability is shared between twins? Here we quantify individual differences in the best understood functionally defined regions of cortex: V1, V2, V3. The Human Connectome Project 7T Retinotopy Dataset includes retinotopic measurements from 181 subjects (109 female, 72 male), including many twins. We trained four "anatomists" to manually define V1-V3 using retinotopic features. These definitions were more accurate than automated anatomical templates and showed that surface areas for these maps varied more than threefold across individuals. This threefold variation was little changed when normalizing visual area size by the surface area of the entire cerebral cortex. In addition to varying in size, we find that visual areas vary in how they sample the visual field. Specifically, the cortical magnification function differed substantially among individuals, with the relative amount of cortex devoted to central vision varying by more than a factor of 2. To complement the variability analysis, we examined the similarity of visual area size and structure across twins. Whereas the twin sample sizes are too small to make precise heritability estimates (50 monozygotic pairs, 34 dizygotic pairs), they nonetheless reveal high correlations, consistent with strong effects of the combination of shared genes and environment on visual area size. Collectively, these results provide the most comprehensive account of individual variability in visual area structure to date, and provide a robust population benchmark against which new individuals and developmental and clinical populations can be compared.SIGNIFICANCE STATEMENT Areas V1, V2, and V3 are among the best studied functionally defined regions in human cortex. Using the largest retinotopy dataset to date, we characterized the variability of these regions across individuals and the similarity between twin pairs. We find that the size of visual areas varies dramatically (up to 3.5×) across healthy young adults, far more than the variability of the cerebral cortex size as a whole. Much of this variability appears to arise from inherited factors, as we find very high correlations in visual area size between monozygotic twin pairs, and lower but still substantial correlations between dizygotic twin pairs. These results provide the most comprehensive assessment of how functionally defined visual cortex varies across the population to date.

Visual field asymmetries in numerosity processing

A small number of objects can be rapidly and accurately enumerated, whereas a larger number of objects can only be approximately enumerated. These subitizing and estimation abilities, respectively, are both spatial processes relying on extracting information across spatial locations. Nevertheless, whether and how these processes vary across visual field locations remains unknown. Here, we examined if enumeration displays asymmetries around the visual field. Experiment 1 tested small number (1–6) enumeration at cardinal and non-cardinal peripheral locations while manipulating the spacing among the objects. Experiment 2 examined enumeration at cardinal locations in more detail while minimising crowding. Both experiments demonstrated a Horizontal-Vertical Asymmetry (HVA) where performance was better along the horizontal axis relative to the vertical. Experiment 1 found that this effect was modulated by spacing with stronger asymmetry at closer spacing. Experiment 2 revealed further asymmetries: a Vertical Meridian Asymmetry (VMA) with better enumeration on the lower vertical meridian than on the upper and a Horizontal Meridian Asymmetry (HMA) with better enumeration along the left horizontal meridian than along the right. All three asymmetries were evident for both subitizing and estimation. HVA and VMA have been observed in a range of visual tasks, indicating that they might be inherited from early visual constraints. However, HMA is observed primarily in mid-level tasks, often involving attention. These results suggest that while enumeration processes can be argued to inherit low-level visual constraints, the findings are, parsimoniously, consistent with visual attention playing a role in both subitizing and estimation.

Cascaded normalizations for spatial integration in the primary visual cortex of primates

Spatial integration of visual information is an important function in the brain. However, neural computation for spatial integration in the visual cortex remains unclear. In this study, we recorded laminar responses in V1 of awake monkeys driven by visual stimuli with grating patches and annuli of different sizes. We find three important response properties related to spatial integration that are significantly different between input and output layers: neurons in output layers have stronger surround suppression, smaller receptive field (RF), and higher sensitivity to grating annuli partially covering their RFs. These interlaminar differences can be explained by a descriptive model composed of two global divisions (normalization) and a local subtraction. Our results suggest suppressions with cascaded normalizations (CNs) are essential for spatial integration and laminar processing in the visual cortex. Interestingly, the features of spatial integration in convolutional neural networks, especially in lower layers, are different from our findings in V1.

Severe distortion in the representation of foveal visual image locations in short-term memory

The foveal visual image region provides the human visual system with the highest acuity. However, it is unclear whether such a high fidelity representational advantage is maintained when foveal image locations are committed to short-term memory. Here, we describe a paradoxically large distortion in foveal target location recall by humans. We briefly presented small, but high contrast, points of light at eccentricities ranging from 0.1 to 12°, while subjects maintained their line of sight on a stable target. After a brief memory period, the subjects indicated the remembered target locations via computer controlled cursors. The biggest localization errors, in terms of both directional deviations and amplitude percentage overshoots or undershoots, occurred for the most foveal targets, and such distortions were still present, albeit with qualitatively different patterns, when subjects shifted their gaze to indicate the remembered target locations. Foveal visual images are severely distorted in short-term memory.

Linking individual differences in human primary visual cortex to contrast sensitivity around the visual field

A central question in neuroscience is how the organization of cortical maps relates to perception, for which human primary visual cortex (V1) is an ideal model system. V1 nonuniformly samples the retinal image, with greater cortical magnification (surface area per degree of visual field) at the fovea than periphery and at the horizontal than vertical meridian. Moreover, the size and cortical magnification of V1 varies greatly across individuals. Here, we used fMRI and psychophysics in the same observers to quantify individual differences in V1 cortical magnification and contrast sensitivity at the four polar angle meridians. Across observers, the overall size of V1 and localized cortical magnification positively correlated with contrast sensitivity. Moreover, greater cortical magnification and higher contrast sensitivity at the horizontal than the vertical meridian were strongly correlated. These data reveal a link between cortical anatomy and visual perception at the level of individual observer and stimulus location.

Intra-Areal Visual Topography in Primate Brains Mapped with Probabilistic Tractography of Diffusion-Weighted Imaging

Noninvasive diffusion-weighted magnetic resonance imaging (dMRI) can be used to map the neural connectivity between distinct areas in the intact brain, but the standard resolution achieved fundamentally limits the sensitivity of such maps. We investigated the sensitivity and specificity of high-resolution postmortem dMRI and probabilistic tractography in rhesus macaque brains to produce retinotopic maps of the lateral geniculate nucleus (LGN) and extrastriate cortical visual area V5/MT based on their topographic connections with the previously established functional retinotopic map of primary visual cortex (V1). We also replicated the differential connectivity of magnocellular and parvocellular LGN compartments with V1 across visual field positions. Predicted topographic maps based on dMRI data largely matched the established retinotopy of both LGN and V5/MT. Furthermore, tractography based on in vivo dMRI data from the same macaque brains acquired at standard field strength (3T) yielded comparable topographic maps in many cases. We conclude that tractography based on dMRI is sensitive enough to reveal the intrinsic organization of ordered connections between topographically organized neural structures and their resultant functional organization.

Crowding changes appearance systematically in peripheral, amblyopic, and developing vision

Visual crowding is the disruptive effect of clutter on object recognition. Although most prominent in adult peripheral vision, crowding also disrupts foveal vision in typically developing children and those with strabismic amblyopia. Do these crowding effects share the same mechanism? Here we exploit observations that crowded errors in peripheral vision are not random: Target objects appear either averaged with the flankers (assimilation) or replaced by them (substitution). If amblyopic and developmental crowding share the same mechanism, then their errors should be similarly systematic. We tested foveal vision in children aged 3 to 8 years with typical vision or strabismic amblyopia and peripheral vision in typical adults. The perceptual effects of crowding were measured by requiring observers to adjust a reference stimulus to match the perceived orientation of a target “Vac-Man” element. When the target was surrounded by flankers that differed by ± 30°, all three groups (adults and children with typical or amblyopic vision) reported orientations between the target and flankers (assimilation). Errors were reduced with ± 90° differences but primarily matched the flanker orientation (substitution) when they did occur. A population pooling model of crowding successfully simulated this pattern of errors in all three groups. We conclude that the perceptual effects of amblyopic and developing crowding are systematic and resemble the near periphery in adults, suggesting a common underlying mechanism.

The retrocalcarine sulcus maps different retinotopic representations in macaques and humans

Primate cerebral cortex is highly convoluted with much of the cortical surface buried in sulcal folds. The origins of cortical folding and its functional relevance have been a major focus of systems and cognitive neuroscience, especially when considering stereotyped patterns of cortical folding that are shared across individuals within a primate species and across multiple species. However, foundational questions regarding organizing principles shared across species remain unanswered. Taking a cross-species comparative approach with a careful consideration of historical observations, we investigate cortical folding relative to primary visual cortex (area V1). We identify two macroanatomical structures-the retrocalcarine and external calcarine sulci-in 24 humans and 6 macaque monkeys. We show that within species, these sulci are identifiable in all individuals, fall on a similar part of the V1 retinotopic map, and thus, serve as anatomical landmarks predictive of functional organization. Yet, across species, the underlying eccentricity representations corresponding to these macroanatomical structures differ strikingly across humans and macaques. Thus, the correspondence between retinotopic representation and cortical folding for an evolutionarily old structure like V1 is species-specific and suggests potential differences in developmental and experiential constraints across primates.

On the cortical mapping function - Visual space, cortical space, and crowding

The retino-cortical visual pathway is retinotopically organized: Neighbourhood relationships on the retina are preserved in the mapping. Size relationships in that mapping are also highly regular: The size of a patch in the visual field that maps onto a cortical patch of fixed size follows, along any radius and over a wide range, simply a linear function with retinal eccentricity. As a consequence, the mapping of retinal to cortical locations follows a logarithmic function along that radius. While this has already been shown by Fischer (1973, Vision Research, 13, 2113-2120), the link between the linear function - which describes the local behaviour by the cortical magnification factor M - and the logarithmic location function for the global behaviour, has never been made explicit. The present paper provides such a link as a set of ready-to-use equations using Levi and Klein's E₂ nomenclature, and examples for their validity and applicability in the mapping literature are discussed. The equations allow estimating M in the retinotopic centre; values thus derived from the literature show enormous, hitherto unnoticed, variability. A new structural parameter, d₂, is proposed to characterize the cortical map, as a counterpart to E₂; it shows much more stability. One pitfall is discussed and spelt out, namely the common myth that a pure logarithmic function, without constant term, will give an adequate map. The correct equations are finally extended to describe the cortical map of Bouma's law on visual crowding. The result contradicts recent suggestions that critical crowding distance corresponds to constant cortical distance.

Quantitative characterization of the human retinotopic map based on quasiconformal mapping

The retinotopic map depicts the cortical neurons' response to visual stimuli on the retina and has contributed significantly to our understanding of human visual system. Although recent advances in high field functional magnetic resonance imaging (fMRI) have made it possible to generate the in vivo retinotopic map with great detail, quantifying the map remains challenging. Existing quantification methods do not preserve surface topology and often introduce large geometric distortions to the map. In this study, we developed a new framework based on computational conformal geometry and quasiconformal Teichmüller theory to quantify the retinotopic map. Specifically, we introduced a general pipeline, consisting of cortical surface conformal parameterization, surface-spline-based cortical activation signal smoothing, and vertex-wise Beltrami coefficient-based map description. After correcting most of the violations of the topological conditions, the result was a "Beltrami coefficient map" (BCM) that rigorously and completely characterizes the retinotopic map by quantifying the local quasiconformal mapping distortion at each visual field location. The BCM provided topological and fully reconstructable retinotopic maps. We successfully applied the new framework to analyze the V1 retinotopic maps from the Human Connectome Project (n=181), the largest state of the art retinotopy dataset currently available. With unprecedented precision, we found that the V1 retinotopic map was quasiconformal and the local mapping distortions were similar across observers. The new framework can be applied to other visual areas and retinotopic maps of individuals with and without eye diseases, and improve our understanding of visual cortical organization in normal and clinical populations.

A BCI-Based Study on the Relationship Between the SSVEP and Retinal Eccentricity in Overt and Covert Attention

Covert attention aids us in monitoring the environment and optimizing performance in visual tasks. Past behavioral studies have shown that covert attention can enhance spatial resolution. However, electroencephalography (EEG) activity related to neural processing between central and peripheral vision has not been systematically investigated. Here, we conducted an EEG study with 25 subjects who performed covert attentional tasks at different retinal eccentricities ranging from 0.75° to 13.90°, as well as tasks involving overt attention and no attention. EEG signals were recorded with a single stimulus frequency to evoke steady-state visual evoked potentials (SSVEPs) for attention evaluation. We found that the SSVEP response in fixating at the attended location was generally negatively correlated with stimulus eccentricity as characterized by Euclidean distance or horizontal and vertical distance. Moreover, more pronounced characteristics of SSVEP analysis were also acquired in overt attention than in covert attention. Furthermore, offline classification of overt attention, covert attention, and no attention yielded an average accuracy of 91.42%. This work contributes to our understanding of the SSVEP representation of attention in humans and may also lead to brain-computer interfaces (BCIs) that allow people to communicate with choices simply by shifting their attention to them.

Asymmetries around the visual field: From retina to cortex to behavior

Visual performance varies around the visual field. It is best near the fovea compared to the periphery, and at iso-eccentric locations it is best on the horizontal, intermediate on the lower, and poorest on the upper meridian. The fovea-to-periphery performance decline is linked to the decreases in cone density, retinal ganglion cell (RGC) density, and V1 cortical magnification factor (CMF) as eccentricity increases. The origins of polar angle asymmetries are not well understood. Optical quality and cone density vary across the retina, but recent computational modeling has shown that these factors can only account for a small percentage of behavior. Here, we investigate how visual processing beyond the cone photon absorptions contributes to polar angle asymmetries in performance. First, we quantify the extent of asymmetries in cone density, midget RGC density, and V1 CMF. We find that both polar angle asymmetries and eccentricity gradients increase from cones to mRGCs, and from mRGCs to cortex. Second, we extend our previously published computational observer model to quantify the contribution of phototransduction by the cones and spatial filtering by mRGCs to behavioral asymmetries. Starting with photons emitted by a visual display, the model simulates the effect of human optics, cone isomerizations, phototransduction, and mRGC spatial filtering. The model performs a forced choice orientation discrimination task on mRGC responses using a linear support vector machine classifier. The model shows that asymmetries in a decision maker's performance across polar angle are greater when assessing the photocurrents than when assessing isomerizations and are greater still when assessing mRGC signals. Nonetheless, the polar angle asymmetries of the mRGC outputs are still considerably smaller than those observed from human performance. We conclude that cone isomerizations, phototransduction, and the spatial filtering properties of mRGCs contribute to polar angle performance differences, but that a full account of these differences will entail additional contribution from cortical representations.

Population receptive fields in non-human primates from whole-brain fMRI and large-scale neurophysiology in visual cortex

Population receptive field (pRF) modeling is a popular fMRI method to map the retinotopic organization of the human brain. While fMRI-based pRF maps are qualitatively similar to invasively recorded single-cell receptive fields in animals, it remains unclear what neuronal signal they represent. We addressed this question in awake nonhuman primates comparing whole-brain fMRI and large-scale neurophysiological recordings in areas V1 and V4 of the visual cortex. We examined the fits of several pRF models based on the fMRI blood-oxygen-level-dependent (BOLD) signal, multi-unit spiking activity (MUA), and local field potential (LFP) power in different frequency bands. We found that pRFs derived from BOLD-fMRI were most similar to MUA-pRFs in V1 and V4, while pRFs based on LFP gamma power also gave a good approximation. fMRI-based pRFs thus reliably reflect neuronal receptive field properties in the primate brain. In addition to our results in V1 and V4, the whole-brain fMRI measurements revealed retinotopic tuning in many other cortical and subcortical areas with a consistent increase in pRF size with increasing eccentricity, as well as a retinotopically specific deactivation of default mode network nodes similar to previous observations in humans.

Microendoscopic calcium imaging of the primary visual cortex of behaving macaques

In vivo calcium imaging with genetically encoded indicators has recently been applied to macaque brains to monitor neural activities from a large population of cells simultaneously. Microendoscopic calcium imaging combined with implantable gradient index lenses captures neural activities from deep brain areas with a compact and convenient setup; however, this has been limited to rodents and marmosets. Here, we developed miniature fluorescent microscopy to image neural activities from the primary visual cortex of behaving macaques. We found tens of clear fluorescent signals from three of the six brain hemispheres. A subset of these neurons showed clear retinotopy and orientation tuning. Moreover, we successfully decoded the stimulus orientation and tracked the cells across days. These results indicate that microendoscopic calcium imaging is feasible and reasonable for investigating neural circuits in the macaque brain by monitoring fluorescent signals from a large number of neurons.

Occipital sleep spindles predict sequence learning in a visuo-motor task

STUDY OBJECTIVES

The brain appears to use internal models to successfully interact with its environment via active predictions of future events. Both internal models and the predictions derived from them are based on previous experience. However, it remains unclear how previously encoded information is maintained to support this function, especially in the visual domain. In the present study, we hypothesized that sleep consolidates newly encoded spatio-temporal regularities to improve predictions afterwards.

METHODS

We tested this hypothesis using a novel sequence-learning paradigm that aimed to dissociate perceptual from motor learning. We recorded behavioral performance and high-density electroencephalography (EEG) in male human participants during initial training and during testing two days later, following an experimental night of sleep (n = 16, including high-density EEG recordings) or wakefulness (n = 17).

RESULTS

Our results show sleep-dependent behavioral improvements correlated with sleep-spindle activity specifically over occipital cortices. Moreover, event-related potential (ERP) responses indicate a shift of attention away from predictable to unpredictable sequences after sleep, consistent with enhanced automaticity in the processing of predictable sequences.

CONCLUSIONS

These findings suggest a sleep-dependent improvement in the prediction of visual sequences, likely related to visual cortex reactivation during sleep spindles. Considering that controls in our experiments did not fully exclude oculomotor contributions, future studies will need to address the extent to which these effects depend on purely perceptual versus oculomotor sequence learning.

Cortical magnification in human visual cortex parallels task performance around the visual field

Human vision has striking radial asymmetries, with performance on many tasks varying sharply with stimulus polar angle. Performance is generally better on the horizontal than vertical meridian, and on the lower than upper vertical meridian, and these asymmetries decrease gradually with deviation from the vertical meridian. Here, we report cortical magnification at a fine angular resolution around the visual field. This precision enables comparisons between cortical magnification and behavior, between cortical magnification and retinal cell densities, and between cortical magnification in twin pairs. We show that cortical magnification in the human primary visual cortex, measured in 163 subjects, varies substantially around the visual field, with a pattern similar to behavior. These radial asymmetries in the cortex are larger than those found in the retina, and they are correlated between monozygotic twin pairs. These findings indicate a tight link between cortical topography and behavior, and suggest that visual field asymmetries are partly heritable.

Errors in visuospatial working memory across space and time

Visuospatial working memory (VSWM) involves cortical regions along the dorsal visual pathway, which are topographically organized with respect to the visual space. However, it remains unclear how such functional organization may constrain VSWM behavior across space and time. Here, we systematically mapped VSWM performance across the 2-dimensional (2D) space in various retention intervals in human subjects using the memory-guided and visually guided saccade tasks in two experiments. Relative to visually guided saccades, memory-guided saccades showed significant increases in unsystematic errors, or response variability, with increasing target eccentricity (3°-13° of visual angle). Unsystematic errors also increased with increasing delay (1.5-3 s, Experiment 1; 0.5-5 s, Experiment 2), while there was little or no interaction between delay and eccentricity. Continuous bump attractor modeling suggested neurophysiological and functional organization factors in the increasing unsystematic errors in VSWM across space and time. These findings indicate that: (1) VSWM representation may be limited by the functional topology of the visual pathway for the 2D space; (2) Unsystematic errors may reflect accumulated noise from memory maintenance while systematic errors may originate from non-mnemonic processes such as noisy sensorimotor transformation; (3) There may be independent mechanisms supporting the spatial and temporal processing of VSWM.

Multiple Visuotopically Organized Subdivisions of the Lateral Pulvinar/Central Lateral Inferior Pulvinar Project into Thin and Thick Stripe Compartments of V2 in Macaques

The lateral and central lateral inferior pulvinar (PL/PIcl) of primates has been implicated in playing an important role in visual processing, but its physiological and anatomical characteristics remain to be elucidated. It has been suggested that there are two complete visuotopic maps in the PL/PIcl, each of which sends afferents into V2 and V4 in primates. Given that functionally distinct thin and thick stripes of V2 both receive inputs from the PL/PIcl, this raises the possibility of a presence of parallel segregated pathways within the PL/PIcl. To address this question, we selectively injected three types of retrograde tracers (CTB-488, CTB-555, and BDA) into thin or thick stripes in V2 and examined labeling in the PL/PIcl in macaques. As a result, we found that every cluster of retrograde labeling in the PL/PIcl included all three types of signals next to each other, suggesting that thin stripe- and thick stripe-projecting compartments are not segregated into domains. Unexpectedly, we found at least five topographically organized retrograde labeling clusters in the PL/PIcl, indicating the presence of more than two V2-projecting maps. Our results suggest that the PL/PIcl exhibits greater compartmentalization than previously thought. They may be functionally similar but participate in multiple cortico-pulvinar-cortical loops.

Mouse visual cortex contains a region of enhanced spatial resolution

The representation of space in mouse visual cortex was thought to be relatively uniform. Here we reveal, using population receptive-field (pRF) mapping techniques, that mouse visual cortex contains a region in which pRFs are considerably smaller. This region, the “focea,” represents a location in space in front of, and slightly above, the mouse. Using two-photon imaging we show that the smaller pRFs are due to lower scatter of receptive-fields at the focea and an over-representation of binocular regions of space. We show that receptive-fields of single-neurons in areas LM and AL are smaller at the focea and that mice have improved visual resolution in this region of space. Furthermore, freely moving mice make compensatory eye-movements to hold this region in front of them. Our results indicate that mice have spatial biases in their visual processing, a finding that has important implications for the use of the mouse model of vision.

The representation of space in mouse visual cortex was considered to be relatively uniform. The authors show that mice have improved visual resolution in a cortical region representing a location in space directly in front and slightly above them, showing that the representation of space in mouse visual cortex is non-uniform.

MRI-based Parcellation and Morphometry of the Individual Rhesus Monkey Brain: the macaque Harvard-Oxford Atlas (mHOA), a translational system referencing a standardized ontology

Investigations of the rhesus monkey (Macaca mulatta) brain have shed light on the function and organization of the primate brain at a scale and resolution not yet possible in humans. A cornerstone of the linkage between non-human primate and human studies of the brain is magnetic resonance imaging, which allows for an association to be made between the detailed structural and physiological analysis of the non-human primate and that of the human brain. To further this end, we present a novel parcellation method and system for the rhesus monkey brain, referred to as the macaque Harvard-Oxford Atlas (mHOA), which is based on the human Harvard-Oxford Atlas (HOA) and grounded in an ontological and taxonomic framework. Consistent anatomical features were used to delimit and parcellate brain regions in the macaque, which were then categorized according to functional systems. This system of parcellation will be expanded with advances in technology and, like the HOA, will provide a framework upon which the results from other experimental studies (e.g., functional magnetic resonance imaging (fMRI), physiology, connectivity, graph theory) can be interpreted.

The Mechanism of Macular Sparing

Patients with homonymous hemianopia sometimes show preservation of the central visual fields, ranging up to 10°. This phenomenon, known as macular sparing, has sparked perpetual controversy. Two main theories have been offered to explain it. The first theory proposes a dual representation of the macula in each hemisphere. After loss of one occipital lobe, the back-up representation in the remaining occipital lobe is postulated to sustain ipsilateral central vision in the blind hemifield. This theory is supported by studies showing that some midline retinal ganglion cells project to the wrong hemisphere, presumably driving neurons in striate cortex that have ipsilateral receptive fields. However, more recent electrophysiological recordings and neuroimaging studies have cast doubt on this theory by showing only a minuscule ipsilateral field representation in early visual cortical areas. The second theory holds that macular sparing arises because the occipital pole, where the macula is represented, remains perfused after occlusion of the posterior cerebral artery because it receives collateral flow from the middle cerebral artery. An objection to this theory is that it cannot account for reports of macular sparing in patients after loss of an entire occipital lobe. On close scrutiny, such reports turn out to be erroneous, arising from inadequate control of fixation during visual field testing. Patients seem able to detect test stimuli on their blind side within the macula or along the vertical meridian because they make surveillance saccades. A purported treatment for hemianopia, called vision restoration therapy, is based on this error. The dual perfusion theory is supported by anatomical studies showing that the middle cerebral artery perfuses the occipital pole in many individuals. In patients with hemianopia from stroke, neuroimaging shows preservation of the occipital pole when macular sparing is present. The frontier dividing the infarcted territory of the posterior cerebral artery and the preserved territory of the middle cerebral artery is variable, but always falls within the representation of the macula, because the macula is so highly magnified. For physicians, macular sparing was an important neurological sign in acute hemianopia because it signified a posterior cerebral artery occlusion. Modern neuroimaging has supplanted the importance of that clinical sign but at the same time confirmed its validity. For patients, macular sparing remains important because it mitigates the impact of hemianopia and preserves the ability to read fluently. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Spatial receptive field structure of double-opponent cells in macaque V1

The spatial processing of color is important for visual perception. Double-opponent (DO) cells likely contribute to this processing by virtue of their spatially opponent and cone-opponent receptive fields (RFs). However, the representation of visual features by DO cells in the primary visual cortex of primates is unclear because the spatial structure of their RFs has not been fully characterized. To fill this gap, we mapped the RFs of DO cells in awake macaques with colorful, dynamic white noise patterns. The spatial RF of each neuron was fitted with a Gabor function and three versions of the difference of Gaussians (DoG) function. The Gabor function provided the more accurate description for most DO cells, a result that is incompatible with a center-surround RF organization. A nonconcentric version of the DoG function, in which the RFs have a circular center and a crescent-shaped surround, performed nearly as well as the Gabor model thus reconciling results from previous reports. For comparison, we also measured the RFs of simple cells. We found that the superiority of the Gabor fits over DoG fits was slightly more decisive for simple cells than for DO cells. The implications of these results on biological image processing and visual perception are discussed.NEW & NOTEWORTHY Double-opponent cells in macaque area V1 respond to spatial chromatic contrast in visual scenes. What information they carry is debated because their receptive field organization has not been characterized thoroughly. Using white noise analysis and statistical model comparisons, De and Horwitz show that many double-opponent receptive fields can be captured by either a Gabor model or a center-with-an-asymmetric-surround model but not by a difference of Gaussians model.

Asymmetries in visual acuity around the visual field

Human vision is heterogeneous around the visual field. At a fixed eccentricity, performance is better along the horizontal than the vertical meridian and along the lower than the upper vertical meridian. These asymmetric patterns, termed performance fields, have been found in numerous visual tasks, including those mediated by contrast sensitivity and spatial resolution. However, it is unknown whether spatial resolution asymmetries are confined to the cardinal meridians or whether and how far they extend into the upper and lower hemifields. Here, we measured visual acuity at isoeccentric peripheral locations (10 deg eccentricity), every 15° of polar angle. On each trial, observers judged the orientation (± 45°) of one of four equidistant, suprathreshold grating stimuli varying in spatial frequency (SF). On each block, we measured performance as a function of stimulus SF at 4 of 24 isoeccentric locations. We estimated the 75%-correct SF threshold, SF cutoff point (i.e., chance-level), and slope of the psychometric function for each location. We found higher SF estimates (i.e., better acuity) for the horizontal than the vertical meridian and for the lower than the upper vertical meridian. These asymmetries were most pronounced at the cardinal meridians and decreased gradually as the angular distance from the vertical meridian increased. This gradual change in acuity with polar angle reflected a shift of the psychometric function without changes in slope. The same pattern was found under binocular and monocular viewing conditions. These findings advance our understanding of visual processing around the visual field and help constrain models of visual perception.

Decision Signals in the Local Field Potentials of Early and Mid-Level Macaque Visual Cortex

The neural basis of perceptual decision making has typically been studied using measurements of single neuron activity, though decisions are likely based on the activity of large neuronal ensembles. Local field potentials (LFPs) may, in some cases, serve as a useful proxy for population activity and thus be useful for understanding the neural basis of perceptual decision making. However, little is known about whether LFPs in sensory areas include decision-related signals. We therefore analyzed LFPs recorded using two 48-electrode arrays implanted in primary visual cortex (V1) and area V4 of macaque monkeys trained to perform a fine orientation discrimination task. We found significant choice information in low (0-30 Hz) and higher (70-500 Hz) frequency components of the LFP, but little information in gamma frequencies (30-70 Hz). Choice information was more robust in V4 than V1 and stronger in LFPs than in simultaneously measured spiking activity. LFP-based choice information included a global component, common across electrodes within an area. Our findings reveal the presence of robust choice-related signals in the LFPs recorded in V1 and V4 and suggest that LFPs may be a useful complement to spike-based analyses of decision making.

Deep learning networks reflect cytoarchitectonic features used in brain mapping

The distribution of neurons in the cortex (cytoarchitecture) differs between cortical areas and constitutes the basis for structural maps of the human brain. Deep learning approaches provide a promising alternative to overcome throughput limitations of currently used cytoarchitectonic mapping methods, but typically lack insight as to what extent they follow cytoarchitectonic principles. We therefore investigated in how far the internal structure of deep convolutional neural networks trained for cytoarchitectonic brain mapping reflect traditional cytoarchitectonic features, and compared them to features of the current grey level index (GLI) profile approach. The networks consisted of a 10-block deep convolutional architecture trained to segment the primary and secondary visual cortex. Filter activations of the networks served to analyse resemblances to traditional cytoarchitectonic features and comparisons to the GLI profile approach. Our analysis revealed resemblances to cellular, laminar- as well as cortical area related cytoarchitectonic features. The networks learned filter activations that reflect the distinct cytoarchitecture of the segmented cortical areas with special regard to their laminar organization and compared well to statistical criteria of the GLI profile approach. These results confirm an incorporation of relevant cytoarchitectonic features in the deep convolutional neural networks and mark them as a valid support for high-throughput cytoarchitectonic mapping workflows.

Uniform spatial pooling explains topographic organization and deviation from receptive-field scale invariance in primate V1

Receptive field (RF) size and preferred spatial frequency (SF) vary greatly across the primary visual cortex (V1), increasing in a scale invariant fashion with eccentricity. Recent studies reveal that preferred SF also forms a fine-scale periodic map. A fundamental open question is how local variability in preferred SF is tied to the overall spatial RF. Here, we use two-photon imaging to simultaneously measure maps of RF size, phase selectivity, SF bandwidth, and orientation bandwidth—all of which were found to be topographically organized and correlate with preferred SF. Each of these newly characterized inter-map relationships strongly deviate from scale invariance, yet reveal a common motif—they are all accounted for by a model with uniform spatial pooling from scale invariant inputs. Our results and model provide novel and quantitative understanding of the output from V1 to downstream circuits.

Two-photon imaging in macaque V1 captured maps of tuning selectivity for four spatial parameters, all of which correlated with peak spatial frequency. These inter-map relationships reveal a common motif—they are described by uniform spatial pooling from a family of scale invariant Gabor receptive fields.

The Influence of the Stimulus Design on the Harmonic Components of the Steady-State Visual Evoked Potential

Steady-state visual evoked potentials (ssVEPs) are commonly used for functional objective diagnostics. In general, the main response at the stimulation frequency is used. However, some studies reported the main response at the second harmonic of the stimulation frequency. The aim of our study was to analyze the influence of the stimulus design on the harmonic components of ssVEPs. We studied 22 subjects (8 males, mean age ± SD = 27 ± 4.8 years) using a circular layout (r₁ = 0–1.6°, r₂ = 1.6–3.5°, r₃ = 3.5–6.4°, r₄ = 6.4–10.9°, and r₅ = 10.9–18°). At a given eccentricity, the stimulus was presented according to a 7.5 Hz square wave with 50% duty cycle. To analyze the influence of the stimulus eccentricity, a background luminance of 30 cd/m² was added to suppress foveal stray light effects; to analyze the influence of simultaneous foveal and peripheral stimulations, stimulations are performed without stray light suppression. For statistical analysis, medians M of the amplitude ratios for amplitudes at the second harmonic to the first harmonic and the probability of the occurrence of the main response at the second harmonic P(MCSH) are calculated. For stimulations with foveal stray light suppression, the medians were M_0–1.6° = 0.45, M_1.6–3.5° = 0.45, M_3.5–6.4° = 0.76, M_6.4–10.9° = 0.72, and M_10.9–18° = 0.48, and the probabilities were P_0–1.6°(MCSH) = 0.05, P_1.6–3.5°(MCSH) = 0.05, P_3.5–6.4°(MCSH) = 0.32, P_6.4–10.9°(MCSH) = 0.29, and P_10.9–18°(MCSH) = 0.30. For stimulations without foveal stray light suppression, the medians M were M_0–1.6° = 0.29, M_1.6–3.5° = 0.37, M_3.5–6.4° = 0.98, M_6.4–10.9° = 1.08, and M_10.9–18° = 1.24, and the probabilities were P_0–1.6°(MCSH) = 0.09, P_1.6–3.5°(MCSH) = 0.05, P_3.5–6.4°(MCSH) = 0.50, P_6.4–10.9°(MCSH) = 0.55, and P_10.9–18°(MCSH) = 0.55. In conclusion, the stimulus design has an influence on the harmonic components of ssVEPs. An increase in stimulation eccentricity during extrafoveal stimulation leads to a transition of the main response to the second harmonic. The effect is enhanced by a simultaneous foveal stimulation.

Optimized Signal Flow through Photoreceptors Supports the High-Acuity Vision of Primates

The fovea is a neural specialization that endows humans and other primates with the sharpest vision among mammals. This performance originates in the foveal cones, which are extremely narrow and long to form a high-resolution pixel array. Puzzlingly, this form is predicted to impede electrical conduction to an extent that appears incompatible with vision. We observe the opposite: signal flow through even the longest cones (0.4-mm axons) is essentially lossless. Unlike in most neurons, amplification and impulse generation by voltage-gated channels are dispensable. Rather, sparse channel activity preserves intracellular current, which flows as if unobstructed by organelles. Despite these optimizations, signaling would degrade if cones were lengthier. Because cellular packing requires that cone elongation accompanies foveal expansion, this degradation helps explain why the fovea is a constant, miniscule size despite multiplicative changes in eye size through evolution. These observations reveal how biophysical mechanisms tailor form-function relationships for primate behavioral performance.

Combining local and global evolutionary trajectories of brain-behaviour relationships through game theory

The study of the evolution of brain-behaviour relationships concerns understanding the causes and repercussions of cross- and within-species variability. Understanding such variability is a main objective of evolutionary and cognitive neuroscience, and it may help explaining the appearance of psychopathological phenotypes. Although brain evolution is related to the progressive action of selection and adaptation through multiple paths (e.g. mosaic vs. concerted evolution, metabolic vs. structural and functional constraints), a coherent, integrative framework is needed to combine evolutionary paths and neuroscientific evidence. Here, we review the literature on evolutionary pressures focusing on structural-functional changes and developmental constraints. Taking advantage of recent progress in neuroimaging and cognitive neuroscience, we propose a twofold hypothetical model of brain evolution. Within this model, global and local trajectories imply rearrangements of neural subunits and subsystems and of behavioural repertoires of a species, respectively. We incorporate these two processes in a game in which the global trajectory shapes the structural-functional neural substrates (i.e. players), while the local trajectory shapes the behavioural repertoires (i.e. stochastic payoffs).

Functional ultrasound imaging of deep visual cortex in awake nonhuman primates

Nowadays, several techniques exist to study and better understand how the brain works (fMRI, EEG, electrophysiology, etc.). Each has its own advantages and disadvantages (spatiotemporal resolution, maximal recording depth, signal-to-noise ratio, etc.). In this article, we show that the new functional ultrasound (fUS) imaging technique is appropriate to record and map brain activity in awake primates on a scale previously unreachable. It allows distinguishing patterns similar to ocular dominance bands in the visual cortex through all layers of the cortex, which was impossible before with common techniques. This paper demonstrates the utility of fUS imaging for studying brain activity in awake primates and its interest to all neuroscientists.

Deep regions of the brain are not easily accessible to investigation at the mesoscale level in awake animals or humans. We have recently developed a functional ultrasound (fUS) technique that enables imaging hemodynamic responses to visual tasks. Using fUS imaging on two awake nonhuman primates performing a passive fixation task, we constructed retinotopic maps at depth in the visual cortex (V1, V2, and V3) in the calcarine and lunate sulci. The maps could be acquired in a single-hour session with relatively few presentations of the stimuli. The spatial resolution of the technology is illustrated by mapping patterns similar to ocular dominance (OD) columns within superficial and deep layers of the primary visual cortex. These acquisitions using fUS suggested that OD selectivity is mostly present in layer IV but with extensions into layers II/III and V. This imaging technology provides a new mesoscale approach to the mapping of brain activity at high spatiotemporal resolution in awake subjects within the whole depth of the cortex.

Generation of Scale-Invariant Sequential Activity in Linear Recurrent Networks

Sequential neural activity has been observed in many parts of the brain and has been proposed as a neural mechanism for memory. The natural world expresses temporal relationships at a wide range of scales. Because we cannot know the relevant scales a priori, it is desirable that memory, and thus the generated sequences, is scale invariant. Although recurrent neural network models have been proposed as a mechanism for generating sequences, the requirements for scale-invariant sequences are not known. This letter reports the constraints that enable a linear recurrent neural network model to generate scale-invariant sequential activity. A straightforward eigendecomposition analysis results in two independent conditions that are required for scale invariance for connectivity matrices with real, distinct eigenvalues. First, the eigenvalues of the network must be geometrically spaced. Second, the eigenvectors must be related to one another via translation. These constraints are easily generalizable for matrices that have complex and distinct eigenvalues. Analogous albeit less compact constraints hold for matrices with degenerate eigenvalues. These constraints, along with considerations on initial conditions, provide a general recipe to build linear recurrent neural networks that support scale-invariant sequential activity.

Anatomy and Physiology of Macaque Visual Cortical Areas V1, V2, and V5/MT: Bases for Biologically Realistic Models

The cerebral cortex of primates encompasses multiple anatomically and physiologically distinct areas processing visual information. Areas V1, V2, and V5/MT are conserved across mammals and are central for visual behavior. To facilitate the generation of biologically accurate computational models of primate early visual processing, here we provide an overview of over 350 published studies of these three areas in the genus Macaca, whose visual system provides the closest model for human vision. The literature reports 14 anatomical connection types from the lateral geniculate nucleus of the thalamus to V1 having distinct layers of origin or termination, and 194 connection types between V1, V2, and V5, forming multiple parallel and interacting visual processing streams. Moreover, within V1, there are reports of 286 and 120 types of intrinsic excitatory and inhibitory connections, respectively. Physiologically, tuning of neuronal responses to 11 types of visual stimulus parameters has been consistently reported. Overall, the optimal spatial frequency (SF) of constituent neurons decreases with cortical hierarchy. Moreover, V5 neurons are distinct from neurons in other areas for their higher direction selectivity, higher contrast sensitivity, higher temporal frequency tuning, and wider SF bandwidth. We also discuss currently unavailable data that could be useful for biologically accurate models.

In vivo functional localization of the temporal monocular crescent representation in human primary visual cortex

The temporal monocular crescent (TMC) is the most peripheral portion of the visual field whose perception relies solely on input from the ipsilateral eye. According to a handful of post-mortem histological studies in humans and non-human primates, the TMC is represented visuotopically within the most anterior portion of the primary visual cortical area (V1). However, functional evidence of the TMC visuotopic representation in human visual cortex is rare, mostly due to the small size of the TMC representation (~6% of V1) and due to the technical challenges of stimulating the most peripheral portion of the visual field inside the MRI scanner. In this study, by taking advantage of custom-built MRI-compatible visual stimulation goggles with curved displays, we successfully stimulated the TMC region of the visual field in eight human subjects, half of them right-eye dominant, inside a 3 ​T MRI scanner. This enabled us to localize the representation of TMC, along with the blind spot representation (another visuotopic landmark in V1), in all volunteers, which match the expected spatial pattern based on prior anatomical studies. In all hemispheres, the TMC visuotopic representation was localized along the peripheral border of V1, within the most anterior portion of the calcarine sulcus, without any apparent extension into the second visual area (V2). We further demonstrate the reliability of this localization within/across experimental sessions, and consistency in the spatial location of TMC across individuals after accounting for inter-subject structural differences.

Temporal information loss in the macaque early visual system

Stimuli that modulate neuronal activity are not always detectable, indicating a loss of information between the modulated neurons and perception. To identify where in the macaque visual system information about periodic light modulations is lost, signal-to-noise ratios were compared across simulated cone photoreceptors, lateral geniculate nucleus (LGN) neurons, and perceptual judgements. Stimuli were drifting, threshold-contrast Gabor patterns on a photopic background. The sensitivity of LGN neurons, extrapolated to populations, was similar to the monkeys' at low temporal frequencies. At high temporal frequencies, LGN sensitivity exceeded the monkeys' and approached the upper bound set by cone photocurrents. These results confirm a loss of high-frequency information downstream of the LGN. However, this loss accounted for only about 5% of the total. Phototransduction accounted for essentially all of the rest. Together, these results show that low temporal frequency information is lost primarily between the cones and the LGN, whereas high-frequency information is lost primarily within the cones, with a small additional loss downstream of the LGN.