Population receptive field estimates in human visual cortex

DENSE-GWP: AN IMPROVED PRIMARY VISUAL ENCODING MODEL BASED ON DENSE GABOR FEATURES

Brain visual encoding models based on functional magnetic resonance imaging are growing increasingly popular. The Gabor wavelet pyramid model (GWP) is a classic example, exhibiting a good prediction performance for the primary visual cortex (V1, V2, and V3). However, the local variations in the visual stimulation are quite convoluted in terms of spatial frequency, orientation, and position, posing a challenge for visual encoding models. Whether the GWP model can thoroughly extract informative and effective features from visual stimulus remains unclear. To this end, this paper proposes a dense GWP visual encoding model by ameliorating the composition of the Gabor wavelet basis from three aspects: spatial frequency, orientation, and position. The improved model named Dense-GWP model could extract denser features from the image stimulus. A regularization optimization algorithm was used to select informative and effective features, which were crucial for predicting voxel activity in the region of interest. Extensive experimental results showed that the Dense-GWP model exhibits an improved prediction performance and can therefore help further understand the human visual perception mechanism.

[Neuro-computational approaches for objective assessment of visual function]

BACKGROUND

Retinal pathologies affect the structure and function of post-retinal visual pathways. These post-retinal alterations bear the potential to obstruct the aim of innovative retinal treatment to restore visual function.

OBJECTIVE

Current developments in the field of neuroimaging and the associated neurocomputational approaches enable a detailed assessment of this interrelationship. As a consequence, they open up the possibility to anticipate the success of treatment.

METHODS

This review article demonstrates how innovations particularly in magnetic resonance imaging (MRI)-based anatomical, functional, and diffusion imaging can guide visual pathway assessments that are relevant for ophthalmological applications.

RESULTS

Specific examples of retinal and visual pathway pathologies in the context of a detailed analysis of the visual pathway are described.

CONCLUSION

A concept is introduced of how to translate the meaningful but technically and computationally challenging neuroimaging procedures into a clinical setting in order to effectively connect these procedures to innovative treatment approaches.

Individualized cognitive neuroscience needs 7T: Comparing numerosity maps at 3T and 7T MRI

The field of cognitive neuroscience is weighing evidence about whether to move from the current standard field strength of 3 Tesla (3T) to ultra-high field (UHF) of 7T and above. The present study contributes to the evidence by comparing a computational cognitive neuroscience paradigm at 3T and 7T. The goal was to evaluate the practical effects, i.e. model predictive power, of field strength on a numerosity task using accessible pre-processing and analysis tools. Previously, using 7T functional magnetic resonance imaging and biologically-inspired analyses, i.e. population receptive field modelling, we discovered topographical organization of numerosity-selective neural populations in human parietal cortex. Here we show that these topographic maps are also detectable at 3T. However, averaging of many more functional runs was required at 3T to reliably reconstruct numerosity maps. On average, one 7T run had about four times the model predictive power of one 3T run. We believe that this amount of scanning would have made the initial discovery of the numerosity maps on 3T highly infeasible in practice. Therefore, we suggest that the higher signal-to-noise ratio and signal sensitivity of UHF MRI is necessary to build mechanistic models of the organization and function of our cognitive abilities in individual participants.

Functional MRI of visual cortex predicts training-induced recovery in stroke patients with homonymous visual field defects

•

Damage to the visual brain typically leads to vision loss.

•

Vision loss may be partially recovered with visual restitution training (VRT)

•

Cortical responses to visual stimulation do not always lead to visual awareness.

•

A mismatch between Humphrey and neural perimetry predicts training outcome.

•

This finding has important implications for better rehabilitation strategies.

Post-chiasmatic damage to the visual system leads to homonymous visual field defects (HVDs), which can severely interfere with daily life activities. Visual Restitution Training (VRT) can recover parts of the affected visual field in patients with chronic HVDs, but training outcome is variable. An untested hypothesis suggests that training potential may be largest in regions with ‘neural reserve’, where cortical responses to visual stimulation do not lead to visual awareness as assessed by Humphrey perimetry—a standard behavioural visual field test. Here, we tested this hypothesis in a sample of twenty-seven hemianopic stroke patients, who participated in an assiduous 80-hour VRT program. For each patient, we collected Humphrey perimetry and wide-field fMRI-based retinotopic mapping data prior to training. In addition, we used Goal Attainment Scaling to assess whether personal activities in daily living improved. After training, we assessed with a second Humphrey perimetry measurement whether the visual field was improved and evaluated which personal goals were attained. Confirming the hypothesis, we found significantly larger improvements of visual sensitivity at field locations with neural reserve. These visual field improvements implicated both regions in primary visual cortex and higher order visual areas. In addition, improvement in daily life activities correlated with the extent of visual field enlargement. Our findings are an important step toward understanding the mechanisms of visual restitution as well as predicting training efficacy in stroke patients with chronic hemianopia.

Tuned neural responses to haptic numerosity in the putamen

The ability to perceive the numerosity of items in the environment is critical for behavior of species across the evolutionary tree. Though the focus of studies of numerosity perception lays on the parietal and frontal cortices, the ability to perceive numerosity by a range of species suggests that subcortical nuclei may be implicated in the process. Recently, we have uncovered tuned neural responses to haptic numerosity in the human cortex. Here, we questioned whether subcortical nuclei are also engaged in perception of haptic numerosity. To that end, we utilized a task of haptic numerosity exploration, together with population receptive field model of numerosity selective responses measured at ultra-high field MRI (7T). We found tuned neural responses to haptic numerosity in the bilateral putamen. Similar to the cortex, the population receptive fields tuning width increased with numerosity. The tuned responses to numerosity in the putamen extend its role in cognition and propose that the motor-sensory loops of the putamen and basal ganglia might take an active part in numerosity perception and preparation for future action.

Cortical and subcortical signatures of conscious object recognition

The neural mechanisms underlying conscious recognition remain unclear, particularly the roles played by the prefrontal cortex, deactivated brain areas and subcortical regions. We investigated neural activity during conscious object recognition using 7 Tesla fMRI while human participants viewed object images presented at liminal contrasts. Here, we show both recognized and unrecognized images recruit widely distributed cortical and subcortical regions; however, recognized images elicit enhanced activation of visual, frontoparietal, and subcortical networks and stronger deactivation of the default-mode network. For recognized images, object category information can be decoded from all of the involved cortical networks but not from subcortical regions. Phase-scrambled images trigger strong involvement of inferior frontal junction, anterior cingulate cortex and default-mode network, implicating these regions in inferential processing under increased uncertainty. Our results indicate that content-specific activity in both activated and deactivated cortical networks and non-content-specific subcortical activity support conscious recognition.

Cortical and subcortical neural activity supporting conscious object recognition has not yet been well defined. Here, the authors describe these networks and show recognition-related category information can be decoded from widespread cortical activity but not subcortical activity.

Aberrant visual population receptive fields in human albinism

Retinotopic organization is a fundamental feature of visual cortex thought to play a vital role in encoding spatial information. One important aspect of normal retinotopy is the representation of the right and left hemifields in contralateral visual cortex. However, in human albinism, many temporal retinal afferents decussate aberrantly at the optic chiasm resulting in partially superimposed representations of opposite hemifields in each hemisphere of visual cortex. Previous functional magnetic resonance imaging (fMRI) studies in human albinism suggest that the right and left hemifield representations are superimposed in a mirror-symmetric manner. This should produce imaging voxels which respond to two separate locations mirrored across the vertical meridian. However, it is not yet clear how retino-cortical miswiring in albinism manifests at the level of single voxel population receptive fields (pRFs). Here, we used pRF modeling to fit both single and dual pRF models to the visual responses of voxels in visual areas V1 to V3 of five subjects with albinism. We found that subjects with albinism (but not controls) have sizable clusters of voxels with unequivocal dual pRFs consistently corresponding to, but not fully coextensive with, regions of hemifield overlap. These dual pRFs were typically positioned at locations roughly mirrored across the vertical meridian and were uniquely clustered within a portion of the visual field for each subject.

A deep-learning framework for human perception of abstract art composition

Artistic composition (the structural organization of pictorial elements) is often characterized by some basic rules and heuristics, but art history does not offer quantitative tools for segmenting individual elements, measuring their interactions and related operations. To discover whether a metric description of this kind is even possible, we exploit a deep-learning algorithm that attempts to capture the perceptual mechanism underlying composition in humans. We rely on a robust behavioral marker with known relevance to higher-level vision: orientation judgements, that is, telling whether a painting is hung “right-side up.” Humans can perform this task, even for abstract paintings. To account for this finding, existing models rely on “meaningful” content or specific image statistics, often in accordance with explicit rules from art theory. Our approach does not commit to any such assumptions/schemes, yet it outperforms previous models and for a larger database, encompassing a wide range of painting styles. Moreover, our model correctly reproduces human performance across several measurements from a new web-based experiment designed to test whole paintings, as well as painting fragments matched to the receptive-field size of different depths in the model. By exploiting this approach, we show that our deep learning model captures relevant characteristics of human orientation perception across styles and granularities. Interestingly, the more abstract the painting, the more our model relies on extended spatial integration of cues, a property supported by deeper layers.

A review of interactions between peripheral and foveal vision

Visual processing varies dramatically across the visual field. These differences start in the retina and continue all the way to the visual cortex. Despite these differences in processing, the perceptual experience of humans is remarkably stable and continuous across the visual field. Research in the last decade has shown that processing in peripheral and foveal vision is not independent, but is more directly connected than previously thought. We address three core questions on how peripheral and foveal vision interact, and review recent findings on potentially related phenomena that could provide answers to these questions. First, how is the processing of peripheral and foveal signals related during fixation? Peripheral signals seem to be processed in foveal retinotopic areas to facilitate peripheral object recognition, and foveal information seems to be extrapolated toward the periphery to generate a homogeneous representation of the environment. Second, how are peripheral and foveal signals re-calibrated? Transsaccadic changes in object features lead to a reduction in the discrepancy between peripheral and foveal appearance. Third, how is peripheral and foveal information stitched together across saccades? Peripheral and foveal signals are integrated across saccadic eye movements to average percepts and to reduce uncertainty. Together, these findings illustrate that peripheral and foveal processing are closely connected, mastering the compromise between a large peripheral visual field and high resolution at the fovea.

Differential spatial computations in ventral and lateral face-selective regions are scaffolded by structural connections

Face-processing occurs across ventral and lateral visual streams, which are involved in static and dynamic face perception, respectively. However, the nature of spatial computations across streams is unknown. Using functional MRI and population receptive field (pRF) mapping, we measured pRFs in face-selective regions. Results reveal that spatial computations by pRFs in ventral face-selective regions are concentrated around the center of gaze (fovea), but spatial computations in lateral face-selective regions extend peripherally. Diffusion MRI reveals that these differences are mirrored by a preponderance of white matter connections between ventral face-selective regions and foveal early visual cortex (EVC), while connections with lateral regions are distributed more uniformly across EVC eccentricities. These findings suggest a rethinking of spatial computations in face-selective regions, showing that they vary across ventral and lateral streams, and further propose that spatial computations in high-level regions are scaffolded by the fine-grain pattern of white matter connections from EVC.

Topographic maps and neural tuning for sensory substitution dimensions learned in adulthood in a congenital blind subject

Topographic maps, a key principle of brain organization, emerge during development. It remains unclear, however, whether topographic maps can represent a new sensory experience learned in adulthood. MaMe, a congenitally blind individual, has been extensively trained in adulthood for perception of a 2D auditory-space (soundscape) where the y- and x-axes are represented by pitch and time, respectively. Using population receptive field mapping we found neural populations tuned topographically to pitch, not only in the auditory cortices but also in the parietal and occipito-temporal cortices. Topographic neural tuning to time was revealed in the parietal and occipito-temporal cortices. Some of these maps were found to represent both axes concurrently, enabling MaMe to represent unique locations in the soundscape space. This case study provides proof of concept for the existence of topographic maps tuned to the newly learned soundscape dimensions. These results suggest that topographic maps can be adapted or recycled in adulthood to represent novel sensory experiences.

Quantitative examination of an unconventional form of the filled-space illusion

The spatial interval containing some visual elements (fillers) seems to be longer than an empty interval of the same length, and the effect persists for most observers. This illusion of interrupted spatial extent (or the filled-space illusion) can be observed even in extremely simplified line drawings, but its origin is still not completely understood. Recently, we proposed a quantitative explanation for the results of experiments with stimuli containing either continuous or discrete filling: the illusion may be associated with the integration of distractor-induced effects near the endpoints (terminators) of the stimulus intervals. Subsequent analysis of the principles underlying the explanation allowed us to hypothesize the appearance of illusory effects caused by previously unknown stimulus modifications. To test the suggestions, in the present study we performed experiments with three-dot stimuli that contain a distracting circle (either outline or uniformly filled) surrounding one of the lateral terminators. It has been demonstrated that the illusion magnitude varies predictably with the size of the circle, and there is no significant difference between the data obtained for stimuli with the outline and filled distractors. To more thoroughly examine the illusion, the central angle of circular distracting arcs (real or imaginary) was used as an independent variable in supplementary experiments. A rather successful theoretical interpretation of the experimental results supports the suggestion that perceptual positional biases induced by additional context-evoked neural excitation can be considered as one of the main causes of the filled-space illusion.

Population Receptive Field Shapes in Early Visual Cortex Are Nearly Circular

The visual field region where a stimulus evokes a neural response is called the receptive field (RF). Analytical tools combined with functional MRI (fMRI) can estimate the RF of the population of neurons within a voxel. Circular population RF (pRF) methods accurately specify the central position of the pRF and provide some information about the spatial extent (diameter) of the RF. A number of investigators developed methods to further estimate the shape of the pRF, for example, whether the shape is more circular or elliptical. There is a report that there are many pRFs with highly elliptical pRFs in early visual cortex (V1-V3; Silson et al., 2018). Large aspect ratios (>2) are difficult to reconcile with the spatial scale of orientation columns or visual field map properties in early visual cortex. We started to replicate the experiments and found that the software used in the publication does not accurately estimate RF shape: it produces elliptical fits to circular ground-truth data. We analyzed an independent data set with a different software package that was validated over a specific range of measurement conditions, to show that in early visual cortex the aspect ratios are <2. Furthermore, current empirical and theoretical methods do not have enough precision to discriminate ellipses with aspect ratios of 1.5 from circles. Through simulation we identify methods for improving sensitivity that may estimate ellipses with smaller aspect ratios. The results we present are quantitatively consistent with prior assessments using other methodologies.SIGNIFICANCE STATEMENT We evaluated whether the shape of many population receptive fields (RFs) in early visual cortex is elliptical and differs substantially from circular. We evaluated two tools for estimating elliptical models of the pRF; one tool was valid over the measured compliance range. Using the validated tool, we found no evidence that confidently rejects circular fits to the pRF in visual field maps V1, V2, and V3. The new measurements and analyses are consistent with prior theoretical and experimental assessments in the literature.

Representation of Contralateral Visual Space in the Human Hippocampus

The initial encoding of visual information primarily from the contralateral visual field is a fundamental organizing principle of the primate visual system. Recently, the presence of such retinotopic sensitivity has been shown to extend well beyond early visual cortex to regions not historically considered retinotopically sensitive. In particular, human scene-selective regions in parahippocampal and medial parietal cortex exhibit prominent biases for the contralateral visual field. Here, we used fMRI to test the hypothesis that the human hippocampus, which is thought to be anatomically connected with these scene-selective regions, would also exhibit a biased representation of contralateral visual space. First, population receptive field (pRF) mapping with scene stimuli revealed strong biases for the contralateral visual field in bilateral hippocampus. Second, the distribution of retinotopic sensitivity suggested a more prominent representation in anterior medial portions of the hippocampus. Finally, the contralateral bias was confirmed in independent data taken from the Human Connectome Project (HCP) initiative. The presence of contralateral biases in the hippocampus, a structure considered by many as the apex of the visual hierarchy, highlights the truly pervasive influence of retinotopy. Moreover, this finding has important implications for understanding how visual information relates to the allocentric global spatial representations known to be encoded therein.SIGNIFICANCE STATEMENT Retinotopic encoding of visual information is an organizing principle of visual cortex. Recent work demonstrates this sensitivity in structures far beyond early visual cortex, including those anatomically connected to the hippocampus. Here, using population receptive field (pRF) modeling in two independent sets of data we demonstrate a consistent bias for the contralateral visual field in bilateral hippocampus. Such a bias highlights the truly pervasive influence of retinotopy, with important implications for understanding how the presence of retinotopy relates to more allocentric spatial representations.

Size constancy affects the perception and parietal neural representation of object size

Humans and animals rely on accurate object size perception to guide behavior. Object size is judged from visual input, but the relationship between an object's retinal size and its real-world size varies with distance. Humans perceive object sizes to be relatively constant when retinal size changes. Such size constancy compensates for the variable relationship between retinal size and real-world size, using the context of recent retinal sizes of the same object to bias perception towards its likely real-world size. We therefore hypothesized that object size perception may be affected by the range of recently viewed object sizes, attracting perceived object sizes towards recently viewed sizes. We demonstrate two systematic biases: a central tendency attracting perceived size towards the average size across all trials, and a serial dependence attracting perceived size towards the size presented on the previous trial. We recently described topographic object size maps in the human parietal cortex. We therefore hypothesized that neural representations of object size here would be attracted towards recently viewed sizes. We used ultra-high-field (7T) functional MRI and population receptive field modeling to compare object size representations measured with small (0.05-1.4°diameter) and large objects sizes (0.1-2.8°). We found that parietal object size preferences and tuning widths follow this presented range, but change less than presented object sizes. Therefore, perception and neural representation of object size are attracted towards recently viewed sizes. This context-dependent object size representation reveals effects on neural response preferences that may underlie context dependence of object size perception.

Assessing Uncertainty and Reliability of Connective Field Estimations From Resting State fMRI Activity at 3T

Connective Field (CF) modeling estimates the local spatial integration between signals in distinct cortical visual field areas. As we have shown previously using 7T data, CF can reveal the visuotopic organization of visual cortical areas even when applied to BOLD activity recorded in the absence of external stimulation. This indicates that CF modeling can be used to evaluate cortical processing in participants in which the visual input may be compromised. Furthermore, by using Bayesian CF modeling it is possible to estimate the co-variability of the parameter estimates and therefore, apply CF modeling to single cases. However, no previous studies evaluated the (Bayesian) CF model using 3T resting-state fMRI data. This is important since 3T scanners are much more abundant and more often used in clinical research compared to 7T scanners. Therefore in this study, we investigate whether it is possible to obtain meaningful CF estimates from 3T resting state (RS) fMRI data. To do so, we applied the standard and Bayesian CF modeling approaches on two RS scans, which were separated by the acquisition of visual field mapping data in 12 healthy participants. Our results show good agreement between RS- and visual field (VF)- based maps using either the standard or Bayesian CF approach. In addition to quantify the uncertainty associated with each estimate in both RS and VF data, we applied our Bayesian CF framework to provide the underlying marginal distribution of the CF parameters. Finally, we show how an additional CF parameter, beta, can be used as a data-driven threshold on the RS data to further improve CF estimates. We conclude that Bayesian CF modeling can characterize local functional connectivity between visual cortical areas from RS data at 3T. Moreover, observations obtained using 3T scanners were qualitatively similar to those reported for 7T. In particular, we expect the ability to assess parameter uncertainty in individual participants will be important for future clinical studies.

The time-course of prediction formation and revision in human visual motion processing

Establishing the real-time position of a moving object poses a challenge to the visual system due to neural processing delays. While sensory information is travelling through the visual hierarchy, the object continues moving and information about its position becomes outdated. By extrapolating the position of a moving object along its trajectory, predictive mechanisms might effectively decrease the processing time associated with these objects. Here, we use time-resolved decoding of electroencephalographic (EEG) data from an apparent motion paradigm to demonstrate the interaction of two separate predictive mechanisms. First, we reveal predictive latency advantages for position representations as soon as the second object in an apparent motion sequence - even before the stimulus contains any physical motion energy. This is consistent with the existence of omni-directional, within-layer waves of sub-threshold activity that bring neurons coding for adjacent positions closer to their firing threshold, thereby reducing the processing time of the second stimulus in one of those positions. Second, we show that an additional direction-specific latency advantage emerges from the third sequence position onward, once the direction of the apparent motion stimulus is uniquely determined. Because the receptive fields of early visual areas are too small to encompass sequential apparent motion positions (as evidenced by the lack of latency modulation for the second stimulus position), this latency advantage most likely arises from descending predictions from higher to lower visual areas through feedback connections. Finally, we reveal that the same predictive activation that facilitates the processing of the object in its expected position needs to be overcome when the object's trajectory unexpectedly reverses, causing an additional latency disadvantage for stimuli that violate predictions. Altogether, our results suggest that two complementary mechanisms interact to form and revise predictions in visual motion processing, modulating the latencies of neural position representations at different levels of visual processing.

End-to-end neural system identification with neural information flow

Neural information flow (NIF) provides a novel approach for system identification in neuroscience. It models the neural computations in multiple brain regions and can be trained end-to-end via stochastic gradient descent from noninvasive data. NIF models represent neural information processing via a network of coupled tensors, each encoding the representation of the sensory input contained in a brain region. The elements of these tensors can be interpreted as cortical columns whose activity encodes the presence of a specific feature in a spatiotemporal location. Each tensor is coupled to the measured data specific to a brain region via low-rank observation models that can be decomposed into the spatial, temporal and feature receptive fields of a localized neuronal population. Both these observation models and the convolutional weights defining the information processing within regions are learned end-to-end by predicting the neural signal during sensory stimulation. We trained a NIF model on the activity of early visual areas using a large-scale fMRI dataset recorded in a single participant. We show that we can recover plausible visual representations and population receptive fields that are consistent with empirical findings.

Neural markers of suppression in impaired binocular vision

Even after conventional patching treatment, individuals with a history of amblyopia typically lack good stereo vision. This is often attributed to atypical suppression between the eyes, yet the specific mechanism is still unclear. Guided by computational models of binocular vision, we tested explicit predictions about how neural responses to contrast might differ in individuals with impaired binocular vision. Participants with a history of amblyopia (N = 25), and control participants with typical visual development (N = 19) took part in the study. Neural responses to different combinations of contrast in the left and right eyes, were measured using both electroencephalography (EEG) and functional magnetic resonance imaging (fMRI). Stimuli were sinusoidal gratings with a spatial frequency of 3c/deg, flickering at 4 Hz. In the fMRI experiment, we also ran population receptive field and retinotopic mapping sequences, and a phase-encoded localiser stimulus, to identify voxels in primary visual cortex (V1) sensitive to the main stimulus. Neural responses in both modalities increased monotonically with stimulus contrast. When measured with EEG, responses were attenuated in the weaker eye, consistent with a fixed tonic suppression of that eye. When measured with fMRI, a low contrast stimulus in the weaker eye substantially reduced the response to a high contrast stimulus in the stronger eye. This effect was stronger than when the stimulus-eye pairings were reversed, consistent with unbalanced dynamic suppression between the eyes. Measuring neural responses using different methods leads to different conclusions about visual differences in individuals with impaired binocular vision. Both of the atypical suppression effects may relate to binocular perceptual deficits, e.g. in stereopsis, and we anticipate that these measures could be informative for monitoring the progress of treatments aimed at recovering binocular vision.

Zooming-in on higher-level vision: High-resolution fMRI for understanding visual perception and awareness

One of the central questions in visual neuroscience is how the sparse retinal signals leaving our eyes are transformed into a rich subjective visual experience of the world. Invasive physiology studies, which offers the highest spatial resolution, have revealed many facts about the processing of simple visual features like contrast, color, and orientation, focusing on the early visual areas. At the same time, standard human fMRI studies with comparably coarser spatial resolution have revealed more complex, functionally specialized, and category-selective responses in higher visual areas. Although the visual system is the best understood among the sensory modalities, these two areas of research remain largely segregated. High-resolution fMRI opens up a possibility for linking them. On the one hand, it allows studying how the higher-level visual functions affect the fine-scale activity in early visual areas. On the other hand, it allows discovering the fine-scale functional organization of higher visual areas and exploring their functional connectivity with visual areas lower in the hierarchy. In this review, I will discuss examples of successful work undertaken in these directions using high-resolution fMRI and discuss where this method could be applied in the future to advance our understanding of the complexity of higher-level visual processing.

Adaptation to visual numerosity changes neural numerosity selectivity

Perceiving numerosity, i.e. the set size of a group of items, is an evolutionarily preserved ability found in humans and animals. A useful method to infer the neural underpinnings of a given perceptual property is sensory adaptation. Like other primary perceptual attributes, numerosity is susceptible to adaptation. Recently, we have shown numerosity-selective neural populations with a topographic organization in the human brain. Here, we investigated whether numerosity adaptation can affect the numerosity selectivity of these populations using ultra-high field (7 Tesla) functional magnetic resonance imaging (fMRI). Participants viewed stimuli of changing numerosity (1 to 7 dots), which allowed the mapping of numerosity selectivity. We interleaved a low or high numerosity adapter stimulus with these mapping stimuli, repeatedly presenting 1 or 20 dots respectively to adapt the numerosity-selective neural populations. We analyzed the responses using custom-build population receptive field neural models of numerosity encoding and compared estimated numerosity preferences between adaptation conditions. We replicated our previous studies where we found several topographic maps of numerosity-selective responses. We found that overall, numerosity adaptation altered the preferred numerosities within the numerosity maps, resulting in predominantly attractive biases towards the numerosity of the adapter. The differential biases could be explained by the difference between the unadapted preferred numerosity and the numerosity of the adapter, with attractive biases being observed with higher difference. The results could link perceptual numerosity adaptation effects to changes in neural numerosity selectivity.

Topographic maps representing haptic numerosity reveals distinct sensory representations in supramodal networks

Dedicated maps for cognitive quantities such as timing, size and numerosity support the view that topography is a general principle of brain organization. To date, however, all of these maps were driven by the visual system. Here, we ask whether there are supramodal topographic maps representing cognitive dimensions irrespective of the stimulated sensory modality. We measured haptically and visually driven numerosity-selective neural responses using model-based analyses and ultra-high field (7T) fMRI. We found topographically organized neural populations tuned to haptic numerosity. The responses to visual or haptic numerosity shared a similar cortical network. However, the maps of the two modalities only partially overlap. Thus, although both visual and haptic numerosities are processed in a similar supramodal functional network, the underlying neural populations may be related, but distinct. Therefore, we hypothesize that overlap between modality-specific maps facilitates cross-modal interactions and supramodal representation of cognitive quantities.

Topographically organized tuned responses to haptic numerosity were found in the human brain. The responses to visual or haptic numerosity shared a similar large-scale cortical network, yet the maps of the two modalities only partially overlapped, suggesting distinct underlying neural populations.

Cross-species neuroscience: closing the explanatory gap

Neuroscience has seen substantial development in non-invasive methods available for investigating the living human brain. However, these tools are limited to coarse macroscopic measures of neural activity that aggregate the diverse responses of thousands of cells. To access neural activity at the cellular and circuit level, researchers instead rely on invasive recordings in animals. Recent advances in invasive methods now permit large-scale recording and circuit-level manipulations with exquisite spatio-temporal precision. Yet, there has been limited progress in relating these microcircuit measures to complex cognition and behaviour observed in humans. Contemporary neuroscience thus faces an explanatory gap between macroscopic descriptions of the human brain and microscopic descriptions in animal models. To close the explanatory gap, we propose adopting a cross-species approach. Despite dramatic differences in the size of mammalian brains, this approach is broadly justified by preserved homology. Here, we outline a three-armed approach for effective cross-species investigation that highlights the need to translate different measures of neural activity into a common space. We discuss how a cross-species approach has the potential to transform basic neuroscience while also benefiting neuropsychiatric drug development where clinical translation has, to date, seen minimal success. This article is part of the theme issue 'Key relationships between non-invasive functional neuroimaging and the underlying neuronal activity'.

Validating Linear Systems Analysis for Laminar fMRI: Temporal Additivity for Stimulus Duration Manipulations

Advancements in ultra-high field (7 T and higher) magnetic resonance imaging (MRI) scanners have made it possible to investigate both the structure and function of the human brain at a sub-millimeter scale. As neuronal feedforward and feedback information arrives in different layers, sub-millimeter functional MRI has the potential to uncover information processing between cortical micro-circuits across cortical depth, i.e. laminar fMRI. For nearly all conventional fMRI analyses, the main assumption is that the relationship between local neuronal activity and the blood oxygenation level dependent (BOLD) signal adheres to the principles of linear systems theory. For laminar fMRI, however, directional blood pooling across cortical depth stemming from the anatomy of the cortical vasculature, potentially violates these linear system assumptions, thereby complicating analysis and interpretation. Here we assess whether the temporal additivity requirement of linear systems theory holds for laminar fMRI. We measured responses elicited by viewing stimuli presented for different durations and evaluated how well the responses to shorter durations predicted those elicited by longer durations. We find that BOLD response predictions are consistently good predictors for observed responses, across all cortical depths, and in all measured visual field maps (V1, V2, and V3). Our results suggest that the temporal additivity assumption for linear systems theory holds for laminar fMRI. We thus show that the temporal additivity assumption holds across cortical depth for sub-millimeter gradient-echo BOLD fMRI in early visual cortex.

A Probabilistic Functional Atlas of Human Occipito-Temporal Visual Cortex

Human visual cortex contains many retinotopic and category-specific regions. These brain regions have been the focus of a large body of functional magnetic resonance imaging research, significantly expanding our understanding of visual processing. As studying these regions requires accurate localization of their cortical location, researchers perform functional localizer scans to identify these regions in each individual. However, it is not always possible to conduct these localizer scans. Here, we developed and validated a functional region of interest (ROI) atlas of early visual and category-selective regions in human ventral and lateral occipito-temporal cortex. Results show that for the majority of functionally defined ROIs, cortex-based alignment results in lower between-subject variability compared to nonlinear volumetric alignment. Furthermore, we demonstrate that 1) the atlas accurately predicts the location of an independent dataset of ventral temporal cortex ROIs and other atlases of place selectivity, motion selectivity, and retinotopy. Next, 2) we show that the majority of voxel within our atlas is responding mostly to the labeled category in a left-out subject cross-validation, demonstrating the utility of this atlas. The functional atlas is publicly available (download.brainvoyager.com/data/visfAtlas.zip) and can help identify the location of these regions in healthy subjects as well as populations (e.g., blind people, infants) in which functional localizers cannot be run.

Graph neural fields: A framework for spatiotemporal dynamical models on the human connectome

Tools from the field of graph signal processing, in particular the graph Laplacian operator, have recently been successfully applied to the investigation of structure-function relationships in the human brain. The eigenvectors of the human connectome graph Laplacian, dubbed "connectome harmonics", have been shown to relate to the functionally relevant resting-state networks. Whole-brain modelling of brain activity combines structural connectivity with local dynamical models to provide insight into the large-scale functional organization of the human brain. In this study, we employ the graph Laplacian and its properties to define and implement a large class of neural activity models directly on the human connectome. These models, consisting of systems of stochastic integrodifferential equations on graphs, are dubbed graph neural fields, in analogy with the well-established continuous neural fields. We obtain analytic predictions for harmonic and temporal power spectra, as well as functional connectivity and coherence matrices, of graph neural fields, with a technique dubbed CHAOSS (shorthand for Connectome-Harmonic Analysis Of Spatiotemporal Spectra). Combining graph neural fields with appropriate observation models allows for estimating model parameters from experimental data as obtained from electroencephalography (EEG), magnetoencephalography (MEG), or functional magnetic resonance imaging (fMRI). As an example application, we study a stochastic Wilson-Cowan graph neural field model on a high-resolution connectome graph constructed from diffusion tensor imaging (DTI) and structural MRI data. We show that the model equilibrium fluctuations can reproduce the empirically observed harmonic power spectrum of resting-state fMRI data, and predict its functional connectivity, with a high level of detail. Graph neural fields natively allow the inclusion of important features of cortical anatomy and fast computations of observable quantities for comparison with multimodal empirical data. They thus appear particularly suitable for modelling whole-brain activity at mesoscopic scales, and opening new potential avenues for connectome-graph-based investigations of structure-function relationships.

Visual Field Reconstruction Using fMRI-Based Techniques

Purpose

To evaluate the accuracy and reliability of functional magnetic resonance imaging (fMRI)-based techniques to assess the integrity of the visual field (VF).

Methods

We combined 3T fMRI and neurocomputational models, that is, conventional population receptive field (pRF) mapping and a new advanced pRF framework "microprobing" (MP), to reconstruct the VF representations of different cortical areas. To demonstrate their scope, both approaches were applied in healthy participants with simulated scotomas and participants with glaucoma. For the latter group we compared the VFs obtained with standard automated perimetry (SAP) and via fMRI.

Results

Using SS, we found that the fMRI-based techniques can detect absolute defects in VFs that are larger than 3°, in single participants, based on 12 minutes of fMRI scan time. Moreover, we found that the MP approach results in a less biased estimation of the preserved VF. In participants with glaucoma, we found that fMRI-based VF reconstruction detected VF defects with a correspondence to SAP that was decent, reflected by the positive correlation between fMRI-based sampling density and SAP-based contrast sensitivity loss (SAP) r2 = 0.44, P = 0.0002. This correlation was higher for MP compared to that for the conventional pRF analysis.

Conclusions

The fMRI-based reconstruction of the VF enables the evaluation of vision loss and provides useful details on the properties of the visual cortex.

Translational Relevance

The fMRI-based VF reconstruction provides an objective alternative to detect VF defects. It may either complement SAP or could provide VF information in patients unable to perform SAP.

Ultra-high field fMRI reveals origins of feedforward and feedback activity within laminae of human ocular dominance columns

Ultra-high field MRI can functionally image the cerebral cortex of human subjects at the submillimeter scale of cortical columns and laminae. Here, we investigate both in concert, by imaging ocular dominance columns (ODCs) in primary visual cortex (V1) across different cortical depths. We ensured that putative ODC patterns in V1 (a) are stable across runs, sessions, and scanners located in different continents, (b) have a width (~1.3 mm) expected from post-mortem and animal work and (c) are absent at the retinotopic location of the blind spot. We then dissociated the effects of bottom-up thalamo-cortical input and attentional feedback processes on activity in V1 across cortical depth. Importantly, the separation of bottom-up information flows into ODCs allowed us to validly compare attentional conditions while keeping the stimulus identical throughout the experiment. We find that, when correcting for draining vein effects and using both model-based and model-free approaches, the effect of monocular stimulation is largest at deep and middle cortical depths. Conversely, spatial attention influences BOLD activity exclusively near the pial surface. Our findings show that simultaneous interrogation of columnar and laminar dimensions of the cortical fold can dissociate thalamocortical inputs from top-down processing, and allow the investigation of their interactions without any stimulus manipulation.

A low-cost telescope for enhanced stimulus visual field coverage in functional MRI

BACKGROUND

A common limitation of typical projection systems used for visual fMRI is the limited field of view that can be presented to the observer within the scanner. A wide field of view over which stimuli can be presented is critical when investigating peripheral visual function, in particular visual disorders or diseases that lead to the loss of peripheral vision.

NEW METHOD

We present a relatively low-cost Galilean telescopic device that can be used in most MRI scanners to double the effective visual field being presented. The system described is non-ferromagnetic, and compatible with most standard methods of visual presentation in MRI environments. The increase in area of visual cortex activation was quantified by comparing the extent of visual activity evoked by observing flickering checkerboards with and without the telescope in place.

RESULTS

In all three observers that reported image fusion from the telescope, the extent of cortical activation was greater with the telescope, while in the fourth observer there was no difference between the two methods due to a lack of fusion.

CONCLUSION

The telescope is a low cost, easy to implement solution in situations where changes to the existing equipment or setup are not feasible.

The relationship between retinal cone density and cortical magnification in human albinism

The human fovea lies at the center of the retina and supports high-acuity vision. In normal visual system development, the highest acuity is correlated with both a high density of cone photoreceptors in the fovea and a magnified retinotopic representation of the fovea in the visual cortex. Both cone density and the cortical area dedicated to each degree of visual space—the latter describing cortical magnification (CM)—steadily decrease with increasing eccentricity from the fovea. In albinism, peak cone density at the fovea and visual acuity are decreased, but seem to be within normal limits in the periphery, thus providing a model to explore the correlation between retinal structure, cortical structure, and behavior. Here, we used adaptive optics scanning light ophthalmoscopy to assess retinal cone density and functional magnetic resonance imaging to measure CM in the primary visual cortex of normal controls and individuals with albinism. We find that retinotopic organization is more varied among individuals with albinism than previously appreciated. Additionally, CM outside the fovea is similar to that in controls, but also more variable. CM in albinism and controls exceeds that which might be predicted based on cone density alone, but is more accurately predicted by retinal ganglion cell density. This finding suggests that decreased foveal cone density in albinism may be partially counteracted by nonuniform connectivity between cones and their downstream signaling partners. Together, these results emphasize that central as well as retinal factors must be included to provide a complete picture of aberrant structure and function in albinism.

Object Selection by Automatic Spreading of Top-Down Attentional Signals in V1

What is selected when attention is directed to a specific location of the visual field? Theories of object-based attention have suggested that when spatial attention is directed to part of an object, attention does not simply enhance the attended location but automatically spreads to enhance all locations that comprise the object. Here, we tested this hypothesis by reconstructing the distribution of attention from primary visual cortex (V1) population neuronal activity patterns in 24 human adults (17 female) using functional magnetic resonance imaging (fMRI) and population-based receptive field (prf) mapping. We find that attention spreads from a spatially cued location to the underlying object, and enhances all spatial locations that comprise the object. Importantly, this spreading was also evident when the object was not task relevant. These data suggest that attentional selection automatically operates at an object level, facilitating the reconstruction of coherent objects from fragmented representations in early visual cortex.SIGNIFICANCE STATEMENT Object perception is an astonishing feat of the visual system. When visual information about orientation, shape, and color enters through our eyes, it has yet to be integrated into a coherent representation of an object. But which visual features constitute a single object and which features belong to the background? The brain mechanisms underpinning object perception are yet to be understood. We now demonstrate that one candidate mechanism, the successive activation of all parts of an object, occurs in early visual cortex and results in a detailed representation of the object following Gestalt principles. Furthermore, our results suggest that object selection occurs automatically, without involving voluntary control.

Hierarchical cortical gradients in somatosensory processing

Sensory information is processed in the visual cortex in distinct streams of different anatomical and functional properties. A comparable organizational principle has also been proposed to underlie auditory processing. This raises the question of whether a similar principle characterize the somatosensory domain. One property of a cortical stream is a hierarchical organization of the neuronal response properties along an anatomically distinct pathway. Indeed, several hierarchies between specific somatosensory cortical regions have been identified, primarily using electrophysiology, in non-human primates. However, it has been unclear how these local hierarchies are organized throughout the cortex. Here we used phase-encoded bilateral full-body light touch stimulation in healthy humans under functional MRI to study the large-scale organization of hierarchies in the somatosensory domain. We quantified two measures of hierarchy of BOLD responses, selectivity and laterality. We measured how selectivity and laterality change as we move away from the central sulcus within four gross anatomically-distinct regions. We found that both selectivity and laterality decrease in three directions: parietal, posteriorly along the parietal lobe, frontal, anteriorly along the frontal lobe and medial, inferiorly-anteriorly along the medial wall. The decline of selectivity and laterality along these directions provides evidence for hierarchical gradients. In view of the anatomical segregation of these three directions, the multiplicity of body representations in each region and the hierarchical gradients in our findings, we propose that as in the visual and auditory domains, these directions are streams of somatosensory information processing.

Task-related activity in human visual cortex

The brain exhibits widespread endogenous responses in the absence of visual stimuli, even at the earliest stages of visual cortical processing. Such responses have been studied in monkeys using optical imaging with a limited field of view over visual cortex. Here, we used functional MRI (fMRI) in human participants to study the link between arousal and endogenous responses in visual cortex. The response that we observed was tightly entrained to task timing, was spatially extensive, and was independent of visual stimulation. We found that this response follows dynamics similar to that of pupil size and heart rate, suggesting that task-related activity is related to arousal. Finally, we found that higher reward increased response amplitude while decreasing its trial-to-trial variability (i.e., the noise). Computational simulations suggest that increased temporal precision underlies both of these observations. Our findings are consistent with optical imaging studies in monkeys and support the notion that arousal increases precision of neural activity.

The brain exhibits widespread endogenous responses in the absence of visual stimuli, even at the earliest stages of visual cortical processing. This fMRI study characterizes a widespread hemodynamic response in early visual cortex that is not related to visual input but instead reflects a participant’s engagement in a task, is modulated by expected monetary reward, and may reflect neural quenching.

Self-organization of cortical areas in the development and evolution of neocortex

While the mechanisms generating the topographic organization of primary sensory areas in the neocortex are well studied, what generates secondary cortical areas is virtually unknown. Using physical parameters representing primary and secondary visual areas as they vary from monkey to mouse, we derived a network growth model to explore if characteristic features of secondary areas could be produced from correlated activity patterns arising from V1 alone. We found that V1 seeded variable numbers of secondary areas based on activity-driven wiring and wiring-density limits within the cortical surface. These secondary areas exhibited the typical mirror-reversal of map topography on cortical area boundaries and progressive reduction of the area and spatial resolution of each new map on the caudorostral axis. Activity-based map formation may be the basic mechanism that establishes the matrix of topographically organized cortical areas available for later computational specialization.

Depth-dependent functional MRI responses to chromatic and achromatic stimuli throughout V1 and V2

In the primate visual system, form (shape, location) and color information are processed in separate but interacting pathways. Recent access to high-resolution neuroimaging has facilitated the exploration of the structure of these pathways at the mesoscopic level in the human visual cortex. We used 7T fMRI to observe selective activation of the primary visual cortex to chromatic versus achromatic stimuli in five participants across two scanning sessions. Achromatic checkerboards with low spatial frequency and high temporal frequency targeted the color-insensitive magnocellular pathway. Chromatic checkerboards with higher spatial frequency and low temporal frequency targeted the color-selective parvocellular pathway. This work resulted in three main findings. First, responses driven by chromatic stimuli had a laminar profile biased towards superficial layers of V1, as compared to responses driven by achromatic stimuli. Second, we found stronger preference for chromatic stimuli in parafoveal V1 compared with peripheral V1. Finally, we found alternating, stimulus-selective bands stemming from the V1 border into V2 and V3. Similar alternating patterns have been previously found in both NHP and human extrastriate cortex. Together, our findings confirm the utility of fMRI for revealing details of mesoscopic neural architecture in human cortex.

Wide-field retinotopy reveals a new visuotopic cluster in macaque posterior parietal cortex

We investigated the visuotopic organization of macaque posterior parietal cortex (PPC) by combining functional imaging (fMRI) and wide-field retinotopic mapping in two macaque monkeys. Whole brain blood-oxygen-level-dependent (BOLD) signal was recorded while monkeys maintained central fixation during the presentation of large rotating wedges and expending/contracting annulus of a "shaking" fruit basket, designed to maximize the recruitment of PPC neurons. Results of the surface-based population receptive field (pRF) analysis reveal a new cluster of four visuotopic areas at the confluence of the parieto-occipital and intra-parietal sulci, in a location previously defined histologically and anatomically as the posterior intra-parietal (PIP) region. This PIP cluster groups together two recently described areas (CIP1/2) laterally and two newly identified ones (PIP1/2) medially, whose foveal representations merge in the fundus of the intra-parietal sulcus. The cluster shares borders with other visuotopic areas: V3d posteriorly, V3A/DP laterally, V6/V6A medially and LIP anteriorly. Together, these results show that monkey PPC is endowed with a dense set of visuotopic areas, as its human counterpart. The fact that fMRI and wide-field stimulation allows a functional parsing of monkey PPC offers a new framework for studying functional homologies with human PPC.

Decoding visual information from high-density diffuse optical tomography neuroimaging data

Background:

Neural decoding could be useful in many ways, from serving as a neuroscience research tool to providing a means of augmented communication for patients with neurological conditions. However, applications of decoding are currently constrained by the limitations of traditional neuroimaging modalities. Electrocorticography requires invasive neurosurgery, magnetic resonance imaging (MRI) is too cumbersome for uses like daily communication, and alternatives like functional near-infrared spectroscopy (fNIRS) offer poor image quality. High-density diffuse optical tomography (HD-DOT) is an emerging modality that uses denser optode arrays than fNIRS to combine logistical advantages of optical neuroimaging with enhanced image quality. Despite the resulting promise of HD-DOT for facilitating field applications of neuroimaging, decoding of brain activity as measured by HD-DOT has yet to be evaluated.

Objective:

To assess the feasibility and performance of decoding with HD-DOT in visual cortex.

Methods and Results:

To establish the feasibility of decoding at the single-trial level with HD-DOT, a template matching strategy was used to decode visual stimulus position. A receiver operating characteristic (ROC) analysis was used to quantify the sensitivity, specificity, and reproducibility of binary visual decoding. Mean areas under the curve (AUCs) greater than 0.97 across 10 imaging sessions in a highly sampled participant were observed. ROC analyses of decoding across 5 participants established both reproducibility in multiple individuals and the feasibility of inter-individual decoding (mean AUCs > 0.7), although decoding performance varied between individuals. Phase-encoded checkerboard stimuli were used to assess more complex, non-binary decoding with HD-DOT. Across 3 highly sampled participants, the phase of a 60° wide checkerboard wedge rotating 10° per second through 360° was decoded with a within-participant error of 25.8±24.7°. Decoding between participants was also feasible based on permutation-based significance testing.

Conclusions:

Visual stimulus information can be decoded accurately, reproducibly, and across a range of detail (for both binary and non-binary outcomes) at the single-trial level (without needing to block-average test data) using HD-DOT data. These results lay the foundation for future studies of more complex decoding with HD-DOT and applications in clinical populations.

Spatially Specific Working Memory Activity in the Human Superior Colliculus

Theoretically, working memory (WM) representations are encoded by population activity of neurons with distributed tuning across the stored feature. Here, we leverage computational neuroimaging approaches to map the topographic organization of human superior colliculus (SC) and model how population activity in SC encodes WM representations. We first modeled receptive field properties of voxels in SC, deriving a detailed topographic organization resembling that of the primate SC. Neural activity within human (5 male and 1 female) SC persisted throughout a retention interval of several types of modified memory-guided saccade tasks. Assuming an underlying neural architecture of the SC based on its retinotopic organization, we used an encoding model to show that the pattern of activity in human SC represents locations stored in WM. Our tasks and models allowed us to dissociate the locations of visual targets and the motor metrics of memory-guided saccades from the spatial locations stored in WM, thus confirming that human SC represents true WM information. These data have several important implications. They add the SC to a growing number of cortical and subcortical brain areas that form distributed networks supporting WM functions. Moreover, they specify a clear neural mechanism by which topographically organized SC encodes WM representations.

SIGNIFICANCE STATEMENT Using computational neuroimaging approaches, we mapped the topographic organization of human superior colliculus (SC) and modeled how population activity in SC encodes working memory (WM) representations, rather than simpler visual or motor properties that have been traditionally associated with the laminar maps in the primate SC. Together, these data both position the human SC into a distributed network of brain areas supporting WM and elucidate the neural mechanisms by which the SC supports WM.

Optimizing Visual Cortex Parameterization with Error-Tolerant Teichmüller Map in Retinotopic Mapping

The mapping between the visual input on the retina to the cortical surface, i.e., retinotopic mapping, is an important topic in vision science and neuroscience. Human retinotopic mapping can be revealed by analyzing cortex functional magnetic resonance imaging (fMRI) signals when the subject is under specific visual stimuli. Conventional methods process, smooth, and analyze the retinotopic mapping based on the parametrization of the (partial) cortical surface. However, the retinotopic maps generated by this approach frequently contradict neuropsychology results. To address this problem, we propose an integrated approach that parameterizes the cortical surface, such that the parametric coordinates linearly relates the visual coordinate. The proposed method helps the smoothing of noisy retinotopic maps and obtains neurophysiological insights in human vision systems. One key element of the approach is the Error-Tolerant Teichmüller Map, which uniforms the angle distortion and maximizes the alignments to self-contradicting landmarks. We validated our overall approach with synthetic and real retinotopic mapping datasets. The experimental results show the proposed approach is superior in accuracy and compatibility. Although we focus on retinotopic mapping, the proposed framework is general and can be applied to process other human sensory maps.

Learning to Read Increases the Informativeness of Distributed Ventral Temporal Responses

Becoming a proficient reader requires substantial learning over many years. However, it is unknown how learning to read affects development of distributed visual representations across human ventral temporal cortex (VTC). Using fMRI and a data-driven, computational approach, we quantified the development of distributed VTC responses to characters (pseudowords and numbers) versus other domains in children, preteens, and adults. Results reveal anatomical- and hemisphere-specific development. With development, distributed responses to words and characters became more distinctive and informative in lateral but not medial VTC, and in the left but not right hemisphere. While the development of voxels with both positive and negative preference to words affected distributed information, only development of voxels with positive preference to words (i.e., word-selective) was correlated with reading ability. These data show that developmental increases in informativeness of distributed left lateral VTC responses are related to proficient reading and have important implications for both developmental theories and for elucidating neural mechanisms of reading disabilities.

Peeling the Onion of Brain Representations

The brain's function is to enable adaptive behavior in the world. To this end, the brain processes information about the world. The concept of representation links the information processed by the brain back to the world and enables us to understand what the brain does at a functional level. The appeal of making the connection between brain activity and what it represents has been irresistible to neuroscience, despite the fact that representational interpretations pose several challenges: We must define which aspects of brain activity matter, how the code works, and how it supports computations that contribute to adaptive behavior. It has been suggested that we might drop representational language altogether and seek to understand the brain, more simply, as a dynamical system. In this review, we argue that the concept of representation provides a useful link between dynamics and computational function and ask which aspects of brain activity should be analyzed to achieve a representational understanding. We peel the onion of brain representations in search of the layers (the aspects of brain activity) that matter to computation. The article provides an introduction to the motivation and mathematics of representational models, a critical discussion of their assumptions and limitations, and a preview of future directions in this area.

Electrocorticography Evidence of Tactile Responses in Visual Cortices

There is ongoing debate regarding the extent to which human cortices are specialized for processing a given sensory input versus a given type of information, independently of the sensory source. Many neuroimaging and electrophysiological studies have reported that primary and extrastriate visual cortices respond to tactile and auditory stimulation, in addition to visual inputs, suggesting these cortices are intrinsically multisensory. In particular for tactile responses, few studies have proven neuronal processes in visual cortex in humans. Here, we assessed tactile responses in both low-level and extrastriate visual cortices using electrocorticography recordings in a human participant. Specifically, we observed significant spectral power increases in the high frequency band (30-100 Hz) in response to tactile stimuli, reportedly associated with spiking neuronal activity, in both low-level visual cortex (i.e. V2) and in the anterior part of the lateral occipital-temporal cortex. These sites were both involved in processing tactile information and responsive to visual stimulation. More generally, the present results add to a mounting literature in support of task-sensitive and sensory-independent mechanisms underlying functions like spatial, motion, and self-processing in the brain and extending from higher-level as well as to low-level cortices.

Dynamics of the cerebral blood flow response to brief neural activity in human visual cortex

The blood oxygen-level dependent (BOLD) functional magnetic resonance imaging (fMRI) signal depends on an interplay of cerebral blood flow (CBF), oxygen metabolism, and cerebral blood volume. Despite wide usage of BOLD fMRI, it is not clear how these physiological components create the BOLD signal. Here, baseline CBF and its dynamics evoked by a brief stimulus (2 s) in human visual cortex were measured at 3T. We found a stereotypical CBF response: immediate increase, rising to a peak a few second after the stimulus, followed by a significant undershoot. The BOLD hemodynamic response function (HRF) was also measured in the same session. Strong correlations between HRF and CBF peak responses indicate that the flow responses evoked by neural activation in nearby gray matter drive the early HRF. Remarkably, peak CBF and HRF were also strongly modulated by baseline perfusion. The CBF undershoot was reliable and significantly correlated with the HRF undershoot. However, late-time dynamics of the HRF and CBF suggest that oxygen metabolism can also contribute to the HRF undershoot. Combined measurement of the CBF and HRF for brief neural activation is a useful tool to understand the temporal dynamics of neurovascular and neurometabolic coupling.

Convergence Along the Visual Hierarchy Is Altered in Posterior Cortical Atrophy

Purpose

Posterior cortical atrophy (PCA) is a rare neurodegenerative syndrome manifesting with visuospatial processing impairment. We recently suggested that abnormal population receptive field properties are associated with the symptoms of PCA patients. Specifically, simultanagnosia, the inability to perceive multiple items simultaneously, can be explained by smaller peripheral population receptive fields, and foveal crowding, in which nearby distractors interfere with object perception, may result from larger foveal population receptive fields. These effects occurred predominantly in V1, even though atrophy mainly involves high-order areas. In this study, we used connective field modeling to better understand these inter-area interactions.

Methods

We used functional magnetic resonance imaging to scan six PCA patients and eight controls while they viewed drifting bar stimuli. Resting-state data were also collected. Connective field modeling was applied for both conditions: once when the source was V1 and the targets were extrastriate areas and once for the opposite direction. The difference between the two was defined as convergence magnitude.

Results

With stimulus, the convergence magnitude of the controls increased along the visual pathway, suggesting that spatial integration from V1 becomes larger up the visual hierarchy. No such slope was found in the PCA patients. The difference between the groups originated mainly from the dorsal pathway. Without stimulus, the convergence magnitude was negative, slightly more so for the PCA patients, with no slope, suggesting constant divergence along the visual hierarchy.

Conclusions

Atrophy in one part of the visual system can affect other areas within the network through complex intervisual area interactions, resulting in modulation of population receptive field properties and an ensemble of visuocognitive function impairments.

Increased Right Posterior STS Recruitment Without Enhanced Directional-Tuning During Tactile Motion Processing in Early Deaf Individuals

Upon early sensory deprivation, the remaining modalities often exhibit cross-modal reorganization, such as primary auditory cortex (PAC) recruitment for visual motion processing in early deafness (ED). Previous studies of compensatory plasticity in ED individuals have given less attention to tactile motion processing. In the current study, we aimed to examine the effects of early auditory deprivation on tactile motion processing. We simulated four directions of tactile motion on each participant's right index finger and characterized their tactile motion responses and directional-tuning profiles using population receptive field analysis. Similar tactile motion responses were found within primary (SI) and secondary (SII) somatosensory cortices between ED and hearing control groups, whereas ED individuals showed a reduced proportion of voxels with directionally tuned responses in SI contralateral to stimulation. There were also significant but minimal responses to tactile motion within PAC for both groups. While early deaf individuals show significantly larger recruitment of right posterior superior temporal sulcus (pSTS) region upon tactile motion stimulation, there was no evidence of enhanced directional tuning. Greater recruitment of right pSTS region is consistent with prior studies reporting reorganization of multimodal areas due to sensory deprivation. The absence of increased directional tuning within the right pSTS region may suggest a more distributed population of neurons dedicated to processing tactile spatial information as a consequence of early auditory deprivation.

Foveal pRF properties in the visual cortex depend on the extent of stimulated visual field

Previous studies demonstrated that alterations in functional MRI derived receptive field (pRF) properties in cortical projection zones of retinal lesions can erroneously be mistaken for cortical large-scale reorganization in response to visual system pathologies. We tested, whether such confounds are also evident in the normal cortical projection zone of the fovea for simulated peripheral visual field defects. We applied fMRI-based visual field mapping of the central visual field at 3 T in eight controls to compare the pRF properties of the central visual field of a reference condition (stimulus radius: 14°) and two conditions with simulated peripheral visual field defect, i.e., with a peripheral gray mask, stimulating only the central 7° or 4° radius. We quantified, for the cortical representation of the actually stimulated visual field, the changes in the position and size of the pRFs associated with reduced peripheral stimulation using conventional and advanced pRF modeling. We found foveal pRF-positions (≤3°) to be significantly shifted towards the periphery (p<0.05, corrected). These pRF-shifts were largest for the 4° condition [visual area (mean eccentricity shift): V1 (0.9°), V2 (0.9°), V3 (1.0°)], but also evident for the 7° condition [V1 (0.5°), V2 (0.5°), V3 (0.9°)]. Further, an overall enlargement of pRF-sizes was observed. These findings indicate the dependence of foveal pRF parameters on the spatial extent of the stimulated visual field and are likely associated with methodological biases and/or physiological mechanisms. Consequently, our results imply that, previously reported similar findings in patients with actual peripheral scotomas need to be interpreted with caution and indicate the need for adequate control conditions in investigations of visual cortex reorganization.

Encoding schemes in somatosensation: From micro- to meta-topography

Encoding schemes are systematic large-scale arrangements that convert incoming sensory information into a format required for further information processing. The increased spatial resolution of brain images obtained with ultra-high field magnetic resonance imaging at 7 T (7T-MRI) and above increases the granularity and precision of processing units that mediate the link between neuronal encoding and functional readouts. Here, these new developments are reviewed with a focus on human tactile encoding schemes derived from small-scale processing units (in the order of 0.5-5 mm) that are relevant for theoretical and practical concepts of somatosensory encoding and cortical plasticity. Precisely, we review recent approaches to characterize meso-scale maps, layer units, and cortical fields in the sensorimotor cortex of the living human brain and discuss their impact on theories of perception, motor control, topographic encoding, and cortical plasticity. Finally, we discuss concepts on the integration of small-scale processing units into functional networks that span multiple topographic maps and multiple cortical areas. Novel research areas are highlighted that may help to bridge the gap between cortical microstructure and meta-topographic models on brain anatomy and function.

Intersubject Spatial Pattern Correlations During Movie Viewing Are Stimulus-Driven and Nonuniform Across the Cortex

A fundamental step to predicting brain activity in healthy and diseased populations is characterizing the common spatio-temporal response to a shared experience. Multivoxel pattern analysis allows us to investigate information encoding through these patterns; however, we have yet to explore local, stimulus-driven, patterns of cortical activity during naturalistic stimulation. We sought to examine these patterns with minimum interpolation—excluding functional alignment—to characterize the most basic degree of shared response between subjects. We used an unbiased analytic approach, combined with rich, naturalistic, and nonsemantic stimulation to estimate shared spatial patterns in functional magnetic resonance imaging responses across a large group. We found that meso-scale spatial patterns were shared nonuniformly across the visual cortex and represent information distinct from the shared temporal response. Shared spatial patterns were stimulus-driven, modulated by pattern size, and more sensitive to the contrast of 3D versus 2D stimulus differences than the temporal signals. Although the grand functional structure of the brain is understood to be common, these results suggest that even at a meso-scale, we share common spatial structures with anatomical alignment alone. The strength of this similarity varies across the cortex, suggesting some spatial structures are innately organized, whereas others are shaped by factors such as learning and plasticity.

Investigating the Reliability of Population Receptive Field Size Estimates Using fMRI

In functional MRI (fMRI), population receptive field (pRF) models allow a quantitative description of the response as a function of the features of the stimuli that are relevant for each voxel. The most popular pRF model used in fMRI assumes a Gaussian shape in the features space (e.g., the visual field) reducing the description of the voxel’s pRF to the Gaussian mean (the pRF preferred feature) and standard deviation (the pRF size). The estimation of the pRF mean has been proven to be highly reliable. However, the estimate of the pRF size has been shown not to be consistent within and between subjects. While this issue has been noted experimentally, here we use an optimization theory perspective to describe how the inconsistency in estimating the pRF size is linked to an inherent property of the Gaussian pRF model. When fitting such models, the goodness of fit is less sensitive to variations in the pRF size than to variations in the pRF mean. We also show how the same issue can be considered from a bias-variance perspective. We compare different estimation procedures in terms of the reliability of their estimates using simulated and real fMRI data in the visual (using the Human Connectome Project database) and auditory domain. We show that, the reliability of the estimate of the pRF size can be improved considering a linear combination of those pRF models with similar goodness of fit or a permutation based approach. This increase in reliability of the pRF size estimate does not affect the reliability of the estimate of the pRF mean and the prediction accuracy.