Cortical depth dependent population receptive field attraction by spatial attention in human V1

Spatial attention alters visual cortical representation during target anticipation

Attention enables us to efficiently and flexibly interact with the environment by prioritizing some image features in preparation for responding to a stimulus. Using a concurrent psychophysics- fMRI experiment, we investigated how covert spatial attention affects responses in human visual cortex prior to target onset, and how it affects subsequent behavioral performance. Performance improved at cued locations and worsened at uncued locations, relative to distributed attention, demonstrating a selective tradeoff in processing. Pre-target BOLD responses in cortical visual field maps changed in two ways: First, there was a stimulus-independent baseline shift, positive in map locations near the cued location and negative elsewhere, paralleling the behavioral results. Second, population receptive field centers shifted toward the attended location. Both effects increased in higher visual areas. Together, the results show that spatial attention has large effects on visual cortex prior to target appearance, altering neural response properties throughout and across multiple visual field maps.

Are neuronal mechanisms of attention universal across human sensory and motor brain maps?

One's experience of shifting attention from the color to the smell to the act of picking a flower seems like a unitary process applied, at will, to one modality after another. Yet, the unique and separable experiences of sight versus smell versus movement might suggest that the neural mechanisms of attention have been separately optimized to employ each modality to its greatest advantage. Moreover, addressing the issue of universality can be particularly difficult due to a paucity of existing cross-modal comparisons and a dearth of neurophysiological methods that can be applied equally well across disparate modalities. Here we outline some of the conceptual and methodological issues related to this problem and present an instructive example of an experimental approach that can be applied widely throughout the human brain to permit detailed, quantitative comparison of attentional mechanisms across modalities. The ultimate goal is to spur efforts across disciplines to provide a large and varied database of empirical observations that will either support the notion of a universal neural substrate for attention or more clearly identify the degree to which attentional mechanisms are specialized for each modality.

Neuronal modeling of magnetoencephalography responses in auditory cortex to auditory and visual stimuli

Previous studies have demonstrated that auditory cortex activity can be influenced by crosssensory visual inputs. Intracortical recordings in non-human primates (NHP) have suggested a bottom-up feedforward (FF) type laminar profile for auditory evoked but top-down feedback (FB) type for cross-sensory visual evoked activity in the auditory cortex. To test whether this principle applies also to humans, we analyzed magnetoencephalography (MEG) responses from eight human subjects (six females) evoked by simple auditory or visual stimuli. In the estimated MEG source waveforms for auditory cortex region of interest, auditory evoked responses showed peaks at 37 and 90 ms and cross-sensory visual responses at 125 ms. The inputs to the auditory cortex were then modeled through FF and FB type connections targeting different cortical layers using the Human Neocortical Neurosolver (HNN), which consists of a neocortical circuit model linking the cellular- and circuit-level mechanisms to MEG. The HNN models suggested that the measured auditory response could be explained by an FF input followed by an FB input, and the crosssensory visual response by an FB input. Thus, the combined MEG and HNN results support the hypothesis that cross-sensory visual input in the auditory cortex is of FB type. The results also illustrate how the dynamic patterns of the estimated MEG/EEG source activity can provide information about the characteristics of the input into a cortical area in terms of the hierarchical organization among areas.

Multilayer Network Analysis across Cortical Depths in Resting-State 7T fMRI

In graph theory, "multilayer networks" represent systems involving several interconnected topological levels. A neuroscience example is the hierarchy of connections between different cortical depths or "lamina". This hierarchy is becoming non-invasively accessible in humans using ultra-high-resolution functional MRI (fMRI). Here, we applied multilayer graph theory to examine functional connectivity across different cortical depths in humans, using 7T fMRI (1-mm3 voxels; 30 participants). Blood oxygenation level dependent (BOLD) signals were derived from five depths between the white matter and pial surface. We then compared networks where the inter-regional connections were limited to a single cortical depth only ("layer-by-layer matrices") to those considering all possible connections between regions and cortical depths ("multilayer matrix"). We utilized global and local graph theory features that quantitatively characterize network attributes such as network composition, nodal centrality, path-based measures, and hub segregation. Detecting functional differences between cortical depths was improved using multilayer connectomics compared to the layer-by-layer versions. Superficial aspects of the cortex dominated information transfer and deeper aspects clustering. These differences were largest in frontotemporal and limbic brain regions. fMRI functional connectivity across different cortical depths may contain neurophysiologically relevant information. Multilayer connectomics could provide a methodological framework for studies on how information flows across this hierarchy.

A selection and targeting framework of cortical locations for line-scanning fMRI

Depth-resolved functional magnetic resonance imaging (fMRI) is an emerging field growing in popularity given the potential of separating signals from different computational processes in cerebral cortex. Conventional acquisition schemes suffer from low spatial and temporal resolutions. Line-scanning methods allow depth-resolved fMRI by sacrificing spatial coverage to sample blood oxygenated level-dependent (BOLD) responses at ultra-high temporal and spatial resolution. For neuroscience applications, it is critical to be able to place the line accurately to (1) sample the right neural population and (2) target that neural population with tailored stimuli or tasks. To this end, we devised a multi-session framework where a target cortical location is selected based on anatomical and functional properties. The line is then positioned according to this information in a separate second session, and we tailor the experiment to focus on the target location. Anatomically, the precision of the line placement was confirmed by projecting a nominal representation of the acquired line back onto the surface. Functional estimates of neural selectivities in the line, as quantified by a visual population-receptive field model, resembled the target selectivities well for most subjects. This functional precision was quantified in detail by estimating the distance between the visual field location of the targeted vertex and the location in visual cortex (V1) that most closely resembled the line-scanning estimates; this distance was on average ~5.5 mm. Given the dimensions of the line, differences in acquisition, session, and stimulus design, this validates that line-scanning can be used to probe local neural sensitivities across sessions. In summary, we present an accurate framework for line-scanning MRI; we believe such a framework is required to harness the full potential of line-scanning and maximize its utility. Furthermore, this approach bridges canonical fMRI experiments with electrophysiological experiments, which in turn allows novel avenues for studying human physiology non-invasively.

Functional neuroimaging as a catalyst for integrated neuroscience

Functional magnetic resonance imaging (fMRI) enables non-invasive access to the awake, behaving human brain. By tracking whole-brain signals across a diverse range of cognitive and behavioural states or mapping differences associated with specific traits or clinical conditions, fMRI has advanced our understanding of brain function and its links to both normal and atypical behaviour. Despite this headway, progress in human cognitive neuroscience that uses fMRI has been relatively isolated from rapid advances in other subdomains of neuroscience, which themselves are also somewhat siloed from one another. In this Perspective, we argue that fMRI is well-placed to integrate the diverse subfields of systems, cognitive, computational and clinical neuroscience. We first summarize the strengths and weaknesses of fMRI as an imaging tool, then highlight examples of studies that have successfully used fMRI in each subdomain of neuroscience. We then provide a roadmap for the future advances that will be needed to realize this integrative vision. In this way, we hope to demonstrate how fMRI can help usher in a new era of interdisciplinary coherence in neuroscience.

Seeing and extrapolating motion trajectories share common informative activation patterns in primary visual cortex

The natural environment is dynamic and moving objects become constantly occluded, engaging the brain in a challenging completion process to estimate where and when the object might reappear. Although motion extrapolation is critical in daily life-imagine crossing the street while an approaching car is occluded by a larger standing vehicle-its neural underpinnings are still not well understood. While the engagement of low-level visual cortex during dynamic occlusion has been postulated, most of the previous group-level fMRI-studies failed to find evidence for an involvement of low-level visual areas during occlusion. In this fMRI-study, we therefore used individually defined retinotopic maps and multivariate pattern analysis to characterize the neural basis of visible and occluded changes in motion direction in humans. To this end, participants learned velocity-direction change pairings (slow motion-upwards; fast motion-downwards or vice versa) during a training phase without occlusion and judged the change in stimulus direction, based on its velocity, during a following test phase with occlusion. We find that occluded motion direction can be predicted from the activity patterns during visible motion within low-level visual areas, supporting the notion of a mental representation of motion trajectory in these regions during occlusion.

Cortical depth profiles of auditory and visual 7 T functional MRI responses in human superior temporal areas

Invasive neurophysiological studies in nonhuman primates have shown different laminar activation profiles to auditory vs. visual stimuli in auditory cortices and adjacent polymodal areas. Means to examine the underlying feedforward vs. feedback type influences noninvasively have been limited in humans. Here, using 1-mm isotropic resolution 3D echo-planar imaging at 7 T, we studied the intracortical depth profiles of functional magnetic resonance imaging (fMRI) blood oxygenation level dependent (BOLD) signals to brief auditory (noise bursts) and visual (checkerboard) stimuli. BOLD percent-signal-changes were estimated at 11 equally spaced intracortical depths, within regions-of-interest encompassing auditory (Heschl's gyrus, Heschl's sulcus, planum temporale, and posterior superior temporal gyrus) and polymodal (middle and posterior superior temporal sulcus) areas. Effects of differing BOLD signal strengths for auditory and visual stimuli were controlled via normalization and statistical modeling. The BOLD depth profile shapes, modeled with quadratic regression, were significantly different for auditory vs. visual stimuli in auditory cortices, but not in polymodal areas. The different depth profiles could reflect sensory-specific feedforward versus cross-sensory feedback influences, previously shown in laminar recordings in nonhuman primates. The results suggest that intracortical BOLD profiles can help distinguish between feedforward and feedback type influences in the human brain. Further experimental studies are still needed to clarify how underlying signal strength influences BOLD depth profiles under different stimulus conditions.

Layer-specific correlates of detected and undetected auditory targets during attention

In everyday life, the processing of acoustic information allows us to react to subtle changes in the auditory scene. Yet even when closely attending to sounds in the context of a task, we occasionally miss task-relevant features. The neural computations that underlie our ability to detect behavioral relevant sound changes are thought to be grounded in both feedforward and feedback processes within the auditory hierarchy. Here, we assessed the role of feedforward and feedback contributions in primary and non-primary auditory areas during behavioral detection of target sounds using submillimeter spatial resolution functional magnetic resonance imaging (fMRI) at high-fields (7 T) in humans. We demonstrate that the successful detection of subtle temporal shifts in target sounds leads to a selective increase of activation in superficial layers of primary auditory cortex (PAC). These results indicate that feedback signals reaching as far back as PAC may be relevant to the detection of targets in the auditory scene.

What has vision science taught us about functional MRI?

In the domain of human neuroimaging, much attention has been paid to the question of whether and how the development of functional magnetic resonance imaging (fMRI) has advanced our scientific knowledge of the human brain. However, the opposite question is also important; how has our knowledge of the visual system advanced our understanding of fMRI? Here, we discuss how and why scientific knowledge about the human and animal visual system has been used to answer fundamental questions about fMRI as a brain measurement tool and how these answers have contributed to scientific discoveries beyond vision science.

The promise of layer-specific neuroimaging for testing predictive coding theories of psychosis

Predictive coding potentially provides an explanatory model for understanding the neurocognitive mechanisms of psychosis. It proposes that cognitive processes, such as perception and inference, are implemented by a hierarchical system, with the influence of each level being a function of the estimated precision of beliefs at that level. However, predictive coding models of psychosis are insufficiently constrained-any phenomenon can be explained in multiple ways by postulating different changes to precision at different levels of processing. One reason for the lack of constraint in these models is that the core processes are thought to be implemented by the function of specific cortical layers, and the technology to measure layer specific neural activity in humans has until recently been lacking. As a result, our ability to constrain the models with empirical data has been limited. In this review we provide a brief overview of predictive processing models of psychosis and then describe the potential for newly developed, layer specific neuroimaging techniques to test and thus constrain these models. We conclude by discussing the most promising avenues for this research as well as the technical and conceptual challenges which may limit its application.

Point-spread function of the BOLD response across columns and cortical depth in human extra-striate cortex

Columns and layers are fundamental organizational units of the brain. Well known examples of cortical columns are the ocular dominance columns (ODCs) in primary visual cortex and the column-like stripe-based arrangement in the second visual area V2. The spatial scale of columns and layers is beyond the reach of conventional neuroimaging, but the advent of high field magnetic resonance imaging (MRI) scanners (UHF, 7 Tesla and above) has opened the possibility to acquire data at this spatial scale, in-vivo and non-invasively in humans. The most prominent non-invasive technique to measure brain function is blood oxygen level dependent (BOLD) fMRI, measuring brain activity indirectly, via changes in hemodynamics. A key determinant of the ability of high-resolution BOLD fMRI to accurately resolve columns and layers is the point-spread function (PSF) of the BOLD response in relation to the spatial extent of neuronal activity. In this study we take advantage of the stripe-based arrangement present in visual area V2, coupled with sub-millimetre anatomical and gradient-echo BOLD (GE BOLD) acquisition at 7 T to obtain PSF estimates and along cortical depth in human participants. Results show that the BOLD PSF is maximal in the superficial part of the cortex (1.78 mm), and it decreases with increasing cortical depth (0.83 mm close to white matter).

Divisive normalization unifies disparate response signatures throughout the human visual hierarchy

A canonical neural computation is a mathematical operation applied by the brain in a wide variety of contexts and capable of explaining and unifying seemingly unrelated neural and perceptual phenomena. Here, we use a combination of state-of-the-art experiments (ultra-high-field functional MRI) and mathematical methods (population receptive field [pRF] modeling) to uniquely demonstrate the role of divisive normalization (DN) as the canonical neural computation underlying visuospatial responses throughout the human visual hierarchy. The DN pRF model provides a tool to investigate and interpret the computational processes underlying neural responses in human and animal recordings, but also in clinical and cognitive dimensions.

Neural processing is hypothesized to apply the same mathematical operations in a variety of contexts, implementing so-called canonical neural computations. Divisive normalization (DN) is considered a prime candidate for a canonical computation. Here, we propose a population receptive field (pRF) model based on DN and evaluate it using ultra-high-field functional MRI (fMRI). The DN model parsimoniously captures seemingly disparate response signatures with a single computation, superseding existing pRF models in both performance and biological plausibility. We observe systematic variations in specific DN model parameters across the visual hierarchy and show how they relate to differences in response modulation and visuospatial information integration. The DN model delivers a unifying framework for visuospatial responses throughout the human visual hierarchy and provides insights into its underlying information-encoding computations. These findings extend the role of DN as a canonical computation to neuronal populations throughout the human visual hierarchy.

Predictive masking of an artificial scotoma is associated with a system-wide reconfiguration of neural populations in the human visual cortex

The visual brain has the remarkable capacity to complete our percept of the world even when the information extracted from the visual scene is incomplete. This ability to predict missing information based on information from spatially adjacent regions is an intriguing attribute of healthy vision. Yet, it gains particular significance when it masks the perceptual consequences of a retinal lesion, leaving patients unaware of their partial loss of vision and ultimately delaying diagnosis and treatment. At present, our understanding of the neural basis of this masking process is limited which hinders both quantitative modeling as well as translational application. To overcome this, we asked the participants to view visual stimuli with and without superimposed artificial scotoma (AS). We used fMRI to record the associated cortical activity and applied model-based analyzes to track changes in cortical population receptive fields and connectivity in response to the introduction of the AS. We found that throughout the visual field and cortical hierarchy, pRFs shifted their preferred position towards the AS border. Moreover, extrastriate areas biased their sampling of V1 towards sections outside the AS projection zone, thereby effectively masking the AS with signals from spared portions of the visual field. We speculate that the signals that drive these system-wide population modifications originate in extrastriate visual areas and, through feedback, also reconfigure the neural populations in the earlier visual areas.

Perceived and mentally rotated contents are differentially represented in cortical depth of V1

Primary visual cortex (V1) in humans is known to represent both veridically perceived external input and internally-generated contents underlying imagery and mental rotation. However, it is unknown how the brain keeps these contents separate thus avoiding a mixture of the perceived and the imagined which could lead to potentially detrimental consequences. Inspired by neuroanatomical studies showing that feedforward and feedback connections in V1 terminate in different cortical layers, we hypothesized that this anatomical compartmentalization underlies functional segregation of external and internally-generated visual contents, respectively. We used high-resolution layer-specific fMRI to test this hypothesis in a mental rotation task. We found that rotated contents were predominant at outer cortical depth bins (i.e. superficial and deep). At the same time perceived contents were represented stronger at the middle cortical bin. These results identify how through cortical depth compartmentalization V1 functionally segregates rather than confuses external from internally-generated visual contents. These results indicate that feedforward and feedback manifest in distinct subdivisions of the early visual cortex, thereby reflecting a general strategy for implementing multiple cognitive functions within a single brain region.

In order to test whether there is a cortical depth compartmentalization in the processing of external and internally-generated visual contents, Iamshchinina et al use high-resolution fMRI at 7 T in participants performing a mental rotation task. They demonstrate that feedforward and feedback representations during mental rotation manifest at differentiable grey matter depth in early visual cortex, thereby reflecting a general strategy for implementing multiple cognitive functions within a single brain region.

Attention selectively enhances stimulus information for surround over foveal stimulus representations in occipital cortex

By attending to part of a visual scene, we can prioritize processing of the most relevant visual information and so use our limited resources effectively. Previous functional magnetic resonance imaging (fMRI) work has shown that attention can increase overall blood-oxygen-level-dependent (BOLD) signal responsiveness but also enhances the stimulus information in terms of classifier performance. Here, we investigate how these effects vary across the visual field. We compare attention-enhanced fMRI-BOLD amplitude responses and classifier accuracy in fovea and surrounding stimulus regions using a set of four simple stimuli subdivided into a foveal region (1.4° diameter) and a surround region (15° diameter). We found dissociations between the effects of attention on average response and in enhancing stimulus information. In early visual cortex, we found that attention increased the amplitude of responses to both foveal and surround parts of the stimuli and increased classifier performance only for the surround stimulus. Conversely, ventral visual areas showed less change in average response but greater changes in decoding. Unlike for early visual cortex, in the ventral visual cortex attention produced similar changes in decoding for center and surround stimuli.

Sub-millimetre resolution laminar fMRI using Arterial Spin Labelling in humans at 7 T

Laminar fMRI at ultra-high magnetic field strength is typically carried out using the Blood Oxygenation Level-Dependent (BOLD) contrast. Despite its unrivalled sensitivity to detecting activation, the BOLD contrast is limited in its spatial specificity due to signals stemming from intra-cortical ascending and pial veins. Alternatively, regional changes in perfusion (i.e., cerebral blood flow through tissue) are colocalised to neuronal activation, which can be non-invasively measured using Arterial Spin Labelling (ASL) MRI. In addition, ASL provides a quantitative marker of neuronal activation in terms of perfusion signal, which is simultaneously acquired along with the BOLD signal. However, ASL for laminar imaging is challenging due to the lower SNR of the perfusion signal and higher RF power deposition i.e., specific absorption rate (SAR) of ASL sequences. In the present study, we present for the first time in humans, isotropic sub-millimetre spatial resolution functional perfusion images using Flow-sensitive Alternating Inversion Recovery (FAIR) ASL with a 3D-EPI readout at 7 T. We show that robust statistical activation maps can be obtained with perfusion-weighting in a single session. We observed the characteristic BOLD amplitude increase towards the superficial laminae, and, in apparent discrepancy, the relative perfusion profile shows a decrease of the amplitude and the absolute perfusion profile a much smaller increase towards the cortical surface. Considering the draining vein effect on the BOLD signal using model-based spatial “convolution”, we show that the empirically measured perfusion and BOLD profiles are, in fact, consistent with each other. This study demonstrates that laminar perfusion fMRI in humans is feasible at 7 T and that caution must be exercised when interpreting BOLD signal laminar profiles as direct representation of the cortical distribution of neuronal activity.

Point-spread function of the BOLD response across columns and cortical depth in human extra-striate cortex

Columns and layers are fundamental organizational units of the brain. Well known examples of cortical columns are the ocular dominance columns (ODCs) in primary visual cortex and the column-like stripe-based arrangement in the second visual area V2. The spatial scale of columns and layers is beyond the reach of conventional neuroimaging, but the advent of high field magnetic resonance imaging (MRI) scanners (UHF, 7 T and above) has opened the possibility to acquire data at this spatial scale, in-vivo and non-invasively in humans. The most prominent non-invasive technique to measure brain function is blood oxygen level dependent (BOLD) fMRI, measuring brain activity indirectly, via changes in hemodynamics. A key determinant of the ability of high-resolution BOLD fMRI to accurately resolve columns and layers is the point-spread function (PSF) of the BOLD response in relation to the spatial extent of neuronal activity. In this study we take advantage of the stripe-based arrangement present in visual area V2, coupled with sub-millimetre anatomical and gradient-echo BOLD (GE BOLD) acquisition at 7 T to obtain PSF estimates and along cortical depth in human participants. Results show that the BOLD PSF is maximal in the superficial part of the cortex (1.78 mm), and it decreases with increasing cortical depth (0.83 mm close to white matter).

Zooming-in on higher-level vision: High-resolution fMRI for understanding visual perception and awareness

One of the central questions in visual neuroscience is how the sparse retinal signals leaving our eyes are transformed into a rich subjective visual experience of the world. Invasive physiology studies, which offers the highest spatial resolution, have revealed many facts about the processing of simple visual features like contrast, color, and orientation, focusing on the early visual areas. At the same time, standard human fMRI studies with comparably coarser spatial resolution have revealed more complex, functionally specialized, and category-selective responses in higher visual areas. Although the visual system is the best understood among the sensory modalities, these two areas of research remain largely segregated. High-resolution fMRI opens up a possibility for linking them. On the one hand, it allows studying how the higher-level visual functions affect the fine-scale activity in early visual areas. On the other hand, it allows discovering the fine-scale functional organization of higher visual areas and exploring their functional connectivity with visual areas lower in the hierarchy. In this review, I will discuss examples of successful work undertaken in these directions using high-resolution fMRI and discuss where this method could be applied in the future to advance our understanding of the complexity of higher-level visual processing.

Prior expectations evoke stimulus-specific activity in the deep layers of the primary visual cortex

The way we perceive the world is strongly influenced by our expectations. In line with this, much recent research has revealed that prior expectations strongly modulate sensory processing. However, the neural circuitry through which the brain integrates external sensory inputs with internal expectation signals remains unknown. In order to understand the computational architecture of the cortex, we need to investigate the way these signals flow through the cortical layers. This is crucial because the different cortical layers have distinct intra- and interregional connectivity patterns, and therefore determining which layers are involved in a cortical computation can inform us on the sources and targets of these signals. Here, we used ultra-high field (7T) functional magnetic resonance imaging (fMRI) to reveal that prior expectations evoke stimulus-specific activity selectively in the deep layers of the primary visual cortex (V1). These findings are in line with predictive processing theories proposing that neurons in the deep cortical layers represent perceptual hypotheses and thereby shed light on the computational architecture of cortex.

The way we perceive the world is strongly influenced by our expectations, but the neural circuitry through which the brain achieves this remains unknown. A study using ultra-high field fMRI reveals that prior expectations evoke stimulus-specific signals in the deep layers of the primary visual cortex.

Higher and deeper: Bringing layer fMRI to association cortex

Recent advances in fMRI have enabled non-invasive measurements of brain function in awake, behaving humans at unprecedented spatial resolutions, allowing us to separate activity in distinct cortical layers. While most layer fMRI studies to date have focused on primary cortices, we argue that the next big steps forward in our understanding of cognition will come from expanding this technology into higher-order association cortex, to characterize depth-dependent activity during increasingly sophisticated mental processes. We outline phenomena and theories ripe for investigation with layer fMRI, including perception and imagery, selective attention, and predictive coding. We discuss practical and theoretical challenges to cognitive applications of layer fMRI, including localizing regions of interest in the face of substantial anatomical heterogeneity across individuals, designing appropriate task paradigms within the confines of acquisition parameters, and generating hypotheses for higher-order brain regions where the laminar circuitry is less well understood. We consider how applying layer fMRI in association cortex may help inform computational models of brain function as well as shed light on consciousness and mental illness, and issue a call to arms to our fellow methodologists and neuroscientists to bring layer fMRI to this next frontier.

Adaptation to feedback representation of illusory orientation produced from flash grab effect

Adaptation is a ubiquitous property of sensory systems. It is typically considered that neurons adapt to dominant energy in the ambient environment to function optimally. However, perceptual representation of the stimulus, often modulated by feedback signals, sometimes do not correspond to the input state of the stimulus, which tends to be more linked with feedforward signals. Here we investigated the relative contributions to cortical adaptation from feedforward and feedback signals, taking advantage of a visual illusion, the Flash-Grab Effect, to disassociate the feedforward and feedback representation of an adaptor. Results reveal that orientation adaptation is exclusively dependent on the perceived rather than the retinal orientation of the adaptor. Combined fMRI and EEG measurements demonstrate that the perceived orientation of the Flash-Grab Effect is indeed supported by feedback signals in the cortex. These findings highlight the important contribution of feedback signals for cortical neurons to recalibrate their sensitivity.

Feedforward-feedback signal interactions are common in the brain during sensory information processing. Here, the authors show that feedback-driven representation of perceived orientation dominates visual adaptation, despite the discrepant feedforward representation of input orientation.

Functional ultrasound imaging of deep visual cortex in awake nonhuman primates

Nowadays, several techniques exist to study and better understand how the brain works (fMRI, EEG, electrophysiology, etc.). Each has its own advantages and disadvantages (spatiotemporal resolution, maximal recording depth, signal-to-noise ratio, etc.). In this article, we show that the new functional ultrasound (fUS) imaging technique is appropriate to record and map brain activity in awake primates on a scale previously unreachable. It allows distinguishing patterns similar to ocular dominance bands in the visual cortex through all layers of the cortex, which was impossible before with common techniques. This paper demonstrates the utility of fUS imaging for studying brain activity in awake primates and its interest to all neuroscientists.

Deep regions of the brain are not easily accessible to investigation at the mesoscale level in awake animals or humans. We have recently developed a functional ultrasound (fUS) technique that enables imaging hemodynamic responses to visual tasks. Using fUS imaging on two awake nonhuman primates performing a passive fixation task, we constructed retinotopic maps at depth in the visual cortex (V1, V2, and V3) in the calcarine and lunate sulci. The maps could be acquired in a single-hour session with relatively few presentations of the stimuli. The spatial resolution of the technology is illustrated by mapping patterns similar to ocular dominance (OD) columns within superficial and deep layers of the primary visual cortex. These acquisitions using fUS suggested that OD selectivity is mostly present in layer IV but with extensions into layers II/III and V. This imaging technology provides a new mesoscale approach to the mapping of brain activity at high spatiotemporal resolution in awake subjects within the whole depth of the cortex.

Triple visual hemifield maps in a case of optic chiasm hypoplasia

In humans, each hemisphere comprises an overlay of two visuotopic maps of the contralateral visual field, one from each eye. Is the capacity of the visual cortex limited to these two maps or are plastic mechanisms available to host more maps? We determined the cortical organization of the visual field maps in a rare individual with chiasma hypoplasia, where visual cortex plasticity is challenged to accommodate three hemifield maps. Using high-resolution fMRI at 7T and diffusion-weighted MRI at 3T, we found three hemiretinal inputs, instead of the normal two, to converge onto the left hemisphere. fMRI-based population receptive field mapping of the left V1-V3 at 3T revealed three superimposed hemifield representations in the left visual cortex, i.e. two representations of opposing visual hemifields from the left eye and one right hemifield representation from the right eye. We conclude that developmental plasticity including the re-wiring of local intra- and cortico-cortical connections is pivotal to support the coexistence and functioning of three hemifield maps within one hemisphere.

Linear systems analysis for laminar fMRI: Evaluating BOLD amplitude scaling for luminance contrast manipulations

A fundamental assumption of nearly all functional magnetic resonance imaging (fMRI) analyses is that the relationship between local neuronal activity and the blood oxygenation level dependent (BOLD) signal can be described as following linear systems theory. With the advent of ultra-high field (7T and higher) MRI scanners, it has become possible to perform sub-millimeter resolution fMRI in humans. A novel and promising application of sub-millimeter fMRI is measuring responses across cortical depth, i.e. laminar imaging. However, the cortical vasculature and associated directional blood pooling towards the pial surface strongly influence the cortical depth-dependent BOLD signal, particularly for gradient-echo BOLD. This directional pooling may potentially affect BOLD linearity across cortical depth. Here we assess whether the amplitude scaling assumption for linear systems theory holds across cortical depth. For this, we use stimuli with different luminance contrasts to elicit different BOLD response amplitudes. We find that BOLD amplitude across cortical depth scales with luminance contrast, and that this scaling is identical across cortical depth. Although nonlinearities may be present for different stimulus configurations and acquisition protocols, our results suggest that the amplitude scaling assumption for linear systems theory across cortical depth holds for luminance contrast manipulations in sub-millimeter laminar BOLD fMRI.

Ultra-high-resolution fMRI of Human Ventral Temporal Cortex Reveals Differential Representation of Categories and Domains

Human ventral temporal cortex (VTC) is critical for visual recognition. It is thought that this ability is supported by large-scale patterns of activity across VTC that contain information about visual categories. However, it is unknown how category representations in VTC are organized at the submillimeter scale and across cortical depths. To fill this gap in knowledge, we measured BOLD responses in medial and lateral VTC to images spanning 10 categories from five domains (written characters, bodies, faces, places, and objects) at an ultra-high spatial resolution of 0.8 mm using 7 Tesla fMRI in both male and female participants. Representations in lateral VTC were organized most strongly at the general level of domains (e.g., places), whereas medial VTC was also organized at the level of specific categories (e.g., corridors and houses within the domain of places). In both lateral and medial VTC, domain-level and category-level structure decreased with cortical depth, and downsampling our data to standard resolution (2.4 mm) did not reverse differences in representations between lateral and medial VTC. The functional diversity of representations across VTC partitions may allow downstream regions to read out information in a flexible manner according to task demands. These results bridge an important gap between electrophysiological recordings in single neurons at the micron scale in nonhuman primates and standard-resolution fMRI in humans by elucidating distributed responses at the submillimeter scale with ultra-high-resolution fMRI in humans.SIGNIFICANCE STATEMENT Visual recognition is a fundamental ability supported by human ventral temporal cortex (VTC). However, the nature of fine-scale, submillimeter distributed representations in VTC is unknown. Using ultra-high-resolution fMRI of human VTC, we found differential distributed visual representations across lateral and medial VTC. Domain representations (e.g., faces, bodies, places, characters) were most salient in lateral VTC, whereas category representations (e.g., corridors/houses within the domain of places) were equally salient in medial VTC. These results bridge an important gap between electrophysiological recordings in single neurons at a micron scale and fMRI measurements at a millimeter scale.

Studying Cortical Plasticity in Ophthalmic and Neurological Disorders: From Stimulus-Driven to Cortical Circuitry Modeling Approaches

Unsolved questions in computational visual neuroscience research are whether and how neurons and their connecting cortical networks can adapt when normal vision is compromised by a neurodevelopmental disorder or damage to the visual system. This question on neuroplasticity is particularly relevant in the context of rehabilitation therapies that attempt to overcome limitations or damage, through either perceptual training or retinal and cortical implants. Studies on cortical neuroplasticity have generally made the assumption that neuronal population properties and the resulting visual field maps are stable in healthy observers. Consequently, differences in the estimates of these properties between patients and healthy observers have been taken as a straightforward indication for neuroplasticity. However, recent studies imply that the modeled neuronal properties and the cortical visual maps vary substantially within healthy participants, e.g., in response to specific stimuli or under the influence of cognitive factors such as attention. Although notable advances have been made to improve the reliability of stimulus-driven approaches, the reliance on the visual input remains a challenge for the interpretability of the obtained results. Therefore, we argue that there is an important role in the study of cortical neuroplasticity for approaches that assess intracortical signal processing and circuitry models that can link visual cortex anatomy, function, and dynamics.

Comparison of human population receptive field estimates between scanners and the effect of temporal filtering

Background: Population receptive field (pRF) analysis with functional magnetic resonance imaging (fMRI) is an increasingly popular method for mapping visual field representations and estimating the spatial selectivity of voxels in human visual cortex. However, the multitude of experimental setups and processing methods used makes comparisons of results between studies difficult. Methods: Here, we compared pRF maps acquired in the same three individuals using comparable scanning parameters on a 1.5 and a 3 Tesla scanner located in two different countries. We also tested the effect of low-pass filtering of the time series on pRF estimates. Results: As expected, the signal-to-noise ratio for the 3 Tesla data was superior; critically, however, estimates of pRF size and cortical magnification did not reveal any systematic differences between the sites. Unsurprisingly, low-pass filtering enhanced goodness-of-fit, presumably by removing high-frequency noise. However, there was no substantial increase in the number of voxels containing meaningful retinotopic signals after low-pass filtering. Importantly, filtering also increased estimates of pRF size in the early visual areas which could substantially skew interpretations of spatial tuning properties. Conclusion: Our results therefore suggest that pRF estimates are generally comparable between scanners of different field strengths, but temporal filtering should be used with caution.

Comparison of human population receptive field estimates between scanners and the effect of temporal filtering

Background: Population receptive field (pRF) analysis with functional magnetic resonance imaging (fMRI) is an increasingly popular method for mapping visual field representations and estimating the spatial selectivity of voxels in human visual cortex. However, the multitude of experimental setups and processing methods used makes comparisons of results between studies difficult. Methods: Here, we compared pRF maps acquired in the same three individuals using comparable scanning parameters on a 1.5 and a 3 Tesla scanner located in two different countries. We also tested the effect of low-pass filtering of the time series on pRF estimates. Results: As expected, the signal-to-noise ratio for the 3 Tesla data was superior; critically, however, estimates of pRF size and cortical magnification did not reveal any systematic differences between the sites. Unsurprisingly, low-pass filtering enhanced goodness-of-fit, presumably by removing high-frequency noise. However, there was no substantial increase in the number of voxels containing meaningful retinotopic signals after low-pass filtering. Importantly, filtering also increased estimates of pRF size in the early visual areas which could substantially skew interpretations of spatial tuning properties. Conclusion: Our results therefore suggest that pRF estimates are generally comparable between scanners of different field strengths, but temporal filtering should be used with caution.

Dissociable laminar profiles of concurrent bottom-up and top-down modulation in the human visual cortex

Recent developments in human neuroimaging make it possible to non-invasively measure neural activity from different cortical layers. This can potentially reveal not only which brain areas are engaged by a task, but also how. Specifically, bottom-up and top-down responses are associated with distinct laminar profiles. Here, we measured lamina-resolved fMRI responses during a visual task designed to induce concurrent bottom-up and top-down modulations via orthogonal manipulations of stimulus contrast and feature-based attention. BOLD responses were modulated by both stimulus contrast (bottom-up) and by engaging feature-based attention (top-down). Crucially, these effects operated at different cortical depths: Bottom-up modulations were strongest in the middle cortical layer and weaker in deep and superficial layers, while top-down modulations were strongest in the superficial layers. As such, we demonstrate that laminar activity profiles can discriminate between concurrent top-down and bottom-up processing, and are diagnostic of how a brain region is activated.