Eyetracker-based gaze correction for robust mapping of population receptive fields

Rapid effects of tryptamine psychedelics on perceptual distortions and early visual cortical population receptive fields

N, N-dimethyltryptamine (DMT) is a psychedelic tryptamine acting on 5-HT2A serotonin receptors, which is associated with intense visual hallucinatory phenomena and perceptual changes such as distortions in visual space. The neural underpinnings of these effects remain unknown. We hypothesised that changes in population receptive field (pRF) properties in the primary visual cortex (V1) might underlie visual perceptual experience. We tested this hypothesis using magnetic resonance imaging (MRI) in a within-subject design. We used a technique called pRF mapping, which measures neural population visual response properties and retinotopic maps in early visual areas. We show that in the presence of visual effects, as documented by the Hallucinogen Rating Scale (HRS), the mean pRF sizes in V1 significantly increase in the peripheral visual field for active condition (inhaled DMT) compared to the control. Eye and head movement differences were absent across conditions. This evidence for short-term effects of DMT in pRF may explain perceptual distortions induced by psychedelics such as field blurring, tunnel vision (peripheral vision becoming blurred while central vision remains sharp) and the enlargement of nearby visual space, particularly at the visual locations surrounding the fovea. Our findings are also consistent with a mechanistic framework whereby gain control of ongoing and evoked activity in the visual cortex is controlled by activation of 5-HT2A receptors.

Retinotopic cortical mapping in objective functional monitoring of macular therapy

BACKGROUND/AIMS

To determine the suitability of functional MRI (fMRI) as an objective measure of macular function following therapeutic intervention; conventional psychophysical measures rely heavily on patient compliance.

METHODS

Twenty patients with neovascular age-related macular degeneration (nAMD) were studied with high-resolution fMRI, visual acuity, reading accuracy and speed, contrast sensitivity (CS) and microperimetry (MP) before and after 3 monthly intravitreal injections of ranibizumab. Population-receptive field retinotopic maps calculated from fMRI data were compared with psychophysical measures and optical coherence tomography.

RESULTS

Best-corrected visual acuity (BCVA) responders (≥5 letters) showed an increase of 29.5% in activated brain area, while non-responders showed a decrease of 0.8%. Radial histograms over eccentricity allowed quantification of the absolute number of significant voxels and thus differences before and after treatment. Responders showed increases in foveal (α<0.5°) activation, while non-responders did not. Absence of intraretinal fluid and preservation of outer retinal layers was associated with higher numbers of active V1 voxels and better BCVA. Higher voxel numbers were associated with improved reading performance and, less marked, with BCVA, CS and MP.

CONCLUSION

The data show that retinotopic mapping using fMRI can successfully be applied objectively to evaluate the therapeutic response in nAMD patients treated with anti-vascular endothelial growth factor therapy. This demonstrates the ability of retinotopic mapping to provide an objective assessment of functional recovery at a cortical level; the technique can therefore be applied, in other degenerative macular diseases, to the assessment of potential therapeutic interventions such as gene therapy or cell replacement therapy.

Early visual experience refines the retinotopic organization within and across visual cortical regions

Early visual areas are retinotopically organized in human and non-human primates. Population receptive field (pRF) size increases with eccentricity and from lower- to higher-level visual areas. Furthermore, the cortical magnification factor (CMF), a measure of how much cortical space is devoted to each degree of visual angle, is typically larger for foveal as opposed to peripheral regions of the visual field. Whether this fine-scale organization within and across visual areas depends on early visual experience has yet been unknown. Here, we employed 7T functional magnetic resonance imaging pRF mapping to assess the retinotopic organization of early visual regions (i.e., V1, V2, and V3) in eight sight recovery individuals with a history of congenital blindness until a maximum of 4 years of age. Compared with sighted controls, foveal pRF sizes in these individuals were larger, and pRF sizes did not show the typical increase with eccentricity and down the visual cortical processing stream (V1-V2-V3). Cortical magnification was overall diminished and decreased less from foveal to parafoveal visual field locations. Furthermore, cortical magnification correlated with visual acuity in sight recovery individuals. The results of this study suggest that early visual experience is essential for refining a presumably innate prototypical retinotopic organization in humans within and across visual areas, which seems to be crucial for acquiring full visual capabilities.

Retinotopic connectivity maps of human visual cortex with unconstrained eye movements

Human visual cortex contains topographic visual field maps whose organization can be revealed with retinotopic mapping. Unfortunately, constraints posed by standard mapping hinder its use in patients, atypical subject groups, and individuals at either end of the lifespan. This severely limits the conclusions we can draw about visual processing in such individuals. Here, we present a novel data-driven method to estimate connective fields, resulting in fine-grained maps of the functional connectivity between brain areas. We find that inhibitory connectivity fields accompany, and often surround facilitatory fields. The visual field extent of these inhibitory subfields falls off with cortical magnification. We further show that our method is robust to large eye movements and myopic defocus. Importantly, freed from the controlled stimulus conditions in standard mapping experiments, using entertaining stimuli and unconstrained eye movements our approach can generate retinotopic maps, including the periphery visual field hitherto only possible to map with special stimulus displays. Generally, our results show that the connective field method can gain knowledge about retinotopic architecture of visual cortex in patients and participants where this is at best difficult and confounded, if not impossible, with current methods.

A population receptive field model of the magnetoencephalography response

Computational models which predict the neurophysiological response from experimental stimuli have played an important role in human neuroimaging. One type of computational model, the population receptive field (pRF), has been used to describe cortical responses at the millimeter scale using functional magnetic resonance imaging (fMRI) and electrocorticography (ECoG). However, pRF models are not widely used for non-invasive electromagnetic field measurements (EEG/MEG), because individual sensors pool responses originating from several centimeter of cortex, containing neural populations with widely varying spatial tuning. Here, we introduce a forward-modeling approach in which pRFs estimated from fMRI data are used to predict MEG sensor responses. Subjects viewed contrast-reversing bar stimuli sweeping across the visual field in separate fMRI and MEG sessions. Individual subject's pRFs were modeled on the cortical surface at the millimeter scale using the fMRI data. We then predicted cortical time series and projected these predictions to MEG sensors using a biophysical MEG forward model, accounting for the pooling across cortex. We compared the predicted MEG responses to observed visually evoked steady-state responses measured in the MEG session. We found that pRF parameters estimated by fMRI could explain a substantial fraction of the variance in steady-state MEG sensor responses (up to 60% in individual sensors). Control analyses in which we artificially perturbed either pRF size or pRF position reduced MEG prediction accuracy, indicating that MEG data are sensitive to pRF properties derived from fMRI. Our model provides a quantitative approach to link fMRI and MEG measurements, thereby enabling advances in our understanding of spatiotemporal dynamics in human visual field maps.

Predictive masking of an artificial scotoma is associated with a system-wide reconfiguration of neural populations in the human visual cortex

The visual brain has the remarkable capacity to complete our percept of the world even when the information extracted from the visual scene is incomplete. This ability to predict missing information based on information from spatially adjacent regions is an intriguing attribute of healthy vision. Yet, it gains particular significance when it masks the perceptual consequences of a retinal lesion, leaving patients unaware of their partial loss of vision and ultimately delaying diagnosis and treatment. At present, our understanding of the neural basis of this masking process is limited which hinders both quantitative modeling as well as translational application. To overcome this, we asked the participants to view visual stimuli with and without superimposed artificial scotoma (AS). We used fMRI to record the associated cortical activity and applied model-based analyzes to track changes in cortical population receptive fields and connectivity in response to the introduction of the AS. We found that throughout the visual field and cortical hierarchy, pRFs shifted their preferred position towards the AS border. Moreover, extrastriate areas biased their sampling of V1 towards sections outside the AS projection zone, thereby effectively masking the AS with signals from spared portions of the visual field. We speculate that the signals that drive these system-wide population modifications originate in extrastriate visual areas and, through feedback, also reconfigure the neural populations in the earlier visual areas.

Mapping Visual Field Defects With fMRI - Impact of Approach and Experimental Conditions

Current initiatives to restore vision emphasize the need for objective assessments of visual field (VF) defects as pursued with functional magnetic resonance imaging (fMRI) approaches. Here, we compared population receptive field (pRF) mapping-based VF reconstructions to an fMRI method that uses more robust visual stimulation (on-off block design) in combination with individualized anatomy-driven retinotopic atlas-information (atlas-based VF). We investigated participants with sizable peripheral VF-deficits due to advanced glaucoma (n = 4) or retinitis pigmentosa (RP; n = 2) and controls (n = 6) with simulated scotoma. We obtained (1) standard automated perimetry (SAP) data as reference VFs and 3T fMRI data for (2) pRF-mapping [8-direction bar stimulus, fixation color change task] and (3) block-design full-field stimulation [8-direction drifting contrast patterns during (a) passive viewing (PV) and (b) one-back-task (OBT; reporting successions of identical motion directions) to probe the impact of previously reported task-related unspecific visual cortex activations]. Correspondence measures between the SAP and fMRI-based VFs were accuracy, assisted by sensitivity and specificity. We found an accuracy of pRF-based VF from V1 in patients [median: 0.62] that was similar to previous reports and increased by adding V2 and V3 to the analysis [0.74]. In comparison to the pRF-based VF, equivalent accuracies were obtained for the atlas-based VF for both PV [0.67] and, unexpectedly, the OBT [0.59], where, however, unspecific cortical activations were reflected by a reduction in sensitivity [0.71 (PV) and 0.35 (OBT)]. In conclusion, in patients with peripheral VF-defects, we demonstrate that previous fMRI procedures to obtain VF-estimates might be enhanced by: (1) pooling V1-V3 to enhance accuracy; (2) reporting sensitivity and specificity measures to increase transparency of the VF-reconstruction metric; (3) applying atlas-based procedures, if pRF-based VFs are not available or difficult to obtain; and (4) giving, counter-intuitively, preference to PV. These findings are expected to provide guidance to overcome current limitations of translating fMRI-based methods to a clinical work-up.

Visual Field Reconstruction Using fMRI-Based Techniques

Purpose

To evaluate the accuracy and reliability of functional magnetic resonance imaging (fMRI)-based techniques to assess the integrity of the visual field (VF).

Methods

We combined 3T fMRI and neurocomputational models, that is, conventional population receptive field (pRF) mapping and a new advanced pRF framework "microprobing" (MP), to reconstruct the VF representations of different cortical areas. To demonstrate their scope, both approaches were applied in healthy participants with simulated scotomas and participants with glaucoma. For the latter group we compared the VFs obtained with standard automated perimetry (SAP) and via fMRI.

Results

Using SS, we found that the fMRI-based techniques can detect absolute defects in VFs that are larger than 3°, in single participants, based on 12 minutes of fMRI scan time. Moreover, we found that the MP approach results in a less biased estimation of the preserved VF. In participants with glaucoma, we found that fMRI-based VF reconstruction detected VF defects with a correspondence to SAP that was decent, reflected by the positive correlation between fMRI-based sampling density and SAP-based contrast sensitivity loss (SAP) r2 = 0.44, P = 0.0002. This correlation was higher for MP compared to that for the conventional pRF analysis.

Conclusions

The fMRI-based reconstruction of the VF enables the evaluation of vision loss and provides useful details on the properties of the visual cortex.

Translational Relevance

The fMRI-based VF reconstruction provides an objective alternative to detect VF defects. It may either complement SAP or could provide VF information in patients unable to perform SAP.

Studying Cortical Plasticity in Ophthalmic and Neurological Disorders: From Stimulus-Driven to Cortical Circuitry Modeling Approaches

Unsolved questions in computational visual neuroscience research are whether and how neurons and their connecting cortical networks can adapt when normal vision is compromised by a neurodevelopmental disorder or damage to the visual system. This question on neuroplasticity is particularly relevant in the context of rehabilitation therapies that attempt to overcome limitations or damage, through either perceptual training or retinal and cortical implants. Studies on cortical neuroplasticity have generally made the assumption that neuronal population properties and the resulting visual field maps are stable in healthy observers. Consequently, differences in the estimates of these properties between patients and healthy observers have been taken as a straightforward indication for neuroplasticity. However, recent studies imply that the modeled neuronal properties and the cortical visual maps vary substantially within healthy participants, e.g., in response to specific stimuli or under the influence of cognitive factors such as attention. Although notable advances have been made to improve the reliability of stimulus-driven approaches, the reliance on the visual input remains a challenge for the interpretability of the obtained results. Therefore, we argue that there is an important role in the study of cortical neuroplasticity for approaches that assess intracortical signal processing and circuitry models that can link visual cortex anatomy, function, and dynamics.

Reconstructing imagined letters from early visual cortex reveals tight topographic correspondence between visual mental imagery and perception

Visual mental imagery is the quasi-perceptual experience of “seeing in the mind’s eye”. While a tight correspondence between imagery and perception in terms of subjective experience is well established, their correspondence in terms of neural representations remains insufficiently understood. In the present study, we exploit the high spatial resolution of functional magnetic resonance imaging (fMRI) at 7T, the retinotopic organization of early visual cortex, and machine-learning techniques to investigate whether visual imagery of letter shapes preserves the topographic organization of perceived shapes. Sub-millimeter resolution fMRI images were obtained from early visual cortex in six subjects performing visual imagery of four different letter shapes. Predictions of imagery voxel activation patterns based on a population receptive field-encoding model and physical letter stimuli provided first evidence in favor of detailed topographic organization. Subsequent visual field reconstructions of imagery data based on the inversion of the encoding model further showed that visual imagery preserves the geometric profile of letter shapes. These results open new avenues for decoding, as we show that a denoising autoencoder can be used to pretrain a classifier purely based on perceptual data before fine-tuning it on imagery data. Finally, we show that the autoencoder can project imagery-related voxel activations onto their perceptual counterpart allowing for visually recognizable reconstructions even at the single-trial level. The latter may eventually be utilized for the development of content-based BCI letter-speller systems.

Spatial sampling in human visual cortex is modulated by both spatial and feature-based attention

Spatial attention changes the sampling of visual space. Behavioral studies suggest that feature-based attention modulates this resampling to optimize the attended feature's sampling. We investigate this hypothesis by estimating spatial sampling in visual cortex while independently varying both feature-based and spatial attention. Our results show that spatial and feature-based attention interacted: resampling of visual space depended on both the attended location and feature (color vs. temporal frequency). This interaction occurred similarly throughout visual cortex, regardless of an area's overall feature preference. However, the interaction did depend on spatial sampling properties of voxels that prefer the attended feature. These findings are parsimoniously explained by variations in the precision of an attentional gain field. Our results demonstrate that the deployment of spatial attention is tailored to the spatial sampling properties of units that are sensitive to the attended feature.

Flexible 23-channel coil array for high-resolution magnetic resonance imaging at 3 Tesla

PURPOSE

The purpose of this work is the design, implementation and evaluation of a mechanically flexible receive-only coil array for magnetic resonance imaging (MRI) at 3 T that can be applied to various target organs and provides high parallel imaging performance.

METHODS

A 23-channel array was designed based on a rigid-flex printed circuit board (PCB). The flexible multi-layer part contains the copper traces forming the coil elements. The rigid part of the PCB houses the solder joints and lumped elements. The coil housing consists of rigid caps mounted above the rigid parts. Adhesive PTFE sheets cover all flexible parts. The developed array was tested on the bench as well as in phantom and in vivo MRI experiments employing parallel imaging acceleration factors up to six.

RESULTS

Efficient mutual decoupling between receive elements and detuning between receive array and body coil was achieved. An increased signal-to-noise ratio in comparison to commercial reference coils is demonstrated, especially in regions close to the developed array and for high parallel imaging acceleration factors. Exemplary in vivo images of head, ankle, knee, shoulder and hand are presented.

CONCLUSION

Based on high sensitivity close to the array and low g-factors, this flexible coil is well suited for studies of occipital and temporal cortex, as well as musculoskeletal targets like knee, ankle, elbow and wrist.

How Visual Cortical Organization Is Altered by Ophthalmologic and Neurologic Disorders

Receptive fields are a core property of cortical organization. Modern neuroimaging allows routine access to visual population receptive fields (pRFs), enabling investigations of clinical disorders. Yet how the underlying neural circuitry operates is controversial. The controversy surrounds observations that measurements of pRFs can change in healthy adults as well as in patients with a range of ophthalmological and neurological disorders. The debate relates to the balance between plasticity and stability of the underlying neural circuitry. We propose that to move the debate forward, the field needs to define the implied mechanism. First, we review the pRF changes in both healthy subjects and those with clinical disorders. Then, we propose a computational model that describes how pRFs can change in healthy humans. We assert that we can correctly interpret the pRF changes in clinical disorders only if we establish the capabilities and limitations of pRF dynamics in healthy humans with mechanistic models that provide quantitative predictions.

Correspondence between retinotopic cortical mapping and conventional functional and morphological assessment of retinal disease

PURPOSE

The present study describes retinotopic mapping of the primary visual cortex using functional MRI (fMRI) in patients with retinal disease. It addresses the relationship between fMRI data and data obtained by conventional assessment including microperimetry (MP) and structural imaging.

METHODS

Initial testing involved eight patients with central retinal disease (Stargardt disease, STGD) and eight with peripheral retinal disease (retinitis pigmentosa, RP), who were examined using fMRI and MP (Nidek MP-1). All had a secure clinical diagnosis supported by electrophysiological data. fMRI used population-receptive field (pRF) mapping to provide retinotopic data that were then compared with the results of MP, optical coherence tomography and fundus autofluorescence imaging.

RESULTS

Full analysis, following assessment of fMRI data reliability criteria, was performed in five patients with STGD and seven patients with RP; unstable fixation was responsible for unreliable pRF measurements in three patients excluded from final analysis. The macular regions in patients with STGD with central visual field defects and outer retinal atrophy (ORA) at the macula correlated well with pRF coverage maps showing reduced density of activated voxels at the occipital pole. Patients with RP exhibited peripheral ORA and concentric visual field defects both on MP and pRF mapping. Anterior V1 voxels, corresponding to peripheral regions, showed no significant activation. Correspondence between MP and pRF mapping was quantified by calculating the simple matching coefficient.

CONCLUSION

Retinotopic maps acquired by fMRI provide a valuable adjunct in the assessment of retinal dysfunction. The addition of microperimetric data to pRF maps allowed better assessment of macular function than MP alone. Unlike MP, pRF mapping provides objective data independent of psychophysical perception from the patient.

Development differentially sculpts receptive fields across early and high-level human visual cortex

Receptive fields (RFs) processing information in restricted parts of the visual field are a key property of visual system neurons. However, how RFs develop in humans is unknown. Using fMRI and population receptive field (pRF) modeling in children and adults, we determine where and how pRFs develop across the ventral visual stream. Here we report that pRF properties in visual field maps, from the first visual area, V1, through the first ventro-occipital area, VO1, are adult-like by age 5. However, pRF properties in face-selective and character-selective regions develop into adulthood, increasing the foveal coverage bias for faces in the right hemisphere and words in the left hemisphere. Eye-tracking indicates that pRF changes are related to changing fixation patterns on words and faces across development. These findings suggest a link between face and word viewing behavior and the differential development of pRFs across visual cortex, potentially due to competition on foveal coverage.

Population receptive fields (pRFs) in the visual system are key information-processors, but how they develop is unknown. Here, authors use fMRI and pRF modeling in children and adults to show that in the ventral stream only pRFs in face- and word-selective regions continue to develop, mirroring changes in viewing behavior.

Artificial scotoma estimation based on population receptive field mapping

Population receptive field (pRF) mapping based on functional magnetic resonance imaging (fMRI) is an ideal method for obtaining detailed retinotopic information. One particularly promising application of pRF mapping is the estimation and quantification of visual field effects, for example scotomata in patients suffering from macular dysfunction or degeneration (MD) or hemianopic defects in patients with intracranial dysfunction. However, pRF mapping performance is influenced by a number of factors including spatial and temporal resolution, distribution of dural venous sinuses and patient performance. This study addresses the ability of current pRF methodology to assess the size of simulated scotomata in healthy individuals. The data demonstrate that central scotomata down to a radius of 2.35° (4.7° diameter) visual angle can be reliably estimated in single subjects using high spatial resolution protocols and multi-channel receive array coils.

Image identification from brain activity using the population receptive field model

A goal of computational models is not only to explain experimental data but also to make new predictions. A current focus of computational neuroimaging is to predict features of the presented stimulus from measured brain signals. These computational neuroimaging approaches may be agnostic about the underlying neural processes or may be biologically inspired. Here, we use the biologically inspired population receptive field (pRF) approach to identify presented images from fMRI recordings of the visual cortex, using an explicit model of the underlying neural response selectivity. The advantage of the pRF-model is its simplicity: it is defined by a handful of parameters, which can be estimated from fMRI data that was collected within half an hour. Using 7T MRI, we measured responses elicited by different visual stimuli: (i) conventional pRF mapping stimuli, (ii) semi-random synthetic images and (iii) natural images. The pRF mapping stimuli were used to estimate the pRF-properties of each cortical location in early visual cortex. Next, we used these pRFs to identify which synthetic or natural images was presented to the subject from the fMRI responses. We show that image identification using V1 responses is far above chance, both for the synthetic and natural images. Thus, we can identify visual images, including natural images, using the most fundamental low-parameter pRF model estimated from conventional pRF mapping stimuli. This allows broader application of image identification.