Multifocal fMRI mapping of visual cortical areas

Improving the Reliability and Accuracy of Population Receptive Field Measures Using a Logarithmically Warped Stimulus

The population receptive field method, which measures the region in visual space that elicits a BOLD signal in a voxel in retinotopic cortex, is a powerful tool for investigating the functional organization of human visual cortex with fMRI (Dumoulin & Wandell, 2008). However, recent work has shown that population receptive field (pRF) estimates for early retinotopic visual areas can be biased and unreliable, especially for voxels representing the fovea. Here, we show that a 'log-bar' stimulus that is logarithmically warped along the eccentricity dimension produces more reliable estimates of pRF size and location than the traditional moving bar stimulus. The log-bar stimulus was better able to identify pRFs near the foveal representation, and pRFs were smaller in size, consistent with simulation estimates of receptive field sizes in the fovea.

Structural and functional alterations in the brains of patients with anisometropic and strabismic amblyopia: a systematic review of magnetic resonance imaging studies

Amblyopia is the most common cause of vision loss in children and can persist into adulthood in the absence of effective intervention. Previous clinical and neuroimaging studies have suggested that the neural mechanisms underlying strabismic amblyopia and anisometropic amblyopia may be different. Therefore, we performed a systematic review of magnetic resonance imaging studies investigating brain alterations in patients with these two subtypes of amblyopia; this study is registered with PROSPERO (registration ID: CRD42022349191). We searched three online databases (PubMed, EMBASE, and Web of Science) from inception to April 1, 2022; 39 studies with 633 patients (324 patients with anisometropic amblyopia and 309 patients with strabismic amblyopia) and 580 healthy controls met the inclusion criteria (e.g., case-control designed, peer-reviewed articles) and were included in this review. These studies highlighted that both strabismic amblyopia and anisometropic amblyopia patients showed reduced activation and distorted topological cortical activated maps in the striate and extrastriate cortices during task-based functional magnetic resonance imaging with spatial-frequency stimulus and retinotopic representations, respectively; these may have arisen from abnormal visual experiences. Compensations for amblyopia that are reflected in enhanced spontaneous brain function have been reported in the early visual cortices in the resting state, as well as reduced functional connectivity in the dorsal pathway and structural connections in the ventral pathway in both anisometropic amblyopia and strabismic amblyopia patients. The shared dysfunction of anisometropic amblyopia and strabismic amblyopia patients, relative to controls, is also characterized by reduced spontaneous brain activity in the oculomotor cortex, mainly involving the frontal and parietal eye fields and the cerebellum; this may underlie the neural mechanisms of fixation instability and anomalous saccades in amblyopia. With regards to specific alterations of the two forms of amblyopia, anisometropic amblyopia patients suffer more microstructural impairments in the precortical pathway than strabismic amblyopia patients, as reflected by diffusion tensor imaging, and more significant dysfunction and structural loss in the ventral pathway. Strabismic amblyopia patients experience more attenuation of activation in the extrastriate cortex than in the striate cortex when compared to anisometropic amblyopia patients. Finally, brain structural magnetic resonance imaging alterations tend to be lateralized in the adult anisometropic amblyopia patients, and the patterns of brain alterations are more limited in amblyopic adults than in children. In conclusion, magnetic resonance imaging studies provide important insights into the brain alterations underlying the pathophysiology of amblyopia and demonstrate common and specific alterations in anisometropic amblyopia and strabismic amblyopia patients; these alterations may improve our understanding of the neural mechanisms underlying amblyopia.

Neurologically Healthy Humans' Ability to Make Saccades Toward Unseen Targets

Some patients with a visual field loss due to a lesion in the primary visual cortex (V1) can shift their gaze to stimuli presented in their blind visual field. The extent to which a similar "blindsight" capacity is present in neurologically healthy individuals remains unknown. Using retinotopically navigated transcranial magnetic stimulation (TMS) of V1 (Experiment 1) and metacontrast masking (Experiment 2) to suppress conscious vision, we examined neurologically healthy humans' ability to make saccadic eye movements toward visual targets that they reported not seeing. In the TMS experiment, the participants were more likely to initiate a saccade when a stimulus was presented, and they reported not seeing it, than in trials which no stimulus was presented. However, this happened only in a very small proportion (∼8%) of unseen trials, suggesting that saccadic reactions were largely based on conscious perception. In both experiments, saccade landing location was influenced by unconscious information: When the participants denied seeing the target but made a saccade, the saccade was made toward the correct location (TMS: 68%, metacontrast: 63%) more often than predicted by chance. Signal detection theoretic measures suggested that in the TMS experiment, saccades toward unseen targets may have been based on weak conscious experiences. In both experiments, reduced visibility of the target stimulus was associated with slower and less precise gaze shifts. These results suggest that saccades made by neurologically healthy humans may be influenced by unconscious information, although the initiation of saccades is largely based on conscious vision.

Dynamics of retinotopic spatial attention revealed by multifocal MEG

Visual focal attention is both fast and spatially localized, making it challenging to investigate using human neuroimaging paradigms. Here, we used a new multivariate multifocal mapping method with magnetoencephalography (MEG) to study how focal attention in visual space changes stimulus-evoked responses across the visual field. The observer's task was to detect a color change in the target location, or at the central fixation. Simultaneously, 24 regions in visual space were stimulated in parallel using an orthogonal, multifocal mapping stimulus sequence. First, we used univariate analysis to estimate stimulus-evoked responses in each channel. Then we applied multivariate pattern analysis to look for attentional effects on the responses. We found that attention to a target location causes two spatially and temporally separate effects. Initially, attentional modulation is brief, observed at around 60-130 ms post stimulus, and modulates responses not only at the target location but also in adjacent regions. A later modulation was observed from around 200 ms, which was specific to the location of the attentional target. The results support the idea that focal attention employs several processing stages and suggest that early attentional modulation is less spatially specific than late.

Combining stimulus types for improved coverage in population receptive field mapping

Retinotopy experiments using population receptive field (pRF) mapping are ideal for assigning regions in the visual field to cortical brain areas. While various designs for visual stimulation were suggested in the literature, all have specific shortcomings regarding visual field coverage. Here we acquired high-resolution 7 Tesla fMRI data to compare pRF-based coverage maps obtained with the two most commonly used stimulus variants: moving bars; rotating wedges and expanding rings. We find that stimulus selection biases the spatial distribution of pRF centres. In addition, eccentricity values and pRF sizes obtained from wedge/ring or bar stimulation runs show systematic differences. Wedge/ring stimulation results show lower eccentricity values and strongly reduced pRF sizes compared to bar stimulation runs. Statistical comparison shows significantly higher pRF centre numbers in the foveal 2° region of the visual field for wedge/ring compared to bar stimuli. We suggest and evaluate approaches for combining pRF data from different visual stimulus patterns to obtain improved mapping results.

Mapping sequences can bias population receptive field estimates

Population receptive field (pRF) modelling is a common technique for estimating the stimulus-selectivity of populations of neurons using neuroimaging. Here, we aimed to address if pRF properties estimated with this method depend on the spatio-temporal structure and the predictability of the mapping stimulus. We mapped the polar angle preference and tuning width of voxels in visual cortex (V1-V4) of healthy, adult volunteers. We compared sequences sweeping orderly through the visual field or jumping from location to location employing stimuli of different width (45° vs 6°) and cycles of variable duration (8s vs 60s). While we did not observe any systematic influence of stimulus predictability, the temporal structure of the sequences significantly affected tuning width estimates. Ordered designs with large wedges and short cycles produced systematically smaller estimates than random sequences. Interestingly, when we used small wedges and long cycles, we obtained larger tuning width estimates for ordered than random sequences. We suggest that ordered and random mapping protocols show different susceptibility to other design choices such as stimulus type and duration of the mapping cycle and can produce significantly different pRF results.

Recurrent Processing of Contour Integration in the Human Visual Cortex as Revealed By fMRI-Guided TMS

Contour integration is a critical step in visual perception because it groups discretely local elements into perceptually global contours. Previous investigations have suggested that striate and extrastriate visual areas are involved in this mid-level processing of visual perception. However, the temporal dynamics of these areas in the human brain during contour integration is less understood. The present study used functional magnetic resonance imaging-guided transcranial magnetic stimulation (TMS) to briefly disrupt 1 of 2 visual areas (V1/V2 and V3B) and examined the causal contributions of these areas to contour detection. The results demonstrated that the earliest critical time window at which behavioral detection performance was impaired by TMS pluses differed between V1/V2 and V3B. The first critical window of V3B (90-110 ms after stimulus onset) was earlier than that of V1/V2 (120-140 ms after stimulus onset), thus indicating that feedback connection from higher to lower area was necessary for complete contour integration. These results suggested that the fine processing of contour-related information in V1/V2 follows the generation of a coarse template in the higher visual areas, such as V3B. Our findings provide direct causal evidence that a recurrent mechanism is necessary for the integration of contours from cluttered background in the human brain.

How Visual Cortical Organization Is Altered by Ophthalmologic and Neurologic Disorders

Receptive fields are a core property of cortical organization. Modern neuroimaging allows routine access to visual population receptive fields (pRFs), enabling investigations of clinical disorders. Yet how the underlying neural circuitry operates is controversial. The controversy surrounds observations that measurements of pRFs can change in healthy adults as well as in patients with a range of ophthalmological and neurological disorders. The debate relates to the balance between plasticity and stability of the underlying neural circuitry. We propose that to move the debate forward, the field needs to define the implied mechanism. First, we review the pRF changes in both healthy subjects and those with clinical disorders. Then, we propose a computational model that describes how pRFs can change in healthy humans. We assert that we can correctly interpret the pRF changes in clinical disorders only if we establish the capabilities and limitations of pRF dynamics in healthy humans with mechanistic models that provide quantitative predictions.

Retinotopic effects of visual attention revealed by dichoptic multifocal pupillography

Multifocal pupillographic objective perimetry (mfPOP) has recently been shown to be able to measure cortical function. Here we assessed 44 regions of the central 60 degrees of the visual fields of each eye concurrently in 7 minutes/test. We examined how foveally- and peripherally-directed attention changed response sensitivity and delay across the 44 visual field locations/eye. Four experiments were completed comparing white, yellow and blue stimulus arrays. Experiments 1 to 4 tested 16, 23, 9 and 6 subjects, 49/54 being unique. Experiment 1, Experiments 2 and 3, and Experiment 4 used three variants of the mfPOP method that provided increasingly improved signal quality. Experiments 1 to 3 examined centrally directed attention, and Experiment 4 compared effects of attention directed to different peripheral targets. Attention reduced the sensitivity of the peripheral locations in Experiment 1, but only for the white stimuli not yellow. Experiment 2 confirmed that result. Experiment 3 showed that blue stimuli behaved like white. Peripheral attention showed increased sensitivity around the attentional targets. The results are discussed in terms of the cortical inputs to the pupillary system. The results agree with those from multifocal and other fMRI and VEP studies. mfPOP may be a useful adjunct to those methods.

Two cortical deficits underlie amblyopia: A multifocal fMRI analysis

Amblyopia is a relatively common (incidence 3%) developmental disorder in which there is loss of vision as a consequence of a disruption to normal visual development. Although the deficit is monocular and known to be of cortical origin, the nature of the processing deficit is controversial. Human behavioral studies have identified two main deficits - a loss of contrast sensitivity and perceived spatial distortions. Here we use a multifocal fMRI approach to ascertain, in a group of anisometropic amblyopes, whether these two deficits have a single common cause or whether they are the result of two underlying independent cortical disorders. We found that fMRI magnitudes were attenuated in amblyopic eye stimulation, and that there was poor fidelity for co-localization of the activity clusters between the amblyopic and fellow-fixing eye stimulation. These effects varied across eccentricities and correlate with the degree of amblyopia but not with one another, suggesting two independent cortical deficits: a reduced responsiveness as well as reduced fidelity of spatial representation. These deficits are independent of eccentricity within the central field and consistent across early cortical visual areas.

Positive and Negative Somatotopic BOLD Responses in Contralateral Versus Ipsilateral Penfield Homunculus

One of the basic properties of sensory cortices is their topographical organization. Most imaging studies explored this organization using the positive blood oxygenation level-dependent (BOLD) signal. Here, we studied the topographical organization of both positive and negative BOLD in contralateral and ipsilateral primary somatosensory cortex (S1). Using phase-locking mapping methods, we verified the topographical organization of contralateral S1, and further showed that different body segments elicit pronounced negative BOLD responses in both hemispheres. In the contralateral hemisphere, we found a sharpening mechanism in which stimulation of a given body segment triggered a gradient of activation with a significant deactivation in more remote areas. In the ipsilateral cortex, deactivation was not only located in the homolog area of the stimulated parts but rather was widespread across many parts of S1. Additionally, analysis of resting-state functional magnetic resonance imaging signal showed a gradient of connectivity to the neighboring contralateral body parts as well as to the ipsilateral homologous area for each body part. Taken together, our results indicate a complex pattern of baseline and activity-dependent responses in the contralateral and ipsilateral sides. Both primary sensory areas were characterized by unique negative BOLD responses, suggesting that they are an important component in topographic organization of sensory cortices.

Eyetracker-based gaze correction for robust mapping of population receptive fields

Functional MRI enables the acquisition of a retinotopic map that relates regions of the visual field to neural populations in the visual cortex. During such a "population receptive field" (PRF) experiment, stable gaze fixation is of utmost importance in order to correctly link the presented stimulus patterns to stimulated retinal regions and the resulting Blood Oxygen Level Dependent (BOLD) response of the appropriate region within the visual cortex. A method is described that compensates for unstable gaze fixation by recording gaze position via an eyetracker and subsequently modifies the input stimulus underlying the PRF analysis according to the eyetracking measures. Here we show that PRF maps greatly improve when the method is applied to data acquired with either saccadic or smooth eye movements. We conclude that the technique presented herein is useful for studies involving subjects with unstable gaze fixation, particularly elderly patient populations.

Temporal structure of human magnetic evoked fields

Nonlinear analysis of the multifocal cortical visual evoked potential has allowed the identification of neural generation of higher-order nonlinear components by magnocellular and parvocellular neural streams. However, the location of individual brain sources that make such contributions to these evoked responses has not been studied. Thus, an m-sequence pseudorandom stimulus system was developed for use in magnetoencephalographic (MEG) studies. Five normal young adults were recorded using an Elekta TRIUX MEG with 306 sensors. Visual stimuli comprised a nine-patch dartboard stimulus, and each patch fluctuated between two luminance levels with separate recordings carried out at low (24 %) and high (96 %) temporal contrast. Sensor-space analysis of MEG evoked fields identified components of the first- and second-order Wiener kernel decomposition that showed qualitative similarity with EEG-based cortical VEP recordings. The first slice of the second-order response (K2.1) was already saturated at 24 % contrast, while the major waveform of the second slice of the second-order response (K2.2) grew strongly with contrast, consistent with properties of the magnocellular and parvocellular neurons. Minimum norm estimates of cortical source localization showed almost simultaneous activation of V1 and MT+ activations with latencies only a little greater that those reported for first neural spikes in primate single cell studies. Time-frequency analysis of the kernel responses from five minimum norm estimate scout sources shows contributions from higher-frequency bands for the first compared with the second slice response, consistent with the proposed neural sources. In support of this magno/parvo break-up, the onset latencies of the K2.2 responses were delayed by approximately 30 ms compared with K2.1 responses.

From evoked potentials to cortical currents: Resolving V1 and V2 components using retinotopy constrained source estimation without fMRI

Despite evoked potentials' (EP) ubiquity in research and clinical medicine, insights are limited to gross brain dynamics as it remains challenging to map surface potentials to their sources in specific cortical regions. Multiple sources cancellation due to cortical folding and cross-talk obscures close sources, e.g. between visual areas V1 and V2. Recently retinotopic functional magnetic resonance imaging (fMRI) responses were used to constrain source locations to assist separating close sources and to determine cortical current generators. However, an fMRI is largely infeasible for routine EP investigation. We developed a novel method that replaces the fMRI derived retinotopic layout (RL) by an approach where the retinotopy and current estimates are generated from EEG or MEG signals and a standard clinical T1-weighted anatomical MRI. Using the EEG-RL, sources were localized to within 2 mm of the fMRI-RL constrained localized sources. The EEG-RL also produced V1 and V2 current waveforms that closely matched the fMRI-RL's (n = 2) r(1,198)  = 0.99, P < 0.0001. Applying the method to subjects without fMRI (n = 4) demonstrates it generates waveforms that agree closely with the literature. Our advance allows investigators with their current EEG or MEG systems to create a library of brain models tuned to individual subjects' cortical folding in retinotopic maps, and should be applicable to auditory and somatosensory maps. The novel method developed expands EP's ability to study specific brain areas, revitalizing this well-worn technique. Hum Brain Mapp 37:1696-1709, 2016. © 2016 Wiley Periodicals, Inc.

Spatial summation revealed in the earliest visual evoked component C1 and the effect of attention on its linearity

In natural scenes, multiple objects are usually presented simultaneously. How do specific areas of the brain respond to multiple objects based on their responses to each individual object? Previous functional magnetic resonance imaging (fMRI) studies have shown that the activity induced by a multiobject stimulus in the primary visual cortex (V1) can be predicted by the linear or nonlinear sum of the activities induced by its component objects. However, there has been little evidence from electroencephelogram (EEG) studies so far. Here we explored how V1 responded to multiple objects by comparing the EEG signals evoked by a three-grating stimulus with those evoked by its two components (the central grating and 2 flanking gratings). We focused on the earliest visual component C1 (onset latency of ∼50 ms) because it has been shown to reflect the feedforward responses of neurons in V1. We found that when the stimulus was unattended, the amplitude of the C1 evoked by the three-grating stimulus roughly equaled the sum of the amplitudes of the C1s evoked by its two components, regardless of the distances between these gratings. When the stimulus was attended, this linear spatial summation existed only when the three gratings were far apart from each other. When the three gratings were close to each other, the spatial summation became compressed. These results suggest that the earliest visual responses in V1 follow a linear summation rule when attention is not involved and that attention can affect the earliest interactions between multiple objects.

Quantitative evaluation of fMRI retinotopic maps, from V1 to V4, for cognitive experiments

FMRI retinotopic mapping is a non-invasive technique for the delineation of low-level visual areas in individual subjects. It generally relies upon the analysis of functional responses to periodic visual stimuli that encode eccentricity or polar angle in the visual field. This technique is used in vision research when the precise assignation of brain activation to retinotopic areas is an issue. It involves processing steps computed with different algorithms and embedded in various software suites. Manual intervention may be needed for some steps. Although the diversity of the available processing suites and manual interventions may potentially introduce some differences in the final delineation of visual areas, no documented comparison between maps obtained with different procedures has been reported in the literature. To explore the effect of the processing steps on the quality of the maps obtained, we used two tools, BALC, which relies on a fully automated procedure, and BrainVoyager, where areas are delineated “by hand” on the brain surface. To focus on the mapping procedures specifically, we used the same SPM pipeline for pretreatment and the same tissue segmentation tool. We document the consistency and differences of the fMRI retinotopic maps obtained from “routine retinotopy” experiments on 10 subjects. The maps obtained by skilled users are never fully identical. However, the agreement between the maps, around 80% for low-level areas, is probably sufficient for most applications. Our results also indicate that assigning cognitive activations, following a specific experiment (here, color perception), to individual retinotopic maps is not free of errors. We provide measurements of this error, that may help for the cautious interpretation of cognitive activation projection onto fMRI retinotopic maps. On average, the magnitude of the error is about 20%, with much larger differences in a few subjects. More variability may even be expected with less trained users or using different acquisition parameters and preprocessing chains.

Modeling fMRI signals can provide insights into neural processing in the cerebral cortex

Every stimulus or task activates multiple areas in the mammalian cortex. These distributed activations can be measured with functional magnetic resonance imaging (fMRI), which has the best spatial resolution among the noninvasive brain imaging methods. Unfortunately, the relationship between the fMRI activations and distributed cortical processing has remained unclear, both because the coupling between neural and fMRI activations has remained poorly understood and because fMRI voxels are too large to directly sense the local neural events. To get an idea of the local processing given the macroscopic data, we need models to simulate the neural activity and to provide output that can be compared with fMRI data. Such models can describe neural mechanisms as mathematical functions between input and output in a specific system, with little correspondence to physiological mechanisms. Alternatively, models can be biomimetic, including biological details with straightforward correspondence to experimental data. After careful balancing between complexity, computational efficiency, and realism, a biomimetic simulation should be able to provide insight into how biological structures or functions contribute to actual data processing as well as to promote theory-driven neuroscience experiments. This review analyzes the requirements for validating system-level computational models with fMRI. In particular, we study mesoscopic biomimetic models, which include a limited set of details from real-life networks and enable system-level simulations of neural mass action. In addition, we discuss how recent developments in neurophysiology and biophysics may significantly advance the modelling of fMRI signals.

Feedback to distal dendrites links fMRI signals to neural receptive fields in a spiking network model of the visual cortex

The blood oxygenation level-dependent (BOLD) response has been strongly associated with neuronal activity in the brain. However, some neuronal tuning properties are consistently different from the BOLD response. We studied the spatial extent of neural and hemodynamic responses in the primary visual cortex, where the BOLD responses spread and interact over much longer distances than the small receptive fields of individual neurons would predict. Our model shows that a feedforward-feedback loop between V1 and a higher visual area can account for the observed spread of the BOLD response. In particular, anisotropic landing of inputs to compartmental neurons were necessary to account for the BOLD signal spread, while retaining realistic spiking responses. Our work shows that simple dendrites can separate tuning at the synapses and at the action potential output, thus bridging the BOLD signal to the neural receptive fields with high fidelity.

Comparing different stimulus configurations for population receptive field mapping in human fMRI

Population receptive field (pRF) mapping is a widely used approach to measuring aggregate human visual receptive field properties by recording non-invasive signals using functional MRI. Despite growing interest, no study to date has systematically investigated the effects of different stimulus configurations on pRF estimates from human visual cortex. Here we compared the effects of three different stimulus configurations on a model-based approach to pRF estimation: size-invariant bars and eccentricity-scaled bars defined in Cartesian coordinates and traveling along the cardinal axes, and a novel simultaneous “wedge and ring” stimulus defined in polar coordinates, systematically covering polar and eccentricity axes. We found that the presence or absence of eccentricity scaling had a significant effect on goodness of fit and pRF size estimates. Further, variability in pRF size estimates was directly influenced by stimulus configuration, particularly for higher visual areas including V5/MT+. Finally, we compared eccentricity estimation between phase-encoded and model-based pRF approaches. We observed a tendency for more peripheral eccentricity estimates using phase-encoded methods, independent of stimulus size. We conclude that both eccentricity scaling and polar rather than Cartesian stimulus configuration are important considerations for optimal experimental design in pRF mapping. While all stimulus configurations produce adequate estimates, simultaneous wedge and ring stimulation produced higher fit reliability, with a significant advantage in reduced acquisition time.

Comparison of randomized multifocal mapping and temporal phase mapping of visual cortex for clinical use

fMRI is becoming an important clinical tool for planning and guidance of surgery to treat brain tumors, arteriovenous malformations, and epileptic foci. For visual cortex mapping, the most popular paradigm by far is temporal phase mapping, although random multifocal stimulation paradigms have drawn increased attention due to their ability to identify complex response fields and their random properties. In this study we directly compared temporal phase and multifocal vision mapping paradigms with respect to clinically relevant factors including: time efficiency, mapping completeness, and the effects of noise. Randomized, multifocal mapping accurately decomposed the response of single voxels to multiple stimulus locations and made correct retinotopic assignments as noise levels increased despite decreasing sensitivity. Also, multifocal mapping became less efficient as the number of stimulus segments (locations) increased from 13 to 25 to 49 and when duty cycle was increased from 25% to 50%. Phase mapping, on the other hand, activated more extrastriate visual areas, was more time efficient in achieving statistically significant responses, and had better sensitivity as noise increased, though with an increase in systematic retinotopic mis-assignments. Overall, temporal phase mapping is likely to be a better choice for routine clinical applications though random multifocal mapping may offer some unique advantages for selected applications.

•

Phase mapping activates more extrastriate visual areas and is more efficient per run.

•

Random mapping can decompose the response of single voxels to multiple locations.

•

Efficiency of random mapping depends on number of stimulus regions and duty cycle.

•

Noise affects random- and phase-mapping differently.

Visual interactions conform to pattern decorrelation in multiple cortical areas

Neural responses to visual stimuli are strongest in the classical receptive field, but they are also modulated by stimuli in a much wider region. In the primary visual cortex, physiological data and models suggest that such contextual modulation is mediated by recurrent interactions between cortical areas. Outside the primary visual cortex, imaging data has shown qualitatively similar interactions. However, whether the mechanisms underlying these effects are similar in different areas has remained unclear. Here, we found that the blood oxygenation level dependent (BOLD) signal spreads over considerable cortical distances in the primary visual cortex, further than the classical receptive field. This indicates that the synaptic activity induced by a given stimulus occurs in a surprisingly extensive network. Correspondingly, we found suppressive and facilitative interactions far from the maximum retinotopic response. Next, we characterized the relationship between contextual modulation and correlation between two spatial activation patterns. Regardless of the functional area or retinotopic eccentricity, higher correlation between the center and surround response patterns was associated with stronger suppressive interaction. In individual voxels, suppressive interaction was predominant when the center and surround stimuli produced BOLD signals with the same sign. Facilitative interaction dominated in the voxels with opposite BOLD signal signs. Our data was in unison with recently published cortical decorrelation model, and was validated against alternative models, separately in different eccentricities and functional areas. Our study provides evidence that spatial interactions among neural populations involve decorrelation of macroscopic neural activation patterns, and suggests that the basic design of the cerebral cortex houses a robust decorrelation mechanism for afferent synaptic input.

Minimizing biases in estimating the reorganization of human visual areas with BOLD retinotopic mapping

There is substantial interest in using functional magnetic resonance imaging (fMRI) retinotopic mapping techniques to examine reorganization of the occipital cortex after vision loss in humans and nonhuman primates. However, previous reports suggest that standard phase encoding and the more recent population Receptive Field (pRF) techniques give biased estimates of retinotopic maps near the boundaries of retinal or cortical scotomas. Here we examine the sources of this bias and show how it can be minimized with a simple modification of the pRF method. In normally sighted subjects, we measured fMRI responses to a stimulus simulating a foveal scotoma; we found that unbiased retinotopic map estimates can be obtained in early visual areas, as long as the pRF fitting algorithm takes the scotoma into account and a randomized "multifocal" stimulus sequence is used.

Compressive spatial summation in human visual cortex

Neurons within a small (a few cubic millimeters) region of visual cortex respond to stimuli within a restricted region of the visual field. Previous studies have characterized the population response of such neurons using a model that sums contrast linearly across the visual field. In this study, we tested linear spatial summation of population responses using blood oxygenation level-dependent (BOLD) functional MRI. We measured BOLD responses to a systematic set of contrast patterns and discovered systematic deviation from linearity: the data are more accurately explained by a model in which a compressive static nonlinearity is applied after linear spatial summation. We found that the nonlinearity is present in early visual areas (e.g., V1, V2) and grows more pronounced in relatively anterior extrastriate areas (e.g., LO-2, VO-2). We then analyzed the effect of compressive spatial summation in terms of changes in the position and size of a viewed object. Compressive spatial summation is consistent with tolerance to changes in position and size, an important characteristic of object representation.

Fovea-periphery axis symmetry of surround modulation in the human visual system

A visual stimulus activates different sized cortical area depending on eccentricity of the stimulus. Here, our aim is to understand whether the visual field size of a stimulus or cortical size of the corresponding representation determines how strongly it interacts with other stimuli. We measured surround modulation of blood-oxygenation-level-dependent signal and perceived contrast with surrounds that extended either towards the periphery or the fovea from a center stimulus, centered at 6° eccentricity. This design compares the effects of two surrounds which are identical in visual field size, but differ in the sizes of their cortical representations. The surrounds produced equally strong suppression, which suggests that visual field size of the surround determines suppression strength. A modeled population of neuronal responses, in which all the parameters were experimentally fixed, captured the pattern of results both in psychophysics and functional magnetic resonance imaging. Although the fovea-periphery anisotropy affects nearly all aspects of spatial vision, our results suggest that in surround modulation the visual system compensates for it.

Refractive surgery in anisometropic adult patients induce plastic changes in primary visual cortex

PURPOSE

To prospectively study the effect of refractive surgery in the primary visual cortex of adult anisometropic and isometropic myopic patients.

METHODS

Two anisometropic and two isometropic myopic patients were examined with multifocal functional magnetic resonance imaging technique (mffMRI) before refractive surgery and at 3, 6, 9 and 12 months postoperatively. Two controls without refractive surgery were also examined with mffMRI in the beginning and in the end of the study. Anisometropic patients had only their more myopic eye operated to correct the anisometropia. The myopic isometropic patients had their both eyes operated.

RESULTS

Operated anisometropic eyes showed 65% reduced amount of active voxels in foveal data at 12 months postoperatively compared with the preoperative situation. In unoperated anisometropic eyes, the corresponding value was 86% and in myopic patients and controls 31% and 1%, respectively. To confirm this finding, the number of activated voxels representing the innermost ring of the stimulus was also calculated, and an exactly similar phenomenon was encountered in the anisometropic patients. Both anisometropic patients improved the best-spectacle-corrected visual acuity in the operated eye after refractive surgery.

CONCLUSION

Our results suggest that plastic changes may take place in the primary visual cortex of anisometropic adult patients after refractive surgery.

Retinotopic maps, spatial tuning, and locations of human visual areas in surface coordinates characterized with multifocal and blocked FMRI designs

The localization of visual areas in the human cortex is typically based on mapping the retinotopic organization with functional magnetic resonance imaging (fMRI). The most common approach is to encode the response phase for a slowly moving visual stimulus and to present the result on an individual's reconstructed cortical surface. The main aims of this study were to develop complementary general linear model (GLM)-based retinotopic mapping methods and to characterize the inter-individual variability of the visual area positions on the cortical surface. We studied 15 subjects with two methods: a 24-region multifocal checkerboard stimulus and a blocked presentation of object stimuli at different visual field locations. The retinotopic maps were based on weighted averaging of the GLM parameter estimates for the stimulus regions. In addition to localizing visual areas, both methods could be used to localize multiple retinotopic regions-of-interest. The two methods yielded consistent retinotopic maps in the visual areas V1, V2, V3, hV4, and V3AB. In the higher-level areas IPS0, VO1, LO1, LO2, TO1, and TO2, retinotopy could only be mapped with the blocked stimulus presentation. The gradual widening of spatial tuning and an increase in the responses to stimuli in the ipsilateral visual field along the hierarchy of visual areas likely reflected the increase in the average receptive field size. Finally, after registration to Freesurfer's surface-based atlas of the human cerebral cortex, we calculated the mean and variability of the visual area positions in the spherical surface-based coordinate system and generated probability maps of the visual areas on the average cortical surface. The inter-individual variability in the area locations decreased when the midpoints were calculated along the spherical cortical surface compared with volumetric coordinates. These results can facilitate both analysis of individual functional anatomy and comparisons of visual cortex topology across studies.

Unconscious and Conscious Processing of Color Rely on Activity in Early Visual Cortex: A TMS Study

Chromatic information is processed by the visual system both at an unconscious level and at a level that results in conscious perception of color. It remains unclear whether both conscious and unconscious processing of chromatic information depend on activity in the early visual cortex or whether unconscious chromatic processing can also rely on other neural mechanisms. In this study, the contribution of early visual cortex activity to conscious and unconscious chromatic processing was studied using single-pulse TMS in three time windows 40–100 msec after stimulus onset in three conditions: conscious color recognition, forced-choice discrimination of consciously invisible color, and unconscious color priming. We found that conscious perception and both measures of unconscious processing of chromatic information depended on activity in early visual cortex 70–100 msec after stimulus presentation. Unconscious forced-choice discrimination was above chance only when participants reported perceiving some stimulus features (but not color).

Is selective primary visual cortex stimulation achievable with TMS?

The primary visual cortex (V1) has been the target of stimulation in a number of transcranial magnetic stimulation (TMS) studies. In this study, we estimated the actual sites of stimulation by modeling the cortical location of the TMS-induced electric field when participants reported visual phosphenes or scotomas. First, individual retinotopic areas were identified by multifocal functional magnetic resonance imaging (mffMRI). Second, during the TMS stimulation, the cortical stimulation sites were derived from electric field modeling. When an external anatomical landmark for V1 was used (2 cm above inion), the cortical stimulation landed in various functional areas in different individuals, the dorsal V2 being the most affected area at the group level. When V1 was specifically targeted based on the individual mffMRI data, V1 could be selectively stimulated in half of the participants. In the rest, the selective stimulation of V1 was obstructed by the intermediate position of the dorsal V2. We conclude that the selective stimulation of V1 is possible only if V1 happens to be favorably located in the individual anatomy. Selective and successful targeting of TMS pulses to V1 requires MRI-navigated stimulation, selection of participants and coil positions based on detailed retinotopic maps of individual functional anatomy, and computational modeling of the TMS-induced electric field distribution in the visual cortex. It remains to be resolved whether even more selective stimulation of V1 could be achieved by adjusting the coil orientation according to sulcal orientation of the target site.

The development and use of phase-encoded functional MRI designs

Phase-encoded designs advanced the early development of functional MRI, enabling the "killer app" of retinotopic mapping, which helped demonstrate fMRI's value to a skeptical scientific public. The design, also called "the traveling wave", remains in wide use today, due to its ability to easily measure neural activity in a parameterized set of experimental conditions. In phase-encoded designs, stimuli defined by a numerical parameter, for example visual eccentricity, are presented continuously in the order specified by the parameter. The stimulus parameter that produces maximum response can be recovered from the timing of neural activity, i.e. its phase. From the outset, phase-encoded designs were used for two related, but complementary purposes: 1) to measure aggregate response properties of neurons in a voxel, for example the average visual field location of receptive fields, and 2) to segregate the set of voxels that corresponds to an organized cortical region, for example a retinotopically mapped visual area. This short review will cover the history and current uses of phase-encoded fMRI, while noting the ongoing tension in the field between the brain mapping and computational neuroimaging approaches.

Imaging retinotopic maps in the human brain

A quarter-century ago visual neuroscientists had little information about the number and organization of retinotopic maps in human visual cortex. The advent of functional magnetic resonance imaging (MRI), a non-invasive, spatially-resolved technique for measuring brain activity, provided a wealth of data about human retinotopic maps. Just as there are differences amongst non-human primate maps, the human maps have their own unique properties. Many human maps can be measured reliably in individual subjects during experimental sessions lasting less than an hour. The efficiency of the measurements and the relatively large amplitude of functional MRI signals in visual cortex make it possible to develop quantitative models of functional responses within specific maps in individual subjects. During this last quarter-century, there has also been significant progress in measuring properties of the human brain at a range of length and time scales, including white matter pathways, macroscopic properties of gray and white matter, and cellular and molecular tissue properties. We hope the next 25years will see a great deal of work that aims to integrate these data by modeling the network of visual signals. We do not know what such theories will look like, but the characterization of human retinotopic maps from the last 25years is likely to be an important part of future ideas about visual computations.

Recurrent processing in V1/V2 contributes to categorization of natural scenes

Humans are able to categorize complex natural scenes very rapidly and effortlessly, which has led to an assumption that such ultra-rapid categorization is driven by feedforward activation of ventral brain areas. However, recent accounts of visual perception stress the role of recurrent interactions that start rapidly after the activation of V1. To study whether or not recurrent processes play a causal role in categorization, we applied fMRI-guided transcranial magnetic stimulation on early visual cortex (V1/V2) and lateral occipital cortex (LO) while the participants categorized natural images as containing animals or not. The results showed that V1/V2 contributed to categorization speed and to subjective perception during a long activity period before and after the contribution of LO had started. This pattern of results suggests that recurrent interactions in visual cortex between areas along the ventral stream and striate cortex play a causal role in categorization and perception of natural scenes.

Stimulus predictability reduces responses in primary visual cortex

In this functional magnetic resonance imaging study we tested whether the predictability of stimuli affects responses in primary visual cortex (V1). The results of this study indicate that visual stimuli evoke smaller responses in V1 when their onset or motion direction can be predicted from the dynamics of surrounding illusory motion. We conclude from this finding that the human brain anticipates forthcoming sensory input that allows predictable visual stimuli to be processed with less neural activation at early stages of cortical processing.

Representation of cross-frequency spatial phase relationships in human visual cortex

An image patch can be locally decomposed into sinusoidal waves of different orientations, spatial frequencies, amplitudes, and phases. The local phase information is essential for perception, because important visual features like edges emerge at locations of maximal local phase coherence. Detection of phase coherence requires integration of spatial frequency information across multiple spatial scales. Models of early visual processing suggest that the visual system should implement phase-sensitive pooling of spatial frequency information in the identification of broadband edges. We used functional magnetic resonance imaging (fMRI) adaptation to look for phase-sensitive neural responses in the human visual cortex. We found sensitivity to the phase difference between spatial frequency components in all studied visual areas, including the primary visual cortex (V1). Control experiments demonstrated that these results were not explained by differences in contrast or position. Next, we compared fMRI responses for broadband compound grating stimuli with congruent and random phase structures. All studied visual areas showed stronger responses for the stimuli with congruent phase structure. In addition, selectivity to phase congruency increased from V1 to higher-level visual areas along both the ventral and dorsal streams. We conclude that human V1 already shows phase-sensitive pooling of spatial frequencies, but only higher-level visual areas might be capable of pooling spatial frequency information across spatial scales typical for broadband natural images.

Area summation in human visual system: psychophysics, fMRI, and modeling

Contextual modulation is a fundamental feature of sensory processing, both on perceptual and on single-neuron level. When the diameter of a visual stimulus is increased, the firing rate of a cell typically first increases (summation field) and then decreases (surround field). Such an area summation function draws a comprehensive profile of the receptive field structure of a neuron, including areas outside the classical receptive field. We investigated area summation in human vision with psychophysics and functional magnetic resonance imaging (fMRI). The stimuli were drifting sine wave gratings similar to those used in previous macaque single-cell area summation studies [corrected]. A model was developed to facilitate comparison of area summation in fMRI to area summation in psychophysics and single cells. The model consisted of units with an antagonistic receptive field structure found in single cells in the primary visual cortex. The receptive field centers of the model neurons were distributed in the region of the visual field covered by a single voxel. The measured area summation functions were qualitatively similar to earlier single-cell data. The model with parameters derived from psychophysics captured the spatial structure of the summation field in the primary visual cortex as measured with fMRI. The model also generalized to a novel situation in which the neural population was displaced from the stimulus center. The current study shows that contextual modulation arises from similar spatially antagonistic and overlapping excitatory and inhibitory mechanisms, both in single cells and in human vision.

Automatic fMRI-guided MEG multidipole localization for visual responses

Previously, we introduced the use of individual cortical location and orientation constraints in the spatiotemporal Bayesian dipole analysis setting proposed by Jun et al. ([2005]; Neuroimage 28:84-98). However, the model's performance was limited by slow convergence and multimodality of the numerically estimated posterior distribution. In this paper, we present an intuitive way to exploit functional magnetic resonance imaging (fMRI) data in the Markov chain Monte Carlo sampling -based inverse estimation of magnetoencephalographic (MEG) data. We used simulated MEG and fMRI data to show that the convergence and localization accuracy of the method is significantly improved with the help of fMRI-guided proposal distributions. We further demonstrate, using an identical visual stimulation paradigm in both fMRI and MEG, the usefulness of this type of automated approach when investigating activation patterns with several spatially close and temporally overlapping sources. Theoretically, the MEG inverse estimates are not biased and should yield the same results even without fMRI information, however, in practice the multimodality of the posterior distribution causes problems due to the limited mixing properties of the sampler. On this account, the algorithm acts perhaps more as a stochastic optimizer than enables a full Bayesian posterior analysis.

Interocular transfer of orientation-specific fMRI adaptation reveals amblyopia-related deficits in humans

We devised an experimental strategy for assessing the cortical cross-talk between ocular subsystems. For this purpose we measured the interocular transfer of adaptation (IOTA) at different levels in the human brain, using orientation-selective fMRI adaptation. We tested 10 normally sighted and 10 stereoblind or stereodeficient amblyopic observers by adapting monocularly to phase-reversing, oblique sinusoidal gratings. Following monocular adaptation, cortical activations evoked by the same (monoptic) or the other eye (interocular) were measured for the same and for the orthogonal orientation in a two by two factorial design. In both experimental groups, we obtained significant orientation-selective monocular adaptation in area V1 and in extrastriate regions on the dorsal and ventral visual pathways. In the normally-sighted subjects we found in addition interocular adaptation in V1 and extrastriate visual areas. This interocular adaptation indicates that fMRI adaptation transfers from the adapted ocular subsystem to the non-adapted ocular subsystem, and thus provides a measure of binocular interaction in normally-sighted subjects. In the amblyopic subjects, no interocular adaptation was seen at any of the investigated cortical levels, regardless of which eye was adapted. We suggest that the abnormal pattern of interocular transfer of fMRI adaptation is related to the disturbed integration of binocular signals in amblyopia.

Visual image reconstruction from human brain activity using a combination of multiscale local image decoders

Perceptual experience consists of an enormous number of possible states. Previous fMRI studies have predicted a perceptual state by classifying brain activity into prespecified categories. Constraint-free visual image reconstruction is more challenging, as it is impractical to specify brain activity for all possible images. In this study, we reconstructed visual images by combining local image bases of multiple scales, whose contrasts were independently decoded from fMRI activity by automatically selecting relevant voxels and exploiting their correlated patterns. Binary-contrast, 10 x 10-patch images (2(100) possible states) were accurately reconstructed without any image prior on a single trial or volume basis by measuring brain activity only for several hundred random images. Reconstruction was also used to identify the presented image among millions of candidates. The results suggest that our approach provides an effective means to read out complex perceptual states from brain activity while discovering information representation in multivoxel patterns.

Quantitative multifocal fMRI shows active suppression in human V1

Multifocal functional magnetic resonance imaging has recently been introduced as an alternative method for retinotopic mapping, and it enables effective functional localization of multiple regions-of-interest in the visual cortex. In this study we characterized interactions in V1 with spatially and temporally identical stimuli presented alone, or as a part of a nine-region multifocal stimulus. We compared stimuli at different contrasts, collinear and orthogonal orientations and spatial frequencies one octave apart. Results show clear attenuation of BOLD signal from the central region in the multifocal condition. The observed modulation in BOLD signal could be produced either by neural suppression resulting from stimulation of adjacent regions of visual field, or alternatively by hemodynamic saturation or stealing effects in V1. However, we find that attenuation of the central response persists through a range of contrasts, and that its strength varies with relative orientation and spatial frequency of the central and surrounding stimulus regions, indicating active suppression mechanisms of neural origin. Our results also demonstrate that the extent of the signal spreading is commensurate with the extent of the horizontal connections in primate V1.

Topography of attention in the primary visual cortex

Previous research suggests that feedback circuits mediate the effect of attention to the primary visual cortex (V1). This inference is mainly based on temporal information of the responses, where late modulation is associated with feedback signals. However, temporal data alone are inconclusive because the anatomical hierarchy between cortical areas differs significantly from the temporal sequence of activation. In the current work, we relied on recent physiological and computational models of V1 network architecture, which have shown that the thalamic feedforward, local horizontal and feedback contribution are reflected in the spatial spread of responses. We used multifocal functional localizer and quantitative analysis in functional magnetic resonance imaging to determine the spatial scales of attention and sensory responses. Representations of 60 visual field regions in V1 were functionally localized and four of these regions were targets in a subsequent attention experiment, where human volunteers fixated centrally and performed a visual discrimination task at the attended location. Attention enhanced the peak amplitudes significantly more in the lower than in the upper visual field. This enhancement by attention spread with a 2.4 times larger radius (approximately 10 mm, assuming an average magnification factor) compared with the unattended response. The corresponding target region of interest was on average 20% stronger than that caused by the afferent sensory stimulation alone. This modulation could not be attributed to eye movements. Given the contemporary view of primate V1 connections, the activation spread along the cortex provides further evidence that the signal enhancement by spatial attention is dependent on feedback circuits.

Visual field maps in human cortex

Much of the visual cortex is organized into visual field maps: nearby neurons have receptive fields at nearby locations in the image. Mammalian species generally have multiple visual field maps with each species having similar, but not identical, maps. The introduction of functional magnetic resonance imaging made it possible to identify visual field maps in human cortex, including several near (1) medial occipital (V1,V2,V3), (2) lateral occipital (LO-1,LO-2, hMT+), (3) ventral occipital (hV4, VO-1, VO-2), (4) dorsal occipital (V3A, V3B), and (5) posterior parietal cortex (IPS-0 to IPS-4). Evidence is accumulating for additional maps, including some in the frontal lobe. Cortical maps are arranged into clusters in which several maps have parallel eccentricity representations, while the angular representations within a cluster alternate in visual field sign. Visual field maps have been linked to functional and perceptual properties of the visual system at various spatial scales, ranging from the level of individual maps to map clusters to dorsal-ventral streams. We survey recent measurements of human visual field maps, describe hypotheses about the function and relationships between maps, and consider methods to improve map measurements and characterize the response properties of neurons comprising these maps.

fMRI of peripheral visual field representation

OBJECTIVE

Despite mapping tools for central visual field, delineation of peripheral visual field representations in the human cortex has remained a challenge. Access to large visual field and differentiation of retinotopic areas with robust mapping procedures and automated analysis are beneficial in basic research and could accelerate development of clinical applications.

METHODS

We constructed a simple optical near view system for wide visual field stimulation, and examined the topology of retinotopic areas. We used multifocal (mf) design, which enables analysis with general linear model and standard fMRI softwares and is easily automated.

RESULTS

Our stimulation method enabled individual mapping of visual field up to 50 degrees of eccentricity and showed that retinotopic visual areas extended through posterior cerebrum. In addition, we located a separate peripheral upper visual field representation in parieto-occipital (PO) sulcus.

CONCLUSIONS

These functional results are in line with earlier histological data, and support recent findings on human V6, a retinotopic area in the medial PO sulcus with an apparent emphasis on peripheral visual field.

SIGNIFICANCE

Our projection system and mf-design together enable efficient and robust retinotopic mapping of wide visual field, which can at low cost be adapted to any clinical environment with visual back-projection system.

Training-induced cortical representation of a hemianopic hemifield

BACKGROUND

Patients with homonymous hemianopia often have some residual sensitivity for visual stimuli in their blind hemifield. Previous imaging studies suggest an important role for extrastriate cortical areas in such residual vision, but results of training to improve vision in patients with hemianopia are conflicting.

OBJECTIVE

To show that intensive training with flicker stimulation in the chronic stage of stroke can reorganise visual cortices of an adult patient.

METHODS

A 61-year-old patient with homonymous hemianopia was trained with flicker stimulation, starting 22 months after stroke. Changes in functioning during training were documented with magnetoencephalography, and the cortical organisation after training was examined with functional magnetic resonance imaging (fMRI).

RESULTS

Both imaging methods showed that, after training, visual information from both hemifields was processed mainly in the intact hemisphere. The fMRI mapping results showed the representations of both the blind and the normal hemifield in the same set of cortical areas in the intact hemisphere, more specifically in the visual motion-sensitive area V5, in a region around the superior temporal sulcus and in retinotopic visual areas V1 (primary visual cortex), V2, V3 and V3a.

CONCLUSIONS

Intensive training of a blind hemifield can induce cortical reorganisation in an adult patient, and this case shows an ipsilateral representation of the trained visual hemifield in several cortical areas, including the primary visual cortex.