What multiplexing means for the interpretation of functional MRI data

Despite technology advances that have enabled routine acquisition of functional MRI data with sub-millimeter resolution, the inferences that cognitive neuroscientists must make to link fMRI data to behavior are complicated. Thus, a single dataset subjected to different analyses can be interpreted in different ways. This article presents two optical analogies that can be useful for framing fMRI analyses in a way that allows for multiple interpretations of fMRI data to be valid simultaneously without undermining each other. The first is reflection: when an object is reflected in a mirrored surface, it appears as if the reflected object is sharing space with the mirrored object, but of course it is not. This analogy can be a good guide for interpreting the fMRI signal, since even at sub-millimeter resolutions the signal is determined by a mixture of local and long-range neural computations. The second is refraction. If we view an object through a multi-faceted prism or gemstone, our view will change-sometimes dramatically-depending on our viewing angle. In the same way, interpretation of fMRI data (inference of underlying neuronal activity) can and should be different depending on the analysis approach. Rather than representing a weakness of the methodology, or the superiority of one approach over the other (for example, simple regression analysis versus multi-voxel pattern analysis), this is an expected consequence of how information is multiplexed in the neural networks of the brain: multiple streams of information are simultaneously present in each location. The fact that any one analysis typically shows only one view of the data also puts some parentheses around fMRI practitioners' constant search for ground truth against which to compare their data. By holding our interpretations lightly and understanding that many interpretations of the data can all be true at the same time, we do a better job of preparing ourselves to appreciate, and eventually understand, the complexity of the brain and the behavior it produces.

The Psychosis Human Connectome Project: Design and rationale for studies of visual neurophysiology

Visual perception is abnormal in psychotic disorders such as schizophrenia. In addition to hallucinations, laboratory tests show differences in fundamental visual processes including contrast sensitivity, center-surround interactions, and perceptual organization. A number of hypotheses have been proposed to explain visual dysfunction in psychotic disorders, including an imbalance between excitation and inhibition. However, the precise neural basis of abnormal visual perception in people with psychotic psychopathology (PwPP) remains unknown. Here, we describe the behavioral and 7 tesla MRI methods we used to interrogate visual neurophysiology in PwPP as part of the Psychosis Human Connectome Project (HCP). In addition to PwPP (n = 66) and healthy controls (n = 43), we also recruited first-degree biological relatives (n = 44) in order to examine the role of genetic liability for psychosis in visual perception. Our visual tasks were designed to assess fundamental visual processes in PwPP, whereas MR spectroscopy enabled us to examine neurochemistry, including excitatory and inhibitory markers. We show that it is feasible to collect high-quality data across multiple psychophysical, functional MRI, and MR spectroscopy experiments with a sizable number of participants at a single research site. These data, in addition to those from our previously described 3 tesla experiments, will be made publicly available in order to facilitate further investigations by other research groups. By combining visual neuroscience techniques and HCP brain imaging methods, our experiments offer new opportunities to investigate the neural basis of abnormal visual perception in PwPP.

Weakened untuned gain control is associated with schizophrenia while atypical orientation-tuned suppression depends on visual acuity

Perceptual distortions are core features of psychosis. Weakened contrast surround suppression has been proposed as a neural mechanism underlying atypical perceptual experiences. Although previous work has measured suppression by asking participants to report the perceived contrast of a low-contrast target surrounded by a high-contrast surround, it is possible to modulate perceived contrast solely by manipulating the orientation of a matched-contrast center and surround. Removing the bottom-up segmentation cue of contrast difference and isolating orientation-dependent suppression may clarify the neural processes responsible for atypical surround suppression in psychosis. We examined surround suppression across a spectrum of psychotic psychopathology including people with schizophrenia (PSZ; N = 31) and people with bipolar disorder (PBD; N = 29), first-degree biological relatives of these patient groups (PBDrel, PSZrel; N = 28, N = 21, respectively), and healthy controls (N = 29). PSZ exhibited reduced surround suppression across orientations; although group differences were minimal at the condition that produced the strongest suppression. PBD and PSZrel exhibited intermediate suppression, whereas PBDrel performed most similarly to controls. Intriguingly, group differences in orientation-dependent surround suppression magnitude were moderated by visual acuity. A simulation in which visual acuity and/or focal attention interact with untuned gain control reproduces the observed pattern of results, including the lack of group differences when orientation of center and surround are the same. Our findings further elucidate perceptual mechanisms of impaired center-surround processing in psychosis and provide insights into the effects of visual acuity on orientation-dependent suppression in PSZ.

20-fold Accelerated 7T fMRI Using Referenceless Self-Supervised Deep Learning Reconstruction

High spatial and temporal resolution across the whole brain is essential to accurately resolve neural activities in fMRI. Therefore, accelerated imaging techniques target improved coverage with high spatio-temporal resolution. Simultaneous multi-slice (SMS) imaging combined with in-plane acceleration are used in large studies that involve ultrahigh field fMRI, such as the Human Connectome Project. However, for even higher acceleration rates, these methods cannot be reliably utilized due to aliasing and noise artifacts. Deep learning (DL) reconstruction techniques have recently gained substantial interest for improving highly-accelerated MRI. Supervised learning of DL reconstructions generally requires fully-sampled training datasets, which is not available for high-resolution fMRI studies. To tackle this challenge, self-supervised learning has been proposed for training of DL reconstruction with only undersampled datasets, showing similar performance to supervised learning. In this study, we utilize a self-supervised physics-guided DL reconstruction on a 5-fold SMS and 4-fold in-plane accelerated 7T fMRI data. Our results show that our self-supervised DL reconstruction produce high-quality images at this 20-fold acceleration, substantially improving on existing methods, while showing similar functional precision and temporal effects in the subsequent analysis compared to a standard 10-fold accelerated acquisition.

The psychosis human connectome project: An overview

Investigations within the Human Connectome Project have expanded to include studies focusing on brain disorders. This paper describes one of the investigations focused on psychotic psychopathology: The psychosis Human Connectome Project (P-HCP). The data collected as part of this project were multimodal and derived from clinical assessments of psychopathology, cognitive assessments, instrument-based motor assessments, blood specimens, and magnetic resonance imaging (MRI) data. The dataset will be made publicly available through the NIMH Data Archive. In this report we provide specific information on how the sample of participants was obtained and characterized and describe the experimental tasks and procedures used to probe neural functions involved in psychotic disorders that may also mark genetic liability for psychotic psychopathology. Our goal in this paper is to outline the data acquisition process so that researchers intending to use these publicly available data can plan their analyses. MRI data described in this paper are limited to data acquired at 3 Tesla. A companion paper describes the study's 7 Tesla image acquisition protocol in detail, which is focused on visual perceptual functions in psychotic psychopathology.

Self-reported perceptual aberrations in psychosis map to event-related potentials and semantic appraisals of objects

Psychotic disorders have been associated with visual deficits and deviant semantic processing, making it unclear whether object detection abnormalities in psychosis originate from low-level or higher-order visual processes. The current study investigated how high-level visual processing is affected in psychosis by presenting object stimuli with equivalent low-level visual features. Outpatients with affective and nonaffective psychotic disorders, first-degree biological relatives, and psychiatrically unaffected individuals (N = 130) completed the Fragmented Ambiguous Object Task (FAOT) to assess recognition of objects in ambiguous stimuli. During the task, we recorded electroencephalography, quantified event-related potential (ERP) components (P1, N1, negative closure [N_CL], N400), and derived four spatiotemporal event-related potential factors using principal components analysis (PCA). In addition to traditional diagnoses, psychosis was characterized using a dimensional measure of individual differences in self-reported sensory experiences (perceptual absorption) calculated from scales that tap the psychotic domain of the hierarchical structure of psychopathology. Rates of detecting objects within fragmented stimuli failed to differ across diagnostic groups or significantly predict perceptual absorption (p = .057). PCA factors that reflected smaller N1 and larger NCL amplitudes were associated with detecting objects. Exploratory analyses revealed that higher perceptual absorption was associated with reductions in the N400 and a late positive PCA factor. Although early and midlatency brain responses modulate during object detection, late brain responses tied to semantic appraisal of objects are related to perceptual aberrations often reported by individuals with severe psychopathology. Dimensional measures of personality appear sensitive to variation in biological systems relevant to psychotic symptomatology and object perception. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Assessing methods for geometric distortion compensation in 7 T gradient echo functional MRI data

Echo planar imaging (EPI) is widely used in functional and diffusion‐weighted MRI, but suffers from significant geometric distortions in the phase encoding direction caused by inhomogeneities in the static magnetic field (B₀). This is a particular challenge for EPI at very high field (≥7 T), as distortion increases with higher field strength. A number of techniques for distortion correction exist, including those based on B₀ field mapping and acquiring EPI scans with opposite phase encoding directions. However, few quantitative comparisons of distortion compensation methods have been performed using human EPI data, especially at very high field. Here, we compared distortion compensation using B₀ field maps and opposite phase encoding scans in two different software packages (FSL and AFNI) applied to 7 T gradient echo (GE) EPI data from 31 human participants. We assessed distortion compensation quality by quantifying alignment to anatomical reference scans using Dice coefficients and mutual information. Performance between FSL and AFNI was equivalent. In our whole‐brain analyses, we found superior distortion compensation using GE scans with opposite phase encoding directions, versus B₀ field maps or spin echo (SE) opposite phase encoding scans. However, SE performed better when analyses were limited to ventromedial prefrontal cortex, a region with substantial dropout. Matching the type of opposite phase encoding scans to the EPI data being corrected (e.g., SE‐to‐SE) also yielded better distortion correction. While the ideal distortion compensation approach likely varies depending on methodological differences across experiments, this study provides a framework for quantitative comparison of different distortion compensation methods.

Reduced influence of perceptual context in schizophrenia: behavioral and neurophysiological evidence

BACKGROUND

Accurate perception of visual contours is essential for seeing and differentiating objects in the environment. Both the ability to detect visual contours and the influence of perceptual context created by surrounding stimuli are diminished in people with schizophrenia (SCZ). The central aim of the present study was to better understand the biological underpinnings of impaired contour integration and weakened effects of perceptual context. Additionally, we sought to determine whether visual perceptual abnormalities reflect genetic factors in SCZ and are present in other severe mental disorders.

METHODS

We examined behavioral data and event-related potentials (ERPs) collected during the perception of simple linear contours embedded in similar background stimuli in 27 patients with SCZ, 23 patients with bipolar disorder (BP), 23 first-degree relatives of SCZ, and 37 controls.

RESULTS

SCZ exhibited impaired visual contour detection while BP exhibited intermediate performance. The orientation of neighboring stimuli (i.e. flankers) relative to the contour modulated perception across all groups, but SCZ exhibited weakened suppression by the perceptual context created by flankers. Late visual (occipital P2) and cognitive (centroparietal P3) neural responses showed group differences and flanker orientation effects, unlike earlier ERPs (occipital P1 and N1). Moreover, behavioral effects of flanker context on contour perception were correlated with modulation in P2 & P3 amplitudes.

CONCLUSION

In addition to replicating and extending findings of abnormal contour integration and visual context modulation in SCZ, we provide novel evidence that the abnormal use of perceptual context is associated with higher-order sensory and cognitive processes.

Forging a path to mesoscopic imaging success with ultra-high field functional magnetic resonance imaging

Functional magnetic resonance imaging (fMRI) studies with ultra-high field (UHF, 7+ Tesla) technology enable the acquisition of high-resolution images. In this work, we discuss recent achievements in UHF fMRI at the mesoscopic scale, on the order of cortical columns and layers, and examine approaches to addressing common challenges. As researchers push to smaller and smaller voxel sizes, acquisition and analysis decisions have greater potential to degrade spatial accuracy, and UHF fMRI data must be carefully interpreted. We consider the impact of acquisition decisions on the spatial specificity of the MR signal with a representative dataset with 0.8 mm isotropic resolution. We illustrate the trade-offs in contrast with noise ratio and spatial specificity of different acquisition techniques and show that acquisition blurring can increase the effective voxel size by as much as 50% in some dimensions. We further describe how different sources of degradations to spatial resolution in functional data may be characterized. Finally, we emphasize that progress in UHF fMRI depends not only on scientific discovery and technical advancement, but also on informal discussions and documentation of challenges researchers face and overcome in pursuit of their goals. This article is part of the theme issue 'Key relationships between non-invasive functional neuroimaging and the underlying neuronal activity'.

Depth-dependent functional MRI responses to chromatic and achromatic stimuli throughout V1 and V2

In the primate visual system, form (shape, location) and color information are processed in separate but interacting pathways. Recent access to high-resolution neuroimaging has facilitated the exploration of the structure of these pathways at the mesoscopic level in the human visual cortex. We used 7T fMRI to observe selective activation of the primary visual cortex to chromatic versus achromatic stimuli in five participants across two scanning sessions. Achromatic checkerboards with low spatial frequency and high temporal frequency targeted the color-insensitive magnocellular pathway. Chromatic checkerboards with higher spatial frequency and low temporal frequency targeted the color-selective parvocellular pathway. This work resulted in three main findings. First, responses driven by chromatic stimuli had a laminar profile biased towards superficial layers of V1, as compared to responses driven by achromatic stimuli. Second, we found stronger preference for chromatic stimuli in parafoveal V1 compared with peripheral V1. Finally, we found alternating, stimulus-selective bands stemming from the V1 border into V2 and V3. Similar alternating patterns have been previously found in both NHP and human extrastriate cortex. Together, our findings confirm the utility of fMRI for revealing details of mesoscopic neural architecture in human cortex.

Intelligence, educational attainment, and brain structure in those at familial high-risk for schizophrenia or bipolar disorder

First-degree relatives of patients diagnosed with schizophrenia (SZ-FDRs) show similar patterns of brain abnormalities and cognitive alterations to patients, albeit with smaller effect sizes. First-degree relatives of patients diagnosed with bipolar disorder (BD-FDRs) show divergent patterns; on average, intracranial volume is larger compared to controls, and findings on cognitive alterations in BD-FDRs are inconsistent. Here, we performed a meta-analysis of global and regional brain measures (cortical and subcortical), current IQ, and educational attainment in 5,795 individuals (1,103 SZ-FDRs, 867 BD-FDRs, 2,190 controls, 942 schizophrenia patients, 693 bipolar patients) from 36 schizophrenia and/or bipolar disorder family cohorts, with standardized methods. Compared to controls, SZ-FDRs showed a pattern of widespread thinner cortex, while BD-FDRs had widespread larger cortical surface area. IQ was lower in SZ-FDRs (d = -0.42, p = 3 × 10^-5 ), with weak evidence of IQ reductions among BD-FDRs (d = -0.23, p = .045). Both relative groups had similar educational attainment compared to controls. When adjusting for IQ or educational attainment, the group-effects on brain measures changed, albeit modestly. Changes were in the expected direction, with less pronounced brain abnormalities in SZ-FDRs and more pronounced effects in BD-FDRs. To conclude, SZ-FDRs and BD-FDRs show a differential pattern of structural brain abnormalities. In contrast, both had lower IQ scores and similar school achievements compared to controls. Given that brain differences between SZ-FDRs and BD-FDRs remain after adjusting for IQ or educational attainment, we suggest that differential brain developmental processes underlying predisposition for schizophrenia or bipolar disorder are likely independent of general cognitive impairment.

Perceptual Mechanisms of Visual Hallucinations and Illusions in Psychosis

Psychosis has been associated with neural anomalies across a number of brain regions and cortical networks. Nevertheless, the exact pathophysiology of the disorder remains unclear. Aberrant visual perceptions such as hallucinations are evident in psychosis, while the occurrence of visual distortions is elevated in individuals with genetic liability for psychosis. The overall goals of this project are to: (1) use psychophysical tasks and neuroimaging to characterize deficits in visual perception; (2) acquire a mechanistic understanding of these deficits through development and validation of a computational model; and (3) determine if said mechanisms mark genetic liability for psychosis. Visual tasks tapping both low- and high-level visual processing are being completed as individuals with psychotic disorders (IPD), first-degree biological siblings of IPDs (SibIPDs) and healthy controls (HCs) undergo 248-channel magneto-encephalography (MEG) recordings followed by 7 Tesla functional magnetic resonance imaging (MRI). By deriving cortical source signals from MEG and MRI data, we will characterize the timing, location and coordination of neural processes. We hypothesize that IPDs prone to visual hallucinations will exhibit deviant functions within early visual cortex, and that aberrant contextual influences on visual perception will involve higher-level visual cortical regions and be associated with visual hallucinations. SibIPDs who experience visual distortions-but not hallucinations-are hypothesized to exhibit deficits in higher-order visual processing reflected in abnormal inter-regional neural synchronization. We hope the results lead to the development of targeted interventions for psychotic disorders, as well as identify useful biomarkers for aberrant neural functions that give rise to psychosis.

Fragmented ambiguous objects: Stimuli with stable low-level features for object recognition tasks

Visual object recognition is a complex skill that relies on the interaction of many spatially distinct and specialized visual areas in the human brain. One tool that can help us better understand these specializations and interactions is a set of visual stimuli that do not differ along low-level dimensions (e.g., orientation, contrast) but do differ along high-level dimensions, such as whether a real-world object can be detected. The present work creates a set of line segment-based images that are matched for luminance, contrast, and orientation distribution (both for single elements and for pair-wise combinations) but result in a range of object and non-object percepts. Image generation started with images of isolated objects taken from publicly available databases and then progressed through 3-stages: a computer algorithm generating 718 candidate images, expert observers selecting 217 for further consideration, and naïve observers performing final ratings. This process identified a set of 100 images that all have the same low-level properties but cover a range of recognizability (proportion of naïve observers (N = 120) who indicated that the stimulus "contained a known object") and semantic stability (consistency across the categories of living, non-living/manipulable, and non-living/non-manipulable when the same observers named "known" objects). Stimuli are available at https://github.com/caolman/FAOT.git.

Responses in early visual areas to contour integration are context dependent

It has been shown that early visual areas are involved in contour processing. However, it is not clear how local and global context interact to influence responses in those areas, nor has the interarea coordination that yields coherent structural percepts been fully studied, especially in human observers. In this study, we used functional magnetic resonance imaging (fMRI) to measure activity in early visual cortex while observers performed a contour detection task in which alignment of Gabor elements and background clutter were manipulated. Six regions of interest (two regions, containing either the cortex representing the target or the background clutter, in each of areas V1, V2, and V3) were predefined using separate target versus background functional localizer scans. The first analysis using a general linear model showed that in the presence of background clutter, responses in V1 and V2 target regions of interest were significantly stronger to aligned than unaligned contours, whereas when background clutter was absent, no significant difference was observed. The second analysis using interarea correlations showed that with background clutter, there was an increase in V1–V2 coordination within the target regions when perceiving aligned versus unaligned contours; without clutter, however, correlations between V1 and V2 were similar no matter whether aligned contours were present or not. Both the average response magnitude and the connectivity analysis suggest different mechanisms support contour processing with or without background distractors. Coordination between V1 and V2 may play a major role in coherent structure perception, especially with complex scene organization.

The effects of orientation and attention during surround suppression of small image features: A 7 Tesla fMRI study

Although V1 responses are driven primarily by elements within a neuron's receptive field, which subtends about 1° visual angle in parafoveal regions, previous work has shown that localized fMRI responses to visual elements reflect not only local feature encoding but also long-range pattern attributes. However, separating the response to an image feature from the response to the surrounding stimulus and studying the interactions between these two responses demands both spatial precision and signal independence, which may be challenging to attain with fMRI. The present study used 7 Tesla fMRI with 1.2-mm resolution to measure the interactions between small sinusoidal grating patches (targets) at 3° eccentricity and surrounds of various sizes and orientations to test the conditions under which localized, context-dependent fMRI responses could be predicted from either psychophysical or electrophysiological data. Targets were presented at 8%, 16%, and 32% contrast while manipulating (a) spatial extent of parallel (strongly suppressive) or orthogonal (weakly suppressive) surrounds, (b) locus of attention, (c) stimulus onset asynchrony between target and surround, and (d) blocked versus event-related design. In all experiments, the V1 fMRI signal was lower when target stimuli were flanked by parallel versus orthogonal context. Attention amplified fMRI responses to all stimuli but did not show a selective effect on central target responses or a measurable effect on orientation-dependent surround suppression. Suppression of the V1 fMRI response by parallel surrounds was stronger than predicted from psychophysics but showed a better match to previous electrophysiological reports.

Representations of Pitch and Timbre Variation in Human Auditory Cortex

Pitch and timbre are two primary dimensions of auditory perception, but how they are represented in the human brain remains a matter of contention. Some animal studies of auditory cortical processing have suggested modular processing, with different brain regions preferentially coding for pitch or timbre, whereas other studies have suggested a distributed code for different attributes across the same population of neurons. This study tested whether variations in pitch and timbre elicit activity in distinct regions of the human temporal lobes. Listeners were presented with sequences of sounds that varied in either fundamental frequency (eliciting changes in pitch) or spectral centroid (eliciting changes in brightness, an important attribute of timbre), with the degree of pitch or timbre variation in each sequence parametrically manipulated. The BOLD responses from auditory cortex increased with increasing sequence variance along each perceptual dimension. The spatial extent, region, and laterality of the cortical regions most responsive to variations in pitch or timbre at the univariate level of analysis were largely overlapping. However, patterns of activation in response to pitch or timbre variations were discriminable in most subjects at an individual level using multivoxel pattern analysis, suggesting a distributed coding of the two dimensions bilaterally in human auditory cortex.

SIGNIFICANCE STATEMENT

Pitch and timbre are two crucial aspects of auditory perception. Pitch governs our perception of musical melodies and harmonies, and conveys both prosodic and (in tone languages) lexical information in speech. Brightness-an aspect of timbre or sound quality-allows us to distinguish different musical instruments and speech sounds. Frequency-mapping studies have revealed tonotopic organization in primary auditory cortex, but the use of pure tones or noise bands has precluded the possibility of dissociating pitch from brightness. Our results suggest a distributed code, with no clear anatomical distinctions between auditory cortical regions responsive to changes in either pitch or timbre, but also reveal a population code that can differentiate between changes in either dimension within the same cortical regions.

Reduced contextual effects on visual contrast perception in schizophrenia and bipolar affective disorder

BACKGROUND

The salience of a visual stimulus is often reduced by nearby stimuli, an effect known as surround suppression of perceived contrast, which may help in locating the borders of an object. Weaker surround suppression has been observed in schizophrenia but it is unclear whether this abnormality is present in other mental disorders with similar symptomatology, or is evident in people with genetic liability for schizophrenia.

METHOD

By examining surround suppression among subjects with schizophrenia or bipolar affective disorder, their unaffected biological relatives and healthy controls we sought to determine whether diminished surround suppression was specific to schizophrenia, and if subjects with a genetic risk for either disorder would show similar deficits. Measuring perceived contrast in different surround conditions also allowed us to investigate how this suppression depends on the similarity of target and surrounding stimuli.

RESULTS

Surround suppression was weaker among schizophrenia patients regardless of surround configuration. Subjects with bipolar affective disorder showed an intermediate deficit, with stronger suppression than in schizophrenia but weaker than control subjects. Surround suppression was normal in relatives of both patient groups. Findings support a deficit in broadly tuned (rather than sharply orientation- or direction-selective) suppression mechanisms.

CONCLUSIONS

Weak broadly tuned suppression during visual perception is evident in schizophrenia and bipolar affective disorder, consistent with impaired gain control related to the clinical expression of these conditions.

Scene coherence can affect the local response to natural images in human V1

Neurons in primary visual cortex (V1) can be indirectly affected by visual stimulation positioned outside their receptive fields. Although this contextual modulation has been intensely studied, we have little notion of how it manifests with naturalistic stimulation. Here, we investigated how the V1 response to a natural image fragment is affected by spatial context that is consistent or inconsistent with the scene from which it was extracted. Using functional magnetic resonance imaging at 7 T, we measured the blood oxygen level-dependent signal in human V1 (n = 8) while participants viewed an array of apertures. Most apertures showed fragments from a single scene, yielding a dominant perceptual interpretation which participants were asked to categorize, and the remaining apertures each showed fragments drawn from a set of 20 scenes. We find that the V1 response was significantly increased for apertures showing image structure that was coherent with the dominant scene relative to the response to the same image structure when it was non-coherent. Additional analyses suggest that this effect was mostly evident for apertures in the periphery of the visual field, that it peaked towards the centre of the aperture, and that it peaked in the middle to superficial regions of the cortical grey matter. These findings suggest that knowledge of typical spatial relationships is embedded in the circuitry of contextual modulation. Such mechanisms, possibly augmented by contributions from attentional factors, serve to increase the local V1 activity under conditions of contextual consistency.

A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes

Recent multi-voxel pattern classification (MVPC) studies have shown that in early visual cortex patterns of brain activity generated during mental imagery are similar to patterns of activity generated during perception. This finding implies that low-level visual features (e.g., space, spatial frequency, and orientation) are encoded during mental imagery. However, the specific hypothesis that low-level visual features are encoded during mental imagery is difficult to directly test using MVPC. The difficulty is especially acute when considering the representation of complex, multi-object scenes that can evoke multiple sources of variation that are distinct from low-level visual features. Therefore, we used a voxel-wise modeling and decoding approach to directly test the hypothesis that low-level visual features are encoded in activity generated during mental imagery of complex scenes. Using fMRI measurements of cortical activity evoked by viewing photographs, we constructed voxel-wise encoding models of tuning to low-level visual features. We also measured activity as subjects imagined previously memorized works of art. We then used the encoding models to determine if putative low-level visual features encoded in this activity could pick out the imagined artwork from among thousands of other randomly selected images. We show that mental images can be accurately identified in this way; moreover, mental image identification accuracy depends upon the degree of tuning to low-level visual features in the voxels selected for decoding. These results directly confirm the hypothesis that low-level visual features are encoded during mental imagery of complex scenes. Our work also points to novel forms of brain-machine interaction: we provide a proof-of-concept demonstration of an internet image search guided by mental imagery.

Larger neural responses produce BOLD signals that begin earlier in time

Functional MRI analyses commonly rely on the assumption that the temporal dynamics of hemodynamic response functions (HRFs) are independent of the amplitude of the neural signals that give rise to them. The validity of this assumption is particularly important for techniques that use fMRI to resolve sub-second timing distinctions between responses, in order to make inferences about the ordering of neural processes. Whether or not the detailed shape of the HRF is independent of neural response amplitude remains an open question, however. We performed experiments in which we measured responses in primary visual cortex (V1) to large, contrast-reversing checkerboards at a range of contrast levels, which should produce varying amounts of neural activity. Ten subjects (ages 22-52) were studied in each of two experiments using 3 Tesla scanners. We used rapid, 250 ms, temporal sampling (repetition time, or TR) and both short and long inter-stimulus interval (ISI) stimulus presentations. We tested for a systematic relationship between the onset of the HRF and its amplitude across conditions, and found a strong negative correlation between the two measures when stimuli were separated in time (long- and medium-ISI experiments, but not the short-ISI experiment). Thus, stimuli that produce larger neural responses, as indexed by HRF amplitude, also produced HRFs with shorter onsets. The relationship between amplitude and latency was strongest in voxels with lowest mean-normalized variance (i.e., parenchymal voxels). The onset differences observed in the longer-ISI experiments are likely attributable to mechanisms of neurovascular coupling, since they are substantially larger than reported differences in the onset of action potentials in V1 as a function of response amplitude.

Neural correlates of preparatory and regulatory control over positive and negative emotion

This study used functional magnetic resonance imaging to investigate brain activation during preparatory and regulatory control while participants (N = 24) were instructed either to simply view or decrease their emotional response to, pleasant, neutral or unpleasant pictures. A main effect of emotional valence on brain activity was found in the right precentral gyrus, with greater activation during positive than negative emotion regulation. A main effect of regulation phase was evident in the bilateral anterior prefrontal cortex (PFC), precuneus, posterior cingulate cortex, right putamen and temporal and occipital lobes, with greater activity in these regions during preparatory than regulatory control. A valence X regulation interaction was evident in regions of ventromedial PFC and anterior cingulate cortex, reflecting greater activation while regulating negative than positive emotion, but only during active emotion regulation (not preparation). Conjunction analyses revealed common brain regions involved in differing types of emotion regulation including selected areas of left lateral PFC, inferior parietal lobe, temporal lobe, right cerebellum and bilateral dorsomedial PFC. The right lateral PFC was additionally activated during the modulation of both positive and negative valence. Findings demonstrate significant modulation of brain activity during both preparation for, and active regulation of positive and negative emotional states.

Regions of mid-level human visual cortex sensitive to the global coherence of local image patches

The global structural arrangement and spatial layout of the visual environment must be derived from the integration of local signals represented in the lower tiers of the visual system. This interaction between the spatially local and global properties of visual stimulation underlies many of our visual capacities, and how this is achieved in the brain is a central question for visual and cognitive neuroscience. Here, we examine the sensitivity of regions of the posterior human brain to the global coordination of spatially displaced naturalistic image patches. We presented observers with image patches in two circular apertures to the left and right of central fixation, with the patches drawn from either the same (coherent condition) or different (noncoherent condition) extended image. Using fMRI at 7T (n = 5), we find that global coherence affected signal amplitude in regions of dorsal mid-level cortex. Furthermore, we find that extensive regions of mid-level visual cortex contained information in their local activity pattern that could discriminate coherent and noncoherent stimuli. These findings indicate that the global coordination of local naturalistic image information has important consequences for the processing in human mid-level visual cortex.

Segmentation decreases the magnitude of the tilt illusion

In the tilt illusion, the perceived orientation of a target grating depends strongly on the orientation of a surround. When the orientations of the center and surround gratings differ by a small angle, the center grating appears to tilt away from the surround orientation (repulsion), whereas for a large difference in angle, the center appears to tilt toward the surround orientation (attraction). In order to understand how segmentation/perceptual grouping of the center and surround affect the magnitude of the tilt illusion, we conducted three psychophysical experiments in which we measured observers' perception of center orientation as a function of center-surround relative contrast, relative disparity depth, and geometric features such as occlusion and collinearity. All of these manipulations affected the strength of perceived orientation bias in the center. Our results suggest that if stronger segmentation/perceptual grouping is induced between the center and surround, the tilt repulsion bias decreases/increases. A grouping-dependent tilt illusion plays an important role in visual search and detection by enhancing the sensitivity of our visual system to feature discrepancies, especially in relatively homogenous environments.

Abnormal contextual modulation of visual contour detection in patients with schizophrenia

Schizophrenia patients demonstrate perceptual deficits consistent with broad dysfunction in visual context processing. These include poor integration of segments forming visual contours, and reduced visual contrast effects (e.g. weaker orientation-dependent surround suppression, ODSS). Background image context can influence contour perception, as stimuli near the contour affect detection accuracy. Because of ODSS, this contextual modulation depends on the relative orientation between the contour and flanking elements, with parallel flankers impairing contour perception. However in schizophrenia, the impact of abnormal ODSS during contour perception is not clear. It is also unknown whether deficient contour perception marks genetic liability for schizophrenia, or is strictly associated with clinical expression of this disorder. We examined contour detection in 25 adults with schizophrenia, 13 unaffected first-degree biological relatives of schizophrenia patients, and 28 healthy controls. Subjects performed a psychophysics experiment designed to quantify the effect of flanker orientation during contour detection. Overall, patients with schizophrenia showed poorer contour detection performance than relatives or controls. Parallel flankers suppressed and orthogonal flankers enhanced contour detection performance for all groups, but parallel suppression was relatively weaker for schizophrenia patients than healthy controls. Relatives of patients showed equivalent performance with controls. Computational modeling suggested that abnormal contextual modulation in schizophrenia may be explained by suppression that is more broadly tuned for orientation. Abnormal flanker suppression in schizophrenia is consistent with weaker ODSS and/or broader orientation tuning. This work provides the first evidence that such perceptual abnormalities may not be associated with a genetic liability for schizophrenia.

Consequences of polar form coherence for fMRI responses in human visual cortex

Relevant features in the visual image are often spatially extensive and have complex orientation structure. Our perceptual sensitivity to such spatial form is demonstrated by polar Glass patterns, in which an array of randomly-positioned dot pairs that are each aligned with a particular polar displacement (rotation, for example) yield a salient impression of spatial structure. Such patterns are typically considered to be processed in two main stages: local spatial filtering in low-level visual cortex followed by spatial pooling and complex form selectivity in mid-level visual cortex. However, it remains unclear both whether reciprocal interactions within the cortical hierarchy are involved in polar Glass pattern processing and which mid-level areas identify and communicate polar Glass pattern structure. Here, we used functional magnetic resonance imaging (fMRI) at 7T to infer the magnitude of neural response within human low-level and mid-level visual cortex to polar Glass patterns of varying coherence (proportion of signal elements). The activity within low-level visual areas V1 and V2 was not significantly modulated by polar Glass pattern coherence, while the low-level area V3, dorsal and ventral mid-level areas, and the human MT complex each showed a positive linear coherence response functions. The cortical processing of polar Glass patterns thus appears to involve primarily feedforward communication of local signals from V1 and V2, with initial polar form selectivity reached in V3 and distributed to multiple pathways in mid-level visual cortex.

Layer-specific fMRI reflects different neuronal computations at different depths in human V1

Recent work has established that cerebral blood flow is regulated at a spatial scale that can be resolved by high field fMRI to show cortical columns in humans. While cortical columns represent a cluster of neurons with similar response properties (spanning from the pial surface to the white matter), important information regarding neuronal interactions and computational processes is also contained within a single column, distributed across the six cortical lamina. A basic understanding of underlying neuronal circuitry or computations may be revealed through investigations of the distribution of neural responses at different cortical depths. In this study, we used T₂-weighted imaging with 0.7 mm (isotropic) resolution to measure fMRI responses at different depths in the gray matter while human subjects observed images with either recognizable or scrambled (physically impossible) objects. Intact and scrambled images were partially occluded, resulting in clusters of activity distributed across primary visual cortex. A subset of the identified clusters of voxels showed a preference for scrambled objects over intact; in these clusters, the fMRI response in middle layers was stronger during the presentation of scrambled objects than during the presentation of intact objects. A second experiment, using stimuli targeted at either the magnocellular or the parvocellular visual pathway, shows that laminar profiles in response to parvocellular-targeted stimuli peak in more superficial layers. These findings provide new evidence for the differential sensitivity of high-field fMRI to modulations of the neural responses at different cortical depths.

High-field FMRI for human applications: an overview of spatial resolution and signal specificity

In the last decade, dozens of 7 Tesla scanners have been purchased or installed around the world, while 3 Tesla systems have become a standard. This increased interest in higher field strengths is driven by a demonstrated advantage of high fields for available signal-to-noise ratio (SNR) in the magnetic resonance signal. Functional imaging studies have additional advantages of increases in both the contrast and the spatial specificity of the susceptibility based BOLD signal. One use of this resultant increase in the contrast to noise ratio (CNR) for functional MRI studies at high field is increased image resolution. However, there are many factors to consider in predicting exactly what kind of resolution gains might be made at high fields, and what the opportunity costs might be. The first part of this article discusses both hardware and image quality considerations for higher resolution functional imaging. The second part draws distinctions between image resolution, spatial specificity, and functional specificity of the fMRI signals that can be acquired at high fields, suggesting practical limitations for attainable resolutions of fMRI experiments at a given field, given the current state of the art in imaging techniques. Finally, practical resolution limitations and pulse sequence options for studies in human subjects are considered.

An exploration of the spatial scale over which orientation-dependent surround effects affect contour detection

Contour detection is a crucial component of visual processing; however, performance on contour detection tasks can vary depending on the context of the visual scene. S. C. Dakin and N. J. Baruch (2009) showed that detection of a contour in an array of distracting elements depends on the orientation of flanking elements. Here, using a line of five collinear Gabor elements ("target contour") in a field of distractor Gabor elements, we systematically measured the effects of eccentricity, spacing, and spatial frequency on contour detection performance in three different contexts: randomly oriented distractors (control condition), flanking distractors (on either side of the collinear Gabors) aligned approximately parallel to the target contour, and flanking distractors aligned approximately orthogonal to the target contour. In the control condition, contour detection performance was best for larger Gabors (2 cpd) spaced farther apart (1.2°). Parallel flankers reduced performance for intermediate and large spacings and sizes compared to the control condition, while orthogonal flankers increased performance for the smallest spacing and size compared to the control condition. The results are fit by a model in which collinear facilitation, which is size-dependent but can persist for several degrees of visual angle, competes with orientation-dependent suppression from the flanking context when elements are separated by less than a degree of visual angle.

Selective BOLD responses to individual finger movement measured with fMRI at 3T

Although the gross somatotopic organization of the posterior bank of the precentral gyrus is well established, a fine scale organization of the representations of the digits of the hand has not been fully characterized. Previous neuroimaging studies have failed to find clear evidence for a specificity of digit representations in motor cortex, but rather report a distributed network of control. Reported here are the results of two experiments; in Experiment 1 a sequential finger tapping task produced strong blood oxygen level dependent (BOLD) responses in the contralateral precentral gyrus, but there was a lack of specificity for distinguishing individual representations. A randomly ordered task did accomplish this goal. In the second experiment, a randomly ordered finger-tapping task was used and the findings demonstrated BOLD responses in clusters of voxels specific to movement of a single digit. The region of interest defined for each digit comprised several noncontiguous clusters. A "selectivity index" was developed to quantify the magnitude of the BOLD response to the movement of a specific digit, relative to BOLD response associated with movement of other digits. Strong evidence of BOLD selectivity (albeit not exclusivity) was found in the hemisphere contralateral to the cued digit; however, there was no evidence for an orderly spatial topography. These findings demonstrate that a selectivity of activation is quantifiable, supports a theory of noncontiguous distribution of control, and provides a method for comparing between healthy and impaired populations and investigating changes following training or intervention.

Contrast Response Functions for Single Gabor Patches: ROI-Based Analysis Over-Represents Low-Contrast Patches for GE BOLD

IMPORTANT FOR THE INTERPRETATION OF BOLD FMRI DATA IS A LINEAR RELATIONSHIP BETWEEN THE BOLD RESPONSE AND THE UNDERLYING NEURAL ACTIVITY: increased BOLD responses should reflect proportionate increases in the underlying neural activity. While previous studies have demonstrated a linear relationship between the peak amplitude of the BOLD response and neural activity in primary visual cortex (V1), these studies have used stimuli that excite large areas of cortex, and the linearity of the BOLD response has not been demonstrated when only a small patch of cortex is stimulated. The BOLD response to isolated Gabor patches of increasing contrast was measured with gradient echo (GE) BOLD and spin echo (SE) BOLD at 7 T. Our primary finding is notable spatial heterogeneity of the BOLD contrast response, particularly for the GE BOLD data, resulting in a more reliably linear relationship between BOLD data and estimated neural responses in the center of the cortical representations of the individual Gabor patches than near the edges. A control experiment with larger sinusoidal grating patches confirms that the observed sensitivity to voxel selection in the regions of interest-based analysis is unique to the small stimuli.

Multiband multislice GE-EPI at 7 tesla, with 16-fold acceleration using partial parallel imaging with application to high spatial and temporal whole-brain fMRI

Parallel imaging in the form of multiband radiofrequency excitation, together with reduced k-space coverage in the phase-encode direction, was applied to human gradient echo functional MRI at 7 T for increased volumetric coverage and concurrent high spatial and temporal resolution. Echo planar imaging with simultaneous acquisition of four coronal slices separated by 44mm and simultaneous 4-fold phase-encoding undersampling, resulting in 16-fold acceleration and up to 16-fold maximal aliasing, was investigated. Task/stimulus-induced signal changes and temporal signal behavior under basal conditions were comparable for multiband and standard single-band excitation and longer pulse repetition times. Robust, whole-brain functional mapping at 7 T, with 2 x 2 x 2mm(3) (pulse repetition time 1.25 sec) and 1 x 1 x 2mm(3) (pulse repetition time 1.5 sec) resolutions, covering fields of view of 256 x 256 x 176 mm(3) and 192 x 172 x 176 mm(3), respectively, was demonstrated with current gradient performance.

High-resolution BOLD fMRI measurements of local orientation-dependent contextual modulation show a mismatch between predicted V1 output and local BOLD response

The blood oxygenation level-dependent (BOLD) functional MRI response to suppressive neural activity has not been tested on a fine spatial scale. Using Gabor patches placed in the near periphery, we precisely localized individual regions of interest in primary visual cortex and measured the response at a range of contrasts in two different contexts: with parallel and with orthogonal flanking Gabor patches. Psychophysical measurements confirmed strong suppression of the target Gabor response when flanked by parallel Gabors. However, the BOLD response to the target with parallel flankers decreased as the target contrast increased, which contradicts psychophysical estimates of local neural activity.

Distortion and signal loss in medial temporal lobe

Background

The medial temporal lobe (MTL) contains subregions that are subject to severe distortion and signal loss in functional MRI. Air/tissue and bone/tissue interfaces in the vicinity of the MTL distort the local magnetic field due to differences in magnetic susceptibility. Fast image acquisition and thin slices can reduce the amount of distortion and signal loss, but at the cost of image signal-to-noise ratio (SNR).

Methodology/Principal Findings

In this paper, we quantify the severity of distortion and signal loss in MTL subregions for three different echo planar imaging (EPI) acquisitions at 3 Tesla: a conventional moderate-resolution EPI (3×3×3 mm), a conventional high-resolution EPI (1.5×1.5×2 mm), and a zoomed high-resolution EPI. We also demonstrate the advantage of reversing the phase encode direction to control the direction of distortion and to maximize efficacy of distortion compensation during data post-processing. With the high-resolution zoomed acquisition, distortion is not significant and signal loss is present only in the most anterior regions of the parahippocampal gyrus. Furthermore, we find that the severity of signal loss is variable across subjects, with some subjects showing negligible loss and others showing more dramatic loss.

Conclusions/Significance

Although both distortion and signal loss are minimized in a zoomed field of view acquisition with thin slices, this improvement in accuracy comes at the cost of reduced SNR. We quantify this trade-off between distortion and SNR in order to provide a decision tree for design of high-resolution experiments investigating the function of subregions in MTL.

Metabolic and hemodynamic events after changes in neuronal activity: current hypotheses, theoretical predictions and in vivo NMR experimental findings

Unraveling the energy metabolism and the hemodynamic outcomes of excitatory and inhibitory neuronal activity is critical not only for our basic understanding of overall brain function, but also for the understanding of many brain disorders. Methodologies of magnetic resonance spectroscopy (MRS) and magnetic resonance imaging (MRI) are powerful tools for the noninvasive investigation of brain metabolism and physiology. However, the temporal and spatial resolution of in vivo MRS and MRI is not suitable to provide direct evidence for hypotheses that involve metabolic compartmentalization between different cell types, or to untangle the complex neuronal microcircuitry, which results in changes of electrical activity. This review aims at describing how the current models of brain metabolism, mainly built on the basis of in vitro evidence, relate to experimental findings recently obtained in vivo by (1)H MRS, (13)C MRS, and MRI. The hypotheses related to the role of different metabolic substrates, the metabolic neuron-glia interactions, along with the available theoretical predictions of the energy budget of neurotransmission will be discussed. In addition, the cellular and network mechanisms that characterize different types of increased and suppressed neuronal activity will be considered within the sensitivity-constraints of MRS and MRI.

The effect of large veins on spatial localization with GE BOLD at 3 T: Displacement, not blurring

We used two different methods of region of interest (ROI) definition to investigate the spatial accuracy of functional magnetic resonance imaging (fMRI) at low and high spatial resolution. The "single-condition localizer" consisted of block alternation between a target stimulus and a mean gray background. The "differential localizer" consisted of block alternation between the target stimulus and another stimulus that filled the complement of the visual field. A separate series of scans, in which the target stimulus was presented briefly with long inter-stimulus intervals, was used to measure the hemodynamic impulse response function (HIRF). As expected, the differential localizer defined more restricted ROIs that better matched the predicted cortical representation of the target stimulus. However, at low resolution (3-mm isotropic) many voxels that responded positively to the target stimulus in the differential protocol responded negatively to the target stimulus in the single-condition localizer and in the HIRF measurements. The localization errors were attributed to voxels near large veins, which were identified based on low mean intensity and high variance. At high resolution (1.2-mm isotropic), the effects of large veins were present, but affected a smaller number of voxels. Thus, the use of differential localizers does not necessarily result in a more accurate indication of the underlying neural activity. Localization errors are reduced at higher spatial resolutions and can be eliminated by identification and removal of voxels dominated by large veins.

Spatially specific FMRI repetition effects in human visual cortex

The functional MRI (fMRI) response to a pair of identical, successively presented stimuli can result in a smaller signal than the presentation of two nonidentical stimuli. This "repetition effect" has become a frequently used tool to make inferences about neural selectivity in specific cortical areas. However, little is known about the mechanism(s) underlying the effect. In particular, despite many successful applications of the technique in higher visual areas, repetition effects in lower visual areas [e.g., primary visual cortex (V1)] have been more difficult to characterize. One property that is well understood in early visual areas is the mapping of visual field locations to specific areas of the cortex (i.e., retinotopy). We used the retinotopic organization of V1 to activate progressively different populations of neurons in a rapid fMRI experimental design. We observed a repetition effect (reduced signal) when localized stimulus elements were repeated in identical locations. We show that this effect is spatially tuned and largely independent of both interstimulus interval (100-800 ms) and the focus of attention. Using the same timing parameters for which we observed a large effect of spatial position, we also examined the response to orientation changes and observed no effect of an orientation change on the response to repeated stimuli in V1 but significant effects in other retinotopic areas. Given these results, we discuss the possible causes of these repetition effects as well as the implications for interpreting other experiments that use this potentially powerful imaging technique.

BOLD fMRI and psychophysical measurements of contrast response to broadband images

We have measured the relationship between image contrast, perceived contrast, and BOLD fMRI activity in human early visual areas, for natural, whitened, pink noise, and white noise images. As root-mean-square contrast increases, BOLD response to natural images is stronger and saturates more rapidly than response to the whitened images. Perceived contrast and BOLD fMRI responses are higher for pink noise than for white noise patterns, by the same ratio as between natural and whitened images. Spatial phase structure has no measurable effect on perceived contrast or BOLD fMRI response. The fMRI and perceived contrast response results can be described by models of spatial frequency response in V1, that match the contrast sensitivity function at low contrasts, and have more uniform spatial frequency response at high contrasts.