Functional magnetic resonance adaptation in visual neuroscience

Retinotopic variations of the negative blood-oxygen-level dependent hemodynamic response function in human primary visual cortex

Functional magnetic resonance imaging (fMRI) measures blood-oxygen-level-dependent (BOLD) contrast that is generally assumed to be linearly related to excitatory neural activity. The positive hemodynamic response function (pHRF) is the positive BOLD response (PBR) evoked by a brief neural stimulation; the pHRF is often used as the impulse response for linear analysis of neural excitation. Many fMRI studies have observed a negative BOLD response (NBR) that is often associated with neural suppression. However, the temporal dynamics of the NBR evoked by a brief stimulus, the negative HRF (nHRF), remains unclear. Here, a unilateral visual stimulus was presented in a slow event-related design to elicit both pHRFs in the stimulus representation (SR), and nHRFs elsewhere. The observed nHRFs were not inverted versions of the pHRF previously reported. They were characterized by a stronger initial negative response followed by a significantly later positive peak. In contralateral primary visual cortex (V1), these differences varied with eccentricity from the SR. Similar nHRFs were observed in ipsilateral V1 with less eccentricity variation. Experiments with the blocked version of the same stimulus confirmed that brain regions presenting the unexpected nHRF dynamics correspond to those presenting a strong NBR. These data demonstrated that shift-invariant temporal linearity did not hold for the NBR while confirming that the PBR maintained rough linearity. Modeling indicated that the observed nHRFs can be created by suppression of both blood flow and oxygen metabolism. Critically, the nHRF can be misinterpreted as a pHRF due to their similarity, which could confound linear analysis for event-related fMRI experiments.NEW & NOTEWORTHY We investigate dynamics of the negative hemodynamic response function (nHRF), the negative blood-oxygen-level-dependent (BOLD) response (NBR) evoked by a brief stimulus, in human early visual cortex. Here, we show that the nHRFs are not inverted versions of the corresponding pHRFs. The nHRF has complex dynamics that varied significantly with eccentricity. The results also show shift-invariant temporal linearity does not hold for the NBR.

Stable habituation deficits in the early stage of psychosis: a 2-year follow-up study

Neural habituation, the decrease in brain response to repeated stimuli, is a fundamental, highly conserved mechanism that acts as an essential filter for our complex sensory environment. Convergent evidence indicates neural habituation is disrupted in both early and chronic stages of schizophrenia, with deficits co-occurring in brain regions that show inhibitory dysfunction. As inhibitory deficits have been proposed to contribute to the onset and progression of illness, habituation may be an important treatment target. However, a crucial first step is clarifying whether habituation deficits progress with illness. In the present study, we measured neural habituation in 138 participants (70 early psychosis patients (<2 years of illness), 68 healthy controls), with 108 participants assessed longitudinally at both baseline and 2-year follow-up. At follow-up, all early psychosis patients met criteria for a schizophrenia spectrum disorder (i.e., schizophreniform disorder, schizophrenia, schizoaffective disorder). Habituation slopes (i.e., rate of fMRI signal change) to repeated images were computed for the anterior hippocampus, occipital cortex, and the fusiform face area. Habituation slopes were entered into a linear mixed model to test for effects of group and time by region. We found that early psychosis patients showed habituation deficits relative to healthy control participants across brain regions, and that these deficits were maintained, but did not worsen, over two years. These results suggest a stable period of habituation deficits in the early stage of schizophrenia.

The steady-state visual evoked potential (SSVEP) reflects the activation of cortical object representations: evidence from semantic stimulus repetition

We applied high-density EEG to examine steady-state visual evoked potentials (SSVEPs) during a perceptual/semantic stimulus repetition design. SSVEPs are evoked oscillatory cortical responses at the same frequency as visual stimuli flickered at this frequency. In repetition designs, stimuli are presented twice with the repetition being task irrelevant. The cortical processing of the second stimulus is commonly characterized by decreased neuronal activity (repetition suppression). The behavioral consequences of stimulus repetition were examined in a companion reaction time pre-study using the same experimental design as the EEG study. During the first presentation of a stimulus, we confronted participants with drawings of familiar object images or object words, respectively. The second stimulus was either a repetition of the same object image (perceptual repetition; PR) or an image depicting the word presented during the first presentation (semantic repetition; SR)—all flickered at 15 Hz to elicit SSVEPs. The behavioral study revealed priming effects in both experimental conditions (PR and SR). In the EEG, PR was associated with repetition suppression of SSVEP amplitudes at left occipital and repetition enhancement at left temporal electrodes. In contrast, SR was associated with SSVEP suppression at left occipital and central electrodes originating in bilateral postcentral and occipital gyri, right middle frontal and right temporal gyrus. The conclusion of the presented study is twofold. First, SSVEP amplitudes do not only index perceptual aspects of incoming sensory information but also semantic aspects of cortical object representation. Second, our electrophysiological findings can be interpreted as neuronal underpinnings of perceptual and semantic priming.

I See Your Effort: Force-Related BOLD Effects in an Extended Action Execution-Observation Network Involving the Cerebellum

Action observation (AO) is crucial for motor planning, imitation learning, and social interaction, but it is not clear whether and how an action execution–observation network (AEON) processes the effort of others engaged in performing actions. In this functional magnetic resonance imaging (fMRI) study, we used a “squeeze ball” task involving different grip forces to investigate whether AEON activation showed similar patterns when executing the task or observing others performing it. Both in action execution, AE (subjects performed the visuomotor task) and action observation, AO (subjects watched a video of the task being performed by someone else), the fMRI signal was detected in cerebral and cerebellar regions. These responses showed various relationships with force mapping onto specific areas of the sensorimotor and cognitive systems. Conjunction analysis of AE and AO was repeated for the “0th” order and linear and nonlinear responses, and revealed multiple AEON nodes remapping the detection of actions, and also effort, of another person onto the observer’s own cerebrocerebellar system. This result implies that the AEON exploits the cerebellum, which is known to process sensorimotor predictions and simulations, performing an internal assessment of forces and integrating information into high-level schemes, providing a crucial substrate for action imitation.

Brain regions that show repetition suppression and enhancement: A meta-analysis of 137 neuroimaging experiments

Repetition suppression and enhancement refer to the reduction and increase in the neural responses for repeated rather than novel stimuli, respectively. This study provides a meta-analysis of the effects of repetition suppression and enhancement, restricting the data used to that involving fMRI/PET, visual stimulus presentation, and healthy participants. The major findings were as follows. First, the global topography of the repetition suppression effects was strikingly similar to that of the "subsequent memory" effects, indicating that the mechanism for repetition suppression is the reduced engagement of an encoding system. The lateral frontal cortex effects involved the frontoparietal control network regions anteriorly and the dorsal attention network regions posteriorly. The left fusiform cortex effects predominantly involved the dorsal attention network regions, whereas the right fusiform cortex effects mainly involved the visual network regions. Second, the category-specific meta-analyses and their comparisons indicated that most parts of the alleged category-specific regions showed repetition suppression for more than one stimulus category. In this regard, these regions may not be "dedicated cortical modules," but are more likely parts of multiple overlapping large-scale maps of simple features. Finally, the global topography of the repetition enhancement effects was similar to that of the "retrieval success" effects, suggesting that the mechanism for repetition enhancement is voluntary or involuntary explicit retrieval during an implicit memory task. Taken together, these results clarify the network affiliations of the regions showing reliable repetition suppression and enhancement effects and contribute to the theoretical interpretations of the local and global topography of these two effects. Hum Brain Mapp 38:1894-1913, 2017. © 2017 Wiley Periodicals, Inc.

Stimulus-specific adaptation to visual but not auditory motion direction in the barn owl's optic tectum

Whether the auditory and visual systems use a similar coding strategy to represent motion direction is an open question. We investigated this question in the barn owl's optic tectum (OT) testing stimulus-specific adaptation (SSA) to the direction of motion. SSA, the reduction of the response to a repetitive stimulus that does not generalize to other stimuli, has been well established in OT neurons. SSA suggests a separate representation of the adapted stimulus in upstream pathways. So far, only SSA to static stimuli has been studied in the OT. Here, we examined adaptation to moving auditory and visual stimuli. SSA to motion direction was examined using repeated presentations of moving stimuli, occasionally switching motion to the opposite direction. Acoustic motion was either mimicked by varying binaural spatial cues or implemented in free field using a speaker array. While OT neurons displayed SSA to motion direction in visual space, neither stimulation paradigms elicited significant SSA to auditory motion direction. These findings show a qualitative difference in how auditory and visual motion is processed in the OT and support the existence of dedicated circuitry for representing motion direction in the early stages of visual but not the auditory system.

Left extrastriate body area is sensitive to the meaning of symbolic gesture: evidence from fMRI repetition suppression

Functional magnetic resonance imaging (fMRI) adaptation (a.k.a. repetition suppression) paradigm was used to test if semantic information contained in object-related (transitive) pantomimes and communicative (intransitive) gestures is represented differently in the occipito-temporal cortex. Participants watched 2.75 s back-to-back videos where the meaning of gesture was either repeated or changed. The just observed (typically second) gesture was then imitated. To maintain participants’ attention, some trials contained a single video. fMRI adaptation –signal decreases– for watching both movement categories were observed particularly in the lateral occipital cortex, including the extrastriate body area (EBA). Yet, intransitive (vs. transitive) gesture specific repetition suppression was found mainly in the left rostral EBA and caudal middle temporal gyrus- the rEBA/cMTG complex. Repetition enhancement (signal increase) was revealed in the precuneus. While the whole brain and region-of-interest analyses indicate that the precuneus is involved only in visuospatial action processing for later imitation, the common EBA repetition suppression discloses sensitivity to the meaning of symbolic gesture, namely the “semantic what” of actions. Moreover, the rEBA/cMTG suppression reveals greater selectivity for conventionalized communicative gesture. Thus, fMRI adaptation shows higher-order functions of EBA, its role in the semantic network, and indicates that its functional repertoire is wider than previously thought.

Visual Adaptation

Sensory systems continuously mold themselves to the widely varying contexts in which they must operate. Studies of these adaptations have played a long and central role in vision science. In part this is because the specific adaptations remain a powerful tool for dissecting vision, by exposing the mechanisms that are adapting. That is, "if it adapts, it's there." Many insights about vision have come from using adaptation in this way, as a method. A second important trend has been the realization that the processes of adaptation are themselves essential to how vision works, and thus are likely to operate at all levels. That is, "if it's there, it adapts." This has focused interest on the mechanisms of adaptation as the target rather than the probe. Together both approaches have led to an emerging insight of adaptation as a fundamental and ubiquitous coding strategy impacting all aspects of how we see.

Neocortical Rebound Depolarization Enhances Visual Perception

Animals are constantly exposed to the time-varying visual world. Because visual perception is modulated by immediately prior visual experience, visual cortical neurons may register recent visual history into a specific form of offline activity and link it to later visual input. To examine how preceding visual inputs interact with upcoming information at the single neuron level, we designed a simple stimulation protocol in which a brief, orientated flashing stimulus was subsequently coupled to visual stimuli with identical or different features. Using in vivo whole-cell patch-clamp recording and functional two-photon calcium imaging from the primary visual cortex (V1) of awake mice, we discovered that a flash of sinusoidal grating per se induces an early, transient activation as well as a long-delayed reactivation in V1 neurons. This late response, which started hundreds of milliseconds after the flash and persisted for approximately 2 s, was also observed in human V1 electroencephalogram. When another drifting grating stimulus arrived during the late response, the V1 neurons exhibited a sublinear, but apparently increased response, especially to the same grating orientation. In behavioral tests of mice and humans, the flashing stimulation enhanced the detection power of the identically orientated visual stimulation only when the second stimulation was presented during the time window of the late response. Therefore, V1 late responses likely provide a neural basis for admixing temporally separated stimuli and extracting identical features in time-varying visual environments.

A study of mice and humans shows that prior activity in the visual cortex induces a long-delayed depolarization that enhances perception of subsequent visual stimuli if these are identical to the previous one, thereby extracting invariant visual features from the constantly changing visual world.

Animals are constantly exposed to a visual world that varies over time. To examine how the visual cortex integrates visual information that is temporally spaced, we monitored neuronal activity of the primary visual cortex (V1) using single- and multicell recording techniques. We discovered that a brief visual stimulus induced an early, transient activation as well as a delayed reactivation of V1 neurons in mice and humans. Notably, this reactivation of visual cortex conveyed information about stimulus orientation: presentation of a second visual stimulus during this reactivation enhanced the V1 response specifically when the orientations of the two stimuli were identical. Behavioral tests in mice and humans revealed that the ability to detect visual stimuli was also enhanced when the second stimulus was presented during the time window of V1 reactivation. Because animals extract visual information from an environment in constant change, the modulation of visual responses through cortical reactivation might be a strategy commonly used in the visual system.

Pretreatment Differences in BOLD Response to Emotional Faces Correlate with Antidepressant Response to Scopolamine

BACKGROUND

Faster acting antidepressants and biomarkers that predict treatment response are needed to facilitate the development of more effective treatments for patients with major depressive disorders. Here, we evaluate implicitly and explicitly processed emotional faces using neuroimaging to identify potential biomarkers of treatment response to the antimuscarinic, scopolamine.

METHODS

Healthy participants (n=15) and unmedicated-depressed major depressive disorder patients (n=16) participated in a double-blind, placebo-controlled crossover infusion study using scopolamine (4 μg/kg). Before and following scopolamine, blood oxygen-level dependent signal was measured using functional MRI during a selective attention task. Two stimuli comprised of superimposed pictures of faces and houses were presented. Participants attended to one stimulus component and performed a matching task. Face emotion was modulated (happy/sad) creating implicit (attend-houses) and explicit (attend-faces) emotion processing conditions. The pretreatment difference in blood oxygen-level dependent response to happy and sad faces under implicit and explicit conditions (emotion processing biases) within a-priori regions of interest was correlated with subsequent treatment response in major depressive disorder.

RESULTS

Correlations were observed exclusively during implicit emotion processing in the regions of interest, which included the subgenual anterior cingulate (P<.02) and middle occipital cortices (P<.02).

CONCLUSIONS

The magnitude and direction of differential blood oxygen-level- dependent response to implicitly processed emotional faces prior to treatment reflect the potential to respond to scopolamine. These findings replicate earlier results, highlighting the potential for pretreatment neural activity in the middle occipital cortices and subgenual anterior cingulate to inform us about the potential to respond clinically to scopolamine.

The amygdala's response to face and emotional information and potential category-specific modulation of temporal cortex as a function of emotion

The amygdala has been implicated in the processing of emotion and animacy information and to be responsive to novelty. However, the way in which these functions interact is poorly understood. Subjects (N = 30) viewed threatening or neutral images that could be either animate (facial expressions) or inanimate (objects) in the context of a dot probe task. The amygdala showed responses to both emotional and animacy information, but no emotion by stimulus-type interaction; i.e., emotional face and object stimuli, when matched for arousal and valence, generate comparable amygdala activity relative to neutral face and object stimuli. Additionally, a habituation effect was not seen in amygdala; however, increased amygdala activity was observed for incongruent relative to congruent negative trials in second vs. first exposures. Furthermore, medial fusiform gyrus showed increased response to inanimate stimuli, while superior temporal sulcus showed increased response to animate stimuli. Greater functional connectivity between bilateral amygdala and medial fusiform gyrus was observed to negative vs. neutral objects, but not to fearful vs. neutral faces. The current data suggest that the amygdala is responsive to animate and emotional stimuli. Additionally, these data suggest that the interaction between the various functions of the amygdala may need to be considered simultaneously to fully understand how they interact. Moreover, they suggest category-specific modulation of medial fusiform cortex as a function of emotion.

Estimating neural response functions from fMRI

This paper proposes a methodology for estimating Neural Response Functions (NRFs) from fMRI data. These NRFs describe non-linear relationships between experimental stimuli and neuronal population responses. The method is based on a two-stage model comprising an NRF and a Hemodynamic Response Function (HRF) that are simultaneously fitted to fMRI data using a Bayesian optimization algorithm. This algorithm also produces a model evidence score, providing a formal model comparison method for evaluating alternative NRFs. The HRF is characterized using previously established "Balloon" and BOLD signal models. We illustrate the method with two example applications based on fMRI studies of the auditory system. In the first, we estimate the time constants of repetition suppression and facilitation, and in the second we estimate the parameters of population receptive fields in a tonotopic mapping study.

Reduced habituation in patients with schizophrenia

BACKGROUND

Neural habituation, the decrease in brain response to repeated stimulation, is a basic form of learning. There is strong evidence for behavioral and physiological habituation deficits in schizophrenia, and one previous study found reduced neural habituation within the hippocampus. However, it is unknown whether neural habituation deficits are specific to faces and limited to the hippocampus. Here we studied habituation of several brain regions in schizophrenia, using both face and object stimuli. Post-scan memory measures were administered to test for a link between hippocampal habituation and memory performance.

METHODS

During an fMRI scan, 23 patients with schizophrenia and 21 control subjects viewed blocks of a repeated neutral face or neutral object, and blocks of different neutral faces and neutral objects. Habituation in the hippocampus, primary visual cortex and fusiform face area (FFA) was compared between groups. Memory for faces, words, and word pairs was assessed after the scan.

RESULTS

Patients showed reduced habituation to faces in the hippocampus and primary visual cortex, but not the FFA. Healthy control subjects exhibited a pattern of hippocampal discrimination that distinguished between repeated and different images for both faces and objects, and schizophrenia patients did not. Hippocampal discrimination was positively correlated with memory for word pairs.

CONCLUSION

Patients with schizophrenia showed reduced habituation of the hippocampus and visual cortex, and a lack of neural discrimination between old and new images in the hippocampus. Hippocampal discrimination correlated with memory performance, suggesting reduced habituation may contribute to the memory deficits commonly observed in schizophrenia.

Representation of frequency-modulated sounds in the human brain

Frequency-modulation is a ubiquitous sound feature present in communicative sounds of various animal species and humans. Functional imaging of the human auditory system has seen remarkable advances in the last two decades and studies pertaining to frequency-modulation have centered around two major questions: a) are there dedicated feature-detectors encoding frequency-modulation in the brain and b) is there concurrent representation with amplitude-modulation, another temporal sound feature? In this review, we first describe how these two questions are motivated by psychophysical studies and neurophysiology in animal models. We then review how human non-invasive neuroimaging studies have furthered our understanding of the representation of frequency-modulated sounds in the brain. Finally, we conclude with some suggestions on how human neuroimaging could be used in future studies to address currently still open questions on this fundamental sound feature. This article is part of a Special Issue entitled Human Auditory Neuroimaging.

Adaptation of cerebral oxygen metabolism and blood flow and modulation of neurovascular coupling with prolonged stimulation in human visual cortex

Prolonged visual stimulation results in neurophysiologic and hemodynamic adaptation. However, the hemodynamic adaptation appears to be small compared to neural adaptation. It is not clear how the cerebral metabolic rate of oxygen (CMRO2) is affected by adaptation. We measured cerebral blood flow (CBF) and CMRO2 change in responses to peripheral stimulation either continuously, or intermittently (on/off cycles). A linear system's response to the continuous input should be equal to the sum of the original response to the intermittent input and a version of that response shifted by half a cycle. The CMRO2 response showed a large non-linearity consistent with adaptation, the CBF response adapted to a lesser degree, and the blood oxygenation level dependent (BOLD) response was nearly linear. The metabolic response was coupled with a larger flow in the continuous condition than in the intermittent condition. Our results suggest that contrast adaptation improves energy economy of visual processing. However BOLD modulations may not accurately represent the underlying metabolic nonlinearity due to modulation of the coupling of blood flow and oxygen metabolism changes.

Potential of pretreatment neural activity in the visual cortex during emotional processing to predict treatment response to scopolamine in major depressive disorder

CONTEXT

The need for improved treatment options for patients with major depressive disorder (MDD) is critical. Faster-acting antidepressants and biomarkers that predict clinical response will facilitate treatment. Scopolamine produces rapid antidepressant effects and thus offers the opportunity to characterize potential biomarkers of treatment response within short periods.

OBJECTIVE

To determine if baseline brain activity when processing emotional information can predict treatment response to scopolamine in MDD.

DESIGN

A double-blind, placebo-controlled, crossover study together with repeated functional magnetic resonance imaging, acquired as participants performed face-identity and face-emotion working memory tasks.

SETTING

National Institute of Mental Health Division of Intramural Research Programs.

PARTICIPANTS

Fifteen currently depressed outpatients meeting DSM-IV criteria for recurrent MDD and 21 healthy participants, between 18 and 55 years of age.

MAIN OUTCOME MEASURE

The magnitude of treatment response to scopolamine (percentage of change in the Montgomery-Asberg Depression Rating Scale score between study end and baseline) was correlated with blood oxygen level-dependent (BOLD) signal associated with each working memory component (encode, maintenance, and test) for both identity and emotion tasks. Treatment response also was correlated with change in BOLD response (scopolamine vs baseline). Baseline activity was compared between healthy and MDD groups.

RESULTS

Baseline BOLD response in the bilateral middle occipital cortex, selectively during the stimulus-processing components of the emotion working memory task (no correlation during the identity task), correlated with treatment response magnitude. Change in BOLD response following scopolamine administration in overlapping areas in the middle occipital cortex while performing the same task conditions also correlated with clinical response. Healthy controls showed higher activity in the same visual regions than patients with MDD during baseline.

CONCLUSION

These results implicate cholinergic and visual processing dysfunction in the pathophysiology of MDD and suggest that neural response in the visual cortex, selectively to emotional stimuli, may provide a useful biomarker for identifying patients who will respond favorably to scopolamine.

TRIAL REGISTRATION

clinicaltrials.gov Identifier: NCT00055575.

Combined diffusion-weighted and functional magnetic resonance imaging reveals a temporal-occipital network involved in auditory-visual object processing

Functional magnetic resonance imaging (MRI) showed that the superior temporal and occipital cortex are involved in multisensory integration. Probabilistic fiber tracking based on diffusion-weighted MRI suggests that multisensory processing is supported by white matter connections between auditory cortex and the temporal and occipital lobe. Here, we present a combined functional MRI and probabilistic fiber tracking study that reveals multisensory processing mechanisms that remained undetected by either technique alone. Ten healthy participants passively observed visually presented lip or body movements, heard speech or body action sounds, or were exposed to a combination of both. Bimodal stimulation engaged a temporal-occipital brain network including the multisensory superior temporal sulcus (msSTS), the lateral superior temporal gyrus (lSTG), and the extrastriate body area (EBA). A region-of-interest (ROI) analysis showed multisensory interactions (e.g., subadditive responses to bimodal compared to unimodal stimuli) in the msSTS, the lSTG, and the EBA region. Moreover, sounds elicited responses in the medial occipital cortex. Probabilistic tracking revealed white matter tracts between the auditory cortex and the medial occipital cortex, the inferior occipital cortex (IOC), and the superior temporal sulcus (STS). However, STS terminations of auditory cortex tracts showed limited overlap with the msSTS region. Instead, msSTS was connected to primary sensory regions via intermediate nodes in the temporal and occipital cortex. Similarly, the lSTG and EBA regions showed limited direct white matter connections but instead were connected via intermediate nodes. Our results suggest that multisensory processing in the STS is mediated by separate brain areas that form a distinct network in the lateral temporal and inferior occipital cortex.

That's near my hand! Parietal and premotor coding of hand-centered space contributes to localization and self-attribution of the hand

The ability to identify and localize our own limbs is crucial for survival. Indeed, the majority of our interactions with objects occur within the space surrounding the hands. In non-human primates, neurons in the posterior parietal and premotor cortices dynamically represent the space near the upper limbs in hand-centered coordinates. Neuronal populations selective for the space near the hand also exist in humans. It is unclear whether these remap the peri-hand representation as the arm is moved in space. Furthermore, no combined neuronal and behavioral data are available about the possible involvement of peri-hand neurons in the perception of the upper limbs in any species. We used fMRI adaptation to demonstrate dynamic hand-centered encoding of space by reporting response suppression in human premotor and posterior parietal cortices to repeated presentations of an object near the hand for different arm postures. Furthermore, we show that such spatial representation is related to changes in body perception, being remapped onto a prosthetic hand if perceived as one's own during an illusion. Interestingly, our results further suggest that peri-hand space remapping in the premotor cortex is most tightly linked to the subjective feeling of ownership of the seen limb, whereas remapping in the posterior parietal cortex closely reflects changes in the position sense of the arm. These findings identify the neural bases for dynamic hand-centered encoding of peripersonal space in humans and provide hitherto missing evidence for the link between the peri-hand representation of space and the perceived self-attribution and position of the upper limb.

Objective assessment of chromatic and achromatic pattern adaptation reveals the temporal response properties of different visual pathways

The aim was to investigate the temporal response properties of magnocellular, parvocellular, and koniocellular visual pathways using increment/decrement changes in contrast to elicit visual evoked potentials (VEPs). Static achromatic and isoluminant chromatic gratings were generated on a monitor. Chromatic gratings were modulated along red/green (R/G) or subject-specific tritanopic confusion axes, established using a minimum distinct border criterion. Isoluminance was determined using minimum flicker photometry. Achromatic and chromatic VEPs were recorded to contrast increments and decrements of 0.1 or 0.2 superimposed on the static gratings (masking contrast 0–0.6). Achromatic increment/decrement changes in contrast evoked a percept of apparent motion when the spatial frequency was low; VEPs to such stimuli were positive in polarity and largely unaffected by high levels of static contrast, consistent with transient response mechanisms. VEPs to finer achromatic gratings showed marked attenuation as static contrast was increased. Chromatic VEPs to R/G or tritan chromatic contrast increments were of negative polarity and showed progressive attenuation as static contrast was increased, in keeping with increasing desensitization of the sustained responses of the color-opponent visual pathways. Chromatic contrast decrement VEPs were of positive polarity and less sensitive to pattern adaptation. The relative contribution of sustained/transient mechanisms to achromatic processing is spatial frequency dependent. Chromatic contrast increment VEPs reflect the sustained temporal response properties of parvocellular and koniocellular pathways. Cortical VEPs can provide an objective measure of pattern adaptation and can be used to probe the temporal response characteristics of different visual pathways.

Neural adaptation to thin and fat bodies in the fusiform body area and middle occipital gyrus: an fMRI adaptation study

Visual perception can be strongly biased due to exposure to specific stimuli in the environment, often causing neural adaptation and visual aftereffects. In this study, we investigated whether adaptation to certain body shapes biases the perception of the own body shape. Furthermore, we aimed to evoke neural adaptation to certain body shapes. Participants completed a behavioral experiment (n = 14) to rate manipulated pictures of their own bodies after adaptation to demonstratively thin or fat pictures of their own bodies. The same stimuli were used in a second experiment (n = 16) using functional magnetic resonance imaging (fMRI) adaptation. In the behavioral experiment, after adapting to a thin picture of the own body participants also judged a thinner than actual body picture to be the most realistic and vice versa, resembling a typical aftereffect. The fusiform body area (FBA) and the right middle occipital gyrus (rMOG) show neural adaptation to specific body shapes while the extrastriate body area (EBA) bilaterally does not. The rMOG cluster is highly selective for bodies and perhaps body parts. The findings of the behavioral experiment support the existence of a perceptual body shape aftereffect, resulting from a specific adaptation to thin and fat pictures of one's own body. The fMRI results imply that body shape adaptation occurs in the FBA and the rMOG. The role of the EBA in body shape processing remains unclear. The results are also discussed in the light of clinical body image disturbances.

Visual short-term memory: activity supporting encoding and maintenance in retinotopic visual cortex

Recent studies have demonstrated that retinotopic cortex maintains information about visual stimuli during retention intervals. However, the process by which transient stimulus-evoked sensory responses are transformed into enduring memory representations is unknown. Here, using fMRI and short-term visual memory tasks optimized for univariate and multivariate analysis approaches, we report differential involvement of human retinotopic areas during memory encoding of the low-level visual feature orientation. All visual areas show weaker responses when memory encoding processes are interrupted, possibly due to effects in orientation-sensitive primary visual cortex (V1) propagating across extrastriate areas. Furthermore, intermediate areas in both dorsal (V3a/b) and ventral (LO1/2) streams are significantly more active during memory encoding compared with non-memory (active and passive) processing of the same stimulus material. These effects in intermediate visual cortex are also observed during memory encoding of a different stimulus feature (spatial frequency), suggesting that these areas are involved in encoding processes on a higher level of representation. Using pattern-classification techniques to probe the representational content in visual cortex during delay periods, we further demonstrate that simply initiating memory encoding is not sufficient to produce long-lasting memory traces. Rather, active maintenance appears to underlie the observed memory-specific patterns of information in retinotopic cortex.

Relationship between neural response and adaptation selectivity to form and color: an ERP study

Adaptation is widely used as a tool for studying selectivity to visual features. In these studies it is usually assumed that the loci of feature selective neural responses and adaptation coincide. We used an adaptation paradigm to investigate the relationship between response and adaptation selectivity in event-related potentials (ERPs). ERPs were evoked by the presentation of colored Glass patterns in a form discrimination task. Response selectivities to form and, to some extent, color of the patterns were reflected in the C1 and N1 ERP components. Adaptation selectivity to color was reflected in N1 and was followed by a late (300–500 ms after stimulus onset) effect of form adaptation. Thus for form, response and adaptation selectivity were manifested in non-overlapping intervals. These results indicate that adaptation and response selectivity can be associated with different processes. Therefore, inferring selectivity from an adaptation paradigm requires analysis of both adaptation and neural response data.

Quantifying hemodynamic refractory bold effects in normal subjects at the single-subject level using an inverse logit fitting procedure

PURPOSE

To evaluate whether hemodynamic refractory effects provoked by repeated visual stimulation can be detected and quantified at the single-subject level using a recently described hemodynamic response function (HRF) fitting algorithm.

MATERIALS AND METHODS

Hemodynamic refractory effects were induced with an easily applicable functional MRI (fMRI) paradigm. A fitting method with inverse logit (IL) functions was applied to quantify net HRFs at the single-subject level with three interstimulus intervals (ISI; 1, 2, and 6 s). The model yielded amplitude, latencies, and width for each HRF.

RESULTS

HRF fitting was possible in 44 of 51 healthy volunteers, with excellent goodness-of-fit (R(2) = 0.9745 ± 0.0241). Refractory effects were most pronounced for the 1-s ISI (P < 0.001) and had nearly disappeared for the 6-s ISI.

CONCLUSION

Quantifying refractory effects in individuals was possible in 86.3% of normal subjects using the IL fitting algorithm. This setup may be suitable to explore such effects in individual patients.

Adaptation and visual coding

Visual coding is a highly dynamic process and continuously adapting to the current viewing context. The perceptual changes that result from adaptation to recently viewed stimuli remain a powerful and popular tool for analyzing sensory mechanisms and plasticity. Over the last decade, the footprints of this adaptation have been tracked to both higher and lower levels of the visual pathway and over a wider range of timescales, revealing that visual processing is much more adaptable than previously thought. This work has also revealed that the pattern of aftereffects is similar across many stimulus dimensions, pointing to common coding principles in which adaptation plays a central role. However, why visual coding adapts has yet to be fully answered.

Orientation-selective functional magnetic resonance imaging adaptation in primary visual cortex revisited

The processing of orientations is at the core of our visual experience. Orientation selectivity in human visual cortex has been inferred from psychophysical experiments and more recently demonstrated with functional magnetic resonance imaging (fMRI). One method to identify orientation-selective responses is fMRI adaptation, in which two stimuli-either with the same or with different orientations-are presented successively. A region containing orientation-selective neurons should demonstrate an adapted response to the "same orientation" condition in contrast to the "different orientation" condition. So far, human primary visual cortex (V1) showed orientation-selective fMRI adaptation only in experimental designs using prolonged pre-adaptation periods (∼40 s) in combination with top-up stimuli that are thought to maintain the adapted level. This finding has led to the notion that orientation-selective short-term adaptation in V1 (but not V2 or V3) cannot be demonstrated using fMRI. The present study aimed at re-evaluating this question by testing three differently timed adaptation designs. With the use of a more sensitive analysis technique, we show robust orientation-selective fMRI adaptation in V1 evoked by a short-term adaptation design.

The cognitive neuroscience toolkit for the neuroeconomist: A functional overview

This article provides the beginning neuroeconomist with an introductory overview to the different methods used in human neuroscience. It describes basic strengths and weaknesses of each technique, points to examples of how each technique has been used in neuroeconomic studies, and provides key tutorial references that contain more detailed information. In addition to this overview, the article presents a framework that organizes human neuroscience methods functionally, according to whether they provide tests of the association between brain activity and cognition or behavior, or whether they test the necessity or the sufficiency of brain activity for cognition and behavior. This framework demonstrates the utility of a multi-method research approach, since converging evidence from tests of association, necessity and sufficiency provides the strongest inference regarding brain-behavior relationships. Set against this goal of converging evidence, human neuroscience studies in neuroeconomics currently rely far too heavily on methods that test association, most notably functional MRI.

Representation of action in occipito-temporal cortex

A fundamental question for social cognitive neuroscience is how and where in the brain the identities and actions of others are represented. Here we present a replication and extension of a study by Kable and Chatterjee [Kable, J. W., & Chatterjee, A. Specificity of action representations in the lateral occipito-temporal cortex. Journal of Cognitive Neuroscience, 18, 1498-1517, 2006] examining the role of occipito-temporal cortex in these processes. We presented full-cue movies of actors performing whole-body actions and used fMRI to test for action- and identity-specific adaptation effects. We examined a series of functionally defined regions, including the extrastriate and fusiform body areas, the fusiform face area, the parahippocampal place area, the lateral occipital complex, the right posterior superior temporal sulcus, and motion-selective area hMT+. These regions were analyzed with both standard univariate measures as well as multivoxel pattern analyses. Additionally, we performed whole-brain tests for significant adaptation effects. We found significant action-specific adaptation in many areas, but no evidence for identity-specific adaptation. We argue that this finding could be explained by differences in the familiarity of the stimuli presented: The actions shown were familiar but the actors performing the actions were unfamiliar. However, in contrast to previous findings, we found that the action adaptation effect could not be conclusively tied to specific functionally defined regions. Instead, our results suggest that the adaptation to previously seen actions across identities is a widespread effect, evident across lateral and ventral occipito-temporal cortex.

Audiovisual functional magnetic resonance imaging adaptation reveals multisensory integration effects in object-related sensory cortices

Information integration across different sensory modalities contributes to object recognition, the generation of associations and long-term memory representations. Here, we used functional magnetic resonance imaging adaptation to investigate the presence of sensory integrative effects at cortical levels as early as nonprimary auditory and extrastriate visual cortices, which are implicated in intermediate stages of object processing. Stimulation consisted of an adapting audiovisual stimulus S(1) and a subsequent stimulus S(2) from the same basic-level category (e.g., cat). The stimuli were carefully balanced with respect to stimulus complexity and semantic congruency and presented in four experimental conditions: (1) the same image and vocalization for S(1) and S(2), (2) the same image and a different vocalization, (3) different images and the same vocalization, or (4) different images and vocalizations. This two-by-two factorial design allowed us to assess the contributions of auditory and visual stimulus repetitions and changes in a statistically orthogonal manner. Responses in visual regions of right fusiform gyrus and right lateral occipital cortex were reduced for repeated visual stimuli (repetition suppression). Surprisingly, left lateral occipital cortex showed stronger responses to repeated auditory stimuli (repetition enhancement). Similarly, auditory regions of interest of the right middle superior temporal gyrus and sulcus exhibited repetition suppression to auditory repetitions and repetition enhancement to visual repetitions. Our findings of crossmodal repetition-related effects in cortices of the respective other sensory modality add to the emerging view that in human subjects sensory integrative mechanisms operate on earlier cortical processing levels than previously assumed.

Interocular transfer of orientation-specific fMRI adaptation reveals amblyopia-related deficits in humans

We devised an experimental strategy for assessing the cortical cross-talk between ocular subsystems. For this purpose we measured the interocular transfer of adaptation (IOTA) at different levels in the human brain, using orientation-selective fMRI adaptation. We tested 10 normally sighted and 10 stereoblind or stereodeficient amblyopic observers by adapting monocularly to phase-reversing, oblique sinusoidal gratings. Following monocular adaptation, cortical activations evoked by the same (monoptic) or the other eye (interocular) were measured for the same and for the orthogonal orientation in a two by two factorial design. In both experimental groups, we obtained significant orientation-selective monocular adaptation in area V1 and in extrastriate regions on the dorsal and ventral visual pathways. In the normally-sighted subjects we found in addition interocular adaptation in V1 and extrastriate visual areas. This interocular adaptation indicates that fMRI adaptation transfers from the adapted ocular subsystem to the non-adapted ocular subsystem, and thus provides a measure of binocular interaction in normally-sighted subjects. In the amblyopic subjects, no interocular adaptation was seen at any of the investigated cortical levels, regardless of which eye was adapted. We suggest that the abnormal pattern of interocular transfer of fMRI adaptation is related to the disturbed integration of binocular signals in amblyopia.