Recovery of fMRI activation in motion area MT following storage of the motion aftereffect

Dissociating representations of affect and motion in visual cortices

While a delicious dessert being presented to us may elicit strong feelings of happiness and excitement, the same treat falling slowly away can lead to sadness and disappointment. Our emotional response to the item depends on its visual motion direction. Despite this importance, it remains unclear whether (and how) cortical areas devoted to decoding motion direction represents or integrates emotion with perceived motion direction. Motion-selective visual area V5/MT+ sits, both functionally and anatomically, at the nexus of dorsal and ventral visual streams. These pathways, however, differ in how they are modulated by emotional cues. The current study was designed to disentangle how emotion and motion perception interact, as well as use emotion-dependent modulation of visual cortices to understand the relation of V5/MT+ to canonical processing streams. During functional magnetic resonance imaging (fMRI), approaching, receding, or static motion after-effects (MAEs) were induced on stationary positive, negative, and neutral stimuli. An independent localizer scan was conducted to identify the visual-motion area V5/MT+. Through univariate and multivariate analyses, we demonstrated that emotion representations in V5/MT+ share a more similar response profile to that observed in ventral visual than dorsal, visual structures. Specifically, V5/MT+ and ventral structures were sensitive to the emotional content of visual stimuli, whereas dorsal visual structures were not. Overall, this work highlights the critical role of V5/MT+ in the representation and processing of visually acquired emotional content. It further suggests a role for this region in utilizing affectively salient visual information to augment motion perception of biologically relevant stimuli.

An Optical Illusion Pinpoints an Essential Circuit Node for Global Motion Processing

Direction-selective (DS) neurons compute the direction of motion in a visual scene. Brain-wide imaging in larval zebrafish has revealed hundreds of DS neurons scattered throughout the brain. However, the exact population that causally drives motion-dependent behaviors-e.g., compensatory eye and body movements-remains largely unknown. To identify the behaviorally relevant population of DS neurons, here we employ the motion aftereffect (MAE), which causes the well-known "waterfall illusion." Together with region-specific optogenetic manipulations and cellular-resolution functional imaging, we found that MAE-responsive neurons represent merely a fraction of the entire population of DS cells in larval zebrafish. They are spatially clustered in a nucleus in the ventral lateral pretectal area and are necessary and sufficient to steer the entire cycle of optokinetic eye movements. Thus, our illusion-based behavioral paradigm, combined with optical imaging and optogenetics, identified key circuit elements of global motion processing in the vertebrate brain.

Adaptation aftereffects influence the perception of specific emotions from walking gait

We investigated the existence and nature of adaptation aftereffects on the visual perception of basic emotions displayed through walking gait. Stimuli were previously validated gender-ambiguous point-light walker models displaying various basic emotions (happy, sad, anger and fear). Results indicated that both facilitative and inhibitive aftereffects influenced the perception of all displayed emotions. Facilitative aftereffects were found between theoretically opposite emotions (i.e. happy/sad and anger/fear). Evidence suggested that low-level and high-level visual processes contributed to both stimulus aftereffect and conceptual aftereffect mechanisms. Significant aftereffects were more frequently evident for the time required to identify the displayed emotion than for emotion identification rates. The perception of basic emotions from walking gait is influenced by a number of different perceptual mechanisms which shift the categorical boundaries of each emotion as a result of perceptual experience.

Rotating One's Head Modulates the Perceived Velocity of Motion Aftereffect

As a prominent illusion, the motion aftereffect (MAE) has traditionally been considered a visual phenomenon. Recent neuroimaging work has revealed increased activities in MT+ and decreased activities in vestibular regions during the MAE, supporting the notion of visual-vestibular interaction on the MAE. Since the head had to remain stationary in fMRI experiments, vestibular self-motion signals were absent in those studies. Accordingly, more direct evidence is still lacking in terms of whether and how vestibular signals modulate the MAE. By developing a virtual reality approach, the present study for the first time demonstrates that horizontal head rotation affects the perceived velocity of the MAE. We found that the MAE was predominantly perceived as moving faster when its direction was opposite to the direction of head rotation than when its direction was the same as head rotation. The magnitude of this effect was positively correlated with the velocity of head rotation. Similar result patterns were not observed for the real motion stimuli. Our findings support a 'cross-modal bias' hypothesis that after living in a multisensory environment long-term the brain develops a strong association between signals from the visual and vestibular pathways. Consequently, weak biasing visual signals in the associated direction can spontaneously emerge with the input of vestibular signals in the multisensory brain areas, substantially modulating the illusory visual motion represented in those areas as well. The hypothesis can also be used to explain other multisensory integration phenomena.

The direction after-effect is a global motion phenomenon

Prior experience influences visual perception. For example, extended viewing of a moving stimulus results in the misperception of a subsequent stimulus's motion direction-the direction after-effect (DAE). There has been an ongoing debate regarding the locus of the neural mechanisms underlying the DAE. We know the mechanisms are cortical, but there is uncertainty about where in the visual cortex they are located-at relatively early local motion processing stages, or at later global motion stages. We used a unikinetic plaid as an adapting stimulus, then measured the DAE experienced with a drifting random dot test stimulus. A unikinetic plaid comprises a static grating superimposed on a drifting grating of a different orientation. Observers cannot see the true motion direction of the moving component; instead they see pattern motion running parallel to the static component. The pattern motion of unikinetic plaids is encoded at the global processing level-specifically, in cortical areas MT and MST-and the local motion component is encoded earlier. We measured the direction after-effect as a function of the plaid's local and pattern motion directions. The DAE was induced by the plaid's pattern motion, but not by its component motion. This points to the neural mechanisms underlying the DAE being located at the global motion processing level, and no earlier than area MT.

Functional correlate and delineated connectivity pattern of human motion aftereffect responses substantiate a subjacent visual-vestibular interaction

The visual motion aftereffect (MAE) is the most prominent aftereffect in the visual system. Regarding its function, psychophysical studies suggest its function to be a form of sensory error correction, possibly also triggered by incongruent visual-vestibular stimulation. Several observational imaging experiments have deducted an essential role for region MT+ in the perception of a visual MAE but not provided conclusive evidence. Potential confounders with the MAE such as ocular motor performance, attention, and vection sensations have also never been controlled for. Aim of this neuroimaging study was to delineate the neural correlates of MAE and its subjacent functional connectivity pattern. A rotational MAE (n = 22) was induced using differing visual stimuli whilst modulating ocular motor parameters in a 3T scanner. Data was analyzed with SPM12. Eye movements as a response to the same stimuli were studied by means of high-resolution videooculography. Analysis for all stimuli gave bilateral activations along the dorsal visual stream with an emphasis on area MT. The onset of a visual MAE revealed an additional response in the right medial superior temporal area (MST) and a concurrent deactivation of vestibular hub region OP2. There was no correlation for the BOLD effects during the MAE with either ocular motor or attention parameters. The functional correlate of a visual MAE in humans may be represented in the interaction between region MT and area MST. This MAE representation is independent of a potential afternystagmus, attention and the presence of egomotion sensations. Connectivity analyses showed that in the event of conflicting visual-vestibular motion information (here MAE) area MST and area OP2 may act as the relevant mediating network hubs.

Evidence for distinct levels of neural adaptation to both coherent and incoherently moving visual surfaces in visual area hMT

Visual adaptation describes the processes by which the visual system alters its operating properties in response to changes in the environment. It is one of the mechanisms controlling visual perceptual bistability - when two perceptual solutions are available - by controlling the duration of each percept. Moving plaids are an example of such ambiguity. They can be perceived as two surfaces sliding incoherently over each other or as a single coherent surface. Here, we investigated, using fMRI, whether activity in the human motion complex (hMT+), a region tightly related to the perceptual integration of visual motion, is modulated by distinct forms of visual adaptation to coherent or incoherent perception of moving plaids. Our hypothesis is that exposure to global coherent or incoherent moving stimuli leads to different levels of measurable adaptation, reflected in hMT+ activity. We found that the strength of the measured visual adaptation effect depended on whether subjects integrated (coherent percept) or segregated (incoherent percept) surface motion signals. Visual motion adaptation was significant both for coherent motion and globally incoherent surface motion. Although not as strong as to the coherent percept, visual adaptation due to the incoherent percept also affects hMT+. This shows that adaptation can contribute to regulate percept duration during visual bistability, with distinct weights, depending on the type of percept. Our findings suggest a link between bistability and adaptation mechanisms, both due to coherent and incoherent motion percepts, but in an asymmetric manner. These asymmetric adaptation weights have strong implications in models of perceptual decision and may explain asymmetry of perceptual interpretation periods.

Opposite effects of high- and low-frequency transcranial random noise stimulation probed with visual motion adaptation

Transcranial random noise stimulation (tRNS) is a recent neuro-modulation technique whose effects at both behavioural and neural level are still debated. Here we employed the well-known phenomenon of motion after-effect (MAE) in order to investigate the effects of high- vs. low-frequency tRNS on motion adaptation and recovery. Participants were asked to estimate the MAE duration following prolonged adaptation (20 s) to a complex moving pattern, while being stimulated with either sham or tRNS across different blocks. Different groups were administered with either high- or low-frequency tRNS. Stimulation sites were either bilateral human MT complex (hMT⁺) or frontal areas. The results showed that, whereas no effects on MAE duration were induced by stimulating frontal areas, when applied to the bilateral hMT⁺, high-frequency tRNS caused a significant decrease in MAE duration whereas low-frequency tRNS caused a significant corresponding increase in MAE duration. These findings indicate that high- and low-frequency tRNS have opposed effects on the adaptation-dependent unbalance between neurons tuned to opposite motion directions, and thus on neuronal excitability.

Perception of the Mccollough Effect Correlates with Activity in Extrastriate Cortex: A Functional Magnetic Resonance Imaging Study

The McCollough effect is a striking color aftereffect that is linked to the orientation of the patterns used to induce it. To produce the McCollough effect, two differently oriented grating patterns, such as a red-and-black vertical grating and a green-and-black horizontal grating, are viewed alternately for a few minutes. After such colored gratings are viewed, the white sections of a vertical black-and-white test grating appear to be tinged with green, and the white sections of a horizontal grating appear to be tinged with pink. We present evidence from a functional magnetic resonance imaging study that the perception of the McCollough effect correlates with increased activation in the lingual and fusiform gyri—extrastriate visual areas that have been implicated in color perception in humans.

Haptically Guided Grasping. fMRI Shows Right-Hemisphere Parietal Stimulus Encoding, and Bilateral Dorso-Ventral Parietal Gradients of Object- and Action-Related Processing during Grasp Execution

The neural bases of haptically-guided grasp planning and execution are largely unknown, especially for stimuli having no visual representations. Therefore, we used functional magnetic resonance imaging (fMRI) to monitor brain activity during haptic exploration of novel 3D complex objects, subsequent grasp planning, and the execution of the pre-planned grasps. Haptic object exploration, involving extraction of shape, orientation, and length of the to-be-grasped targets, was associated with the fronto-parietal, temporo-occipital, and insular cortex activity. Yet, only the anterior divisions of the posterior parietal cortex (PPC) of the right hemisphere were significantly more engaged in exploration of complex objects (vs. simple control disks). None of these regions were re-recruited during the planning phase. Even more surprisingly, the left-hemisphere intraparietal, temporal, and occipital areas that were significantly invoked for grasp planning did not show sensitivity to object features. Finally, grasp execution, involving the re-recruitment of the critical right-hemisphere PPC clusters, was also significantly associated with two kinds of bilateral parieto-frontal processes. The first represents transformations of grasp-relevant target features and is linked to the dorso-dorsal (lateral and medial) parieto-frontal networks. The second monitors grasp kinematics and belongs to the ventro-dorsal networks. Indeed, signal modulations associated with these distinct functions follow dorso-ventral gradients, with left aIPS showing significant sensitivity to both target features and the characteristics of the required grasp. Thus, our results from the haptic domain are consistent with the notion that the parietal processing for action guidance reflects primarily transformations from object-related to effector-related coding, and these mechanisms are rather independent of sensory input modality.

Visual motion transforms visual space representations similarly throughout the human visual hierarchy

Several studies demonstrate that visual stimulus motion affects neural receptive fields and fMRI response amplitudes. Here we unite results of these two approaches and extend them by examining the effects of visual motion on neural position preferences throughout the hierarchy of human visual field maps. We measured population receptive field (pRF) properties using high-field fMRI (7T), characterizing position preferences simultaneously over large regions of the visual cortex. We measured pRFs properties using sine wave gratings in stationary apertures, moving at various speeds in either the direction of pRF measurement or the orthogonal direction. We find direction- and speed-dependent changes in pRF preferred position and size in all visual field maps examined, including V1, V3A, and the MT+ map TO1. These effects on pRF properties increase up the hierarchy of visual field maps. However, both within and between visual field maps the extent of pRF changes was approximately proportional to pRF size. This suggests that visual motion transforms the representation of visual space similarly throughout the visual hierarchy. Visual motion can also produce an illusory displacement of perceived stimulus position. We demonstrate perceptual displacements using the same stimulus configuration. In contrast to effects on pRF properties, perceptual displacements show only weak effects of motion speed, with far larger speed-independent effects. We describe a model where low-level mechanisms could underlie the observed effects on neural position preferences. We conclude that visual motion induces similar transformations of visuo-spatial representations throughout the visual hierarchy, which may arise through low-level mechanisms.

Visual motion processing and visual sensorimotor control in autism

Impairments in visual motion perception and use of visual motion information to guide behavior have been reported in autism, but the brain alterations underlying these abnormalities are not well characterized. We performed functional magnetic resonance imaging (fMRI) studies to investigate neural correlates of impairments related to visual motion processing. Sixteen high-functioning individuals with autism and 14 age and IQ-matched typically developing individuals completed two fMRI tasks using passive viewing to examine bottom-up responses to visual motion and visual pursuit tracking to assess top-down modulation of visual motion processing during sensorimotor control. The autism group showed greater activation and faster hemodynamic decay in V5 during the passive viewing task and reduced frontal and V5 activation during visual pursuit. The observations of increased V5 activation and its faster decay during passive viewing suggest alterations in local V5 circuitries that may be associated with reduced GABAergic tone and inhibitory modulation. Reduced frontal and V5 activation during active pursuit suggest reduced top-down modulation of sensory processing. These results suggest that both local intrinsic abnormalities in V5 and more widely distributed network level abnormalities are associated with visual motion processing in autism.

Decoding the motion aftereffect in human visual cortex

In the motion aftereffect (MAE), adapting to a moving stimulus causes a subsequently presented stationary stimulus to appear to move in the opposite direction. Recently, the neural basis of the motion aftereffect has received considerable interest, and a number of brain areas have been implicated in the generation of the illusory motion. Here, we use functional magnetic resonance imaging in combination with multivariate pattern classification to directly compare the neural activity evoked during the observation of both real and illusory motions. We show that the perceived illusory motion is not encoded in the same way as real motion in the same direction. Instead, suppression of the adapted direction of motion results in a shift of the population response of motion sensitive neurons in area MT+, resulting in activation patterns that are in fact more similar to real motion in orthogonal, rather than opposite directions. Although robust motion selectivity was observed in visual areas V1, V2, V3, and V4, this MAE-specific modulation of the population response was only observed in area MT+. Implications for our understanding of the motion aftereffect, and models of motion perception in general, are discussed.

The morphology and variability of the caudal rami of the superior temporal sulcus

The caudal branches of the superior temporal sulcus (cSTS) have been difficult to characterize because of the considerable degree of morphological variability across individuals. Leading atlases of the human brain are inconsistent with each other in terms of the number of branches identified and the nomenclature used to refer to them. Examination of the magnetic resonance images (MRIs) of 45 human brains (90 hemispheres) demonstrates three branches of the cSTS that ascend into the inferior parietal lobule: an anterior branch (cSTS1), a central branch (cSTS2) and a posterior branch (cSTS3). The cSTS1 is found immediately posterior to the ascending limb of the Sylvian fissure, followed by the cSTS2, and then the last branch, cSTS3, at the parieto-occipital junction. The temporal part of the STS joins most frequently with the cSTS2 (approximately 60% of cases), the cSTS1 (approximately 30% of cases) and least frequently with the cSTS3 (approximately 10% of cases). At the temporo-occipital junction, there is another sulcus that is related to the STS, the ventral anterior occipital sulcus (AOCS-v), a sulcus that has been functionally linked to area MT/v5 in the human brain. While the STS may appear to join AOCS-v from the surface of the brain, it can be established from examination of the depth of the sulci that they are not continuous. The variability in location of each one of the cSTS branches is expressed quantitatively in the MNI standard proportional stereotaxic space.

Hierarchy of direction-tuned motion adaptation in human visual cortex

Prolonged exposure to a single direction of motion alters perception of subsequent static or dynamic stimuli and induces substantial changes in behaviors of motion-sensitive neurons, but the origin of neural adaptation and neural correlates of perceptual consequences of motion adaptation in human brain remain unclear. Using functional magnetic resonance imaging, we measured motion adaptation tuning curves in a fine scale by probing changes in cortical activity after adaptation for a range of directions relative to the adapted direction. We found a clear dichotomy in tuning curve shape: cortical responses in early-tier visual areas reduced at around both the adapted and opposite direction, resulting in a bidirectional tuning curve, whereas response reduction in high-tier areas occurred only at around the adapted direction, resulting in a unidirectional tuning curve. We also found that the psychophysically measured adaptation tuning curves were unidirectional and best matched the cortical adaptation tuning curves in the middle temporal area (MT) and the medial superior temporal area (MST). Our findings are compatible with, but not limited to, an interpretation in which direct impacts of motion adaptation occur in both unidirectional and bidirectional units in early visual areas, but the perceptual consequences of motion adaptation are manifested in the population activity in MT and MST, which may inherit those direct impacts of adaptation from the directionally selective units.

The postcentral gyrus shows sustained fMRI activation during the tactile motion aftereffect

The tactile motion aftereffect (tMAE) is a perceptual illusion in which a stationary stimulus feels as though it is moving when presented following adaptation to a unidirectionally moving tactile stimulus. Using functional magnetic resonance imaging (fMRI), we localized the brain areas responsive to tactile motion and then investigated whether these areas underlie the tMAE. Tactile stimulation was delivered to the glabrous surface of the right hand by means of a plastic cylinder with a square-wave patterned surface. In the tactile motion localizer, we contrasted periods in which the cylinder rotated at 15 rpm with periods of rest (stationary contact). Activation was observed in the contralateral (left) thalamus, postcentral gyrus, and parietal operculum. In the tMAE experiment, the cylinder rotated at 15 or 60 rpm for 2 min. The 60-rpm speed induced reliable tMAEs, whereas the 15-rpm speed did not. Of the areas activated by the tactile motion localizer, only the postcentral gyrus showed a sustained fMRI response following the offset of 60-rpm (but not 15-rpm) stimulation, presumably reflecting the illusory perception of motion.

The neural basis of centre-surround interactions in visual motion processing

Perception of a moving visual stimulus can be suppressed or enhanced by surrounding context in adjacent parts of the visual field. We studied the neural processes underlying such contextual modulation with fMRI. We selected motion selective regions of interest (ROI) in the occipital and parietal lobes with sufficiently well defined topography to preclude direct activation by the surround. BOLD signal in the ROIs was suppressed when surround motion direction matched central stimulus direction, and increased when it was opposite. With the exception of hMT+/V5, inserting a gap between the stimulus and the surround abolished surround modulation. This dissociation between hMT+/V5 and other motion selective regions prompted us to ask whether motion perception is closely linked to processing in hMT+/V5, or reflects the net activity across all motion selective cortex. The motion aftereffect (MAE) provided a measure of motion perception, and the same stimulus configurations that were used in the fMRI experiments served as adapters. Using a linear model, we found that the MAE was predicted more accurately by the BOLD signal in hMT+/V5 than it was by the BOLD signal in other motion selective regions. However, a substantial improvement in prediction accuracy could be achieved by using the net activity across all motion selective cortex as a predictor, suggesting the overall conclusion that visual motion perception depends upon the integration of activity across different areas of visual cortex.

Similar adaptation effects on motion pattern detection and position discrimination tasks: unusual properties of global and local level motion adaptation

Here we examine adaptation effects on pattern detection and position discrimination tasks in radial and rotational motion patterns, induced by adapting stimuli moving in the same or opposite directions to the test stimuli. Adaptation effects on the two tasks were similar, suggesting these tasks are performed by the same population of neurons. Global motion specific adaptation was then induced by presenting adaptation stimuli and test stimuli in different parts of the visual field. Again, adaptation effects on the two tasks were similar, but neither same-direction nor opposite-direction motion produced any adaptation effect on contracting motion patterns. Finally, adaptation stimuli were compared that should have similar effects on local motion processing neurons, but different effects on global motion processing neurons. Again, adaptation effects on the two tasks were similar. However, when global-level adaptation was avoided, no adaptation effects were seen with adaptation patterns moving in the opposite direction to the test pattern. Together, these last two experiments suggest that adaptation to opposite directions of motion from the test motion affects global motion processing but not local motion processing neurons.

Type of featural attention differentially modulates hMT+ responses to illusory motion aftereffects

Activity in the human motion complex (hMT(+)/V5) is related to the perception of motion, be it either real surface motion or an illusion of motion such as apparent motion (AM) or motion aftereffect (MAE). It is a long-lasting debate whether illusory motion-related activations in hMT(+) represent the motion itself or attention to it. We have asked whether hMT(+) responses to MAEs are present when shifts in arousal are suppressed and attention is focused on concurrent motion versus nonmotion features. Significant enhancement of hMT(+) activity was observed during MAEs when attention was focused either on concurrent spatial angle or color features. This observation was confirmed by direct comparison of adapting (MAE inducing) versus nonadapting conditions. In contrast, this effect was diminished when subjects had to report on concomitant speed changes of superimposed AM. The same finding was observed for concomitant orthogonal real motion (RM), suggesting that selective attention to concurrent illusory or real motion was interfering with the saliency of MAE signals in hMT(+). We conclude that MAE-related changes in the global activity of hMT(+) are present provided selective attention is not focused on an interfering feature such as concurrent motion. Accordingly, there is a genuine MAE-related motion signal in hMT(+) that is neither explained by shifts in arousal nor by selective attention.

Seeing the invisible: the scope and limits of unconscious processing in binocular rivalry

When an image is presented to one eye and a very different image is presented to the corresponding location of the other eye, the two images compete for conscious representations, such that only one image is visible at a time while the other is suppressed. Called binocular rivalry, this phenomenon and its deviants have been extensively exploited to study the mechanism and neural correlates of consciousness. In this paper, we propose a framework - the unconscious binding hypothesis - to distinguish unconscious processing from conscious processing. According to this framework, the unconscious mind not only encodes individual features but also temporally binds distributed features to give rise to cortical representations; unlike conscious binding, however, unconscious binding is fragile. Under this framework, we review evidence from psychophysical and neuroimaging studies and come to two important conclusions. First, processing of invisible features depends on the "level" of the features as defined by their neural mechanisms. For low-level simple features, prolonged exposure to visual patterns (e.g. tilt) and simple translational motion can alter the appearance of subsequent visible features (i.e. adaptation). For invisible high-level features, complex spiral motion cannot produce adaptation, nor can objects/words enhance subsequent processing of related stimuli (i.e. priming). Yet images of tools can activate the dorsal pathway. Second, processing of invisible features has functional significance. Although invisible central cues cannot orient attention, invisible erotic pictures in the periphery can nevertheless guide attention, likely through emotional arousal; reciprocally, the processing of invisible information can be modulated by attention.

Adaptive estimation of three-dimensional structure in the human brain

Perceiving the three-dimensional (3D) properties of the environment relies on the brain bringing together ambiguous cues (e.g., binocular disparity, shading, texture) with information gained from short- and long-term experience. Perceptual aftereffects, in which the perception of an ambiguous 3D stimulus is biased away from the shape of a previously viewed stimulus, provide a sensitive means of probing this process, yet little is known about their neural basis. Here, we investigate 3D aftereffects using psychophysical and functional MRI (fMRI) adaptation paradigms to gain insight into the cortical circuits that mediate the perceptual interpretation of ambiguous depth signals. Using two classic bistable stimuli (Mach card, kinetic depth effect), we test aftereffects produced by 3D shapes defined by binocular (disparity) or monocular (texture, shading) depth cues. We show that the processing of ambiguous 3D stimuli in dorsal visual cortical areas (V3B/KO, V7) and posterior parietal regions is modulated by adaptation in line with perceptual aftereffects. Similar behavioral and fMRI adaptation effects for the two types of bistable stimuli suggest common neural substrates for depth aftereffects independent of the inducing depth cues (disparity, texture, shading). In line with current thinking about the role of adaptation in sensory optimization, our findings provide evidence that estimation of 3D shape in dorsal cortical areas takes account of the adaptive context to resolve depth ambiguity and interpret 3D structure.

The N2pc as an Electrophysiological Correlate of Attention in Change Blindness

Changes between two successively presented pictures are hard to detect when their presentation is interrupted by a blank (change blindness). This task is well established for investigating the neural correlates of visual awareness. It allows the comparison of electrophysiological activity evoked by physically identical trials in which the change was detected versus trials in which the change remained unnoticed. One possible correlate of aware processing is the N2pc component, an increased negative activity, contralateral to a processed stimulus between 200–300 ms after stimulus onset. However, this component has been also assigned to the allocation of attention. In two experiments, an N2pc was observed for detected changes. This component was markedly reduced for undetected changes and even more if participants reported a change that was not present (imagined change). These results suggest that the N2pc rather reflects attentional processing of stimuli in visual cortical areas than the actual aware representation.

The motion aftereffect reloaded

The motion aftereffect is a robust illusion of visual motion resulting from exposure to a moving pattern. There is a widely accepted explanation of it in terms of changes in the response of cortical direction-selective neurons. Research has distinguished several variants of the effect. Converging recent evidence from different experimental techniques (psychophysics, single-unit recording, brain imaging, transcranial magnetic stimulation, visual evoked potentials and magnetoencephalography) reveals that adaptation is not confined to one or even two cortical areas, but occurs at multiple levels of processing involved in visual motion analysis. A tentative motion-processing framework is described, based on motion aftereffect research. Recent ideas on the function of adaptation see it as a form of gain control that maximises the efficiency of information transmission at multiple levels of the visual pathway.

Motion processing, directional selectivity, and conscious visual perception in the human brain

Several human and monkey studies have demonstrated a close relationship between motion perception and activation of area V5, leading to the general view that activity in this area correlates with the subjective experience of motion. In the present study, we investigate whether the responses of this area are still governed by the motion percept when the latter is in conflict with the reality of the physical visual stimulation. We simultaneously presented two different, specially designed random-dot kinematograms, one to each eye. These stimuli either both had a single direction of motion and worked in synergy, or had opposite motion directions and thus cancelled each other out perceptually. In this way, we were able to pit the visual stimulus (one vs. two stimulating directions) against the reported perception (directional motion vs. motion noise) of human volunteers during fMRI experiments. We found that a strong motion stimulus that is weakly perceived is more effective in activating V5 (as well as V3) than a weaker motion stimulus, which is nevertheless robustly perceived. Thus, contrary to the prevailing view of perception being the correlate of activity in higher visual areas, we show here that activity is instead dominated by the properties of the physical stimulus, raising the question of whether there is a subpopulation of cells in V5 whose activity is critical for generating the motion percept. In addition, our results provide the first robust evidence for the presence of directionally selective neuronal populations in human prestriate cortex.

fMRI and its interpretations: an illustration on directional selectivity in area V5/MT

fMRI is a tool to study brain function noninvasively that can reliably identify sites of neural involvement for a given task. However, to what extent can fMRI signals be related to measures obtained in electrophysiology? Can the blood-oxygen-level-dependent signal be interpreted as spatially pooled spiking activity? Here we combine knowledge from neurovascular coupling, functional imaging and neurophysiology to discuss whether fMRI has succeeded in demonstrating one of the most established functional properties in the visual brain, namely directional selectivity in the motion-processing region V5/MT+. We also discuss differences of fMRI and electrophysiology in their sensitivity to distinct physiological processes. We conclude that fMRI constitutes a complement, not a poor-resolution substitute, to invasive techniques, and that it deserves interpretations that acknowledge its stand as a separate signal.

Gamma oscillations underlying the visual motion aftereffect

After having been exposed to strong visual motion in one direction, a subsequently presented stationary visual scene seems to move in the opposite direction. This motion aftereffect (MAE) is usually ascribed to short-term functional changes in cortical areas involved in visual motion analysis akin to adaptation. Using magnetoencephalography (MEG), we show increased global field activity due to the MAE which could mostly be explained by a dipole located near the putative location of human area MT+. We further demonstrate that the induced MAE is accompanied by a significant increase in gamma-band activity (GBA) recorded from parietooccipital cortex contralateral to the visual motion stimulus. This gamma oscillation most likely reflects an increase in neuronal response coherence due to decreased inhibition of a group of neurons with similar preferred direction, namely the direction opposite to the adapted one. A second focal GBA response was picked up by the most posterior sensors ipsilateral to the side of the stimulus, reflecting the size of the MAE, whose source could not be reliably located.

Simultaneous adaptation of retinal and extra-retinal motion signals

A number of models of motion perception include estimates of eye velocity to help compensate for the incidental retinal motion produced by smooth pursuit. The 'classical' model uses extra-retinal motor command signals to obtain the estimate. More recent 'reference-signal' models use retinal motion information to enhance the extra-retinal signal. The consequence of simultaneously adapting to pursuit and retinal motion is thought to favour the reference-signal model, largely because the perception of motion during pursuit ('perceived stability') changes despite the absence of a standard motion aftereffect. The current experiments investigated whether the classical model could also account for these findings. Experiment 1 replicated the changes to perceived stability and then showed how simultaneous motion adaptation changes perceived retinal speed (a velocity aftereffect). Contrary to claims made by proponents of the reference-signal model, adapting simultaneously to pursuit and retinal motion therefore alters the retinal motion inputs to the stability computation. Experiment 2 tested the idea that simultaneous motion adaptation sets up a competitive interaction between two types of velocity aftereffect, one retinal and one extra-retinal. The results showed that pursuit adaptation by itself drove perceived stability in one direction and that adding adapting retinal motion drove perceived stability in the other. Moreover, perceived stability changed in conditions that contained no mismatch between adapting pursuit and adapting retinal motion, contrary to the reference-signal account. Experiment 3 investigated whether the effects of simultaneous motion adaptation were directionally tuned. Surprisingly no tuning was found, but this was true for both perceived stability and retinal velocity aftereffect. The three experiments suggest that simultaneous motion adaptation alters perceived stability based on separable changes to retinal and extra-retinal inputs. Possible mechanisms underlying the extra-retinal velocity aftereffect are discussed.

Face adaptation aftereffects reveal anterior medial temporal cortex role in high level category representation

Previous studies have shown reductions of the functional magnetic resonance imaging (fMRI) signal in response to repetition of specific visual stimuli. We examined how adaptation affects the neural responses associated with categorization behavior, using face adaptation aftereffects. Adaptation to a given facial category biases categorization towards non-adapted facial categories in response to presentation of ambiguous morphs. We explored a hypothesis, posed by recent psychophysical studies, that these adaptation-induced categorizations are mediated by activity in relatively advanced stages within the occipitotemporal visual processing stream. Replicating these studies, we find that adaptation to a facial expression heightens perception of non-adapted expressions. Using comparable behavioral methods, we also show that adaptation to a specific identity heightens perception of a second identity in morph faces. We show both expression and identity effects to be associated with heightened anterior medial temporal lobe activity, specifically when perceiving the non-adapted category. These regions, incorporating bilateral anterior ventral rhinal cortices, perirhinal cortex and left anterior hippocampus are regions previously implicated in high-level visual perception. These categorization effects were not evident in fusiform or occipital gyri, although activity in these regions was reduced to repeated faces. The findings suggest that adaptation-induced perception is mediated by activity in regions downstream to those showing reductions due to stimulus repetition.

Visually guided reaching depends on motion area MT+

Visual information is crucial for goal-directed reaching. A number of studies have recently shown that motion in particular is an important source of information for the visuomotor system. For example, when reaching a stationary object, movement of the background can influence the trajectory of the hand, even when the background motion is irrelevant to the object and task. This manual following response may be a compensatory response to changes in body position, but the underlying mechanism remains unclear. Here we tested whether visual motion area MT+ is necessary to generate the manual following response. We found that stimulation of MT+ with transcranial magnetic stimulation significantly reduced a strong manual following response. MT+ is therefore necessary for generating the manual following response, indicating that it plays a crucial role in guiding goal-directed reaching movements by taking into account background motion in scenes.

Extra-Retinal Vision: Firing at Will

Recent evidence suggests that a key visual motion centre in the brain ignores extra-retinal motor information concerning reflexive eye movement. Instead it seems that neurons sensitive to oculomotor actions in this area fire at will.

Storage of an oculomotor motion aftereffect

Adaptation to motion produces a motion aftereffect (MAE), where illusory, oppositely-directed motion is perceived when viewing a stationary image. A common hypothesis for motion adaptation is that it reflects an imbalance of activity caused by neuronal fatigue. However, the perceptual MAE exhibits storage, in that the MAE appears even after a prolonged period of darkness is interposed between the adapting stimulus and the test, suggesting that fatigue cannot explain the perceptual MAE. We asked whether neural fatigue was a viable explanation for the oculomotor MAE (OMAE) by testing if the OMAE exhibits storage. Human observers were adapted with moving, random-dot cinematograms. Following adaptation, they generated an oculomotor MAE (OMAE), with both pursuit and saccadic components. The OMAE occurred in the presence of a visual test stimulus, but not in the dark. When the test stimulus was introduced after the dark period, the OMAE reappeared, analogous to perceptual MAE storage. The results suggest that fatigue cannot explain the OMAE, and that visual stimulation is necessary to elicit it. We propose a model in which adaptation recalibrates the motion-processing network by adjusting the weights of the inputs to neurons in the middle-temporal (MT) area.

Decreased cortical activation in response to a motion stimulus in anisometropic amblyopic eyes using functional magnetic resonance imaging

PURPOSE

Motion perception abnormalities and extrastriate abnormalities have been suggested in amblyopia. Functional MRI (fMRI) and motion stimuli were used to study whether interocular differences in activation are detectable in motion-sensitive cortical areas in patients with anisometropic amblyopia.

METHODS

We performed fMRI at 1.5 T 4 control subjects (20/20 OU), 1 with monocular suppression (20/25), and 2 with anisometropic amblyopia (20/60, 20/800). Monocular suppression was thought to be form fruste of amblyopia. The experimental stimulus consisted of expanding and contracting concentric rings, whereas the control condition consisted of stationary concentric rings. Activation was determined by contrasting the 2 conditions for each eye.

RESULTS

Significant fMRI activation and comparable right and left eye activation was found in V3a and V5 in all control subjects (Average z-values in L vs R contrast 0.42, 0.43) and in the subject with monocular suppression (z = 0.19). The anisometropes exhibited decreased extrastriate activation in their amblyopic eyes compared with the fellow eyes (zs = 2.12, 2.76).

CONCLUSIONS

Our data suggest motion-sensitive cortical structures may be less active when anisometropic amblyopic eyes are stimulated with moving rings. These results support the hypothesis that extrastriate cortex is affected in anisometropic amblyopia. Although suggestive of a magnocellular defect, the exact mechanism is unclear.

Extra-retinal adaptation of cortical motion-processing areas during pursuit eye movements

Repetitive eye movement produces a compelling motion aftereffect (MAE). One mechanism thought to contribute to the illusory movement is an extra-retinal motion signal generated after adaptation. However, extra-retinal signals are also generated during pursuit. They modulate activity within cortical motion-processing area MST, helping transform retinal motion into motion in the world during an eye movement. Given the evidence that MST plays a key role in generating MAE, it may also become indirectly adapted by prolonged pursuit. To differentiate between these two extra-retinal mechanisms we examined storage of the MAE across a period of darkness. In one condition observers were told to stare at a moving pattern, an instruction that induces a more reflexive type of eye movement. In another they were told to deliberately pursue it. We found equally long MAEs when testing immediately after adaptation but not when the test was delayed by 40 s. In the case of the reflexive eye movement the delay almost completely extinguished the MAE, whereas the illusory motion following pursuit remained intact. This suggests pursuit adapts cortical motion-processing areas whereas unintentional eye movement does not. A second experiment showed that cortical mechanisms cannot be the sole determinant of pursuit-induced MAE. Following oblique pursuit, we found MAE direction changes from oblique to vertical. Perceived MAE direction appears to be influenced by a subcortical mechanism as well, one based on the relative recovery rate of horizontal and vertical eye-movement processes recruited during oblique pursuit.

Simultaneous recordings of visual evoked potentials and BOLD MRI activations in response to visual motion processing

Visual motion processing in humans was studied by simultaneous 32-channel electroencephalography (EEG) recordings of visual evoked potentials and BOLD MRI activations at 2.9 T. The paradigms compared three different random dot patterns (12 s duration) with stationary random dots (18 s) or with each other. The stimuli represented pattern reversal (500 ms switches between two stationary patterns), motion onset (200 ms of starfield motion followed by 1000 ms of stationary dots) and motion reversal (reversal of moving starfield directions every 1000 ms). Whereas motion-evoked visual potentials, and in particular the N2 component in occipito-temporal channels, were most prominent for motion onset, the most extended BOLD MRI activations and strongest signal changes in V5/MT+ were obtained in response to motion reversal. These apparently contradictory findings most likely reflect different physiological aspects of the neural activity associated with visual motion processing. For example, desynchronized activity of subpopulations of cortical neurons inside V5/MT+ is expected to attenuate visual evoked potentials in scalp recordings while continuously driving metabolic demands that lead to sustained BOLD MRI responses. The understanding of the physiological correlates and neural processes underlying either technique is fundamental to exploring fully the potential of combined EEG-MRI for studying human brain function at both high temporal and spatial resolution.

MT+/V5 Activation without Conscious Motion Perception: A High-Field fMRI Study

While activity of MT+/V5 neurons is believed to be necessary for the conscious perception of visual motion, whether neural activity in MT+/V5 is a sufficient condition for the conscious perception of motion in vision still remains unanswered. A high-field (3.0 Tesla) functional magnetic resonance imaging (fMRI) study was designed and performed to answer this specific question. Eleven healthy subjects viewed a checkerboard pattern stimulus reversed in contrast at 0.2, 12, 30, and 60 Hz while being probed for activation in MT+/V5. At 0.2 Hz, all viewers perceived pattern-reversal which was stationary in position. However, at 12, 30, and 60 Hz, many subjects perceived apparent motion (e.g., vertical and horizontal flows) in the square pattern. At 12 and 30 Hz reversals, MT+/V5 was activated in all subjects (11/11). Nevertheless, three out of eleven (3/11) subjects denied motion perception in these conditions. At 60 Hz reversal, as many as seven out of eleven (7/11) subjects failed to see motion but activation in MT+/V5 was found in the majority (5/7) of the subjects. The results demonstrated that significant MT+/V5 activation occurs without accompanying subjective awareness of seeing motion in an apparent-motion stimulus, indicating that neural activity in MT+/V5 does not represent a sufficient condition for conscious perception of motion in vision.

Attention to 3-D shape, 3-D motion, and texture in 3-D structure from motion displays

We used fMRI to directly compare the neural substrates of three-dimensional (3-D) shape and motion processing for realistic textured objects rotating in depth. Subjects made judgments about several different attributes of these objects, including 3-D shape, the 3-D motion, and the scale of surface texture. For all of these tasks, we equated visual input, motor output, and task difficulty, and we controlled for differences in spatial attention. Judgments about 3-D shape from motion involve both parietal and occipito-temporal regions. The processing of 3-D shape is associated with the analysis of 3-D motion in parietal regions and the analysis of surface texture in occipito-temporal regions, which is consistent with the different behavioral roles that are typically attributed to the dorsal and ventral processing streams.

Static motion aftereffect does not modulate positional representations in early visual areas

A stationary stimulus is perceived to drift in the opposite direction after adaptation to a moving stimulus (static motion aftereffect (MAE)). It is commonly assumed that positional effects from the static motion aftereffect are mediated by early visual areas. Here we psychophysically showed that these positional effects did not modulate illusory line-tilt aftereffect (TAE). Since illusory contours seem to be represented at relatively early stages of visual hierarchy, we suggest that the neural substrates underlying the perception of static motion aftereffect and illusory contours are different.

The Role of Spared Calcarine Cortex and Lateral Occipital Cortex in the Responses of Human Hemianopes to Visual Motion

Some patients, who are rendered perimetrically blind in one hemifield by cortical lesions, nevertheless exhibit residual visual capacities within their field defects. The neural mechanism that mediates the residual visual responses has remained the topic of considerable debate. One explanation posits the subcortical visual pathways that bypass the primary visual cortex and innervate the extrastriate visual areas as the substrate that underlies the residual vision. The other explanation is that small islands of the primary visual cortex remain intact and provide the signals for residual vision. We have performed behavioral and functional magnetic resonance imaging experiments to investigate the validity of the two explanations of residual vision. Our behavioral experiments indicated that of the seven hemianopes tested, two had the ability to discriminate the direction of a drifting grating. This residual visual response was shown with fMRI to be the result of spared islands of calcarine cortical activity in one of the hemianopes, whereas only lateral occipital activity was documented in the other patient. These results indicate that the underlying neural correlates of residual vision can vary between patients. Moreover, our study emphasizes the necessity of ruling out the presence of islands of preserved function and primary visual cortex before assigning residual visual capacities to the properties of visual pathways that bypass the primary visual cortex.

Temporal dependence of local motion induced shifts in perceived position

It has been shown that a moving visual pattern can influence the perceived position of outlying, briefly flashed objects. Using a rotating bar as an inducing stimulus we observed a shift, in the direction of motion, of the perceived position of small bars flashed together on either side of the moving bar. The greatest shift occurred when the 13 ms flashes were presented 60 ms before the rotating bar came closest to their locations. By varying rotation speed we showed that the peak effect was determined by the temporal rather than the spatial interval. The motion induced shift could be attenuated by introducing background flickering dots. The perceived shift decreased with distance from motion when the eccentricity of the flashes was kept constant. We conclude that the shift reflects feedback to primary visual cortex from motion selective cells in extrastriate cortex with receptive fields that overlap the retinal location of the flash.

Neuroimaging of direction-selective mechanisms for second-order motion

Psychophysical findings have revealed a functional segregation of processing for 1st-order motion (movement of luminance modulation) and 2nd-order motion (e.g., movement of contrast modulation). However neural correlates of this psychophysical distinction remain controversial. To test for a corresponding anatomical segregation, we conducted a new functional magnetic resonance imaging (fMRI) study to localize direction-selective cortical mechanisms for 1st- and 2nd-order motion stimuli, by measuring direction-contingent response changes induced by motion adaptation, with deliberate control of attention. The 2nd-order motion stimulus generated direction-selective adaptation in a wide range of visual cortical areas, including areas V1, V2, V3, VP, V3A, V4v, and MT+. Moreover, the pattern of activity was similar to that obtained with 1st-order motion stimuli. Contrary to expectations from psychophysics, these results suggest that in the human visual cortex, the direction of 2nd-order motion is represented as early as V1. In addition, we found no obvious anatomical segregation in the neural substrates for 1st- and 2nd-order motion processing that can be resolved using standard fMRI.

Neuronal adaptation to visual motion in area MT of the macaque

The responsivity of primary sensory cortical neurons is reduced following prolonged adaptation, but such adaptation has been little studied in higher sensory areas. Adaptation to visual motion has strong perceptual effects, so we studied the effect of prolonged stimulation on neuronal responsivity in the macaque's area MT, a cortical area whose importance to visual motion perception is well established. We adapted MT neurons with sinusoidal gratings drifting in the preferred or null direction. Preferred adaptation reduced the responsiveness of MT cells, primarily by changing their contrast gain, and this effect was spatially specific within the receptive field. Null adaptation reduced the ability of null gratings to inhibit the response to a simultaneously presented preferred stimulus. While both preferred and null adaptation alter MT responses, these effects probably do not occur in MT neurons but are likely to reflect adaptation-induced changes in contrast gain earlier in the visual pathway.

Isolating motion responses in visual evoked potentials by preadapting flicker-sensitive mechanisms

Onset of visual motion evokes a component in the EEG, the motion onset VEP. Exploring its motion specificity with a direction-specific adaptation paradigm, previous work demonstrated that less than 50% of the motion onset VEP represents actual motion detection. Here, we tested whether preadaptation of flicker-sensitive mechanisms can help to isolate motion-specific responses in the VEP. Flicker preadaptation was accomplished by limiting dot lifetime in the random-dot kinematograms that we used to study the direction specificity of motion adaptation. With unlimited dot lifetime, motion adaptation reduced the VEP amplitude to 35% (adapted direction) and 50% (opposite direction). With the shortest dot lifetime (40 ms), motion adaptation reduced the amplitude to 55% (adapted direction) and 70% (opposite direction). These findings suggest that random-dot kinematograms with short dot lifetimes could improve the investigation of human motion processing, be it in electrophysiology or other fields. While such stimuli successfully preadapt flicker-related components, they still evoke a sizable response, of which an estimated 70% is motion-specific.

Visual consciousness in health and disease

Conscious experience is an essential part of normal human life and interaction with the environment. Yet the nature of consciousness and conscious perception remains a mystery. Because of its subjective nature, consciousness has been difficult to investigate scientifically, but clues have been gained through studies involving patients with cortical lesions. During the past decade, the development of event-related fMRI has provided insights into aspects of conscious perception in control subjects and patients with cortical lesions by correlating awareness and performance with neural activity during visual tasks. This article reviews how recent research has advanced understanding of conscious perception, its relationship to neural activity and visual performance, and how this relationship can be altered by visual dysfunction. It also presents recent research about how conscious awareness of vision might be represented at a neural level in the central nervous system.