Motion processing in the macaque: revisited with functional magnetic resonance imaging

Mesoscale organization of ventral and dorsal visual pathways in macaque monkey revealed by 7T fMRI

In human and nonhuman primate brains, columnar (mesoscale) organization has been demonstrated to underlie both lower and higher order aspects of visual information processing. Previous studies have focused on identifying functional preferences of mesoscale domains in specific areas; but there has been little understanding of how mesoscale domains may cooperatively respond to single visual stimuli across dorsal and ventral pathways. Here, we have developed ultrahigh-field 7 T fMRI methods to enable simultaneous mapping, in individual macaque monkeys, of response in both dorsal and ventral pathways to single simple color and motion stimuli. We provide the first evidence that anatomical V2 cytochrome oxidase-stained stripes are well aligned with fMRI maps of V2 stripes, settling a long-standing controversy. In the ventral pathway, a systematic array of paired color and luminance processing domains across V4 was revealed, suggesting a novel organization for surface information processing. In the dorsal pathway, in addition to high quality motion direction maps of MT, MST and V3A, alternating color and motion direction domains in V3 are revealed. As well, submillimeter motion domains were observed in peripheral LIPd and LIPv. In sum, our study provides a novel global snapshot of how mesoscale networks in the ventral and dorsal visual pathways form the organizational basis of visual objection recognition and vision for action.

Visual Motion Coherence Responses in Human Visual Cortex

Random dot kinematograms (RDKs) have recently been used to train subjects with cortical scotomas to perform direction of motion discrimination, partially restoring visual motion perception. To study the recovery of visual perception, it is important to understand how visual areas in normal subjects and subjects with cortical scotomas respond to RDK stimuli. Studies in normal subjects have shown that blood oxygen level-dependent (BOLD) responses in human area hV5/MT+ increase monotonically with coherence, in general agreement with electrophysiology studies in primates. However, RDK responses in prior studies were obtained while the subject was performing fixation, not a motion discrimination condition. Furthermore, BOLD responses were gauged against a baseline condition of uniform illumination or static dots, potentially decreasing the specificity of responses for the spatial integration of local motion signals (motion coherence). Here, we revisit this question starting from a baseline RDK condition of no coherence, thereby isolating the component of BOLD response due specifically to the spatial integration of local motion signals. In agreement with prior studies, we found that responses in the area hV5/MT+ of healthy subjects were monotonically increasing when subjects fixated without performing a motion discrimination task. In contrast, when subjects were performing an RDK direction of motion discrimination task, responses in the area hV5/MT+ remained flat, changing minimally, if at all, as a function of motion coherence. A similar pattern of responses was seen in the area hV5/MT+ of subjects with dense cortical scotomas performing direction of motion discrimination for RDKs presented inside the scotoma. Passive RDK presentation within the scotoma elicited no significant hV5/MT+ responses. These observations shed further light on how visual cortex responses behave as a function of motion coherence, helping to prepare the ground for future studies using these methods to study visual system recovery after injury.

Receptor architecture of macaque and human early visual areas: not equal, but comparable

Existing cytoarchitectonic maps of the human and macaque posterior occipital cortex differ in the number of areas they display, thus hampering identification of homolog structures. We applied quantitative in vitro receptor autoradiography to characterize the receptor architecture of the primary visual and early extrastriate cortex in macaque and human brains, using previously published cytoarchitectonic criteria as starting point of our analysis. We identified 8 receptor architectonically distinct areas in the macaque brain (mV1d, mV1v, mV2d, mV2v, mV3d, mV3v, mV3A, mV4v), and their respective counterpart areas in the human brain (hV1d, hV1v, hV2d, hV2v, hV3d, hV3v, hV3A, hV4v). Mean densities of 14 neurotransmitter receptors were quantified in each area, and ensuing receptor fingerprints used for multivariate analyses. The 1st principal component segregated macaque and human early visual areas differ. However, the 2nd principal component showed that within each species, area-specific differences in receptor fingerprints were associated with the hierarchical processing level of each area. Subdivisions of V2 and V3 were found to cluster together in both species and were segregated from subdivisions of V1 and from V4v. Thus, comparative studies like this provide valuable architectonic insights into how differences in underlying microstructure impact evolutionary changes in functional processing of the primate brain and, at the same time, provide strong arguments for use of macaque monkey brain as a suitable animal model for translational studies.

Illusory Motion Reversal in Touch

Psychophysical visual experiments have shown illusory motion reversal (IMR), in which the perceived direction of motion is the opposite of its actual direction. The tactile form of this illusion has also been reported. However, it remains unclear which stimulus characteristics affect the magnitude of IMR. We closely examined the effect of stimulus characteristics on IMR by presenting moving sinusoid gratings and random-dot patterns to 10 participants’ fingerpads at different spatial periods, speeds, and indentation depths. All participants perceived a motion direction opposite to the veridical direction some of the time. The illusion was more prevalent at spatial periods of 1 and 2 mm and at extreme speeds of 20 and 320 mm/s. We observed stronger IMR for gratings and much weaker IMR for a random-dot pattern, indicating that edge orientation might be a major contributor to this illusion. These results show that the optimal parameters for IMR are consistent with the characteristics of motion-selective neurons in the somatosensory cortex, as most of these neurons are also orientation-selective. We speculate that these neurons could be the neural substrate that accounts for tactile IMR.

Functional correlate and delineated connectivity pattern of human motion aftereffect responses substantiate a subjacent visual-vestibular interaction

The visual motion aftereffect (MAE) is the most prominent aftereffect in the visual system. Regarding its function, psychophysical studies suggest its function to be a form of sensory error correction, possibly also triggered by incongruent visual-vestibular stimulation. Several observational imaging experiments have deducted an essential role for region MT+ in the perception of a visual MAE but not provided conclusive evidence. Potential confounders with the MAE such as ocular motor performance, attention, and vection sensations have also never been controlled for. Aim of this neuroimaging study was to delineate the neural correlates of MAE and its subjacent functional connectivity pattern. A rotational MAE (n = 22) was induced using differing visual stimuli whilst modulating ocular motor parameters in a 3T scanner. Data was analyzed with SPM12. Eye movements as a response to the same stimuli were studied by means of high-resolution videooculography. Analysis for all stimuli gave bilateral activations along the dorsal visual stream with an emphasis on area MT. The onset of a visual MAE revealed an additional response in the right medial superior temporal area (MST) and a concurrent deactivation of vestibular hub region OP2. There was no correlation for the BOLD effects during the MAE with either ocular motor or attention parameters. The functional correlate of a visual MAE in humans may be represented in the interaction between region MT and area MST. This MAE representation is independent of a potential afternystagmus, attention and the presence of egomotion sensations. Connectivity analyses showed that in the event of conflicting visual-vestibular motion information (here MAE) area MST and area OP2 may act as the relevant mediating network hubs.

Monkey cortex through fMRI glasses

In 1998 several groups reported the feasibility of fMRI experiments in monkeys, with the goal to bridge the gap between invasive nonhuman primate studies and human functional imaging. These studies yielded critical insights in the neuronal underpinnings of the BOLD signal. Furthermore, the technology has been successful in guiding electrophysiological recordings and identifying focal perturbation targets. Finally, invaluable information was obtained concerning human brain evolution. We here provide a comprehensive overview of awake monkey fMRI studies mainly confined to the visual system. We review the latest insights about the topographic organization of monkey visual cortex and discuss the spatial relationships between retinotopy and category- and feature-selective clusters. We briefly discuss the functional layout of parietal and frontal cortex and continue with a summary of some fascinating functional and effective connectivity studies. Finally, we review recent comparative fMRI experiments and speculate about the future of nonhuman primate imaging.

Spatial proximity rather than temporal frequency determines the wagon wheel illusion

A rotating disk composed of alternating light and dark segments may give rise to the wagon wheel illusion: a perceptual reversal in rotation direction. Continuously illuminated (eg in daylight) as well as discretely presented (eg stroboscopic or computer-animated) versions of the illusion exist; here, we investigated the discrete version. Prominence of the illusion is commonly believed to depend on temporal frequency of rotation, but frequency effects have been unsystematic across previous experiments. Here, illusion strength is shown instead to lawfully depend on an attraction function of angular displacement between successive frames (experiments 1 and 2). We studied the illusion across a wider range of this factor than previously and as a result obtained unusually strong effects (up to 100% reversal). In two further experiments we showed that this is because the effect of the attraction function on the wagon wheel illusion strength is modulated by a perceived increase in the number of spokes of the wheel, a phenomenon generally known as the frequency doubling illusion. These factors combine to offer a unifying explanation of the wagon wheel illusion, at least under discrete presentation and possibly under continuous presentation conditions as well.

A motion direction preference map in monkey V4

In the primate visual system, area V4 is located in the ventral pathway and is traditionally thought to be involved in processing color and form information. However, little is known about its functional role in processing motion information. Using intrinsic signal optical imaging over large fields of view in V1, V2, and V4, we mapped the direction of motion responses in anesthetized macaques. We found that V4 contains direction-preferring domains that are preferentially activated by stimuli moving in one direction. These direction-preferring domains normally occupy several restricted regions of V4 and tend to overlap with orientation- and color-preferring domains. Single-cell recordings targeting these direction-preferring domains also showed a clustering, as well as a columnar organization of V4 direction-selective neurons. These data suggest that, in contrast to the classical view, motion information is also processed in ventral pathway regions such as area V4.

Pattern-motion selective responses in MT, MST and the pulvinar of humans

Plaid stimuli are often used to investigate the mechanisms involved in the integration and segregation of motion information. Considering the perceptual importance of such mechanisms, only a very limited number of visual brain areas have been found to be specifically involved in motion integration. These are the human (h)MT+ complex, area V3 and the pulvinar. The hMT+ complex can be functionally subdivided into two separate areas, middle temporal area (MT) and medial superior temporal area (MST); however, it is currently unclear whether these distinct sub-regions have different responses to plaid stimuli. To address this issue we used functional magnetic resonance imaging to quantify the relative response of MT and MST to component and pattern motion. Participants viewed plaid stimuli that were constrained to result in the perception of either component motion (segregation of motion information) or pattern motion (integration of motion information). MT/MST segregation was achieved using a moving dot stimulus that allowed stimulation of each visual hemifield either in unison or separately. We found pattern motion selective responses in both MT and MST. Consistent with previous reports, activity indicative of pattern motion selectivity was also found in the pulvinar as well as in other extrastriate areas. These results demonstrate that MT, MST and the pulvinar are involved in the complex motion integration mechanisms that are triggered by plaid stimuli. This reinforces the concept that integrative computations take place in a distributed neuronal circuit both in cortical and sub-cortical networks.

Hierarchy of direction-tuned motion adaptation in human visual cortex

Prolonged exposure to a single direction of motion alters perception of subsequent static or dynamic stimuli and induces substantial changes in behaviors of motion-sensitive neurons, but the origin of neural adaptation and neural correlates of perceptual consequences of motion adaptation in human brain remain unclear. Using functional magnetic resonance imaging, we measured motion adaptation tuning curves in a fine scale by probing changes in cortical activity after adaptation for a range of directions relative to the adapted direction. We found a clear dichotomy in tuning curve shape: cortical responses in early-tier visual areas reduced at around both the adapted and opposite direction, resulting in a bidirectional tuning curve, whereas response reduction in high-tier areas occurred only at around the adapted direction, resulting in a unidirectional tuning curve. We also found that the psychophysically measured adaptation tuning curves were unidirectional and best matched the cortical adaptation tuning curves in the middle temporal area (MT) and the medial superior temporal area (MST). Our findings are compatible with, but not limited to, an interpretation in which direct impacts of motion adaptation occur in both unidirectional and bidirectional units in early visual areas, but the perceptual consequences of motion adaptation are manifested in the population activity in MT and MST, which may inherit those direct impacts of adaptation from the directionally selective units.

Evaluating reverse speech as a control task with language-related gamma activity on electrocorticography

Reverse speech has often been used as a control task in brain-mapping studies of language utilizing various non-invasive modalities. The rationale is that reverse speech is comparable to forward speech in terms of auditory characteristics, while omitting the linguistic components. Thus, it may control for non-language auditory functions. This finds some support in fMRI studies indicating that reverse speech resulted in less blood-oxygen-level-dependent (BOLD) signal intensity in perisylvian regions than forward speech. We attempted to externally validate a reverse speech control task using intracranial electrocorticography (ECoG) in eight patients with intractable focal epilepsy. We studied adolescent and adult patients who underwent extraoperative ECoG prior to resective epilepsy surgery. All patients received an auditory language task during ECoG recording. Patients were presented 115 audible question stimuli, including 30 reverse speech trials. Reverse speech trials more strongly engaged bilateral superior temporal sites than did the corresponding forward speech trials. Forward speech trials elicited larger gamma-augmentation at frontal lobe sites not attributable to sensorimotor function. Other temporal and frontal sites of significant augmentation showed no significant difference between reverse and forward speech. Thus, we failed to validate reported evidence of weaker activation of temporal neocortices during reverse compared to forward speech. Superior temporal lobe engagement may indicate increased attention to reverse speech. Reverse speech does not appear to be a suitable task for the control of non-language auditory functions on ECoG.

Mapping the organization of axis of motion selective features in human area MT using high-field fMRI

Functional magnetic resonance imaging (fMRI) at high magnetic fields has made it possible to investigate the columnar organization of the human brain in vivo with high degrees of accuracy and sensitivity. Until now, these results have been limited to the organization principles of early visual cortex (V1). While the middle temporal area (MT) has been the first identified extra-striate visual area shown to exhibit a columnar organization in monkeys, evidence of MT's columnar response properties and topographic layout in humans has remained elusive. Research using various approaches suggests similar response properties as in monkeys but failed to provide direct evidence for direction or axis of motion selectivity in human area MT. By combining state of the art pulse sequence design, high spatial resolution in all three dimensions (0.8 mm isotropic), optimized coil design, ultrahigh field magnets (7 Tesla) and novel high resolution cortical grid sampling analysis tools, we provide the first direct evidence for large-scale axis of motion selective feature organization in human area MT closely matching predictions from topographic columnar-level simulations.

Visual stability and the motion aftereffect: a psychophysical study revealing spatial updating

Eye movements create an ever-changing image of the world on the retina. In particular, frequent saccades call for a compensatory mechanism to transform the changing visual information into a stable percept. To this end, the brain presumably uses internal copies of motor commands. Electrophysiological recordings of visual neurons in the primate lateral intraparietal cortex, the frontal eye fields, and the superior colliculus suggest that the receptive fields (RFs) of special neurons shift towards their post-saccadic positions before the onset of a saccade. However, the perceptual consequences of these shifts remain controversial. We wanted to test in humans whether a remapping of motion adaptation occurs in visual perception.The motion aftereffect (MAE) occurs after viewing of a moving stimulus as an apparent movement to the opposite direction. We designed a saccade paradigm suitable for revealing pre-saccadic remapping of the MAE. Indeed, a transfer of motion adaptation from pre-saccadic to post-saccadic position could be observed when subjects prepared saccades. In the remapping condition, the strength of the MAE was comparable to the effect measured in a control condition (33±7% vs. 27±4%). Contrary, after a saccade or without saccade planning, the MAE was weak or absent when adaptation and test stimulus were located at different retinal locations, i.e. the effect was clearly retinotopic. Regarding visual cognition, our study reveals for the first time predictive remapping of the MAE but no spatiotopic transfer across saccades. Since the cortical sites involved in motion adaptation in primates are most likely the primary visual cortex and the middle temporal area (MT/V5) corresponding to human MT, our results suggest that pre-saccadic remapping extends to these areas, which have been associated with strict retinotopy and therefore with classical RF organization. The pre-saccadic transfer of visual features demonstrated here may be a crucial determinant for a stable percept despite saccades.

A motion direction map in macaque V2

In mammals, the perception of motion starts with direction-selective neurons in the visual cortex. Despite numerous studies in monkey primary and second visual cortex (V1 and V2), there has been no evidence of direction maps in these areas. In the present study, we used optical imaging methods to study the organization of motion response in macaque V1 and V2. In contrast to the findings in other mammals (e.g., cats and ferrets), we found no direction maps in macaque V1. Robust direction maps, however, were found in V2 thick/pale stripes and avoided thin stripes. In many cases direction maps were located within thick stripes and exhibited pinwheel or linear organizations. The presence of motion maps in V2 points to a newfound prominence of V2 in motion processing, for contributing to motion perception in the dorsal pathway and/or for motion cue-dependent form perception in the ventral pathway.

A comparison of fMRI adaptation and multivariate pattern classification analysis in visual cortex

Functional magnetic resonance imaging (fMRI) has become a ubiquitous tool in cognitive neuroscience. The technique allows noninvasive measurements of cortical responses in the human brain, but only on the millimeter scale. Because a typical voxel contains many thousands of neurons with varied properties, establishing the selectivity of their responses directly is impossible. In recent years, two methods using fMRI aimed at studying the selectivity of neuronal populations on a 'subvoxel' scale have been heavily used. The first technique, fMRI adaptation, relies on the observation that the blood oxygen level-dependent (BOLD) response in a given voxel is reduced after prolonged presentation of a stimulus, and that this reduction is selective to the characteristics of the repeated stimuli (adapters). The second technique, multivariate pattern analysis (MVPA), makes use of multivariate statistics to recover small biases in individual voxels in their responses to different stimuli. It is thought that these biases arise due to the uneven distribution of neurons (with different properties) sampled by the many voxels in the imaged volume. These two techniques have not been compared explicitly, however, and little is known about their relative sensitivities. Here, we compared fMRI results from orientation-specific visual adaptation and orientation-classification by MVPA, using optimized experimental designs for each, and found that the multivariate pattern classification approach was more sensitive to small differences in stimulus orientation than the adaptation paradigm. Estimates of orientation selectivity obtained with the two methods were, however, very highly correlated across visual areas.

Functional magnetic resonance adaptation in visual neuroscience

Functional magnetic resonance imaging (fMRI) is a powerful non-invasive tool to investigate neuronal processing. In the last ten years a new methodological approach in the field of fMRI has been developed: fMRI adaptation. It has been found that the repetition of a stimulus leads to a decrease of the fMRI signal in the brain region that processes this stimulus. The phenomenon has been related to neuronal adaptation effects found in single-cell recordings. Since the first experiments that observed fMRI-adaptation effects, the method has been applied extensively to study various visual phenomena, such as the perception of motion, shape, objects, and orientation. The great advantage of fMRI adaptation is that it allows assessing the functional response profile of a brain region at a subvoxel level. The purpose of the current review is to evaluate the different experimental approaches used to elicit fMRI-adaptation effects. We discuss papers published in the domain of visual neuroscience that made use of fMRI-adaptation paradigms. In doing so, we focus on methodological considerations concerning experimental design, stimulus presentation and influencing factors such as awareness and attention. In the course of this review, we show that different fMRI-adaptation designs capture heterogeneous neuronal adaptation effects. As the picture of the mechanisms underlying neuronal adaptation changes from simple synaptic fatigue to complex network interactions, the concept of fMRI adaptation has to be redefined.

Electrophysiological correlates of default-mode processing in macaque posterior cingulate cortex

During the course of daily activity, our level of engagement with the world varies on a moment-to-moment basis. Although these fluctuations in vigilance have critical consequences for our thoughts and actions, almost nothing is known about the neuronal substrates governing such dynamic variations in task engagement. We investigated the hypothesis that the posterior cingulate cortex (CGp), a region linked to default-mode processing by hemodynamic and metabolic measures, controls such variations. We recorded the activity of single neurons in CGp in 2 macaque monkeys performing simple tasks in which their behavior varied from vigilant to inattentive. We found that firing rates were reliably suppressed during task performance and returned to a higher resting baseline between trials. Importantly, higher firing rates predicted errors and slow behavioral responses, and were also observed during cued rest periods when monkeys were temporarily liberated from exteroceptive vigilance. These patterns of activity were not observed in the lateral intraparietal area, an area linked to the frontoparietal attention network. Our findings provide physiological confirmation that CGp mediates exteroceptive vigilance and are consistent with the idea that CGp is part of the "default network" of brain areas associated with control of task engagement.

Smooth Pursuit Eye Movements to Isoluminant Targets

At slow speeds, chromatic isoluminant stimuli are perceived to move much slower than comparable luminance stimuli. We investigated whether smooth pursuit eye movements to isoluminant stimuli show an analogous slowing. Beside pursuit speed and latency, we studied speed judgments to the same stimuli during fixation and pursuit. Stimuli were either large sine wave gratings or small Gaussians blobs moving horizontally at speeds between 1 and 11°/s. Targets were defined by luminance contrast or color. Confirming prior studies, we found that speed judgments of isoluminant stimuli during fixation showed a substantial slowing when compared with luminance stimuli. A similarly strong and significant effect of isoluminance was found for pursuit initiation: compared with luminance targets of matched contrasts, latencies of pursuit initiation were delayed by 50 ms at all speeds and eye accelerations were reduced for isoluminant targets. A small difference was found between steady-state eye velocities of luminance and isoluminant targets. For comparison, we measured latencies of saccades to luminance and isoluminant stimuli under similar conditions, but the effect of isoluminance was only found for pursuit. Parallel psychophysical experiments revealed that different from speed judgments of moving isoluminant stimuli made during fixation, judgments during pursuit are veridical for the same stimuli at all speeds. Therefore information about target speed seems to be available for pursuit eye movements and speed judgments during pursuit but is degraded for perceptual speed judgments during fixation and for pursuit initiation.

fMRI and its interpretations: an illustration on directional selectivity in area V5/MT

fMRI is a tool to study brain function noninvasively that can reliably identify sites of neural involvement for a given task. However, to what extent can fMRI signals be related to measures obtained in electrophysiology? Can the blood-oxygen-level-dependent signal be interpreted as spatially pooled spiking activity? Here we combine knowledge from neurovascular coupling, functional imaging and neurophysiology to discuss whether fMRI has succeeded in demonstrating one of the most established functional properties in the visual brain, namely directional selectivity in the motion-processing region V5/MT+. We also discuss differences of fMRI and electrophysiology in their sensitivity to distinct physiological processes. We conclude that fMRI constitutes a complement, not a poor-resolution substitute, to invasive techniques, and that it deserves interpretations that acknowledge its stand as a separate signal.

Neural substrates for action understanding at different description levels in the human brain

Understanding complex movements and abstract action goals is an important skill for our social interactions. Successful social interactions entail understanding of actions at different levels of action description, ranging from detailed movement trajectories that support learning of complex motor skills through imitation to distinct features of actions that allow us to discriminate between action goals and different action styles. Previous studies have implicated premotor, parietal, and superior temporal areas in action understanding. However, the role of these different cortical areas in action understanding at different levels of action description remains largely unknown. We addressed this question using advanced animation and stimulus generation techniques in combination with sensitive functional magnetic resonance imaging adaptation or repetition suppression methods. We tested the neural sensitivity of fronto-parietal and visual areas to differences in the kinematics and goals of actions using kinematic morphs of arm movements. Our findings provide novel evidence for differential involvement of ventral premotor, parietal, and temporal regions in action understanding. We show that the ventral premotor cortex encodes the physical similarity between movement trajectories and action goals that are important for exact copying of actions and the acquisition of complex motor skills. In contrast, whereas parietal regions and the superior temporal sulcus process the perceptual similarity between movements and may support the perception and imitation of abstract action goals and movement styles. Thus, our findings propose that fronto-parietal and visual areas involved in action understanding mediate a cascade of visual-motor processes at different levels of action description from exact movement copies to abstract action goals achieved with different movement styles.

Mechanisms of feature- and space-based attention: response modulation and baseline increases

Selective attention modulates neural activity in the visual system both in the presence and in the absence of visual stimuli. When subjects direct attention to a particular location in a visual scene in anticipation of the stimulus onset, there is an increase in baseline activity. How do such baseline increases relate to the attentional modulation of stimulus-driven activity? Using functional magnetic resonance imaging, we demonstrate that baseline increases related to the expectation of motion or color stimuli at a peripheral target location do not predict the modulation of neural responses evoked by these stimuli when attended. In areas such as MT and TEO that were more effectively activated by one stimulus type than the other, attentional modulation of visually evoked activity depended on the stimulus preference of a visual area and was stronger for the effective than for the noneffective stimulus. In contrast, baseline increases did not reflect the stimulus preference of a visual area. Rather, these signals were shown to be spatially specific and appeared to be dominated by the location information and not by the feature information of the cue with the experimental paradigms under study. These findings provide evidence that baseline increases in visual cortex during cue periods do not reflect the activation of a memory template that includes particular stimulus properties of the expected target, but rather carry information about the location of an expected target stimulus. In addition, when the stimulus contained both color and motion, an object-based attention effect was observed, with significant attentional modulation in the area that responded preferentially to the unattended feature.

Direction-selective adaptation in fly visual motion-sensitive neurons is generated by an intrinsic conductance-based mechanism

Motion-sensitive neurons in the blowfly brain present an ideal model system to study the cellular mechanisms and functional significance of adaptation to visual motion. Various adaptation processes have been described, but it is still largely unknown which of these processes are generated in the motion-sensitive neurons themselves and which originate at more peripheral processing stages. By input resistance measurements I demonstrate that direction-selective adaptation is generated by an activity-dependent conductance increase in the motion-sensitive neurons. Based on correlations between dendritic Ca(2+) accumulation and slow hyperpolarizing after-potentials following excitatory stimulation, a regulation of direction-selective adaptation by Ca(2+) has previously been suggested. In the present study, however, adaptation phenomena are not evoked when the cytosolic Ca(2+) concentration is elevated by ultraviolet photolysis of caged Ca(2+) in single neurons rather than by motion stimulation. This result renders it unlikely, that adaptation in fly motion-sensitive neurons is regulated by bulk cytosolic Ca(2+).

Repetition suppression in monkey inferotemporal cortex: relation to behavioral priming

In tasks requiring judgments about visual stimuli, humans exhibit repetition priming, responding with increased speed when a stimulus is repeated. Repetition priming might depend on repetition suppression, a phenomenon first observed in monkey inferotemporal cortex (IT) whereby, when a stimulus is repeated, the strength of the neuronal visual response is reduced. If the reduction resulted in sharpening of the cortical representation of the stimulus, and did not just scale it down, then speeded processing might result. To explore the relation between repetition priming and repetition suppression, we monitored neuronal activity in IT while monkeys performed a symmetry decision task. We found 1) that monkeys exhibit repetition priming, 2) that IT neurons simultaneously exhibit repetition suppression, 3) that repetition priming and repetition suppression do not vary in a significantly correlated fashion across trials, and 4) that repetition suppression scales down the representation of the stimulus without sharpening it. We conclude that repetition suppression accompanies repetition priming but is unlikely to be its cause.

Storage of an oculomotor motion aftereffect

Adaptation to motion produces a motion aftereffect (MAE), where illusory, oppositely-directed motion is perceived when viewing a stationary image. A common hypothesis for motion adaptation is that it reflects an imbalance of activity caused by neuronal fatigue. However, the perceptual MAE exhibits storage, in that the MAE appears even after a prolonged period of darkness is interposed between the adapting stimulus and the test, suggesting that fatigue cannot explain the perceptual MAE. We asked whether neural fatigue was a viable explanation for the oculomotor MAE (OMAE) by testing if the OMAE exhibits storage. Human observers were adapted with moving, random-dot cinematograms. Following adaptation, they generated an oculomotor MAE (OMAE), with both pursuit and saccadic components. The OMAE occurred in the presence of a visual test stimulus, but not in the dark. When the test stimulus was introduced after the dark period, the OMAE reappeared, analogous to perceptual MAE storage. The results suggest that fatigue cannot explain the OMAE, and that visual stimulation is necessary to elicit it. We propose a model in which adaptation recalibrates the motion-processing network by adjusting the weights of the inputs to neurons in the middle-temporal (MT) area.

BOLD adaptation in vibrotactile stimulation: neuronal networks involved in frequency discrimination

The present functional magnetic resonance imaging (fMRI) study investigated human brain regions subserving the discrimination of vibrotactile frequency. An event-related adaptation paradigm was used in which blood-oxygen-level-dependent (BOLD) responses are lower to same compared with different pairs of stimuli (BOLD adaptation). This adaptation effect serves as an indicator for feature-specific responding of neuronal subpopulations. Subjects had to discriminate two vibrotactile stimuli sequentially applied with a delay of 600 ms to their left middle fingertip. The stimulus frequency was in the flutter range of 18-26 Hz. In half of the trials, the two stimuli possessed identical frequency (same), whereas in the other half, a frequency difference of +/-2 Hz was used (diff). As a result, BOLD adaptation was observed in the contralateral primary somatosensory cortex (S1), precentral gyrus, superior temporal gyrus (STG); ipsilateral insula as well as bilateral secondary somatosensory cortex and supplementary motor area. When statistically comparing the BOLD time courses between same and diff trials in these cortical areas, it was found that the vibrotactile BOLD adaptation is initiated in the contralateral S1 and STG simultaneously. These findings suggest that the cortical areas responsive to the frequency difference between two serially presented stimuli sequentially process the frequency of a vibrotactile stimulus and constitute a putative neuronal network underlying human vibrotactile frequency discrimination.

Decoding seen and attended motion directions from activity in the human visual cortex

Functional neuroimaging has successfully identified brain areas that show greater responses to visual motion and adapted responses to repeated motion directions. However, such methods have been thought to lack the sensitivity and spatial resolution to isolate direction-selective responses to individual motion stimuli. Here, we used functional magnetic resonance imaging (fMRI) and pattern classification methods to show that ensemble activity patterns in human visual cortex contain robust direction-selective information, from which it is possible to decode seen and attended motion directions. Ensemble activity in areas V1-V4 and MT+/V5 allowed us to decode which of eight possible motion directions the subject was viewing on individual stimulus blocks. Moreover, ensemble activity evoked by single motion directions could effectively predict which of two overlapping motion directions was the focus of the subject's attention and presumably dominant in perception. Our results indicate that feature-based attention can bias direction-selective population activity in multiple visual areas, including MT+/V5 and early visual areas (V1-V4), consistent with gain-modulation models of feature-based attention and theories of early attentional selection. Our approach for measuring ensemble direction selectivity may provide new opportunities to investigate relationships between attentional selection, conscious perception, and direction-selective responses in the human brain.

Linking dynamical perceptual decisions at different levels of description in motion pattern formation: computational simulations

A two-level dynamical model of motion pattern formation is developed in which local motion/ nonmotion perceptual decisions are based on inhibitory competition between area V1 detectors responsive to motion-specifying versus motion-independent stimulus information, and pattern-level perceptual decisions are based on inhibitory competition between area MT motion detectors with orthogonal directional selectivity. The model accounts for the effects of luminance perturbations on the relative size of the pattern-level hysteresis effects reported by Hock and Ploeger (2006) and also accounts for related experimental results reported by Hock, Kelso, and Schöner (1993). Single-trial simulations demonstrated the crucial role of local motion/nonmotion bistability and activation-dependent future-shaping interactions in stabilizing perceived global motion patterns. Such interactions maintain currently perceived motion patterns by inhibiting the soon-to-be-stimulated motion detectors that otherwise would be the basis for the perception of an alternative pattern.

Repetition and the brain: neural models of stimulus-specific effects

One of the most robust experience-related cortical dynamics is reduced neural activity when stimuli are repeated. This reduction has been linked to performance improvements due to repetition and also used to probe functional characteristics of neural populations. However, the underlying neural mechanisms are as yet unknown. Here, we consider three models that have been proposed to account for repetition-related reductions in neural activity, and evaluate them in terms of their ability to account for the main properties of this phenomenon as measured with single-cell recordings and neuroimaging techniques. We also discuss future directions for distinguishing between these models, which will be important for understanding the neural consequences of repetition and for interpreting repetition-related effects in neuroimaging data.

Mapping cortical activity elicited with electrical microstimulation using FMRI in the macaque

Over the last two centuries, electrical microstimulation has been used to demonstrate causal links between neural activity and specific behaviors and cognitive functions. However, to establish these links it is imperative to characterize the cortical activity patterns that are elicited by stimulation locally around the electrode and in other functionally connected areas. We have developed a technique to record brain activity using the blood oxygen level dependent (BOLD) signal while applying electrical microstimulation to the primate brain. We find that the spread of activity around the electrode tip in macaque area V1 was larger than expected from calculations based on passive spread of current and therefore may reflect functional spread by way of horizontal connections. Consistent with this functional transynaptic spread we also obtained activation in expected projection sites in extrastriate visual areas, demonstrating the utility of our technique in uncovering in vivo functional connectivity maps.

Simultaneous recordings of visual evoked potentials and BOLD MRI activations in response to visual motion processing

Visual motion processing in humans was studied by simultaneous 32-channel electroencephalography (EEG) recordings of visual evoked potentials and BOLD MRI activations at 2.9 T. The paradigms compared three different random dot patterns (12 s duration) with stationary random dots (18 s) or with each other. The stimuli represented pattern reversal (500 ms switches between two stationary patterns), motion onset (200 ms of starfield motion followed by 1000 ms of stationary dots) and motion reversal (reversal of moving starfield directions every 1000 ms). Whereas motion-evoked visual potentials, and in particular the N2 component in occipito-temporal channels, were most prominent for motion onset, the most extended BOLD MRI activations and strongest signal changes in V5/MT+ were obtained in response to motion reversal. These apparently contradictory findings most likely reflect different physiological aspects of the neural activity associated with visual motion processing. For example, desynchronized activity of subpopulations of cortical neurons inside V5/MT+ is expected to attenuate visual evoked potentials in scalp recordings while continuously driving metabolic demands that lead to sustained BOLD MRI responses. The understanding of the physiological correlates and neural processes underlying either technique is fundamental to exploring fully the potential of combined EEG-MRI for studying human brain function at both high temporal and spatial resolution.

Contrast adaptation and representation in human early visual cortex

The human visual system can distinguish variations in image contrast over a much larger range than measurements of the static relationship between contrast and response in visual cortex would suggest. This discrepancy may be explained if adaptation serves to re-center contrast response functions around the ambient contrast, yet experiments on humans have yet to report such an effect. By using event-related fMRI and a data-driven analysis approach, we found that contrast response functions in V1, V2, and V3 shift to approximately center on the adapting contrast. Furthermore, we discovered that, unlike earlier areas, human V4 (hV4) responds positively to contrast changes, whether increments or decrements, suggesting that hV4 does not faithfully represent contrast, but instead responds to salient changes. These findings suggest that the visual system discounts slow uninformative changes in contrast with adaptation, yet remains exquisitely sensitive to changes that may signal important events in the environment.

Object-selective cortex exhibits performance-independent repetition suppression

Object-selective cortical regions exhibit a decreased response when an object stimulus is repeated [repetition suppression (RS)]. RS is often associated with priming: reduced response times and increased accuracy for repeated stimuli. It is unknown whether RS reflects stimulus-specific repetition, the associated changes in response time, or the combination of the two. To address this question, we performed a rapid event-related functional MRI (fMRI) study in which we measured BOLD signal in object-selective cortex, as well as object recognition performance, while we manipulated stimulus repetition. Our design allowed us to examine separately the roles of response time and repetition in explaining RS. We found that repetition played a robust role in explaining RS: repeated trials produced weaker BOLD responses than nonrepeated trials, even when comparing trials with matched response times. In contrast, response time played a weak role in explaining RS when repetition was controlled for: it explained BOLD responses only for one region of interest (ROI) and one experimental condition. Thus repetition suppression seems to be mostly driven by repetition rather than performance changes. We further examined whether RS reflects processes occurring at the same time as recognition or after recognition by manipulating stimulus presentation duration. In one experiment, durations were longer than required for recognition (2 s), whereas in a second experiment, durations were close to the minimum time required for recognition (85-101 ms). We found significant RS for brief presentations (albeit with a reduced magnitude), which again persisted when controlling for performance. This suggests a substantial amount of RS occurs during recognition.

The dynamics of visual adaptation to faces

Several recent demonstrations using visual adaptation have revealed high-level aftereffects for complex patterns including faces. While traditional aftereffects involve perceptual distortion of simple attributes such as orientation or colour that are processed early in the visual cortical hierarchy, face adaptation affects perceived identity and expression, which are thought to be products of higher-order processing. And, unlike most simple aftereffects, those involving faces are robust to changes in scale, position and orientation between the adapting and test stimuli. These differences raise the question of how closely related face aftereffects are to traditional ones. Little is known about the build-up and decay of the face aftereffect, and the similarity of these dynamic processes to traditional aftereffects might provide insight into this relationship. We examined the effect of varying the duration of both the adapting and test stimuli on the magnitude of perceived distortions in face identity. We found that, just as with traditional aftereffects, the identity aftereffect grew logarithmically stronger as a function of adaptation time and exponentially weaker as a function of test duration. Even the subtle aspects of these dynamics, such as the power-law relationship between the adapting and test durations, closely resembled that of other aftereffects. These results were obtained with two different sets of face stimuli that differed greatly in their low-level properties. We postulate that the mechanisms governing these shared dynamics may be dissociable from the responses of feature-selective neurons in the early visual cortex.

Implied motion from form in the human visual cortex

When cartoonists use speed lines--also called motion streaks--to suggest the speed of a stationary object, they use form to imply motion. The goal of this study was to investigate the mechanisms that mediate the percept of implied motion in the human visual cortex. In an adaptation functional imaging paradigm we presented Glass patterns that, just like speed lines, imply motion but do not on average contain coherent motion energy. We found selective adaptation to these patterns in the human motion complex, the lateral occipital complex (LOC), and earlier visual areas. Glass patterns contain both local orientation features and global structure. To disentangle these aspects we performed a control experiment using Glass patterns with minimal local orientation differences but large global structure differences. This experiment showed that selectivity for Glass patterns arises in part in areas beyond V1 and V2. Interestingly, the selective adaptation transferred from implied motion stimuli to similar real motion patterns in dorsal but not ventral areas. This suggests that the same subpopulations of cells in dorsal areas that are selective for implied motion are also selective for real motion. In other words, these cells are invariant with respect to the cue (implied or real) that generates the motion. We conclude that the human motion complex responds to Glass patterns as if they contain coherent motion. This, presumably, is the reason why these patterns appear to move coherently. The LOC, however, has different cells that respond to the structure of real motion patterns versus implied motion patterns. Such a differential response may allow ventral areas to further analyze the structure of global patterns.

Lack of long-term cortical reorganization after macaque retinal lesions

Several aspects of cortical organization are thought to remain plastic into adulthood, allowing cortical sensorimotor maps to be modified continuously by experience. This dynamic nature of cortical circuitry is important for learning, as well as for repair after injury to the nervous system. Electrophysiology studies suggest that adult macaque primary visual cortex (V1) undergoes large-scale reorganization within a few months after retinal lesioning, but this issue has not been conclusively settled. Here we applied the technique of functional magnetic resonance imaging (fMRI) to detect changes in the cortical topography of macaque area V1 after binocular retinal lesions. fMRI allows non-invasive, in vivo, long-term monitoring of cortical activity with a wide field of view, sampling signals from multiple neurons per unit cortical area. We show that, in contrast with previous studies, adult macaque V1 does not approach normal responsivity during 7.5 months of follow-up after retinal lesions, and its topography does not change. Electrophysiology experiments corroborated the fMRI results. This indicates that adult macaque V1 has limited potential for reorganization in the months following retinal injury.

Neurons in macaque area V4 acquire directional tuning after adaptation to motion stimuli

Neurons in area V4 of the macaque are generally not selective for direction of motion, as judged from their response to directional stimuli presented after a baseline condition devoid of movement. We used motion adaptation to investigate whether stimulation history influences direction-of-motion selectivity. We found that classically nondirectional V4 neurons develop direction-of-motion selectivity after adaptation, an observation that underscores the dynamic nature of functional cortical architecture.

Comparative mapping of higher visual areas in monkeys and humans

The advent of functional magnetic resonance imaging (fMRI) in non-human primates has facilitated comparison of the neurobiology of cognitive functions in humans and macaque monkeys, the most intensively studied animal model for higher brain functions. Most of these comparative studies have been performed in the visual system. The early visual areas V1, V2 and V3, as well as the motion area MT are conserved in humans. Beyond these areas, differences between human and monkey functional organization are increasingly evident. At the regional level, the monkey inferotemporal and intraparietal complexes appear to be conserved in humans, but there are profound functional differences in the intraparietal cortex suggesting that not all its constituent areas are homologous. In the long term, fMRI offers opportunities to compare the functional anatomy of a variety of cognitive functions in the two species.

Methods for functional magnetic resonance imaging in normal and lesioned behaving monkeys

Methods for performing functional magnetic resonance imaging (fMRI) studies in behaving and lesioned monkeys using a human MR scanner are reported. Materials for head implant surgery were selected based on tests for magnetic susceptibility. A primate chair with a rigid head fixation system and a mock scanner environment for training were developed. To perform controlled visual studies, monkeys were trained to maintain fixation for several minutes using a novel training technique that utilized continuous juice rewards. A surface coil was used to acquire anatomical and functional images in four monkeys, one with a partial lesion of striate cortex. High-resolution anatomical images were used after non-uniform intensity correction to create cortical surface reconstructions of both lesioned and normal hemispheres. Our methods were confirmed in two visual experiments, in which functional activations were obtained during both free viewing and fixation conditions. In one experiment, face-selective activity was found in the fundus and banks of the superior temporal sulcus and the middle temporal gyrus in monkeys viewing pictures of faces and objects while maintaining fixation. In a second experiment, regions in occipital, parietal, and frontal cortex were activated in lesioned and normal animals viewing a cartoon movie. Importantly, in the animal with the striate lesion, fMRI signals were obtained in the immediate vicinity of the lesion. Our results extend those previously reported by providing a detailed account of the technique and by demonstrating the feasibility of fMRI in monkeys with lesions.

Attention to 3-D shape, 3-D motion, and texture in 3-D structure from motion displays

We used fMRI to directly compare the neural substrates of three-dimensional (3-D) shape and motion processing for realistic textured objects rotating in depth. Subjects made judgments about several different attributes of these objects, including 3-D shape, the 3-D motion, and the scale of surface texture. For all of these tasks, we equated visual input, motor output, and task difficulty, and we controlled for differences in spatial attention. Judgments about 3-D shape from motion involve both parietal and occipito-temporal regions. The processing of 3-D shape is associated with the analysis of 3-D motion in parietal regions and the analysis of surface texture in occipito-temporal regions, which is consistent with the different behavioral roles that are typically attributed to the dorsal and ventral processing streams.

Static motion aftereffect does not modulate positional representations in early visual areas

A stationary stimulus is perceived to drift in the opposite direction after adaptation to a moving stimulus (static motion aftereffect (MAE)). It is commonly assumed that positional effects from the static motion aftereffect are mediated by early visual areas. Here we psychophysically showed that these positional effects did not modulate illusory line-tilt aftereffect (TAE). Since illusory contours seem to be represented at relatively early stages of visual hierarchy, we suggest that the neural substrates underlying the perception of static motion aftereffect and illusory contours are different.

Nonlinear coupling of neural activity and CBF in rodent barrel cortex

The relationship between neural activity and accompanying changes in cerebral blood flow (CBF) and oxygenation must be fully understood before data from brain imaging techniques can be correctly interpreted. Whether signals in fMRI reflect the neural input or output of an activated region is still unclear. Similarly, quantitative relationships between neural activity and changes in CBF are not well understood. The present study addresses these issues by using simultaneous laser Doppler flowmetry (LDF) to measure CBF and multichannel electrophysiology to record neural activity in the form of field potentials and multiunit spiking. We demonstrate that CBF-activation coupling is a nonlinear inverse sigmoid function. Comparing the data with previous work suggests that within a cortical model, CBF shows greatest spatial correlation with a current sink 500 microm below the surface corresponding to sensory input. These results show that care must be exercised when interpreting imaging data elicited by particularly strong or weak stimuli and that hemodynamic changes may better reflect the input to a region rather than its spiking output.

Eye movements: keeping vision stable

A long-standing problem for vision researchers is how our perception of the world remains stable despite the continual motion of our eyes. Three recent studies begin to shed light on how the visual system suppresses the motion generated by these eye movements.

The influence of motion-defined form on the perception of spatially-defined form

It is well established that the visual system is sensitive to the global structure--or "form"--of objects defined exclusively by spatial or motion cues, but it remains unclear how form perception combines spatial and motion cues if these are presented concurrently. In the present study, we introduce a novel class of stimuli where spatial-form and motion-form can be superimposed and manipulated independently. In both the spatial and motion domains, global structure consisted of radial-frequency (RF) contours defined by a virtual circle of Gabor elements whose positions and/or drift speeds were sinusoidally modulated at a specified frequency of polar angle. The first two experiments revealed that observers encode the global structure of spatial-RF and motion-RF contours presented in isolation. In a third experiment, observers detected a spatial-RF modulation superimposed on a motion-RF pedestal of identical radial frequency: results showed little facilitation at low pedestal amplitudes but significant masking at higher pedestal amplitudes, especially if the RF modulations of test and pedestal were in anti-phase. Additional experiments demonstrated that masking of the spatial-RF test is abolished if the global structure of the motion-RF pedestal is altered or destroyed while local motion cues are preserved. We argue these results cannot be explained by local neural interactions between spatial and motion cues and propose instead that data reflect higher-level interactions between separate visual pathways encoding spatial-form and motion-form.