Human cortical area responding to stimuli in apparent motion

Decoding information about dynamically occluded objects in visual cortex

During dynamic occlusion, an object passes behind an occluding surface and then later reappears. Even when completely occluded from view, such objects are experienced as continuing to exist or persist behind the occluder even though they are no longer visible. The contents and neural basis of this persistent representation remain poorly understood. Questions remain as to whether there is information maintained about the object itself (i.e. its shape or identity) or non-object-specific information such as its position or velocity as it is tracked behind an occluder, as well as which areas of visual cortex represent such information. Recent studies have found that early visual cortex is activated by "invisible" objects during visual imagery and by unstimulated regions along the path of apparent motion, suggesting that some properties of dynamically occluded objects may also be neurally represented in early visual cortex. We applied functional magnetic resonance imaging in human subjects to examine representations within visual cortex during dynamic occlusion. For gradually occluded, but not for instantly disappearing objects, there was an increase in activity in early visual cortex (V1, V2, and V3). This activity was spatially-specific, corresponding to the occluded location in the visual field. However, the activity did not encode enough information about object identity to discriminate between different kinds of occluded objects (circles vs. stars) using MVPA. In contrast, object identity could be decoded in spatially-specific subregions of higher-order, topographically organized areas such as ventral, lateral, and temporal occipital areas (VO, LO, and TO) as well as the functionally defined LOC and hMT+. These results suggest that early visual cortex may only represent the dynamically occluded object's position or motion path, while later visual areas represent object-specific information.

Keeping postdiction simple

Postdiction effects are phenomena in which a stimulus influences the appearance of events taking place before it. In metacontrast masking, for instance, a masking stimulus can render a target stimulus shown before the mask invisible. This and other postdiction effects have been considered incompatible with a simple explanation according to which (i) our perceptual experiences are delayed for only the time it takes for a distal stimulus to reach our sensory receptors and for our neural mechanisms to process it, and (ii) the order in which the processing of stimuli is completed corresponds with the apparent temporal order of stimuli. As a result, the theories that account for more than a single postdiction effect reject at least one of these theses. This paper presents a new framework for the timing of experiences-the non-linear latency difference view-in which the three most discussed postdiction effects-apparent motion, the flash-lag effect, and metacontrast masking-can be accounted for while simultaneously holding theses (i) and (ii). This view is grounded in the local reentrant processes, which are known to have a crucial role in perception. Accordingly, the non-linear latency difference view is both more parsimonious and more empirically plausible than the competing theories, all of which remain largely silent about the neural implementation of the mechanisms they postulate.

Contributions of magno- and parvocellular channels to conscious and non-conscious vision

The dorsal and ventral cortical pathways, driven predominantly by magnocellular (M) and parvocellular (P) inputs, respectively, assume leading roles in models of visual information processing. Although in prior proposals, the dorsal and ventral pathways support non-conscious and conscious vision, respectively, recent modelling and empirical developments indicate that each pathway plays important roles in both non-conscious and conscious vision. In these models, the ventral P-pathway consists of one subpathway processing an object's contour features, e.g. curvature, the other processing its surface attributes, e.g. colour. Masked priming studies have shown that feed-forward activity in the ventral P-pathway on its own supports non-conscious processing of contour and surface features. The dorsal M-pathway activity contributes directly to conscious vision of motion and indirectly to object vision by projecting to prefrontal cortex, which in turn injects top-down neural activity into the ventral P-pathway and there 'ignites' feed-forward-re-entrant loops deemed necessary for conscious vision. Moreover, an object's shape or contour remains invisible without the prior conscious registration of its surface properties, which for that reason are taken to comprise fundamental visual qualia. Besides suggesting avenues for future research, these developments bear on several recent and past philosophical issues.

Effects of inverting contour and features on processing for static and dynamic face perception: an MEG study

We investigated the effects of inverting facial contour (hair and chin) and features (eyes, nose and mouth) on processing for static and dynamic face perception using magnetoencephalography (MEG). We used apparent motion, in which the first stimulus (S1) was replaced by a second stimulus (S2) with no interstimulus interval and subjects perceived visual motion, and presented three conditions as follows: (1) U&U: Upright contour and Upright features, (2) U&I: Upright contour and Inverted features, and (3) I&I: Inverted contour and Inverted features. In static face perception (S1 onset), the peak latency of the fusiform area's activity, which was related to static face perception, was significantly longer for U&I and I&I than for U&U in the right hemisphere and for U&I than for U&U and I&I in the left. In dynamic face perception (S2 onset), the strength (moment) of the occipitotemporal area's activity, which was related to dynamic face perception, was significantly larger for I&I than for U&U and U&I in the right hemisphere, but not the left. These results can be summarized as follows: (1) in static face perception, the activity of the right fusiform area was more affected by the inversion of features while that of the left fusiform area was more affected by the disruption of the spatial relation between the contour and features, and (2) in dynamic face perception, the activity of the right occipitotemporal area was affected by the inversion of the facial contour.

Do we have independent visual streams for perception and action?

The perception-action model proposes that vision-for-perception and vision-for-action are based on anatomically distinct and functionally independent streams within the visual cortex. This idea can account for diverse experimental findings, and has been hugely influential over the past two decades. The model itself comprises a set of core contrasts between the functional properties of the two visual streams. We critically review the evidence for these contrasts, arguing that each of them has either been refuted or found limited empirical support. We suggest that the perception-action model captures some broad patterns of functional localization, but that the specializations of the two streams are relative, not absolute. The ubiquity and extent of inter-stream interactions suggest that we should reject the idea that the ventral and dorsal streams are functionally independent processing pathways.

Abnormalities of coherent motion processing in strabismic amblyopia: Visual-evoked potential measurements

Coherent motion responses of patients with mild to moderate strabismic amblyopia were compared to those of normals using visual-evoked potentials (VEPs). Responses were elicited by dynamic random-dot kinematograms that alternated at 0.83 Hz between globally coherent (left-right) and incoherent (random) motion states. Tuning curves were measured at the first harmonic of the global motion update rate (0.83 Hz) and at the first harmonic of the dot update rate (20 Hz) for spatial displacements 3.1 to 27.9 arcmin (1.6 to 9.3 deg/s). Responses locked to the changes in the global organization of the local direction vectors were an inverted U-shaped function of displacement/speed in the normal-vision observers and in the fellow eyes of the strabismus patients while the tuning function of the amblyopic eyes was shifted to larger displacements/higher speeds. Responses at the dot update rate were reduced in amplitude and altered in timing in both eyes of the patients. The results are consistent with both local and global deficits in motion processing in strabismic amblyopia.

Repetitive transcranial magnetic stimulation of human MT+ reduces apparent motion perception

We investigated the effects of repetitive transcranial magnetic stimulation (rTMS) over the human cerebral cortex on apparent motion perception. Previous studies have shown that human extrastriate visual area MT+ (V5) processes not only real but also apparent motion. However, the functional relevance of MT+ on long-range apparent motion perception remains unclear. Here, we show direct evidence for the involvement of MT+ in apparent motion perception using rTMS, which is known to temporarily inhibit a localized region in the cerebral cortex. The results showed that apparent motion perception decreased after applying rTMS over MT+, but not after applying rTMS over the control region (inferior temporal gyrus). The decrease in performance caused by applying rTMS to MT+ suggests that MT+ is a causally responsible region for apparent motion perception, and thus, further supports the idea that MT+ plays a major role in the perception of motion.

Human cortical response to various apparent motions: A magnetoencephalographic study

The human visual system is considered to have at least two different mechanisms for perceiving motions: one for luminance-based (first-order) motions and another for non-luminance-based (second-order) motions. In this study, we examined the perception of first- and second-order motions using four different types of stimulus cues (luminance, contrast, texture, and flicker) while using whole head magnetoencephalography (MEG) to measure human brain responses to those apparent motions. MEG responses to all stimuli were recorded from the occipito-temporal area (possibly human MT/V5+), and response properties (peak latency and amplitude) varied with stimulus cues. Further, we observed various effects of luminance-addition to the non-luminance cues on the response properties that could not be explained by the magnetic field distribution and/or the visibility of the stationary object. The results indicate that differences in response properties elicited by various stimulus cues represent differences in the neural processes underlying apparent motions with various cues. We suggest that the distinct "preprocessing" of each stimulus cue occurs before the common process for apparent motion, and the response property changes associated with different cues are related to differences in preprocessing that may occur in a distributed cortical network that include the striate and extrastriate visual cortex.

A primer on motion visual evoked potentials

Motion visual evoked potentials (motion VEPs) have been used since the late 1960s to investigate the properties of human visual motion processing, and continue to be a popular tool with a possible future in clinical diagnosis. This review first provides a synopsis of the characteristics of motion VEPs and then summarizes important methodological aspects. A subsequent overview illustrates how motion VEPs have been applied to study basic functions of human motion processing and shows perspectives for their use as a diagnostic tool.

Effects of face contour and features on early occipitotemporal activity when viewing eye movement

We investigated whether early activity in the occipitotemporal region, corresponding to human MT/V5, is influenced by a face contour and/or features such as the mouth using magnetoencephalography (MEG). We used apparent motion as visual stimuli and compared four conditions as follows: (1) CDL: A schematic face consisting of a face Contour, two Dots and a horizontal Line (2) CD: The Contour and two Dots (3) DL: Two Dots and a horizontal Line and (4) D: Two Dots only. Subjects described a simple movement of dots for D, but eye movement for CDL, DL and CD, though movement modalities were the same through all conditions. We used a single equivalent current dipole (ECD) model within 145-220 ms after stimulus onset and estimated the location, dipole moment (strength) and peak latency. There were no significant differences in the peak latency of the estimated dipoles between each condition, but the activity was significantly stronger for CDL than for CD (p<0.05), DL (p<0.01), and D (p<0.01) in the right hemisphere, and DL and D (p<0.01) in the left. These results indicated that there is specific information processing for eye movements in the occipitotemporal region, the human MT/V5 homologue, and this activity was significantly influenced by whether movements appeared with the face contour and/or features, in other words, whether the eyes moved or not, even if the movement itself was the same.

Magnetoencephalography: In search of neural processes for visual motion information

Magnetoencephalography (MEG) has become a standard approach to the investigation of human brain functions. This review starts with a brief review of the human visual system and studies on visual motion detection mechanisms is followed by the presentation of MEG studies that have contributed to the field. Emphasis is placed on the fact that because the neural activities measured in functional magnetic resonance imaging (fMRI) differ substantially from those measured in MEG--fMRI data cannot be used directly to estimate MEG signal sources. The basic ideas behind the methods of signal processing and analyses generally used in MEG studies are described and theoretical considerations of the neural mechanisms determining MEG response latency and amplitude changes are discussed. Here, scalar fields theory is proposed to explain MEG responses to incoherent motions, and the ways in which detection of complex motions such as transparency, rotation and expansion can be explained by this theory are also presented. Relationships between human behavioral reaction time and MEG response latency suggest a new concept underlying the reasons why humans are late in detecting slow motion.

An MEG study into the visual perception of apparent motion in depth

This study investigated (1) the responses associated with the perception of motion in depth induced by a series of scale-changing paradigms, and (2) the locations of the dipoles in the brain elicited by stimuli of motion in depth and in-plane motion. The former was determined using two types of stimulation: real motion and apparent motion in scale (AMS; where two frames with size-changed patterns were presented alternately); and the latter was determined by moving a full-field checkerboard pattern forward or rightward smoothly with the same time course. The results from analyzing magnetoencephalography (MEG) component M160 to differentiate the signals of perception can be summarized as follows: (1) the neurons stimulated by apparent motion (AM) might be similar to those stimulated by a real motion, since there was no statistical difference associated with the signals at M160 and the dipole locations; (2) the perceptional signal of motion in depth seems to be more sensitive when scale-changing information is present; and (3) asymmetrical responses are present in the visual system, with responses being more sensitive to expanding stimuli than to contracting ones, and with the activity being more prominent in the right occipitotemporal area. Overall, this study indicates that the responses evoked by the stimuli causing motion in depth are allocated more to area V3a rather to area V5.

Motion standstill leads to activation of inferior parietal lobe

Previous studies on motion perception revealed motion-processing brain areas sensitive to changes in luminance and texture (low-level) and changes in salience (high-level). The present functional magnetic resonance imaging (fMRI) study focused on motion standstill. This phenomenon, occurring at fast presentation frequencies of visual moving objects that are perceived as static, has not been previously explored by neuroimaging techniques. Thirteen subjects were investigated while perceiving apparent motion at 4 Hz, at 30 Hz (motion standstill), isoluminant static and flickering stimuli, fixation cross, and blank screen, presented randomly and balanced for rapid event-related fMRI design. Blood oxygenation level-dependent (BOLD) signal in the occipito-temporal brain region MT/V5 increased during apparent motion perception. Here we could demonstrate that brain areas like the posterior part of the right inferior parietal lobule (IPL) demonstrated higher BOLD-signal during motion standstill. These findings suggest that the activation of higher-order motion areas is elicited by apparent motion at high presentation rates (motion standstill). We interpret this observation as a manifestation of an orienting reaction in IPL towards stimulus motion that might be detected but not resolved by other motion-processing areas (i.e., MT/V5).

Human MT/V5 activity on viewing eye gaze changes in others: A magnetoencephalographic study

The present study used magnetoencephalography (MEG) to investigate human MT/V5 activity when observing changes in eye gaze. Subjects viewed a face in which the eyes changed to look either directly at (BACK) or away from (AWAY) the subject in a series of apparent motion conditions. BACK involved 2 directions, from left to center (LC) and from right to center (RC). Likewise, AWAY involved 2 directions, from center to left (CL) and from center to right (CR). A clear MEG component, 1M, was elicited with all eye gaze changes. Mean peak latency was 157 ms and was unaffected by stimulus condition. The equivalent current dipole (ECD) was localized to human MT/V5. Two main effects were noted: (1) ECD moment was significantly larger for BACK than for AWAY; and (2) 1M ECD locations were more posterior for AWAY than for BACK. Gaze direction, with LEFT involving CL and RC and RIGHT involving CR and LC, showed no significant effects. These data indicate that MT/V5 responds to gaze direction rather than eye position, and that eye movements directed at the viewer elicit the strongest effects. Processing of gaze change is NOT sensitive to eye direction per se but rather is modulated by eye gaze relative to the viewer.

Maturation of luminance- and motion-defined form perception beyond adolescence: a combined ERP and fMRI study

Abilities to discriminate forms defined by motion continue to develop throughout childhood. To investigate late development of the visual motion system, we measured brain activity with event-related EEG potentials (ERPs) and functional magnetic resonance imaging (fMRI) in groups of adolescents (15-17 years) and adults (20-30 years) during a visual form discrimination task--with forms being either defined by motion or luminance contrast. We further explored whether possible developmental changes varied with the degree of motion coherence reflecting maturation specific to global motion processing. Both the fMRI activation patterns and ERP topographies were very similar between adolescents and adults, suggesting that the basic visual networks for processing motion and form are established by the age of 15-17. The ERP response to luminance- and motion-defined forms was dominated by a posterior negativity (N1: 120-270 ms). The N1 of the motion contrast was delayed in adolescents, whereas the N1 of the static condition did not differ between groups. Since the motion-evoked N1 is thought to arise in the middle temporal area MT/V5, our results indicate that visual motion processing in MT continues to get faster, becoming still more efficient during late development. Neither the ERP nor the fMRI results revealed maturation effects specific to motion coherence. This indicates that the specific mechanisms to process global dot motion are already mature in adolescence. The present findings support the view that static perception matures earlier than dynamic perception, and that these visual systems have different developmental courses.

Studies of human visual pathophysiology with visual evoked potentials

Visual evoked potentials (VEPs) offer reproducible and quantitative data on the function of the visual pathways and the visual cortex. Pattern reversal VEPs to full-field stimulation are best suited to evaluate anterior visual pathways while hemi-field stimulation is most effective in the assessment of post-chiasmal function. However, visual information is processed simultaneously via multiple parallel channels and each channel constitutes a set of sequential processes. We outline the major parallel pathways of the visual system from the retina to the primary visual cortex and higher visual areas via lateral geniculate nucleus that receive visual input. There is no best method of stimulus selection, rather visual stimuli and VEPs' recording should be tailored to answer specific clinical and/or research questions. Newly developed techniques that can assess the functions of extrastriate as well as striate cortices are discussed. Finally, an algorithm of sequential steps to evaluate the various levels of visual processing is proposed and its clinical use revisited.

Asymmetric modulation of human visual cortex activity during 10° lateral gaze (fMRI study)

We used BOLD fMRI to study the differential effects of the direction of gaze on the visual and the ocular motor systems. Fixation of a target straight ahead was compared to fixation of a target 10 degrees to the right and 10 degrees to the left from gaze straight ahead, and to eyes open in complete darkness in thirteen healthy volunteers. While retinotopic coordinates remained the same in all fixation conditions, the fixation target shifted with respect to a head-centered frame of reference. During lateral fixation, deactivations in higher-order visual areas (one ventral cluster in the lingual and fusiform gyri and one dorsal cluster in the postero-superior cuneus) and, as a trend, activations in early visual cortical areas were found predominantly in the hemisphere contralateral to the fixation target. We propose that visual processing is performed predominantly in the hemisphere contralateral to gaze direction, even during small gaze shifts into one visual hemifield. The excitability of visual neurons may be modulated depending on eye position to construct a head-centered frame of reference from a retinotopic input, thus allowing perceptual stability of space during eye movements. A further finding was that BOLD signal increases in fronto-parietal ocular motor and attentional structures were more pronounced during lateral than central fixation.

Involvement of V5/MT+ in object substitution masking: evidence from repetitive transcranial magnetic stimulation

The visibility of a briefly presented target can be reduced by a subsequent weak mask that does not touch it, when the target is encoded in low spatiotemporal resolution. This phenomenon, called object substitution masking, has recently been proposed to reflect information updating in object-level representation, with perception of the target and the mask belonging to a single object through apparent motion. We investigated this issue by applying repetitive transcranial magnetic stimulation over V5/MT+, specialized in visual motion processing. The transient functional disruption of V5/MT+ produced by repetitive transcranial magnetic stimulation attenuated object substitution masking, while sham stimulation did not. Our results suggest that object substitution masking is mediated by normal functioning of V5/MT+. We conclude that repetitive transcranial magnetic stimulation of V5/MT+ impaired perceived object continuity and reduced object substitution masking accordingly.

Mechanisms of face perception in humans: A magneto- and electro-encephalographic study

We have been studying the underlying mechanisms of face perception in humans using magneto- (MEG) and electro-encephalography (EEG) including (1) perception by viewing the static face, (2) differences in perception by viewing the eyes and whole face, (3) the face inversion effect, (4) the effect of gaze direction, (5) perception of eye motion, (6) perception of mouth motion, and (7) the interaction between auditory and visual stimuli related to the vowel sounds. In this review article, we mainly summarize our results obtained on 3, 5, and 6 above. With the presentation of both upright and inverted unfamiliar faces, the inferior temporal cortex (IT) centered on the fusiform gyrus, and the lateral temporal cortex (LT) near the superior temporal sulcus were activated simultaneously, but independently, between 140 and 200 ms post-stimulus. The right hemisphere IT and LT were both active in all subjects, and those in the left hemisphere in half of the subjects. Latencies with inverted faces relative to those with upright faces were longer in the right hemisphere, and shorter in the left hemisphere. Since the activated regions under upright and those under inverted face stimuli did not show a significant difference, we consider that differences in processing upright versus inverted faces are attributable to temporal processing differences rather than to processing of information by different brain regions. When viewing the motion of the mouth and eyes, a large clear MEG component, 1M (mean peak latency of approximately 160 ms), was elicited to both mouth and eye movement, and was generated mainly in the occipito-temporal border, at human MT/V5. The 1M to mouth movement and the 1M to eye movement showed no significant difference in amplitude or generator location. Therefore, our results indicate that human MT/V5 is active in the perception of both mouth and eye motion, and that the perception of movement of facial parts is probably processed similarly.

Activation in the MT-complex during visual perception of apparent motion and temporal succession

Previous studies have shown that MT (i.e., the MT-complex) is activated during visual perception of apparent motion. To further explore the function of MT, we measured activation in MT by positron emission tomography (PET) using a broad range of stroboscopic stimulus events in which (a) the frame rate was so fast that observers perceived stimulus frames as simultaneous, (b) the frame rate was slower and generated compelling impressions of apparent motion, or (c) the frame rate was so slow that observers perceived temporal succession (successive views of the same objects at different locations) instead of motion. As expected, the simultaneity condition showed no activation (reliable increase in regional cerebral blood flow, rCBF) in MT whereas the motion condition showed activation in both left and right MT. However, the succession condition showed even stronger activation in left and right MT than did the motion condition. MT seems implicated in perception of retinal stimuli as successive views of the same object at different locations whether or not the views are connected by apparent motion.

Subregions of human MT complex revealed by comparative MEG and direct electrocorticographic recordings

OBJECTIVE

To locate the visual motion complex (MT+) and study its response properties in an epilepsy surgery patient.

METHODS

A 17-year-old epilepsy patient underwent invasive monitoring with subdural electrodes in the right temporo-parieto-occipital area. MT+ was investigated by cortical electric stimulation and by epicortical visual evoked potentials time-locked to motion onset of sinusoidal gratings (motion VEP). Motion-related visual evoked magnetic field (motion VEF) was also recorded before the electrode implantation to complement the invasive recording.

RESULTS

Motion VEPs revealed two subregions within MT+, generating early and late potentials respectively. The early activity with a peak around 130 ms was localized at a single electrode situated immediately caudal to the initial portion of the ascending limb of the superior temporal sulcus (AL-STS). The late activity, peaking at 242-274 ms, was located ventro-rostrally over three electrodes. Among the four electrodes with motion VEPs, cortical stimulation at the most caudal pair elicited motion-in-depth perception involving the whole visual field. In addition to two subregions revealed on the gyral crown, magnetoencephalography (MEG) demonstrated another subregion with a late motion VEF in AL-STS immediately rostral to the electrode with the early motion VEP.

CONCLUSIONS

In combination with MEG recording, the present invasive exploration demonstrated human MT+ in a focal area of the temporo-parieto-occipital junction and delineated possible three subregions as indicated by the different latencies and distributions of the motion VEP/VEFs.

SIGNIFICANCE

Comparative MEG and direct electrocorticographic recordings delineated possible subregions within the human MT complex.

Magnetoencephalographic study of occipitotemporal activity elicited by viewing mouth movements

OBJECTIVE

We studied the temporal and spatial characteristics of neural responses elicited by viewing mouth movements using magnetoencephalography.

METHODS

We focused on differences in responses to mouth opening and closing movements by apparent motion, using an averting eyes condition as a control.

RESULTS

A large clear MEG component, 1 M (mean peak latency of approximately 160 ms), was elicited by both mouth movements. We modeled the neural sources using a brain electric source analysis (BESA) method and placed the sources around: (1) the occipitotemporal border at human MT/V5, (2) the primary visual cortex (V1), and (3) fusiform gyrus. The calculated activity of Source (1) was large whereas the activity of the others was small or negligible. Source (1), as calculated separately for mouth closing and opening movements and eye movement, showed no significant different amplitude and locations. We did not find any activity in the superior temporal sulcus (STS).

CONCLUSIONS

Our results indicate that human MT/V5 is active in the perception of both mouth and eye motions. Viewing mouth and eye movements elicits no significant differences in MT/V5 activity, indicating that the perception of movement of facial parts is probably processed in the same manner.

SIGNIFICANCE

Characteristic activities in the human MT/V5 elicited by viewing mouth movement were clarified by MEG.

Adaptation to apparent motion in crowding condition

Visual adaptation has been successfully used for studying the neural activity of different cortical areas in response to visual stimuli when observers do not have explicit conscious access to those stimuli. We compared the orientation selective adaptation to apparent motion and its effect on the perception of stimuli with bistable apparent motion in crowded and non-crowded conditions. In the crowding paradigm conscious access to a visual stimulus is severely impaired when it is flanked by other similar stimuli in the peripheral visual field. As expected, adaptation to the target stimulus occurred in the non-crowded condition in all of the individual subjects (n=4; P<0.001). Although in the crowded condition subjects were not able to discriminate the target stimulus, adaptation to that stimulus was still preserved (P<0.001). There was no significant difference between the adaptations in the two conditions of the apparent motion (P>0.05). Imaging studies have shown that V5 cortex is the earliest visual area that specifically responds to apparent motion. Our results suggest that in certain conditions V5 may be activated while there is no explicit conscious access to the apparent motion.

Unconscious Orientation Processing

Recent findings have shown that certain attributes of visual stimuli, like orientation, are registered in cortical areas when the stimulus is unresolvable or perceptually invisible; however, there is no evidence to show that complex forms of orientation processing (e.g., modulatory effects of orientation on the processing of other features) could occur in the absence of awareness. To address these questions, different psychophysical paradigms were designed in six experiments to probe unconscious orientation processing. First we demonstrated orientation-selective adaptation and color-contingent orientation adaptation for peripheral unresolvable Gabor patches. The next experiments showed the modulatory effects of perceptually indiscriminable orientations on apparent motion processing and attentional mechanisms. Finally we investigated disappearance patterns of unresolvable Gabor stimuli during motion-induced blindness (MIB). Abrupt changes in local unresolvable orientations truncated MIB; however, orientation-based grouping failed to affect the MIB pattern when the orientations were unresolvable. Overall results revealed that unresolvable orientations substantially influence perception at multiple levels.

Perception of apparent motion in depth: a high-density electrical mapping study in humans

We evaluated brain activity using 64-channel visual evoked potentials (VEPs) while subjects perceived apparent motion in depth. Checkerboard patterns (CBPs) within small and large circles were presented in turn as experimental conditions. Motion in depth was perceived when the CBP in the large circle was coarser than in the small circle; when coarseness did not change, no motion in depth was perceived. As control conditions only fine or coarse CBPs were presented. We used ANOVA to compare VEPs associated with experimental vs. control conditions and with coarse vs. fine CBPs. Negative potentials at a latency near 190 ms showed statistically significant interactions between these comparisons in the right lateral occipital and posterior parietal areas when apparent motion in depth was perceived. This suggests that higher tiers of the dorsal stream mediate this motion perception.

Temporal structure of the apparent motion perception: a magnetoencephalographic study

Humans perceive motion when numerous small dots pattern is followed by one of the same pattern but with all the dots shifted a little in one direction. When the amount of shift exceeds a level humans no more perceive motion even though physical visual information does not change. Using this stimulus, we addressed to elucidate the temporal structure of the neural activity related to this apparent motion perception. The magnetic responses to the random-dot patterns with various amounts of shift were measured while the subjects were performing a direction discrimination task. A significant magnetic response amplitude change occurred with three distinct peaks when the response inducing apparent motion was compared with those inducing no motion without change in the response latencies. The major difference occurred at about 110, 140, 210 ms after the stimulus onset. The response origin was always within the occipitotemporal area. The results indicate that the neural activity for the perception of apparent motion can be measured by MEG that occur at least 110 ms after the stimulus onset possibly in the human MT+. Three distinct peaks in the response difference may represent the sequential multiple neural process proposed theoretically though further study is necessary to prove.

Precise Oculomotor Correlates of Visuospatial Mental Rotation and Circular Motion Imagery

Visual imagery is a basic form of cognition central to activities such as problem solving or creative thinking. Phenomena such as mental rotation, in which mental images undergo spatial transformations, and motion imagery, in which we imagine objects in motion, are very elusive. For example, although several aspects of visual imagery and mental rotation have been reconstructed through mental chronometry, their instantaneous evolution has never been directly observed. We paired mental chronometry to eye movement recording in subjects performing a visuospatial mental rotation task and an instructed circular motion imagery task. In both tasks, sequences of spontaneous saccades formed curved trajectories with a regular spatio-temporal evolution. In the visuospatial mental rotation task, saccadic amplitude decreased progressively within each sequence, resulting in an average gaze rotation with a bell-shaped asymmetrical angular velocity profile whose peak and mean increased with the amount of the to-be-performed rotation, as in reaching movements. In the second task, the average gaze rotation reproduced faithfully the to-be-imagined constant-velocity circular motion, thus excluding important distortions in the oculomotor performance. These findings show for the first time the instantaneous spatio-temporal evolution of mental rotation and motion imagery. Moreover, the fact that visuospatial mental rotation is modeled as a reaching act suggests that reaching pertains to the realm of visuospatial thinking, rather than being restricted to the motor domain. This approach based on eye movement recording can be profitably coupled to methods such as event-related potentials, transcranial magnetic stimulation, or functional magnetic resonance to study the precise neuronal dynamics associated with an ongoing mental activity.

Physiological evidence of interaction of first- and second-order motion processes in the human visual system: a magnetoencephalographic study

Humans have several mechanisms for the visual perception of motion, including one that is luminance-based (first-order) and another that is luminance-independent (second-order). Recent psychophysical studies have suggested that significant interaction occurs between these two neural processes. We investigated whether such interactions are represented as neural activity measured by magnetoencephalography (MEG). The second-order motion of a drifting sinusoidal grating, which is defined by the speed of the dot motion, did not generate a response. Apparent motion (AM) of the square area, defined by the speed of randomly moving dots, evoked a magnetic response whose latency and amplitude changed with the distance that the area moved (a second-order characteristic), though the response properties were significantly different from those for the first-order AM. AM, defined by both first- and second-order attributes, evoked an MEG response and the latencies and the amplitudes were distributed between those for the first- and second-order motions. The cortical source of the response was estimated to be around MT+. The results show a distinct difference in the neural processing of the second-order motion that cannot be explained by the difference in visibility, and they indicate that the interaction of the neural processes underlying first- and second-order motion detection occurs before the MEG response. Our study provides the first physiological evidence of a neural interaction between the two types of early motion detection.

Spatiotemporal separability in the human cortical response to visual motion speed: a magnetoencephalography study

Humans can estimate the speed of an object's motion independently of other visual information. Although speed-related neural activity is known to exist in the primate brain, there has been no physiological study that investigated where and how the speed of motion is represented in the human brain. Nine different combinations of spatial and temporal frequencies were used to make drifting sinusoidal grating of five different speeds (from 1.5 to 24 deg/s). Using the stimuli, we evaluated whether the magnetoencephalographic response property changes were due to a speed-tuned mechanism or to separable spatial and temporal frequency detection mechanisms. The latency change was caused mainly by an inseparable speed-tuned mechanism. In contrast, the amplitude was inversely related to the spatial frequency and was also affected by the temporal frequency differently depending on the frequency. Our results support the view that the human visual system has three sets of mechanisms tuned to spatial frequency, temporal frequency, and speed.

Human cortical response to incoherent motion on a background of coherent motion

To investigate whether humans achieve a high sensitivity to coherent motion by excluding the response to incoherent motion, we measured the magnetoencephalographic response to the motion of randomly located dots one half of which moved coherently while the other half moved incoherently. The response was related to the faster motion of either coherent or incoherent motion though the observers saw both. All the estimated response sources were within the extrastriate area. The results indicate that incoherent motion is represented in the neural activity of the human extrastriate area even when the coherent motion is perceived at the same time. The fact that the neural activity for the slower coherent motion is not represented in the magnetic response suggests the existence of interaction between the neural activities for the two motions.

Apparent motion cues distort object localisation in egocentric space

The visual localisation of objects in space is thought to rely on retinal information defining the environmental context and non-retinal cues from proprioception and motor commands. Here, the influence of dynamic contextual cues on the perception of egocentric space in a reaching task was investigated. Compared to performances with realistic motion or static cues, target localisation was less accurate when apparent motion was used to provide contextual information about space between the hand and the target. This effect could not be explained by the 'presence' of motion, or a bias in depth perception. Since the distortion was connected with the reaching area it was concluded that cognitive factors can unconsciously influence the perception of egocentric space, in particular distance estimation. We propose a mechanism for this whereby signals from areas MT/MST (middle temporal/medial superior temporal) create a perceptual bias through cortico-cortical connections with posterior parietal cortex.

Central versus peripheral visual field stimulation results in timing differences in dorsal stream sources as measured with MEG

Small, achromatic circular sinusoids were presented in the central and peripheral visual fields to investigate dorsal visual stream activation. It was hypothesized that peripheral stimulation would lead to faster onset latencies, as well as preferentially activate dorsal stream visual areas relative to central field stimulation. Although both central and peripheral stimulation activated similar areas, the onset latencies of neuromagnetic sources in two dorsal stream areas were found to be significantly shorter for peripheral versus central field stimulation. The results suggest that information from central versus peripheral fields arrives in the higher-order visual areas via different routes.

Visual information process in Williams syndrome: intact motion detection accompanied by typical visuospatial dysfunctions

It has been suggested that visuospatial cognitive disabilities seen in children with Williams syndrome (WMS) are related to a dysfunction of the dorsal stream in the visual information analysis system. We investigated whether visual motion detection is also impaired in WMS because it is one of the main functions of the dorsal stream. Using various psychophysical examinations and magnetoencephalography, we studied a child with WMS who had the typical features of the syndrome. We found profound impairments in the visuospatial cognitions, as previously reported in WMS. In contrast, he had normal ability for the direction discrimination of coherent motion on a background of randomly moving dots, and he perceived apparent motion as do normal children. Furthermore, the latencies of both responses to the coherent and incoherent motions as measured by magnetoencephalography were within the mean +/- 2 SD among normal adults and the estimated origins were near the human homologue of V5/MT (visual area 5/middle temporal area). The results indicate that the visuospatial cognitive deficits in WMS can occur without impairment of the visual motion detection. We consider that the deficits are caused by a restricted dysfunction of the neural groups for position and three-dimensional form perceptions in the dorsal stream of the visual system, though other possibilities are not excluded.

Human cortical responses to coherent and incoherent motion as measured by magnetoencephalography

To investigate the detail response properties for the incoherent motion of the human visual system, we measured the magnetoencephalographic neural responses to both coherent and incoherent motions at various speeds (from 0.65 to 20.6 degrees /s). The peak latency of the first component of the response from the extrastriate area was inversely related to the speed of motion (from 228 to 155 ms in mean) and there was no significant difference in the latency change between the two types of motion. There were significant differences in the peak amplitude change with the motion speed and a difference in the distribution of the magnetic fields of the responses was seen in six of the seven subjects. The results show that the speed of the incoherently moving dots is represented in the human visual system in the same manner as that of coherently moving dots. The differences in the magnetic fields between the two responses indicate that the same speed-related response changes can occur with different neural populations responsible for both motions.

Visual detection of motion speed in humans: spatiotemporal analysis by fMRI and MEG

Humans take a long time to respond to the slow visual motion of an object. It is not known what neural mechanism causes this delay. We measured magnetoencephalographic neural responses to light spot motion onset within a wide speed range (0.4-500 degrees /sec) and compared these with human reaction times (RTs). The mean response latency was inversely related to the speed of motion up to 100 degrees /sec, whereas the amplitude increased with the speed. The response property at the speed of 500 degrees /sec was different from that at the other speeds. The speed-related latency change was observed when the motion duration was 10 msec or longer in the speed range between 5 and 500 degrees /sec, indicating that the response is directly related to the speed itself. The source of the response was estimated to be around the human MT+ and was validated by functional magnetic imaging study using the same stimuli. The results indicate that the speed of motion is encoded in the neural activity of MT+ and that it can be detected within 10 msec of motion observation. RT to the same motion onset was also inversely related to the speed of motion but the delay could not be explained by the magnetic response latency change. Instead, the reciprocal of RT was linearly related to the reciprocal of the magnetic response latency, suggesting that the visual process interacts with other neural processes for decision and motor preparation.

Distinguishing subregions of the human MT+ complex using visual fields and pursuit eye movements

In humans, functional imaging studies have demonstrated a homologue of the macaque motion complex, MT+ [suggested to contain both middle temporal (MT) and medial superior temporal (MST)], in the ascending limb of the inferior temporal sulcus. In the macaque monkey, motion-sensitive areas MT and MST are adjacent in the superior temporal sulcus. Electrophysiological research has demonstrated that while MT receptive fields primarily encode the contralateral visual field, MST dorsal (MSTd) receptive fields extend well into the ipsilateral visual field. Additionally, macaque MST has been shown to receive extraretinal smooth-pursuit eye-movement signals, whereas MT does not. We used functional magnetic resonance imaging (fMRI) and the neural properties that had been observed in monkeys to distinguish putative human areas MT from MST. Optic flow stimuli placed in the full field, or contralateral field only, produced a large cluster of functional activation in our subjects consistent with previous reports of human area MT+. Ipsilateral optic flow stimuli limited to the peripheral retina produced activation only in an anterior subsection of the MT+ complex, likely corresponding to putative MSTd. During visual pursuit of a single target, a large portion of the MT+ complex was activated. However, during nonvisual pursuit, only the anterolateral portion of the MT+ complex was activated. This subsection of the MT+ cluster could correspond to putative MSTl (lateral). In summary, we observed three distinct subregions of the human MT+ complex that were arranged in a manner similar to that seen in the monkey.

Attention and visual interference stimulation affect somatosensory processing: a magnetoencephalographic study

In our previous study, continuous visual (cartoon and random dot motion) and auditory (music) stimulation changed the somatosensory evoked magnetic fields following electrical stimulation of the median nerve in human subjects. They enhanced the middle-latency components (3M and 4M) generated in the contralateral primary somatosensory cortex, and reduced the MI component generated in the ipsilateral secondary somatosensory cortex. We speculated that such interference effects were caused by activation of polymodal neurons in areas 5 and/or 7 of the parietal lobe as well as in the medial superior temporal region and superior temporal sulcus. However, we could not exclude the effect of attention on such interference effects. In the present study, to know the effect of attention on visual and auditory interference in these changes, we stimulated the bilateral median nerves unilaterally in a random order, and asked subjects to count the number of times the left median nerve was stimulated while visual or auditory interference was applied. Five components (1M-5M) were identified in the hemisphere contralateral to the stimulated nerve and only one component (MI) was found in the ipsilateral hemisphere. The 3M and 4M components (33-75 ms in latency) were enhanced by both attention and visual interference stimulation but not by auditory stimulation. The 5M component (70-115 ms) and MI component (70-133 ms) were enhanced by attention, but were not changed by attention together with visual or auditory interference. Summarizing the results of our previous study and the present study, (1) visual interference alone enhanced the 3M and 4M but reduced the MI, and (2) attention alone also enhanced the 3M and 4M, and enhanced the 5M and MI. As a result, (3) visual interference with attention enhanced the 3M and 4M more, and showed no significant change of the 5M and MI. This was compatible with a summation of the effects caused by visual interference alone and attention alone, but some interactions between visual interference and attention might have taken place. The locations of dipoles of all components were not significantly changed by attention or any interference stimulation. These findings support the idea that there are significant interactions of activities relating to somatosensory stimulation, visual stimulation and cognitive function, in both the primary and the secondary somatosensory cortex in humans.

The effect of stimulus repetition on cortical magnetic responses evoked by words and nonwords

Stimulus repetition improves performance and modulates event-related brain potentials in word recognition tasks. We recorded evoked magnetic responses from bilateral temporal sites of the brain to determine the cortical area related to the word repetition effect. Fourteen Japanese volunteers read words or pronounceable nonwords, some of which occurred twice with a lag of eight items. Clear magnetic responses were observed bilaterally. In the left hemisphere, a reduction of the magnetic responses by repetition was observed for words but not for nonwords in the latency range of 300-500 ms poststimulus. The sources of the responses were estimated to be in the left perisylvian area adjacent to the auditory cortex and the left parietal area. Only the perisylvian source activity showed the reduction by the word repetition. The left perisylvian area was thus suggested to be related to the word repetition effect. The activity in this area might be associated with the lexical memory process.

Neural Correlates of Naming Actions and of Naming Spatial Relations

Ina [(15)O] water PET experiment, 10 normal subjects retrieved words denoting actions (performed with or without an implement), and another 10 normal subjects retrieved words denoting the spatial relations between objects. Our objective was to test the following hypothesis: that the salient neural activity associated with naming actions and spatial relations occurs in left frontal operculum and left parietal association cortices, but not in the left inferotemporal cortices (IT) or in the right parietal association cortices. There were two control tasks, one requiring a decision on the orientation of unknown faces (a standard control task in our laboratory) and another requiring the retrieval of words denoting the concrete entities used in the action and spatial relations tasks. In accordance with the hypothesis, both naming actions and spatial relations (using the face orientation task as control activated the left frontal operculum; naming actions also activated the left parietal lobe. However, sectors of the left posterior IT were also engaged in both naming actions and spatial relations. When the naming of concrete entities was subtracted from the naming of actions performed with such entities, area MT in the posterior temporo-occipital region was activated bilaterally. On the other hand, when naming of the concrete entities was subtracted from the naming of spatial relations, left parietal activation was found, and when two tasks of naming spatial relations were contrasted to each other bilateral parietal activation was seen, right when abstract stimuli were used and left when concrete objects were used. The activity in posterior IT is thought to be related to object processing and possibly name retrieval at a subconscious level.

Occipitotemporal activity elicited by viewing eye movements: a magnetoencephalographic study

The temporal and spatial processing of viewing eye movements was studied by magnetoencephalography (MEG) in six normal subjects. Three visual stimulus types were studied: (1) moving eyes (EYES), (2) moving simulated eyes (SIM), consisting of checks moving in the same spatial location as EYES, and (3) an inwardly moving radial pattern (RADIAL). A large clear MEG component, 1M, with mean peak latency of approximately 170 ms, was seen in the right hemisphere to RADIAL and EYES in all six subjects. The 1M to EYES was significantly longer in latency and smaller in amplitude than that seen to RADIAL. A left hemisphere 1M to EYES and RADIAL was seen in three of six subjects. In all subjects and both hemispheres the equivalent current dipoles (ECD) for EYES and RADIAL were located near the occipitotemporal border, the MT/V5 homologue in humans. The ECD to EYES was significantly more posterior and inferior than that to RADIAL, with a calculated significant separation distance of around 1 cm. No ECD was estimated in the fusiform gyrus, a structure that plays a main role in static face perception. Although the 1M was detected in SIM in all six subjects, our criteria for a reliable ECD could only be satisfied in only one subject. Our results suggest that the cortex of human MT/V5 and its surrounds is active both in the perception of eye motion and motion in general, particularly in the right hemisphere. The areas responsive to eye motion were separable from those responsive to radial motion. These data suggest that there may be specialization within regions of human cortex previously thought to be sensitive to motion in general.

Cortical activity related to cue-invariant shape perception in humans

We used magnetoencephalography to search spatio-temporally for cortical activity related to the perception of shape defined by various visual cues in humans. The visual stimuli were three kinds of two-dimensional figures: two had fixed shapes (Diamond and Cross), the other did not (Noise). These figures were defined by three visual cues: difference of flicker, texture or luminance between the foreground and the background in the random dot pattern. Using this stimulus, we recorded the magnetic responses from the temporo-occipital regions of nine healthy subjects. Additionally, we measured the reaction time for the subjects to detect the figure by button-pressing. A magnetic component was identified in the responses. The properties of the first magnetic component differed for stimulus condition. The peak latency of the first magnetic component was different for the cues (270 ms for flicker, 360 ms for texture and 250 ms for luminance), but not for the figures. In contrast, the peak amplitude of the first magnetic component was different for the figures (96-144 fT for Diamond or Cross and 52-80 fT for Noise), but not for the cues. The signal source of the first magnetic component was estimated to lie on the ventral side of the extrastriate cortex: In the posterior part of the inferior temporal cortex, probably in the fusiform gyrus in four subjects, and in the lateral part of the occipital cortex which was outside of the primary visual cortex (visual area 1) in one subject. The signal source location was different inter-individually, but almost the same within each subject. Reaction time was 471 ms for flicker, 569 ms for texture and 426 ms for luminance, but the interval between the reaction time and the peak latency was constant (about 200 ms) for each cue. The first magnetic component was more clearly recorded from the right hemisphere than from the left.We found that the shape defined by the different visual cues activates the same localized site in the lateral extrastriate cortex. This spatial convergence suggests that there is a restricted locus that processes the visual shape regardless of the difference of the visual cue. The correspondence between the peak latency and the reaction time suggests that the activity of the area is responsible for the perception of visual shape. The inter-hemispheric difference suggests a dominance of the right hemisphere in visual shape processing.

The dynamic processes for word and picture encoding in the human brain as revealed by magnetoencephalography

Subjects were asked to memorize either the size or the meaning of the first stimulus (encoding) of a stimulus pair, and to match it to the second stimulus. Words and pictures were used as the stimuli in separate tests. Two components named 1M and 2M in both hemispheres for word or picture stimuli could be detected by magnetoencephalography (MEG). The dipole location of 1M in bilateral hemispheres for words is different from that for pictures, but that of 2M is not. It is considered that picture and word are processed in different systems at the initial stage, mainly in the lateral temporal cortex for words and in the parietal cortex for pictures, whereas they are processed in a common semantic system at the late stage.

Magnetic response of human extrastriate cortex in the detection of coherent and incoherent motion

Although direction selectivity is a cardinal property of neurons in the visual motion detection system, movement of numerous elements without global direction (incoherent motion) has been shown to activate human and monkey visual systems, as does coherent motion which has global direction. We used magnetoencephalography to investigate the neural process underlying responses to these types of motions in the human extrastriate cortex. Both motions were created using a random dot kinematogram and four speeds (0, 0.6, 9.6 and 25 degrees /s). The visual stimuli were composed of two successive motions at different speeds; a coherent motion at a certain speed that changed to incoherent motion at another speed or vice versa. Magnetic responses to the change in motion consisted of a few components, the first of which was always largest. The peak latency of the first component was inversely related to the speed of the preceding motion, but for both motions it was not affected by the speed of the subsequent motion. For each subject, the estimated origin of the first component was always in the extrastriate cortex, and this changed with the speed of the preceding motion. For both motions, the location for the slower preceding motion was lateral to that for the faster preceding motion. Although the latency changes of the two motions differed, their overall response properties were markedly similar. These findings show that the speed of incoherent motion is represented in the human extrastriate cortex neurons to the same degree as coherent motion. We consider that the human visual system has a distinct neural mechanism to perceive random dots' motion even though they do not move in a specific direction as a whole.