Human brain regions involved in direction discrimination

Impairment in motion discrimination tasks is unrelated to amount of damage to superior temporal sulcus motion areas

The behavioral role of the middle temporal (MT/V5) area and its satellites in motion processing is still unclear, particularly the degree to which MT/V5 proper is critical for different types of motion processing. Therefore, effects of small and large lesions in the caudal part of the superior temporal sulcus of macaque monkeys were compared for two tasks requiring different types of motion processing: a direction and a kinetic orientation discrimination. The small lesion was restricted to the peripheral representation of MT/V5 but included V4t, whereas the large lesion included all of MT/V5 and the medial superior temporal (MST) area as well as substantial parts of the floor of the superior temporal (FST) area. Both lesions resulted in significant and long-lasting impairment of direction discrimination but had a lesser effect on kinetic orientation discrimination. Thus the effects of small STS lesions on motion perception are much stronger than expected.

Participation of the left posterior inferior temporal cortex in writing and mental recall of kanji orthography: A functional MRI study

To examine the neuropsychological mechanisms involved in writing kanji (morphograms), we used functional MRI (fMRI) in 10 normal volunteers, all right-handed, native Japanese speakers. The experimental paradigms consisted of kana-to-kanji transcription, mental recall of kanji orthography and oral reading and semantic judgement of kana words. The first two tasks require manual and mental transcription of visually presented kana words into kanji, respectively, whereas the last two tasks involve language processing of the same set of stimulus words without recall of kanji. The transcription and mental recall tasks yielded lateralized activation of the left posterior inferior temporal cortex (PITC). By contrast, neither oral reading nor semantic judgement produced similar activation of the area. These results, in good accordance with lesion data, provide converging evidence that the left PITC plays an important role in writing kanji through retrieval of their visual graphic images, and suggest language-specific cerebral organization of writing. The set of fMRI experiments also provides new neuroimaging data on the cortical localization of basic language functions in people using a non-alphabetical language.

Brain activation studies on visual-vestibular and ocular motor interaction

Despite their different sensorimotor functions, saccades, pursuit eye movements, small-field optokinetic nystagmus and visual motion stimulation with the eyes stationary evoke a common complex pattern of activation in various cortical, basal ganglia, brain-stem and cerebellar areas. On closer inspection, however, typical subregions can be delineated that allow differentiation of adjacent but separate loci for specific functions (e.g. the separation of the two parallel corticocortical systems to control saccades and pursuit in the cortical eye fields). It is becoming increasingly clear that stimulation of one sensory system affects other sensory systems, and generally this is via an inhibitory reciprocal mode of interaction. For example, vestibular stimulation deactivates the visual cortex and visual stimulation deactivates the vestibular cortex.

Hemispheric asymmetry for selective attention

A letter-identification task, previously demonstrated to show activation of the pulvinar nucleus of the thalamus with fluodeoxyglucose position emission tomography, was administered to 20 normal volunteers. The letter to be detected could appear alone as a big stimulus or as a small one stimulus surrounded by flanking letters. To test for a hemispheric specialization for filtering processes, the stimuli were displayed horizontally, either in the left or in the right hemifield, or vertically, either above or below the fixation point. In addition, to study the effect of cognitive processes on selective attention resources, we varied the feedback conditions, by delivering or not delivering a blue flash in cases of misses or mistakes. The results show a significant interaction between the type of stimulus (alone or surrounded by flankers) and the hemifield of presentation (left or right) only in the condition where the subjects were presented stimuli horizontally without any feedback. In this condition, reaction times (RTs) were shorter in the left hemifield than in the right hemifield for single stimuli, whereas for stimuli surrounded by flankers, the opposite pattern was observed, that is, shorter RT in the right hemifield than in the left one. The present findings suggest a hemispheric specialization for selective attention, in particular at the subcortical level.

Human cortical areas underlying the perception of optic flow: brain imaging studies

In summary, we have reviewed electrophysiological and brain imaging studies of motion and optic-flow processing. Single-unit studies indicate that MST (V5a) is a site of optic-flow extraction and that this information can be used to guide pursuit eye movements and to estimate heading. The EEG and MEG studies point to a localized electrical dipole in occipitotemporal cortex evoked by visual motion. We have also discussed the evidence from functional imaging studies for response specificity of the rCBF and BOLD effects in posterior cortex to visual motion and optic flow. Focal attention modulates the amplitude of the BOLD signal evoked by visual motion stimulation. Retinotopic mapping techniques have been used to locate region borders within the visual cortex. Our results indicate that striate (V1) and extrastriate areas (V2, V3/V3a) respond robustly to optic flow. However, with exception of a more pronounced response in V3/V3a to random walk, we found little evidence for response selectivity with respect to flow type and disparity in these early visual areas. In a similar fashion, the human V5/V5a complex responds well to optic flow, but these responses do not vary significantly with the type of flow field and do not seem to depend on disparity. In contrast, the kinetic occipital area (KO/V3b) responds well to optic-flow information, and it is the only area that produces more pronounced activation to the disparity in the flow fields. These initial results are promising because they suggest that the fMRI method can be sensitive to changes in stimulus parameters that define flow fields. More work will be required to explore the extent to which these responses reflect the neuronal processing of optic flow. Eye position tracking is now possible during fMRI experiments. We have demonstrated that the eye movements affect the BOLD responses in motion-sensitive areas (Kimming et al., 1999). Further experiments in our laboratory are aimed at understanding the effects of eye movements on the neuronal coding of complex optic-flow fields (Schira et al., 1999).

Human cortical regions involved in extracting depth from motion

We used functional magnetic resonance imaging (fMRI) to investigate brain regions involved in extracting three-dimensional structure from motion. A factorial design included two-dimensional and three-dimensional structures undergoing rigid and nonrigid motions. As predicted from monkey data, the human homolog of MT/V5 was significantly more active when subjects viewed three-dimensional (as opposed to two-dimensional) displays, irrespective of their rigidity. Human MT/V5+ (hMT/V5+) is part of a network with right hemisphere dominance involved in extracting depth from motion, including a lateral occipital region, five sites along the intraparietal sulcus (IPS), and two ventral occipital regions. Control experiments confirmed that this pattern of activation is most strongly correlated with perceived three-dimensional structure, in as much as it arises from motion and cannot be attributed to numerous two-dimensional image properties or to saliency.

Areas involved in encoding and applying directional expectations to moving objects

Two experiments used functional magnetic resonance imaging (fMRI) to examine the cortical areas involved in establishing an expectation about the direction of motion of an upcoming object and applying that expectation to the analysis of the object. In Experiment 1, subjects saw a stationary cue that either indicated the direction of motion of a subsequent test stimulus (directional cue) or provided no directional information (neutral cue). Their task was to detect the presence of coherent motion in the test stimulus. The stationary directional cue produced larger modulations than the neutral cue, with respect to a passive viewing baseline, both in motion-sensitive areas such as left MT+ and the anterior intraparietal sulcus, as well as motion-insensitive areas such as the posterior intraparietal sulcus and the junction of the left medial precentral sulcus and superior frontal sulcus. Experiment 2 used an event-related fMRI technique to separate signals during the cue period, in which the expectation was encoded and maintained, from signals during the subsequent test period, in which the expectation was applied to the test object. Cue period activations from a stationary, directional cue included many of the same motion-sensitive and -insensitive areas from Experiment 1 that produced directionally specific modulations. Prefrontal activations were not observed during the cue period, even though the stationary cue information had to be translated into a format appropriate for influencing motion detection, and this format was maintained for the duration of the cue period (approximately 5 sec).

Regional brain activity during shape recognition impaired by a scopolamine challenge to encoding

In the present positron emission tomography (PET) study, we examine the effect of a scopolamine-induced challenge to encoding upon the pattern of regional cerebral blood flow during recognition of a list of abstract visual shapes 3 days after encoding of these shapes. This study was conducted to test hypotheses concerning the fusiform and thalamic contributions to object recognition arising from a previous imaging study of impaired recognition. In that study, we demonstrated that activity in the fusiform cortex and the thalamus during shape recognition was modulated by memory challenges. These memory challenges included, on one hand, impaired storage as a consequence of diazepam administration during encoding, and, on the other hand, impaired retrieval caused by a perceptual challenge. Activation in the fusiform cortex decreased during impaired recognition, irrespective of the type of challenge. In contrast, thalamic activation increased only when the recognition deficit resulted from impaired memory storage. Based on these results, we hypothesized that fusiform activation during recognition reflects the matching of an incoming stimulus with a stored one, whereas thalamic activation reflects retrieval attempts. These hypotheses would receive considerable support if scopolamine, which also impairs memory storage, induced similar modulations of fusiform and thalamic activation. In the present study, we observed that a scopolamine challenge to encoding does indeed modulate the activity in the very same regions that were previously modulated by a diazepam challenge. Hence, a similar memory deficit, although primarily effected through different neurochemical pathways, was paralleled by a similar modulation of activity in the same set of nodes in the shape recognition network. In the fusiform cortex, scopolamine decreased recognition-related activity, as did the sensory challenge of retrieval. Furthermore, covariate analysis demonstrated that the level of fusiform activity linearly correlates with behavioural performance. In the thalamus, activation increased following impaired encoding. This is in accordance with the idea that enhanced thalamic activity reflects increased effort expended in retrieval. In addition, in the intraparietal sulcus, differential activation also increased following impaired memory storage, possibly reflecting enhanced visuospatial attention in an effort to compensate for impaired performance.

Effects of attention on the processing of motion in macaque middle temporal and medial superior temporal visual cortical areas

The visual system is continually inundated with information received by the eyes. Only a fraction of this information appears to reach visual awareness. This process of selection is one of the functions ascribed to visual attention. Although many studies have investigated the role of attention in shaping neuronal representations in cortical areas, few have focused on attentional modulation of neuronal signals related to visual motion. We recorded from 89 direction-selective neurons in middle temporal (MT) and medial superior temporal (MST) visual cortical areas of two macaque monkeys using identical sensory stimulation under various attentional conditions. Neural responses in both areas were greatly influenced by attention. When attention was directed to a stimulus inside the receptive field of a neuron, responses in MT and MST were enhanced an average of 20 and 40% compared with a condition in which attention was directed outside the receptive field. Even stronger average enhancements (70% in MT and 100% in MST) were observed when attention was switched from a stimulus moving in the nonpreferred direction inside the receptive field to another stimulus in the receptive field that was moving in the preferred direction. These findings show that attention modulates motion processing from stages early in the dorsal visual pathway by selectively enhancing the representation of attended stimuli and simultaneously reducing the influence of unattended stimuli.

Linking visual perception with human brain activity

The past year has seen great advances in the use of functional magnetic resonance imaging (fMRI) to study the functional organization of the human visual cortex, to measure the neuronal correlates of visual perception, and to test computational theories of vision. Activity in particular visual brain areas, as measured with fMRI, has been found to correlate with psychophysical performance, with visual attention, and with subjective perceptual experience.

Human brain activity related to the perception of spatial features of objects

The role of the parietal cortex in visuospatial analysis of object was investigated by cerebral blood flow measurements in seven objects using positron emission tomography. Data were acquired while subjects performed a matching task requiring the discrimination of simultaneously presented objects based on one of their spatial properties. Three properties were studied separately during three scanning conditions repeated twice:surface orientation, principal axis orientation, and size. Scans were also obtained during a sensorimotor control task (similar visual stimulation, same motor action, voluntary saccades toward each object) as well as during rest (no stimulation, eyes closed). Compared to rest, the three property matching tasks showed the same pattern of activation: the whole occipital lobe, the right intraparietal sulcus (IPS), and the right occipitotemporal (OT) junction. Compared to the control condition, only right IPS and OT junction were significantly activated during discrimination of the spatial properties. The IPS focus was located between the superior parietal lobule and the angular gyrus, and the OT activation overlapped the posterior part of the inferior temporal gyrus and the middle occipital gyrus. These results indicate that discrimination of spatial attributes requires the activation of both the parietal and the temporal cortices of the right hemisphere and provide further evidence that the IPS plays a critical role in visuospatial analysis of objects.

Human cortical areas activated in relation to vergence eye movements-a PET study

Human cortical areas activated in relation to vergence eye movements were determined using positron emission tomography. Binocular disparity-driven visual stimuli were presented using a head-mounted display. Eye movements were monitored continuously by an infrared limbus tracker. A combination of a bar and a cross was used as the target. In the vergence task, subjects were instructed to follow an approaching bar, while ignoring a stationary cross. Activation in relation to vergence eye movement was discriminated from activation in relation to motion vision by using the ignore-bar task as the control. In the ignore-bar task, subjects were instructed to fixate on a stationary cross, while ignoring an approaching bar. The fixation task was used as the basic control for both the vergence and the ignore-bar tasks. Areas of activation in relation to vergence eye movements were found in the bilateral temporooccipital junction, the left inferior parietal lobule, and the right fusiform gyrus by comparing regional cerebral flow between the vergence and ignore-bar tasks and by the conjunctive analyses of vergence-vs-ignore comparison with vergence-vs-fixation comparison.

Regions in the human brain activated by simultaneous orientation discrimination: a study with positron emission tomography

In order to compare regional cerebral activity involved in simultaneous as opposed to successive orientation discrimination, we used positron emission tomography to measure regional cerebral blood flow, in two threefold sets of conditions, in a large number of subjects. The first such triad involved simultaneous orientation discrimination, orientation identification and detection, with all tasks using the same pair of gratings. The second triad consisted of successive orientation discrimination with its corresponding identification and detection tasks. Comparisons between tasks within each triad isolate attention to orientation and, respectively, spatial or temporal comparison. The subtraction of detection from simultaneous discrimination revealed activation of right fusiform, right lingual, left precentral, left cingulate and left temporal cortex, in addition to right insula, cerebellum and left thalamus. Only the fusiform, insular and precentral activations remained when the corresponding identification was subtracted from simultaneous discrimination. In contrast, most of the non-visual activation sites remained when simultaneous discrimination was compared with successive discrimination, which also revealed a left lingual activation. These experiments provide further evidence for task-dependent processing in the human visual system and suggest that the right fusiform cortex is involved in spatial as much as temporal comparisons.

The neuronal machinery involved in successive orientation discrimination

Following our strategy of using simple discrimination tasks to investigate the primate visual system, we trained both human and monkey subjects for two orientation discrimination tasks: an identification and a successive discrimination. Contrasting these two tasks allowed us to isolate the temporal comparison component and to relate this component to activity in right fusiform gyrus using Positron Emission Tomography (PET) and to infero-temporal cortex using a lesion approach in monkeys. Single-cell recordings in infero-temporal cortex demonstrated that neurons in this region can contribute to the three processes underlying temporal comparison: (1) sensorial representation of visual stimuli, (2) maintaining a trace of the preceding stimulus, and (3) comparison of the incoming stimulus with that trace. By the same token, a comparison of these two tasks, which use the same input and the same attribute, demonstrates the task dependency of processing in the human and non-human primate visual system.