Cortical connections of inferior temporal area TEO in macaque monkeys

Movement preparation and motor intention

This paper addresses the functional anatomy of movement representation. We have used associative visuomotor tasks with instructed delays to elicit motor preparatory activity. We regard such activity, when independent from transient stimulus-locked responses, as a likely candidate for the neural basis of movement representation (M. Jeannerod, The Cognitive Neuroscience of Action. Blackwell, Oxford, 1997). In a first event-related fMRI experiment, we found that preparing to move according to arbitrary visuomotor associations relies not only on parietofrontal circuitry, but also on portions of the posterior superior temporal sulcus. In a separate behavioral experiment, we discarded the hypothesis that such activities were confounded by working memory processes. In a second imaging experiment, we have further defined the relative contributions of these parietal, premotor, and temporal areas to the preparatory process and their involvement in motor representations. We conclude that posterior parietal cortex is interested in evaluating the potential motor significance of sensory stimuli, irrespectively of the likelihood of providing a response ("motor intention"). Conversely, preparatory activity in frontal premotor regions appears to be a function of the probability of a subsequent movement. Finally, on the basis of the present and published data, we suggest that posterior temporal cortex might be involved in the extraction of contextual and intentional cues during goal-oriented behavior.

Processing of kinetically defined boundaries in areas V1 and V2 of the macaque monkey

We recorded responses in 107 cells in the primary visual area V1 and 113 cells in the extrastriate visual area V2 while presenting a kinetically defined edge or a luminance contrast edge. Cells meeting statistical criteria for responsiveness and orientation selectivity were classified as selective for the orientation of the kinetic edge if the preferred orientation for a kinetic boundary stimulus remained essentially the same even when the directions of the two motion components defining that boundary were changed by 90 degrees. In area V2, 13 of the 113 cells met all three requirements, whereas in V1, only 4 cells met the criteria of 107 that were tested, and even these demonstrated relatively weak selectivity. Correlation analysis showed that V1 and V2 populations differed greatly (P < 1.0 x 10(-6), Student's t-test) in their selectively for specific orientations of kinetic edge stimuli. Neurons in V2 that were selective for the orientation of a kinetic boundary were further distinguished from their counterparts in V1 in displaying a strong, sharply tuned response to a luminance edge of the same orientation. We concluded that selectivity for the orientation of kinetically defined boundaries first emerges in area V2 rather than in primary visual cortex. An analysis of response onset latencies in V2 revealed that cells selective for the orientation of the motion-defined boundary responded about 40 ms more slowly, on average, to the kinetic edge stimulus than to a luminance edge. In nonselective cells, that is, those presumably responding only to the local motion in the stimulus, this difference was only about 20 ms. Response latencies for the luminance edge were indistinguishable in KE-selective and -nonselective neurons. We infer that while responses to luminance edges or local motion are indigenous to V2, KE-selective responses may involve feedback entering the ventral stream at a point downstream with respect to V2.

Connections between anterior inferotemporal cortex and superior temporal sulcus regions in the macaque monkey

We examined the connections between the anterior inferotemporal cortex and the superior temporal sulcus (STS) in the macaque monkey by injecting Phaseolus vulgaris leucoagglutinin (PHA-L) or wheat germ agglutinin conjugated to horseradish peroxidase (WGA-HRP) into the dorsoanterior and ventroanterior subdivisions of TE (TEad and TEav, respectively) and observing the labeled terminals and cell bodies in STS. We found a clear dichotomy in the connections of the rostral part of STS: the injections into TEad resulted in a dense distribution of labeled terminals and cell bodies in the upper bank of rostral STS, whereas labeling was confined to the lower bank and fundus of rostral STS after injections into TEav. The distribution of labeling in the rostral STS was discontinuous from the distribution of labeling surrounding the injection sites: the lower bank of the rostral STS was spared from labeling in the TEad injection cases, and TEad had only sparse distribution in the TEav injection cases. These results revise the classical view that the lower bank of rostral STS is connected with TE, whereas the upper bank of rostral STS is connected with the parietal, prefrontal, and superior temporal regions (Seltzer and Pandya, 1978, 1991, 1994). The upper bank of the rostral STS is called the superior temporal polysensory area (STP), because it was previously found that neurons there respond to auditory, somatosensory, and visual stimuli. The present results thus suggest that the polymodal representation in STP interacts more with information processing in TEad than TEav. It is also suggested that the information processing in the ventral bank of the rostral STS is distinct from that in TEad, and the former more directly interacts with TEav than TEad.

Connections between the medial temporal cortex and the CA1 subfield of the hippocampal formation in the Japanese monkey (Macaca fuscata)

The connections between the medial temporal cortical areas and CA1 of the hippocampus were examined in the Japanese monkey (Macaca fuscata) by means of retrograde and anterograde tract-tracing methods with wheat germ agglutinin-conjugated horseradish peroxidase (WGA-HRP) and fluorescent dyes (Fast Blue and Diamidino Yellow). The posterior parahippocampal (areas TF1, TF2, and TH), perirhinal (areas 35 and 36), and ventral inferotemporal areas (areas TEav and TEpv) were reciprocally connected with CA1. Projection fibers from CA1 to the medial temporal cortical areas originated in the pyramidal cell layer, whereas those from the medial temporal cortical areas to CA1 terminated in the molecular layer. Each of these cortical areas was reciprocally connected with the entire rostrocaudal extent of CA1. However, the intensity of the connections varied along the rostrocaudal axis of CA1: areas TH and TF2 were connected most markedly with the anterior and middle parts of CA1, respectively. Areas TF, 35, 36, TEav, and TEpv were connected predominantly with the posterior part of CA1. In the coronal plane of CA1, labeled cells were located in proximal CA1 (i. e., near the prosubiculum), but not in distal CA1 (i.e., near CA2). The medial temporal cortical areas in direct reciprocal connection with CA1 were presumed to be involved in the memory system, especially in the system for declarative memory.

Connections underlying the synthesis of cognition, memory, and emotion in primate prefrontal cortices

Distinct domains of the prefrontal cortex in primates have a set of connections suggesting that they have different roles in cognition, memory, and emotion. Caudal lateral prefrontal areas (areas 8 and 46) receive projections from cortices representing early stages in visual or auditory processing, and from intraparietal and posterior cingulate areas associated with oculomotor guidance and attentional processes. Cortical input to areas 46 and 8 is complemented by projections from the thalamic multiform and parvicellular sectors of the mediodorsal nucleus associated with oculomotor functions and working memory. In contrast, caudal orbitofrontal areas receive diverse input from cortices representing late stages of processing within every unimodal sensory cortical system. In addition, orbitofrontal and caudal medial (limbic) prefrontal cortices receive robust projections from the amygdala, associated with emotional memory, and from medial temporal and thalamic structures associated with long-term memory. Prefrontal cortices are linked with motor control structures related to their specific roles in central executive functions. Caudal lateral prefrontal areas project to brainstem oculomotor structures, and are connected with premotor cortices effecting head, limb and body movements. In contrast, medial prefrontal and orbitofrontal limbic cortices project to hypothalamic visceromotor centers for the expression of emotions. Lateral, orbitofrontal, and medial prefrontal cortices are robustly interconnected, suggesting that they participate in concert in central executive functions. Prefrontal limbic cortices issue widespread projections through their deep layers and terminate in the upper layers of lateral (eulaminate) cortices, suggesting a predominant role in feedback communication. In contrast, when lateral prefrontal cortices communicate with limbic areas they issue projections from their upper layers and their axons terminate in the deep layers, suggesting a role in feedforward communication. Through their widespread connections, prefrontal limbic cortices may exercise a tonic influence on lateral prefrontal cortices, inextricably linking areas associated with cognitive and emotional processes. The integration of cognitive, mnemonic and emotional processes is likely to be disrupted in psychiatric and neurodegenerative diseases which preferentially affect limbic cortices and consequently disconnect major feedback pathways to the neuraxis.

Divergent backward projections from the anterior part of the inferotemporal cortex (area TE) in the macaque

The organization of backward projections from the anterior part of the inferotemporal cortex (area TE) to the posterior part of the inferotemporal cortex (area TEO) was studied in the macaque monkey by using the anterograde tracer Phaseolus vulgaris-leucoagglutinin (PHA-L). The objectives of the study were to investigate this backward projection and to compare it with 1) the backward projections that have been described previously in the early sensory areas and 2) the forward projection from area TEO to area TE. After a single iontophoretic injection of PHA-L into area TE in three monkeys, a dense distribution of labeled terminals was observed in area TEO and in the ventral bank of the superior temporal sulcus (area PITd) that adjoined area TEO. A less dense distribution was observed in areas V4, V2, and V1. Clusters of labeled terminals in areas TEO and PITd extended more than 4 mm along the cortical surface. The forward projections from area TEO to area TE also were studied for comparison by reanalyzing two previous cases (Saleem et al. ¿1993 Cerebral Cortex 3:454-464). These projections (from area TEO to area TE) were more focal than the terminations that occurred in area TEO after injections into area TE. Nine single axons projecting from area TE to areas TEO/PITd were reconstructed through serial sections. These showed variable, complex branching patterns with multiple arbors (1-12). Arbors were localized in layers 1-3 for four axons, in layer 1 for one axon, layers 5 and 6 for two axons, and in both layers 1-3 and layers 5-6 for two axons. Axons with horizontally elongated arbors confined to layer 1 were not predominant. The size of the individual arbors of these axons along their long axes tended to be larger (1.56 +/- 1.24 mm) than those of TEO-to-TE forward axons (<0.6 mm). Thus, the authors conclude that, like other backward systems described to date, those from area TE to areas TEO/PITd are divergent. However, single axons have more variable laminar patterns of terminal distribution than those in the other backward systems.

Laminar distribution of neurons in extrastriate areas projecting to visual areas V1 and V4 correlates with the hierarchical rank and indicates the operation of a distance rule

The directionality of corticocortical projections is classified as feedforward (going from a lower to higher hierarchical levels), feedback (interconnecting descending levels), and lateral (interconnecting equivalent levels). Directionality is determined by the combined criteria of the laminar patterns of the axon terminals as well as the cells of origins and has been used to construct models of the visual system, which reveals a strict hierarchical organization (Felleman and Van Essen, 1991; Hilgetag et al., 1996a). However, these models are indeterminate partly because we have no indication of the distance separating adjacent levels. Here we have attempted to determine a graded parameter describing the anatomical relationship of interconnected areas. We have investigated whether the precise percentage of labeled supragranular layer neurons (SLN%) in each afferent area after injection in either visual areas V1 or V4 determines its hierarchical position in the model. This shows that pathway directionality in the Felleman and Van Essen model is characterized by a range of SLN% values. The one exception is the projection of the frontal eye field to area V4, which resembles a feedforward projection. Individual areal differences in SLN% values are highly significant, and the number of hierarchical steps separating a target area from a source area is found to be tightly correlated to SLN%. The present results show that the hierarchical rank of each afferent area is reliably indicated by SLN%, and therefore this constitutes a graded parameter that is related to hierarchical distance.

A stimulus-driven approach to object identity and location processing in the human brain

The primate visual system is considered to be segregated into ventral and dorsal streams specialized for processing object identity and location, respectively. We reexamined the dorsal/ventral model using a stimulus-driven approach to object identity and location processing. While looking at repeated presentations of a standard object at a standard location, subjects monitored for any infrequent "oddball" changes in object identity, location, or identity and location (conjunction). While the identity and location oddballs preferentially activated ventral and dorsal brain regions respectively, each oddball type activated both pathways. Furthermore, all oddball types recruited the lateral temporal cortex and the temporo-parietal junction. These findings suggest that a strict dorsal/ventral dual-stream model does not fully account for the perception of novel objects in space.

Suppression on neuronal responses by a metacontrast masking stimulus in monkey V4

We studied the temporal characteristics of suppression in area V4 of the monkey using a visual stimulus for metacontrast masking. Visual responses of V4 neurons to a brief test stimulus presented within the receptive field were recorded, and the effect of a mask stimulus that did not spatially overlap the test stimulus was examined. Responses to the test stimulus were suppressed by the mask stimulus, which either preceded or followed the test stimulus. To study the temporal characteristics of suppression, the interval between the onset of the test stimulus and that of the mask stimulus (stimulus onset asynchrony, SOA) was varied. Maximum suppression occurred with a simultaneous presentation of the two stimuli, and the suppression gradually weakened as the SOA increased. The suppressive effect of the mask stimulus lasted on average about 77 ms in the negative SOA (forward masking) and 65 ms in the positive SOA (backward masking). These results indicate that surround suppression in V4 neurons has considerable temporal width, which is longer than that previously reported in areas V1 and V2. There were marked differences between the time course of suppression in V4 neurons in the present study and those reported in human metacontrast masking.

More thoughts on perceiving and grasping the Müller-Lyer illusion

It has been suggested that the insensitivity of the visuomotor system to various visual illusions is based on mechanisms in the so-called 'dorsal stream' of primate extrastriate cortex, which may depend upon binocular cues for their functions. The present study investigated the effects of binocular and monocular viewing on perception of and action to Müller-Lyer figures. Fourteen participants were required to match and grasp the shaft of a Müller-Lyer display under both viewing conditions. In the matching condition, participants were required to show the perceived extent of the central shaft of one of the two Müller-Lyer figures, using the extent of the gap between their finger and thumb. In the grasping task, participants were required to quickly and accurately reach out and grasp the central shaft of the specified Müller-Lyer figure. First, there was a striking effect of the illusion on the matching performance under both viewing conditions. However, the maximum grip aperture remained unaffected by the illusion figures. These results add to the theory of distinct modes of visual processing for perception and action. However, we did not find that grasping performance was affected by the illusion under monocular conditions. It is plausible that monocular depth cues distinct from those responsible for the illusion can successfully drive accurate grasping. Additional concerns regarding claims of action system resistance to the perceptual distortions of various illusions are discussed.

Neurochemical gradients along monkey sensory cortical pathways: calbindin-immunoreactive pyramidal neurons in layers II and III

We examined the distribution of neurons containing immunoreactivity for three calcium-binding proteins, calbindin, parvalbumin and calretinin, as well as nonphosphorylated neurofilament protein, in cortical areas along the ventral and dorsal cortical visual pathways, and in ventrally-directed somatosensory and auditory cortical pathways. Calbindin-immunoreactive pyramidal neurons showed the most prominent regional differences. They were largely restricted to layers II and III and their number monotonically increased from the primary sensory areas to the anteroventral areas along the ventral visual pathway and along the ventrally-directed somatosensory and auditory pathways. The number of calbindin-immunoreactive pyramidal neurons in layers II and III also increased along the dorsal visual pathway, but the number in the last recognized stage of the dorsal visual pathway (area 7a) was significantly smaller than that at the corresponding stage in the ventral visual pathway (TE). The number of calbindin-immunoreactive pyramidal neurons was highest in layers II and III of areas 35/36, TG, and TF/TH, which represent terminal cortical regions of the pathways. These results show neurochemical differences between cortical areas located at early and late stages along serial corticocortical pathways, as well as confirming differences between pyramidal neurons in the supragranular and infragranular layers.

Frontotemporal interactions in face encoding and recognition

Cognition may result from different patterns of neural interactions distributed across the brain. If this is true then across different cognitive tasks different functional interactions should be observed within an anatomical network. To investigate this hypothesis, a network analysis of PET data obtained from a face memory study was conducted. PET scans were obtained while subjects performed face perception, face encoding and face recognition tasks. Partial least squares (PLS) analysis of rCBF was used to identify brain regions that were engaged during these tasks, and anatomically based structural equation modeling (SEM) was used to construct functional models for matching, encoding and recognition. There was some overlap in the functional interactions observed across the three cognitive tasks. In all three tasks, there were positive interactions involving the left occipitotemporal regions. These interactions may represent the perceptual component of the three tasks. Task-specific functional interactions were also observed. During face encoding, there was a bilateral positive influence of occipitotemporal regions on medial temporal regions. In addition, there were positive interhemispheric interactions between middle temporal regions and between limbic regions during encoding. These patterns may reflect the participation of medial temporal cortex in the formation of new memories. In the face recognition task, there was a positive loop in the right hemisphere from occipital cortex to frontal cortex and back from frontal cortex to occipitotemporal cortex. In addition, there was a strong positive input into the right hippocampal region from right occipitotemporal cortex. This pattern of interaction was specific to the recognition task and might represent the process whereby the input faces are compared to the internal representation laid down during encoding, thus enabling recognition.

14C-deoxyglucose mapping of the monkey brain during reaching to visual targets

The strategies used by the macaca monkey brain in controlling the performance of a reaching movement to a visual target have been studied by the quantitative autoradiographic 14C-DG method. Experiments on visually intact monkeys reaching to a visual target indicate that V1 and V2 convey visuomotor information to the cortex of the superior temporal and parietoccipital sulci which may encode the position of the moving forelimb, and to the cortex in the ventral part and lateral bank of the intraparietal sulcus which may encode the location of the visual target. The involvement of the medial bank of the intraparietal sulcus in proprioceptive guidance of movement is also suggested on the basis of the parallel metabolic effects estimated in this region and in the forelimb representations of the primary somatosensory and motor cortices. The network including the inferior postarcuate skeletomotor and prearcuate oculomotor cortical fields and the caudal periprincipal area 46 may participate in sensory-to-motor and oculomotor-to-skeletomotor transformations, in parallel with the medial and lateral intraparietal cortices. Experiments on split brain monkeys reaching to visual targets revealed that reaching is always controlled by the hemisphere contralateral to the moving forelimb whether it is visually intact or 'blind'. Two supplementary mechanisms compensate for the 'blindness' of the hemisphere controlling the moving forelimb. First, the information about the location of the target is derived from head and eye movements and is sent to the 'blind' hemisphere via inferior parietal cortical areas, while the information about the forelimb position is derived from proprioceptive mechanisms and is sent via the somatosensory and superior parietal cortices. Second, the cerebellar hemispheric extensions of vermian lobules V, VI and VIII, ipsilateral to the moving forelimb, combine visual and oculomotor information about the target position, relayed by the 'seeing' cerebral hemisphere, with sensorimotor information concerning cortical intended and peripheral actual movements of the forelimb, and then send this integrated information back to the motor cortex of the 'blind' hemisphere, thus enabling it to guide the contralateral forelimb to the target.

Loss of attentional stimulus selection after extrastriate cortical lesions in macaques

Many objects in natural visual scenes compete for attention. To identify the neural mechanisms necessary for visual attention, we made restricted lesions, affecting different quadrants of the visual field but leaving one quadrant intact, in extrastriate cortical areas V4 and TEO of two monkeys. Monkeys were trained to discriminate the orientation of a target grating surrounded by distracters. As distracter contrast increased, performance deteriorated in quadrants affected by V4 and TEO lesions, but not in the normal quadrant. Performance in affected quadrants was restored by increasing the contrast of the target relative to distracters. Thus, without V4 and TEO, visual attention is 'captured' by strong stimuli, regardless of their behavioral relevance.

The distribution of cerebral activity related to visuomotor coordination indicating perceptual and executional specialization

The distribution of increased regional cerebral blood flow (rCBF) related to visuomotor coordination was studied by means of positron emission tomography (PET) in normal subjects. An experimental condition, in which a vertically presented zigzag figure had to be copied in a horizontal orientation, was compared with a control condition in which the same horizontal drawing was made, guided by a horizontally presented example. Cognitive components dealing with the mismatch in visual orientation resulted in activation of (i) right dorsal premotor cortex, (ii) right posterior parietal cortex, (iii) visual cortex (area V1) and (iv) left fusiform gyrus. In a second experiment, conditions were compared in which the same horizontal zigzag figure was copied in either a vertical or a horizontal orientation. Now, the motor components of the transformation of orientation appeared to be associated only with left premotor cortex activation. The differential distribution of activations is regarded to reflect the selective effort to cope with either the visual or the motor component of spatial incongruity, and indicates specialization for perceptual and executive components in visuomotor control. We propose that the perceptual component of visuomotor transformation in our experiment relates to a realignment of the coordinates of a percept to an internally defined coordinate system. The executive component relates to guidance of movement within an internal representation of space. In a preceding behavioural experiment, a majority of patients with Parkinson's disease (PD) failed on the task in which they had to make a horizontal copy of a vertically presented picture. This finding may suggest a deficit in the maintenance of an internal spatial representation to guide movement.

Tolerances of responses to visual patterns in neurons of the posterior inferotemporal cortex in the macaque against changing stimulus size and orientation, and deleting patterns

Neuronal activities were recorded in areas TEO and TE of the inferotemporal cortex in four hemispheres of two monkeys during the performance of a visual pattern discrimination task. Tolerances of responses to patterns against changing stimulus size and orientation, and deleting patterns halves were investigated and compared between TEO and TE neurons. Of 311 neurons tested, 80 (26%) responded to one or more patterns out of four standard patterns. Of these 80 neurons, 50 (63%) were recorded in area TEO and 30 (38%) in area TE. Neurons responsive to patterns were recorded in both areas TEO and TE, however degrees of tolerance of responses were different between TEO and TE neurons. Tolerances of TEO neurons were moderate and degrees of tolerance varied from neuron to neuron. Responses to particular patterns were dependent on stimulus size, stimulus orientation, and/or completeness of patterns. By contrast, tolerances of TE neurons were generally strong. Responses to particular patterns were not affected by changing stimulus size, changing stimulus orientation nor deleting patterns halves. These results suggest that area TEO rather than area TE is involved in detecting and processing particular visual shapes.

The predictive value of changes in effective connectivity for human learning

During learning, neural responses decrease over repeated exposure to identical stimuli. This repetition suppression is thought to reflect a progressive optimization of neuronal responses elicited by the task. Functional magnetic resonance imaging was used to study the neural basis of associative learning of visual objects and their locations. As expected, activation in specialized cortical areas decreased with time. However, with path analysis it was shown that, in parallel to this adaptation, increases in effective connectivity occurred between distinct cortical systems specialized for spatial and object processing. The time course of these plastic changes was highly correlated with individual learning performance, suggesting that interactions between brain areas underlie associative learning.

Single units and conscious vision

Figures that can be seen in more than one way are invaluable tools for the study of the neural basis of visual awareness, because such stimuli permit the dissociation of the neural responses that underlie what we perceive at any given time from those forming the sensory representation of a visual pattern. To study the former type of responses, monkeys were subjected to binocular rivalry, and the response of neurons in a number of different visual areas was studied while the animals reported their alternating percepts by pulling levers. Perception-related modulations of neural activity were found to occur to different extents in different cortical visual areas. The cells that were affected by suppression were almost exclusively binocular, and their proportion was found to increase in the higher processing stages of the visual system. The strongest correlations between neural activity and perception were observed in the visual areas of the temporal lobe. A strikingly large number of neurons in the early visual areas remained active during the perceptual suppression of the stimulus, a finding suggesting that conscious visual perception might be mediated by only a subset of the cells exhibiting stimulus selective responses. These physiological findings, together with a number of recent psychophysical studies, offer a new explanation of the phenomenon of binocular rivalry. Indeed, rivalry has long been considered to be closely linked with binocular fusion and stereopsis, and the sequences of dominance and suppression have been viewed as the result of competition between the two monocular channels. The physiological data presented here are incompatible with this interpretation. Rather than reflecting interocular competition, the rivalry is most probably between the two different central neural representations generated by the dichoptically presented stimuli. The mechanisms of rivalry are probably the same as, or very similar to, those underlying multistable perception in general, and further physiological studies might reveal much about the neural mechanisms of our perceptual organization.

Object vision and visual awareness

Conscious experience involves perceiving, attending, remembering, and recognizing. Recent neuroscientific research has made significant contributions to our understanding of the mechanisms that mediate such capacities. Physiological and neuropsychological investigations have provided increasingly detailed descriptions of the location and functional properties of the brain structures involved in conscious perception, in attentive behavior and working memory, and in the recognition of objects. Such studies suggest that awareness of a visual stimulus probably reflects the interconnectivity and the type of cells involved in the representation of this stimulus, rather than the activity of specific circumscribed visual areas or processing streams.

Amnesia and the organization of the hippocampal system

Early hippocampal injury in humans has been found to result in a limited form of global anterograde amnesia. At issue is whether the limitation is qualitative, with the amnesia reflecting substantially greater impairment in episodic than in semantic memory, or only quantitative, with both episodic and semantic memory being partially and equivalently impaired. Evidence from neuroanatomical and lesion studies in animals suggests that the hippocampus and subhippocampal cortices form a hierarchically organized system, such that the greatest convergence of information (and, by implication, the richest amount of association) takes place within the hippocampus, located at the top of the hierarchy. On the one hand, this evidence is consistent with the view that selective hippocampal damage produces a differential impairment in context-rich episodic memory as compared with context-free semantic memory, because only the latter can be supported by the subhippocampal cortices. On the other hand, given the system's hierarchical form of organization, this dissociation of deficits is difficult to prove, because a quantitatively limited deficit will nearly always be a viable alternative. A final choice between the alternative views is therefore likely to depend less on further evidence gathered in brain-injured patients than on which view accounts for more of the data gathered from converging approaches to the problem.

Area-specific laminar distribution of cortical feedback neurons projecting to cat area 17: quantitative analysis in the adult and during ontogeny

Corticocortical pathways can be classified as feedback and feedforward, in part according to the laminar distribution of the parent cell bodies. Here, we have developed exhaustive sampling procedures to determine unambiguously this laminar distribution. This shows that individual extrastriate areas in the adult cat have highly stereotyped proportions of supragranular layer neurons with respect to the total population of neurons back-projecting to area 17. During development, these adult laminar patterns emerge from an initially uniform radial distribution through a process of selective reorganization, which is highly specific to each area. Injections of fluorescent retrograde tracers were made in area 17. In areas 19, 20, posteromedial lateral suprasylvian area, and anteromedial lateral suprasylvian area, we defined a projection zone as the region containing retrogradely labeled neurons. In the neonate, counts of labeled neurons throughout the projection zones show constant percentages of 40% in the supragranular layers. During development, there is an area-specific reduction in the percentage of supragranular labeled neurons generating the laminar distributions characteristic of each area. Numbers of labeled neurons were estimated at different eccentricities of the projection zone. This finding indicates that during development there is a relative decrease in the numbers of labeled neurons of the periphery of the projection zone in the supragranular layers but not in the infragranular layers. This decrease is accompanied by a relative decrease in the dimensions of the supragranular projection zone with respect to the infragranular projection zone. These findings suggest that each extrastriate area precisely adjusts the proportions of supragranular layer neurons back-projecting to striate cortex in part by developmental changes in the divergence-convergence values of individual neurons. This shaping of corticocortical connectivity occurs relatively late in postnatal development and could, therefore, be under epigenetic control.

Activation of visuomotor systems during visually guided movements: a functional MRI study

The dorsal stream is a dominant visuomotor pathway that connects the striate and extrastriate cortices to posterior parietal areas. In turn, the posterior parietal areas send projections to the frontal primary motor and premotor areas. This cortical pathway is hypothesized to be involved in the transformation of a visual input into the appropriate motor output. In this study we used functional magnetic resonance imaging (fMRI) of the entire brain to determine the patterns of activation that occurred while subjects performed a visually guided motor task. In nine human subjects, fMRI data were acquired on a 4-T whole-body MR system equipped with a head gradient coil and a birdcage RF coil using a T2*-weighted EPI sequence. Functional activation was determined for three different tasks: (1) a visuomotor task consisting of moving a cursor on a screen with a joystick in relation to various targets, (2) a hand movement task consisting of moving the joystick without visual input, and (3) a eye movement task consisting of moving the eyes alone without visual input. Blood oxygenation level-dependent (BOLD) contrast-based activation maps of each subject were generated using period cross-correlation statistics. Subsequently, each subject's brain was normalized to Talairach coordinates, and the individual maps were compared on a pixel by pixel basis. Significantly activated pixels common to at least four out of six subjects were retained to construct the final functional image. The pattern of activation during visually guided movements was consistent with the flow of information from striate and extrastriate visual areas, to the posterior parietal complex, and then to frontal motor areas. The extensive activation of this network and the reproducibility among subjects is consistent with a role for the dorsal stream in transforming visual information into motor behavior. Also extensively activated were the medial and lateral cerebellar structures, implicating the cortico-pontocerebellar pathway in visually guided movements. Thalamic activation, particularly of the pulvinar, suggests that this nucleus is an important subcortical target of the dorsal stream.

A neural system for human visual working memory

Working memory is the process of actively maintaining a representation of information for a brief period of time so that it is available for use. In monkeys, visual working memory involves the concerted activity of a distributed neural system, including posterior areas in visual cortex and anterior areas in prefrontal cortex. Within visual cortex, ventral stream areas are selectively involved in object vision, whereas dorsal stream areas are selectively involved in spatial vision. This domain specificity appears to extend forward into prefrontal cortex, with ventrolateral areas involved mainly in working memory for objects and dorsolateral areas involved mainly in working memory for spatial locations. The organization of this distributed neural system for working memory in monkeys appears to be conserved in humans, though some differences between the two species exist. In humans, as compared with monkeys, areas specialized for object vision in the ventral stream have a more inferior location in temporal cortex, whereas areas specialized for spatial vision in the dorsal stream have a more superior location in parietal cortex. Displacement of both sets of visual areas away from the posterior perisylvian cortex may be related to the emergence of language over the course of brain evolution. Whereas areas specialized for object working memory in humans and monkeys are similarly located in ventrolateral prefrontal cortex, those specialized for spatial working memory occupy a more superior and posterior location within dorsal prefrontal cortex in humans than in monkeys. As in posterior cortex, this displacement in frontal cortex also may be related to the emergence of new areas to serve distinctively human cognitive abilities.

Eye position encoding in the macaque posterior parietal cortex

In two previous studies, we had demonstrated the influence of eye position on neuronal discharges in the middle temporal area, medial superior temporal area, lateral intraparietal area and area 7A of the awake monkey (Bremmer et al., 1997a,b). Eye position effects also have been found in visual cortical areas V3A and V6 and even in the premotor cortex and the supplementary eye field. These effects are generally discussed in light of a coordinate transformation of visual signals into a non-retinocentric frame of reference. Neural network studies dealing with the eye position effect succeeded in constructing such non-retinocentric representations by using model neurones whose response characteristics resembled those of 'real' neurones. However, to our knowledge, response properties of real neurones never acted as input into these neural networks. In the present study, we thus investigated whether, theoretically, eye position could be estimated from the population discharge of the (previously) recorded neurones and, if so, we intended to develop an encoding algorithm for the position of the eyes in the orbit. The optimal linear estimator proved the capability of the ensemble activity for determining correctly eye position. We then developed the so-called subpopulation encoding of eye position. This algorithm is based on the partition of the ensemble of neurones into two pairs of subpopulations. Eye position is represented by the differences of activity levels within each pair of subpopulations. Considering this result, encoding of the location of an object relative to the head could easily be accomplished by combining eye position information with the intrinsic knowledge about the retinal location of a visual stimulus. Taken together, these results show that throughout the monkey's visual cortical system information is available which can be used in a fairly simple manner in order to generate a non-retinocentric representation of visual information.

Parallel processing streams in human visual cortex

This study shows the existence in humans of independent neural processing streams in early visual cortex, which had previously been demonstrated in macaque monkeys. This evidence was obtained by controlled fixation testing of a subject who had suffered a small stroke in the right fusiform gyrus. The patient showed a severe disruption of color perception, shape discrimination and contrast sensitivity for stationary gratings in the upper left quadrant of his visual field. However, motion perception and contrast sensitivity for drifting gratings were relatively preserved. These results support the view that there are independent visual processing streams early in human visual cortex, and that these streams may subserve such functions as motion and color/form perception.

Responsiveness of neurons in the posterior inferotemporal cortex to visual patterns in the macaque monkey

Using anesthetized and immobilized monkeys, responses of neurons in the posterior inferotemporal cortex to visual patterns were examined. Response properties were compared between the sulcus and the gyrus, extending between the anterior tip of the posterior middle temporal sulcus and the inferior occipital sulcus. Of 682 neurons tested, 37% in the sulcus (134/365) and 36% in the gyrus (113/317) responded to one or more patterns. The preference of neurons for patterns varied from neuron to neuron; some neurons responded selectively to one particular pattern, whereas others responded to two or more patterns. To evaluate response properties of neurons, two indices were calculated (the pattern preference index and the pattern selectivity index). The distributions of these indices in the sulcus did not differ significantly from those of the gyrus. Furthermore, the relationship between the pattern preference index and the pattern selectivity index for each neuron was almost the same in these two portions; most neurons responding to a small number of patterns showed inhibitory or weak responses to the worst pattern. In both portions, most neurons had receptive fields with small eccentricities and receptive field sizes were almost the same. These results suggest that the cortex in the sulcus in the posterior inferotemporal cortex is involved in the detection of features of visual patterns, similarly to the cortex in the gyrus.

Modular organization of occipito-temporal pathways: cortical connections between visual area 4 and visual area 2 and posterior inferotemporal ventral area in macaque monkeys

The modular organization of cortical pathways linking visual area 4 (V4) with occipital visual area 2 (V2) and inferotemporal posterior inferotemporal ventral area (PITv) was investigated through an analysis of the patterns of retrogradely labeled cell bodies after injections of tracers into V4 and PITv. Although cytochrome oxidase or other stains have failed to yield reliable independent anatomical markers for cortical modules beyond V1 and V2, V4 and PITv seem to have modular compartments with specific patterns of cortico-cortical connectivity. Tracer injections of V4 labeled cells in V2 (1) thin stripes exclusively, (2) interstripes exclusively, or (3) specific combinations of interstripe and thin stripe subcompartments. These labeling patterns suggest (1) that there is a complicated organization of inputs to V4, (2) that projections from V2 to V4 display a submodular selectivity, and (3) that projections from V2 to V4 display some degree of cross-stream convergence. Consistent with this framework, extensive regions of PITv provide feedback projections to interstripe-recipient portions of V4, whereas more restricted portions of PITv provide feedback to thin stripe-recipient portions of V4. Similarly, the feedforward projection from V4 to PITv often arose from multiple cell clusters across a wide expanse of V4. When distinguishable fluorescent tracers were injected into two PITv sites separated by 3-5 mm, a variety of projection patterns was observed in V4. In most cases, labeled cells were found in multiple, interdigitating, nonoverlapping clusters of 1-3 mm width, whereas in other cases the two labeled fields were highly intermixed. These results suggest that V4 and PITv contain functional modules that can be characterized by the specific patterns of segregated and convergent projections they receive from lower cortical areas. These specific patterns of intercortical input, in conjunction with intrinsic cortical circuitry, may endow extrastriate cortical neurons with new and more complex receptive field properties.

Cortical connections of areas V3 and VP of macaque monkey extrastriate visual cortex

The cortical connections of visual area 3 (V3) and the ventral posterior area (VP) in the macaque monkey were studied by using combinations of retrograde and anterograde tracers. Tracer injections were made into V3 or VP following electrophysiological recording in and near the target area. The pattern of ipsilateral cortical connections was analyzed in relation to the pattern of interhemispheric connections identified after transection of the corpus callosum. Both V3 and VP have major connections with areas V2, V3A, posterior intraparietal area (PIP), V4, middle temporal area (MT), medial superior temporal area (dorsal) (MSTd), and ventral intraparietal area (VIP). Their connections differ in several respects. Specifically, V3 has connections with areas V1 and V4 transitional area (V4t) that are absent for VP; VP has connections with areas ventral occipitotemporal area (VOT), dorsal prelunate area (DP), and visually responsive portion of temporal visual area F (VTF) that are absent or occur only rarely for V3. The laminar pattern of labelled terminals and retrogradely labeled cell bodies allowed assessment of the hierarchical relationships between areas V3 and VP and their various targets. Areas V1 and V2 are at a lower level than V3 and VP; all of the remaining areas are at a higher level. V3 receives major inputs from layer 4B of V1, suggesting an association with the magnocellular-dominated processing stream and a role in routing magnocellular-dominated information along pathways leading to both parietal and temporal lobes. The convergence and divergence of pathways involving V3 and VP underscores the distributed nature of hierarchical processing in the visual system.

Collateralized divergent feedback connections that target multiple cortical areas

Nonreciprocal feedback connections from ventromedial areas TE and TF have previously been reported to visual areas V1 and V2 (Kennedy and Bullier, 1985; Rockland and Van Hoesen, 1994). The present report confirms these earlier observations by utilizing anterograde label in conjunction with serial section analysis. Furthermore, it directly demonstrates the divergent configuration and range of these terminal fields. Thirteen axons were analyzed from ventromedial TE (4) or area TF (9) to occipitotemporal areas, and two from area TF to the upper bank of the intraparietal sulcus (IPS). All these axons have narrow, elongated fields that range from 4.0-21.0 mm. Terminations are distributed linearly along the axon or, in some cases, concentrated in irregularly spaced clusters. Most of these axons have terminations concentrated in layer 1. The two axons in the IPS have a bistratified terminal distribution (in layers 1-3 and 6) in their anterior field, but a distinctly different laminar pattern (with terminations concentrated in layer 1) in their distal 2.0 mm. These fields probably correspond to different areas, most likely MIP and PO. Axons projecting from higher order to early visual areas may contribute to extraperceptual, complex processes within area V1, such as activation in response to visual imagery, and are a possible substrate for synchronous linkage of spatially discrete assemblies of neurons. In summary, these results demonstrate 1) that some neurons in ventromedial TE and TF are in direct communication with early visual areas, including V1 and V2, and 2) that some feedback axons target several areas, sometimes with different laminar termination patterns. These results emphasize that cortical areas are interrelated by multiple direct and indirect pathways, not all of which are strictly hierarchical.

Localization of grasp representations in humans by PET: 1. Observation versus execution

Positron emission tomography (PET) was used to localize brain regions that are active during the observation of grasping movements. Normal, right-handed subjects were tested under three conditions. In the first, they observed grasping movements of common objects performed by the experimenter. In the second, they reached and grasped the same objects. These two conditions were compared with a third condition consisting of object observation. On the basis of monkey data, it was hypothesized that during grasping observation, activations should be present in the region of the superior temporal sulcus (STS) and in inferior area 6. The findings in humans demonstrated that grasp observation significantly activates the cortex of the middle temporal gyrus including that of the adjacent superior temporal sulcus (Brodmann's area 21) and the caudal part of the left inferior frontal gyrus (Brodmann's area 45). The possible functional homologies between these areas and the monkey STS region and frontal area F5 are discussed.

Topographic patterns of V2 cortical connections in macaque monkeys

Patterns of connections of dorsal and ventral portions of the second visual area (V2) were used to evaluate and extend current theories of cortical organization and processing streams in macaque monkeys. Injections of wheat germ agglutinin-horseradish peroxidase (WGA-HRP) and up to four different fluorochromes in V2 labeled neurons and terminations in V2 and in 1) caudal (DLc) and rostral (DLr) subdivisions of dorsolateral cortex between V2 and the middle temporal area (MT); 2) regions we define as dorsomedial (DM) and dorsointermediate (DI) areas; 3) MT, medial superior temporal area (MST), and fundal superior temporal area (FST); 4) the dorsal part of inferior temporal (TEO) cortex; and 5) two locations in posterior parietal cortex. The largest extrastriate connection zone was DLc, which occupied the caudal one-third to one-half of the fourth visual area (V4) region of other proposals. Based on the connection pattern, foveal vision in DLc is represented adjacent to foveal vision in V2, with the lower quadrant represented dorsally and the upper quadrant ventrally, as in V2, but within a much less extensive region of cortex. The sparser connections of DLr formed a more compressed but parallel visuotopic pattern. A third visuotopic pattern of connections was located in a moderately myelinated region of cortex just rostral to dorsomedial V2. Whereas the region would include parts of dorsal visual area 3 (V3), V3a, and possibly other areas of other proposals, we interpret the connection pattern as reflecting a dorsomedial visual area, DM, with foveal vision represented caudolaterally and other parts of the lower and upper quadrants represented more medially and rostrally. A fourth pattern of label in dorsointermediate cortex suggested the location and organization of another visual area (DI). Most of a fifth connection pattern with MT was congruent with the known visuotopic organization of MT area, but visuotopically mismatched foci of connections were observed as well. Sparser foci of label in MST suggested a rostrodorsal representation of foveal vision, with paracentral vision represented more caudally. Separate dorsal and ventral foci of label in FST were consistent with previous evidence for dorsal (FSTd) and ventral (FSTv) visual areas. Finally, connections with TEO and posterior parietal cortex were sparse. Our results suggest that much of visual cortex organization is similar in New and Old World monkeys.

rCBF-activatie en neuronale circuits gerelateerd aan visuele waarneming

Three principles of neuronal interaction within cortically distributed networks are discussed. PET-rCBF activation methods provide an opportunity to acquire insight in the distribution of functionally related areas of the human brain in vivo. The distinction of visual areas, activated by either motion or color within an observed scenery, points at a segregation in neuronal information processing. Such a segregation extends into both a dorsal and a ventral route towards consequently the parietal and temporal cortex. Simultaneous activation over the dorsal and ventral route, which for example occurs in relation to the perception of complex motion (optic flow), or motion perception after lesion of V5, suggests integration by means of cross-connectivity. The third principle, i.e. "top-down" integration, appears by analysis of V5-V1 interaction, attentional effects on V4, frontal activation in prosopagnosia, and by analysis of hallucinations. Such "top-down" integration indicates the presence of momentaneous effect on cortical areas, intimately related to the primary sensory cortex, by neuronal activity of remote "association" cortex, the latter being connected by direct (synaps-restricted) bypass from early stations of information processing.

The primate temporal pole: its putative role in object recognition and memory

In this article, we consider both the ventral temporopolar cortex and the perirhinal cortex (areas 35 and 36) as the anterior ventromedial temporal (aVMT) cortex, and discuss its role based on recent data in monkeys and human subjects. In monkeys, the aVMT cortex receives its primary input from area TE, and only minor input from other cortical areas. Laminar patterns of connections suggest that the aVMT cortex is a hierarchically higher-order area than area TE. Lesions of this cortex produce deficits in the learning and performance of visual memory tasks. Neurons in the aVMT cortex respond selectively to complex stimuli and changes in activity related to visual memory tasks. In humans, damage of this cortex induces deficits in the recognition of familiar objects and faces. The aVMT cortex is activated during recognition of familiar faces. In addition, the aVMT cortex is one of the most vulnerable areas in Alzheimer's disease. All these data indicate that the aVMT cortex is a higher-order visual cortical area that is related to object recognition and memory. The anterior area TE has been implicated in both functions. We propose here that these areas and the anterior entorhinal cortex are designated as the temporal pole, a brain region which is specialized for both object recognition and memory.

Cue-dependent deficits in grating orientation discrimination after V4 lesions in macaques

To examine the role of visual area V4 in pattern vision, we tested two monkeys with lesions of V4 on tasks that required them to discriminate the orientation of contours defined by several different cues. The cues used to separate the contours from their background included luminance, color, motion, and texture, as well as phase-shifted abutting gratings that created an "illusory" contour. The monkeys were trained to maintain fixation on a fixation target while discriminating extrafoveal stimuli, which were located in either a normal control quadrant of the visual field or in a quadrant affected by a lesion of area V4 in one hemisphere. Comparing performance in the two quadrants, we found significant deficits for contours defined by texture and for the illusory contour, but smaller or no deficits for motion-, color-, and luminance-defined contours. The data suggest a specific role of V4 in the perception of illusory contours and contours defined by texture.

Functional streams in occipito-frontal connections in the monkey

It is known that the prestriate cortical regions that project to area LIP in parietal cortex and to areas TEO and TE in temporal cortex are mostly separated. Two separate streams of information transfer from occipital cortex can this be distinguished. We wished to determine whether the parietal and temporal streams remain segregated in their projections to frontal cortex. Paired injections of retrograde fluorescent tracers were placed in parietal and temporal cortex, or in the lateral and medial parts of the frontal eye field (FEF). The cortical regions containing retrogradely labeled cells were reconstructed in two-dimensional maps. The results show that temporal cortex mainly projects to lateral FEF (area 45). Parietal cortex sends projections to medial FEF (area 8a) and to lateral FEF, as well as to area 46. Thus, the parietal and temporal streams converge in lateral FEF. Most of the occipital regions projecting to medial FEF are the same as those projecting to parietal cortex, whereas lateral FEF receives afferents from the same occipital regions as those sending projections to temporal cortex. Thus, one can distinguish two interconnected networks. One is associated with the inferotemporal cortex and includes areas of the ventral bank and fundus of the superior temporal sulcus (STS), lateral FEF and ventral prestriate cortex. This network emphasizes central vision, small accades and form recognition. The other network is linked to cortex of the intraparietal sulcus. It consists of areas of the upper bank and fundus of STS, medial FEF and dorsal prestriate cortex. These areas encode peripheral visual field and are active during large saccades.

Frontal lobe mechanisms subserving vision-for-action versus vision-for-perception

In the typical course of daily events, we often gaze at an object, attend to its features and its place, reach toward it and grasp it, all with an awareness of what we are doing at the time. But behavior is not always thus. Gaze, attention, limb movement direction and awareness can be behaviorally dissociated from each other, and this review focuses on one such dissociation: that between the perception of an object and the use of that object's inherent spatial and nonspatial information for mediating visuomotor control. We review evidence that partially different neuronal systems underlie these two aspects of visual information processing. In neurophysiological studies of the primate frontal lobe, it has been possible to demonstrate that neural signals appearing to be visual responses reflect, at least in part, the motor significance of a stimulus. This finding has been confirmed, in separate studies, for both spatial and nonspatial visual information and supports the hypothesis that some frontal cortex activity reflects the selection and guidance of action rather than the properties of visual stimuli, per se. These findings are discussed in the context of neuropsychological studies indicating that accurate and appropriate movements are possible without perceptual awareness of the information guiding those movements.