Object shape processing in the visual system evaluated using functional MRI

The extrastriate symmetry response is robust to variation in visual memory load

An Event Related Potential response to visual symmetry, known as the Sustained Posterior Negativity (SPN), is generated whether symmetry is task relevant or not, and whether symmetry is attended or not. However, no study has yet examined interference from concurrent memory tasks. To answer this fundamental question, we investigated whether the SPN is robust to variation in Visual Working Memory (VWM) load. In Experiment 1 (N = 24), each trial involved a sample display, a probe and a test display. Sample and test displays contained either four colors or four black shapes, and the probe was either a symmetrical or random pattern. We compared a memory task and a passive viewing task. In the memory task, participants held color or shape information in VWM when the probe was presented. In the passive viewing task, there were no memory demands. Contrary to our predictions, there was no evidence that VWM interfered with the symmetry response. Instead, there was a general SPN enhancement during both color and shape memory tasks compared to passive viewing. In Experiment 2 (N = 24), we used symmetrical patterns themselves as sample and test to maximize interference. Again, the SPN was enhanced in the memory task compared to passive viewing. We conclude that the visual symmetry response is not impaired by concurrent VWM tasks, even when these tasks involve remembering symmetry itself. It seems that the SPN is not only attention-proof, but also memory-proof. This adds to evidence that symmetry perception is robust and automatic.

Cortical responses to shape-from-motion stimuli in the infant

Our ability to extract three-dimensional (3-D) object structure from motion-carried information is a basic visual capacity that is fundamental to object perception. Despite a rich body of behavioral work demonstrating that infants are sensitive to motion-carried information from the early months of life, little is known about the cortical networks that support infants' use of motion-carried information to extract 3-D object structure. This study assessed patterns of cortical activation in infants aged 4 to 6 months as they viewed two types of visual stimuli: (a) shape-from-motion (SFM) displays, where coherent motion of randomly distributed dots gave rise to the percept of 3-D shape and (b) random motion (RM) displays, where dots' motions lacked a coherent structure and gave rise to the percept of randomly moving dots. Functional near-infrared spectroscopy was used to assess activation in occipital, inferior parietal, and posterior temporal cortex. The optical imaging data revealed differential responding to SFM and RM in lower level object processing areas than typically observed in the adult. Possible explanations for this pattern of results are considered.

White Matter Changes and Confrontation Naming in Retired Aging National Football League Athletes

Using diffusion tensor imaging (DTI), we assessed the relationship of white matter integrity and performance on the Boston Naming Test (BNT) in a group of retired professional football players and a control group. We examined correlations between fractional anisotropy (FA) and mean diffusivity (MD) with BNT T-scores in an unbiased voxelwise analysis processed with tract-based spatial statistics (TBSS). We also analyzed the DTI data by grouping voxels together as white matter tracts and testing each tract's association with BNT T-scores. Significant voxelwise correlations between FA and BNT performance were only seen in the retired football players (p < 0.02). Two tracts had mean FA values that significantly correlated with BNT performance: forceps minor and forceps major. White matter integrity is important for distributed cognitive processes, and disruption correlates with diminished performance in athletes exposed to concussive and subconcussive brain injuries, but not in controls without such exposure.

Distinct Patterns of Viewpoint-Dependent BOLD Activity during Common-Object Recognition and Mental Rotation

A fundamental but unanswered question about the human visual system concerns the way in which misoriented objects are recognized. One hypothesis maintains that representations of incoming stimuli are transformed via parietally based spatial normalization mechanisms (eg mental rotation) to match view-specific representations in long-term memory. Using fMRI, we tested this hypothesis by directly comparing patterns of brain activity evoked during classic mental rotation and misoriented object recognition involving everyday objects. BOLD activity increased systematically with stimulus rotation within the ventral visual stream during object recognition and within the dorsal visual stream during mental rotation. More specifically, viewpoint-dependent activity was significantly greater in the right superior parietal lobule during mental rotation than during object recognition. In contrast, viewpoint-dependent activity was significantly greater in the right fusiform gyrus during object recognition than during mental rotation. In addition to these differences in viewpoint-dependent activity, object recognition and mental rotation produced distinct patterns of brain activity, independent of stimulus rotation: object recognition resulted in greater overall activity within ventral stream visual areas and mental rotation resulted in greater overall activity within dorsal stream visual areas. The present results are inconsistent with the hypothesis that misoriented object recognition is mediated by structures within the parietal lobe that are known to be involved in mental rotation.

Brain functional network connectivity based on a visual task: visual information processing-related brain regions are significantly activated in the task state

It is not clear whether the method used in functional brain-network related research can be applied to explore the feature binding mechanism of visual perception. In this study, we investigated feature binding of color and shape in visual perception. Functional magnetic resonance imaging data were collected from 38 healthy volunteers at rest and while performing a visual perception task to construct brain networks active during resting and task states. Results showed that brain regions involved in visual information processing were obviously activated during the task. The components were partitioned using a greedy algorithm, indicating the visual network existed during the resting state. Z-values in the vision-related brain regions were calculated, confirming the dynamic balance of the brain network. Connectivity between brain regions was determined, and the result showed that occipital and lingual gyri were stable brain regions in the visual system network, the parietal lobe played a very important role in the binding process of color features and shape features, and the fusiform and inferior temporal gyri were crucial for processing color and shape information. Experimental findings indicate that understanding visual feature binding and cognitive processes will help establish computational models of vision, improve image recognition technology, and provide a new theoretical mechanism for feature binding in visual perception.

Cortical activation to object shape and speed of motion during the first year

A great deal is known about the functional organization of cortical networks that mediate visual object processing in the adult. The current research is part of a growing effort to identify the functional maturation of these pathways in the developing brain. The current research used near-infrared spectroscopy to investigate functional activation of the infant cortex during the processing of featural information (shape) and spatiotemporal information (speed of motion) during the first year of life. Our investigation focused on two areas that were implicated in previous studies: anterior temporal cortex and posterior parietal cortex. Neuroimaging data were collected with 207 infants across three age groups: 3-6 months (Experiment 1), 7-8 months (Experiment 2), and 10-12 months (Experiments 3 and 4). The neuroimaging data revealed age-related changes in patterns of activation to shape and speed information, mostly involving posterior parietal areas, some of which were predicted and others that were not. We suggest that these changes reflect age-related differences in the perceptual and/or cognitive processes engaged during the task.

Multisensory convergence of visual and haptic object preference across development

Visuohaptic inputs offer redundant and complementary information regarding an object׳s geometrical structure. The integration of these inputs facilitates object recognition in adults. While the ability to recognize objects in the environment both visually and haptically develops early on, the development of the neural mechanisms for integrating visual and haptic object shape information remains unknown. In the present study, we used functional Magnetic Resonance Imaging (fMRI) in three groups of participants, 4 to 5.5 year olds, 7 to 8.5 year olds, and adults. Participants were tested in a block design involving visual exploration of two-dimensional images of common objects and real textures, and haptic exploration of their three-dimensional counterparts. As in previous studies, object preference was defined as a greater BOLD response for objects than textures. The analyses specifically target two sites of known visuohaptic convergence in adults: the lateral occipital tactile-visual region (LOtv) and intraparietal sulcus (IPS). Results indicated that the LOtv is involved in visuohaptic object recognition early on. More importantly, object preference in the LOtv became increasingly visually dominant with development. Despite previous reports that the lateral occipital complex (LOC) is adult-like by 8 years, these findings indicate that at least part of the LOC is not. Whole-brain maps showed overlap between adults and both groups of children in the LOC. However, the overlap did not build incrementally from the younger to the older group, suggesting that visuohaptic object preference does not develop in an additive manner. Taken together, the results show that the development of neural substrates for visuohaptic recognition is protracted compared to substrates that are primarily visual or haptic.

Facilitation of naming in aphasia with auditory repetition: an investigation of neurocognitive mechanisms

Prior phonological processing can enhance subsequent picture naming performance in individuals with aphasia, yet the neurocognitive mechanisms underlying this effect and its longevity are unknown. This study used functional magnetic resonance imaging to examine the short-term (within minutes) and long-term (within days) facilitation effects from a phonological task in both participants with aphasia and age-matched controls. Results for control participants suggested that long-term facilitation of subsequent picture naming may be driven by a strengthening of semantic-phonological connections, while semantic and object recognition mechanisms underlie more short-term effects. All participants with aphasia significantly improved in naming accuracy following both short- and long-term facilitation. A descriptive comparison of the neuroimaging results identified different patterns of activation for each individual with aphasia. The exclusive engagement of a left hemisphere phonological network underlying facilitation was not revealed. The findings suggest that improved naming in aphasia with phonological tasks may be supported by changes in right hemisphere activity in some individuals and reveal the potential contribution of the cerebellum to improved naming following phonological facilitation. Conclusions must be interpreted with caution, however, due to the comparison of corrected group control results to that of individual participants with aphasia, which were not corrected for multiple comparisons.

The neural correlates of picture naming facilitated by auditory repetition

BACKGROUND

Overt repetition of auditorily presented words can facilitate picture naming performance in both unimpaired speakers and individuals with word retrieval difficulties, but the underlying neurocognitive mechanisms and longevity of such effects remain unclear. This study used functional magnetic resonance imaging to examine whether different neurological mechanisms underlie short-term (within minutes) and long-term (within days) facilitation effects from an auditory repetition task in healthy older adults.

RESULTS

The behavioral results showed that both short- and long-term facilitated items were named significantly faster than unfacilitated items, with short-term items significantly faster than long-term items. Neuroimaging analyses identified a repetition suppression effect for long-term facilitated items, relative to short-term facilitated and unfacilitated items, in regions known to be associated with both semantic and phonological processing. A repetition suppression effect was also observed for short-term facilitated items when compared to unfacilitated items in a region of the inferior temporal lobe linked to semantic processing and object recognition, and a repetition enhancement effect when compared to long-term facilitated items in a posterior superior temporal region associated with phonological processing.

CONCLUSIONS

These findings suggest that different neurocognitive mechanisms underlie short- and long-term facilitation of picture naming by an auditory repetition task, reflecting both phonological and semantic processing. More specifically, the brain areas engaged were consistent with the view that long-term facilitation may be driven by a strengthening of semantic-phonological connections. Short-term facilitation, however, appears to result in more efficient semantic processing and/or object recognition, possibly in conjunction with active recognition of the phonological form.

Selective involvement of superior frontal cortex during working memory for shapes

A spatial/nonspatial functional dissociation between the dorsal and ventral visual pathways is well established and has formed the basis of domain-specific theories of prefrontal cortex (PFC). Inconsistencies in the literature regarding prefrontal organization, however, have led to questions regarding whether the nature of the dissociations observed in PFC during working memory are equivalent to those observed in the visual pathways for perception. In particular, the dissociation between dorsal and ventral PFC during working memory for locations versus object identities has been clearly present in some studies but not in others, seemingly in part due to the type of objects used. The current study compared functional MRI activation during delayed-recognition tasks for shape or color, two object features considered to be processed by the ventral pathway for perceptual recognition. Activation for the shape-delayed recognition task was greater than that for the color task in the lateral occipital cortex, in agreement with studies of visual perception. Greater memory-delay activity was also observed, however, in the parietal and superior frontal cortices for the shape than for the color task. Activity in superior frontal cortex was associated with better performance on the shape task. Conversely, greater delay activity for color than for shape was observed in the left anterior insula and this activity was associated with better performance on the color task. These results suggest that superior frontal cortex contributes to performance on tasks requiring working memory for object identities, but it represents different information about those objects than does the ventral frontal cortex.

Hemodynamic changes in the infant cortex during the processing of featural and spatiotemporal information

Over the last 20 years neuroscientists have learned a great deal about the ventral and dorsal object processing pathways in the adult brain, yet little is known about the functional development of these pathways. The present research assessed the extent to which different patterns of neural activation, as measured by changes in blood volume and oxygenation, are observed in infant visual and temporal cortex in response to events that involve processing of featural differences or spatiotemporal discontinuities. Infants aged 6.5 months were tested. Increased neural activation was observed in visual cortex in response to a featural-difference and a spatiotemporal-discontinuity event. In addition, increased neural activation was observed in temporal cortex in response to the featural-difference but not the spatiotemporal-discontinuity event. The outcome of this experiment reveals early functional specialization of temporal cortex and lays the foundation for future investigation of the maturation of object processing pathways in humans.

Hemodynamic response to featural changes in the occipital and inferior temporal cortex in infants: a preliminary methodological exploration

Over the past 30 years researchers have learned a great deal about the development of object processing in infancy. In contrast, little is understood about the neural mechanisms that underlie this capacity, in large part because there are few techniques available to measure brain functioning in human infants. The present research examined the extent to which near-infrared spectroscopy (NIRS), an optical imaging technique, could be used to assess the relation between object processing and brain functioning. Infants aged 6.5 months were presented with an occlusion event involving objects that differed on many feature dimensions (multi-featural change), differed on shape only (shape change) or color only (color change), or did not differ (control). NIRS data were collected in the occipital and inferior temporal cortex. In the occipital cortex, a significant increase in oxyhemoglobin (HbO(2)) was observed in response to all four events and these responses did not differ significantly from each other. In the inferior temporal cortex, a significant increase in HbO(2 )was observed in the multi-featural and the shape change condition but not in the control condition. An increase was also observed in the color change condition but this increase did not differ significantly from baseline nor did it differ significantly from the response obtained in the control condition. These data were discussed in terms of (a) what they suggest about the neural basis of feature processing in infants and (b) the viability of using NIRS to study brain-behavior relations in infants.

Visual recognition and visually guided action after early bilateral lesion of occipital cortex: a behavioral study of a 4.6-year-old girl

We report the case of a 4.6-year-old girl born pre-term with early bilateral occipital damage. It was revealed that the child had non-severely impaired basic visual abilities and ocular motility, a selective perceptual deficit of figure-ground segregation, impaired visual recognition and abnormal navigating through space. Even if the child's visual functioning was not optimal, this was the expression of adaptive anatomic and functional brain modifications that occurred following the early lesion. Anatomic brain structure was studied with anatomic MRI and Diffusor Tensor Imaging (DTI)-MRI. This behavioral study may provide an important contribution to understanding the impact of an early lesion of the visual system on the development of visual functions and on the immature brain's potential for reorganisation related to when the damage occurred.

Using functional magnetic resonance imaging to assess adaptation and size invariance of shape processing by humans and monkeys

Functional magnetic resonance imaging in awake monkeys and humans was used to compare object adaptation in shape-sensitive regions of these two species under identical and different size conditions. Object adaptation was similar in humans and monkeys under both conditions. Neither species showed complete size invariance, in agreement with single-cell studies. Both the macaque inferotemporal (IT) complex and human lateral occipital complex (LOC) displayed an anteroposterior gradient in object adaptation and size invariance, with the more anterior regions being more adaptable and size invariant. The results provide additional evidence for the homology between the macaque IT cortex and human LOC but also add to the growing list of differences between human and monkey intraparietal sulcus regions.

Recognition of objects in non-canonical views: a functional MRI study

BACKGROUND

The neural correlate of object recognition in non-canonical views is uncertain, but there is evidence for involvement of neural pathways, possibly separate from those used for object recognition in canonical views.

METHODS

Boxcar functional MRI (fMRI) techniques were used to detect neural activity while eight normal subjects were instructed to identify digital photographs of objects in non-canonical and canonical orientations.

RESULTS

The right angular gyrus, the left inferior temporal gyrus, and the right cerebellum showed significant fMRI activity during non-canonical as opposed to canonical viewing.

CONCLUSIONS

Subjects recognizing objects in non-canonical orientations engage in a process separate from, or in addition to, the process used in recognizing objects in canonical orientations.

Studies of human visual pathophysiology with visual evoked potentials

Visual evoked potentials (VEPs) offer reproducible and quantitative data on the function of the visual pathways and the visual cortex. Pattern reversal VEPs to full-field stimulation are best suited to evaluate anterior visual pathways while hemi-field stimulation is most effective in the assessment of post-chiasmal function. However, visual information is processed simultaneously via multiple parallel channels and each channel constitutes a set of sequential processes. We outline the major parallel pathways of the visual system from the retina to the primary visual cortex and higher visual areas via lateral geniculate nucleus that receive visual input. There is no best method of stimulus selection, rather visual stimuli and VEPs' recording should be tailored to answer specific clinical and/or research questions. Newly developed techniques that can assess the functions of extrastriate as well as striate cortices are discussed. Finally, an algorithm of sequential steps to evaluate the various levels of visual processing is proposed and its clinical use revisited.

A memory span of one? Object identification in 6.5-month-old infants

Infants' abilities to identify objects based on their perceptual features develop gradually during the first year and possibly beyond. Earlier we reported [Káldy, Z., & Leslie, A. M. (2003). Identification of objects in 9-month-old infants: Integrating 'what' and 'where' information. Developmental Science, 6, 360-373] that infants at 9 months of age are able to use shape information to identify two objects and follow their spatiotemporal trajectories behind occlusion. On the other hand, another recent study suggests that infants at 4-5 months of age cannot identify objects by features and bind them to locations [Mareschal, D., & Johnson, M. H. (2003). The "what" and "where" of object representations in infancy. Cognition, 88, 259-276]. In the current study, we investigated the developmental steps between these two benchmark ages by testing 6.5-month-old infants. Experiment 1 and 2 adapted the paradigm used in our previous studies with 9-month-olds that involves two objects hidden sequentially behind separate occluders. This technique allows us to address object identification and to examine whether only one or both object identities are being tracked. Results of experiment 1 showed that 6.5-month-old infants could identify at least one of two objects based on shape and experiment 2 found that this ability holds for only one, the last object hidden. We propose that at this age, infants' working memory capacity is limited to one occluded object if there is a second intervening hiding. If their attention is distracted by an intervening object during the memory maintenance period, the memory of the first object identity appears to be lost. Results of experiment 3 supported this hypothesis with a simpler one-screen setup. Finally, results of experiment 4 show that temporal decay of the memory trace (without an intervening hiding) by itself cannot explain the observed pattern of results. Taken together, our findings suggest that at six months of age infants can store but a single object representation with bound shape information, most likely in the ventral stream. The memory span of one may be due to immaturity of the neural structures underlying working memory such that intervening items overwrite the existing storage.

A double dissociation between sensitivity to changes in object identity and object orientation in the ventral and dorsal visual streams: a human fMRI study

We used an event-related fMR-adaptation paradigm to investigate changes in BOLD activity in the dorsal and ventral visual streams as a function of object identity and object orientation. Participants viewed successive paired images of real-world, graspable objects, separated by a visual mask. The second image of each pair was either: (i) the same as the first image, (ii) different only in identity, (iii) different only in orientation, or (iv) different in both identity and orientation. A region in the parieto-occipital cortex (dorsal stream) showed a selective increase in BOLD activity with changes in object orientation, but was insensitive to changes in object identity. In contrast, a region in the temporo-occipital cortex (ventral stream) showed a selective increase in activity with changes in identity, but was insensitive to changes in orientation. The differential sensitivity to orientation and identity is consistent with the idea that the dorsal stream plays a critical role in the visual control of object-directed actions while the ventral stream plays a critical role in object perception.

Distinct and shared cortical regions of the human brain activated by pictorial depictions versus verbal descriptions: an fMRI study

Using fMRI, we observed that there were functionally disjunctive regions in the human brain that were specifically activated during the silent reading of sentences (i.e., the symbolical representation at the propositional level) but not during the perception of arranged objects (i.e., analogical representation), or vice versa: Parts of the left and right lingual gyri, the left fusiform gyrus, the left and right inferior occipital gyri, the right cuneus, and the left middle occipital gyrus were activated exclusively during the silent reading of sentences, whereas perception of the arranged objects activated distinct regions in the lingual gyrus, the declive, the fusiform gyrus, and the cuneus in the right hemisphere. A large proportion (86% in cortical volume) of the occipito-temporal regions was functionally conjunctive: these neural structures were activated during both silent reading of sentences and perception of arranged objects. We observed a similar trend of functional disjunction and conjunction between single words (the symbolical mode at the lexical level) and single objects (analogical mode): the degree of functional conjunction in the latter case was about 96%. These results suggest that the degree of functional disjunction between the pictorial depictions and the verbal descriptions tended to increase as the complexity of mental representation increased from the single word (lexical) level (4%) to the sentence (propositional) level (14%).

Using near-infrared spectroscopy to assess neural activation during object processing in infants

The capacity to represent the world in terms of numerically distinct objects (i.e., object individuation) is a milestone in early cognitive development and forms the foundation for more complex thought and behavior. Over the past 10 to 15 yr, infant researchers have expended a great deal of effort to identify the origins and development of this capacity. In contrast, relatively little is known about the neural mechanisms that underlie the ability to individuate objects, in large part because there are a limited number of noninvasive techniques available to measure brain functioning in human infants. Recent research suggests that near-IR spectroscopy (NIRS), an optical imaging technique that uses relative changes in total hemoglobin concentration and oxygenation as an indicator of neural activation, may be a viable procedure for assessing the relation between object processing and brain function in human infants. We examine the extent to which increased neural activation, as measured by NIRS, could be observed in two neural areas known to be involved in object processing, the primary visual cortex and the inferior temporal cortex, during an object processing task. Infants aged 6.5 months are presented with a visual event in which two featurally distinct objects emerge successively to opposite sides of an occluder and neuroimaging data are collected. As predicted, increased neural activation is observed in both the primary visual and inferior cortex during the visual event, suggesting that these neural areas support object processing in the young infant. The outcome has important implications for research in cognitive development, developmental neuroscience, and optical imaging.

Similar cortical correlates underlie visual object identification and orientation judgment

Visual object perception has been suggested to follow two different routes in the human brain: a ventral, view-invariant occipital-temporal route processes object identity, whereas a dorsal, view-dependent occipital-parietal route processes spatial properties of an object. Using fMRI, we addressed the question whether these routes are exclusively involved in either object recognition or spatial representation. We presented subjects with images of natural objects and involved them either in object identification or object orientation judgment task. For both tasks, we observed activation in ventro-temporal as well as parietal areas bilaterally, with significantly stronger responses for the orientation judgment in both ventro-temporal as well as parietal areas. Our findings suggest that object identification and orientation judgment do not follow strictly separable cortical pathways, but rather involve both the dorsal and the ventral stream.

Segregation and persistence of form in the lateral occipital complex

While the lateral occipital complex (LOC) has been shown to be implicated in object recognition, it is unclear whether this brain area is responsive to low-level stimulus-driven features or high-level representational processes. We used scrambled shape-from-motion displays to disambiguate the presence of contours from figure-ground segregation and to measure the strength of the binding process for shapes without contours. We found persisting brain activation in the LOC for scrambled displays after the motion stopped indicating that this brain area subserves and maintains figure-ground segregation processes, a low-level function in the object processing hierarchy. In our second experiment, we found that the figure-ground segregation process has some form of spatial constancy indicating top-down influences. The persisting activation after the motion stops suggests an intermediate role in object recognition processes for this brain area and might provide further evidence for the idea that the lateral occipital complex subserves mnemonic functions mediating between iconic and short-term memory.

Functional MRI neuroanatomic correlates of the Hooper Visual Organization Test

The Hooper Visual Organization Test (VOT), a commonly applied neuropsychological test of visual spatial ability, is used for assessing patients with suspected right hemisphere, or parietal lobe involvement. A controversy has developed over whether the inferences of this test metric can be assumed to involve global, lateralized, or regional functionality. In this study, the characteristic visual organization and object naming aspects of the VOT task presentation were adapted to a functional MR imaging (fMRI) paradigm to probe the neuroanatomic correlates of this neuropsychological test. Whole brain fMRI mapping results are reported on a cohort of normal subjects. Bilateral fMRI responses were found predominantly in the posterior brain, in regions of superior parietal lobules, ventral temporal-occipital cortex, and posterior visual association areas, and to a lesser extent, the frontal eye fields bilaterally, and left dorsolateral prefrontal cortex. The results indicate a general brain region or network in which VOT impairment, due to its visuospatial and object identification demands, is possible to be detected. Discussion is made of interpretive limitations when adapting neuropsychological tests to fMRI analysis.

The processing of visual shape in the cerebral cortex of human and nonhuman primates: a functional magnetic resonance imaging study

We compared neural substrates of two-dimensional shape processing in human and nonhuman primates using functional magnetic resonance (MR) imaging in awake subjects. The comparison of MR activity evoked by viewing intact and scrambled images of objects revealed shape-sensitive regions in occipital, temporal, and parietal cortex of both humans and macaques. Intraparietal cortex in monkeys was relatively more two-dimensional shape sensitive than that of humans. In both species, there was an interaction between scrambling and type of stimuli (grayscale images and drawings), but the effect of stimulus type was much stronger in monkeys than in humans. Shape- and motion-sensitive regions overlapped to some degree. However, this overlap was much more marked in humans than in monkeys. The shape-sensitive regions can be used to constrain the warping of monkey to human cortex and suggest a large expansion of lateral parietal and superior temporal cortex in humans compared with monkeys.

Dorsal stream activation during retrieval of object size and shape

We investigated dorsal visual stream involvement in the retrieval of a variety of visual attributes of common objects, using functional magnetic resonance imaging. Seven subjects made binary decisions about the shape, color, and size of named objects during scanning. Bilateral parietal activity was significantly greater during retrieval of shape and size information than during retrieval of color information. Consistent with a domain-specific distributed model of semantic organization, the finding that dorsal stream activity is associated with size and shape retrieval, as compared with color retrieval, may indicate that both size and shape information are learned partly through dorsally mediated processes, such as visually guided grasping. These results demonstrate that both visual-processing streams (i.e., the ventral "what" pathway and the dorsal "where" pathway) are involved in the storage and/or retrieval of knowledge of object appearance but that, just as in vision, these two pathways may play different roles in conceptual processing.

Functional magnetic resonance imaging of brain activity in the visual oddball task

Abnormalities in the P300 ERP, elicited by the oddball task and measured using EEG, have been found in a number of central nervous system disorders including schizophrenia, Alzheimer's disease, and alcohol dependence. While electrophysiological studies provide high temporal resolution, localizing the P300 deficit has been particularly difficult because the measurements are collected from the scalp. Knowing which brain regions are involved in this process would elucidate the behavioral correlates of P300. The aim of this study was to determine the brain regions involved in a visual oddball task using fMRI. In this study, functional and high-resolution anatomical MR images were collected from seven normal volunteers. The data were analyzed using a randomization-based statistical method that accounts for multiple comparisons, requires no assumptions about the noise structure of the data, and does not require spatial or temporal smoothing. Activations were detected (P<0.01) bilaterally in the supramarginal gyrus (SMG; BA 40), superior parietal lobule (BA 7), the posterior cingulate gyrus, thalamus, inferior occipitotemporal cortex (BA 19/37), insula, dorsolateral prefrontal cortex (BA 9), anterior cingulate cortex (ACC), medial frontal gyrus (BA 6), premotor area, and cuneus (BA 17). Our results are consistent with previous studies that have observed activation in ACC and SMG. Activation of thalamus, insula, and the occipitotemporal cortex has been reported less consistently. The present study lends further support to the involvement of these structures in visual target detection.

Haptic study of three-dimensional objects activates extrastriate visual areas

In humans and many other primates, the visual system plays the major role in object recognition. But objects can also be recognized through haptic exploration, which uses our sense of touch. Nonetheless, it has been argued that the haptic system makes use of 'visual' processing to construct a representation of the object. To investigate possible interactions between the visual and haptic systems, we used functional magnetic resonance imaging to measure the effects of cross-modal haptic-to-visual priming on brain activation. Subjects studied three-dimensional novel clay objects either visually or haptically before entering the scanner. During scanning, subjects viewed visually primed, haptically primed, and non-primed objects. They also haptically explored non-primed objects. Visual and haptic exploration of non-primed objects produced significant activation in several brain regions, and produced overlapping activation in the middle occipital area (MO). Viewing visually and haptically primed objects produced more activation than viewing non-primed objects in both area MO and the lateral occipital area (LO). In summary, haptic exploration of novel three-dimensional objects produced activation, not only in somatosensory cortex, but also in areas of the occipital cortex associated with visual processing. Furthermore, previous haptic experience with these objects enhanced activation in visual areas when these same objects were subsequently viewed. Taken together, these results suggest that the object-representation systems of the ventral visual pathway are exploited for haptic object perception.

Differential effects of viewpoint on object-driven activation in dorsal and ventral streams

Using fMRI, we showed that an area in the ventral temporo-occipital cortex (area vTO), which is part of the human homolog of the ventral stream of visual processing, exhibited priming for both identical and depth-rotated images of objects. This pattern of activation in area vTO corresponded to performance in a behavioral matching task. An area in the caudal part of the intraparietal sulcus (area cIPS) also showed priming, but only with identical images of objects. This dorsal-stream area treated rotated images as new objects. The difference in the pattern of priming-related activation in the two areas may reflect the respective roles of the ventral and dorsal streams in object recognition and object-directed action.

Object activation in semantic memory from visual multimodal feature input

The human brain's representation of objects has been proposed to exist as a network of coactivated neural regions present in multiple cognitive systems. However, it is not known if there is a region specific to the process of activating an integrated object representation in semantic memory from multimodal feature stimuli (e.g., picture-word). A previous study using word-word feature pairs as stimulus input showed that the left thalamus is integrally involved in object activation (Kraut, Kremen, Segal, et al., this issue). In the present study, participants were presented picture-word pairs that are features of objects, with the task being to decide if together they "activated" an object not explicitly presented (e.g., picture of a candle and the word "icing" activate the internal representation of a "cake"). For picture-word pairs that combine to elicit an object, signal change was detected in the ventral temporo-occipital regions, pre-SMA, left primary somatomotor cortex, both caudate nuclei, and the dorsal thalami bilaterally. These findings suggest that the left thalamus is engaged for either picture or word stimuli, but the right thalamus appears to be involved when picture stimuli are also presented with words in semantic object activation tasks. The somatomotor signal changes are likely secondary to activation of the semantic object representations from multimodal visual stimuli.

Object activation from features in the semantic system

The human brain is thought to elicit an object representation via co-activation of neural regions that encode various object features. The cortical regions and mechanisms involved in this process have never been elucidated for the semantic system. We used functional magnetic resonance imaging (fMRI) to evaluate regions activated during a task designed to elicit object activation within the semantic system (e.g., presenting the words "desert" and "humps" with the task to determine if they combine to form an object, in this case a "camel"). There were signal changes in the thalamus for word pairs that activated an object, but not for pairs that (a) failed to activate an object, (b) were simply semantically associated, or (c) were members of the same category. These results suggest that the thalamus has a critical role in coordinating the cortical activity required for activating an object concept in the semantic system.

Seeing, since childhood, without ventral stream: a behavioural study

We report the case of a 30-year-old man (S.B.) who developed visual agnosia following a meningoencephalitis at the age of 3 years. MRI disclosed extensive bilateral lesions of the occipital temporal visual pathway (ventral stream) and lesions in the right dorsal pathway, sparing primary visual cortices. S.B. showed a severe visual recognition deficit (texture, colour, objects, faces and words), although movement and space perception were largely preserved. His remaining visual capacities illustrate the competence of an isolated dorsal system which essentially functions on the sole basis of magnocellular afferents (low spatial resolution, high sensitivity to low contrast and moving stimuli). Patient S.B. also shows remarkable visuomotor competences, despite his perceptual limitations. It is suggested that his perceptual capacities correspond to the visual processing limitations of the dorsal visual stream, which in this patient have become accessible to perceptual awareness.

An fMRI study of the functional neuroanatomy of picture encoding in younger and older adults

Age-related changes in the neural mechanisms of picture encoding were investigated using functional magnetic resonance imaging (fMRI). Seven younger and seven older adults were studied while they were encoding pairs of concrete-related, concrete-unrelated, and abstract pictures. Functional (T2*-weighted) and anatomical (T1-weighted) images of the brain were obtained using a 1.5 T MRI scanner. The results in the younger adults showed that the left dorsal prefrontal cortex (PFC) was activated during associative learning of the concrete-unrelated or abstract pictures. The results also suggest that both ventral and dorsal visual pathways are involved in the encoding of abstract pictures, and that the right superior parietal lobule likely mediates spatial information of the abstract pictures. The older adults showed significant activation in the left dorsal PFC under concrete-unrelated and abstract conditions. However, the older adults failed to activate either the left ventral and right dorsal PFC under the concrete-unrelated condition, or the parietal areas under abstract condition. A direct comparison between the two age groups demonstrates that the older adults had a reduced activation in the bilateral parieto-temporo-occipital areas under abstract condition, and in the right temporo-occipital area extending to the fusiform gyrus under the concrete-unrelated condition. Finally, age difference was found in correlation between memory performance and amplitude of signal change in the parahippocampal gyrus and fusiform gyrus under the concrete-unrelated and abstract conditions. These changes in neural response likely underlie the age-related memory decline in relation to pictorial information.

Visual recognition: evidence for two distinctive mechanisms from a PET study

In this study, we examined the hypothesis that two distinct sets of cortical areas subserve two dissociable neurophysiological mechanisms of visual recognition. We posited that one such mechanism uses category specific cues extractable from the viewed pattern for the purpose of recognition. The other mechanism matches the pattern to be recognized with a pre-encoded memory representation of the pattern. In order to distinguish the cortical areas active in these two strategies, we measured changes in regional cerebral blood flow (rCBF) with positron emission tomography (PET) and (15)O Butanol as the radiotracer. Ten subjects performed pattern recognition tasks based on three different short-term memory conditions and a condition based on visual categories of the patterns. When subjects used representations of the patterns held in short-term memory for the purpose of recognition, the precunei were bilaterally activated. Recognition based on visual categories of the patterns activated the right (R) angular gyrus, left (L) inferior temporal gyrus, and L superior parieto-occipital cortex. These findings demonstrate that the R angular gyrus, the L inferior temporal gyrus, and the L superior parieto-occipital cortex are associated with recognition of patterns based on visual categories, whereas recognition of patterns using memory representations is associated with the activity of the precunei. This study is the first to show functional dual dissociation of active cortical fields for different mechanisms of visual pattern recognition.

Complementary category learning systems identified using event-related functional MRI

Event-related fMRI was used to dissociate the neural systems involved in category learning with and without awareness. Ten subjects performed a speeded response category learning task. Functional MR images were acquired during both explicit and implicit learning conditions. Behavioral data showed evidence of learning in both conditions. Functional imaging data showed different activation patterns in implicit and explicit trials. Decreased activation in extrastriate region V3 was found with implicit learning, and increased activation in V3, the medial temporal lobe, and frontal regions were found with explicit learning. These results support the theory that implicit and explicit learning utilize dissociable neural systems. Moreover, in both the implicit and explicit conditions a similar pattern of decreased activation was found in parietal regions. This commonality suggests that these dissociable systems also operate in parallel.

The effects of visual object priming on brain activation before and after recognition

BACKGROUND

Recognizing an object is improved by recent experience with that object even if one cannot recall seeing the object. This perceptual facilitation as a result of previous experience is called priming. In neuroimaging studies, priming is often associated with a decrease in activation in brain regions involved in object recognition. It is thought that this occurs because priming causes a sharpening of object representations which leads to more efficient processing and, consequently, a reduction in neural activity. Recent evidence has suggested, however, that the apparent effect of priming on brain activation may vary as a function of whether the neural activity is measured before or after recognition has taken place.

RESULTS

Using a gradual 'unmasking' technique, we presented primed and non-primed objects to subjects, and measured activation time courses using high-field functional magnetic resonance imaging (fMRI). As the objects were slowly revealed, but before recognition had occurred, activation increased from baseline level to a peak that corresponded in time to the subjects' behavioural recognition responses. The activation peak for primed objects occurred sooner than the peak for non-primed objects, and subjects responded sooner when presented with a primed object than with a non-primed object. During this pre-recognition phase, primed objects produced more activation than non-primed objects. After recognition, activation declined rapidly for both primed and non-primed objects, but now activation was lower for the primed objects.

CONCLUSIONS

Priming did not produce a general decrease in activation in the brain regions involved in object recognition but, instead, produced a shift in the time of peak activation that corresponded to the shift in time seen in the subjects' behavioural recognition performance.

Cortical regions involved in perceiving object shape

The studies described here use functional magnetic resonance imaging to test whether common or distinct cognitive and/or neural mechanisms are involved in extracting object structure from the different image cues defining an object's shape, such as contours, shading, and monocular depth cues. We found overlapping activations in the lateral and ventral occipital cortex [known as the lateral occipital complex (LOC)] for objects defined by different visual cues (e.g., grayscale photographs and line drawings) when each was compared with its own scrambled-object control. In a second experiment we found a reduced response when objects were repeated, independent of whether they appeared in the same or a different format (i.e., grayscale images vs line drawings). A third experiment showed that activation in the LOC was no stronger for three-dimensional shapes defined by contours or monocular depth cues, such as occlusion, than for two-dimensional shapes, suggesting that these regions are not selectively involved in processing three-dimensional shape information. These results suggest that common regions in the LOC are involved in extracting and/or representing information about object structure from different image cues.

Olfactory function evaluated by SPECT

Few articles on neuroimaging techniques in the study of central and peripheral olfactory pathways are present in the literature. By Single Photon Emission Computed Tomography (SPECT), cortical perfusion increment after sensorial stimulation can be evaluated objectively. In the present research, 10 healthy adults underwent SPECT by CER.TO.96 cerebral tomograph, before and after olfactory stimulation with lavender-water. A variable degree of cortical activation was detected in all patients. Gyrus rectus (+24.5%), orbito-frontal cortex (right +26.6%, left +25.6%), and superior temporal (right +9.9%, left +5.5%) cortical areas were always activated. A slight perfusion increase was present in middle temporal (right +3.2%, left +2.1%) and parieto-occipital (right +0.4%, left +2%) regions. Five patients affected by posttraumatic anosmia were also investigated: they showed a perfusion increment markedly inferior to 0.5% in every olfactory area. SPECT is a rather diffused, easily performed technique which yields objective semi-quantitative information on brain perfusion. Hence, it can be regarded as a promising contribution in the fields of smell neurophysiology, clinical olfactometry, and medicolegal queries.

Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies

Positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) have been extensively used to explore the functional neuroanatomy of cognitive functions. Here we review 275 PET and fMRI studies of attention (sustained, selective, Stroop, orientation, divided), perception (object, face, space/motion, smell), imagery (object, space/ motion), language (written/spoken word recognition, spoken/ no spoken response), working memory (verbal/numeric, object, spatial, problem solving), semantic memory retrieval (categorization, generation), episodic memory encoding (verbal, object, spatial), episodic memory retrieval (verbal, nonverbal, success, effort, mode, context), priming (perceptual, conceptual), and procedural memory (conditioning, motor, and nonmotor skill learning). To identify consistent activation patterns associated with these cognitive operations, data from 412 contrasts were summarized at the level of cortical Brodmann's areas, insula, thalamus, medial-temporal lobe (including hippocampus), basal ganglia, and cerebellum. For perception and imagery, activation patterns included primary and secondary regions in the dorsal and ventral pathways. For attention and working memory, activations were usually found in prefrontal and parietal regions. For language and semantic memory retrieval, typical regions included left prefrontal and temporal regions. For episodic memory encoding, consistently activated regions included left prefrontal and medial-temporal regions. For episodic memory retrieval, activation patterns included prefrontal, medial-temporal, and posterior midline regions. For priming, deactivations in prefrontal (conceptual) or extrastriate (perceptual) regions were consistently seen. For procedural memory, activations were found in motor as well as in non-motor brain areas. Analysis of regional activations across cognitive domains suggested that several brain regions, including the cerebellum, are engaged by a variety of cognitive challenges. These observations are discussed in relation to functional specialization as well as functional integration.

Imaging cognition II: An empirical review of 275 PET and fMRI studies

Positron emission tomography (PET) and functional magnetic resonance imaging (fMRI) have been extensively used to explore the functional neuroanatomy of cognitive functions. Here we review 275 PET and fMRI studies of attention (sustained, selective, Stroop, orientation, divided), perception (object, face, space/motion, smell), imagery (object, space/motion), language (written/spoken word recognition, spoken/no spoken response), working memory (verbal/numeric, object, spatial, problem solving), semantic memory retrieval (categorization, generation), episodic memory encoding (verbal, object, spatial), episodic memory retrieval (verbal, nonverbal, success, effort, mode, context), priming (perceptual, conceptual), and procedural memory (conditioning, motor, and nonmotor skill learning). To identify consistent activation patterns associated with these cognitive operations, data from 412 contrasts were summarized at the level of cortical Brodmann's areas, insula, thalamus, medial-temporal lobe (including hippocampus), basal ganglia, and cerebellum. For perception and imagery, activation patterns included primary and secondary regions in the dorsal and ventral pathways. For attention and working memory, activations were usually found in prefrontal and parietal regions. For language and semantic memory retrieval, typical regions included left prefrontal and temporal regions. For episodic memory encoding, consistently activated regions included left prefrontal and medial temporal regions. For episodic memory retrieval, activation patterns included prefrontal, medial temporal, and posterior midline regions. For priming, deactivations in prefrontal (conceptual) or extrastriate (perceptual) regions were consistently seen. For procedural memory, activations were found in motor as well as in non-motor brain areas. Analysis of regional activations across cognitive domains suggested that several brain regions, including the cerebellum, are engaged by a variety of cognitive challenges. These observations are discussed in relation to functional specialization as well as functional integration.

Temporal dynamics of verbal object comprehension

Knowledge of the stage composition and the temporal dynamics of human cognitive operations is critical for building theories of higher mental activity. This information has been difficult to acquire, even with different combinations of techniques such as refined behavioral testing, electrical recording/interference, and metabolic imaging studies. Verbal object comprehension was studied herein in a single individual, by using three tasks (object naming, auditory word comprehension, and visual word comprehension), two languages (English and Farsi), and four techniques (stimulus manipulation, direct cortical electrical interference, electrocorticography, and a variation of the technique of direct cortical electrical interference to produce time-delimited effects, called timeslicing), in a subject in whom indwelling subdural electrode arrays had been placed for clinical purposes. Electrical interference at a pair of electrodes on the left lateral occipitotemporal gyrus interfered with naming in both languages and with comprehension in the language tested (English). The naming and comprehension deficit resulted from interference with processing of verbal object meaning. Electrocorticography indices of cortical activation at this site during naming started 250-300 msec after visual stimulus presentation. By using the timeslicing technique, which varies the onset of electrical interference relative to the behavioral task, we found that completion of processing for verbal object meaning varied from 450 to 750 msec after current onset. This variability was found to be a function of the subject's familiarity with the objects.

Explaining category-related effects in the retrieval of conceptual and lexical knowledge for concrete entities: operationalization and analysis of factors

Category-related effects in the retrieval of conceptual and lexical knowledge for concrete entities have been well documented in lesion studies, and also with functional imaging and electrophysiological approaches. For example, brain-damaged subjects may be impaired in the ability to recognize or to name animals but not tools, or the opposite pattern may obtain. One reason for these dissociations is that different patterns of defects tend to be caused by distinct lesion profiles, suggesting a relative tendency for certain neural systems to be involved in category-related knowledge. But we and others have also hypothesized that a variety of traits of concrete entities co-determine category-related dissociations. Such traits ('factors') include homomorphy (similarity of form), familiarity, value to perceiver, manipulability, characteristic motion, characteristic sensory modality of transaction (vision, touch, hearing), and typical age of acquisition. It is our view that the mix of factors relative to different conceptual categories plays a key role in the neuroanatomical distribution of records for those different categories, and is thus behind the systematic correlations between certain retrieval defects and damage to certain neural systems [12, 52]. In this study, we operationalized these factors and analyzed their intercorrelations. Stimuli were slides of 215 items from the conceptual categories of animals, fruits/vegetables, tools/utensils, vehicles, and musical instruments. The factors were operationalized on the basis of ratings obtained from 227 normal control subjects and on the basis of computer analyses of the digitized outlines of the stimuli. Principal components analysis revealed that 81% of the variability across items could be accounted for by three components: Component 1 (practically useful, common items): high value to perceiver, tactile mode of transaction, high familiarity, low age of acquisition; Component 2 (homomorphic, non-manipulable items): high homomorphy, low characteristic motion and manipulability; Component 3 (items with characteristic sound): hearing mode of transaction, highly distinctive sounds. In another analysis, we found that the categories of animals versus tools/utensils differed significantly on the factors of homomorphy, familiarity, value, manipulability, characteristic motion, and touch. The factor structure we identified in this study may help explain category-related performance defects in brain-damaged subjects. The results lend support to our proposal that systematic differences in physical characteristics and contextual specification of concrete entities constitute a driving force behind the regionalization of neural systems related to the acquisition and retrieval of conceptual and lexical knowledge.

A neural basis for the retrieval of conceptual knowledge

Both clinical reports and systematic neuropsychological studies have shown that patients with damage to selected brain sites develop defects in the retrieval of conceptual knowledge for various concrete entities, leading to the hypothesis that the retrieval of knowledge for entities from different conceptual categories depends on partially segregated large-scale neural systems. To test this hypothesis, 116 subjects with focal, unilateral lesions to various sectors of the telencephalon, and 55 matched controls, were studied with a procedure which required the visual recognition of entities from three categories--unique persons, non-unique animals and non-unique tools. Defective recognition of persons was associated with maximal lesion overlap in right temporal polar region; defective recognition of animals was associated with maximal lesion overlap in right mesial occipital/ventral temporal region and also in left mesial occipital region; and defective recognition of tools was associated with maximal lesion overlap in the occipital-temporal-parietal junction of the left hemisphere. The findings support the hypothesis that the normal retrieval of knowledge for concrete entities from different conceptual domains depends on partially segregated neural systems. These sites may operate as catalysts for the retrieval of the multidimensional aspects of knowledge which are necessary and sufficient for the mental representation of a concept of a given entity.