Individual differences in cerebral blood flow in area 17 predict the time to evaluate visualized letters

Sixteen subjects closed their eyes and visualized uppercase letters of the alphabet at two sizes, as small as possible or as large as possible while remaining "visible." Subjects evaluated a shape characteristic of each letter (e.g., whether it has any curved lines), and responded as quickly as possible. Cerebral blood flow was normalized to the same value for each subject, and relative blood flow was computed for a set of regions of interest. The mean response time for each subject in the task was regressed onto the blood flow values. Blood flow in area 17 was negatively correlated with response time (r = -0.65), as was blood flow in area 19 (r = -0.66), whereas blood flow in the inferior parietal lobe was positively correlated with response time (r = 0.54). The first two effects persisted even when variance due to the other correlations was removed. These findings suggest that individual differences in the activation of specific brain loci are directly related to performance of tasks that rely on processing in those loci.

On cognitive neuroscience

Abstract Stephen M. Kosslyn is Professor of Psychology at Harvard University and an Associate Psychologist in the Department of Neurology at the Massachusetts General Hospital. He received his B.A. in 1970 from UCLA and his Ph.D. from Stanford University in 1974, both in psychology, and taught at Johns Hopkins, Harvard, and Brandeis Universities before joining the Harvard Faculty as Professor of Psychology in 1983. His work focuses on the nature of visual mental imagery and high-level vision, as well as applications of psychological principles to visual display design. He has published over 125 papers on these topics, co-edited five books, and authored or co-authored five books. His books include Image and Mind (1980), Ghosts in the Mind's Machine (1983), Wet Mind: The New Cognitive Neuroscience (with 0. Koenig, 1992), Elements of Graph Design (1994), and Image and Brain: The Resolution of the Imagery Debate (1994). Dr. Kosslyn has received numerous honors, including the National Academy of Sciences Initiatives in Research Award, is currently on the editorial boards of many professional journals, and has served on several National Research Council committees to advise the government on new technologies.

MiniCog: a method for administering psychological tests and experiments on a handheld personal digital assistant

Because of their minimal cost, size, and weight, handheld personal digital assistants (PDAs) are appealing as a means for administering response time tasks "in the field" or to participants in longitudinal studies who need repeated access to the testing equipment. We have developed a software package that allows investigators to author simple scripts on their desktop computers and administer the compiled tasks on PDAs. MiniCog presents instructions, practice trials with auditory feedback, and visual stimuli in random or fixed sequential orders with fixed or variable durations and intertrial intervals and records single-button responses and response times. Data from each trial are stored with a user ID, user-entered demographics and notes, and a time-and-date stamp, for later upload to a desktop computer. MiniCog performs automatic calculations of mean response time and error rate, available to users with a password and stored with the other data for upload.

Neural correlates of different types of deception: an fMRI investigation

Deception is a complex cognitive activity, and different types of lies could arise from different neural systems. We investigated this possibility by first classifying lies according to two dimensions, whether they fit into a coherent story and whether they were previously memorized. fMRI revealed that well-rehearsed lies that fit into a coherent story elicit more activation in right anterior frontal cortices than spontaneous lies that do not fit into a story, whereas the opposite pattern occurs in the anterior cingulate and in posterior visual cortex. Furthermore, both types of lies elicited more activation than telling the truth in anterior prefrontal cortices (bilaterally), the parahippocampal gyrus (bilaterally), the right precuneus, and the left cerebellum. At least in part, distinct neural networks support different types of deception.

Impact of fMRI acoustic noise on the functional anatomy of visual mental imagery

One drawback of functional magnetic resonance imaging (fMRI) is that the subject must endure intense noise during testing. We examined the possible role of such noise on the activation of early visual cortex during visual mental imagery. We postulated that noise may require subjects to work harder to pay attention to the task, which in turn could alter the activation pattern found in a silent environment. To test this hypothesis, we used positron emission tomography (PET) to monitor regional Cerebral Blood Flow (rCBF) of six subjects while they performed an imagery task either in a silent environment or in an "fMRI-like" noisy environment. Both noisy and silent imagery conditions, as compared to their respective baselines, resulted in activation of a bilateral fronto-parietal network (related to spatial processing), a bilateral inferior temporal area (related to shape processing), and deactivation of anterior calcarine cortex. Among the visual areas, rCBF increased in the most posterior part of the calcarine cortex, but at level just below the statistical threshold. However, blood flow values in the calcarine cortex during the silent imagery condition (but not the noisy imagery condition) were strongly negatively correlated with accuracy; the more challenging subjects found the task, the more strongly the calcarine cortex was activated. The subjects made more errors in the noisy condition than in the silent condition, and a direct comparison of the two conditions revealed that noise resulted in an increase in rCBF in the anterior cingulate cortex (involved in performance monitoring) and in the Wernicke's area (required to encode the verbal cues used in the task). These results thus demonstrate a nonadditive effect of fMRI gradient noise, resulting in a slight but significant effect on both performance and the neural activation pattern.

Mental imagery of visual motion modifies the perception of roll-vection stimulation

When viewing a wide-angle visual display, which rotates in the frontoparallel plane around the line of sight, observers experience an illusory shift of the direction of gravity; this shift leads to an apparent tilt of the body and displaces allocentric space coordinates. In this study, subjects adjusted an indicator to the apparent horizontal while viewing a rotating display. To determine whether top down processes could affect the illusion, the subjects were asked to visualize a rotating configuration of dots onto a blank central portion of the moving visual field. Visualizing dots and actually viewing the dots deflected the spatial judgment in very similar ways. These results demonstrate that top down processing can affect allocentric space coordinates.

Transient activity in the human calcarine cortex during visual-mental imagery: an event-related fMRI study

Although it is largely accepted that visual-mental imagery and perception draw on many of the same neural structures, the existence and nature of neural processing in the primary visual cortex (or area V1) during visual imagery remains controversial. We tested two general hypotheses: The first was that V1 is activated only when images with many details are formed and used, and the second was that V1 is activated whenever images are formed, even if they are not necessarily used to perform a task. We used event-related functional magnetic resonance imaging (ER-fMRI) to detect and characterize the activity in the calcarine sulcus (which contains the primary visual cortex) during single instances of mental imagery. The results revealed reproducible transient activity in this area whenever participants generated or evaluated a mental image. This transient activity was strongly enhanced when participants evaluated characteristics of objects, whether or not details actually needed to be extracted from the image to perform the task. These results show that visual imagery processing commonly involves the earliest stages of the visual system.

Imagining rotation by endogenous versus exogenous forces: distinct neural mechanisms

Previous neuroimaging studies of mental image transformations have sometimes implicated motor processes and sometimes not. In this study, prior to neuroimaging the subjects either viewed an electric motor rotating an angular object, or they rotated the object manually. Following this, they performed the identical mental rotation task in which they compared members of pairs of such figures, but were asked to imagine the figures rotating as they had just seen the model rotate. When results from the two rotation conditions were directly compared, motor cortex (including area M1) was found to be activated only when subjects imagined the rotations as a consequence of manual activity. Thus, there are at least two, qualitatively distinct, ways to imagine objects rotating in images, and these different strategies can be adopted voluntarily.

Mental imagery of high- and low-resolution gratings activates area 17

Some, but not all, previous neuroimaging studies of visual mental imagery have found that Area 17 (primary visual cortex) is activated when people visualize objects. The present study was designed to test the hypothesis that the necessary degree of resolution of the mental image is a determining factor in whether Area 17 is activated during imagery. Eight male subjects visualized and compared sets of stripes that required high or low resolution to resolve, while their brains were scanned using 15O(CO2) positron emission tomography (PET). When imagery in general (visualization of high- and low-resolution gratings stimuli combined) was compared to an auditory baseline condition where subjects did not visualize, Area 17 was activated. However, region of interest (ROI) and statistical parametric mapping (SPM) analyses revealed no difference between imagery conditions using high- and low-resolution stimuli. These results indicate that the resolution of the stimuli alone does not necessarily determine whether Area 17 will be activated during visual mental imagery.

Hemispheric differences in body image in anorexia nervosa

OBJECTIVE

This study tested the hypothesis that women with anorexia nervosa (AN) have an inappropriately fatter body image in the left cerebral hemisphere (LH) than in the right cerebral hemisphere (RH).

METHOD

Women with AN symptomatology were compared with thin controls in a divided visual field experiment. Distorted and undistorted pictures of their own and someone else's body were flashed briefly in the left and right visual fields. Participants judged the pictures as thinner than, equal to, or fatter than the actual body size.

RESULTS

The AN participants judged a higher proportion of fatter distortions as equal to their own size. They responded faster when stimuli were presented initially to the LH than when they were presented initially to the RH. In contrast, fewer thinner distortions were judged as equal to their own body size, and were judged more slowly, on LH trials than on RH trials. Controls did not show hemispheric differences when judging their own body and AN participants did not show hemispheric differences when judging pictures of somebody else. Additional analyses revealed that these findings were carried entirely by a subgroup who had AN in the past, not by the subgroup who currently had AN.

DISCUSSION

The brain lateralization paradigm may prove useful in understanding body image disturbance in AN patients.

Deficits in visual cognition and attention following bilateral anterior cingulotomy

A series of eight tests of visual cognitive abilities was used to examine pre- to post-operative performance changes in a patient receiving bilateral anterior cingulotomy. Compared with a set of eight matched control participants, post-operatively, the patient exhibited deficits in (a) the ability to sequence novel cognitive operations required to generate multipart images or rotate perceptual stimuli; (b) the ability to search for, select, and compare images of objects when the instructions did not specify precisely which objects should be visualized; and, (c) the ability to select a controlled and unpracticed response over an automatic one. Other imagery and cognitive tasks were not affected. Results are consistent with the hypothesis that anterior cingulate cortex is a component of an executive control system. One of the anterior cingulate's roles may be to monitor on-line processing and signal the motivational significance of current actions or cognitions.

Speed of information processing in children referred for learning problems: performance on a visual filtering test

Children referred for evaluation of learning impairment (LI, N =100) and a comparison group of nonreferred (NLI, N = 243) children were evaluated on a visual filtering task. The task was designed hierarchically to provide for evaluation of component operations-serial search, parallel search, decision, and response. With each additional processing demand, response times increased disproportionately for the LI group relative to the NLI group. Overall response time reliably predicted academic skills and cognitive ability, but was more strongly related to group membership. Thus, this nonverbal visual task is sensitive to a characteristic of children with learning problems over and above discrete academic and cognitive skills. Children with problems adapting to the demands of schooling may be distinguished by a disproportionate vulnerability to processing load.

Aging and the scope of visual attention

OBJECTIVE

To discover whether some cognitive deficits associated with aging could be related to a restricted scope of visual attention.

DESIGN

Cross-sectional study, with subjects in each age group receiving the same four conditions.

SUBJECTS

24 elderly (mean age 65.2 years, 12 men and 12 women) and 24 young (mean age 21.8 years, 12 men and 12 women) matched for handedness, gender, and education level.

METHODS

SUBJECTS viewed a display that contained four light-gray squares arranged as if on the tips of a plus sign, then black X marks appeared and the subjects indicated whether one or two Xs appeared in the squares as quickly and accurately as possible. The time to respond and accuracy level were recorded. Two types of displays were used; one with squares spread out over a large area and one with squares condensed into a small area. In two thirds of the trials the size remained the same (with half being large, and half small), and in one third it changed (with half of these trials changing from large-to-small and half from small-to-large).

RESULTS

In the trials that had a consistent display size, the elderly subjects performed the task better with the smaller display, whereas the young subjects performed equally well with both sized displays. In addition, the elderly found it easier to shift from large to small scope than to maintain attention at the large scope; in contrast, the younger subjects found it easiest to maintain attention on a static display size.

CONCLUSIONS

The elderly prefer to focus attention on a smaller region of space than do younger people.

Hypnotic visual illusion alters color processing in the brain

OBJECTIVE

This study was designed to determine whether hypnosis can modulate color perception. Such evidence would provide insight into the nature of hypnosis and its underlying mechanisms.

METHOD

Eight highly hypnotizable subjects were asked to see a color pattern in color, a similar gray-scale pattern in color, the color pattern as gray scale, and the gray-scale pattern as gray scale during positron emission tomography scanning by means of [(15)O]CO(2). The classic color area in the fusiform or lingual region of the brain was first identified by analyzing the results when subjects were asked to perceive color as color versus when they were asked to perceive gray scale as gray scale.

RESULTS

When subjects were hypnotized, color areas of the left and right hemispheres were activated when they were asked to perceive color, whether they were actually shown the color or the gray-scale stimulus. These brain regions had decreased activation when subjects were told to see gray scale, whether they were actually shown the color or gray-scale stimuli. These results were obtained only during hypnosis in the left hemisphere, whereas blood flow changes reflected instructions to perceive color versus gray scale in the right hemisphere, whether or not subjects had been hypnotized.

CONCLUSIONS

Among highly hypnotizable subjects, observed changes in subjective experience achieved during hypnosis were reflected by changes in brain function similar to those that occur in perception. These findings support the claim that hypnosis is a psychological state with distinct neural correlates and is not just the result of adopting a role.

Transcranial magnetic stimulation of primary motor cortex affects mental rotation

Neuroimaging studies have shown that motor structures are activated not only during overt motor behavior but also during tasks that require no overt motor behavior, such as motor imagery and mental rotation. We tested the hypothesis that activation of the primary motor cortex is needed for mental rotation by using single- pulse transcranial magnetic stimulation (TMS). Single-pulse TMS was delivered to the representation of the hand in left primary motor cortex while participants performed mental rotation of pictures of hands and feet. Relative to a peripheral magnetic stimulation control condition, response times (RTs) were slower when TMS was delivered at 650 ms but not at 400 ms after stimulus onset. The magnetic stimulation effect at 650 ms was larger for hands than for feet. These findings demonstrate that (i) activation of the left primary motor cortex has a causal role in the mental rotation of pictures of hands; (ii) this role is stimulus-specific because disruption of neural activity in the hand area slowed RTs for pictures of hands more than feet; and (iii) left primary motor cortex is involved relatively late in the mental rotation process.

Functional anatomy of high-resolution visual mental imagery

This study had two purposes. First, in order to address the controversy regarding activation of the primary visual area (PVA) during visual mental imagery, regional cerebral blood flow (rCBF) was recorded while subjects performed a task that required high-resolution visual mental imagery. Second, in order to discover whether verbal descriptions can engage visual mechanisms during imagery in the same way as visual stimuli, subjects memorized 3D scenes that were visually presented or were based on a verbal description. Comparison of the results from the imagery conditions to a non-imagery baseline condition revealed no activation in PVA for imagery based on a verbal description and a significant decrease of rCBF in this region for imagery based on visual learning. The pattern of activation in other regions was very similar in the two conditions, including parietal, midbrain, cerebellar, prefrontal, left insular, and right inferior, temporal regions. These results provide strong evidence that imagery based on verbal descriptions can recruit regions known to be engaged in high-order visual processing.

Visual mental imagery interferes with allocentric orientation judgements

The subjective visual vertical is determined when a subject judges the orientation of an indicator (e.g. a short line segment) as apparently vertical. The mechanisms that underlie this perceptual performance are usually assumed to be based predominantly on bottom-up processing of primarily vestibular and visual information. However, it is also possible that top-down processes play a role in such abilities. We used an interference paradigm in order to investigate the effects of mental images on the perception of the visual vertical. The results demonstrate for the first time that visual mental imagery can exert the same directional influence on the subjective visual vertical as a perception of the corresponding stimulus.

If neuroimaging is the answer, what is the question?

It is unclear that we will come to a better understanding of mental processes simply by observing which neural loci are activated while subjects perform a task. Rather, I suggest here that it is better to come armed with a question that directs one to design tasks in ways that take advantage of the strengths of neuroimaging techniques (particularly positron emission tomography and functional magnetic resonance imaging). Here I develop a taxonomy of types of questions that can be easily addressed by such techniques. The first class of questions focuses on how information processing is implemented in the brain; these questions can be posed at a very coarse scale, focusing on the entire system that confers a particular ability, or at increasingly more specific scales, ultimately focusing on individual structures or processes. The second class of questions focuses on specifying when particular processes and structures are invoked; these questions focus on how one can use patterns of activation to infer that specific processes and structures were invoked, and on how processing changes in different circumstances. The use of neuroimaging to address these questions is illustrated with results from experiments on visual cognition, and caveats regarding the logic of inference in each case are noted. Finally, the necessary interplay between neuroimaging and behavioural studies is stressed.

Perceptual and memory biases for health-related information in hypochondriacal individuals

Problematic health concerns characteristic of hypochondriasis may be better understood with the aid of cognitive, information processing theories. We investigated whether hypochondriacal individuals show perceptual and explicit memory biases favoring health-related information. A clinical sample of hypochondriacs (n=18) and healthy controls (n=22), and a sample of hypochondriacal (n=22) and nonhypochondriacal (n=67) patients referred for Holter monitoring, completed a computerized test of perceiving difficult-to-read words and then an encoding task followed by recall of those words. Contrary to our prediction, hypochondriacal individuals in the clinical sample did not perceive more health-related words than words not related to health. Hypochondriacal individuals in the Holter-monitoring sample showed an unexpected bias against reporting health-related words. Social class may account for some of the group differences in this sample. Hypochondriacal individuals in both samples showed better memory for health-related than nonhealth words.

The role of area 17 in visual imagery: convergent evidence from PET and rTMS

Visual imagery is used in a wide range of mental activities, ranging from memory to reasoning, and also plays a role in perception proper. The contribution of early visual cortex, specifically Area 17, to visual mental imagery was examined by the use of two convergent techniques. In one, subjects closed their eyes during positron emission tomography (PET) while they visualized and compared properties (for example, relative length) of sets of stripes. The results showed that when people perform this task, Area 17 is activated. In the other, repetitive transcranial magnetic stimulation (rTMS) was applied to medial occipital cortex before presentation of the same task. Performance was impaired after rTMS compared with a sham control condition; similar results were obtained when the subjects performed the task by actually looking at the stimuli. In sum, the PET results showed that when patterns of stripes are visualized, Area 17 is activated, and the rTMS results showed that such activation underlies information processing.

Regional cerebral blood flow during script-driven imagery in childhood sexual abuse-related PTSD: A PET investigation

OBJECTIVE

The purpose of this study was to determine whether anterior limbic and paralimbic regions of the brain are differentially activated during the recollection and imagery of traumatic events in trauma-exposed individuals with and without posttraumatic stress disorder (PTSD).

METHOD

Positron emission tomography (PET) was used to measure normalized regional cerebral blood flow (CBF) in 16 women with histories of childhood sexual abuse: eight with current PTSD and eight without current PTSD. In separate script-driven imagery conditions, participants recalled and imagined traumatic and neutral autobiographical events. Psychophysiologic responses and subjective ratings of emotional state were measured for each condition.

RESULTS

In the traumatic condition versus the neutral control conditions, both groups exhibited regional CBF increases in orbitofrontal cortex and anterior temporal poles; however, these increases were greater in the PTSD group than in the comparison group. The comparison group exhibited regional CBF increases in insular cortex and anterior cingulate gyrus; increases in anterior cingulate gyrus were greater in the comparison group than in the PTSD group. Regional CBF decreases in bilateral anterior frontal regions were greater in the PTSD group than in the comparison group, and only the PTSD group exhibited regional CBF decreases in left inferior frontal gyrus.

CONCLUSIONS

The recollection and imagery of traumatic events versus neutral events was accompanied by regional CBF increases in anterior paralimbic regions of the brain in trauma-exposed individuals with and without PTSD. However, the PTSD group had greater increases in orbitofrontal cortex and anterior temporal pole, whereas the comparison group had greater increases in anterior cingulate gyrus.

Squinting with the mind's eye: effects of stimulus resolution on imaginal and perceptual comparisons

Subjects either viewed or visualized arrays that were divided into four quadrants, with each quadrant containing a set of stripes. In two experiments, one array contained only relatively narrow (high-resolution) stripes, and one contained only relatively thick (low-resolution) stripes. The subjects compared sets of stripes in different quadrants according to their length, spacing, orientation, or width. When the subjects visualized the arrays, they required much more time to compare high-resolution patterns than low-resolution patterns; when the subjects saw the arrays, they evaluated both types of arrays equally easily. In addition, the results from the third experiment provide strong evidence that people use imagery in this task; in one condition, the subjects evaluated oblique sets of stripes, and in another condition, they evaluated vertical and horizontal stripes. In both imagery and perception, the subjects made more errors when evaluating oblique stimuli; in imagery, they also required more time to evaluate oblique stimuli. The results suggest that additional effort is required in imagery to represent visual patterns with high resolution. This finding demonstrates that, although imagery and perception may activate common brain regions, it is more difficult to represent high-resolution information in imagery than in perception.

Imagery and hypnotizability revisited

The objective of this study was to correlate computer-generated imagery tasks and a self-report measure of imagery ability with hypnotizability, hypothesizing that computer-generated imagery tasks would be better predictors of hypnotizability than will the self-report measure. Hypnotizability of 43 subjects was assessed using the Hypnotic Induction Profile and the Stanford Hypnotic Susceptibility Scale, Form C. Imagery ability was assessed by the Visual Vividness Imagery Questionnaire (VVIQ) and by computer-generated imagery tasks measuring the ability to generate, maintain, and transform images. Although there was no correlation between the VVIQ and hypnotizability, the less hypnotizable subjects made twice as many mistakes in the spatial imagery tasks than did the more hypnotizables, but this difference was not statistically significant. The relationships among hypnotic performance, hypnotizability, and imagery functions are complex.

The judgement of absence in neglect

The usual way of looking at neglect is by investigating how neglect patients fail to detect that something is there. In this study, we look at how neglect patients correctly detect that something is not there. Patients with parietal lesions (11 with and 16 without neglect) and 23 control subjects indicated whether a dot target was or was not present in a geometrical display. While control subjects were consistently (and unexpectedly) faster in the no-dot than in the dot condition, the distinguishing response time pattern of right parietal patients with neglect was not--as one might expect--a relatively longer response time to left vs right targets, but a longer response time to target absence vs presence. This may be due to a serial search or, alternatively, it might result from double-checking for target absence, produced by lowered perceptual confidence. Since this "wariness" about stimulus absence seems to operate in parallel with neglect patients' denial of the deficit, we conclude that the response time pattern observed in this study could be used as a measure of subjective (un)awareness of neglect.

Motor processes in mental rotation

Much indirect evidence supports the hypothesis that transformations of mental images are at least in part guided by motor processes, even in the case of images of abstract objects rather than of body parts. For example, rotation may be guided by processes that also prime one to see results of a specific motor action. We directly test the hypothesis by means of a dual-task paradigm in which subjects perform the Cooper-Shepard mental rotation task while executing an unseen motor rotation in a given direction and at a previously-learned speed. Four results support the inference that mental rotation relies on motor processes. First, motor rotation that is compatible with mental rotation results in faster times and fewer errors in the imagery task than when the two rotations are incompatible. Second, the angle through which subjects rotate their mental images, and the angle through which they rotate a joystick handle are correlated, but only if the directions of the two rotations are compatible. Third, motor rotation modifies the classical inverted V-shaped mental rotation response time function, favoring the direction of the motor rotation; indeed, in some cases motor rotation even shifts the location of the minimum of this curve in the direction of the motor rotation. Fourth, the preceding effect is sensitive not only to the direction of the motor rotation, but also to the motor speed. A change in the speed of motor rotation can correspondingly slow down or speed up the mental rotation.

Age degradation in top-down processing: identifying objects from canonical and noncanonical viewpoints

Twenty-four young (mean age 21.8 years) and 24 old (mean age 65.2 years) participants were asked to determine whether spoken words correctly named pictures of objects. Half of the objects were portrayed from noncanonical (unusual) viewpoints, and half were portrayed from canonical viewpoints. The older participants required more time and made more errors when they evaluated the noncanonical pictures (relative to the canonical pictures) than the younger participants. This finding is consistent with previous evidence that frontal lobe function degrades with aging and with results from a positron emission tomography study (S. M. Kosslyn et al., 1994) that showed that the frontal lobes (among other areas) are activated more in the noncanonical condition than in the canonical condition.

Aging and scanning of imagined and perceived visual images

The authors examined adult age differences in the proficiency of visually scanning across perceived and imagined displays. Participants were asked to indicate whether an arrow in the central region of a square grid ring pointed to a target square. The distance between arrow and target was varied, and all participants showed the expected increase in response times and error rates as scanning distance increased. The arrow and grid display either remained visible until the participant responded (perceptual condition) or disappeared after 50 ms (imagery condition). In both conditions, older participants required more time to scan and made more errors as distance increased than did younger participants. These findings conflict with previous studies showing that perceptual and imagery scanning are preserved with aging. Although methodological factors may have contributed to these differences, further research is needed to elucidate effects of aging on visual scanning.

Mental rotation of objects versus hands: neural mechanisms revealed by positron emission tomography

Twelve right-handed men participated in two mental rotation tasks as their regional cerebral blood flow (rCBF) was monitored using positron emission tomography. In one task, participants mentally rotated and compared figures composed of angular branching forms; in the other task, participants mentally rotated and compared drawings of human hands. In both cases, rCBF was compared with a baseline condition that used identical stimuli and required the same comparison, but in which rotation was not required. Mental rotation of branching objects engendered activation in the parietal lobe and Area 19. In contrast, mental rotation of hands engendered activation in the precentral gyrus (M1), superior and inferior parietal lobes, primary visual cortex, insula, and frontal Areas 6 and 9. The results suggest that at least two different mechanisms can be used in mental rotation, one mechanism that recruits processes that prepare motor movements and another mechanism that does not.

Neural systems shared by visual imagery and visual perception: a positron emission tomography study

Subjects participated in perceptual and imagery tasks while their brains were scanned using positron emission tomography. In the perceptual conditions, subjects judged whether names were appropriate for pictures. In one condition, the objects were pictured from canonical perspectives and could be recognized at first glance; in the other, the objects were pictured from noncanonical perspectives and were not immediately recognizable. In this second condition, we assume that top-down processing is used to evaluate the names. In the imagery conditions, subjects saw a grid with a single X mark; a lowercase letter was presented before the grid. In the baseline condition, they simply responded when they saw the stimulus, whereas in the imagery condition they visualized the corresponding block letter in the grid and decided whether it would have covered the X if it were physically present. Fourteen areas were activated in common by both tasks, only 1 of which may not be involved in visual processing (the precentral gyrus); in addition, 2 were activated in perception but not imagery, and 5 were activated in imagery but not perception. Thus, two-thirds of the activated areas were activated in common.

Detecting high-level and low-level properties in visual images and visual percepts

In this article we provide further evidence that visual mental imagery and visual perception share modality-specific mechanisms, and we find that representing visual information in a mental image (activating stored information to create a picture-like mental representation) preserves relatively low-level visual detail. Subjects either saw or visualized simple pictures, and evaluated them for the presence or absence of six types of non-accidental properties. These properties varied from very 'low-level' ones, such as T junctions, to very 'high-level' ones, such as global symmetry. The question was whether both sorts of information are equally accessible in percepts and mental images. If mental images are equivalent to descriptions of perceptual units and their organization, as some have argued, then subjects should have greater difficulty accessing low-level properties in a mental image compared to the difficulty they experience when the drawing is visible. The results of two experiments were clearcut: Subjects could evaluate high-level properties more easily than low-level ones, but this difference was the same in imagery and perception. These findings suggest that mental images preserve relatively low-level visual features, and are not simply descriptions of a pattern.

Visual imagery and perception in posttraumatic stress disorder. A positron emission tomographic investigation

BACKGROUND

Relative regional cerebral blood flow (rCBF) changes were measured in Vietnam combat veterans with and without posttraumatic stress disorder (PTSD) during exposure to combat-related stimuli.

METHODS

Positron emission tomography was used to measure rCBF in 7 combat veterans with PTSD (PTSD group) and 7 healthy combat veterans (control group) who viewed and generated visual mental images of neutral, negative, and combat-related pictures.

RESULTS

Unlike control subjects, subjects with PTSD had increased rCBF in ventral anterior cingulate gyrus and right amygdala when generating mental images of combat-related pictures; when viewing combat pictures, subjects with PTSD showed decreased rCBF in Broca's area.

CONCLUSIONS

Results suggest that ventral anterior cingulate gyrus and right amygdala play a role in the response of combat veterans with PTSD to mental images of combat-related scenes. Reexperiencing phenomena of PTSD, which often involve emotional visual mental imagery, may be likewise associated with increased rCBF in these regions.

Functional anatomy of object recognition in humans: evidence from positron emission tomography and functional magnetic resonance imaging

The ability to recognize elements of the environment as familiar objects, events, or classes underlies virtually all human cognition. Positron emission tomography and functional magnetic resonance imaging studies of the recognition of visually presented objects suggest that several brain areas crucially support this function. However, a review of these findings reveals great variability in the cortical localization of object recognition in humans. Although there is converging evidence for the importance of the temporal and occipitotemporal cortex in object recognition, a consistent picture of the functional organization within these areas and their relation to function in other cortical regions has not yet emerged from brain imaging studies.

Enhanced image generation abilities in deaf signers: a right hemisphere effect

Deaf subjects who use American Sign Language as their primary language generated visual mental images faster than hearing nonsigning subjects when stimuli were initially presented to the right hemisphere. Deaf subjects exhibited a strong right hemisphere advantage for image generation using either categorical or coordinate spatial relations representations. In contrast, hearing subjects showed evidence of left hemisphere processing for categorical spatial relations representations, and no hemispheric asymmetry for coordinate spatial relations representations. The enhanced right hemisphere image generation abilities observed in deaf singers may be linked to a stronger right hemisphere involvement in processing imageable signs and linguistically encoded spatial relations.

Neural effects of visualizing and perceiving aversive stimuli: a PET investigation

Cerebral blood flow was recorded (using positron emission tomography) while middle-aged subjects viewed or visualized pictures of neutral or aversive stimuli, and then determined whether auditorily presented statements correctly described the stimuli. Visualizing aversive stimuli enhanced cerebral blood flow, relative to visualizing neutral stimuli, in areas 17 (right) and 18 (bilateral), as well as the anterior insula (bilateral) and middle frontal cortex (left). Areas 17 and 18 have been identified as supporting the representations that underlie the experience of imagery, and the anterior insula is a major cortical recipient of input from the autonomic nervous system. Perceiving aversive stimuli enhanced cerebral blood flow, relative to neutral stimuli, in area 46, the angular gyrus and area 19, area 47, and the middle temporal gyrus (all in the left hemisphere). All of these areas have previously been implicated in visual object identification. It is striking that negative emotion did not modulate activation in any areas in the same way during imagery and perception.

Encoding words and pictures: a positron emission tomography study

Subjects viewed words, pictures, crosshairs, or a large X flanked by two smaller xs on either side while their brain activity was monitored using positron emission tomography (PET). When activation from the pictures, crosshairs, or Xs condition was subtracted from activation in the words condition, the left angular gyrus and Broca's area were found to be activated. In the comparison of words and pictures, additional language areas were activated. These results provide support for the classical neurological model of reading. The results also suggest that a "word form area" is near the margin of the left angular gyrus.

Changes in cortical activity during mental rotation. A mapping study using functional MRI

Mental imagery is an important cognitive method for problem solving, and the mental rotation of complex objects, as originally described by Shepard and Metzler (1971), is among the best studied mental imagery tasks. Functional MRI was used to observe focal changes in blood flow in the brains of 10 healthy volunteers performing a mental rotation task. On each trial, subjects viewed a pair of perspective drawings of three-dimensional shapes, mentally rotated one into congruence with the other, and then determined whether the two forms were identical or mirror-images. The control task, which we have called the 'comparison' condition, was identical except that both members of each pair appeared at the same orientation, and hence the same encoding, comparison and decision processes were used but mental rotation was not required. These tasks were interleaved with a baseline 'fixation' condition, in which the subjects viewed a crosshair. Technically adequate studies were obtained in eight of the 10 subjects. Areas of increased signal were identified according to sulcal landmarks and are described in terms of the Brodmann's area (BA) definitions that correspond according to the atlas of Talaraich and Tournoux. When the rotation task was contrasted with the comparison condition, all subjects showed consistent foci of activation in BAs 7a and 7b (sometimes spreading to BA 40): 88% had increased signal in middle frontal gyrus (BA 8) and 75% showed extrastriate activation, including particularly BAs 39 and 19, in a position consistent with area V5/human MT as localized by functional and histological assays. In more than half of the subjects, hand somatosensory cortex (3-1-2) was engaged, and in 50% of subjects there was elevated signal in BA 18. In frontal cortex, activation was above threshold in half the subjects in BAs 9 and/or 46 (dorsolateral prefrontal cortex). Some (four out of eight) subjects also showed signal increases in BAs 44 and/or 46. Premotor cortex (BA 6) was active in half of the subjects during the rotation task. There was little evidence for lateralization of the cortical activity or of engagement of motor cortex. These data are consistent with the hypothesis that mental rotation engages cortical areas involved in tracking moving objects and encoding spatial relations, as well as the more general understanding that mental imagery engages the same, or similar, neural imagery as direct perception.

Topographical representations of mental images in primary visual cortex

We report here the use of positron emission tomography (PET) to reveal that the primary visual cortex is activated when subjects close their eyes and visualize objects. The size of the image is systematically related to the location of maximal activity, which is as expected because the earliest visual areas are spatially organized. These results were only evident, however, when imagery conditions were compared to a non-imagery baseline in which the same auditory cues were presented (and hence the stimuli were controlled); when a resting baseline was used (and hence brain activation was uncontrolled), imagery activation was obscured because of activation in visual cortex during the baseline condition. These findings resolve a debate in the literature about whether imagery activates early visual cortex and indicate that visual mental imagery involves 'depictive' representations, not solely language-like descriptions. Moreover, the fact that stored visual information can affect processing in even the earliest visual areas suggests that knowledge can fundamentally bias what one sees.

Two types of image generation: evidence for left and right hemisphere processes

The results from seven experiments provide evidence that visual mental images can be generated by either the left or right cerebral hemisphere, but in different ways. Subjects were cued to form images within a grid or within a set of four corner brackets; a single X mark was enclosed within each stimulus, and the subjects were to determine whether the X mark was enclosed within each stimulus, and the subjects were to determine whether the X mark would have fallen on an imaged pattern. When subjects memorized descriptions of how parts were arranged, they could later form images of the composite pattern when cued in the right visual field (left hemisphere) more accurately than when they were cued in the left visual field (right hemisphere). In contrast, when subjects memorized individual segments on a screen, and 'mentally glued' them into a single pattern, they later could form images more accurately, at least in some circumstances, when cued in the left visual field. These results were predicted by the theory that images are built up by arranging parts, and that two different processes can be used to arrange them. One process uses stored descriptions to arrange parts, and is more effective in the left cerebral hemisphere; the other process uses stored memories of metric positions to arrange parts, and is more effective in the right cerebral hemisphere. Convergent evidence was obtained by having subjects memorize letters in grids (which are easily encoded using descriptions of the positions of segments) or within a space delineated by four brackets (which require memorizing the precise positions of the segments). Subjects were relatively more accurate when cued in the left visual field with bracket stimuli, but tended to be relatively more accurate when cued in the right visual field with grids stimuli. Control experiments showed that this finding was not due to hemispheric differences in the ease of forming images at different sizes or differences in the ease of perceptually encoding the probes.

Brain mechanisms in human classical conditioning: a PET blood flow study

Five healthy male subjects participated in a classical conditioning experiment, and positron emission tomography (PET) was used to compare regional cerebral blood flow before and after conditioning. The subjects participated in three different experimental phases. In the first (habituation) phase they listened to 24 repetitions of a tone with random intervals. In the second (acquisition) phase, the tone was paired with a brief shock to the wrist. In the third (extinction) phase, the tone was presented alone again. 15OPET scans were taken during the habituation and extinction phases. Because the habituation and extinction phases were similar, any difference in blood flow to the tones presented during extinction probably reflected conditioning that occurred during the acquisition phase. Statistical parametric mapping (SPM) analysis of the PET data showed significantly increased activation in the right hemisphere in the orbito-frontal cortex, dorsolateral prefrontal cortex, inferior and superior frontal cortices, and inferior and middle temporal corticies. The only activated areas in the left hemisphere were area 19 and the superior frontal cortex. The results are interpreted as evidence for the involvement of cortical areas in human classical conditioning.

On computational evidence for different types of spatial relations encoding: reply to Cook et al. (1995)

Computational models in psychology play an increasingly important role in characterizing theoretical distinctions, understanding empirical results, and formulating new predictions. However, the proper use of models is subject to debate and interpretation, as Cook, Früh, and Landis (1995) have demonstrated in a critique of neural network simulations reported by Kosslyn, Chabris, Marsolek, and Koenig (1992). These simulation results supported a distinction between two types of spatial relations encoding. Cook et al. argue that Kosslyn et al.'s models did not process "spatial" representations and that input-output correlations rather than properties of spatial relations encoding processes explain the performance of the models. This article provides conceptual and analytic rebuttals of those criticisms.

Visual processing in migraineurs

Twelve migraine subjects with aura and 12 matched control subjects performed four computerized visual tasks. Because chronic electroencephalographic and regional cerebral blood flow abnormalities in posterior brain functions have been documented during interictal periods, migraine subjects were tested between migraine attacks. Two tasks, orientation detection and temporal order judgement, were devised to examine 'low-level' visual processes. The results were compared with results from two tasks, picture naming and word priming, that were devised to examine 'high-level' visual processes. Regarding the response time data across all four tasks, the migraine group was faster in the two low-level tasks. There were no differences in error rate in any of the four tasks. The migraineur's apparent response time advantage in the low-level tasks provides a psychophysical corroboration of their assumed oversensitivity to visual stimuli. The remaining two tasks, picture naming and word priming, which involve the use of previously stored information, do not distinguish migraineurs from matched control subjects. These results suggest that migraineurs are better in low-level visual processing, in that the signals to the primary visual cortex (Area V1) are processed more rapidly, but this hypersensitivity does not carry over to the subsequent processing stages (beyond V1 to superior parietal and inferior temporal cortices), as evidenced by the absence of a response time advantage in the two higher-level vision tasks.