Temporal dynamics of brain activation during a working memory task

Neuropsychiatric dynamics: the study of mental illness using functional magnetic resonance imaging

Functional magnetic resonance imaging (fMRI) is poised to make significant contributions to the study of neuropsychiatric illnesses. Whatever neural pathology attends such illnesses has proven subtle at best. By identifying predictable, regionally specific deficits in brain function, fMRI can suggest brain regions for detailed cellular analyses, provide valuable in vivo data regarding effective connectivity, provide a means to model the effects of various drug challenge paradigms, and characterize intermediate phenotypes in the search for the genes underlying mental illness. Nonetheless, as promising as fMRI appears to be in terms of its relative safety, repeatability, ability to generate individual brain maps and widespread availability, it is still subject to a number of unresolved conceptual conundrums inherited from earlier neuroimaging work. For example, functional neuroimaging has not generated any pathognomic findings in mental illness, has not established a clear link between neurophysiology and observable behavior, and has not resolved the potential confounds of medication. In this article, we will review the relevant historical background preceding fMRI, address methodological considerations in fMRI, and summarize recent fMRI findings in psychiatry. Finally, fMRI is being used to simplify the complex genetics of neuropsychiatric illness by generating quantitative and qualitative brain phenotypes.

Zur Messung von Übungs- und Trainingserfolg auf der Grundlage von EEG-Parametern *Friedhart Klix zum 70. Geburtstag gewidmet

Zusammenfassung: Übung bzw. Training reduziert im allgemeinen die Bearbeitungszeit zur Lösung eines Problems. Diese Zeiteinsparung wird oft auf eine Verringerung kontrollierter Prozesse zugunsten automatisierter Teilprozesse zurückgeführt. Doch welche Prozeßeigenschaften zeigen einen solchen Lerneffekt an? Einen möglichen Weg zur Beantwortung dieser Frage sehen wir in der Analyse prozeßbegleitender funktionaler Kooperationen zwischen Hirnregionen und ihrer Veränderung durch Übung. In 2 EEG-Studien wird die Annahme getroffen, daß sich hoher kognitiver Aufwand für Kontroll- und Steuerprozesse im Arbeitsgedächtnis in besonders starken Synchronisationen zwischen Regionen des Frontal- und des Parietalbereiches widerspiegelt. Die Erwartung, daß eine Aufwandsreduktion durch Übung mit einer Verringerung solcher Synchronisationen einhergeht, ließ sich auf der Basis einer EEG-Kohärenzanalyse empirisch bestätigen. Gleichzeitig mit einer Verringerung der Stärke dieser interregionalen Synchronisation wurde eine Erhöhung der Stärke der lokalen Synchronisation in parietalen Bereichen gefunden. Das könnte dahingehend interpretiert werden, daß der durch Übung teilweise automatisierte Lösungsprozeß mehr und mehr in parietalen Regionen stattfindet und damit die Exekutive von ihrer Kontrollfunktion entlastet wird.

Common inhibitory mechanism in human inferior prefrontal cortex revealed by event-related functional MRI

Inhibition of an ongoing reaction tendency for adaptation to changing environments is a major function of the human prefrontal cortex. This function has been investigated frequently using the go/no-go task and set-shifting tasks such as the Wisconsin Card Sorting Test (WCST). Studies in humans and monkeys suggest the involvement of the dorsolateral prefrontal cortex in the two task paradigms. However, it remains unknown where in the dorsolateral prefrontal cortex this function is localized, whether a common inhibitory mechanism is used in these task paradigms and how this inhibitory function acts on two different targets, i.e. the go response in the go/no-go task and the cognitive set in the WCST. In the go/no-go task of this study, subjects were instructed to either respond (go trial) or not respond (no-go trial), depending on the cue stimulus presented. The signals of functional MRI (fMRI) related to the inhibitory function should be transient by nature. Thus, we used the temporal resolution of fMRI (event-related fMRI) by which transient signals in go and no-go trials can be analysed separately and compared with each other. We found a focus that showed transient no-go dominant activity in the posterior part of the inferior frontal sulcus in the right hemisphere. This was true irrespective of whether the subjects used their right or left hands. These results suggest that the transient activation in the right inferior prefrontal area is related to the neural mechanism underlying the response inhibition function. Furthermore, this area was found to be overlapped spatially with the area that was activated transiently during cognitive set shifting in the WCST. The transient signals in the go/no-go task peaked 5 s after the transient expression of the inhibitory function, and the transient signals in the WCST peaked 7s after the transient expression, reflecting different durations of neuronal activity in the two inhibitory task paradigms. These results imply that the right inferior prefrontal area is commonly involved in the inhibition of different targets, i.e. the go response during performance of the go/no-go task and the cognitive set during performance of the WCST.

Neuroanatomical correlates of hunger and satiation in humans using positron emission tomography

The central role of the hypothalamus in the origination and/or processing of feeding-related stimuli may be modulated by the activity of other functional areas of the brain including the insular cortex (involved in enteroceptive monitoring) and the prefrontal cortex (involved in the inhibition of inappropriate response tendencies). Regional cerebral blood flow (rCBF), a marker of neuronal activity, was measured in 11 healthy, normal-weight men by using positron emission tomography in a state of hunger (after 36-h fast) and a state of satiation (after a liquid meal). Hunger was associated with significantly increased rCBF in the vicinity of the hypothalamus and insular cortex and in additional paralimbic and limbic areas (orbitofrontal cortex, anterior cingulate cortex, and parahippocampal and hippocampal formation), thalamus, caudate, precuneus, putamen, and cerebellum. Satiation was associated with increased rCBF in the vicinity of the ventromedial prefrontal cortex, dorsolateral prefrontal cortex, and inferior parietal lobule. Changes in plasma insulin concentrations in response to the meal were negatively correlated with changes in rCBF in the insular and orbitofrontal cortex. Changes in plasma free fatty acid concentrations in response to the meal were negatively correlated with changes in rCBF in the anterior cingulate and positively correlated with changes in rCBF in the dorsolateral prefrontal cortex. In conclusion, these findings raise the possibility that several regions of the brain participate in the regulation of hunger and satiation and that insulin and free fatty acids may be metabolic modulators of postprandial brain neuronal events. Although exploratory, the present study provides a foundation for investigating the human brain regions and cognitive operations that respond to nutritional stimuli.

Neuronal substrates participating in attentional set-shifting of rules for visually guided motor selection: a functional magnetic resonance imaging investigation

To investigate the neuronal substrates participating in attentional set-shifting for motor selection rules, a functional magnetic resonance imaging study was performed during hand-shape selection tasks. During the session, six right-handed subjects were required to make one of three hand-shapes using their right hands, in response to the hand-shape images on a video screen, following one of the three predefined rules of win, lose, and tie. The selection rules were consistently applied in three conditions (win, tie, and lose), and changed alternately in one condition (alternate win-lose). Thus the alternate win-lose condition requires the shift of rules for motor selection. This alternate condition compared with the win, tie, and lose conditions showed activation in the left middle frontal gyrus, the bilateral inferior frontal gyri, and the left posterior fusiform and lingual gyri. These activation patterns in the prefrontal cortex were similar to those observed during the performance of the Wisconsin Card Sorting Test (WCST), which requires a typical set-shifting ability from one perceptual dimension to another (Berman et al., 1995. Neuropsychologia 33, 1027-1046; Nagahama et al., 1996. Brain 119, 1667-1675; Konishi et al., 1998. Nature Neuroscience 1, 80-84.). Our data may indicate that the dorsolateral prefrontal cortex including the middle and inferior frontal gyri are important in attentional set-shifting of both perceptual and non-perceptual characteristics. Another activation in the fusiform and lingual gyri may have reflected the increased attentional demand for visual processing in the light of a current rule for motor selection.

Deconvolution of impulse response in event-related BOLD fMRI

The temporal characteristics of the BOLD response in sensorimotor and auditory cortices were measured in subjects performing finger tapping while listening to metronome pacing tones. A repeated trial paradigm was used with stimulus durations of 167 ms to 16 s and intertrial times of 30 s. Both cortical systems were found to be nonlinear in that the response to a long stimulus could not be predicted by convolving the 1-s response with a rectangular function. In the short-time regime, the amplitude of the response varied only slowly with stimulus duration. It was found that this character was predicted with a modification to Buxton's balloon model. Wiener deconvolution was used to deblur the response to concatenated short episodes of finger tapping at different temporal separations and at rates from 1 to 4 Hz. While the measured response curves were distorted by overlap between the individual episodes, the deconvolved response at each rate was found to agree well with separate scans at each of the individual rates. Thus, although the impulse response cannot predict the response to fully overlapping stimuli, linear deconvolution is effective when the stimuli are separated by at least 4 s. The deconvolution filter must be measured for each subject using a short-stimulus paradigm. It is concluded that deconvolution may be effective in diminishing the hemodynamically imposed temporal blurring and may have potential applications in quantitating responses in eventrelated fMRI.

Control of resolution and perception in working memory

Mechanisms underlying and controlling resolution and perception in working memory are studied by means of a pulse-coupled network model. It is shown that the adaptivity, i.e. the degree to which previous activity affects the ability to fire, of the excitatory units can control several aspects of the network dynamics in a coordinated way to enable multiple items to be resolved and perceived in working memory. One basic aspect is the complexity of the dynamics that regulates the temporal resolution of several items. The slow NMDA-receptor-mediated component of synaptic couplings to excitatory units facilitates successive activations of a given item. The dimension of the activated subspace of the complete available neural representation space is gradually decreased as adaptivity is reduced. It is also shown that the formation of perception by sufficiently intense and coherent activation of different features of an object can be controlled concurrently with resolution by the adaptivity. The mechanisms derived can account for the observed capacity of working memory with respect to number of items consciously resolved and also for the observed temporal separation of different items. Numerous observations link neuromodulators to cognitive functions and to various brain disorders involving working memory. Based on the influence of various neuromodulators on neuronal adaptivity, the model can also account for neuromodulatory regulation of working memory functions.

Storage and executive processes in the frontal lobes

The human frontal cortex helps mediate working memory, a system that is used for temporary storage and manipulation of information and that is involved in many higher cognitive functions. Working memory includes two components: short-term storage (on the order of seconds) and executive processes that operate on the contents of storage. Recently, these two components have been investigated in functional neuroimaging studies. Studies of storage indicate that different frontal regions are activated for different kinds of information: storage for verbal materials activates Broca's area and left-hemisphere supplementary and premotor areas; storage of spatial information activates the right-hemisphere premotor cortex; and storage of object information activates other areas of the prefrontal cortex. Two of the fundamental executive processes are selective attention and task management. Both processes activate the anterior cingulate and dorsolateral prefrontal cortex.

The neural consequences of conflict between intention and the senses

Normal sensorimotor states involve integration of intention, action and sensory feedback. An example is the congruence between motor intention and sensory experience (both proprioceptive and visual) when we move a limb through space. Such goal-directed action necessitates a mechanism that monitors sensorimotor inputs to ensure that motor outputs are congruent with current intentions. Monitoring in this sense is usually implicit and automatic but becomes conscious whenever there is a mismatch between expected and realized sensorimotor states. To investigate how the latter type of monitoring is achieved we conducted three fully factorial functional neuroimaging experiments using PET measures of relative regional cerebral blood flow with healthy volunteers. In the first experiment subjects were asked to perform Luria's bimanual co-ordination task which involves either in-phase (conditions 1 and 3) or out-of-phase (conditions 2 and 4) bimanual movements (factor one), while looking towards their left hand. In half of the conditions (conditions 3 and 4) a mirror was used that altered visual feedback (factor two) by replacing their left hand with the mirror image of their right hand. Hence (in the critical condition 4) subjects saw in-phase movements despite performing out-of-phase movements. This mismatch between intention, proprioception and visual feedback engendered cognitive conflict. The main effect of out-of-phase movements was associated with increased neural activity in posterior parietal cortex (PPC) bilaterally [Brodmann area (BA) 40, extending into BA 7] and dorsolateral prefrontal cortex (DLPFC) bilaterally (BA 9/46). The main effect of the mirror showed increased neural activity in right DLPFC (BA 9/ 46) and right superior PPC (BA 7) only. Analysis of the critical interaction revealed that the mismatch condition led to a specific activation in the right DLPFC alone (BA 9/46). Study 2, using an identical experimental set-up but manipulating visual feedback from the right hand (instead of the left), subsequently demonstrated that this right DLPFC activation was independent of the hand attended. Finally, study 3 removed the motor intentional component by moving the subjects' hand passively, thus engendering a mismatch between proprioception and vision only. Activation in the right lateral prefrontal cortex was now more ventral than in studies 1 or 2 (BA 44/45). A direct comparison of studies 1 and 3 (which both manipulated visual feedback from the left hand) confirmed that a ventral right lateral prefrontal region is primarily activated by discrepancies between signals from sensory systems, while a more dorsal area in right lateral prefrontal cortex is activated when actions must be maintained in the face of a conflict between intention and sensory outcome.

An oscillatory short-term memory buffer model can account for data on the Sternberg task

A limited number (7 +/- 2) of items can be held in human short-term memory (STM). We have previously suggested that observed dual (theta and gamma) oscillations could underlie a multiplexing mechanism that enables a single network to actively store up to seven memories. Here we have asked whether models of this kind can account for the data on the Sternberg task, the most quantitative measurements of memory search available. We have found several variants of the oscillatory search model that account for the quantitative dependence of the reaction time distribution on the number of items (S) held in STM. The models differ on the issues of (1) whether theta frequency varies with S and (2) whether the phase of ongoing oscillations is reset by the probe. Using these models the frequencies of dual oscillations can be derived from psychophysical data. The derived values (ftheta = 6-10 Hz; fgamma = 45-60 Hz) are in reasonable agreement with experimental values. The exhaustive nature of the serial search that has been inferred from psychophysical measurements can be plausibly explained by these oscillatory models. One argument against exhaustive serial search has been the existence of serial position effects. We find that these effects can be explained by short-term repetition priming in the context of serial scanning models. Our results strengthen the case for serial processing and point to experiments that discriminate between variants of the serial scanning process.

Load-dependent roles of frontal brain regions in the maintenance of working memory

Brain imaging studies have suggested a critical role for prefrontal cortex in working memory (WM) tasks that require both maintainenance and manipulation of information over time in delayed-response WM tasks. In the present study, functional magnetic resonance imaging (fMRI) was used to examine whether prefrontal areas are activated when only maintenance is required in a delayed-response WM task, without the overt requirement to manipulate the stored information. In two scans, six subjects performed WM tasks in which, on each trial, they (1) encoded 1, 3, or 6 to-be-remembered letters, (2) maintained these letters across a 5-second unfilled delay, and (3) determined whether a single probe letter was or was not part of the memory set. Activation of left caudal inferior frontal gyrus was observed, relative to the 1-letter task, when subjects were required to maintain 3 letters in WM. When subjects were required to maintain 6 letters in WM, additional prefrontal areas, most notably middle and superior frontal gyri, were activated bilaterally. Thus, increasing the amount of to-be-maintained information, without any overt manipulation requirement, resulted in the recruitment of wide-spread frontal-lobe regions. Inferior frontal gyrus activation was left-hemisphere dominant in both the 3- and 6-letter conditions, suggesting that such activation reflected material-specific verbal processes. Activation in middle and superior frontal gyri appeared only in the 6-letter condition and was right-hemisphere dominant, suggesting that such activation reflected material-independent executive processes.

Redefining the functional organization of working memory processes within human lateral prefrontal cortex

It is widely held that the frontal cortex plays a critical part in certain aspects of spatial and non-spatial working memory. One unresolved issue is whether there are functionally distinct subdivisions of the lateral frontal cortex that subserve different aspects of working memory. The present study used positron emission tomography (PET) to demonstrate that working memory processes within the human mid-dorsolateral and mid-ventrolateral frontal regions are organized according to the type of processing required rather than according to the nature (i.e. spatial or non-spatial), of the information being processed, as has been widely assumed. Two spatial working memory tasks were used which varied in the extent to which they required different executive processes. During a 'spatial span' task that required the subject to hold a sequence of five previously remembered locations in working memory a significant change in blood-flow was observed in the right mid-ventrolateral frontal cortex, but not in the anatomically and cytoarchitectonically distinct mid-dorsolateral frontal-lobe region. By contrast, during a '2-back' task that required the subject to continually update and manipulate an ongoing sequence of locations within working memory, significant blood flow increases were observed in both mid-ventrolateral and mid-dorsolateral frontal regions. When the two working memory tasks were compared directly, the one that emphasized manipulation of information within working memory yielded significantly greater activity in the right mid-dorsolateral frontal cortex only. This dissociation provides unambiguous evidence that the mid-dorsolateral and mid-ventrolateral frontal cortical areas make distinct functional contributions to spatial working memory and corresponds with a fractionation of working memory processes in psychological terms.

Auditory belt and parabelt projections to the prefrontal cortex in the rhesus monkey

Recent anatomical and electrophysiological studies have expanded our knowledge of the auditory cortical system in primates and have described its organization as a series of concentric circles with a central or primary auditory core, surrounded by a lateral and medial belt of secondary auditory cortex with a tertiary parabelt cortex just lateral to this belt. Because recent studies have shown that rostral and caudal belt and parabelt cortices have distinct patterns of connections and acoustic responsivity, we hypothesized that these divergent auditory regions might have distinct targets in the frontal lobe. We, therefore, placed discrete injections of wheat germ agglutinin-horseradish peroxidase or fluorescent retrograde tracers into the prefrontal cortex of macaque monkeys and analyzed the anterograde and retrograde labeling in the aforementioned auditory areas. Injections that included rostral and orbital prefrontal areas (10, 46 rostral, 12) labeled the rostral belt and parabelt most heavily, whereas injections including the caudal principal sulcus (area 46), periarcuate cortex (area 8a), and ventrolateral prefrontal cortex (area12vl) labeled the caudal belt and parabelt. Projections originating in the parabelt cortex were denser than those arising from the lateral or medial belt cortices in most cases. In addition, the anterior third of the superior temporal gyrus and the dorsal bank of the superior temporal sulcus were also labeled after prefrontal injections, confirming previous studies. The present topographical results suggest that acoustic information diverges into separate streams that target distinct rostral and caudal domains of the prefrontal cortex, which may serve different acoustic functions.

Temporal isolation of the neural correlates of spatial mnemonic processing with fMRI

The use of cognitive subtraction to study the neural substrates of the maintenance component of spatial working memory in humans relies upon the assumptions of the pure insertion of cognitive processes and a linear transform of neural activity to neuroimaging signal. Here, functional changes attributable to the memory requiring phase (referred to as the retention delay) of a spatial working memory task were temporally discriminated from those attributable to other behavioral subcomponents within trials using an experimental design that is argued to obviate these assumptions, as well as permit a joint test of their validity. The hypothesis that the assumptions of cognitive subtraction (as applied to neuroimaging) hold in general was not supported. Functional changes attributable to the retention delay were detected in the dorsolateral prefrontal cortex as well as in other cortical regions in a subset of the subjects, and in the right frontal eye field and right superior parietal lobule of all subjects (n=5). These results support models in which these regions are involved in maintaining spatial representations in humans. In addition, nearly all regions that evidenced such functional changes during the retention delay also evidenced functional changes during behaviors that did not require spatial working memory. This result tends to dispute models which posit the existence of gross neuroanatomical regions involved in solely mnemonic function.

Graded functional activation in the visuospatial system with the amount of task demand

Two studies examined how the amount and type of computational demand are related to fMRI-measured activation in three bilateral cortical regions involved in the Shepard-Metzler (1971) mental-rotation paradigm. The amount of demand for the computation of visuospatial coordinates was manipulated by presenting mental rotation problems with increasing angular disparity (0, 40, 80, or 120 degrees). Activation in both the left and right intraparietal sulcal regions increased linearly with angular disparity in two separate studies. Activation also occurred in the fusiform gyrus and inferior temporal regions, regions that are primarily associated with the processes of object and object-part identification. By contrast, the demand for object recognition and rotation processes was relatively low, and the demand for executing saccades was high in a control condition that required making a systematic visual scan of two grids. The grid-scanning condition resulted in relatively less activation in the parietal and inferior temporal regions but considerable activation in frontal areas that are associated with planning and executing saccades, including the precentral gyrus and sulcus into the posterior middle frontal region. These data suggest that the amount of activation in the various cortical regions that support visuospatial processing is related to the amount, as well as to the type, of computational demand.

Different effects of unilateral and bilateral hippocampal lesions in rats on the performance of radial maze and odor-paired associate tasks

The hippocampus plays an important role in the declarative or explicit memory in humans and is necessary for allocentric spatial learning and olfactory memory in animals. In primates and rodents, the bilateral hemispheres of the brain (especially the forebrain) symmetrically and asymmetrically contribute to diverse cognitive manipulations. In this study, we investigated the role of the hippocampus in spatial memory and in odor-paired associate memory by unilaterally or bilaterally lesioning this region in rats. The bilateral removal, but not the unilateral removal, of the hippocampus impaired both the acquisition of spatial working memory in the radial maze task and the retrieval of maze performance tested 1 month after the acquisition trials. In contrast, neither bilateral nor unilateral removal impaired the odor-paired associate learning. These findings suggest that the hippocampus is critical to the spatial memory, and that a unilateral hippocampus is sufficient for executing a spatial task. The present results also indicate that the hippocampus plays a minor role in odor-dominated associate learning and that some kinds of memories in rats may be processed independently by the left or right hippocampus.

Regional brain activity during tasks devoted to the central executive of working memory

Most previous PET studies investigating the central executive (CE) component of working memory found activation in the prefrontal cortex. However, the tasks used did not always permit to distinguish precisely the functions of the CE from the storage function of the slave systems. The aim of the present study was to isolate brain areas that subserve manipulation of information by the CE when the influence of storage function was removed. A PET activation study was performed with four cognitive tasks, crossing conditions of temporary storage and manipulation of information. The manipulation of information induced an activation in the right (BA 10/46) and left (BA 9/6) middle frontal gyrus and in the left parietal area (BA7). The interaction between the storage and manipulation conditions did not reveal any significant changes in activation. These results are in agreement with the hypothesis that CE functions are distributed between anterior and posterior brain areas, but could also reflect a simultaneous involvement of controlled (frontal) and automatic (parietal) attentional systems. In the other hand, the absence of interaction between the storage and manipulation conditions demonstrates that the CE is not necessarily related to the presence of a memory load.

Dynamic pattern of brain activation during sequencing of word strings evaluated by fMRI

An impaired ability to recite highly automated word strings (e.g., the names of the months of the year) in reverse order concomitant with preserved production of the conventional sequence has been considered a salient sign of frontal lobe dysfunction. Using functional magnetic resonance imaging (fMRI), the spatial and temporal pattern of brain activation during covert performance of these tasks was evaluated in healthy subjects. As compared to the response obtained during forward recitation, re-sequencing of the word string yielded additional activation of the bilateral middle and inferior frontal gyri, the posterior parietal cortex and the left anterior cingulate gyrus. The prefrontal responses are in accordance with the clinical findings referred to. However, the set of activated areas, as a whole, presumably reflects contribution of the various components of the working memory system to the sequencing of word strings. During successive periods of task administration, subjects showed a linear increase of production speed. Analysis of corresponding dynamic changes of regional hemodynamic responses revealed a significant increase at the level of the left inferior parietal cortex and a decrease within the mesial aspect of the left superior frontal gyrus. Presumably, the former finding reflects increasing demands on the phonological short-term memory store, due to faster updating of its content under increased word production rate. Decreasing activation within the superior frontal gyrus might indicate contribution of this area to the initiation of the cognitive processes subserving the sequencing of verbal items. These findings demonstrate the capability of fMRI as a powerful tool for the analysis of dynamic brain activation.

Sustained activity in the medial wall during working memory delays

We have taken advantage of the temporal resolution afforded by functional magnetic resonance imaging (fMRI) to investigate the role played by medial wall areas in humans during working memory tasks. We demarcated the medial motor areas activated during simple manual movement, namely the supplementary motor area (SMA) and the cingulate motor area (CMA), and those activated during visually guided saccadic eye movements, namely the supplementary eye field (SEF). We determined the location of sustained activity over working memory delays in the medial wall in relation to these functional landmarks during both spatial and face working memory tasks. We identified two distinct areas, namely the pre-SMA and the caudal part of the anterior cingulate cortex (caudal-AC), that showed similar sustained activity during both spatial and face working memory delays. These areas were distinct from and anterior to the SMA, CMA, and SEF. Both the pre-SMA and caudal-AC activation were identified by a contrast between sustained activity during working memory delays as compared with sustained activity during control delays in which subjects were waiting for a cue to make a simple manual motor response. Thus, the present findings suggest that sustained activity during working memory delays in both the pre-SMA and caudal-AC does not reflect simple motor preparation but rather a state of preparedness for selecting a motor response based on the information held on-line.

Memory fields of neurons in the primate prefrontal cortex

Many prefrontal (PF) neurons convey information about both an object's identity (what) and its location (where). To explore how they represent conjunctions of what and where, we explored the receptive fields of their mnemonic activity (i.e., their "memory fields") by requiring monkeys to remember both an object and its location at many positions throughout a wide portion of central vision. Many PF neurons conveyed object information and had highly localized memory fields that emphasized the contralateral, but not necessarily foveal, visual field. These results indicate that PF neurons can simultaneously convey precise location and object information and thus may play a role in constructing a unified representation of a visual scene.

A model of visuospatial working memory in prefrontal cortex: recurrent network and cellular bistability

We report a computer simulation of the visuospatial delayed-response experiments of Funahashi et al. (1989), using a firing-rate model that combines intrinsic cellular bistability with the recurrent local network architecture of the neocortex. In our model, the visuospatial working memory is stored in the form of a continuum of network activity profiles that coexist with a spontaneous activity state. These neuronal firing patterns provide a population code for the cue position in a graded manner. We show that neuronal persistent activity and tuning curves of delay-period activity (memory fields) can be generated by an excitatory feedback circuit and recurrent synaptic inhibition. However, if the memory fields are constructed solely by network mechanisms, noise may induce a random drift over time in the encoded cue position, so that the working memory storage becomes unreliable. Furthermore, a "distraction" stimulus presented during the delay period produces a systematic shift in the encoded cue position. We found that the working memory performance can be rendered robust against noise and distraction stimuli if single neurons are endowed with cellular bistability (presumably due to intrinsic ion channel mechanisms) that is conditional and realized only with sustained synaptic inputs from the recurrent network. We discuss how cellular bistability at the single cell level may be detected by analysis of spike trains recorded during delay-period activity and how local modulation of intrinsic cell properties and/or synaptic transmission can alter the memory fields of individual neurons in the prefrontal cortex.

Prefrontal involvement in "temporal bridging" and timing movement

Brain activity exclusively related to a temporal delay has rarely been investigated using modern brain imaging. In this study we exploited the temporal resolution of functional magnetic resonance imaging (fMRI) to characterise, by sinusoidal regression analysis, differential neuroactivation patterns induced in healthy subjects by two sensorimotor synchronization tasks different in their premovement delay of either 0.6 s or 5 s. The short event rate condition required rhythmic tapping, while the long event rate condition required timing of intermittent movements. Left rostral prefrontal cortex, medial frontal cortex, SMA and supramarginal gyrus demonstrated increased MR signal intensity during low frequency synchronization, suggesting that these brain regions form a distributed neural network for cognitive time management processes, such as time estimation and motor output timing. Medial frontal cortex showed a biphasic pattern of response during both synchronization conditions, presumably reflecting frequency-independent motor output related attention. As predicted, sensorimotor and visual association areas demonstrated increased MR signal intensity during high frequency synchronization.

The role of prefrontal cortex in working memory: examining the contents of consciousness

Working memory enables us to hold in our 'mind's eye' the contents of our conscious awareness, even in the absence of sensory input, by maintaining an active representation of information for a brief period of time. In this review we consider the functional organization of the prefrontal cortex and its role in this cognitive process. First, we present evidence from brain-imaging studies that prefrontal cortex shows sustained activity during the delay period of visual working memory tasks, indicating that this cortex maintains on-line representations of stimuli after they are removed from view. We then present evidence for domain specificity within frontal cortex based on the type of information, with object working memory mediated by more ventral frontal regions and spatial working memory mediated by more dorsal frontal regions. We also propose that a second dimension for domain specificity within prefrontal cortex might exist for object working memory on the basis of the type of representation, with analytic representations maintained preferentially in the left hemisphere and image-based representations maintained preferentially in the right hemisphere. Furthermore, we discuss the possibility that there are prefrontal areas brought into play during the monitoring and manipulation of information in working memory in addition to those engaged during the maintenance of this information. Finally, we consider the relationship of prefrontal areas important for working memory, both to posterior visual processing areas and to prefrontal areas associated with long-term memory.

A neuronal model of a global workspace in effortful cognitive tasks

A minimal hypothesis is proposed concerning the brain processes underlying effortful tasks. It distinguishes two main computational spaces: a unique global workspace composed of distributed and heavily interconnected neurons with long-range axons, and a set of specialized and modular perceptual, motor, memory, evaluative, and attentional processors. Workspace neurons are mobilized in effortful tasks for which the specialized processors do not suffice. They selectively mobilize or suppress, through descending connections, the contribution of specific processor neurons. In the course of task performance, workspace neurons become spontaneously coactivated, forming discrete though variable spatio-temporal patterns subject to modulation by vigilance signals and to selection by reward signals. A computer simulation of the Stroop task shows workspace activation to increase during acquisition of a novel task, effortful execution, and after errors. We outline predictions for spatio-temporal activation patterns during brain imaging, particularly about the contribution of dorsolateral prefrontal cortex and anterior cingulate to the workspace.

Age-related changes in regional cerebral blood flow during working memory for faces

Young and old adults underwent positron emission tomography during the performance of a working memory task for faces (delayed match-to-sample), in which the delay between the sample and choice faces was varied from 1 to 21 s. Reaction time was slower and accuracy lower in the old group, but not markedly so. Values of regional cerebral blood flow (rCBF) were analyzed for sustained activity across delay conditions, as well as for changes as delay increased. Many brain regions showed similar activity during these tasks in both young and old adults, including left anterior prefrontal cortex, which had increased rCBF with delay, and ventral extrastriate cortex, which showed decreased rCBF with delay. However, old adults had less activation overall and less modulation of rCBF across delay in right ventrolateral prefrontal cortex than did the young adults. Old adults also showed greater rCBF activation in left dorsolateral prefrontal cortex across all WM delays and increased rCBF at short delays in left occipitoparietal cortex compared to young adults. Activity in many of these regions was differentially related to performance in that it was associated with decreasing response times in the young group and increasing response times in the older individuals. Thus despite the finding that performance on these memory tasks and associated activity in a number of brain areas are relatively preserved in old adults, differences elsewhere in the brain suggest that different strategies or cognitive processes are used by the elderly to maintain memory representations over short periods of time.

Saccadic eye movement and working memory deficits following damage to human prefrontal cortex

A patient with a lesion confined largely to the right inferior frontal gyrus was found to be impaired on tests of spatial working memory and executive functioning. By contrast, his pattern recognition was good. The patient's selective impairments are consistent with the view that prefrontal cortex contributes to processes involved in spatial working memory. The patient was also tested on a range of oculomotor paradigms, some of which required the temporary suppression of a saccadic response. He was unable to suppress making contra- or ipsilesional reflexive glances to peripheral stimuli on the "anti-saccade" paradigm, but his performance improved on delayed saccade, memory-guided saccade and fixation tasks. Although reflexive glances were observed under these conditions they occurred more frequently in response to contralesional stimuli than ipsilesional ones. Furthermore, the patient had no difficulty in performing anti-point movements with his ipsilesional hand. Thus, his inability to suppress reflexive glances on the anti-saccade task is not due to a generalised problem of "distractibility". The patient's deficits are discussed in terms of models of anti-saccade generation and are related to recent findings regarding the role of prefrontal cortex in working memory and visual attention.

Reproducibility of fMRI results across four institutions using a spatial working memory task

Four U.S. sites formed a consortium to conduct a multisite study of fMRI methods. The primary purpose of this consortium was to examine the reliability and reproducibility of fMRI results. FMRI data were collected on healthy adults during performance of a spatial working memory task at four different institutions. Two sets of data from each institution were made available. First, data from two subjects were made available from each site and were processed and analyzed as a pooled data set. Second, statistical maps from five to eight subjects per site were made available. These images were aligned in stereotactic space and common regions of activation were examined to address the reproducibility of fMRI results when both image acquisition and analysis vary as a function of site. Our grouped and individual data analyses showed reliable patterns of activation in dorsolateral prefrontal cortex and posterior parietal cortex during performance of the working memory task across all four sites. This multisite study, the first of its kind using fMRI data, demonstrates highly consistent findings across sites.

Neuroimaging analyses of human working memory

We review a program of research that uses neuroimaging techniques to determine the functional and neural architecture of human working memory. A first set of studies indicates that verbal working memory includes a storage component, which is implemented neurally by areas in the left-hemisphere posterior parietal cortex, and a subvocal rehearsal component, which is implemented by left-hemisphere speech areas, including Broca's area as well as the premotor and supplementary motor areas. We provide a number of neuroimaging dissociations between the storage and rehearsal areas. A second set of studies focuses on spatial working memory and indicates that it is mediated by a network of predominantly right-hemisphere regions that include areas in posterior parietal, occipital, and frontal cortex. We provide some suggestive evidence that these areas, too, divide into storage and rehearsal regions, with right-hemisphere posterior parietal and premotor regions subserving spatial rehearsal. In a final set of studies, we turn to "executive processes," metaprocesses that regulate the processing of working-memory contents. We focus on the executive process of inhibition as it is used in verbal working memory. We provide evidence that such inhibition is mediated by the left-hemisphere prefrontal region and that it can be dissociated from verbal storage and rehearsal processes.

Participation of the prefrontal cortices in prospective memory: evidence from a PET study in humans

Prospective memory is a memory feature in humans which involves activities for remembering to do something in the future. The present study provides functional neuroanatomy of prospective memory for the first time. We used positron emission tomography (PET) and found several localized brain activations in relation to a prospective memory task required to retain and remember a planned action while performing an ongoing routine activity. Activations were identified in the right dorsolateral and ventrolateral prefrontal cortices, the left frontal pole and anterior cingulate gyrus, the left parahippocampal gyrus, and midline medial frontal lobe. We attributed these activations to several cognitive processes involved in prospective memory, such as holding an intention toward future behavior, checking target items within presented stimuli, and dividing attention between the planned action and the routine activity.

Refractory periods observed by intrinsic signal and fluorescent dye imaging

All perfusion-based imaging modalities depend on the relationship between neuronal and vascular activity. However, the relationship between stimulus and response was never fully characterized. With the use of optical imaging (intrinsic signals and intravascular fluorescent dyes) during repetitive stimulation paradigms, we observed reduced responses with temporally close stimuli. Cortical evoked potentials, however, did not produce the same reduced responsiveness. We therefore termed these intervals of reduced responsiveness "refractory periods." During these refractory periods an ability to respond was retained, but at a near 60% reduction in the initial magnitude. Although increasing the initial stimulus duration lengthened the observed refractory periods, significantly novel or temporally spaced stimuli overcame them. We observed this phenomenon in both rodent and human subjects in somatosensory and auditory cortices. These results have significant implications for understanding the capacities, mechanisms, and distributions of neurovascular coupling and thereby possess relevance to all perfusion-dependent functional imaging techniques.

Working memory in childhood-onset schizophrenia and attention-deficit/hyperactivity disorder

We investigated verbal and spatial working memory in participants with childhood-onset schizophrenia (N=13), attention-deficit/hyperactivity disorder (ADHD; N=31) and age-matched normal children (N=27). The ages of the participants ranged from 9 to 20 years, with an average age of approx. 14 in all groups. Diagnoses were based on structured interviews (Kiddie-Schedule for Affective Disorders and Schizophrenia) with the children and their parents and made using DSM-III-R criteria. Verbal working memory was assessed by the highest number of digits recalled in forward and backward order on the Digit Span subtest of the Wechsler Intelligence Scale. Results showed that normal children recalled more digits than schizophrenic and ADHD children, who did not differ. Spatial working memory was assessed with the Dot Test of Visuospatial Working Memory: The children were presented with a dot on a page for 5 s and asked to mark its location on a blank page immediately after presentation or 30 s later. A distracter task was used during the delay to prevent verbal rehearsal. The average distance between the target dot and the child's mark in the 30-s condition was shorter for normal than for schizophrenic and ADHD children, who did not differ. Thus, both schizophrenic and ADHD children showed deficits in verbal and spatial working memory. These results suggest that in both disorders, the capacity of the sensory buffers may be diminished, and/or the availability and allocation of resources to the central executive may be limited.

Reopening the mental imagery debate: lessons from functional anatomy

Over the past few years, the neural bases of mental imagery have been both a topic of intense debate and a domain of extensive investigations using either PET or fMRI that have provided new insights into the cortical anatomy of this cognitive function. Several studies have in fact demonstrated that there exist types of mental imagery that do not rely on primary/early visual areas, whereas a consensus now exists on the validity of the dorsal/ventral-route model in the imagery domain. More importantly, these studies have provided evidence that, in addition to higher order visual areas, mental imagery shares common brain areas with other major cognitive functions, such as language, memory, and movement, depending on the nature of the imagery task. This body of recent results indicates that there is no unique mental imagery cortical network; rather, it reflects the high degree of interaction between mental imagery and other cognitive functions.

Immediate versus delayed visual memory task performance among schizophrenic patients and normal control subjects

In an exploratory study, 10 schizophrenic patients and 10 normal control subjects performed immediate and delayed memory tasks, which were variants of previously developed continuous performance tests. Both tasks required participants to identify five-digit numbers which were repeated. Numbers were presented in series for 500 ms each and separated by a 500-ms time-out period. In the immediate memory task, subjects were to respond if a number was identical to the one that had immediately preceded it. The delayed memory task differed from the first task in that a longer delay (3.5 s) between stimuli was introduced, and during this delay distracter stimuli appeared. While normal control subjects performed accurately on both tasks (exceeding 80% correct detections), schizophrenic patients performed poorly, performing worse on the delayed memory task than on the immediate memory task. Rates of commission errors (responses made to similar, but not identical numbers) were nearly equal between groups on the immediate memory task, but on the delayed memory task normal control subjects made relatively more commission errors while schizophrenic patients made fewer commission errors. No differences in response latencies were observed between subject groups or tasks. This paradigm may prove useful in discriminating subtle differences in immediate and delayed memory capability among psychiatric populations and normal control subjects.

The role of parietal cortex in verbal working memory

Neuroimaging studies of normal subjects and studies of patients with focal lesions implicate regions of parietal cortex in verbal working memory (VWM), yet the precise role of parietal cortex in VWM remains unclear. Some evidence (; ) suggests that the parietal cortex mediates the storage of verbal information, but these studies and most previous ones included encoding and retrieval processes as well as storage and rehearsal of verbal information. A recent positron emission tomography (PET) study by isolated storage and rehearsal from other VWM processes and did not find reliable activation in parietal cortex. This result suggests that parietal cortex may not be involved in VWM storage, contrary to previous proposals. However, we report two behavioral studies indicating that some of the verbal material used by may not have required phonological representations in VWM. In addition, we report a PET study that isolated VWM encoding, retrieval, and storage and rehearsal processes in different PET scans and used material likely to require phonological codes in VWM. After subtraction of appropriate controls, the encoding condition revealed no reliable activations; the retrieval condition revealed reliable activations in dorsolateral prefrontal, anterior cingulate, posterior parietal, and extrastriate cortices, and the storage condition revealed reliable activations in dorsolateral prefrontal, inferior frontal, premotor, and posterior parietal cortices, as well as cerebellum. These results suggest that parietal regions are part of a network of brain areas that mediate the short-term storage and retrieval of phonologically coded verbal material.

Cerebral blood flow in hypertensive patients: an initial report of reduced and compensatory blood flow responses during performance of two cognitive tasks

We asked whether the altered cerebral vasculature associated with essential hypertension might dampen or redirect the regional cerebral blood flow (rCBF) response to cognitive work. Relative rCBF was assessed with [(15)O]water positron emission tomography during a working memory task, a memory span task, and two perceptual control tasks. Unmedicated hypertensive patients and control subjects differed in rCBF response during both memory tasks. Hypertensives showed relatively diminished rCBF responses in right hemisphere areas combined with compensatory activation of homologous areas in the left cerebral cortex. Essential hypertension appears to selectively influence the circulatory reserve of portions of cerebral cortex and secondarily induce recruitment of other cortical areas to process certain tasks.

Matching patterns of activity in primate prefrontal area 8a and parietal area 7ip neurons during a spatial working memory task

Single-unit recording studies of posterior parietal neurons have indicated a similarity of neuronal activation to that observed in the dorsolateral prefrontal cortex in relation to performance of delayed saccade tasks. A key issue addressed in the present study is whether the different classes of neuronal activity observed in these tasks are encountered more frequently in one or the other area or otherwise exhibit region-specific properties. The present study is the first to directly compare these patterns of neuronal activity by alternately recording from parietal area 7ip and prefrontal area 8a, under the identical behavioral conditions, within the same hemisphere of two monkeys performing an oculomotor delayed response task. The firing rate of 222 posterior parietal and 235 prefrontal neurons significantly changed during the cue, delay, and/or saccade periods of the task. Neuronal responses in the two areas could be distinguished only by subtle differences in their incidence and timing. Thus neurons responding to the cue appeared earliest and were more frequent among the task-related neurons within parietal cortex, whereas neurons exhibiting delay-period activity accounted for a larger proportion of task-related neurons in prefrontal cortex. Otherwise, the task-related neuronal activities were remarkably similar. Cue period activity in prefrontal and parietal cortex exhibited comparable spatial tuning and temporal duration characteristics, taking the form of phasic, tonic, or combined phasic/tonic excitation in both cortical populations. Neurons in both cortical areas exhibited sustained activity during the delay period with nearly identical spatial tuning. The various patterns of delay-period activity-tonic, increasing or decreasing, alone or in combination with greater activation during cue and/or saccade periods-likewise were distributed to both cortical areas. Finally, similarities in the two populations extended to the proportion and spatial tuning of presaccadic and postsaccadic neuronal activity occurring in relation to the memory-guided saccade. The present findings support and extend evidence for a faithful duplication of receptive field properties and virtually every other dimension of task-related activity observed when parietal and prefrontal cortex are recruited to a common task. This striking similarity attests to the principal that information shared by a prefrontal region and a sensory association area with which it is connected is domain specific and not subject to hierarchical elaboration, as is evident at earlier stages of visuospatial processing.

Transient activation of inferior prefrontal cortex during cognitive set shifting

The Wisconsin Card Sorting Test, which probes the ability to shift attention from one category of stimulus attributes to another (shifting cognitive sets), is the most common paradigm used to detect human frontal lobe pathology. However, the exact relationship of this card test to prefrontal function and the precise anatomical localization of the cognitive shifts involved are controversial. By isolating shift-related signals using the temporal resolution of functional magnetic resonance imaging, we reproducibly found transient activation of the posterior part of the bilateral inferior frontal sulci. This activation was larger as the number of dimensions (relevant stimulus attributes that had to be recognized) were increased. These results suggest that the inferior frontal areas play an essential role in the flexible shifting of cognitive sets.