Verbal Working Memory Load Affects Regional Brain Activation as Measured by PET

We report an experiment that assesses the effect of variations in memory load on brain activations that mediate verbal working memory. The paradigm that forms the basis of this experiment is the "n-back" task in which subjects must decide for each letter in a series whether it matches the one presented n items back in the series. This task is of interest because it recruits processes involved in both the storage and manipulation of information in working memory. Variations in task difficulty were accomplished by varying the value of n. As n increased, subjects showed poorer behavioral performance as well as monotonically increasing magnitudes of brain activation in a large number of sites that together have been identified with verbal working-memory processes. By contrast, there was no reliable increase in activation in sites that are unrelated to working memory. These results validate the use of parametric manipulation of task variables in neuroimaging research, and they converge with the subtraction paradigm used most often in neuroimaging. In addition, the data support a model of working memory that includes both storage and executive processes that recruit a network of brain areas, all of which are involved in task performance.

Spatial versus Object Working Memory: PET Investigations

We used positron emission tomography (PET) to answer the following question: Is working memory a unitary storage system, or does it instead include different storage buffers for different kinds of information? In Experiment 1, PET measures were taken while subjects engaged in either a spatial-memory task (retain the position of three dots for 3 sec) or an object-memory task (retain the identity of two objects for 3 sec). The results manifested a striking double dissociation, as the spatial task activated only right-hemisphere regions, whereas the object task activated primarily left-hemisphere regions. The spatial (right-hemisphere) regions included occipital, parietal, and prefrontal areas, while the object (left-hemisphere) regions included inferotemporal and parietal areas. Experiment 2 was similar to Experiment 1 except that the stimuli and trial events were identical for the spatial and object tasks; whether spatial or object memory was required was manipulated by instructions. The PET results once more showed a double dissociation, as the spatial task activated primarily right-hemisphere regions (again including occipital, parietal and prefrontal areas), whereas the object task activated only left-hemisphere regions (again including inferotemporal and parietal areas). Experiment 3 was a strictly behavioral study, which produced another double dissociation. It used the same tasks as Experiment 2, and showed that a variation in spatial similarity affected performance in the spatial but not the object task, whereas a variation in shape similarity affected performance in the object but not the spatial task. Taken together, the results of the three experiments clearly imply that different working-memory buffers are used for storing spatial and object information.

Short-time windows of correlation between large-scale functional brain networks predict vigilance intraindividually and interindividually

A better understanding of how behavioral performance emerges from interacting brain systems may come from analysis of functional networks using functional magnetic resonance imaging. Recent studies comparing such networks with human behavior have begun to identify these relationships, but few have used a time scale small enough to relate their findings to variation within a single individual's behavior. In the present experiment we examined the relationship between a psychomotor vigilance task and the interacting default mode and task positive networks. Two time-localized comparative metrics were calculated: difference between the two networks' signals at various time points around each instance of the stimulus (peristimulus times) and correlation within a 12.3-s window centered at each peristimulus time. Correlation between networks was also calculated within entire resting-state functional imaging runs from the same individuals. These metrics were compared with response speed on both an intraindividual and an interindividual basis. In most cases, a greater difference or more anticorrelation between networks was significantly related to faster performance. While interindividual analysis showed this result generally, using intraindividual analysis it was isolated to peristimulus times 4 to 8 s before the detected target. Within that peristimulus time span, the effect was stronger for individuals who tended to have faster response times. These results suggest that the relationship between functional networks and behavior can be better understood by using shorter time windows and also by considering both intraindividual and interindividual variability.

The boundaries of sequential modulations: evidence for set-level control

We examined the sequential modulation of congruency effects using a task in which the irrelevant information shares the same stimulus dimensions as the relevant information but is presented at an earlier time. In Experiment 1, sequential modulations were observed within a stimulus modality but not between stimulus modalities. In Experiment 2, sequential modulations were observed across two sets of visual stimuli, even though the two sets involved distinct stimulus dimensions. Experiment 3 used the same stimuli as Experiment 2, but required different responses for the two sets of stimuli. In this case, sequential modulations were specific to the stimulus set. In Experiment 4, two stimulus sets were presented along two stimulus modalities, and sequential modulations crossed both set and modality boundaries. These results suggest that control processes obey flexible boundaries defined by task constraints.

Spatiotemporal dynamics of low frequency BOLD fluctuations in rats and humans

Most studies involving spontaneous fluctuations in the BOLD signal extract connectivity patterns that show relationships between brain areas that are maintained over the length of the scanning session. In this study, however, we examine the spatiotemporal dynamics of the BOLD fluctuations to identify common patterns of propagation within a scan. A novel pattern finding algorithm was developed for detecting repeated spatiotemporal patterns in BOLD fMRI data. The algorithm was applied to high temporal resolution T2*-weighted multislice images obtained from rats and humans in the absence of any task or stimulation. In rats, the primary pattern consisted of waves of high signal intensity, propagating in a lateral to medial direction across the cortex, replicating our previous findings (Majeed et al., 2009a). These waves were observed primarily in sensorimotor cortex, but also extended to visual and parietal association areas. A secondary pattern, confined to subcortical regions consisted of an initial increase and subsequent decrease in signal intensity in the caudate-putamen. In humans, the most common spatiotemporal pattern consisted of an alteration between activation of areas comprising the "default-mode" (e.g., posterior cingulate and anterior medial prefrontal cortices) and the "task-positive" (e.g., superior parietal and premotor cortices) networks. Signal propagation from focal starting points was also observed. The pattern finding algorithm was shown to be reasonably insensitive to the variation in user-defined parameters, and the results were consistent within and between subjects. This novel approach for probing the spontaneous network activity of the brain has implications for the interpretation of conventional functional connectivity studies, and may increase the amount of information that can be obtained from neuroimaging data.

Parallel response selection disrupts sequence learning under dual-task conditions

Some studies suggest that dual-task processing impairs sequence learning; others suggest it does not. The reason for this discrepancy remains obscure. It may have to do with the dual-task procedure often used. Many dual-task sequence learning studies pair the serial reaction time (SRT) task with a tone-counting secondary task. The tone-counting task, however, is not ideal for studying the cognitive processes involved in sequence learning. The present experiments sought to identify the nature of the interference responsible for disrupting sequence learning in dual-task situations using more tractable dual-task procedures. Experiments 1 and 2 showed that parallel-interfering central processing disrupts sequence learning. Experiment 3 used a novel combination of the SRT task as the secondary task in a psychological refractory period procedure. It showed that SRT task performance can be disrupted without disrupting sequence learning when that disruption involves a response-selection bottleneck rather than parallel response selection. Together, these results suggest that it is the overlap of central processes involved in successfully performing the 2 tasks concurrently that leads to learning deficits in dual-task sequence learning.

Neural evidence of a role for spatial response selection in the learning of spatial sequences

Despite over 20 years of behavioral research, considerable disagreement remains regarding the locus of the cognitive mechanisms (e.g., stimulus encoding, response selection or response production) responsible for the acquisition and expression of learned sequences. Functional neuroimaging may prove invaluable for resolving this controversy. The cortical mechanisms underlying spatial response selection (i.e., right dorsal prefrontal, dorsal premotor and superior parietal cortices) are well known. These regions as well as supplementary motor area, striatum and the hippocampus have also been implicated in sequence learning. This neural overlap lends support for the hypothesis that spatial response selection is involved in learning spatial sequences; however, these experimental factors have not been investigated in the same experiment so the extent of neural overlap is debatable. The present study investigates the role of spatial response selection in sequence learning during the performance of the serial reaction time task. We orthogonally manipulated spatial sequence learning and spatial response-selection difficulty to precisely identify the neural overlap of these cognitive systems. Results demonstrate near complete overlap in regions affected by the spatial response selection and spatial sequence learning manipulations. Only right dorsal prefrontal cortex was selectively influenced by the response selection difficulty manipulation. These findings emphasize the importance of spatial response selection for successful spatial sequence learning.

Reorganization of visual processing is related to eccentric viewing in patients with macular degeneration

PURPOSE

Neural evidence exists for cortical reorganization in human visual cortex in response to retinal disease. Macular degeneration (MD) causes the progressive loss of central visual acuity. To cope with this, MD patients often adopt a preferred retinal location (PRL, i.e., a functional retinal area in their periphery used to fixate instead of the damaged fovea). The use of a PRL may foster cortical reorganization.

METHODS

We used fMRI to measure brain activity in calcarine sulcus while visually stimulating peripheral visual regions in MD patients and age-matched control participants.

RESULTS

We found that visual stimulation of the PRL in MD patients increased brain activity in cortex normally representing central vision relative to visual stimulation of a peripheral region outside the patients' PRL and relative to stimulation in the periphery of age-matched control participants.

CONCLUSIONS

These data directly link cortical reorganization in MD to behavioral adaptations adopted by MD patients. These results not only confirm that large-scale cortical reorganization of visual processing occurs in humans in response to retinal disease, but also relate this reorganization to functional changes in patient behavior.

Regional specificity and practice: dynamic changes in object and spatial working memory

Working memory (WM) tasks engage a network of brain regions that includes primary, unimodal, and multimodal associative cortices. Little is known, however, about whether task practice influences these types of regions differently. In this experiment, we used event-related fMRI to examine practice-related activation changes in different region types over the course of a scanning session while participants performed a delayed-recognition task. The task contained separate WM processing stages (encoding, maintenance, retrieval) and different materials (object, spatial), which allowed us to investigate the influence of practice on different component processes. We observed significant monotonic decreases, and not increases, in fMRI signal primarily in unimodal and multimodal regions. These decreases occurred during WM encoding and retrieval, but not during maintenance. Finally, regions specific to the type of memoranda (e.g., spatial or object) showed a lesser degree of sensitivity to practice as compared to regions activated by both types of memoranda, suggesting that these regions may be specialized more for carrying out processing within a particular modality than for experience-related flexibility. Overall, these findings indicate that task practice does not have a uniform effect on stages of WM processing, the type of WM memoranda being processed or on different types of brain regions. Instead, regions engaged during WM encoding and retrieval may have greater capacity for functional plasticity than WM maintenance. Additionally, the degree of specialization within brain regions may determine processing efficiency. Unimodal and multimodal regions that participate in both object and spatial processing may be specialized for flexible experience-related change, while those supporting primary sensorimotor processing may operate at optimal efficiency and are less susceptible to practice.

Selection and maintenance of stimulus-response rules during preparation and performance of a spatial choice-reaction task

The ability to select an appropriate response among competing alternatives is a fundamental requirement for successful performance of a variety of everyday tasks. Recent research suggests that a frontal-parietal network of brain regions (including dorsal prefrontal, dorsal premotor and superior parietal cortices) mediate response selection for spatial material. Most of this research has used blocked experimental designs. Thus, the frontal-parietal activity reported may be due either to tonic activity across a block or to processing occurring at the trial level. Our current event-related fMRI study investigated response selection at the level of the trial in order to identify possible response selection sub-processes. In the study, participants responded to a visually presented stimulus with either a spatially compatible or incompatible manual response. On some trials, several seconds prior to stimulus onset, a cue indicated which task was to be performed. In this way we could identify separate brain regions for task preparation and task performance, if they exist. Our results showed that the frontal-parietal network for spatial response selection activated both during task preparation as well as during task performance. We found no evidence for preparation specific brain mechanisms in this task. These data suggest that spatial response selection and response preparation processes rely on the same neurocognitive mechanisms.

The neural effect of stimulus-response modality compatibility on dual-task performance: an fMRI study

Recent fMRI studies suggest that the inferior frontal sulcus (IFS) is involved in the coordination of interfering processes in dual-task situations. The present study aims to further specify this assumption by investigating whether the compatibility between stimulus and response modalities modulates dual-task-related activity along the IFS. It has been shown behaviorally that the degree of interference, as measured by dual-task costs, increases in modality-incompatible conditions (e.g. visual-vocal tasks combined with auditory-manual tasks) as compared to modality-compatible conditions (e.g. visual-manual tasks combined with auditory-vocal tasks). Using fMRI, we measured IFS activity when participants performed modality-compatible and modality-incompatible single and dual tasks. Behaviorally, we replicated the finding of higher dual-task costs for modality-incompatible tasks compared to modality-compatible tasks. The fMRI data revealed higher activity along the IFS in modality-incompatible dual tasks compared with modality-compatible dual tasks when inter-individual variability in functional brain organization is taken into account. We argue that in addition to temporal order coordination (Szameitat et al., 2002), the IFS is involved in the coordination of cognitive processes associated with the concurrent mapping of sensory information onto corresponding motor responses in dual-task situations.

Sustained involvement of a frontal-parietal network for spatial response selection with practice of a spatial choice-reaction task

With practice, performance on a task typically becomes faster, more accurate, and less prone to interference from competing tasks. Some theories of this performance change suggest it reflects a qualitative reorganization of the cognitive processing required for successful task performance. Other theories suggest this change in performance reflects a more quantitative change in the amount of processing required to perform the task. Neuroimaging research results provide some support for both of these broad theories. This inconsistency may reflect the complex nature of the effect of practice on cognitive and neural processing. Our current experiment addresses this issue by investigating the effect of practice of a relatively easy perceptual-motor task on the frontal-parietal brain network for a specific cognitive process (viz. spatial response selection). Participants were scanned during three functional magnetic resonance imaging sessions on separate days within 4 days while they performed a relatively easy spatial perceptual-motor task. We found sustained activity with practice in right dorsal prefrontal cortex; and sustained but decreasing activity in bilateral dorsal premotor, left superior parietal, and precuneus cortices, supporting a quantitative decrease in difficulty of response selection with practice. Conversely, we found a qualitative change in activity with practice in left dorsal prefrontal cortex. This brain region is outside the response selection network for this task and showed activity only during novel task performance. These results suggest that practice produces both qualitative and quantitative changes in processing. The particular effect of practice depends on the cognitive process in question.

A functional MRI study of the influence of practice on component processes of working memory

Previous neuroimaging studies have shown that neural activity changes with task practice. The types of changes reported have been inconsistent, however, and the neural mechanisms involved remain unclear. In this study, we investigated the influence of practice on different component processes of working memory (WM) using a face WM task. Event-related functional magnetic resonance imaging (fMRI) methodology allowed us to examine signal changes from early to late in the scanning session within different task stages (i.e., encoding, delay, retrieval), as well as to determine the influence of different levels of WM load on neural activity. We found practice-related decreases in fMRI signal and effects of memory load occurring primarily during encoding. This suggests that practice improves encoding efficiency, especially at higher memory loads. The decreases in fMRI signal we observed were not accompanied by improved behavioral performance; in fact, error rate increased for high WM load trials, indicating that practice-related changes in activation may occur during a scanning session without behavioral evidence of learning. Our results suggest that practice influences particular component processes of WM differently, and that the efficiency of these processes may not be captured by performance measures alone.

Neural Evidence for Representation-Specific Response Selection

Response selection is the mental process of choosing representations for appropriate motor behaviors given particular environmental stimuli and one's current task situation and goals. Many cognitive theories of response selection postulate a unitary process. That is, one central response-selection mechanism chooses appropriate responses in most, if not all, task situations. However, neuroscience research shows that neural processing is often localized based on the type of information processed. Our current experiments investigate whether response selection is unitary or stimulus specific by manipulating response-selection difficulty in two functional magnetic resonance imaging experiments using spatial and nonspatial stimuli. The same participants were used in both experiments. We found spatial response selection involves the right prefrontal cortex, the bilateral premotor cortex, and the dorsal parietal cortical regions (precuneus and superior parietal lobule). Nonspatial response selection, conversely, involves the left prefrontal cortex and the more ventral posterior cortical regions (left middle temporal gyrus, left inferior parietal lobule, and right extrastriate cortex). Our brain activation data suggest a cognitive model for response selection in which different brain networks mediate the choice of appropriate responses for different types of stimuli. This model is consistent with behavioral research suggesting that responseselection processing may be more flexible and adaptive than originally proposed.

Neural implementation of response selection in humans as revealed by localized effects of stimulus-response compatibility on brain activation

Response selection, which involves choosing representations for appropriate motor behaviors given one's current situation, is a fundamental mental process central to a wide variety of human performance, yet the neural mechanisms underlying this mental process remain unclear. Research using nonhuman primates implicates ventral prefrontal and lateral premotor cortices in this process. In contrast, human neuroimaging research also highlights the role of dorsal prefrontal, anterior cingulate, and superior parietal cortices in response selection. This inconsistency may stem from the difficulty of isolating response selection within the constraints of cognitive subtraction methodology utilized in neuroimaging. We overcome this limitation by using an experimental procedure designed to selectively influence discrete mental processing stages and analyses that are less reliant on the assumptions of cognitive subtraction. We varied stimulus contrast to affect stimulus encoding and stimulus-response compatibility to affect response selection. Brain activation data suggest processing specific to response selection in superior parietal and dorsal prefrontal cortices, and not ventral prefrontal cortex. Anterior cingulate and lateral premotor cortices may also be involved in response selection, or these regions may mediate other response processes.

Virtually perfect time sharing in dual-task performance: uncorking the central cognitive bottleneck

A fundamental issue for psychological science concerns the extent to which people can simultaneously perform two perceptual-motor tasks. Some theorists have hypothesized that such dual-task performance is severely and persistently constrained by a central cognitive "bottle-neck," whereas others have hypothesized that skilled procedural decision making and response selection for two or more tasks can proceed at the same time under adaptive executive control. The three experiments reported here support this latter hypothesis. Their results show that after relatively modest amounts of practice, at least some participants achieve virtually perfect time sharing in the dual-task performance of basic choice reaction tasks. The results also show that observed interference between tasks can be modulated by instructions about differential task priorities and personal preferences for daring (concurrent) or cautious (successive) scheduling of tasks. Given this outcome, future research should investigate exactly when and how such sophisticated skills in dual-task performance are acquired.

Aging and the psychological refractory period: task-coordination strategies in young and old adults

The apparently deleterious effect of aging on dual-task performance is well established, but there is little agreement about the source of this effect. Studies of the psychological refractory period (PRP) indicate that young adults can flexibly control dual-task performance through task-coordination strategies. Thus, the performance of older adults might differ from young adults because older adults use different task-coordination strategies. To test this hypothesis, the executive-process interactive control (EPIC) architecture was applied to quantify the reaction time data from two PRP experiments conducted with young (age 18-26) and older (age 60-70) adults. The results show that participants' ability to coordinate the processing of two tasks did not decline with age. However, dual-task time costs were greater in the older adults. Three sources for this increase were found: generalized slowing, process-specific slowing, and the use of more cautious task-coordination strategies by the older adults.

Aging and the psychological refractory period: task-coordination strategies in young and old adults

The apparently deleterious effect of aging on dual-task performance is well established, but there is little agreement about the source of this effect. Studies of the psychological refractory period (PRP) indicate that young adults can flexibly control dual-task performance through task-coordination strategies. Thus, the performance of older adults might differ from young adults because older adults use different task-coordination strategies. To test this hypothesis, the executive-process interactive control (EPIC) architecture was applied to quantify the reaction time data from two PRP experiments conducted with young (age 18-26) and older (age 60-70) adults. The results show that participants' ability to coordinate the processing of two tasks did not decline with age. However, dual-task time costs were greater in the older adults. Three sources for this increase were found: generalized slowing, process-specific slowing, and the use of more cautious task-coordination strategies by the older adults.

The role of parietal cortex in verbal working memory

Neuroimaging studies of normal subjects and studies of patients with focal lesions implicate regions of parietal cortex in verbal working memory (VWM), yet the precise role of parietal cortex in VWM remains unclear. Some evidence (; ) suggests that the parietal cortex mediates the storage of verbal information, but these studies and most previous ones included encoding and retrieval processes as well as storage and rehearsal of verbal information. A recent positron emission tomography (PET) study by isolated storage and rehearsal from other VWM processes and did not find reliable activation in parietal cortex. This result suggests that parietal cortex may not be involved in VWM storage, contrary to previous proposals. However, we report two behavioral studies indicating that some of the verbal material used by may not have required phonological representations in VWM. In addition, we report a PET study that isolated VWM encoding, retrieval, and storage and rehearsal processes in different PET scans and used material likely to require phonological codes in VWM. After subtraction of appropriate controls, the encoding condition revealed no reliable activations; the retrieval condition revealed reliable activations in dorsolateral prefrontal, anterior cingulate, posterior parietal, and extrastriate cortices, and the storage condition revealed reliable activations in dorsolateral prefrontal, inferior frontal, premotor, and posterior parietal cortices, as well as cerebellum. These results suggest that parietal regions are part of a network of brain areas that mediate the short-term storage and retrieval of phonologically coded verbal material.

PET evidence for an amodal verbal working memory system

Current models of verbal working memory assume that modality-specific representations are translated into phonological representations before entering the working memory system. We report an experiment that tests this assumption. Positron emission tomography measures were taken while subjects performed a verbal working memory task. Stimuli were presented either visually or aurally, and a visual or auditory search tasks, respectively, was used as a control. Results revealed an almost complete overlap between the active memory areas regardless of input modality. These areas included dorsolateral frontal, Broca's area, SMA, and premotor cortex in the left hemisphere; bilateral superior and posterior parietal cortices and anterior cingulate; and right cerebellum. These results correspond well with previous research and suggest that verbal working memory is modality independent and is mediated by a circuit involving frontal, parietal, and cerebellar mechanisms.