The influence of memory load upon delay-interval activity in a working-memory task: an event-related functional MRI study

The impact of caregiver inhibitory control on infant visual working memory

Visual working memory (VWM) emerges in the first year of life and has far-reaching implications for academic and later life outcomes. Given that caregivers play a significant role in shaping cognitive function in children, it is important to understand how they might impact VWM development as early as infancy. The current study investigated whether caregivers' efficiency of regulating inhibitory control was associated with VWM function in their infants. Eighty-eight caregivers were presented with a Go-NoGo task to assess inhibitory control. An efficiency score was calculated using their behavioural responses. Eighty-six 6-to-10-month-old infants were presented with a preferential looking task to assess VWM function. VWM load was manipulated across one (low load), two (medium load) and three (high load) items. Functional near-infrared spectroscopy was used to record brain activation from caregivers and their infants. We found no direct association between caregiver efficiency and infant VWM behaviour. However, we found an indirect association - caregiver efficiency was linked to infant VWM through left-lateralized fronto-parietal engagement. Specifically, infants with low efficiency caregivers showed decreasing left-lateralized parietal engagement with increasing VWM performance at the medium and high loads compared to infants with high efficiency caregivers, who did not show any load- or performance-dependent modulation. Our findings contribute to a growing body of literature examining the role that caregivers play in early neurocognitive development.

Optimizing cognitive neuroscience experiments for separating event- related fMRI BOLD responses in non-randomized alternating designs

Functional magnetic resonance imaging (fMRI) has revolutionized human brain research. But there exists a fundamental mismatch between the rapid time course of neural events and the sluggish nature of the fMRI blood oxygen level-dependent (BOLD) signal, which presents special challenges for cognitive neuroscience research. This limitation in the temporal resolution of fMRI puts constraints on the information about brain function that can be obtained with fMRI and also presents methodological challenges. Most notably, when using fMRI to measure neural events occurring closely in time, the BOLD signals may temporally overlap one another. This overlap problem may be exacerbated in complex experimental paradigms (stimuli and tasks) that are designed to manipulate and isolate specific cognitive-neural processes involved in perception, cognition, and action. Optimization strategies to deconvolve overlapping BOLD signals have proven effective in providing separate estimates of BOLD signals from temporally overlapping brain activity, but there remains reduced efficacy of such approaches in many cases. For example, when stimulus events necessarily follow a non-random order, like in trial-by-trial cued attention or working memory paradigms. Our goal is to provide guidance to improve the efficiency with which the underlying responses evoked by one event type can be detected, estimated, and distinguished from other events in designs common in cognitive neuroscience research. We pursue this goal using simulations that model the nonlinear and transient properties of fMRI signals, and which use more realistic models of noise. Our simulations manipulated: (i) Inter-Stimulus-Interval (ISI), (ii) proportion of so-called null events, and (iii) nonlinearities in the BOLD signal due to both cognitive and design parameters. We offer a theoretical framework along with a python toolbox called deconvolve to provide guidance on the optimal design parameters that will be of particular utility when using non-random, alternating event sequences in experimental designs. In addition, though, we also highlight the challenges and limitations in simultaneously optimizing both detection and estimation efficiency of BOLD signals in these common, but complex, cognitive neuroscience designs.

Brain correlates of action word memory revealed by fMRI

Understanding language semantically related to actions activates the motor cortex. This activation is sensitive to semantic information such as the body part used to perform the action (e.g. arm-/leg-related action words). Additionally, motor movements of the hands/feet can have a causal effect on memory maintenance of action words, suggesting that the involvement of motor systems extends to working memory. This study examined brain correlates of verbal memory load for action-related words using event-related fMRI. Seventeen participants saw either four identical or four different words from the same category (arm-/leg-related action words) then performed a nonmatching-to-sample task. Results show that verbal memory maintenance in the high-load condition produced greater activation in left premotor and supplementary motor cortex, along with posterior-parietal areas, indicating that verbal memory circuits for action-related words include the cortical action system. Somatotopic memory load effects of arm- and leg-related words were observed, but only at more anterior cortical regions than was found in earlier studies employing passive reading tasks. These findings support a neurocomputational model of distributed action-perception circuits (APCs), according to which language understanding is manifest as full ignition of APCs, whereas working memory is realized as reverberant activity receding to multimodal prefrontal and lateral temporal areas.

Dimension of visual information interacts with working memory in monkeys and humans

Humans demonstrate behavioural advantages (biases) towards particular dimensions (colour or shape of visual objects), but such biases are significantly altered in neuropsychological disorders. Recent studies have shown that lesions in the prefrontal cortex do not abolish dimensional biases, and therefore suggest that such biases might not depend on top-down prefrontal-mediated attention and instead emerge as bottom-up processing advantages. We hypothesised that if dimensional biases merely emerge from an enhancement of object features, the presence of visual objects would be necessary for the manifestation of dimensional biases. In a specifically-designed working memory task, in which macaque monkeys and humans performed matching based on the object memory rather than the actual object, we found significant dimensional biases in both species, which appeared as a shorter response time and higher accuracy in the preferred dimension (colour and shape dimension in humans and monkeys, respectively). Moreover, the mnemonic demands of the task influenced the magnitude of dimensional bias. Our findings in two primate species indicate that the dichotomy of top-down and bottom-up processing does not fully explain the emergence of dimensional biases. Instead, dimensional biases may emerge when processed information regarding visual object features interact with mnemonic and executive functions to guide goal-directed behaviour.

The role of neural load effects in predicting individual differences in working memory function

Studies of working memory (WM) function have tended to adopt either a within-subject approach, focusing on effects of load manipulations, or a between-subjects approach, focusing on individual differences. This dichotomy extends to WM neuroimaging studies, with different neural correlates being identified for within- and between-subjects variation in WM. Here, we examined this issue in a systematic fashion, leveraging the large-sample Human Connectome Project dataset, to conduct a well-powered, whole-brain analysis of the N-back WM task. We first demonstrate the advantages of parcellation schemes for dimension reduction, in terms of load-related effect sizes. This parcel-based approach is then utilized to directly compare the relationship between load-related (within-subject) and behavioral individual differences (between-subject) effects through both correlational and predictive analyses. The results suggest a strong linkage of within-subject and between-subject variation, with larger load-effects linked to stronger brain-behavior correlations. In frontoparietal cortex no hemispheric biases were found towards one type of variation, but the Dorsal Attention Network did exhibit greater sensitivity to between over within-subjects variation, whereas in the Somatomotor network, the reverse pattern was observed. Cross-validated predictive modeling capitalizing on this tight relationship between the two effects indicated greater predictive power for load-activated than load-deactivated parcels, while also demonstrating that load-related effect size can serve as an effective guide to feature (i.e., parcel) selection, in maximizing predictive power while maintaining interpretability. Together, the findings demonstrate an important consistency across within- and between-subjects approaches to identifying the neural substrates of WM, which can be effectively harnessed to develop more powerful predictive models.

Face Processing in Developmental Prosopagnosia: Altered Neural Representations in the Fusiform Face Area

Rationale: Face expertise is a pivotal social skill. Developmental prosopagnosia (DP), i.e., the inability to recognize faces without a history of brain damage, affects about 2% of the general population, and is a renowned model system of the face-processing network. Within this network, the right Fusiform Face Area (FFA), is particularly involved in face identity processing and may therefore be a key element in DP. Neural representations within the FFA have been examined with Representational Similarity Analysis (RSA), a data-analytical framework in which multi-unit measures of brain activity are assessed with correlation analysis. Objectives: Our study intended to scrutinize modifications of FFA-activation during face encoding and maintenance based on RSA. Methods: Thirteen participants with DP (23-70 years) and 12 healthy control subjects (19-62 years) participated in a functional MRI study, including morphological MRI, a functional FFA-localizer and a modified Sternberg paradigm probing face memory encoding and maintenance. Memory maintenance of one, two, or four faces represented low, medium, and high memory load. We examined conventional activation differences in response to working memory load and applied RSA to compute individual correlation-matrices on the voxel level. Group correlation-matrices were compared via Donsker's random walk analysis. Results: On the functional level, increased memory load entailed both a higher absolute FFA-activation level and a higher degree of correlation between activated voxels. Both aspects were deficient in DP. Interestingly, control participants showed a homogeneous degree of correlation for successful trials during the experiment. In DP-participants, correlation levels between FFA-voxels were significantly lower and were less sustained during the experiment. In behavioral terms, DP-participants performed poorer and had longer reaction times in relation to DP-severity. Furthermore, correlation levels were negatively correlated with reaction times for the most demanding high load condition. Conclusion: We suggest that participants with DP fail to generate robust and maintained neural representations in the FFA during face encoding and maintenance, in line with poorer task performance and prolonged reaction times. In DP, alterations of neural coding in the FFA might therefore explain curtailing in working memory and contribute to impaired long-term memory and mental imagery.

Respiratory, cardiac, EEG, BOLD signals and functional connectivity over multiple microsleep episodes

Falling asleep is common in fMRI studies. By using long eyelid closures to detect microsleep onset, we showed that the onset and termination of short sleep episodes invokes a systematic sequence of BOLD signal changes that are large, widespread, and consistent across different microsleep durations. The signal changes are intimately intertwined with shifts in respiration and heart rate, indicating that autonomic contributions are integral to the brain physiology evaluated using fMRI and cannot be simply treated as nuisance signals. Additionally, resting state functional connectivity (RSFC) was altered in accord with the frequency of falling asleep and in a manner that global signal regression does not eliminate. Our findings point to the need to develop a consensus among neuroscientists using fMRI on how to deal with microsleep intrusions. SIGNIFICANCE STATEMENT: Sleep, breathing and cardiac action are influenced by common brainstem nuclei. We show that falling asleep and awakening are associated with a sequence of BOLD signal changes that are large, widespread and consistent across varied durations of sleep onset and awakening. These signal changes follow closely those associated with deceleration and acceleration of respiration and heart rate, calling into question the separation of the latter signals as 'noise' when the frequency of falling asleep, which is commonplace in RSFC studies, correlates with the extent of RSFC perturbation. Autonomic and central nervous system contributions to BOLD signal have to be jointly considered when interpreting fMRI and RSFC studies.

Home assessment of visual working memory in pre-schoolers reveals associations between behaviour, brain activation and parent reports of life stress

Visual working memory (VWM) is reliably predictive of fluid intelligence and academic achievements. The objective of the current study was to investigate individual differences in pre-schoolers' VWM processing by examining the association between behaviour, brain function and parent-reported measures related to the child's environment. We used a portable functional near-infrared spectroscopy system to record from the frontal and parietal cortices of 4.5-year-old children (N = 74) as they completed a colour change-detection VWM task in their homes. Parents were asked to fill in questionnaires on temperament, academic aspirations, home environment and life stress. Children were median-split into a low-performing (LP) and a high-performing (HP) group based on the number of items they could successfully remember during the task. LPs increasingly activated channels in the left frontal and bilateral parietal cortices with increasing load, whereas HPs showed no difference in activation. Our findings suggest that LPs recruited more neural resources than HPs when their VWM capacity was challenged. We employed mediation analyses to examine the association between the difference in activation between the highest and lowest loads and variables from the questionnaires. The difference in activation between loads in the left parietal cortex partially mediated the association between parent-reported stressful life events and VWM performance. Critically, our findings show that the association between VWM capacity, left parietal activation and indicators of life stress is important to understand the nature of individual differences in VWM in pre-school children.

The what, where and how of delay activity

Working memory is characterized by neural activity that persists during the retention interval of delay tasks. Despite the ubiquity of this delay activity across tasks, species and experimental techniques, our understanding of this phenomenon remains incomplete. Although initially there was a narrow focus on sustained activation in a small number of brain regions, methodological and analytical advances have allowed researchers to uncover previously unobserved forms of delay activity various parts of the brain. In light of these new findings, this Review reconsiders what delay activity is, where in the brain it is found, what roles it serves and how it may be generated.

Effects of High-Definition Transcranial Direct Current Stimulation and Theta Burst Stimulation for Modulating the Posterior Parietal Cortex

OBJECTIVES

Noninvasive brain stimulation methods, including high-definition transcranial direct current stimulation (HD-tDCS) and theta burst stimulation (TBS) have emerged as novel tools to modulate and explore brain function. However, the relative efficacy of these newer stimulation approaches for modulating cognitive functioning remains unclear. This study investigated the cognitive effects of HD-tDCS, intermittent TBS (iTBS) and prolonged continuous TBS (ProcTBS) and explored the potential of these approaches for modulating hypothesized functions of the left posterior parietal cortex (PPC).

METHODS

Twenty-two healthy volunteers attended four experimental sessions in a cross-over experimental design. In each session, participants either received HD-tDCS, iTBS, ProcTBS or sham, and completed cognitive tasks, including a divided attention task, a working memory maintenance task and an attention task (emotional Stroop test).

RESULTS

The results showed that compared to sham, HD-tDCS, iTBS and ProcTBS caused significantly faster response times on the emotional Stroop task. The effect size (Cohen's d) was d = .32 for iTBS (p < .001), .21 for ProcTBS (p = .01) and .15 for HD-tDCS (p = .044). However, for the performance on the divided attention and working memory maintenance tasks, no significant effect of stimulation was found.

CONCLUSIONS

The results suggest that repetitive transcranial magnetic stimulation techniques, including TBS, may have greater efficacy for modulating cognition compared with HD-tDCS, and extend existing knowledge about specific functions of the left PPC.

Dynamic adjustments in working memory in the face of affective interference

Cognitive control, which allows for the selection and monitoring of goal-relevant behavior, is dynamically upregulated on the basis of moment-to-moment cognitive demands. One route by which these demands are registered by cognitive control systems is via the detection of response conflict. Yet working memory (WM) demands may similarly signal dynamic adjustments in cognitive control. In a delayed-recognition WM task, Jha and Kiyonaga (Journal of Experimental Psychology: Learning, Memory, & Cognition, 36(4), 1036-1042, 2010) demonstrated dynamic adjustments in cognitive control via manipulations of mnemonic load and delay-spanning cognitive interference. In the present study, we aimed to extend prior work by investigating whether affective interference may similarly upregulate cognitive control. In Experiment 1, participants (N = 89) completed a delayed-recognition WM task in which mnemonic load (memory load of one vs. two items) and delay-spanning affective interference (neutral vs. negative distractors) were manipulated in a factorial design. Consistent with Jha and Kiyonaga, the present results revealed that mnemonic load led to dynamic adjustments in cognitive control, as reflected by greater performance on trials preceded by high than by low load. In addition, we observed that affective interference could trigger dynamic adjustments in cognitive control, as evinced by higher performance on trials preceded by negative than by neutral distractors. These findings were subsequently confirmed in Experiment 2, which was a pre-registered replication study (N = 100). Thus, these results suggest that in addition to dynamic adjustments as a function of mnemonic load, affective interference, similar to cognitive interference (Jha & Kiyonaga Journal of Experimental Psychology: Learning, Memory, & Cognition, 36(4), 1036-1042, 2010), may trigger dynamic adjustments in cognitive control during a WM task.

Dual cognitive pathways to voice quality: Frequent voicers improvise, infrequent voicers elaborate

We investigate the involvement of Working Memory Capacity (WMC, the cognitive resource necessary for controlled elaborate thinking) in voice behavior (speaking up with suggestions, problems, and opinions to change the organization). While scholars assume voice requires elaborate thinking, some empirical evidence suggests voice might be more automatic. To explain this discrepancy, we distinguish between voice quantity (frequency of voice) and voice quality (novelty and value of voiced information) and propose that WMC is important for voice quality, but less for voice quantity. Furthermore, we propose that frequent voicers rely less on WMC to reach high voice quality than people who voice rarely. To test our ideas, we conducted three studies: a between-participant lab-study, a within-participant experiment, and a multi-source field-study. All studies supported our expectation that voice quantity is unrelated to WMC, and that voice quality is positively related to WMC, but only for those who rarely voice. This indicates that the decision to voice (quantity) might be more automatic and intuitive than often assumed, whereas its value to the organization (quality), relies more on the degree of cognitive elaboration of the voicer. It also suggests that frequent and infrequent voicers use distinct cognitive pathways to voice high-quality information: frequent voicers improvise, while infrequent voicers elaborate.

Effects of High-Definition Transcranial Direct Current Stimulation (HD-tDCS) of the Intraparietal Sulcus and Dorsolateral Prefrontal Cortex on Working Memory and Divided Attention

Objective: There is a need to elucidate the underlying neural mechanisms subserving working memory and divided attention functioning. Recent neuroimaging studies provide evidence for anatomical co-localization of both functions. In the present study we used a functional intervention, whereby we applied a novel type of focalised, non-invasive brain stimulation, High-Definition transcranial Direct Current Stimulation (HD-tDCS), to the regions subserving these processes, the left intraparietal sulcus (IPS) and left dorsolateral prefrontal cortex (LDLPFC). Our aim was therefore to modulate activity in these regions using HD-tDCS and thereby assess their relevance for working memory, divided attention and their shared sub-processes. Method: 78 participants were evenly randomized to one of three conditions in a single blind, parallel group study design. Anodal or sham HD-tDCS was applied to either the left IPS or LDLPFC while participants completed a verbal working memory task, a divided attention task, and two tasks measuring subcomponents of working memory (updating and maintenance). Results: Focalised stimulation of the IPS and LDLPFC did not significantly modulate performance compared to sham stimulation. However, moderate effect sizes were obtained for at least one HD-tDCS condition relative to sham for all tasks, warranting further research into the functional importance of the IPS in subserving these abilities. Conclusions: The current results may be useful for informing future tDCS studies for modulating working memory and divided attention functioning.

Temporal Expectation Modulates the Cortical Dynamics of Short-Term Memory

Increased memory load is often signified by enhanced neural oscillatory power in the alpha range (8-13 Hz), which is taken to reflect inhibition of task-irrelevant brain regions. The corresponding neural correlates of memory decay, however, are not yet well understood. In the current study, we investigated auditory short-term memory decay in humans using a delayed matching-to-sample task with pure-tone sequences. First, in a behavioral experiment, we modeled memory performance over six different delay-phase durations. Second, in a MEG experiment, we assessed alpha-power modulations over three different delay-phase durations. In both experiments, the temporal expectation for the to-be-remembered sound was manipulated so that it was either temporally expected or not. In both studies, memory performance declined over time, but this decline was weaker when the onset time of the to-be-remembered sound was expected. Similarly, patterns of alpha power in and alpha-tuned connectivity between sensory cortices changed parametrically with delay duration (i.e., decrease in occipitoparietal regions, increase in temporal regions). Temporal expectation not only counteracted alpha-power decline in heteromodal brain areas (i.e., supramarginal gyrus), but also had a beneficial effect on memory decay, counteracting memory performance decline. Correspondingly, temporal expectation also boosted alpha connectivity within attention networks known to play an active role during memory maintenance. The present data show how patterns of alpha power orchestrate short-term memory decay and encourage a more nuanced perspective on alpha power across brain space and time beyond its inhibitory role.SIGNIFICANCE STATEMENT Our sensory memories of the physical world fade quickly. We show here that this decay of short-term memory can be counteracted by so-called temporal expectation; that is, knowledge of when to expect a sensory event that an individual must remember. We also show that neural oscillations in the "alpha" (8-13 Hz) range index both the degree of memory decay (for brief sound patterns) and the respective memory benefit from temporal expectation. Spatially distributed cortical patterns of alpha power show opposing effects in auditory versus visual sensory cortices. Moreover, alpha-tuned connectivity changes within supramodal attention networks reflect the allocation of neural resources as short-term memory representations fade.

Factor analysis of regional brain activation in bipolar and healthy individuals reveals a consistent modular structure

BACKGROUND

The neurophysiological substrates of cognition and emotion, as seen with fMRI, are generally explained using modular structures. The present study was designed to probe the modular structure of cognitive-emotional processing in bipolar and healthy individuals using factor analysis and compare the results with current conceptions of the neurophysiology of bipolar disorder.

METHODS

Exploratory factor analysis was used to assess patterns of covariation among brain regions-of-interest activated during the Continuous Performance Task with Emotional and Neutral Distractors in healthy and bipolar individuals without a priori constraints on the number or composition of latent factors.

RESULTS

Results indicated a common cognitive-emotional network consisting of prefrontal, medial temporal, limbic, parietal, anterior cingulate and posterior cingulate modules. However, reduced brain activation to emotional stimuli in the frontal, medial temporal and limbic modules was apparent in the bipolar relative to the healthy group, potentially accounting for emotional dysregulation in bipolar disorder.

LIMITATIONS

This study is limited by a relatively small sample size recruited at a single site. The results have yet to be validated on a larger independent sample.

CONCLUSIONS

Although the modular structure of cognitive-emotional processing is similar in bipolar and healthy individuals, activation in response to emotional/neutral cues varies. These findings are not only consistent with recent conceptions of mood regulation in bipolar disorder, but also suggest that regional activation can be considered within tighter modular structures without compromising data interpretation. This demonstration may serve as a template for data reduction in future region-of-interest analyses to increase statistical power.

Localized Fluctuant Oscillatory Activity by Working Memory Load: A Simultaneous EEG-fMRI Study

Working memory (WM) is a resource-limited memory system for temporary storage and processing of brain information during the execution of cognitive tasks. Increased WM load will increase the amount and difficulty of memory information. Several studies have used electroencephalography (EEG) or functional magnetic resonance imaging (fMRI) to explore load-dependent cognition processing according to the time courses of electrophysiological activity or the spatial pattern of blood oxygen metabolic activity. However, the relationships between these two activities and the underlying neural mechanism are still unclear. In this study, using simultaneously collected EEG and fMRI data under an n-back verbal WM task, we modeled the spectral perturbation of EEG oscillation and fMRI activation through joint independent component analysis (JICA). Multi-channel oscillation features were also introduced into the JICA model for further analysis. The results showed that time-locked activity of theta and beta were modulated by memory load in the early stimuli evaluation stage, corresponding to the enhanced activation in the frontal and parietal lobe, which were involved in stimulus discrimination, information encoding and delay-period activity. In the late response selection stage, alpha and gamma activity changes dependent on the load correspond to enhanced activation in the areas of frontal, temporal and parietal lobes, which played important roles in attention, information extraction and memory retention. These findings suggest that the increases in memory load not only affect the intensity and time course of the EEG activities, but also lead to the enhanced activation of brain regions which plays different roles during different time periods of cognitive process of WM.

Multi-Voxel Decoding and the Topography of Maintained Information During Visual Working Memory

The ability to maintain representations in the absence of external sensory stimulation, such as in working memory, is critical for guiding human behavior. Human functional brain imaging studies suggest that visual working memory can recruit a network of brain regions from visual to parietal to prefrontal cortex. In this review, we focus on the maintenance of representations during visual working memory and discuss factors determining the topography of those representations. In particular, we review recent studies employing multi-voxel pattern analysis (MVPA) that demonstrate decoding of the maintained content in visual cortex, providing support for a “sensory recruitment” model of visual working memory. However, there is some evidence that maintained content can also be decoded in areas outside of visual cortex, including parietal and frontal cortex. We suggest that the ability to maintain representations during working memory is a general property of cortex, not restricted to specific areas, and argue that it is important to consider the nature of the information that must be maintained. Such information-content is critically determined by the task and the recruitment of specific regions during visual working memory will be both task- and stimulus-dependent. Thus, the common finding of maintained information in visual, but not parietal or prefrontal, cortex may be more of a reflection of the need to maintain specific types of visual information and not of a privileged role of visual cortex in maintenance.

What works in auditory working memory? A neural oscillations perspective

Working memory is a limited resource: brains can only maintain small amounts of sensory input (memory load) over a brief period of time (memory decay). The dynamics of slow neural oscillations as recorded using magneto- and electroencephalography (M/EEG) provide a window into the neural mechanics of these limitations. Especially oscillations in the alpha range (8-13Hz) are a sensitive marker for memory load. Moreover, according to current models, the resultant working memory load is determined by the relative noise in the neural representation of maintained information. The auditory domain allows memory researchers to apply and test the concept of noise quite literally: Employing degraded stimulus acoustics increases memory load and, at the same time, allows assessing the cognitive resources required to process speech in noise in an ecologically valid and clinically relevant way. The present review first summarizes recent findings on neural oscillations, especially alpha power, and how they reflect memory load and memory decay in auditory working memory. The focus is specifically on memory load resulting from acoustic degradation. These findings are then contrasted with contextual factors that benefit neural as well as behavioral markers of memory performance, by reducing representational noise. We end on discussing the functional role of alpha power in auditory working memory and suggest extensions of the current methodological toolkit. This article is part of a Special Issue entitled SI: Auditory working memory.

Intracranial recordings reveal transient response dynamics during information maintenance in human cerebral cortex

Despite an extensive body of work, it is still not clear how short term maintenance of information is implemented in the human brain. Most prior research has focused on "working memory"-typically involving the storage of a number of items, requiring the use of a phonological loop and focused attention during the delay period between encoding and retrieval. These studies largely support a model of enhanced activity in the delay interval as the central mechanism underlying working memory. However, multi-item working memory constitutes only a subset of storage phenomena that may occur during daily life. A common task in naturalistic situations is short term memory of a single item-for example, blindly reaching to a previously placed cup of coffee. Little is known about such single-item, effortless, storage in the human brain. Here, we examined the dynamics of brain responses during a single-item maintenance task, using intracranial recordings implanted for clinical purpose in patients (ECoG). Our results reveal that active electrodes were dominated by transient short latency visual and motor responses, reflected in broadband high frequency power increases in occipito-temporal, frontal, and parietal cortex. Only a very small set of electrodes showed activity during the early part of the delay period. Interestingly, no cortical site displayed a significant activation lasting to the response time. These results suggest that single item encoding is characterized by transient high frequency ECoG responses, while the maintenance of information during the delay period may be mediated by mechanisms necessitating only low-levels of neuronal activations.

Neurofunctional effects of quetiapine in patients with bipolar mania

OBJECTIVES

Several lines of evidence suggest that abnormalities within portions of the extended limbic network involved in affective regulation and expression contribute to the neuropathophysiology of bipolar disorder. In particular, portions of the prefrontal cortex have been implicated in the appearance of manic symptomatology. The effect of atypical antipsychotics on activation of these regions, however, remains poorly understood.

METHODS

Twenty-two patients diagnosed with bipolar mania and 26 healthy subjects participated in a baseline functional magnetic resonance imaging scan during which they performed a continuous performance task with neutral and emotional distractors. Nineteen patients with bipolar disorder were treated for eight weeks with quetiapine monotherapy and then rescanned. Regional activity in response to emotional stimuli was compared between healthy and manic subjects at baseline; and in the subjects with bipolar disorder between baseline and eight-week scans.

RESULTS

At baseline, functional activity did not differ between subjects with bipolar disorder and healthy subjects in any region examined. After eight weeks of treatment, subjects with bipolar disorder showed a significant decrease in ratings on the Young Mania Rating Scale (YMRS) (p < 0.001), and increased activation in the right orbitofrontal cortex (OFC) (p = 0.002); there was a significant association between increased right OFC activity and YMRS improvement (p = 0.003).

CONCLUSIONS

These findings are consistent with suggestions that mania involves a loss of emotional modulatory activity in the prefrontal cortex--restoration of the relatively greater elevation in prefrontal activity widely observed in euthymic patients is associated with clinical improvement. It is not clear, however, whether changes are related to quetiapine treatment or represent a non-specific marker of affective change.

Different Roles of COMT and HTR2A Genotypes in Working Memory Subprocesses

Working memory is linked to the functions of the frontal areas, in which neural activity is mediated by dopaminergic and serotonergic tones. However, there is no consensus regarding how the dopaminergic and serotonergic systems influence working memory subprocesses. The present study used an imaging genetics approach to examine the interaction between neurochemical functions and working memory performance. We focused on functional polymorphisms of the catechol-O-methyltransferase (COMT) Val¹⁵⁸Met and serotonin 2A receptor (HTR2A) -1438G/A genes, and devised a delayed recognition task to isolate the encoding, retention, and retrieval processes for visual information. The COMT genotypes affected recognition accuracy, whereas the HTR2A genotypes were associated with recognition response times. Activations specifically related to working memory were found in the right frontal and parietal areas, such as the middle frontal gyrus (MFG), inferior frontal gyrus (IFG), anterior cingulate cortex (ACC), and inferior parietal lobule (IPL). MFG and ACC/IPL activations were sensitive to differences between the COMT genotypes and between the HTR2A genotypes, respectively. Structural equation modeling demonstrated that stronger connectivity in the ACC-MFG and ACC-IFG networks is related to better task performance. The behavioral and fMRI results suggest that the dopaminergic and serotonergic systems play different roles in the working memory subprocesses and modulate closer cooperation between lateral and medial frontal activations.

Dopaminergic modulation of distracter-resistance and prefrontal delay period signal

Dopamine has long been implicated in the online maintenance of information across short delays. Specifically, dopamine has been proposed to modulate the strength of working memory representations in the face of intervening distracters. This hypothesis has not been tested in humans. We fill this gap using pharmacological neuroimaging. Healthy young subjects were scanned after intake of the dopamine receptor agonist bromocriptine or placebo (in a within-subject, counterbalanced, and double-blind design). During scanning, subjects performed a delayed match-to-sample task with face stimuli. A face or scene distracter was presented during the delay period (between the cue and the probe). Bromocriptine altered distracter-resistance, such that it impaired performance after face relative to scene distraction. Individual differences in the drug effect on distracter-resistance correlated negatively with drug effects on delay period signal in the prefrontal cortex, as well as on functional connectivity between the prefrontal cortex and the fusiform face area. These results provide evidence for the hypothesis that dopaminergic modulation of the prefrontal cortex alters resistance of working memory representations to distraction. Moreover, we show that the effects of dopamine on the distracter-resistance of these representations are accompanied by modulation of the functional strength of connections between the prefrontal cortex and stimulus-specific posterior cortex.

A Working Memory Buffer in Parahippocampal Regions: Evidence from a Load Effect during the Delay Period

Computational models have proposed that the entorhinal cortex (EC) is well suited for maintaining multiple items in working memory (WM). Evidence from animal recording and human neuroimaging studies show that medial temporal lobe areas including the perirhinal (PrC), EC, and CA1 hippocampal subfield may contribute to active maintenance during WM. Previous neuroimaging work also suggests CA1 may be recruited transiently when encoding novel information, and EC and CA1 may be involved in maintaining multiple items in WM. In this study, we tested the prediction that a putative WM buffer would demonstrate a load-dependent effect during a WM delay. Using high-resolution fMRI, we examined whether activity within the hippocampus (CA3/DG, CA1, and subiculum) and surrounding medial temporal cortices (PrC, EC, and parahippocampal cortex-PHC) is modulated in a load-dependent manner. We employed a delayed matching-to-sample task with novel scenes at 2 different WM loads. A contrast between high- and low-WM load showed greater activity within CA1 and subiculum during the encoding phase, and greater EC, PrC, and PHC activity during WM maintenance. These results are consistent with computational models and suggest that EC/PrC and PHC act as a WM buffer by actively maintaining novel information in a capacity-dependent manner.

The effect of rehearsal rate and memory load on verbal working memory

While many neuroimaging studies have investigated verbal working memory (WM) by manipulating memory load, the subvocal rehearsal rate at these various memory loads has generally been left uncontrolled. Therefore, the goal of this study was to investigate how mnemonic load and the rate of subvocal rehearsal modulate patterns of activity in the core neural circuits underlying verbal working memory. Using fMRI in healthy subjects, we orthogonally manipulated subvocal rehearsal rate and memory load in a verbal WM task with long 45-s delay periods. We found that middle frontal gyrus (MFG) and superior parietal lobule (SPL) exhibited memory load effects primarily early in the delay period and did not exhibit rehearsal rate effects. In contrast, we found that inferior frontal gyrus (IFG), premotor cortex (PM) and Sylvian-parietal-temporal region (area Spt) exhibited approximately linear memory load and rehearsal rate effects, with rehearsal rate effects lasting through the entire delay period. These results indicate that IFG, PM and area Spt comprise the core articulatory rehearsal areas involved in verbal WM, while MFG and SPL are recruited in a general supervisory role once a memory load threshold in the core rehearsal network has been exceeded.

Evidence for working memory storage operations in perceptual cortex

Isolating the short-term storage component of working memory (WM) from the myriad of associated executive processes has been an enduring challenge. Recent efforts have identified patterns of activity in visual regions that contain information about items being held in WM. However, it remains unclear (1) whether these representations withstand intervening sensory input and (2) how communication between multimodal association cortex and the unimodal perceptual regions supporting WM representations is involved in WM storage. We present evidence that the features of a face held in WM are stored within face-processing regions, that these representations persist across subsequent sensory input, and that information about the match between sensory input and a memory representation is relayed forward from perceptual to prefrontal regions. Participants were presented with a series of probe faces and indicated whether each probe matched a target face held in WM. We parametrically varied the feature similarity between the probe and target faces. Activity within face-processing regions scaled linearly with the degree of feature similarity between the probe face and the features of the target face, suggesting that the features of the target face were stored in these regions. Furthermore, directed connectivity measures revealed that the direction of information flow that was optimal for performance was from sensory regions that stored the features of the target face to dorsal prefrontal regions, supporting the notion that sensory input is compared to representations stored within perceptual regions and is subsequently relayed forward. Together, these findings indicate that WM storage operations are carried out within perceptual cortex.

The role of the precuneus in metaphor comprehension: evidence from an fMRI study in people with schizophrenia and healthy participants

Comprehension of conventional and novel metaphors involves traditional language-related cortical regions as well as non-language related regions. While semantic processing is crucial for understanding metaphors, it is not sufficient. Recently the precuneus has been identified as a region that mediates complex and highly integrated tasks, including retrieval of episodic memory and mental imagery. Although the understanding of non-literal language is relatively easy for healthy individuals, people with schizophrenia exhibit deficits in this domain. The present study aims to examine whether people with schizophrenia differentially recruit the precuneus, extending to the superior parietal (SP) cortex (SPL), to support their deficit in metaphor comprehension. We also examine interregional associations between the precuneus/SPL and language-related brain regions. Twelve people with schizophrenia and twelve healthy controls were scanned while silently reading literal word pairs, conventional metaphors, and novel metaphors. People with schizophrenia showed reduced comprehension of both conventional and novel metaphors. Analysis of functional connectivity found that the correlations between activation in the left precuneus/SPL and activation in the left posterior superior temporal sulcus (PSTS) were significant for both literal word pairs and novel metaphors, and significant correlations were found between activation in the right precuneus/SPL and activation in the right PSTS for the three types of semantic relations. These results were found in the schizophrenia group alone. Furthermore, relative to controls, people with schizophrenia demonstrated increased activation in the right precuneus/SPL. Our results may suggest that individuals with schizophrenia use mental imagery to support comprehension of both literal and metaphoric language. In particular, our findings indicate over-integration of language and non-language brain regions during more effortful processes of novel metaphor comprehension.

Distributed and dynamic storage of working memory stimulus information in extrastriate cortex

The predominant neurobiological model of working memory (WM) posits that stimulus information is stored via stable, elevated activity within highly selective neurons. On the basis of this model, which we refer to as the canonical model, the storage of stimulus information is largely associated with lateral PFC (lPFC). A growing number of studies describe results that cannot be fully explained by the canonical model, suggesting that it is in need of revision. In this study, we directly tested key elements of the canonical model. We analyzed fMRI data collected as participants performed a task requiring WM for faces and scenes. Multivariate decoding procedures identified patterns of activity containing information about the items maintained in WM (faces, scenes, or both). Although information about WM items was identified in extrastriate visual cortex (EC) and lPFC, only EC exhibited a pattern of results consistent with a sensory representation. Information in both regions persisted even in the absence of elevated activity, suggesting that elevated population activity may not represent the storage of information in WM. Additionally, we observed that WM information was distributed across EC neural populations that exhibited a broad range of selectivity for the WM items rather than restricted to highly selective EC populations. Finally, we determined that activity patterns coding for WM information were not stable, but instead varied over the course of a trial, indicating that the neural code for WM information is dynamic rather than static. Together, these findings challenge the canonical model of WM.

Sleep deprivation accelerates delay-related loss of visual short-term memories without affecting precision

STUDY OBJECTIVES

Visual short-term memory (VSTM) is an important measure of information processing capacity and supports many higher-order cognitive processes. We examined how sleep deprivation (SD) and maintenance duration interact to influence the number and precision of items in VSTM using an experimental design that limits the contribution of lapses at encoding.

DESIGN

For each trial, participants attempted to maintain the location and color of three stimuli over a delay. After a retention interval of either 1 or 10 seconds, participants reported the color of the item at the cued location by selecting it on a color wheel. The probability of reporting the probed item, the precision of report, and the probability of reporting a nonprobed item were determined using a mixture-modeling analysis. Participants were studied twice in counterbalanced order, once after a night of normal sleep and once following a night of sleep deprivation.

SETTING

Sleep laboratory.

PARTICIPANTS

Nineteen healthy college age volunteers (seven females) with regular sleep patterns.

INTERVENTIONS

Approximately 24 hours of total SD.

MEASUREMENTS AND RESULTS

SD selectively reduced the number of integrated representations that can be retrieved after a delay, while leaving the precision of object information in the stored representations intact. Delay interacted with SD to lower the rate of successful recall.

CONCLUSIONS

Visual short-term memory is compromised during sleep deprivation, an effect compounded by delay. However, when memories are retrieved, they tend to be intact.

A balancing act of the brain: activations and deactivations driven by cognitive load

The majority of neuroimaging studies focus on brain activity during performance of cognitive tasks; however, some studies focus on brain areas that activate in the absence of a task. Despite the surge of research comparing these contrasted areas of brain function, their interrelation is not well understood. We systematically manipulated cognitive load in a working memory task to examine concurrently the relation between activity elicited by the task versus activity during control conditions. We presented adults with six levels of task demand, and compared those with three conditions without a task. Using whole-brain analysis, we found positive linear relations between cortical activity and task difficulty in areas including middle frontal gyrus and dorsal cingulate; negative linear relations were found in medial frontal gyrus and posterior cingulate. These findings demonstrated balancing of activation patterns between two mental processes, which were both modulated by task difficulty. Frontal areas followed a graded pattern more closely than other regions. These data also showed that working memory has limited capacity in adults: an upper bound of seven items and a lower bound of four items. Overall, working memory and default-mode processes, when studied concurrently, reveal mutually competing activation patterns.

Multi-voxel pattern analysis of selective representation of visual working memory in ventral temporal and occipital regions

While previous results from univariate analysis showed that the activity level of the parahippocampal gyrus (PHG) but not the fusiform gyrus (FG) reflects selective maintenance of the cued picture category, present results from multi-voxel pattern analysis (MVPA) showed that the spatial response patterns of both regions can be used to differentiate the selected picture category in working memory. The ventral temporal and occipital areas including the PHG and FG have been shown to be specialized in perceiving and processing different kinds of visual information, though their role in the representation of visual working memory remains unclear. To test whether the PHG and FG show spatial response patterns that reflect selective maintenance of task-relevant visual working memory in comparison with other posterior association regions, we reanalyzed data from a previous fMRI study of visual working memory with a cue inserted during the delay period of a delayed recognition task. Classification of FG and PHG activation patterns for the selected category (face or scene) during the cue phase was well above chance using classifiers trained with fMRI data from the cue or probe phase. Classification of activity in other temporal and occipital regions for the cued picture category during the cue phase was relatively less consistent even though classification of their activity during the probe recognition was comparable with the FG and PHG. In sum, these findings suggest that the FG and PHG carry information relevant to the cued visual category, and their spatial activation patterns during selective maintenance seem to match those during visual recognition.

Anticipatory activity in rat medial prefrontal cortex during a working memory task

OBJECTIVE

Working memory is a key cognitive function in which the prefrontal cortex plays a crucial role. This study aimed to show the firing patterns of a neuronal population in the prefrontal cortex of the rat in a working memory task and to explore how a neuronal ensemble encodes a working memory event.

METHODS

Sprague-Dawley rats were trained in a Y-maze until they reached an 80% correct rate in a working memory task. Then a 16-channel microelectrode array was implanted in the prefrontal cortex. After recovery, neuronal population activity was recorded during the task, using the Cerebus data-acquisition system. Spatio-temporal trains of action potentials were obtained from the original neuronal population signals.

RESULTS

During the Y-maze working memory task, some neurons showed significantly increased firing rates and evident neuronal ensemble activity. Moreover, the anticipatory activity was associated with the delayed alternate choice of the upcoming movement. In correct trials, the averaged pre-event firing rate (10.86 ± 1.82 spikes/bin) was higher than the post-event rate (8.17 ± 1.15 spikes/bin) (P<0.05). However, in incorrect trials, the rates did not differ.

CONCLUSION

The results indicate that the anticipatory activity of a neuronal ensemble in the prefrontal cortex may play a role in encoding working memory events.

The relationship between working memory storage and elevated activity as measured with functional magnetic resonance imaging

Does the sustained, elevated neural activity observed during working memory tasks reflect the short-term retention of information? Functional magnetic resonance imaging (fMRI) data of delayed recognition of visual motion in human participants were analyzed with two methods: a general linear model (GLM) and multivoxel pattern analysis. Although the GLM identified sustained, elevated delay-period activity in superior and lateral frontal cortex and in intraparietal sulcus, pattern classifiers were unable to recover trial-specific stimulus information from these delay-active regions. The converse-no sustained, elevated delay-period activity but successful classification of trial-specific stimulus information-was true of posterior visual regions, including area MT+ (which contains both middle temporal area and medial superior temporal area) and calcarine and pericalcarine cortex. In contrast to stimulus information, pattern classifiers were able to extract trial-specific task instruction-related information from frontal and parietal areas showing elevated delay-period activity. Thus, the elevated delay-period activity that is measured with fMRI may reflect processes other than the storage, per se, of trial-specific stimulus information. It may be that the short-term storage of stimulus information is represented in patterns of (statistically) "subthreshold" activity distributed across regions of low-level sensory cortex that univariate methods cannot detect.

Curvilinear relationship between phonological working memory load and social-emotional modulation

Accumulating evidence suggests that working memory load is an important factor for the interplay between cognitive and facial-affective processing. However, it is unclear how distraction caused by perception of faces interacts with load-related performance. We developed a modified version of the delayed match-to-sample task wherein task-irrelevant facial distracters were presented early in the rehearsal of pseudoword memoranda that varied incrementally in load size (1-syllable, 2-syllables, or 3-syllables). Facial distracters displayed happy, sad, or neutral expressions in Experiment 1 (N=60) and happy, fearful, or neutral expressions in Experiment 2 (N=29). Facial distracters significantly disrupted task performance in the intermediate load condition (2-syllable) but not in the low or high load conditions (1- and 3-syllables, respectively), an interaction replicated and generalised in Experiment 2. All facial distracters disrupted working memory in the intermediate load condition irrespective of valence, suggesting a primary and general effect of distraction caused by faces. However, sad and fearful faces tended to be less disruptive than happy faces, suggesting a secondary and specific valence effect. Working memory appears to be most vulnerable to social-emotional information at intermediate loads. At low loads, spare capacity is capable of accommodating the combinatorial load (1-syllable plus facial distracter), whereas high loads maximised capacity and deprived facial stimuli from occupying working memory slots to cause disruption.

Functional MRI of sustained attention in bipolar mania

We examined sustained attention deficits in bipolar disorder and associated changes in brain activation assessed by functional magnetic resonance imaging (fMRI). We hypothesized that relative to healthy participants, those with mania or mixed mania would (1) exhibit incremental decrements in sustained attention over time, (2) overactivate brain regions required for emotional processing and (3) progressively underactivate attentional regions of prefrontal cortex. Fifty participants with manic/mixed bipolar disorder (BP group) and 34 healthy comparison subjects (HC group) received an fMRI scan while performing a 15-min continuous performance task (CPT). The data were divided into three consecutive 5-min vigilance periods to analyze sustained attention. Composite brain activation maps indicated that both groups activated dorsal and ventral regions of an anterior-limbic network, but the BP group exhibited less activation over time relative to baseline. Consistent with hypotheses 1 and 2, the BP group showed a marginally greater behavioral CPT sustained attention decrement and more bilateral amygdala activation than the HC group, respectively. Instead of differential activation in prefrontal cortex over time, as predicted in hypothesis 3, the BP group progressively decreased activation in subcortical regions of striatum and thalamus relative to the HC group. These results suggest that regional activation decrements in dorsolateral prefrontal cortex accompany sustained attention decrements in both bipolar and healthy individuals. Stable amygdala overactivation across prolonged vigils may interfere with sustained attention and exacerbate attentional deficits in bipolar disorder. Differential striatal and thalamic deactivation in bipolar disorder is interpreted as a loss of amygdala (emotional brain) modulation by the ventrolateral prefrontal-subcortical circuit, which interferes with attentional maintenance.

Working Memory Benefits Creative Insight, Musical Improvisation, and Original Ideation Through Maintained Task-Focused Attention

Anecdotes from creative eminences suggest that executive control plays an important role in creativity, but scientific evidence is sparse. Invoking the Dual Pathway to Creativity Model, the authors hypothesize that working memory capacity (WMC) relates to creative performance because it enables persistent, focused, and systematic combining of elements and possibilities (persistence). Study 1 indeed showed that under cognitive load, participants performed worse on a creative insight task. Study 2 revealed positive associations between time-on-task and creativity among individuals high but not low in WMC, even after controlling for general intelligence. Study 3 revealed that across trials, semiprofessional cellists performed increasingly more creative improvisations when they had high rather than low WMC. Study 4 showed that WMC predicts original ideation because it allows persistent (rather than flexible) processing. The authors conclude that WMC benefits creativity because it enables the individual to maintain attention focused on the task and prevents undesirable mind wandering.

The contribution of working memory to divided attention

Previous studies have indicated that increasing working memory (WM) load can affect the attentional selection of signals originating from one object/location. Here we assessed whether WM load affects also the selection of multiple objects/locations (divided attention). Participants monitored either two object-categories (vs. one category; object-based divided attention) or two locations (vs. one location; space-based divided attention) while maintaining in WM either a variable number of objects (object-based WM load) or locations (space-based WM load). Behavioural results showed that WM load affected attentional performance irrespective of divided or focused attention. However, fMRI results showed that the activity associated with object-based divided attention increased linearly with increasing object-based WM load in the left and right intraparietal sulcus (IPS); while, in the same areas, activity associated with space-based divided attention was not affected by any type of WM load. These findings support the hypothesis that WM contributes to the maintenance of resource-demanding attentional sets in a domain-specific manner. Moreover, the dissociable impact of WM load on performance and brain activity suggests that increased IPS activation reflects a recruitment of additional, domain-specific processing resources that enable dual-task performance under conditions of high WM load and high attentional demand.

The influence of emotional distraction on verbal working memory: an fMRI investigation comparing individuals with schizophrenia and healthy adults

The ability to maintain information over short periods of time (i.e., working memory) is critically important in a variety of cognitive functions including language, planning, and decision-making. Recent functional Magnetic Resonance Imaging (fMRI) research with healthy adults has shown that brain activations evoked during the delay interval of working memory tasks can be reduced by the presentation of distracting emotional events, suggesting that emotional events may take working-memory processes momentarily offline. Both executive function and emotional processing are disrupted in schizophrenia, and here we sought to elucidate the effect of emotional distraction upon brain activity in schizophrenic and healthy adults performing a verbal working memory task. During the delay period between the memoranda and memory probe items, emotional and neutral distractors differentially influenced brain activity in these groups. In healthy adults, the hemodynamic response from posterior cingulate, orbital frontal cortex, and the parietal lobe strongly differentiated emotional from neutral distractors. In striking contrast, schizophrenic adults showed no significant differences in brain activation when processing emotional and neutral distractors. Moreover, the influence of emotional distractors extended into the memory probe period in healthy, but not schizophrenic, adults. The results suggest that although emotional items are highly salient for healthy adults, emotional items are no more distracting than neutral ones to individuals with schizophrenia.

Functional magnetic resonance imaging brain activation in bipolar mania: evidence for disruption of the ventrolateral prefrontal-amygdala emotional pathway

BACKGROUND

Bipolar I disorder is defined by the occurrence of mania. The presence of mania, coupled with a course of illness characterized by waxing and waning of affective symptoms, suggests that bipolar disorder arises from dysfunction of neural systems that maintain emotional arousal and homeostasis. We used functional magnetic resonance imaging (fMRI) to study manic bipolar subjects as they performed a cognitive task designed to examine the ventrolateral prefrontal emotional arousal network.

METHODS

We used fMRI to study regional brain activation in 40 DSM-IV manic bipolar I patients and 36 healthy subjects while they performed a continuous performance task with emotional and neutral distracters. Event-related region-of-interest analyses were performed to test the primary hypothesis. Voxelwise analyses were also completed.

RESULTS

Compared with healthy subjects, the manic subjects exhibited blunted activation to emotional and neutral images, but not targets, across most of the predefined regions of interest. Several additional brain regions identified in the voxelwise analysis also exhibited similar differences between groups, including right parahippocampus, right lingual gyrus, and medial thalamus. In addition to these primary findings, the manic subjects also exhibited increased activation in response to targets in a number of brain regions that were primarily associated with managing affective stimuli. Group differences did not appear to be secondary to medication exposure or other confounds.

CONCLUSIONS

Bipolar manic subjects exhibit blunted brain fMRI response to emotional cues throughout the ventrolateral prefrontal emotional arousal network. Disruption of this emotional network may contribute to the mood dysregulation of bipolar disorder.

Encoding/retrieval dissociation in working memory for human body forms

The present study was conducted to investigate the effect of working memory (WM) load on body processing mechanisms by using event-related potentials (ERPs). It is well known that WM load modulates the P3b (amplitude decreases as WM load increases). Additionally, WM load for faces modulates earlier ERPs like the N170. The present study aimed to investigate the effect of WM load for bodies on the P3b which is associated with WM. Additionally, we explored the effect of WM load on the N170, which is thought to be associated with configural processing, and P1, which has been observed in body as well as in face processing. Effects were analyzed during the encoding and retrieval phases. WM load was modulated by presenting one to four unfamiliar bodies simultaneously for memory encoding. The present study showed that early encoding processes (reflected by the P1 and N170) might not be modulated by WM load, whereas during the retrieval phase, early processes associated with structural encoding (N170) were affected by WM load. A possible explanation of the encoding/retrieval differences might be that subjects used distinct processing strategies in both phases. Parallel encoding of the simultaneously presented bodies might play an important role during the encoding phase where one to four bodies have to be stored, whereas serial matching might be used to compare the probe with the stored pictures during the retrieval phase. Additionally, WM load modulations were observed in later processing steps, which might be associated with stimulus identification and matching processes (reflected by the early P3b) during the encoding but not during the retrieval phase. The current findings further showed for both the encoding and the retrieval phase that the late P3b amplitude decreased as WM load for body images increased indicating that the late P3b is involved in WM processes which do not appear to be category-specific.

Working memory load modulates the auditory "What" and "Where" neural networks

Working memory for sound identity (What) and sound location (Where) has been associated with increased neural activity in ventral and dorsal brain regions, respectively. To further ascertain this domain specificity, we measured fMRI signals during an n-back (n=1, 2) working memory task for sound identity or location, where stimuli selected randomly from three semantic categories (human, animal, and music) were presented at three possible virtual locations. Accuracy and reaction times were comparable in both "What" and "Where" tasks, albeit worse for the 2-back than for the 1-back condition. The analysis of fMRI data revealed greater activity in ventral and dorsal brain regions during sound identity and sound location, respectively. More importantly, there was an interaction between task and working memory load in the inferior parietal lobule (IPL). Within the right IPL, there were two sub-regions modulated differentially by working memory load: an anterior ventromedial region modulated by location load and a posterior dorsolateral region modulated by category load. These specific changes in neural activity as a function of working memory load reveal domain-specificity within the parietal cortex.

Retention of identity versus expression of emotional faces differs in the recruitment of limbic areas

Faces are multidimensional stimuli that convey information for complex social and emotional functions. Separate neural systems have been implicated in the recognition of facial identity (mainly extrastriate visual cortex) and emotional expression (limbic areas and the superior temporal sulcus). Working-memory (WM) studies with faces have shown different but partly overlapping activation patterns in comparison to spatial WM in parietal and prefrontal areas. However, little is known about the neural representations of the different facial dimensions during WM. In the present study 22 subjects performed a face-identity or face-emotion WM task at different load levels during functional magnetic resonance imaging. We found a fronto-parietal-visual WM-network for both tasks during maintenance, including fusiform gyrus. Limbic areas in the amygdala and parahippocampal gyrus demonstrated a stronger activation for the identity than the emotion condition. One explanation for this finding is that the repetitive presentation of faces with different identities but the same emotional expression during the identity-task is responsible for the stronger increase in BOLD signal in the amygdala. These results raise the question how different emotional expressions are coded in WM. Our findings suggest that emotional expressions are re-coded in an abstract representation that is supported at the neural level by the canonical fronto-parietal WM network.

Specific and nonspecific neural activity during selective processing of visual representations in working memory

In this fMRI study, we investigated prefrontal cortex (PFC) and visual association regions during selective information processing. We recorded behavioral responses and neural activity during a delayed recognition task with a cue presented during the delay period. A specific cue ("Face" or "Scene") was used to indicate which one of the two initially viewed pictures of a face and a scene would be tested at the end of a trial, whereas a nonspecific cue ("Both") was used as control. As expected, the specific cues facilitated behavioral performance (faster response times) compared to the nonspecific cue. A postexperiment memory test showed that the items cued to remember were better recognized than those not cued. The fMRI results showed largely overlapped activations across the three cue conditions in dorsolateral and ventrolateral PFC, dorsomedial PFC, posterior parietal cortex, ventral occipito-temporal cortex, dorsal striatum, and pulvinar nucleus. Among those regions, dorsomedial PFC and inferior occipital gyrus remained active during the entire postcue delay period. Differential activity was mainly found in the association cortices. In particular, the parahippocampal area and posterior superior parietal lobe showed significantly enhanced activity during the postcue period of the scene condition relative to the Face and Both conditions. No regions showed differentially greater responses to the face cue. Our findings suggest that a better representation of visual information in working memory may depend on enhancing the more specialized visual association areas or their interaction with PFC.