Object and spatial visual working memory activate separate neural systems in human cortex

The cerebral representation of space: insights from functional imaging data

Functional imaging techniques, such as positron emission tomography and functional magnetic resonance imaging, present a unique opportunity to examine, in humans, the cerebral representation of space in vivo. Space is ubiquitous and not a unitary phenomenon, and the brain uses visual, vestibular and proprioceptive inputs to produce multiple representations of space subserving spatial cognition, ranging from gaze control to remembering multiple complex large-scale environments. Functional imaging studies have shown the importance of the parietal cortex in perceptual, motor, attention and working memory aspects of body-centred human spatial cognition. Functional imaging has also revealed pathways in humans homologous to those found in monkeys for the separate processing of spatial location and object identity. There are further suggestions of similar differentiation in working memory. The importance of the medial temporal region in the recall of spatial location has been confirmed also and novel virtual reality paradigms are now providing insights into the cerebral representation of spatially-extended large-scale environments. We still have much to learn about the cerebral representation of space in the human brain and functional brain imaging, in concert with patient studies and animal models, will allow us to continue investigating.

Localised face processing by the human prefrontal cortex: stimulation-evoked hallucinations of faces

Left and right prefrontal, premotor, and anterior temporal sites were stereotaxically implanted in order to direct surgical therapy for epilepsy. Direct electrical stimulation of the right anterior inferior frontal gyrus resulted in face-related hallucinations and illusions. When the patient was viewing a blank background, stimulation induced the experience of a rapid succession of faces. When the patient was viewing a real face, stimulation induced a series of modifications to that face. Effective stimulations induced afterdischarges that remained localised to right ventrolateral prefrontal cortex (VLPFC). Stimulation of other frontal and anterior temporal sites, bilaterally, induced no face-related hallucinations or illusions. This result supports a contribution of right VLPFC to face processing, and is consistent with models wherein it activates representations in working or declarative memories.

Effective visual working memory capacity: an emergent effect from the neural dynamics in an attractor network

The study of working memory capacity is of outmost importance in cognitive psychology as working memory is at the basis of general cognitive function. Although the working memory capacity limit has been thoroughly studied, its origin still remains a matter of strong debate. Only recently has the role of visual saliency in modulating working memory storage capacity been assessed experimentally and proved to provide valuable insights into working memory function. In the computational arena, attractor networks have successfully accounted for psychophysical and neurophysiological data in numerous working memory tasks given their ability to produce a sustained elevated firing rate during a delay period. Here we investigate the mechanisms underlying working memory capacity by means of a biophysically-realistic attractor network with spiking neurons while accounting for two recent experimental observations: 1) the presence of a visually salient item reduces the number of items that can be held in working memory, and 2) visually salient items are commonly kept in memory at the cost of not keeping as many non-salient items.

Our model suggests that working memory capacity is determined by two fundamental processes: encoding of visual items into working memory and maintenance of the encoded items upon their removal from the visual display. While maintenance critically depends on the constraints that lateral inhibition imposes to the mnemonic activity, encoding is limited by the ability of the stimulated neural assemblies to reach a sufficiently high level of excitation, a process governed by the dynamics of competition and cooperation among neuronal pools. Encoding is therefore contingent upon the visual working memory task and has led us to introduce the concept of effective working memory capacity (eWMC) in contrast to the maximal upper capacity limit only reached under ideal conditions.

Development of orthogonal task designs in fMRI studies of higher cognition: the NIMH experience

This paper chronicles one researcher's journey at the National Institute of Mental Health, exploring ways to understand the neural systems responsible for the cognitive sub-processes of working memory tasks. Both the opportunities and the pitfalls with applying the idea of cognitive subtraction to neuroimaging data were well-known from studies using positron emission tomography. We took advantage of the improved temporal resolution of fMRI with a delayed-recognition task and identified the time-courses of the different stages of the task (encoding, memory delay, and recognition test) as predictor variables in a multiple regression analysis. Because these signals were temporally independent, individual components of tasks could be contrasted with one another, rather than entire tasks, reducing the problem of violations of pure insertion in cognitive subtraction. This approach enabled us to draw more detailed conclusions about the neural systems of higher cognition and the organization of prefrontal cortex than had been possible before fMRI. Further enhancements and innovations over the last 20 years by a multitude of researchers across the field have greatly expanded this knowledge, but this approach called "orthogonal task design" has remained a fundamental component of many of these modern studies.

Rostrolateral prefrontal cortex: domain-general or domain-sensitive?

The ability to jointly consider several structured mental representations, or relations, is fundamental to human cognition. Prior studies have consistently linked this capacity for relational integration to rostrolateral prefrontal cortex (RLPFC). Here, we sought to test two competing hypotheses: (1) RLPFC processes relations in a domain-general manner, interacting with different brain regions as a function of the type of lower-level relations that must be integrated; or (2) A dorsal-ventral gradient exists within RLPFC, such that relational integration in the visuospatial domain involves relatively more dorsal RLPFC than integration in the semantic domain. To this end, we examined patterns of fMRI activation and functional connectivity during performance of visuospatial and semantic variants of a relational matching task. Across the two task variants, the regions that were most strongly engaged during relational comparison were left RLPFC and left intraparietal sulcus (IPS). Within left RLPFC, there was considerable overlap in activation for the semantic and visuospatial tasks. However, visuospatial task activation peaks were located dorsally to the semantic task peaks. In addition, RLPFC exhibited differential functional connectivity on the two tasks, interacting with different brain regions as a function of the type of relations being compared. While neurons throughout RLPFC may share the function of integrating diverse inputs, individual RLPFC neurons may have privileged access to particular representations depending on their anatomical inputs, organized along a dorsal-ventral gradient. Thus, RLPFC is well-positioned as a locus of abstraction from concrete, domain-specific details to the general principles and rules that enable higher-level cognition.

Hemispheric Differences within the Fronto-Parietal Network Dynamics Underlying Spatial Imagery

Spatial imagery refers to the inspection and evaluation of spatial features (e.g., distance, relative position, configuration) and/or the spatial manipulation (e.g., rotation, shifting, reorienting) of mentally generated visual images. In the past few decades, psychophysical as well as functional brain imaging studies have indicated that any such processing of spatially coded information and/or manipulation based on mental images (i) is subject to similar behavioral demands and limitations as in the case of spatial processing based on real visual images, and (ii) consistently activates several nodes of widely distributed cortical networks in the brain. These nodes include areas within both, the dorsal fronto-parietal as well as ventral occipito-temporal visual processing pathway, representing the “what” versus “where” aspects of spatial imagery. We here describe evidence from functional brain imaging and brain interference studies indicating systematic hemispheric differences within the dorsal fronto-parietal networks during the execution of spatial imagery. Importantly, such hemispheric differences and functional lateralization principles are also found in the effective brain network connectivity within and across these networks, with a direction of information flow from anterior frontal/premotor regions to posterior parietal cortices. In an attempt to integrate these findings of hemispheric lateralization and fronto-to-parietal interactions, we argue that spatial imagery constitutes a multifaceted cognitive construct that can be segregated in several distinct mental sub processes, each associated with activity within specific lateralized fronto-parietal (sub) networks, forming the basis of the here proposed dynamic network model of spatial imagery.

Comparison of spatial working memory in children with prenatal alcohol exposure and those diagnosed with ADHD; A functional magnetic resonance imaging study

Background

Alcohol related neurodevelopmental disorder (ARND) falls under the umbrella of fetal alcohol spectrum disorder (FASD), but individuals do not demonstrate the facial characteristics associated with fetal alcohol syndrome (FAS), making diagnosis difficult. While attentional problems in ARND are similar to those found in attention-deficit/hyperactivity disorder (ADHD), the underlying impairment in attention pathways may be different.

Methods

Functional magnetic resonance imaging (fMRI) of a working memory (1-back) task of 63 children, 10 to 14 years old, diagnosed with ARND and ADHD, as well as typically developing (TD) controls, was conducted at 3 T. Diffusion tensor imaging (DTI) data were also acquired.

Results

Activations were observed in posterior parietal and occipital regions in the TD group and in dorsolateral prefrontal and posterior parietal regions in the ARND group, whereas the ADHD group activated only dorsolateral prefrontal regions, during the working memory component of the task (1-back minus 0-back contrast). The increases in frontal and parietal activity were significantly greater in the ARND group compared to the other groups. This increased activity was associated with reduced accuracy and increased response time variability, suggesting that ARND subjects exert greater effort to manage short-term memory load. Significantly greater intra-subject variability, demonstrated by fMRI region-of-interest analysis, in the ADHD and ARND groups compared to the TD group suggests that moment-to-moment lapses in attention contributed to their poorer task performance. Differences in functional activity in ARND subjects with and without a diagnosis of ADHD resulted primarily from reduced activation by the ARND/ADHD + group during the 0-back task. In contrast, children with ADHD alone clearly showed reduced activations during the 1-back task. DTI analysis revealed that the TD group had significantly higher total tract volume and number of fibers than the ARND group. These measures were negatively correlated with errors on the 1-back task, suggesting a link between white matter integrity and task performance.

Conclusions

fMRI activations suggest that the similar behavior of children with ARND and ADHD on a spatial working memory task is the result of different cognitive events. The nature of ADHD in children with ARND appears to differ from that of children with ADHD alone.

Delay- and dose-dependent effects of Δ⁹-tetrahydrocannabinol administration on spatial and object working memory tasks in adolescent rhesus monkeys

Among adolescents, the perception that cannabis can cause harm has decreased and use has increased. However, in rodents, cannabinoid administration during adolescence induces working memory (WM) deficits that are more severe than if the same exposure occurs during adulthood. As both object and spatial WM mature in a protracted manner, although apparently along different trajectories, adolescent cannabis users may be more susceptible to impairments in one type of WM. Here, we evaluate the acute effects of a range of doses (30-240 μg/kg) of intravenous Δ⁹-tetrahydrocannabinol (THC) administration on the performance of spatial and object WM tasks in adolescent rhesus monkeys. Accuracy on the object WM task was not significantly affected by any dose of THC. In contrast, THC administration impaired accuracy on the spatial WM task in a delay- and dose-dependent manner. Importantly, the THC-induced spatial WM deficits were not because of motor or motivational impairments. These data support the idea that immature cognitive functions are more sensitive to the acute effects of THC.

Space representation in the prefrontal cortex

The representation of space and its function in the prefrontal cortex have been examined using a variety of behavioral tasks. Among them, since the delayed-response task requires the temporary maintenance of spatial information, this task has been used to examine the mechanisms of spatial representation. In addition, the concept of working memory to explain prefrontal functions has helped us to understand the nature and functions of space representation in the prefrontal cortex. The detailed analysis of delay-period activity observed in spatial working memory tasks has provided important information for understanding space representation in the prefrontal cortex. Directional delay-period activity has been shown to be a neural correlate of the mechanism for temporarily maintaining information and represent spatial information for the visual cue and the saccade. In addition, many task-related prefrontal neurons exhibit spatially selective activities. These neurons are also important components of spatial information processing. In fact, information flow from sensory-related neurons to motor-related neurons has been demonstrated, along with a change in spatial representation as the trial progresses. The dynamic functional interactions among neurons exhibiting different task-related activities and representing different aspects of information could play an essential role in information processing. In addition, information provided from other cortical or subcortical areas might also be necessary for the representation of space in the prefrontal cortex. To better understand the representation of space and its function in the prefrontal cortex, we need to understand the nature of functional interactions between the prefrontal cortex and other cortical and subcortical areas.

Frontal and parietal theta burst TMS impairs working memory for visual-spatial conjunctions

In tasks that selectively probe visual or spatial working memory (WM) frontal and posterior cortical areas show a segregation, with dorsal areas preferentially involved in spatial (e.g. location) WM and ventral areas in visual (e.g. object identity) WM. In a previous fMRI study [1], we showed that right parietal cortex (PC) was more active during WM for orientation, whereas left inferior frontal gyrus (IFG) was more active during colour WM. During WM for colour-orientation conjunctions, activity in these areas was intermediate to the level of activity for the single task preferred and non-preferred information. To examine whether these specialised areas play a critical role in coordinating visual and spatial WM to perform a conjunction task, we used theta burst transcranial magnetic stimulation (TMS) to induce a functional deficit. Compared to sham stimulation, TMS to right PC or left IFG selectively impaired WM for conjunctions but not single features. This is consistent with findings from visual search paradigms, in which frontal and parietal TMS selectively affects search for conjunctions compared to single features, and with combined TMS and functional imaging work suggesting that parietal and frontal regions are functionally coupled in tasks requiring integration of visual and spatial information. Our results thus elucidate mechanisms by which the brain coordinates spatially segregated processing streams and have implications beyond the field of working memory.

Selective spatial processing deficits in an at-risk subgroup of the fragile X premutation

Until a decade ago, it was assumed that males with the fragile X premutation were unaffected by any cognitive phenotype. Here we examined the extent to which CGG repeat toxicity extends to visuospatial functioning in male fragile X premutation carriers who are asymptomatic for a late-onset neurodegenerative disorder, fragile X-associated tremor/ataxia syndrome (FXTAS). Thirty-three premutation males aged 20-68 years [divided into two groups: 16 low-repeat carriers (CGG ≥ 55 ≤ 100) and 17 high-repeat carriers (CGG>100)] with a family history of fragile X syndrome and 62 non-affected adult males with normal FMR1 alleles were recruited. Subjects underwent neuropsychological tests of visuospatial and visual working memory functioning and visuoperceptual processing. On measures of visuospatial processing, the high-repeat carriers performed significantly worse than the normal allele group when age and IQ were covaried out. With increasing age and only in carriers of a larger (>100 repeats) premutation allele was there a greater decrement in visuospatial working memory functioning. Performance on spatial and perceptual judgement tasks failed to show similar specificity in males within the upper premutation range. We conclude that identification of selective visuospatial impairments in carriers of a larger premutation allele indicates greater CGG repeat toxicity in specific neural regions. Longitudinal follow-up studies will be needed to determine whether subtle decline in visuospatial functioning is associated with the later onset of motor symptoms of FXTAS.

Monitoring the mind: the neurocognitive correlates of metamemory

Memory performance in everyday life is often far from perfect and therefore needs to be monitored and controlled by metamemory evaluations, such as judgments of learning (JOLs). JOLs support monitoring for goal-directed modification of learning. Behavioral studies suggested retrieval processes as providing a basis for JOLs. Previous functional imaging research on JOLs found a dissociation between processes underlying memory prediction, located in the medial prefrontal cortex (mPFC), and actual encoding success, located in the medial temporal lobe. However, JOL-specific neural correlates could not be identified unequivocally, since JOLs were given simultaneously with encoding. Here, we aimed to identify the neurocognitive basis of JOLs, i.e., the cognitive processes and neural correlates of JOL, separate from initial encoding. Using functional magnetic resonance imaging (fMRI), we implemented a face-name paired associative design. In general, we found that actual memory success was associated with increased brain activation of the hippocampi bilaterally, whereas predicted memory success was accompanied by increased activation in mPFC, orbital frontal and anterior cingulate cortices. Masking brain activation during predicted memory success with activation during retrieval success revealed BOLD increases of the mPFC. Our findings indicate that JOLs actually incorporate retrieval processes.

Eye and Hand Movements during Reconstruction of Spatial Memory

Recent behavioural and biological evidence indicates common mechanisms serving working memory and attention (eg Awh et al, 2006 Neuroscience139 201–208). This study explored the role of spatial attention and visual search in an adapted Corsi spatial memory task. Eye movements and touch responses were recorded from participants who recalled locations (signalled by colour or shape change) from an array presented either simultaneously or sequentially. The time delay between target presentation and recall (0,5, or 10 s) and the number of locations to be remembered (2–5) were also manipulated. Analysis of the response phase revealed subjects were less accurate (touch data) and fixated longer (eye data) when responding to sequentially presented targets suggesting higher cognitive effort. Fixation duration on target at recall was also influenced by whether spatial location was initially signalled by colour or shape change. Finally, we found that the sequence tasks encouraged longer fixations on the signalled targets than simultaneous viewing during encoding, but no difference was observed during recall. We conclude that the attentional manipulations (colour/shape) mainly affected the eye movement parameters, whereas the memory manipulation (sequential versus simultaneous, number of items) mainly affected the performance of the hand during recall, and thus the latter is more important for ascertaining if an item is remembered or forgotten. In summary, the nature of the stimuli that is used and how it is presented play key roles in determining subject performance and behaviour during spatial memory tasks.

Working memory, long-term memory, and medial temporal lobe function

Early studies of memory-impaired patients with medial temporal lobe (MTL) damage led to the view that the hippocampus and related MTL structures are involved in the formation of long-term memory and that immediate memory and working memory are independent of these structures. This traditional idea has recently been revisited. Impaired performance in patients with MTL lesions on tasks with short retention intervals, or no retention interval, and neuroimaging findings with similar tasks have been interpreted to mean that the MTL is sometimes needed for working memory and possibly even for visual perception itself. We present a reappraisal of this interpretation. Our main conclusion is that, if the material to be learned exceeds working memory capacity, if the material is difficult to rehearse, or if attention is diverted, performance depends on long-term memory even when the retention interval is brief. This fundamental notion is better captured by the terms subspan memory and supraspan memory than by the terms short-term memory and long-term memory. We propose methods for determining when performance on short-delay tasks must depend on long-term (supraspan) memory and suggest that MTL lesions impair performance only when immediate memory and working memory are insufficient to support performance. In neuroimaging studies, MTL activity during encoding is influenced by the memory load and correlates positively with long-term retention of the material that was presented. The most parsimonious and consistent interpretation of all the data is that subspan memoranda are supported by immediate memory and working memory and are independent of the MTL.

Reduced prefrontal oxygenation during object and spatial visual working memory in unpolar and bipolar depression

Altered prefrontal brain activity (e.g. hypofrontality) during cognitive tasks such as working memory is a core neuroimaging marker in unipolar (UNI) and bipolar (BI) depression. The present study investigated for the first time UNI (n=16) and BI patients (n=14) in a working memory task including different processes (storage and matching) and components (object and spatial visual) with functional near-infrared spectroscopy (fNIRS) over the prefrontal cortex. In healthy controls (n=15) comparable to both patient groups, changes of oxygenated and deoxygenated haemoglobin indicated increased ventro-lateral, dorso-lateral prefrontal and superior frontal cortex activity for object and spatial visual working memory storage as compared to the control condition. In contrast, both patient groups showed diminished brain activity in all working memory conditions. Results revealed unspecific deficits that did not allow the differentiation between unipolar and bipolar depression in dependence of working memory processes or components. However, fNIRS can be considered as a valid, easy manageable, low cost and rapid tool for measuring (diminished) prefrontal cortex functions.

The Neurotopography of Written Word Production: An fMRI Investigation of the Distribution of Sensitivity to Length and Frequency

This research is directed at charting the neurotopography of the component processes of the spelling system by using fMRI to identify the neural substrates that are sensitive to the factors of lexical frequency and word length. In spelling, word frequency effects index orthographic long-term memory whereas length effects, as measured by the number of letters, index orthographic working memory (grapheme buffering). Using the task of spelling to dictation in the scanner, we found a highly differentiated neural distribution of sensitivity to the factors of length and lexical frequency, with areas exhibiting sensitivity to length but not frequency and vice versa. In addition, a direct comparison with the results of a previous study [Rapp, B., & Lipka, K. The literate brain: The relationship between spelling and reading. Journal of Cognitive Neuroscience, 23, 1180–1197, 2011] that used a very different spelling task yielded a converging pattern of findings regarding the neural substrates of the central components of spelling. Also, with regard to relationship between reading and spelling, we replicated previous functional neuroimaging studies that have shown overlapping regions of activation in the left posterior inferior frontal gyrus and midfusiform gyrus for word reading and spelling.

The contribution of working memory to divided attention

Previous studies have indicated that increasing working memory (WM) load can affect the attentional selection of signals originating from one object/location. Here we assessed whether WM load affects also the selection of multiple objects/locations (divided attention). Participants monitored either two object-categories (vs. one category; object-based divided attention) or two locations (vs. one location; space-based divided attention) while maintaining in WM either a variable number of objects (object-based WM load) or locations (space-based WM load). Behavioural results showed that WM load affected attentional performance irrespective of divided or focused attention. However, fMRI results showed that the activity associated with object-based divided attention increased linearly with increasing object-based WM load in the left and right intraparietal sulcus (IPS); while, in the same areas, activity associated with space-based divided attention was not affected by any type of WM load. These findings support the hypothesis that WM contributes to the maintenance of resource-demanding attentional sets in a domain-specific manner. Moreover, the dissociable impact of WM load on performance and brain activity suggests that increased IPS activation reflects a recruitment of additional, domain-specific processing resources that enable dual-task performance under conditions of high WM load and high attentional demand.

WITHDRAWN: fMRI correlates of visual working memory: What vs. where

This article has been withdrawn at the request of the authors. The Publisher apologizes for any inconvenience this may cause. The full Elsevier Policy on Article Withdrawal can be found at http://www.elsevier.com/locate/withdrawalpolicy. This article has been withdrawn at the request of the editor. The Publisher apologizes for any inconvenience this may cause. The full Elsevier Policy on Article Withdrawal can be found at http://www.elsevier.com/locate/withdrawalpolicy.

The other face of the other-race effect: an fMRI investigation of the other-race face categorization advantage

The present study was the first to use the functional magnetic resonance imaging (fMRI) methodology to investigate the neural correlates of race categorization of own- and other-race faces. We found that Chinese participants categorized the race of Caucasian faces more accurately and faster than that of Chinese faces, replicating the robust effect of the other-race categorization advantage. Regions of interest (ROI) analyses revealed greater neural activations when participants were categorizing own-race faces than other-race faces in the bilateral ventral occipito-temporal cortex (VOT) such as the fusiform face areas (FFAs) and the occipital face areas (OFAs). Within the left FFA, there was also a significant negative correlation between the behavioral difference of own- and other-race face categorization accuracy and the activation difference between categorizing own- and other-race faces. Whole brain analyses showed that categorizing own-race faces induced greater activations in the right medial frontal cortex (MFC) and right inferior frontal gyrus (IFG) than categorizing other-race faces. Psychophysiological interaction (PPI) analyses revealed that the frontal cortical regions interacted more strongly with the posterior VOT during the categorization of own-race faces than that of other-race faces. Overall, our findings suggest that relative to the categorization of other-race faces, more cortical resources are engaged during the categorization of own-race faces with which we have a higher level of processing expertise. This increased involvement of cortical neural sources perhaps serves to provide more in-depth processing of own-race faces (such as individuation), which in turn paradoxically results in the behavioral other-race categorization advantage.

Competition in working memory reduces frontal guidance of visual selection

Working memory (WM) representations can bias visual selection to matching stimuli in the field. WM biases can, however, be modulated by the level of cognitive load, with WM guidance reduced as memory load increases. Here, we used functional magnetic resonance imaging to distinguish between competing hypotheses for the reduction of WM guidance under load: 1) poor neural representations of memory contents under high load, 2) strategic control at high loads to direct attention away from search distracters matching the WM content, and 3) reduction of frontal top-down biasing of visual areas with increasing memory loads. We show that matching between WM contents and the visual display appeared to be well represented in visual areas under high memory loads, despite a lack of WM guidance at the behavioral level. There was little engagement of "cognitive control" areas in the prefrontal cortex during search at high loads. More importantly, WM guidance at low loads engaged a set of frontal regions in the superior and inferior ventral frontal cortex. Functional connectivity analyses revealed frontal regions working in concert with occipital areas at low memory loads, but this coupling was disrupted by increased memory load. We discuss the implications for understanding the mechanisms supporting the interplay between WM and attention.

Simple composition: a magnetoencephalography investigation into the comprehension of minimal linguistic phrases

The expressive power of language lies in its ability to construct an infinite array of ideas out of a finite set of pieces. Surprisingly, few neurolinguistic investigations probe the basic processes that constitute the foundation of this ability, choosing instead to focus on relatively complex combinatorial operations. Contrastingly, in the present work, we investigate the neural circuits underlying simple linguistic composition, such as required by the minimal phrase "red boat." Using magnetoencephalography, we examined activity in humans generated at the visual presentation of target nouns, such as "boat," and varied the combinatorial operations induced by its surrounding context. Nouns in minimal compositional contexts ("red boat") were compared with those appearing in matched non-compositional contexts, such as after an unpronounceable consonant string ("xkq boat") or within a list ("cup, boat"). Source analysis did not implicate traditional language areas (inferior frontal gyrus, posterior temporal regions) in such basic composition. Instead, we found increased combinatorial-related activity in the left anterior temporal lobe (LATL) and ventromedial prefrontal cortex (vmPFC). These regions have been linked previously to syntactic (LATL) and semantic (vmPFC) combinatorial processing in more complex linguistic contexts. Thus, we suggest that these regions play a role in basic syntactic and semantic composition, respectively. Importantly, the temporal ordering of the effects, in which LATL activity (∼225 ms) precedes vmPFC activity (∼400 ms), is consistent with many processing models that posit syntactic composition before semantic composition during the construction of linguistic representations.

Cortical mechanisms for trans-saccadic memory and integration of multiple object features

Constructing an internal representation of the world from successive visual fixations, i.e. separated by saccadic eye movements, is known as trans-saccadic perception. Research on trans-saccadic perception (TSP) has been traditionally aimed at resolving the problems of memory capacity and visual integration across saccades. In this paper, we review this literature on TSP with a focus on research showing that egocentric measures of the saccadic eye movement can be used to integrate simple object features across saccades, and that the memory capacity for items retained across saccades, like visual working memory, is restricted to about three to four items. We also review recent transcranial magnetic stimulation experiments which suggest that the right parietal eye field and frontal eye fields play a key functional role in spatial updating of objects in TSP. We conclude by speculating on possible cortical mechanisms for governing egocentric spatial updating of multiple objects in TSP.

Individual working memory capacity is uniquely correlated with feature-based attention when combined with spatial attention

A growing literature suggests that working memory and attention are closely related constructs. Both involve the selection of task-relevant information, and both are characterized by capacity limits. Furthermore, studies using a variety of methodological approaches have demonstrated convergent working memory and attention-related processing at the individual, neural and behavioral level. Given the varieties of both constructs, the specific kinds of attention and WM must be considered. We find that individuals' working memory capacity (WMC) uniquely interacts with feature-based attention when combined with spatial attention in a cuing paradigm (Posner, 1980). Our findings suggest a positive correlation between WM and feature-based attention only within the spotlight of spatial attention. This finding lends support to the controlled attention view of working memory by demonstrating that integrated feature-based expectancies are uniquely correlated with individual performance on a working memory task.

Different roles of lateral anterior temporal lobe and inferior parietal lobule in coding function and manipulation tool knowledge: evidence from an rTMS study

A remarkable cognitive ability in humans is the competency to use a wide variety of different tools. Two cortical regions, the anterior temporal lobes (ATL) and left inferior parietal lobule (IPL), have been proposed to make differential contributions to two kinds of knowledge about tools - function vs. manipulation. We used repetitive transcranial magnetic stimulation (rTMS) and two semantic decision tasks to assess the role of these regions in healthy participants. Participants made semantic decisions about the function (what for) or manipulation (how) of tools used in daily life. The stimulation of ATL resulted in longer responses for the "function" judgments, whilst stimulation of IPL yielded longer responses for the "manipulation" judgments. In line with the neuropsychological literature, these results are discussed within hub-and-spoke framework of semantic memory.

fMRI correlates of working memory: specific posterior representation sites for motion and position information

We assume that working memory is provided by a network comprising domain-general anterior and different domain-specific posterior brain areas depending on the type of stimulus and the task demands. Based on imaging studies from perception, we hypothesized that dynamic spatial (motion) and static spatial (position) information can be dissociated during retention in working memory. Participants were presented with a moving dot. About one second after stimulus presentation, a cue indicated whether its motion or end position should be held in memory. Six seconds later, a second stimulus was shown which was to be compared with the first one with respect to identity on the cued dimension. In the baseline condition, the cue indicated that no memory task would follow. We contrasted activity during maintenance of the different features. Differential activations in regions related to motion perception (area hMT/V5+, superior temporal sulcus) were observed in the motion working memory task. For position working memory, enhanced activations in a right brain region at the temporo-parieto-occipital junction emerged. The results are discussed with respect to domain-specific regions active in perception and how they can be also involved in short term retention for those very features. It is suggested that two types of spatial information categories can be dissociated: dynamic spatial (motion) and static spatial (position) information seem to be processed by different working memory structures.

Prefrontal cortex activity during the discrimination of relative distance

To compare with our previous findings on relative-duration discrimination, we studied prefrontal cortex activity as monkeys performed a relative-distance discrimination task. We wanted to know whether the same parts of the prefrontal cortex compare durations and distances and, if so, whether they use similar mechanisms. Two stimuli appeared sequentially on a video screen, one above a fixed reference point, the other below it by a different distance. After a delay period, the same two stimuli reappeared (as choice stimuli), and the monkeys' task was to choose the one that had appeared farther from the reference point during its initial presentation. We recorded from neurons in the dorsolateral prefrontal cortex (area 46) and the caudal prefrontal cortex (area 8). Although some prefrontal neurons encoded the absolute distance of a stimulus from the reference point, many more encoded relative distance. Categorical representations ("farther") predominated over parametric ones ("how much farther"). Relative-distance coding was most often abstract, coding the farther or closer stimulus to the same degree, independent of its position on the screen. During the delay period before the choice stimuli appeared, feature-based coding supplanted order-based coding, and position-based coding-always rare-decreased to chance levels. The present results closely resembled those for a duration-discrimination task in the same cortical areas. We conclude, therefore, that these areas contribute to decisions based on both spatial and temporal information.

Cognitive and metacognitive activity in mathematical problem solving: prefrontal and parietal patterns

Students were taught an algorithm for solving a new class of mathematical problems. Occasionally in the sequence of problems, they encountered exception problems that required that they extend the algorithm. Regular and exception problems were associated with different patterns of brain activation. Some regions showed a Cognitive pattern of being active only until the problem was solved and no difference between regular or exception problems. Other regions showed a Metacognitive pattern of greater activity for exception problems and activity that extended into the post-solution period, particularly when an error was made. The Cognitive regions included some of parietal and prefrontal regions associated with the triple-code theory of (Dehaene, S., Piazza, M., Pinel, P., & Cohen, L. (2003). Three parietal circuits for number processing. Cognitive Neuropsychology, 20, 487-506) and associated with algebra equation solving in the ACT-R theory (Anderson, J. R. (2005). Human symbol manipulation within an 911 integrated cognitive architecture. Cognitive science, 29, 313-342. Metacognitive regions included the superior prefrontal gyrus, the angular gyrus of the triple-code theory, and frontopolar regions.

Cross-modal interactions during perception of audiovisual speech and nonspeech signals: an fMRI study

During speech communication, visual information may interact with the auditory system at various processing stages. Most noteworthy, recent magnetoencephalography (MEG) data provided first evidence for early and preattentive phonetic/phonological encoding of the visual data stream--prior to its fusion with auditory phonological features [Hertrich, I., Mathiak, K., Lutzenberger, W., & Ackermann, H. Time course of early audiovisual interactions during speech and non-speech central-auditory processing: An MEG study. Journal of Cognitive Neuroscience, 21, 259-274, 2009]. Using functional magnetic resonance imaging, the present follow-up study aims to further elucidate the topographic distribution of visual-phonological operations and audiovisual (AV) interactions during speech perception. Ambiguous acoustic syllables--disambiguated to /pa/ or /ta/ by the visual channel (speaking face)--served as test materials, concomitant with various control conditions (nonspeech AV signals, visual-only and acoustic-only speech, and nonspeech stimuli). (i) Visual speech yielded an AV-subadditive activation of primary auditory cortex and the anterior superior temporal gyrus (STG), whereas the posterior STG responded both to speech and nonspeech motion. (ii) The inferior frontal and the fusiform gyrus of the right hemisphere showed a strong phonetic/phonological impact (differential effects of visual /pa/ vs. /ta/) upon hemodynamic activation during presentation of speaking faces. Taken together with the previous MEG data, these results point at a dual-pathway model of visual speech information processing: On the one hand, access to the auditory system via the anterior supratemporal “what" path may give rise to direct activation of "auditory objects." On the other hand, visual speech information seems to be represented in a right-hemisphere visual working memory, providing a potential basis for later interactions with auditory information such as the McGurk effect.

The role of working memory in supporting drivers' situation awareness for surrounding traffic

OBJECTIVE

To link working memory to driver situational awareness (SA) for surrounding traffic.

BACKGROUND

Operating a motor vehicle is a complex activity that requires drivers to maintain a high level of SA. Working memory has been conceptually linked to SA; however, the roles of working memory subsystems in supporting driver SA is unclear.

METHOD

Participants drove a simulated vehicle and monitored surrounding traffic while concurrently performing either visuospatial- or phonological-load tasks. Drivers' SA was indexed as the ability to recall the positions of the surrounding traffic relative to their own vehicle at the end of each trial.

RESULTS

In Experiment I, a visuospatial task interfered with drivers' ability to recall the positions of traffic located in front of their vehicle. In contrast, a phonological task interfered with drivers' ability to recall the positions of traffic located behind their vehicle. Experiment 2 confirmed and extended the findings of Experiment I with the use of different visuospatial- and phonological-load tasks.

CONCLUSION

Visuospatial and phonological codes play a role in supporting driver SA for traffic located in the forward view and the rear view, respectively.

APPLICATION

Drivers' SA for surrounding vehicles is disrupted by concurrent performance on secondary tasks. The development and implementation of new in-cabin communication, navigation, and informational technologies needs to be done with the knowledge that components of drivers' working memory capacity may be exceeded, thereby compromising driving safety.

A link between visual disambiguation and visual memory

Sensory information in the retinal image is typically too ambiguous to support visual object recognition by itself. Theories of visual disambiguation posit that to disambiguate, and thus interpret, the incoming images, the visual system must integrate the sensory information with previous knowledge of the visual world. However, the underlying neural mechanisms remain unclear. Using functional magnetic resonance imaging (fMRI) of human subjects, we have found evidence for functional specialization for storing disambiguating information in memory versus interpreting incoming ambiguous images. Subjects viewed two-tone, "Mooney" images, which are typically ambiguous when seen for the first time but are quickly disambiguated after viewing the corresponding unambiguous color images. Activity in one set of regions, including a region in the medial parietal cortex previously reported to play a key role in Mooney image disambiguation, closely reflected memory for previously seen color images but not the subsequent disambiguation of Mooney images. A second set of regions, including the superior temporal sulcus, showed the opposite pattern, in that their responses closely reflected the subjects' percepts of the disambiguated Mooney images on a stimulus-to-stimulus basis but not the memory of the corresponding color images. Functional connectivity between the two sets of regions was stronger during those trials in which the disambiguated percept was stronger. This functional interaction between brain regions that specialize in storing disambiguating information in memory versus interpreting incoming ambiguous images may represent a general mechanism by which previous knowledge disambiguates visual sensory information.

Abnormal brain activation during working memory in children with prenatal exposure to drugs of abuse: the effects of methamphetamine, alcohol, and polydrug exposure

Structural and metabolic abnormalities in fronto-striatal structures have been reported in children with prenatal methamphetamine (MA) exposure. The current study was designed to quantify functional alterations to the fronto-striatal circuit in children with prenatal MA exposure using functional magnetic resonance imaging (fMRI). Because many women who use MA during pregnancy also use alcohol, a known teratogen, we examined 50 children (age range 7-15), 19 with prenatal MA exposure, 15 of whom had concomitant prenatal alcohol exposure (the MAA group), 13 with heavy prenatal alcohol but no MA exposure (ALC group), and 18 unexposed controls (CON group). We hypothesized that MA exposed children would demonstrate abnormal brain activation during a visuospatial working memory (WM) "N-Back" task. As predicted, the MAA group showed less activation than the CON group in many brain areas, including the striatum and frontal lobe in the left hemisphere. The ALC group showed less activation than the MAA group in several regions, including the right striatum. We found an inverse correlation between performance and activity in the striatum in both the CON and MAA groups. However, this relationship was significant in the caudate of the CON group but not the MAA group, and in the putamen of the MAA group but not the CON group. These findings suggest that structural damage in the fronto-striatal circuit after prenatal MA exposure leads to decreased recruitment of this circuit during a WM challenge, and raise the possibility that a rewiring of cortico-striatal networks may occur in children with prenatal MA exposure.

Encoding of visual-spatial information in working memory requires more cerebral efforts than retrieval: Evidence from an EEG and virtual reality study

Visual-spatial working memory tasks can be decomposed into encoding and retrieval phases. It was hypothesized that encoding of visual-spatial information is cognitively more challenging than retrieval. This was tested by combining electroencephalography with a virtual reality paradigm to observe the modulation in EEG activity. EEG power analysis results demonstrated an increase in theta activity during encoding in comparison to retrieval, whereas alpha activity was significantly higher for retrieval in comparison to encoding. We found that encoding required more cerebral efforts than retrieval. Further, as seen in fMRI studies, we observed an encoding/retrieval flip in that encoding and retrieval differentially activated similar neural substrates. Results obtained from sLORETA identified cortical sources in the inferior frontal gyrus, which is a part of dorsolateral prefrontal cortex (DLPFC) during encoding, whereas the inferior parietal lobe and precuneus cortical sources were identified during retrieval. We further tie our results into studies examining the default network, which have shown increased activation in DLPFC occurs in response to increased cerebral challenge, while posterior parietal areas show activation during baseline or internal processing tasks. We conclude that encoding of visual-spatial information via VR navigation task is more cerebrally challenging than retrieval.

Functional MR imaging correlates of neuropsychological impairment in primary-progressive multiple sclerosis

BACKGROUND AND PURPOSE

Cognitive deficits affect

MATERIALS AND METHODS

From 16 right-handed patients with PPMS and 17 matched controls, structural and fMRIs (during the performance of the 2-back task) were acquired. Neuropsychological tests exploring memory, attention, and frontal lobe cognitive domains were administered. T2 LL, NBV, and CC areas were measured.

RESULTS

Six patients with PPMS were CI. Structural MR imaging measures did not differ between patients who were CI and those who were CP. Compared with patients who were CI, patients who were CP had increased activations of the left caudate nucleus, PFC, and inferior parietal lobule. Compared with controls and patients who were CP, patients who were CI had increased activations of the SII, cerebellum, and insula. Compared with controls, they also had increased activations of the right precentral gyrus and a reduced recruitment of the left PFC. In patients with PPMS, a decreased composite cognitive score correlated with increased activity of the cerebellum, insula, and SII, as well as decreased PFC activity. T2 LL correlated with decreased PFC recruitment and increased SII recruitment.

CONCLUSIONS

In PPMS, an increased recruitment of cognitive-related networks might represent a functional reserve with the potential to limit the severity of cognitive impairment. The accumulation of T2 lesions and the consequent exhaustion of frontal lobe plasticity might contribute to cognitive impairment in PPMS.

Collapse

Key Words Collapse

MESH Headings

• Adult
• Aged
• Brain/physiopathology
• Cerebellum/physiopathology
• Cognition Disorders/diagnosis
• Cognition Disorders/etiology
• Cognition Disorders/physiopathology
• Female
• Frontal Lobe/physiopathology
• Humans
• Magnetic Resonance Imaging
• Male
• Middle Aged
• Multiple Sclerosis, Chronic Progressive/complications
• Multiple Sclerosis, Chronic Progressive/diagnosis
• Multiple Sclerosis, Chronic Progressive/physiopathology
• Neuronal Plasticity/physiology
• Neuropsychological Tests
• Parietal Lobe/physiopathology
• Severity of Illness Index

Collapse

Grants Collapse

Affiliation(s)

M A Rocca Neuroimaging Research Unit, Institute of Experimental Neurology, Scientific Institute and University Ospedale San Raffaele, Milan, Italy
G Riccitelli
M Rodegher
A Ceccarelli
A Falini
M Falautano
A Meani
G Comi
Massimo Filippi

Collapse

Collaborators Collapse

Prefrontal oxygenation during working memory in ADHD

OBJECTIVES

Deficits in working memory have been repeatedly found on a behavioural level in children with attention-deficit/hyperactivity disorder (ADHD). Functional brain imaging studies have revealed evidence for alterations in the prefrontal cortex associated with working memory. So far it remains unresolved whether object (OWM) and spatial visual working memory (SWM) are distinctly impaired in ADHD. We investigated this issue with the fist multi-channel functional near-infrared spectroscopy study of children with ADHD.

METHOD

We investigated 19 children with ADHD combined type (DSM-IV) and 19 controls matched for age (8-15years), sex, handedness, and intelligence during a working memory task assessing OWM and SWM separately, and a control condition (CON). Prefrontal brain activity was measured by concentration changes of oxygenated haemoglobin.

RESULTS

Working memory performance showed significant differences for conditions (OWM>SWM>CON), but no differences between groups. Cortical prefrontal activation was significantly higher for OWM and SWM in contrast to CON, again with no differences between groups.

CONCLUSIONS

We found no indication for an altered prefrontal processing during OWM and SWM tasks in ADHD children compared to controls. Reviewing the existing imaging literature on working memory in ADHD and considering the present data, we discuss possible confounding factors relevant for brain activity in previous, the current, and future investigations. Thus, it is of high importance to capture developmental trajectories, task specific discrepancies, and effects of permanent medication intake in future studies.

Modality-dependent "what" and "where" preparatory processes in auditory and visual systems

The present study examined the modality specificity and spatio-temporal dynamics of "what" and "where" preparatory processes in anticipation of auditory and visual targets using ERPs and a cue-target paradigm. Participants were presented with an auditory (Experiment 1) or a visual (Experiment 2) cue that signaled them to attend to the identity or location of an upcoming auditory or visual target. In both experiments, participants responded faster to the location compared to the identity conditions. Multivariate spatio-temporal partial least square (ST-PLS) analysis of the scalp-recorded data revealed supramodal "where" preparatory processes between 300-600 msec and 600-1200 msec at central and posterior parietal electrode sites in anticipation of both auditory and visual targets. Furthermore, preparation for pitch processing was captured at modality-specific temporal regions between 300 and 700 msec, and preparation for shape processing was detected at occipital electrode sites between 700 and 1150 msec. The spatio-temporal patterns noted above were replicated when a visual cue signaled the upcoming response (Experiment 2). Pitch or shape preparation exhibited modality-dependent spatio-temporal patterns, whereas preparation for target localization was associated with larger amplitude deflections at multimodal, centro-parietal sites preceding both auditory and visual targets. Using a novel paradigm, the study supports the notion of a division of labor in the auditory and visual pathways following both auditory and visual cues that signal identity or location response preparation to upcoming auditory or visual targets.

Trade-off in object versus spatial visualization abilities: restriction in the development of visual-processing resources

Previous research indicates relative independence between the ventral and dorsal visual pathways, associated with object and spatial visual processing, respectively. The present research shows that, at the individual-differences level, there is a trade-off, rather than independence, between object and spatial visualization abilities. Across five different age groups with different professional specializations, participants with above-average object visualization abilities (artists) had below-average spatial visualization abilities, and the inverse was true for those with above-average spatial visualization abilities (scientists). No groups showed both above-average object and above-average spatial visualization abilities. Furthermore, while total object and spatial visualization resources increase with age and experience, the trade-off relationship between object and spatial visualization abilities does not. These results suggest that the trade-off originates through a bottleneck that restricts the development of overall visualization resources, rather than through preferential experience in one type of visualization.

Synchronous retinotopic frontal-temporal activity during long-term memory for spatial location

Early visual areas in occipital cortex are known to be retinotopic. Recently, retinotopic maps have been reported in frontal and parietal cortex during spatial attention and working memory. The present event-related potential (ERP) and functional magnetic resonance imaging (fMRI) study determined whether spatial long-term memory was associated with retinotopic activity in frontal and parietal regions, and assessed whether retinotopic activity in these higher level control regions was synchronous with retinotopic activity in lower level visual sensory regions. During encoding, abstract shapes were presented to the left or right of fixation. During retrieval, old and new shapes were presented at fixation and participants classified each shape as old and previously on the "left", old and previously on the "right", or "new". Retinotopic effects were manifested by accurate memory for items previously presented on the left producing activity in the right hemisphere and accurate memory for items previously presented on the right producing activity in the left hemisphere. Retinotopic ERP activity was observed in frontal regions and visual sensory (occipital and temporal) regions. In frontal cortex, retinotopic fMRI activity was localized to the frontal eye fields. There were no significant ERP or fMRI retinotopic memory effects in parietal regions. The present long-term memory retinotopic effects complement previous spatial attention and working memory findings (and suggest retinotopic activity in parietal cortex may require an external peripheral stimulus). Furthermore, ERP cross-correlogram analysis revealed that retinotopic activations in frontal and temporal regions were synchronous, indicating that these regions interact during retrieval of spatial information.