Orienting Attention to Locations in Perceptual Versus Mental Representations

Attentional cueing by cross-modal congruency produces both facilitation and inhibition on short-term visual recognition

The attentional modulation of performance in a memory task, comparable to the one obtained in a perceptual task, is at the focus of contemporary research. We hypothesized that a biphasic effect (namely, facilitation followed by inhibition) can be obtained in visual working memory when attention is cued towards one item of the memorandum and participants must recognize a delayed probe as being identical to any item of the memorandum. In every trial, a delayed spiky/curvy probe appeared centrally, to be matched with the same-category shape maintained in visual working memory which could be either physically identical (positive trials) or only categorically similar (negative trials). To orient the participant's attention towards a selected portion of a two-item memorandum, a (tzk/wow) sound was played simultaneously with two lateral visual shapes (one spiky and one curved). Our results indicate that an exogenous attentional shift during perception of the memorandum, induced by a congruent audio-visual pairing, first facilitates and then inhibits the recognition of a cued item (but not of a non-cued item) stored in visual working memory. A coherent pattern of individual differences emerged, indicating that the amount of early facilitation in congruent-sound trials was negatively correlated with recognition sensitivity in no-sound trials (suggesting that the inverse effectiveness rule may also apply to memory) and positively correlated with later inhibition, as well as with the self-reported susceptibility to memory failures.

Temporal dynamics of attention during encoding versus maintenance of working memory: complementary views from event-related potentials and alpha-band oscillations

Working memory (WM) is strongly influenced by attention. In visual WM tasks, recall performance can be improved by an attention-guiding cue presented before encoding (precue) or during maintenance (retrocue). Although precues and retrocues recruit a similar frontoparietal control network, the two are likely to exhibit some processing differences, because precues invite anticipation of upcoming information whereas retrocues may guide prioritization, protection, and selection of information already in mind. Here we explored the behavioral and electrophysiological differences between precueing and retrocueing in a new visual WM task designed to permit a direct comparison between cueing conditions. We found marked differences in ERP profiles between the precue and retrocue conditions. In line with precues primarily generating an anticipatory shift of attention toward the location of an upcoming item, we found a robust lateralization in late cue-evoked potentials associated with target anticipation. Retrocues elicited a different pattern of ERPs that was compatible with an early selection mechanism, but not with stimulus anticipation. In contrast to the distinct ERP patterns, alpha-band (8-14 Hz) lateralization was indistinguishable between cue types (reflecting, in both conditions, the location of the cued item). We speculate that, whereas alpha-band lateralization after a precue is likely to enable anticipatory attention, lateralization after a retrocue may instead enable the controlled spatiotopic access to recently encoded visual information.

The effects of sequential attention shifts within visual working memory

Previous studies have shown conflicting data as to whether it is possible to sequentially shift spatial attention among visual working memory (VWM) representations. The present study investigated this issue by asynchronously presenting attentional cues during the retention interval of a change detection task. In particular, we focused on two types of sequential attention shifts: (1) orienting attention to one location, and then withdrawing attention from it, and (2) switching the focus of attention from one location to another. In Experiment 1, a withdrawal cue was presented after a spatial retro-cue to measure the effect of withdrawing attention. The withdrawal cue significantly reduced the cost of invalid spatial cues, but surprisingly, did not attenuate the benefit of valid spatial cues. This indicates that the withdrawal cue only triggered the activation of facilitative components but not inhibitory components of attention. In Experiment 2, two spatial retro-cues were presented successively to examine the effect of switching the focus of attention. We observed equivalent benefits of the first and second spatial cues, suggesting that participants were able to reorient attention from one location to another within VWM, and the reallocation of attention did not attenuate memory at the first-cued location. In Experiment 3, we found that reducing the validity of the preceding spatial cue did lead to a significant reduction in its benefit. However, performance was still better at first-cued locations than at uncued and neutral locations, indicating that the first cue benefit might have been preserved both partially under automatic control and partially under voluntary control. Our findings revealed new properties of dynamic attentional control in VWM maintenance.

WORKING MEMORY IMPAIRMENT AS AN ENDOPHENOTYPIC MARKER OF A SCHIZOPHRENIA DIATHESIS

This chapter focuses on the viability of working memory impairment as an endophenotypic marker of a schizophrenia diathesis. It begins with an introduction of the construct of working memory. It follows with a review of the operational criteria for defining an endophenotype. Research findings regarding the working memory performance of schizophrenia and schizophrenia-spectrum patients, first-degree relatives of schizophrenia patients and healthy controls, are reviewed in terms of the criteria for being considered an endophenotypic marker. Special attention is paid to specific components of the working memory deficit (namely, encoding, maintenance, and manipulation), in terms of which aspects are likely to be the best candidates for endophenotypes. We consider the extant literature regarding working memory performance in bipolar disorder and major depression in order to address the issue of relative specificity to schizophrenia. Despite some unresolved issues, it appears that working memory impairment is a very promising candidate for an endophenotypic marker of a schizophrenia diathesis but not for mood disorders. Throughout this chapter, we identify future directions for research in this exciting and dynamic area of research and evaluate the contribution of working memory research to our understanding of schizophrenia.

Resource-sharing between internal maintenance and external selection modulates attentional capture by working memory content

It is unclear why and under what circumstances working memory (WM) and attention interact. Here, we apply the logic of the time-based resource-sharing (TBRS) model of WM (e.g., Barrouillet et al., 2004) to explore the mixed findings of a separate, but related, literature that studies the guidance of visual attention by WM contents. Specifically, we hypothesize that the linkage between WM representations and visual attention is governed by a time-shared cognitive resource that alternately refreshes internal (WM) and selects external (visual attention) information. If this were the case, WM content should guide visual attention (involuntarily), but only when there is time for it to be refreshed in an internal focus of attention. To provide an initial test for this hypothesis, we examined whether the amount of unoccupied time during a WM delay could impact the magnitude of attentional capture by WM contents. Participants were presented with a series of visual search trials while they maintained a WM cue for a delayed-recognition test. WM cues could coincide with the search target, a distracter, or neither. We varied both the number of searches to be performed, and the amount of available time to perform them. Slowing of visual search by a WM matching distracter—and facilitation by a matching target—were curtailed when the delay was filled with fast-paced (refreshing-preventing) search trials, as was subsequent memory probe accuracy. WM content may, therefore, only capture visual attention when it can be refreshed, suggesting that internal (WM) and external attention demands reciprocally impact one another because they share a limited resource. The TBRS rationale can thus be applied in a novel context to explain why WM contents capture attention, and under what conditions that effect should be observed.

Internal and external spatial attention examined with lateralized EEG power spectra

Several authors argued that retrieval of an item from visual short term memory (internal spatial attention) and focusing attention on an externally presented item (external spatial attention) are similar. Part of the neuroimaging support for this view may be due to the employed experimental procedures. Furthermore, as internal spatial attention may have a more induced than evoked nature some effects may not have been visible in event related analyses of the electroencephalogram (EEG), which limits the possibility to demonstrate differences. In the current study, a colored frame cued which stimulus, one out of four presented in separate quadrants, required a response, which depended on the form of the cued stimulus (circle or square). Importantly, the frame occurred either before (precue), simultaneously with (simultaneous cue), or after the stimuli (postcue). The precue and simultaneous cue condition both concern external attention, while the postcue condition implies the involvement of internal spatial attention. Event-related lateralizations (ERLs), reflecting evoked effects, and lateralized power spectra (LPS), reflecting both evoked and induced effects, were determined. ERLs revealed a posterior contralateral negativity (PCN) only in the precue condition. LPS analyses on the raw EEG showed early increased contralateral theta power at posterior sites and later increased ipsilateral alpha power at occipito-temporal sites in all cue conditions. Responses were faster when the internally or externally attended location corresponded with the required response side than when not. These findings provide further support for the view that internal and external spatial attention share their underlying mechanism.

Sharp emergence of feature-selective sustained activity along the dorsal visual pathway

Sustained activity encoding visual working memory representations has been observed in several cortical areas of primates. Where along the visual pathways this activity emerges remains unknown. Here we show in macaques that sustained spiking activity encoding memorized visual motion directions is absent in direction-selective neurons in early visual area middle temporal (MT). However, it is robustly present immediately downstream, in multimodal association area medial superior temporal (MST), and in the lateral prefrontal cortex (LPFC). This sharp emergence of sustained activity along the dorsal pathway suggests a functional boundary between early visual areas, encoding sensory inputs, and downstream association areas, additionally encoding mnemonic representations. Moreover, local field potential oscillations in MT encoded the memorized directions and, in the low frequencies, were phase-coherent with LPFC spikes. This suggests that LPFC sustained activity modulates synaptic activity in MT, a putative top-down mechanism by which memory signals influence stimulus processing in early visual cortex.

Invalid retro-cues can eliminate the retro-cue benefit: Evidence for a hybridized account

The contents of visual working memory (VWM) are capacity limited and require frequent updating. The retrospective cueing (retro-cueing) paradigm clarifies how directing internal attention among VWM items boosts VWM performance. In this paradigm a cue appears prior to retrieval, but after encoding and maintenance. The retro-cue effect (RCE) refers to superior VWM after valid versus neutral retro-cues. Here we investigated the effect of the invalid retro-cues' inclusion on VWM performance. We conducted 2 pairs of experiments, changing both probe type (recognition and recall) as well as presence and absence of invalid retro-cue trials. Furthermore, to fully characterize these effects over time, we used extended post-retro-cue delay durations. In the first set of experiments, probing VWM using recognition indicated that the RCE remained consistent in magnitude with or without invalid retro-cue trials. In the second set of experiments, VWM was probed with recall. Here, the RCE was eliminated when invalid retro-cues were included. This finer-grained measure of VWM fidelity showed that all items were subject to decay over time. We conclude that the invalid retro-cues impaired the protection of validly cues items, but they remain accessible, suggesting greater concordance with a prioritization account.

The working memory stroop effect: when internal representations clash with external stimuli

Working memory (WM) has recently been described as internally directed attention, which implies that WM content should affect behavior exactly like an externally perceived and attended stimulus. We tested whether holding a color word in WM, rather than attending to it in the external environment, can produce interference in a color-discrimination task, which would mimic the classic Stroop effect. Over three experiments, the WM Stroop effect recapitulated core properties of the classic attentional Stroop effect, displaying equivalent congruency effects, additive contributions from stimulus- and response-level congruency, and susceptibility to modulation by the percentage of congruent and incongruent trials. Moreover, WM maintenance was inversely related to attentional demands during the WM delay between stimulus presentation and recall, with poorer memory performance following incongruent than congruent trials. Together, these results suggest that WM and attention rely on the same resources and operate over the same representations.

Neural mechanisms by which attention modulates the comparison of remembered and perceptual representations

Attention is important for effectively comparing incoming perceptual information with the contents of visual short-term memory (VSTM), such that any differences can be detected. However, how attentional mechanisms operate upon these comparison processes remains largely unknown. Here we investigate the underlying neural mechanisms by which attention modulates the comparisons between VSTM and perceptual representations using functional magnetic resonance imaging (fMRI). Participants performed a cued change detection task. Spatial cues were presented to orient their attention either to the location of an item in VSTM prior to its comparison (retro-cues), or simultaneously (simultaneous-cues) with the probe array. A no-cue condition was also included. When attention cannot be effectively deployed in advance (i.e. following the simultaneous-cues), we observed a distributed and extensive activation pattern in the prefrontal and parietal cortices in support of successful change detection. This was not the case when participants can deploy their attention in advance (i.e. following the retro-cues). The region-of-interest analyses confirmed that neural responses for successful change detection versus correct rejection in the visual and parietal regions were significantly different for simultaneous-cues compared to retro-cues. Importantly, we found enhanced functional connectivity between prefrontal and parietal cortices when detecting changes on the simultaneous-cue trials. Moreover, we demonstrated a close relationship between this functional connectivity and d′ scores. Together, our findings elucidate the attentional and neural mechanisms by which items held in VSTM are compared with incoming perceptual information.

Attention biases visual activity in visual short-term memory

In the current study, we tested whether representations in visual STM (VSTM) can be biased via top-down attentional modulation of visual activity in retinotopically specific locations. We manipulated attention using retrospective cues presented during the retention interval of a VSTM task. Retrospective cues triggered activity in a large-scale network implicated in attentional control and led to retinotopically specific modulation of activity in early visual areas V1-V4. Importantly, shifts of attention during VSTM maintenance were associated with changes in functional connectivity between pFC and retinotopic regions within V4. Our findings provide new insights into top-down control mechanisms that modulate VSTM representations for flexible and goal-directed maintenance of the most relevant memoranda.

Multiple neural states of representation in short-term memory? It's a matter of attention

Short-term memory (STM) refers to the capacity-limited retention of information over a brief period of time, and working memory (WM) refers to the manipulation and use of that information to guide behavior. In recent years it has become apparent that STM and WM interact and overlap with other cognitive processes, including attention (the selection of a subset of information for further processing) and long-term memory (LTM—the encoding and retention of an effectively unlimited amount of information for a much longer period of time). Broadly speaking, there have been two classes of memory models: systems models, which posit distinct stores for STM and LTM (Atkinson and Shiffrin, 1968; Baddeley and Hitch, 1974); and state-based models, which posit a common store with different activation states corresponding to STM and LTM (Cowan, 1995; McElree, 1996; Oberauer, 2002). In this paper, we will focus on state-based accounts of STM. First, we will consider several theoretical models that postulate, based on considerable behavioral evidence, that information in STM can exist in multiple representational states. We will then consider how neural data from recent studies of STM can inform and constrain these theoretical models. In the process we will highlight the inferential advantage of multivariate, information-based analyses of neuroimaging data (fMRI and electroencephalography (EEG)) over conventional activation-based analysis approaches (Postle, in press). We will conclude by addressing lingering questions regarding the fractionation of STM, highlighting differences between the attention to information vs. the retention of information during brief memory delays.

Deployment of spatial attention towards locations in memory representations. An EEG study

Recalling information from visual short-term memory (VSTM) involves the same neural mechanisms as attending to an actually perceived scene. In particular, retrieval from VSTM has been associated with orienting of visual attention towards a location within a spatially-organized memory representation. However, an open question concerns whether spatial attention is also recruited during VSTM retrieval even when performing the task does not require access to spatial coordinates of items in the memorized scene. The present study combined a visual search task with a modified, delayed central probe protocol, together with EEG analysis, to answer this question. We found a temporal contralateral negativity (TCN) elicited by a centrally presented go-signal which was spatially uninformative and featurally unrelated to the search target and informed participants only about a response key that they had to press to indicate a prepared target-present vs. -absent decision. This lateralization during VSTM retrieval (TCN) provides strong evidence of a shift of attention towards the target location in the memory representation, which occurred despite the fact that the present task required no spatial (or featural) information from the search to be encoded, maintained, and retrieved to produce the correct response and that the go-signal did not itself specify any information relating to the location and defining feature of the target.

Attention to memory: orienting attention to sound object representations

Despite a growing acceptance that attention and memory interact, and that attention can be focused on an active internal mental representation (i.e., reflective attention), there has been a paucity of work focusing on reflective attention to 'sound objects' (i.e., mental representations of actual sound sources in the environment). Further research on the dynamic interactions between auditory attention and memory, as well as its degree of neuroplasticity, is important for understanding how sound objects are represented, maintained, and accessed in the brain. This knowledge can then guide the development of training programs to help individuals with attention and memory problems. This review article focuses on attention to memory with an emphasis on behavioral and neuroimaging studies that have begun to explore the mechanisms that mediate reflective attentional orienting in vision and more recently, in audition. Reflective attention refers to situations in which attention is oriented toward internal representations rather than focused on external stimuli. We propose four general principles underlying attention to short-term memory. Furthermore, we suggest that mechanisms involved in orienting attention to visual object representations may also apply for orienting attention to sound object representations.

Internal attention to features in visual short-term memory guides object learning

Attending to objects in the world affects how we perceive and remember them. What are the consequences of attending to an object in mind? In particular, how does reporting the features of a recently seen object guide visual learning? In three experiments, observers were presented with abstract shapes in a particular color, orientation, and location. After viewing each object, observers were cued to report one feature from visual short-term memory (VSTM). In a subsequent test, observers were cued to report features of the same objects from visual long-term memory (VLTM). We tested whether reporting a feature from VSTM: (1) enhances VLTM for just that feature (practice-benefit hypothesis), (2) enhances VLTM for all features (object-based hypothesis), or (3) simultaneously enhances VLTM for that feature and suppresses VLTM for unreported features (feature-competition hypothesis). The results provided support for the feature-competition hypothesis, whereby the representation of an object in VLTM was biased towards features reported from VSTM and away from unreported features (Experiment 1). This bias could not be explained by the amount of sensory exposure or response learning (Experiment 2) and was amplified by the reporting of multiple features (Experiment 3). Taken together, these results suggest that selective internal attention induces competitive dynamics among features during visual learning, flexibly tuning object representations to align with prior mnemonic goals.

Working memory as internal attention: toward an integrative account of internal and external selection processes

Working memory (WM) and attention have been studied as separate cognitive constructs, although it has long been acknowledged that attention plays an important role in controlling the activation, maintenance, and manipulation of representations in WM. WM has, conversely, been thought of as a means of maintaining representations to voluntarily guide perceptual selective attention. It has more recently been observed, however, that the contents of WM can capture visual attention, even when such internally maintained representations are irrelevant, and often disruptive, to the immediate external task. Thus, the precise relationship between WM and attention remains unclear, but it appears that they may bidirectionally impact one another, whether or not internal representations are consistent with the external perceptual goals. This reciprocal relationship seems, further, to be constrained by limited cognitive resources to handle demands in either maintenance or selection. We propose here that the close relationship between WM and attention may be best described as a give-and-take interdependence between attention directed toward either actively maintained internal representations (traditionally considered WM) or external perceptual stimuli (traditionally considered selective attention), underpinned by their shared reliance on a common cognitive resource. Put simply, we argue that WM and attention should no longer be considered as separate systems or concepts, but as competing and influencing one another because they rely on the same limited resource. This framework can offer an explanation for the capture of visual attention by irrelevant WM contents, as well as a straightforward account of the underspecified relationship between WM and attention.

Spatial Attention Interacts With Serial-Order Retrieval From Verbal Working Memory

The ability to maintain the serial order of events is recognized as a major function of working memory. Although general models of working memory postulate a close link between working memory and attention, such a link has so far not been proposed specifically for serial-order working memory. The present study provided the first empirical demonstration of a direct link between serial order in verbal working memory and spatial selective attention. We show that the retrieval of later items of a sequence stored in working memory—compared with that of earlier items—produces covert attentional shifts toward the right. This observation suggests the conceptually surprising notion that serial-order working memory, even for nonspatially defined verbal items, draws on spatial attention.

Early and late stages of working-memory maintenance contribute differentially to long-term memory formation

The present paper investigated the role of early and late stages of working-memory maintenance, which have been suggested to differentially contribute to long-term memory formation. In experiment 1, we administered a delayed-match-to-sample task, requiring participants to remember line drawings of non-sense three-dimensional stimuli. In the delay phase, participants were either presented with a fixation cross (for 2 or 9s) or with one of two different interference tasks, varying in visual overlap with the target. The interference task was presented 1.5, 4.5 or 7.5s after target offset. Early interfering and early probing disproportionately affected performance on an unexpected subsequent recognition-memory task compared to later interference or probing. This was not modulated by the type of interference task. In Experiment 2, we examined whether the formation of a holistic internal code of the target may be a gradual process. An analogous delayed-match-to-sample task was administered, with interference after 0.5, 2.5 or 4.5s after target offset. The early and middle interference condition similarly disproportionately affected performance compared to later interference. Hence, the present results support the view of a functional dissociation between early and late stages of working-memory maintenance and that early working-memory processes contribute particularly to long-term memory formation.

Multi-voxel pattern analysis of selective representation of visual working memory in ventral temporal and occipital regions

While previous results from univariate analysis showed that the activity level of the parahippocampal gyrus (PHG) but not the fusiform gyrus (FG) reflects selective maintenance of the cued picture category, present results from multi-voxel pattern analysis (MVPA) showed that the spatial response patterns of both regions can be used to differentiate the selected picture category in working memory. The ventral temporal and occipital areas including the PHG and FG have been shown to be specialized in perceiving and processing different kinds of visual information, though their role in the representation of visual working memory remains unclear. To test whether the PHG and FG show spatial response patterns that reflect selective maintenance of task-relevant visual working memory in comparison with other posterior association regions, we reanalyzed data from a previous fMRI study of visual working memory with a cue inserted during the delay period of a delayed recognition task. Classification of FG and PHG activation patterns for the selected category (face or scene) during the cue phase was well above chance using classifiers trained with fMRI data from the cue or probe phase. Classification of activity in other temporal and occipital regions for the cued picture category during the cue phase was relatively less consistent even though classification of their activity during the probe recognition was comparable with the FG and PHG. In sum, these findings suggest that the FG and PHG carry information relevant to the cued visual category, and their spatial activation patterns during selective maintenance seem to match those during visual recognition.

A meta-analysis of executive components of working memory

Working memory (WM) enables the online maintenance and manipulation of information and is central to intelligent cognitive functioning. Much research has investigated executive processes of WM in order to understand the operations that make WM "work." However, there is yet little consensus regarding how executive processes of WM are organized. Here, we used quantitative meta-analysis to summarize data from 36 experiments that examined executive processes of WM. Experiments were categorized into 4 component functions central to WM: protecting WM from external distraction (distractor resistance), preventing irrelevant memories from intruding into WM (intrusion resistance), shifting attention within WM (shifting), and updating the contents of WM (updating). Data were also sorted by content (verbal, spatial, object). Meta-analytic results suggested that rather than dissociating into distinct functions, 2 separate frontal regions were recruited across diverse executive demands. One region was located dorsally in the caudal superior frontal sulcus and was especially sensitive to spatial content. The other was located laterally in the midlateral prefrontal cortex and showed sensitivity to nonspatial content. We propose that dorsal-"where"/ventral-"what" frameworks that have been applied to WM maintenance also apply to executive processes of WM. Hence, WM can largely be simplified to a dual selection model.

The mental wormhole: internal attention shifts without regard for distance

Attention operates perceptually on items in the environment, and internally on objects in visuospatial working memory. In the present study, we investigated whether spatial and temporal constraints affecting endogenous perceptual attention extend to internal attention. A retro-cue paradigm in which a cue is presented beyond the range of iconic memory and after stimulus encoding was used to manipulate shifts of internal attention. Participants' memories were tested for colored circles (Experiments 1, 2, 3a, 4) or for novel shapes (Experiment 3b) and their locations within an array. In these experiments, the time to shift internal attention (Experiments 1 and 3) and the eccentricity of encoded objects (Experiments 2-4) were manipulated. Our data showed that, unlike endogenous perceptual attention, internal shifts of attention are not modulated by stimulus eccentricity. Across several timing parameters and stimuli, we found that shifts of internal attention require a minimum quantal amount of time regardless of the object eccentricity at encoding. Our findings are consistent with the view that internal attention operates on objects whose spatial information is represented in relative terms. Although endogenous perceptual attention abides by the laws of space and time, internal attention can shift across spatial representations without regard for physical distance.

Differential frontal involvement in shifts of internal and perceptual attention

BACKGROUND

Perceptual attention enhances the processing of items in the environment, whereas internal attention enhances processing of items encoded in visual working memory. In perceptual and internal attention cueing paradigms, cues indicate the to-be-probed item before (pre-cueing) or after (retro-cueing) the memory display, respectively. Pre- and retro-cues confer similar behavioral accuracy benefits (pre-: 14-19%, retro-: 11-17%) and neuroimaging data show that they activate overlapping frontoparietal networks. Yet reports of behavioral and neuroimaging differences suggest that pre- and retro-cueing differentially recruit frontal and parietal cortices (Lepsien and Nobre, 2006).

OBJECTIVE/HYPOTHESIS

This study examined whether perceptual and internal attention are equally disrupted by neurostimulation to frontal and parietal cortices. We hypothesized that neurostimulation applied to frontal cortex would disrupt internal attention to a greater extent than perceptual attention.

METHODS

Cathodal transcranial direct current stimulation (tDCS) was applied to frontal or parietal cortices. After stimulation, participants completed a change detection task coupled with either pre- or retro-cues.

RESULTS

Cathodal tDCS across site (frontal, parietal) hindered performance. However, frontal tDCS had a greater negative impact on the retro-cued trials demonstrating greater frontal involvement during shifts of internal attention.

CONCLUSIONS

These results complement the neuroimaging data and provide further evidence suggesting that perceptual and internal attention are not identical processes. We conclude that although internal and perceptual attention are mediated by similar frontoparietal networks, the weight of contribution of these structures differs, with internal attention relying more heavily on the frontal cortex.

Selective maintenance in visual working memory does not require sustained visual attention

In four experiments, we tested whether sustained visual attention is required for the selective maintenance of objects in visual working memory (VWM). Participants performed a color change-detection task. During the retention interval, a valid cue indicated the item that would be tested. Change-detection performance was higher in the valid-cue condition than in a neutral-cue control condition. To probe the role of visual attention in the cuing effect, on half of the trials, a difficult search task was inserted after the cue, precluding sustained attention on the cued item. The addition of the search task produced no observable decrement in the magnitude of the cuing effect. In a complementary test, search efficiency was not impaired by simultaneously prioritizing an object for retention in VWM. The results demonstrate that selective maintenance in VWM can be dissociated from the locus of visual attention.

Dissociable frontal-striatal and frontal-parietal networks involved in updating hierarchical contexts in working memory

Recent theories propose that the prefrontal cortex (PFC) is organized in a hierarchical fashion with more abstract, higher level information represented in anterior regions and more concrete, lower level information represented in posterior regions. This hierarchical organization affords flexible adjustments of action plans based on the context. Computational models suggest that such hierarchical organization in the PFC is achieved through interactions with the basal ganglia (BG) wherein the BG gate relevant contexts into the PFC. Here, we tested this proposal using functional magnetic resonance imaging (fMRI). Participants were scanned while updating working memory (WM) with 2 levels of hierarchical contexts. Consistent with PFC abstraction proposals, higher level context updates involved anterior portions of the PFC (BA 46), whereas lower level context updates involved posterior portions of the PFC (BA 6). Computational models were only partially supported as the BG were sensitive to higher, but not lower level context updates. The posterior parietal cortex (PPC) showed the opposite pattern. Analyses examining changes in functional connectivity confirmed dissociable roles of the anterior PFC-BG during higher level context updates and posterior PFC-PPC during lower level context updates. These results suggest that hierarchical contexts are organized by distinct frontal-striatal and frontal-parietal networks.

The efficiency of attentional networks in children who stutter

PURPOSE

The purpose of this study was to evaluate whether previously reported questionnaire-based differences in self-regulatory behaviors (Eggers, De Nil, & Van den Bergh, 2009, 2010) between children who stutter (CWS) and children who do not stutter (CWNS) would also be reflected in their underlying attentional networks.

METHOD

Participants consisted of 41 CWS (mean age = 6;09; years;months) and 41 CWNS (mean age = 6;09) ranging in age from 4;00 to 9;00. Participants were matched on age and gender. The efficiency of the attentional networks was assessed by using the computerized Attention Network Test (Fan, McCandliss, Sommer, Raz, & Posner, 2002).

RESULTS

Primary results indicated that CWS had a significantly lower efficiency of the orienting network compared with CWNS, whereas no differences were found on the alerting or executive control network.

CONCLUSION

Current findings corroborate previously found differences in self-regulatory behavior and were taken to suggest a possible role for attentional processes in developmental stuttering.

Shifting attention within memory representations involves early visual areas

Prior studies have shown that spatial attention modulates early visual cortex retinotopically, resulting in enhanced processing of external perceptual representations. However, it is not clear whether the same visual areas are modulated when attention is focused on, and shifted within a working memory representation. In the current fMRI study participants were asked to memorize an array containing four stimuli. After a delay, participants were presented with a verbal cue instructing them to actively maintain the location of one of the stimuli in working memory. Additionally, on a number of trials a second verbal cue instructed participants to switch attention to the location of another stimulus within the memorized representation. Results of the study showed that changes in the BOLD pattern closely followed the locus of attention within the working memory representation. A decrease in BOLD-activity (V1–V3) was observed at ROIs coding a memory location when participants switched away from this location, whereas an increase was observed when participants switched towards this location. Continuous increased activity was obtained at the memorized location when participants did not switch. This study shows that shifting attention within memory representations activates the earliest parts of visual cortex (including V1) in a retinotopic fashion. We conclude that even in the absence of visual stimulation, early visual areas support shifting of attention within memorized representations, similar to when attention is shifted in the outside world. The relationship between visual working memory and visual mental imagery is discussed in light of the current findings.

Synaesthetic perception of colour and visual space in a blind subject: an fMRI case study

In spatial sequence synaesthesia (SSS) ordinal stimuli are perceived as arranged in peripersonal space. Using fMRI, we examined the neural bases of SSS and colour synaesthesia for spoken words in a late-blind synaesthete, JF. He reported days of the week and months of the year as both coloured and spatially ordered in peripersonal space; parts of the days and festivities of the year were spatially ordered but uncoloured. Words that denote time-units and triggered no concurrents were used in a control condition. Both conditions inducing SSS activated the occipito-parietal, infero-frontal and insular cortex. The colour area hOC4v was engaged when the synaesthetic experience included colour. These results confirm the continued recruitment of visual colour cortex in this late-blind synaesthetes. Synaesthesia also involved activation in inferior frontal cortex, which may be related to spatial memory and detection, and in the insula, which might contribute to audiovisual integration related to the processing of inducers and concurrents.

Neural changes when actions change: adaptation of strong and weak expectations

Repeated experiences with an event create the expectation that subsequent events will expose an analog structure. These spontaneous expectations rely on an internal model of the event that results from learning. But what happens when events change? Do experience-based internal models get adapted instantaneously, or is model adaptation a function of the solidity of, i.e., familiarity with, the corresponding internal model? The present fMRI study investigated the effects of model solidity on model adaptation in an action observation paradigm. Subjects were made acquainted with a set of action movies that displayed an altered script when encountered again in the scanning session. We found model adaptation to result in an attenuation of the premotor-parietal network for action observation. Model solidity was found to modulate activation in the parahippocampal gyrus and the anterior cerebellar lobules, where increased solidity correlated with activity increase. Finally, the comparison between early and late stages of learning indicated an effect of model solidity on adaptation rate. This contrast revealed the involvement of a fronto-mesial network of Brodmann area 10 and the ACC in those states of learning that were signified by high model solidity, no matter if the memorized original or the altered action model was the more solid component. Findings suggest that the revision of an internal model is dependent on its familiarity. Unwarranted adaptations, but also perseverations may thus be prevented.

Right temporoparietal junction and attentional reorienting

The interaction between goal-directed and stimulus-driven attentional control allows humans to rapidly reorient to relevant objects outside the focus of attention--a phenomenon termed contingent reorienting. Neuroimaging studies have observed activation of the ventral and dorsal attentional networks, but specific involvement of each network remains unclear. The present study aimed to determine whether both networks are critical to the processes of top-down contingent reorienting. To this end, we combined the contingent attentional capture paradigm with the use of transcranial magnetic stimulation (TMS) to interfere with temporoparietal junction (TPJ; ventral network) and frontal eye field (dorsal network) activity. The results showed that only right TPJ (rTPJ) TMS modulated contingent orienting. Furthermore, this modulation was highly dependent on visual fields: rTPJ TMS increased contingent capture in the left visual field and decreased the effect in the right visual field. These results demonstrate a critical involvement of the ventral network in attentional reorienting and reveal the spatial selectivity within such network.

The role of attention in conscious recollection

Most research on the relationship between attention and consciousness has been limited to perception. However, perceptions are not the only kinds of mental contents of which we can be conscious. An important set of conscious states that has not received proper treatment within this discussion is that of memories. This paper reviews compelling evidence indicating that attention may be necessary, but probably not sufficient, for conscious recollection. However, it is argued that unlike the case of conscious perception, the kind of attention required during recollection is internal, as opposed to external, attention. As such, the surveyed empirical evidence is interpreted as suggesting that internal attention is necessary, but probably not sufficient, for conscious recollection. The paper begins by justifying the need for clear distinctions among different kinds of attention, and then emphasizes the difference between internal and external attention. Next, evidence from behavioral, neuropsychological, and neuroimaging studies suggesting that internal attention is required for the successful retrieval of memorial contents is reviewed. In turn, it is argued that internal attention during recollection is what makes us conscious of the contents of retrieved memories; further evidence in support of this claim is also provided. Finally, it is suggested that internal attention is probably not sufficient for conscious recollection. Open questions and possible avenues for future research are also mentioned.

Memory: enduring traces of perceptual and reflective attention

Attention and memory are typically studied as separate topics, but they are highly intertwined. Here we discuss the relation between memory and two fundamental types of attention: perceptual and reflective. Memory is the persisting consequence of cognitive activities initiated by and/or focused on external information from the environment (perceptual attention) and initiated by and/or focused on internal mental representations (reflective attention). We consider three key questions for advancing a cognitive neuroscience of attention and memory: to what extent do perception and reflection share representational areas? To what extent are the control processes that select, maintain, and manipulate perceptual and reflective information subserved by common areas and networks? During perception and reflection, to what extent are common areas responsible for binding features together to create complex, episodic memories and for reviving them later? Considering similarities and differences in perceptual and reflective attention helps integrate a broad range of findings and raises important unresolved issues.

Top-down modulation: bridging selective attention and working memory

Selective attention, the ability to focus our cognitive resources on information relevant to our goals, influences working memory (WM) performance. Indeed, attention and working memory are increasingly viewed as overlapping constructs. Here, we review recent evidence from human neurophysiological studies demonstrating that top-down modulation serves as a common neural mechanism underlying these two cognitive operations. The core features include activity modulation in stimulus-selective sensory cortices with concurrent engagement of prefrontal and parietal control regions that function as sources of top-down signals. Notably, top-down modulation is engaged during both stimulus-present and stimulus-absent stages of WM tasks; that is, expectation of an ensuing stimulus to be remembered, selection and encoding of stimuli, maintenance of relevant information in mind and memory retrieval.

Brain activation during spatial updating and attentive tracking of moving targets

Keeping aware of the locations of objects while one is moving requires the updating of spatial representations. As long as the objects are visible, attentional tracking is sufficient, but knowing where objects out of view went in relation to one's own body involves an updating of spatial working memory. Here, multiple object tracking was employed to study spatial updating and its neural correlates. In a dynamic 3D-scene, targets moved among visually indistinguishable distractors. The targets and distractors either stayed visible during continuous viewpoint changes or they turned invisible. The parametric variation of tracking load revealed load-dependent activations of the intraparietal sulcus, the superior parietal lobule, and the lateral occipital cortex in response to the attentive tracking task. Viewpoint changes with invisible objects that demanded retention and updating produced load-dependent activation only in the precuneus in line with its presumed involvement in updating spatial working memory.

Cortical plasticity for visuospatial processing and object recognition in deaf and hearing signers

Experience-dependent plasticity in deaf participants has been shown in a variety of studies focused on either the dorsal or ventral aspects of the visual system, but both systems have never been investigated in concert. Using functional magnetic resonance imaging (fMRI), we investigated functional plasticity for spatial processing (a dorsal visual pathway function) and for object processing (a ventral visual pathway function) concurrently, in the context of differing sensory (auditory deprivation) and language (use of a signed language) experience. During scanning, deaf native users of American Sign Language (ASL), hearing native ASL users, and hearing participants without ASL experience attended to either the spatial arrangement of frames containing objects or the identity of the objects themselves. These two tasks revealed the expected dorsal/ventral dichotomy for spatial versus object processing in all groups. In addition, the object identity matching task contained both face and house stimuli, allowing us to examine category-selectivity in the ventral pathway in all three participant groups. When contrasting the groups we found that deaf signers differed from the two hearing groups in dorsal pathway parietal regions involved in spatial cognition, suggesting sensory experience-driven plasticity. Group differences in the object processing system indicated that responses in the face-selective right lateral fusiform gyrus and anterior superior temporal cortex were sensitive to a combination of altered sensory and language experience, whereas responses in the amygdala were more closely tied to sensory experience. By selectively engaging the dorsal and ventral visual pathways within participants in groups with different sensory and language experiences, we have demonstrated that these experiences affect the function of both of these systems, and that certain changes are more closely tied to sensory experience, while others are driven by the combination of sensory and language experience.

Long-term memory prepares neural activity for perception

Past experience provides a rich source of predictive information about the world that could be used to guide and optimize ongoing perception. However, the neural mechanisms that integrate information coded in long-term memory (LTM) with ongoing perceptual processing remain unknown. Here, we explore how the contents of LTM optimize perception by modulating anticipatory brain states. By using a paradigm that integrates LTM and attentional orienting, we first demonstrate that the contents of LTM sharpen perceptual sensitivity for targets presented at memory-predicted spatial locations. Next, we examine oscillations in EEG to show that memory-guided attention is associated with spatially specific desynchronization of alpha-band activity over visual cortex. Additionally, we use functional MRI to confirm that target-predictive spatial information stored in LTM triggers spatiotopic modulation of preparatory activity in extrastriate visual cortex. Finally, functional MRI results also implicate an integrated cortical network, including the hippocampus and a dorsal frontoparietal circuit, as a likely candidate for organizing preparatory states in visual cortex according to the contents of LTM.

The right hemisphere advantage in visual change detection depends on temporal factors

What accounts for the Right Hemisphere (RH) functional superiority in visual change detection? An original task which combines one-shot and divided visual field paradigms allowed us to direct change information initially to the RH or the Left Hemisphere (LH) by deleting, respectively, an object included in the left or right half of a scene presented centrally. We manipulated the perceptual salience and semantic relevance of the change as well as the duration of the Inter-Stimulus Interval (ISI) between the scenes in order to clarify the role of the RH in memory and attention processes, and to explore whether lengthening the ISI would enhance the contribution of the LH. When analyzing data collapsed over the two levels (high vs. low) of salience and of relevance, changes were better detected in the left visual field (lvf) than in the right visual field (rvf) in the case of a short ISI, while no difference emerged in the case of a long ISI. Moreover, lengthening the ISI resulted in a performance decrement in the lvf, both for accuracy and response speed. The fact that the RH superiority was limited to short intervals indicates that stimulus-driven orienting contributes more than perceptual processing to this hemispheric asymmetry. When considering perceptual and semantic properties of the change, the effect of the ISI duration seemed to specifically emerge in the case of low relevance, with an enhancement of accuracy in the rvf when comparing the long with the short ISI. This suggests that the ISI influence on hemispheric performance operates on different levels.

Top–Down Modulation of Human Early Visual Cortex after Stimulus Offset Supports Successful Postcued Report

Modulations of sensory processing in early visual areas are thought to play an important role in conscious perception. To date, most empirical studies focused on effects occurring before or during visual presentation. By contrast, several emerging theories postulate that sensory processing and conscious visual perception may also crucially depend on late top–down influences, potentially arising after a visual display. To provide a direct test of this, we performed an fMRI study using a postcued report procedure. The ability to report a target at a specific spatial location in a visual display can be enhanced behaviorally by symbolic auditory postcues presented shortly after that display. Here we showed that such auditory postcues can enhance target-specific signals in early human visual cortex (V1 and V2). For postcues presented 200 msec after stimulus termination, this target-specific enhancement in visual cortex was specifically associated with correct conscious report. The strength of this modulation predicted individual levels of performance in behavior. By contrast, although later postcues presented 1000 msec after stimulus termination had some impact on activity in early visual cortex, this modulation no longer related to conscious report. These results demonstrate that within a critical time window of a few hundred milliseconds after a visual stimulus has disappeared, successful conscious report of that stimulus still relates to the strength of top–down modulation in early visual cortex. We suggest that, within this critical time window, sensory representation of a visual stimulus is still under construction and so can still be flexibly influenced by top–down modulatory processes.

Attentional control constrains visual short-term memory: insights from developmental and individual differences

The mechanisms by which attentional control biases mnemonic representations have attracted much interest but remain poorly understood. As attention and memory develop gradually over childhood and variably across individuals, assessing how participants of different ages and ability attend to mnemonic contents can elucidate their interplay. In Experiment 1, 7-year-olds, 10-year-olds, and adults were asked to report whether a probe item had been part of a previously presented four-item array. The initial array could either be uncued, be preceded ("precued"), or followed ("retrocued") by a spatial cue orienting attention to one of the potential item locations. Performance across groups was significantly improved by both cue types, and individual differences in children's retrospective attentional control predicted their visual short-term and working memory span, whereas their basic ability to remember in the absence of cues did not. Experiment 2 imposed a variable delay between the array and the subsequent orienting cue. Cueing benefits were greater in adults than in 10-year-olds, but they persisted even when cues followed the array by nearly 3 seconds, suggesting that orienting operated on durable short-term representations for both age groups. The findings indicate that there are substantial developmental and individual differences in the ability to control attention to memory and that in turn these differences constrain visual short-term memory capacity.

Different states in visual working memory: when it guides attention and when it does not

Recent studies have revealed a strong relationship between visual working memory and selective attention, such that attention is biased by what is currently on our mind. However, other data show that not all memorized items influence the deployment of attention, thus calling for a distinction within working memory: whereas active memory items function as an attentional template and directly affect perception, other, accessory items do not. We review recent evidence that items compete for the status of 'attentional template' that contains only one object at a time. Neurophysiological results provide insight into these different memory states by revealing a more intricate organization of working memory than was previously thought.

Response inhibition results in the emotional devaluation of faces: neural correlates as revealed by fMRI

Although it is well established that prior experience with faces determines their subsequent social-emotional evaluation, recent work shows that top-down inhibitory mechanisms, including response inhibition, can lead to social devaluation after even a single, brief exposure. These rapidly induced effects indicate interplay among perceptual, attentional, response-selection and social-emotional networks; yet, the brain mechanisms underlying this are not well understood. This study used functional magnetic resonance imaging (fMRI) to investigate the neural mechanism mediating the relationship between inhibitory control and emotional devaluation. Participants performed two tasks: (i) a Go/No-Go task in response to faces and (ii) a trustworthiness rating task involving the previously seen faces. No-Go faces were rated as significantly less trustworthy than Go faces. By examining brain activations during Task 1, behavioral measures and brain activations obtained in Task 2 could be predicted. Specifically, activity in brain areas during Task 1 associated with (i) executive control and response suppression (i.e. lateral prefrontal cortex) and (ii) affective responses and value representation (i.e. orbitofrontal cortex), systematically covaried with behavioral ratings and amygdala activity obtained during Task 2. The present findings offer insights into the neural mechanisms linking inhibitory processes to affective responses.