Cognitive control of attention in the human brain: Insights from orienting attention to mental representations

Shifting attention between perception and working memory

Most everyday tasks require shifting the focus of attention between sensory signals in the external environment and internal contents in working memory. To date, shifts of attention have been investigated within each domain, but shifts between the external and internal domain remain poorly understood. We developed a combined perception and working-memory task to investigate and compare the consequences of shifting spatial attention within and between domains in the service of a common orientation-reproduction task. Participants were sequentially cued to attend to items either in working memory or to an upcoming sensory stimulation. Stay trials provided a baseline condition, while shift trials required participants to shift their attention to another item within the same or different domain. Validating our experimental approach, we found evidence that participants shifted attention effectively in either domain (Experiment 1). In addition, we observed greater costs when transitioning attention between as compared to within domains (Experiments 1, 2). Strikingly, these costs persisted even when participants were given more time to complete the attentional shift (Experiment 2). Biases in fixational gaze behaviour tracked attentional orienting in both domains, but revealed no latency or magnitude difference for within- versus between-domain shifts (Experiment 1). Collectively, the results from Experiments 1 and 2 suggest that shifting between attentional domains might be regulated by a unique control function. Our results break new ground for exploring the ubiquitous act of shifting attention between perception and working memory to guide adaptive behaviour in everyday cognition.

Comparing auditory and visual aspects of multisensory working memory using bimodally matched feature patterns

Working memory (WM) reflects the transient maintenance of information in the absence of external input, which can be attained via multiple senses separately or simultaneously. Pertaining to WM, the prevailing literature suggests the dominance of vision over other sensory systems. However, this imbalance may be stemming from challenges in finding comparable stimuli across modalities. Here, we addressed this problem by using a balanced multisensory retro-cue WM design, which employed combinations of auditory (ripple sounds) and visuospatial (Gabor patches) patterns, adjusted relative to each participant's discrimination ability. In three separate experiments, the participant was asked to determine whether the (retro-cued) auditory and/or visual items maintained in WM matched or mismatched the subsequent probe stimulus. In Experiment 1, all stimuli were audiovisual, and the probes were either fully mismatching, only partially mismatching, or fully matching the memorized item. Experiment 2 was otherwise same as Experiment 1, but the probes were unimodal. In Experiment 3, the participant was cued to maintain only the auditory or visual aspect of an audiovisual item pair. In two of the three experiments, the participant matching performance was significantly more accurate for the auditory than visual attributes of probes. When the perceptual and task demands are bimodally equated, auditory attributes can be matched to multisensory items in WM at least as accurately as, if not more precisely than, their visual counterparts.

Early top-down control of internal selection induced by retrospective cues in visual working memory: advantage of peripheral over central cues

Attention can be deployed among external sensory stimuli or internal working memory (WM) representations, and recent primate studies have revealed that these external and internal selections share a common neural basis in the prefrontal cortex (PFC). However, it remains to be elucidated how PFC implements these selections, especially in humans. The present study aimed to further investigate whether PFC responded differentially to the peripheral and central retrospective cues (retro-cues) that induced attention selection among WM representations. To achieve this, we combined magnetoencephalography (MEG, Experiment 1) and transcranial magnetic stimulation (TMS, Experiment 2) with an orientation-recall paradigm. Experiment 1 found that a peripheral retro-cue with 100% reliability had a greater benefit on WM performance than a central retro-cue, while this advantage of peripheral over central cues vanished when the cue reliability dropped to 50% (non-informative). MEG source analysis indicated that the 100% peripheral retro-cue elicited earlier (∼125 ms) PFC responses than the central retro-cue (∼275 ms). Meanwhile, Granger causality analysis showed that PFC had earlier (0-200 ms) top-down signals projecting to the superior parietal lobule (SPL) and the lateral occipital cortex (LOC) after the onset of peripheral retro-cues, while these top-down signals appeared later (300-500 ms) after the onset of central retro-cues. Importantly, PFC activity within this period of 300-500 ms correlated with the peripheral advantage in behavior. Moreover, Experiment 2 applied TMS at different time points to test the causal influence of brain activity on behavior and found that stimulating PFC at 100 ms abolished the behavioral benefit of the peripheral retro-cue, as well as its advantage over the central retro-cue. Taken together, our results suggested that the advantage of peripheral over central retro-cues in the mnemonic domain is realized through faster top-down control from PFC, which challenged traditional opinions that the top-down control of attention on WM required at least 300 ms to appear. The present study highlighted that in addition to the causal role of PFC in attention selection of WM representations, timing was critical as well and faster was better.

When the mind's eye prevails: The Internal Dominance over External Attention (IDEA) hypothesis

Throughout the 20th century, the psychological literature has considered attention as being primarily directed at the outside world. More recent theories conceive attention as also operating on internal information, and mounting evidence suggests a single, shared attentional focus between external and internal information. Such sharing implies a cognitive architecture where attention needs to be continuously shifted between prioritizing either external or internal information, but the fundamental principles underlying this attentional balancing act are currently unknown. Here, we propose and evaluate one such principle in the shape of the Internal Dominance over External Attention (IDEA) hypothesis: Contrary to the traditional view of attention as being primarily externally oriented, IDEA asserts that attention is inherently biased toward internal information. We provide a theoretical account for why such an internal attention bias may have evolved and examine findings from a wide range of literatures speaking to the balancing of external versus internal attention, including research on working memory, attention switching, visual search, mind wandering, sustained attention, and meditation. We argue that major findings in these disparate research lines can be coherently understood under IDEA. Finally, we consider tentative neurocognitive mechanisms contributing to IDEA and examine the practical implications of more deliberate control over this bias in the context of psychopathology. It is hoped that this novel hypothesis motivates cross-talk between the reviewed research lines and future empirical studies directly examining the mechanisms that steer attention either inward or outward on a moment-by-moment basis.

Switching between External and Internal Attention in Hippocampal Networks

Everyday experience requires processing external signals from the world around us and internal information retrieved from memory. To do both, the brain must fluctuate between states that are optimized for external versus internal attention. Here, we focus on the hippocampus as a region that may serve at the interface between these forms of attention and ask how it switches between prioritizing sensory signals from the external world versus internal signals related to memories and thoughts. Pharmacological, computational, and animal studies have identified input from the cholinergic basal forebrain as important for biasing the hippocampus toward processing external information, whereas complementary research suggests the dorsal attention network (DAN) may aid in allocating attentional resources toward accessing internal information. We therefore tested the hypothesis that the basal forebrain and DAN drive the hippocampus toward external and internal attention, respectively. We used data from 29 human participants (17 female) who completed two attention tasks during fMRI. One task (memory-guided) required proportionally more internal attention, and proportionally less external attention, than the other (explicitly instructed). We discovered that background functional connectivity between the basal forebrain and hippocampus was stronger during the explicitly instructed versus memory-guided task. In contrast, DAN-hippocampus background connectivity was stronger during the memory-guided versus explicitly instructed task. Finally, the strength of DAN-hippocampus background connectivity was correlated with performance on the memory-guided but not explicitly instructed task. Together, these results provide evidence that the basal forebrain and DAN may modulate the hippocampus to switch between external and internal attention.SIGNIFICANCE STATEMENT How does the brain balance the need to pay attention to internal thoughts and external sensations? We focused on the human hippocampus, a region that may serve at the interface between internal and external attention, and asked how its functional connectivity varies based on attentional states. The hippocampus was more strongly coupled with the cholinergic basal forebrain when attentional states were guided by the external world rather than retrieved memories. This pattern flipped for functional connectivity between the hippocampus and dorsal attention network, which was higher for attention tasks that were guided by memory rather than external cues. Together, these findings show that distinct networks in the brain may modulate the hippocampus to switch between external and internal attention.

Prioritizing flexible working memory representations through retrospective attentional strengthening

Previous work has proposed two potential benefits of retrospective attention on working memory (WM): target strengthening and non-target inhibition. It remains unknown which hypothesis contributes to the improved WM performance, yet the neural mechanisms responsible for this attentional benefit are unclear. Here, we recorded electroencephalography (EEG) signals while 33 participants performed a retrospective-cue WM task. Multivariate pattern classification analysis revealed that only representations of target features were enhanced by valid retrospective attention during retention, supporting the target strengthening hypothesis. Further univariate analysis found that mid-frontal theta inter-trial phase coherence (ITPC) and ERP components were modulated by valid retrospective attention and correlated with individual differences and moment-to-moment fluctuations on behavioral outcomes, suggesting that both trait- and state-level variability in attentional preparatory processes influence goal-directed behavior. Furthermore, task-irrelevant target spatial location could be decoded from EEG signals, indicating that enhanced spatial binding of target representation is vital to high WM precision. Importantly, frontoparietal theta-alpha phase-amplitude coupling was increased by valid retrospective attention and predicted the reduced random guessing rates. This long-range connection supported top-down information flow in the engagement of frontoparietal networks, which might organize attentional states to integrate target features. Altogether, these results provide neurophysiological bases that retrospective attention improves WM precision by enhancing flexible target representation and emphasize the critical role of the frontoparietal attentional network in the control of WM representations.

Visual working memory representations bias attention more when they are the target of an action plan

Attention has frequently been regarded as an emergent property of linking sensory representations to action plans. It has recently been proposed that similar mechanisms may operate within visual working memory (VWM), such that linking an object in VWM to an action plan strengthens its sensory memory representation, which then expresses as an attentional bias. Here we directly tested this hypothesis by comparing attentional biases induced by VWM representations which were the target of a future action, to those induced by VWM representations that were equally task-relevant, but not the direct target of action. We predicted that the first condition would result in a more prioritized memory state and hence stronger attentional biases. Specifically, participants memorized a geometric shape for a subsequent memory test. At test, in case of a match, participants either had to perform a grip movement on the matching object (action condition), or perform the same movement, but on an unrelated object (control condition). To assess any attentional biases, during the delay period between memorandum and test, participants performed a visual selection task in which either the target was surrounded by the memorized shape (congruent trials) or a distractor (incongruent trials). Eye movements were measured as a proxy for attentional priority. We found a significant interaction for saccade latencies between action condition and shape congruency, reflecting more pronounced VWM-based attentional biases in the action condition. Our results are consistent with the idea that action plans prioritize sensory representations in VWM.

Sensory Delay Activity: More than an Electrophysiological Index of Working Memory Load

Sustained contralateral delay activity emerges in the retention period of working memory (WM) tasks and has been commonly interpreted as an electrophysiological index of the number of items held in a discrete-capacity WM resource. More recent findings indicate that these visual and tactile components are sensitive to various cognitive operations beyond the storage of discrete items in WM. In this Perspective, we present recent evidence from unisensory and multisensory visual and tactile WM tasks suggesting that, in addition to memory load, sensory delay activity may also be indicative of attentional and executive processes, as well as reflecting the flexible, rather than discrete, allocation of a continuous WM resource. Together, these findings challenge the traditional model of the functional significance of the contralateral delay activity as a pure measure of item load, and suggest that it may also reflect executive, attentional, and perceptual mechanisms operating in hierarchically organized WM systems.

Attentional Orienting in Working Memory in Children with ADHD

Children with attentional-deficit/hyperactivity disorder (ADHD) have impairments in working memory (WM) functioning. Impaired orienting of visual attention during encoding and/or maintenance is hypothesized as the cause of poor performance in visuospatial WM in 10-to-16-year-olds. We used a color-recognition task with valid location cues before encoding (pre-cues) and during maintenance (retro-cues). If ADHD children have an orienting deficit during these processing stages, they should not benefit from the cues. We observed strong pre- and retro-cueing benefits both for ADHD and typically developing controls, with no differences between the groups. This strengthens findings showing that ADHD is not characterized by deficits in orienting attention and provides evidence of retro-cue benefits in this population.

The Influence of Active Removal from Working Memory on Serial Dependence

Flexible control of the contents of working memory (WM) includes removing no-longer-relevant information. Although simply withdrawing attention offers a “passive” mechanism, empirical findings suggest that it is also possible to actively remove information from WM. In this Registered Report we tested evidence that the bias (serial dependence) that an item exerts on the subsequent trial will be opposite in sign—attraction vs. repulsion — depending on whether it was passively or actively removed, respectively. A repulsive bias would be consistent with a specific mechanism for active removal: a rapid adaptation-like modification of perceptual circuitry. In a preliminary study, trials of two types were administered in pairs, multi-item WM followed by 1-item delayed recall, and we evaluated serial dependence of the latter on items from the former. In the first trial of each pair, two memoranda were presented, then one was designated irrelevant, then a third memorandum was presented. The critical manipulation was whether the third item was presented at the same location as the now “irrelevant memory item” (IMI). Overlap between the two should prompt the active removal of the IMI, whereas nonoverlap might prompt just the withdrawal of attention. Whereas the IMI exerted the expected attractive bias on 1-item recall in the no-overlap condition, we found an (unexpected) repulsive bias in the overlap condition. Because repulsive biases have been attributed to the adaptation-like modification of perceptual circuitry, replication of this result in this Registered Report would provide independent evidence for this mechanism for active removal from WM. Interpretation of the Stage 2 results are complicated by the fact that the approved Registered Report, carried out online, generated data that failed to meet a basic sanity check, and were therefore uninterpretable. Consequently, a follow-up lab-based experiment using procedures similar to the Registered Report generated results consistent with the hypothesis of principal theoretical interest: The IMI in the overlap condition exerted a repulsive bias on the subsequent trial.

Distributed networks for auditory memory differentially contribute to recall precision

Re-directing attention to objects in working memory can enhance their representational fidelity. However, how this attentional enhancement of memory representations is implemented across distinct, sensory and cognitive-control brain network is unspecified. The present fMRI experiment leverages psychophysical modelling and multivariate auditory-pattern decoding as behavioral and neural proxies of mnemonic fidelity. Listeners performed an auditory syllable pitch-discrimination task and received retro-active cues to selectively attend to a to-be-probed syllable in memory. Accompanied by increased neural activation in fronto-parietal and cingulo-opercular networks, valid retro-cues yielded faster and more perceptually sensitive responses in recalling acoustic detail of memorized syllables. Information about the cued auditory object was decodable from hemodynamic response patterns in superior temporal sulcus (STS), fronto-parietal, and sensorimotor regions. However, among these regions retaining auditory memory objects, neural fidelity in the left STS and its enhancement through attention-to-memory best predicted individuals' gain in auditory memory recall precision. Our results demonstrate how functionally discrete brain regions differentially contribute to the attentional enhancement of memory representations.

Mnemonic attention in analogy to perceptual attention: harmony but not uniformity

It has been found that a spatial cue in perception causes benefits through target facilitation at low external noise but noise reduction at high external noise. Assuming that mnemonic attention is similar to perceptual attention, we propose that how a spatial retro-cue is used depends on internal noise. To test this hypothesis, we manipulated internal noise with memory load. We focused on questioning whether/why there was a difference between peripheral and central retro-cues at low or high internal noise. In Experiments 1 and 2, we consistently found that peripheral retro-cues were more effective than central retro-cues at low internal noise. Results from Experiments 3-5 showed that this difference was due to a voluntary process of target facilitation, which happened much earlier on peripheral than central retro-cue trials. These findings are consistent with the hypothesis and indicated that mnemonic attention and perceptual attention could be incorporated into one framework. Nevertheless, spatial retro-cues, including peripheral ones, relied on voluntary control to become effective, different from peripheral cues in perception. To conclude, our findings suggest that the effects of spatial cues on memory and perception are similar but not identical.

O Papel da Atenção na Manutenção da Informação Visuoespacial na Memória Operacional

Resumo A memória operacional ainda apresenta várias questões pouco compreendidas. O presente estudo teve como objetivo investigar a eficiência de retrodicas atentivas no processo de manutenção da informação visuoespacial na memória operacional. Foram delineados dois experimentos, definidos por uma tarefa única (memorização) ou dupla (memorização e busca visual). Os resultados sugerem que o efeito da retrodica informativa proporcionou uma melhora na probabilidade de recuperação da informação memorizada na presença ou na ausência da tarefa de busca visual, mesmo em condições que a busca era iniciada 50 ms após a apresentação da retrodica. Esse resultado é discutido em termos de um processo de múltiplas etapas no processo de alocação da atenção na memória operacional visual.

Age Differences in the Efficiency of Filtering and Ignoring Distraction in Visual Working Memory

Healthy aging is associated with decline in the ability to maintain visual information in working memory (WM). We examined whether this decline can be explained by decreases in the ability to filter distraction during encoding or to ignore distraction during memory maintenance. Distraction consisted of irrelevant objects (Exp. 1) or irrelevant features of an object (Exp. 2). In Experiment 1, participants completed a spatial WM task requiring remembering locations on a grid. During encoding or during maintenance, irrelevant distractor positions were presented. In Experiment 2, participants encoded either single-feature (colors or orientations) or multifeature objects (colored triangles) and later reproduced one of these features using a continuous scale. In multifeature blocks, a precue appeared before encoding or a retrocue appeared during memory maintenance indicating with 100% certainty to the to-be-tested feature, thereby enabling filtering and ignoring of the irrelevant (not-cued) feature, respectively. There were no age-related deficits in the efficiency of filtering and ignoring distractor objects (Exp. 1) and of filtering irrelevant features (Exp. 2). Both younger and older adults could not ignore irrelevant features when cued with a retrocue. Overall, our results provide no evidence for an aging deficit in using attention to manage visual WM.

Neural activity underlying the detection of an object movement by an observer during forward self-motion: Dynamic decoding and temporal evolution of directional cortical connectivity

Relatively little is known about how the human brain identifies movement of objects while the observer is also moving in the environment. This is, ecologically, one of the most fundamental motion processing problems, critical for survival. To study this problem, we used a task which involved nine textured spheres moving in depth, eight simulating the observer's forward motion while the ninth, the target, moved independently with a different speed towards or away from the observer. Capitalizing on the high temporal resolution of magnetoencephalography (MEG) we trained a Support Vector Classifier (SVC) using the sensor-level data to identify correct and incorrect responses. Using the same MEG data, we addressed the dynamics of cortical processes involved in the detection of the independently moving object and investigated whether we could obtain confirmatory evidence for the brain activity patterns used by the classifier. Our findings indicate that response correctness could be reliably predicted by the SVC, with the highest accuracy during the blank period after motion and preceding the response. The spatial distribution of the areas critical for the correct prediction was similar but not exclusive to areas underlying the evoked activity. Importantly, SVC identified frontal areas otherwise not detected with evoked activity that seem to be important for the successful performance in the task. Dynamic connectivity further supported the involvement of frontal and occipital-temporal areas during the task periods. This is the first study to dynamically map cortical areas using a fully data-driven approach in order to investigate the neural mechanisms involved in the detection of moving objects during observer's self-motion.

Cognitive focus affects spatial decisions under conditions of uncertainty

Finding one’s way to a destination is a common, everyday task that often relies on spatial information provided by humans and/or automatic devices. However, the information can be inaccurate. How we decide which route to take will depend on our thoughts about the available route information, including who or what provided it, and how these sources may be associated with differential accuracy and fallibility. In three experiments (previously reported in Brunyé et al. (Q J Exper Psychol 68(3):585–607, 2015)), we found that when route directions conflicted with the perceived environment, people trusted the landmark information other humans provided, but relied on the turn direction information from an automatic device. But what guides these behavioral results? Here we present a systematic linguistic analysis of retrospective reports that sheds some light on how information about the direction source affects cognitive focus. A focus on direction sources in the instruction triggered a cognitive focus on the direction source throughout. Participants who systematically switched strategies focused more on features of the scenario than those who did not. Non-switching strategies were associated with a higher focus on the participants’ own reasoning processes, in particular when relying on turn information. These results highlight how cognitive focus is guided by scenario factors and individual preferences, triggering inferences that influence decisions.

Retrospective Selection in Visual and Tactile Working Memory Is Mediated by Shared Control Mechanisms

Selective attention regulates the activation of working memory (WM) representations. Retro-cues, presented after memory sample stimuli have been stored, modulate these activation states by triggering shifts of attention to task-relevant samples. Here, we investigated whether the control of such attention shifts is modality-specific or shared across sensory modalities. Participants memorized bilateral tactile and visual sample stimuli before an auditory retro-cue indicated which visual and tactile stimuli had to be retained. Critically, these cued samples were located on the same side or opposite sides, thus requiring spatially congruent or incongruent attention shifts in tactile and visual WM. To track the attentional selection of retro-cued samples, tactile and visual contralateral delay activities (tCDA and CDA components) were measured. Clear evidence for spatial synergy effects from attention shifts in visual WM on concurrent shifts in tactile WM were observed: Tactile WM performance was impaired, and tCDA components triggered by retro-cues were strongly attenuated on opposite-sides relative to same-side trials. These spatial congruency effects were eliminated when cued attention shifts in tactile WM occurred in the absence of simultaneous shifts within visual WM. Results show that, in contrast to other modality-specific aspects of WM control, concurrent attentional selection processes within tactile and visual WM are mediated by shared supramodal control processes.

Visual working memory directly alters perception

Visual working memory (VWM), the ability to temporarily maintain and manipulate information, underlies a variety of critical high-level behaviours from directing attention^1-4 to making complex decisions⁵. Here we show that its impact extends to even the most basic levels of perceptual processing, directly interacting with and even distorting the physical appearance of visual features. This interference results from and can be predicted by the recruitment of posterior perceptual cortices to maintain information in VWM^6-9, which causes an overlap with the neuronal populations supporting perceptual processing^10-15. Across three sets of experiments, we demonstrated bidirectional interference between VWM and low-level perception. Specifically, for both maintained colours and orientations, presenting a distractor created bias in VWM representation depending on the similarity between incoming and maintained information, consistent with the known tuning curves for these features. Moreover, holding an item in mind directly altered the appearance of new stimuli, demonstrated by changes in psychophysical discrimination thresholds. Thus, as a consequence of sharing the early visual cortices, what you see and what you are holding in mind are intertwined at even the most fundamental stages of processing.

Functionally distinct contributions of parietal cortex to a numerical landmark task: An fMRI study

This study aimed at establishing the neural basis of magnitude processing of multiple numbers from working memory. We designed a numerical landmark task and embedded it in a fragmented trial event-related fMRI design, allowing to separate encoding from decision processing. An attentional localiser task not involving numbers allowed further functional specification. The results show that in a numerical landmark task the right anterior intraparietal sulcus is involved in number encoding while more posterior parietal regions, bilateral superior parietal lobule and right inferior parietal lobule, provide domain-general support in the form of constructing a working memory representation or orienting spatial attention within that mental representation during number comparison. The results are in line with earlier studies reporting a functional distinction between anterior and posterior parietal contributions to number processing and further specify their role at a functional level.

Neural correlates of active controlled retrieval development: An exploratory ERP study

Working memory is composed of different processes and encompasses not only the temporary storage of information but also its manipulation in order to perform complex cognitive activities. During childhood, one of these manipulation processes, namely active controlled retrieval, improves significantly between the age of 6 to 10, suggesting that the neuronal network supporting this function undergoes substantial maturational changes. The present study examined the neural activity of 14 healthy children and 14 adults while performing an active controlled retrieval task. Results showed differences in brain activity according to active controlled retrieval in a 300-500 ms window corresponding to the retrieval period. Active controlled retrieval was associated with a P3b-like potential in parietal sites for both children and adults. In fronto-central sites, children demonstrated a "N400 like" potential associated with active retrieval processing. These results are discussed in terms of maturational development.

Independent Attention Mechanisms Control the Activation of Tactile and Visual Working Memory Representations

Working memory (WM) is limited in capacity, but it is controversial whether these capacity limitations are domain-general or are generated independently within separate modality-specific memory systems. These alternative accounts were tested in bimodal visual/tactile WM tasks. In Experiment 1, participants memorized the locations of simultaneously presented task-relevant visual and tactile stimuli. Visual and tactile WM load was manipulated independently (one, two, or three items per modality), and one modality was unpredictably tested after each trial. To track the activation of visual and tactile WM representations during the retention interval, the visual contralateral delay activity (CDA) and tactile CDA (tCDA) were measured over visual and somatosensory cortex, respectively. CDA and tCDA amplitudes were selectively affected by WM load in the corresponding (tactile or visual) modality. The CDA parametrically increased when visual load increased from one to two and to three items. The tCDA was enhanced when tactile load increased from one to two items and showed no further enhancement for three tactile items. Critically, these load effects were strictly modality-specific, as substantiated by Bayesian statistics. Increasing tactile load did not affect the visual CDA, and increasing visual load did not modulate the tCDA. Task performance at memory test was also unaffected by WM load in the other (untested) modality. This was confirmed in a second behavioral experiment where tactile and visual loads were either two or four items, unimodal baseline conditions were included, and participants performed a color change detection task in the visual modality. These results show that WM capacity is not limited by a domain-general mechanism that operates across sensory modalities. They suggest instead that WM storage is mediated by distributed modality-specific control mechanisms that are activated independently and in parallel during multisensory WM.

The precision of spatial selection into the focus of attention in working memory

Attention helps manage the information held in visual working memory (vWM). Perceptual attention selects the stimuli to be represented in vWM, whereas internal attention prioritizes information already in vWM. In the present study we assessed the spatial precision of perceptual and internal attention in vWM. Participants encoded eight colored dots for a local-recognition test. To manipulate attention, a cue indicated the item most likely to be tested (~65% validity). The cue appeared either before the onset of the memory array (precue) or during the retention interval (retrocue). The precue guides perceptual attention to gate encoding into vWM, whereas the retrocue guides internal attention to prioritize the cued item within vWM. If attentional selection is spatially imprecise, attention should be preferentially allocated to the cued location, with a gradual drop-off of attention over space to nearby uncued locations. In this case, memory for uncued locations should vary as a function of their distance from the cued location. As compared to a no-cue condition, memory was better for validly cued items but worse for uncued items. The spatial distance between the uncued and cued locations modulated the cuing costs: Items close in space to the cued location were insulated from cuing costs. The extension of this spatial proximity effect was larger for precues than for retrocues, mostly because the benefits of attention were larger for precues. These results point to similar selection principles between perceptual and internal attention and to a critical role of spatial distance in the selection of visual representations.

Anomalous network architecture of the resting brain in children who stutter

PURPOSE

We combined a large longitudinal neuroimaging dataset that includes children who do and do not stutter and a whole-brain network analysis in order to examine the intra- and inter-network connectivity changes associated with stuttering. Additionally, we asked whether whole brain connectivity patterns observed at the initial year of scanning could predict persistent stuttering in later years.

METHODS

A total of 224 high-quality resting state fMRI scans collected from 84 children (42 stuttering, 42 controls) were entered into an independent component analysis (ICA), yielding a number of distinct network connectivity maps ("components") as well as expression scores for each component that quantified the degree to which it is expressed for each child. These expression scores were compared between stuttering and control groups' first scans. In a second analysis, we examined whether the components that were most predictive of stuttering status also predicted persistence in stuttering.

RESULTS

Stuttering status, as well as stuttering persistence, were associated with aberrant network connectivity involving the default mode network and its connectivity with attention, somatomotor, and frontoparietal networks. The results suggest developmental alterations in the balance of integration and segregation of large-scale neural networks that support proficient task performance including fluent speech motor control.

CONCLUSIONS

This study supports the view that stuttering is a complex neurodevelopmental disorder and provides comprehensive brain network maps that substantiate past theories emphasizing the importance of considering situational, emotional, attentional and linguistic factors in explaining the basis for stuttering onset, persistence, and recovery.

Salience of Somatosensory Stimulus Modulating External-to-Internal Orienting Attention

Shifting between one’s external and internal environments involves orienting attention. Studies on differentiating subprocesses associated with external-to-internal orienting attention are limited. This study aimed to reveal the characteristics of the disengagement, shifting and reengagement subprocesses by using somatosensory external stimuli and internally generated images. Study participants were to perceive nociceptive external stimuli (External Low (E_L) or External High (E_H)) induced by electrical stimulations (50 ms) followed by mentally rehearsing learned subnociceptive images (Internal Low (I_L) and Internal High (I_H)). Behavioral responses and EEG signals of the participants were recorded. The three significant components elicited were: fronto-central negativity (FCN; 128–180 ms), fronto-central P2 (200–260 ms), and central P3 (320–380 ms), which reflected the three subprocesses, respectively. Differences in the FCN and P2 amplitudes during the orienting to the subnociceptive images revealed only in the E_H but not E_L stimulus condition that are new findings. The results indicated that modulations of the disengagement and shifting processes only happened if the external nociceptive stimuli were of high salience and the external-to-internal incongruence was large. The reengaging process reflected from the amplitude of P3 correlated significantly with attenuation of the pain intensity felt from the external nociceptive stimuli. These findings suggested that the subprocesses underlying external-to-internal orienting attention serve different roles. Disengagement subprocess tends to be stimulus dependent, which is bottom-up in nature. Shifting and reengagement tend to be top-down subprocesses, which taps on cognitive control. This subprocess may account for the attenuation effects on perceived pain intensity after orienting attention.

Working memory accuracy for multiple targets is driven by reward expectation and stimulus contrast with different time-courses

The richness of sensory input dictates that the brain must prioritize and select information for further processing and storage in working memory. Stimulus salience and reward expectations influence this prioritization but their relative contributions and underlying mechanisms are poorly understood. Here we investigate how the quality of working memory for multiple stimuli is determined by priority during encoding and later memory phases. Selective attention could, for instance, act as the primary gating mechanism when stimuli are still visible. Alternatively, observers might still be able to shift priorities across memories during maintenance or retrieval. To distinguish between these possibilities, we investigated how and when reward cues determine working memory accuracy and found that they were only effective during memory encoding. Previously learned, but currently non-predictive, color-reward associations had a similar influence, which gradually weakened without reinforcement. Finally, we show that bottom-up salience, manipulated through varying stimulus contrast, influences memory accuracy during encoding with a fundamentally different time-course than top-down reward cues. While reward-based effects required long stimulus presentation, the influence of contrast was strongest with brief presentations. Our results demonstrate how memory resources are distributed over memory targets and implicates selective attention as a main gating mechanism between sensory and memory systems.

Prioritizing Information during Working Memory: Beyond Sustained Internal Attention

Working memory (WM) has limited capacity. This leaves attention with the important role of allowing into storage only the most relevant information. It is increasingly evident that attention is equally crucial for prioritizing representations within WM as the importance of individual items changes. Retrospective prioritization has been proposed to result from a focus of internal attention highlighting one of several representations. Here, we suggest an updated model, in which prioritization acts in multiple steps: first orienting towards and selecting a memory, and then reconfiguring its representational state in the service of upcoming task demands. Reconfiguration sets up an optimized perception-action mapping, obviating the need for sustained attention. This view is consistent with recent literature, makes testable predictions, and links WM with task switching and action preparation.

Intermodal Attention Shifts in Multimodal Working Memory

Attention maintains task-relevant information in working memory (WM) in an active state. We investigated whether the attention-based maintenance of stimulus representations that were encoded through different modalities is flexibly controlled by top–down mechanisms that depend on behavioral goals. Distinct components of the ERP reflect the maintenance of tactile and visual information in WM. We concurrently measured tactile (tCDA) and visual contralateral delay activity (CDA) to track the attentional activation of tactile and visual information during multimodal WM. Participants simultaneously received tactile and visual sample stimuli on the left and right sides and memorized all stimuli on one task-relevant side. After 500 msec, an auditory retrocue indicated whether the sample set's tactile or visual content had to be compared with a subsequent test stimulus set. tCDA and CDA components that emerged simultaneously during the encoding phase were consistently reduced after retrocues that marked the corresponding (tactile or visual) modality as task-irrelevant. The absolute size of cue-dependent modulations was similar for the tCDA/CDA components and did not depend on the number of tactile/visual stimuli that were initially encoded into WM. Our results suggest that modality-specific maintenance processes in sensory brain regions are flexibly modulated by top–down influences that optimize multimodal WM representations for behavioral goals.

Attentional Modulation of Change Detection ERP Components by Peripheral Retro-Cueing

Change detection is essential for visual perception and performance in our environment. However, observers often miss changes that should be easily noticed. A failure in any of the processes involved in conscious detection (encoding the pre-change display, maintenance of that information within working memory, and comparison of the pre and post change displays) can lead to change blindness. Given that unnoticed visual changes in a scene can be easily detected once attention is drawn to them, it has been suggested that attention plays an important role on visual awareness. In the present study, we used behavioral and electrophysiological (ERPs) measures to study whether the manipulation of retrospective spatial attention affects performance and modulates brain activity related to the awareness of a change. To that end, exogenous peripheral cues were presented during the delay period (retro-cues) between the first and the second array using a one-shot change detection task. Awareness of a change was associated with a posterior negative amplitude shift around 228–292 ms (“Visual Awareness Negativity”), which was independent of retrospective spatial attention, as it was elicited to both validly and invalidly cued change trials. Change detection was also associated with a larger positive deflection around 420–580 ms (“Late Positivity”), but only when the peripheral retro-cues correctly predicted the change. Present results confirm that the early and late ERP components related to change detection can be functionally dissociated through manipulations of exogenous retro-cueing using a change blindness paradigm.

Hemispheric lateralization of resting-state functional connectivity of the ventral striatum: an exploratory study

Resting-state functional connectivity (rsFC) is widely used to examine cerebral functional organization. The ventral striatum (VS) is critical to motivated behavior, with extant studies suggesting functional hemispheric asymmetry. The current work investigated differences in rsFC between the left (L) and right (R) VS and explored gender differences in the extent of functional lateralization. In 106 adults, we computed a laterality index (fcLI) to query whether a target region shows greater or less connectivity to the L vs R VS. A total of 45 target regions with hemispheric masks were examined from the Automated Anatomic Labeling atlas. One-sample t test was performed to explore significant laterality in the whole sample and in men and women separately. Two-sample t test was performed to examine gender differences in fcLI. At a corrected threshold (p < 0.05/45 = 0.0011), the dorsomedial prefrontal cortex (dmPFC) and posterior cingulate cortex (pCC) showed L lateralization and the intraparietal sulcus (IPS) and supramarginal gyrus (SMG) showed R lateralization in VS connectivity. Except for the pCC, these findings were replicated in a different data set (n = 97) from the Human Connectome Project. Furthermore, the fcLI of VS-pCC was negatively correlated with a novelty seeking trait in women but not in men. Together, the findings may suggest a more important role of the L VS in linking saliency response to self control and other internally directed processes. Right lateralization of VS connectivity to the SMG and IPS may support attention and action directed to external behavioral contingencies.

Development and Validation of the Way-Finding Ability Scale for Middle-Aged and Older Adults

Background and Purpose

This study was performed to newly develop the Way-Finding Ability Scale (WFAS) for middle-aged and older adults and validate its clinical utility.

Methods

The participants for verifying construct validity included 324 adults aged from 45 to 79 years, and 22 normal old adults without way-finding deficit (WFD), 41 amnestic mild cognitive impairment (aMCI), and 35 patients with Parkinson's disease (PD-MCI) for verifying discriminant validity. All participants were administered the newly constructed 28-item WFAS.

Results

Exploratory factor analysis of the WFAS revealed a four-factor solution (sense of direction and inattention, spatial learning and memory, strategic ability, and cardinal direction). This four-factor structure was confirmed by confirmatory factor analysis. The discriminant validity was examined by administering the WFAS to normal older adults and two patient groups (aMCI & PD-MCI). The results showed that the total scores of two patient groups were lower than that of normal older adults. The patients with WFD had significantly lower total scores than those without WFD. Interestingly, the total scores of patients without WFD were significantly lower than those of normal older adults suggesting that the cognitive functions associated with way-finding ability (WFA) were partially impaired in aMCI and PD-MCI patients without apparent WFD. The patients with WFD had consistently lower scores in every four-factor than those without WFD.

Conclusions

These results indicated that the WFAS assesses the WFD reliably as well as estimates the degree of decline in WFA.

Filtering and storage working memory networks in younger and older age

INTRODUCTION

Working memory (WM) is a multi-component model that among others involves the two processes of filtering and storage. The first reflects the necessity to inhibit irrelevant information from entering memory, whereas the latter refers to the active maintenance of object representations in memory. In this study, we aimed at a) redefining the neuronal networks sustaining filtering and storage within visual working memory by avoiding shortcomings of prior studies, and b) assessing age-related changes in these networks.

METHODS

We designed a new paradigm that strictly controlled for perceptual load by presenting the same number of stimuli in each of three conditions. We calculated fMRI contrasts between a baseline condition (low filter and low storage load) and conditions that posed high demands on filtering and storage, respectively, in large samples of younger (n = 40) and elder (n = 38) participants.

RESULTS

Our approach of comparing contrasts between groups revealed more extensive filter and storage WM networks than previous studies. In the younger group, filtering involved the bilateral insulae, the right occipital cortex, the right brainstem, and the right cerebellum. In the elder group, filtering was associated with the bilateral insulae, right precuneus, and bilateral ventromedial prefrontal cortex. An extensive neuronal network was also found during storage of information in the bilateral posterior parietal cortex, the left ventromedial prefrontal cortex, and the right precuneus in the younger participants. In addition to these brain regions, elder participants recruited the bilateral ventral prefrontal cortex, the superior, middle and inferior and temporal cortex, the left cingulum and the bilateral parahippocampal cortex.

CONCLUSIONS

In general, elder participants recruited more brain regions in comparison to younger participants to reach similar accuracy levels. Furthermore, in elder participants one brain region emerged in both contrasts, namely the left ventromedial prefrontal cortex. Hence, elder participants seem to routinely recruit this brain region in demanding tasks, irrespective of whether filtering or storing is challenged.

Retrospective Attention Interacts with Stimulus Strength to Shape Working Memory Performance

Orienting attention retrospectively to selective contents in working memory (WM) influences performance. A separate line of research has shown that stimulus strength shapes perceptual representations. There is little research on how stimulus strength during encoding shapes WM performance, and how effects of retrospective orienting might vary with changes in stimulus strength. We explore these questions in three experiments using a continuous-recall WM task. In Experiment 1 we show that benefits of cueing spatial attention retrospectively during WM maintenance (retrocueing) varies according to stimulus contrast during encoding. Retrocueing effects emerge for supraliminal but not sub-threshold stimuli. However, once stimuli are supraliminal, performance is no longer influenced by stimulus contrast. In Experiments 2 and 3 we used a mixture-model approach to examine how different sources of error in WM are affected by contrast and retrocueing. For high-contrast stimuli (Experiment 2), retrocues increased the precision of successfully remembered items. For low-contrast stimuli (Experiment 3), retrocues decreased the probability of mistaking a target with distracters. These results suggest that the processes by which retrospective attentional orienting shape WM performance are dependent on the quality of WM representations, which in turn depends on stimulus strength during encoding.

Rapid forgetting results from competition over time between items in visual working memory

Working memory is now established as a fundamental cognitive process across a range of species. Loss of information held in working memory has the potential to disrupt many aspects of cognitive function. However, despite its significance, the mechanisms underlying rapid forgetting remain unclear, with intense recent debate as to whether it is interference between stored items that leads to loss of information or simply temporal decay. Here we show that both factors are essential and interact in a highly specific manner. Although a single item can be maintained in memory with high fidelity, multiple items compete in working memory, progressively degrading each other’s representations as time passes. Specifically, interaction between items is associated with both worsening precision and increased reporting errors of object features over time. Importantly, during the period of maintenance, although items are no longer visible, maintenance resources can be selectively redeployed to protect the probability to recall the correct feature and the precision with which cued items can be recalled, as if it was the only item in memory. These findings reveal that the biased competition concept could be applied not only to perceptual processes but also to active maintenance of working memory representations over time.

Different Cortical Mechanisms for Spatial vs. Feature-Based Attentional Selection in Visual Working Memory

The limited capacity of visual working memory (VWM) necessitates attentional mechanisms that selectively update and maintain only the most task-relevant content. Psychophysical experiments have shown that the retroactive selection of memory content can be based on visual properties such as location or shape, but the neural basis for such differential selection is unknown. For example, it is not known if there are different cortical modules specialized for spatial vs. feature-based mnemonic attention, in the same way that has been demonstrated for attention to perceptual input. Here, we used transcranial magnetic stimulation (TMS) to identify areas in human parietal and occipital cortex involved in the selection of objects from memory based on cues to their location (spatial information) or their shape (featural information). We found that TMS over the supramarginal gyrus (SMG) selectively facilitated spatial selection, whereas TMS over the lateral occipital cortex (LO) selectively enhanced feature-based selection for remembered objects in the contralateral visual field. Thus, different cortical regions are responsible for spatial vs. feature-based selection of working memory representations. Since the same regions are involved in terms of attention to external events, these new findings indicate overlapping mechanisms for attentional control over perceptual input and mnemonic representations.

Explaining the U-Shaped Development of Intent-Based Moral Judgments

When preschoolers evaluate actions and agents, they typically neglect agents' intentions and focus on action outcomes instead. By contrast, intentions count much more than outcomes for older children and adults. This phenomenon has traditionally been seen as evidence of a developmental change in children's concept of what is morally good and bad. However, a growing number of studies shows that infants are able to reason about agents' intentions and take them into account in their spontaneous socio-moral evaluations. Here we argue that this puzzling U-shaped trajectory in children's judgments is best accounted for by a model that posits developmental continuity in moral competence and emphasizes the effect of immature executive function skills on preschoolers' performance.

The many faces of anxiety-neurobiological correlates of anxiety phenotypes

Anxiety is an all-inclusive concept incorporating somatic symptoms (palpitations, dizziness, dyspnea), emotional and cognitive elements (negative affect, fear, worry, rumination) and behavioral components (e.g., avoidance). The aim of this study was to examine the specific neural correlates associated with anxiety phenotypes (worry, rumination, somatic anxiety) and negative affect (neuroticism). Twenty-nine anxious participants and 30 healthy controls were included in the study. We analyzed seed-based intrinsic connectivity and used correlation maps in a multivariable regression model to describe the specific effect of each anxiety phenotype independently of the effects of age and the other measures of anxiety. Worry severity was uniquely correlated with increased intrinsic connectivity between right anterior insula (RAI) and the precuneus. Global and somatic anxiety were associated with the limbic and paralimbic structures (increased connectivity between the amygdala, PVN, and hippocampus), while neuroticism was correlated with increased connectivity between limbic and prefrontal structures. Rumination severity did not correlate significantly with any measures of functional connectivity once we controlled for other clinical measures of anxiety. Measures of worry, global anxiety, somatic anxiety, and neuroticism have distinct 'neural signatures'. These results advocate for a fine-grain approach when analyzing the neural substrates of clinical samples with various anxiety disorders.

Mental Imagery and Post-Traumatic Stress Disorder: A Neuroimaging and Experimental Psychopathology Approach to Intrusive Memories of Trauma

This hypothesis and theory paper presents a pragmatic framework to help bridge the clinical presentation and neuroscience of intrusive memories following psychological trauma. Intrusive memories are a hallmark symptom of post-traumatic stress disorder (PTSD). However, key questions, including those involving etiology, remain. In particular, we know little about the brain mechanisms involved in why only some moments of the trauma return as intrusive memories while others do not. We first present an overview of the patient experience of intrusive memories and the neuroimaging studies that have investigated intrusive memories in PTSD patients. Next, one mechanism of how to model intrusive memories in the laboratory, the trauma film paradigm, is examined. In particular, we focus on studies combining the trauma film paradigm with neuroimaging. Stemming from the clinical presentation and our current understanding of the processes involved in intrusive memories, we propose a framework in which an intrusive memory comprises five component parts; autobiographical (trauma) memory, involuntary recall, negative emotions, attention hijacking, and mental imagery. Each component part is considered in turn, both behaviorally and from a brain imaging perspective. A mapping of these five components onto our understanding of the brain is described. Unanswered questions that exist in our understanding of intrusive memories are considered using the proposed framework. Overall, we suggest that mental imagery is key to bridging the experience, memory, and intrusive recollection of the traumatic event. Further, we suggest that by considering the brain mechanisms involved in the component parts of an intrusive memory, in particular mental imagery, we may be able to aid the development of a firmer bridge between patients' experiences of intrusive memories and the clinical neuroscience behind them.

Lateralized delay period activity marks the focus of spatial attention in working memory: evidence from somatosensory event-related brain potentials

The short-term retention of sensory information in working memory (WM) is known to be associated with a sustained enhancement of neural activity. What remains controversial is whether this neural trace indicates the sustained storage of information or the allocation of attention. To evaluate the storage and attention accounts, we examined sustained tactile contralateral delay activity (tCDA component) of the event-related potential. The tCDA manifests over somatosensory cortex contralateral to task-relevant tactile information during stimulus retention. Two tactile sample sets (S1, S2) were presented sequentially, separated by 1.5 s. Each set comprised two stimuli, one per hand. Human participants memorized the location of one task-relevant stimulus per sample set and judged whether one of these locations was stimulated again at memory test. The two relevant pulses were unpredictably located on the same hand (stay trials) or on different hands (shift trials). Initially, tCDA components emerged contralateral to the relevant S1 pulse. Sequential loading of WM enhanced the tCDA after S2 was presented on stay trials. On shift trials, the tCDA's polarity reversed after S2 presentation, resulting in delay activity that was now contralateral to the task-relevant S2 pulse. The disappearance of a lateralized neural trace for the relevant S1 pulse did not impair memory accuracy for this stimulus on shift trials. These results contradict the storage account and suggest that delay period activity indicates the sustained engagement of an attention-based rehearsal mechanism. In conclusion, somatosensory delay period activity marks the current focus of attention in tactile WM.

Sustained maintenance of somatotopic information in brain regions recruited by tactile working memory

To adaptively guide ongoing behavior, representations in working memory (WM) often have to be modified in line with changing task demands. We used event-related potentials (ERPs) to demonstrate that tactile WM representations are stored in modality-specific cortical regions, that the goal-directed modulation of these representations is mediated through hemispheric-specific activation of somatosensory areas, and that the rehearsal of somatotopic coordinates in memory is accomplished by modality-specific spatial attention mechanisms. Participants encoded two tactile sample stimuli presented simultaneously to the left and right hands, before visual retro-cues indicated which of these stimuli had to be retained to be matched with a subsequent test stimulus on the same hand. Retro-cues triggered a sustained tactile contralateral delay activity component with a scalp topography over somatosensory cortex contralateral to the cued hand. Early somatosensory ERP components to task-irrelevant probe stimuli (that were presented after the retro-cues) and to subsequent test stimuli were enhanced when these stimuli appeared at the currently memorized location relative to other locations on the cued hand, demonstrating that a precise focus of spatial attention was established during the selective maintenance of tactile events in WM. These effects were observed regardless of whether participants performed the matching task with uncrossed or crossed hands, indicating that WM representations in this task were based on somatotopic rather than allocentric spatial coordinates. In conclusion, spatial rehearsal in tactile WM operates within somatotopically organized sensory brain areas that have been recruited for information storage.

A bilateral advantage for maintaining objects in visual short term memory

Research has shown that attentional pre-cues can subsequently influence the transfer of information into visual short term memory (VSTM) (Schmidt, B., Vogel, E., Woodman, G., & Luck, S. (2002). Voluntary and automatic attentional control of visual working memory. Perception & Psychophysics, 64(5), 754-763). However, studies also suggest that those effects are constrained by the hemifield alignment of the pre-cues (Holt, J. L., & Delvenne, J.-F. (2014). A bilateral advantage in controlling access to visual short-term memory. Experimental Psychology, 61(2), 127-133), revealing better recall when distributed across hemifields relative to within a single hemifield (otherwise known as a bilateral field advantage). By manipulating the duration of the retention interval in a colour change detection task (1s, 3s), we investigated whether selective pre-cues can also influence how information is later maintained in VSTM. The results revealed that the pre-cues influenced the maintenance of the colours in VSTM, promoting consistent performance across retention intervals (Experiments 1 & 4). However, those effects were only shown when the pre-cues were directed to stimuli displayed across hemifields relative to stimuli within a single hemifield. Importantly, the results were not replicated when participants were required to memorise colours (Experiment 2) or locations (Experiment 3) in the absence of spatial pre-cues. Those findings strongly suggest that attentional pre-cues have a strong influence on both the transfer of information in VSTM and its subsequent maintenance, allowing bilateral items to better survive decay.

Invalid retro-cues can eliminate the retro-cue benefit: Evidence for a hybridized account

The contents of visual working memory (VWM) are capacity limited and require frequent updating. The retrospective cueing (retro-cueing) paradigm clarifies how directing internal attention among VWM items boosts VWM performance. In this paradigm a cue appears prior to retrieval, but after encoding and maintenance. The retro-cue effect (RCE) refers to superior VWM after valid versus neutral retro-cues. Here we investigated the effect of the invalid retro-cues' inclusion on VWM performance. We conducted 2 pairs of experiments, changing both probe type (recognition and recall) as well as presence and absence of invalid retro-cue trials. Furthermore, to fully characterize these effects over time, we used extended post-retro-cue delay durations. In the first set of experiments, probing VWM using recognition indicated that the RCE remained consistent in magnitude with or without invalid retro-cue trials. In the second set of experiments, VWM was probed with recall. Here, the RCE was eliminated when invalid retro-cues were included. This finer-grained measure of VWM fidelity showed that all items were subject to decay over time. We conclude that the invalid retro-cues impaired the protection of validly cues items, but they remain accessible, suggesting greater concordance with a prioritization account.