Orienting Attention to Locations in Perceptual Versus Mental Representations

Separate and combined effects of action relevance and motivational value on visual working memory

Visual working memory contents can be selectively weighted according to differences in their task-relevance. In the present study, we examined the influence of two more indirect selection biases established by a concurrent task or learned reward associations: action relevance and motivational value. In three experiments, memory performance was assessed with the same color change detection task. Potential action relevance and motivational value were each determined by a specific feature of the memory items (location or shape, respectively) and manipulated orthogonally. Investigated separately (Experiments 1A and 1B), both selection biases modulated visual working memory. In combination (Experiment 2), action relevance and motivational value still each exerted an influence, but not in a fully independent and additive manner. While action relevance impacted performance irrespective of the reward associated with the items, an effect of motivational value was only observed for action-relevant items. These results support the notion that visual working memory is automatically biased as an inherent part of action planning. More generally, these findings highlight the versatile nature of visual working memory: Contents can be flexibly weighted to reflect differences in their importance, taking into account several sources of information.

The Retro-Cue Benefit for Verbal Material and Its Influence on the Probability of Intrusions Under Dual-Task Conditions

It is well established in the working memory literature, that performance can be improved by cueing attention toward the position of a to-be-tested item, even after that item's presentation. This retro-cue benefit is often characterized as the joint outcome of two different effects: facilitation of recall and memory strengthening at the cued position. While the latter has been mainly explained by increased context-content binding, competing hypotheses exist to explain the facilitation of recall. The present study focuses on two of these hypotheses: the removal of non-cued information and the protection of cued information against interference. I replicate the retro-cue effect for verbal material and provide strong evidence for its protective effect. However, I did not find support for the removal hypothesis. This lack of support follows from two empirical findings: Retro-cueing does not decrease, rather increases the conditional probability of intrusions, and the retro-cue benefit does not interact with memory load.

No evidence of binding items to spatial configuration representations in visual working memory

When detecting changes in visual features (e.g., colour or shape), object locations, represented as points within a configuration, might also be automatically represented in working memory. If the configuration of a scene is represented automatically, the locations of individual items might form part of this representation, irrespective of their relevance to the task. Participants took part in a change-detection task in which they studied displays containing different sets of items (shapes, letters, objects), which varied in their task relevance. Specifically, they were asked to remember the features of two sets, and ignore the third set. During the retention interval, an audio cue indicated which of the to-be-remembered sets would become the target set (having a 50% probability of containing a new feature). At test, they were asked to indicate whether a new feature was present amongst the target set. We measured binding of individual items to the configuration by manipulating the locations of the different sets so that their position in the test display either matched or mismatched their original location in the study display. If items are automatically bound to the configuration, location changes should disrupt performance, even if they were explicitly instructed not to remember the features of that particular set of items. There was no effect on performance of changing the locations of any of the sets between study and test displays, indicating that the configural representation did not enter their decision stage, and therefore that individual item representations are not necessarily bound to the configuration.

Functional interplay of top-down attention with affective codes during visual short-term memory maintenance

Visual short-term memory (VSTM) allows individuals to briefly maintain information over time for guiding behaviours. Because the contents of VSTM can be neutral or emotional, top-down influence in VSTM may vary with the affective codes of maintained representations. Here we investigated the neural mechanisms underlying the functional interplay of top-down attention with affective codes in VSTM using functional magnetic resonance imaging. Participants were instructed to remember both threatening and neutral objects in a cued VSTM task. Retrospective cues (retro-cues) were presented to direct attention to the hemifield of a threatening object (i.e., cue-to-threat) or a neutral object (i.e., cue-to-neutral) during VSTM maintenance. We showed stronger activity in the ventral occipitotemporal cortex and amygdala for attending threatening relative to neutral representations. Using multivoxel pattern analysis, we found better classification performance for cue-to-threat versus cue-to-neutral objects in early visual areas and in the amygdala. Importantly, retro-cues modulated the strength of functional connectivity between the frontoparietal and early visual areas. Activity in the frontoparietal areas became strongly correlated with the activity in V3a-V4 coding the threatening representations instructed to be relevant for the task. Together, these findings provide the first demonstration of top-down modulation of activation patterns in early visual areas and functional connectivity between the frontoparietal network and early visual areas for regulating threatening representations during VSTM maintenance.

Neural Representation of Working Memory Content Is Modulated by Visual Attentional Demand

Recent theories assert that visual working memory (WM) relies on the same attentional resources and sensory substrates as visual attention to external stimuli. Behavioral studies have observed competitive tradeoffs between internal (i.e., WM) and external (i.e., visual) attentional demands, and neuroimaging studies have revealed representations of WM content as distributed patterns of activity within the same cortical regions engaged by perception of that content. Although a key function of WM is to protect memoranda from competing input, it remains unknown how neural representations of WM content are impacted by incoming sensory stimuli and concurrent attentional demands. Here, we investigated how neural evidence for WM information is affected when attention is occupied by visual search-at varying levels of difficulty-during the delay interval of a WM match-to-sample task. Behavioral and fMRI analyses suggested that WM maintenance was impacted by the difficulty of a concurrent visual task. Critically, multivariate classification analyses of category-specific ventral visual areas revealed a reduction in decodable WM-related information when attention was diverted to a visual search task, especially when the search was more difficult. This study suggests that the amount of available attention during WM maintenance influences the detection of sensory WM representations.

Toward a taxonomic model of attention in effortful listening

In recent years, there has been increasing interest in studying listening effort. Research on listening effort intersects with the development of active theories of speech perception and contributes to the broader endeavor of understanding speech perception within the context of neuroscientific theories of perception, attention, and effort. Due to the multidisciplinary nature of the problem, researchers vary widely in their precise conceptualization of the catch-all term listening effort. Very recent consensus work stresses the relationship between listening effort and the allocation of cognitive resources, providing a conceptual link to current cognitive neuropsychological theories associating effort with the allocation of selective attention. By linking listening effort to attentional effort, we enable the application of a taxonomy of external and internal attention to the characterization of effortful listening. More specifically, we use a vectorial model to decompose the demand causing listening effort into its mutually orthogonal external and internal components and map the relationship between demanded and exerted effort by means of a resource-limiting term that can represent the influence of motivation as well as vigilance and arousal. Due to its quantitative nature and easy graphical interpretation, this model can be applied to a broad range of problems dealing with listening effort. As such, we conclude that the model provides a good starting point for further research on effortful listening within a more differentiated neuropsychological framework.

Distinct Top-down and Bottom-up Brain Connectivity During Visual Perception and Imagery

Research suggests that perception and imagination engage neuronal representations in the same visual areas. However, the underlying mechanisms that differentiate sensory perception from imagination remain unclear. Here, we examine the directed coupling (effective connectivity) between fronto-parietal and visual areas during perception and imagery. We found an increase in bottom-up coupling during perception relative to baseline and an increase in top-down coupling during both perception and imagery, with a much stronger increase during imagery. Modulation of the coupling from frontal to early visual areas was common to both perception and imagery. Furthermore, we show that the experienced vividness during imagery was selectively associated with increases in top-down connectivity to early visual cortex. These results highlight the importance of top-down processing in internally as well as externally driven visual experience.

Restoring Latent Visual Working Memory Representations in Human Cortex

Working memory (WM) enables the storage and manipulation of limited amounts of information over short periods. Prominent models posit that increasing the number of remembered items decreases the spiking activity dedicated to each item via mutual inhibition, which irreparably degrades the fidelity of each item's representation. We tested these models by determining if degraded memory representations could be recovered following a post-cue indicating which of several items in spatial WM would be recalled. Using an fMRI-based image reconstruction technique, we identified impaired behavioral performance and degraded mnemonic representations with elevated memory load. However, in several cortical regions, degraded mnemonic representations recovered substantially following a post-cue, and this recovery tracked behavioral performance. These results challenge pure spike-based models of WM and suggest that remembered items are additionally encoded within latent or hidden neural codes that can help reinvigorate active WM representations.

Prioritizing Information during Working Memory: Beyond Sustained Internal Attention

Working memory (WM) has limited capacity. This leaves attention with the important role of allowing into storage only the most relevant information. It is increasingly evident that attention is equally crucial for prioritizing representations within WM as the importance of individual items changes. Retrospective prioritization has been proposed to result from a focus of internal attention highlighting one of several representations. Here, we suggest an updated model, in which prioritization acts in multiple steps: first orienting towards and selecting a memory, and then reconfiguring its representational state in the service of upcoming task demands. Reconfiguration sets up an optimized perception-action mapping, obviating the need for sustained attention. This view is consistent with recent literature, makes testable predictions, and links WM with task switching and action preparation.

Attentional Modulation of Change Detection ERP Components by Peripheral Retro-Cueing

Change detection is essential for visual perception and performance in our environment. However, observers often miss changes that should be easily noticed. A failure in any of the processes involved in conscious detection (encoding the pre-change display, maintenance of that information within working memory, and comparison of the pre and post change displays) can lead to change blindness. Given that unnoticed visual changes in a scene can be easily detected once attention is drawn to them, it has been suggested that attention plays an important role on visual awareness. In the present study, we used behavioral and electrophysiological (ERPs) measures to study whether the manipulation of retrospective spatial attention affects performance and modulates brain activity related to the awareness of a change. To that end, exogenous peripheral cues were presented during the delay period (retro-cues) between the first and the second array using a one-shot change detection task. Awareness of a change was associated with a posterior negative amplitude shift around 228–292 ms (“Visual Awareness Negativity”), which was independent of retrospective spatial attention, as it was elicited to both validly and invalidly cued change trials. Change detection was also associated with a larger positive deflection around 420–580 ms (“Late Positivity”), but only when the peripheral retro-cues correctly predicted the change. Present results confirm that the early and late ERP components related to change detection can be functionally dissociated through manipulations of exogenous retro-cueing using a change blindness paradigm.

On the Role of the Inferior Intraparietal Sulcus in Visual Working Memory for Lateralized Single-feature Objects

A consolidated practice in cognitive neuroscience is to explore the properties of human visual working memory through the analysis of electromagnetic signals using cued change detection tasks. Under these conditions, EEG/MEG activity increments in the posterior parietal cortex scaling with the number of memoranda are often reported in the hemisphere contralateral to the objects' position in the memory array. This highly replicable finding clashes with several reported failures to observe compatible hemodynamic activity modulations using fMRI or fNIRS in comparable tasks. Here, we reconcile this apparent discrepancy by acquiring fMRI data on healthy participants and employing a cluster analysis to group voxels in the posterior parietal cortex based on their functional response. The analysis identified two distinct subpopulations of voxels in the intraparietal sulcus (IPS) showing a consistent functional response among participants. One subpopulation, located in the superior IPS, showed a bilateral response to the number of objects coded in visual working memory. A different subpopulation, located in the inferior IPS, showed an increased unilateral response when the objects were displayed contralaterally. The results suggest that a cluster of neurons in the inferior IPS is a candidate source of electromagnetic contralateral responses to working memory load in cued change detection tasks.

Hemispheric lateralization of resting-state functional connectivity of the ventral striatum: an exploratory study

Resting-state functional connectivity (rsFC) is widely used to examine cerebral functional organization. The ventral striatum (VS) is critical to motivated behavior, with extant studies suggesting functional hemispheric asymmetry. The current work investigated differences in rsFC between the left (L) and right (R) VS and explored gender differences in the extent of functional lateralization. In 106 adults, we computed a laterality index (fcLI) to query whether a target region shows greater or less connectivity to the L vs R VS. A total of 45 target regions with hemispheric masks were examined from the Automated Anatomic Labeling atlas. One-sample t test was performed to explore significant laterality in the whole sample and in men and women separately. Two-sample t test was performed to examine gender differences in fcLI. At a corrected threshold (p < 0.05/45 = 0.0011), the dorsomedial prefrontal cortex (dmPFC) and posterior cingulate cortex (pCC) showed L lateralization and the intraparietal sulcus (IPS) and supramarginal gyrus (SMG) showed R lateralization in VS connectivity. Except for the pCC, these findings were replicated in a different data set (n = 97) from the Human Connectome Project. Furthermore, the fcLI of VS-pCC was negatively correlated with a novelty seeking trait in women but not in men. Together, the findings may suggest a more important role of the L VS in linking saliency response to self control and other internally directed processes. Right lateralization of VS connectivity to the SMG and IPS may support attention and action directed to external behavioral contingencies.

Controlling Working Memory Operations by Selective Gating: The Roles of Oscillations and Synchrony

Working memory (WM) is a primary cognitive function that corresponds to the ability to update, stably maintain, and manipulate short-term memory (ST M) rapidly to perform ongoing cognitive tasks. A prevalent neural substrate of WM coding is persistent neural activity, the property of neurons to remain active after having been activated by a transient sensory stimulus. This persistent activity allows for online maintenance of memory as well as its active manipulation necessary for task performance. WM is tightly capacity limited. Therefore, selective gating of sensory and internally generated information is crucial for WM function. While the exact neural substrate of selective gating remains unclear, increasing evidence suggests that it might be controlled by modulating ongoing oscillatory brain activity. Here, we review experiments and models that linked selective gating, persistent activity, and brain oscillations, putting them in the more general mechanistic context of WM. We do so by defining several operations necessary for successful WM function and then discussing how such operations may be carried out by mechanisms suggested by computational models. We specifically show how oscillatory mechanisms may provide a rapid and flexible active gating mechanism for WM operations.

The short- and long-term fates of memory items retained outside the focus of attention

When a test of working memory (WM) requires the retention of multiple items, a subset of them can be prioritized. Recent studies have shown that, although prioritized (i.e., attended) items are associated with active neural representations, unprioritized (i.e., unattended) memory items can be retained in WM despite the absence of such active representations, and with no decrement in their recognition if they are cued later in the trial. These findings raise two intriguing questions about the nature of the short-term retention of information outside the focus of attention. First, when the focus of attention shifts from items in WM, is there a loss of fidelity for those unattended memory items? Second, could the retention of unattended memory items be accomplished by long-term memory mechanisms? We addressed the first question by comparing the precision of recall of attended versus unattended memory items, and found a significant decrease in precision for unattended memory items, reflecting a degradation in the quality of those representations. We addressed the second question by asking subjects to perform a WM task, followed by a surprise memory test for the items that they had seen in the WM task. Long-term memory for unattended memory items from the WM task was not better than memory for items that had remained selected by the focus of attention in the WM task. These results show that unattended WM representations are degraded in quality and are not preferentially represented in long-term memory, as compared to attended memory items.

Different Cortical Mechanisms for Spatial vs. Feature-Based Attentional Selection in Visual Working Memory

The limited capacity of visual working memory (VWM) necessitates attentional mechanisms that selectively update and maintain only the most task-relevant content. Psychophysical experiments have shown that the retroactive selection of memory content can be based on visual properties such as location or shape, but the neural basis for such differential selection is unknown. For example, it is not known if there are different cortical modules specialized for spatial vs. feature-based mnemonic attention, in the same way that has been demonstrated for attention to perceptual input. Here, we used transcranial magnetic stimulation (TMS) to identify areas in human parietal and occipital cortex involved in the selection of objects from memory based on cues to their location (spatial information) or their shape (featural information). We found that TMS over the supramarginal gyrus (SMG) selectively facilitated spatial selection, whereas TMS over the lateral occipital cortex (LO) selectively enhanced feature-based selection for remembered objects in the contralateral visual field. Thus, different cortical regions are responsible for spatial vs. feature-based selection of working memory representations. Since the same regions are involved in terms of attention to external events, these new findings indicate overlapping mechanisms for attentional control over perceptual input and mnemonic representations.

Selection in spatial working memory is independent of perceptual selective attention, but they interact in a shared spatial priority map

We examined the relationship between the attentional selection of perceptual information and of information in working memory (WM) through four experiments, using a spatial WM-updating task. Participants remembered the locations of two objects in a matrix and worked through a sequence of updating operations, each mentally shifting one dot to a new location according to an arrow cue. Repeatedly updating the same object in two successive steps is typically faster than switching to the other object; this object switch cost reflects the shifting of attention in WM. In Experiment 1, the arrows were presented in random peripheral locations, drawing perceptual attention away from the selected object in WM. This manipulation did not eliminate the object switch cost, indicating that the mechanisms of perceptual selection do not underlie selection in WM. Experiments 2a and 2b corroborated the independence of selection observed in Experiment 1, but showed a benefit to reaction times when the placement of the arrow cue was aligned with the locations of relevant objects in WM. Experiment 2c showed that the same benefit also occurs when participants are not able to mark an updating location through eye fixations. Together, these data can be accounted for by a framework in which perceptual selection and selection in WM are separate mechanisms that interact through a shared spatial priority map.

Imagine a mouse and an elephant: Hemispheric asymmetries of imagination

The present study aimed to explore the existence of an asymmetrical bias in the imagination of pairs of objects of unequal size. We assumed that such pairs are conceptualized with the smaller object being placed on the left, creating an ascending size order from left to right. Such a bias could derive from a cognitive strategy known from the mental number line. Sixty-four participants were instructed to imagine stimulus-pairs that were staggered from those showing very prominent intra-pair size differences (e.g., elephant vs. mouse) to very low size differences (e.g., orange vs. apple). The results showed that the tendency to imagine the bigger object on the right side increases with the size difference of the two stimuli. Such a visual field bias was also present in stimulus-pairs including numbers so that the participants imagined smaller and larger numbers on the left and the right side of the visual fields, respectively. Taken together, our findings could imply that the left-to-right orientation observed in our object imagining task may share the same cognitive mechanism as the mental number line.

The Focus of Attention in Visual Working Memory: Protection of Focused Representations and Its Individual Variation

Visual working memory can be modulated according to changes in the cued task relevance of maintained items. Here, we investigated the mechanisms underlying this modulation. In particular, we studied the consequences of attentional selection for selected and unselected items, and the role of individual differences in the efficiency with which attention is deployed. To this end, performance in a visual working memory task as well as the CDA/SPCN and the N2pc, ERP components associated with visual working memory and attentional processes, were analysed. Selection during the maintenance stage was manipulated by means of two successively presented retrocues providing spatial information as to which items were most likely to be tested. Results show that attentional selection serves to robustly protect relevant representations in the focus of attention while unselected representations which may become relevant again still remain available. Individuals with larger retrocueing benefits showed higher efficiency of attentional selection, as indicated by the N2pc, and showed stronger maintenance-associated activity (CDA/SPCN). The findings add to converging evidence that focused representations are protected, and highlight the flexibility of visual working memory, in which information can be weighted according its relevance.

Only pre-cueing but no retro-cueing effects emerge with masked arrow cues

The impact of masked stimulation on cognitive control processes is investigated with much interest. In many cases, masked stimulation suffices to initiate and employ control processes. Shifts of attention either happen in the external environment or internally, for example, in working memory. In the former, even masked cues (i.e., cues that are presented for a period too short to allow strategic use) were shown efficient for shifting attention to particular locations in pre-cue paradigms. Internal attention shifting can be investigated using retro-cues: long after encoding, a valid cue indicates the location to-be-tested via change detection, and this improves performance (retro-cue effect). In the present experiment, participants performed in both a pre- and a retro-cue task with masked and normally presented cues. While the masked cues benefitted performance in the pre-cue task, they did not in the retro-cue task. These results inform about limits of masked stimulation.

Top-Down Activation of Spatiotopic Sensory Codes in Perceptual and Working Memory Search

A critical requirement of an efficient cognitive system is the selection and prioritization of relevant information. This occurs when selecting specific items from our sensory inputs, which then receive preferential status at subsequent levels of processing. Many everyday tasks also require us to select internal representations, such as a relevant item from memory. We show that both of these types of search are underpinned by the spatiotopic activation of sensory codes, using both fMRI and MEG data. When individuals searched for perceived and remembered targets, the MEG data highlighted a sensor level electrophysiological effect that reflects the contralateral organization of the visual system-namely, the N2pc. The fMRI data were used to identify a network of frontoparietal areas common to both types of search, as well as the early visual areas activated by the search display. We then combined fMRI and MEG data to explore the temporal dynamics of functional connections between the frontoparietal network and the early visual areas. Searching for a target item resulted in significantly enhanced phase-phase coupling between the frontoparietal network and the visual areas contralateral to the perceived or remembered location of that target. This enhancement of spatially specific phase-phase coupling occurred before the N2pc effect and was significantly associated with it on a trial-by-trial basis. The combination of these two imaging modalities suggests that perceptual and working memory search are underpinned by the synchronization of a frontoparietal network and the relevant sensory cortices.

Dissociable loss of the representations in visual short-term memory

The present study investigated in what manner the information in visual short-term memory (VSTM) is lost. Participants memorized four items, one of which was given higher priority later by a retro-cue. Then participants were required to detect a possible change, which could be either a large or small change, occurred to one of the items. The results showed that the detection performance for the small change of the uncued items was poorer than the cued item, yet large change that occurred to all four memory items could be detected perfectly, indicating that the uncued representations lost some detailed information yet still had some basic features retained in VSTM. The present study suggests that after being encoded into VSTM, the information is not lost in an object-based manner; rather, features of an item are still dissociable, so that they can be lost separately.

From Behavior to Neural Dynamics: An Integrated Theory of Attention

The brain has a limited capacity and therefore needs mechanisms to selectively enhance the information most relevant to one's current behavior. We refer to these mechanisms as "attention." Attention acts by increasing the strength of selected neural representations and preferentially routing them through the brain's large-scale network. This is a critical component of cognition and therefore has been a central topic in cognitive neuroscience. Here we review a diverse literature that has studied attention at the level of behavior, networks, circuits, and neurons. We then integrate these disparate results into a unified theory of attention.

Center-Surround Inhibition in Working Memory

Directing visual attention toward a particular feature or location in the environment suppresses processing of nearby stimuli [1-4]. Echoing the center-surround organization of retinal ganglion cell receptive fields [5], and biasing of competitive local neuronal dynamics in favor of task-relevant stimuli [6], this "inhibitory surround" attention mechanism accentuates the demarcation between task-relevant and irrelevant items. Here, we show that internally maintaining a color stimulus in working memory (WM), rather than visually attending the stimulus in the external environment, produces an analogous pattern of inhibition for stimuli that are nearby in color space. Replicating a well-known effect of attentional capture by stimuli that match WM content [7], visual attention was biased toward (task-irrelevant) stimuli that exactly matched a WM item. This bias was curtailed, however, for stimuli that were very similar to the WM content (i.e., within the inhibitory zone surrounding the focus of WM) and recovered for less similar stimuli (i.e., beyond the bounds of the inhibitory surround). Moreover, the expression of this inhibition effect was positively associated with WM performance across observers. In a second experiment, inhibition also occurred between two similar items simultaneously held in WM. This suggests that maintenance in WM is characterized by an excitatory peak centered on the focus of (internal) attention, surrounded by an inhibitory zone to limit interference by irrelevant and confusable representations. Here, thus, we show for the first time that the same center-surround selection mechanism that focuses visual attention on sensory stimuli also selectively maintains internally activated representations in WM.

Recurrence of task set-related MEG signal patterns during auditory working memory

Processing of auditory spatial and non-spatial information in working memory has been shown to rely on separate cortical systems. While previous studies have demonstrated differences in spatial versus non-spatial processing from the encoding of to-be-remembered stimuli onwards, here we investigated whether such differences would be detectable already prior to presentation of the sample stimulus. We analyzed broad-band magnetoencephalography data from 15 healthy adults during an auditory working memory paradigm starting with a visual cue indicating the task-relevant stimulus feature for a given trial (lateralization or pitch) and a subsequent 1.5-s pre-encoding phase. This was followed by a sample sound (0.2s), the delay phase (0.8s) and a test stimulus (0.2s) after which participants made a match/non-match decision. Linear discriminant functions were trained to decode task-specific signal patterns throughout the task, and temporal generalization was used to assess whether the neural codes discriminating between the tasks during the pre-encoding phase would recur during later task periods. The spatial versus non-spatial tasks could indeed be discriminated after the onset of the cue onwards, and decoders trained during the pre-encoding phase successfully discriminated the tasks during both sample stimulus encoding and during the delay phase. This demonstrates that task-specific neural codes are established already before the memorandum is presented and that the same patterns are reestablished during stimulus encoding and maintenance. This article is part of a Special Issue entitled SI: Auditory working memory.

Sound Classification and Call Discrimination Are Decoded in Order as Revealed by Event-Related Potential Components in Frogs

Species that use communication sounds to coordinate social and reproductive behavior must be able to distinguish vocalizations from nonvocal sounds as well as to identify individual vocalization types. In this study we sought to identify the neural localization of the processes involved and the temporal order in which they occur in an anuran species, the music frog Babina daunchina. To do this we measured telencephalic and mesencephalic event-related potentials (ERPs) elicited by synthesized white noise (WN), highly sexually attractive (HSA) calls produced by males from inside nests and male calls of low sexual attractiveness (LSA) produced outside of nests. Each stimulus possessed similar temporal structures. The results showed the following: (1) the amplitudes of the first negative ERP component (N1) at ∼100 ms differed significantly between WN and conspecific calls but not between HSA and LSA calls, indicating that discrimination between conspecific calls and nonvocal sounds occurs in ∼100 ms, (2) the amplitudes of the second positive ERP component (P2) at ∼200 ms in the difference waves between HSA calls and WN were significantly higher than between LSA calls and WN in the right telencephalon, implying that call characteristic identification occurs in ∼200 ms and (3) WN evoked a larger third positive ERP component (P3) at ∼300 ms than conspecific calls, suggesting the frogs had classified the conspecific calls into one category and perceived WN as novel. Thus, both the detection of sounds and the identification of call characteristics are accomplished quickly in a specific temporal order, as reflected by ERP components. In addition, the most dynamic ERP patterns appeared in the left mesencephalon and the right telencephalon, indicating the two brain regions might play key roles in anuran vocal communication.

Cortical localization of phase and amplitude dynamics predicting access to somatosensory awareness

Neural dynamics leading to conscious sensory perception have remained enigmatic in despite of large interest. Human functional magnetic resonance imaging (fMRI) studies have revealed that a co-activation of sensory and frontoparietal areas is crucial for conscious sensory perception in the several second time-scale of BOLD signal fluctuations. Electrophysiological recordings with magneto- and electroencephalography (MEG and EEG) and intracranial EEG (iEEG) have shown that event related responses (ERs), phase-locking of neuronal activity, and oscillation amplitude modulations in sub-second timescales are greater for consciously perceived than for unperceived stimuli. The cortical sources of ER and oscillation dynamics predicting the conscious perception have, however, remained unclear because these prior studies have utilized MEG/EEG sensor-level analyses or iEEG with limited neuroanatomical coverage. We used a somatosensory detection task, magnetoencephalography (MEG), and cortically constrained source reconstruction to identify the cortical areas where ERs, local poststimulus amplitudes and phase-locking of neuronal activity are predictive of the conscious access of somatosensory information. We show here that strengthened ERs, phase-locking to stimulus onset (SL), and induced oscillations amplitude modulations all predicted conscious somatosensory perception, but the most robust and widespread of these was SL that was sustained in low-alpha (6-10 Hz) band. The strength of SL and to a lesser extent that of ER predicted conscious perception in the somatosensory, lateral and medial frontal, posterior parietal, and in the cingulate cortex. These data suggest that a rapid phase-reorganization and concurrent oscillation amplitude modulations in these areas play an instrumental role in the emergence of a conscious percept.

Retro-cue benefits in working memory without sustained focal attention

In working memory (WM) tasks, performance can be boosted by directing attention to one memory object: When a retro-cue in the retention interval indicates which object will be tested, responding is faster and more accurate (the retro-cue benefit). We tested whether the retro-cue benefit in WM depends on sustained attention to the cued object by inserting an attention-demanding interruption task between the retro-cue and the memory test. In the first experiment, the interruption task required participants to shift their visual attention away from the cued representation and to a visual classification task on colors. In the second and third experiments, the interruption task required participants to shift their focal attention within WM: Attention was directed away from the cued representation by probing another representation from the memory array prior to probing the cued object. The retro-cue benefit was not attenuated by shifts of perceptual attention or by shifts of attention within WM. We concluded that sustained attention is not needed to maintain the cued representation in a state of heightened accessibility.

Identifying neural correlates of visual consciousness with ALE meta-analyses

Neural correlates of consciousness (NCC) have been a topic of study for nearly two decades. In functional imaging studies, several regions have been proposed to constitute possible candidates for NCC, but as of yet, no quantitative summary of the literature on NCC has been done. The question whether single (striate or extrastriate) regions or a network consisting of extrastriate areas that project directly to fronto-parietal regions are necessary and sufficient neural correlates for visual consciousness is still highly debated [e.g., Rees et al., 2002, Nat Rev. Neurosci 3, 261-270; Tong, 2003, Nat Rev. Neurosci 4, 219-229]. The aim of this work was to elucidate this issue and give a synopsis of the present state of the art by conducting systematic and quantitative meta-analyses across functional magnetic resonance imaging (fMRI) studies using several standard paradigms for conscious visual perception. In these paradigms, consciousness is operationalized via perceptual changes, while the visual stimulus remains invariant. An activation likelihood estimation (ALE) meta-analysis was performed, representing the best approach for voxel-wise meta-analyses to date. In addition to computing a meta-analysis across all paradigms, separate meta-analyses on bistable perception and masking paradigms were conducted to assess whether these paradigms show common or different NCC. For the overall meta-analysis, we found significant clusters of activation in inferior and middle occipital gyrus; fusiform gyrus; inferior temporal gyrus; caudate nucleus; insula; inferior, middle, and superior frontal gyri; precuneus; as well as in inferior and superior parietal lobules. These results suggest a subcortical-extrastriate-fronto-parietal network rather than a single region that constitutes the necessary NCC. The results of our exploratory paradigm-specific meta-analyses suggest that this subcortical-extrastriate-fronto-parietal network might be differentially activated as a function of the paradigms used to probe for NCC.

Mental Imagery and Post-Traumatic Stress Disorder: A Neuroimaging and Experimental Psychopathology Approach to Intrusive Memories of Trauma

This hypothesis and theory paper presents a pragmatic framework to help bridge the clinical presentation and neuroscience of intrusive memories following psychological trauma. Intrusive memories are a hallmark symptom of post-traumatic stress disorder (PTSD). However, key questions, including those involving etiology, remain. In particular, we know little about the brain mechanisms involved in why only some moments of the trauma return as intrusive memories while others do not. We first present an overview of the patient experience of intrusive memories and the neuroimaging studies that have investigated intrusive memories in PTSD patients. Next, one mechanism of how to model intrusive memories in the laboratory, the trauma film paradigm, is examined. In particular, we focus on studies combining the trauma film paradigm with neuroimaging. Stemming from the clinical presentation and our current understanding of the processes involved in intrusive memories, we propose a framework in which an intrusive memory comprises five component parts; autobiographical (trauma) memory, involuntary recall, negative emotions, attention hijacking, and mental imagery. Each component part is considered in turn, both behaviorally and from a brain imaging perspective. A mapping of these five components onto our understanding of the brain is described. Unanswered questions that exist in our understanding of intrusive memories are considered using the proposed framework. Overall, we suggest that mental imagery is key to bridging the experience, memory, and intrusive recollection of the traumatic event. Further, we suggest that by considering the brain mechanisms involved in the component parts of an intrusive memory, in particular mental imagery, we may be able to aid the development of a firmer bridge between patients' experiences of intrusive memories and the clinical neuroscience behind them.

Activity in human visual and parietal cortex reveals object-based attention in working memory

Visual attention enables observers to select behaviorally relevant information based on spatial locations, features, or objects. Attentional selection is not limited to physically present visual information, but can also operate on internal representations maintained in working memory (WM) in service of higher-order cognition. However, only little is known about whether attention to WM contents follows the same principles as attention to sensory stimuli. To address this question, we investigated in humans whether the typically observed effects of object-based attention in perception are also evident for object-based attentional selection of internal object representations in WM. In full accordance with effects in visual perception, the key behavioral and neuronal characteristics of object-based attention were observed in WM. Specifically, we found that reaction times were shorter when shifting attention to memory positions located on the currently attended object compared with equidistant positions on a different object. Furthermore, functional magnetic resonance imaging and multivariate pattern analysis of visuotopic activity in visual (areas V1-V4) and parietal cortex revealed that directing attention to one position of an object held in WM also enhanced brain activation for other positions on the same object, suggesting that attentional selection in WM activates the entire object. This study demonstrated that all characteristic features of object-based attention are present in WM and thus follows the same principles as in perception.

Frontoparietal and Cingulo-opercular Networks Play Dissociable Roles in Control of Working Memory

We used magnetoencephalography to characterize the spatiotemporal dynamics of cortical activity during top-down control of working memory (WM). fMRI studies have previously implicated both the frontoparietal and cingulo-opercular networks in control over WM, but their respective contributions are unclear. In our task, spatial cues indicating the relevant item in a WM array occurred either before the memory array or during the maintenance period, providing a direct comparison between prospective and retrospective control of WM. We found that in both cases a frontoparietal network activated following the cue, but following retrocues this activation was transient and was succeeded by a cingulo-opercular network activation. We also characterized the time course of top-down modulation of alpha activity in visual/parietal cortex. This modulation was transient following retrocues, occurring in parallel with the frontoparietal network activation. We suggest that the frontoparietal network is responsible for top-down modulation of activity in sensory cortex during both preparatory attention and orienting within memory. In contrast, the cingulo-opercular network plays a more downstream role in cognitive control, perhaps associated with output gating of memory.

A Neurophysiological and Neuropsychological Consideration of Mindful Movement: Clinical and Research Implications

In this article, we present ideas related to three key aspects of mindfulness training: the regulation of attention via noradrenaline, the importance of working memory and its various components (particularly the central executive and episodic buffer), and the relationship of both of these to mind-wandering. These same aspects of mindfulness training are also involved in the preparation and execution of movement and implicated in the pathophysiology of psychosis. We argue that by moving in a mindful way, there may be an additive effect of training as the two elements of the practice (mindfulness and movement) independently, and perhaps synergistically, engage common underlying systems (the default mode network). We discuss how working with mindful movement may be one route to mindfulness training for individuals who would struggle to sit still to complete the more commonly taught mindfulness practices. Drawing on our clinical experience working with individuals with severe and enduring mental health conditions, we show the real world application of these ideas and how they can be used to help those who are suffering and for whom current treatments are still far from adequate.

Dissociation in decision bias mechanism between probabilistic information and previous decision

Target detection performance is known to be influenced by events in the previous trials. It has not been clear, however, whether this bias effect is due to the previous sensory stimulus, motor response, or decision. Also it remains open whether or not the previous trial effect emerges via the same mechanism as the effect of knowledge about the target probability. In the present study, we asked normal human subjects to make a decision about the presence or absence of a visual target. We presented a pre-cue indicating the target probability before the stimulus, and also a decision-response mapping cue after the stimulus so as to tease apart the effect of decision from that of motor response. We found that the target detection performance was significantly affected by the probability cue in the current trial and also by the decision in the previous trial. While the information about the target probability modulated the decision criteria, the previous decision modulated the sensitivity to target-relevant sensory signals (d-prime). Using functional magnetic resonance imaging (fMRI), we also found that activation in the left intraparietal sulcus (IPS) was decreased when the probability cue indicated a high probability of the target. By contrast, activation in the right inferior frontal gyrus (IFG) was increased when the subjects made a target-present decision in the previous trial, but this change was observed specifically when the target was present in the current trial. Activation in these regions was associated with individual-difference in the decision computation parameters. We argue that the previous decision biases the target detection performance by modulating the processing of target-selective information, and this mechanism is distinct from modulation of decision criteria due to expectation of a target.

Understanding age-related reductions in visual working memory capacity: examining the stages of change detection

Visual working memory (VWM) capacity is reduced in older adults. Research has shown age-related impairments to VWM encoding, but aging is likely to affect multiple stages of VWM. In the present study, we recorded the event-related potentials (ERPs) of younger and older adults during VWM maintenance and retrieval. We measured encoding-stage processing with the P1 component, maintenance-stage processing with the contralateral delay activity (CDA), and retrieval-stage processing by comparing the activity for old and new items (old-new effect). Older adults showed lower behavioral capacity estimates (K) than did younger adults, but surprisingly, their P1 components and CDAs were comparable to those of younger adults. This remarkable dissociation between neural activity and behavior in the older adults indicated that the P1 and CDA did not accurately assess their VWM capacity. However, the neural activity evoked during VWM retrieval yielded results that helped clarify the age-related differences. During retrieval, younger adults showed early old-new effects in frontal and occipital areas and a late central-parietal old-new effect, whereas older adults showed a late right-lateralized parietal old-new effect. The younger adults' early old-new effects strongly resembled an index of perceptual fluency, suggesting that perceptual implicit memory was activated. The activation of implicit memory could have facilitated the younger adults' behavior, and the lack of these early effects in older adults may suggest that they have much lower-resolution memory than do younger adults. From these data, we speculated that younger and older adults store the same number of items in VWM, but that younger adults store a higher-resolution representation than do older adults.

Visual memory performance for color depends on spatiotemporal context

Performance on visual short-term memory for features has been known to depend on stimulus complexity, spatial layout, and feature context. However, with few exceptions, memory capacity has been measured for abruptly appearing, single-instance displays. In everyday life, objects often have a spatiotemporal history as they or the observer move around. In three experiments, we investigated the effect of spatiotemporal history on explicit memory for color. Observers saw a memory display emerge from behind a wall, after which it disappeared again. The test display then emerged from either the same side as the memory display or the opposite side. In the first two experiments, memory improved for intermediate set sizes when the test display emerged in the same way as the memory display. A third experiment then showed that the benefit was tied to the original motion trajectory and not to the display object per se. The results indicate that memory for color is embedded in a richer episodic context that includes the spatiotemporal history of the display.

Neural dynamics underlying attentional orienting to auditory representations in short-term memory

Sounds are ephemeral. Thus, coherent auditory perception depends on "hearing" back in time: retrospectively attending that which was lost externally but preserved in short-term memory (STM). Current theories of auditory attention assume that sound features are integrated into a perceptual object, that multiple objects can coexist in STM, and that attention can be deployed to an object in STM. Recording electroencephalography from humans, we tested these assumptions, elucidating feature-general and feature-specific neural correlates of auditory attention to STM. Alpha/beta oscillations and frontal and posterior event-related potentials indexed feature-general top-down attentional control to one of several coexisting auditory representations in STM. Particularly, task performance during attentional orienting was correlated with alpha/low-beta desynchronization (i.e., power suppression). However, attention to one feature could occur without simultaneous processing of the second feature of the representation. Therefore, auditory attention to memory relies on both feature-specific and feature-general neural dynamics.

Immediate memory for "when, where and what": Short-delay retrieval using dynamic naturalistic material

We investigated the neural correlates supporting three kinds of memory judgments after very short delays using naturalistic material. In two functional magnetic resonance imaging (fMRI) experiments, subjects watched short movie clips, and after a short retention (1.5–2.5 s), made mnemonic judgments about specific aspects of the clips. In Experiment 1, subjects were presented with two scenes and required to either choose the scene that happened earlier in the clip (“scene‐chronology”), or with a correct spatial arrangement (“scene‐layout”), or that had been shown (“scene‐recognition”). To segregate activity specific to seen versus unseen stimuli, in Experiment 2 only one probe image was presented (either target or foil). Across the two experiments, we replicated three patterns underlying the three specific forms of memory judgment. The precuneus was activated during temporal‐order retrieval, the superior parietal cortex was activated bilaterally for spatial‐related configuration judgments, whereas the medial frontal cortex during scene recognition. Conjunction analyses with a previous study that used analogous retrieval tasks, but a much longer delay (>1 day), demonstrated that this dissociation pattern is independent of retention delay. We conclude that analogous brain regions mediate task‐specific retrieval across vastly different delays, consistent with the proposal of scale‐invariance in episodic memory retrieval. Hum Brain Mapp 36:2495–2513, 2015. © 2015 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Amygdala responses to unpleasant pictures are influenced by task demands and positive affect trait

The role of attention in emotional processing is still the subject of debate. Recent studies have found that high positive affect in approach motivation narrows attention. Furthermore, the positive affect trait has been suggested as an important component for determining human variability in threat reactivity. We employed functional magnetic resonance imaging to investigate whether different states of attention control would modulate amygdala responses to highly unpleasant pictures relative to neutral and whether this modulation would be influenced by the positive affect trait. Participants (n = 22, 12 male) were scanned while viewing neutral (people) or unpleasant pictures (mutilated bodies) flanked by two peripheral bars. They were instructed to (a) judge the picture content as unpleasant or neutral or (b) to judge the difference in orientation between the bars in an easy condition (0 or 90(∘) orientation difference) or (c) in a hard condition (0 or 6(∘) orientation difference). Whole brain analysis revealed a task main effect of brain areas related to the experimental manipulation of attentional control, including the amygdala, dorsolateral prefrontal cortex, and posterior parietal cortex. Region of interest analysis showed an inverse correlation (r = -0.51, p < 0.01) between left amygdala activation and positive affect level when participants viewed unpleasant stimuli and judged bar orientation in the easy condition. This result suggests that subjects with high positive affect exhibit lower amygdala reactivity to distracting unpleasant pictures. In conclusion, the current study suggests that positive affect modulates attention effect on unpleasant pictures, therefore attenuating emotional responses.

Conceptual control across modalities: graded specialisation for pictures and words in inferior frontal and posterior temporal cortex

Controlled semantic retrieval to words elicits co-activation of inferior frontal (IFG) and left posterior temporal cortex (pMTG), but research has not yet established (i) the distinct contributions of these regions or (ii) whether the same processes are recruited for non-verbal stimuli. Words have relatively flexible meanings - as a consequence, identifying the context that links two specific words is relatively demanding. In contrast, pictures are richer stimuli and their precise meaning is better specified by their visible features - however, not all of these features will be relevant to uncovering a given association, tapping selection/inhibition processes. To explore potential differences across modalities, we took a commonly-used manipulation of controlled retrieval demands, namely the identification of weak vs. strong associations, and compared word and picture versions. There were 4 key findings: (1) Regions of interest (ROIs) in posterior IFG (BA44) showed graded effects of modality (e.g., words>pictures in left BA44; pictures>words in right BA44). (2) An equivalent response was observed in left mid-IFG (BA45) across modalities, consistent with the multimodal semantic control deficits that typically follow LIFG lesions. (3) The anterior IFG (BA47) ROI showed a stronger response to verbal than pictorial associations, potentially reflecting a role for this region in establishing a meaningful context that can be used to direct semantic retrieval. (4) The left pMTG ROI also responded to difficulty across modalities yet showed a stronger response overall to verbal stimuli, helping to reconcile two distinct literatures that have implicated this site in semantic control and lexical-semantic access respectively. We propose that left anterior IFG and pMTG work together to maintain a meaningful context that shapes ongoing semantic processing, and that this process is more strongly taxed by word than picture associations.

Serial position markers in space: visuospatial priming of serial order working memory retrieval

Most general theories on serial order working memory (WM) assume the existence of position markers that are bound to the to-be-remembered items to keep track of the serial order. So far, the exact cognitive/neural characteristics of these markers have remained largely underspecified, while direct empirical evidence for their existence is mostly lacking. In the current study we demonstrate that retrieval from verbal serial order WM can be facilitated or hindered by spatial cuing: begin elements of a verbal WM sequence are retrieved faster after cuing the left side of space, while end elements are retrieved faster after cuing the right side of space. In direct complement to our previous work--where we showed the reversed impact of WM retrieval on spatial processing--we argue that the current findings provide us with a crucial piece of evidence suggesting a direct and functional involvement of space in verbal serial order WM. We outline the idea that serial order in verbal WM is coded within a spatial coordinate system with spatial attention being involved when searching through WM, and we discuss how this account can explain several hallmark observations related to serial order WM.

A bilateral advantage for maintaining objects in visual short term memory

Research has shown that attentional pre-cues can subsequently influence the transfer of information into visual short term memory (VSTM) (Schmidt, B., Vogel, E., Woodman, G., & Luck, S. (2002). Voluntary and automatic attentional control of visual working memory. Perception & Psychophysics, 64(5), 754-763). However, studies also suggest that those effects are constrained by the hemifield alignment of the pre-cues (Holt, J. L., & Delvenne, J.-F. (2014). A bilateral advantage in controlling access to visual short-term memory. Experimental Psychology, 61(2), 127-133), revealing better recall when distributed across hemifields relative to within a single hemifield (otherwise known as a bilateral field advantage). By manipulating the duration of the retention interval in a colour change detection task (1s, 3s), we investigated whether selective pre-cues can also influence how information is later maintained in VSTM. The results revealed that the pre-cues influenced the maintenance of the colours in VSTM, promoting consistent performance across retention intervals (Experiments 1 & 4). However, those effects were only shown when the pre-cues were directed to stimuli displayed across hemifields relative to stimuli within a single hemifield. Importantly, the results were not replicated when participants were required to memorise colours (Experiment 2) or locations (Experiment 3) in the absence of spatial pre-cues. Those findings strongly suggest that attentional pre-cues have a strong influence on both the transfer of information in VSTM and its subsequent maintenance, allowing bilateral items to better survive decay.

The external-internal loop of interference: two types of attention and their influence on the learning abilities of mice

Attention is a component of the working memory system, and is responsible for protecting task-relevant information from interference. Cognitive performance (particularly outside of the laboratory) is often plagued by interference, and the source of this interference, either external or internal, might influence the expression of individual differences in attentional ability. By definition, external attention (also described as "selective attention") protects working memory against sensorial distractors of all kinds, while internal attention (also called "inhibition") protects working memory against emotional impulses, irrelevant information from memory, and automatically-generated responses. At present, it is unclear if these two types of attention are expressed independently in non-human animals, and how they might differentially impact performance on other cognitive processes, such as learning. By using a diverse battery of four attention tests (with varying levels of internal and external sources of interference), here we aimed both to explore this issue, and to obtain a robust and general (less task-specific) measure of attention in mice. Exploratory factor analyses revealed two factors (external and internal attention) that in total, accounted for 73% of the variance in attentional performance. Confirmatory factor analyses found an excellent fit with the data of the model of attention that assumed an external and internal distinction (with a resulting correlation of 0.43). In contrast, a model of attention that assumed one source of variance (i.e., "general attention") exhibited a poor fit with the data. Regarding the relationship between attention and learning, higher resistance against external sources of interference promoted better new learning, but tended to impair performance when cognitive flexibility was required, such as during the reversal of a previously instantiated response. The present results suggest that there can be (at least) two types of attention that contribute to the common variance in attentional performance in mice, and that external and internal attentions might have opposing influences on the rate at which animals learn.