Spatial information is processed even when it is task-irrelevant: implications for neuroimaging task design

The role of location in visual feature binding

Location appears to play a vital role in binding discretely processed visual features into coherent objects. Consequently, it has been proposed that objects are represented for cognition by their spatiotemporal location, with other visual features attached to this location index. On this theory, the visual features of an object are only connected via mutual location; direct binding cannot occur. Despite supporting evidence, some argue that direct binding does take over according to task demands and when representing familiar objects. The current study was developed to evaluate these claims, using a brief memory task to test for contingencies between features under different circumstances. Participants were shown a sequence of three items in different colours and locations, and then asked for the colour and/or location of one of them. The stimuli could either be abstract shapes, or familiar objects. Results indicated that location is necessary for binding regardless of the type of stimulus and task demands, supporting the proposed structure. A follow-up experiment assessed an alternate explanation for the apparent importance of location in binding; eye movements may automatically capture location information, making it impossible to ignore and suggesting a contingency that is not representative of cognitive processes. Participants were required to maintain fixation on half of the trials, with an eye tracker for confirmation. Results indicated that the importance of location in binding cannot be attributed to eye movements. Overall, the findings of this study support the claim that location is essential for visual feature binding, due to the structure of object representations.

No evidence for binding of items to task-irrelevant backgrounds in visual working memory

When representing visual features such as color and shape in visual working memory (VWM), participants also represent the locations of those features as a spatial configuration of the locations of those features in the display. In everyday life, we encounter objects against some background, yet it is unclear whether the configural representation in memory obligatorily constitutes the entire display, including that (often task-irrelevant) background information. In three experiments, participants completed a change detection task on color and shape; the memoranda were presented in front of uniform gray backgrounds, a textured background (Exp. 1), or a background containing location placeholders (Exps. 2 and 3). When whole-display probes were presented, changes to the objects' locations or feature bindings impacted memory performance-implying that the spatial configuration of the probes influenced participants' change decisions. Furthermore, when only a single item was probed, the effect of changing its location or feature bindings was either diminished or completely extinguished, implying that single probes do not necessarily elicit the entire spatial configuration. Critically, when task-irrelevant backgrounds were also presented that may have provided a spatial configuration for the single probes, the effect of location or bindings was not moderated. These findings suggest that although the spatial configuration of a display guides VWM-based recognition, this information does not necessarily always influence the decision process during change detection.

Asymmetric binding in serial memory for verbal and spatial information

As the number of studies showing that items can be retained as bound representations in memory increases, researchers are beginning to investigate how the different features are bound together. In the present study, we examined the relative importances of the verbal and spatial features in serial memory for visual stimuli. Participants were asked to memorize the order of series of letters presented visually in different locations on the computer screen. The results showed that manipulating the phonological similarity of the letters affected recall of their spatial locations, but that increasing the complexity of the spatial pattern had no effect on recall of the letters. This finding was observed in both order reconstruction (Exps. 1 and 2) and probe serial recall (Exps. 3 and 4), suggesting that verbal-spatial binding in serial memory for visual information is asymmetric.

Irrelevant features of a stimulus can either facilitate or disrupt performance in a working memory task: the role of fluid intelligence

It has been shown that fluid intelligence (gf) is fundamental to overcome interference due to information of a previously encoded item along a task-relevant domain. However, the biasing effect of task-irrelevant dimensions is still unclear as well as its relation with gf. The present study aimed at clarifying these issues. Gf was assessed in 60 healthy subjects. In a different session, the same subjects performed two versions (letter-detection and spatial) of a three-back working memory task with a set of physically identical stimuli (letters) presented at different locations on the screen. In the letter-detection task, volunteers were asked to match stimuli on the basis of their identity whereas, in the spatial task, they were required to match items on their locations. Cross-domain bias was manipulated by pseudorandomly inserting a match between the current and the three back items on the irrelevant domain. Our findings showed that a task-irrelevant feature of a salient stimulus can actually bias the ongoing performance. We revealed that, at trials in which the current and the three-back items matched on the irrelevant domain, group accuracy was lower (interference). On the other hand, at trials in which the two items matched on both the relevant and irrelevant domains, the group showed an enhancement of the performance (facilitation). Furthermore, we demonstrated that individual differences in fluid intelligence covaries with the ability to override cross-domain interference in that higher gf subjects showed better performance at interference trials than low gf subjects. Altogether, our findings suggest that stimulus features irrelevant to the task can affect cognitive performance along the relevant domain and that gf plays an important role in protecting relevant memory contents from the hampering effect of such a bias.

Independent components in stimulus-related BOLD signals and estimation of the underlying neural responses

We measured blood oxygen level dependent (BOLD) responses to the onset of dynamic noise stimulation in defined regions of the primary retinotopic projection (V1) in visual cortex. The response waveforms showed a remarkable diversity across stimulus types, violating the basic assumption of a unitary general linear model of a uniform BOLD response function convolved with each stimulus sequence. We used independent component analysis (ICA) to analyze the component mechanisms contributing to these responses. The underlying neural responses for the components were estimated by nonlinear optimization through the Friston-Buxton hemodynamic model of the BOLD response. Our analysis suggests that one of the identified components reflected a sustained neural response to the stimulus and that another reflected an extremely slow neural response. A third component exhibited nonlinear change-specific transient responses. The first two components showed stable spatial structure in the V1 region of interest with respect to the eccentricity of the noise stimulus.

Spontaneous fluctuations in posterior alpha-band EEG activity reflect variability in excitability of human visual areas

Neural activity fluctuates dynamically with time, and these changes have been reported to be of behavioral significance, despite occurring spontaneously. Through electroencephalography (EEG), fluctuations in alpha-band (8-14 Hz) activity have been identified over posterior sites that covary on a trial-by-trial basis with whether an upcoming visual stimulus will be detected or not. These fluctuations are thought to index the momentary state of visual cortex excitability. Here, we tested this hypothesis by directly exciting human visual cortex via transcranial magnetic stimulation (TMS) to induce illusory visual percepts (phosphenes) in blindfolded participants, while simultaneously recording EEG. We found that identical TMS-stimuli evoked a percept (P-yes) or not (P-no) depending on prestimulus alpha-activity. Low prestimulus alpha-band power resulted in TMS reliably inducing phosphenes (P-yes trials), whereas high prestimulus alpha-values led the same TMS-stimuli failing to evoke a visual percept (P-no trials). Additional analyses indicated that the perceptually relevant fluctuations in alpha-activity/visual cortex excitability were spatially specific and occurred on a subsecond time scale in a recurrent pattern. Our data directly link momentary levels of posterior alpha-band activity to distinct states of visual cortex excitability, and suggest that their spontaneous fluctuation constitutes a visual operation mode that is activated automatically even without retinal input.

Anxiety selectively disrupts visuospatial working memory

On the basis of a review of the extant literature describing emotion-cognition interactions, the authors propose 4 methodological desiderata for studying how task-irrelevant affect modulates cognition and present data from an experiment satisfying them. Consistent with accounts of the hemispheric asymmetries characterizing withdrawal-related negative affect and visuospatial working memory (WM) in prefrontal and parietal cortices, threat-induced anxiety selectively disrupted accuracy of spatial but not verbal WM performance. Furthermore, individual differences in physiological measures of anxiety statistically mediated the degree of disruption. A second experiment revealed that individuals characterized by high levels of behavioral inhibition exhibited more intense anxiety and relatively worse spatial WM performance in the absence of threat, solidifying the authors' inference that anxiety causally mediates disruption. These observations suggest a revision of extant models of how anxiety sculpts cognition and underscore the utility of the desiderata.