Is attention based on spatial contextual memory preferentially guided by low spatial frequency signals?

Keeping it real: Looking beyond capacity limits in visual cognition

Research within visual cognition has made tremendous strides in uncovering the basic operating characteristics of the visual system by reducing the complexity of natural vision to artificial but well-controlled experimental tasks and stimuli. This reductionist approach has for example been used to assess the basic limitations of visual attention, visual working memory (VWM) capacity, and the fidelity of visual long-term memory (VLTM). The assessment of these limits is usually made in a pure sense, irrespective of goals, actions, and priors. While it is important to map out the bottlenecks our visual system faces, we focus here on selected examples of how such limitations can be overcome. Recent findings suggest that during more natural tasks, capacity may be higher than reductionist research suggests and that separable systems subserve different actions, such as reaching and looking, which might provide important insights about how pure attentional or memory limitations could be circumvented. We also review evidence suggesting that the closer we get to naturalistic behavior, the more we encounter implicit learning mechanisms that operate "for free" and "on the fly." These mechanisms provide a surprisingly rich visual experience, which can support capacity-limited systems. We speculate whether natural tasks may yield different estimates of the limitations of VWM, VLTM, and attention, and propose that capacity measurements should also pass the real-world test within naturalistic frameworks. Our review highlights various approaches for this and suggests that our understanding of visual cognition will benefit from incorporating the complexities of real-world cognition in experimental approaches.

The conceptual understanding of depth rather than the low-level processing of spatial frequencies drives the corridor illusion

Our objective was to determine how different spatial frequencies affect the perceptual size rescaling of stimuli in the corridor illusion. Two experiments were performed using the method of constant stimuli. In experiment 1, the task required participants to compare the size of comparison and standard rings displayed over the same background image. ANOVA on the points of subject equality (PSEs) revealed that the perceived size of the top and bottom standard rings changed as a function of the availability of the high, medium, and low spatial frequency information. In experiment 2, the task required participants to compare the size of a comparison ring presented outside of the background image with a standard ring presented inside it. ANOVA on the PSEs revealed that the apparent size of the top and not the bottom standard ring changed depending on the availability of medium spatial frequency information. Eye-tracking revealed that the spatial frequency range of the background image in the periphery affected participants' eye positioning, which may explain why the effects of different spatial frequencies fluctuated across experiments. Nonetheless, when we consider these findings together, we propose that the conceptual understanding of depth plays a more important role in explaining the corridor illusion than the low-level processing of depth information extracted from different spatial frequencies along separate channels.

Search superiority: Goal-directed attentional allocation creates more reliable incidental identity and location memory than explicit encoding in naturalistic virtual environments

We use representations and expectations formed during life-long learning to support attentional allocation and perception. In comparison to traditional laboratory investigations, real-world memory formation is usually achieved without explicit instruction and on-the-fly as a by-product of natural interactions with our environment. Understanding this process and the quality of naturally formed representations is critical to understanding how memory is used to guide attention and perception. Utilizing immersive, navigable, and realistic virtual environments, we investigated incidentally generated memory representations by comparing them to memories for items which were explicitly memorized. Participants either searched for objects embedded in realistic indoor environments or explicitly memorized them for follow-up identity and location memory tests. We show for the first time that memory for the identity of naturalistic objects and their location in 3D space is higher after incidental encoding compared to explicit memorization, even though the subsequent memory tests came as a surprise to participants. Relating gaze behavior to memory performance revealed that encoding time was more predictive of subsequent memory when participants explicitly memorized an item, compared to incidentally encoding it. Our results suggest that the active nature of guiding attentional allocation during proactive behavior allows for behaviorally optimal formation and utilization of representations. This highlights the importance of investigating cognition under ecologically valid conditions and shows that understanding the most natural processes for encoding and maintaining information is critical for understanding adaptive behavior.

The functional consequences of social attention on memory precision and on memory-guided orienting in development

Adults are slower at locating targets in naturalistic scenes containing a social distractor compared to an equally salient non-social distractor, and their subsequent memory for targets in social scenes is poorer. Therefore, adults’ social biases affect not only attention, but also their memory. Six-to-ten year-old children and young adults took part in the current study, employing a combination of behavioural and eye-tracking measures. Social stimuli in naturalistic scenes distracted both children and adults during visual search, as demonstrated by their gaze behavior and search times. In addition, eye-tracking revealed even greater attentional capture by social distractors for children. Memory for targets was worse in social compared to non-social scenes. Intriguingly, children demonstrated overall better memory precision than adults. Finally, when participants detected previously learnt targets within visual scenes, adults were slower for targets appearing at unexpected (invalid) locations within social scenes compared to non-social scenes, but this was not the case for children. In their entirety, these findings suggest that the interplay between social attentional biases, memory and memory-guided attention is complex and modulated by age-related differences. Complementary methodologies in developmental cognitive neuroscience shed light on the mechanisms through which social attention and memory interact over development.

The Functional Consequences of Social Attention for Memory-guided Attention Orienting and Anticipatory Neural Dynamics

Social attention when viewing natural social (compared with nonsocial) images has functional consequences on contextual memory in healthy human adults. In addition to attention affecting memory performance, strong evidence suggests that memory, in turn, affects attentional orienting. Here, we ask whether the effects of social processing on memory alter subsequent memory-guided attention orienting and corresponding anticipatory dynamics of 8-12 Hz alpha-band oscillations as measured with EEG. Eighteen young adults searched for targets in scenes that contained either social or nonsocial distracters and their memory precision tested. Subsequently, RT was measured as participants oriented to targets appearing in those scenes at either valid (previously learned) locations or invalid (different) locations. Memory precision was poorer for target locations in social scenes. In addition, distractor type moderated the validity effect during memory-guided attentional orienting, with a larger cost in RT when targets appeared at invalid (different) locations within scenes with social distractors. The poorer memory performance was also marked by reduced anticipatory dynamics of spatially lateralized 8-12 Hz alpha-band oscillations for scenes with social distractors. The functional consequences of a social attention bias therefore extend from memory to memory-guided attention orienting, a bidirectional chain that may further reinforce attentional biases.

Ultrafast scene detection and recognition with limited visual information

Humans can detect target color pictures of scenes depicting concepts like picnic or harbor in sequences of six or twelve pictures presented as briefly as 13 ms, even when the target is named after the sequence (Potter, Wyble, Hagmann, & McCourt, 2014). Such rapid detection suggests that feedforward processing alone enabled detection without recurrent cortical feedback. There is debate about whether coarse, global, low spatial frequencies (LSFs) provide predictive information to high cortical levels through the rapid magnocellular (M) projection of the visual path, enabling top-down prediction of possible object identities. To test the "Fast M" hypothesis, we compared detection of a named target across five stimulus conditions: unaltered color, blurred color, grayscale, thresholded monochrome, and LSF pictures. The pictures were presented for 13-80 ms in six-picture rapid serial visual presentation (RSVP) sequences. Blurred, monochrome, and LSF pictures were detected less accurately than normal color or grayscale pictures. When the target was named before the sequence, all picture types except LSF resulted in above-chance detection at all durations. Crucially, when the name was given only after the sequence, performance dropped and the monochrome and LSF pictures (but not the blurred pictures) were at or near chance. Thus, without advance information, monochrome and LSF pictures were rarely understood. The results offer only limited support for the Fast M hypothesis, suggesting instead that feedforward processing is able to activate conceptual representations without complementary reentrant processing.

Preserved memory-based orienting of attention with impaired explicit memory in healthy ageing

It is increasingly recognised that spatial contextual long-term memory (LTM) prepares neural activity for guiding visuo-spatial attention in a proactive manner. In the current study, we investigated whether the decline in explicit memory observed in healthy ageing would compromise this mechanism. We compared the behavioural performance of younger and older participants on learning new contextual memories, on orienting visual attention based on these learnt contextual associations, and on explicit recall of contextual memories. We found a striking dissociation between older versus younger participants in the relationship between the ability to retrieve contextual memories versus the ability to use these to guide attention to enhance performance on a target-detection task. Older participants showed significant deficits in the explicit retrieval task, but their behavioural benefits from memory-based orienting of attention were equivalent to those in young participants. Furthermore, memory-based orienting correlated significantly with explicit contextual LTM in younger adults but not in older adults. These results suggest that explicit memory deficits in ageing might not compromise initial perception and encoding of events. Importantly, the results also shed light on the mechanisms of memory-guided attention, suggesting that explicit contextual memories are not necessary.

The neural bases of spatial frequency processing during scene perception

Theories on visual perception agree that scenes are processed in terms of spatial frequencies. Low spatial frequencies (LSF) carry coarse information whereas high spatial frequencies (HSF) carry fine details of the scene. However, how and where spatial frequencies are processed within the brain remain unresolved questions. The present review addresses these issues and aims to identify the cerebral regions differentially involved in low and high spatial frequency processing, and to clarify their attributes during scene perception. Results from a number of behavioral and neuroimaging studies suggest that spatial frequency processing is lateralized in both hemispheres, with the right and left hemispheres predominantly involved in the categorization of LSF and HSF scenes, respectively. There is also evidence that spatial frequency processing is retinotopically mapped in the visual cortex. HSF scenes (as opposed to LSF) activate occipital areas in relation to foveal representations, while categorization of LSF scenes (as opposed to HSF) activates occipital areas in relation to more peripheral representations. Concomitantly, a number of studies have demonstrated that LSF information may reach high-order areas rapidly, allowing an initial coarse parsing of the visual scene, which could then be sent back through feedback into the occipito-temporal cortex to guide finer HSF-based analysis. Finally, the review addresses spatial frequency processing within scene-selective regions areas of the occipito-temporal cortex.