Preparatory attention in visual cortex

Pre-stimulus activities affect subsequent visual processing: Empirical evidence and potential neural mechanisms

PURPOSE

Humans obtain most of their information from visual stimuli. The perception of these stimuli may be modulated by the ongoing pre-stimulus brain activities. Depending on the task design, the processing of different cognitive functions such as spatial attention, feature-based attention, temporal attention, arousal, and mental imagery may start prior to the stimulus onset.

METHOD

This process is typically accompanied by changes in pre-stimulus oscillatory activities including power, phase, or connectivity in different frequency bands. To explain the effect of these changes, several mechanisms have been proposed. In this article, we review these changes and the potential mechanisms in the context of the pre-stimulus enabled cognitive functions. We provide evidence both in favor of and against the most documented mechanisms and conclude that no single mechanism can solely delineate the effects of pre-stimulus brain activities on later processing. Instead, multiple mechanisms may work in tandem to guide pre-stimulus brain activities.

FINDING

Additionally, our findings indicate that in many studies a combination of these cognitive functions begins prior to stimulus onset.

CONCLUSION

Thus, dissociating these cognitive functions is challenging based on the current literature, and the need for precise task designs in later studies to differentiate between them is crucial.

The strength of confidence is involved in controlling the intensity of attentional allocation

Subjective confidence and uncertainty are closely related to cognition and behavior. However, direct evidence that subjective confidence controls attention allocation is lacking. This study aimed to clarify whether subjective confidence could be involved in controlling attention allocation and intensity. We created a model for predicting the participants' subjective confidence and verified its validity. Then, an electroencephalogram was recorded while the participants engaged in a behavioral task aimed to allocate their attention based on their confidence level. We observed a negative correlation where trials with higher confidence were associated with shorter reaction times to the target. Regarding event-related potentials (ERPs), we observed higher P1 potentials (early component of the ERP waveform after stimulus onset) in the ipsilateral occipital area during target presentation. Additionally, we observed lower frontoparietal P3a potentials (component of the ERP waveform associated with attention) in the high-confidence condition. We observed a higher alpha (8-12 Hz) power in the ipsilateral occipitoparietal area of the target presentation in the low-confidence condition. Subjective confidence might influence attentional allocation and intensity, possibly achieved by suppressing processing in the target-absent space. Our findings provided important insights into the role of subjective confidence in cognitive and behavioral control.

Decoding the rhythmic representation and communication of visual contents

Rhythmic neural activity is considered essential for adaptively modulating responses in the visual system. In this opinion article we posit that visual brain rhythms also serve a key function in the representation and communication of visual contents. Collating a set of recent studies that used multivariate decoding methods on rhythmic brain signals, we highlight such rhythmic content representations in visual perception, imagery, and prediction. We argue that characterizing representations across frequency bands allows researchers to elegantly disentangle content transfer in feedforward and feedback directions. We further propose that alpha dynamics are central to content-specific feedback propagation in the visual system. We conclude that considering rhythmic content codes is pivotal for understanding information coding in vision and beyond.

The influence of lexical word properties on selective attention to emotional words: Support for the attentional tuning of valent word forms

Using event-related potentials, it was found that selective attention to valence facilitates early affective discrimination of words with task-relevant valence and inhibits affective processing of words with task-irrelevant valence. This attention-based modulation of affective processing presumably relies on prior associative learning linking visual word forms with their affects. To investigate this hypothesis, we employed a valence-detection task and manipulated lexical (length, frequency) and affective (arousal) word features. Since we assumed that these features strongly influence the strength of visual form-affect associations, we expected them to play a crucial role in early affective discrimination. Fifty-eight participants made speeded responses only to words of one predefined target level of valence (negative, neutral, or positive), which varied across three blocks. As expected, the visual P1 component yielded greater valence discrimination for the target than for nontarget words. This interactive effect was most prominent for short, high-frequency and low-arousal words, respectively. Regarding the N170 component, low-frequency words showed higher amplitudes when they were either positive low-arousing or negative high-arousing compared with the other two sets of words, independently of target status. Additionally, an average-referenced EPN-like posterior negativity (150-270 ms) revealed a target-independent interaction between valence and arousal and increased amplitudes for negative target words. Results extend previous research in showing that particularly short and highly frequent valent word forms can be tuned by selective attention to valence, facilitating early affective discrimination. Finally, findings support the notion that valence and arousal interact during early preattentive, bottom-up processing which is interpreted within the valence-arousal conflict theory.

You're Beautiful When You Smile: Event-Related Brain Potential (ERP) Evidence of Early Opposite-Gender Bias in Happy Faces

Studies of social cognition have shown gender differences regarding human face processing. One interesting finding is the enhanced processing of opposite-gender faces at different time stages, as revealed by event-related brain potentials. Crucially, from an evolutionary perspective, such a bias might interact with the emotional expression of the face. To investigate this, 100 participants (50 female, 50 male) completed an expression-detection task while their EEG was recorded. In three blocks, fearful, happy and neutral faces (female and male) were randomly presented, with participants instructed to respond to only one predefined target expression level in each block. Using linear mixed models, we observed both faster reaction times as well as larger P1 and late positive potential (LPP) amplitudes for women compared to men, supporting a generally greater female interest in faces. Highly interestingly, the analysis revealed an opposite-gender bias at P1 for happy target faces. This suggests that participants' attentional templates may include more opposite-gender facial features when selectively attending to happy faces. While N170 was influenced by neither the face nor the participant gender, LPP was modulated by the face gender and specific combinations of the target status, face gender and expression, which is interpreted in the context of gender-emotion stereotypes. Future research should further investigate this expression and attention dependency of early opposite-gender biases.

Laminar dissociation of feedforward and feedback in high-level ventral visual cortex during imagery and perception

Visual imagery and perception share neural machinery but rely on different information flow. While perception is driven by the integration of sensory feedforward and internally generated feedback information, imagery relies on feedback only. This suggests that although imagery and perception may activate overlapping brain regions, they do so in informationally distinctive ways. Using lamina-resolved MRI at 7 T, we measured the neural activity during imagery and perception of faces and scenes in high-level ventral visual cortex at the mesoscale of laminar organization that distinguishes feedforward from feedback signals. We found distinctive laminar profiles for imagery and perception of scenes and faces in the parahippocampal place area and the fusiform face area, respectively. Our findings provide insight into the neural basis of the phenomenology of visual imagery versus perception and shed new light into the mesoscale organization of feedforward and feedback information flow in high-level ventral visual cortex.

Meta-analysis of experimental factors influencing single-pulse TMS effects on the early visual cortex

Background

Single-pulse transcranial magnetic stimulation (spTMS) applied to the Early Visual Cortex (EVC) has demonstrated the ability to suppress the perception on visual targets, akin to the effect of visual masking. However, the reported spTMS suppression effects across various studies have displayed inconsistency.

Objective

We aim to test if the heterogeneity of the spTMS effects can be attributable to variations in experimental factors.

Methods

We conducted a meta-analysis using data collected from the PubMed and Web of Science databases spanning from 1995 to March 2024. The meta-analysis encompassed a total of 40 independent experiments drawn from 33 original articles.

Results

The findings unveiled an overall significant spTMS suppression effect on visual perception. Nevertheless, there existed substantial heterogeneity among the experiments. Univariate analysis elucidated that the spTMS effects could be significantly influenced by TMS intensity, visual angle of the stimulus, coil type, and TMS stimulators from different manufacturers. Reliable spTMS suppression effects were observed within the time windows of -80 to 0 ms and 50 to 150 ms. Multivariate linear regression analyses, which included SOA, TMS intensity, visual angle of the stimulus, and coil type, identified SOA as the key factor influencing the spTMS effects. Within the 50 to 150 ms time window, optimal SOAs were identified as 112 ms and 98 ms for objective and subjective performance, respectively. Collectively, multiple experimental factors accounted for 22.9% (r = 0.3353) and 39.9% (r = 0.3724) of the variance in objective and subjective performance, respectively. Comparing univariate and multivariate analyses, it was evident that experimental factors had different impacts on objective performance and subjective performance.

Conclusion

The present study provided quantitative recommendations for future experiments involving the spTMS effects on visual targets, offering guidance on how to configure experimental factors to achieve the optimal masking effect.

Category-based attention facilitates memory search

We often need to decide whether the object we look at is also the object we look for. When we look for one specific object, this process can be facilitated by feature-based attention. However, when we look for many objects at the same time (e.g., the products on our shopping list) such a strategy may no longer be possible, as research has shown that we can actively prepare to detect only one or two objects at a time. Therefore, looking for multiple objects additionally requires long-term memory search, slowing down decision making. Interestingly, however, previous research has shown that distractor objects can be efficiently rejected during memory search when they are from a different category than the items in the memory set. Here, using EEG, we show that this efficiency is supported by top-down attention at the category level. In Experiment 1, human participants (both sexes) performed a memory search task on individually presented objects from different categories, most of which were distractors. We observed category-level attentional modulation of distractor processing from ∼150 ms after stimulus onset, expressed both as an evoked response modulation and as an increase in decoding accuracy of same-category distractors. In Experiment 2, memory search was performed on two concurrently presented objects. When both objects were distractors, spatial attention (indexed by the N2pc component) was directed to the object that was of the same category as the objects in the memory set. Together, these results demonstrate how top-down attention can facilitate memory search.Significance statement When we are in the supermarket, we repeatedly decide whether a product we look at (e.g., a banana) is on our memorized shopping list (e.g., apples, oranges, kiwis). This requires searching our memory, which takes time. However, when the product is of an entirely different category (e.g., dairy instead of fruit), the decision can be made quickly. Here, we used EEG to show that this between-category advantage in memory search tasks is supported by top-down attentional modulation of visual processing: The visual response evoked by distractor objects was modulated by category membership, and spatial attention was quickly directed to the location of within-category (vs. between-category) distractors. These results demonstrate a close link between attention and memory.

Attentional Modulation in Early Visual Cortex: A Focused Reanalysis of Steady-state Visual Evoked Potential Studies

Steady-state visual evoked potentials (SSVEPs) are a powerful tool for investigating selective attention. Here, we conducted a combined reanalysis of multiple studies employing this technique in a variety of attentional experiments to, first, establish benchmark effect sizes of attention on amplitude and phase of SSVEPs and, second, harness the power of a large data set to test more specific hypotheses. Data of eight published SSVEP studies were combined, in which human participants (n = 135 in total) attended to flickering random dot stimuli based on their defining features (e.g., location, color, luminance, or orientation) or feature conjunctions. The reanalysis established that, in all the studies, attention reliably enhanced amplitudes, with color-based attention providing the strongest effect. In addition, the latency of SSVEPs elicited by attended stimuli was reduced by ∼4 msec. Next, we investigated the modulation of SSVEP amplitudes in a subset of studies where two different features were attended concurrently. Although most models assume that attentional effects of multiple features are combined additively, our results suggest that neuronal enhancement provided by concurrent attention is better described by multiplicative integration. Finally, we used the combined data set to demonstrate that the increase in trial-averaged SSVEP amplitudes with attention cannot be explained by increased synchronization of single-trial phases. Contrary to the prediction of the phase-locking account, the variance across trials of complex Fourier coefficients increases with attention, which is more consistent with boosting of a largely phase-locked signal embedded in non-phase-locked noise.

The influence of selective attention to specific emotions on the processing of faces as revealed by event-related brain potentials

Event-related potential studies using affective words have indicated that selective attention to valence can increase affective discrimination at early perceptual stages. This effect most likely relies on neural associations between perceptual features of a stimulus and its affective value. Similar to words, emotional expressions in human faces are linked to specific visual elements. Therefore, selectively attending to a given emotion should allow for the preactivation of neural networks coding for the emotion and associated first-order visual elements, leading to enhanced early processing of faces expressing the attended emotion. To investigate this, we employed an expression detection task (N = 65). Fearful, happy, and neutral faces were randomly presented in three blocks while participants were instructed to respond only to one predefined target level of expression in each block. Reaction times were the fastest for happy target faces, which was accompanied by an increased occipital P1 for happy compared with fearful faces. The N170 yielded an arousal effect (emotional > neutral) while both components were not modulated by target status. In contrast, the early posterior negativity (EPN) arousal effect tended to be larger for target compared with nontarget faces. The late positive potential (LPP) revealed large effects of status and expression as well as an interaction driven by an increased LPP specifically for nontarget fearful faces. These findings tentatively indicate that selective attention to facial affect may enhance early emotional processing (EPN) even though further research is needed. Moreover, late controlled processing of facial emotions appears to involve a negativity bias.

Testing cognitive theories with multivariate pattern analysis of neuroimaging data

Multivariate pattern analysis (MVPA) has emerged as a powerful method for the analysis of functional magnetic resonance imaging, electroencephalography and magnetoencephalography data. The new approaches to experimental design and hypothesis testing afforded by MVPA have made it possible to address theories that describe cognition at the functional level. Here we review a selection of studies that have used MVPA to test cognitive theories from a range of domains, including perception, attention, memory, navigation, emotion, social cognition and motor control. This broad view reveals properties of MVPA that make it suitable for understanding the 'how' of human cognition, such as the ability to test predictions expressed at the item or event level. It also reveals limitations and points to future directions.

Top-down specific preparatory activations for selective attention and perceptual expectations

Proactive cognition brain models are mainstream nowadays. Within these, preparation is understood as an endogenous, top-down function that takes place prior to the actual perception of a stimulus and improves subsequent behavior. Neuroimaging has shown the existence of such preparatory activity separately in different cognitive domains, however no research to date has sought to uncover their potential similarities and differences. Two of these, often confounded in the literature, are Selective Attention (information relevance) and Perceptual Expectation (information probability). We used EEG to characterize the mechanisms that pre-activate specific contents in Attention and Expectation. In different blocks, participants were cued to the relevance or to the probability of target categories, faces vs. names, in a gender discrimination task. Multivariate Pattern (MVPA) and Representational Similarity Analyses (RSA) during the preparation window showed that both manipulations led to a significant, ramping-up prediction of the relevant or expected target category. However, classifiers trained with data from one condition did not generalize to the other, indicating the existence of unique anticipatory neural patterns. In addition, a Canonical Template Tracking procedure showed that there was stronger anticipatory perceptual reinstatement for relevance than for expectation blocks. Overall, the results indicate that preparation during attention and expectation acts through distinguishable neural mechanisms. These findings have important implications for current models of brain functioning, as they are a first step towards characterizing and dissociating the neural mechanisms involved in top-down anticipatory processing.

Alcohol-induced deficits in reactive control of response selection and inhibition are counteracted by a seemingly paradox increase in proactive control

High-dose alcohol intoxication reduces cognitive control, including inhibition. Although inhibition deficits may contribute to the behavioral deficits commonly observed in alcohol use disorder (AUD), many questions about potentially modulating factors have remained unanswered. We examined the effects of experimentally induced high-dose alcohol intoxication (~ 1.1 ‰) on the interplay between controlled vs. automatic response selection and inhibition in healthy young men. A holistic EEG-based theta activity analysis that considered both reactive control during task performance and preceding proactive control processes was run. It revealed a previously unknown seesaw relationship, with decreased reactive control, but paradoxically increased proactive control. Most importantly, alcohol-induced increases in proactive occipital theta band power were associated with reductions in negative alcohol effects on reactive control processes associated with decreased activity in the SMA and medial frontal cortex. Our findings demonstrate that research should not solely focus on immediate effects during task performance. Aside from differential neurobiochemical and neuroanatomical effects of alcohol, it is also conceivable that proactive control may have been recruited in a (secondary) response to compensate for alcohol-induced impairments in reactive control. Against this background, it could be promising to investigate changes in such compensatory mechanisms in pronounced alcohol-associated inhibition deficits, like in AUD patients.

Is cognitive control of perception and action via attentional focus moderated by motor imagery?

Motor imagery (MI) has emerged as an individual factor that may modulate the effects of attentional focus on motor skill performance. In this study, we investigated whether global MI, as well as its components (i.e., kinesthetic MI, internal visual MI, and external visual MI) moderate the effect of attentional focus on performance in a group of ninety-two young adult novice air-pistol shooters (age: M = 21.87, SD = 2.54). After completing the movement imagery questionnaire-3 (MIQ-3), participants were asked to complete a pistol shooting experiment in three different attentional focus conditions: (1) No focus instruction condition (control condition with no verbal instruction) (2) an internal focus instruction condition, and (3) an external focus condition. Shot accuracy, performance time, and aiming trace speed (i.e., stability of hold or weapon stability) were measured as the performance variables. Results revealed that shot accuracy was significantly poorer during internal relative to control focus condition. In addition, performance time was significantly higher during external relative to both control and internal condition. However, neither global MI, nor its subscales, moderated the effects of attentional focus on performance. This study supports the importance of attentional focus for perceptual and motor performance, yet global MI and its modalities/perspectives did not moderate pistol shooting performance. This study suggests that perception and action are cognitively controlled by attentional mechanisms, but not motor imagery. Future research with complementary assessment modalities is warranted to extend the present findings.

Preparatory attention to visual features primarily relies on non-sensory representation

Prior knowledge of behaviorally relevant information promotes preparatory attention before the appearance of stimuli. A key question is how our brain represents the attended information during preparation. A sensory template hypothesis assumes that preparatory signals evoke neural activity patterns that resembled the perception of the attended stimuli, whereas a non-sensory, abstract template hypothesis assumes that preparatory signals reflect the abstraction of attended stimuli. To test these hypotheses, we used fMRI and multivariate analysis to characterize neural activity patterns when human participants were prepared to attend a feature and then select it from a compound stimulus. In an fMRI experiment using basic visual feature (motion direction), we observed reliable decoding of the to-be-attended feature from the preparatory activity in both visual and frontoparietal areas. However, while the neural patterns constructed by a single feature from a baseline task generalized to the activity patterns during stimulus selection, they could not generalize to the activity patterns during preparation. Our findings thus suggest that neural signals during attentional preparation are predominantly non-sensory in nature that may reflect an abstraction of the attended feature. Such a representation could provide efficient and stable guidance of attention.

Pre-stimulus Alpha Activity Modulates Face and Object Processing in the Intra-Parietal Sulcus, a MEG Study

Face perception is crucial in all social animals. Recent studies have shown that pre-stimulus oscillations of brain activity modulate the perceptual performance of face vs. non-face stimuli, specifically under challenging conditions. However, it is unclear if this effect also occurs during simple tasks, and if so in which brain regions. Here we used magnetoencephalography (MEG) and a 1-back task in which participants decided if the two sequentially presented stimuli were the same or not in each trial. The aim of the study was to explore the effect of pre-stimulus alpha oscillation on the perception of face (human and monkey) and non-face stimuli. Our results showed that pre-stimulus activity in the left occipital face area (OFA) modulated responses in the intra-parietal sulcus (IPS) at around 170 ms after the presentation of human face stimuli. This effect was also found after participants were shown images of motorcycles. In this case, the IPS was modulated by pre-stimulus activity in the right OFA and the right fusiform face area (FFA). We conclude that pre-stimulus modulation of post-stimulus response also occurs during simple tasks and is therefore independent of behavioral responses.

The Superior Colliculus: Cell Types, Connectivity, and Behavior

The superior colliculus (SC), one of the most well-characterized midbrain sensorimotor structures where visual, auditory, and somatosensory information are integrated to initiate motor commands, is highly conserved across vertebrate evolution. Moreover, cell-type-specific SC neurons integrate afferent signals within local networks to generate defined output related to innate and cognitive behaviors. This review focuses on the recent progress in understanding of phenotypic diversity amongst SC neurons and their intrinsic circuits and long-projection targets. We further describe relevant neural circuits and specific cell types in relation to behavioral outputs and cognitive functions. The systematic delineation of SC organization, cell types, and neural connections is further put into context across species as these depend upon laminar architecture. Moreover, we focus on SC neural circuitry involving saccadic eye movement, and cognitive and innate behaviors. Overall, the review provides insight into SC functioning and represents a basis for further understanding of the pathology associated with SC dysfunction.

Efficient Prestimulus Network Integration of Fusiform Face Area Biases Face Perception during Binocular Rivalry

Ongoing fluctuations in neural excitability and connectivity influence whether or not a stimulus is seen. Do they also influence which stimulus is seen? We recorded magnetoencephalography data while 21 human participants viewed face or house stimuli, either one at a time or under bistable conditions induced through binocular rivalry. Multivariate pattern analysis revealed common neural substrates for rivalrous versus nonrivalrous stimuli with an additional delay of ∼36 msec for the bistable stimulus, and poststimulus signals were source-localized to the fusiform face area. Before stimulus onset followed by a face versus house report, fusiform face area showed stronger connectivity to primary visual cortex and to the rest of the cortex in the alpha frequency range (8-13 Hz), but there were no differences in local oscillatory alpha power. The prestimulus connectivity metrics predicted the accuracy of poststimulus decoding and the delay associated with rivalry disambiguation suggesting that perceptual content is shaped by ongoing neural network states.

Working memory guidance of visual attention to threat in offenders

Aggression and trait anger have been linked to attentional biases toward angry faces and attribution of hostile intent in ambiguous social situations. Memory and emotion play a crucial role in social-cognitive models of aggression but their mechanisms of influence are not fully understood. Combining a memory task and a visual search task, this study investigated the guidance of attention allocation toward naturalistic face targets during visual search by visual working memory (WM) templates in 113 participants who self-reported having served a custodial sentence. Searches were faster when angry faces were held in working memory regardless of the emotional valence of the visual search target. Higher aggression and trait anger predicted increased working memory modulated attentional bias. These results are consistent with the Social-Information Processing model, demonstrating that internal representations bias attention allocation to threat and that the bias is linked to aggression and trait anger.

Combined influences of strategy and selection history on attentional control

Visual attention is guided by top-down mechanisms and pre-stimulus task preparation, but also by selection history (i.e., the bias to prioritize previously attended items). Here we examine how these influences combine. Two groups of participants completed two intermingled tasks. One task involved categorization of a unique target; one group categorized the target based on color, and the other based on shape. The other task involved searching for a target defined by unique shape while ignoring a distractor defined by unique color. Our expectation was that the search task would be difficult for the color-categorization group because their categorization task required attentional resolution of color, but the search task required that they ignore color. In some experimental blocks, trials from the two tasks appeared predictably, giving the color-categorization group an opportunity to strategically prepare by switching between color-prioritizing and shape-prioritizing attentional templates. We looked to pre-stimulus oscillatory activity as a direct index of this preparation, and to reaction times and post-stimulus ERPs for markers of resultant change in attentional deployment. Results showed that preparation in the color-categorization group optimized attentional templates, such that these participants became less sensitive to the color distractor in the search task. But preparation was not sufficient to entirely negate the influence of selection history, and participants in the color-categorization group continued to show a propensity to attend to the color distractor. These results indicate that preparatory effort can be scaled to the anticipated attentional requirements, but attention is nevertheless considerably biased by selection history.

Preparatory attention incorporates contextual expectations

Humans are remarkably proficient at finding objects within complex visual scenes. According to current theories of attention,^1-3 visual processing of an object of interest is favored through the preparatory activation of object-specific representations in visual cortex.^4-15 One key problem that is inherent to real-world visual search but is not accounted for by current theories is that a given object will produce a dramatically different retinal image depending on its location, which is unknown in advance. For instance, the color of the retinal image depends on the illumination on the object, its shape depends on the viewpoint, and (most critically) its size can vary by several orders of magnitude, depending on the distance to the observer. In order to benefit search, preparatory activity thus needs to incorporate contextual expectations. In the current study, we measured fMRI blood-oxygen-level-dependent (BOLD) activity in human observers while they prepared to search for objects at different distances in indoor-scene photographs. First, we established that observers instantiated preparatory object representations: activity patterns in object-selective cortex evoked during search preparation (while no objects were presented) resembled activity patterns evoked by viewing those objects in isolation. Second, we demonstrated that these preparatory object representations were systematically modulated by expectations derived from scene context: activity patterns reflected the predicted retinal image of the object at each distance (i.e., distant search evoking smaller object representations and nearby search evoking larger object representations). These findings reconcile current theories of attentional selection with the challenges of real-world vision.

Spatial and Feature-selective Attention Have Distinct, Interacting Effects on Population-level Tuning

Attention can be deployed in different ways: When searching for a taxi in New York City, we can decide where to attend (e.g., to the street) and what to attend to (e.g., yellow cars). Although we use the same word to describe both processes, nonhuman primate data suggest that these produce distinct effects on neural tuning. This has been challenging to assess in humans, but here we used an opportunity afforded by multivariate decoding of MEG data. We found that attending to an object at a particular location and attending to a particular object feature produced effects that interacted multiplicatively. The two types of attention induced distinct patterns of enhancement in occipital cortex, with feature-selective attention producing relatively more enhancement of small feature differences and spatial attention producing relatively larger effects for larger feature differences. An information flow analysis further showed that stimulus representations in occipital cortex were Granger-caused by coding in frontal cortices earlier in time and that the timing of this feedback matched the onset of attention effects. The data suggest that spatial and feature-selective attention rely on distinct neural mechanisms that arise from frontal-occipital information exchange, interacting multiplicatively to selectively enhance task-relevant information.

Coherent natural scene structure facilitates the extraction of task-relevant object information in visual cortex

Looking for objects within complex natural environments is a task everybody performs multiple times each day. In this study, we explore how the brain uses the typical composition of real-world environments to efficiently solve this task. We recorded fMRI activity while participants performed two different categorization tasks on natural scenes. In the object task, they indicated whether the scene contained a person or a car, while in the scene task, they indicated whether the scene depicted an urban or a rural environment. Critically, each scene was presented in an "intact" way, preserving its coherent structure, or in a "jumbled" way, with information swapped across quadrants. In both tasks, participants' categorization was more accurate and faster for intact scenes. These behavioral benefits were accompanied by stronger responses to intact than to jumbled scenes across high-level visual cortex. To track the amount of object information in visual cortex, we correlated multi-voxel response patterns during the two categorization tasks with response patterns evoked by people and cars in isolation. We found that object information in object- and body-selective cortex was enhanced when the object was embedded in an intact, rather than a jumbled scene. However, this enhancement was only found in the object task: When participants instead categorized the scenes, object information did not differ between intact and jumbled scenes. Together, these results indicate that coherent scene structure facilitates the extraction of object information in a task-dependent way, suggesting that interactions between the object and scene processing pathways adaptively support behavioral goals.

Decoding of cognitive processes involved in the continuous performance task

Decoding of electroencephalogram brain representations is a powerful data driven technique to assess the stream of cognitive information processing. It could promote a more thorough understanding of cognitive control networks. For many years, the continuous performance task has been utilized to investigate impaired proactive and reactive cognitive functions. So far, mainly task performance and univariate electroencephalogram were involved in such investigations. In this study, we benefit from multi-variate pattern analysis of continuous performance task variations to provide a more complete spatio-temporal outline of information processing flow involved in sustained and transient attention and response preparation. Besides effects that are well in line with previous EEG research but could be described in more spatial and temporal detail by the used methods, our results could suggest the presence of a higher order feedback control system when expectations are violated. Such a feedback control is related to modulations of behavior both intra- and inter-individually.

Closed-Loop Neurofeedback of α Synchrony during Goal-Directed Attention

α Oscillations in sensory cortex, under frontal control, desynchronize during attentive preparation. Here, in a selective attention study with simultaneous EEG in humans of either sex, we first demonstrate that diminished anticipatory α synchrony between the mid-frontal region of the dorsal attention network and ventral visual sensory cortex [frontal-sensory synchrony (FSS)] significantly correlates with greater task performance. Then, in a double-blind, randomized controlled study in healthy adults, we implement closed-loop neurofeedback (NF) of the anticipatory α FSS signal over 10 d of training. We refer to this closed-loop experimental approach of rapid NF integrated within a cognitive task as cognitive NF (cNF). We show that cNF results in significant trial-by-trial modulation of the anticipatory α FSS measure during training, concomitant plasticity of stimulus-evoked α/θ responses, as well as transfer of benefits to response time (RT) improvements on a standard test of sustained attention. In a third study, we implement cNF training in children with attention deficit hyperactivity disorder (ADHD), replicating trial-by-trial modulation of the anticipatory α FSS signal as well as significant improvement of sustained attention RTs. These first findings demonstrate the basic mechanisms and translational utility of rapid cognitive-task-integrated NF.SIGNIFICANCE STATEMENT When humans prepare to attend to incoming sensory information, neural oscillations in the α band (8-14 Hz) undergo desynchronization under the control of prefrontal cortex. Here, in an attention study with electroencephalography, we first show that frontal-sensory synchrony (FSS) of α oscillations during attentive preparation significantly correlates with task performance. Then, in a randomized controlled study in healthy adults, we show that neurofeedback (NF) training of this α FSS signal within the attention task is feasible. We show that this rapid cognitive NF (cNF) approach engenders plasticity of stimulus-evoked neural responses, and improves performance on a standard test of sustained attention. In a final study, we implement cNF in children with attention deficit hyperactivity disorder (ADHD), replicating the improvement of sustained attention found in adults.

Dissociating conscious and unconscious influences on visual detection effects

The scope of unconscious processing is highly debated, with recent studies showing that even high-level functions such as perceptual integration and category-based attention occur unconsciously. For example, upright faces that are suppressed from awareness through interocular suppression break into awareness more quickly than inverted faces. Similarly, verbal object cues boost otherwise invisible objects into awareness. Here, we replicate these findings, but find that they reflect a general difference in detectability not specific to interocular suppression. To dissociate conscious and unconscious influences on visual detection effects, we use an additional discrimination task to rule out conscious processes as a cause for these differences. Results from this detection-discrimination dissociation paradigm reveal that, while face orientation is processed unconsciously, category-based attention requires awareness. These findings provide insights into the function of conscious perception and offer an experimental approach for mapping out the scope and limits of unconscious processing.

Short timescale modulation of cortical and cerebellar activity in the early phase of motor sequence learning: an fMRI study

Motor learning is a multi-stage process, in which the involvement of different brain regions is related to the specific stage. We aimed at characterising short timescale changes of brain activity induced by motor sequence learning. Twenty healthy volunteers performed a serial reaction time task during an MRI session in a 3 T scanner. The task consisted of two conditions: repeated and random, that were compared over the whole fMRI run, as well as within sections, to investigate brain activity modulating related to the learning stage. The whole fMRI run analysis showed a stronger response for the repeated condition in fronto-parietal regions, cerebellum and thalamus. The analysis on sections showed initially increased right cerebellar activity. In the subsequent phase, bilateral cerebellar activity was observed, while no increased activity was seen in the last phase, when the learning was established. At the neocortical level, the repeated condition showed stronger activity at first in fronto-parietal regions bilaterally, then lateralized to the right hemisphere in the last learning phase. This study showed short time scale brain activity modulation in cortical and cerebellar regions with involvement of different brain regions over the learning process not restricted to the motor circuit.

Attention driven phantom vision: measuring the sensory strength of attentional templates and their relation to visual mental imagery and aphantasia

When we search for an object in an array or anticipate attending to a future object, we create an 'attentional template' of the object. The definitions of attentional templates and visual imagery share many similarities as well as many of the same neural characteristics. However, the phenomenology of these attentional templates and their neural similarities to visual imagery and perception are rarely, if ever discussed. Here, we investigate the relationship between these two forms of non-retinal phantom vision through the use of the binocular rivalry technique, which allows us to measure the sensory strength of attentional templates in the absence of concurrent perceptual stimuli. We find that attentional templates correlate with both feature-based attention and visual imagery. Attentional templates, like imagery, were significantly disrupted by the presence of irrelevant visual stimuli, while feature-based attention was not. We also found that a special population who lack the ability to visualize (aphantasia), showed evidence of feature-based attention when measured using the binocular rivalry paradigm, but not attentional templates. Taken together, these data suggest functional similarities between attentional templates and visual imagery, advancing the theory of visual imagery as a general simulation tool used across cognition. This article is part of the theme issue 'Offline perception: voluntary and spontaneous perceptual experiences without matching external stimulation'.

Population codes of prior knowledge learned through environmental regularities

How the brain makes correct inferences about its environment based on noisy and ambiguous observations is one of the fundamental questions in Neuroscience. Prior knowledge about the probability with which certain events occur in the environment plays an important role in this process. Humans are able to incorporate such prior knowledge in an efficient, Bayes optimal, way in many situations, but it remains an open question how the brain acquires and represents this prior knowledge. The long time spans over which prior knowledge is acquired make it a challenging question to investigate experimentally. In order to guide future experiments with clear empirical predictions, we used a neural network model to learn two commonly used tasks in the experimental literature (i.e. orientation classification and orientation estimation) where the prior probability of observing a certain stimulus is manipulated. We show that a population of neurons learns to correctly represent and incorporate prior knowledge, by only receiving feedback about the accuracy of their inference from trial-to-trial and without any probabilistic feedback. We identify different factors that can influence the neural responses to unexpected or expected stimuli, and find a novel mechanism that changes the activation threshold of neurons, depending on the prior probability of the encoded stimulus. In a task where estimating the exact stimulus value is important, more likely stimuli also led to denser tuning curve distributions and narrower tuning curves, allocating computational resources such that information processing is enhanced for more likely stimuli. These results can explain several different experimental findings, clarify why some contradicting observations concerning the neural responses to expected versus unexpected stimuli have been reported and pose some clear and testable predictions about the neural representation of prior knowledge that can guide future experiments.

Neural mechanisms underlying expectation-dependent inhibition of distracting information

Predictions based on learned statistical regularities in the visual world have been shown to facilitate attention and goal-directed behavior by sharpening the sensory representation of goal-relevant stimuli in advance. Yet, how the brain learns to ignore predictable goal-irrelevant or distracting information is unclear. Here, we used EEG and a visual search task in which the predictability of a distractor's location and/or spatial frequency was manipulated to determine how spatial and feature distractor expectations are neurally implemented and reduce distractor interference. We find that expected distractor features could not only be decoded pre-stimulus, but their representation differed from the representation of that same feature when part of the target. Spatial distractor expectations did not induce changes in preparatory neural activity, but a strongly reduced Pd, an ERP index of inhibition. These results demonstrate that neural effects of statistical learning critically depend on the task relevance and dimension (spatial, feature) of predictions.

Looking beyond occlusion: A novel perspective for amblyopia treatment

Purpose:

The aim of this study was to evaluate the efficacy of Orthoptek (Magnocellular Stimulator OMS; Carditek Pvt. Ltd., Bangalore) as a treatment modality for amblyopia and strabismus.

Methods:

Thirty-five patients with amblyopia of any type, reduced vision in one or both eyes with no binocular vision and or poor stereopsis were included in the study. All patients underwent a minimum of 10 sessions of therapy with each session lasting for a cumulative period of 60 min. At the end of the 10^th session, patients were evaluated for improvement in visual acuity, stereopsis, Binocular single vision and amount of strabismus, if any.

Results:

The mean logMAR corrected distance visual acuity improved from 0.31 ± 0.34 and 0.32 ± 0.44 to 0.08 ± 0.12 and 0.07 ± 0.12 posttreatment in the right eye and left eye, respectively. Following therapy, 34 (97%) patients showed improvement in stereopsis, orthophoria was noticed in 28 (80%), and binocular single vision was noted in 33 (94%). All patients were followed up for 1 year with maintenance therapy and none showed any regression.

Conclusion:

We believe that top–down impulses and the role of the attention area in the parietal cortex have not been studied well enough in the treatment of amblyopia. Our device addresses these issues and corrects the visual deficits in amblyopia. However, the study needs validation of this pilot study from independent centers. The same will be done at some stage

Preparation for upcoming attentional states in the hippocampus and medial prefrontal cortex

Goal-directed attention is usually studied by providing individuals with explicit instructions on what they should attend to. But in daily life, we often use past experiences to guide our attentional states. Given the importance of memory for predicting upcoming events, we hypothesized that memory-guided attention is supported by neural preparation for anticipated attentional states. We examined preparatory coding in the human hippocampus and mPFC, two regions that are important for memory-guided behaviors, in two tasks: one where attention was guided by memory and another in which attention was explicitly instructed. Hippocampus and mPFC exhibited higher activity for memory-guided vs. explicitly instructed attention. Furthermore, representations in both regions contained information about upcoming attentional states. In the hippocampus, this preparation was stronger for memory-guided attention, and occurred alongside stronger coupling with visual cortex during attentional guidance. These results highlight the mechanisms by which memories are used to prepare for upcoming attentional goals.

The Weakened Relationship Between Prestimulus Alpha Oscillations and Response Time in Older Adults With Mild Cognitive Impairment

Background: Prestimulus alpha oscillations associated with preparatory attention have an impact on response time (RT). However, little is known about whether there is a deficit in the relationship between prestimulus alpha oscillations and RT in older adults with mild cognitive impairment (MCI).

Method: We collected electroencephalography (EEG) data from 28 older adults with MCI and 28 demographically matched healthy controls (HCs) when they were performing an Eriksen flanker task. For each participant, single-trial prestimulus alpha power was calculated for combinations of congruency (congruent vs. incongruent) and response speed (fast vs. slow).

Result: Statistical analysis indicated that prestimulus alpha power was significantly lower for fast trials than slow trials in HCs but not in older adults with MCI. The Fisher’s z scores of the within-subject correlation coefficients between single-trial prestimulus alpha power and RT were significantly larger in HCs than in older adults with MCI. In addition, machine learning analyses indicated that prestimulus alpha power and its correlation with RT could serve as features to distinguish older adults with MCI from HCs and to predict performance on some neuropsychological tests.

Conclusion: The reduced correlation between prestimulus alpha activity and RT suggests that older adults with MCI experience impaired preparatory attention.

Inhibition in selective attention

Our ability to focus on goal-relevant aspects of the environment is critically dependent on our ability to ignore or inhibit distracting information. One perspective is that distractor inhibition is under similar voluntary control as attentional facilitation of target processing. However, a rapidly growing body of research shows that distractor inhibition often relies on prior experience with the distracting information or other mechanisms that need not rely on active representation in working memory. Yet, how and when these different forms of inhibition are neurally implemented remains largely unclear. Here, we review findings from recent behavioral and neuroimaging studies to address this outstanding question. We specifically explore how experience with distracting information may change the processing of that information in the context of current predictive processing views of perception: by modulating a distractor's representation already in anticipation of the distractor, or after integration of top-down and bottom-up sensory signals. We also outline directions for future research necessary to enhance our understanding of how the brain filters out distracting information.

Functional Imaging of Visuospatial Attention in Complex and Naturalistic Conditions

One of the ultimate goals of cognitive neuroscience is to understand how the brain works in the real world. Functional imaging with naturalistic stimuli provides us with the opportunity to study the brain in situations similar to the everyday life. This includes the processing of complex stimuli that can trigger many types of signals related both to the physical characteristics of the external input and to the internal knowledge that we have about natural objects and environments. In this chapter, I will first outline different types of stimuli that have been used in naturalistic imaging studies. These include static pictures, short video clips, full-length movies, and virtual reality, each comprising specific advantages and disadvantages. Next, I will turn to the main issue of visual-spatial orienting in naturalistic conditions and its neural substrates. I will discuss different classes of internal signals, related to objects, scene structure, and long-term memory. All of these, together with external signals about stimulus salience, have been found to modulate the activity and the connectivity of the frontoparietal attention networks. I will conclude by pointing out some promising future directions for functional imaging with naturalistic stimuli. Despite this field of research is still in its early days, I consider that it will play a major role in bridging the gap between standard laboratory paradigms and mechanisms of brain functioning in the real world.

Modulation of the pupillary response by the content of visual working memory

Studies of selective attention during perception have revealed modulation of the pupillary response according to the brightness of task-relevant (attended) vs. -irrelevant (unattended) stimuli within a visual display. As a strong test of top-down modulation of the pupil response by selective attention, we asked whether changes in pupil diameter follow internal shifts of attention to memoranda of visual stimuli of different brightness maintained in working memory, in the absence of any visual stimulation. Across 3 studies, we reveal dilation of the pupil when participants orient attention to the memorandum of a dark grating relative to that of a bright grating. The effect occurs even when the attention-orienting cue is independent of stimulus brightness, and even when stimulus brightness is merely incidental and not required for the working-memory task of judging stimulus orientation. Furthermore, relative dilation and constriction of the pupil occurred dynamically and followed the changing temporal expectation that 1 or the other stimulus would be probed across the retention delay. The results provide surprising and consistent evidence that pupil responses are under top-down control by cognitive factors, even when there is no direct adaptive gain for such modulation, since no visual stimuli were presented or anticipated. The results also strengthen the view of sensory recruitment during working memory, suggesting even activation of sensory receptors. The thought-provoking corollary to our findings is that the pupils provide a reliable measure of what is in the focus of mind, thus giving a different meaning to old proverbs about the eyes being a window to the mind.

Evaluation of the role of the colour tent in vision stimulation for children with complex disabilities and cerebral visual impairment: A feasibility study

Children with profound and multiple disabilities commonly have their visual impairment overlooked when seeking to meet their complex health needs. The act of surrounding a child with little or no apparent visual function by a monochromatic translucent tent can serve to ‘switch on’ a child’s visual system. The aim of the project was to investigate the role of using colour tents to bring about attentional responses in children with complex disabilities including cerebral visual impairment.

The evaluation comprises three phases, repeated on four occasions over the space of 4 weeks. The child’s visual attention prior to entering the tent and during the 5 minutes after leaving the tent was recorded. Moreover, the child’s responses and behaviours while in the tent were recorded. Nine children participated in the evaluation, mean age 6 years (range: 5–9 years). All children showed a change in visual behaviour on at least one occasion while in the colour tent. Most children required more than one session before a change in visual behaviour was noted. Only two children showed increase in visual awareness after any session, and there was no sustained effect demonstrated.

This feasibility study has demonstrated that a short series of sessions in a colour tent is insufficient to demonstrate the effectiveness of a colour tent in stimulating visual awareness in children with complex needs. The methodology was acceptable to parents and teachers and lessons have been learned which will inform future studies.

Learning What Is Irrelevant or Relevant: Expectations Facilitate Distractor Inhibition and Target Facilitation through Distinct Neural Mechanisms

It is well known that attention can facilitate performance by top-down biasing processing of task-relevant information in advance. Recent findings from behavioral studies suggest that distractor inhibition is not under similar direct control but strongly dependent on expectations derived from previous experience. Yet, how expectations about distracting information influence distractor inhibition at the neural level remains unclear. The current study addressed this outstanding question in three experiments in which search displays with repeating distractor or target locations across trials allowed human observers (male and female) to learn which location to selectively suppress or boost. Behavioral findings demonstrated that both distractor and target location learning resulted in more efficient search, as indexed by faster response times. Crucially, distractor learning benefits were observed without target location foreknowledge, unaffected by the number of possible target locations, and could not be explained by priming alone. To determine how distractor location expectations facilitated performance, we applied a spatial encoding model to EEG data to reconstruct activity in neural populations tuned to distractor or target locations. Target location learning increased neural tuning to target locations in advance, indicative of preparatory biasing. This sensitivity increased after target presentation. By contrast, distractor expectations did not change preparatory spatial tuning. Instead, distractor expectations reduced distractor-specific processing, as reflected in the disappearance of the Pd event-related potential component, a neural marker of distractor inhibition, and decreased decoding accuracy. These findings suggest that the brain may no longer process expected distractors as distractors, once it has learned they can safely be ignored.SIGNIFICANCE STATEMENT We constantly try hard to ignore conspicuous events that distract us from our current goals. Surprisingly, and in contrast to dominant attention theories, ignoring distracting, but irrelevant, events does not seem to be as flexible as is focusing our attention on those same aspects. Instead, distractor suppression appears to strongly rely on learned, context-dependent expectations. Here, we investigated how learning about upcoming distractors changes distractor processing and directly contrasted the underlying neural dynamics to target learning. We show that, while target learning enhanced anticipatory sensory tuning, distractor learning only modulated reactive suppressive processing. These results suggest that expected distractors may no longer be considered distractors by the brain once it has learned that they can safely be ignored.

What causes dyslexia? Identifying the causes and effective compensatory therapy

BackgroundChildren are diagnosed as dyslexic when their reading performance is much below that which could be expected for their educational level and cannot be explained by a sensory, neurological or psychiatric deficit or by a low IQ. Although poor reading is a major obstacle to school and career achievement, the causes of dyslexia are unclear and traditional therapies are often unsuccessful. To determine the causes of dyslexia, experiments must demonstrate under which conditions a reading disorder occurs and whether the reading performance improves if these conditions are abolished or compensated. To avoid irreproducible results, experiments must be repeated and the effect size must be calculated.ObjectivesThe aims of the study were to investigate the rate and location of misread letters within pseudowords, prove the effectiveness of compensatory reading therapy and demonstrate the reproducibility of the experimental results. The influence of reading therapy on the rate of eye movements opposite to the reading direction was investigated and causes of a poor reading performance were identified.MethodsThe rate and location of misread letters were investigated by tachystoscopic presentation of pseudowords containing between three and six letters. Presentation time, fixation time, and the time it takes to begin pronouncing the words (speech onset latency) were changed until 95% of the pseudowords were recognized correctly. On the basis of these results, the children learned a reading strategy that compensated the causes of the reading disorder. The therapy was demonstrated to be highly effective and it was shown that the results of the therapy were reproducible.ResultsIt was shown that misread letters occurred at all locations in pseudowords, regardless of the word's length. Inadequate fixation, excessively large saccadic amplitudes, reduced ability to simultaneously recognize a sequence of letters, a longer required fixation time and a longer required speech onset latency were all identified as causes of dyslexia. Each of the studies included in the meta-analysis were much more efficient than conventional therapeutic methods. The overall effect size with a value of Hedges' G = 1.72 showed that the therapy had a reproducible and stable effect.ConclusionsThe causes of dyslexia can be revealed by a dual-intervention approach consisting of a pseudoword experiment and learning a compensatory reading strategy. Reading performance improves immediately if the identified causes of dyslexia are compensated by an appropriate reading therapy.