Attention enhances contrast sensitivity at cued and impairs it at uncued locations

Spatial attention alters visual cortical representation during target anticipation

Attention enables us to efficiently and flexibly interact with the environment by prioritizing some image features in preparation for responding to a stimulus. Using a concurrent psychophysics- fMRI experiment, we investigated how covert spatial attention affects responses in human visual cortex prior to target onset, and how it affects subsequent behavioral performance. Performance improved at cued locations and worsened at uncued locations, relative to distributed attention, demonstrating a selective tradeoff in processing. Pre-target BOLD responses in cortical visual field maps changed in two ways: First, there was a stimulus-independent baseline shift, positive in map locations near the cued location and negative elsewhere, paralleling the behavioral results. Second, population receptive field centers shifted toward the attended location. Both effects increased in higher visual areas. Together, the results show that spatial attention has large effects on visual cortex prior to target appearance, altering neural response properties throughout and across multiple visual field maps.

Task demand mediates the interaction of spatial and temporal attention

Psychophysical studies typically test attentional mechanisms in isolation, but in everyday life they interact to optimize human behavior. We investigated whether spatial and temporal attention interact in two orientation discrimination experiments that vary in task demand. We manipulated temporal and spatial attention separately and conjointly with well-established methods for testing each spatial or temporal attention. We assessed sensitivity (d') and reaction time for every combination of spatial and timing cues, each of which was valid, neutral, or invalid. Spatial attention modulated sensitivity (d') and speed (reaction time) across temporal attention conditions. Temporal attention modulated sensitivity and speed under high- but not low- task demands. Furthermore, spatial and temporal attention interacted for the high-demand task. This study reveals that task demand matters; in a simple task spatial attention suffices to improve performance, whereas in a more demanding task both spatial and temporal attention interact to boost performance, albeit in a subadditive fashion.

Adaptation and exogenous attention interact in the early visual cortex: A TMS study

Transcranial magnetic stimulation (TMS) to early visual cortex modulates the effect of adaptation and eliminates the effect of exogenous (involuntary) attention on contrast sensitivity. Here we investigated whether adaptation modulates exogenous attention under TMS to V1/V2. Observers performed an orientation discrimination task while attending to one of two stimuli, with or without adaptation. Following an attentional cue, two stimuli were presented in the stimulated region and its contralateral symmetric region. A response cue indicated the stimulus whose orientation observers had to discriminate. Without adaptation, in the distractor-stimulated condition, contrast sensitivity increased at the attended location and decreased at the unattended location via response gain-but these effects were eliminated in the target-stimulated condition. Critically, after adaptation, exogenous attention altered performance similarly in both distractor-stimulated and target-stimulated conditions. These results reveal that (1) adaptation and attention interact in the early visual cortex, and (2) adaptation shields exogenous attention from TMS effects.

Visual and cognitive processes contribute to age-related improvements in visual selective attention

Children (N = 103, 4-9 years, 59 females, 84% White, c. 2019) completed visual processing, visual feature integration (color, luminance, motion), and visual search tasks. Contrast sensitivity and feature search improved with age similarly for luminance and color-defined targets. Incidental feature integration improved more with age for color-motion than luminance-motion. Individual differences in feature search (β  = .11) and incidental feature integration (β  = .06) mediated age-related changes in conjunction visual search, an index of visual selective attention. These findings suggest that visual selective attention is best conceptualized as a series of developmental trajectories, within an individual, that vary by an object's defining features. These data have implications for design of educational and interventional strategies intended to maximize attention for learning and memory.

Life motion signals modulate visual working memory

Previous research has demonstrated that biological motion (BM) cues can induce a reflexive attentional orienting effect, a phenomenon referred to as social attention. However, it remains undetermined whether BM cues can further affect higher-order cognitive processes, such as visual working memory (WM). By combining a modified central pre-cueing paradigm with a traditional WM change detection task, the current study investigated whether the walking direction of BM, as a non-predictive central cue, could modulate the encoding process of WM. Results revealed a significant improvement in WM performance for the items appearing at the location cued by the walking direction of BM. The observed effect disappeared when the BM cues were shown inverted, or when the critical biological characteristics of the cues were removed. Crucially, this effect could be extended to upright feet motion cues without global configuration, reflecting the key role of local BM signals in modulating WM. More importantly, such a BM-induced modulation effect was not observed with inanimate motion cues, although these cues can also elicit attentional effects. Our findings suggest that the attentional effect induced by life motion signals can penetrate to higher-order cognitive processes, and provide compelling evidence for the existence of "life motion detector" in the human brain from a high-level cognitive function perspective.

Costs and benefits of voluntary attention in crows

Behavioural signatures of voluntary, endogenous selective attention have been found in both mammals and birds, but the relationship between performance benefits at attended and costs at unattended locations remains unclear. We trained two carrion crows (Corvus corone) on a Posner-like spatial cueing task with dissociated cue and target locations, using both highly predictive and neutral central cues to compare reaction time (RT) and detection accuracy for validly, invalidly and neutrally cued targets. We found robust RT effects of predictive cueing at varying stimulus-onset asynchronies (SOA) that resulted from both advantages at cued locations and costs at un-cued locations. Both crows showed cueing effects around 15-25 ms with an early onset at 100 ms SOA, comparable to macaques. Our results provide a direct assessment of costs and benefits of voluntary attention in a bird species. They show that crows are able to guide spatial attention using associative cues, and that the processing advantage at attended locations impairs performance at unattended locations.

Tasks and their role in visual neuroscience

Vision is widely used as a model system to gain insights into how sensory inputs are processed and interpreted by the brain. Historically, careful quantification and control of visual stimuli have served as the backbone of visual neuroscience. There has been less emphasis, however, on how an observer's task influences the processing of sensory inputs. Motivated by diverse observations of task-dependent activity in the visual system, we propose a framework for thinking about tasks, their role in sensory processing, and how we might formally incorporate tasks into our models of vision.

Effects of Voluntary Attention on Social and Non-Social Emotion Perception

Existing studies have focused on the effect of emotion on attention, and the role of attention on emotion has largely been underestimated. To further determine the mechanisms underlying the role of attention on emotion, the present study explored the effects of voluntary attention on both social and non-social aspects of emotional perception. Participants were 25 college students who completed the Rapid Serial Visual Prime (RSVP) paradigm. In this study, the selection rates of participants' emotional intensity, pleasure and distinctness perception of the pictures were measured. The results showed as following: (a) The cued condition selection rate was higher than the non-cued condition in the evaluation of non-social emotional intensity perception and pleasure perception, (b) In the evaluation of social emotional intensity and pleasure perception, there was no significant difference in the selection rate between the cued and non-cued condition, (c) The cued condition selection rate was higher than the non-cued condition in the perception of non-social positive emotional intensity and social negative emotional distinctness. The novel findings of this study revealed that the effect of voluntary attention on emotional perception is influenced not only by emotional valence but also by emotional sociality.

Perceptual Difficulty Regulates Attentional Gain Modulations in Human Visual Cortex

Perceptual difficulty is sometimes used to manipulate selective attention. However, these two factors are logically distinct. Selective attention is defined by priority given to specific stimuli based on their behavioral relevance, whereas perceptual difficulty is often determined by perceptual demands required to discriminate relevant stimuli. That said, both perceptual difficulty and selective attention are thought to modulate the gain of neural responses in early sensory areas. Previous studies found that selectively attending to a stimulus or increasing perceptual difficulty enhanced the gain of neurons in visual cortex. However, some other studies suggest that perceptual difficulty can have either a null or even reversed effect on gain modulations in visual cortex. According to Yerkes-Dodson's Law, it is possible that this discrepancy arises because of an interaction between perceptual difficulty and attentional gain modulations yielding a nonlinear inverted-U function. Here, we used EEG to measure modulations in the visual cortex of male and female human participants performing an attention-cueing task where we systematically manipulated perceptual difficulty across blocks of trials. The behavioral and neural data implicate a nonlinear inverted-U relationship between selective attention and perceptual difficulty: a focused-attention cue led to larger response gain in both neural and behavioral data at intermediate difficulty levels compared with when the task was more or less difficult. Moreover, difficulty-related changes in attentional gain positively correlated with those predicted by quantitative modeling of the behavioral data. These findings suggest that perceptual difficulty mediates attention-related changes in perceptual performance via selective neural modulations in human visual cortex.SIGNIFICANCE STATEMENT Both perceptual difficulty and selective attention are thought to influence perceptual performance by modulating response gain in early sensory areas. That said, less is known about how selective attention interacts with perceptual difficulty. Here, we measured neural gain modulations in the visual cortex of human participants performing an attention-cueing task where perceptual difficulty was systematically manipulated. Consistent with Yerkes-Dodson's Law, our behavioral and neural data implicate a nonlinear inverted-U relationship between selective attention and perceptual difficulty. These results suggest that perceptual difficulty mediates attention-related changes in perceptual performance via selective neural modulations in visual cortex, extending our understanding of the attentional operation under different levels of perceptual demands.

Microsaccades and temporal attention at different locations of the visual field

Temporal attention, the prioritization of information at specific points in time, improves performance in behavioral tasks but cannot ameliorate the perceptual asymmetries that exist across the visual field. That is, even after attentional deployment, performance is better along the horizontal than vertical meridian and worse at the upper than lower vertical meridian. Here we asked whether and how microsaccades-tiny fixational eye-movements-could mirror or alternatively attempt to compensate for these performance asymmetries by assessing temporal profiles and direction of microsaccades as a function of visual field location. Observers were asked to report the orientation of one of two targets presented at different time points, in one of three blocked locations (fovea, right horizontal meridian, upper vertical meridian). We found the following: (1) Microsaccade occurrence did not affect either task performance or the magnitude of the temporal attention effect. (2) Temporal attention modulated the microsaccade temporal profiles, and this modulation varied with polar angle location. At all locations, microsaccade rates were significantly more suppressed in anticipation of the target when temporally cued than in the neutral condition. Moreover, microsaccade rates were more suppressed during target presentation in the fovea than in the right horizontal meridian. (3) Across locations and attention conditions, there was a pronounced bias toward the upper hemifield. Overall, these results reveal that temporal attention benefits performance similarly around the visual field, microsaccade suppression is more pronounced for attention than expectation (neutral trials) across locations, and the directional bias toward the upper hemifield could reflect an attempt to compensate for typical poor performance at the upper vertical meridian.

Attention relieves visual crowding: Dissociable effects of peripheral and central cues

Visual crowding can be reduced when attention is directed to the target by peripheral cues. However, it is unclear whether central cues relieve visual crowding to the same extent as peripheral cues. In this study, we combined the Posner cueing task and the crowding task to investigate the effect of exogenous and endogenous attention on crowding. In Experiment 1, five different stimulus-onset asychronies (SOAs) between the cue and the target and a predictive validity of 100% were adopted. Both attentional cues were shown to significantly reduce the effect of visual crowding, but the peripheral cue was more effective than the central cue. Furthermore, peripheral cues started to relieve visual crowding at the shortest SOA (100 ms), whereas central cues worked only at later SOAs (275 ms or above). When the predictive validity of the cue was decreased to 70% in Experiment 2, similar results to Experiment 1 were found, but the valid cue was less effective in reducing crowding than that in Experiment 1. In Experiment 3, when the predictive validity was decreased to 50%, a valid peripheral cue improved performance but a valid central cue did not, suggesting that endogenous attention but not exogenous attention can be voluntarily controlled when the cues are not predictive of the target's location. These findings collectively suggest that both peripheral and central cues can alleviate crowding, but they differ in terms of strength, time dynamics, and flexibility of voluntary control.

The linear impact of visual working memory load on visual awareness: Evidence from motion-induced blindness

Despite the close relationship between visual working memory (VWM) and visual awareness, the question of how these two constructs interact with each other is still under debate. The current study aimed to further address this issue by investigating whether and how visual awareness is influenced by VWM load. In Experiment 1, participants were asked to perform a motion-induced blindness (MIB) task while simultaneously memorizing different numbers of items in VWM. The results indicated that the latency of MIB was prolonged gradually as the VWM load increased, revealing a linear trend in the modulation effect of VWM load on visual awareness. Experiments 2 and 3 tested the other potential explanations and validated the initial finding by confirming that VWM load was indeed responsible for the observed effect on visual awareness. These findings have important implications for a better understanding of the relationship between VWM and visual awareness.

Exogenous temporal attention varies with temporal uncertainty

Temporal attention is the selection and prioritization of information at a specific moment. Exogenous temporal attention is the automatic, stimulus driven deployment of attention. The benefits and costs of exogenous temporal attention on performance have not been isolated. Previous experimental designs have precluded distinguishing the effects of attention and expectation about stimulus timing. Here, we manipulated exogenous temporal attention and the uncertainty of stimulus timing independently and investigated visual performance at the attended and unattended moments with different levels of temporal uncertainty. In each trial, two Gabor patches were presented consecutively with a variable stimulus onset. To drive exogenous attention and test performance at attended and unattended moments, a task-irrelevant, brief cue was presented 100 ms before target onset, and an independent response cue was presented at the end of the trial. Exogenous temporal attention slightly improved accuracy, and the effects varied with temporal uncertainty, suggesting a possible interaction of temporal attention and expectations in time.

Effect of Cognitive Mental Load on Attended and Nonattended Visual Stimuli

SIGNIFICANCE

In the real word, visual tasks may be concurrent with other activity that imposes mental load. Although the brain's capacity to process information is limited, attention can improve visual performance by selectively allocating processing resources. Therefore, measuring visual performance under such circumstances can reflect patients' vision more accurately.

PURPOSE

The aim of this study was to evaluate the effect of nonvisual task-induced mental load on visual performance at both attended and unattended locations in stimulus-driven captured attention.

METHODS

Visual function was measured with an orientation discrimination task for Gabor patches with contrasts of 10, 15, 30, 50, and 80%. Three attentional conditions (valid-cue, invalid-cue, and neutral-cue) were randomly interleaved within runs. To modulate mental load, the visual task was performed either with or without a simultaneous auditory n-back task (two-back for maximum mental load and zero-back to control for the effect of having to perform a simultaneous task).

RESULTS

Our result showed that the effect of mental load on correct responses was significant ( P = .02). Correct responses decreased significantly during the two-back task when compared with the baseline condition ( P = .03), but there was no significant difference between baseline and zero-back conditions ( P = .06). The effect of attention and spatial frequencies on the percentage of correct responses was significant ( P < .001). There was no significant interaction between mental load and spatial frequency, contrast level, or attention ( P > .05).

CONCLUSIONS

Mental load had a similar decreasing effect on attended and unattended visual stimuli. This may be due to a generalized effect on processing resources upstream to where spatial attention is allocated.

The cost of attentional reorienting on conscious visual perception: an MEG study

How do attentional networks influence conscious perception? To answer this question, we used magnetoencephalography in human participants and assessed the effects of spatially nonpredictive or predictive supra-threshold peripheral cues on the conscious perception of near-threshold Gabors. Three main results emerged. (i) As compared with invalid cues, both nonpredictive and predictive valid cues increased conscious detection. Yet, only predictive cues shifted the response criterion toward a more liberal decision (i.e. willingness to report the presence of a target under conditions of greater perceptual uncertainty) and affected target contrast leading to 50% detections. (ii) Conscious perception following valid predictive cues was associated to enhanced activity in frontoparietal networks. These responses were lateralized to the left hemisphere during attentional orienting and to the right hemisphere during target processing. The involvement of frontoparietal networks occurred earlier in valid than in invalid trials, a possible neural marker of the cost of re-orienting attention. (iii) When detected targets were preceded by invalid predictive cues, and thus reorienting to the target was required, neural responses occurred in left hemisphere temporo-occipital regions during attentional orienting, and in right hemisphere anterior insular and temporo-occipital regions during target processing. These results confirm and specify the role of frontoparietal networks in modulating conscious processing and detail how invalid orienting of spatial attention disrupts conscious processing.

Pre-saccadic attention relies more on suppression than does covert attention

During covert and pre-saccadic attentional shifts, it is unclear how facilitation and suppression processes interact for target selection. A recent countermanding task pointed to greater suppression at unattended locations during trials with saccades compared to trials without saccades (i.e., fixation and successful stop trials), whereas target facilitation did not differ. It is unknown whether this finding is restricted to countermanding paradigms that involve inhibitory processes. To test this, we adapted Gaspelin and colleagues (2015)'s attention capture task where, within the same block, one location was primed with frequent line discrimination trials, and all locations were occasionally probed using letters report trials. Participants also performed a baseline condition without priming. We tested 15 participants and examined how performance at non-primed locations was affected by covert versus pre-saccadic attention in blocks of four or six items, as well as by position from the primed location and timing from saccade onset. For both attention conditions, letter report at non-primed locations was worse compared to baseline, demonstrating suppression, and letter report at primed location was better, demonstrating facilitation. In saccades trials, letter report was better at primed locations and worse at non-primed locations compared to fixation trials. The timing of this additional pre-saccadic suppression differed from saccadic suppression. In both attention conditions, suppression was greater when primed and non-primed locations were within the same hemifield or in diagonal opposite quadrants. These results confirmed that attention preceding saccade execution suppressed non-primed locations to a larger extent than covert attention, with the same spatial quadrant effect.

Metacognition tracks sensitivity following involuntary shifts of visual attention

Salient, exogenous cues have been shown to induce a temporary boost of perceptual sensitivity in their immediate vicinity. In two experiments involving uninformative exogenous cues presented at various times before a target stimulus, we investigated whether human observers (N = 100) were able to monitor the involuntary increase in performance induced by such transients. We found that an increase of perceptual sensitivity (in a choice task) and encoding precision (in a free-estimation task) occurred approximately 100 ms after cue onset, and was accompanied by an increase in confidence about the perceptual response. These simultaneous changes in sensitivity and confidence resulted in stable metacognition across conditions. These results suggest that metacognition efficiently tracks the effects of a reflexive attentional mechanism known to evade voluntary control, and illustrate a striking ability of high-level cognition to capture fleeting, low-level sensory modulations.

Transient attention equally reduces visual crowding in radial and tangential axes

Crowding refers to the failure to identify a peripheral object due to its proximity to other objects (flankers). This phenomenon can lead to reading and object recognition impairments and is associated with macular degeneration, amblyopia, and dyslexia. Crucially, the maximal target–flanker spacing required for the crowding interference (critical spacing) increases with eccentricity. This spacing is also larger when target and flankers appear along the horizontal meridian (radial arrangement) than when the flankers appear above and below the target (tangential arrangement). This phenomenon is known as radial–tangential anisotropy. Previous studies have demonstrated that transient attention can reduce crowding interference; however, it is still unclear whether and how attention interacts with radial–tangential anisotropy. To address this issue, we manipulated transient attention by using a cue at either the target (valid) or the fixation (neutral) location, in both radial and tangential target–flanker arrangements. Results showed that critical spacing was larger in the radial than in the tangential arrangement and that cueing the target location improved performance and reduced the critical spacing for both radial and tangential arrangements to the same extent. Together, our findings suggest that transient spatial attention plays an essential role in crowding but not in radial–tangential anisotropy.

Benefits of Endogenous Spatial Attention During Visual Double-Training in Cortically-Blinded Fields

Recovery of visual discrimination thresholds inside cortically-blinded (CB) fields is most commonly attained at a single, trained location at a time, with iterative progress deeper into the blind field as performance improves over several months. As such, training is slow, inefficient, burdensome, and often frustrating for patients. Here, we investigated whether double-location training, coupled with a covert spatial-attention (SA) pre-cue, could improve the efficiency of training. Nine CB participants completed a randomized, training assignment with either a spatial attention or neutral pre-cue. All trained for a similar length of time on a fine direction discrimination task at two blind field locations simultaneously. Training stimuli and tasks for both cohorts were identical, save for the presence of a central pre-cue, to manipulate endogenous (voluntary) SA, or a Neutral pre-cue. Participants in the SA training cohort demonstrated marked improvements in direction discrimination thresholds, albeit not to normal/intact-field levels; participants in the Neutral training cohort remained impaired. Thus, double-training within cortically blind fields, when coupled with SA pre-cues can significantly improve direction discrimination thresholds at two locations simultaneously, offering a new method to improve performance and reduce the training burden for CB patients. Double-training without SA pre-cues revealed a hitherto unrecognized limitation of cortically-blind visual systems’ ability to improve while processing two stimuli simultaneously. These data could potentially explain why exposure to the typically complex visual environments encountered in everyday life is insufficient to induce visual recovery in CB patients. It is hoped that these new insights will direct both research and therapeutic developments toward methods that can attain better, faster recovery of vision in CB fields.

The Ecological View of Selective Attention

Accumulating evidence is supporting the hypothesis that our selective attention is a manifestation of mechanisms that evolved early in evolution and are shared by many organisms from different taxa. This surge of new data calls for the re-examination of our notions about attention, which have been dominated mostly by human psychology. Here, we present an hypothesis that challenges, based on evolutionary grounds, a common view of attention as a means to manage limited brain resources. We begin by arguing that evolutionary considerations do not favor the basic proposition of the limited brain resources view of attention, namely, that the capacity of the sensory organs to provide information exceeds the capacity of the brain to process this information. Moreover, physiological studies in animals and humans show that mechanisms of selective attention are highly demanding of brain resources, making it paradoxical to see attention as a means to release brain resources. Next, we build on the above arguments to address the question why attention evolved in evolution. We hypothesize that, to a certain extent, limiting sensory processing is adaptive irrespective of brain capacity. We call this hypothesis the ecological view of attention (EVA) because it is centered on interactions of an animal with its environment rather than on internal brain resources. In its essence is the notion that inherently noisy and degraded sensory inputs serve the animal’s adaptive, dynamic interactions with its environment. Attention primarily functions to resolve behavioral conflicts and false distractions. Hence, we evolved to focus on a particular target at the expense of others, not because of internal limitations, but to ensure that behavior is properly oriented and committed to its goals. Here, we expand on this notion and review evidence supporting it. We show how common results in human psychophysics and physiology can be reconciled with an EVA and discuss possible implications of the notion for interpreting current results and guiding future research.

Gaze-cued shifts of attention and microsaccades are sustained for whole bodies but are transient for body parts

Gaze direction is an evolutionarily important mechanism in daily social interactions. It reflects a person’s internal cognitive state, spatial locus of interest, and predicts future actions. Studies have used static head images presented foveally and simple synthetic tasks to find that gaze orients attention and facilitates target detection at the cued location in a sustained manner. Little is known about how people’s natural gaze behavior, including eyes, head, and body movements, jointly orient covert attention, microsaccades, and facilitate performance in more ecological dynamic scenes. Participants completed a target person detection task with videos of real scenes. The videos showed people looking toward (valid cue) or away from a target (invalid cue) location. We digitally manipulated the individuals in the videos directing gaze to create three conditions: whole-intact (head and body movements), floating heads (only head movements), and headless bodies (only body movements). We assessed their impact on participants’ behavioral performance and microsaccades during the task. We show that, in isolation, an individual’s head or body orienting toward the target-person direction led to facilitation in detection that is transient in time (200 ms). In contrast, only the whole-intact condition led to sustained facilitation (500 ms). Furthermore, observers executed microsaccades more frequently towards the cued direction for valid trials, but this bias was sustained in time only with the joint presence of head and body parts. Together, the results differ from previous findings with foveally presented static heads. In more real-world scenarios and tasks, sustained attention requires the presence of the whole-intact body of the individuals dynamically directing their gaze.

Exogenous attention generalizes location transfer of perceptual learning in adults with amblyopia

Visual perceptual learning (VPL) is a behavioral manifestation of brain neuroplasticity. However, its practical effectiveness is limited because improvements are often specific to the trained conditions and require significant time and effort. It is critical to understand the conditions that promote learning and transfer. Covert endogenous (voluntary) and exogenous (involuntary) spatial attention help overcome VPL location specificity in neurotypical adults, but whether they also do so for people with atypical visual development is unknown. This study investigates the role of exogenous attention during VPL in adults with amblyopia, an ideal population given their asymmetrically developed, but highly plastic, visual cortex. Here we show that training on a discrimination task leads to improvements in foveal contrast sensitivity, acuity, and stereoacuity. Notably, exogenous attention helps generalize learning beyond trained spatial locations. Future large-scale studies can verify the extent to which attention enhances the effectiveness of perceptual learning during rehabilitation of visual disorders.

•

Contrast sensitivity (CS)-based VPL in amblyopes improves CS, acuity and stereoacuity

•

Similar improvement in trained amblyopic eye and untrained fellow eye

•

Exogenous spatial attention facilitates location transfer of VPL in amblyopic adults

Larger images are better remembered during naturalistic encoding

We are constantly exposed to multiple visual scenes, and while freely viewing them without an intentional effort to memorize or encode them, only some are remembered. It has been suggested that image memory is influenced by multiple factors, such as depth of processing, familiarity, and visual category. However, this is typically investigated when people are instructed to perform a task (e.g., remember or make some judgment about the images), which may modulate processing at multiple levels and thus, may not generalize to naturalistic visual behavior. Visual memory is assumed to rely on high-level visual perception that shows a level of size invariance and therefore is not assumed to be highly dependent on image size. Here, we reasoned that during naturalistic vision, free of task-related modulations, bigger images stimulate more visual system processing resources (from retina to cortex) and would, therefore, be better remembered. In an extensive set of seven experiments, naïve participants (n = 182) were asked to freely view presented images (sized 3° to 24°) without any instructed encoding task. Afterward, they were given a surprise recognition test (midsized images, 50% already seen). Larger images were remembered better than smaller ones across all experiments (∼20% higher accuracy or ∼1.5 times better). Memory was proportional to image size, faces were better remembered, and outdoors the least. Results were robust even when controlling for image set, presentation order, screen resolution, image scaling at test, or the amount of information. While multiple factors affect image memory, our results suggest that low- to high-level processes may all contribute to image memory.

Spatial attention in encoding letter combinations

Reading requires the correct identification of letters and letter positions within words. Selective attention is, therefore, required to select chunks of the text for sequential processing. Despite the extensive literature on visual attention, the well-known effects of spatial cues in simple perceptual tasks cannot inform us about the role of attention in a task as complex as reading. Here, we systematically manipulate spatial attention in a multi-letter processing task to understand the effects of spatial cues on letter encoding in typical adults. Overall, endogenous (voluntary) cue benefits were larger than exogenous (reflexive). We show that cue benefits are greater in the left than in the right visual field and larger for the most crowded letter positions. Endogenous valid cues reduced errors due to confusing letter positions more than misidentifications, specifically for the most crowded letter positions. Therefore, shifting endogenous attention along a line of text is likely an important mechanism to alleviate the effects of crowding on encoding letters within words. Our results help set the premise for constructing theories about how specific mechanisms of attention support reading development in children. Understanding the link between reading development and attention mechanisms has far-reaching implications for effectively addressing the needs of children with reading disabilities.

A dynamic normalization model of temporal attention

Vision is dynamic, handling a continuously changing stream of input, yet most models of visual attention are static. Here, we develop a dynamic normalization model of visual temporal attention and constrain it with new psychophysical human data. We manipulated temporal attention-the prioritization of visual information at specific points in time-to a sequence of two stimuli separated by a variable time interval. Voluntary temporal attention improved perceptual sensitivity only over a specific interval range. To explain these data, we modelled voluntary and involuntary attentional gain dynamics. Voluntary gain enhancement took the form of a limited resource over short time intervals, which recovered over time. Taken together, our theoretical and experimental results formalize and generalize the idea of limited attentional resources across space at a single moment to limited resources across time at a single location.

A causal role for the right frontal eye fields in value comparison

Recent studies have suggested close functional links between overt visual attention and decision making. This suggests that the corresponding mechanisms may interface in brain regions known to be crucial for guiding visual attention - such as the frontal eye field (FEF). Here, we combined brain stimulation, eye tracking, and computational approaches to explore this possibility. We show that inhibitory transcranial magnetic stimulation (TMS) over the right FEF has a causal impact on decision making, reducing the effect of gaze dwell time on choice while also increasing reaction times. We computationally characterize this putative mechanism by using the attentional drift diffusion model (aDDM), which reveals that FEF inhibition reduces the relative discounting of the non-fixated option in the comparison process. Our findings establish an important causal role of the right FEF in choice, elucidate the underlying mechanism, and provide support for one of the key causal hypotheses associated with the aDDM.

Spatial and Feature-selective Attention Have Distinct, Interacting Effects on Population-level Tuning

Attention can be deployed in different ways: When searching for a taxi in New York City, we can decide where to attend (e.g., to the street) and what to attend to (e.g., yellow cars). Although we use the same word to describe both processes, nonhuman primate data suggest that these produce distinct effects on neural tuning. This has been challenging to assess in humans, but here we used an opportunity afforded by multivariate decoding of MEG data. We found that attending to an object at a particular location and attending to a particular object feature produced effects that interacted multiplicatively. The two types of attention induced distinct patterns of enhancement in occipital cortex, with feature-selective attention producing relatively more enhancement of small feature differences and spatial attention producing relatively larger effects for larger feature differences. An information flow analysis further showed that stimulus representations in occipital cortex were Granger-caused by coding in frontal cortices earlier in time and that the timing of this feedback matched the onset of attention effects. The data suggest that spatial and feature-selective attention rely on distinct neural mechanisms that arise from frontal-occipital information exchange, interacting multiplicatively to selectively enhance task-relevant information.

Contrasting effects of exogenous and endogenous attention on size perception

Although neuroimaging studies have shown that exogenous and endogenous attention are dissociable, only a few behavioural studies have explored their differential effects on visual sensitivity, and none have directly focused on visual appearance. Here, we show that exogenous and endogenous attention produces contrasting effects on apparent size. Participants performed a spatial pre-cueing comparative judgement task that had been frequently used to test the attentional effects on visual perception. The results showed that a smaller stimulus within the focus of exogenous attention was perceived to be equal in size as a larger unattended stimulus, whereas a larger stimulus within the focus of endogenous attention was perceived to be equal in size as a smaller unattended stimulus. In other words, exogenous attention increased the perceived size while endogenous attention decreased the perceived size. The contrasting effects may be attributed to the mechanism that exogenous attention favours parvocellular processing for which more neurons with smaller receptive fields (RFs) are activated for a given size, whereas endogenous attention favours magnocellular processing for which fewer neurons with larger RFs are activated. This finding shows that exogenous and endogenous attention acts differentially on size perception, and provides supportive evidence for the distinct mechanisms underlying the two types of attentional processing.

Extrafoveal Processing in Categorical Search for Geometric Shapes: General Tendencies and Individual Variations

The paper addresses the capabilities and limitations of extrafoveal processing during a categorical visual search. Previous research has established that a target could be identified from the very first or without any saccade, suggesting that extrafoveal perception is necessarily involved. However, the limits in complexity defining the processed information are still not clear. We performed four experiments with a gradual increase of stimuli complexity to determine the role of extrafoveal processing in searching for the categorically defined geometric shape. The series of experiments demonstrated a significant role of extrafoveal processing while searching for simple two-dimensional shapes and its gradual decrease in a condition with more complicated three-dimensional shapes. The factors of objects' spatial orientation and distractor homogeneity significantly influenced both reaction time and the number of saccades required to identify a categorically defined target. An analysis of the individual p-value distributions revealed pronounced individual differences in using extrafoveal analysis and allowed examination of the performance of each particular participant. The condition with the forced prohibition of eye movements enabled us to investigate the efficacy of covert attention in the condition with complicated shapes. Our results indicate that both foveal and extrafoveal processing are simultaneously involved during a categorical search, and the specificity of their interaction is determined by the spatial orientation of objects, type of distractors, the prohibition to use overt attention, and individual characteristics of the participants.

Time-dependent inhibition of covert shifts of attention

Visual transients can interrupt overt orienting by abolishing the execution of a planned eye movement due about 90 ms later, a phenomenon known as saccadic inhibition (SI). It is not known if the same inhibitory process might influence covert orienting in the absence of saccades, and consequently alter visual perception. In Experiment 1 (n = 14), we measured orientation discrimination during a covert orienting task in which an uninformative exogenous visual cue preceded the onset of an oriented probe by 140-290 ms. In half of the trials, the onset of the probe was accompanied by a brief irrelevant flash, a visual transient that would normally induce SI. We report a time-dependent inhibition of covert orienting in which the irrelevant flash impaired orientation discrimination accuracy when the probe followed the cue by 190 and 240 ms. The interference was more pronounced when the cue was incongruent with the probe location, suggesting an impact on the reorienting component of the attentional shift. In Experiment 2 (n = 12), we tested whether the inhibitory effect of the flash could occur within an earlier time range, or only within the later, reorienting range. We presented probes at congruent cue locations in a time window between 50 and 200 ms. Similar to Experiment 1, discrimination performance was altered at 200 ms after the cue. We suggest that covert attention may be susceptible to similar inhibitory mechanisms that generate SI, especially in later stages of attentional shifting (> 200 ms after a cue), typically associated with reorienting.

Cross-modal orienting of exogenous attention results in visual-cortical facilitation, not suppression

Attention may be oriented exogenously (i.e., involuntarily) to the location of salient stimuli, resulting in improved perception. However, it is unknown whether exogenous attention improves perception by facilitating processing of attended information, suppressing processing of unattended information, or both. To test this question, we measured behavioral performance and cue-elicited neural changes in the electroencephalogram as participants (N = 19) performed a task in which a spatially non-predictive auditory cue preceded a visual target. Critically, this cue was either presented at a peripheral target location or from the center of the screen, allowing us to isolate spatially specific attentional activity. We find that both behavior and attention-mediated changes in visual-cortical activity are enhanced at the location of a cue prior to the onset of a target, but that behavior and neural activity at an unattended target location is equivalent to that following a central cue that does not direct attention (i.e., baseline). These results suggest that exogenous attention operates via facilitation of information at an attended location.

The Impact of Shape-Based Cue Discriminability on Attentional Performance

With rapidly developing technology, visual cues became a powerful tool for deliberate guiding of attention and affecting human performance. Using cues to manipulate attention introduces a trade-off between increased performance in cued, and decreased in not cued, locations. For higher efficacy of visual cues designed to purposely direct user’s attention, it is important to know how manipulation of cue properties affects attention. In this verification study, we addressed how varying cue complexity impacts the allocation of spatial endogenous covert attention in space and time. To gradually vary cue complexity, the discriminability of the cue was systematically modulated using a shape-based design. Performance was compared in attended and unattended locations in an orientation-discrimination task. We evaluated additional temporal costs due to processing of a more complex cue by comparing performance at two different inter-stimulus intervals. From preliminary data, attention scaled with cue discriminability, even for supra-threshold cue discriminability. Furthermore, individual cue processing times partly impacted performance for the most complex, but not simpler cues. We conclude that, first, cue complexity expressed by discriminability modulates endogenous covert attention at supra-threshold cue discriminability levels, with increasing benefits and decreasing costs; second, it is important to consider the temporal processing costs of complex visual cues.

Dissociable Cortical and Subcortical Mechanisms for Mediating the Influences of Visual Cues on Microsaccadic Eye Movements

Visual selection in primates is intricately linked to eye movements, which are generated by a network of cortical and subcortical neural circuits. When visual selection is performed covertly, without foveating eye movements toward the selected targets, a class of fixational eye movements, called microsaccades, is still involved. Microsaccades are small saccades that occur when maintaining precise gaze fixation on a stationary point, and they exhibit robust modulations in peripheral cueing paradigms used to investigate covert visual selection mechanisms. These modulations consist of changes in both microsaccade directions and frequencies after cue onsets. Over the past two decades, the properties and functional implications of these modulations have been heavily studied, revealing a potentially important role for microsaccades in mediating covert visual selection effects. However, the neural mechanisms underlying cueing effects on microsaccades are only beginning to be investigated. Here we review the available causal manipulation evidence for these effects' cortical and subcortical substrates. In the superior colliculus (SC), activity representing peripheral visual cues strongly influences microsaccade direction, but not frequency, modulations. In the cortical frontal eye fields (FEF), activity only compensates for early reflexive effects of cues on microsaccades. Using evidence from behavior, theoretical modeling, and preliminary lesion data from the primary visual cortex and microstimulation data from the lower brainstem, we argue that the early reflexive microsaccade effects arise subcortically, downstream of the SC. Overall, studying cueing effects on microsaccades in primates represents an important opportunity to link perception, cognition, and action through unaddressed cortical-subcortical neural interactions. These interactions are also likely relevant in other sensory and motor modalities during other active behaviors.

Spatial Attention and Saccade Preparation Both Independently Contribute to the Discrimination of Oblique Orientations

The extent to which the preparation of an eye movement and spatial attention both independently influence performance within the same task has long been debated. In a recent study that combined computational modelling with a dual-task, both saccade preparation and spatial cueing were revealed to separately contribute to the discrimination of targets oriented along the cardinal axis (horizontal and vertical). However, it remains to be seen whether and to what degree the same holds true when different perceptual stimuli are used. In the present study, we combined evidence accumulation modelling with a dual-task paradigm to assess the extent to which both saccade preparation and spatial attention contribute to the discrimination of full contrast targets oriented along the oblique axis (diagonal). The results revealed a separate and quantifiable contribution of both types of orienting to discrimination performance. Comparison of the magnitude of these effects to those obtained for cardinal orientation discrimination revealed the influence of saccade preparation and spatial attention to be six times smaller for oblique orientations. Importantly, the results revealed a separate and quantifiable contribution of both saccade preparation and spatial attention regardless of perceptual stimuli or stimulus contrast.

Attention control: The missing link between sensory discrimination and intelligence

Intelligence is correlated with the ability to make fine sensory discriminations. Although this relationship has been known since the beginning of intelligence testing, the mechanisms underlying this relationship are still unknown. In two large-scale structural equation-modelling studies, we investigated whether individual differences in attention control abilities can explain the relationship between sensory discrimination and intelligence. Across these two studies, we replicated the finding that attention control fully mediated the relationships of intelligence/working-memory capacity to sensory discrimination. Our findings show that attention control plays a prominent role in relating sensory discrimination to higher-order cognitive abilities.

Analysis of microsaccades during extended practice of a visual discrimination task in the macaque monkey

The spatial location indicated by a visual cue can bias microsaccades directions towards or away from the cue. Aim of this work was to evaluate the microsaccades characteristics during the monkey's training, investigating the relationship between a shift of attention and practice. The monkey was trained to press a lever at a target onset, then an expanding optic flow stimulus appeared to the right of the target. After a variable time delay, a visual cue appeared within the optic flow stimulus and the monkey had to release the lever in a maximum reaction time (RT) of 700 ms. In the control task no visual cue appeared and the monkey had to attend a change in the target color. Data were recorded in 9 months. Results revealed that the RTs at the control task changed significantly across time. The microsaccades directions were significantly clustered toward the visual cue, suggesting that the animal developed an attentional bias toward the visual space where the cue appeared. The microsaccades amplitude differed significantly across time. The microsaccades peak velocity differed significantly both across time and within the time delays, indicating that the monkey made faster microsaccades when it expected the cue to appear. The microsaccades number was significantly higher in the control task with respect to discrimination. The lack of change in microsaccades rate, duration, number and direction across time indicates that the experience acquired during practicing the task did not influence microsaccades generation.

Differential impact of endogenous and exogenous attention on activity in human visual cortex

How do endogenous (voluntary) and exogenous (involuntary) attention modulate activity in visual cortex? Using ROI-based fMRI analysis, we measured fMRI activity for valid and invalid trials (target at cued/un-cued location, respectively), pre- or post-cueing endogenous or exogenous attention, while participants performed the same orientation discrimination task. We found stronger modulation in contralateral than ipsilateral visual regions, and higher activity in valid- than invalid-trials. For endogenous attention, modulation of stimulus-evoked activity due to a pre-cue increased along the visual hierarchy, but was constant due to a post-cue. For exogenous attention, modulation of stimulus-evoked activity due to a pre-cue was constant along the visual hierarchy, but was not modulated due to a post-cue. These findings reveal that endogenous and exogenous attention distinctly modulate activity in visuo-occipital areas during orienting and reorienting; endogenous attention facilitates both the encoding and the readout of visual information whereas exogenous attention only facilitates the encoding of information.

Differential impact of exogenous and endogenous attention on the contrast sensitivity function across eccentricity

Both exogenous and endogenous covert spatial attention enhance contrast sensitivity, a fundamental measure of visual function that depends substantially on the spatial frequency and eccentricity of a stimulus. Whether and how each type of attention systematically improves contrast sensitivity across spatial frequency and eccentricity are fundamental to our understanding of visual perception. Previous studies have assessed the effects of spatial attention at individual spatial frequencies and, separately, at different eccentricities, but this is the first study to do so parametrically with the same task and observers. Using an orientation discrimination task, we investigated the effect of attention on contrast sensitivity over a wide range of spatial frequencies and eccentricities. Targets were presented alone or among distractors to assess signal enhancement and distractor suppression mechanisms of spatial attention. At each eccentricity, we found that exogenous attention preferentially enhanced spatial frequencies higher than the peak frequency in the baseline condition. In contrast, endogenous attention similarly enhanced a broad range of lower and higher spatial frequencies. The presence or absence of distractors did not alter the pattern of enhancement by each type of attention. Our findings reveal how the two types of covert spatial attention differentially shape how we perceive basic visual dimensions across the visual field.

Extinguishing Exogenous Attention via Transcranial Magnetic Stimulation

Orienting covert exogenous (involuntary) attention to a target location improves performance in many visual tasks [1, 2]. It is unknown whether early visual cortical areas are necessary for this improvement. To establish a causal link between these areas and attentional modulations, we used transcranial magnetic stimulation (TMS) to briefly alter cortical excitability and determine whether early visual areas mediate the effect of exogenous attention on performance. Observers performed an orientation discrimination task. After a peripheral valid, neutral, or invalid cue, two cortically magnified gratings were presented, one in the stimulated region and the other in the symmetric region in the opposite hemifield. Observers received two successive TMS pulses around their occipital pole while the stimuli were presented. Shortly after, a response cue indicated the grating whose orientation observers had to discriminate. The response cue either matched-target stimulated-or did not match-distractor stimulated-the stimulated side. Grating contrast was varied to measure contrast response functions (CRF) for all combinations of attention and TMS conditions. When the distractor was stimulated, exogenous attention yielded response gain-performance benefits in the valid-cue condition and costs in the invalid-cue condition compared with the neutral condition at the high contrast levels. Crucially, when the target was stimulated, this response gain was eliminated. Therefore, TMS extinguished the effect of exogenous attention. These results establish a causal link between early visual areas and the modulatory effect of exogenous attention on performance.

Passive training with upper extremity exoskeleton robot affects proprioceptive acuity and performance of motor learning

Sports trainers often grasp and move trainees' limbs to give instructions on desired movements, and a merit of this passive training is the transferring of instructions via proprioceptive information. However, it remains unclear how passive training affects the proprioceptive system and improves learning. This study examined changes in proprioceptive acuity due to passive training to understand the underlying mechanisms of upper extremity training. Participants passively learned a trajectory of elbow-joint movement as per the instructions of a single-arm upper extremity exoskeleton robot, and the performance of the target movement and proprioceptive acuity were assessed before and after the training. We found that passive training improved both the reproduction performance and proprioceptive acuity. We did not identify a significant transfer of the training effect across arms, suggesting that the learning effect is specific to the joint space. Furthermore, we found a significant improvement in learning performance in another type of movement involving the trained elbow joint. These results suggest that participants form a representation of the target movement in the joint space during the passive training, and intensive use of proprioception improves proprioceptive acuity.

Exogenous spatial attention shortens perceived depth

Although spatial attention has been found to alter the subjective appearance of visual stimuli in several perceptual dimensions, no research has explored whether exogenous spatial attention can affect depth perception, which is a fundamental dimension in perception that allows us to effectively interact with the environment. Here, we used an experimental paradigm adapted from Gobell and Carrasco (Psychological Science, 16[8], 644-651, 2005) to investigate this question. A peripheral cue preceding two line stimuli was used to direct exogenous attention to either location of the two lines. The two lines were separated by a certain relative disparity, and participants were asked to judge the perceived depth of two lines while attention was manipulated. We found that a farther stereoscopic depth at the attended location was perceived to be equally distant as a nearer depth at the unattended location. No such effect was found in a control experiment that employed a postcue paradigm, suggesting that our findings could not be attributed to response bias. Therefore, our study shows that exogenous spatial attention shortens perceived depth. The apparent change in stereoscopic depth may be regulated by a mechanism involving direct neural enhancement on those tuned to disparity, or be modulated by an attentional effect on apparent contrast. This finding shows that attention can change not only visual appearance but also the perceived spatial relation between an object and an observer.

Exogenous attention facilitates perceptual learning in visual acuity to untrained stimulus locations and features

Visual perceptual learning (VPL) refers to the improvement in performance on a visual task due to practice. A hallmark of VPL is specificity, as improvements are often confined to the trained retinal locations or stimulus features. We have previously found that exogenous (involuntary, stimulus-driven) and endogenous (voluntary, goal-driven) spatial attention can facilitate the transfer of VPL across locations in orientation discrimination tasks mediated by contrast sensitivity. Here, we investigated whether exogenous spatial attention can facilitate such transfer in acuity tasks that have been associated with higher specificity. We trained observers for 3 days (days 2-4) in a Landolt acuity task (Experiment 1) or a Vernier hyperacuity task (Experiment 2), with either exogenous precues (attention group) or neutral precues (neutral group). Importantly, during pre-tests (day 1) and post-tests (day 5), all observers were tested with neutral precues; thus, groups differed only in their attentional allocation during training. For the Landolt acuity task, we found evidence of location transfer in both the neutral and attention groups, suggesting weak location specificity of VPL. For the Vernier hyperacuity task, we found evidence of location and feature specificity in the neutral group, and learning transfer in the attention group-similar improvement at trained and untrained locations and features. Our results reveal that, when there is specificity in a perceptual acuity task, exogenous spatial attention can overcome that specificity and facilitate learning transfer to both untrained locations and features simultaneously with the same training. Thus, in addition to improving performance, exogenous attention generalizes perceptual learning across locations and features.

The profile of attentional modulation to visual features

Although it is well established that feature-based attention (FBA) can enhance an attended feature, how it modulates unattended features remains less clear. Previous studies have generally supported either a graded profile as predicted by the feature-similarity gain model or a nonmonotonic profile predicted by the surround suppression model. To reconcile these different views, we systematically measured the attentional profile in three basic feature dimensions-orientation, motion direction, and spatial frequency. In three experiments, we instructed participants to detect a coherent feature signal against noise under attentional or neutral condition. Our results support a nonmonotonic hybrid model of attentional modulation consisting of feature-similarity gain and surround suppression for orientation and motion direction. For spatial frequency, we also found a similar nonmonotonic profile for higher frequencies than the attended frequency, but a lack of attentional modulation for lower frequencies than the attended frequency. The current findings can reconcile the discrepancies in the literature and suggest the hybrid model as a new framework for attentional modulation in feature space. In addition, a computational model incorporating known properties of spatial frequency channels and attentional modulations at the neural level reproduced the asymmetric attentional modulation, thus revealing a connection between surround suppression and the basic neural architecture of an early visual system.

Complexity can facilitate visual and auditory perception

Visual and auditory inputs vary in complexity. For example, driving in a city versus the country or listening to the radio versus not are experiences that differ in complexity. How does such complexity impact perception? One possibility is that complex stimuli demand resources that exceed attentional or working memory capacities, reducing sensitivity to perceptual changes. Alternatively, complexity may allow for richer and more distinctive representations, increasing such sensitivity. We performed five experiments to test the nature of the relationship between complexity and perceptual sensitivity during movie clip viewing. Experiment 1 revealed higher sensitivity to global changes in audio or video streams for clips with greater complexity, defined both subjectively (judgments by independent coders) and objectively (information-theoretic redundancy). Experiment 2 replicated this finding but found no evidence that it resulted from complexity drawing attention. Experiment 3 provided a boundary condition by showing that change detection was unaffected by complexity when the changes were superimposed on, rather than dispersed throughout, the clips. Experiment 4 suggested that the effect of complexity, at least when defined objectively, was present without the working memory demands of the preceding experiments. Experiment 5 suggested that complexity led to richer representations of the clips, as reflected in enhanced long-term memory. Collectively, these findings show that, despite increasing informational load, complexity can serve to ground and facilitate perceptual sensitivity. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Unraveling Causal Mechanisms of Top-Down and Bottom-Up Visuospatial Attention with Non-invasive Brain Stimulation

Attention is a process of selection that allows us to intelligently navigate the abundance of information in our world. Attention can be either directed voluntarily based on internal goals-"top-down" or goal-directed attention-or captured automatically, by salient stimuli-"bottom-up" or stimulus-driven attention. Do these two modes of attention control arise from same or different brain circuits? Do they share similar or distinct neural mechanisms? In this review, we explore this dichotomy between the neural bases of top-down and bottom-up attention control, with a special emphasis on insights gained from non-invasive neurostimulation techniques, specifically, transcranial magnetic stimulation (TMS). TMS enables spatially focal and temporally precise manipulation of brain activity. We explore a significant literature devoted to investigating the role of fronto-parietal brain regions in top-down and bottom-up attention with TMS, and highlight key areas of convergence and debate. We also discuss recent advances in combinatorial paradigms that combine TMS with other imaging modalities, such as functional magnetic resonance imaging or electroencephalography. These paradigms are beginning to bridge essential gaps in our understanding of the neural pathways by which TMS affects behavior, and will prove invaluable for unraveling mechanisms of attention control, both in health and in disease.