The Premotor theory of attention: Time to move on?

Training enables substantial decoupling of visual attention and saccade preparation

Visual attention is typically shifted toward the targets of upcoming saccadic eye movements. This observation is commonly interpreted in terms of an obligatory coupling between attentional selection and oculomotor programming. Here, we investigated whether this coupling is facilitated by a habitual expectation of spatial congruence between visual and motor targets. To this end, we conducted a dual-task (i.e., concurrent saccade task and visual discrimination task) experiment in which male and female participants were trained to either anticipate spatial congruence or incongruence between a saccade target and an attention probe stimulus. To assess training-induced effects of expectation on premotor attention allocation, participants subsequently completed a test phase in which the attention probe position was randomized. Results revealed that discrimination performance was systematically biased toward the expected attention probe position, irrespective of whether this position matched the saccade target or not. Overall, our findings demonstrate that visual attention can be substantially decoupled from ongoing oculomotor programming and suggest an important role of habitual expectations in the attention-action coupling.

Inter-individual variability (but intra-individual stability) of overt versus covert rehearsal strategies in a digital Corsi task

The Corsi (block-tapping) paradigm is a classic and well-established visuospatial working memory task in humans involving internal computations (memorizing of item sequences, organizing and updating the memorandum, and recall processes), as well as both overt and covert shifts of attention to facilitate rehearsal, serving to maintain the Corsi sequences during the retention phase. Here, we introduce a novel digital version of a Corsi task in which i) the difficulty of the memorandum (using sequence lengths ranging from 3 to 8) was controlled, ii) the execution of overt and/or covert attention as well as the visuospatial working memory load during the retention phase was manipulated, and iii) shifts of attention were quantified in all experimental phases. With this, we present behavioral data that demonstrate, characterize, and classify the individual effects of overt and covert strategies used as a means of encoding and rehearsal. In a full within-subject design, we tested 28 participants who had to solve three different Corsi conditions. While in condition A neither of the two strategies were restricted, in condition B the overt and in condition C the overt as well as the covert strategies were suppressed. Analyzing Corsi span, (eye) exploration index, and pupil size (change), data clearly show a continuum between overt and covert strategies over all participants (indicating inter-individual variability). Further, all participants showed stable strategy choice (indicating intra-individual stability), meaning that the preferred strategy was maintained in all three conditions, phases, and sequence lengths of the experiment.

The challenge of controlling an auditory BCI in the case of severe motor disability

BACKGROUND

The locked-in syndrome (LIS), due to a lesion in the pons, impedes communication. This situation can also be met after some severe brain injury or in advanced Amyotrophic Lateral Sclerosis (ALS). In the most severe condition, the persons cannot communicate at all because of a complete oculomotor paralysis (Complete LIS or CLIS). This even prevents the detection of consciousness. Some studies suggest that auditory brain-computer interface (BCI) could restore a communication through a « yes-no» code.

METHODS

We developed an auditory EEG-based interface which makes use of voluntary modulations of attention, to restore a yes-no communication code in non-responding persons. This binary BCI uses repeated speech sounds (alternating "yes" on the right ear and "no" on the left ear) corresponding to either frequent (short) or rare (long) stimuli. Users are instructed to pay attention to the relevant stimuli only. We tested this BCI with 18 healthy subjects, and 7 people with severe motor disability (3 "classical" persons with locked-in syndrome and 4 persons with ALS).

RESULTS

We report online BCI performance and offline event-related potential analysis. On average in healthy subjects, online BCI accuracy reached 86% based on 50 questions. Only one out of 18 subjects could not perform above chance level. Ten subjects had an accuracy above 90%. However, most patients could not produce online performance above chance level, except for two people with ALS who obtained 100% accuracy. We report individual event-related potentials and their modulation by attention. In addition to the classical P3b, we observed a signature of sustained attention on responses to frequent sounds, but in healthy subjects and patients with good BCI control only.

CONCLUSIONS

Auditory BCI can be very well controlled by healthy subjects, but it is not a guarantee that it can be readily used by the target population of persons in LIS or CLIS. A conclusion that is supported by a few previous findings in BCI and should now trigger research to assess the reasons of such a gap in order to propose new and efficient solutions.

CLINICAL TRIAL REGISTRATIONS

No. NCT02567201 (2015) and NCT03233282 (2013).

The Motor of Time: Coupling Action to Temporally Predictable Events Heightens Perception

Timing and motor function share neural circuits and dynamics, which underpin their close and synergistic relationship. For instance, the temporal predictability of a sensory event optimizes motor responses to that event. Knowing when an event is likely to occur lowers response thresholds, leading to faster and more efficient motor behavior though in situations of response conflict can induce impulsive and inappropriate responding. In turn, through a process of active sensing, coupling action to temporally predictable sensory input enhances perceptual processing. Action not only hones perception of the event's onset or duration, but also boosts sensory processing of its non-temporal features such as pitch or shape. The effects of temporal predictability on motor behavior and sensory processing involve motor and left parietal cortices and are mediated by changes in delta and beta oscillations in motor areas of the brain.

MEG frequency tagging reveals a grid-like code during attentional movements

Grid-cells firing fields tile the environment with a 6-fold periodicity during both locomotion and visual exploration. Here, we tested, in humans, whether movements of covert attention elicit grid-like coding using frequency tagging. Participants observed visual trajectories presented sequentially at fixed rate, allowing different spatial periodicities (e.g., 4-, 6-, and 8-fold) to have corresponding temporal periodicities (e.g., 1, 1.5, and 2 Hz), thus resulting in distinct spectral responses. We found a higher response for the (grid-like) 6-fold periodicity and localized this effect in medial-temporal sources. In a control experiment featuring the same temporal periodicity but lacking spatial structure, the 6-fold effect did not emerge, suggesting its dependency on spatial movements of attention. We report evidence that grid-like signals in the human medial-temporal lobe can be elicited by covert attentional movements and suggest that attentional coding may provide a suitable mechanism to support the activation of cognitive maps during conceptual navigation.

Dissociable roles of human frontal eye fields and early visual cortex in presaccadic attention

Shortly before saccadic eye movements, visual sensitivity at the saccade target is enhanced, at the expense of sensitivity elsewhere. Some behavioral and neural correlates of this presaccadic shift of attention resemble those of covert attention, deployed during fixation. Microstimulation in non-human primates has shown that presaccadic attention modulates perception via feedback from oculomotor to visual areas. This mechanism also seems plausible in humans, as both oculomotor and visual areas are active during saccade planning. We investigated this hypothesis by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show their causal and differential roles in contralateral presaccadic attention effects: Whereas rFEF+ stimulation enhanced sensitivity opposite the saccade target throughout saccade preparation, V1/V2 stimulation reduced sensitivity at the saccade target only shortly before saccade onset. These findings are consistent with presaccadic attention modulating perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.

Learning induced neuronal identity switch in the superficial layers of the primary somatosensory cortex

During learning, multi-dimensional inputs are integrated within the sensory cortices. However, the strategies by which the sensory cortex employs to achieve learning remains poorly understood. We studied the sensory cortical neuronal coding of trace eyeblink conditioning (TEC) in head-fixed, freely running mice, where whisker deflection was used as a conditioned stimulus (CS) and an air puff to the cornea delivered after an interval was used as unconditioned stimulus (US). After training, mice learned the task with a set of stereotypical behavioral changes, most prominent ones include prolonged closure of eyelids, and increased reverse running between CS and US onset. The local blockade of the primary somatosensory cortex (S1) activities with muscimol abolished the behavior learning suggesting that S1 is required for the TEC. In naive animals, based on the response properties to the CS and US, identities of the small proportion (~20%) of responsive primary neurons (PNs) were divided into two subtypes: CR (i.e. CS-responsive) and UR neurons (i.e. US-responsive). After animals learned the task, identity of CR and UR neurons changed: while the CR neurons are less responsive to CS, UR neurons gain responsiveness to CS, a new phenomenon we defined as 'learning induced neuronal identity switch (LINIS)'. To explore the potential mechanisms underlying LINIS, we found that systemic and local (i.e. in S1) administration of the nicotinic receptor antagonist during TEC training blocked the LINIS, and concomitantly disrupted the behavior learning. Additionally, we monitored responses of two types of cortical interneurons (INs) and observed that the responses of the somatostatin-expressing (SST), but not parvalbumin-expressing (PV) INs are negatively correlated with the learning performance, suggesting that SST-INs contribute to the LINIS. Thus, we conclude that L2/3 PNs in S1 encode perceptual learning by LINIS like mechanisms, and cholinergic pathways and cortical SST interneurons are involved in the formation of LINIS.

The Costs of Paying Overt and Covert Attention Assessed With Pupillometry

Attention can be shifted with or without an accompanying saccade (i.e., overtly or covertly, respectively). Thus far, it is unknown how cognitively costly these shifts are, yet such quantification is necessary to understand how and when attention is deployed overtly or covertly. In our first experiment (N = 24 adults), we used pupillometry to show that shifting attention overtly is more costly than shifting attention covertly, likely because planning saccades is more complex. We pose that these differential costs will, in part, determine whether attention is shifted overtly or covertly in a given context. A subsequent experiment (N = 24 adults) showed that relatively complex oblique saccades are more costly than relatively simple saccades in horizontal or vertical directions. This provides a possible explanation for the cardinal-direction bias of saccades. The utility of a cost perspective as presented here is vital to furthering our understanding of the multitude of decisions involved in processing and interacting with the external world efficiently.

The Role of Visual Factors in Dyslexia

What are the causes of dyslexia? Decades of research reflect a determined search for a single cause where a common assumption is that dyslexia is a consequence of problems with converting phonological information into lexical codes. But reading is a highly complex activity requiring many well-functioning mechanisms, and several different visual problems have been documented in dyslexic readers. We critically review evidence from various sources for the role of visual factors in dyslexia, from magnocellular dysfunction through accounts based on abnormal eye movements and attentional processing, to recent proposals that problems with high-level vision contribute to dyslexia. We believe that the role of visual problems in dyslexia has been underestimated in the literature, to the detriment of the understanding and treatment of the disorder. We propose that rather than focusing on a single core cause, the role of visual factors in dyslexia fits well with risk and resilience models that assume that several variables interact throughout prenatal and postnatal development to either promote or hinder efficient reading.

Dissociable roles of human frontal eye fields and early visual cortex in presaccadic attention - evidence from TMS

Shortly before each saccadic eye movement, presaccadic attention improves visual sensitivity at the saccade target 1-5 at the expense of lowered sensitivity at non-target locations 6-11 . Some behavioral and neural correlates of presaccadic attention and covert attention -which likewise enhances sensitivity, but during fixation 12 -are similar 13 . This resemblance has led to the debatable 13-18 notion that presaccadic and covert attention are functionally equivalent and rely on the same neural circuitry 19-21 . At a broad scale, oculomotor brain structures (e.g., FEF) are also modulated during covert attention 22-24 - yet by distinct neuronal subpopulations 25-28 . Perceptual benefits of presaccadic attention rely on feedback from oculomotor structures to visual cortices 29,30 ( Fig. 1a ); micro-stimulation of FEF in non-human primates affects activity in visual cortex 31-34 and enhances visual sensitivity at the movement field of the stimulated neurons 35-37 . Similar feedback projections seem to exist in humans: FEF+ activation precedes occipital activation during saccade preparation 38,39 and FEF TMS modulates activity in visual cortex 40-42 and enhances perceived contrast in the contralateral hemifield 40 . We investigated presaccadic feedback in humans by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show the causal and differential roles of these brain regions in contralateral presaccadic benefits at the saccade target and costs at non-targets: Whereas rFEF+ stimulation reduced presaccadic costs throughout saccade preparation, V1/V2 stimulation reduced benefits only shortly before saccade onset. These effects provide causal evidence that presaccadic attention modulates perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.

Oculomotor rehearsal in visuospatial working memory

The neural and cognitive mechanisms of spatial working memory are tightly coupled with the systems that control eye movements, but the precise nature of this coupling is not well understood. It has been argued that the oculomotor system is selectively involved in rehearsal of spatial but not visual material in visuospatial working memory. However, few studies have directly compared the effect of saccadic interference on visual and spatial memory, and there is little consensus on how the underlying working memory representation is affected by saccadic interference. In this study we aimed to examine how working memory for visual and spatial features is affected by overt and covert attentional interference across two experiments. Participants were shown a memory array, then asked to either maintain fixation or to overtly or covertly shift attention in a detection task during the delay period. Using the continuous report task we directly examined the precision of visual and spatial working memory representations and fit psychophysical functions to investigate the sources of recall error associated with different types of interference. These data were interpreted in terms of embodied theories of attention and memory and provide new insights into the nature of the interactions between cognitive and motor systems.

Temporal order judgments and presaccadic shifts of attention: What can prior entry teach us about the premotor theory?

A temporal order judgment (TOJ) 2-alternative forced choice design was used to examine presaccadic shifts of attention. Prior work on the premotor theory of attention (PTA) has predominantly focused on single-target discrimination tasks as a tool to measure accuracy and shifts of attention. It is important to demonstrate that the PTA is effective across attentional tasks that have been shown to be reliable in other contexts. Therefore, it was decided to use a perceptual task that probes multiple locations simultaneously and can equally be used to examine spatial spread of attention in more detail. In typical TOJ studies, prior entry is the metric used to measure an attentional effect. Prior entry is the biasing of temporal perception toward an attentionally cued location. This generally manifests as observers processing events at the cued location more rapidly, altering their perspective of temporal order. Participants were required to prepare saccades toward one of four targets, two of which would light up either synchronously or sequentially after a GO signal but before saccadic execution. Results demonstrated that in conditions with critical stimulus onset asynchronies, saccade preparation had a significant effect on performance. Prior entry effects were observed at saccade congruent locations with probes at these locations being typically perceived earlier than probes presented at a neutral location. These effects were not observed in control trials without a saccade. A further spatial effect was demonstrated for the attentional modulation, suggesting that this effect is restricted predominantly to horizontal configurations. Overall, results demonstrated that presaccadic attention is effective at eliciting a prior entry effect in TOJ designs and that such effects are more pronounced when the probes are distributed across the two lateral hemifields.

Reduced motor planning underlying inhibition of prepotent responses in children with ADHD

To flexibly regulate their behavior, children's ability to inhibit prepotent responses arises from cognitive and motor mechanisms that have an intertwined developmental trajectory. Subtle differences in planning and control can contribute to impulsive behaviors, which are common in Attention Deficit and Hyperactivity Disorder (ADHD) and difficult to be assessed and trained. We adapted a Go/No-Go task and employed a portable, low-cost kinematic sensor to explore the different strategies used by children with ADHD or typical development to provide a prepotent response (dominant condition) or inhibit the prepotent and select an alternative one (non-dominant condition). Although no group difference emerged on accuracy levels, the kinematic analysis of correct responses revealed that, unlike neurotypical children, those with ADHD did not show increased motor planning in non-dominant compared to dominant trials. Future studies should investigate whether motor control could help children with ADHD compensate for planning difficulties. This strategy might make inhibition harder in naturalistic situations that involve complex actions. Combining cognitive and kinematic measures is a potential innovative method for assessment and intervention of subtle differences in executive processes such as inhibition, going deeper than is possible based on accuracy outcomes alone.

Independence of implicitly guided attention from goal-driven oculomotor control

Location probability learning-the acquisition of an attentional bias toward locations that frequently contained a search target-shows many characteristics of a search habit. To what degree does it depend on oculomotor control, as might be expected if habit-like attention is grounded in eye movements? Here, we examined the impact of a spatially incompatible oculomotor signal on location probability learning (LPL). On each trial of a visual search task, participants first saccaded toward a unique C-shape, whose orientation determined whether participants should continue searching for a T target among L distractors. The C-shape often appeared in one, "C-rich" quadrant that differed from where the T was frequently located. Experiment 1 showed that participants acquired LPL toward the high-probability, "T-rich" quadrant, an effect that persisted in an unbiased testing phase. Participants were also faster finding the target in the vicinity of the C-shape, but this effect did not persist after the C-shape was removed. Experiment 2 found that the C-shape affected search only when it was task-relevant. Experiment 3 replicated and extended the findings of Experiment 1 using eye tracking. Thus, location probability learning is robust in the face of a spatially incompatible saccade, demonstrating partial independence between experience-guided attention and goal-driven oculomotor control. The findings are in line with the modular view of attention, which conceptualizes the search habit as a high-level process abstracted from eye movements.

Visual Attention in the Prefrontal Cortex

Voluntary attention selects behaviorally relevant signals for further processing while filtering out distracter signals. Neural correlates of voluntary visual attention have been reported across multiple areas of the primate visual processing streams, with the earliest and strongest effects isolated in the prefrontal cortex. In this article, I review evidence supporting the hypothesis that signals guiding the allocation of voluntary attention emerge in areas of the prefrontal cortex and reach upstream areas to modulate the processing of incoming visual information according to its behavioral relevance. Areas located anterior and dorsal to the arcuate sulcus and the frontal eye fields produce signals that guide the allocation of spatial attention. Areas located anterior and ventral to the arcuate sulcus produce signals for feature-based attention. Prefrontal microcircuits are particularly suited to supporting voluntary attention because of their ability to generate attentional template signals and implement signal gating and their extensive connectivity with the rest of the brain. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

The role of temporal cortex in the control of attention

Attention is an indispensable component of active vision. Contrary to the widely accepted notion that temporal cortex processing primarily focusses on passive object recognition, a series of very recent studies emphasize the role of temporal cortex structures, specifically the superior temporal sulcus (STS) and inferotemporal (IT) cortex, in guiding attention and implementing cognitive programs relevant for behavioral tasks. The goal of this theoretical paper is to advance the hypothesis that the temporal cortex attention network (TAN) entails necessary components to actively participate in attentional control in a flexible task-dependent manner. First, we will briefly discuss the general architecture of the temporal cortex with a focus on the STS and IT cortex of monkeys and their modulation with attention. Then we will review evidence from behavioral and neurophysiological studies that support their guidance of attention in the presence of cognitive control signals. Next, we propose a mechanistic framework for executive control of attention in the temporal cortex. Finally, we summarize the role of temporal cortex in implementing cognitive programs and discuss how they contribute to the dynamic nature of visual attention to ensure flexible behavior.

Infrequent faces bias social attention differently in manual and oculomotor measures

Although attention is thought to be spontaneously biased by social cues like faces and eyes, recent data have demonstrated that when extraneous content, context, and task factors are controlled, attentional biasing is abolished in manual responses while still occurring sparingly in oculomotor measures. Here, we investigated how social attentional biasing was affected by face novelty by measuring responses to frequently presented (i.e., those with lower novelty) and infrequently presented (i.e., those with higher novelty) face identities. Using a dot-probe task, participants viewed either the same face and house identity that was frequently presented on half of the trials or sixteen different face and house identities that were infrequently presented on the other half of the trials. A response target occurred with equal probability at the previous location of the eyes or mouth of the face or the top or bottom of the house. Experiment 1 measured manual responses to the target while participants maintained central fixation. Experiment 2 additionally measured participants' natural oculomotor behaviour when their eye movements were not restricted. Across both experiments, no evidence of social attentional biasing was found in manual data. However, in Experiment 2, there was a reliable oculomotor bias towards the eyes of infrequently presented upright faces. Together, these findings suggest that face novelty does not facilitate manual measures of social attention, but it appears to promote spontaneous oculomotor biasing towards the eyes of infrequently presented novel faces.

All eyes on attention

Eye movements are neither necessary nor sufficient to account for the neural effects associated with covert attention.

Upward action promotes selective attention to negative words

Space-valence metaphors (e.g., bad is down) are embedded within cognitive and emotional processing (e.g., negative stimuli at a lower space capture visual attention more than those at an upper space). Previous studies have revealed that motor action to vertical direction affects the emotional valence rating of stimuli in a metaphor-congruent manner only when the action was introduced after the stimuli presentation. In the present study, we hypothesized that motor action before the stimuli presentation does not affect valence rating while it may affect visual selective attention. In Experiment 1 (participants: 28 university students; mean age = 19.50 years), we partially replicated the previous result with repeated ANOVA and t-tests; manual action introduced before the stimuli presentation does not affect the valence rating. Then, in Experiment 2 (participants: 28 university students; mean age = 19.57 years), we employed a modified version of the dot-probe task as a measure of visual selective attention to emotional stimuli, where participants’ vertical or horizontal manual action was introduced before the presentation of a pair of emotional words. The results of the t-tests revealed that an upward manual action promoting selective attention to negative words, which was incongruent with the space-valence metaphorical correspondence. These results suggest that even though manual action does not affect the evaluative process of emotional stimuli prospectively, upward manual action introduced before stimuli presentation can promote visual attention to the subsequent negative stimuli in a way that is incongruent with the space-valence metaphor.

Comparing saccadic and manual responses in the attention network test

Attention is proposed to be a system of multiple functional networks, including alertness, orienting and executive control. A popular experimental paradigm for testing these networks and their interactions within a single design is the Attentional Networks Test (ANT) (Fan et al., 2002). The role of the oculomotor system in these various networks, however, has not been tested despite the strong link between attention and eye movements. We modified the executive control component of the manual response ANT version (ANTm) that allows testing the networks' involvement with oculomotor responses. Specifically, we used a central target to signal pro or anti-saccades that allows us to match the saccadic response compatibility of the original ANTm. We conducted three experiments to compare interactions of the networks between the traditional ANTm that used a flanker task response, our new ANTs with saccadic responses signalled with a fixation arrow, and a manual response version with the response arrow at fixation (ANTf). Results for all three experiments showed typical main effects of all three attention networks, but we observed differences in their interactions. The ANTm showed only an interaction of alerting enhancing the orienting; ANTs showed a congruency by orienting interaction with the orienting effect only observed for pro-saccades. The ANTf showed both alerting by orienting, and orienting by congruency. Although the saccadic response did differ from the original ANTm, key differences were also highlighted by the switch from peripheral to central target. Overall the proposed ANTf is a valid tool to test main effects of attentional networks. Further investigation of interaction differences between manual and oculomotor systems is required.

Time-dependent inhibition of covert shifts of attention

Visual transients can interrupt overt orienting by abolishing the execution of a planned eye movement due about 90 ms later, a phenomenon known as saccadic inhibition (SI). It is not known if the same inhibitory process might influence covert orienting in the absence of saccades, and consequently alter visual perception. In Experiment 1 (n = 14), we measured orientation discrimination during a covert orienting task in which an uninformative exogenous visual cue preceded the onset of an oriented probe by 140-290 ms. In half of the trials, the onset of the probe was accompanied by a brief irrelevant flash, a visual transient that would normally induce SI. We report a time-dependent inhibition of covert orienting in which the irrelevant flash impaired orientation discrimination accuracy when the probe followed the cue by 190 and 240 ms. The interference was more pronounced when the cue was incongruent with the probe location, suggesting an impact on the reorienting component of the attentional shift. In Experiment 2 (n = 12), we tested whether the inhibitory effect of the flash could occur within an earlier time range, or only within the later, reorienting range. We presented probes at congruent cue locations in a time window between 50 and 200 ms. Similar to Experiment 1, discrimination performance was altered at 200 ms after the cue. We suggest that covert attention may be susceptible to similar inhibitory mechanisms that generate SI, especially in later stages of attentional shifting (> 200 ms after a cue), typically associated with reorienting.

Dyslexics' Fragile Oculomotor Control Is Further Destabilized by Increased Text Difficulty

Dyslexic adolescents demonstrate deficits in word decoding, recognition, and oculomotor coordination as compared to healthy controls. Our lab recently showed intrinsic deficits in large saccades and vergence movements with a Remobi device independent from reading. This shed new light on the field of dyslexia, as it has been debated in the literature whether the deficits in eye movements are a cause or consequence of reading difficulty. The present study investigates how these oculomotor problems are compensated for or aggravated by text difficulty. A total of 46 dyslexic and 41 non-dyslexic adolescents' eye movements were analyzed while reading L'Alouette, a dyslexia screening test, and 35 Kilos D'Espoir, a children's book with a reading age of 10 years. While reading the more difficult text, dyslexics made more mistakes, read slower, and made more regressive saccades; moreover, they made smaller amplitude saccades with abnormal velocity profiles (e.g., higher peak velocity but lower average velocity) and significantly higher saccade disconjugacy. While reading the simpler text, these differences persisted; however, the difference in saccade disconjugacy, although present, was no longer significant, nor was there a significant difference in the percentage of regressive saccades. We propose that intrinsic eye movement abnormalities in dyslexics such as saccade disconjugacy, abnormal velocity profiles, and cognitively associated regressive saccades can be particularly exacerbated if the reading text relies heavily on word decoding to extract meaning; increased number of regressive saccades are a manifestation of reading difficulty and not a problem of eye movement per se. These interpretations are in line with the motor theory of visual attention and our previous research describing the relationship between binocular motor control, attention, and cognition that exists outside of the field of dyslexia.

Common cortical areas have different neural mechanisms for covert and overt visual pursuits

Although humans can direct their attention to visual targets with or without eye movements, it remains unclear how different brain mechanisms control visual attention and eye movements together and/or separately. Here, we measured MEG and fMRI data during covert/overt visual pursuit tasks and estimated cortical currents using our previously developed extra-dipole, hierarchical Bayesian method. Then, we predicted the time series of target positions and velocities from the estimated cortical currents of each task using a sparse machine-learning algorithm. The predicted target positions/velocities had high temporal correlations with actual visual target kinetics. Additionally, we investigated the generalization ability of predictive models among three conditions: control, covert, and overt pursuit tasks. When training and testing data were the same tasks, the largest reconstructed accuracies were overt, followed by covert and control, in that order. When training and testing data were selected from different tasks, accuracies were in reverse order. These results are well explained by the assumption that predictive models consist of combinations of three computational brain functions: visual information-processing, maintenance of attention, and eye-movement control. Our results indicate that separate subsets of neurons in the same cortical regions control visual attention and eye movements differently.

Impaired pre-saccadic shifts of attention in neglect patients

Every saccade is generally preceded by a mandatory shift of attention to the saccade endpoint, allowing us to process visual information more effectively. Whether this 'pre-saccadic shift of attention' is still intact in hemispatial neglect is unknown. Whereas neglect patients exhibit lateralized impairments of attention and often show impaired saccadic behaviour, it is not yet clear how the pre-saccadic shift of attention is affected during accurately executed eye movements. In this study, we used a gaze contingent visual discrimination task, in which neglect patients had to discriminate a probe presented before saccade onset. Results revealed an imbalance in discrimination performance between the two hemifields with poor performance to probes in the contralesional compared to the ipsilesional hemifield when accounting for saccadic impairments. These results suggest that attention and eye movements are both unique impairments of neglect patients. We hypothesize that the impaired pre-saccadic shift of attention could be one of the key problems of neglect and might underlie other spatial and non-spatial deficits often reported in neglect patients.

Attention Trade-Off for Localization and Saccadic Remapping

Predictive remapping may be the principal mechanism of maintaining visual stability, and attention is crucial for this process. We aimed to investigate the role of attention in predictive remapping in a dual task paradigm with two conditions, with and without saccadic remapping. The first task was to remember the clock hand position either after a saccade to the clock face (saccade condition requiring remapping) or after the clock being displaced to the fixation point (fixation condition with no saccade). The second task was to report the remembered location of a dot shown peripherally in the upper screen for 1 s. We predicted that performance in the two tasks would interfere in the saccade condition, but not in the fixation condition, because of the attentional demands needed for remapping with the saccade. For the clock estimation task, answers in the saccadic trials tended to underestimate the actual position by approximately 37 ms while responses in the fixation trials were closer to veridical. As predicted, the findings also revealed significant interaction between the two tasks showing decreased predicted accuracy in the clock task for increased error in the localization task, but only for the saccadic condition. Taken together, these results point at the key role of attention in predictive remapping.

The presence of placeholders modulates the naso-temporal asymmetry in the remote distractor effect

The remote distractor effect (RDE) is a well-known and robust phenomenon whereby latencies of saccades are increased when a distractor is presented simultaneously along with the saccade target. Studies of the RDE in patients with a loss of vision in one visual field (hemianopia) following damage to primary visual cortex have provided conflicting results. Rafal, Smith, Krantz, Cohen, and Brennan (1990) reported a naso-temporal asymmetry in the RDE in patients with hemianopias, with a greater influence of distractors presented in their blind temporal visual field. This asymmetry was not observed in typically sighted controls. By contrast, Walker, Mannan, Maurer, Pambakian, and Kennard (2000) observed no effect of distractors presented to either the blind nasal or blind temporal hemifield of hemianopes, but the naso-temporal asymmetry was observed in typically sighted controls. The present study addressed one potential methodological differences between the two studies by investigating the inhibitory effect of a distractor on saccade latency in neurotypical participants. Here participants were tested monocularly and the effect of a nasal/temporal hemifield distractor on saccade latency observed in the presence or absence of peripheral placeholders. Our results showed a naso-temporal asymmetry in the magnitude of the RDE in the no placeholder condition, with a greater RDE when the distractor was presented in the temporal visual field. However, in the placeholder condition the opposite asymmetry was observed, that is an increased RDE when the distractor was presented in the nasal visual field. Our results suggest that the presence/absence of a placeholder might be the critical factor explaining the discrepancy between Rafal et al. (1990) and Walker et al. (2000) in participants without visual field loss. The current results can be interpreted in terms of additional inhibitory or attentional processes that bias selection towards stimuli in the nasal hemifield in the presence of placeholders, still, the mechanisms underlying these effects remain unclear.

Unilateral Spatial Neglect without Hemiplegia: The Output-Mode Effect Revisited

BACKGROUND

The occurrence of unilateral spatial neglect (USN) in non-hemiplegic right-hemisphere damaged patients is rare. Earlier studies of such patients revealed a significant advantage when typical neglect tests were performed by the patient's left hand as compared to the dominant right hand. The mechanism underlying this "output-mode effect" remains elusive.

METHODS

We analyzed the temporal dynamics of this effect using line-bisection task in 9 non-hemiplegic stroke patients with left-USN.

RESULTS

In 4 patients tested shortly after stroke onset (≤ 6 weeks), the impact of hand laterality was variable (left-hand advantage in one patient; right-hand advantage in 2 patients; similar performance in both hands in one patient). Only later (> 6 weeks) a clear advantage of the left hand emerged in the majority of patients, similar to the earlier reports which were all based on late testing.

CONCLUSIONS

We found variable dynamics in the expression of the output-mode effect in the first weeks following stroke onset, which may reflect changes of inter-hemispheric balance, related to recovery processes. We propose that therapeutic interventions aiming to manipulate the inter-hemispheric balance (e.g., by non-invasive brain stimulation) take into account the existence of such dynamics and their highly variate nature.

Visual selective attention and the control of tracking eye movements: a critical review

People’s eyes are directed at objects of interest with the aim of acquiring visual information. However, processing this information is constrained in capacity, requiring task-driven and salience-driven attentional mechanisms to select few among the many available objects. A wealth of behavioral and neurophysiological evidence has demonstrated that visual selection and the motor selection of saccade targets rely on shared mechanisms. This coupling supports the premotor theory of visual attention put forth more than 30 years ago, postulating visual selection as a necessary stage in motor selection. In this review, we examine to which extent the coupling of visual and motor selection observed with saccades is replicated during ocular tracking. Ocular tracking combines catch-up saccades and smooth pursuit to foveate a moving object. We find evidence that ocular tracking requires visual selection of the speed and direction of the moving target, but the position of the motion signal may not coincide with the position of the pursuit target. Further, visual and motor selection can be spatially decoupled when pursuit is initiated (open-loop pursuit). We propose that a main function of coupled visual and motor selection is to serve the coordination of catch-up saccades and pursuit eye movements. A simple race-to-threshold model is proposed to explain the variable coupling of visual selection during pursuit, catch-up and regular saccades, while generating testable predictions. We discuss pending issues, such as disentangling visual selection from preattentive visual processing and response selection, and the pinpointing of visual selection mechanisms, which have begun to be addressed in the neurophysiological literature.

The Editing Density of Moving Images Influences Viewers' Time Perception: The Mediating Role of Eye Movements

The present study examined whether cinematographic editing density affects viewers' perception of time. As a second aim, based on embodied models that conceive time perception as strictly connected to the movement, we tested the hypothesis that the editing density of moving images also affects viewers' eye movements and that these later mediate the effect of editing density on viewers' temporal judgments. Seventy participants watched nine video clips edited by manipulating the number of cuts (slow- and fast-paced editing against a master shot, unedited condition). For each editing density, multiple video clips were created, representing three different kinds of routine actions. The participants' eye movements were recorded while watching the video, and the participants were asked to report duration judgments and subjective passage of time judgments after watching each clip. The results showed that participants subjectively perceived that time flew more while watching fast-paced edited videos than slow-paced or unedited videos; by contrast, concerning duration judgments, participants overestimated the duration of fast-paced videos compared to the master-shot videos. Both the slow- and the fast-paced editing generated shorter fixations than the master shot, and the fast-paced editing led to shorter fixations than the slow-paced editing. Finally, compared to the unedited condition, editing led to an overestimation of durations through increased eye mobility. These findings suggest that the editing density of moving images by increasing the number of cuts effectively altered viewers' experience of time and add further evidence to prior research showing that performed eye movement is associated with temporal judgments.

Neural Representations of Covert Attention across Saccades: Comparing Pattern Similarity to Shifting and Holding Attention during Fixation

We can focus visuospatial attention by covertly attending to relevant locations, moving our eyes, or both simultaneously. How does shifting versus holding covert attention during fixation compare with maintaining covert attention across saccades? We acquired human fMRI data during a combined saccade and covert attention task. On Eyes-fixed trials, participants either held attention at the same initial location (“hold attention”) or shifted attention to another location midway through the trial (“shift attention”). On Eyes-move trials, participants made a saccade midway through the trial, while maintaining attention in one of two reference frames: the “retinotopic attention” condition involved holding attention at a fixation-relative location but shifting to a different screen-centered location, whereas the “spatiotopic attention” condition involved holding attention on the same screen-centered location but shifting relative to fixation. We localized the brain network sensitive to attention shifts (shift > hold attention), and used multivoxel pattern time course (MVPTC) analyses to investigate the patterns of brain activity for spatiotopic and retinotopic attention across saccades. In the attention shift network, we found transient information about both whether covert shifts were made and whether saccades were executed. Moreover, in this network, both retinotopic and spatiotopic conditions were represented more similarly to shifting than to holding covert attention. An exploratory searchlight analysis revealed additional regions where spatiotopic was relatively more similar to shifting and retinotopic more to holding. Thus, maintaining retinotopic and spatiotopic attention across saccades may involve different types of updating that vary in similarity to covert attention “hold” and “shift” signals across different regions.

Spontaneous Beta Band Rhythms in the Predictive Coding of Natural Stimuli

The regularity of the physical world and the biomechanics of the human body movements generate distributions of highly probable states that are internalized by the brain in the course of a lifetime. In Bayesian terms, the brain exploits prior knowledge, especially under conditions when sensory input is unavailable or uncertain, to predictively anticipate the most likely outcome of upcoming stimuli and movements. These internal models, formed during development, yet still malleable in adults, continuously adapt through the learning of novel stimuli and movements.Traditionally, neural beta (β) oscillations are considered essential for maintaining sensorimotor and cognitive representations, and for temporal coding of expectations. However, recent findings show that fluctuations of β band power in the resting state strongly correlate between cortical association regions. Moreover, central (hub) regions form strong interactions over time with different brain regions/networks (dynamic core). β band centrality fluctuations of regions of the dynamic core predict global efficiency peaks suggesting a mechanism for network integration. Furthermore, this temporal architecture is surprisingly stable, both in topology and dynamics, during the observation of ecological natural visual scenes, whereas synthetic temporally scrambled stimuli modify it. We propose that spontaneous β rhythms may function as a long-term "prior" of frequent environmental stimuli and behaviors.

Attention attracts action in healthy participants: An insight into optic ataxia?

Patients with optic ataxia following lesions to superior parts of the posterior parietal cortex make large errors when reaching to targets in the peripheral visual field. These errors are characterised by a contraction, or attraction, towards the point of fixation. These patients also have a reduced ability to allocate visual attention away from the point of fixation, but it is unclear whether the core symptom of misreaching is related to these attentional problems. In neurologically-intact adults, we tested the effect of an attention-demanding dual-task performed at fixation upon visually-guided reaching to peripheral targets. The dual task was associated with delayed movement initiation, and a shortened deceleration phase of movement suggesting a reduced ability to benefit from online control. It also induced a small but consistent shift of reaching endpoints towards the side of fixation. Our experimental restriction of visual attention thus impaired both the programming and control of reaching, and induced a spatial pattern of errors that was qualitatively reminiscent of optic ataxia, albeit much less severe. These findings are consistent with a close functional link between attention and action in the healthy brain, and suggest that attentional disturbances could be a core component of optic ataxia following parietal lesions.

Spatial attention and spatial short term memory in PSP and Parkinson's disease

Progressive Supranuclear Palsy (PSP) is a neurodegenerative disorder characterised by deterioration in motor, oculomotor and cognitive function. A key clinical feature of PSP is the progressive paralysis of eye movements, most notably for vertical saccades. These oculomotor signs can be subtle, however, and PSP is often misdiagnosed as Parkinson's disease (PD), in its early stages. Although some of the clinical features of PD and PSP overlap, they are distinct disorders with differing underlying pathological processes, responses to treatment and prognoses. One key difference lies in the effects the diseases have on cognition. The oculomotor system is tightly linked to cognitive processes such as spatial attention and spatial short-term memory (sSTM), and previous studies have suggested that PSP and PD experience different deficits in these domains. We therefore hypothesised that people with PSP (N = 15) would experience problems with attention (assessed with feature and conjunction visual search tasks) and sSTM (assessed with the Corsi blocks task) compared to people with PD (N = 16) and Age Matched Controls (N = 15). As predicted, feature and conjunction search were sgnificantly slower in the PSP group compared to the other groups, and this deficit was significantly worse for feature compared to conjunction search. The PD group did not differ from AMC on feature search but were significantly impaired on the conjunction search. The PSP group also had a pronounced vertical sSTM impairment that was not present in PD or AMC groups. It is argued that PSP is associated with specific impairment of visuospatial cognition which is caused by degeneration of the oculomotor structures that support exogenous spatial attention, consistent with oculomotor theories of spatial attention and memory.

Sustained visuospatial attention enhances lateralized anticipatory ERP activity in sensory areas

The existence of neural correlates of spatial attention is not limited to the reactive stage of stimulus processing: neural activities subtending spatial attention are deployed well ahead of stimulus onset. ERP evidence supporting this proactive (top-down) attentional control is based on trial-by-trial S1-S2 paradigms, where the onset of a directional cue (S1) indicates on which side attention must be directed to respond to an upcoming target stimulus (S2). Crucially, S1 onset trigger both attention and motor preparation, therefore, these paradigms are not ideal to demonstrate the effect of attention at preparatory stage of processing. To isolate top-down anticipatory attention, the present study used a sustained attention paradigm based on a steady cue that indicates the attended side constantly throughout an entire block of trials, without any onset of an attentional cue. The main result consists in the description of the attention effect on the visual negativity (vN) component, a growing neural activity starting before stimulus presentation in extrastriate visual areas. The vN was consistently lateralized in the hemisphere contralateral to the attended side, regardless of the hand to be used. At the opposite, the lateralized motor activity emerged long after, confirming that the hand-selection process followed the spatial attention orientation process. The present study confirms the anticipatory nature of the vN component and corroborate its role in terms of preparatory visuospatial attention.

Sustained spatial attention accounts for the direction bias of human microsaccades

Small ballistic eye movements, so called microsaccades, occur even while foveating an object. Previous studies using covert attention tasks have shown that shortly after a symbolic spatial cue, specifying a behaviorally relevant location, microsaccades tend to be directed toward the cued location. This suggests that microsaccades can serve as an index for the covert orientation of spatial attention. However, this hypothesis faces two major challenges: First, effects associated with visual spatial attention are hard to distinguish from those that associated with the contemplation of foveating a peripheral stimulus. Second, it is less clear whether endogenously sustained attention alone can bias microsaccade directions without a spatial cue on each trial. To address the first issue, we investigated the direction of microsaccades in human subjects while they attended to a behaviorally relevant location and prepared a response eye movement either toward or away from this location. We find that directions of microsaccades are biased toward the attended location rather than towards the saccade target. To tackle the second issue, we verbally indicated the location to attend before the start of each block of trials, to exclude potential visual cue-specific effects on microsaccades. Our results indicate that sustained spatial attention alone reliably produces the microsaccade direction effect. Overall, our findings demonstrate that sustained spatial attention alone, even in the absence of saccade planning or a spatial cue, is sufficient to explain the direction bias observed in microsaccades.

Social information rapidly prioritizes overt but not covert attention in a joint spatial cueing task

Coordinating actions with others is crucial for our survival. Our ability to see what others are seeing and to align our visual attention with them facilitates these joint actions. In the present research, we set out to increase our understanding of such joint attention by investigating the extent to which social information would be able to prioritize overt (when moving the eyes to attend) and covert (when shifting attention without eye movements) attention in a joint spatial cueing task. Participants saw a cue and detected a target at the same or a different location alongside an unseen partner of either higher or lower social rank. In a novel twist, participants were led to believe that the cue was connected to the gaze location of their partner. In Experiment 1, where participants were told to not move their eyes (covert attention), the partner's social rank did not change how quickly participants detected targets. But in Experiment 2, where participants were free to move their eyes naturally (overt attention), inhibition of return effects (slower responses to cued than uncued targets) were modulated by their partner's social rank. These social top-down effects occurred already at a short SOA of 150 ms. Our findings suggest that overt attention might provide a key tool for joint action, as it is penetrable for social information at the early stages of information processing.

Exogenous Orientation of Attention to the Center of Mass in a Visual Search Task

Anne Treisman's scientific career included broad-ranging contributions that advanced our understanding of the attentional mechanisms that people rely on to make sense of the world. In this paper, we describe results from a visual-search paradigm first developed by Grabowecky and Treisman (Grabowecky, 1992). Their design exploited known feature-search asymmetries (Treisman & Gormican, 1988) to investigate the role of a center of mass (CoM) mechanism in determining the initial locus of visual-spatial attention in visual search. The original experiment supported the hypothesis that CoM influences initial orienting of visual-spatial attention, as targets near the CoM of a multi-element array were detected more quickly than targets distant from the CoM. These findings were replicated in a follow-up experiment using a different feature-search asymmetry, with eye-tracking added to verify central fixation. We also investigated whether CoM had any influence on pop-out search, and found no evidence that it does. Surprisingly, the effect of position of the search array on the CoM suggested that CoM may be computed independently for elements contained within each visual hemifield. Whereas our work on CoM with Treisman was initiated within an earlier theoretical context, the present results are also compatible with contemporary theoretical advances; both the early results and the new results can be integrated within current ways of thinking about attention and pre-attentive mechanisms.

On the link between attentional search and the oculomotor system: Is preattentive search restricted to the range of eye movements?

It has been proposed that covert visual search can be fast, efficient, and stimulus driven, particularly when the target is defined by a salient single feature, or slow, inefficient, and effortful when the target is defined by a nonsalient conjunction of features. This distinction between fast, stimulus-driven orienting and slow, effortful orienting can be related to the distinction between exogenous spatial attention and endogenous spatial attention. Several studies have shown that exogenous, covert orienting is limited to the range of saccadic eye movements, whereas covert endogenous orienting is independent of the range of saccadic eye movements. The current study examined whether covert visual search is affected in a similar way. Experiment 1 showed that covert visual search for feature singletons was impaired when stimuli were presented beyond the range of saccadic eye movements, whereas conjunction search was unaffected by array position. Experiment 2 replicated and extended this effect by measuring search times at 6 eccentricities. The impairment in covert feature search emerged only when stimuli crossed the effective oculomotor range and remained stable for locations further into the periphery, ruling out the possibility that the results of Experiment 1 were due to a failure to fully compensate for the effects of cortical magnification. The findings are interpreted in terms of biased competition and oculomotor theories of spatial attention. It is concluded that, as with covert exogenous orienting, biological constraints on overt orienting in the oculomotor system constrain covert, preattentive search.

Microsaccades inhibition triggered by a repetitive visual distractor is not subject to habituation: Implications for the programming of reflexive saccades

The oculomotor capture triggered by a peripheral onset is subject to habituation, a basic form of learning consisting in a response decrement toward a repeatedly presented stimulus. However, it is unclear whether habituation of reflexive saccades takes place at the saccadic programming or execution stage (or both). To address this issue, we exploited the fact that during fixation the programming of a reflexive saccade exerts a robust but short-lasting phasic inhibition in the absolute microsaccadic frequency. Hence, if habituation of reflexive saccades occurs at the programming stage, then this should also affect the microsaccadic frequency, with a progressive reduction of the inhibitory phase. Conversely, if habituation occurs only at the later stage of saccade execution, the no change in the microsaccadic pattern is expected. Participants were repeatedly exposed to a peripheral onset distractor, and when eye movements were allowed, we replicated the oculomotor capture habituation. Crucially, however, when fixation was maintained the microsaccadic response did not change as exposure to the onset progressed, suggesting that habituation of reflexive saccades does not take place at the programming stage in the superior colliculus (SC), but at the later stage of saccade execution in the brainstem, where the competition between different saccades might be resolved. This scenario challenges one of the main assumptions of the competitive integration model for oculomotor control, which assumes that competition between exogenous and endogenous saccade programs occurs in the (SC). Our results and interpretation are instead in agreement with neurophysiological studies in non-human primates showing that saccadic adaption, another form of oculomotor plasticity, takes place downstream from the SC.

Ocular fixations and presaccadic potentials to explain pareidolias in Parkinson's disease

In Parkinson's disease, a precursor phenomenon to visual hallucinations presents as 'pareidolias' which make ambiguous forms appear meaningful. To evoke and detect pareidolias in patients, a noise pareidolia test was recently developed, although its task-dependent mechanisms are yet to be revealed. When subjected to this test, we hypothesized that patients exhibiting pareidolias would show altered top-down influence of visual processing allowing us to demonstrate the influence of pareidolic illusionary behaviour in Parkinson's disease patients. To that end, we evaluated eye-movement strategies and fixation-related presaccadic activity on scalp EEG when participants performed the test. Twelve healthy controls and 21 Parkinson's disease patients, evaluated for cognitive, visuo-spatial and executive functions, took a modified computer-based version of the noise pareidolia test in a free-viewing EEG eye-tracking experiment. Eye-tracking metrics (fixation-related durations and counts) documented the eye movement behaviour employed in correct responses (face/noise) and misperceptions (pareidolia/missed) during early and late visual search conditions. Simultaneously, EEG recorded the presaccadic activity in frontal and parietal areas of the brain. Based on the noise pareidolia test scores, we found certain Parkinson's disease patients exhibited pareidolias whereas others did not. ANOVA on eye-tracking data showed that patients dwelled significantly longer to detect faces and pareidolias which affected both global and local search dynamics depending on their visuo-perceptual status. Presaccadic activity in parietal electrodes for the groups was positive for faces and pareidolias, and negative for noise, though these results depended mainly on saccade size. However, patients sensitive to pareidolias showed a significantly higher presaccadic potential on frontal electrodes independent of saccade sizes, suggesting a stronger frontal activation for pareidolic stimuli. We concluded with the following interpretations (i) the noise pareidolia test specifically characterizes visuo-perceptual inadequacies in patients despite their wide range of cognitive scores, (ii) Parkinson's disease patients dwell longer to converge attention to pareidolic stimuli due to abnormal saccade generation proportional to their visuo-perceptual deficit during early search, and during late search, due to time-independent alteration of visual attentional network and (iii) patients with pareidolias show increased frontal activation reflecting the allocation of attention to irrelevant targets that express the pareidolic phenomenon. While the disease per se alters the visuo-perceptual and oculomotor dynamics, pareidolias occur in Parkinson's disease due to an abnormal top-down modulation of visual processing that affects visual attention and guidance to ambiguous stimuli.

Preparation of saccade sequences and eye programming affect endogenous covert attention

Endogenous attention can be allocated in parallel to at least two saccade target locations of a planned sequence, but attentional resources are larger in the location of the first than the second saccade. The meridian effect that is observed in endogenous attention can be explained by eye programming, but it is not known how eye-movement preparation and eye programming can together affect endogenous attention during sequential saccades. We used a double-task paradigm to investigate this issue. In two experiments, we confirmed the relation between the preparation of sequential saccades and attentional selection and also showed that eye programming could eliminate deterioration of attentional resources in the second saccade location. The finding of the meridian effect in both the saccadic task and the target discrimination task additionally indicates the important role of eye programming in endogenous attention. The results were discussed in terms of the Premotor Theory of Attention.

No Advantage for Separating Overt and Covert Attention in Visual Search

We move our eyes roughly three times every second while searching complex scenes, but covert attention helps to guide where we allocate those overt fixations. Covert attention may be allocated reflexively or voluntarily, and speeds the rate of information processing at the attended location. Reducing access to covert attention hinders performance, but it is not known to what degree the locus of covert attention is tied to the current gaze position. We compared visual search performance in a traditional gaze-contingent display, with a second task where a similarly sized contingent window is controlled with a mouse, allowing a covert aperture to be controlled independently by overt gaze. Larger apertures improved performance for both the mouse- and gaze-contingent trials, suggesting that covert attention was beneficial regardless of control type. We also found evidence that participants used the mouse-controlled aperture somewhat independently of gaze position, suggesting that participants attempted to untether their covert and overt attention when possible. This untethering manipulation, however, resulted in an overall cost to search performance, a result at odds with previous results in a change blindness paradigm. Untethering covert and overt attention may therefore have costs or benefits depending on the task demands in each case.

Motor congruency and multisensory integration jointly facilitate visual information processing before movement execution

Attention allows us to select important sensory information and enhances sensory information processing. Attention and our motor system are tightly coupled: attention is shifted to the target location before a goal-directed eye- or hand movement is executed. Congruent eye-hand movements to the same target can boost the effect of this pre-movement shift of attention. Moreover, visual information processing can be enhanced by, for example, auditory input presented in spatial and temporal proximity of visual input via multisensory integration (MSI). In this study, we investigated whether the combination of MSI and motor congruency can synergistically enhance visual information processing beyond what can be observed using motor congruency alone. Participants performed congruent eye- and hand movements during a 2-AFC visual discrimination task. The discrimination target was presented in the planning phase of the movements at the movement target location or a movement irrelevant location. Three conditions were compared: (1) a visual target without sound, (2) a visual target with sound spatially and temporally aligned (MSI) and (3) a visual target with sound temporally misaligned (no MSI). Performance was enhanced at the movement-relevant location when congruent motor actions and MSI coincide compared to the other conditions. Congruence in the motor system and MSI together therefore lead to enhanced sensory information processing beyond the effects of motor congruency alone, before a movement is executed. Such a synergy implies that the boost of attention previously observed for the independent factors is not at ceiling level, but can be increased even further when the right conditions are met.