Distinct perceptual rhythms for feature and conjunction searches

Serial attentional resource allocation during parallel feature value tracking

The visual system has evolved the ability to track features like color and orientation in parallel. This property aligns with the specialization of processing these feature dimensions in the visual cortex. But what if we ask to track changing feature-values within the same feature dimension? Parallel tracking would then have to share the same cortical representation, which would set strong limitations on tracking performance. We address this question by measuring the precision of color representations when human observers track the color of two superimposed dot clouds that simultaneously change color along independent trajectories in color-space. We find that tracking precision is highly imbalanced between streams and that tracking precision changes over time by alternating between streams at a rate of ~1 Hz. These observations suggest that, while parallel color tracking is possible, it is highly limited, essentially allowing for only one color-stream to be tracked with precision at a given time.

Attentional priming in Go No-Go search tasks

Go/No-Go responses in visual search yield different estimates of the operation of visual attention than more standard present versus absent tasks. Such minor methodological tweaks have a surprisingly large effect on measures that have, for the last half-century or so, formed the backbone of prominent theories of visual attention. Secondly, priming effects in visual search have a dominating influence on visual search, accounting for effects that have been attributed to top-down guidance in standard theories. Priming effects in visual search have, however, never been investigated for searches involving Go/No-Go present/absent decisions. Here, Go/No-Go tasks were used to assess visual search for an odd-one-out face, defined either by color or facial expression. The Go/No-Go responses for the color-based task were very fast for both present and absent trials and notably, they resulted in negative slopes of RT and set size. Interestingly "Go" responses were even faster for the target absent case. The "Go" responses were, on the other hand, much slower for expression and became higher with increased set-size, particularly for the target-absent response. Priming effects were considerable for the feature search, but for expression, the target absent priming was strong, but did not occur for target present trials, arguing that repetition priming for this search mainly reflects priming of context rather than target features. Overall, the results reinforce the point that Go/No-Go tasks are highly informative for theoretical accounts of visual attention and are shown here to cast a new light on attentional priming.

No evidence for rhythmic sampling in inhibition of return

When exogenously cued, attention reflexively reorients towards the cued position. After a brief dwelling time, attention is released and then persistently inhibited from returning to this position for up to three seconds, a phenomenon coined 'inhibition of return' (IOR). This inhibitory interpretation has shaped our understanding of the spatio-temporal dynamics of the attentional spotlight after an exogenous visual cue for more than three decades. However, a recent theory refines this traditional view and predicts that attention rhythmically alternates between possible target locations at a theta frequency, implying occasional returns of attention to the cued position. Unfortunately, previous IOR studies have only probed performance at a few, temporally wide-spread cue-target onset asynchronies (CTOAs) rendering a comparison of these contradictory predictions impossible. We therefore used a temporally fine-grained adaptation of the Posner paradigm with 25 equally and densely spaced CTOAs, which yielded a robust IOR effect in the reaction time difference between valid and invalidly cued trials. We modelled the time course of this effect across CTOAs as a linear or exponential decay (traditional IOR model), sinusoidal rhythm (rhythmic model) and a combination of both (hybrid model). Model comparison by means of goodness-of-fit indices provided strong evidence in favor of traditional IOR models, and against theta-rhythmic attentional sampling contributing to IOR. This finding was supported by an FFT analysis, which also revealed no significant theta rhythm. We therefore conclude that the spatio-temporal dynamics of attention following an exogenous cue cannot be explained by rhythmic attentional sampling.

Periodic attention operates faster during more complex visual search

Attention has been found to sample visual information periodically, in a wide range of frequencies below 20 Hz. This periodicity may be supported by brain oscillations at corresponding frequencies. We propose that part of the discrepancy in periodic frequencies observed in the literature is due to differences in attentional demands, resulting from heterogeneity in tasks performed. To test this hypothesis, we used visual search and manipulated task complexity, i.e., target discriminability (high, medium, low) and number of distractors (set size), while electro-encephalography was simultaneously recorded. We replicated previous results showing that the phase of pre-stimulus low-frequency oscillations predicts search performance. Crucially, such effects were observed at increasing frequencies within the theta-alpha range (6–18 Hz) for decreasing target discriminability. In medium and low discriminability conditions, correct responses were further associated with higher post-stimulus phase-locking than incorrect ones, in increasing frequency and latency. Finally, the larger the set size, the later the post-stimulus effect peaked. Together, these results suggest that increased complexity (lower discriminability or larger set size) requires more attentional cycles to perform the task, partially explaining discrepancies between reports of attentional sampling. Low-frequency oscillations structure the temporal dynamics of neural activity and aid top-down, attentional control for efficient visual processing.

Theta oscillations shift towards optimal frequency for cognitive control

Cognitive control allows to flexibly guide behaviour in a complex and ever-changing environment. It is supported by theta band (4-7 Hz) neural oscillations that coordinate distant neural populations. However, little is known about the precise neural mechanisms permitting such flexible control. Most research has focused on theta amplitude, showing that it increases when control is needed, but a second essential aspect of theta oscillations, their peak frequency, has mostly been overlooked. Here, using computational modelling and behavioural and electrophysiological recordings, in three independent datasets, we show that theta oscillations adaptively shift towards optimal frequency depending on task demands. We provide evidence that theta frequency balances reliable set-up of task representation and gating of task-relevant sensory and motor information and that this frequency shift predicts behavioural performance. Our study presents a mechanism supporting flexible control and calls for a reevaluation of the mechanistic role of theta oscillations in adaptive behaviour.

Putative rhythms in attentional switching can be explained by aperiodic temporal structure

The neural and perceptual effects of attention were traditionally assumed to be sustained over time, but recent work suggests that covert attention rhythmically switches between objects at 3-8 Hz. Here I use simulations to demonstrate that the analysis approaches commonly used to test for rhythmic oscillations generate false positives in the presence of aperiodic temporal structure. I then propose two alternative analyses that are better able to discriminate between periodic and aperiodic structure in time series. Finally, I apply these alternative analyses to published datasets and find no evidence for behavioural rhythms in attentional switching after accounting for aperiodic temporal structure. The techniques presented here will help clarify the periodic and aperiodic dynamics of perception and of cognition more broadly.

Rhythmic sampling revisited: Experimental paradigms and neural mechanisms

Sampling of information is thought to be an important aspect of explorative behaviour. Evidence for it has been gained in behavioural assessments of a variety of overt and covert cognitive domains, including sensation, attention, memory, eye movements and dexterity. A common aspect across many findings is that sampling tends to exhibit a rhythmicity at low frequencies (theta, 4-8 Hz; alpha, 9-12 Hz). Neurophysiological investigations in a wide range of species, including rodents, non-human primates and humans have demonstrated the presence of sampling related neural oscillations in a number of brain areas ranging from early sensory cortex, hippocampus to high-level cognitive areas. However, to assess whether rhythmic sampling represents a general aspect of exploratory behaviour one must critically evaluate the task parameters, and their potential link with neural oscillations. Here we focus on sampling during attentive vision to present an overview on the experimental conditions that are used to investigate rhythmic sampling and associated oscillatory brain activity in this domain. This review aims to (1) provide guidelines to efficiently quantify behavioural rhythms, (2) compare results from human and non-human primate studies and (3) argue that the underlying neural mechanisms of sampling can co-occur in both sensory and high-level areas.

Distinct contributions of alpha and theta rhythms to perceptual and attentional sampling

Accumulating evidence suggests that visual perception operates in an oscillatory fashion at an alpha frequency (around 10 Hz). Moreover, visual attention also seems to operate rhythmically, albeit at a theta frequency (around 5 Hz). Both rhythms are often associated to "perceptual snapshots" taken at the favorable phases of these rhythms. However, less is known about the unfavorable phases: do they constitute "blind gaps," requiring the observer to guess, or is information sampled with reduced precision insufficient for the task demands? As simple detection or discrimination tasks cannot distinguish these options, we applied a continuous report task by asking for the exact orientation of a Landolt ring's gap to estimate separate model parameters for precision and the amount of guessing. We embedded this task in a well-established psychophysical protocol by densely sampling such reports across 20 cue-target stimulus onset asynchronies in a Posner-like cueing paradigm manipulating involuntary spatial attention. Testing the resulting time courses of the guessing and precision parameters for rhythmicities using a fast Fourier transform, we found an alpha rhythm (9.6 Hz) in precision for invalidly cued trials and a theta rhythm (4.8 Hz) in the guess rate across validity conditions. These results suggest distinct roles of the perceptual alpha and the attentional theta rhythm. We speculate that both rhythms result in environmental sampling characterized by fluctuating spatial resolution, speaking against a strict succession of blind gaps and perceptual snapshots.

Cortical Distance but Not Physical Distance Modulates Attentional Rhythms

It has been well documented that the spotlight of attention is intrinsically rhythmic and oscillates by discretely sampling either single or multiple objects. However, the neural site of attentional rhythms remains poorly understood. Considering the topography of visual cortical areas, we modulated the cortical distances of two gratings while fixing the corresponding retinal distance by setting the gratings on different sides (cortically far, Experiment 1) or on the same side (cortically near, Experiment 2) of the vertical median, to investigate the interhemispheric divide effect in attentional rhythms. The cue-target stimulus onset asynchrony (SOA) varied from 0.1 s to 1.08 s in 20-ms increments, allowing fluctuations below 50 Hz to be examined. The results showed that when the two stimuli were on opposite sides of the vertical meridian, attentional rhythms were observed at theta and alpha frequencies, consistent with the results reported in previous studies. However, when the two stimuli were located on the same side of the vertical meridian, attentional rhythms were not observed. This study indicates that attentional rhythms are modulated by cortical distance but not by physical distance.

Differential impact of endogenous and exogenous attention on activity in human visual cortex

How do endogenous (voluntary) and exogenous (involuntary) attention modulate activity in visual cortex? Using ROI-based fMRI analysis, we measured fMRI activity for valid and invalid trials (target at cued/un-cued location, respectively), pre- or post-cueing endogenous or exogenous attention, while participants performed the same orientation discrimination task. We found stronger modulation in contralateral than ipsilateral visual regions, and higher activity in valid- than invalid-trials. For endogenous attention, modulation of stimulus-evoked activity due to a pre-cue increased along the visual hierarchy, but was constant due to a post-cue. For exogenous attention, modulation of stimulus-evoked activity due to a pre-cue was constant along the visual hierarchy, but was not modulated due to a post-cue. These findings reveal that endogenous and exogenous attention distinctly modulate activity in visuo-occipital areas during orienting and reorienting; endogenous attention facilitates both the encoding and the readout of visual information whereas exogenous attention only facilitates the encoding of information.

Specific Visual Subregions of TPJ Mediate Reorienting of Spatial Attention

The temporo-parietal junction (TPJ) has been associated with various cognitive and social functions, and is critical for attentional reorienting. Attention affects early visual processing. Neuroimaging studies dealing with such processes have thus far concentrated on striate and extrastriate areas. Here, we investigated whether attention orienting or reorienting modulate activity in visually driven TPJ subregions. For each observer we identified 3 visually responsive subregions within TPJ: 2 bilateral (vTPJant and vTPJpost) and 1 right lateralized (vTPJcent). Cortical activity in these subregions was measured using fMRI while observers performed a 2-alternative forced-choice orientation discrimination task. Covert spatial endogenous (voluntary) or exogenous (involuntary) attention was manipulated using either a central or a peripheral cue with task, stimuli and observers constant. Both endogenous and exogenous attention increased activity for invalidly cued trials in right vTPJpost; only endogenous attention increased activity for invalidly cued trials in left vTPJpost and in right vTPJcent; and neither type of attention modulated either right or left vTPJant. These results demonstrate that vTPJpost and vTPJcent mediate the reorientation of covert attention to task relevant stimuli, thus playing a critical role in visual attention. These findings reveal a differential reorienting cortical response after observers' attention has been oriented to a given location voluntarily or involuntarily.

A surface-based code contributes to visual shape perception

Considerable uncertainty remains regarding the types of features human vision uses for shape representation. Visual-search experiments are reported which assessed the hypothesis of a surface-based (i.e., edge-bounded polygons) code for shape representation in human vision. The results indicate slower search rates and/or longer response times when the target shape shares its constituent surfaces with distractors (conjunction condition) than when the target surfaces are unique in the display (nonconjunction condition). This demonstration is made using test conditions that strictly control any potential artifact pertaining to target-distractor similarity. The surface-based code suggested by this surface-conjunction effect is strictly 2-D, since the effect occurs even when the surfaces are shared between the target and distractors in the 2-D image but not in their 3-D instantiation. Congruently, this latter finding is unaltered by manipulations of the richness of the depth information offered by the stimuli. It is proposed that human vision uses a 2-D surface-based code for shape representation which, considering other key findings in the field, probably coexists with an alternative representation mode based on a type of structural description that can integrate information pertaining to the 3-D aspect of shapes.

Contribution of FEF to Attentional Periodicity during Visual Search: A TMS Study

Visual search, looking for a target embedded among distractors, has long been used to study attention. Current theories postulate a two-stage process in which early visual areas perform feature extraction, whereas higher-order regions perform attentional selection. Such a model implies iterative communication between low- and high-level regions to sequentially select candidate targets in the array, focus attention on these elements, and eventually permit target recognition. This leads to two independent predictions: (1) high-level, attentional regions and (2) early visual regions should both be involved periodically during the search. Here, we used transcranial magnetic stimulation (TMS) applied over the frontal eye field (FEF) in humans, known to be involved in attentional selection, at various delays while observers performed a difficult, attentional search task. We observed a periodic pattern of interference at ∼6 Hz (theta) suggesting that the FEF is periodically involved during this difficult search task. We further compared this result with two previous studies (Dugué et al., 2011, 2015a) in which a similar TMS procedure was applied over the early visual cortex (V1) while observers performed the same task. This analysis revealed the same pattern of interference, i.e., V1 is periodically involved during this difficult search task, at the theta frequency. Past V1 evidence reappraised for this paper, together with our current FEF results, confirm both of our independent predictions, and suggest that difficult search is supported by low- and high-level regions, each involved periodically at the theta frequency.

Attention periodically samples competing stimuli during binocular rivalry

The attentional sampling hypothesis suggests that attention rhythmically enhances sensory processing when attending to a single (~8 Hz), or multiple (~4 Hz) objects. Here, we investigated whether attention samples sensory representations that are not part of the conscious percept during binocular rivalry. When crossmodally cued toward a conscious image, subsequent changes in consciousness occurred at ~8 Hz, consistent with the rates of undivided attentional sampling. However, when attention was cued toward the suppressed image, changes in consciousness slowed to ~3.5 Hz, indicating the division of attention away from the conscious visual image. In the electroencephalogram, we found that at attentional sampling frequencies, the strength of inter-trial phase-coherence over fronto-temporal and parieto-occipital regions correlated with changes in perception. When cues were not task-relevant, these effects disappeared, confirming that perceptual changes were dependent upon the allocation of attention, and that attention can flexibly sample away from a conscious image in a task-dependent manner.

On spatial attention and its field size on the repulsion effect

We investigated the attentional repulsion effect-stimuli appear displaced further away from attended locations-in three experiments: one with exogenous (involuntary) attention, and two with endogenous (voluntary) attention with different attention-field sizes. It has been proposed that differences in attention-field size can account for qualitative differences in neural responses elicited by attended stimuli. We used psychophysical comparative judgments and manipulated either exogenous attention via peripheral cues or endogenous attention via central cues and a demanding rapid serial visual presentation task. We manipulated the attention field size of endogenous attention by presenting streams of letters at two specific locations or at two of many possible locations during each block. We found a robust attentional repulsion effect in all three experiments: with endogenous and exogenous attention and with both attention-field sizes. These findings advance our understanding of the influence of spatial attention on the perception of visual space and help relate this repulsion effect to possible neurophysiological correlates.

Discretized Theta-Rhythm Perception Revealed by Moving Stimuli

Despite the subjective continuity of perception over time, increasing evidence suggests that the human nervous system samples sensory information periodically, a finding strongly exemplified by discretized perception in the alpha-rhythm frequency band. More recently, studies have revealed a theta-band cyclic process that manifests itself as periodical fluctuations in behavioral performance. Here, we used a simple stimulus to demonstrate that the theta-cyclic system can produce a vivid experience of slow discrete visual sampling: a Gabor texture pattern appears as a series of flickering snapshots if its spatial window moves continuously over a carrier grating that remains still or drifts continuously in the opposite direction. While the perceptual magnitude of this illusory saltation varied with the speed difference between grating and window components in head-centered coordinates, the perceived rhythm of saltation remained nearly constant (3–8 Hz) over a wide range of stimulus parameters. Results provide further evidence that the slow cyclic neural processes play a critical role not only in attentional task performance but also in conscious perception.

Behavioral Oscillations in Visual Attention Modulated by Task Difficulty

The spotlight of attention is full of discrete moments and operates periodically. Recently, it has been well-documented there were behavioral oscillations in visual attention, however, different periodicities were demonstrated. Task difficulty may be an important factor causing disagreement in attentional periodic patterns. The present study examined behavioral oscillations in visual attention during difficult and easy tasks. A modified high temporal resolution cue-target paradigm in which the cue-target stimulus onset asynchrony (SOAs) varied from 0.1 to 1.08 s in steps of 20 ms was used. The target was detected with the accuracy of 65% in the difficult condition and 75% in the easy condition. Oscillatory patterns were analyzed and observed in behavioral performance. A theta rhythm was visible in the difficult version. However, attention oscillation increased to a higher frequency in the easy version. Task difficulty was negatively related to power for all bands. Our findings suggest that the attention spotlight switched faster when the task was easy, while, it switched much more slowly when the task was difficult in order to obtain more information. A flexible mechanism for attention spotlight was demonstrated, and task demand modulated attention oscillations.

Transcranial Magnetic Stimulation Reveals Intrinsic Perceptual and Attentional Rhythms

Oscillatory brain activity has functional relevance for perceptual and cognitive processes, as proven by numerous electrophysiology studies accumulating over the years. However, only within the past two decades have researchers been able to study the causal role of such oscillations using transcranial magnetic stimulation (TMS) technology. Two complementary approaches exist. A majority of research employs rhythmic TMS (rTMS) to entrain oscillatory activity and investigate its effect on targeted brain functions. On the other hand, single pulses of TMS (spTMS) that can be delivered with a high spatio-temporal resolution, can be used to precisely probe the state of the system. In this mini-review, we concentrate on this second approach. We argue that, with no a priori hypothesis on the oscillatory frequency of the targeted cortical regions, spTMS can help establish causal links between spontaneous oscillatory activity and perceptual and cognitive functions. Notably, this approach helped to demonstrate that the occipital cortex is periodically involved during specific attentional tasks at the theta (~5 Hz) frequency. We propose that this frequency reflects periodic inter-areal communication for attentional exploration and selection. In the future, clever combination of non-invasive recording and stimulation with well-controlled psychophysics protocols will allow us to further our understanding of the role of brain oscillations for human brain functions.