Different effects of spatial and temporal attention on the integration and segregation of stimuli in time

Attention to space and time: Independent or interactive systems? A narrative review

While there is ample evidence for the ability to selectively attend to where in space and when in time a relevant event might occur, it remains poorly understood whether spatial and temporal attention operate independently or interactively to optimize behavior. To elucidate this important issue, we provide a narrative review of the literature investigating the relationship between the two. The studies were organized based on the attentional manipulation employed (endogenous vs. exogenous) and the type of task (detection vs. discrimination). Although the reviewed findings depict a complex scenario, three aspects appear particularly important in promoting independent or interactive effects of spatial and temporal attention: task demands, attentional manipulation, and their combination. Overall, the present review provides key insights into the relationship between spatial and temporal attention and identifies some critical gaps that need to be addressed by future research.

Emotional response evoked by viewing facial expression pictures leads to higher temporal resolution

We examined the effects of emotional response, with different levels of valence and arousal, on the temporal resolution of visual processing by using photos of various facial expressions. As an index of the temporal resolution of visual processing, we measured the minimum lengths of the noticeable durations for desaturated photographs using the method of constant stimuli by switching colorful facial expression photographs to desaturated versions of the same photographs. Experiments 1 and 2 used facial photographs that evoke various degrees of arousal and valence. Those photographs were prepared not only in an upright orientation but also in an inverted orientation to reduce emotional response without changing the photographs' image properties. Results showed that the minimum duration to notice monochrome photographs for anger, fear, and joy was shorter than that for a neutral face when viewing upright face photographs but not when viewing inverted face photographs. For Experiment 3, we used facial expression photographs to evoke various degrees of arousal. Results showed that the temporal resolution of visual processing increased with the degree of arousal. These results suggest that the arousal of emotional responses evoked by viewing facial expressions might increase the temporal resolution of visual processing.

Evidence for a theta-band behavioural oscillation in rapid face detection

Theories of rhythmic perception propose that perceptual sampling operates in a periodic way, with alternating moments of high and low responsiveness to sensory inputs. This rhythmic sampling is linked to neural oscillations and thought to produce fluctuations in behavioural outcomes. Previous studies have revealed theta- and alpha-band behavioural oscillations in low-level visual tasks and object categorization. However, less is known about fluctuations in face perception, for which the human brain has developed a highly specialized network. To investigate this, we ran an online study (N = 179) incorporating the dense sampling technique with a dual-target rapid serial visual presentation (RSVP) paradigm. In each trial, a stream of object images was presented at 30 Hz and participants were tasked with detecting whether or not there was a face image in the sequence. On some trials, one or two (identical) face images (the target) were embedded in each stream. On dual-target trials, the targets were separated by an interstimulus interval (ISI) that varied between 0 to 633 ms. The task was to indicate the presence of the target and its gender if present. Performance varied as a function of ISI, with a significant behavioural oscillation in the face detection task at 7.5 Hz, driven mainly by the male target faces. This finding is consistent with a high theta-band-based fluctuation in visual processing. Such fluctuations might reflect rhythmic attentional sampling or, alternatively, feedback loops involved in updating top-down predictions.

Temporal Expectation Improves Recognition Memory for Spatially Attended Objects

Recent evidence suggests that temporal expectation is beneficial to memory formation. Rhythmic presentation of stimuli during encoding enhances subsequent recognition and is associated with distinct neural activity compared with when stimuli are presented in an arrhythmic manner. However, no prior study has examined how temporal expectation interacts with another important form of facilitation-spatial attention-to affect memory. This study systematically manipulated temporal expectation and spatial attention during encoding to examine their combined effect on behavioral recognition and associated ERPs. Participants performed eight experimental blocks consisting of an encoding phase and recognition test, with EEG recorded throughout. During encoding, pairs of objects and checkerboards were presented and participants were cued to attend to the left or right stream and detect targets as quickly as possible. In four blocks, stimulus presentation followed a rhythmic (constant, predictable) temporal structure, and in the other four blocks, stimulus onset was arrhythmic (random, unpredictable). An interaction between temporal expectation and spatial attention emerged, with greater recognition in the rhythmic than the arrhythmic condition for spatially attended items. Analysis of memory-specific ERP components uncovered effects of spatial attention. There were late positive component and FN400 old/new effects in the attended condition for both rhythmic and arrhythmic items, whereas in the unattended condition, there was an FN400 old/new effect and no late positive component effect. The study provides new evidence that memory improvement as a function of temporal expectation is dependent upon spatial attention.

No effect of spatial attention on the processing of a motion ensemble: Evidence from Posner cueing

The formation of ensemble codes is an efficient means through which the visual system represents vast arrays of information. This has led to the claim that ensemble representations are formed with minimal reliance on attentional resources. However, evidence is mixed regarding the effects of attention on ensemble processing, and researchers do not always make it clear how attention is being manipulated by their paradigm of choice. In this study, we examined the effects of Posner cueing - a well-established method of manipulating spatial attention - on the processing of a global motion stimulus, a naturalistic ensemble that requires the pooling of local motion signals. In Experiment 1, using a centrally presented, predictive attentional cue, we found no effect of spatial attention on global motion performance: Accuracy in invalid trials, where attention was misdirected by the cue, did not differ from accuracy in valid trials, where attention was directed to the location of the motion stimulus. In Experiment 2, we maximized the potential for our paradigm to reveal any attentional effects on global motion processing by using a threshold-based measure of performance; however, despite this change, there was again no evidence of an attentional effect on performance. Together, our results show that the processing of a global motion stimulus is unaffected when spatial attention is misdirected, and speak to the efficiency with which such ensemble stimuli are processed.

Binding Mechanisms in Visual Perception and Their Link With Neural Oscillations: A Review of Evidence From tACS

Neurophysiological studies in humans employing magneto- (MEG) and electro- (EEG) encephalography increasingly suggest that oscillatory rhythmic activity of the brain may be a core mechanism for binding sensory information across space, time, and object features to generate a unified perceptual representation. To distinguish whether oscillatory activity is causally related to binding processes or whether, on the contrary, it is a mere epiphenomenon, one possibility is to employ neuromodulatory techniques such as transcranial alternating current stimulation (tACS). tACS has seen a rising interest due to its ability to modulate brain oscillations in a frequency-dependent manner. In the present review, we critically summarize current tACS evidence for a causal role of oscillatory activity in spatial, temporal, and feature binding in the context of visual perception. For temporal binding, the emerging picture supports a causal link with the power and the frequency of occipital alpha rhythms (8-12 Hz); however, there is no consistent evidence on the causal role of the phase of occipital tACS. For feature binding, the only study available showed a modulation by occipital alpha tACS. The majority of studies that successfully modulated oscillatory activity and behavioral performance in spatial binding targeted parietal areas, with the main rhythms causally linked being the theta (~7 Hz) and beta (~18 Hz) frequency bands. On the other hand, spatio-temporal binding has been directly modulated by parieto-occipital gamma (~40-60 Hz) and alpha (10 Hz) tACS, suggesting a potential role of cross-frequency coupling when binding across space and time. Nonetheless, negative or partial results have also been observed, suggesting methodological limitations that should be addressed in future research. Overall, the emerging picture seems to support a causal role of brain oscillations in binding processes and, consequently, a certain degree of plasticity for shaping binding mechanisms in visual perception, which, if proved to have long lasting effects, can find applications in different clinical populations.

Investigating the role of temporal processing in developmental dyslexia: Evidence for a specific deficit in rapid visual segmentation

The current study investigates the role of temporal processing in the visual domain in participants with developmental dyslexia (DD), the most common neurodevelopmental disorder, which is characterized by severe and specific difficulties in learning to read despite normal intelligence and adequate education. Specifically, our aim was to test whether DD is associated with a general impairment of temporal sensory processing or a specific deficit in temporal integration (which ensures stability of object identity and location) or segregation (which ensures sensitivity to changes in visual input). Participants with DD performed a task that measured both temporal integration and segregation using an identical sequence of two displays separated by a varying interstimulus interval (ISI) under two different task instructions. Results showed that participants with DD performed worse in the segregation task, with a shallower slope of the psychometric curve of percentage correct as a function of the ISI between the two target displays. Moreover, we found also a relationship between temporal segregation performance and text, words, and pseudowords reading speeds at the individual level. In contrast, no significant association between reading (dis)ability and temporal integration emerged. The current findings provide evidence for a difference in the fine temporal resolution of visual processing in DD and, considering the growing evidence about a link between visual temporal segregation and neural oscillations at specific frequencies, they support the idea that DD is characterized by an altered oscillatory sampling within the visual system.

Testing the effect of tACS over parietal cortex in modulating endogenous alpha rhythm and temporal integration windows in visual perception

Neural oscillations in the alpha band (8-12 Hz) have been proposed as a key mechanism for the temporal resolution of visual perception. Higher alpha frequencies have been related to improved segregation of visual events over time, whereas lower alpha frequencies have been related to improved temporal integration. Similarly, also the phase of ongoing alpha has been shown to correlate with temporal integration/segregation. To test a causal relationship between alpha oscillations and perception, we here employed multi-channel transcranial alternating current stimulation (mc-tACS) over the right parietal cortex, whereas participants performed a visual temporal integration/segregation task that used identical stimuli with different instructions. Before and after mc-tACS we recorded the resting-state electroencephalogram (EEG) to extract the individual alpha frequency (IAF) and delivered electrical stimulation at slightly slower and faster frequencies (IAF±2 Hz). We hypothesized that this would not only drive endogenous alpha rhythms, but also affect temporal integration and segregation in an opposite way. However, the mc-tACS protocol used here did not consistently increase or decrease the IAF after the stimulation and did not affect temporal integration/segregation accuracy as expected. Although we found some preliminary evidence for an influence of tACS phase on temporal integration accuracy, the ongoing phase of mc-tACS oscillations did not reliably modulate temporal integration/segregation accuracy in a sinusoidal way as would have been predicted by an effective entrainment of brain oscillations. These findings may guide future studies using different stimulation montages for investigating the role of cortical alpha oscillations for human vision.

Perceptual inference employs intrinsic alpha frequency to resolve perceptual ambiguity

The brain uses its intrinsic dynamics to actively predict observed sensory inputs, especially under perceptual ambiguity. However, it remains unclear how this inference process is neurally implemented in biasing perception of ambiguous inputs towards the predicted percepts. The process of perceptual inference can be well illustrated by the phenomenon of bistable apparent motion in the Ternus display, in which subjective perception spontaneously alternates between element motion (EM) and group motion (GM) percepts depending on whether two consecutively presented frames are grouped over time or not. The frequency of alpha-band oscillations has long been hypothesized to gate the temporal window of perceptual grouping over time. Under this hypothesis, variation in the intrinsic alpha frequency should predict perceptual outcome of the bistable Ternus display. Moreover, we hypothesize that the perception system employs this prior knowledge on intrinsic alpha frequency to resolve perceptual ambiguity, by shifting perceptual inference towards the predicted percepts. Using electroencephalography and intracranial recordings, we showed that both between and within subjects, lower prestimulus alpha frequencies (PAFs) predicted the EM percepts since the two frames fell in the same alpha cycle and got temporally integrated, while higher PAFs predicted the GM percepts since the two frames fell in different alpha cycles. Multivariate decoding analysis between the EM percepts with lower PAFs and the GM percepts with higher PAFs further revealed a representation of the subsequently reported bistable percept in the neural signals shortly before the actual appearance of the second frame. Therefore, perceptual inference, based on variation in intrinsic PAFs, biases poststimulus neural representations by inducing preactivation of the predicted percepts. In addition, enhanced prestimulus blood-oxygen-level-dependent (BOLD) signals and network dynamics in the frontoparietal network, together with reduced prestimulus alpha power, upon perceiving the EM percepts suggest that temporal grouping is an attention-demanding process.