Modulation of auditory stimulus processing by visual spatial or temporal cue: an event-related potentials study

Attention to space and time: Independent or interactive systems? A narrative review

While there is ample evidence for the ability to selectively attend to where in space and when in time a relevant event might occur, it remains poorly understood whether spatial and temporal attention operate independently or interactively to optimize behavior. To elucidate this important issue, we provide a narrative review of the literature investigating the relationship between the two. The studies were organized based on the attentional manipulation employed (endogenous vs. exogenous) and the type of task (detection vs. discrimination). Although the reviewed findings depict a complex scenario, three aspects appear particularly important in promoting independent or interactive effects of spatial and temporal attention: task demands, attentional manipulation, and their combination. Overall, the present review provides key insights into the relationship between spatial and temporal attention and identifies some critical gaps that need to be addressed by future research.

Spatiotemporal and sensory modality attention processing with domain-specific representations in frontoparietal areas

The frontoparietal network (FPN), including bilateral frontal eye field, inferior parietal sulcus, and supplementary motor area, has been linked to attention processing, including spatiotemporal and sensory modality domains. However, it is unclear whether FPN encodes representations of these domains that are generalizable across subdomains. We decomposed multivariate patterns of functional magnetic resonance imaging activity from 20 participants into domain-specific components and identified latent multivariate representations that generalized across subdomains. The 30 experimental conditions were organized into unimodal-bimodal and spatial-temporal models. We found that brain areas in the FPN, form the primary network that modulated during attention across domains. However, the activation patterns of areas within the FPN were reorganized according to the specific attentional demand, especially when pay attention to different sensory, suggesting distinct regional neural representations associated with specific attentional processes within FPN. In addition, there were also other domain-specific areas outside the FPN, such as the dorsolateral prefrontal cortex. Our conclusion is that, according to the results of the analysis of representation similarity, 2 types of activated brain regions, related to attention domain detailed information processing and general information processing, can be revealed.

Processing of task-irrelevant sounds during typical everyday activities in children

Our ability to focus on a task and ignore task-irrelevant stimuli is critical for efficient cognitive functioning. Attention control is especially required in the auditory modality as sound has privileged access to perception and consciousness. Despite this important function, little is known about auditory attention during typical everyday activities in childhood. We investigated the impact of task-irrelevant sounds on attention during three everyday activities - playing a game, reading a book, watching a movie. During these activities, environmental novel sounds were presented within a sequence of standard sounds to 7-8-year-old children and adults. We measured ERPs reflecting early sound processing and attentional orienting and theta power evoked by standard and novel sounds during these activities. Playing a game versus reading or watching reduced early encoding of sounds in children and affected ongoing information processing and attention allocation in both groups. In adults, theta power was reduced during playing at mid-central brain areas. Results show a pattern of immature neuronal mechanisms underlying perception and attention of task-irrelevant sounds in 7-8-year-old children. While the type of activity affected the processing of irrelevant sounds in both groups, early stimulus encoding processes were more sensitive to the type of activities in children.

Endogenous Spatial Attention Modulates the Magnitude of the Colavita Visual Dominance Effect

The Colavita effect refers to the phenomenon wherein people tend to not respond to an auditory stimulus when a visual stimulus is simultaneously presented. Although previous studies have shown that endogenous modality attention influences the Colavita effect, whether the Colavita effect is influenced by endogenous spatial attention remains unknown. In the present study, we established endogenous spatial cues to investigate whether the size of the Colavita effect changes under visual or auditory cues. We measured three indexes to investigate the effect of endogenous spatial attention on the size of the Colavita effect. These three indexes were developed based on the following observations in bimodal trials: (a) The proportion of the "only vision" response was significantly higher than that of the "only audition" response; (b) the proportion of the "vision precedes audition" response was significantly higher than that of the "audition precedes vision" response; and (c) the reaction time difference of the "vision precedes audition" response was significantly higher than that of the "audition precedes vision" response. Our results showed that the Colavita effect was always influenced by endogenous spatial attention and that its size was larger at the cued location than at the uncued location; the cue modality (visual vs. auditory) had no effect on the size of the Colavita effect. Taken together, the present results shed light on how endogenous spatial attention affects the Colavita effect.

The Modulating Effect of Top-down Attention on the Optimal Pre-target Onset Oscillatory States of Bottom-up Attention

Research in both bottom-up and top-down attention has shown that behavioural performance is related to brain oscillations at the time of stimulus presentation: the angle of the theta phase in bottom-up attention and the inhibition of alpha oscillations in top-down attention. However, whether the conditions most favourable for bottom-up attention change with the addition of top-down cues is unclear. To explore the characteristics of favourable oscillations during bottom-up processing, in experiment 1, 36 participants completed a selective attention task (visual search) without cues. Then, in experiment 2, we examined whether favourable oscillatory characteristics were changed by top-down attentional cues; in this experiment, 62 subjects were asked to perform an attention network task. We found that without anticipation, oscillatory states that were associated with better performance were characterized by lower theta power in the frontal area, higher alpha power in the occipital area, higher beta power in the frontal area, and weaker gamma-theta amplitude-envelope coupling in the parietal area. However, some characteristics that were associated with better performance, including theta power and low beta power, were changed after the addition of different cues. In addition, there were some new characteristics related to improved performance under temporal and spatial anticipation. These results suggest that top-down attention implements a more energy-efficient strategy to process information, optimizing the process of bottom-up attention.

The interactions of multisensory integration with endogenous and exogenous attention

Stimuli from multiple sensory organs can be integrated into a coherent representation through multiple phases of multisensory processing; this phenomenon is called multisensory integration. Multisensory integration can interact with attention. Here, we propose a framework in which attention modulates multisensory processing in both endogenous (goal-driven) and exogenous (stimulus-driven) ways. Moreover, multisensory integration exerts not only bottom-up but also top-down control over attention. Specifically, we propose the following: (1) endogenous attentional selectivity acts on multiple levels of multisensory processing to determine the extent to which simultaneous stimuli from different modalities can be integrated; (2) integrated multisensory events exert top-down control on attentional capture via multisensory search templates that are stored in the brain; (3) integrated multisensory events can capture attention efficiently, even in quite complex circumstances, due to their increased salience compared to unimodal events and can thus improve search accuracy; and (4) within a multisensory object, endogenous attention can spread from one modality to another in an exogenous manner.

Independent effects of bottom-up temporal expectancy and top-down spatial attention. An audiovisual study using rhythmic cueing

Selective attention to a spatial location has shown enhanced perception and facilitate behavior for events at attended locations. However, selection relies not only on where but also when an event occurs. Recently, interest has turned to how intrinsic neural oscillations in the brain entrain to rhythms in our environment, and, stimuli appearing in or out of sync with a rhythm have shown to modulate perception and performance. Temporal expectations created by rhythms and spatial attention are two processes which have independently shown to affect stimulus processing but it remains largely unknown how, and if, they interact. In four separate tasks, this study investigated the effects of voluntary spatial attention and bottom-up temporal expectations created by rhythms in both unimodal and crossmodal conditions. In each task the participant used an informative cue, either color or pitch, to direct their covert spatial attention to the left or right, and respond as quickly as possible to a target. The lateralized target (visual or auditory) was then presented at the attended or unattended side. Importantly, although not task relevant, the cue was a rhythm of either flashes or beeps. The target was presented in or out of sync (early or late) with the rhythmic cue. Results showed participants were faster responding to spatially attended compared to unattended targets in all tasks. Moreover, there was an effect of rhythmic cueing upon response times in both unimodal and crossmodal conditions. Responses were faster to targets presented in sync with the rhythm compared to when they appeared too early in both crossmodal tasks. That is, rhythmic stimuli in one modality influenced the temporal expectancy in the other modality, suggesting temporal expectancies created by rhythms are crossmodal. Interestingly, there was no interaction between top-down spatial attention and rhythmic cueing in any task suggesting these two processes largely influenced behavior independently.