Temporal orienting of attention is interfered by concurrent working memory updating

Attention to space and time: Independent or interactive systems? A narrative review

While there is ample evidence for the ability to selectively attend to where in space and when in time a relevant event might occur, it remains poorly understood whether spatial and temporal attention operate independently or interactively to optimize behavior. To elucidate this important issue, we provide a narrative review of the literature investigating the relationship between the two. The studies were organized based on the attentional manipulation employed (endogenous vs. exogenous) and the type of task (detection vs. discrimination). Although the reviewed findings depict a complex scenario, three aspects appear particularly important in promoting independent or interactive effects of spatial and temporal attention: task demands, attentional manipulation, and their combination. Overall, the present review provides key insights into the relationship between spatial and temporal attention and identifies some critical gaps that need to be addressed by future research.

The effect of emotion counter-regulation to anger on working memory updating

Emotion counter-regulation has been suggested as the core cognitive mechanism of automatic emotion regulation. Emotion counter-regulation not only induces an unintentional transfer of attention from the current emotional state to stimuli with the opposite valence but also prompts approach to stimuli of the opposite valence and increases response inhibition to stimuli of the same valence. Working memory (WM) updating has been shown to be related to attention selection and response inhibition. However, it remains unclear whether emotion counter-regulation would affect WM updating with emotional stimuli. In the present study, 48 participants were recruited and randomly assigned to the angry-priming group that watched highly arousing angry video clips, or the control group that watched neutral video clips. Then participants performed a two-back face identity matching task with happy and angry face pictures. Behavioral results showed higher accuracy for identity recognition of happy than of angry faces. The event-related potential (ERP) results revealed smaller P2 to angry faces than to happy faces in the control group. In the angry-priming group, there was no difference in P2 amplitude between angry and happy trials. Between groups, P2 to angry faces was larger in the priming group than in the control group. Late positive potential (LPP) was smaller for happy faces than for angry faces in the priming group, but not in the control group. These findings suggest that emotion counter-regulation affects the onset updating and maintenance of emotional face stimuli in WM.

A transcranial magnetic stimulation study on the role of the left intraparietal sulcus in temporal orienting of attention

Adaptive behavior requires the ability to orient attention to the moment in time at which a relevant event is likely to occur. Temporal orienting of attention has been consistently associated with activation of the left intraparietal sulcus (IPS) in prior fMRI studies. However, a direct test of its causal involvement in temporal orienting is still lacking. The present study tackled this issue by transiently perturbing left IPS activity with either online (Experiment 1) or offline (Experiment 2) transcranial magnetic stimulation (TMS). In both experiments, participants performed a temporal orienting task, alternating between blocks in which a temporal cue predicted when a subsequent target would appear and blocks in which a neutral cue provided no information about target timing. In Experiment 1 we used an online TMS protocol, aiming to interfere specifically with cue-related temporal processes, whereas in Experiment 2 we employed an offline protocol whereby participants performed the temporal orienting task before and after receiving TMS. The right IPS and/or the vertex were stimulated as active control regions. While results replicated the canonical pattern of temporal orienting effects on reaction time, with faster responses for temporal than neutral trials, these effects were not modulated by TMS over the left IPS (as compared to the right IPS and/or vertex regions) regardless of the online or offline protocol used. Overall, these findings challenge the causal role of the left IPS in temporal orienting of attention inviting further research on its underlying neural substrates.

Temporal Expectations Prepare Visual Working Memory for Behavior

Working memory enables us to retain past sensations in service of anticipated task demands. How we prepare for anticipated task demands during working memory retention remains poorly understood. Here, we focused on the role of time—asking how temporal expectations help prepare for ensuing memory-guided behavior. We manipulated the expected probe time in a delayed change-detection task and report that temporal expectation can have a profound influence on memory-guided behavioral performance. EEG measurements corroborated the utilization of temporal expectations: demonstrating the involvement of a classic EEG signature of temporal expectation—the contingent negative variation—in the context of working memory. We also report the influence of temporal expectations on 2 EEG signatures associated with visual working memory—the lateralization of 8- to 12-Hz alpha activity, and the contralateral delay activity. We observed a dissociation between these signatures, whereby alpha lateralization (but not the contralateral delay activity) adapted to the time of expected memory utilization. These data show how temporal expectations prepare visual working memory for behavior and shed new light on the electrophysiological markers of both temporal expectation and working memory.

Temporal attention is not affected by working memory load

Temporal attention refers to the ability to orient attention in time, which serves to enhance performance such as target detection and discrimination and is a fundamental component of cognitive function. Although some research indicates that temporal attention ability is affected by working memory updating, it is unclear whether temporal attention is also affected by the availability of working memory stores. To address this, participants were presented a dual-task paradigm requiring zero, three, or six digits to be held in working memory while engaged in a temporally cued visual discrimination task. Results show that working memory load did not differentially affect the ability to benefit from predictive temporal cues during the visual discrimination task. This indicates that temporal attention is not affected by available working memory stores. Interestingly, posterior beta band (12-30 Hz) activity was differentially modulated by temporal attention and working memory load, such that it decreased prior to expected targets and increased with load. Analysis across participants indicated that those individuals who exhibited greater temporal attention-based modulation of beta activity (i.e., predictive < neutrally cued) displayed improved discrimination performance, but also yielded lowered working memory accuracy. Thus, the ability to benefit from temporal attention processes while multitasking comes at the cost of lowered secondary task performance. Together, these results indicate that available working memory stores do not affect temporal attention ability. Rather, limitations in divided attention ability result in a performance cost that prioritizes one task over another, which may be indexed by beta band activity.

The role of premature evidence accumulation in making difficult perceptual decisions under temporal uncertainty

The computations and neural processes underpinning decision making have primarily been investigated using highly simplified tasks in which stimulus onsets cue observers to start accumulating choice-relevant information. Yet, in daily life we are rarely afforded the luxury of knowing precisely when choice-relevant information will appear. Here, we examined neural indices of decision formation while subjects discriminated subtle stimulus feature changes whose timing relative to stimulus onset ('foreperiod') was uncertain. Joint analysis of behavioural error patterns and neural decision signal dynamics indicated that subjects systematically began the accumulation process before any informative evidence was presented, and further, that accumulation onset timing varied systematically as a function of the foreperiod of the preceding trial. These results suggest that the brain can adjust to temporal uncertainty by strategically modulating accumulation onset timing according to statistical regularities in the temporal structure of the sensory environment with particular emphasis on recent experience.

Multiple phases of cross-sensory interactions associated with the audiovisual bounce-inducing effect

Using event-related potential (ERP) recordings, the present study investigated the cross-modal neural activities underlying the audiovisual bounce-inducing effect (ABE) via a novel experimental design wherein the audiovisual bouncing trials were induced solely by the ABE. The within-subject (percept-based) analysis showed that early cross-modal interactions within 100-200 ms after sound onset over fronto-central and occipital regions were associated with the occurrence of the ABE, but the cross-modal interaction at a later latency (ND250, 220-280 ms) over fronto-central region did not differ between ABE trials and non-ABE trials. The between-subject analysis indicated that the cross-modal interaction revealed by ND250 was larger for subjects who perceived the ABE more frequently. These findings suggest that the ABE is generated as a consequence of the rapid interplay between the variations of early cross-modal interactions and the general multisensory binding predisposition at an individual level.

Monitoring prediction errors facilitates cognition in action

Cognition in action requires strategic allocation of attention between internal processes and the sensory environment. We hypothesized that this resource allocation could be facilitated by mechanisms that predict sensory results of self-generated actions. Sensory signals conforming to predictions would be safely ignored to facilitate focus on internally generated content, whereas those violating predictions would draw attention for additional scrutiny. During a visual-verbal serial digit-recall task, we varied the temporal relationship between task-irrelevant keypresses and auditory distractors so that the distractors were either temporally coupled or decoupled with keypresses. Consistent with our hypothesis, distractors were more likely to interfere with target maintenance and intrude into working memory when they were decoupled from keypresses, thereby violating action-based sensory predictions. Interference was maximal when sounds preceded keypresses, suggesting that stimuli were most distracting when their timing was inconsistent with expected action-sensation contingencies. In a follow-up experiment, neither auditory nor visual cues to distractor timing produced similar effects, suggesting a unique action-based mechanism. These results suggest that action-based sensory predictions are used to dynamically optimize attentional allocation during cognition in action. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Phasic and sustained interactions of multisensory interplay and temporal expectation

Every moment organisms are confronted with complex streams of information which they use to generate a reliable mental model of the world. There is converging evidence for several optimization mechanisms instrumental in integrating (or segregating) incoming information; among them are multisensory interplay (MSI) and temporal expectation (TE). Both mechanisms can account for enhanced perceptual sensitivity and are well studied in isolation; how these two mechanisms interact is currently less well-known. Here, we tested in a series of four psychophysical experiments for TE effects in uni- and multisensory contexts with different levels of modality-related and spatial uncertainty. We found that TE enhanced perceptual sensitivity for the multisensory relative to the best unisensory condition (i.e. multisensory facilitation according to the max-criterion). In the latter TE effects even vanished if stimulus-related spatial uncertainty was increased. Accordingly, computational modelling indicated that TE, modality-related and spatial uncertainty predict multisensory facilitation. Finally, the analysis of stimulus history revealed that matching expectation at trial n-1 selectively improves multisensory performance irrespective of stimulus-related uncertainty. Together, our results indicate that benefits of multisensory stimulation are enhanced by TE especially in noisy environments, which allows for more robust information extraction to boost performance on both short and sustained time ranges.

Cross-frequency Phase–Amplitude Coupling as a Mechanism for Temporal Orienting of Attention in Childhood

Temporal orienting of attention operates by biasing the allocation of cognitive and motor resources in specific moments in time, resulting in the improved processing of information from expected compared with unexpected targets. Recent findings have shown that temporal orienting operates relatively early across development, suggesting that this attentional mechanism plays a core role for human cognition. However, the exact neurophysiological mechanisms allowing children to attune their attention over time are not well understood. In this study, we presented 8- to 12-year-old children with a temporal cueing task designed to test (1) whether anticipatory oscillatory dynamics predict children's behavioral performance on a trial-by-trial basis and (2) whether anticipatory oscillatory neural activity may be supported by cross-frequency phase–amplitude coupling as previously shown in adults. Crucially, we found that, similar to what has been reported in adults, children's ongoing beta rhythm was strongly coupled with their theta rhythm and that the strength of this coupling distinguished validly cued temporal intervals, relative to neutral cued trials. In addition, in long trials, there was an inverse correlation between oscillatory beta power and children's trial-by-trial reaction, consistent with oscillatory beta power reflecting better response preparation. These findings provide the first experimental evidence that temporal attention in children operates by exploiting oscillatory mechanism.

Spatiotemporal neurodynamics of automatic temporal expectancy in 9-month old infants

Anticipating events occurrence (Temporal Expectancy) is a crucial capacity for survival. Yet, there is little evidence about the presence of cortical anticipatory activity from infancy. In this study we recorded the High-density electrophysiological activity in 9 month-old infants and adults undergoing an audio-visual S1–S2 paradigm simulating a lifelike “Peekaboo” game inducing automatic temporal expectancy of smiling faces. The results indicate in the S2-preceding Contingent Negative Variation (CNV) an early electrophysiological signature of expectancy-based anticipatory cortical activity. Moreover, the progressive CNV amplitude increasing across the task suggested that implicit temporal rule learning is at the basis of expectancy building-up over time. Cortical source reconstruction suggested a common CNV generator between adults and infants in the right prefrontal cortex. The decrease in the activity of this area across the task (time-on-task effect) further implied an early, core role of this region in implicit temporal rule learning. By contrast, a time-on-task activity boost was found in the supplementary motor area (SMA) in adults and in the temporoparietal regions in infants. Altogether, our findings suggest that the capacity of the human brain to translate temporal predictions into anticipatory neural activity emerges ontogenetically early, although the underlying spatiotemporal cortical dynamics change across development.

Temporal orienting of attention can be preserved in normal aging

Being able to orient our attention to moments in time is crucial for optimizing behavioral performance. In young adults, flexible cue-based temporal expectations have been shown to modulate perceptual functions and enhance behavioral performance. Recent studies with older individuals have reported significant deficits in cued temporal orienting. To investigate the extent of these deficits, the authors conducted 3 studies in healthy old and young adults. For each study, participants completed 2 tasks: a reaction time (RT) task that emphasized speeded responding and a nonspeeded rapid-serial-visual-presentation task that emphasized visual discrimination. Auditory cues indicated the likelihood of a target item occurring after a short or long temporal interval (foreperiod; 75% validity). In the first study, cues indicating a short or a long foreperiod were manipulated across blocks. The second study was designed to replicate and extend the first study by manipulating the predictive temporal cues on a trial-by-trial basis. The third study extended the findings by including neutral cues so that it was possible to separate cueing validity benefits and invalidity costs. In all 3 studies, cued temporal expectation conferred significant performance advantages for target stimuli occurring after the short foreperiod for both old and young participants. Contrary to previous findings, these results suggest that the ability to allocate attention to moments in time can be preserved in healthy aging. Further research is needed to ascertain whether similar neural networks are used to orient attention in time as we age, and/or whether compensatory mechanisms are at work in older individuals. (PsycINFO Database Record

Spatiotemporally dissociable neural signatures for generating and updating expectation over time in children: A High Density-ERP study

•

8–12-year-old children can generate and update expectancy over time.

•

Cue- and SOA-related ERPs reflect expectancy generation and updating, respectively.

•

Only cue-related ERPs are correlated with age.

•

Distinct cortical networks underlie cue- and SOA-related ERP effects.

•

The neural bases of temporal expectation only partially differ in children and adults.

Temporal orienting (TO) is the allocation of attentional resources in time based on the a priori generation of temporal expectancy of relevant stimuli as well as the a posteriori updating of this expectancy as a function of both sensory-based evidence and elapsing time. These processes rely on dissociable cognitive mechanisms and neural networks. Yet, although there is evidence that TO may be a core mechanism for cognitive functioning in childhood, the developmental spatiotemporal neural dynamics of this mechanism are little understood. In this study we employed a combined approach based on the application of distributed source reconstruction on a high spatial resolution ERP data array obtained from eighteen 8- to 12-year-old children completing a TO paradigm in which both the cue (Temporal vs. Neutral) and the SOA (Short vs. Long) were manipulated. Results show both cue (N1) and SOA (CNV, Omission Detection Potential and Anterior Anticipatory Index) ERP effects, which were associated with expectancy generation and updating, respectively. Only cue-related effects were correlated with age, as revealed by a reduction of the N1 delta effect with increasing age. Our data suggest that the neural correlates underlying TO are already established at least from 8 to 12 years of age.

Developmental Trajectories of Internally and Externally Driven Temporal Prediction

The ability to generate temporal prediction (TP) is fundamental to our survival since it allows us to selectively orient our attention in time in order to prioritize relevant environmental information. Studies on adult participants showed that externally and internally driven mechanisms can be engaged to establish TP, both resulting in better behavioural performance. However, few studies on children have investigated the ability to engage internally and externally driven TP, especially in relation to how these mechanisms change across development. In this study, 111 participants (88 children between six and eleven years of age, and 23 adults) were tested by means of a simple reaction time paradigm, in which temporal cueing and neutral conditions were orthogonally manipulated to induce externally and internally driven TP mechanisms, as well as an interaction between the two. Sequential effects (SEs) relative to both tasks were also investigated. Results showed that all children participating in the study were able to implement both external and internal TP in an independent fashion. However, children younger than eight years were not able to combine both strategies. Furthermore, in the temporal cueing blocks they did not show the typically-observed asymmetric SE pattern. These results suggest that children can flexibly use both external and internal TP mechanisms to optimise their behaviour, although their successful combined use develops only after eight years of age.

Spatiotemporal Neurodynamics Underlying Internally and Externally Driven Temporal Prediction: A High Spatial Resolution ERP Study

Temporal prediction (TP) is a flexible and dynamic cognitive ability. Depending on the internal or external nature of information exploited to generate TP, distinct cognitive and brain mechanisms are engaged with the same final goal of reducing uncertainty about the future. In this study, we investigated the specific brain mechanisms involved in internally and externally driven TP. To this end, we employed an experimental paradigm purposely designed to elicit and compare externally and internally driven TP and a combined approach based on the application of a distributed source reconstruction modeling on a high spatial resolution electrophysiological data array. Specific spatiotemporal ERP signatures were identified, with significant modulation of contingent negative variation and frontal late sustained positivity in external and internal TP contexts, respectively. These different electrophysiological patterns were supported by the engagement of distinct neural networks, including a left sensorimotor and a prefrontal circuit for externally and internally driven TP, respectively.

Automatic Bias of Temporal Expectations following Temporally Regular Input Independently of High-level Temporal Expectation

Exposure to rhythmic stimulation results in facilitated responses to events that appear in-phase with the rhythm and modulation of anticipatory and target-evoked brain activity, presumably reflecting “exogenous,” unintentional temporal expectations. However, the extent to which this effect is independent from intentional processes is not clear. In two EEG experiments, we isolated the unintentional component of this effect from high-level, intentional factors. Visual targets were presented either in-phase or out-of-phase with regularly flickering colored stimuli. In different blocks, the rhythm could be predictive (i.e., high probability for in-phase target) or not, and the color could be predictive (i.e., validly cue the interval to the target) or not. Exposure to nonpredictive rhythms resulted in faster responses for in-phase targets, even when the color predicted specific out-of-phase target times. Also, the contingent negative variation, an EEG component reflecting temporal anticipation, followed the interval of the nonpredictive rhythm and not that of the predictive color. Thus, rhythmic stimulation unintentionally induced expectations, even when this was detrimental. Intentional usage of predictive rhythms to form expectations resulted in a stronger behavioral effect, and only predictive cues modulated the latency of the target-evoked P3, presumably reflecting stimulus evaluation. These findings establish the existence of unintentional temporal expectations in rhythmic contexts, dissociate them from intentional expectations, and highlight the need to distinguish between the source of expectation (exogenous–endogenous) and the level of voluntary control involved in it (unintentional–intentional).

The effects of incidentally learned temporal and spatial predictability on response times and visual fixations during target detection and discrimination

Responses are quicker to predictable stimuli than if the time and place of appearance is uncertain. Studies that manipulate target predictability often involve overt cues to speed up response times. However, less is known about whether individuals will exhibit faster response times when target predictability is embedded within the inter-trial relationships. The current research examined the combined effects of spatial and temporal target predictability on reaction time (RT) and allocation of overt attention in a sustained attention task. Participants responded as quickly as possible to stimuli while their RT and eye movements were measured. Target temporal and spatial predictability were manipulated by altering the number of: 1) different time intervals between a response and the next target; and 2) possible spatial locations of the target. The effects of target predictability on target detection (Experiment 1) and target discrimination (Experiment 2) were tested. For both experiments, shorter RTs as target predictability increased across both space and time were found. In addition, the influences of spatial and temporal target predictability on RT and the overt allocation of attention were task dependent; suggesting that effective orienting of attention relies on both spatial and temporal predictability. These results indicate that stimulus predictability can be increased without overt cues and detected purely through inter-trial relationships over the course of repeated stimulus presentations.