Combining spatial and temporal expectations to improve visual perception

Gazing into spatiotemporal 'known unknowns': the influence of uncertainty on pupil size and saccadic eye movements

Expectation of a future stimulus increases the preparedness to act once it actually appears and results in reduced latency of the appropriate motor response. Real world events are uncertain both spatially and/or temporally but this uncertainty could itself be expected. In the presence of both expected spatial and temporal uncertainty, which one should be prioritized by the motor system could depend on the context. Therefore, we investigated the relative weight of expected spatial and temporal uncertainty during the preparation of a saccadic eye movement. A reaction time task was used with a variable foreperiod between a warning and an imperative visual stimuli. Expected temporal and/or spatial uncertainty associated with the stimulus was cued. We found that before imperative stimulus onset, pupil dilation increased with expected temporal uncertainty but was unaltered by spatial uncertainty. After imperative stimulus onset, both types of expected uncertainty affected saccade latency. Maximum eye velocity was modulated by expected spatial uncertainty only. In conclusion, expected temporal and spatial uncertainty do not have the same impact on preparation and execution of a motor response. There could be a prioritization of the relevant information as a function of the evolving expected uncertainty context during the task.

Eyes on the past: Gaze stability differs between temporal expectation and temporal attention

Temporal expectation and temporal attention distinctly improve performance and gaze stability, and interact at the behavioral and neural levels. Foreperiod-the interval between the preparatory signal and stimulus onset-facilitates temporal expectation. Preceding foreperiod-the foreperiod in the previous trial-modulates expectation at behavioral and oculomotor levels. Here, we investigated whether preceding foreperiod guides temporal attention. Regardless of the preceding foreperiod, temporal attention improved performance, particularly at early moments,and consistently accelerated gaze stability onset and offset by shifting microsaccade timing. However, only with preceding expected foreperiods, attention inhibited microsaccade rates. Moreover, preceding late foreperiods weakened expectation effects on microsaccade rates, but such a weakening was overridden by attention. Altogether, these findings reveal that the oculomotor system's flexibility does not translate to performance, and suggest that although selection history can be utilized as one of the sources of expectation in subsequent trials, it does not necessarily determine, strengthen, or guide attentional deployment.

Enhancing rhythmic temporal expectations: The dominance of auditory modality under spatial uncertainty

To effectively process the most relevant information, the brain anticipates the optimal timing for allocating attentional resources. Behavior can be optimized by automatically aligning attention with external rhythmic structures, whether visual or auditory. Although the auditory modality is known for its efficacy in representing temporal information, the current body of research has not conclusively determined whether visual or auditory rhythmic presentations have a definitive advantage in entraining temporal attention. The present study directly examined the effects of auditory and visual rhythmic cues on the discrimination of visual targets in Experiment 1 and on auditory targets in Experiment 2. Additionally, the role of endogenous spatial attention was also considered. When and where the target was the most likely to occur were cued by unimodal (visual or auditory) and bimodal (audiovisual) signals. A sequence of salient events was employed to elicit rhythm-based temporal expectations and a symbolic predictive cue served to orient spatial attention. The results suggest a superiority of auditory over visual rhythms, irrespective of spatial attention, whether the spatial cue and rhythm converge or not (unimodal or bimodal), and regardless of the target modality (visual or auditory). These findings are discussed in terms of a modality-specific rhythmic orienting, while considering a single, supramodal system operating in a top-down manner for endogenous spatial attention.

Dynamic alpha power modulations and slow negative potentials track natural shifts of spatio-temporal attention

Alpha power modulations and slow negative potentials have previously been associated with anticipatory processes in spatial and temporal top-down attention. In typical experimental designs, however, neural responses triggered by transient stimulus onsets can interfere with attention-driven activity patterns and our interpretation of such. Here, we investigated these signatures of spatio-temporal attention in a dynamic paradigm free from potentially confounding stimulus-driven activity using electroencephalography. Participants attended the cued side of a bilateral stimulus rotation and mentally counted how often one of two remembered sample orientations (i.e., the target) was displayed while ignoring the uncued side and non-target orientation. Afterwards, participants performed a delayed match-to-sample task, in which they indicated if the orientation of a probe stimulus matched the corresponding sample orientation (previously target or non-target). We observed dynamic alpha power reductions and slow negative waves around task-relevant points in space and time (i.e., onset of the target orientation in the cued hemifield) over posterior electrodes contralateral to the locus of attention. In contrast to static alpha power lateralization, these dynamic signatures correlated with subsequent memory performance (primarily detriments for matching probes of the non-target orientation), suggesting a preferential allocation of attention to task-relevant locations and time points at the expense of reduced resources and impaired performance for information outside the current focus of attention. Our findings suggest that humans can naturally and dynamically focus their attention at relevant points in space and time and that such spatio-temporal attention shifts can be reflected by dynamic alpha power modulations and slow negative potentials.

Goal-Dependent Use of Temporal Regularities to Orient Attention under Spatial and Action Uncertainty

The temporal regularities in our environments support the proactive dynamic anticipation of relevant events. In visual attention, one important outstanding question is whether temporal predictions must be linked to predictions about spatial locations or motor plans to facilitate behaviour. To test this, we developed a task for manipulating temporal expectations and task relevance of visual stimuli appearing within rapidly presented streams, while stimulus location and responding hand remained uncertain. Differently coloured stimuli appeared in one of two concurrent (left and right) streams with distinct temporal probability structures. Targets were defined by colour on a trial-by-trial basis and appeared equiprobably in either stream, requiring a localisation response. Across two experiments, participants were faster and more accurate at detecting temporally predictable targets compared to temporally unpredictable targets. We conclude that temporal expectations learned incidentally from temporal regularities can be called upon flexibly in a goal-driven manner to guide behaviour. Moreover, we show that visual temporal attention can facilitate performance in the absence of concomitant spatial or motor expectations in dynamically unfolding contexts.

Task demand mediates the interaction of spatial and temporal attention

Psychophysical studies typically test attentional mechanisms in isolation, but in everyday life they interact to optimize human behavior. We investigated whether spatial and temporal attention interact in two orientation discrimination experiments that vary in task demand. We manipulated temporal and spatial attention separately and conjointly with well-established methods for testing each spatial or temporal attention. We assessed sensitivity (d') and reaction time for every combination of spatial and timing cues, each of which was valid, neutral, or invalid. Spatial attention modulated sensitivity (d') and speed (reaction time) across temporal attention conditions. Temporal attention modulated sensitivity and speed under high- but not low- task demands. Furthermore, spatial and temporal attention interacted for the high-demand task. This study reveals that task demand matters; in a simple task spatial attention suffices to improve performance, whereas in a more demanding task both spatial and temporal attention interact to boost performance, albeit in a subadditive fashion.

An event-termination cue causes perceived time to dilate

The perceived duration of time does not veridically reflect the physical duration but is distorted by various factors, such as the stimulus magnitude or the observer's emotional state. Here, we showed that knowledge about an event's termination time is another significant factor. We often experience time passage differently when we know that an event will terminate soon. To quantify this, we asked 33 university students to report a rotating clock hand's duration with or without a termination cue that indicated the position at which the clock hand disappeared. The results showed that the presence of the termination cue dilated perceived durations, and the dilating effect was larger when the stimulus duration was longer, or the speed of the rotating stimulus was slower. A control experiment with a start-cue excluded the possibility that the cue's mere existence caused the results. Further computational analyses based on the attention theory-of-time perception revealed that the size of dilation is best explained by neither an event's duration nor the distance traveled by the clock hand, but by how long the clock hand spends time near the termination cue. The results imply that an event-termination cue generates a field in which the perceived time dilates.

Time for What? Dissociating Explicit Timing Tasks through Electrophysiological Signatures

Estimating durations between hundreds of milliseconds and seconds is essential for several daily tasks. Explicit timing tasks, which require participants to estimate durations to make a comparison (time for perception) or to reproduce them (time for action), are often used to investigate psychological and neural timing mechanisms. Recent studies have proposed that mechanisms may depend on specific task requirements. In this study, we conducted electroencephalogram (EEG) recordings on human participants as they estimated intervals in different task contexts to investigate the extent to which timing mechanisms depend on the nature of the task. We compared the neural processing of identical visual reference stimuli in two different tasks, in which stimulus durations were either perceptually compared or motorically reproduced in separate experimental blocks. Using multivariate pattern analyses, we could successfully decode the duration and the task of reference stimuli. We found evidence for both overlapping timing mechanisms across tasks as well as recruitment of task-dependent processes for comparing intervals for different purposes. Our findings suggest both core and specialized timing functions are recruited to support explicit timing tasks.

Null effects of temporal prediction on recognition memory but evidence for differential neural activity at encoding. A registered report

Previous research has demonstrated that rhythmic presentation of stimuli during encoding boosts subsequent recognition and is associated with distinct neural activity compared with when stimuli are presented in an arrhythmic manner. However, it is unclear whether the effect is driven by automatic entrainment to rhythm or non-rhythmic temporal prediction. This registered report presents an Electroencephalographic (EEG) study aimed at establishing the cognitive and neural mechanisms of the effect of temporal prediction on recognition. In a blocked design, stimulus onset during encoding was systematically manipulated in four conditions prior to recognition testing: rhythmic fixed (RF), rhythmic variable (RV), arrhythmic fixed (AF), and arrhythmic variable (AV). By orthogonally varying rhythm and temporal position we were able to assess their independent contributions to recognition enhancement. Our behavioural results did not replicate previous findings that show a difference in recognition memory based on temporal predictability at encoding. However, event-related potential (ERP) component analysis did show an early (N1) interaction effect of temporal position and rhythm, and later (N2 and Dm) effects driven by temporal position only. Taken together, we observed effects of temporal prediction at encoding, but these differences did not translate to later effects of memory, suggesting that effects of temporal prediction on recognition are less robust than previously thought.

Attention to space and time: Independent or interactive systems? A narrative review

While there is ample evidence for the ability to selectively attend to where in space and when in time a relevant event might occur, it remains poorly understood whether spatial and temporal attention operate independently or interactively to optimize behavior. To elucidate this important issue, we provide a narrative review of the literature investigating the relationship between the two. The studies were organized based on the attentional manipulation employed (endogenous vs. exogenous) and the type of task (detection vs. discrimination). Although the reviewed findings depict a complex scenario, three aspects appear particularly important in promoting independent or interactive effects of spatial and temporal attention: task demands, attentional manipulation, and their combination. Overall, the present review provides key insights into the relationship between spatial and temporal attention and identifies some critical gaps that need to be addressed by future research.

Dynamic models for musical rhythm perception and coordination

Rhythmicity permeates large parts of human experience. Humans generate various motor and brain rhythms spanning a range of frequencies. We also experience and synchronize to externally imposed rhythmicity, for example from music and song or from the 24-h light-dark cycles of the sun. In the context of music, humans have the ability to perceive, generate, and anticipate rhythmic structures, for example, "the beat." Experimental and behavioral studies offer clues about the biophysical and neural mechanisms that underlie our rhythmic abilities, and about different brain areas that are involved but many open questions remain. In this paper, we review several theoretical and computational approaches, each centered at different levels of description, that address specific aspects of musical rhythmic generation, perception, attention, perception-action coordination, and learning. We survey methods and results from applications of dynamical systems theory, neuro-mechanistic modeling, and Bayesian inference. Some frameworks rely on synchronization of intrinsic brain rhythms that span the relevant frequency range; some formulations involve real-time adaptation schemes for error-correction to align the phase and frequency of a dedicated circuit; others involve learning and dynamically adjusting expectations to make rhythm tracking predictions. Each of the approaches, while initially designed to answer specific questions, offers the possibility of being integrated into a larger framework that provides insights into our ability to perceive and generate rhythmic patterns.

A transcranial magnetic stimulation study on the role of the left intraparietal sulcus in temporal orienting of attention

Adaptive behavior requires the ability to orient attention to the moment in time at which a relevant event is likely to occur. Temporal orienting of attention has been consistently associated with activation of the left intraparietal sulcus (IPS) in prior fMRI studies. However, a direct test of its causal involvement in temporal orienting is still lacking. The present study tackled this issue by transiently perturbing left IPS activity with either online (Experiment 1) or offline (Experiment 2) transcranial magnetic stimulation (TMS). In both experiments, participants performed a temporal orienting task, alternating between blocks in which a temporal cue predicted when a subsequent target would appear and blocks in which a neutral cue provided no information about target timing. In Experiment 1 we used an online TMS protocol, aiming to interfere specifically with cue-related temporal processes, whereas in Experiment 2 we employed an offline protocol whereby participants performed the temporal orienting task before and after receiving TMS. The right IPS and/or the vertex were stimulated as active control regions. While results replicated the canonical pattern of temporal orienting effects on reaction time, with faster responses for temporal than neutral trials, these effects were not modulated by TMS over the left IPS (as compared to the right IPS and/or vertex regions) regardless of the online or offline protocol used. Overall, these findings challenge the causal role of the left IPS in temporal orienting of attention inviting further research on its underlying neural substrates.

Where and when matter in visual recognition

Our perceptual system processes only a selected subset of an incoming stream of stimuli due to sensory biases and limitations in spatial and temporal attention and working memory capacity. In this study, we investigated perceptual access to sensory information that was temporally predictable or unpredictable and spread across the visual field. In a visual recognition task, participants were presented with an array of different number of alphabetical stimuli that were followed by a probe with a delay. They had to indicate whether the probe was included in the stimulus-set or not. To test the impact of temporal attention, coloured cues that were displayed before the visual stimuli indicated the presentation onset of the stimulus-set. We found that temporal predictability of stimulus onset yields higher performance. In addition, recognition performance was biased across the visual field with higher performance for stimuli that were presented on the upper and right visual quadrants. Our findings demonstrate that recognition accuracy is enhanced by temporal cues and has an inherently asymmetric shape across the visual field.

Spatiotemporal and sensory modality attention processing with domain-specific representations in frontoparietal areas

The frontoparietal network (FPN), including bilateral frontal eye field, inferior parietal sulcus, and supplementary motor area, has been linked to attention processing, including spatiotemporal and sensory modality domains. However, it is unclear whether FPN encodes representations of these domains that are generalizable across subdomains. We decomposed multivariate patterns of functional magnetic resonance imaging activity from 20 participants into domain-specific components and identified latent multivariate representations that generalized across subdomains. The 30 experimental conditions were organized into unimodal-bimodal and spatial-temporal models. We found that brain areas in the FPN, form the primary network that modulated during attention across domains. However, the activation patterns of areas within the FPN were reorganized according to the specific attentional demand, especially when pay attention to different sensory, suggesting distinct regional neural representations associated with specific attentional processes within FPN. In addition, there were also other domain-specific areas outside the FPN, such as the dorsolateral prefrontal cortex. Our conclusion is that, according to the results of the analysis of representation similarity, 2 types of activated brain regions, related to attention domain detailed information processing and general information processing, can be revealed.

No behavioural evidence for rhythmic facilitation of perceptual discrimination

It has been hypothesized that internal oscillations can synchronize (i.e., entrain) to external environmental rhythms, thereby facilitating perception and behaviour. To date, evidence for the link between the phase of neural oscillations and behaviour has been scarce and contradictory; moreover, it remains an open question whether the brain can use this tentative mechanism for active temporal prediction. In our present study, we conducted a series of auditory pitch discrimination tasks with 181 healthy participants in an effort to shed light on the proposed behavioural benefits of rhythmic cueing and entrainment. In the three versions of our task, we observed no perceptual benefit of purported entrainment: targets occurring in-phase with a rhythmic cue provided no perceptual benefits in terms of discrimination accuracy or reaction time when compared with targets occurring out-of-phase or targets occurring randomly, nor did we find performance differences for targets preceded by rhythmic versus random cues. However, we found a surprising effect of cueing frequency on reaction time, in which participants showed faster responses to cue rhythms presented at higher frequencies. We therefore provide no evidence of entrainment, but instead a tentative effect of covert active sensing in which a faster external rhythm leads to a faster communication rate between motor and sensory cortices, allowing for sensory inputs to be sampled earlier in time.

No behavioural evidence for rhythmic facilitation of perceptual discrimination

It has been hypothesized that internal oscillations can synchronize (i.e., entrain) to external environmental rhythms, thereby facilitating perception and behaviour. To date, evidence for the link between the phase of neural oscillations and behaviour has been scarce and contradictory; moreover, it remains an open question whether the brain can use this tentative mechanism for active temporal prediction. In our present study, we conducted a series of auditory pitch discrimination tasks with 181 healthy participants in an effort to shed light on the proposed behavioural benefits of rhythmic cueing and entrainment. In the three versions of our task, we observed no perceptual benefit of purported entrainment: targets occurring in-phase with a rhythmic cue provided no perceptual benefits in terms of discrimination accuracy or reaction time when compared with targets occurring out-of-phase or targets occurring randomly, nor did we find performance differences for targets preceded by rhythmic versus random cues. However, we found a surprising effect of cueing frequency on reaction time, in which participants showed faster responses to cue rhythms presented at higher frequencies. We therefore provide no evidence of entrainment, but instead a tentative effect of covert active sensing in which a faster external rhythm leads to a faster communication rate between motor and sensory cortices, allowing for sensory inputs to be sampled earlier in time.

Temporal Expectation Improves Recognition Memory for Spatially Attended Objects

Recent evidence suggests that temporal expectation is beneficial to memory formation. Rhythmic presentation of stimuli during encoding enhances subsequent recognition and is associated with distinct neural activity compared with when stimuli are presented in an arrhythmic manner. However, no prior study has examined how temporal expectation interacts with another important form of facilitation-spatial attention-to affect memory. This study systematically manipulated temporal expectation and spatial attention during encoding to examine their combined effect on behavioral recognition and associated ERPs. Participants performed eight experimental blocks consisting of an encoding phase and recognition test, with EEG recorded throughout. During encoding, pairs of objects and checkerboards were presented and participants were cued to attend to the left or right stream and detect targets as quickly as possible. In four blocks, stimulus presentation followed a rhythmic (constant, predictable) temporal structure, and in the other four blocks, stimulus onset was arrhythmic (random, unpredictable). An interaction between temporal expectation and spatial attention emerged, with greater recognition in the rhythmic than the arrhythmic condition for spatially attended items. Analysis of memory-specific ERP components uncovered effects of spatial attention. There were late positive component and FN400 old/new effects in the attended condition for both rhythmic and arrhythmic items, whereas in the unattended condition, there was an FN400 old/new effect and no late positive component effect. The study provides new evidence that memory improvement as a function of temporal expectation is dependent upon spatial attention.

Towards understanding how we pay attention in naturalistic visual search settings

Research on attentional control has largely focused on single senses and the importance of behavioural goals in controlling attention. However, everyday situations are multisensory and contain regularities, both likely influencing attention. We investigated how visual attentional capture is simultaneously impacted by top-down goals, the multisensory nature of stimuli, and the contextual factors of stimuli's semantic relationship and temporal predictability. Participants performed a multisensory version of the Folk et al. (1992) spatial cueing paradigm, searching for a target of a predefined colour (e.g. a red bar) within an array preceded by a distractor. We manipulated: 1) stimuli's goal-relevance via distractor's colour (matching vs. mismatching the target), 2) stimuli's multisensory nature (colour distractors appearing alone vs. with tones), 3) the relationship between the distractor sound and colour (arbitrary vs. semantically congruent) and 4) the temporal predictability of distractor onset. Reaction-time spatial cueing served as a behavioural measure of attentional selection. We also recorded 129-channel event-related potentials (ERPs), analysing the distractor-elicited N2pc component both canonically and using a multivariate electrical neuroimaging framework. Behaviourally, arbitrary target-matching distractors captured attention more strongly than semantically congruent ones, with no evidence for context modulating multisensory enhancements of capture. Notably, electrical neuroimaging of surface-level EEG analyses revealed context-based influences on attention to both visual and multisensory distractors, in how strongly they activated the brain and type of activated brain networks. For both processes, the context-driven brain response modulations occurred long before the N2pc time-window, with topographic (network-based) modulations at ∼30 ms, followed by strength-based modulations at ∼100 ms post-distractor onset. Our results reveal that both stimulus meaning and predictability modulate attentional selection, and they interact while doing so. Meaning, in addition to temporal predictability, is thus a second source of contextual information facilitating goal-directed behaviour. More broadly, in everyday situations, attention is controlled by an interplay between one's goals, stimuli's perceptual salience, meaning and predictability. Our study calls for a revision of attentional control theories to account for the role of contextual and multisensory control.

A dynamic normalization model of temporal attention

Vision is dynamic, handling a continuously changing stream of input, yet most models of visual attention are static. Here, we develop a dynamic normalization model of visual temporal attention and constrain it with new psychophysical human data. We manipulated temporal attention-the prioritization of visual information at specific points in time-to a sequence of two stimuli separated by a variable time interval. Voluntary temporal attention improved perceptual sensitivity only over a specific interval range. To explain these data, we modelled voluntary and involuntary attentional gain dynamics. Voluntary gain enhancement took the form of a limited resource over short time intervals, which recovered over time. Taken together, our theoretical and experimental results formalize and generalize the idea of limited attentional resources across space at a single moment to limited resources across time at a single location.

Effects of temporal and spatiotemporal cues on detection of dynamic road hazards

While driving, dangerous situations can occur quickly, and giving drivers extra time to respond may make the road safer for everyone. Extensive research on attentional cueing in cognitive psychology has shown that targets are detected faster when preceded by a spatially valid cue, and slower when preceded by an invalid cue. However, it is unknown how these standard laboratory-based cueing effects may translate to dynamic, real-world situations like driving, where potential targets (i.e., hazardous events) are inherently more complex and variable. Observers in our study were required to correctly localize hazards in dynamic road scenes across three cue conditions (temporal, spatiotemporal valid and spatiotemporal invalid), and a no-cue baseline. All cues were presented at the first moment the hazardous situation began. Both types of valid cues reduced reaction time (by 58 and 60 ms, respectively, with no significant difference between them, a larger effect than in many classic studies). In addition, observers’ ability to accurately localize hazards dropped 11% in the spatiotemporal invalid condition, a result with dangerous implications on the road. This work demonstrates that, in spite of this added complexity, classic cueing effects persist—and may even be enhanced—for the detection of real-world hazards, and that valid cues have the potential to benefit drivers on the road.

Shifting expectations: Lapses in spatial attention are driven by anticipatory attentional shifts

Attention is dynamic, constantly shifting between different locations - sometimes imperfectly. How do goal-driven expectations impact dynamic spatial attention? A previous study (Dowd & Golomb, Psychological Science, 30(3), 343-361, 2019) explored object-feature binding when covert attention needed to be either maintained at a single location or shifted from one location to another. In addition to revealing feature-binding errors during dynamic shifts of attention, this study unexpectedly found that participants sometimes made correlated errors on trials when they did not have to shift attention, mistakenly reporting the features and location of an object at a different location. The authors posited that these errors represent "spatial lapses" attention, which are perhaps driven by the implicit sampling of other locations in anticipation of having to shift attention. To investigate whether these spatial lapses are indeed anticipatory, we conducted a series of four experiments. We first replicated in Psychological Science, 30(3), the original finding of spatial lapses, and then showed that these spatial lapses were not observed in contexts where participants are not expecting to have to shift attention. We then tested contexts where the direction of attentional shifts was spatially predictable, and found that participants lapse preferentially to more likely shift locations. Finally, we found that spatial lapses do not seem to be driven by explicit knowledge of likely shift locations. Combined, these results suggest that spatial lapses of attention are induced by the implicit anticipation of making an attentional shift, providing further insight into the interplay between implicit expectations, dynamic spatial attention, and visual perception.

Context dependency of time-based event-related expectations for different modalities

Expectations about the temporal occurrence of events (when) are often tied with the expectations about certain event-related properties (what and where) happening at these time points. For instance, slowly waking up in the morning we expect our alarm clock to go off; however, the longer we do not hear it the more likely we already missed it. However, most current evidence for complex time-based event-related expectations (TBEEs) is based on the visual modality. Here we tested whether implicit TBEEs can act cross-modally. To this end, visual and auditory stimulus streams were presented which contained early and late targets embedded among distractors (to maximise temporal target uncertainty). Foreperiod-modality-contingencies were manipulated run-wise: visual targets either occurred early in 80% of trials and auditory targets occurred late in 80% of trials or vice versa. Participants showed increased sensitivity for expected auditory early/visual late targets which increased over time while the opposite pattern was observed for visual early/auditory late targets. A benefit in reaction times was only found for auditory early trials. Together, this pattern of results suggests that implicit context-dependent TBEEs for auditory targets after short foreperiods (be they correct or not) dominated and determined which modality became more expected at the late position irrespective of the veridical statistical regularity. Hence, TBEEs in cross-modal and uncertain environments are context-dependent, shaped by the dominant modality in temporal tasks (i.e., auditory) and only boost performance cross-modally when expectations about the event after the short foreperiod match with the run-wise context (i.e., auditory early/visual late).

The human cerebellum is essential for modulating perceptual sensitivity based on temporal expectations

A functional benefit of attention is to proactively enhance perceptual sensitivity in space and time. Although attentional orienting has traditionally been associated with cortico-thalamic networks, recent evidence has shown that individuals with cerebellar degeneration (CD) show a reduced reaction time benefit from cues that enable temporal anticipation. The present study examined whether the cerebellum contributes to the proactive attentional modulation in time of perceptual sensitivity. We tested CD participants on a non-speeded, challenging perceptual discrimination task, asking if they benefit from temporal cues. Strikingly, the CD group showed no duration-specific perceptual sensitivity benefit when cued by repeated but aperiodic presentation of the target interval. In contrast, they performed similar to controls when cued by a rhythmic stream. This dissociation further specifies the functional domain of the cerebellum and establishes its role in the attentional adjustment of perceptual sensitivity in time in addition to its well-documented role in motor timing.

Rethinking attention in time: Expectancy violations reconcile contradictory developmental evidence

Temporal expectations critically influence perception and action. Previous research reports contradictory results in children's ability to endogenously orient attention in time as well as the developmental course. To reconcile this seemingly conflicting evidence, we put forward the hypothesis that expectancy violations-through the use of invalid trials-are the source of the mixed evidence reported in the literature. With the aim of offering new results that could reconcile previous findings, we tested a group of young children (4- to 7-year-olds), an older group (8- to 12-year-olds), and a group of adults. Temporal cues provided expectations about target onset time, and invalid trials were used such that the target appeared at the unexpected time in 25% of the trials. In both experiments, the younger children responded faster in valid trials than in invalid trials, showing that they benefited from the temporal cue. These results show that young children rely on temporal expectations to orient attention in time endogenously. Importantly, younger children exhibited greater validity effects than older children and adults, and these effects correlated positively with participants' performance in the invalid (unexpected) trials. We interpret the reduction of validity effects with age as an index of better adaptation to the invalid (unexpected) condition. By using invalid trials and testing three age groups, we demonstrate that previous findings are not inconsistent. Rather, evidence converges when considering the presence of expectancy violations that require executive control mechanisms, which develop progressively during childhood. We propose a distinction between rigid and flexible mechanisms of temporal orienting to accommodate all findings.

Effects of Temporal Expectations on the Perception of Motion Gestalts

Gestalt psychology has traditionally ignored the role of attention in perception, leading to the view that autonomous processes create perceptual configurations that are then attended. More recent research, however, has shown that spatial attention influences a form of Gestalt perception: the coherence of random-dot kinematograms (RDKs). Using ERPs, we investigated whether temporal expectations exert analogous attentional effects on the perception of coherence level in RDKs. Participants were presented fixed-length sequences of RDKs and reported the coherence level of a target RDK. The target was indicated immediately after its appearance by a postcue. Target expectancy increased as the sequence progressed until target presentation; afterward, remaining RDKs were perceived without target expectancy. Expectancy influenced the amplitudes of ERP components P1 and N2. Crucially, expectancy interacted with coherence level at N2, but not at P1. Specifically, P1 amplitudes decreased linearly as a function of RDK coherence irrespective of expectancy, whereas N2 exhibited a quadratic dependence on coherence: larger amplitudes for RDKs with intermediate coherence levels, and only when they were expected. These results suggest that expectancy at early processing stages is an unspecific, general readiness for perception. At later stages, expectancy becomes stimulus specific and nonlinearly related to Gestalt coherence.

The warning stimulus as retrieval cue: The role of associative memory in temporal preparation

In a warned reaction time task, the warning stimulus (S1) initiates a process of temporal preparation, which promotes a speeded response to the impending target stimulus (S2). According to the multiple trace theory of temporal preparation (MTP), participants learn the timing of S2 by storing a memory trace on each trial, which contains a temporal profile of the events on that trial. On each new trial, S1 serves as a retrieval cue that implicitly and associatively activates memory traces created on earlier trials, which jointly drive temporal preparation for S2. The idea that S1 assumes this role as a retrieval cue was tested across eight experiments, in which two different S1s were associated with two different distributions of S1-S2 intervals: one with predominantly short and one with predominantly long intervals. Experiments differed regarding the S1 features that made up a pair, ranging from highly distinct (e.g., tone and flash) to more similar (e.g., red and green flash) and verbal (i.e., "short" vs "long"). Exclusively for pairs of highly distinct S1s, the results showed that the S1 cue modified temporal preparation, even in participants who showed no awareness of the contingency. This cueing effect persisted in a subsequent transfer phase, in which the contingency between S1 and the timing of S2 was broken - a fact participants were informed of in advance. Together, these findings support the role of S1 as an implicit retrieval cue, consistent with MTP.

Reduction of temporal uncertainty facilitates stimulus-driven processes in spatial selection

Previous studies have shown that the reduction of temporal uncertainty facilitates target selection in visual search. We investigated whether this beneficial effect is caused by an effect on stimulus-driven processes or on goal-driven processes in spatial selection. To discriminate between these processes, we employed a visual search task in which participants searched for a shape target while ignoring a color singleton distractor. As an index of stimulus-driven processes, we measured the N2pc evoked by the singleton distractor (N_D). As indices of goal-driven processes, we measured the N2pc evoked by the target (N_T) and the distractor positivity (P_D) evoked by the singleton distractor, respectively. We observed that reducing temporal uncertainty modulated the amplitude of N_D and the onset latency of the N_T, but did not modulate the amplitude of the P_D. These results are consistent with the view that a reduction of temporal uncertainty influences non-selective, stimulus-driven processes in spatial selection.

Temporal orienting in Parkinson's disease

Temporal orienting of attention can affect multiple stages of processing to guide adaptive behaviour. We tested whether temporal expectation in different task contexts is compromised in individuals with Parkinson's disease (PD). In Experiment 1 two temporal-orienting tasks were used: a speeded task emphasizing motor preparation and a non-speeded task emphasizing perceptual discrimination using rapid serial visual presentation. In both tasks, auditory cues indicated the likelihood of a target appearing after a short or long interval. In the speeded-response task, participants used the cues to anticipate an easily detectable target stimulus. In the non-speeded perceptual-discrimination task, participants used the cues to help discriminate a target letter embedded in a stream of letters. Relative to healthy participants, participants with PD did not show altered temporal orienting effects in the speeded-response task. However, they were impaired in using temporal cues to improve perceptual discrimination. In Experiment 2, we tested whether the temporal-orienting deficits in the perceptual-discrimination task depended on the requirement to ignore temporally distracting stimuli. We replicated the impaired temporal orienting for perceptual discrimination in an independent group of individuals with PD, and showed the impairment was abolished when individuals were on their dopaminergic medication. In a task without any distracting letters, however, patients off or on medication benefited normally from temporal orienting cues. Our findings suggest that deficits in temporal orienting in individuals with PD interact with specific task demands, such as the requirement to select target from temporally competing distractors.

Pre-target oculomotor inhibition reflects temporal orienting rather than certainty

Recent studies suggested that eye movements are linked to temporal predictability. These studies manipulated predictability by setting the cue-target interval (foreperiod) to be fixed or random throughout the block. Findings showed that pre-target oculomotor behavior was reduced in the fixed relative to the random condition. This effect was interpreted as reflecting the formation of temporal expectation. However, it is unknown whether the effect is driven by target-specific temporal orienting, or rather a result of a more context-dependent state of certainty that participants may experience during blocks with a high predictability rate. In this study we dissociated certainty and orienting in a tilt-discrimination task. In each trial, a temporal cue (fixation color change) was followed by a tilted grating-patch. The foreperiod distribution was varied between blocks to be either fully fixed (same foreperiod in 100% of trials), mostly fixed (80% of trials with one foreperiod and 20% with another) or random (five foreperiods in equal probabilities). The two hypotheses led to different prediction models which were tested against the experimental data. Results were consistent with the orienting hypothesis and inconsistent with the certainty hypothesis, supporting the link between oculomotor inhibition and temporal orienting and its validity as a temporal expectations marker.

Purpose-Dependent Consequences of Temporal Expectations Serving Perception and Action

Temporal expectations enable anticipatory brain states that prepare us for upcoming perception and action. We investigated the purpose-dependent nature and consequences of cued temporal expectations on brain and behavior in male and female human volunteers, using two matched visual-motor tasks that stressed either response speed or visual accuracy. We show that the consequences of temporal expectations are fundamentally purpose dependent. Temporal expectations predominantly affected response times when visual demands were low and speed was more important, but perceptual accuracy when visual demands were more challenging. Using magnetoencephalography, we further show how temporal expectations latch onto anticipatory neural states associated with concurrent spatial expectations—modulating task-specific anticipatory neural lateralization of oscillatory brain activity in a modality- and frequency-specific manner. By relating these brain states to behavior, we finally reveal how the behavioral relevance of such anticipatory brain states is similarly purpose dependent.

SIGNIFICANCE STATEMENT Knowing when events may occur helps to prepare neural activity for upcoming perception and action. It is becoming increasingly clear that distinct sources of temporal expectations may facilitate performance via distinct mechanisms. Another relevant dimension to consider regards the distinct purposes that temporal expectations may serve. Here, we demonstrate that the consequences of temporal expectations on neurophysiological brain activity and behavior are fundamentally purpose dependent, and show how temporal expectations interact with task-relevant neural states in a modality- and frequency-specific manner. This brings the important insight that the ways in which temporal expectations influence brain and behavior, and how brain activity is related to behavior, are not fixed properties but rather depend on the task at hand.

Modality-specific and multisensory mechanisms of spatial attention and expectation

In our natural environment, the brain needs to combine signals from multiple sensory modalities into a coherent percept. Whereas spatial attention guides perceptual decisions by prioritizing processing of signals that are task-relevant, spatial expectations encode the probability of signals over space. Previous studies have shown that behavioral effects of spatial attention generalize across sensory modalities. However, because they manipulated spatial attention as signal probability over space, these studies could not dissociate attention and expectation or assess their interaction. In two experiments, we orthogonally manipulated spatial attention (i.e., task-relevance) and expectation (i.e., signal probability) selectively in one sensory modality (i.e., primary modality) (experiment 1: audition, experiment 2: vision) and assessed their effects on primary and secondary sensory modalities in which attention and expectation were held constant. Our results show behavioral effects of spatial attention that are comparable for audition and vision as primary modalities; however, signal probabilities were learned more slowly in audition, so that spatial expectations were formed later in audition than vision. Critically, when these differences in learning between audition and vision were accounted for, both spatial attention and expectation affected responses more strongly in the primary modality in which they were manipulated and generalized to the secondary modality only in an attenuated fashion. Collectively, our results suggest that both spatial attention and expectation rely on modality-specific and multisensory mechanisms.

Temporal attention boosts perceptual effects of spatial attention and feature-based attention

Temporal attention, that is, the process of anticipating the occurrence of a stimulus at a given time point, has been shown to improve perceptual processing of visual stimuli. In the present study, we investigated whether and how temporal attention interacts with spatial attention and feature-based attention in visual selection. To monitor the influence of the three different attention dimensions on perceptual processing, we measured event-related potentials (ERPs). Our participants performed a visual search task, in which a colored singleton was presented amongst homogenous distractors. We manipulated spatial and feature-based attention by requiring participants to respond only to target singletons in a particular color and at a to-be-attended spatial location. We manipulated temporal attention by means of an explicit temporal cue that announced either validly or invalidly the occurrence of the search display. We obtained early ERP effects of spatial attention and feature-based attention at the validly cued but not at the invalidly cued time point. Taken together, our results suggest that temporal attention boosts early effects of spatial and feature-based attention.

Endogenous cueing effects for detection can be accounted for by a decision model of selective attention

Spatial cues help participants detect a visual target when it appears at the cued location. One hypothesis for this cueing effect, called selective perception, is that cueing a location enhances perceptual encoding at that location. Another hypothesis, called selective decision, is that the cue has no effect on perception, but instead provides prior information that facilitates decision-making. We distinguished these hypotheses by comparing a simultaneous display with two spatial locations to sequential displays with two temporal intervals. The simultaneous condition had a partially valid spatial cue, and the sequential condition had a partially valid temporal cue. Selective perception predicts no cueing effect for sequential displays given there is enough time to switch attention. In contrast, selective decision predicts cueing effects for sequential displays regardless of time. We used endogenous cueing of a detection-like coarse orientation discrimination task with clear displays (no external noise or postmasks). Results showed cueing effects for the sequential condition, supporting a decision account of selective attention for endogenous cueing of detection-like tasks.

Expecting the unexpected: Temporal expectation increases the flash-grab effect

In the flash-grab effect, when a disk is flashed on a moving background at the moment it reverses direction, the perceived location of the disk is strongly displaced in the direction of the motion that follows the reversal. Here, we ask whether increased expectation of the reversal reduces its effect on the motion-induced shift, as suggested by predictive coding models with first order predictions. Across four experiments we find that when the reversal is expected, the illusion gets stronger, not weaker. We rule out accumulating motion adaptation as a contributing factor. The pattern of results cannot be accounted for by first-order predictions of location. Instead, it appears that second-order predictions of event timing play a role. Specifically, we conclude that temporal expectation causes a transient increase in temporal attention, boosting the strength of the motion signal and thereby increasing the strength of the illusion.

Natural rhythms of periodic temporal attention

That attention is a fundamentally rhythmic process has recently received abundant empirical evidence. The essence of temporal attention, however, is to flexibly focus in time. Whether this function is constrained by an underlying rhythmic neural mechanism is unknown. In six interrelated experiments, we behaviourally quantify the sampling capacities of periodic temporal attention during auditory or visual perception. We reveal the presence of limited attentional capacities, with an optimal sampling rate of ~1.4 Hz in audition and ~0.7 Hz in vision. Investigating the motor contribution to temporal attention, we show that it scales with motor rhythmic precision, maximal at ~1.7 Hz. Critically, motor modulation is beneficial to auditory but detrimental to visual temporal attention. These results are captured by a computational model of coupled oscillators, that reveals the underlying structural constraints governing the temporal alignment between motor and attention fluctuations.

Rhythmic Temporal Expectation Boosts Neural Activity by Increasing Neural Gain

Temporal orienting improves sensory processing, akin to other top-down biases. However, it is unknown whether these improvements reflect increased neural gain to any stimuli presented at expected time points, or specific tuning to task-relevant stimulus aspects. Furthermore, while other top-down biases are selective, the extent of trade-offs across time is less well characterized. Here, we tested whether gain and/or tuning of auditory frequency processing in humans is modulated by rhythmic temporal expectations, and whether these modulations are specific to time points relevant for task performance. Healthy participants (N = 23) of either sex performed an auditory discrimination task while their brain activity was measured using magnetoencephalography/electroencephalography (M/EEG). Acoustic stimulation consisted of sequences of brief distractors interspersed with targets, presented in a rhythmic or jittered way. Target rhythmicity not only improved behavioral discrimination accuracy and M/EEG-based decoding of targets, but also of irrelevant distractors preceding these targets. To explain this finding in terms of increased sensitivity and/or sharpened tuning to auditory frequency, we estimated tuning curves based on M/EEG decoding results, with separate parameters describing gain and sharpness. The effect of rhythmic expectation on distractor decoding was linked to gain increase only, suggesting increased neural sensitivity to any stimuli presented at relevant time points.SIGNIFICANCE STATEMENT Being able to predict when an event may happen can improve perception and action related to this event, likely due to the alignment of neural activity to the temporal structure of stimulus streams. However, it is unclear whether rhythmic increases in neural sensitivity are specific to task-relevant targets, and whether they competitively impair stimulus processing at unexpected time points. By combining magnetoencephalography and encephalographic recordings, neural decoding of auditory stimulus features, and modeling, we found that rhythmic expectation improved neural decoding of both relevant targets and irrelevant distractors presented and expected time points, but did not competitively impair stimulus processing at unexpected time points. Using a quantitative model, these results were linked to nonspecific neural gain increases due to rhythmic expectation.

Dissecting beta-state changes during timed movement preparation in Parkinson's disease

An emerging perspective describes beta-band (15-28 Hz) activity as consisting of short-lived high-amplitude events that only appear sustained in conventional measures of trial-average power. This has important implications for characterising abnormalities observed in beta-band activity in disorders like Parkinson's disease. Measuring parameters associated with beta-event dynamics may yield more sensitive measures, provide more selective diagnostic neural markers, and provide greater mechanistic insight into the breakdown of brain dynamics in this disease. Here, we used magnetoencephalography in eighteen Parkinson's disease participants off dopaminergic medication and eighteen healthy control participants to investigate beta-event dynamics during timed movement preparation. We used the Hidden Markov Model to classify event dynamics in a data-driven manner and derived three parameters of beta events: (1) beta-state amplitude, (2) beta-state lifetime, and (3) beta-state interval time. Of these, changes in beta-state interval time explained the overall decreases in beta power during timed movement preparation and uniquely captured the impairment in such preparation in patients with Parkinson's disease. Thus, the increased granularity of the Hidden Markov Model analysis (compared with conventional analysis of power) provides increased sensitivity and suggests a possible reason for impairments of timed movement preparation in Parkinson's disease.

Small numerosity advantage for sequential enumeration on RSVP stimuli: an object individuation-based account

Although there is a large literature demonstrating rapid and accurate enumeration of small sets of simultaneously presented items (i.e., subitizing), it is unclear whether this small numerosity advantage (SNA) can also manifest in sequential enumeration. The present study thus has two aims: to establish a robust processing advantage for small numerosities during sequential enumeration using a rapid serial visual presentation (RSVP) paradigm, and to examine the underlying mechanism for a SNA in sequential enumeration. The results indicate that a small set of items presented in fast sequences can be enumerated accurately with a high precision and a SOA (stimulus onset asynchrony)-sensitive capacity limit, essentially generalizing the large literature on small numerosity advantage from spatial domain to temporal domain. A resource competition hypothesis was proposed and confirmed in further experiments. Specifically, sequential enumeration and other cognitive process, such as visual working memory (VWM), compete for a shared resource of object individuation by which items are segregated as individual entities. These results implied that the limited resource of object individuation can be allocated within time windows of flexible temporal scales during simultaneous and sequential enumerations. Taken together, the present study calls for attention to the dynamic aspect of the enumeration process and highlights the pivotal role of object individuation in underlying a wide range of mental operations, such as enumeration and VWM.

When Temporal Certainty Doesn't Help

In a dynamically changing environment, the ability to capture regularities in our sensory input helps us generate predictions about future events. In most sensory systems, the basic finding is clear: Knowing when something will happen improves performance on it [Nobre, A. C., & van Ede, F. (2017). Anticipated moments: Temporal structure in attention. Nature Reviews Neuroscience, 19, 34-48, 2017]. We here examined the impact of temporal predictions on a less-explored modality: touch. Participants were instructed to detect a brief target embedded in an ongoing vibrotactile stimulus. Unbeknownst to them, the experiment had two timing conditions: In one part, the time of target onset was fixed and thus temporally predictable, whereas in the other, it could appear at a random time within the ongoing stimulation. We found a clear modulation of detection thresholds due to temporal predictability: Contrary to other sensory systems, detecting a predictable tactile target was worse relative to unpredictable targets. We discuss our findings within the framework of tactile suppression.

Probing the early phase of rapid instructed rule encoding

Humans can rapidly convert instructions about a rule into functional neural structures used to apply the rule. The early stages of this encoding process are poorly understood. We designed a stimulus-response (SR) task in which participants were first shown a SR rule on a screen for 200 ms, and then had to apply it to a test stimulus T, which either matched the S in the rule (SR trial) or not (catch trial). To investigate the early stages of rule encoding, the delay between the end of rule display and the onset of the test stimulus was manipulated and chosen between values of 50 ms to 1300 ms. Participants conducted three sessions of 288 trials each, separated by a median of 9 h. Random sequences of 20 rules were used. We then analysed the reaction times and the types of errors made by participants in the different conditions. The analysis of practice effects in session 1 suggests that the neural networks that process SR and catch trials are at least partially distinct, and improve separately during the practice of respectively SR and catch trials. The rule-encoding process, however, is common to both tasks and improves with the number of trials, irrespective of the trial type. Rule encoding shows interesting dynamic properties that last for 500 ms after the end of the stimulus presentation. The encoding process increases the response time in a non-stochastic way, simply adding a reaction time cost to all responses. The rule-retrieval system is functional before the encoding has stabilized, as early as 50 ms after the end of SR rule presentation, with low response errors. It is sensitive to masking however, producing errors with brief (100 ms) test stimulus presentations. Once encoding has stabilized, the sensitivity to masking disappears. It is suggested that participants do encode rules as a parametrized function, using the same neural encoding structure for each trial, rather than reconfiguring their brain anew for each new SR rule. This structure would have been implemented from instructions received prior to the experiment, by using a library of neural functions available in the brain. The observed errors are consistent with this view.

Expectation Gates Neural Facilitation of Emotional Words in Early Visual Areas

The current study examined whether emotional expectations gate attention to emotional words in early visual cortex. Color cues informed about word valence and onset latency. We observed a stimulus-preceding negativity prior to the onset of cued words that was larger for negative than for neutral words. This indicates that in anticipation of emotional words more attention was allocated to them than to neutral words before target onset. During stimulus presentation the steady-state visual evoked potential (SSVEP), elicited by flickering words, was attenuated for cued compared to uncued words, indicating sharpened sensory activity, i.e., expectation suppression. Most importantly, the SSVEP was more enhanced for negative than neutral words when these were cued. Uncued conditions did not differ in SSVEP amplitudes, paralleling previous studies reporting lexico-semantic but not early visual effects of emotional words. We suggest that cueing mediates re-entrant engagement of visual resources by providing an early “affective gist” of an upcoming word. Consequently, visual single-word studies may have underestimated attentional effects of emotional words and their anticipation during reading.

Rhythmic Temporal Structure at Encoding Enhances Recognition Memory

Presenting events in a rhythm has been shown to enhance perception and facilitate responses for stimuli that appear in synchrony with the rhythm, but little is known about how rhythm during encoding influences later recognition. In this study, participants were presented with images of everyday objects in an encoding phase before a recognition task in which they judged whether or not objects were previously presented. Blockwise, object presentation during encoding followed either a rhythmic (constant, predictable) or arrhythmic (random, unpredictable) temporal structure, of which participants were unaware. Recognition was greater for items presented in a rhythmic relative to an arrhythmic manner. During encoding, there was a differential neural activity based on memory effect with larger positivity for rhythmic over arrhythmic stimuli. At recognition, memory-specific ERP components were differentially affected by temporal structure: The FN400 old/new effect was unaffected by rhythmic structure, whereas the late positive component old/new effect was observed only for rhythmically encoded items. Taken together, this study provides new evidence that memory-specific processing at recognition is affected by temporal structure at encoding.

Directing Voluntary Temporal Attention Increases Fixational Stability

Our visual input is constantly changing, but not all moments are equally relevant. Visual temporal attention, the prioritization of visual information at specific points in time, increases perceptual sensitivity at behaviorally relevant times. The dynamic processes underlying this increase are unclear. During fixation, humans make small eye movements called microsaccades, and inhibiting microsaccades improves perception of brief stimuli. Here, we investigated whether temporal attention changes the pattern of microsaccades in anticipation of brief stimuli. Human observers (female and male) judged stimuli presented within a short sequence. Observers were given either an informative precue to attend to one of the stimuli, which was likely to be probed, or an uninformative (neutral) precue. We found strong microsaccadic inhibition before the stimulus sequence, likely due to its predictable onset. Critically, this anticipatory inhibition was stronger when the first target in the sequence (T1) was precued (task-relevant) than when the precue was uninformative. Moreover, the timing of the last microsaccade before T1 and the first microsaccade after T1 shifted such that both occurred earlier when T1 was precued than when the precue was uninformative. Finally, the timing of the nearest pre- and post-T1 microsaccades affected task performance. Directing voluntary temporal attention therefore affects microsaccades, helping to stabilize fixation at the most relevant moments over and above the effect of predictability. Just as saccading to a relevant stimulus can be an overt correlate of the allocation of spatial attention, precisely timed gaze stabilization can be an overt correlate of the allocation of temporal attention.SIGNIFICANCE STATEMENT We pay attention at moments in time when a relevant event is likely to occur. Such temporal attention improves our visual perception, but how it does so is not well understood. Here, we discovered a new behavioral correlate of voluntary, or goal-directed, temporal attention. We found that the pattern of small fixational eye movements called microsaccades changes around behaviorally relevant moments in a way that stabilizes the position of the eyes. Microsaccades during a brief visual stimulus can impair perception of that stimulus. Therefore, such fixation stabilization may contribute to the improvement of visual perception at attended times. This link suggests that, in addition to cortical areas, subcortical areas mediating eye movements may be recruited with temporal attention.

Temporal attention improves perception similarly at foveal and parafoveal locations

Temporal attention, the prioritization of information at a specific point in time, improves visual performance, but it is unknown whether it does so to the same extent across the visual field. This knowledge is necessary to establish whether temporal attention compensates for heterogeneities in discriminability and speed of processing across the visual field. Discriminability and rate of information accrual depend on eccentricity as well as on polar angle, a characteristic known as performance fields. Spatial attention improves speed of processing more at locations at which discriminability is lower and information accrual is slower, but it improves discriminability to the same extent across isoeccentric locations. Here we asked whether temporal attention benefits discriminability in a similar or differential way across the visual field. Observers were asked to report the orientation of one of two targets presented at different points in time at the same spatial location (fovea, right horizontal meridian, or upper vertical meridian, blocked). Temporal attention improved discriminability and shortened reaction times at the foveal and each parafoveal location similarly. These results provide evidence that temporal attention is similarly effective at multiple locations in the visual field. Consequently, at the tested locations, performance fields are preserved with temporal orienting of attention.

Predicting change: Approximate inference under explicit representation of temporal structure in changing environments

In our daily lives timing of our actions plays an essential role when we navigate the complex everyday environment. It is an open question though how the representations of the temporal structure of the world influence our behavior. Here we propose a probabilistic model with an explicit representation of state durations which may provide novel insights in how the brain predicts upcoming changes. We illustrate several properties of the behavioral model using a standard reversal learning design and compare its task performance to standard reinforcement learning models. Furthermore, using experimental data, we demonstrate how the model can be applied to identify participants' beliefs about the latent temporal task structure. We found that roughly one quarter of participants seem to have learned the latent temporal structure and used it to anticipate changes, whereas the remaining participants' behavior did not show signs of anticipatory responses, suggesting a lack of precise temporal expectations. We expect that the introduced behavioral model will allow, in future studies, for a systematic investigation of how participants learn the underlying temporal structure of task environments and how these representations shape behavior.

Different effects of spatial and temporal attention on the integration and segregation of stimuli in time

Having expectations about when and where relevant stimuli will appear engenders endogenous temporal and spatial orienting and can provide vital benefits to visual processing. Although more is known about how each of these forms of orienting affects spatial processing, comparatively little is understood about their influences on the temporal integration and segregation of rapid sequential stimuli. A critical question is whether the influence of spatial cueing on temporal processing involves independent spatial and temporal orienting effects or a synergistic spatiotemporal impact. Here we delineated between the temporal and spatial orienting engendered by endogenous cues by using a paradigm with identical visual stimulation when the goal was to integrate or segregate the stimuli, in separate blocks of trials. We found strong effects of spatial orienting on both integration and segregation performance. In contrast, temporal orienting engendered only an invalid cueing cost, and for integration trials only. This clear differentiation between spatial and temporal cueing effects provides constraints to inform arbitration between theories of how attention biases the visual processing stream and influences the organization of visual perception in time.

Early Behavioural Facilitation by Temporal Expectations in Complex Visual-motor Sequences

In daily life, temporal expectations may derive from incidental learning of recurring patterns of intervals. We investigated the incidental acquisition and utilisation of combined temporal-ordinal (spatial/effector) structure in complex visual-motor sequences using a modified version of a serial reaction time (SRT) task. In this task, not only the series of targets/responses, but also the series of intervals between subsequent targets was repeated across multiple presentations of the same sequence. Each participant completed three sessions. In the first session, only the repeating sequence was presented. During the second and third session, occasional probe blocks were presented, where a new (unlearned) spatial-temporal sequence was introduced. We first confirm that participants not only got faster over time, but that they were slower and less accurate during probe blocks, indicating that they incidentally learned the sequence structure. Having established a robust behavioural benefit induced by the repeating spatial-temporal sequence, we next addressed our central hypothesis that implicit temporal orienting (evoked by the learned temporal structure) would have the largest influence on performance for targets following short (as opposed to longer) intervals between temporally structured sequence elements, paralleling classical observations in tasks using explicit temporal cues. We found that indeed, reaction time differences between new and repeated sequences were largest for the short interval, compared to the medium and long intervals, and that this was the case, even when comparing late blocks (where the repeated sequence had been incidentally learned), to early blocks (where this sequence was still unfamiliar). We conclude that incidentally acquired temporal expectations that follow a sequential structure can have a robust facilitatory influence on visually-guided behavioural responses and that, like more explicit forms of temporal orienting, this effect is most pronounced for sequence elements that are expected at short inter-element intervals.

Temporal Processing in Audition: Insights from Music

Music is a curious example of a temporally patterned acoustic stimulus, and a compelling pan-cultural phenomenon. This review strives to bring some insights from decades of music psychology and sensorimotor synchronization (SMS) literature into the mainstream auditory domain, arguing that musical rhythm perception is shaped in important ways by temporal processing mechanisms in the brain. The feature that unites these disparate disciplines is an appreciation of the central importance of timing, sequencing, and anticipation. Perception of musical rhythms relies on an ability to form temporal predictions, a general feature of temporal processing that is equally relevant to auditory scene analysis, pattern detection, and speech perception. By bringing together findings from the music and auditory literature, we hope to inspire researchers to look beyond the conventions of their respective fields and consider the cross-disciplinary implications of studying auditory temporal sequence processing. We begin by highlighting music as an interesting sound stimulus that may provide clues to how temporal patterning in sound drives perception. Next, we review the SMS literature and discuss possible neural substrates for the perception of, and synchronization to, musical beat. We then move away from music to explore the perceptual effects of rhythmic timing in pattern detection, auditory scene analysis, and speech perception. Finally, we review the neurophysiology of general timing processes that may underlie aspects of the perception of rhythmic patterns. We conclude with a brief summary and outlook for future research.