Anticipated moments: temporal structure in attention

Blocked versus interleaved: How range contexts modulate time perception and its EEG signatures

Accurate time perception is a crucial element in a wide range of cognitive tasks, including decision-making, memory, and motor control. One commonly observed phenomenon is that when given a range of time intervals to consider, people's estimates often cluster around the midpoint of those intervals. Previous studies have suggested that the range of these intervals can also influence our judgments, but the neural mechanisms behind this "range effect" are not yet understood. We used both behavioral tests and electroencephalographic (EEG) measures to understand how the range of sample time intervals affects the accuracy of people's subsequent time estimates. Study participants were exposed to two different setups: In the "blocked-range" (BR) session, short and long intervals were presented in separate blocks, whereas in the "interleaved-range" (IR) session, intervals of various lengths were presented randomly. Our findings indicated that the BR context led to more accurate time estimates compared to the IR context. In terms of EEG data, the BR context resulted in quicker buildup of contingent negative variation (CNV), which also reached higher amplitude levels and dissolved more rapidly during the encoding stage. We also observed an enhanced amplitude in the offset P2 component of the EEG signal. Overall, our results suggest that the variability in time intervals, as defined by their range, influences the neural processes that underlie time estimation.

ATLAS: Mapping ATtention's Location And Size to probe five modes of serial and parallel search

Conventional visual search tasks do not address attention directly and their core manipulation of 'set size' - the number of displayed items - introduces stimulus confounds that hinder interpretation. However, alternative approaches have not been widely adopted, perhaps reflecting their complexity, assumptions, or indirect attention-sampling. Here, a new procedure, the ATtention Location And Size ('ATLAS') task used probe displays to track attention's location, breadth, and guidance during search. Though most probe displays comprised six items, participants reported only the single item they judged themselves to have perceived most clearly - indexing the attention 'peak'. By sampling peaks across variable 'choice sets', the size and position of the attention window during search was profiled. These indices appeared to distinguish narrow- from broad attention, signalled attention to pairs of items where it arose and tracked evolving attention-guidance over time. ATLAS is designed to discriminate five key search modes: serial-unguided, sequential-guided, unguided attention to 'clumps' with local guidance, and broad parallel-attention with or without guidance. This initial investigation used only an example set of highly regular stimuli, but its broader potential should be investigated.

Contingent magnetic variation and beta-band oscillations in sensorimotor temporal decision-making

The ability to accurately encode the temporal information of sensory events and hence to make prompt action is fundamental to humans' prompt behavioral decision-making. Here we examined the ability of ensemble coding (averaging multiple inter-intervals in a sound sequence) and subsequent immediate reproduction of target duration at half, equal, or double that of the perceived mean interval in a sensorimotor loop. With magnetoencephalography (MEG), we found that the contingent magnetic variation (CMV) in the central scalp varied as a function of the averaging tasks, with a faster rate for buildup amplitudes and shorter peak latencies in the "half" condition as compared to the "double" condition. ERD (event-related desynchronization) -to-ERS (event-related synchronization) latency was shorter in the "half" condition. A robust beta band (15-23Hz) power suppression and recovery between the final tone and the action of key pressing was found for time reproduction. The beta modulation depth (i.e., the ERD-to-ERS power difference) was larger in motor areas than in primary auditory areas. Moreover, results of phase slope index (PSI) indicated that beta oscillations in the left supplementary motor area (SMA) led those in the right superior temporal gyrus (STG), showing SMA to STG directionality for the processing of sequential (temporal) auditory interval information. Our findings provide the first evidence to show that CMV and beta oscillations predict the coupling between perception and action in time averaging.

Preparatory movement state enhances premovement EEG representations for brain-computer interfaces

Objective. Motor-related brain-computer interface (BCI) have a broad range of applications, with the detection of premovement intentions being a prominent use case. However, the electroencephalography (EEG) features during the premovement phase are not distinctly evident and are susceptible to attentional influences. These limitations impede the enhancement of performance in motor-based BCI. The objective of this study is to establish a premovement BCI encoding paradigm that integrates the preparatory movement state and validates its feasibility in improving the detection of movement intentions.Methods. Two button tasks were designed to induce subjects into a preparation state for two movement intentions (left and right) based on visual guidance, in contrast to spontaneous premovement. The low frequency movement-related cortical potentials (MRCPs) and high frequency event-related desynchronization (ERD) EEG data of 14 subjects were recorded. Extracted features were fused and classified using task related common spatial patterns (CSP) and CSP algorithms. Differences between prepared premovement and spontaneous premovement were compared in terms of time domain, frequency domain, and classification accuracy.Results. In the time domain, MRCPs features reveal that prepared premovement induce lower amplitude and earlier latency on both contralateral and ipsilateral motor cortex compared to spontaneous premovement, with susceptibility to the dominant hand's influence. Frequency domain ERD features indicate that prepared premovement induce lower ERD values bilaterally, and the ERD recovery speed after button press is the fastest. By using the fusion approach, the classification accuracy increased from 78.92% for spontaneous premovement to 83.59% for prepared premovement (p< 0.05). Along with the 4.67% improvement in classification accuracy, the standard deviation decreased by 0.95.Significance. The research findings confirm that incorporating a preparatory state into premovement enhances neural representations related to movement. This encoding enhancement paradigm effectively improves the performance of motor-based BCI. Additionally, this concept has the potential to broaden the range of decodable movement intentions and related information in motor-related BCI.

Eyes on the past: Gaze stability differs between temporal expectation and temporal attention

Temporal expectation and temporal attention distinctly improve performance and gaze stability, and interact at the behavioral and neural levels. Foreperiod-the interval between the preparatory signal and stimulus onset-facilitates temporal expectation. Preceding foreperiod-the foreperiod in the previous trial-modulates expectation at behavioral and oculomotor levels. Here, we investigated whether preceding foreperiod guides temporal attention. Regardless of the preceding foreperiod, temporal attention improved performance, particularly at early moments,and consistently accelerated gaze stability onset and offset by shifting microsaccade timing. However, only with preceding expected foreperiods, attention inhibited microsaccade rates. Moreover, preceding late foreperiods weakened expectation effects on microsaccade rates, but such a weakening was overridden by attention. Altogether, these findings reveal that the oculomotor system's flexibility does not translate to performance, and suggest that although selection history can be utilized as one of the sources of expectation in subsequent trials, it does not necessarily determine, strengthen, or guide attentional deployment.

Perception of temporal structure in speech is influenced by body movement and individual beat perception ability

The subjective experience of time flow in speech deviates from the sound acoustics in substantial ways. The present study focuses on the perceptual tendency to regularize time intervals found in speech but not in other types of sounds with a similar temporal structure. We investigate to what extent individual beat perception ability is responsible for perceptual regularization and if the effect can be eliminated through the involvement of body movement during listening. Participants performed a musical beat perception task and compared spoken sentences to their drumbeat-based versions either after passive listening or after listening and moving along with the beat of the sentences. The results show that the interval regularization prevails in listeners with a low beat perception ability performing a passive listening task and is eliminated in an active listening task involving body movement. Body movement also helped to promote a veridical percept of temporal structure in speech at the group level. We suggest that body movement engages an internal timekeeping mechanism, promoting the fidelity of auditory encoding even in sounds of high temporal complexity and irregularity such as natural speech.

10 Hz rhythmic stimulation modulates electrophysiological, but not behavioral markers of suppression

We investigated the role of alpha in the suppression of attention capture by salient but to-be-suppressed (negative and nonpredictive) color cues, expecting a potential boosting effect of alpha-rhythmic entrainment on feature-specific cue suppression. We did so by presenting a rhythmically flickering visual bar of 10 Hz before the cue - either on the cue's side or opposite the cue -while an arrhythmically flickering visual bar was presented on the respective other side. We hypothesized that rhythmic entrainment at cue location could enhance the suppression of the cue. Testing 27 participants ranging from 18 to 39 years of age, we found both behavioral and electrophysiological evidence of suppression: Search times for a target at a negatively cued location were delayed relative to a target away from the cued location (inverse validity effects). In addition, an event-related potential indicative for suppression (the Distractor Positivity, Pd) was observed following rhythmic but not arrhythmic stimulation, indicating that suppression was boosted by the stimulation. This was also echoed in higher spectral power and intertrial phase coherence of EEG at rhythmically versus arrhythmically stimulated electrode sites, albeit only at the second harmonic (20 Hz), but not at the stimulation frequency. In addition, inverse validity effects were not modulated by rhythmic entrainment congruent with the cue side. Hence, we propose that rhythmic visual stimulation in the alpha range could support suppression, though behavioral evidence remains elusive, in contrast to electrophysiological findings.

Oscillatory attention in groove

Attention is not constant but rather fluctuates over time and these attentional fluctuations may prioritize the processing of certain events over others. In music listening, the pleasurable urge to move to music (termed 'groove' by music psychologists) offers a particularly convenient case study of oscillatory attention because it engenders synchronous and oscillatory movements which also vary predictably with stimulus complexity. In this study, we simultaneously recorded pupillometry and scalp electroencephalography (EEG) from participants while they listened to drumbeats of varying complexity that they rated in terms of groove afterwards. Using the intertrial phase coherence of the beat frequency, we found that while subjects were listening, their pupil activity became entrained to the beat of the drumbeats and this entrained attention persisted in the EEG even as subjects imagined the drumbeats continuing through subsequent silent periods. This entrainment in both the pupillometry and EEG worsened with increasing rhythmic complexity, indicating poorer sensory precision as the beat became more obscured. Additionally, sustained pupil dilations revealed the expected, inverted U-shaped relationship between rhythmic complexity and groove ratings. Taken together, this work bridges oscillatory attention to rhythmic complexity in relation to musical groove.

Dynamic alpha power modulations and slow negative potentials track natural shifts of spatio-temporal attention

Alpha power modulations and slow negative potentials have previously been associated with anticipatory processes in spatial and temporal top-down attention. In typical experimental designs, however, neural responses triggered by transient stimulus onsets can interfere with attention-driven activity patterns and our interpretation of such. Here, we investigated these signatures of spatio-temporal attention in a dynamic paradigm free from potentially confounding stimulus-driven activity using electroencephalography. Participants attended the cued side of a bilateral stimulus rotation and mentally counted how often one of two remembered sample orientations (i.e., the target) was displayed while ignoring the uncued side and non-target orientation. Afterwards, participants performed a delayed match-to-sample task, in which they indicated if the orientation of a probe stimulus matched the corresponding sample orientation (previously target or non-target). We observed dynamic alpha power reductions and slow negative waves around task-relevant points in space and time (i.e., onset of the target orientation in the cued hemifield) over posterior electrodes contralateral to the locus of attention. In contrast to static alpha power lateralization, these dynamic signatures correlated with subsequent memory performance (primarily detriments for matching probes of the non-target orientation), suggesting a preferential allocation of attention to task-relevant locations and time points at the expense of reduced resources and impaired performance for information outside the current focus of attention. Our findings suggest that humans can naturally and dynamically focus their attention at relevant points in space and time and that such spatio-temporal attention shifts can be reflected by dynamic alpha power modulations and slow negative potentials.

Neural Mechanisms Determining the Duration of Task-free, Self-paced Visual Perception

Humans spend hours each day spontaneously engaging with visual content, free from specific tasks and at their own pace. Currently, the brain mechanisms determining the duration of self-paced perceptual behavior remain largely unknown. Here, participants viewed naturalistic images under task-free settings and self-paced each image's viewing duration while undergoing EEG and pupillometry recordings. Across two independent data sets, we observed large inter- and intra-individual variability in viewing duration. However, beyond an image's presentation order and category, specific image content had no consistent effects on spontaneous viewing duration across participants. Overall, longer viewing durations were associated with sustained enhanced posterior positivity and anterior negativity in the ERPs. Individual-specific variations in the spontaneous viewing duration were consistently correlated with evoked EEG activity amplitudes and pupil size changes. By contrast, presentation order was selectively correlated with baseline alpha power and baseline pupil size. Critically, spontaneous viewing duration was strongly predicted by the temporal stability in neural activity patterns starting as early as 350 msec after image onset, suggesting that early neural stability is a key predictor for sustained perceptual engagement. Interestingly, neither bottom-up nor top-down predictions about image category influenced spontaneous viewing duration. Overall, these results suggest that individual-specific factors can influence perceptual processing at a surprisingly early time point and influence the multifaceted ebb and flow of spontaneous human perceptual behavior in naturalistic settings.

Effects of neural oscillation power and phase on discrimination performance in a visual tilt illusion

Neural oscillations reflect fluctuations in the relative excitation/inhibition of neural systems1,2,3,4,5 and are theorized to play a critical role in canonical neural computations6,7,8,9 and cognitive processes.10,11,12,13,14 These theories have been supported by findings that detection of visual stimuli fluctuates with the phase of oscillations prior to stimulus onset.15,16,17,18,19,20,21,22,23 However, null results have emerged in studies seeking to demonstrate these effects in visual discrimination tasks,24,25,26,27 raising questions about the generalizability of these phenomena to wider neural processes. Recently, we suggested that methodological limitations may mask effects of phase in higher-level sensory processing.28 To test the generality of phasic influences on perception requires a task that involves stimulus discrimination while also depending on early sensory processing. Here, we examined the influence of oscillation phase on the visual tilt illusion, in which a center grating has its perceived orientation biased away from the orientation of a surround grating29 due to lateral inhibitory interactions in early visual processing.30,31,32 We presented center gratings at participants' subjective vertical angle and had participants report whether the grating appeared tilted clockwise or counterclockwise from vertical on each trial while measuring their brain activity with electroencephalography (EEG). In addition to effects of alpha power and aperiodic slope, we observed robust associations between orientation perception and alpha and theta phase, consistent with fluctuating illusion magnitude across the oscillatory cycle. These results confirm that oscillation phase affects the complex processing involved in stimulus discrimination, consistent with its purported role in canonical computations that underpin cognition.

Task demand mediates the interaction of spatial and temporal attention

Psychophysical studies typically test attentional mechanisms in isolation, but in everyday life they interact to optimize human behavior. We investigated whether spatial and temporal attention interact in two orientation discrimination experiments that vary in task demand. We manipulated temporal and spatial attention separately and conjointly with well-established methods for testing each spatial or temporal attention. We assessed sensitivity (d') and reaction time for every combination of spatial and timing cues, each of which was valid, neutral, or invalid. Spatial attention modulated sensitivity (d') and speed (reaction time) across temporal attention conditions. Temporal attention modulated sensitivity and speed under high- but not low- task demands. Furthermore, spatial and temporal attention interacted for the high-demand task. This study reveals that task demand matters; in a simple task spatial attention suffices to improve performance, whereas in a more demanding task both spatial and temporal attention interact to boost performance, albeit in a subadditive fashion.

Impact of relative and absolute values on orienting attention in time

Reward has been known to render the reward-associated stimulus more salient to block effective attentional orienting in space. However, whether and how reward influences goal-directed attention in time remains unclear. Here, we used a modified attentional cueing paradigm to explore the effect of reward on temporal attention, in which the valid targets were given a low monetary reward and invalid targets were given a high monetary reward. The results showed that the temporal cue validity effect was significantly smaller when the competitive reward structure was employed (Experiment 1), and we ruled out the possibility that the results were due to the practice effect (Experiment 2a) or a reward-promoting effect (Experiment 2b). When further strengthening the intensity of the reward from 1:10 to 1:100 (Experiment 3), we found a similar pattern of results to those in Experiment 1. These results suggest that reward information which was based on relative instead of absolute values can weaken, but not reverse, the orienting attention in time.

Internal attention modulates the functional state of novel stimulus-response associations in working memory

Information in working memory (WM) is crucial for guiding behavior. However, not all WM representations are equally relevant simultaneously. Current theoretical frameworks propose a functional dissociation between 'latent' and 'active' states, in which relevant representations are prioritized into an optimal (active) state to face current demands, while relevant information that is not immediately needed is maintained in a dormant (latent) state. In this context, task demands can induce rapid and flexible prioritization of information from latent to active state. Critically, these functional states have been primarily studied using simple visual memories, with attention selecting and prioritizing relevant representations to serve as templates to guide subsequent behavior. It remains unclear whether more complex WM representations, such as novel stimulus-response associations, can also be prioritized into different functional states depending on their task relevance, and if so how these different formats relate to each other. In the present study, we investigated whether novel WM-guided actions can be brought into different functional states depending on current task demands. Our results reveal that planned actions can be flexibly prioritized when needed and show how their functional state modulates their influence on ongoing behavior. Moreover, they suggest the representations of novel actions of different functional states are maintained in WM via a non-orthogonal coding scheme, thus are prone to interference.

An event-termination cue causes perceived time to dilate

The perceived duration of time does not veridically reflect the physical duration but is distorted by various factors, such as the stimulus magnitude or the observer's emotional state. Here, we showed that knowledge about an event's termination time is another significant factor. We often experience time passage differently when we know that an event will terminate soon. To quantify this, we asked 33 university students to report a rotating clock hand's duration with or without a termination cue that indicated the position at which the clock hand disappeared. The results showed that the presence of the termination cue dilated perceived durations, and the dilating effect was larger when the stimulus duration was longer, or the speed of the rotating stimulus was slower. A control experiment with a start-cue excluded the possibility that the cue's mere existence caused the results. Further computational analyses based on the attention theory-of-time perception revealed that the size of dilation is best explained by neither an event's duration nor the distance traveled by the clock hand, but by how long the clock hand spends time near the termination cue. The results imply that an event-termination cue generates a field in which the perceived time dilates.

Prenatal exposure to metal mixtures and childhood temporal processing in the PROGRESS Birth Cohort Study: Modification by childhood obesity

Children are frequently exposed to various biological trace metals, some essential for their development, while others can be potent neurotoxicants. Furthermore, the inflammatory and metabolic conditions associated with obesity may interact with and amplify the impact of metal exposure on neurodevelopment. However, few studies have assessed the potential modification effect of body mass index (BMI). As a result, we investigated the role of child BMI phenotype on the relationship between prenatal exposure to metal mixtures and temporal processing. Leveraging the PROGRESS birth cohort in Mexico City, children (N = 563) aged 6-9 years completed a Temporal Response Differentiation (TRD) task where they had to hold a lever down for 10-14 s. Blood and urinary metal (As, Pb, Cd, and Mn) measurements were collected from mothers in the 2nd and 3rd trimesters. Child BMI z-scores were dichotomized to normal (between -2 and +0.99) and high (≥1.00). Covariate-adjusted weighted quantile sum (WQS) regression models were used to estimate and examine the combined effect of metal biomarkers (i.e., blood and urine) on TRD measures. Effect modification by the child's BMI was evaluated using 2-way interaction terms. Children with a high BMI and greater exposure to the metal mixture during prenatal development exhibited significant temporal processing deficits compared to children with a normal BMI. Notably, children with increased exposure to the metal mixture and higher BMI had a decrease in the percent of tasks completed (β = -10.13; 95 % CI: -19.84, -0.42), number of average holds (β = -2.15; 95 % CI: -3.88, -0.41), longer latency (β = 0.78; 95 % CI: 0.13, 1.44), and greater variability in the standard deviation of the total hold time (β = 2.08; 95 % CI: 0.34, 3.82) compared to normal BMI children. These findings implicate that high BMI may amplify the effect of metals on children's temporal processing. Understanding the relationship between metal exposures, temporal processing, and childhood obesity can provide valuable insights for developing targeted environmental interventions.

Temporal attention recruits fronto-cingulate cortex to amplify stimulus representations

The human brain receives a continuous stream of input, but it faces significant constraints in its ability to process every item in a sequence of stimuli. Voluntary temporal attention can alleviate these constraints by using information about upcoming stimulus timing to selectively prioritize a task-relevant item over others in a sequence. But the neural mechanisms underlying this ability remain unclear. Here, we manipulated temporal attention to successive stimuli in a two-target temporal cueing task, while controlling for temporal expectation by using fully predictable stimulus timing. We recorded magnetoencephalography (MEG) in human observers and measured the effects of temporal attention on orientation representations of each stimulus using time-resolved multivariate decoding in both sensor and source space. Voluntary temporal attention enhanced the orientation representation of the first target 235-300 milliseconds after target onset. Unlike previous studies that did not isolate temporal attention from temporal expectation, we found no evidence that temporal attention enhanced early visual evoked responses. Instead, and unexpectedly, the primary source of enhanced decoding for attended stimuli in the critical time window was a contiguous region spanning left frontal cortex and cingulate cortex. The results suggest that voluntary temporal attention recruits cortical regions beyond the ventral stream at an intermediate processing stage to amplify the representation of a target stimulus, which may serve to protect it from subsequent interference by a temporal competitor.

Exposure to temporal variability promotes subsequent adaptation to new temporal regularities

Noise is intuitively thought to interfere with perceptual learning; However, human and machine learning studies suggest that, in certain contexts, variability may reduce overfitting and improve generalizability. Whereas previous studies have examined the effects of variability in learned stimuli or tasks, it is hitherto unknown what are the effects of variability in the temporal environment. Here, we examined this question in two groups of adult participants (N = 40) presented with visual targets at either random or fixed temporal routines and then tested on the same type of targets at a new nearly-fixed temporal routine. Findings reveal that participants of the random group performed better and adapted quicker following a change in the timing routine, relative to participants of the fixed group. Corroborated with eye-tracking and computational modeling, these findings suggest that prior exposure to temporal variability promotes the formation of new temporal expectations and enhances generalizability in a dynamic environment. We conclude that noise plays an important role in promoting perceptual learning in the temporal domain: rather than interfering with the formation of temporal expectations, noise enhances them. This counterintuitive effect is hypothesized to be achieved through eliminating overfitting and promoting generalizability.

Dissociation between temporal attention and Consciousness: Unconscious temporal cue induces temporal expectation effect

The debate over the independence of attention and consciousness is ongoing. Prior studies have established that invisible spatial cues can direct attention. However, our exploration extends beyond spatial dimensions to temporal information as a potent guide for attention. A intriguing question arises: Can unconscious temporal cues trigger attentional orienting? To investigate, we employed a modified reaction-time task in Experiments 1 and 2, using Gabor stimuli or human facial stimuli as temporal cues rendered invisible through continuous flash suppression. We aimed to uncover temporal expectation effects (TE effects) without conscious awareness. Moreover, Experiments 3 and 4 probed the boundaries of this unconscious processing, assessing whether conscious temporal cues could modulate TE effects. Our results confirm that invisible temporal cues can induce TE effects, and these effects can be overridden by conscious temporal cues. This dissociation between temporal attention and consciousness provide a new perspective on our understanding of their relationship.

When temporal attention interacts with expectation

Temporal attention is voluntarily deployed at specific moments, whereas temporal expectation is deployed according to timing probabilities. When the target appears at an expected moment in a sequence, temporal attention improves performance at the attended moments, but the timing and the precision of the attentional window remain unknown. Here we independently and concurrently manipulated temporal attention-via behavioral relevance-and temporal expectation-via session-wise precision and trial-wise hazard rate-to investigate whether and how these mechanisms interact to improve perception. Our results reveal that temporal attention interacts with temporal expectation-the higher the precision, the stronger the attention benefit, but surprisingly this benefit decreased with delayed onset despite the increasing probability of stimulus appearance. When attention was suboptimally deployed to earlier than expected moments, it could not be reoriented to a later time point. These findings provide evidence that temporal attention and temporal expectation are different mechanisms, and highlight their interplay in optimizing visual performance.

Linking vestibular, tactile, and somatosensory rhythm perception to language development in infancy

First experiences with rhythm occur in the womb, with different rhythmic sources being available to the human fetus. Among sensory modalities, vestibular, tactile, and somatosensory perception plays a crucial role in early processing. However, a limited number of studies so far have specifically focused on VTS rhythms in language development. The present work investigated VTS rhythmic abilities and their role in language acquisition through two experiments with 45 infants (21 females, sex assigned at birth; M age = 661.6 days, SD = 192.6) with middle/high socioeconomic status. Specifically, 37 infants from the original sample completed Experiment 1, assessing VTS rhythmic abilities through a vibrotactile tool for music perception. In Experiment 2, linguistic abilities were evaluated in 40 participants from the same cohort, specifically testing phonological and prosodic processing. Discrimination abilities for rhythmic and linguistic stimuli were inferred from changes in pupil diameter to contingent visual stimuli over time, through a Tobii X-60 eye-tracker. The predictive effect of VTS rhythmic abilities on linguistic processing and the developmental changes occurring across ages were explored in the 32 infants who completed both Experiments 1 and 2 by means of generalized, additive and linear, mixed-effect models. Results are discussed in terms of cross-sensory (i.e., haptic to hearing) and cross-domain (i.e., music to language) effects of rhythm on language acquisition, with implications for typical and atypical development.

Temporal unpredictability increases error monitoring as revealed by EEG-EMG investigation

Reacting in an unpredictable context increases error monitoring as evidenced by greater error-related negativity (ERN), an electrophysiological marker linked to an evaluation of response outcomes. We investigated whether ERN also increased when participants evaluated their responses to events that appeared in unpredictable versus predictable moments in time. We complemented electroencephalographic (EEG) analysis of cortical activity by measuring performance monitoring processes at the peripheral level using electromyography (EMG). Specifically, we used EMG data to quantify how temporal unpredictability would affect motor time (MT), the interval between the onset of muscle activity, and the mechanical response. MT increases following errors, indexing online error detection, and an attempt to stop incorrect actions. In our temporally cued version of the stop-signal task, symbolic cues predicted (temporally predictable condition) or not (temporally unpredictable condition) the onset of a target. In 25% of trials, an auditory signal occurred shortly after the target presentation, informing participants that they should inhibit their response completely. Response times were slower, and fewer inhibitory errors were made during temporally unpredictable than predictable trials, indicating enhanced control of unwanted actions when target onset time was unknown. Importantly, the ERN to inhibitory errors was greater in temporally unpredictable relative to temporally predictable conditions. Similarly, EMG data revealed prolonged MT when reactions to temporally unpredictable targets had not been stopped. Taken together, our results show that a temporally unpredictable environment increases the control of unwanted actions, both at cortical and peripheral levels, suggesting a higher subjective cost of maladaptive responses to temporally uncertain events.

Time for What? Dissociating Explicit Timing Tasks through Electrophysiological Signatures

Estimating durations between hundreds of milliseconds and seconds is essential for several daily tasks. Explicit timing tasks, which require participants to estimate durations to make a comparison (time for perception) or to reproduce them (time for action), are often used to investigate psychological and neural timing mechanisms. Recent studies have proposed that mechanisms may depend on specific task requirements. In this study, we conducted electroencephalogram (EEG) recordings on human participants as they estimated intervals in different task contexts to investigate the extent to which timing mechanisms depend on the nature of the task. We compared the neural processing of identical visual reference stimuli in two different tasks, in which stimulus durations were either perceptually compared or motorically reproduced in separate experimental blocks. Using multivariate pattern analyses, we could successfully decode the duration and the task of reference stimuli. We found evidence for both overlapping timing mechanisms across tasks as well as recruitment of task-dependent processes for comparing intervals for different purposes. Our findings suggest both core and specialized timing functions are recruited to support explicit timing tasks.

Short-Term Effect of Auditory Stimulation on Neural Activities: A Scoping Review of Longitudinal Electroencephalography and Magnetoencephalography Studies

Explored through EEG/MEG, auditory stimuli function as a suitable research probe to reveal various neural activities, including event-related potentials, brain oscillations and functional connectivity. Accumulating evidence in this field stems from studies investigating neuroplasticity induced by long-term auditory training, specifically cross-sectional studies comparing musicians and non-musicians as well as longitudinal studies with musicians. In contrast, studies that address the neural effects of short-term interventions whose duration lasts from minutes to hours are only beginning to be featured. Over the past decade, an increasing body of evidence has shown that short-term auditory interventions evoke rapid changes in neural activities, and oscillatory fluctuations can be observed even in the prestimulus period. In this scoping review, we divided the extracted neurophysiological studies into three groups to discuss neural activities with short-term auditory interventions: the pre-stimulus period, during stimulation, and a comparison of before and after stimulation. We show that oscillatory activities vary depending on the context of the stimuli and are greatly affected by the interplay of bottom-up and top-down modulational mechanisms, including attention. We conclude that the observed rapid changes in neural activitiesin the auditory cortex and the higher-order cognitive part of the brain are causally attributed to short-term auditory interventions.

What is a Rhythm for the Brain? The Impact of Contextual Temporal Variability on Auditory Perception

Temporal predictions can be formed and impact perception when sensory timing is fully predictable: for instance, the discrimination of a target sound is enhanced if it is presented on the beat of an isochronous rhythm. However, natural sensory stimuli, like speech or music, are not entirely predictable, but still possess statistical temporal regularities. We investigated whether temporal expectations can be formed in non-fully predictable contexts, and how the temporal variability of sensory contexts affects auditory perception. Specifically, we asked how "rhythmic" an auditory stimulation needs to be in order to observe temporal predictions effects on auditory discrimination performances. In this behavioral auditory oddball experiment, participants listened to auditory sound sequences where the temporal interval between each sound was drawn from gaussian distributions with distinct standard deviations. Participants were asked to discriminate sounds with a deviant pitch in the sequences. Auditory discrimination performances, as measured with deviant sound discrimination accuracy and response times, progressively declined as the temporal variability of the sound sequence increased. Moreover, both global and local temporal statistics impacted auditory perception, suggesting that temporal statistics are promptly integrated to optimize perception. Altogether, these results suggests that temporal predictions can be set up quickly based on the temporal statistics of past sensory events and are robust to a certain amount of temporal variability. Therefore, temporal predictions can be built on sensory stimulations that are not purely periodic nor temporally deterministic.

Terms of debate: Consensus definitions to guide the scientific discourse on visual distraction

Hypothesis-driven research rests on clearly articulated scientific theories. The building blocks for communicating these theories are scientific terms. Obviously, communication - and thus, scientific progress - is hampered if the meaning of these terms varies idiosyncratically across (sub)fields and even across individual researchers within the same subfield. We have formed an international group of experts representing various theoretical stances with the goal to homogenize the use of the terms that are most relevant to fundamental research on visual distraction in visual search. Our discussions revealed striking heterogeneity and we had to invest much time and effort to increase our mutual understanding of each other's use of central terms, which turned out to be strongly related to our respective theoretical positions. We present the outcomes of these discussions in a glossary and provide some context in several essays. Specifically, we explicate how central terms are used in the distraction literature and consensually sharpen their definitions in order to enable communication across theoretical standpoints. Where applicable, we also explain how the respective constructs can be measured. We believe that this novel type of adversarial collaboration can serve as a model for other fields of psychological research that strive to build a solid groundwork for theorizing and communicating by establishing a common language. For the field of visual distraction, the present paper should facilitate communication across theoretical standpoints and may serve as an introduction and reference text for newcomers.

Interdependence of "What" and "When" in the Brain

From a brain's-eye-view, when a stimulus occurs and what it is are interrelated aspects of interpreting the perceptual world. Yet in practice, the putative perceptual inferences about sensory content and timing are often dichotomized and not investigated as an integrated process. We here argue that neural temporal dynamics can influence what is perceived, and in turn, stimulus content can influence the time at which perception is achieved. This computational principle results from the highly interdependent relationship of what and when in the environment. Both brain processes and perceptual events display strong temporal variability that is not always modeled; we argue that understanding-and, minimally, modeling-this temporal variability is key for theories of how the brain generates unified and consistent neural representations and that we ignore temporal variability in our analysis practice at the peril of both data interpretation and theory-building. Here, we review what and when interactions in the brain, demonstrate via simulations how temporal variability can result in misguided interpretations and conclusions, and outline how to integrate and synthesize what and when in theories and models of brain computation.

Probing Beat Perception with Event-Related Potentials (ERPs) in Human Adults, Newborns, and Nonhuman Primates

The aim of this chapter is to give an overview of how the perception of rhythmic temporal regularity such as a regular beat in music can be studied in human adults, human newborns, and nonhuman primates using event-related brain potentials (ERPs). First, we discuss different aspects of temporal structure in general, and musical rhythm in particular, and we discuss the possible mechanisms underlying the perception of regularity (e.g., a beat) in rhythm. Additionally, we highlight the importance of dissociating beat perception from the perception of other types of structure in rhythm, such as predictable sequences of temporal intervals, ordinal structure, and rhythmic grouping. In the second section of the chapter, we start with a discussion of auditory ERPs elicited by infrequent and frequent sounds: ERP responses to regularity violations, such as mismatch negativity (MMN), N2b, and P3, as well as early sensory responses to sounds, such as P1 and N1, have been shown to be instrumental in probing beat perception. Subsequently, we discuss how beat perception can be probed by comparing ERP responses to sounds in regular and irregular sequences, and by comparing ERP responses to sounds in different metrical positions in a rhythm, such as on and off the beat or on strong and weak beats. Finally, we will discuss previous research that has used the aforementioned ERPs and paradigms to study beat perception in human adults, human newborns, and nonhuman primates. In doing so, we consider the possible pitfalls and prospects of the technique, as well as future perspectives.

Assessing the predictions from Posner's theory of phasic alertness using data from Los and Schut (2008)

Alertness has been construed as one of three fundamental components of attention. When generated by a warning signal, phasic changes in alertness ubiquitously decrease reaction time. But how does it do so? Based on earlier findings, in 1975, Posner proposed a theory of phasic alertness with two postulates: (i) phasic alertness does not affect the accumulation of information; (ii) phasic alertness accelerates when a response based on the accumulating information will be generated. When targets are continuously presented, this theory predicts that alertness will reduce reaction at the expense of an increase in errors-that is, generate a speed-accuracy trade-off. Los and Schut, Cognitive Psychology, 57, 20-55, (2008), while endorsing Posner's theory, claimed to have failed to replicated the tell-tale trade-off reported by Posner et al. Memory and Cognition, 1, 2-12, (1973, Experiment 1). The primary goal of this commentary was to use all the data from Los and Schut to see if the predicted speed-accuracy trade-off would be verified or not. With the increased power, it was confirmed that the conditions that benefited the most in reaction time from alertness also had higher error rates. It is noteworthy that recent studies have generated replications and extensions of the methods and findings of Posner et al; thus, it appears that the empirical pattern predicted by Posner's theory of phasic alertness is relatively robust.

The Motor of Time: Coupling Action to Temporally Predictable Events Heightens Perception

Timing and motor function share neural circuits and dynamics, which underpin their close and synergistic relationship. For instance, the temporal predictability of a sensory event optimizes motor responses to that event. Knowing when an event is likely to occur lowers response thresholds, leading to faster and more efficient motor behavior though in situations of response conflict can induce impulsive and inappropriate responding. In turn, through a process of active sensing, coupling action to temporally predictable sensory input enhances perceptual processing. Action not only hones perception of the event's onset or duration, but also boosts sensory processing of its non-temporal features such as pitch or shape. The effects of temporal predictability on motor behavior and sensory processing involve motor and left parietal cortices and are mediated by changes in delta and beta oscillations in motor areas of the brain.

Dopamine dysregulation in Parkinson's disease flattens the pleasurable urge to move to musical rhythms

The pleasurable urge to move to music (PLUMM) activates motor and reward areas of the brain and is thought to be driven by predictive processes. Dopamine in motor and limbic networks is implicated in beat-based timing and music-induced pleasure, suggesting a central role of basal ganglia (BG) dopaminergic systems in PLUMM. This study tested this hypothesis by comparing PLUMM in participants with Parkinson's disease (PD), age-matched controls, and young controls. Participants listened to musical sequences with varying rhythmic and harmonic complexity (low, medium and high), and rated their experienced pleasure and urge to move to the rhythm. In line with previous results, healthy younger participants showed an inverted U-shaped relationship between rhythmic complexity and ratings, with preference for medium complexity rhythms, while age-matched controls showed a similar, but weaker, inverted U-shaped response. Conversely, PD showed a significantly flattened response for both the urge to move and pleasure. Crucially, this flattened response could not be attributed to differences in rhythm discrimination and did not reflect an overall decrease in ratings. For harmonic complexity, PD showed a negative linear pattern for both the urge to move and pleasure while healthy age-matched controls showed the same pattern for pleasure and an inverted U for the urge to move. This contrasts with the pattern observed in young healthy controls in previous studies, suggesting that both healthy aging and PD also influence affective responses to harmonic complexity. Together, these results support the role of dopamine within cortico-striatal circuits in the predictive processes that form the link between the perceptual processing of rhythmic patterns and the affective and motor responses to rhythmic music.

Temporal Information Processing in the Cerebellum and Basal Ganglia

Temporal information processing in the range of a few hundred milliseconds to seconds involves the cerebellum and basal ganglia. In this chapter, we present recent studies on nonhuman primates. In the studies presented in the first half of the chapter, monkeys were trained to make eye movements when a certain amount of time had elapsed since the onset of the visual cue (time production task). The animals had to report time lapses ranging from several hundred milliseconds to a few seconds based on the color of the fixation point. In this task, the saccade latency varied with the time length to be measured and showed stochastic variability from one trial to the other. Trial-to-trial variability under the same conditions correlated well with pupil diameter and the preparatory activity in the deep cerebellar nuclei and the motor thalamus. Inactivation of these brain regions delayed saccades when asked to report subsecond intervals. These results suggest that the internal state, which changes with each trial, may cause fluctuations in cerebellar neuronal activity, thereby producing variations in self-timing. When measuring different time intervals, the preparatory activity in the cerebellum always begins approximately 500 ms before movements, regardless of the length of the time interval being measured. However, the preparatory activity in the striatum persists throughout the mandatory delay period, which can be up to 2 s, with different rate of increasing activity. Furthermore, in the striatum, the visual response and low-frequency oscillatory activity immediately before time measurement were altered by the length of the intended time interval. These results indicate that the state of the network, including the striatum, changes with the intended timing, which lead to different time courses of preparatory activity. Thus, the basal ganglia appear to be responsible for measuring time in the range of several hundred milliseconds to seconds, whereas the cerebellum is responsible for regulating self-timing variability in the subsecond range. The second half of this chapter presents studies related to periodic timing. During eye movements synchronized with alternating targets at regular intervals, different neurons in the cerebellar nuclei exhibit activity related to movement timing, predicted stimulus timing, and the temporal error of synchronization. Among these, the activity associated with target appearance is particularly enhanced during synchronized movements and may represent an internal model of the temporal structure of stimulus sequence. We also considered neural mechanism underlying the perception of periodic timing in the absence of movement. During perception of rhythm, we predict the timing of the next stimulus and focus our attention on that moment. In the missing oddball paradigm, the subjects had to detect the omission of a regularly repeated stimulus. When employed in humans, the results show that the fastest temporal limit for predicting each stimulus timing is about 0.25 s (4 Hz). In monkeys performing this task, neurons in the cerebellar nuclei, striatum, and motor thalamus exhibit periodic activity, with different time courses depending on the brain region. Since electrical stimulation or inactivation of recording sites changes the reaction time to stimulus omission, these neuronal activities must be involved in periodic temporal processing. Future research is needed to elucidate the mechanism of rhythm perception, which appears to be processed by both cortico-cerebellar and cortico-basal ganglia pathways.

Cerebellar Direct Current Stimulation Reveals the Causal Role of the Cerebellum in Temporal Prediction

Temporal prediction (TP) influences our perception and cognition. The cerebellum could mediate this multi-level ability in a context-dependent manner. We tested whether a modulation of the cerebellar neural activity, induced by transcranial Direct Current Stimulation (tDCS), changed the TP ability according to the temporal features of the context and the duration of target interval. Fifteen healthy participants received anodal, cathodal, and sham tDCS (15 min × 2 mA intensity) over the right cerebellar hemisphere during a TP task. We recorded reaction times (RTs) to a target during the task in two contextual conditions of temporal anticipation: rhythmic (i.e., interstimulus intervals (ISIs) were constant) and single-interval condition (i.e., the estimation of the timing of the target was based on the prior exposure of the train of stimuli). Two ISIs durations were explored: 600 ms (short trials) and 900 ms (long trials). Cathodal tDCS improved the performance during the TP task (shorter RTs) specifically in the rhythmic condition only for the short trials and in the single-interval condition only for the long trials. Our results suggest that the inhibition of cerebellar activity induced a different improvement in the TP ability according to the temporal features of the context. In the rhythmic context, the cerebellum could integrate the temporal estimation with the anticipatory motor responses critically for the short target interval. In the single-interval context, for the long trials, the cerebellum could play a main role in integrating representation of time interval in memory with the elapsed time providing an accurate temporal prediction.

Sequential effect and temporal orienting in prestimulus oculomotor inhibition

When faced with unfamiliar circumstances, we often turn to our past experiences with similar situations to shape our expectations. This results in the well-established sequential effect, in which previous trials influence the expectations of the current trial. Studies have revealed that, in addition to the classical behavioral metrics, the inhibition of eye movement could be used as a biomarker to study temporal expectations. This prestimulus oculomotor inhibition is found a few hundred milliseconds prior to predictable events, with a stronger inhibition for predictable than unpredictable events. The phenomenon has been found to occur in various temporal structures, such as rhythms, cue-association, and conditional probability, yet it is still unknown whether it reflects local sequential information of the previous trial. To explore this, we examined the relationship between the sequential effect and the prestimulus oculomotor inhibition. Our results (N = 40) revealed that inhibition was weaker when the previous trial was longer than the current trial, in line with findings of behavioral metrics. These findings indicate that the prestimulus oculomotor inhibition covaries with expectation based on local sequential information, demonstrating the tight connection between this phenomenon and expectation and providing a novel measurement for studying sequential effects in temporal expectation.

Null effects of temporal prediction on recognition memory but evidence for differential neural activity at encoding. A registered report

Previous research has demonstrated that rhythmic presentation of stimuli during encoding boosts subsequent recognition and is associated with distinct neural activity compared with when stimuli are presented in an arrhythmic manner. However, it is unclear whether the effect is driven by automatic entrainment to rhythm or non-rhythmic temporal prediction. This registered report presents an Electroencephalographic (EEG) study aimed at establishing the cognitive and neural mechanisms of the effect of temporal prediction on recognition. In a blocked design, stimulus onset during encoding was systematically manipulated in four conditions prior to recognition testing: rhythmic fixed (RF), rhythmic variable (RV), arrhythmic fixed (AF), and arrhythmic variable (AV). By orthogonally varying rhythm and temporal position we were able to assess their independent contributions to recognition enhancement. Our behavioural results did not replicate previous findings that show a difference in recognition memory based on temporal predictability at encoding. However, event-related potential (ERP) component analysis did show an early (N1) interaction effect of temporal position and rhythm, and later (N2 and Dm) effects driven by temporal position only. Taken together, we observed effects of temporal prediction at encoding, but these differences did not translate to later effects of memory, suggesting that effects of temporal prediction on recognition are less robust than previously thought.

Attention to space and time: Independent or interactive systems? A narrative review

While there is ample evidence for the ability to selectively attend to where in space and when in time a relevant event might occur, it remains poorly understood whether spatial and temporal attention operate independently or interactively to optimize behavior. To elucidate this important issue, we provide a narrative review of the literature investigating the relationship between the two. The studies were organized based on the attentional manipulation employed (endogenous vs. exogenous) and the type of task (detection vs. discrimination). Although the reviewed findings depict a complex scenario, three aspects appear particularly important in promoting independent or interactive effects of spatial and temporal attention: task demands, attentional manipulation, and their combination. Overall, the present review provides key insights into the relationship between spatial and temporal attention and identifies some critical gaps that need to be addressed by future research.

Rhythmic temporal prediction enhances neural representations of movement intention for brain-computer interface

Objective.Detecting movement intention is a typical use of brain-computer interfaces (BCI). However, as an endogenous electroencephalography (EEG) feature, the neural representation of movement is insufficient for improving motor-based BCI. This study aimed to develop a new movement augmentation BCI encoding paradigm by incorporating the cognitive function of rhythmic temporal prediction, and test the feasibility of this new paradigm in optimizing detections of movement intention.Methods.A visual-motion synchronization task was designed with two movement intentions (left vs. right) and three rhythmic temporal prediction conditions (1000 ms vs. 1500 ms vs. no temporal prediction). Behavioural and EEG data of 24 healthy participants were recorded. Event-related potentials (ERPs), event-related spectral perturbation induced by left- and right-finger movements, the common spatial pattern (CSP) and support vector machine, Riemann tangent space algorithm and logistic regression were used and compared across the three temporal prediction conditions, aiming to test the impact of temporal prediction on movement detection.Results.Behavioural results showed significantly smaller deviation time for 1000 ms and 1500 ms conditions. ERP analyses revealed 1000 ms and 1500 ms conditions led to rhythmic oscillations with a time lag in contralateral and ipsilateral areas of movement. Compared with no temporal prediction, 1000 ms condition exhibited greater beta event-related desynchronization (ERD) lateralization in motor area (P< 0.001) and larger beta ERD in frontal area (P< 0.001). 1000 ms condition achieved an averaged left-right decoding accuracy of 89.71% using CSP and 97.30% using Riemann tangent space, both significantly higher than no temporal prediction. Moreover, movement and temporal information can be decoded simultaneously, achieving 88.51% four-classification accuracy.Significance.The results not only confirm the effectiveness of rhythmic temporal prediction in enhancing detection ability of motor-based BCI, but also highlight the dual encodings of movement and temporal information within a single BCI paradigm, which is promising to expand the range of intentions that can be decoded by the BCI.

Time for Memories

The ability to store information about the past to dynamically predict and prepare for the future is among the most fundamental tasks the brain performs. To date, the problems of understanding how the brain stores and organizes information about the past (memory) and how the brain represents and processes temporal information for adaptive behavior have generally been studied as distinct cognitive functions. This Symposium explores the inherent link between memory and temporal cognition, as well as the potential shared neural mechanisms between them. We suggest that working memory and implicit timing are interconnected and may share overlapping neural mechanisms. Additionally, we explore how temporal structure is encoded in associative and episodic memory and, conversely, the influences of episodic memory on subsequent temporal anticipation and the perception of time. We suggest that neural sequences provide a general computational motif that contributes to timing and working memory, as well as the spatiotemporal coding and recall of episodes.

N1-P2 event-related potentials and perceived intensity are associated: The effects of a weak pre-stimulus and attentional load on processing of a subsequent intense stimulus

A weak stimulus presented immediately before a more intense one reduces both the N1-P2 cortical response and the perceived intensity of the intense stimulus. The former effect is referred to as cortical prepulse inhibition (PPI), the latter as prepulse inhibition of perceived stimulus intensity (PPIPSI). Both phenomena are used to study sensory gating in clinical and non-clinical populations, however little is known about their relationship. Here, we investigated 1) the possibility that cortical PPI and PPIPSI are associated, and 2) how they are affected by attentional load. Participants were tasked with comparing the intensity of an electric pulse presented alone versus one preceded 200 ms by a weaker electric prepulse (Experiment 1), or an acoustic pulse presented alone with one preceded 170 ms by a weaker acoustic prepulse (Experiment 2). A counting task (easy vs. hard) manipulating attentional load was included in Experiment 2. In both experiments, we observed a relationship between N1-P2 amplitude and perceived intensity, where greater cortical PPI was associated with a higher probability of perceiving the 'pulse with prepulse' as less intense. Moreover, higher attentional load decreased observations of PPIPSI but had no effect on N1-P2 amplitude. Based on the findings we propose that PPIPSI partially relies on the allocation of attentional resources towards monitoring cortical channels that process stimulus intensity characteristics such as the N1-P2 complex.

Predictability awareness rather than mere predictability enhances the perceptual benefits for targets in auditory rhythms over targets following temporal cues

Sounds following a cue or embedded in a periodic rhythm are processed more effectively than sounds that are part of an aperiodic rhythm. One might also expect that a sound embedded in a periodic rhythm is processed more effectively than a sound following a single temporal cue. Such a finding would follow the theory that the entrainment of neural rhythmic activity by periodic stimuli renders the prediction of upcoming stimuli more efficient. We conducted a psychophysical experiment in which we tested the behavioral elements of this idea. Targets in periodic and aperiodic rhythms, if they occurred, always appeared at the same moment in time, and thus were fully predictable. In a first condition, participants remained unaware of this. In a second condition, an explicit instruction on the temporal location of the targets embedded in rhythms was provided. We assessed sensitivity and reaction times to the target stimuli in a difficult temporal detection task, and contrasted performance in this task to that obtained for targets temporally cued by a single preceding cue. Irrespective of explicit information about target predictability, target detection performance was always better in the periodic and temporal cue conditions, compared to the aperiodic condition. However, we found that the mere predictability of an acoustic target within a periodic rhythm did not allow participants to detect the target any better than in a condition where the target's timing was predicted by a single temporal cue. Only when participants were made aware of the specific moment in the periodic rhythm where the target could occur, did sensitivity increase. This finding suggests that a periodic rhythm is not automatically sufficient to provide perceptual benefits compared to a condition predictable yet not rhythmic condition (a cue). In some conditions, as shown here, these benefits may only occur in interaction with other factors such as explicit instruction and directed attention.

Spontaneous α Brain Dynamics Track the Episodic "When"

Across species, neurons track time over the course of seconds to minutes, which may feed the sense of time passing. Here, we asked whether neural signatures of time-tracking could be found in humans. Participants stayed quietly awake for a few minutes while being recorded with magnetoencephalography (MEG). They were unaware they would be asked how long the recording lasted (retrospective time) or instructed beforehand to estimate how long it will last (prospective timing). At rest, rhythmic brain activity is nonstationary and displays bursts of activity in the alpha range (α: 7-14 Hz). When participants were not instructed to attend to time, the relative duration of α bursts linearly predicted individuals' retrospective estimates of how long their quiet wakefulness lasted. The relative duration of α bursts was a better predictor than α power or burst amplitude. No other rhythmic or arrhythmic activity predicted retrospective duration. However, when participants timed prospectively, the relative duration of α bursts failed to predict their duration estimates. Consistent with this, the amount of α bursts was discriminant between prospective and retrospective timing. Last, with a control experiment, we demonstrate that the relation between α bursts and retrospective time is preserved even when participants are engaged in a visual counting task. Thus, at the time scale of minutes, we report that the relative time of spontaneous α burstiness predicts conscious retrospective time. We conclude that in the absence of overt attention to time, α bursts embody discrete states of awareness constitutive of episodic timing.SIGNIFICANCE STATEMENT The feeling that time passes is a core component of consciousness and episodic memory. A century ago, brain rhythms called "α" were hypothesized to embody an internal clock. However, rhythmic brain activity is nonstationary and displays on-and-off oscillatory bursts, which would serve irregular ticks to the hypothetical clock. Here, we discovered that in a given lapse of time, the relative bursting time of α rhythms is a good indicator of how much time an individual will report to have elapsed. Remarkably, this relation only holds true when the individual does not attend to time and vanishes when attending to it. Our observations suggest that at the scale of minutes, α brain activity tracks episodic time.

Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism

Introduction

Semantic segmentation is a crucial visual representation learning task for autonomous driving systems, as it enables the perception of surrounding objects and road conditions to ensure safe and efficient navigation.

Methods

In this paper, we present a novel semantic segmentation approach for autonomous driving scenes using a Multi-Scale Adaptive Mechanism (MSAAM). The proposed method addresses the challenges associated with complex driving environments, including large-scale variations, occlusions, and diverse object appearances. Our MSAAM integrates multiple scale features and adaptively selects the most relevant features for precise segmentation. We introduce a novel attention module that incorporates spatial, channel-wise and scale-wise attention mechanisms to effectively enhance the discriminative power of features.

Results

The experimental results of the model on key objectives in the Cityscapes dataset are: ClassAvg:81.13, mIoU:71.46. The experimental results on comprehensive evaluation metrics are: AUROC:98.79, AP:68.46, FPR95:5.72. The experimental results in terms of computational cost are: GFLOPs:2117.01, Infer. Time (ms):61.06. All experimental results data are superior to the comparative method model.

Discussion

The proposed method achieves superior performance compared to state-of-the-art techniques on several benchmark datasets demonstrating its efficacy in addressing the challenges of autonomous driving scene understanding.

Theta Signal Transfer from Parietal to Prefrontal Cortex Ignites Conscious Awareness of Implicit Knowledge during Sequence Learning

Unconscious acquisition of sequence structure from experienced events can lead to explicit awareness of the pattern through extended practice. Although the implicit-to-explicit transition has been extensively studied in humans using the serial reaction time (SRT) task, the subtle neural activity supporting this transition remains unclear. Here, we investigated whether frequency-specific neural signal transfer contributes to this transition. A total of 208 participants (107 females) learned a sequence pattern through a multisession SRT task, allowing us to observe the transitions. Session-by-session measures of participants' awareness for sequence knowledge were conducted during the SRT task to identify the session when the transition occurred. By analyzing time course RT data using switchpoint modeling, we identified an increase in learning benefit specifically at the transition session. Electroencephalogram (EEG)/magnetoencephalogram (MEG) recordings revealed increased theta power in parietal (precuneus) regions one session before the transition (pretransition) and a prefrontal (superior frontal gyrus; SFG) one at the transition session. Phase transfer entropy (PTE) analysis confirmed that directional theta transfer from precuneus → SFG occurred at the pretransition session and its strength positively predicted learning improvement at the subsequent transition session. Furthermore, repetitive transcranial magnetic stimulation (TMS) modulated precuneus theta power and altered transfer strength from precuneus to SFG, resulting in changes in both transition rate and learning benefit at that specific point of transition. Our brain-stimulation evidence supports a role for parietal → prefrontal theta signal transfer in igniting conscious awareness of implicitly acquired knowledge.SIGNIFICANCE STATEMENT There exists a pervasive phenomenon wherein individuals unconsciously acquire sequence patterns from their environment, gradually becoming aware of the underlying regularities through repeated practice. While previous studies have established the robustness of this implicit-to-explicit transition in humans, the refined neural mechanisms facilitating conscious access to implicit knowledge remain poorly understood. Here, we demonstrate that prefrontal activity, known to be crucial for conscious awareness, is triggered by neural signal transfer originating from the posterior brain region, specifically the precuneus. By employing brain stimulation techniques, we establish a causal link between neural signal transfer and the occurrence of awareness. Our findings unveil a mechanism by which implicit knowledge becomes consciously accessible in human cognition.

Rhythm contour drives musical memory

Listeners' use of contour information as a basis for memory of rhythmic patterns was explored in two experiments. Both studies employed a short-term memory paradigm in which listeners heard a standard rhythm, followed by a comparison rhythm, and judged whether the comparison was the same as the standard. Comparison rhythms included exact repetitions of the standard, same contour rhythms in which the relative interval durations of successive notes (but not the absolute durations of the notes themselves) were the same as the standard, and different contour rhythms in which the relative duration intervals of successive notes differed from the standard. Experiment 1 employed metric rhythms, whereas Experiment 2 employed ametric rhythms. D-prime analyses revealed that, in both experiments, listeners showed better discrimination for different contour rhythms relative to same contour rhythms. Paralleling classic work on melodic contour, these findings indicate that the concept of contour is both relevant to one's characterization of the rhythm of musical patterns and influences short-term memory for such patterns.

Cross-modal implicit learning of random time patterns

Perception is sensitive to statistical regularities in the environment, including temporal characteristics of sensory inputs. Interestingly, implicit learning of temporal patterns in one modality can also improve their processing in another modality. However, it is unclear how cross-modal learning transfer affects neural responses to sensory stimuli. Here, we recorded neural activity of human volunteers using electroencephalography (EEG), while participants were exposed to brief sequences of randomly timed auditory or visual pulses. Some trials consisted of a repetition of the temporal pattern within the sequence, and subjects were tasked with detecting these trials. Unknown to the participants, some trials reappeared throughout the experiment across both modalities (Transfer) or only within a modality (Control), enabling implicit learning in one modality and its transfer. Using a novel method of analysis of single-trial EEG responses, we showed that learning temporal structures within and across modalities is reflected in neural learning curves. These putative neural correlates of learning transfer were similar both when temporal information learned in audition was transferred to visual stimuli and vice versa. The modality-specific mechanisms for learning of temporal information and general mechanisms which mediate learning transfer across modalities had distinct physiological signatures: temporal learning within modalities relied on modality-specific brain regions while learning transfer affected beta-band activity in frontal regions.

"What" and "when" predictions modulate auditory processing in a mutually congruent manner

Introduction

Extracting regularities from ongoing stimulus streams to form predictions is crucial for adaptive behavior. Such regularities exist in terms of the content of the stimuli and their timing, both of which are known to interactively modulate sensory processing. In real-world stimulus streams such as music, regularities can occur at multiple levels, both in terms of contents (e.g., predictions relating to individual notes vs. their more complex groups) and timing (e.g., pertaining to timing between intervals vs. the overall beat of a musical phrase). However, it is unknown whether the brain integrates predictions in a manner that is mutually congruent (e.g., if "beat" timing predictions selectively interact with "what" predictions falling on pulses which define the beat), and whether integrating predictions in different timing conditions relies on dissociable neural correlates.

Methods

To address these questions, our study manipulated "what" and "when" predictions at different levels - (local) interval-defining and (global) beat-defining - within the same stimulus stream, while neural activity was recorded using electroencephalogram (EEG) in participants (N = 20) performing a repetition detection task.

Results

Our results reveal that temporal predictions based on beat or interval timing modulated mismatch responses to violations of "what" predictions happening at the predicted time points, and that these modulations were shared between types of temporal predictions in terms of the spatiotemporal distribution of EEG signals. Effective connectivity analysis using dynamic causal modeling showed that the integration of "what" and "when" predictions selectively increased connectivity at relatively late cortical processing stages, between the superior temporal gyrus and the fronto-parietal network.

Discussion

Taken together, these results suggest that the brain integrates different predictions with a high degree of mutual congruence, but in a shared and distributed cortical network. This finding contrasts with recent studies indicating separable mechanisms for beat-based and memory-based predictive processing.

How Does Temporal Blurring Alter Movement Timing?

Subjective uncertainty arises because the estimation of the timing of an event into the future is error prone. This impact of stimulus-bound uncertainty on movement preparation has often been investigated using reaction time tasks where a warning stimulus (WS) predicts the occurrence of a "go" signal. The timing of the "go" signal can be chosen from a particular probability distribution with a given variance or uncertainty. It has been repeatedly shown that reaction times covary with the shape of the used "go" signal distribution. This is interpreted as evidence for temporal preparation. Moreover, the variance of the response time should always increase with the duration of the delay between the WS and the "go" signal. This increasing variance has been interpreted as a consequence of the temporal "blurring" of future events (scalar expectancy). The present paper tested the validity of the temporal "blurring" hypothesis in humans with a simple oculomotor reaction time task where subjective and stimulus-bound uncertainties were increased. Subjective uncertainty about the timing of a "go" signal was increased by lengthening the delay between the WS and the "go" signal. Objective uncertainty was altered by increasing the variance of "go" signal timing. Contrary to temporal blurring hypotheses, the study has shown that increasing the delay between events did not significantly increase movement timing variability. These results suggest that temporal blurring could not be a property of movement timing in an implicit timing context.

Alpha oscillations protect working memory against distracters in a modality-specific way

Alpha oscillations are thought to be involved in suppressing distracting input in working-memory tasks. Yet, the spatial-temporal dynamics of such suppression remain unclear. Key questions are whether such suppression reflects a domain-general inattentiveness mechanism, or occurs in a stimulus- or modality-specific manner within cortical areas most responsive to the distracters; and whether the suppression is proactive (i.e., preparatory) or reactive. Here, we addressed these questions using a working-memory task where participants had to memorize an array of visually presented digits and reproduce one of them upon being probed. We manipulated the presence of distracters and the sensory modality in which distracters were presented during memory maintenance. Our results show that sensory areas most responsive to visual and auditory distracters exhibited stronger alpha power increase after visual and auditory distracter presentation respectively. These results suggest that alpha oscillations underlie distracter suppression in a reactive, modality-specific manner.

Dissociated amplitude and phase effects of alpha oscillation in a nested structure of rhythm- and sequence-based temporal expectation

The human brain can utilize various information to form temporal expectations and optimize perceptual performance. Here we show dissociated amplitude and phase effects of prestimulus alpha oscillation in a nested structure of rhythm- and sequence-based expectation. A visual stream of rhythmic stimuli was presented in a fixed sequence such that their temporal positions could be predicted by either the low-frequency rhythm, the sequence, or the combination. The behavioral modeling indicated that rhythmic and sequence information additively led to increased accumulation speed of sensory evidence and alleviated threshold for the perceptual discrimination of the expected stimulus. The electroencephalographical results showed that the alpha amplitude was modulated mainly by rhythmic information, with the amplitude fluctuating with the phase of the low-frequency rhythm (i.e. phase-amplitude coupling). The alpha phase, however, was affected by both rhythmic and sequence information. Importantly, rhythm-based expectation improved the perceptual performance by decreasing the alpha amplitude, whereas sequence-based expectation did not further decrease the amplitude on top of rhythm-based expectation. Moreover, rhythm-based and sequence-based expectations collaboratively improved the perceptual performance by biasing the alpha oscillation toward the optimal phase. Our findings suggested flexible coordination of multiscale brain oscillations in dealing with a complex environment.

The Impact of Speed-Accuracy Instructions on Spatial Congruency Effects

In many tasks humans can trade speed against accuracy. This variation of strategy has different consequences for congruency effects in different conflict tasks. Recently, Mittelstädt et al. (2022) suggested that these differences are related to the dynamics of congruency effects as assessed by delta plots. With increasing delta plots in the Eriksen flanker task congruency effects were larger under accuracy set, and with decreasing delta plots in the Simon task they were smaller. Here we tested the hypothesis for a single task, making use of the observation that for the Simon task delta plots decline when the irrelevant feature is presented first, but increase when the relevant feature leads. The differences between congruency effects under speed and accuracy instructions confirmed the hypothesized relation to the slope of delta plots. In fact, for similar delta plots in the compared speed-accuracy conditions, the relation should be a straightforward consequence of the shorter and longer reaction times with speed and accuracy set, respectively. However, when relevant and irrelevant features were presented simultaneously, congruency effects were stronger under speed set at all reaction times. For this condition, a supplementary model-based analysis with an extended leaky, competing accumulator model suggested a stronger and longer-lasting influence of the irrelevant stimulus feature. The congruency effects for reaction times were accompanied by congruency effects for error rates when delta plots were decreasing, but not when they were increasing.