Electrophysiological evidence of temporal preparation driven by rhythms in audition

Tactile temporal predictions: The influence of conditional probability

Predicting the timing of incoming information allows brain to optimize information processing in dynamic environments. However, the effects of temporal predictions on tactile perception are not well established. In this study, two experiments were conducted to determine how temporal predictions interact with conditional probabilities in tactile perceptual processing. In Experiment 1, we explored the range of the interval between preceding ready cues and imperative targets in which temporal prediction effects can be observed. This prediction effect was observed for intervals of 500 and 1,000 ms. In Experiment 2, we investigated the benefits of temporal predictions on tactile perception while manipulating the conditional probability (setting the stimulus onset earlier or later than the predicted moment in short and long intervals). Our results revealed that this effect became stronger as the probability of the stimulus at the predicted time point increased under short-interval conditions. Together, our results show that the difficulty of transferring processing resources increases in temporally dynamic environments, suggesting a greater subjective cost associated with maladaptive responses to temporally uncertain events.

Enhancing rhythmic temporal expectations: The dominance of auditory modality under spatial uncertainty

To effectively process the most relevant information, the brain anticipates the optimal timing for allocating attentional resources. Behavior can be optimized by automatically aligning attention with external rhythmic structures, whether visual or auditory. Although the auditory modality is known for its efficacy in representing temporal information, the current body of research has not conclusively determined whether visual or auditory rhythmic presentations have a definitive advantage in entraining temporal attention. The present study directly examined the effects of auditory and visual rhythmic cues on the discrimination of visual targets in Experiment 1 and on auditory targets in Experiment 2. Additionally, the role of endogenous spatial attention was also considered. When and where the target was the most likely to occur were cued by unimodal (visual or auditory) and bimodal (audiovisual) signals. A sequence of salient events was employed to elicit rhythm-based temporal expectations and a symbolic predictive cue served to orient spatial attention. The results suggest a superiority of auditory over visual rhythms, irrespective of spatial attention, whether the spatial cue and rhythm converge or not (unimodal or bimodal), and regardless of the target modality (visual or auditory). These findings are discussed in terms of a modality-specific rhythmic orienting, while considering a single, supramodal system operating in a top-down manner for endogenous spatial attention.

Mechanisms of sustained perceptual entrainment after stimulus offset

Temporal alignment of neural activity to rhythmic stimulation has been suggested to result from a resonating internal neural oscillator mechanism, but can also be explained by interval-based temporal prediction. Here, we investigate behavioural and brain responses in the post-stimulation period to compare an oscillatory versus an interval-based account. Hickok et al.'s (2015) behavioural paradigm yielded results that relate to a neural oscillatory entrainment mechanism. We adapted the paradigm to an event-related potential (ERP) suitable design: a periodic sequence was followed, in half of the trials, by near-threshold targets embedded in noise. The targets were played in various phases in relation to the preceding sequences' period. Participants had to detect whether targets were played or not, and their EEG was recorded. Both behavioural results and the P300 component of the ERP were not only partially consistent with an oscillatory mechanism but also partially consistent with an interval-based attentional gain mechanism. Instead, data obtained in the post-entrainment period can best be explained with a combination of both mechanisms.

Effect of tempo on the age-related changes in temporal expectation driven by rhythms

Temporal expectation refers to the capacity to allocate resources at a particular point in time, enabling us to enhance our behavior performance. Empirical evidence indicates that, among younger adults, temporal expectation can be driven by rhythm (i.e., regular sequences of stimuli). However, whether there are age-related changes in rhythm-based temporal expectation has not been clearly established. Furthermore, whether tempo can influence the relationship between rhythm-based temporal expectation and aging remains unexplored. To address these questions, both younger and older participants took part in a rhythm-based temporal expectation task, engaging three distinct tempos: 600 ms (fast), 1800 ms (moderate), or 3000 ms (slow). The results demonstrated that temporal expectation effects (i.e., participants exhibited significantly faster responses during the regular trials compared to the irregular trials) were observed in both the younger and older participants under the moderate tempo condition. However, in the fast and slow tempo conditions, the temporal expectation effects were solely observed in the younger participants. These findings revealed that rhythm-based temporal expectations can be preserved during aging but within a specific tempo range. When the tempo falls within the range of either being too fast or too slow, it can manifest age-related declines in temporal expectations driven by rhythms.

Predictability awareness rather than mere predictability enhances the perceptual benefits for targets in auditory rhythms over targets following temporal cues

Sounds following a cue or embedded in a periodic rhythm are processed more effectively than sounds that are part of an aperiodic rhythm. One might also expect that a sound embedded in a periodic rhythm is processed more effectively than a sound following a single temporal cue. Such a finding would follow the theory that the entrainment of neural rhythmic activity by periodic stimuli renders the prediction of upcoming stimuli more efficient. We conducted a psychophysical experiment in which we tested the behavioral elements of this idea. Targets in periodic and aperiodic rhythms, if they occurred, always appeared at the same moment in time, and thus were fully predictable. In a first condition, participants remained unaware of this. In a second condition, an explicit instruction on the temporal location of the targets embedded in rhythms was provided. We assessed sensitivity and reaction times to the target stimuli in a difficult temporal detection task, and contrasted performance in this task to that obtained for targets temporally cued by a single preceding cue. Irrespective of explicit information about target predictability, target detection performance was always better in the periodic and temporal cue conditions, compared to the aperiodic condition. However, we found that the mere predictability of an acoustic target within a periodic rhythm did not allow participants to detect the target any better than in a condition where the target's timing was predicted by a single temporal cue. Only when participants were made aware of the specific moment in the periodic rhythm where the target could occur, did sensitivity increase. This finding suggests that a periodic rhythm is not automatically sufficient to provide perceptual benefits compared to a condition predictable yet not rhythmic condition (a cue). In some conditions, as shown here, these benefits may only occur in interaction with other factors such as explicit instruction and directed attention.

The auditory P2 differentiates self- from partner-produced sounds during joint action: Contributions of self-specific attenuation and temporal orienting of attention

Sensory attenuation of the auditory P2 event-related potential (ERP) has been shown to differentiate the sensory consequences of one's own from others' action in joint action contexts. However, recent evidence suggests that when people coordinate joint actions over time, temporal orienting of attention might simultaneously contribute to enhancing the auditory P2. The current study employed a joint tapping task in which partners produced tone sequences together to examine whether temporal orienting influences auditory ERP amplitudes during the time window of self-other differentiation. Our findings demonstrate that the combined requirements of coordinating with a partner toward a joint goal and immediately adjusting to the partner's tone timing enhance P2 amplitudes elicited by the partner's tone onsets. Furthermore, our findings replicate prior evidence for self-specific sensory attenuation of the auditory P2 in joint action, and additionally demonstrate that it occurs regardless of the coordination requirements between partners. Together, these findings provide evidence that temporal orienting and sensory attenuation both modulate the auditory P2 during joint action and suggest that both processes play a role in facilitating precise interpersonal coordination between partners.

Forward entrainment: Psychophysics, neural correlates, and function

We define forward entrainment as that part of behavioral or neural entrainment that outlasts the entraining stimulus. In this review, we examine conditions under which one may optimally observe forward entrainment. In Part 1, we review and evaluate studies that have observed forward entrainment using a variety of psychophysical methods (detection, discrimination, and reaction times), different target stimuli (tones, noise, and gaps), different entraining sequences (sinusoidal, rectangular, or sawtooth waveforms), a variety of physiological measures (MEG, EEG, ECoG, CSD), in different modalities (auditory and visual), across modalities (audiovisual and auditory-motor), and in different species. In Part 2, we describe those experimental conditions that place constraints on the magnitude of forward entrainment, including an evaluation of the effects of signal uncertainty and attention, temporal envelope complexity, signal-to-noise ratio (SNR), rhythmic rate, prior experience, and intersubject variability. In Part 3 we theorize on potential mechanisms and propose that forward entrainment may instantiate a dynamic auditory afterimage that lasts a fraction of a second to minimize prediction error in signal processing.

A critical analysis of Lin et al.'s (2021) failure to observe forward entrainment in pitch discrimination

Forward entrainment refers to that part of the entrainment process that outlasts the entraining stimulus. Several studies have demonstrated psychophysical forward entrainment in a pitch-discrimination task. In a recent paper, Lin et al. (2021) challenged these findings by demonstrating that a sequence of 4 entraining pure tones does not affect the ability to determine whether a frequency modulated pulse, presented after termination of the entraining sequence, has swept up or down in frequency. They concluded that rhythmic sequences do not facilitate pitch discrimination. Here, we describe several methodological and stimulus design flaws in Lin et al.'s study that may explain their failure to observe forward entrainment in pitch discrimination.

Revisiting variable-foreperiod effects: evaluating the repetition priming account

A warning signal preceding an imperative stimulus by a certain foreperiod can accelerate responses (foreperiod effect). When foreperiod is varied within a block, the foreperiod effect on reaction time (RT) is modulated by both the current and the prior foreperiods. Using a non-aging foreperiod distribution in a simple-reaction task, Capizzi et al. (Cognition, 134, 39-49, 2015) found equal sequential effects for different foreperiods, which they credited to repetition priming. The multiple-trace theory of Los et al. (Frontiers in Psychology, 5, Article 1058, 2014) attributes the slope of the foreperiod-RT function to the foreperiod distribution. We conducted three experiments that examined these predicted relations. Experiment 1 tested Capizzi et al.'s prediction in a choice-reaction task and found an increasing foreperiod-RT function but a larger sequential effect at the shorter foreperiod. Experiment 2 used two distinct short foreperiods with the same foreperiod distribution and found a decreasing foreperiod-RT function. By increasing the difference between the foreperiods used in Experiment 2, Experiment 3 yielded a larger sequential effect overall. The experiments provide evidence that, with a non-aging foreperiod distribution, the variable-foreperiod paradigm yields unequal sequential-effect sizes at the different foreperiods, consistent with the multiple-trace theory but contrary to Capizzi et al.'s repetition-priming account. The foreperiod-RT functions are similar to those of the fixed-foreperiod paradigm, which is not predicted by the multiple trace theory.

Effect of Tempo on Temporal Expectation Driven by Rhythms in Dual-Task Performance

Temporal expectation is the ability to focus attention at a particular moment in time to optimize performance, which has been shown to be driven by regular rhythms. However, whether the rhythm-based temporal expectations rely upon automatic processing or require the involvement of controlled processing has not been clearly established. Furthermore, whether the mechanism is affected by tempo remains unknown. To investigate this research question, the present study used a dual-task procedure. In a single task, the participants were instructed to respond to a visual target preceded by a regular or an irregular visual rhythm under a fast (500 ms) or slow (3,500 ms) tempo. The dual-task simultaneously combined a working memory (WM) task. The results showed temporal expectation effects in which the participants responded faster to the regular than to the irregular conditions in a single task. Moreover, this effect persisted under dual-task interference in the fast tempo condition but was impaired in the slow tempo condition. These results revealed that rhythmic temporal expectation induced by fast tempo was dependent on automatic processing. However, compared with the faster tempo, temporal expectation driven by a slower tempo might involve more controlled processing.

Sensory Attenuation of the Auditory P2 Differentiates Self- from Partner-Produced Sounds during Joint Action

Successful human interaction relies on people's ability to differentiate between the sensory consequences of their own and others' actions. Research in solo action contexts has identified sensory attenuation, that is, the selective perceptual or neural dampening of the sensory consequences of self-produced actions, as a potential marker of the distinction between self- and externally produced sensory consequences. However, very little research has examined whether sensory attenuation distinguishes self- from partner-produced sensory consequences in joint action contexts. The current study examined whether sensory attenuation of the auditory N1 or P2 ERPs distinguishes self- from partner-produced tones when pairs of people coordinate their actions to produce tone sequences that match a metronome pace. We did not find evidence of auditory N1 attenuation for either self- or partner-produced tones. Instead, the auditory P2 was attenuated for self-produced tones compared to partner-produced tones within the joint action. These findings indicate that self-specific attenuation of the auditory P2 differentiates the sensory consequences of one's own from others' actions during joint action. These findings also corroborate recent evidence that N1 attenuation may be driven by general rather than action-specific processes and support a recently proposed functional dissociation between auditory N1 and P2 attenuation.

Speaking rhythmically can shape hearing

Evidence suggests that temporal predictions arising from the motor system can enhance auditory perception. However, in speech perception, we lack evidence of perception being modulated by production. Here we show a behavioural protocol that captures the existence of such auditory-motor interactions. Participants performed a syllable discrimination task immediately after producing periodic syllable sequences. Two speech rates were explored: a 'natural' (individually preferred) and a fixed 'non-natural' (2 Hz) rate. Using a decoding approach, we show that perceptual performance is modulated by the stimulus phase determined by a participant's own motor rhythm. Remarkably, for 'natural' and 'non-natural' rates, this finding is restricted to a subgroup of the population with quantifiable auditory-motor coupling. The observed pattern is compatible with a neural model assuming a bidirectional interaction of auditory and speech motor cortices. Crucially, the model matches the experimental results only if it incorporates individual differences in the strength of the auditory-motor connection.

Beat-based and Memory-based Temporal Expectations in Rhythm: Similar Perceptual Effects, Different Underlying Mechanisms

Predicting the timing of incoming information allows the brain to optimize information processing in dynamic environments. Behaviorally, temporal expectations have been shown to facilitate processing of events at expected time points, such as sounds that coincide with the beat in musical rhythm. Yet, temporal expectations can develop based on different forms of structure in the environment, not just the regularity afforded by a musical beat. Little is still known about how different types of temporal expectations are neurally implemented and affect performance. Here, we orthogonally manipulated the periodicity and predictability of rhythmic sequences to examine the mechanisms underlying beat-based and memory-based temporal expectations, respectively. Behaviorally and using EEG, we looked at the effects of beat-based and memory-based expectations on auditory processing when rhythms were task-relevant or task-irrelevant. At expected time points, both beat-based and memory-based expectations facilitated target detection and led to attenuation of P1 and N1 responses, even when expectations were task-irrelevant (unattended). For beat-based expectations, we additionally found reduced target detection and enhanced N1 responses for events at unexpected time points (e.g., off-beat), regardless of the presence of memory-based expectations or task relevance. This latter finding supports the notion that periodicity selectively induces rhythmic fluctuations in neural excitability and furthermore indicates that, although beat-based and memory-based expectations may similarly affect auditory processing of expected events, their underlying neural mechanisms may be different.

Does Temporal Expectation Driven by Rhythmic Cues Differ From That Driven by Symbolic Cues Across the Millisecond and Second Range?

Temporal expectation relies on different predictive information, such as regular rhythms and symbolic cues, to direct attention to a future moment in time to optimize behaviour. However, whether differences exist between temporal expectations driven by regular rhythms and symbolic cues has not been clearly established. In this study, 20 participants performed two temporal expectation tasks in which a rhythmic cue or a symbolic cue indicated (70% expected) that the target would appear after an interval of 500 ms (short), 1,500 ms (medium), or 2,500 ms (long). We found larger cueing effects for the rhythmic cued task than for the symbolic cued task during the short interval, indicating that rhythmic cues were more effective in improving performance. Furthermore, no significant difference was found during the longer interval, reflect that the behavioural differences between the two forms of temporal expectations were likely to diminish as the time interval increased. Thus, we speculate that the temporal expectation driven by rhythmic cues differs from that driven by symbolic cues only in the limited time range; however, the mechanisms underlying the two forms of temporal expectations trend to become more similar over increasing temporal scales.

Sensory Stream Adaptation in Chaotic Networks

Implicit expectations induced by predictable stimuli sequences affect neuronal response to upcoming stimuli at both single cell and neural population levels. Temporally regular sensory streams also phase entrain ongoing low frequency brain oscillations but how and why this happens is unknown. Here we investigate how random recurrent neural networks without plasticity respond to stimuli streams containing oddballs. We found the neuronal correlates of sensory stream adaptation emerge if networks generate chaotic oscillations which can be phase entrained by stimulus streams. The resultant activity patterns are close to critical and support history dependent response on long timescales. Because critical network entrainment is a slow process stimulus response adapts gradually over multiple repetitions. Repeated stimuli generate suppressed responses but oddball responses are large and distinct. Oscillatory mismatch responses persist in population activity for long periods after stimulus offset while individual cell mismatch responses are strongly phasic. These effects are weakened in temporally irregular sensory streams. Thus we show that network phase entrainment provides a biologically plausible mechanism for neural oddball detection. Our results do not depend on specific network characteristics, are consistent with experimental studies and may be relevant for multiple pathologies demonstrating altered mismatch processing such as schizophrenia and depression.

Temporal expectancies driven by self- and externally generated rhythms

The dynamic attending theory proposes that rhythms entrain periodic fluctuations of attention which modulate the gain of sensory input. However, temporal expectancies can also be driven by the mere passage of time (foreperiod effect). It is currently unknown how these two types of temporal expectancy relate to each other, i.e. whether they work in parallel and have distinguishable neural signatures. The current research addresses this issue. Participants either tapped a 1Hz rhythm (active task) or were passively presented with the same rhythm using tactile stimulators (passive task). Based on this rhythm an auditory target was then presented early, in synchrony, or late. Behavioural results were in line with the dynamic attending theory as RTs were faster for in- compared to out-of-synchrony targets. Electrophysiological results suggested self-generated and externally induced rhythms to entrain neural oscillations in the delta frequency band. Auditory ERPs showed evidence of two distinct temporal expectancy processes. Both tasks demonstrated a pattern which followed a linear foreperiod effect. In the active task, however, we also observed an ERP effect consistent with the dynamic attending theory. This study shows that temporal expectancies generated by a rhythm and expectancy generated by the mere passage of time can work in parallel and sheds light on how these mechanisms are implemented in the brain.

Neural Entrainment to Polyrhythms: A Comparison of Musicians and Non-musicians

Music can be thought of as a dynamic path over time. In most cases, the rhythmic structure of this path, such as specific sequences of strong and weak beats or recurring patterns, allows us to predict what and particularly when sounds are going to happen. Without this ability we would not be able to entrain body movements to music, like we do when we dance. By combining EEG and behavioral measures, the current study provides evidence illustrating the importance of ongoing neural oscillations at beat-related frequencies-i.e., neural entrainment-for tracking and predicting musical rhythms. Participants (13 musicians and 13 non-musicians) listened to drum rhythms that switched from a quadruple rhythm to a 3-over-4 polyrhythm. After a silent period of ~2-3 s, participants had to decide whether a target stimulus was presented on time with the triple beat of the polyrhythm, too early, or too late. Results showed that neural oscillations reflected the rhythmic structure of both the simple quadruple rhythm and the more complex polyrhythm with no differences between musicians and non-musicians. During silent periods, the observation of time-frequency plots and more commonly used frequency spectra analyses suggest that beat-related neural oscillations were more pronounced in musicians compared to non-musicians. Neural oscillations during silent periods are not driven by an external input and therefore are thought to reflect top-down controlled endogenous neural entrainment. The functional relevance of endogenous neural entrainment was demonstrated by a positive correlation between the amplitude of task-relevant neural oscillations during silent periods and the number of correctly identified target stimuli. In sum, our findings add to the evidence supporting the neural resonance theory of pulse and meter. Furthermore, they indicate that beat-related top-down controlled neural oscillations can exist without external stimulation and suggest that those endogenous oscillations are strengthened by musical expertise. Finally, this study shows that the analysis of neural oscillations can be a useful tool to assess how we perceive and process complex auditory stimuli such as polyrhythms.

"Lost in time" but still moving to the beat

Motor synchronization to the beat of an auditory sequence (e.g., a metronome or music) is widespread in humans. However, some individuals show poor synchronization and impoverished beat perception. This condition, termed "beat deafness", has been linked to a perceptual deficit in beat tracking. Here we present single-case evidence (L.A. and L.C.) that poor beat tracking does not have to entail poor synchronization. In a first Experiment, L.A., L.C., and a third case (L.V.) were submitted to the Battery for The Assessment of Auditory Sensorimotor and Timing Abilities (BAASTA), which includes both perceptual and sensorimotor tasks. Compared to a control group, L.A. and L.C. performed poorly on rhythm perception tasks, such as detecting time shifts in a regular sequence, or estimating whether a metronome is aligned to the beat of the music or not. Yet, they could tap to the beat of the same stimuli. L.V. showed impairments in both beat perception and tapping. In a second Experiment, we tested whether L.A., L.C., and L.V.'s perceptual deficits extend to an implicit timing task, in which they had to respond as fast as possible to a different target pitch after a sequence of standard tones. The three beat-deaf participants benefited similarly to controls from a regular temporal pattern in detecting the pitch target. The fact that synchronization to a beat can occur in the presence of poor perception shows that perception and action can dissociate in explicit timing tasks. Beat tracking afforded by implicit timing mechanisms is likely to support spared synchronization to the beat in some beat-deaf participants. This finding suggests that separate pathways may subserve beat perception depending on the explicit/implicit nature of a task in a sample of beat-deaf participants.

Sensory Entrainment Mechanisms in Auditory Perception: Neural Synchronization Cortico-Striatal Activation

The auditory system displays modulations in sensitivity that can align with the temporal structure of the acoustic environment. This sensory entrainment can facilitate sensory perception and is particularly relevant for audition. Systems neuroscience is slowly uncovering the neural mechanisms underlying the behaviorally observed sensory entrainment effects in the human sensory system. The present article summarizes the prominent behavioral effects of sensory entrainment and reviews our current understanding of the neural basis of sensory entrainment, such as synchronized neural oscillations, and potentially, neural activation in the cortico-striatal system.

Neural Entrainment in Drum Rhythms with Silent Breaks: Evidence from Steady-state Evoked and Event-related Potentials

The fusion of rhythm, beat perception, and movement is often summarized under the term "entrainment" and becomes obvious when we effortlessly tap our feet or snap our fingers to the pulse of music. Entrainment to music involves a large network of brain structures, and neural oscillations at beat-related frequencies can help elucidate how this network is connected. Here, we used EEG to investigate steady-state evoked potentials (SSEPs) and event-related potentials (ERPs) during listening and tapping to drum clips with different rhythmic structures that were interrupted by silent breaks of 2-6 sec. This design allowed us to address the question of whether neural entrainment processes persist after the physical presence of musical rhythms and to link neural oscillations and event-related neural responses. During stimulus presentation, SSEPs were elicited in both tasks (listening and tapping). During silent breaks, SSEPs were only present in the tapping task. Notably, the amplitude of the N1 ERP component was more negative after longer silent breaks, and both N1 and SSEP results indicate that neural entrainment was increased when listening to drum rhythms compared with an isochronous metronome. Taken together, this suggests that neural entrainment to music is not solely driven by the physical input but involves endogenous timing processes. Our findings break ground for a tighter linkage between steady-state and transient evoked neural responses in rhythm processing. Beyond music perception, they further support the crucial role of entrained oscillatory activity in shaping sensory, motor, and cognitive processes in general.

Musical Meter Modulates the Allocation of Attention across Time

Dynamic attending theory predicts that attention is allocated hierarchically across time during processing of hierarchical rhythmic structures such as musical meter. ERP research demonstrates that attention to a moment in time modulates early auditory processing as evidenced by the amplitude of the first negative peak (N1) approximately 100 msec after sound onset. ERPs elicited by tones presented at times of high and low metric strength in short melodies were compared to test the hypothesis that hierarchically structured rhythms direct attention in a manner that modulates early perceptual processing. A more negative N1 was observed for metrically strong beats compared with metrically weak beats; this result provides electrophysiological evidence that hierarchical rhythms direct attention to metrically strong times during engaged listening. The N1 effect was observed only on fast tempo trials, suggesting that listeners more consistently invoke selective processing based on hierarchical rhythms when sounds are presented rapidly. The N1 effect was not modulated by musical expertise, indicating that the allocation of attention to metrically strong times is not dependent on extensive training. Additionally, changes in P2 amplitude and a late negativity were associated with metric strength under some conditions, indicating that multiple cognitive processes are associated with metric perception.

Temporal attending and prediction influence the perception of metrical rhythm: evidence from reaction times and ERPs

The processing of rhythmic events in music is influenced by the induced metrical structure. Two mechanisms underlying this may be temporal attending and temporal prediction. Temporal fluctuations in attentional resources may influence the processing of rhythmic events by heightening sensitivity at metrically strong positions. Temporal predictions may attenuate responses to events that are highly expected within a metrical structure. In the current study we aimed to disentangle these two mechanisms by examining responses to unexpected sounds, using intensity increments and decrements as deviants. Temporal attending was hypothesized to lead to better detection of deviants in metrically strong (on the beat) than weak (offbeat) positions due to heightened sensitivity on the beat. Temporal prediction was hypothesized to lead to best detection of increments in offbeat positions and decrements on the beat, as they would be most unexpected in these positions. We used a speeded detection task to measure detectability of the deviants under attended conditions (Experiment 1). Under unattended conditions (Experiment 2), we used EEG to measure the mismatch negativity (MMN), an ERP component known to index the detectability of unexpected auditory events. Furthermore, we examined the amplitude of the auditory evoked P1 and N1 responses, which are known to be sensitive to both attention and prediction. We found better detection of small increments in offbeat positions than on the beat, consistent with the influence of temporal prediction (Experiment 1). In addition, we found faster detection of large increments on the beat as opposed to offbeat (Experiment 1), and larger amplitude P1 responses on the beat as compared to offbeat, both in support of temporal attending (Experiment 2). As such, we showed that both temporal attending and temporal prediction shape our processing of metrical rhythm.

Intersensory selective attention and temporal orienting operate in parallel and are instantiated in spatially distinct sensory and motor cortices

Knowledge about the sensory modality in which a forthcoming event might occur permits anticipatory intersensory attention. Information as to when exactly an event occurs enables temporal orienting. Intersensory and temporal attention mechanisms are often deployed simultaneously, but as yet it is unknown whether these processes operate interactively or in parallel. In this human electroencephalography study, we manipulated intersensory attention and temporal orienting in the same paradigm. A continuous stream of bisensory visuo-tactile inputs was presented, and a preceding auditory cue indicated to which modality participants should attend (visual or tactile). Temporal orienting was manipulated blockwise by presenting stimuli either at regular or irregular intervals. Using linear beamforming, we examined neural oscillations at virtual channels in sensory and motor cortices. Both attentional processes simultaneously modulated the power of anticipatory delta- and beta-band oscillations, as well as delta-band phase coherence. Modulations in sensory cortices reflected intersensory attention, indicative of modality-specific gating mechanisms. Modulations in motor and partly in somatosensory cortex reflected temporal orienting, indicative of a supramodal preparatory mechanism. We found no evidence for interactions between intersensory attention and temporal orienting, suggesting that these two mechanisms act in parallel and largely independent of each other in sensory and motor cortices.

Neural correlates of intentional switching from ternary to binary meter in a musical hemiola pattern

Musical rhythms are often perceived and interpreted within a metrical framework that integrates timing information hierarchically based on interval ratios. Endogenous timing processes facilitate this metrical integration and allow us using the sensory context for predicting when an expected sensory event will happen (“predictive timing”). Previously, we showed that listening to metronomes and subjectively imagining the two different meters of march and waltz modulated the resulting auditory evoked responses in the temporal lobe and motor-related brain areas such as the motor cortex, basal ganglia, and cerebellum. Here we further explored the intentional transitions between the two metrical contexts, known as hemiola in the Western classical music dating back to the sixteenth century. We examined MEG from 12 musicians while they repeatedly listened to a sequence of 12 unaccented clicks with an interval of 390 ms, and tapped to them with the right hand according to a 3 + 3 + 2 + 2 + 2 hemiola accent pattern. While participants listened to the same metronome sequence and imagined the accents, their pattern of brain responses significantly changed just before the “pivot” point of metric transition from ternary to binary meter. Until 100 ms before the pivot point, brain activities were more similar to those in the simple ternary meter than those in the simple binary meter, but the pattern was reversed afterwards. A similar transition was also observed at the downbeat after the pivot. Brain areas related to the metric transition were identified from source reconstruction of the MEG using a beamformer and included auditory cortices, sensorimotor and premotor cortices, cerebellum, inferior/middle frontal gyrus, parahippocampal gyrus, inferior parietal lobule, cingulate cortex, and precuneus. The results strongly support that predictive timing processes related to auditory-motor, fronto-parietal, and medial limbic systems underlie metrical representation and its transitions.

Independent effects of temporal expectation and stimulus intensity in audition

Temporal orienting--that is, selective attention to instants in time--has been shown to modulate performance in terms of faster responses in a variety of paradigms. Electrophysiological recordings have shown that temporal orienting modulates neural processing at early, probably perceptual, and late, probably decision- or response-related, stages. Recently, it was shown that the effect of temporal orienting on early auditory brain potentials is independent of the effect of the physical sound feature intensity. This indicates that temporal orienting might not affect stimulus processing by increasing the sensory gain of attended stimuli. In the present study, we investigated whether the independence of temporal-orienting and sound-intensity effects could be replicated behaviorally. Sequences were presented that were either rhythmic, most likely creating temporal expectations, or arrhythmic, presumably not creating such expectations. As hypothesized, the main effects of temporal expectation and sound intensity on reaction times were independent (Experiment 1). The exact pattern of results was replicated with a slightly altered paradigm (Experiment 2) and with a different kind of task (Experiment 3). In sum, these results corroborate the notion that the effect of temporal orienting might not rely on the same processes as the effect of sound intensity does.

The ups and downs of temporal orienting: a review of auditory temporal orienting studies and a model associating the heterogeneous findings on the auditory N1 with opposite effects of attention and prediction

The temporal orienting of attention refers to the process of focusing (neural) resources on a particular time point in order to boost the processing of and the responding to sensory events. Temporal attention is manipulated by varying the task-relevance of events at different time points or by inducing expectations that an event occurs at a particular time point. Notably, the electrophysiological correlates of these manipulations at early processing stages are not identical: Auditory studies operationalizing temporal attention through task-relevance consistently found enhancements of early, sensory processing, as shown in the N1 component of the auditory event-related potential (ERP). By contrast, previous work on temporal orienting based on expectations showed mixed results: early, sensory processing was either enhanced or attenuated or not affected at all. In the present work, I will review existing findings on temporal orienting with a special focus on the auditory modality and present a working model to reconcile the previously heterogeneous results. Specifically, I will suggest that when expectations are used to manipulate attention, this will lead both to an orienting of attention and to the generation of precise predictions about the upcoming event. Attention and prediction are assumed to have opposite effects on early auditory processing, with temporal attention increasing and temporal predictions decreasing the associated ERP correlate, the auditory N1. The heterogeneous findings of studies manipulating temporal orienting by inducing expectations may thus be the consequence of differences in the relative contribution of attention and prediction processes. The model's predictions will be discussed in the context of a functional interpretation of the auditory N1 as an attention call signal, as presented in a recent model on auditory processing.