Predicting "When" Using the Motor System's Beta-Band Oscillations

Premotor cortical beta synchronization and the network neuromodulation of externally paced finger tapping in Parkinson's disease

Parkinson's disease (PD) is characterized by the disruption of repetitive, concurrent and sequential motor actions due to compromised timing-functions principally located in cortex-basal ganglia (BG) circuits. Increasing evidence suggests that motor impairments in untreated PD patients are linked to an excessive synchronization of cortex-BG activity at beta frequencies (13-30 Hz). Levodopa and subthalamic nucleus deep brain stimulation (STN-DBS) suppress pathological beta-band reverberation and improve the motor symptoms in PD. Yet a dynamic tuning of beta oscillations in BG-cortical loops is fundamental for movement-timing and synchronization, and the impact of PD therapies on sensorimotor functions relying on neural transmission in the beta frequency-range remains controversial. Here, we set out to determine the differential effects of network neuromodulation through dopaminergic medication (ON and OFF levodopa) and STN-DBS (ON-DBS, OFF-DBS) on tapping synchronization and accompanying cortical activities. To this end, we conducted a rhythmic finger-tapping study with high-density EEG-recordings in 12 PD patients before and after surgery for STN-DBS and in 12 healthy controls. STN-DBS significantly ameliorated tapping parameters as frequency, amplitude and synchrony to the given auditory rhythms. Aberrant neurophysiologic signatures of sensorimotor feedback in the beta-range were found in PD patients: their neural modulation was weaker, temporally sluggish and less distributed over the right cortex in comparison to controls. Levodopa and STN-DBS boosted the dynamics of beta-band modulation over the right hemisphere, hinting to an improved timing of movements relying on tactile feedback. The strength of the post-event beta rebound over the supplementary motor area correlated significantly with the tapping asynchrony in patients, thus indexing the sensorimotor match between the external auditory pacing signals and the performed taps. PD patients showed an excessive interhemispheric coherence in the beta-frequency range during the finger-tapping task, while under DBS-ON the cortico-cortical connectivity in the beta-band was normalized. Ultimately, therapeutic DBS significantly ameliorated the auditory-motor coupling of PD patients, enhancing the electrophysiological processing of sensorimotor feedback-information related to beta-band activity, and thus allowing a more precise cued-tapping performance.

Neural dynamics of predictive timing and motor engagement in music listening

Why do humans spontaneously dance to music? To test the hypothesis that motor dynamics reflect predictive timing during music listening, we created melodies with varying degrees of rhythmic predictability (syncopation) and asked participants to rate their wanting-to-move (groove) experience. Degree of syncopation and groove ratings are quadratically correlated. Magnetoencephalography data showed that, while auditory regions track the rhythm of melodies, beat-related 2-hertz activity and neural dynamics at delta (1.4 hertz) and beta (20 to 30 hertz) rates in the dorsal auditory pathway code for the experience of groove. Critically, the left sensorimotor cortex coordinates these groove-related delta and beta activities. These findings align with the predictions of a neurodynamic model, suggesting that oscillatory motor engagement during music listening reflects predictive timing and is effected by interaction of neural dynamics along the dorsal auditory pathway.

Rhythmic motor behavior explains individual differences in grammar skills in adults

A growing body of literature has reported the relationship between music and language, particularly between individual differences in perceptual rhythm skill and grammar competency in children. Here, we investigated whether motoric aspects of rhythm processing-as measured by rhythmic finger tapping tasks-also explain the rhythm-grammar connection in 150 healthy young adults. We found that all expressive rhythm skills (spontaneous, synchronized, and continued tapping) along with rhythm discrimination skill significantly predicted receptive grammar skills on either auditory sentence comprehension or grammaticality well-formedness judgment (e.g., singular/plural, past/present), even after controlling for verbal working memory and music experience. Among these, synchronized tapping and rhythm discrimination explained unique variance of sentence comprehension and grammaticality judgment, respectively, indicating differential associations between different rhythm and grammar skills. Together, we demonstrate that even simple and repetitive motor behavior can account for seemingly high-order grammar skills in the adult population, suggesting that the sensorimotor system continue to support syntactic operations.

The Motor of Time: Coupling Action to Temporally Predictable Events Heightens Perception

Timing and motor function share neural circuits and dynamics, which underpin their close and synergistic relationship. For instance, the temporal predictability of a sensory event optimizes motor responses to that event. Knowing when an event is likely to occur lowers response thresholds, leading to faster and more efficient motor behavior though in situations of response conflict can induce impulsive and inappropriate responding. In turn, through a process of active sensing, coupling action to temporally predictable sensory input enhances perceptual processing. Action not only hones perception of the event's onset or duration, but also boosts sensory processing of its non-temporal features such as pitch or shape. The effects of temporal predictability on motor behavior and sensory processing involve motor and left parietal cortices and are mediated by changes in delta and beta oscillations in motor areas of the brain.

Dopamine dysregulation in Parkinson's disease flattens the pleasurable urge to move to musical rhythms

The pleasurable urge to move to music (PLUMM) activates motor and reward areas of the brain and is thought to be driven by predictive processes. Dopamine in motor and limbic networks is implicated in beat-based timing and music-induced pleasure, suggesting a central role of basal ganglia (BG) dopaminergic systems in PLUMM. This study tested this hypothesis by comparing PLUMM in participants with Parkinson's disease (PD), age-matched controls, and young controls. Participants listened to musical sequences with varying rhythmic and harmonic complexity (low, medium and high), and rated their experienced pleasure and urge to move to the rhythm. In line with previous results, healthy younger participants showed an inverted U-shaped relationship between rhythmic complexity and ratings, with preference for medium complexity rhythms, while age-matched controls showed a similar, but weaker, inverted U-shaped response. Conversely, PD showed a significantly flattened response for both the urge to move and pleasure. Crucially, this flattened response could not be attributed to differences in rhythm discrimination and did not reflect an overall decrease in ratings. For harmonic complexity, PD showed a negative linear pattern for both the urge to move and pleasure while healthy age-matched controls showed the same pattern for pleasure and an inverted U for the urge to move. This contrasts with the pattern observed in young healthy controls in previous studies, suggesting that both healthy aging and PD also influence affective responses to harmonic complexity. Together, these results support the role of dopamine within cortico-striatal circuits in the predictive processes that form the link between the perceptual processing of rhythmic patterns and the affective and motor responses to rhythmic music.

Motor-Related Mu/Beta Rhythm in Older Adults: A Comprehensive Review

Mu rhythm, also known as the mu wave, occurs on sensorimotor cortex activity at rest, and the frequency range is defined as 8-13Hz, the same frequency as the alpha band. Mu rhythm is a cortical oscillation that can be recorded from the scalp over the primary sensorimotor cortex by electroencephalogram (EEG) and magnetoencephalography (MEG). The subjects of previous mu/beta rhythm studies ranged widely from infants to young and older adults. Furthermore, these subjects were not only healthy people but also patients with various neurological and psychiatric diseases. However, very few studies have referred to the effect of mu/beta rhythm with aging, and there was no literature review about this theme. It is important to review the details of the characteristics of mu/beta rhythm activity in older adults compared with young adults, focusing on age-related mu rhythm changes. By comprehensive review, we found that, compared with young adults, older adults showed mu/beta activity change in four characteristics during voluntary movement, increased event-related desynchronization (ERD), earlier beginning and later end, symmetric pattern of ERD and increased recruitment of cortical areas, and substantially reduced beta event-related desynchronization (ERS). It was also found that mu/beta rhythm patterns of action observation were changing with aging. Future work is needed in order to investigate not only the localization but also the network of mu/beta rhythm in older adults.

Individual neurophysiological signatures of spontaneous rhythm processing

When sensory input conveys rhythmic regularity, we can form predictions about the timing of upcoming events. Although rhythm processing capacities differ considerably between individuals, these differences are often obscured by participant- and trial-level data averaging procedures in M/EEG research. Here, we systematically assessed neurophysiological variability displayed by individuals listening to isochronous (1.54Hz) equitone sequences interspersed with unexpected (amplitude-attenuated) deviant tones. Our approach aimed at revealing time-varying adaptive neural mechanisms for sampling the acoustic environment at multiple timescales. Rhythm tracking analyses confirmed that individuals encode temporal regularities and form temporal expectations, as indicated in delta-band (1.54Hz) power and its anticipatory phase alignment to expected tone onsets. Zooming into tone- and participant-level data, we further characterized intra- and inter-individual variabilities in phase-alignment across auditory sequences. Further, individual modelling of beta-band tone-locked responses showed that a subset of auditory sequences was sampled rhythmically by superimposing binary (strong-weak; S-w), ternary (S-w-w) and mixed accentuation patterns. In these sequences, neural responses to standard and deviant tones were modulated by a binary accentuation pattern, thus pointing towards a mechanism of dynamic attending. Altogether, the current results point toward complementary roles of delta- and beta-band activity in rhythm processing and further highlight diverse and adaptive mechanisms to track and sample the acoustic environment at multiple timescales, even in the absence of task-specific instructions.

Music and Brain Circuitry: Strategies for Strengthening Evidence-Based Research for Music-Based Interventions

The neuroscience of music and music-based interventions (MBIs) is a fascinating but challenging research field. While music is a ubiquitous component of every human society, MBIs may encompass listening to music, performing music, music-based movement, undergoing music education and training, or receiving treatment from music therapists. Unraveling the brain circuits activated and influenced by MBIs may help us gain better understanding of the therapeutic and educational values of MBIs by gathering strong research evidence. However, the complexity and variety of MBIs impose unique research challenges. This article reviews the recent endeavor led by the National Institutes of Health to support evidence-based research of MBIs and their impact on health and diseases. It also highlights fundamental challenges and strategies of MBI research with emphases on the utilization of animal models, human brain imaging and stimulation technologies, behavior and motion capturing tools, and computational approaches. It concludes with suggestions of basic requirements when studying MBIs and promising future directions to further strengthen evidence-based research on MBIs in connections with brain circuitry.SIGNIFICANCE STATEMENT Music and music-based interventions (MBI) engage a wide range of brain circuits and hold promising therapeutic potentials for a variety of health conditions. Comparative studies using animal models have helped in uncovering brain circuit activities involved in rhythm perception, while human imaging, brain stimulation, and motion capture technologies have enabled neural circuit analysis underlying the effects of MBIs on motor, affective/reward, and cognitive function. Combining computational analysis, such as prediction method, with mechanistic studies in animal models and humans may unravel the complexity of MBIs and their effects on health and disease.

EEG brain oscillations are modulated by interoception in response to a synchronized motor vs. cognitive task

So far, little is known about how conscious attention to internal body signals, that is, interoception, affects the synchronization with another person, a necessary or required social process that promotes affiliations and cooperation during daily joint social interactions. The effect of explicit interoceptive attentiveness (IA) modulation, conceived as the focus on the breath for a given time interval, on electrophysiological (EEG) correlates during an interpersonal motor task compared with a cognitive synchronization task was investigated in this study. A total of 28 healthy participants performed a motor and a cognitive synchronization task during the focus and no-focus breath conditions. During the tasks, frequency bands (delta, theta, alpha, and beta bands) from the frontal, temporo-central, and parieto-occipital regions of interest (ROIs) were acquired. According to the results, significantly higher delta and theta power were found in the focus condition in the frontal ROI during the execution of the motor than the cognitive synchronization task. Moreover, in the same experimental condition, delta and beta band power increased in the temporo-central ROI. The current study suggested two main patterns of frequency band modulation during the execution of a motor compared with the cognitive synchronization task while a person is focusing the attention on one's breath. This study can be considered as the first attempt to classify the different effects of interoceptive manipulation on motor and cognitive synchronization tasks using neurophysiological measures.

Time Perception for Musical Rhythms: Sensorimotor Perspectives on Entrainment, Simulation, and Prediction

Neural mechanisms supporting time perception in continuously changing sensory environments may be relevant to a broader understanding of how the human brain utilizes time in cognition and action. In this review, we describe current theories of sensorimotor engagement in the support of subsecond timing. We focus on musical timing due to the extensive literature surrounding movement with and perception of musical rhythms. First, we define commonly used but ambiguous concepts including neural entrainment, simulation, and prediction in the context of musical timing. Next, we summarize the literature on sensorimotor timing during perception and performance and describe current theories of sensorimotor engagement in the support of subsecond timing. We review the evidence supporting that sensorimotor engagement is critical in accurate time perception. Finally, potential clinical implications for a sensorimotor perspective of timing are highlighted.

Oscillatory and Aperiodic Neural Activity Jointly Predict Language Learning

Memory formation involves the synchronous firing of neurons in task-relevant networks, with recent models postulating that a decrease in low-frequency oscillatory activity underlies successful memory encoding and retrieval. However, to date, this relationship has been investigated primarily with face and image stimuli; considerably less is known about the oscillatory correlates of complex rule learning, as in language. Furthermore, recent work has shown that nonoscillatory (1/ƒ) activity is functionally relevant to cognition, yet its interaction with oscillatory activity during complex rule learning remains unknown. Using spectral decomposition and power-law exponent estimation of human EEG data (17 females, 18 males), we show for the first time that 1/ƒ and oscillatory activity jointly influence the learning of word order rules of a miniature artificial language system. Flexible word-order rules were associated with a steeper 1/ƒ slope, whereas fixed word-order rules were associated with a shallower slope. We also show that increased theta and alpha power predicts fixed relative to flexible word-order rule learning and behavioral performance. Together, these results suggest that 1/ƒ activity plays an important role in higher-order cognition, including language processing, and that grammar learning is modulated by different word-order permutations, which manifest in distinct oscillatory profiles.

Implicit Versus Explicit Timing-Separate or Shared Mechanisms?

Time implicitly shapes cognition, but time is also explicitly represented, for instance, in the form of durations. Parsimoniously, the brain could use the same mechanisms for implicit and explicit timing. Yet, the evidence has been equivocal, revealing both joint versus separate signatures of timing. Here, we directly compared implicit and explicit timing using magnetoencephalography, whose temporal resolution allows investigating the different stages of the timing processes. Implicit temporal predictability was induced in an auditory paradigm by a manipulation of the foreperiod. Participants received two consecutive task instructions: discriminate pitch (indirect measure of implicit timing) or duration (direct measure of explicit timing). The results show that the human brain efficiently extracts implicit temporal statistics of sensory environments, to enhance the behavioral and neural responses to auditory stimuli, but that those temporal predictions did not improve explicit timing. In both tasks, attentional orienting in time during predictive foreperiods was indexed by an increase in alpha power over visual and parietal areas. Furthermore, pretarget induced beta power in sensorimotor and parietal areas increased during implicit compared to explicit timing, in line with the suggested role for beta oscillations in temporal prediction. Interestingly, no distinct neural dynamics emerged when participants explicitly paid attention to time, compared to implicit timing. Our work thus indicates that implicit timing shapes the behavioral and sensory response in an automatic way and is reflected in oscillatory neural dynamics, whereas the translation of implicit temporal statistics to explicit durations remains somewhat inconclusive, possibly because of the more abstract nature of this task.

Electrophysiological correlates and predictors of the antidepressant response to repeated ketamine infusions in treatment-resistant depression

BACKGROUND

Sub-anesthetic ketamine doses rapidly reduce depressive symptoms, although additional investigations of the underlying neural mechanisms and the prediction of response outcomes are needed. Electroencephalographic (EEG)-derived measures have shown promise in predicting antidepressant response to a variety of treatments, and are sensitive to ketamine administration. This study examined their utility in characterizing changes in depressive symptoms following single and repeated ketamine infusions.

METHODS

Recordings were obtained from patients with treatment-resistant major depressive disorder (MDD) (N = 24) enrolled in a multi-phase clinical ketamine trial. During the randomized, double-blind, crossover phase (Phase 1), patients received intravenous ketamine (0.5 mg/kg) and midazolam (30 μg/kg), at least 1 week apart. For each medication, three resting, eyes-closed recordings were obtained per session (pre-infusion, immediately post-infusion, 2 h post-infusion), and changes in power (delta, theta1/2/total, alpha1/2/total, beta, gamma), alpha asymmetry, theta cordance, and theta source-localized anterior cingulate cortex activity were quantified. The relationships between ketamine-induced changes with early (Phase 1) and sustained (Phases 2,3: open-label repeated infusions) decreases in depressive symptoms (Montgomery-Åsberg Depression Rating Score, MADRS) and suicidal ideation (MADRS item 10) were examined.

RESULTS

Both medications decreased alpha and theta immediately post-infusion, however, only midazolam increased delta (post-infusion), and only ketamine increased gamma (immediately post- and 2 h post-infusion). Regional- and frequency-specific ketamine-induced EEG changes were related to and predictive of decreases in depressive symptoms (theta, gamma) and suicidal ideation (alpha). Early and sustained treatment responders differed at baseline in surface-level and source-localized theta.

CONCLUSIONS

Ketamine exerts frequency-specific changes on EEG-derived measures, which are related to depressive symptom decreases in treatment-resistant MDD and provide information regarding early and sustained individual response to ketamine.

CLINICAL TRIAL REGISTRATION

ClinicalTrials.gov: Action of Ketamine in Treatment-Resistant Depression, NCT01945047.

How Do You Feel the Rhythm: Dynamic Motor-Auditory Interactions Are Involved in the Imagination of Hierarchical Timing

Predicting and organizing patterns of events is important for humans to survive in a dynamically changing world. The motor system has been proposed to be actively, and necessarily, engaged in not only the production but the perception of rhythm by organizing hierarchical timing that influences auditory responses. It is not yet well understood how the motor system interacts with the auditory system to perceive and maintain hierarchical structure in time. This study investigated the dynamic interaction between auditory and motor functional sources during the perception and imagination of musical meters. We pursued this using a novel method combining high-density EEG, EMG, and motion capture with independent component analysis to separate motor and auditory activity during meter imagery while robustly controlling against covert movement. We demonstrated that endogenous brain activity in both auditory and motor functional sources reflects the imagination of binary and ternary meters in the absence of corresponding acoustic cues or overt movement at the meter rate. We found clear evidence for hypothesized motor-to-auditory information flow at the beat rate in all conditions, suggesting a role for top-down influence of the motor system on auditory processing of beat-based rhythms, and reflecting an auditory-motor system with tight reciprocal informational coupling. These findings align with and further extend a set of motor hypotheses from beat perception to hierarchical meter imagination, adding supporting evidence to active engagement of the motor system in auditory processing, which may more broadly speak to the neural mechanisms of temporal processing in other human cognitive functions.SIGNIFICANCE STATEMENT Humans live in a world full of hierarchically structured temporal information, the accurate perception of which is essential for understanding speech and music. Music provides a window into the brain mechanisms of time perception, enabling us to examine how the brain groups musical beats into, for example a march or waltz. Using a novel paradigm combining measurement of electrical brain activity with data-driven analysis, this study directly investigates motor-auditory connectivity during meter imagination. Findings highlight the importance of the motor system in the active imagination of meter. This study sheds new light on a fundamental form of perception by demonstrating how auditory-motor interaction may support hierarchical timing processing, which may have clinical implications for speech and motor rehabilitation.

Cortical mu rhythms during action and passive music listening

Brain systems supporting body movement are active during music listening in the absence of overt movement. This covert motor activity is not well understood, but some theories propose a role in auditory timing prediction facilitated by motor simulation. One question is how music-related covert motor activity relates to motor activity during overt movement. We address this question using scalp electroencephalogram by measuring mu rhythms-cortical field phenomena associated with the somatomotor system that appear over sensorimotor cortex. Lateralized mu enhancement over hand sensorimotor cortex during/just before foot movement in foot versus hand movement paradigms is thought to reflect hand movement inhibition during current/prospective movement of another effector. Behavior of mu during music listening with movement suppressed has yet to be determined. We recorded 32-channel EEG (n = 17) during silence without movement, overt movement (foot/hand), and music listening without movement. Using an independent component analysis-based source equivalent dipole clustering technique, we identified three mu-related clusters, localized to left primary motor and right and midline premotor cortices. Right foot tapping was accompanied by mu enhancement in the left lateral source cluster, replicating previous work. Music listening was accompanied by similar mu enhancement in the left, as well as midline, clusters. We are the first, to our knowledge, to report, and also to source-resolve, music-related mu modulation in the absence of overt movements. Covert music-related motor activity has been shown to play a role in beat perception (Ross JM, Iversen JR, Balasubramaniam R. Neurocase 22: 558-565, 2016). Our current results show enhancement in somatotopically organized mu, supporting overt motor inhibition during beat perception.NEW & NOTEWORTHY We are the first to report music-related mu enhancement in the absence of overt movements and the first to source-resolve mu activity during music listening. We suggest that music-related mu modulation reflects overt motor inhibition during passive music listening. This work is relevant for the development of theories relating to the involvement of covert motor system activity for predictive beat perception.

Vocal learning as a preadaptation for the evolution of human beat perception and synchronization

The human capacity to synchronize movements to an auditory beat is central to musical behaviour and to debates over the evolution of human musicality. Have humans evolved any neural specializations for music processing, or does music rely entirely on brain circuits that evolved for other reasons? The vocal learning and rhythmic synchronization hypothesis proposes that our ability to move in time with an auditory beat in a precise, predictive and tempo-flexible manner originated in the neural circuitry for complex vocal learning. In the 15 years, since the hypothesis was proposed a variety of studies have supported it. However, one study has provided a significant challenge to the hypothesis. Furthermore, it is increasingly clear that vocal learning is not a binary trait animals have or lack, but varies more continuously across species. In the light of these developments and of recent progress in the neurobiology of beat processing and of vocal learning, the current paper revises the vocal learning hypothesis. It argues that an advanced form of vocal learning acts as a preadaptation for sporadic beat perception and synchronization (BPS), providing intrinsic rewards for predicting the temporal structure of complex acoustic sequences. It further proposes that in humans, mechanisms of gene-culture coevolution transformed this preadaptation into a genuine neural adaptation for sustained BPS. The larger significance of this proposal is that it outlines a hypothesis of cognitive gene-culture coevolution which makes testable predictions for neuroscience, cross-species studies and genetics. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.

The influence of auditory rhythms on the speed of inferred motion

The present research explored the influence of isochronous auditory rhythms on the timing of movement-related prediction in two experiments. In both experiments, participants observed a moving disc that was visible for a predetermined period before disappearing behind a small, medium, or large occluded area for the remainder of its movement. In Experiment 1, the disc was visible for 1 s. During this period, participants were exposed to either a fast or slow auditory rhythm, or they heard nothing. They were instructed to press a key to indicate when they believed the moving disc had reached a specified location on the other side of the occluded area. The procedure measured the (signed) error in participants' estimate of the time it would take for a moving object to contact a stationary one. The principal results of Experiment 1 were main effects of the rate of the auditory rhythm and of the size of the occlusion on participants' judgments. In Experiment 2, the period of visibility was varied with size of the occlusion area to keep the total movement time constant for all three levels of occlusion. The results replicated the main effect of rhythm found in Experiment 1 and showed a small, significant interaction, but indicated no main effect of occlusion size. Overall, the results indicate that exposure to fast isochronous auditory rhythms during an interval of inferred motion can influence the imagined rate of such motion and suggest a possible role of an internal rhythmicity in the maintenance of temporally accurate dynamic mental representations.

COSMO-Onset: A Neurally-Inspired Computational Model of Spoken Word Recognition, Combining Top-Down Prediction and Bottom-Up Detection of Syllabic Onsets

Recent neurocognitive models commonly consider speech perception as a hierarchy of processes, each corresponding to specific temporal scales of collective oscillatory processes in the cortex: 30-80 Hz gamma oscillations in charge of phonetic analysis, 4-9 Hz theta oscillations in charge of syllabic segmentation, 1-2 Hz delta oscillations processing prosodic/syntactic units and the 15-20 Hz beta channel possibly involved in top-down predictions. Several recent neuro-computational models thus feature theta oscillations, driven by the speech acoustic envelope, to achieve syllabic parsing before lexical access. However, it is unlikely that such syllabic parsing, performed in a purely bottom-up manner from envelope variations, would be totally efficient in all situations, especially in adverse sensory conditions. We present a new probabilistic model of spoken word recognition, called COSMO-Onset, in which syllabic parsing relies on fusion between top-down, lexical prediction of onset events and bottom-up onset detection from the acoustic envelope. We report preliminary simulations, analyzing how the model performs syllabic parsing and phone, syllable and word recognition. We show that, while purely bottom-up onset detection is sufficient for word recognition in nominal conditions, top-down prediction of syllabic onset events allows overcoming challenging adverse conditions, such as when the acoustic envelope is degraded, leading either to spurious or missing onset events in the sensory signal. This provides a proposal for a possible computational functional role of top-down, predictive processes during speech recognition, consistent with recent models of neuronal oscillatory processes.

The sound of silence: an EEG study of how musicians time pauses in individual and joint music performance

Pauses are an integral feature of social interaction. Conversation partners often pause between conversational turns, and musical co-performers often pause between musical phrases. How do humans coordinate the duration of pauses to ensure seamless interaction? A total of 40 trained pianists performed a simple melody containing fermatas (notated expressive pauses of unspecified duration) first alone (Solo) and then with a partner (Duet) while electroencephalography (EEG) was recorded. As predicted, Duet partners' tone onset synchrony was reduced for tones following pauses. Pauses were shorter in Duet relative to Solo performance, and synchrony of partners' Duet tone onsets was enhanced for tones following shorter pauses. EEG analysis revealed classic signatures of action preparation during pauses, namely decreases in the power of cortical beta oscillations (13-30 Hz, event-related desynchronization ERD). Beta ERD did not differ between pauses in Solo and Duet performance, but was enhanced for shorter relative to longer pauses, suggesting that reduced pause durations in Duet performance facilitated a neural state of enhanced action readiness. Together these findings provide novel insight into behavioural strategies by which musical partners resolve coordination challenges posed by expressive silence, and capture a clear neural signature of action planning during time-varying silences in natural music performance.

Dynamic modulation of cortico-muscular coupling during real and imagined sensorimotor synchronisation

People have a natural and intrinsic ability to coordinate body movements with rhythms surrounding them, known as sensorimotor synchronisation. This can be observed in daily environments, when dancing or singing along with music, or spontaneously walking, talking or applauding in synchrony with one another. However, the neurophysiological mechanisms underlying accurately synchronised movement with selected rhythms in the environment remain unclear. Here we studied real and imagined sensorimotor synchronisation with interleaved auditory and visual rhythms using cortico-muscular coherence (CMC) to better understand the processes underlying the preparation and execution of synchronised movement. Electroencephalography (EEG), electromyography (EMG) from the finger flexors, and continuous force signals were recorded in 20 participants during tapping and imagined tapping with discrete stimulus sequences consisting of alternating auditory beeps and visual flashes. The results show that the synchronisation between cortical and muscular activity in the beta (14-38 Hz) frequency band becomes time-locked to the taps executed in synchrony with the visual and auditory stimuli. Dynamic modulation in CMC also occurred when participants imagined tapping with the visual stimuli, but with lower amplitude and a different temporal profile compared to real tapping. These results suggest that CMC does not only reflect changes related to the production of the synchronised movement, but also to its preparation, which appears heightened under higher attentional demands imposed when synchronising with the visual stimuli. These findings highlight a critical role of beta band neural oscillations in the cortical-muscular coupling underlying sensorimotor synchronisation.

How Beat Perception Co-opts Motor Neurophysiology

Beat perception offers cognitive scientists an exciting opportunity to explore how cognition and action are intertwined in the brain even in the absence of movement. Many believe the motor system predicts the timing of beats, yet current models of beat perception do not specify how this is neurally implemented. Drawing on recent insights into the neurocomputational properties of the motor system, we propose that beat anticipation relies on action-like processes consisting of precisely patterned neural time-keeping activity in the supplementary motor area (SMA), orchestrated and sequenced by activity in the dorsal striatum. In addition to synthesizing recent advances in cognitive science and motor neuroscience, our framework provides testable predictions to guide future work.

Audiovisual Modulation in Music Perception for Musicians and Non-musicians

In audiovisual music perception, visual information from a musical instrument being played is available prior to the onset of the corresponding musical sound and consequently allows a perceiver to form a prediction about the upcoming audio music. This prediction in audiovisual music perception, compared to auditory music perception, leads to lower N1 and P2 amplitudes and latencies. Although previous research suggests that audiovisual experience, such as previous musical experience may enhance this prediction, a remaining question is to what extent musical experience modifies N1 and P2 amplitudes and latencies. Furthermore, corresponding event-related phase modulations quantified as inter-trial phase coherence (ITPC) have not previously been reported for audiovisual music perception. In the current study, audio video recordings of a keyboard key being played were presented to musicians and non-musicians in audio only (AO), video only (VO), and audiovisual (AV) conditions. With predictive movements from playing the keyboard isolated from AV music perception (AV-VO), the current findings demonstrated that, compared to the AO condition, both groups had a similar decrease in N1 amplitude and latency, and P2 amplitude, along with correspondingly lower ITPC values in the delta, theta, and alpha frequency bands. However, while musicians showed lower ITPC values in the beta-band in AV-VO compared to the AO, non-musicians did not show this pattern. Findings indicate that AV perception may be broadly correlated with auditory perception, and differences between musicians and non-musicians further indicate musical experience to be a specific factor influencing AV perception. Predicting an upcoming sound in AV music perception may involve visual predictory processes, as well as beta-band oscillations, which may be influenced by years of musical training. This study highlights possible interconnectivity in AV perception as well as potential modulation with experience.

Event-related desynchronization of alpha and beta band neural oscillations predicts speech and limb motor timing deficits in normal aging

Normal aging is associated with decline of motor timing mechanisms implicated in planning and execution of movement. Evidence from previous studies has highlighted the relationship between neural oscillatory activities and motor timing processing in neurotypical younger adults; however, it remains unclear how normal aging affects the underlying neural mechanisms of movement in older populations. In the present study, we recorded EEG activities in two groups of younger and older adults while they performed randomized speech and limb motor reaction time tasks cued by temporally predictable and unpredictable sensory stimuli. Our data showed that older adults were significantly slower than their younger counterparts during speech production and limb movement, especially in response to temporally unpredictable sensory stimuli. This behavioral effect was accompanied by significant desynchronization of alpha (7-12 Hz) and beta (13-25 Hz) band neural oscillatory activities in older compared with younger adults, primarily during the preparatory pre-motor phase of responses for speech production and limb movement. In addition, we found that faster motor reaction times in younger adults were significantly correlated with weaker desynchronization of pre-motor alpha and beta band neural activities irrespective of stimulus timing and response modality. However, the pre-motor components of alpha and beta activities were timing-specific in older adults and were more strongly desynchronized in response to temporally predictable sensory stimuli. These findings highlight the role of alpha and beta band neural oscillations in motor timing processing mechanisms and reflect their functional deficits during the planning phase of speech production and limb movement in normal aging.

Dissociation between Temporal and Spatial Anticipation in the Neural Dynamics of Goal-directed Movement Preparation

It is well documented that providing advanced information regarding the spatial location of a target stimulus (i.e., spatial anticipation) or its timing of occurrence (i.e., temporal anticipation) influences reach preparation, reducing RTs. Yet, it remains unknown whether the RT gains attributable to temporal and spatial anticipation are subtended by similar preparatory dynamics. Here, this issue is addressed in humans by investigating EEG beta-band activity during reach preparation. Participants performed a reach RT task in which they initiated a movement as fast as possible toward visual targets following their appearance. Temporal anticipation was manipulated by having the target appear after a constant or variable delay period, whereas spatial anticipation was manipulated by precueing participants about the upcoming target location in advance or not. Results revealed that temporal and spatial anticipation both reduced reach RTs, with no interaction. Interestingly, temporal and spatial anticipation were associated with fundamentally different patterns of beta-band modulations. Temporal anticipation was associated with beta-band desynchronization over contralateral sensorimotor regions specifically around the expected moment of target onset, the magnitude of which was correlated with RT modulations across participants. In contrast, spatial anticipation did not influence sensorimotor activity but rather led to increased beta-band power over bilateral parieto-occipital regions during the entire delay period. These results argue for distinct states of preparation incurred by temporal and spatial anticipation. In particular, sensorimotor beta-band desynchronization may reflect the timely disinhibition of movement-related neuronal ensembles at the expected time of movement initiation, without reflecting its spatial parameters per se.

Corticomuscular control of walking in older people and people with Parkinson's disease

Changes in human gait resulting from ageing or neurodegenerative diseases are multifactorial. Here we assess the effects of age and Parkinson’s disease (PD) on corticospinal activity recorded during treadmill and overground walking. Electroencephalography (EEG) from 10 electrodes and electromyography (EMG) from bilateral tibialis anterior muscles were acquired from 22 healthy young, 24 healthy older and 20 adults with PD. Event-related power, corticomuscular coherence (CMC) and inter-trial coherence were assessed for EEG from bilateral sensorimotor cortices and EMG during the double-support phase of the gait cycle. CMC and EMG power at low beta frequencies (13–21 Hz) was significantly decreased in older and PD participants compared to young people, but there was no difference between older and PD groups. Older and PD participants spent shorter time in the swing phase than young individuals. These findings indicate age-related changes in the temporal coordination of gait. The decrease in low-beta CMC suggests reduced cortical input to spinal motor neurons in older people during the double-support phase. We also observed multiple changes in electrophysiological measures at low-gamma frequencies during treadmill compared to overground walking, indicating task-dependent differences in corticospinal locomotor control. These findings may be affected by artefacts and should be interpreted with caution.

Musical Expertise Affects Audiovisual Speech Perception: Findings From Event-Related Potentials and Inter-trial Phase Coherence

In audiovisual speech perception, visual information from a talker's face during mouth articulation is available before the onset of the corresponding audio speech, and thereby allows the perceiver to use visual information to predict the upcoming audio. This prediction from phonetically congruent visual information modulates audiovisual speech perception and leads to a decrease in N1 and P2 amplitudes and latencies compared to the perception of audio speech alone. Whether audiovisual experience, such as with musical training, influences this prediction is unclear, but if so, may explain some of the variations observed in previous research. The current study addresses whether audiovisual speech perception is affected by musical training, first assessing N1 and P2 event-related potentials (ERPs) and in addition, inter-trial phase coherence (ITPC). Musicians and non-musicians are presented the syllable, /ba/ in audio only (AO), video only (VO), and audiovisual (AV) conditions. With the predictory effect of mouth movement isolated from the AV speech (AV-VO), results showed that, compared to audio speech, both groups have a lower N1 latency and P2 amplitude and latency. Moreover, they also showed lower ITPCs in the delta, theta, and beta bands in audiovisual speech perception. However, musicians showed significant suppression of N1 amplitude and desynchronization in the alpha band in audiovisual speech, not present for non-musicians. Collectively, the current findings indicate that early sensory processing can be modified by musical experience, which in turn can explain some of the variations in previous AV speech perception research.

Associative learning of response inhibition affects perceived duration in a subsequent temporal bisection task

Interval timing, the ability to discern the duration of an event, is integral to appropriately navigating the world, from crossing the road to catching a ball. Several features of an event can affect its perceived duration, for example it has previously been shown that a large stimulus is perceived to last longer than a small stimulus. In the current article, participants performed either a Go/No-Go or variable foreperiod task prior to performing a temporal bisection task. In both the Go/No-Go and variable foreperiod tasks, participants learned an association between a particular response and a particular stimulus. Subsequently, the perceived duration of these stimuli was tested in a temporal bisection task. Our findings indicated that associating a stimulus with response inhibition (i.e. a No-Go stimulus) decreased perceived duration compared to a stimulus associated with a response (a Go stimulus). Associating a stimulus with either a short or long foreperiod, on the other hand, did not affect perceived duration. We relate this finding back to the coding efficiency theory and the processing principle. A No-Go stimulus requires more cognitive processing than a Go stimulus and would thus be predicted to increase, rather than decrease, perceived duration in both these time perception theories. Finally, we suggest how our findings might be used in future investigations of interval timing.

Low-Frequency Oscillations Code Speech during Verbal Working Memory

The way the human brain represents speech in memory is still unknown. An obvious characteristic of speech is its evolvement over time. During speech processing, neural oscillations are modulated by the temporal properties of the acoustic speech signal, but also acquired knowledge on the temporal structure of language influences speech perception-related brain activity. This suggests that speech could be represented in the temporal domain, a form of representation that the brain also uses to encode autobiographic memories. Empirical evidence for such a memory code is lacking. We investigated the nature of speech memory representations using direct cortical recordings in the left perisylvian cortex during delayed sentence reproduction in female and male patients undergoing awake tumor surgery. Our results reveal that the brain endogenously represents speech in the temporal domain. Temporal pattern similarity analyses revealed that the phase of frontotemporal low-frequency oscillations, primarily in the beta range, represents sentence identity in working memory. The positive relationship between beta power during working memory and task performance suggests that working memory representations benefit from increased phase separation.SIGNIFICANCE STATEMENT Memory is an endogenous source of information based on experience. While neural oscillations encode autobiographic memories in the temporal domain, little is known on their contribution to memory representations of human speech. Our electrocortical recordings in participants who maintain sentences in memory identify the phase of left frontotemporal beta oscillations as the most prominent information carrier of sentence identity. These observations provide evidence for a theoretical model on speech memory representations and explain why interfering with beta oscillations in the left inferior frontal cortex diminishes verbal working memory capacity. The lack of sentence identity coding at the syllabic rate suggests that sentences are represented in memory in a more abstract form compared with speech coding during speech perception and production.

Contributions of non-primary cortical sources to auditory temporal processing

Temporal processing is essential for speech perception and directional hearing. However, the number and locations of cortical sources involved in auditory temporal processing are still a matter of debate. Using source reconstruction of human EEG responses, we show that, in addition to primary sources in the auditory cortices, sources outside the auditory cortex, designated as non-primary sources, are involved in auditory temporal processing. Non-primary sources within the left and right motor areas, the superior parietal lobe and the right occipital lobe were activated by amplitude-modulated stimuli, and were involved in the functional network. The robustness of these findings was checked for different stimulation conditions. The non-primary sources showed weaker phase-locking and lower activity than primary sources. These findings suggest that the non-primary sources belong to the non-primary auditory pathway. This pathway and non-primary sources detected in motor area explain how, in temporal prediction of upcoming stimuli and motor theory of speech perception, the motor area receives auditory inputs.

Lower Beta: A Central Coordinator of Temporal Prediction in Multimodal Speech

How the brain decomposes and integrates information in multimodal speech perception is linked to oscillatory dynamics. However, how speech takes advantage of redundancy between different sensory modalities, and how this translates into specific oscillatory patterns remains unclear. We address the role of lower beta activity (~20 Hz), generally associated with motor functions, as an amodal central coordinator that receives bottom-up delta-theta copies from specific sensory areas and generate top-down temporal predictions for auditory entrainment. Dissociating temporal prediction from entrainment may explain how and why visual input benefits speech processing rather than adding cognitive load in multimodal speech perception. On the one hand, body movements convey prosodic and syllabic features at delta and theta rates (i.e., 1–3 Hz and 4–7 Hz). On the other hand, the natural precedence of visual input before auditory onsets may prepare the brain to anticipate and facilitate the integration of auditory delta-theta copies of the prosodic-syllabic structure. Here, we identify three fundamental criteria based on recent evidence and hypotheses, which support the notion that lower motor beta frequency may play a central and generic role in temporal prediction during speech perception. First, beta activity must respond to rhythmic stimulation across modalities. Second, beta power must respond to biological motion and speech-related movements conveying temporal information in multimodal speech processing. Third, temporal prediction may recruit a communication loop between motor and primary auditory cortices (PACs) via delta-to-beta cross-frequency coupling. We discuss evidence related to each criterion and extend these concepts to a beta-motivated framework of multimodal speech processing.

Temporal Processing in Audition: Insights from Music

Music is a curious example of a temporally patterned acoustic stimulus, and a compelling pan-cultural phenomenon. This review strives to bring some insights from decades of music psychology and sensorimotor synchronization (SMS) literature into the mainstream auditory domain, arguing that musical rhythm perception is shaped in important ways by temporal processing mechanisms in the brain. The feature that unites these disparate disciplines is an appreciation of the central importance of timing, sequencing, and anticipation. Perception of musical rhythms relies on an ability to form temporal predictions, a general feature of temporal processing that is equally relevant to auditory scene analysis, pattern detection, and speech perception. By bringing together findings from the music and auditory literature, we hope to inspire researchers to look beyond the conventions of their respective fields and consider the cross-disciplinary implications of studying auditory temporal sequence processing. We begin by highlighting music as an interesting sound stimulus that may provide clues to how temporal patterning in sound drives perception. Next, we review the SMS literature and discuss possible neural substrates for the perception of, and synchronization to, musical beat. We then move away from music to explore the perceptual effects of rhythmic timing in pattern detection, auditory scene analysis, and speech perception. Finally, we review the neurophysiology of general timing processes that may underlie aspects of the perception of rhythmic patterns. We conclude with a brief summary and outlook for future research.

Top-down, contextual entrainment of neuronal oscillations in the auditory thalamocortical circuit

Our results indicate that nonhuman primates detect complex repeating acoustic sequences in a continuous auditory stream, which is an important precursor for human speech learning and perception. We demonstrate that oscillatory entrainment, known to support the attentive perception of rhythmic stimulus sequences, can occur for rhythms defined solely by stimulus context rather than physical boundaries. As opposed to acoustically driven entrainment by rhythmic tone sequences demonstrated previously, this form of entrainment relies on the brain’s ability to group auditory inputs based on their statistical regularities. The internally initiated, context-driven modulation of excitability in the medial pulvinar prior to A1 supports the notion of top-down entrainment.

Prior studies have shown that repetitive presentation of acoustic stimuli results in an alignment of ongoing neuronal oscillations to the sequence rhythm via oscillatory entrainment by external cues. Our study aimed to explore the neural correlates of the perceptual parsing and grouping of complex repeating auditory patterns that occur based solely on statistical regularities, or context. Human psychophysical studies suggest that the recognition of novel auditory patterns amid a continuous auditory stimulus sequence occurs automatically halfway through the first repetition. We hypothesized that once repeating patterns were detected by the brain, internal rhythms would become entrained, demarcating the temporal structure of these repetitions despite lacking external cues defining pattern on- or offsets. To examine the neural correlates of pattern perception, neuroelectric activity of primary auditory cortex (A1) and thalamic nuclei was recorded while nonhuman primates passively listened to streams of rapidly presented pure tones and bandpass noise bursts. At arbitrary intervals, random acoustic patterns composed of 11 stimuli were repeated five times without any perturbance of the constant stimulus flow. We found significant delta entrainment by these patterns in the A1, medial geniculate body, and medial pulvinar. In A1 and pulvinar, we observed a statistically significant, pattern structure-aligned modulation of neuronal firing that occurred earliest in the pulvinar, supporting the idea that grouping and detecting complex auditory patterns is a top-down, context-driven process. Besides electrophysiological measures, a pattern-related modulation of pupil diameter verified that, like humans, nonhuman primates consciously detect complex repetitive patterns that lack physical boundaries.

Beta oscillatory power modulation reflects the predictability of pitch change

Humans process highly dynamic auditory information in real time, and regularities in stimuli such as speech and music can aid such processing by allowing sensory predictions for upcoming events. Auditory sequences contain information about both the identity of sounds (what) and their timing (when they occur). Temporal prediction in isochronous sequences is reflected in neural oscillatory power modulation in the beta band (∼20 Hz). Specifically, power decreases (desynchronization) after tone onset and then increases (resynchronization) to reach a maximum around the expected time of the next tone. The current study investigates whether the predictability of the pitch of a tone (what) is also reflected in beta power modulation. We presented two isochronous auditory oddball sequences, each with 20% of tones at a deviant pitch. In one sequence the deviant tones occurred regularly every fifth tone (predictably), but in the other sequence they occurred pseudorandomly (unpredictably). We recorded the electroencephalogram (EEG) while participants listened passively to these sequences. The results showed that auditory beta power desynchronization was larger prior to a predictable than an unpredictable pitch change. A single-trial correlation analysis using linear mixed-effect (LME) models further showed that the deeper the pre-deviant beta desynchronization depth, the smaller the event-related P3a amplitude following the deviant, and this effect only occurred when the pitch change was predictable. Given that P3a is associated with attentional response to prediction error, larger beta desynchronization depth indicates better prediction of an upcoming deviant pitch. Thus, these findings suggest that beta oscillations reflect predictions for what in additional to when during dynamic auditory information processing.

The Role of Posterior Parietal Cortex in Beat-based Timing Perception: A Continuous Theta Burst Stimulation Study

There is growing interest in how the brain's motor systems contribute to the perception of musical rhythms. The Action Simulation for Auditory Prediction hypothesis proposes that the dorsal auditory stream is involved in bidirectional interchange between auditory perception and beat-based prediction in motor planning structures via parietal cortex [Patel, A. D., & Iversen, J. R. The evolutionary neuroscience of musical beat perception: The Action Simulation for Auditory Prediction (ASAP) hypothesis. Frontiers in Systems Neuroscience, 8, 57, 2014]. We used a TMS protocol, continuous theta burst stimulation (cTBS), that is known to down-regulate cortical activity for up to 60 min following stimulation to test for causal contributions to beat-based timing perception. cTBS target areas included the left posterior parietal cortex (lPPC), which is part of the dorsal auditory stream, and the left SMA (lSMA). We hypothesized that down-regulating lPPC would interfere with accurate beat-based perception by disrupting the dorsal auditory stream. We hypothesized that we would induce no interference to absolute timing ability. We predicted that down-regulating lSMA, which is not part of the dorsal auditory stream but has been implicated in internally timed movements, would also interfere with accurate beat-based timing perception. We show ( n = 25) that cTBS down-regulation of lPPC does interfere with beat-based timing ability, but only the ability to detect shifts in beat phase, not changes in tempo. Down-regulation of lSMA, in contrast, did not interfere with beat-based timing. As expected, absolute interval timing ability was not impacted by the down-regulation of lPPC or lSMA. These results support that the dorsal auditory stream plays an essential role in accurate phase perception in beat-based timing. We find no evidence of an essential role of parietal cortex or SMA in interval timing.

Sleep-Dependent Memory Consolidation and Incremental Sentence Comprehension: Computational Dependencies during Language Learning as Revealed by Neuronal Oscillations

We hypothesize a beneficial influence of sleep on the consolidation of the combinatorial mechanisms underlying incremental sentence comprehension. These predictions are grounded in recent work examining the effect of sleep on the consolidation of linguistic information, which demonstrate that sleep-dependent neurophysiological activity consolidates the meaning of novel words and simple grammatical rules. However, the sleep-dependent consolidation of sentence-level combinatorics has not been studied to date. Here, we propose that dissociable aspects of sleep neurophysiology consolidate two different types of combinatory mechanisms in human language: sequence-based (order-sensitive) and dependency-based (order-insensitive) combinatorics. The distinction between the two types of combinatorics is motivated both by cross-linguistic considerations and the neurobiological underpinnings of human language. Unifying this perspective with principles of sleep-dependent memory consolidation, we posit that a function of sleep is to optimize the consolidation of sequence-based knowledge (the when) and the establishment of semantic schemas of unordered items (the what) that underpin cross-linguistic variations in sentence comprehension. This hypothesis builds on the proposal that sleep is involved in the construction of predictive codes, a unified principle of brain function that supports incremental sentence comprehension. Finally, we discuss neurophysiological measures (EEG/MEG) that could be used to test these claims, such as the quantification of neuronal oscillations, which reflect basic mechanisms of information processing in the brain.

Entrained delta oscillations reflect the subjective tracking of time

The ability to precisely anticipate the timing of upcoming events at the time-scale of seconds is essential to predict objects' trajectories or to select relevant sensory information. What neurophysiological mechanism underlies the temporal precision in anticipating the occurrence of events? In a recent article,¹ we demonstrated that the sensori-motor system predictively controls neural oscillations in time to optimize sensory selection. However, whether and how the same oscillatory processes can be used to keep track of elapsing time and evaluate short durations remains unclear.

Here, we aim at testing the hypothesis that the brain tracks durations by converting (external, objective) elapsing time into an (internal, subjective) oscillatory phase-angle. To test this, we measured magnetoencephalographic oscillatory activity while participants performed a delayed-target detection task. In the delayed condition, we observe that trials that are perceived as longer are associated with faster delta-band oscillations. This suggests that the subjective indexing of time is reflected in the range of phase-angles covered by delta oscillations during the pre-stimulus period. This result provides new insights into how we predict and evaluate temporal structure and support models in which the active entrainment of sensori-motor oscillatory dynamics is exploited to track elapsing time.

Motor origin of temporal predictions in auditory attention

In behavior, action and perception are inherently interdependent. However, the actual mechanistic contributions of the motor system to sensory processing are unknown. We present neurophysiological evidence that the motor system is involved in predictive timing, a brain function that aligns temporal fluctuations of attention with the timing of events in a task-relevant stream, thus facilitating sensory selection and optimizing behavior. In a magnetoencephalography experiment involving auditory temporal attention, participants had to disentangle two streams of sound on the unique basis of endogenous temporal cues. We show that temporal predictions are encoded by interdependent delta and beta neural oscillations originating from the left sensorimotor cortex, and directed toward auditory regions. We also found that overt rhythmic movements improved the quality of temporal predictions and sharpened the temporal selection of relevant auditory information. This latter behavioral and functional benefit was associated with increased signaling of temporal predictions in right-lateralized frontoparietal associative regions. In sum, this study points at a covert form of auditory active sensing. Our results emphasize the key role of motor brain areas in providing contextual temporal information to sensory regions, driving perceptual and behavioral selection.

θ-Band and β-Band Neural Activity Reflects Independent Syllable Tracking and Comprehension of Time-Compressed Speech

Recent psychophysics data suggest that speech perception is not limited by the capacity of the auditory system to encode fast acoustic variations through neural γ activity, but rather by the time given to the brain to decode them. Whether the decoding process is bounded by the capacity of θ rhythm to follow syllabic rhythms in speech, or constrained by a more endogenous top-down mechanism, e.g., involving β activity, is unknown. We addressed the dynamics of auditory decoding in speech comprehension by challenging syllable tracking and speech decoding using comprehensible and incomprehensible time-compressed auditory sentences. We recorded EEGs in human participants and found that neural activity in both θ and γ ranges was sensitive to syllabic rate. Phase patterns of slow neural activity consistently followed the syllabic rate (4-14 Hz), even when this rate went beyond the classical θ range (4-8 Hz). The power of θ activity increased linearly with syllabic rate but showed no sensitivity to comprehension. Conversely, the power of β (14-21 Hz) activity was insensitive to the syllabic rate, yet reflected comprehension on a single-trial basis. We found different long-range dynamics for θ and β activity, with β activity building up in time while more contextual information becomes available. This is consistent with the roles of θ and β activity in stimulus-driven versus endogenous mechanisms. These data show that speech comprehension is constrained by concurrent stimulus-driven θ and low-γ activity, and by endogenous β activity, but not primarily by the capacity of θ activity to track the syllabic rhythm.SIGNIFICANCE STATEMENT Speech comprehension partly depends on the ability of the auditory cortex to track syllable boundaries with θ-range neural oscillations. The reason comprehension drops when speech is accelerated could hence be because θ oscillations can no longer follow the syllabic rate. Here, we presented subjects with comprehensible and incomprehensible accelerated speech, and show that neural phase patterns in the θ band consistently reflect the syllabic rate, even when speech becomes too fast to be intelligible. The drop in comprehension, however, is signaled by a significant decrease in the power of low-β oscillations (14-21 Hz). These data suggest that speech comprehension is not limited by the capacity of θ oscillations to adapt to syllabic rate, but by an endogenous decoding process.

Theta oscillations locked to intended actions rhythmically modulate perception

Ongoing brain oscillations are known to influence perception, and to be reset by exogenous stimulations. Voluntary action is also accompanied by prominent rhythmic activity, and recent behavioral evidence suggests that this might be coupled with perception. Here, we reveal the neurophysiological underpinnings of this sensorimotor coupling in humans. We link the trial-by-trial dynamics of EEG oscillatory activity during movement preparation to the corresponding dynamics in perception, for two unrelated visual and motor tasks. The phase of theta oscillations (~4 Hz) predicts perceptual performance, even >1 s before movement. Moreover, theta oscillations are phase-locked to the onset of the movement. Remarkably, the alignment of theta phase and its perceptual relevance unfold with similar non-monotonic profiles, suggesting their relatedness. The present work shows that perception and movement initiation are automatically synchronized since the early stages of motor planning through neuronal oscillatory activity in the theta range.

EEG Mu (µ) rhythm spectra and oscillatory activity differentiate stuttering from non-stuttering adults

Stuttering is linked to sensorimotor deficits related to internal modeling mechanisms. This study compared spectral power and oscillatory activity of EEG mu (μ) rhythms between persons who stutter (PWS) and controls in listening and auditory discrimination tasks. EEG data were analyzed from passive listening in noise and accurate (same/different) discrimination of tones or syllables in quiet and noisy backgrounds. Independent component analysis identified left and/or right μ rhythms with characteristic alpha (α) and beta (β) peaks localized to premotor/motor regions in 23 of 27 people who stutter (PWS) and 24 of 27 controls. PWS produced μ spectra with reduced β amplitudes across conditions, suggesting reduced forward modeling capacity. Group time-frequency differences were associated with noisy conditions only. PWS showed increased μ-β desynchronization when listening to noise and early in discrimination events, suggesting evidence of heightened motor activity that might be related to forward modeling deficits. PWS also showed reduced μ-α synchronization in discrimination conditions, indicating reduced sensory gating. Together these findings indicate spectral and oscillatory analyses of μ rhythms are sensitive to stuttering. More specifically, they can reveal stuttering-related sensorimotor processing differences in listening and auditory discrimination that also may be influenced by basal ganglia deficits.