Motor simulation theories of musical beat perception

Enhancing gait cadence through rhythm-modulated music: A study on healthy adults

BACKGROUND AND OBJECTIVE

Gait disorders stemming from brain lesions or chemical imbalances, pose significant challenges for patients. Proposed treatments encompass medication, deep brain stimulation, physiotherapy, and visual stimulation. Music, with its harmonious structures, serves as a continuous reference, synchronizing muscle activities through neural connections between hearing and motor functions, can show promise in gait disorder management. This study explores the influence of heightened music rhythm on young healthy participants' gait cadence in three conditions: FeedForward (independent rhythm), FeedBack (cadence-synced rhythm), and Adaptive (cadence-controlled musical experience). The objective is to increase gait cadence through rhythm modulation during walking.

METHOD

The study involved 18 young healthy participants (13 males and 5 females) who did not have any gait or hearing disorders. Each participant completed the gait task in the three aforementioned conditions. Each condition was comprised of three sessions: 1) Baseline, where participants walked while listening to the original music; 2) Intervention, changing the music rhythm to affect the gait cadence; and 3) Realign, replaying the original music and measuring the durability of the effect of the Intervention session. The measurement tool was a pair of footwear equipped with push-button switches that transmited the foot-to-ground contact to the LabVIEW® software, all designed by the research team. Repeated measures of ANOVA was employed to evaluate the impact of the sessions and conditions.

RESULTS

In all three conditions, there was a significant effect of music on increasing gait cadence during Intervention and Realign sessions (p < 0.001). Additionally, the immediate impact of music on gait cadence in the Adaptive condition was superior to the other conditions.

CONCLUSION

The study findings indicate that increasing the rhythm of music during walking has a significant impact on gait cadence among young healthy participants. This effect remained significant even after realigning the music to normal. It could be harnessed to support the rehabilitation of individuals with movement disorders characterized by a decrease in movement speed, such as Parkinson's disease. Moreover, the results indicate that the Adaptive method showed promising outcomes, suggesting its potential for further exploration as an effective means to control gait cadence.

Embodying Time in the Brain: A Multi-Dimensional Neuroimaging Meta-Analysis of 95 Duration Processing Studies

Time is an omnipresent aspect of almost everything we experience internally or in the external world. The experience of time occurs through such an extensive set of contextual factors that, after decades of research, a unified understanding of its neural substrates is still elusive. In this study, following the recent best-practice guidelines, we conducted a coordinate-based meta-analysis of 95 carefully-selected neuroimaging papers of duration processing. We categorized the included papers into 14 classes of temporal features according to six categorical dimensions. Then, using the activation likelihood estimation (ALE) technique we investigated the convergent activation patterns of each class with a cluster-level family-wise error correction at p < 0.05. The regions most consistently activated across the various timing contexts were the pre-SMA and bilateral insula, consistent with an embodied theory of timing in which abstract representations of duration are rooted in sensorimotor and interoceptive experience, respectively. Moreover, class-specific patterns of activation could be roughly divided according to whether participants were timing auditory sequential stimuli, which additionally activated the dorsal striatum and SMA-proper, or visual single interval stimuli, which additionally activated the right middle frontal and inferior parietal cortices. We conclude that temporal cognition is so entangled with our everyday experience that timing stereotypically common combinations of stimulus characteristics reactivates the sensorimotor systems with which they were first experienced.

The neural bases of familiar music listening in healthy individuals: An activation likelihood estimation meta-analysis

Accumulating evidence suggests that the neural activations during music listening differs as a function of familiarity with the excerpts. However, the implicated brain areas are unclear. After an extensive literature search, we conducted an Activation Likelihood Estimation analysis on 23 neuroimaging studies (232 foci, 364 participants) to identify consistently activated brain regions when healthy adults listen to familiar music, compared to unfamiliar music or an equivalent condition. The results revealed a left cortical-subcortical co-activation pattern comprising three significant clusters localized to the supplementary motor areas (BA 6), inferior frontal gyrus (IFG, BA 44), and the claustrum/insula. Our results are discussed in a predictive coding framework, whereby temporal expectancies and familiarity may drive motor activations, despite any overt movement. Though conventionally associated with syntactic violation, our observed activation in the IFG may support a recent proposal of its involvement in a network that subserves both violation and prediction. Finally, the claustrum/insula plays an integral role in auditory processing, functioning as a hub that integrates sensory and limbic information to (sub)cortical structures.

Probabilistic modelling of microtiming perception

Music performances are rich in systematic temporal irregularities called "microtiming", too fine-grained to be notated in a musical score but important for musical expression and communication. Several studies have examined listeners' preference for rhythms varying in microtiming, but few have addressed precisely how microtiming is perceived, especially in terms of cognitive mechanisms, making the empirical evidence difficult to interpret. Here we provide evidence that microtiming perception can be simulated as a process of probabilistic prediction. Participants performed an XAB discrimination test, in which an archetypal popular drum rhythm was presented with different microtiming. The results indicate that listeners could implicitly discriminate the mean and variance of stimulus microtiming. Furthermore, their responses were effectively simulated by a Bayesian model of entrainment, using a distance function derived from its dynamic posterior estimate over phase. Wide individual differences in participant sensitivity to microtiming were predicted by a model parameter likened to noisy timekeeping processes in the brain. Overall, this suggests that the cognitive mechanisms underlying perception of microtiming reflect a continuous inferential process, potentially driving qualitative judgements of rhythmic feel.

Cognitive Crescendo: How Music Shapes the Brain's Structure and Function

Music is a complex phenomenon with multiple brain areas and neural connections being implicated. Centuries ago, music was discovered as an efficient modality for psychological status enrichment and even for the treatment of multiple pathologies. Modern research investigations give a new avenue for music perception and the understanding of the underlying neurological mechanisms, using neuroimaging, especially magnetic resonance imaging. Multiple brain areas were depicted in the last decades as being of high value for music processing, and further analyses in the neuropsychology field uncover the implications in emotional and cognitive activities. Music listening improves cognitive functions such as memory, attention span, and behavioral augmentation. In rehabilitation, music-based therapies have a high rate of success for the treatment of depression and anxiety and even in neurological disorders such as regaining the body integrity after a stroke episode. Our review focused on the neurological and psychological implications of music, as well as presenting the significant clinical relevance of therapies using music.

Rhythmic modulation of visual discrimination is linked to individuals' spontaneous motor tempo

The impact of external rhythmic structure on perception has been demonstrated across different modalities and experimental paradigms. However, recent findings emphasize substantial individual differences in rhythm-based perceptual modulation. Here, we examine the link between spontaneous rhythmic preferences, as measured through the motor system, and individual differences in rhythmic modulation of visual discrimination. As a first step, we measure individual rhythmic preferences using the spontaneous tapping task. Then we assess perceptual rhythmic modulation using a visual discrimination task in which targets can appear either in-phase or out-of-phase with a preceding rhythmic stream of visual stimuli. The tempo of the preceding stream was manipulated over different experimental blocks (0.77 Hz, 1.4 Hz, 2 Hz). We find that visual rhythmic stimulation modulates discrimination performance. The modulation is dependent on the tempo of stimulation, with maximal perceptual benefits for the slowest tempo of stimulation (0.77 Hz). Most importantly, the strength of modulation is also linked to individuals' spontaneous motor tempo. Individuals with slower spontaneous tempi show greater rhythmic modulation compared to individuals with faster spontaneous tempi. This finding suggests that different tempi affect the cognitive system with varying levels of efficiency and that self-generated rhythms impact our ability to utilize rhythmic structure in the environment for guiding perception and performance.

Music and Brain Circuitry: Strategies for Strengthening Evidence-Based Research for Music-Based Interventions

The neuroscience of music and music-based interventions (MBIs) is a fascinating but challenging research field. While music is a ubiquitous component of every human society, MBIs may encompass listening to music, performing music, music-based movement, undergoing music education and training, or receiving treatment from music therapists. Unraveling the brain circuits activated and influenced by MBIs may help us gain better understanding of the therapeutic and educational values of MBIs by gathering strong research evidence. However, the complexity and variety of MBIs impose unique research challenges. This article reviews the recent endeavor led by the National Institutes of Health to support evidence-based research of MBIs and their impact on health and diseases. It also highlights fundamental challenges and strategies of MBI research with emphases on the utilization of animal models, human brain imaging and stimulation technologies, behavior and motion capturing tools, and computational approaches. It concludes with suggestions of basic requirements when studying MBIs and promising future directions to further strengthen evidence-based research on MBIs in connections with brain circuitry.SIGNIFICANCE STATEMENT Music and music-based interventions (MBI) engage a wide range of brain circuits and hold promising therapeutic potentials for a variety of health conditions. Comparative studies using animal models have helped in uncovering brain circuit activities involved in rhythm perception, while human imaging, brain stimulation, and motion capture technologies have enabled neural circuit analysis underlying the effects of MBIs on motor, affective/reward, and cognitive function. Combining computational analysis, such as prediction method, with mechanistic studies in animal models and humans may unravel the complexity of MBIs and their effects on health and disease.

Differential motor system entrainment to auditory and visual rhythms

Perception of, and synchronization to, auditory rhythms is known to be more accurate than with flashing visual rhythms. The motor system is known to play a role in the processing of timing information for auditory rhythm perception, but it is unclear if the motor system plays the same role for visual rhythm perception. One demonstrated component of auditory rhythm perception is neural entrainment at the frequency of the auditory rhythm. In this study, we use EEG to measure the entrainment of both auditory and visual rhythms from the motor cortex while subjects either tapped in synchrony with or passively attended to the presented rhythms. To isolate activity from motor cortex, we used independent component analysis to first separate out neural sources, then selected components using a combination of component topography, dipole location, mu activation, and beta modulation. This process took advantage of the fact that tapping activity results in reduced mu power, and characteristic beta modulation, which helped select motor components. Our findings suggest neural entrainment in motor components was stronger for visual rhythms than auditory rhythms and strongest during the tapping conditions for both modalities. We also find mu power increased in response to both auditory and visual rhythms. These findings indicate that the generally greater rhythm perception capabilities of the auditory system over the visual system may not depend entirely on neural entrainment in the motor system, but rather how the motor system is able to use the timing information made available to it. NEW & NOTEWORTHY We investigated neural entrainment in the motor system for both auditory and visual isochronous rhythms using electroencephalogram. Counter to expectations, our findings suggest stronger entrainment for visual rhythms than for auditory rhythms. Motor system activity was isolated with a novel procedure using independent component analysis as a means of blind source separation, along with known markers of mu activity from the motor system to identify motor components.

Thinking rhythm objects

The focus of this mini-review is on rhythm objects, defined as strongly coherent chunks of combined sound and body motion in music, typically in the duration range of a few seconds, as may for instance be found in a fragment of dance music, in an energetic drum fill, in a flute ornament, or in a cascade of sounds of a rapid harp glissando. Although there has been much research on rhythm in continuous musical sound and its links with behavior, including the neurocognitive aspects of periodicity, synchrony, and entrainment, there has been much less focus on the generation and perception of singular coherent rhythm objects. This mini-review aims to enhance our understanding of such rhythm objects by pointing to relevant literature on coherence-enhancing elements such as coarticulation, i.e., the fusion of motion events into more extended rhythm objects, and intermittent motor control, i.e., the discontinuous, instant-by-instant control and triggering of rhythm objects.

Time Perception for Musical Rhythms: Sensorimotor Perspectives on Entrainment, Simulation, and Prediction

Neural mechanisms supporting time perception in continuously changing sensory environments may be relevant to a broader understanding of how the human brain utilizes time in cognition and action. In this review, we describe current theories of sensorimotor engagement in the support of subsecond timing. We focus on musical timing due to the extensive literature surrounding movement with and perception of musical rhythms. First, we define commonly used but ambiguous concepts including neural entrainment, simulation, and prediction in the context of musical timing. Next, we summarize the literature on sensorimotor timing during perception and performance and describe current theories of sensorimotor engagement in the support of subsecond timing. We review the evidence supporting that sensorimotor engagement is critical in accurate time perception. Finally, potential clinical implications for a sensorimotor perspective of timing are highlighted.

Experimental suppression of transcranial magnetic stimulation-electroencephalography sensory potentials

The sensory experience of transcranial magnetic stimulation (TMS) evokes cortical responses measured in electroencephalography (EEG) that confound interpretation of TMS-evoked potentials (TEPs). Methods for sensory masking have been proposed to minimize sensory contributions to the TEP, but the most effective combination for suprathreshold TMS to dorsolateral prefrontal cortex (dlPFC) is unknown. We applied sensory suppression techniques and quantified electrophysiology and perception from suprathreshold dlPFC TMS to identify the best combination to minimize the sensory TEP. In 21 healthy adults, we applied single pulse TMS at 120% resting motor threshold (rMT) to the left dlPFC and compared EEG vertex N100-P200 and perception. Conditions included three protocols: No masking (no auditory masking, no foam, and jittered interstimulus interval [ISI]), Standard masking (auditory noise, foam, and jittered ISI), and our ATTENUATE protocol (auditory noise, foam, over-the-ear protection, and unjittered ISI). ATTENUATE reduced vertex N100-P200 by 56%, "click" loudness perception by 50%, and scalp sensation by 36%. We show that sensory prediction, induced with predictable ISI, has a suppressive effect on vertex N100-P200, and that combining standard suppression protocols with sensory prediction provides the best N100-P200 suppression. ATTENUATE was more effective than Standard masking, which only reduced vertex N100-P200 by 22%, loudness by 27%, and scalp sensation by 24%. We introduce a sensory suppression protocol superior to Standard masking and demonstrate that using an unjittered ISI can contribute to minimizing sensory confounds. ATTENUATE provides superior sensory suppression to increase TEP signal-to-noise and contributes to a growing understanding of TMS-EEG sensory neuroscience.

It Takes Two: Interpersonal Neural Synchrony Is Increased after Musical Interaction

Music’s deeply interpersonal nature suggests that music-derived neuroplasticity relates to interpersonal temporal dynamics, or synchrony. Interpersonal neural synchrony (INS) has been found to correlate with increased behavioral synchrony during social interactions and may represent mechanisms that support them. As social interactions often do not have clearly delineated boundaries, and many start and stop intermittently, we hypothesize that a neural signature of INS may be detectable following an interaction. The present study aimed to investigate this hypothesis using a pre-post paradigm, measuring interbrain phase coherence before and after a cooperative dyadic musical interaction. Ten dyads underwent synchronous electroencephalographic (EEG) recording during silent, non-interactive periods before and after a musical interaction in the form of a cooperative tapping game. Significant post-interaction increases in delta band INS were found in the post-condition and were positively correlated with the duration of the preceding interaction. These findings suggest a mechanism by which social interaction may be efficiently continued after interruption and hold the potential for measuring neuroplastic adaption in longitudinal studies. These findings also support the idea that INS during social interaction represents active mechanisms for maintaining synchrony rather than mere parallel processing of stimuli and motor activity.

A structured ICA-based process for removing auditory evoked potentials

Transcranial magnetic stimulation (TMS)-evoked potentials (TEPs), recorded using electroencephalography (EEG), reflect a combination of TMS-induced cortical activity and multi-sensory responses to TMS. The auditory evoked potential (AEP) is a high-amplitude sensory potential-evoked by the "click" sound produced by every TMS pulse-that can dominate the TEP and obscure observation of other neural components. The AEP is peripherally evoked and therefore should not be stimulation site specific. We address the problem of disentangling the peripherally evoked AEP of the TEP from components evoked by cortical stimulation and ask whether removal of AEP enables more accurate isolation of TEP. We hypothesized that isolation of the AEP using Independent Components Analysis (ICA) would reveal features that are stimulation site specific and unique individual features. In order to improve the effectiveness of ICA for removal of AEP from the TEP, and thus more clearly separate the transcranial-evoked and non-specific TMS-modulated potentials, we merged sham and active TMS datasets representing multiple stimulation conditions, removed the resulting AEP component, and evaluated performance across different sham protocols and clinical populations using reduction in Global and Local Mean Field Power (GMFP/LMFP) and cosine similarity analysis. We show that removing AEPs significantly reduced GMFP and LMFP in the post-stimulation TEP (14 to 400 ms), driven by time windows consistent with the N100 and P200 temporal characteristics of AEPs. Cosine similarity analysis supports that removing AEPs reduces TEP similarity between subjects and reduces TEP similarity between stimulation conditions. Similarity is reduced most in a mid-latency window consistent with the N100 time-course, but nevertheless remains high in this time window. Residual TEP in this window has a time-course and topography unique from AEPs, which follow-up exploratory analyses suggest could be a modulation in the alpha band that is not stimulation site specific but is unique to individual subject. We show, using two datasets and two implementations of sham, evidence in cortical topography, TEP time-course, GMFP/LMFP and cosine similarity analyses that this procedure is effective and conservative in removing the AEP from TEP, and may thus better isolate TMS-evoked activity. We show TEP remaining in early, mid and late latencies. The early response is site and subject specific. Later response may be consistent with TMS-modulated alpha activity that is not site specific but is unique to the individual. TEP remaining after removal of AEP is unique and can provide insight into TMS-evoked potentials and other modulated oscillatory dynamics.

Cortical mu rhythms during action and passive music listening

Brain systems supporting body movement are active during music listening in the absence of overt movement. This covert motor activity is not well understood, but some theories propose a role in auditory timing prediction facilitated by motor simulation. One question is how music-related covert motor activity relates to motor activity during overt movement. We address this question using scalp electroencephalogram by measuring mu rhythms-cortical field phenomena associated with the somatomotor system that appear over sensorimotor cortex. Lateralized mu enhancement over hand sensorimotor cortex during/just before foot movement in foot versus hand movement paradigms is thought to reflect hand movement inhibition during current/prospective movement of another effector. Behavior of mu during music listening with movement suppressed has yet to be determined. We recorded 32-channel EEG (n = 17) during silence without movement, overt movement (foot/hand), and music listening without movement. Using an independent component analysis-based source equivalent dipole clustering technique, we identified three mu-related clusters, localized to left primary motor and right and midline premotor cortices. Right foot tapping was accompanied by mu enhancement in the left lateral source cluster, replicating previous work. Music listening was accompanied by similar mu enhancement in the left, as well as midline, clusters. We are the first, to our knowledge, to report, and also to source-resolve, music-related mu modulation in the absence of overt movements. Covert music-related motor activity has been shown to play a role in beat perception (Ross JM, Iversen JR, Balasubramaniam R. Neurocase 22: 558-565, 2016). Our current results show enhancement in somatotopically organized mu, supporting overt motor inhibition during beat perception.NEW & NOTEWORTHY We are the first to report music-related mu enhancement in the absence of overt movements and the first to source-resolve mu activity during music listening. We suggest that music-related mu modulation reflects overt motor inhibition during passive music listening. This work is relevant for the development of theories relating to the involvement of covert motor system activity for predictive beat perception.

The influence of auditory rhythms on the speed of inferred motion

The present research explored the influence of isochronous auditory rhythms on the timing of movement-related prediction in two experiments. In both experiments, participants observed a moving disc that was visible for a predetermined period before disappearing behind a small, medium, or large occluded area for the remainder of its movement. In Experiment 1, the disc was visible for 1 s. During this period, participants were exposed to either a fast or slow auditory rhythm, or they heard nothing. They were instructed to press a key to indicate when they believed the moving disc had reached a specified location on the other side of the occluded area. The procedure measured the (signed) error in participants' estimate of the time it would take for a moving object to contact a stationary one. The principal results of Experiment 1 were main effects of the rate of the auditory rhythm and of the size of the occlusion on participants' judgments. In Experiment 2, the period of visibility was varied with size of the occlusion area to keep the total movement time constant for all three levels of occlusion. The results replicated the main effect of rhythm found in Experiment 1 and showed a small, significant interaction, but indicated no main effect of occlusion size. Overall, the results indicate that exposure to fast isochronous auditory rhythms during an interval of inferred motion can influence the imagined rate of such motion and suggest a possible role of an internal rhythmicity in the maintenance of temporally accurate dynamic mental representations.

A Sound Prediction: EEG-Based Neural Synchrony Predicts Online Music Streams

Neuroforecasting predicts population-wide choices based on neural data of individuals and can be used, for example, in neuromarketing to estimate campaign successes. To deliver true value, the brain activity metrics should deliver predictive value above and beyond traditional stated preferences. Evidence from movie trailer research has proposed neural synchrony, which compares the similarity of brain responses across participants and has shown to be a promising tool in neuroforecasting for movie popularity. The music industry might also benefit from these increasingly accurate success predictors, but only one study has been forecasting music popularity, using functional magnetic resonance imaging measures. Current research validates the strength of neural synchrony as a predictive measure for popularity of music, making use of electroencephalogram to capture moment-to-moment neural similarity between respondents while they listen to music. Neural synchrony is demonstrated to be a significant predictor for public appreciation on Spotify 3 weeks and 10 months after the release of the albums, especially when combined with the release of a single. On an individual level, other brain measures were shown to relate to individual subjective likeability ratings, including Frontal Alpha Asymmetry and engagement when combined with the factors artist and single release. Our results show the predictive value of brain activity measures outperforms stated preferences. Especially, neural synchrony carries high predictive value for the popularity on Spotify, providing the music industry with an essential asset for efficient decision making and investments, in addition to other practical implications that include neuromarketing and advertising industries.

Modality-specific frequency band activity during neural entrainment to auditory and visual rhythms

Rhythm perception depends on the ability to predict the onset of rhythmic events. Previous studies indicate beta band modulation is involved in predicting the onset of auditory rhythmic events (Fujioka et al., 2009, 2012; Snyder & Large, 2005). We sought to determine if similar processes are recruited for prediction of visual rhythms by investigating whether beta band activity plays a role in a modality-dependent manner for rhythm perception. We looked at electroencephalography time-frequency neural correlates of prediction using an omission paradigm with auditory and visual rhythms. By using omissions, we can separate out predictive timing activity from stimulus-driven activity. We hypothesized that there would be modality-independent markers of rhythm prediction in induced beta band oscillatory activity, and our results support this hypothesis. We find induced and evoked predictive timing in both auditory and visual modalities. Additionally, we performed an exploratory-independent components-based spatial clustering analysis, and describe all resulting clusters. This analysis reveals that there may be overlapping networks of predictive beta activity based on common activation in the parietal and right frontal regions, auditory-specific predictive beta in bilateral sensorimotor regions, and visually specific predictive beta in midline central, and bilateral temporal/parietal regions. This analysis also shows evoked predictive beta activity in the left sensorimotor region specific to auditory rhythms and implicates modality-dependent networks for auditory and visual rhythm perception.

Neural Encoding and Representation of Time for Sensorimotor Control and Learning

The ability to perceive and produce movements in the real world with precise timing is critical for survival in animals, including humans. However, research on sensorimotor timing has rarely considered the tight interrelation between perception, action, and cognition. In this review, we present new evidence from behavioral, computational, and neural studies in humans and nonhuman primates, suggesting a pivotal link between sensorimotor control and temporal processing, as well as describing new theoretical frameworks regarding timing in perception and action. We first discuss the link between movement coordination and interval-based timing by addressing how motor training develops accurate spatiotemporal patterns in behavior and influences the perception of temporal intervals. We then discuss how motor expertise results from establishing task-relevant neural manifolds in sensorimotor cortical areas and how the geometry and dynamics of these manifolds help reduce timing variability. We also highlight how neural dynamics in sensorimotor areas are involved in beat-based timing. These lines of research aim to extend our understanding of how timing arises from and contributes to perceptual-motor behaviors in complex environments to seamlessly interact with other cognitive processes.

Effects of cadence-compatible melodic rhythmic auditory stimulation implementation on gait in patients with Parkinson's disease

PURPOSE

Progressive loss of dopaminergic neurons in basal ganglia is blamed as the main source of gait disturbance in Parkinson's disease (PD). It is known that the normal step pattern does not disappear in PD, but there is a problem in activating the correct step response. The aim of this study was to investigate the effect of Rhythmic Auditory Stimulation (RAS), which is an external stimulus, on gait in individuals with PD.

MATERIALS AND METHODS

Twenty-six individuals, 13 in the PD group and 13 in the control group, participated in the study. All individuals were asked to walk under four different RAS conditions configured with beat frequency and melodic variations. Time-distance parameters and gait performance of the individuals were evaluated.

RESULTS

RAS significantly increased the gait speed of the individuals with PD compared to the control group. RAS set to 10% increase in the cadence of the patient with melody (10 M+) was found to be more effective than the RAS set to normal cadence of the patient without melody (0 M-) (p < 0.05). While all RAS implementations increased the stride length of the individuals with PD (p < 0.05), there was no change in the control group. RAS did not affect the return time in both groups.

CONCLUSIONS

Our study has shown that RAS implementation improves gait in individuals with PD both in terms of time-distance parameters and performance, especially when set to 10% more than the patient's gait cadence. It was concluded that cadence-compatible melodic RAS can be safely included in PD rehabilitation programs.

How Beat Perception Co-opts Motor Neurophysiology

Beat perception offers cognitive scientists an exciting opportunity to explore how cognition and action are intertwined in the brain even in the absence of movement. Many believe the motor system predicts the timing of beats, yet current models of beat perception do not specify how this is neurally implemented. Drawing on recent insights into the neurocomputational properties of the motor system, we propose that beat anticipation relies on action-like processes consisting of precisely patterned neural time-keeping activity in the supplementary motor area (SMA), orchestrated and sequenced by activity in the dorsal striatum. In addition to synthesizing recent advances in cognitive science and motor neuroscience, our framework provides testable predictions to guide future work.

Embodying melody through a conducting baton: a pilot comparison between musicians and non-musicians

Finger-tapping tasks have been widely adopted to investigate auditory-motor synchronization, i.e., the coupling of movement with an external auditory rhythm. However, the discrete nature of these movements usually limits their application to the study of beat perception in the context of isochronous rhythms. The purpose of the present pilot study was to test an innovative task that allows investigating bodily responses to complex, non-isochronous rhythms. A conductor's baton was provided to 16 healthy subjects, divided into 2 different groups depending on the years of musical training they had received (musicians or non-musicians). Ad hoc-created melodies, including notes of different durations, were played to the subjects. Each subject was asked to move the baton up and down according to the changes in pitch contour. Software for video analysis and modelling (Tracker®) was used to track the movement of the baton tip. The main parameters used for the analysis were the velocity peaks in the vertical axis. In the musician group, the number of velocity peaks exactly matched the number of notes, while in the non-musician group, the number of velocity peaks exceeded the number of notes. An exploratory data analysis using Poincaré plots suggested a greater degree of coupling between hand-arm movements and melody in musicians both with isochronous and non-isochronous rhythms. The calculated root mean square error (RMSE) between the note onset times and the velocity peaks, and the analysis of the distribution of velocity peaks in relationship to note onset times confirmed the effect of musical training. Notwithstanding the small number of participants, these results suggest that this novel behavioural task could be used to investigate auditory-motor coupling in the context of music in an ecologically valid setting. Furthermore, the task may be used for rhythm training and rehabilitation in neurological patients with movement disorders.

Motor and Predictive Processes in Auditory Beat and Rhythm Perception

In this article, we review recent advances in research on rhythm and musical beat perception, focusing on the role of predictive processes in auditory motor interactions. We suggest that experimental evidence of the motor system's role in beat perception, including in passive listening, may be explained by the generation and maintenance of internal predictive models, concordant with the Active Inference framework of sensory processing. We highlight two complementary hypotheses for the neural underpinnings of rhythm perception: The Action Simulation for Auditory Prediction hypothesis (Patel and Iversen, 2014) and the Gradual Audiomotor Evolution hypothesis (Merchant and Honing, 2014) and review recent experimental progress supporting each of these hypotheses. While initial formulations of ASAP and GAE explain different aspects of beat-based timing-the involvement of motor structures in the absence of movement, and physical entrainment to an auditory beat respectively-we suggest that work under both hypotheses provide converging evidence toward understanding the predictive role of the motor system in the perception of rhythm, and the specific neural mechanisms involved. We discuss future experimental work necessary to further evaluate the causal neural mechanisms underlying beat and rhythm perception.

Tapping doesn't help: Synchronized self-motion and judgments of musical tempo

For both musicians and music psychologists, beat rate (BPM) has often been regarded as a transparent measure of musical speed or tempo, yet recent research has shown that tempo is more than just BPM. In a previous study, London, Burger, Thompson, and Toiviainen (Acta Psychologica, 164, 70-80, 2016) presented participants with original as well as "time-stretched" versions of classic R&B songs; time stretching slows down or speeds up a recording without changing its pitch or timbre. In that study we discovered a tempo anchoring effect (TAE): Although relative tempo judgments (original vs. time-stretched versions of the same song) were correct, they were at odds with BPM rates of each stimulus. As previous studies have shown that synchronous movement enhances rhythm perception, we hypothesized that tapping along to the beat of these songs would reduce or eliminate the TAE and increase the salience of the beat rate of each stimulus. In the current study participants were presented with the London et al. (Acta Psychologica, 164, 70-80, 2016) stimuli in nonmovement and movement conditions. We found that although participants were able to make BPM-based tempo judgments of generic drumming patterns, and were able to tap along to the R&B stimuli at the correct beat rates, the TAE persisted in both movement and nonmovement conditions. Thus, contrary to our hypothesis that movement would reduce or eliminate the TAE, we found a disjunction between correctly synchronized motor behavior and tempo judgment. The implications of the tapping-TAE dissociation in the broader context of tempo and rhythm perception are discussed, and further approaches to studying the TAE-tapping dissociation are suggested.

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

The role of auditory information on perceptual-motor processes has gained increased interest in sports and psychology research in recent years. Numerous neurobiological and behavioral studies have demonstrated the close interaction between auditory and motor areas of the brain, and the importance of auditory information for movement execution, control, and learning. In applied research, artificially produced acoustic information and real-time auditory information have been implemented in sports and rehabilitation to improve motor performance in athletes, healthy individuals, and patients affected by neurological or movement disorders. However, this research is scattered both across time and scientific disciplines. The aim of this paper is to provide an overview about the interaction between movement and sound and review the current literature regarding the effect of natural movement sounds, movement sonification, and rhythmic auditory information in sports and motor rehabilitation. The focus here is threefold: firstly, we provide an overview of empirical studies using natural movement sounds and movement sonification in sports. Secondly, we review recent clinical and applied studies using rhythmic auditory information and sonification in rehabilitation, addressing in particular studies on Parkinson's disease and stroke. Thirdly, we summarize current evidence regarding the cognitive mechanisms and neural correlates underlying the processing of auditory information during movement execution and its mental representation. The current state of knowledge here reviewed provides evidence of the feasibility and effectiveness of the application of auditory information to improve movement execution, control, and (re)learning in sports and motor rehabilitation. Findings also corroborate the critical role of auditory information in auditory-motor coupling during motor (re)learning and performance, suggesting that this area of clinical and applied research has a large potential that is yet to be fully explored.

Sensorimotor Synchronization With Auditory and Visual Modalities: Behavioral and Neural Differences

It has long been known that the auditory system is better suited to guide temporally precise behaviors like sensorimotor synchronization (SMS) than the visual system. Although this phenomenon has been studied for many years, the underlying neural and computational mechanisms remain unclear. Growing consensus suggests the existence of multiple, interacting, context-dependent systems, and that reduced precision in visuo-motor timing might be due to the way experimental tasks have been conceived. Indeed, the appropriateness of the stimulus for a given task greatly influences timing performance. In this review, we examine timing differences for sensorimotor synchronization and error correction with auditory and visual sequences, to inspect the underlying neural mechanisms that contribute to modality differences in timing. The disparity between auditory and visual timing likely relates to differences in the processing specialization between auditory and visual modalities (temporal vs. spatial). We propose this difference could offer potential explanation for the differing temporal abilities between modalities. We also offer suggestions as to how these sensory systems interface with motor and timing systems.

The Role of Posterior Parietal Cortex in Beat-based Timing Perception: A Continuous Theta Burst Stimulation Study

There is growing interest in how the brain's motor systems contribute to the perception of musical rhythms. The Action Simulation for Auditory Prediction hypothesis proposes that the dorsal auditory stream is involved in bidirectional interchange between auditory perception and beat-based prediction in motor planning structures via parietal cortex [Patel, A. D., & Iversen, J. R. The evolutionary neuroscience of musical beat perception: The Action Simulation for Auditory Prediction (ASAP) hypothesis. Frontiers in Systems Neuroscience, 8, 57, 2014]. We used a TMS protocol, continuous theta burst stimulation (cTBS), that is known to down-regulate cortical activity for up to 60 min following stimulation to test for causal contributions to beat-based timing perception. cTBS target areas included the left posterior parietal cortex (lPPC), which is part of the dorsal auditory stream, and the left SMA (lSMA). We hypothesized that down-regulating lPPC would interfere with accurate beat-based perception by disrupting the dorsal auditory stream. We hypothesized that we would induce no interference to absolute timing ability. We predicted that down-regulating lSMA, which is not part of the dorsal auditory stream but has been implicated in internally timed movements, would also interfere with accurate beat-based timing perception. We show ( n = 25) that cTBS down-regulation of lPPC does interfere with beat-based timing ability, but only the ability to detect shifts in beat phase, not changes in tempo. Down-regulation of lSMA, in contrast, did not interfere with beat-based timing. As expected, absolute interval timing ability was not impacted by the down-regulation of lPPC or lSMA. These results support that the dorsal auditory stream plays an essential role in accurate phase perception in beat-based timing. We find no evidence of an essential role of parietal cortex or SMA in interval timing.

Neural bases of rhythmic entrainment in humans: critical transformation between cortical and lower-level representations of auditory rhythm

The spontaneous ability to entrain to meter periodicities is central to music perception and production across cultures. There is increasing evidence that this ability involves selective neural responses to meter-related frequencies. This phenomenon has been observed in the human auditory cortex, yet it could be the product of evolutionarily older lower-level properties of brainstem auditory neurons, as suggested by recent recordings from rodent midbrain. We addressed this question by taking advantage of a new method to simultaneously record human EEG activity originating from cortical and lower-level sources, in the form of slow (< 20 Hz) and fast (> 150 Hz) responses to auditory rhythms. Cortical responses showed increased amplitudes at meter-related frequencies compared to meter-unrelated frequencies, regardless of the prominence of the meter-related frequencies in the modulation spectrum of the rhythmic inputs. In contrast, frequency-following responses showed increased amplitudes at meter-related frequencies only in rhythms with prominent meter-related frequencies in the input but not for a more complex rhythm requiring more endogenous generation of the meter. This interaction with rhythm complexity suggests that the selective enhancement of meter-related frequencies does not fully rely on subcortical auditory properties, but is critically shaped at the cortical level, possibly through functional connections between the auditory cortex and other, movement-related, brain structures. This process of temporal selection would thus enable endogenous and motor entrainment to emerge with substantial flexibility and invariance with respect to the rhythmic input in humans in contrast with non-human animals.

Your move or mine? Music training and kinematic compatibility modulate synchronization with self- versus other-generated dance movement

Motor simulation has been implicated in how musicians anticipate the rhythm of another musician's action to achieve interpersonal synchronization. Here, we investigated whether similar mechanisms govern a related form of rhythmic action: dance. We examined (1) whether synchronization with visual dance stimuli was influenced by movement agency, (2) whether music training modulated simulation efficiency, and (3) what cues were relevant for simulating the dance rhythm. Participants were first recorded dancing the basic Charleston steps paced by a metronome, and later in a synchronization task they tapped to the rhythm of their own point-light dance stimuli, stimuli of another physically matched participant or one matched in movement kinematics, and a quantitative average across individuals. Results indicated that, while there was no overall "self advantage" and synchronization was generally most stable with the least variable (averaged) stimuli, motor simulation was driven-indicated by high tap-beat variability correlations-by familiar movement kinematics rather than morphological features. Furthermore, music training facilitated simulation, such that musicians outperformed non-musicians when synchronizing with others' movements but not with their own movements. These findings support action simulation as underlying synchronization in dance, linking action observation and rhythm processing in a common motor framework.

Temporal expectancies driven by self- and externally generated rhythms

The dynamic attending theory proposes that rhythms entrain periodic fluctuations of attention which modulate the gain of sensory input. However, temporal expectancies can also be driven by the mere passage of time (foreperiod effect). It is currently unknown how these two types of temporal expectancy relate to each other, i.e. whether they work in parallel and have distinguishable neural signatures. The current research addresses this issue. Participants either tapped a 1Hz rhythm (active task) or were passively presented with the same rhythm using tactile stimulators (passive task). Based on this rhythm an auditory target was then presented early, in synchrony, or late. Behavioural results were in line with the dynamic attending theory as RTs were faster for in- compared to out-of-synchrony targets. Electrophysiological results suggested self-generated and externally induced rhythms to entrain neural oscillations in the delta frequency band. Auditory ERPs showed evidence of two distinct temporal expectancy processes. Both tasks demonstrated a pattern which followed a linear foreperiod effect. In the active task, however, we also observed an ERP effect consistent with the dynamic attending theory. This study shows that temporal expectancies generated by a rhythm and expectancy generated by the mere passage of time can work in parallel and sheds light on how these mechanisms are implemented in the brain.