Precursors to infant sensorimotor synchronization to speech and non-speech rhythms: A longitudinal study

Impaired sensorimotor synchronization (SMS) to acoustic rhythm may be a marker of atypical language development. Here, Motion Capture was used to assess gross motor rhythmic movement at six time points between 5- and 11 months of age. Infants were recorded drumming to acoustic stimuli of varying linguistic and temporal complexity: drumbeats, repeated syllables and nursery rhymes. Here we show, for the first time, developmental change in infants' movement timing in response to auditory stimuli over the first year of life. Longitudinal analyses revealed that whilst infants could not yet reliably synchronize their movement to auditory rhythms, infant spontaneous motor tempo became faster with age, and by 11 months, a subset of infants decelerate from their spontaneous motor tempo, which better accords with the incoming tempo. Further, infants became more regular drummers with age, with marked decreases in the variability of spontaneous motor tempo and variability in response to drumbeats. This latter effect was subdued in response to linguistic stimuli. The current work lays the foundation for using individual differences in precursors of SMS in infancy to predict later language outcomes. RESEARCH HIGHLIGHT: We present the first longitudinal investigation of infant rhythmic movement over the first year of life Whilst infants generally move more quickly and with higher regularity over their first year, by 11 months infants begin to counter this pattern when hearing slower infant-directed song Infant movement is more variable to speech than non-speech stimuli In the context of the larger Cambridge UK BabyRhythm Project, we lay the foundation for rhythmic movement in infancy to predict later language outcomes.

Beta oscillation is an indicator for two patterns of sensorimotor synchronization

Previous study indicates that there are two distinct behavioral patterns in the sensory-motor synchronization task with short stimulus onset asynchrony (SOA; 2-3 s) or long SOA (beyond 4 s). However, the underlying neural indicators and mechanisms have not been elucidated. The present study applied magnetoencephalography (MEG) technology to examine the functional role of several oscillations (beta, gamma, and mu) in sensorimotor synchronization with different SOAs to identify a reliable neural indicator. During MEG recording, participants underwent a listening task without motor response, a sound-motor synchronization task, and a motor-only continuation task. These tasks were used to explore whether and how the activity of oscillations changes across different behavioral patterns with different tempos. Results showed that during both the listening and the synchronization task, the beta oscillation changes with the tempo. Moreover, the event-related synchronization of beta oscillations was significantly correlated with motor timing during synchronization. In contrast, mu activity only changes with the tempo in the synchronization task, while the gamma activity remains unchanged. In summary, the current study indicates that beta oscillation could be an indicator of behavioral patterns between fast tempo and slow tempo in sensorimotor synchronization. Also, it is likely to be the potential mechanism of maintaining rhythmic continuous movements with short SOA, which is embedded within the 3 s time window.

Central pattern generators evolved for real-time adaptation to rhythmic stimuli

For a robot to be both autonomous and collaborative requires the ability to adapt its movement to a variety of external stimuli, whether these come from humans or other robots. Typically, legged robots have oscillation periods explicitly defined as a control parameter, limiting the adaptability of walking gaits. Here we demonstrate a virtual quadruped robot employing a bio-inspired central pattern generator (CPG) that can spontaneously synchronize its movement to a range of rhythmic stimuli. Multi-objective evolutionary algorithms were used to optimize the variation of movement speed and direction as a function of the brain stem drive and the centre of mass control respectively. This was followed by optimization of an additional layer of neurons that filters fluctuating inputs. As a result, a range of CPGs were able to adjust their gait pattern and/or frequency to match the input period. We show how this can be used to facilitate coordinated movement despite differences in morphology, as well as to learn new movement patterns.

Neural tracking of visual periodic motion

Periodicity is a fundamental property of biological systems, including human movement systems. Periodic movements support displacements of the body in the environment as well as interactions and communication between individuals. Here, we use electroencephalography (EEG) to investigate the neural tracking of visual periodic motion, and more specifically, the relevance of spatiotemporal information contained at and between their turning points. We compared EEG responses to visual sinusoidal oscillations versus nonlinear Rayleigh oscillations, which are both typical of human movements. These oscillations contain the same spatiotemporal information at their turning points but differ between turning points, with Rayleigh oscillations having an earlier peak velocity, shown to increase an individual's capacity to produce accurately synchronized movements. EEG analyses highlighted the relevance of spatiotemporal information between the turning points by showing that the brain precisely tracks subtle differences in velocity profiles, as indicated by earlier EEG responses for Rayleigh oscillations. The results suggest that the brain is particularly responsive to velocity peaks in visual periodic motion, supporting their role in conveying behaviorally relevant timing information at a neurophysiological level. The results also suggest key functions of neural oscillations in the Alpha and Beta frequency bands, particularly in the right hemisphere. Together, these findings provide insights into the neural mechanisms underpinning the processing of visual periodic motion and the critical role of velocity peaks in enabling proficient visuomotor synchronization.

The Tapping-PROMS: A test for the assessment of sensorimotor rhythmic abilities

Sensorimotor synchronization is a longstanding paradigm in the analysis of isochronous beat tapping. Assessing the finger tapping of complex rhythmic patterns is far less explored and considerably more complex to analyze. Hence, whereas several instruments to assess tempo or beat tapping ability exist, there is at present a shortage of paradigms and tools for the assessment of the ability to tap to complex rhythmic patterns. To redress this limitation, we developed a standardized rhythm tapping test comprising test items of different complexity. The items were taken from the rhythm and tempo subtests of the Profile of Music Perception Skills (PROMS), and administered as tapping items to 40 participants (20 women). Overall, results showed satisfactory psychometric properties for internal consistency and test-retest reliability. Convergent, discriminant, and criterion validity correlations fell in line with expectations. Specifically, performance in rhythm tapping was correlated more strongly with performance in rhythm perception than in tempo perception, whereas performance in tempo tapping was more strongly correlated with performance in tempo than rhythm perception. Both tapping tasks were only marginally correlated with non-temporal perception tasks. In combination, the tapping tasks explained variance in external indicators of musical proficiency above and beyond the perceptual PROMS tasks. This tool allows for the assessment of complex rhythmic tapping skills in about 15 min, thus providing a useful addition to existing music aptitude batteries.

Age interferes with sensorimotor timing and error correction in the supra-second range

Introduction

Precise motor timing including the ability to adjust movements after changes in the environment is fundamental to many daily activities. Sensorimotor timing in the sub-and supra-second range might rely on at least partially distinct brain networks, with the latter including the basal ganglia (BG) and the prefrontal cortex (PFC). Since both structures are particularly vulnerable to age-related decline, the present study investigated whether age might distinctively affect sensorimotor timing and error correction in the supra-second range.

Methods

A total of 50 healthy right-handed volunteers with 22 older (age range: 50-60 years) and 28 younger (age range: 20-36 years) participants synchronized the tap-onsets of their right index finger with an isochronous auditory pacing signal. Stimulus onset asynchronies were either 900 or 1,600 ms. Positive or negative step-changes that were perceivable or non-perceivable were occasionally interspersed to the fixed intervals to induce error correction. A simple reaction time task served as control condition.

Results and Discussion

In line with our hypothesis, synchronization variability in trials with supra-second intervals was larger in the older group. While reaction times were not affected by age, the mean negative asynchrony was significantly smaller in the elderly in trials with positive step-changes, suggesting more pronounced tolerance of positive deviations at older age. The analysis of error correction by means of the phase correction response (PCR) suggests reduced error correction in the older group. This effect emerged in trials with supra-second intervals and large positive step-changes, only. Overall, these results support the hypothesis that sensorimotor synchronization in the sub-second range is maintained but synchronization accuracy and error correction in the supra-second range is reduced in the elderly as early as in the fifth decade of life suggesting that these measures are suitable for the early detection of age-related changes of the motor system.

Effects of motor pacing on frontal-hemodynamic responses during continuous upper-limb and whole-body movements

Advances in timing research advocate for the existence of two timing mechanisms (automatic vs. controlled) that are related to the level of cognitive control intervening for motor behavior regulation. In the present study, we used the functional near-infrared spectroscopy (fNIRS) cutting-edge technique to examine the hypothesis that prefrontal inhibitory control is needed to perform slow motor activities. Participants were asked to perform a sensorimotor-synchronization task at various paces (i.e., slow, close-to-spontaneous, fast). We contrasted upper-limb circle drawing to a more naturalistic behavior that required whole-body movements (i.e., steady-state walking). Results indicated that whole-body movements led to greater brain oxygenation over the motor regions when compared with upper-limb activities. The effect of motor pace was found in the walking task only, with more bilateral orbitofrontal and left dorsolateral activation at slow versus fast pace. Exploratory analyses revealed a positive correlation between the activation of the orbitofrontal and motor areas for the close-to-spontaneous pace in both tasks. Overall, results support the key role of prefrontal cognitive control in the production of slow whole-body movements. In addition, our findings confirm that upper-limb (laboratory-based) tasks might not be representative of those engaged during everyday-life motor behaviors. The fNIRS technique may be a valuable tool to decipher the neurocognitive mechanisms underlying naturalistic, adaptive motor behaviors.

The effect of the severity of neurocognitive disorders on emotional and motor responses to music

The successful design of musical interventions for dementia patients requires knowledge of how rhythmic abilities change with disease severity. In this study, we tested the impact of the severity of the neurocognitive disorders (NCD) on the socioemotional and motor responses to music in three groups of patients with Major NCD, Mild NCD, or No NCD. Patients were asked to tap to a metronomic or musical rhythm while facing a live musician or through a video. We recorded their emotional facial reactions and their sensorimotor synchronization (SMS) abilities. Patients with No NCD or Mild NCD expressed positive socioemotional reactions to music, but patients with Major NCD did not, indicating a decrease in the positive emotional impact of music at this stage of the disease. SMS to a metronome was less regular and less precise in patients with a Major NCD than in patients with No NCD or Mild NCD, which was not the case when tapping with music, particularly in the presence of a live musician, suggesting the relevance of live performance for patients with Major NCD. These findings suggest that the socioemotional and motor reactions to music are negatively affected by the progression of the NCD.

Dysfunctional Timing in Traumatic Brain Injury Patients: Co-occurrence of Cognitive, Motor, and Perceptual Deficits

Timing is an essential part of human cognition and of everyday life activities, such as walking or holding a conversation. Previous studies showed that traumatic brain injury (TBI) often affects cognitive functions such as processing speed and time-sensitive abilities, causing long-term sequelae as well as daily impairments. However, the existing evidence on timing capacities in TBI is mostly limited to perception and the processing of isolated intervals. It is therefore open whether the observed deficits extend to motor timing and to continuous dynamic tasks that more closely match daily life activities. The current study set out to answer these questions by assessing audio motor timing abilities and their relationship with cognitive functioning in a group of TBI patients (n = 15) and healthy matched controls. We employed a comprehensive set of tasks aiming at testing timing abilities across perception and production and from single intervals to continuous auditory sequences. In line with previous research, we report functional impairments in TBI patients concerning cognitive processing speed and perceptual timing. Critically, these deficits extended to motor timing: The ability to adjust to tempo changes in an auditory pacing sequence was impaired in TBI patients, and this motor timing deficit covaried with measures of processing speed. These findings confirm previous evidence on perceptual and cognitive timing deficits resulting from TBI and provide first evidence for comparable deficits in motor behavior. This suggests basic co-occurring perceptual and motor timing impairments that may factor into a wide range of daily activities. Our results thus place TBI into the wider range of pathologies with well-documented timing deficits (such as Parkinson’s disease) and encourage the search for novel timing-based therapeutic interventions (e.g., employing dynamic and/or musical stimuli) with high transfer potential to everyday life activities.

Extreme precision in rhythmic interaction is enabled by role-optimized sensorimotor coupling: analysis and modelling of West African drum ensemble music

Human social interactions often involve carefully synchronized behaviours. Musical performance in particular features precise timing and depends on the differentiation and coordination of musical/social roles. Here, we study the influence of musical/social roles, individual musicians and different ensembles on rhythmic synchronization in Malian drum ensemble music, which features synchronization accuracy near the limits of human performance. We analysed 72 recordings of the same piece performed by four trios, in which two drummers in each trio systematically switched roles (lead versus accompaniment). Musical role, rather than individual or group differences, is the main factor influencing synchronization accuracy. Using linear causal modelling, we found a consistent pattern of bi-directional couplings between players, in which the direction and strength of rhythmic adaptation is asymmetrically distributed across musical roles. This differs from notions of musical leadership, which assume that ensemble synchronization relies predominantly on a single dominant personality and/or musical role. We then ran simulations that varied the direction and strength of sensorimotor coupling and found that the coupling pattern used by the Malian musicians affords nearly optimal synchronization. More broadly, our study showcases the importance of ecologically valid and culturally diverse studies of human behaviour. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.

Towards a Comprehensive Account of Rhythm Processing Issues in Developmental Dyslexia

Developmental dyslexia is typically defined as a difficulty with an individual's command of written language, arising from deficits in phonological awareness. However, motor entrainment difficulties in non-linguistic synchronization and time-keeping tasks have also been reported. Such findings gave rise to proposals of an underlying rhythm processing deficit in dyslexia, even though to date, evidence for impaired motor entrainment with the rhythm of natural speech is rather scarce, and the role of speech rhythm in phonological awareness is unclear. The present study aimed to fill these gaps. Dyslexic adults and age-matched control participants with variable levels of previous music training completed a series of experimental tasks assessing phoneme processing, rhythm perception, and motor entrainment abilities. In a rhythm entrainment task, participants tapped along to the perceived beat of natural spoken sentences. In a phoneme processing task, participants monitored for sonorant and obstruent phonemes embedded in nonsense strings. Individual sensorimotor skills were assessed using a number of screening tests. The results lacked evidence for a motor impairment or a general motor entrainment difficulty in dyslexia, at least among adult participants of the study. Instead, the results showed that the participants' performance in the phonemic task was predictive of their performance in the rhythmic task, but not vice versa, suggesting that atypical rhythm processing in dyslexia may be the consequence, but not the cause, of dyslexic difficulties with phoneme-level encoding. No evidence for a deficit in the entrainment to the syllable rate in dyslexic adults was found. Rather, metrically weak syllables were significantly less often at the center of rhythmic attention in dyslexic adults as compared to neurotypical controls, with an increased tendency in musically trained participants. This finding could not be explained by an auditory deficit in the processing of acoustic-prosodic cues to the rhythm structure, but it is likely to be related to the well-documented auditory short-term memory issue in dyslexia.

The Importance of Rhythmic Stimulation for Preterm Infants in the NICU

The fetal environment provides the fetus with multiple potential sources of rhythmic stimulation that are not present in the NICU. Maternal breathing, heartbeats, walking, dancing, running, speaking, singing, etc., all bathe the fetus in an environment of varied rhythmic stimuli: vestibular, somatosensory, tactile, and auditory. In contrast, the NICU environment does not offer the same proportion of rhythmic stimulation. After analyzing the lack of rhythmic stimulation in the NICU, this review highlights the different proposals for vestibular and/or auditory rhythmic stimulation offered to preterm infants alone and with their parents. The focus is on the beneficial effects of auditory and vestibular stimulation involving both partners of the mother-infant dyad. A preliminary study on the influence of a skin-to-skin lullaby on the stability of maternal behavior and on the tonic emotional manifestations of the preterm infant is presented as an example. The review concludes with the importance of introducing rhythmic stimulations in the NICU.

Adapting Footfall Rhythmicity to Auditory Perturbations Affects Resilience of Locomotor Behavior: A Proof-of-Concept Study

For humans, the ability to effectively adapt footfall rhythm to perturbations is critical for stable locomotion. However, only limited information exists regarding how dynamic stability changes when individuals modify their footfall rhythm. In this study, we recorded 3D kinematic activity from 20 participants (13 males, 18–30 years old) during walking on a treadmill while synchronizing with an auditory metronome sequence individualized to their baseline walking characteristics. The sequence then included unexpected temporal perturbations in the beat intervals with the subjects required to adapt their footfall rhythm accordingly. Building on a novel approach to quantify resilience of locomotor behavior, this study found that, in response to auditory perturbation, the mean center of mass (COM) recovery time across all participants who showed deviation from steady state (N = 15) was 7.4 (8.9) s. Importantly, recovery of footfall synchronization with the metronome beats after perturbation was achieved prior (+3.4 [95.0% CI +0.1, +9.5] s) to the recovery of COM kinematics. These results highlight the scale of temporal adaptation to perturbations and provide implications for understanding regulation of rhythm and balance. Thus, our study extends the sensorimotor synchronization paradigm to include analysis of COM recovery time toward improving our understanding of an individual’s resilience to perturbations and potentially also their fall risk.

Dynamic Modulation of Beta Band Cortico-Muscular Coupling Induced by Audio-Visual Rhythms

Human movements often spontaneously fall into synchrony with auditory and visual environmental rhythms. Related behavioral studies have shown that motor responses are automatically and unintentionally coupled with external rhythmic stimuli. However, the neurophysiological processes underlying such motor entrainment remain largely unknown. Here, we investigated with electroencephalography (EEG) and electromyography (EMG) the modulation of neural and muscular activity induced by periodic audio and/or visual sequences. The sequences were presented at either 1 or 2 Hz, while participants maintained constant finger pressure on a force sensor. The results revealed that although there was no change of amplitude in participants' EMG in response to the sequences, the synchronization between EMG and EEG recorded over motor areas in the beta (12-40 Hz) frequency band was dynamically modulated, with maximal coherence occurring about 100 ms before each stimulus. These modulations in beta EEG-EMG motor coherence were found for the 2-Hz audio-visual sequences, confirming at a neurophysiological level the enhancement of motor entrainment with multimodal rhythms that fall within preferred perceptual and movement frequency ranges. Our findings identify beta band cortico-muscular coupling as a potential underlying mechanism of motor entrainment, further elucidating the nature of the link between sensory and motor systems in humans.

Contrasting contributions of movement onset and duration to self-evaluation of sensorimotor timing performance

Movement execution is not always optimal. Understanding how humans evaluate their own motor decisions can give us insights into their suboptimality. Here, we investigated how humans time the action of synchronizing an arm movement with a predictable visual event and how well they can evaluate the outcome of this action. On each trial, participants had to decide when to start (reaction time) and for how long to move (movement duration) to reach a target on time. After each trial, participants judged the confidence they had that their performance on that trial was better than average. We found that participants mostly varied their reaction time, keeping the average movement duration short and relatively constant across conditions. Interestingly, confidence judgements reflected deviations from the planned reaction time and were not related to planned movement duration. In two other experiments, we replicated these results in conditions where the contribution of sensory uncertainty was reduced. In contrast to confidence judgements, when asked to make an explicit estimation of their temporal error, participants' estimates were related in a similar manner to both reaction time and movement duration. In summary, humans control the timing of their actions primarily by adjusting the delay to initiate the action, and they estimate their confidence in their action from the difference between the planned and executed movement onset. Our results highlight the critical role of the internal model for the self‐evaluation of one's motor performance.

Dynamic Systems Approach in Sensorimotor Synchronization: Adaptation to Tempo Step-Change

This paper presents a dynamic systems model of a sensorimotor synchronization (SMS) task. An SMS task typically gives temporally discrete human responses to some temporally discrete stimuli. Here, a dynamic systems modeling approach is applied after converting the discrete events to regularly sampled time signals. To collect data for model parameter fitting, a previously published pilot study was expanded. Three human participants took part in an experiment: to tap a finger on a keyboard, following a metronome which changed tempo in steps. System identification was used to estimate the transfer function that represented the relationship between the stimulus and the step response signals, assuming a separate linear, time-invariant system for each tempo step. Different versions of model complexity were investigated. As a minimum, a second-order linear system with delay, two poles, and one zero was needed to model the most important features of the tempo step response by humans, while an additional third pole could give a somewhat better fit to the response data. The modeling results revealed the behavior of the system in two distinct regimes: tempo steps below and above the conscious awareness of tempo change, i.e., around 12% of the base tempo. For the tempo steps above this value, model parameters were derived as linear functions of step size for the group of three participants. The results were interpreted in the light of known facts from other fields like SMS, psychoacoustics and behavioral neuroscience.

Time-oriented attention improves accuracy in a paced finger-tapping task

Finger tapping is a task widely used in a variety of experimental paradigms, in particular to understand sensorimotor synchronization and time processing in the range of hundreds of milliseconds (millisecond timing). Normally, subjects do not receive any instruction about what to attend to and the results are seldom interpreted taking into account the possible effects of attention. In this work we show that attention can be oriented to the purely temporal aspects of a paced finger-tapping task and that it affects performance. Specifically, time-oriented attention improves the accuracy in paced finger tapping and it also increases the resynchronization efficiency after a period perturbation. We use two markers of the attention level: auditory ERPs and subjective report of the mental workload. In addition, we propose a novel algorithm to separate the auditory, stimulus-related components from the somatosensory, response-related ones, which are naturally overlapped in the recorded EEG.

The TeensyTap Framework for Sensorimotor Synchronization Experiments

Synchronizing movements with an external periodic stimulus, such as tapping your foot along with a metronome, is a remarkable human skill called sensorimotor synchronization. A growing body of literature investigates this process, but experiments require collecting responses with high temporal reliability, which often requires specialized hardware. The current article presents and validates TeensyTap, an inexpensive, highly functional framework with excellent timing performance. The framework uses widely available, low-cost hardware and consists of custom-written open-source software and communication protocols. TeensyTap allows running complete experiments through a graphical user interface and can simultaneously present a pacing signal (metronome), measure movements using a force-sensitive resistor, and deliver auditory feedback, with optional experimenter-specified artificial feedback delays. Movement data is communicated to a computer and saved for offline analysis in a format that allows it to be easily imported into spreadsheet programs. The present work also reports a validation experiment showing that timing performance of TeensyTap is highly accurate, ranking it among the gold standard tools available in the field. Metronome pacing signals are presented with millisecond accuracy, feedback sounds are delivered on average 2 ms following the subjects' taps, and the timing log files produced by the device are unbiased and accurate to within a few milliseconds. The framework allows for a range of experimental questions to be addressed and, since it is open source and transparent, researchers with some technical expertise can easily adapt and extend it to accommodate a host of possible future experiments that have yet to be imagined.

Attention Guides the Motor-Timing Strategies in Finger-Tapping Tasks When Moving Fast and Slow

Human beings adapt the spontaneous pace of their actions to interact with the environment. Yet, the nature of the mechanism enabling such adaptive behavior remains poorly understood. The aim of the present contribution was to examine the role of attention in motor timing using (a) time series analysis, and (b) a dual task paradigm. In a series of two studies, a finger-tapping task was used in sensorimotor synchronization with various tempi (from 300 to 1,100 ms) and motor complexity (one target vs. six targets). Time series analyzes indicated that two different timing strategies were used depending on the speed constraints. At slow tempi, tapping sequences were characterized by strong negative autocorrelations, suggesting the implication of cognitive predictive timing. When moving at fast and close-to-spontaneous tempi, tapping sequences were characterized by less negative autocorrelations, suggesting that timing properties emerged from body movement dynamics. The analysis of the dual-task reaction times confirmed that both the temporal and spatial constraints impacted the attentional resources allocated to the finger-tapping tasks. Overall, our work suggests that moving fast and slow involve distinct timing strategies that are characterized by contrasting attentional demands.

Procedural learning and retention of audio-verbal temporal sequence is altered in children with developmental coordination disorder but cortical thickness matters

Rhythmic abilities are impaired in developmental coordination disorder (DCD) but learning deficit of procedural skills implying temporal sequence is still unclear. Current contradictory results suggest that procedural learning deficits in DCD highly depend on learning conditions. The present study proposes to test the role of sensory modality of stimulations (visual or auditory) on synchronization, learning, and retention of temporal verbal sequences in children with and without DCD. We postulated a deficit in learning particularly with auditory stimulations, in association with atypical cortical thickness of three regions of interesting: sensorimotor, frontal and parietal regions. Thirty children with and without DCD (a) performed a synchronization task to a regular temporal sequence and (b) practiced and recalled a novel non-regular temporal sequences with auditory and visual modalities. They also had a magnetic resonance imaging to measure their cortical thickness. Results suggested that children with DCD presented a general deficit in synchronization of a regular temporal verbal sequence irrespective of the sensory modality, but a specific deficit in learning and retention of auditory non-regular verbal temporal sequence. Stability of audio-verbal synchronization during practice correlated with cortical thickness of the sensorimotor cortex. For the first time, our results suggest that synchronization deficits in DCD are not limited to manual tasks. This deficit persists despite repeated exposition and practice of an auditory temporal sequence, which suggests a possible alteration in audio-verbal coupling in DCD. On the contrary, control of temporal parameters with visual stimuli seems to be less affected, which opens perspectives for clinical practice.

Headphones or Speakers? An Exploratory Study of Their Effects on Spontaneous Body Movement to Rhythmic Music

Previous studies have shown that music may lead to spontaneous body movement, even when people try to stand still. But are spontaneous movement responses to music similar if the stimuli are presented using headphones or speakers? This article presents results from an exploratory study in which 35 participants listened to rhythmic stimuli while standing in a neutral position. The six different stimuli were 45 s each and ranged from a simple pulse to excerpts from electronic dance music (EDM). Each participant listened to all the stimuli using both headphones and speakers. An optical motion capture system was used to calculate their quantity of motion, and a set of questionnaires collected data about music preferences, listening habits, and the experimental sessions. The results show that the participants on average moved more when listening through headphones. The headphones condition was also reported as being more tiresome by the participants. Correlations between participants' demographics, listening habits, and self-reported body motion were observed in both listening conditions. We conclude that the playback method impacts the level of body motion observed when people are listening to music. This should be taken into account when designing embodied music cognition studies.

Cadence Modulation in Walking and Running: Pacing Steps or Strides?

A change in cadence during walking or running might be indicated for a variety of reasons, among which mobility improvement and injury prevention. In a within-subject study design, we examined whether walking or running cadences are modulated best by means of step-based or stride-based auditory pacing. Sixteen experienced runners walked and ran on a treadmill while synchronizing with step-based and stride-based pacing at slow, preferred and fast pacing frequencies in synchronization-perturbation and synchronization-continuation conditions. We quantified the variability of the relative phase between pacing cues and footfalls and the responses to perturbations in the pacing signal as measures of coordinative stability; the more stable the auditory-motor coordination, the stronger the modulating effect of pacing. Furthermore, we quantified the deviation from the prescribed cadence after removal of the pacing signal as a measure of internalization of this cadence. Synchronization was achieved less often in running, especially at slow pacing frequencies. If synchronization was achieved, coordinative stability was similar, and the paced cadence was well internalized for preferred and fast pacing frequencies. Step-based pacing led to more stable auditory-motor coordination than stride-based pacing in both walking and running. We therefore concluded that step-based auditory pacing deserves preference as a means to modulate cadence in walking and running.

A Tablet-Based Assessment of Rhythmic Ability

The exponential rise in use of mobile consumer electronics has presented a great potential for research to be conducted remotely, with participants numbering several orders of magnitude greater than a typical research paradigm. Here, we attempt to demonstrate the validity and reliability of using a consumer game-engine to create software presented on a mobile tablet to assess sensorimotor synchronization, a proxy of rhythmic ability. Our goal was to ascertain whether previously observed research results can be replicated, rather than assess whether a mobile tablet achieves comparable performance to a desktop computer. To achieve this, younger (aged 18–35 years) and older (aged 60–80 years) adult musicians and non-musicians were recruited to play a custom-designed sensorimotor synchronization assessment on a mobile tablet in a controlled laboratory environment. To assess reliability, participants performed the assessment twice, separated by a week, and an intra-class correlation coefficient (ICC) was calculated. Results supported the validity of this approach to assessing rhythmic abilities by replicating previously observed results. Specifically, musicians performed better than non-musicians, and younger adults performed better than older adults. Participants also performed best when the tempo was in the range of previously-identified preferred tempos, when the stimuli included both audio and visual information, and when synchronizing on-beat compared to off-beat or continuation (self-paced) synchronization. Additionally, high ICC values (>0.75) suggested excellent test–retest reliability. Together, these results support the notion that consumer electronics running software built with a game engine may serve as a valuable resource for remote, mobile-based data collection of rhythmic abilities.

Poor Synchronization to Musical Beat Generalizes to Speech

The rhythmic nature of speech may recruit entrainment mechanisms in a manner similar to music. In the current study, we tested the hypothesis that individuals who display a severe deficit in synchronizing their taps to a musical beat (called beat-deaf here) would also experience difficulties entraining to speech. The beat-deaf participants and their matched controls were required to align taps with the perceived regularity in the rhythm of naturally spoken, regularly spoken, and sung sentences. The results showed that beat-deaf individuals synchronized their taps less accurately than the control group across conditions. In addition, participants from both groups exhibited more inter-tap variability to natural speech than to regularly spoken and sung sentences. The findings support the idea that acoustic periodicity is a major factor in domain-general entrainment to both music and speech. Therefore, a beat-finding deficit may affect periodic auditory rhythms in general, not just those for music.

When Coordinating Finger Tapping to a Variable Beat the Variability Scaling Structure of the Movement and the Cortical BOLD Signal are Both Entrained to the Auditory Stimuli

Rhythmic actions are characterizable as a repeating invariant pattern of movement together with variability taking the form of cycle-to-cycle fluctuations. Variability in behavioral measures is atypically random, and often exhibits serial temporal dependencies and statistical self-similarity in the scaling of variability magnitudes across timescales. Self-similar (i.e. fractal) variability scaling is evident in measures of both brain and behavior. Variability scaling structure can be quantified via the scaling exponent (α) from detrended fluctuation analysis (DFA). Here we study the task of coordinating thumb-finger tapping to the beats of constructed auditory stimuli. We test the hypothesis that variability scaling evident in tap-to-tap intervals as well as in the fluctuations of cortical hemodynamics will become entrained to (i.e. drawn toward) manipulated changes in the variability scaling of a stimulus's beat-to-beat intervals. Consistent with this hypothesis, manipulated changes of the exponent α of the experimental stimuli produced corresponding changes in the exponent α of both tap-to-tap intervals and cortical hemodynamics. The changes in hemodynamics were observed in both motor and sensorimotor cortical areas in the contralateral hemisphere. These results were observed only for the longer timescales of the detrended fluctuation analysis used to measure the exponent α. These findings suggest that complex auditory stimuli engage both brain and behavior at the level of variability scaling structures.

Correspondences Between Music and Involuntary Human Micromotion During Standstill

The relationships between human body motion and music have been the focus of several studies characterizing the correspondence between voluntary motion and various sound features. The study of involuntary movement to music, however, is still scarce. Insight into crucial aspects of music cognition, as well as characterization of the vestibular and sensorimotor systems could be largely improved through a description of the underlying links between music and involuntary movement. This study presents an analysis aimed at quantifying involuntary body motion of a small magnitude (micromotion) during standstill, as well as assessing the correspondences between such micromotion and different sound features of the musical stimuli: pulse clarity, amplitude, and spectral centroid. A total of 71 participants were asked to stand as still as possible for 6 min while being presented with alternating silence and music stimuli: Electronic Dance Music (EDM), Classical Indian music, and Norwegian fiddle music (Telespringar). The motion of each participant's head was captured with a marker-based, infrared optical system. Differences in instantaneous position data were computed for each participant and the resulting time series were analyzed through cross-correlation to evaluate the delay between motion and musical features. The mean quantity of motion (QoM) was found to be highest across participants during the EDM condition. This musical genre is based on a clear pulse and rhythmic pattern, and it was also shown that pulse clarity was the metric that had the most significant effect in induced vertical motion across conditions. Correspondences were also found between motion and both brightness and loudness, providing some evidence of anticipation and reaction to the music. Overall, the proposed analysis techniques provide quantitative data and metrics on the correspondences between micromotion and music, with the EDM stimulus producing the clearest music-induced motion patterns. The analysis and results from this study are compatible with embodied music cognition and sensorimotor synchronization theories, and provide further evidence of the movement inducing effects of groove-related music features and human response to sound stimuli. Further work with larger data sets, and a wider range of stimuli, is necessary to produce conclusive findings on the subject.

Sensorimotor Synchronization With Auditory and Visual Modalities: Behavioral and Neural Differences

It has long been known that the auditory system is better suited to guide temporally precise behaviors like sensorimotor synchronization (SMS) than the visual system. Although this phenomenon has been studied for many years, the underlying neural and computational mechanisms remain unclear. Growing consensus suggests the existence of multiple, interacting, context-dependent systems, and that reduced precision in visuo-motor timing might be due to the way experimental tasks have been conceived. Indeed, the appropriateness of the stimulus for a given task greatly influences timing performance. In this review, we examine timing differences for sensorimotor synchronization and error correction with auditory and visual sequences, to inspect the underlying neural mechanisms that contribute to modality differences in timing. The disparity between auditory and visual timing likely relates to differences in the processing specialization between auditory and visual modalities (temporal vs. spatial). We propose this difference could offer potential explanation for the differing temporal abilities between modalities. We also offer suggestions as to how these sensory systems interface with motor and timing systems.

Asymmetric Adaptability to Temporal Constraints Among Coordination Patterns Differentiated at Early Stages of Learning in Juggling

In this study, we examined the degree of adaptability to new constraints after learning of a fundamental skill in juggling. Adaptation of sensorimotor synchronization with the various constraints is important for expertise. However, this adaptability may not be equivalent between coordination patterns which learners acquired in the previous learning process. In other words, there may be “asymmetric” adaptability among intrinsic patterns. Then, we examined the influence of intrinsic patterns on the adaptation of sensorimotor synchronization according to various temporal constraints. To set the adaptation task, experiment 1 was designed to examine the relationship between tempo and coordination pattern for expert jugglers. Based on experiment 1, juggling in accordance with the tempo change was performed as adaption task in experiment 2, and we compared the performances of the jugglers from the viewpoint of the intrinsic pattern. In experiment 1, participants performed juggling by adjusting catch timing to beep timing in ten conditions with the interval from 260 to 620 ms in steps of 40 ms. Results of experiment 1 presented that when the juggling tempo is fast, the coordination pattern with “rhythmic” frequency characteristics appeared. By contrast, when the tempo is slow, the coordination pattern with “discrete” frequency characteristics appeared. That is, jugglers should switch their coordination patterns when performing under various tempo conditions. In experiment 2, we compared the adaptability to perform juggling under temporal constraints among intermediate jugglers who have different intrinsic coordination patterns acquired through a previous learning process. The adaptation task required participants to adjust their catch timing to a gradually changing tempo. Participants performed juggling under two conditions: gradually ascending and descending tempo ranging from 300 to 600 ms. The results of experiment. 2 showed that participants who had a discrete pattern showed a significantly better adaptation than participants who had a rhythmic pattern. Furthermore, this result of adaptation was not related to juggling experience. This suggests that an intrinsic pattern characterized by different frequency characteristics has the different adaptability to sensorimotor synchronization tasks. Collectively, the degree of adaptability was dependent on the pattern acquired in the early stages of learning.

Motor Synchronization in Patients With Schizophrenia: Preserved Time Representation With Abnormalities in Predictive Timing

Objective: Basic temporal dysfunctions have been described in patients with schizophrenia, which may impact their ability to connect and synchronize with the outer world. The present study was conducted with the aim to distinguish between interval timing and synchronization difficulties and more generally the spatial-temporal organization disturbances for voluntary actions. A new sensorimotor synchronization task was developed to test these abilities. Method: Twenty-four chronic schizophrenia patients matched with 27 controls performed a spatial-tapping task in which finger taps were to be produced in synchrony with a regular metronome to six visual targets presented around a virtual circle on a tactile screen. Isochronous (time intervals of 500 ms) and non-isochronous auditory sequences (alternated time intervals of 300/600 ms) were presented. The capacity to produce time intervals accurately versus the ability to synchronize own actions (tap) with external events (tone) were measured. Results: Patients with schizophrenia were able to produce the tapping patterns of both isochronous and non-isochronous auditory sequences as accurately as controls producing inter-response intervals close to the expected interval of 500 and 900 ms, respectively. However, the synchronization performances revealed significantly more positive asynchrony means (but similar variances) in the patient group than in the control group for both types of auditory sequences. Conclusion: The patterns of results suggest that patients with schizophrenia are able to perceive and produce both simple and complex sequences of time intervals but are impaired in the ability to synchronize their actions with external events. These findings suggest a specific deficit in predictive timing, which may be at the core of early symptoms previously described in schizophrenia.

Temporal Processing in Audition: Insights from Music

•

What music psychology reveals about the natural bounds of human temporal processing.

•

Psychoacoustics of beat perception.

•

Neurophysiology of beat perception.

•

Predictable timing in auditory perception.

•

Neural mechanisms of timing.

Music is a curious example of a temporally patterned acoustic stimulus, and a compelling pan-cultural phenomenon. This review strives to bring some insights from decades of music psychology and sensorimotor synchronization (SMS) literature into the mainstream auditory domain, arguing that musical rhythm perception is shaped in important ways by temporal processing mechanisms in the brain. The feature that unites these disparate disciplines is an appreciation of the central importance of timing, sequencing, and anticipation. Perception of musical rhythms relies on an ability to form temporal predictions, a general feature of temporal processing that is equally relevant to auditory scene analysis, pattern detection, and speech perception. By bringing together findings from the music and auditory literature, we hope to inspire researchers to look beyond the conventions of their respective fields and consider the cross-disciplinary implications of studying auditory temporal sequence processing.

We begin by highlighting music as an interesting sound stimulus that may provide clues to how temporal patterning in sound drives perception. Next, we review the SMS literature and discuss possible neural substrates for the perception of, and synchronization to, musical beat. We then move away from music to explore the perceptual effects of rhythmic timing in pattern detection, auditory scene analysis, and speech perception. Finally, we review the neurophysiology of general timing processes that may underlie aspects of the perception of rhythmic patterns. We conclude with a brief summary and outlook for future research.

High post-movement parietal low-beta power during rhythmic tapping facilitates performance in a stop task

Voluntary movements are followed by a post-movement electroencephalography (EEG) beta rebound, which increases with practice and confidence in a task. We hypothesized that greater beta modulation reflects less load on cognitive resources and may thus be associated with faster reactions to new stimuli. EEG was recorded in 17 healthy subjects during rhythmically paced index finger tapping. In a STOP condition, participants had to interrupt the upcoming tap in response to an auditory cue, which was timed such that stopping was successful only in ~ 50% of all trials. In a second condition, participants carried on tapping twice after the stop signal (CONTINUE condition). Thus the conditions were distinct in whether abrupt stopping was required as a second task. Modulation of 12-20 Hz power over motor and parietal areas developed with time on each trial and more so in the CONTINUE condition. Reduced modulation in the STOP condition went along with reduced negative mean asynchronies suggesting less confident anticipation of the timing of the next tap. Yet participants were more likely to stop when beta modulation prior to the stop cue was more pronounced. In the STOP condition, expectancy of the stop signal may have increased cognitive load during movement execution given that the task might have to be stopped abruptly. However, within this condition, stopping ability was increased if the preceding tap was followed by a relatively larger beta increase. Significant, albeit weak, correlations confirmed that increased post-movement beta power was associated with faster reactions to new stimuli, consistent with reduced cognitive load.

Beat Keeping in a Sea Lion As Coupled Oscillation: Implications for Comparative Understanding of Human Rhythm

Human capacity for entraining movement to external rhythms-i.e., beat keeping-is ubiquitous, but its evolutionary history and neural underpinnings remain a mystery. Recent findings of entrainment to simple and complex rhythms in non-human animals pave the way for a novel comparative approach to assess the origins and mechanisms of rhythmic behavior. The most reliable non-human beat keeper to date is a California sea lion, Ronan, who was trained to match head movements to isochronous repeating stimuli and showed spontaneous generalization of this ability to novel tempos and to the complex rhythms of music. Does Ronan's performance rely on the same neural mechanisms as human rhythmic behavior? In the current study, we presented Ronan with simple rhythmic stimuli at novel tempos. On some trials, we introduced "perturbations," altering either tempo or phase in the middle of a presentation. Ronan quickly adjusted her behavior following all perturbations, recovering her consistent phase and tempo relationships to the stimulus within a few beats. Ronan's performance was consistent with predictions of mathematical models describing coupled oscillation: a model relying solely on phase coupling strongly matched her behavior, and the model was further improved with the addition of period coupling. These findings are the clearest evidence yet for parity in human and non-human beat keeping and support the view that the human ability to perceive and move in time to rhythm may be rooted in broadly conserved neural mechanisms.

Sensorimotor Synchronization with Different Metrical Levels of Point-Light Dance Movements

Rhythm perception and synchronization have been extensively investigated in the auditory domain, as they underlie means of human communication such as music and speech. Although recent studies suggest comparable mechanisms for synchronizing with periodically moving visual objects, the extent to which it applies to ecologically relevant information, such as the rhythm of complex biological motion, remains unknown. The present study addressed this issue by linking rhythm of music and dance in the framework of action-perception coupling. As a previous study showed that observers perceived multiple metrical periodicities in dance movements that embodied this structure, the present study examined whether sensorimotor synchronization (SMS) to dance movements resembles what is known of auditory SMS. Participants watched a point-light figure performing two basic steps of Swing dance cyclically, in which the trunk bounced at every beat and the limbs moved at every second beat, forming two metrical periodicities. Participants tapped synchronously to the bounce of the trunk with or without the limbs moving in the stimuli (Experiment 1), or tapped synchronously to the leg movements with or without the trunk bouncing simultaneously (Experiment 2). Results showed that, while synchronization with the bounce (lower-level pulse) was not influenced by the presence or absence of limb movements (metrical accent), synchronization with the legs (beat) was improved by the presence of the bounce (metrical subdivision) across different movement types. The latter finding parallels the “subdivision benefit” often demonstrated in auditory tasks, suggesting common sensorimotor mechanisms for visual rhythms in dance and auditory rhythms in music.

Finger-to-Beat Coordination Skill of Non-dancers, Street Dancers, and the World Champion of a Street-Dance Competition

The coordination of body movements to a musical beat is a common feature of many dance styles. However, the auditory-motor coordination skills of dancers remain largely uninvestigated. The purpose of this study was to examine the auditory-motor coordination skills of non-dancers, street dancers, and the winner of a celebrated international street dance competition, while coordinating their rhythmic finger movements to a beat. The beat rate of a metronome increased from 1.0 to 3.7 Hz. The participants were asked to either flex or extend their index fingers on the beat in each condition. Under the extend-on-the-beat condition, both the dancers and non-dancers showed a spontaneous transition from the extend-on-the-beat to the flex-on-the-beat or to a phase wandering pattern. However, the critical frequency at which the transition occurred was significantly higher in the dancers (3.3 Hz) than in the non-dancers (2.6 Hz). Under the flex-on-the-beat condition, the dancers were able to maintain their coordination pattern more stably at high beat rates compared to the non-dancers. Furthermore, the world champion matched the timing of movement peak velocity to the beat across the different beat rates. This may give a sense of unity between the movement and the beat for the audience because the peak velocity of the rhythmic movement works as a temporal cue for the audiovisual synchrony perception. These results suggest that the skills of accomplished dancers lie in their small finger movements and that the sensorimotor learning of street dance is characterized by a stabilization of the coordination patterns, including the inhibition of an unintentional transition to other coordination patterns.

Parkinson's Is Time on Your Side? Evidence for Difficulties with Sensorimotor Synchronization

There is lack of consistent evidence as to how well PD patients are able to accurately time their movements across space with an external acoustic signal. For years, research based on the finger-tapping paradigm, the most popular paradigm for exploring the brain's ability to time movement, has provided strong evidence that patients are not able to accurately reproduce an isochronous interval [i.e., Ref. (1)]. This was undermined by Spencer and Ivry (2) who suggested a specific deficit in temporal control linked to emergent, rhythmical movement not event-based actions, which primarily involve the cerebellum. In this study, we investigated motor timing of seven idiopathic PD participants in event-based sensorimotor synchronization task. Participants were asked to move their finger horizontally between two predefined target zones to synchronize with the occurrence of two sound events at two time intervals (1.5 and 2.5 s). The width of the targets and the distance between them were manipulated to investigate impact of accuracy demands and movement amplitude on timing performance. The results showed that participants with PD demonstrated specific difficulties when trying to accurately synchronize their movements to a beat. The extent to which their ability to synchronize movement was compromised was found to be related to the severity of PD, but independent of the spatial constraints of the task.

Non-verbal sensorimotor timing deficits in children and adolescents who stutter

There is growing evidence that motor and speech disorders co-occur during development. In the present study, we investigated whether stuttering, a developmental speech disorder, is associated with a predictive timing deficit in childhood and adolescence. By testing sensorimotor synchronization abilities, we aimed to assess whether predictive timing is dysfunctional in young participants who stutter (8-16 years). Twenty German children and adolescents who stutter and 43 non-stuttering participants matched for age and musical training were tested on their ability to synchronize their finger taps with periodic tone sequences and with a musical beat. Forty percent of children and 90% of adolescents who stutter displayed poor synchronization with both metronome and musical stimuli, falling below 2.5% of the estimated population based on the performance of the group without the disorder. Synchronization deficits were characterized by either lower synchronization accuracy or lower consistency or both. Lower accuracy resulted in an over-anticipation of the pacing event in participants who stutter. Moreover, individual profiles revealed that lower consistency was typical of participants that were severely stuttering. These findings support the idea that malfunctioning predictive timing during auditory-motor coupling plays a role in stuttering in children and adolescents.

Early, but not late visual distractors affect movement synchronization to a temporal-spatial visual cue

The ease of synchronizing movements to a rhythmic cue is dependent on the modality of the cue presentation: timing accuracy is much higher when synchronizing with discrete auditory rhythms than an equivalent visual stimulus presented through flashes. However, timing accuracy is improved if the visual cue presents spatial as well as temporal information (e.g., a dot following an oscillatory trajectory). Similarly, when synchronizing with an auditory target metronome in the presence of a second visual distracting metronome, the distraction is stronger when the visual cue contains spatial-temporal information rather than temporal only. The present study investigates individuals' ability to synchronize movements to a temporal-spatial visual cue in the presence of same-modality temporal-spatial distractors. Moreover, we investigated how increasing the number of distractor stimuli impacted on maintaining synchrony with the target cue. Participants made oscillatory vertical arm movements in time with a vertically oscillating white target dot centered on a large projection screen. The target dot was surrounded by 2, 8, or 14 distractor dots, which had an identical trajectory to the target but at a phase lead or lag of 0, 100, or 200 ms. We found participants' timing performance was only affected in the phase-lead conditions and when there were large numbers of distractors present (8 and 14). This asymmetry suggests participants still rely on salient events in the stimulus trajectory to synchronize movements. Subsequently, distractions occurring in the window of attention surrounding those events have the maximum impact on timing performance.

Current conceptual challenges in the study of rhythm processing deficits

Interest in the study of rhythm processing deficits (RPD) is currently growing in the cognitive neuroscience community, as this type of investigation constitutes a powerful tool for the understanding of normal rhythm processing. Because this field is in its infancy, it still lacks a common conceptual vocabulary to facilitate effective communication between different researchers and research groups. In this commentary, we provide a brief review of recent reports of RPD through the lens of one important empirical issue: the method by which beat perception is measured, and the consequences of method selection for the researcher's ability to specify which mechanisms are impaired in RPD. This critical reading advocates for the importance of matching measurement tools to the putative neurocognitive mechanisms under study, and reveals the need for effective and specific assessments of the different aspects of rhythm perception and synchronization.

Influence of Internal and External Noise on Spontaneous Visuomotor Synchronization

Historically, movement noise or variability is considered to be an undesirable property of biological motor systems. In particular, noise is typically assumed to degrade the emergence and stability of rhythmic motor synchronization. Recently, however, it has been suggested that small levels of noise might actually improve the functioning of motor systems and facilitate their adaptation to environmental events. Here, the authors investigated whether noise can facilitate spontaneous rhythmic visuomotor synchronization. They examined the influence of internal noise in the rhythmic limb movements of participants and external noise in the movement of an oscillating visual stimulus on the occurrence of spontaneous synchronization. By indexing the natural frequency variability of participants and manipulating the frequency variability of the visual stimulus, the authors demonstrated that both internal and external noise degrade synchronization when the participants' and stimulus movement frequencies are similar, but can actually facilitate synchronization when the frequencies are different. Furthermore, the two kinds of noise interact with each other. Internal noise facilitates synchronization only when external noise is minimal and vice versa. Too much internal and external noise together degrades synchronization. These findings open new perspectives for better understanding the role of noise in human rhythmic coordination.

Modeling effects of cerebellar and basal ganglia lesions on adaptation and anticipation during sensorimotor synchronization

This study addressed the role of subcortical brain structures in temporal adaptation and anticipation during sensorimotor synchronization. The performance of patients with cerebellar or basal ganglia lesions was compared with that of healthy control participants on tasks requiring the synchronization of drum strokes with adaptive and tempo-changing auditory pacing sequences. The precision of sensorimotor synchronization was generally lower in patients relative to controls (i.e., variability of asynchronies was higher in patients), although synchronization accuracy (mean asynchrony) was commensurate. A computational model of adaptation and anticipation (ADAM) was used to examine potential sources of individual differences in precision by estimating participants' use of error correction, temporal prediction, and the amount of variability associated with central timekeeping and peripheral motor processes. Parameter estimates based on ADAM indicate that impaired precision was attributable to increased variability of timekeeper and motor processes as well as to reduced temporal prediction in both patient groups. Adaptive processes related to continuously applied error correction were, by contrast, intact in patients. These findings highlight the importance of investigating how subcortical structures, including the cerebellum and basal ganglia, interact with a broader network of cortical regions to support temporal adaptation and anticipation during sensorimotor synchronization.

Keeping an eye on the conductor: neural correlates of visuo-motor synchronization and musical experience

For orchestra musicians, synchronized playing under a conductor’s direction is necessary to achieve optimal performance. Previous studies using simple auditory/visual stimuli have reported cortico-subcortical networks underlying synchronization and that training improves the accuracy of synchronization. However, it is unclear whether people who played regularly under a conductor and non-musicians activate the same networks when synchronizing with a conductor’s gestures. We conducted a functional magnetic resonance imaging (fMRI) experiment testing nonmusicians and musicians who regularly play music under a conductor. Participants were required to tap the rhythm they perceived from silent movies displaying either conductor’s gestures or a swinging metronome. Musicians performed tapping under a conductor with more precision than nonmusicians. Results from fMRI measurement showed greater activity in the anterior part of the left superior frontal gyrus (SFG) in musicians with more frequent practice under a conductor. Conversely, tapping with the metronome did not show any difference between musicians and nonmusicians, indicating that the expertize effect in tapping under the conductor does not result in a general increase in tapping performance for musicians. These results suggest that orchestra musicians have developed an advanced ability to predict conductor’s next action from the gestures.

When they listen and when they watch: Pianists' use of nonverbal audio and visual cues during duet performance

Nonverbal auditory and visual communication helps ensemble musicians predict each other's intentions and coordinate their actions. When structural characteristics of the music make predicting co-performers' intentions difficult (e.g., following long pauses or during ritardandi), reliance on incoming auditory and visual signals may change. This study tested whether attention to visual cues during piano-piano and piano-violin duet performance increases in such situations. Pianists performed the secondo part to three duets, synchronizing with recordings of violinists or pianists playing the primo parts. Secondos' access to incoming audio and visual signals and to their own auditory feedback was manipulated. Synchronization was most successful when primo audio was available, deteriorating when primo audio was removed and only cues from primo visual signals were available. Visual cues were used effectively following long pauses in the music, however, even in the absence of primo audio. Synchronization was unaffected by the removal of secondos' own auditory feedback. Differences were observed in how successfully piano-piano and piano-violin duos synchronized, but these effects of instrument pairing were not consistent across pieces. Pianists' success at synchronizing with violinists and other pianists is likely moderated by piece characteristics and individual differences in the clarity of cueing gestures used.

Rhythm in joint action: psychological and neurophysiological mechanisms for real-time interpersonal coordination

Human interaction often requires simultaneous precision and flexibility in the coordination of rhythmic behaviour between individuals engaged in joint activity, for example, playing a musical duet or dancing with a partner. This review article addresses the psychological processes and brain mechanisms that enable such rhythmic interpersonal coordination. First, an overview is given of research on the cognitive-motor processes that enable individuals to represent joint action goals and to anticipate, attend and adapt to other's actions in real time. Second, the neurophysiological mechanisms that underpin rhythmic interpersonal coordination are sought in studies of sensorimotor and cognitive processes that play a role in the representation and integration of self- and other-related actions within and between individuals' brains. Finally, relationships between social-psychological factors and rhythmic interpersonal coordination are considered from two perspectives, one concerning how social-cognitive tendencies (e.g. empathy) affect coordination, and the other concerning how coordination affects interpersonal affiliation, trust and prosocial behaviour. Our review highlights musical ensemble performance as an ecologically valid yet readily controlled domain for investigating rhythm in joint action.

Young children's difficulties in switching from rhythm production to temporal interval production (>1 s)

This study examined the young children's abilities to switch from rhythm production, with short inter-tap intervals (ITIs), to temporal interval production, with long ITI (>1 s), in a sensorimotor synchronization task. Children aged 3- and 5-year-olds were given six sessions of synchronization. In a control group, they had to synchronize their ITI to an inter-stimulus interval (ISI) of 4 s. In the experimental group, they must progressively increase their ITI for one session to the next (from 0.4 to 4.0-s ISI). Our results showed that the 5-year-olds produced longer ITI that the 3-year-olds in synchronization. However, the value of ITI in the 5-year-olds never exceeded 1.5 s, with more variable ITI in the control than in the experimental group. In addition, at 5 years, boys had more difficulties than girls in changing their tapping rhythm. These results suggest a temporal window in sensorimotor synchronization, beyond which the rhythm is lost and the synchronization becomes difficult.

Rhythm perception, production, and synchronization during the perinatal period

Sensori-motor synchronization (SMS) is the coordination of rhythmic movement with an external rhythm. It plays a central role in motor, cognitive, and social behavior. SMS is commonly studied in adults and in children from four years of age onward. Prior to this age, the ability has rarely been investigated due to a lack of available methods. The present paper reviews what is known about SMS in young children, infants, newborns, and fetuses. The review highlights fetal and infant perception of rhythm and cross modal perception of rhythm, fetal, and infant production of rhythm and cross modal production of rhythm, and the contexts in which production of rhythm can be observed in infants. A primary question is whether infants, even newborns, can modify their spontaneous rhythmical motor behavior in response to external rhythmical stimulation. Spontaneous sucking, crying, and leg movements have been studied in the presence or absence of rhythmical auditory stimulation. Findings suggest that the interaction between movement and sound is present at birth and that SMS can be observed in special conditions and within a narrow range of tempi, particularly near the infant's own spontaneous motor tempo. The discussion centers on the fundamental role of SMS in interaction and communication at the beginning of life.

Stepping to phase-perturbed metronome cues: multisensory advantage in movement synchrony but not correction

Humans can synchronize movements with auditory beats or rhythms without apparent effort. This ability to entrain to the beat is considered automatic, such that any perturbations are corrected for, even if the perturbation was not consciously noted. Temporal correction of upper limb (e.g., finger tapping) and lower limb (e.g., stepping) movements to a phase perturbed auditory beat usually results in individuals being back in phase after just a few beats. When a metronome is presented in more than one sensory modality, a multisensory advantage is observed, with reduced temporal variability in finger tapping movements compared to unimodal conditions. Here, we investigate synchronization of lower limb movements (stepping in place) to auditory, visual and combined auditory-visual (AV) metronome cues. In addition, we compare movement corrections to phase advance and phase delay perturbations in the metronome for the three sensory modality conditions. We hypothesized that, as with upper limb movements, there would be a multisensory advantage, with stepping variability being lowest in the bimodal condition. As such, we further expected correction to the phase perturbation to be quickest in the bimodal condition. Our results revealed lower variability in the asynchronies between foot strikes and the metronome beats in the bimodal condition, compared to unimodal conditions. However, while participants corrected substantially quicker to perturbations in auditory compared to visual metronomes, there was no multisensory advantage in the phase correction task—correction under the bimodal condition was almost identical to the auditory-only (AO) condition. On the whole, we noted that corrections in the stepping task were smaller than those previously reported for finger tapping studies. We conclude that temporal corrections are not only affected by the reliability of the sensory information, but also the complexity of the movement itself.

Bodily synchronization underlying joke telling

Advances in video and time series analysis have greatly enhanced our ability to study the bodily synchronization that occurs in natural interactions. Past research has demonstrated that the behavioral synchronization involved in social interactions is similar to dynamical synchronization found generically in nature. The present study investigated how the bodily synchronization in a joke telling task is spread across different nested temporal scales. Pairs of participants enacted knock–knock jokes and times series of their bodily activity were recorded. Coherence and relative phase analyses were used to evaluate the synchronization of bodily rhythms for the whole trial as well as at the subsidiary time scales of the whole joke, the setup of the punch line, the two-person exchange and the utterance. The analyses revealed greater than chance entrainment of the joke teller’s and joke responder’s movements at all time scales and that the relative phasing of the teller’s movements led those of the responder at the longer time scales. Moreover, this entrainment was greater when visual information about the partner’s movements was present but was decreased particularly at the shorter time scales when explicit gesturing in telling the joke was performed. In short, the results demonstrate that a complex interpersonal bodily “dance” occurs during structured conversation interactions and that this “dance” is constructed from a set of rhythms associated with the nested behavioral structure of the interaction.

Capturing with EEG the neural entrainment and coupling underlying sensorimotor synchronization to the beat

Synchronizing movements with rhythmic inputs requires tight coupling of sensory and motor neural processes. Here, using a novel approach based on the recording of steady-state-evoked potentials (SS-EPs), we examine how distant brain areas supporting these processes coordinate their dynamics. The electroencephalogram was recorded while subjects listened to a 2.4-Hz auditory beat and tapped their hand on every second beat. When subjects tapped to the beat, the EEG was characterized by a 2.4-Hz SS-EP compatible with beat-related entrainment and a 1.2-Hz SS-EP compatible with movement-related entrainment, based on the results of source analysis. Most importantly, when compared with passive listening of the beat, we found evidence suggesting an interaction between sensory- and motor-related activities when subjects tapped to the beat, in the form of (1) additional SS-EP appearing at 3.6 Hz, compatible with a nonlinear product of sensorimotor integration; (2) phase coupling of beat- and movement-related activities; and (3) selective enhancement of beat-related activities over the hemisphere contralateral to the tapping, suggesting a top-down effect of movement-related activities on auditory beat processing. Taken together, our results are compatible with the view that rhythmic sensorimotor synchronization is supported by a dynamic coupling of sensory and motor related activities.