Small perturbations in a finger-tapping task reveal inherent nonlinearities of the underlying error correction mechanism

Short-Term Effect of Auditory Stimulation on Neural Activities: A Scoping Review of Longitudinal Electroencephalography and Magnetoencephalography Studies

Explored through EEG/MEG, auditory stimuli function as a suitable research probe to reveal various neural activities, including event-related potentials, brain oscillations and functional connectivity. Accumulating evidence in this field stems from studies investigating neuroplasticity induced by long-term auditory training, specifically cross-sectional studies comparing musicians and non-musicians as well as longitudinal studies with musicians. In contrast, studies that address the neural effects of short-term interventions whose duration lasts from minutes to hours are only beginning to be featured. Over the past decade, an increasing body of evidence has shown that short-term auditory interventions evoke rapid changes in neural activities, and oscillatory fluctuations can be observed even in the prestimulus period. In this scoping review, we divided the extracted neurophysiological studies into three groups to discuss neural activities with short-term auditory interventions: the pre-stimulus period, during stimulation, and a comparison of before and after stimulation. We show that oscillatory activities vary depending on the context of the stimuli and are greatly affected by the interplay of bottom-up and top-down modulational mechanisms, including attention. We conclude that the observed rapid changes in neural activitiesin the auditory cortex and the higher-order cognitive part of the brain are causally attributed to short-term auditory interventions.

Amodal population clock in the primate medial premotor system for rhythmic tapping

The neural substrate for beat extraction and response entrainment to rhythms is not fully understood. Here we analyze the activity of medial premotor neurons in monkeys performing isochronous tapping guided by brief flashing stimuli or auditory tones. The population dynamics shared the following properties across modalities: the circular dynamics of the neural trajectories form a regenerating loop for every produced interval; the trajectories converge in similar state space at tapping times resetting the clock; and the tempo of the synchronized tapping is encoded in the trajectories by a combination of amplitude modulation and temporal scaling. Notably, the modality induces displacement in the neural trajectories in the auditory and visual subspaces without greatly altering the time-keeping mechanism. These results suggest that the interaction between the medial premotor cortex's amodal internal representation of pulse and a modality-specific external input generates a neural rhythmic clock whose dynamics govern rhythmic tapping execution across senses.

Auditory-motor synchronization varies among individuals and is critically shaped by acoustic features

The ability to synchronize body movements with quasi-regular auditory stimuli represents a fundamental trait in humans at the core of speech and music. Despite the long trajectory of the study of such ability, little attention has been paid to how acoustic features of the stimuli and individual differences can modulate auditory-motor synchrony. Here, by exploring auditory-motor synchronization abilities across different effectors and types of stimuli, we revealed that this capability is more restricted than previously assumed. While the general population can synchronize to sequences composed of the repetitions of the same acoustic unit, the synchrony in a subgroup of participants is impaired when the unit's identity varies across the sequence. In addition, synchronization in this group can be temporarily restored by being primed by a facilitator stimulus. Auditory-motor integration is stable across effectors, supporting the hypothesis of a central clock mechanism subserving the different articulators but critically shaped by the acoustic features of the stimulus and individual abilities.

Sustained Effect of Auditory Entrainment With Coordinated Movement Varies With Temporal Complexity of Sequential Tapping

While the ability to coordinate movements temporally with rhythmic auditory stimuli is universal, previous investigators showed that accurate rhythm reproduction depends on temporal complexity. To date, the effect of multiple pitches on the timing of rhythmic movements has been assumed. Exploring a possible sustained entrainment effect of auditory stimuli on sequential movement might further elucidate the role of temporal complexity and its interaction with multiple pitch engagement. Thus, we investigated the sustained effect of auditory entrainment and the interaction between temporal complexity and pitch on predefined sequential tapping with tapping sequences predefined before a synchronization-timekeeping task. Temporal complexity was manipulated by increasing the number of non-integer ratios in temporal rhythm. The rhythm sequences were presented with either multiple pitches or a single pitch. We found a reduction in mean asynchronies and ratio error in three rhythms with non-integer ratios, while inter-response interval error was reduced in the integer rhythm and the rhythm with one repetitive integer ratio and one non-integer ratio. Ratio error remanence was less in rhythms with two non-integer ratios. We found no significant difference between the two pitch types. There was a sustained entrainment effect of sequential tapping that varied with differing temporal complexity, and pitch information was not essential for auditory entrainment. These findings provide support for possible interventions aimed at motor learning.

The Blursday database as a resource to study subjective temporalities during COVID-19

The COVID-19 pandemic and associated lockdowns triggered worldwide changes in the daily routines of human experience. The Blursday database provides repeated measures of subjective time and related processes from participants in nine countries tested on 14 questionnaires and 15 behavioural tasks during the COVID-19 pandemic. A total of 2,840 participants completed at least one task, and 439 participants completed all tasks in the first session. The database and all data collection tools are accessible to researchers for studying the effects of social isolation on temporal information processing, time perspective, decision-making, sleep, metacognition, attention, memory, self-perception and mindfulness. Blursday includes quantitative statistics such as sleep patterns, personality traits, psychological well-being and lockdown indices. The database provides quantitative insights on the effects of lockdown (stringency and mobility) and subjective confinement on time perception (duration, passage of time and temporal distances). Perceived isolation affects time perception, and we report an inter-individual central tendency effect in retrospective duration estimation.

Dynamic Systems Approach in Sensorimotor Synchronization: Adaptation to Tempo Step-Change

This paper presents a dynamic systems model of a sensorimotor synchronization (SMS) task. An SMS task typically gives temporally discrete human responses to some temporally discrete stimuli. Here, a dynamic systems modeling approach is applied after converting the discrete events to regularly sampled time signals. To collect data for model parameter fitting, a previously published pilot study was expanded. Three human participants took part in an experiment: to tap a finger on a keyboard, following a metronome which changed tempo in steps. System identification was used to estimate the transfer function that represented the relationship between the stimulus and the step response signals, assuming a separate linear, time-invariant system for each tempo step. Different versions of model complexity were investigated. As a minimum, a second-order linear system with delay, two poles, and one zero was needed to model the most important features of the tempo step response by humans, while an additional third pole could give a somewhat better fit to the response data. The modeling results revealed the behavior of the system in two distinct regimes: tempo steps below and above the conscious awareness of tempo change, i.e., around 12% of the base tempo. For the tempo steps above this value, model parameters were derived as linear functions of step size for the group of three participants. The results were interpreted in the light of known facts from other fields like SMS, psychoacoustics and behavioral neuroscience.

Neural Entrainment Meets Behavior: The Stability Index as a Neural Outcome Measure of Auditory-Motor Coupling

Understanding rhythmic behavior in the context of coupled auditory and motor systems has been of interest to neurological rehabilitation, in particular, to facilitate walking. Recent work based on behavioral measures revealed an entrainment effect of auditory rhythms on motor rhythms. In this study, we propose a method to compute the neural component of such a process from an electroencephalographic (EEG) signal. A simple auditory-motor synchronization paradigm was used, where 28 healthy participants were instructed to synchronize their finger-tapping with a metronome. The computation of the neural outcome measure was carried out in two blocks. In the first block, we used Generalized Eigendecomposition (GED) to reduce the data dimensionality to the component which maximally entrained to the metronome frequency. The scalp topography pointed at brain activity over contralateral sensorimotor regions. In the second block, we computed instantaneous frequency from the analytic signal of the extracted component. This returned a time-varying measure of frequency fluctuations, whose standard deviation provided our "stability index" as a neural outcome measure of auditory-motor coupling. Finally, the proposed neural measure was validated by conducting a correlation analysis with a set of behavioral outcomes from the synchronization task: resultant vector length, relative phase angle, mean asynchrony, and tempo matching. Significant moderate negative correlations were found with the first three measures, suggesting that the stability index provided a quantifiable neural outcome measure of entrainment, with selectivity towards phase-correction mechanisms. We address further adoption of the proposed approach, especially with populations where sensorimotor abilities are compromised by an underlying pathological condition. The impact of using stability index can potentially be used as an outcome measure to assess rehabilitation protocols, and possibly provide further insight into neuropathological models of auditory-motor coupling.

Time-oriented attention improves accuracy in a paced finger-tapping task

Finger tapping is a task widely used in a variety of experimental paradigms, in particular to understand sensorimotor synchronization and time processing in the range of hundreds of milliseconds (millisecond timing). Normally, subjects do not receive any instruction about what to attend to and the results are seldom interpreted taking into account the possible effects of attention. In this work we show that attention can be oriented to the purely temporal aspects of a paced finger-tapping task and that it affects performance. Specifically, time-oriented attention improves the accuracy in paced finger tapping and it also increases the resynchronization efficiency after a period perturbation. We use two markers of the attention level: auditory ERPs and subjective report of the mental workload. In addition, we propose a novel algorithm to separate the auditory, stimulus-related components from the somatosensory, response-related ones, which are naturally overlapped in the recorded EEG.

A neural circuit model for human sensorimotor timing

Humans and animals can effortlessly coordinate their movements with external stimuli. This capacity indicates that sensory inputs can rapidly and flexibly reconfigure the ongoing dynamics in the neural circuits that control movements. Here, we develop a circuit-level model that coordinates movement times with expected and unexpected temporal events. The model consists of two interacting modules, a motor planning module that controls movement times and a sensory anticipation module that anticipates external events. Both modules harbor a reservoir of latent dynamics, and their interaction forms a control system whose output is adjusted adaptively to minimize timing errors. We show that the model’s output matches human behavior in a range of tasks including time interval production, periodic production, synchronization/continuation, and Bayesian time interval reproduction. These results demonstrate how recurrent interactions in a simple and modular neural circuit could create the dynamics needed to control timing behavior.

We can flexibly coordinate our movements with external stimuli, but no circuit-level model exists to explain this ability. Inspired by fundamental concepts in control theory, the authors construct a modular neural circuit that captures human behavior in a wide range of temporal coordination tasks.

Response to perturbations as a built-in feature in a mathematical model for paced finger tapping

Paced finger tapping is one of the simplest tasks to study sensorimotor synchronization. The subject is instructed to tap in synchrony with a periodic sequence of brief tones, and the time difference (called asynchrony) between each response and the corresponding stimulus is recorded. Despite its simplicity, this task helps to unveil interesting features of the underlying neural system and the error-correction mechanism responsible for synchronization. Perturbation experiments are usually performed to probe the subject's response, for example, in the form of a "step change," i.e., an unexpected change in tempo. The asynchrony is the usual observable in such experiments and it is chosen as the main variable in many mathematical models that attempt to describe the phenomenon. In this work we show that although asynchrony can be perfectly described in operational terms, it is not well defined as a model variable when tempo perturbations are considered. We introduce an alternative variable and a mathematical model that intrinsically takes into account the perturbation and make theoretical predictions about the response to novel perturbations based on the geometrical organization of the trajectories in phase space. Our proposal is relevant to understand interpersonal synchronization and the synchronization to nonperiodic stimuli.

Spatiotemporal perturbations in paced finger tapping suggest a common mechanism for the processing of time errors

Paced finger tapping is a sensorimotor synchronization task where a subject has to keep pace with a metronome while the time differences (asynchronies) between each stimulus and its response are recorded. A usual way to study the underlying error correction mechanism is to perform unexpected temporal perturbations to the stimuli sequence. An overlooked issue is that at the moment of a temporal perturbation two things change: the stimuli period (a parameter) and the asynchrony (a variable). In terms of experimental manipulation, it would be desirable to have separate, independent control of parameter and variable values. In this work we perform paced finger tapping experiments combining simple temporal perturbations (tempo step change) and spatial perturbations with temporal effect (raised or lowered point of contact). In this way we decouple the parameter-and-variable confounding, performing novel perturbations where either the parameter or the variable changes. Our results show nonlinear features like asymmetry and are compatible with a common error correction mechanism for all types of asynchronies. We suggest taking this confounding into account when analyzing perturbations of any kind in finger tapping tasks but also in other areas of sensorimotor synchronization, like music performance experiments and paced walking in gait coordination studies.

Tutorial and simulations with ADAM: an adaptation and anticipation model of sensorimotor synchronization

Interpersonal coordination of movements often involves precise synchronization of action timing, particularly in expert domains such as ensemble music performance. According to the adaptation and anticipation model (ADAM) of sensorimotor synchronization, precise yet flexible interpersonal coordination is supported by reactive error correction mechanisms and anticipatory mechanisms that exploit systematic patterns in stimulus timing to plan future actions. Here, we provide a tutorial introduction to the computational architecture of ADAM and present a series of single- and dual-virtual agent simulations that examine the model parameters that produce ideal synchronization performance in different tempo conditions. In the single-agent simulations, a virtual agent synchronized responses to steady tempo sequence or a sequence containing gradual tempo changes. Parameters controlling basic reactive error (phase) correction were sufficient for producing ideal synchronization performance at the steady tempo, whereas parameters controlling anticipatory mechanisms were necessary for ideal performance with a tempo-changing sequence. In the dual-agent simulations, two interacting virtual agents produced temporal sequences from either congruent or incongruent internal performance templates specifying a steady tempo or tempo changes. Ideal performance was achieved with reactive error correction alone when both agents implemented the same performance template (either steady tempo or tempo change). In contrast, anticipatory mechanisms played a key role when one agent implemented a steady tempo template and the other agent implemented a tempo change template. These findings have implications for understanding the interplay between reactive and anticipatory mechanisms when agents possess compatible versus incompatible representations of task goals during human-human and human-machine interaction.

Cortical Networks for Correcting Errors in Sensorimotor Synchronization Depend on the Direction of Asynchrony

Recent work provides clues that different cortical mechanisms may be employed when correcting for errors in sensorimotor synchronization that increase tap-tone asynchrony compared with those that decrease it. The authors tested this hypothesis by recording 64-channel electroencephalography while participants synchronized with an auditory metronome. We systematically introduced positive and negative phase-shift perturbations that were either liminal (10%) and subliminal (3%). We used a distributed source modeling approach to evaluate oscillatory activity and connectivity of discrete cortical sources. Three key findings support our hypothesis. First was a theta band response indicative of error detection and top-down control observed in frontomedial presupplementary motor area (pre-SMA) and anterior cingulate for liminal positive perturbations. Second was an increase in theta band coupling between the SMA and contralateral motor cortex exclusively for positive perturbations suggesting a top-down modulation of motor parameters. Third, when compared with other conditions, liminal positive perturbations result in an increase in postmovement beta rebound within contralateral primary motor cortex. The authors propose that frontomedial motor areas exert a top-down inhibitory influence over the primary motor cortex to effectively lengthen tap intervals in response to lengthening tap-tone asynchronies.

Sensorimotor synchronization: neurophysiological markers of the asynchrony in a finger-tapping task

Sensorimotor synchronization (SMS) is a form of referential behavior in which an action is coordinated with a predictable external stimulus. The neural bases of the synchronization ability remain unknown, even in the simpler, paradigmatic task of finger tapping to a metronome. In this task the subject is instructed to tap in synchrony with a periodic sequence of brief tones, and the time difference between each response and the corresponding stimulus tone (asynchrony) is recorded. We make a step towards the identification of the neurophysiological markers of SMS by recording high-density EEG event-related potentials and the concurrent behavioral response-stimulus asynchronies during an isochronous paced finger-tapping task. Using principal component analysis, we found an asymmetry between the traces for advanced and delayed responses to the stimulus, in accordance with previous behavioral observations from perturbation studies. We also found that the amplitude of the second component encodes the higher-level percept of asynchrony 100 ms after the current stimulus. Furthermore, its amplitude predicts the asynchrony of the next step, past 300 ms from the previous stimulus, independently of the period length. Moreover, the neurophysiological processing of synchronization errors is performed within a fixed-duration interval after the stimulus. Our results suggest that the correction of a large asynchrony in a periodic task and the recovery of synchrony after a perturbation could be driven by similar neural processes.

Music and Sound in Time Processing of Children with ADHD

ADHD involves cognitive and behavioral aspects with impairments in many environments of children and their families' lives. Music, with its playful, spontaneous, affective, motivational, temporal, and rhythmic dimensions can be of great help for studying the aspects of time processing in ADHD. In this article, we studied time processing with simple sounds and music in children with ADHD with the hypothesis that children with ADHD have a different performance when compared with children with normal development in tasks of time estimation and production. The main objective was to develop sound and musical tasks to evaluate and correlate the performance of children with ADHD, with and without methylphenidate, compared to a control group with typical development. The study involved 36 participants of age 6-14 years, recruited at NANI-UNIFESP/SP, subdivided into three groups with 12 children in each. Data was collected through a musical keyboard using Logic Audio Software 9.0 on the computer that recorded the participant's performance in the tasks. Tasks were divided into sections: spontaneous time production, time estimation with simple sounds, and time estimation with music.

RESULTS

(1) performance of ADHD groups in temporal estimation of simple sounds in short time intervals (30 ms) were statistically lower than that of control group (p < 0.05); (2) in the task comparing musical excerpts of the same duration (7 s), ADHD groups considered the tracks longer when the musical notes had longer durations, while in the control group, the duration was related to the density of musical notes in the track. The positive average performance observed in the three groups in most tasks perhaps indicates the possibility that music can, in some way, positively modulate the symptoms of inattention in ADHD.

Sensorimotor synchronization: a review of recent research (2006-2012)

Sensorimotor synchronization (SMS) is the coordination of rhythmic movement with an external rhythm, ranging from finger tapping in time with a metronome to musical ensemble performance. An earlier review (Repp, 2005) covered tapping studies; two additional reviews (Repp, 2006a, b) focused on music performance and on rate limits of SMS, respectively. The present article supplements and extends these earlier reviews by surveying more recent research in what appears to be a burgeoning field. The article comprises four parts, dealing with (1) conventional tapping studies, (2) other forms of moving in synchrony with external rhythms (including dance and nonhuman animals' synchronization abilities), (3) interpersonal synchronization (including musical ensemble performance), and (4) the neuroscience of SMS. It is evident that much new knowledge about SMS has been acquired in the last 7 years.