Trial time warping to discriminate stimulus-related from movement-related neural activity

Diverse Time Encoding Strategies Within the Medial Premotor Areas of the Primate

The measurement of time in the subsecond scale is critical for many sophisticated behaviors, yet its neural underpinnings are largely unknown. Recent neurophysiological experiments from our laboratory have shown that the neural activity in the medial premotor areas (MPC) of macaques can represent different aspects of temporal processing. During single interval categorization, we found that preSMA encodes a subjective category limit by reaching a peak of activity at a time that divides the set of test intervals into short and long. We also observed neural signals associated with the category selected by the subjects and the reward outcomes of the perceptual decision. On the other hand, we have studied the behavioral and neurophysiological basis of rhythmic timing. First, we have shown in different tapping tasks that macaques are able to produce predictively and accurately intervals that are cued by auditory or visual metronomes or when intervals are produced internally without sensory guidance. In addition, we found that the rhythmic timing mechanism in MPC is governed by different layers of neural clocks. Next, the instantaneous activity of single cells shows ramping activity that encodes the elapsed or remaining time for a tapping movement. In addition, we found MPC neurons that build neural sequences, forming dynamic patterns of activation that flexibly cover all the produced interval depending on the tapping tempo. This rhythmic neural clock resets on every interval providing an internal representation of pulse. Furthermore, the MPC cells show mixed selectivity, encoding not only elapsed time, but also the tempo of the tapping and the serial order element in the rhythmic sequence. Hence, MPC can map different task parameters, including the passage of time, using different cell populations. Finally, the projection of the time varying activity of MPC hundreds of cells into a low dimensional state space showed circular neural trajectories whose geometry represented the internal pulse and the tapping tempo. Overall, these findings support the notion that MPC is part of the core timing mechanism for both single interval and rhythmic timing, using neural clocks with different encoding principles, probably to flexibly encode and mix the timing representation with other task parameters.

Amodal population clock in the primate medial premotor system for rhythmic tapping

The neural substrate for beat extraction and response entrainment to rhythms is not fully understood. Here we analyze the activity of medial premotor neurons in monkeys performing isochronous tapping guided by brief flashing stimuli or auditory tones. The population dynamics shared the following properties across modalities: the circular dynamics of the neural trajectories form a regenerating loop for every produced interval; the trajectories converge in similar state space at tapping times resetting the clock; and the tempo of the synchronized tapping is encoded in the trajectories by a combination of amplitude modulation and temporal scaling. Notably, the modality induces displacement in the neural trajectories in the auditory and visual subspaces without greatly altering the time-keeping mechanism. These results suggest that the interaction between the medial premotor cortex's amodal internal representation of pulse and a modality-specific external input generates a neural rhythmic clock whose dynamics govern rhythmic tapping execution across senses.

Neural signals regulating motor synchronization in the primate deep cerebellar nuclei

Movements synchronized with external rhythms are ubiquitous in our daily lives. Despite the involvement of the cerebellum, the underlying mechanism remains unclear. In monkeys performing synchronized saccades to periodically alternating visual stimuli, we found that neuronal activity in the cerebellar dentate nucleus correlated with the timing of the next saccade and the current temporal error. One-third of the neurons were active regardless of saccade direction and showed greater activity for synchronized than for reactive saccades. During the transition from reactive to predictive saccades in each trial, the activity of these neurons coincided with target onset, representing an internal model of rhythmic structure rather than a specific motor command. The behavioural changes induced by electrical stimulation were explained by activating different groups of neurons at various strengths, suggesting that the lateral cerebellum contains multiple functional modules for the acquisition of internal rhythms, predictive motor control, and error detection during synchronized movements.

What Behavioral Abilities Emerged at Key Milestones in Human Brain Evolution? 13 Hypotheses on the 600-Million-Year Phylogenetic History of Human Intelligence

This paper presents 13 hypotheses regarding the specific behavioral abilities that emerged at key milestones during the 600-million-year phylogenetic history from early bilaterians to extant humans. The behavioral, intellectual, and cognitive faculties of humans are complex and varied: we have abilities as diverse as map-based navigation, theory of mind, counterfactual learning, episodic memory, and language. But these faculties, which emerge from the complex human brain, are likely to have evolved from simpler prototypes in the simpler brains of our ancestors. Understanding the order in which behavioral abilities evolved can shed light on how and why our brains evolved. To propose these hypotheses, I review the available data from comparative psychology and evolutionary neuroscience.

A spike analysis method for characterizing neurons based on phase locking and scaling to the interval between two behavioral events

Standard analysis of neuronal functions assesses the temporal correlation between animal behaviors and neuronal activity by aligning spike trains with the timing of a specific behavioral event, e.g., visual cue. However, spike activity is often involved in information processing dependent on a relative phase between two consecutive events rather than a single event. Nevertheless, less attention has so far been paid to such temporal features of spike activity in relation to two behavioral events. Here, we propose "Phase-Scaling analysis" to simultaneously evaluate the phase locking and scaling to the interval between two events in task-related spike activity of individual neurons. This analysis method can discriminate conceptual "scaled"-type neurons from "nonscaled"-type neurons using an activity variation map that combines phase locking with scaling to the interval. Its robustness was validated by spike simulation using different spike properties. Furthermore, we applied it to analyzing actual spike data from task-related neurons in the primary visual cortex (V1), posterior parietal cortex (PPC), primary motor cortex (M1), and secondary motor cortex (M2) of behaving rats. After hierarchical clustering of all neurons using their activity variation maps, we divided them objectively into four clusters corresponding to nonscaled-type sensory and motor neurons and scaled-type neurons including sustained and ramping activities, etc. Cluster/subcluster compositions for V1 differed from those of PPC, M1, and M2. The V1 neurons showed the fastest functional activities among those areas. Our method was also applicable to determine temporal "forms" and the latency of spike activity changes. These findings demonstrate its utility for characterizing neurons.NEW & NOTEWORTHY Phase-Scaling analysis is a novel technique to unbiasedly characterize the temporal dependency of functional neuron activity on two behavioral events and objectively determine the latency and form of the activity change. This powerful analysis can uncover several classes of latently functioning neurons that have thus far been overlooked, which may participate differently in intermediate processes of a brain function. The Phase-Scaling analysis will yield profound insights into neural mechanisms for processing internal information.

Motor and Predictive Processes in Auditory Beat and Rhythm Perception

In this article, we review recent advances in research on rhythm and musical beat perception, focusing on the role of predictive processes in auditory motor interactions. We suggest that experimental evidence of the motor system's role in beat perception, including in passive listening, may be explained by the generation and maintenance of internal predictive models, concordant with the Active Inference framework of sensory processing. We highlight two complementary hypotheses for the neural underpinnings of rhythm perception: The Action Simulation for Auditory Prediction hypothesis (Patel and Iversen, 2014) and the Gradual Audiomotor Evolution hypothesis (Merchant and Honing, 2014) and review recent experimental progress supporting each of these hypotheses. While initial formulations of ASAP and GAE explain different aspects of beat-based timing-the involvement of motor structures in the absence of movement, and physical entrainment to an auditory beat respectively-we suggest that work under both hypotheses provide converging evidence toward understanding the predictive role of the motor system in the perception of rhythm, and the specific neural mechanisms involved. We discuss future experimental work necessary to further evaluate the causal neural mechanisms underlying beat and rhythm perception.

Discovering Precise Temporal Patterns in Large-Scale Neural Recordings through Robust and Interpretable Time Warping

Though the temporal precision of neural computation has been studied intensively, a data-driven determination of this precision remains a fundamental challenge. Reproducible spike patterns may be obscured on single trials by uncontrolled temporal variability in behavior and cognition and may not be time locked to measurable signatures in behavior or local field potentials (LFP). To overcome these challenges, we describe a general-purpose time warping framework that reveals precise spike-time patterns in an unsupervised manner, even when these patterns are decoupled from behavior or are temporally stretched across single trials. We demonstrate this method across diverse systems: cued reaching in nonhuman primates, motor sequence production in rats, and olfaction in mice. This approach flexibly uncovers diverse dynamical firing patterns, including pulsatile responses to behavioral events, LFP-aligned oscillatory spiking, and even unanticipated patterns, such as 7 Hz oscillations in rat motor cortex that are not time locked to measured behaviors or LFP.

The amplitude in periodic neural state trajectories underlies the tempo of rhythmic tapping

Our motor commands can be exquisitely timed according to the demands of the environment, and the ability to generate rhythms of different tempos is a hallmark of musical cognition. Yet, the neuronal underpinnings behind rhythmic tapping remain elusive. Here, we found that the activity of hundreds of primate medial premotor cortices (MPCs; pre-supplementary motor area [preSMA] and supplementary motor area [SMA]) neurons show a strong periodic pattern that becomes evident when their responses are projected into a state space using dimensionality reduction analysis. We show that different tapping tempos are encoded by circular trajectories that travelled at a constant speed but with different radii, and that this neuronal code is highly resilient to the number of participating neurons. Crucially, the changes in the amplitude of the oscillatory dynamics in neuronal state space are a signature of duration encoding during rhythmic timing, regardless of whether it is guided by an external metronome or is internally controlled and is not the result of repetitive motor commands. This dynamic state signal predicted the duration of the rhythmically produced intervals on a trial-by-trial basis. Furthermore, the increase in variability of the neural trajectories accounted for the scalar property, a hallmark feature of temporal processing across tasks and species. Finally, we found that the interval-dependent increments in the radius of periodic neural trajectories are the result of a larger number of neurons engaged in the production of longer intervals. Our results support the notion that rhythmic timing during tapping behaviors is encoded in the radial curvature of periodic MPC neural population trajectories.

Linear-nonlinear-time-warp-poisson models of neural activity

Prominent models of spike trains assume only one source of variability - stochastic (Poisson) spiking - when stimuli and behavior are fixed. However, spike trains may also reflect variability due to internal processes such as planning. For example, we can plan a movement at one point in time and execute it at some arbitrary later time. Neurons involved in planning may thus share an underlying time course that is not precisely locked to the actual movement. Here we combine the standard Linear-Nonlinear-Poisson (LNP) model with Dynamic Time Warping (DTW) to account for shared temporal variability. When applied to recordings from macaque premotor cortex, we find that time warping considerably improves predictions of neural activity. We suggest that such temporal variability is a widespread phenomenon in the brain which should be modeled.

EEG time-warping to study non-strictly-periodic EEG signals related to the production of rhythmic movements

BACKGROUND

Many sensorimotor functions are intrinsically rhythmic, and are underlined by neural processes that are functionally distinct from neural responses related to the processing of transient events. EEG frequency tagging is a technique that is increasingly used in neuroscience to study these processes. It relies on the fact that perceiving and/or producing rhythms generates periodic neural activity that translates into periodic variations of the EEG signal. In the EEG spectrum, those variations appear as peaks localized at the frequency of the rhythm and its harmonics.

NEW METHOD

Many natural rhythms, such as music or dance, are not strictly periodic and, instead, show fluctuations of their period over time. Here, we introduce a time-warping method to identify non-strictly-periodic EEG activities in the frequency domain.

RESULTS

EEG time-warping can be used to characterize the sensorimotor activity related to the performance of self-paced rhythmic finger movements. Furthermore, the EEG time-warping method can disentangle auditory- and movement-related EEG activity produced when participants perform rhythmic movements synchronized to an acoustic rhythm. This is possible because the movement-related activity has different period fluctuations than the auditory-related activity.

COMPARISON WITH EXISTING METHODS

With the classic frequency-tagging approach, rhythm fluctuations result in a spreading of the peaks to neighboring frequencies, to the point that they cannot be distinguished from background noise.

CONCLUSIONS

The proposed time-warping procedure is as a simple and effective mean to study natural non-strictly-periodic rhythmic neural processes such as rhythmic movement production, acoustic rhythm perception and sensorimotor synchronization.

Predictive rhythmic tapping to isochronous and tempo changing metronomes in the nonhuman primate

Beat entrainment is the ability to entrain one's movements to a perceived periodic stimulus, such as a metronome or a pulse in music. Humans have a capacity to predictively respond to a periodic pulse and to dynamically adjust their movement timing to match the varying music tempos. Previous studies have shown that monkeys share some of the human capabilities for rhythmic entrainment, such as tapping regularly at the period of isochronous stimuli. However, it is still unknown whether monkeys can predictively entrain to dynamic tempo changes like humans. To address this question, we trained monkeys in three tapping tasks and compared their rhythmic entrainment abilities with those of humans. We found that, when immediate feedback about the timing of each movement is provided, monkeys can predictively entrain to an isochronous beat, generating tapping movements in anticipation of the metronome pulse. This ability also generalized to a novel untrained tempo. Notably, macaques can modify their tapping tempo by predicting the beat changes of accelerating and decelerating visual metronomes in a manner similar to humans. Our findings support the notion that nonhuman primates share with humans the ability of temporal anticipation during tapping to isochronous and smoothly changing sequences of stimuli.

The Synaptic Properties of Cells Define the Hallmarks of Interval Timing in a Recurrent Neural Network

Extensive research has described two key features of interval timing. The bias property is associated with accuracy and implies that time is overestimated for short intervals and underestimated for long intervals. The scalar property is linked to precision and states that the variability of interval estimates increases as a function of interval duration. The neural mechanisms behind these properties are not well understood. Here we implemented a recurrent neural network that mimics a cortical ensemble and includes cells that show paired-pulse facilitation and slow inhibitory synaptic currents. The network produces interval selective responses and reproduces both bias and scalar properties when a Bayesian decoder reads its activity. Notably, the interval-selectivity, timing accuracy, and precision of the network showed complex changes as a function of the decay time constants of the modeled synaptic properties and the level of background activity of the cells. These findings suggest that physiological values of the time constants for paired-pulse facilitation and GABAb, as well as the internal state of the network, determine the bias and scalar properties of interval timing.SIGNIFICANCE STATEMENT Timing is a fundamental element of complex behavior, including music and language. Temporal processing in a wide variety of contexts shows two primary features: time estimates exhibit a shift toward the mean (the bias property) and are more variable for longer intervals (the scalar property). We implemented a recurrent neural network that includes long-lasting synaptic currents, which cannot only produce interval-selective responses but also follow the bias and scalar properties. Interestingly, only physiological values of the time constants for paired-pulse facilitation and GABAb, as well as intermediate background activity within the network can reproduce the two key features of interval timing.

Neural basis for categorical boundaries in the primate pre-SMA during relative categorization of time intervals

Perceptual categorization depends on the assignment of different stimuli to specific groups based, in principle, on the notion of flexible categorical boundaries. To determine the neural basis of categorical boundaries, we record the activity of pre-SMA neurons of monkeys executing an interval categorization task in which the limit between short and long categories changes between blocks of trials within a session. A large population of cells encodes this boundary by reaching a constant peak of activity close to the corresponding subjective limit. Notably, the time at which this peak is reached changes according to the categorical boundary of the current block, predicting the monkeys’ categorical decision on a trial-by-trial basis. In addition, pre-SMA cells also represent the category selected by the monkeys and the outcome of the decision. These results suggest that the pre-SMA adaptively encodes subjective duration boundaries between short and long durations and contains crucial neural information to categorize intervals and evaluate the outcome of such perceptual decisions.

Grouping stimuli into categories often depends on a subjective determination of category boundaries. Here the authors report a neuronal population in pre-supplementary motor area whose peak activity predicts the categorical decision boundary between long and short time intervals on a trial-by-trial basis.

The Computational and Neural Basis of Rhythmic Timing in Medial Premotor Cortex

The neural underpinnings of rhythmic behavior, including music and dance, have been studied using the synchronization-continuation task (SCT), where subjects initially tap in synchrony with an isochronous metronome and then keep tapping at a similar rate via an internal beat mechanism. Here, we provide behavioral and neural evidence that supports a resetting drift-diffusion model (DDM) during SCT. Behaviorally, we show the model replicates the linear relation between the mean and standard-deviation of the intervals produced by monkeys in SCT. We then show that neural populations in the medial premotor cortex (MPC) contain an accurate trial-by-trial representation of elapsed-time between taps. Interestingly, the autocorrelation structure of the elapsed-time representation is consistent with a DDM. These results indicate that MPC has an orderly representation of time with features characteristic of concatenated DDMs and that this population signal can be used to orchestrate the rhythmic structure of the internally timed elements of SCT.SIGNIFICANCE STATEMENT The present study used behavioral data, ensemble recordings from medial premotor cortex (MPC) in macaque monkeys, and computational modeling, to establish evidence in favor of a class of drift-diffusion models of rhythmic timing during a synchronization-continuation tapping task (SCT). The linear relation between the mean and standard-deviation of the intervals produced by monkeys in SCT is replicated by the model. Populations of MPC cells faithfully represent the elapsed time between taps, and there is significant trial-by-trial relation between decoded times and the timing behavior of the monkeys. Notably, the neural decoding properties, including its autocorrelation structure are consistent with a set of drift-diffusion models that are arranged sequentially and that are resetting in each SCT tap.

Novel Modeling of Task vs. Rest Brain State Predictability Using a Dynamic Time Warping Spectrum: Comparisons and Contrasts with Other Standard Measures of Brain Dynamics

Dynamic time warping, or DTW, is a powerful and domain-general sequence alignment method for computing a similarity measure. Such dynamic programming-based techniques like DTW are now the backbone and driver of most bioinformatics methods and discoveries. In neuroscience it has had far less use, though this has begun to change. We wanted to explore new ways of applying DTW, not simply as a measure with which to cluster or compare similarity between features but in a conceptually different way. We have used DTW to provide a more interpretable spectral description of the data, compared to standard approaches such as the Fourier and related transforms. The DTW approach and standard discrete Fourier transform (DFT) are assessed against benchmark measures of neural dynamics. These include EEG microstates, EEG avalanches, and the sum squared error (SSE) from a multilayer perceptron (MLP) prediction of the EEG time series, and simultaneously acquired FMRI BOLD signal. We explored the relationships between these variables of interest in an EEG-FMRI dataset acquired during a standard cognitive task, which allowed us to explore how DTW differentially performs in different task settings. We found that despite strong correlations between DTW and DFT-spectra, DTW was a better predictor for almost every measure of brain dynamics. Using these DTW measures, we show that predictability is almost always higher in task than in rest states, which is consistent to other theoretical and empirical findings, providing additional evidence for the utility of the DTW approach.

Finding the beat: a neural perspective across humans and non-human primates

Humans possess an ability to perceive and synchronize movements to the beat in music ('beat perception and synchronization'), and recent neuroscientific data have offered new insights into this beat-finding capacity at multiple neural levels. Here, we review and compare behavioural and neural data on temporal and sequential processing during beat perception and entrainment tasks in macaques (including direct neural recording and local field potential (LFP)) and humans (including fMRI, EEG and MEG). These abilities rest upon a distributed set of circuits that include the motor cortico-basal-ganglia-thalamo-cortical (mCBGT) circuit, where the supplementary motor cortex (SMA) and the putamen are critical cortical and subcortical nodes, respectively. In addition, a cortical loop between motor and auditory areas, connected through delta and beta oscillatory activity, is deeply involved in these behaviours, with motor regions providing the predictive timing needed for the perception of, and entrainment to, musical rhythms. The neural discharge rate and the LFP oscillatory activity in the gamma- and beta-bands in the putamen and SMA of monkeys are tuned to the duration of intervals produced during a beat synchronization-continuation task (SCT). Hence, the tempo during beat synchronization is represented by different interval-tuned cells that are activated depending on the produced interval. In addition, cells in these areas are tuned to the serial-order elements of the SCT. Thus, the underpinnings of beat synchronization are intrinsically linked to the dynamics of cell populations tuned for duration and serial order throughout the mCBGT. We suggest that a cross-species comparison of behaviours and the neural circuits supporting them sets the stage for a new generation of neurally grounded computational models for beat perception and synchronization.

Motor system evolution and the emergence of high cognitive functions

In human and nonhuman primates, the cortical motor system comprises a collection of brain areas primarily related to motor control. Existing evidence suggests that no other mammalian group has the number, extension, and complexity of motor-related areas observed in the frontal lobe of primates. Such diversity is probably related to the wide behavioral flexibility that primates display. Indeed, recent comparative anatomical, psychophysical, and neurophysiological studies suggest that the evolution of the motor cortical areas closely correlates with the emergence of high cognitive abilities. Advances in understanding the cortical motor system have shown that these areas are also related to functions previously linked to higher-order associative areas. In addition, experimental observations have shown that the classical distinction between perceptual and motor functions is not strictly followed across cortical areas. In this paper, we review evidence suggesting that evolution of the motor system had a role in the shaping of different cognitive functions in primates. We argue that the increase in the complexity of the motor system has contributed to the emergence of new abilities observed in human and nonhuman primates, including the recognition and imitation of the actions of others, speech perception and production, and the execution and appreciation of the rhythmic structure of music.

Dynamic representation of the temporal and sequential structure of rhythmic movements in the primate medial premotor cortex

We determined the encoding properties of single cells and the decoding accuracy of cell populations in the medial premotor cortex (MPC) of Rhesus monkeys to represent in a time-varying fashion the duration and serial order of six intervals produced rhythmically during a synchronization-continuation tapping task. We found that MPC represented the temporal and sequential structure of rhythmic movements by activating small ensembles of neurons that encoded the duration or the serial order in rapid succession, so that the pattern of active neurons changed dramatically within each interval. Interestingly, the width of the encoding or decoding function for serial order increased as a function of duration. Finally, we found that the strength of correlation in spontaneous activity of the individual cells varied as a function of the timing of their recruitment. These results demonstrate the existence of dynamic representations in MPC for the duration and serial order of intervals produced rhythmically and suggest that this dynamic code depends on ensembles of interconnected neurons that provide a strong synaptic drive to the next ensemble in a consecutive chain of neural events.

Linking perception, cognition, and action: psychophysical observations and neural network modelling

It has been argued that perception, decision making, and movement planning are in reality tightly interwoven brain processes. However, how they are implemented in neural circuits is still a matter of debate. We tested human subjects in a temporal categorization task in which intervals had to be categorized as short or long. Subjects communicated their decision by moving a cursor into one of two possible targets, which appeared separated by different angles from trial to trial. Even though there was a 1 second-long delay between interval presentation and decision communication, categorization difficulty affected subjects’ performance, reaction (RT) and movement time (MT). In addition, reaction and movement times were also influenced by the distance between the targets. This implies that not only perceptual, but also movement-related considerations were incorporated into the decision process. Therefore, we searched for a model that could use categorization difficulty and target separation to describe subjects’ performance, RT, and MT. We developed a network consisting of two mutually inhibiting neural populations, each tuned to one of the possible categories and composed of an accumulation and a memory node. This network sequentially acquired interval information, maintained it in working memory and was then attracted to one of two possible states, corresponding to a categorical decision. It faithfully replicated subjects’ RT and MT as a function of categorization difficulty and target distance; it also replicated performance as a function of categorization difficulty. Furthermore, this model was used to make new predictions about the effect of untested durations, target distances and delay durations. To our knowledge, this is the first biologically plausible model that has been proposed to account for decision making and communication by integrating both sensory and motor planning information.

Information processing in the primate basal ganglia during sensory-guided and internally driven rhythmic tapping

Gamma (γ) and beta (β) oscillations seem to play complementary functions in the cortico-basal ganglia-thalamo-cortical circuit (CBGT) during motor behavior. We investigated the time-varying changes of the putaminal spiking activity and the spectral power of local field potentials (LFPs) during a task where the rhythmic tapping of monkeys was guided by isochronous stimuli separated by a fixed duration (synchronization phase), followed by a period of internally timed movements (continuation phase). We found that the power of both bands and the discharge rate of cells showed an orderly change in magnitude as a function of the duration and/or the serial order of the intervals executed rhythmically. More LFPs were tuned to duration and/or serial order in the β- than the γ-band, although different values of preferred features were represented by single cells and by both bands. Importantly, in the LFPs tuned to serial order, there was a strong bias toward the continuation phase for the β-band when aligned to movements, and a bias toward the synchronization phase for the γ-band when aligned to the stimuli. Our results suggest that γ-oscillations reflect local computations associated with stimulus processing, whereas β-activity involves the entrainment of large putaminal circuits, probably in conjunction with other elements of CBGT, during internally driven rhythmic tapping.

Monkeys time their pauses of movement and not their movement-kinematics during a synchronization-continuation rhythmic task

A critical question in tapping behavior is to understand whether the temporal control is exerted on the duration and trajectory of the downward-upward hand movement or on the pause between hand movements. In the present study, we determined the duration of both the movement execution and pauses of monkeys performing a synchronization-continuation task (SCT), using the speed profile of their tapping behavior. We found a linear increase in the variance of pause-duration as a function of interval, while the variance of the motor implementation was relatively constant across intervals. In fact, 96% of the variability of the duration of a complete tapping cycle (pause + movement) was due to the variability of the pause duration. In addition, we performed a Bayesian model selection to determine the effect of interval duration (450–1,000 ms), serial-order (1–6 produced intervals), task phase (sensory cued or internally driven), and marker modality (auditory or visual) on the duration of the movement-pause and tapping movement. The results showed that the most important parameter used to successfully perform the SCT was the control of the pause duration. We also found that the kinematics of the tapping movements was concordant with a stereotyped ballistic control of the hand pressing the push-button. The present findings support the idea that monkeys used an explicit timing strategy to perform the SCT, where a dedicated timing mechanism controlled the duration of the pauses of movement, while also triggered the execution of fixed movements across each interval of the rhythmic sequence.

Are non-human primates capable of rhythmic entrainment? Evidence for the gradual audiomotor evolution hypothesis

We propose a decomposition of the neurocognitive mechanisms that might underlie interval-based timing and rhythmic entrainment. Next to reviewing the concepts central to the definition of rhythmic entrainment, we discuss recent studies that suggest rhythmic entrainment to be specific to humans and a selected group of bird species, but, surprisingly, is not obvious in non-human primates. On the basis of these studies we propose the gradual audiomotor evolution hypothesis that suggests that humans fully share interval-based timing with other primates, but only partially share the ability of rhythmic entrainment (or beat-based timing). This hypothesis accommodates the fact that non-human primates (i.e., macaques) performance is comparable to humans in single interval tasks (such as interval reproduction, categorization, and interception), but show differences in multiple interval tasks (such as rhythmic entrainment, synchronization, and continuation). Furthermore, it is in line with the observation that macaques can, apparently, synchronize in the visual domain, but show less sensitivity in the auditory domain. And finally, while macaques are sensitive to interval-based timing and rhythmic grouping, the absence of a strong coupling between the auditory and motor system of non-human primates might be the reason why macaques cannot rhythmically entrain in the way humans do.

Neurophysiology of timing in the hundreds of milliseconds: multiple layers of neuronal clocks in the medial premotor areas

The precise quantification of time in the subsecond scale is critical for many complex behaviors including music and dance appreciation/execution, speech comprehension/articulation, and the performance of many sports. Nevertheless, its neural underpinnings are largely unknown. Recent neurophysiological experiments from our laboratory have shown that the cell activity in the medial premotor areas (MPC) of macaques can represent different aspects of temporal processing during a synchronization-continuation tapping task (SCT). In this task the rhythmic behavior of monkeys was synchronized to a metronome of isochronous stimuli in the hundreds of milliseconds range (synchronization phase), followed by a period where animals internally temporalized their movements (continuation phase). Overall, we found that the time-keeping mechanism in MPC is governed by different layers of neural clocks. Close to the temporal control of movements are two separate populations of ramping cells that code for elapsed or remaining time for a tapping movement during the SCT. Thus, the sensorimotor loops engaged during the task may depend on the cyclic interplay between two neuronal chronometers that quantify in their instantaneous discharge rate the time passed and the remaining time for an action. In addition, we found MPC neurons that are tuned to the duration of produced intervals during the rhythmic task, showing an orderly variation in the average discharge rate as a function of duration. All the tested durations in the subsecond scale were represented in the preferred intervals of the cell population. Most of the interval-tuned cells were also tuned to the ordinal structure of the six intervals produced sequentially in the SCT. Hence, this next level of temporal processing may work as the notes of a musical score, providing information to the timing network about what duration and ordinal element of the sequence are being executed. Finally, we describe how the timing circuit can use a dynamic neural representation of the passage of time and the context in which the intervals are executed by integrating the time-varying activity of populations of cells. These neural population clocks can be defined as distinct trajectories in the multidimensional cell response-space. We provide a hypothesis of how these different levels of neural clocks can interact to constitute a coherent timing machine that controls the rhythmic behavior during the SCT.

Rhythm sensitivity in macaque monkeys

This study provides evidence that monkeys are rhythm sensitive. We composed isochronous tone sequences consisting of repeating triplets of two short tones and one long tone which humans perceive as repeating triplets of two weak and one strong beat. This regular sequence was compared to an irregular sequence with the same number of randomly arranged short and long tones with no such beat structure. To search for indication of rhythm sensitivity we employed an oddball paradigm in which occasional duration deviants were introduced in the sequences. In a pilot study on humans we showed that subjects more easily detected these deviants when they occurred in a regular sequence. In the monkeys we searched for spontaneous behaviors the animals executed concomitant with the deviants. We found that monkeys more frequently exhibited changes of gaze and facial expressions to the deviants when they occurred in the regular sequence compared to the irregular sequence. In addition we recorded neuronal firing and local field potentials from 175 sites of the primary auditory cortex during sequence presentation. We found that both types of neuronal signals differentiated regular from irregular sequences. Both signals were stronger in regular sequences and occurred after the onset of the long tones, i.e., at the position of the strong beat. Local field potential responses were also significantly larger for the durational deviants in regular sequences, yet in a later time window. We speculate that these temporal pattern-selective mechanisms with a focus on strong beats and their deviants underlie the perception of rhythm in the chosen sequences.

Interval tuning in the primate medial premotor cortex as a general timing mechanism

The precise quantification of time during motor performance is critical for many complex behaviors, including musical execution, speech articulation, and sports; however, its neural mechanisms are primarily unknown. We found that neurons in the medial premotor cortex (MPC) of behaving monkeys are tuned to the duration of produced intervals during rhythmic tapping tasks. Interval-tuned neurons showed similar preferred intervals across tapping behaviors that varied in the number of produced intervals and the modality used to drive temporal processing. In addition, we found that the same population of neurons is able to multiplex the ordinal structure of a sequence of rhythmic movements and a wide range of durations in the range of hundreds of milliseconds. Our results also revealed a possible gain mechanism for encoding the total number of intervals in a sequence of temporalized movements, where interval-tuned cells show a multiplicative effect of their activity for longer sequences of intervals. These data suggest that MPC is part of a core timing network that uses interval tuning as a signal to represent temporal processing in a variety of behavioral contexts where time is explicitly quantified.