Practice-related improvements in somatosensory interval discrimination are temporally specific but generalize across skin location, hemisphere, and modality

Crossmodal to unimodal transfer of temporal perceptual learning

Subsecond temporal processing is crucial for activities requiring precise timing. Here, we investigated perceptual learning of crossmodal (auditory-visual or visual-auditory) temporal interval discrimination (TID) and its impacts on unimodal (visual or auditory) TID performance. The research purpose was to test whether learning is based on a more abstract and conceptual representation of subsecond time, which would predict crossmodal to unimodal learning transfer. The experiments revealed that learning to discriminate a 200-ms crossmodal temporal interval, defined by a pair of visual and auditory stimuli, significantly reduced crossmodal TID thresholds. Moreover, the crossmodal TID training also minimized unimodal TID thresholds with a pair of visual or auditory stimuli at the same interval, even if crossmodal TID thresholds are multiple times higher than unimodal TID thresholds. Subsequent training on unimodal TID failed to reduce unimodal TID thresholds further. These results indicate that learning of high-threshold crossmodal TID tasks can benefit low-threshold unimodal temporal processing, which may be achieved through training-induced improvement of a conceptual representation of subsecond time in the brain.

Recording the tactile P300 with the cEEGrid for potential use in a brain-computer interface

Brain-computer interfaces (BCIs) are scientifically well established, but they rarely arrive in the daily lives of potential end-users. This could be in part because electroencephalography (EEG), a prevalent method to acquire brain activity for BCI operation, is considered too impractical to be applied in daily life of end-users with physical impairment as an assistive device. Hence, miniaturized EEG systems such as the cEEGrid have been developed. While they promise to be a step toward bridging the gap between BCI development, lab demonstrations, and home use, they still require further validation. Encouragingly, the cEEGrid has already demonstrated its ability to record visually and auditorily evoked event-related potentials (ERP), which are important as input signal for many BCIs. With this study, we aimed at evaluating the cEEGrid in the context of a BCI based on tactually evoked ERPs. To compare the cEEGrid with a conventional scalp EEG, we recorded brain activity with both systems simultaneously. Forty healthy participants were recruited to perform a P300 oddball task based on vibrotactile stimulation at four different positions. This tactile paradigm has been shown to be feasible for BCI repeatedly but has never been tested with the cEEGrid. We found distinct P300 deflections in the cEEGrid data, particularly at vertical bipolar channels. With an average of 63%, the cEEGrid classification accuracy was significantly above the chance level (25%) but significantly lower than the 81% reached with the EEG cap. Likewise, the P300 amplitude was significantly lower (cEEGrid R2-R7: 1.87 μV, Cap Cz: 3.53 μV). These results indicate that a tactile BCI using the cEEGrid could potentially be operated, albeit with lower efficiency. Additionally, participants' somatosensory sensitivity was assessed, but no correlation to the accuracy of either EEG system was shown. Our research contributes to the growing amount of literature comparing the cEEGrid to conventional EEG systems and provides first evidence that the tactile P300 can be recorded behind the ear. A BCI based on a thus simplified EEG system might be more readily accepted by potential end-users, provided the accuracy can be substantially increased, e.g., by training and improved classification.

Transfer of Tactile Learning to Untrained Body Parts: Emerging Cortical Mechanisms

Pioneering investigations in the mid-19th century revealed that the perception of tactile cues presented to the surface of the skin improves with training, which is referred to as tactile learning. Surprisingly, tactile learning also occurs for body parts and skin locations that are not physically involved in the training. For example, after training of a finger, tactile learning transfers to adjacent untrained fingers. This suggests that the transfer of tactile learning follows a somatotopic pattern and involves brain regions such as the primary somatosensory cortex (S1), in which the trained and untrained body parts and skin locations are represented close to each other. However, other results showed that transfer occurs between body parts that are not represented close to each other in S1-for example, between the hand and the foot. These and similar findings have led to the suggestion of additional cortical mechanisms to explain the transfer of tactile learning. Here, different mechanisms are reviewed, and the extent to which they can explain the transfer of tactile learning is discussed. What all of these mechanisms have in common is that they assume a representational or functional relationship between the trained and untrained body parts and skin locations. However, none of these mechanisms alone can explain the complex pattern of transfer results, and it is likely that different mechanisms interact to enable transfer, perhaps in concert with higher somatosensory and decision-making areas.

Shift in excitation-inhibition balance underlies perceptual learning of temporal discrimination

Temporal perceptual learning (TPL) constitutes a unique and profound demonstration of neural plasticity within the brain. Our understanding for the neurometabolic changes associated with TPL on the other hand has been limited in part by the use of traditional fMRI approaches. Since plasticity in the visual cortex has been shown to underlie perceptual learning of visual information, we tested the hypothesis that TPL of an auditory interval involves a similar change in plasticity of the auditory pathway and if so, whether these changes take place in a lower-order sensory-specific brain area such as the primary auditory cortex (A1), or a higher-order modality-independent brain area such as the inferior parietal cortex (IPC). This distinction will inform us of the mechanisms underlying perceptual learning as well as the locus of change as it relates to TPL. In the present study, we took advantage of a new technique: proton magnetic resonance spectroscopy (MRS) in combination with psychophysical measures to provide the first evidence of changes in neurometabolic processing following 5 days of temporal discrimination training. We measured the (E)xcitation-to-(I)nhibition ratio as an index of learning in the right IPC and left A1 while participants learned an auditory two-tone discrimination task. During the first day of training, we found a significant task-related increase in functional E/I ratio within the IPC. While the A1 exhibited the opposite pattern of neurochemical activity, this relationship did not reach statistical significance. After timing performance has reached a plateau, there were no further changes to functional E/I. These findings support the hypothesis that improvements in temporal discrimination relies on neuroplastic changes in the IPC, but it is possible that both areas work synergistically to acquire a temporal interval.

Pre-supplementary Motor Cortex Mediates Learning Transfer from Perceptual to Motor Timing

When we intensively train a timing skill, such as learning to play the piano, we not only produce brain changes associated with task-specific learning but also improve our performance in other temporal behaviors that depend on these tuned neural resources. Since the neural basis of time learning and generalization is still unknown, we measured the changes in neural activity associated with the transfer of learning from perceptual to motor timing in a large sample of subjects (n = 65; 39 women). We found that intense training in an interval discrimination task increased the acuity of time perception in a group of subjects that also exhibited learning transfer, expressed as a reduction in inter-tap interval variability during an internally driven periodic motor task. In addition, we found subjects with no learning and/or generalization effects. Notably, functional imaging showed an increase in pre-supplementary motor area and caudate-putamen activity between the post- and pre-training sessions of the tapping task. This increase was specific to the subjects that generalized their timing acuity from the perceptual to the motor context. These results emphasize the central role of the cortico-basal ganglia circuit in the generalization of timing abilities between tasks.

A Second Introduction to the Neurobiology of Interval Timing

Time is a critical variable that organisms must be able to measure in order to survive in a constantly changing environment. Initially, this paper describes the myriad of contexts where time is estimated or predicted and suggests that timing is not a single process and probably depends on a set of different neural mechanisms. Consistent with this hypothesis, the explosion of neurophysiological and imaging studies in the last 10 years suggests that different brain circuits and neural mechanisms are involved in the ability to tell and use time to control behavior across contexts. Then, we develop a conceptual framework that defines time as a family of different phenomena and propose a taxonomy with sensory, perceptual, motor, and sensorimotor timing as the pillars of temporal processing in the range of hundreds of milliseconds.

Diverse Time Encoding Strategies Within the Medial Premotor Areas of the Primate

The measurement of time in the subsecond scale is critical for many sophisticated behaviors, yet its neural underpinnings are largely unknown. Recent neurophysiological experiments from our laboratory have shown that the neural activity in the medial premotor areas (MPC) of macaques can represent different aspects of temporal processing. During single interval categorization, we found that preSMA encodes a subjective category limit by reaching a peak of activity at a time that divides the set of test intervals into short and long. We also observed neural signals associated with the category selected by the subjects and the reward outcomes of the perceptual decision. On the other hand, we have studied the behavioral and neurophysiological basis of rhythmic timing. First, we have shown in different tapping tasks that macaques are able to produce predictively and accurately intervals that are cued by auditory or visual metronomes or when intervals are produced internally without sensory guidance. In addition, we found that the rhythmic timing mechanism in MPC is governed by different layers of neural clocks. Next, the instantaneous activity of single cells shows ramping activity that encodes the elapsed or remaining time for a tapping movement. In addition, we found MPC neurons that build neural sequences, forming dynamic patterns of activation that flexibly cover all the produced interval depending on the tapping tempo. This rhythmic neural clock resets on every interval providing an internal representation of pulse. Furthermore, the MPC cells show mixed selectivity, encoding not only elapsed time, but also the tempo of the tapping and the serial order element in the rhythmic sequence. Hence, MPC can map different task parameters, including the passage of time, using different cell populations. Finally, the projection of the time varying activity of MPC hundreds of cells into a low dimensional state space showed circular neural trajectories whose geometry represented the internal pulse and the tapping tempo. Overall, these findings support the notion that MPC is part of the core timing mechanism for both single interval and rhythmic timing, using neural clocks with different encoding principles, probably to flexibly encode and mix the timing representation with other task parameters.

Training Induced Improvement on Human Perception of the Force Feedback Provided by A Soft Robotic Glove

Creating haptic interface by glove-based wearable robotic system has become an increasingly interested topic in the area of human robotic interaction. Many force feedback gloves are constructed based on soft actuators. However, the recent development of haptic and force feedback technology mainly focused on the advancement of the actuating components and mechanism, and innovation of the force feedback rendering algorithms. It seems that another important part of this human-robot-interaction loop, i.e. the human factors, were understudied. Here, this study focused on the learning effect in haptic perception. We designed a pneumatic muscle-based force feedback robotic glove which can provide customized force feedback to the dorsal surface of each finger. An experiment was carried out with a specifically training procedure and evaluation on the force feedback perceptions. The results show that practice-induced improvement can be achieved by this training, allowing people have a better perception of the force feedback provided by this glove.

Musical Training Facilitates Exogenous Temporal Attention via Delta Phase Entrainment within a Sensorimotor Network

Temporal orienting of attention plays an important role in our day-to-day lives and can use timing information from exogenous or endogenous sources. Yet, it is unclear what neural mechanisms give rise to temporal attention, and it is debated whether both exogenous and endogenous forms of temporal attention share a common neural source. Here, older adult nonmusicians (N = 47, 24 female) were randomized to undergo 8 weeks of either rhythm training, which places demands on exogenous temporal attention, or word search training as a control. The goal was to assess (1) the neural basis of exogenous temporal attention and (2) whether training-induced improvements in exogenous temporal attention can transfer to enhanced endogenous temporal attention abilities, thereby providing support for a common neural mechanism of temporal attention. Before and after training, exogenous temporal attention was assessed using a rhythmic synchronization paradigm, whereas endogenous temporal attention was evaluated via a temporally cued visual discrimination task. Results showed that rhythm training improved performance on the exogenous temporal attention task, which was associated with increased intertrial coherence within the δ (1-4 Hz) band as assessed by EEG recordings. Source localization revealed increased δ-band intertrial coherence arose from a sensorimotor network, including premotor cortex, anterior cingulate cortex, postcentral gyrus, and the inferior parietal lobule. Despite these improvements in exogenous temporal attention, such benefits were not transferred to endogenous attentional ability. These results support the notion that exogenous and endogenous temporal attention uses independent neural sources, with exogenous temporal attention relying on the precise timing of δ band oscillations within a sensorimotor network.SIGNIFICANCE STATEMENT Allocating attention to specific points in time is known as temporal attention, and may arise from external (exogenous) or internal (endogenous) sources. Despite its importance to our daily lives, it is unclear how the brain gives rise to temporal attention and whether exogenous- or endogenous-based sources for temporal attention rely on shared brain regions. Here, we demonstrate that musical rhythm training improves exogenous temporal attention, which was associated with more consistent timing of neural activity in sensory and motor processing brain regions. However, these benefits did not extend to endogenous temporal attention, indicating that temporal attention relies on different brain regions depending on the source of timing information.

Temporal learning in the suprasecond range: insights from cognitive style

The acquisition of information on the timing of events or actions (temporal learning) occurs in both the subsecond and suprasecond range. However, although relevant differences between participants have been reported in temporal learning, the role of dimensions of individual variability in affecting performance in such tasks is still unclear. Here we investigated this issue, assessing the effect of field-dependent/independent cognitive style on temporal learning in the suprasecond range. Since different mechanisms mediate timing when a temporal representation is self-generated, and when it depends on an external referent, temporal learning was assessed in two conditions. Participants observed a stimulus across six repetitions and reproduced it. Unbeknownst to them, in an internally-based learning (IBL) condition, the stimulus duration was fixed within a trial, although the number of events defining it varied; in an externally-cued learning (ECL) condition, the stimulus was defined by the same number of events within each trial, although its duration varied. The effect of the reproduction modality was also assessed (motor vs. perceptual). Error scores were higher in IBL compared to ECL; the reverse was true for variability. Field-independent individuals performed better than field-dependent ones only in IBL, as further confirmed by correlation analyses. Findings provide evidence that differences in dimensions of variability in high-level cognitive functioning, such as field dependence/independence, significantly affect temporal learning in the suprasecond range, and that this effect depends on the type of temporal representation fostered by the specific task demands.

Auditory clicks elicit equivalent temporal frequency perception to tactile pulses: A cross-modal psychophysical study

Both hearing and touch are sensitive to the frequency of mechanical oscillations—sound waves and tactile vibrations, respectively. The mounting evidence of parallels in temporal frequency processing between the two sensory systems led us to directly address the question of perceptual frequency equivalence between touch and hearing using stimuli of simple and more complex temporal features. In a cross-modal psychophysical paradigm, subjects compared the perceived frequency of pulsatile mechanical vibrations to that elicited by pulsatile acoustic (click) trains, and vice versa. Non-invasive pulsatile stimulation designed to excite a fixed population of afferents was used to induce desired temporal spike trains at frequencies spanning flutter up to vibratory hum (>50 Hz). The cross-modal perceived frequency for regular test pulse trains of either modality was a close match to the presented stimulus physical frequency up to 100 Hz. We then tested whether the recently discovered “burst gap” temporal code for frequency, that is shared by the two senses, renders an equivalent cross-modal frequency perception. When subjects compared trains comprising pairs of pulses (bursts) in one modality against regular trains in the other, the cross-sensory equivalent perceptual frequency best corresponded to the silent interval between the successive bursts in both auditory and tactile test stimuli. These findings suggest that identical acoustic and vibrotactile pulse trains, regardless of pattern, elicit equivalent frequencies, and imply analogous temporal frequency computation strategies in both modalities. This perceptual correspondence raises the possibility of employing a cross-modal comparison as a robust standard to overcome the prevailing methodological limitations in psychophysical investigations and strongly encourages cross-modal approaches for transmitting sensory information such as translating pitch into a similar pattern of vibration on the skin.

Identifying potential training factors in a vibrotactile P300-BCI

Brain-computer interfaces (BCI) often rely on visual stimulation and feedback. Potential end-users with impaired vision, however, cannot use these BCIs efficiently and require a non-visual alternative. Both auditory and tactile paradigms have been developed but are often not sufficiently fast or accurate. Thus, it is particularly relevant to investigate if and how users can train and improve performance. We report data from 29 healthy participants who trained with a 4-choice tactile P300-BCI during five sessions. To identify potential training factors, we pre-post assessed the robustness of the BCI performance against increased workload in a dual task condition and determined the participants' somatosensory sensitivity thresholds with a forced-choice intensity discrimination task. Accuracy (M = 79.2% to 92.0%) and tactually evoked P300 amplitudes increased significantly, confirming successful training. Pre-post somatosensory sensitivity increased, and workload decreased significantly, but results of the dual task condition remained inconclusive. The present study confirmed the previously reported feasibility and trainability of our tactile BCI paradigm within a multi-session design. Importantly, we provide first evidence of improvement in the somatosensory system as a potential mediator for the observed training effects.

Time in schizophrenia: a link between psychopathology, psychophysics and technology

It has been widely demonstrated that time processing is altered in patients with schizophrenia. This perspective review delves into such temporal deficit and highlights its link to low-level sensory alterations, which are often overlooked in rehabilitation protocols for psychosis. However, if temporal impairment at the sensory level is inherent to the disease, new interventions should focus on this dimension. Beyond more traditional types of intervention, here we review the most recent digital technologies for rehabilitation and the most promising ones for sensory training. The overall aim is to synthesise existing literature on time in schizophrenia linking psychopathology, psychophysics, and technology to help future developments.

A supramodal and conceptual representation of subsecond time revealed with perceptual learning of temporal interval discrimination

Subsecond time perception has been frequently attributed to modality-specific timing mechanisms that would predict no cross-modal transfer of temporal perceptual learning. In fact, perceptual learning of temporal interval discrimination (TID) reportedly shows either no cross-modal transfer, or asymmetric transfer from audition to vision, but not vice versa. However, here we demonstrate complete cross-modal transfer of auditory and visual TID learning using a double training paradigm. Specifically, visual TID learning transfers to and optimizes auditory TID when the participants also receive exposure to the auditory temporal interval by practicing a functionally orthogonal near-threshold tone frequency discrimination task at the same trained interval. Auditory TID learning also transfers to and optimizes visual TID with additional practice of an orthogonal near-threshold visual contrast discrimination task at the same trained interval. Practicing these functionally orthogonal tasks per se has no impact on TID thresholds. We interpret the transfer results as indications of a supramodal representation of subsecond time. Moreover, because TID learning shows complete transfer between modalities with vastly different temporal precisions, the sub-second time presentation must be conceptual. Double training may refine this supramodal and conceptual subsecond time representation and connect it to a new sense to improve time perception.

Temporal perceptual learning distinguishes between empty and filled intervals

Temporal perceptual learning (TPL) refers to improved temporal performance as a result of training with sub-second intervals. Most studies on TPL have focused on empty intervals (i.e. intervals marked by two brief stimuli); however, scholars have suggested that filled intervals (i.e. intervals presented as continuous sensory inputs) might have different underlying mechanisms. Therefore, the current study aimed to test whether empty and filled intervals yield similar TPL performance and whether such learning effects could transfer mutually. To this end, we trained two groups of participants with empty and filled intervals of 200 ms for four days, respectively. We found that the empty-interval group clearly improved their timing performances after training, and such an effect transferred to filled intervals of 200 ms. By contrast, the filled-interval group had neither learning nor transfer effect. Our results further shed light on the distinct mechanisms between empty and filled intervals in time perception while simultaneously replicating the classical findings on TPL involving empty intervals.

Temporal accuracy of gait after metronome practice

Humans readily entrain their movements to a beat, including matching their gait to a prescribed tempo. Rhythmic auditory cueing tasks have been used to enhance stepping behavior in a variety of clinical populations. However, there is limited understanding of how temporal accuracy of gait changes over practice in healthy young adults. In this study, we examined how inter-step interval and cadence deviated from slow, medium, and fast tempos across steps within trials, across trials within blocks, and across two blocks that bookended a period of practice of walking to each tempo. Participants were accurate in matching the tempo at the slow and medium tempos, while they tended to lag behind the beat at the fast tempo. We also found that participants showed no substantial improvement across steps and trials, nor across blocks, suggesting that participants had a robust ability to entrain their gait to the specified metronome tempo. However, we did find that participants habituated to the prescribed tempo, showing self-paced gait that was faster than self-paced baseline gait after the fast tempo, and slower than self-paced baseline gait after the slow tempo. These findings might represent an "after-effect" in the temporal domain, akin to after-effects consistently shown in other sensorimotor tasks. This knowledge of how healthy participants entrain their gait to temporal cues may have important implications in understanding how clinical populations acquire and modify their gait in rhythmic auditory cueing tasks.

Perceptual timing precision with vibrotactile, auditory, and multisensory stimuli

The growing use of vibrotactile signaling devices makes it important to understand the perceptual limits on vibrotactile information processing. To promote that understanding, we carried out a pair of experiments on vibrotactile, auditory, and bimodal (synchronous vibrotactile and auditory) temporal acuity. On each trial, subjects experienced a set of isochronous, standard intervals (400 ms each), followed by one interval of variable duration (400 ± 1-80 ms). Intervals were demarcated by short vibrotactile, auditory, or bimodal pulses. Subjects categorized the timing of the last interval by describing the final pulse as either "early" or "late" relative to its predecessors. In Experiment 1, each trial contained three isochronous standard intervals, followed by an interval of variable length. In Experiment 2, the number of isochronous standard intervals per trial varied, from one to four. Psychometric modeling revealed that vibrotactile stimulation produced poorer temporal discrimination than either auditory or bimodal stimulation. Moreover, auditory signals dominated bimodal sensitivity, and inter-individual differences in temporal discriminability were reduced with bimodal stimulation. Additionally, varying the number of isochronous intervals in a trial failed to improve temporal sensitivity in either modality, suggesting that memory played a key role in judgments of interval duration.

Human perceptual learning is delayed by the N-methyl-D-aspartate receptor partial agonist D-cycloserine

BACKGROUND

The optimisation of learning has long been a focus of scientific research, particularly in relation to improving psychological treatment and recovery of brain function. Previously, partial N-methyl-D-aspartate agonists have been shown to augment reward learning, procedural learning and psychological therapy, but many studies also report no impact of these compounds on the same processes.

AIMS

Here we investigate whether administration of an N-methyl-D-aspartate partial agonist (D-cycloserine) modulates a previously unexplored process - tactile perceptual learning. Further, we use a longitudinal design to investigate whether N-methyl-D-aspartate-related learning effects vary with time, thereby providing a potentially simple explanation for apparent mixed effects in previous research.

METHODS

Thirty-four volunteers were randomised to receive one dose of 250 mg D-cycloserine or placebo 2 h before tactile sensitivity training. Tactile perception was measured using psychophysical methods before and after training, and 24/48 h later.

RESULTS

The placebo group showed immediate within-day tactile perception gains, but no further improvements between-days. In contrast, tactile perception remained at baseline on day one in the D-cycloserine group (no within-day learning), but showed significant overnight gains on day two. Both groups were equivalent in tactile perception by the final testing - indicating N-methyl-D-aspartate effects changed the timing, but not the overall amount of tactile learning.

CONCLUSIONS

In sum, we provide first evidence for modulation of perceptual learning by administration of a partial N-methyl-D-aspartate agonist. Resolving how the effects of such compounds become apparent over time will assist the optimisation of testing schedules, and may help resolve discrepancies across the learning and cognition domains.

Effects of stimulus and task structure on temporal perceptual learning

Our ability to discriminate temporal intervals can be improved with practice. This learning is generally thought to reflect an enhancement in the representation of a trained interval, which leads to interval-specific improvements in temporal discrimination. In the present study, we asked whether temporal learning is further constrained by context-specific factors dictated through the trained stimulus and task structure. Two groups of participants were trained using a single-interval auditory discrimination task over 5 days. Training intervals were either one of eight predetermined values (FI group), or random from trial to trial (RI group). Before and after the training period, we measured discrimination performance using an untrained two-interval temporal comparison task. Our results revealed a selective improvement in the FI group, but not the RI group. However, this learning did not generalize between the trained and untrained tasks. These results highlight the sensitivity of TPL to stimulus and task structure, suggesting that mechanisms of temporal learning rely on processes beyond changes in interval representation.

Modality-specific and multisensory mechanisms of spatial attention and expectation

In our natural environment, the brain needs to combine signals from multiple sensory modalities into a coherent percept. Whereas spatial attention guides perceptual decisions by prioritizing processing of signals that are task-relevant, spatial expectations encode the probability of signals over space. Previous studies have shown that behavioral effects of spatial attention generalize across sensory modalities. However, because they manipulated spatial attention as signal probability over space, these studies could not dissociate attention and expectation or assess their interaction. In two experiments, we orthogonally manipulated spatial attention (i.e., task-relevance) and expectation (i.e., signal probability) selectively in one sensory modality (i.e., primary modality) (experiment 1: audition, experiment 2: vision) and assessed their effects on primary and secondary sensory modalities in which attention and expectation were held constant. Our results show behavioral effects of spatial attention that are comparable for audition and vision as primary modalities; however, signal probabilities were learned more slowly in audition, so that spatial expectations were formed later in audition than vision. Critically, when these differences in learning between audition and vision were accounted for, both spatial attention and expectation affected responses more strongly in the primary modality in which they were manipulated and generalized to the secondary modality only in an attenuated fashion. Collectively, our results suggest that both spatial attention and expectation rely on modality-specific and multisensory mechanisms.

Force field generalization and the internal representation of motor learning

When learning a new motor behavior, e.g. reaching in a force field, the nervous system builds an internal representation. Examining how subsequent reaches in unpracticed directions generalize reveals this representation. Although often studied, it is not known how this representation changes across training directions, or how changes in reach direction and the corresponding changes in limb impedance, influence these measurements. We ran a force field adaptation experiment using eight groups of subjects each trained on one of eight standard directions and then tested for generalization in the remaining seven directions. Generalization in all directions was local and asymmetric, providing limited and unequal transfer to the left and right side of the trained target. These asymmetries were not consistent in either magnitude or direction, even after correcting for changes in limb impedance. Relying on a standard model for generalization the inferred representations inconsistently shifted to one side or the other of their respective training direction. A second model that accounted for limb impedance and variations in baseline trajectories explained more data and the inferred representations were centered on their respective training directions. Our results highlight the influence of limb mechanics and impedance on psychophysical measurements and their interpretations for motor learning.

Integrating Models of Interval Timing and Reinforcement Learning

We present an integrated view of interval timing and reinforcement learning (RL) in the brain. The computational goal of RL is to maximize future rewards, and this depends crucially on a representation of time. Different RL systems in the brain process time in distinct ways. A model-based system learns 'what happens when', employing this internal model to generate action plans, while a model-free system learns to predict reward directly from a set of temporal basis functions. We describe how these systems are subserved by a computational division of labor between several brain regions, with a focus on the basal ganglia and the hippocampus, as well as how these regions are influenced by the neuromodulator dopamine.

The Neural Basis of Timing: Distributed Mechanisms for Diverse Functions

Timing is critical to most forms of learning, behavior, and sensory-motor processing. Converging evidence supports the notion that, precisely because of its importance across a wide range of brain functions, timing relies on intrinsic and general properties of neurons and neural circuits; that is, the brain uses its natural cellular and network dynamics to solve a diversity of temporal computations. Many circuits have been shown to encode elapsed time in dynamically changing patterns of neural activity-so-called population clocks. But temporal processing encompasses a wide range of different computations, and just as there are different circuits and mechanisms underlying computations about space, there are a multitude of circuits and mechanisms underlying the ability to tell time and generate temporal patterns.

Memory for Random Time Patterns in Audition, Touch, and Vision

Perception deals with temporal sequences of events, like series of phonemes for audition, dynamic changes in pressure for touch textures, or moving objects for vision. Memory processes are thus needed to make sense of the temporal patterning of sensory information. Recently, we have shown that auditory temporal patterns could be learned rapidly and incidentally with repeated exposure [Kang et al., 2017]. Here, we tested whether rapid incidental learning of temporal patterns was specific to audition, or if it was a more general property of sensory systems. We used a same behavioral task in three modalities: audition, touch, and vision, for stimuli having identical temporal statistics. Participants were presented with sequences of acoustic pulses for audition, motion pulses to the fingertips for touch, or light pulses for vision. Pulses were randomly and irregularly spaced, with all inter-pulse intervals in the sub-second range and all constrained to be longer than the temporal acuity in any modality. This led to pulse sequences with an average inter-pulse interval of 166 ms, a minimum inter-pulse interval of 60 ms, and a total duration of 1.2 s. Results showed that, if a random temporal pattern re-occurred at random times during an experimental block, it was rapidly learned, whatever the sensory modality. Moreover, patterns first learned in the auditory modality displayed transfer of learning to either touch or vision. This suggests that sensory systems may be exquisitely tuned to incidentally learn re-occurring temporal patterns, with possible cross-talk between the senses.

Human Vestibulo-Ocular Reflex Adaptation Training: Time Beats Quantity

The vestibulo-ocular reflex (VOR) is the main gaze stabilising system during rapid head movements. The VOR is highly plastic and its gain (eye/head velocity) can be increased via training that induces an incrementally increasing retinal image slip error signal to drive VOR adaptation. Using the unilateral incremental VOR adaptation technique and horizontal active head impulses as the vestibular stimulus, we sought to determine the factors important for VOR adaptation including: the total training time, ratio and number of head impulses to each side (adapting and non-adapting sides; the adapting side was pseudo-randomised left or right) and exposure time to the visual target during each head impulse. We tested 11 normal subjects, each over 5 separate sessions and training protocols. The basic training protocol (protocol one) consisted of unilateral incremental VOR adaptation training lasting 15 min with the ratio of head impulses to each side 1:1. Each protocol varied from the basic. For protocol two, the ratio of impulses were in favour of the adapting side by 2:1. For protocol three, all head impulses were towards the adapting side and the training only lasted 7.5 min. For protocol four, all impulses were towards the adapting side and lasted 15 min. For protocol five, all head impulses were to the adapting side and the exposure time to the visual target during each impulse was doubled. We measured the active and passive VOR gains before and after the training. Albeit with small sample size, our data suggest that the total training time and the visual target exposure time for each head impulse affected adaptation, whereas the total number and repetition rate of head impulses did not. These data have implications for vestibular rehabilitation, suggesting that quality and duration of VOR adaptation exercises are more important than rapid repetition of exercises.

Interactive Sonification Exploring Emergent Behavior Applying Models for Biological Information and Listening

Sonification is an open-ended design task to construct sound informing a listener of data. Understanding application context is critical for shaping design requirements for data translation into sound. Sonification requires methodology to maintain reproducibility when data sources exhibit non-linear properties of self-organization and emergent behavior. This research formalizes interactive sonification in an extensible model to support reproducibility when data exhibits emergent behavior. In the absence of sonification theory, extensibility demonstrates relevant methods across case studies. The interactive sonification framework foregrounds three factors: reproducible system implementation for generating sonification; interactive mechanisms enhancing a listener's multisensory observations; and reproducible data from models that characterize emergent behavior. Supramodal attention research suggests interactive exploration with auditory feedback can generate context for recognizing irregular patterns and transient dynamics. The sonification framework provides circular causality as a signal pathway for modeling a listener interacting with emergent behavior. The extensible sonification model adopts a data acquisition pathway to formalize functional symmetry across three subsystems: Experimental Data Source, Sound Generation, and Guided Exploration. To differentiate time criticality and dimensionality of emerging dynamics, tuning functions are applied between subsystems to maintain scale and symmetry of concurrent processes and temporal dynamics. Tuning functions accommodate sonification design strategies that yield order parameter values to render emerging patterns discoverable as well as rehearsable, to reproduce desired instances for clinical listeners. Case studies are implemented with two computational models, Chua's circuit and Swarm Chemistry social agent simulation, generating data in real-time that exhibits emergent behavior. Heuristic Listening is introduced as an informal model of a listener's clinical attention to data sonification through multisensory interaction in a context of structured inquiry. Three methods are introduced to assess the proposed sonification framework: Listening Scenario classification, data flow Attunement, and Sonification Design Patterns to classify sound control. Case study implementations are assessed against these methods comparing levels of abstraction between experimental data and sound generation. Outcomes demonstrate the framework performance as a reference model for representing experimental implementations, also for identifying common sonification structures having different experimental implementations, identifying common functions implemented in different subsystems, and comparing impact of affordances across multiple implementations of listening scenarios.

Rate after-effects fail to transfer cross-modally: Evidence for distributed sensory timing mechanisms

Accurate time perception is critical for a number of human behaviours, such as understanding speech and the appreciation of music. However, it remains unresolved whether sensory time perception is mediated by a central timing component regulating all senses, or by a set of distributed mechanisms, each dedicated to a single sensory modality and operating in a largely independent manner. To address this issue, we conducted a range of unimodal and cross-modal rate adaptation experiments, in order to establish the degree of specificity of classical after-effects of sensory adaptation. Adapting to a fast rate of sensory stimulation typically makes a moderate rate appear slower (repulsive after-effect), and vice versa. A central timing hypothesis predicts general transfer of adaptation effects across modalities, whilst distributed mechanisms predict a high degree of sensory selectivity. Rate perception was quantified by a method of temporal reproduction across all combinations of visual, auditory and tactile senses. Robust repulsive after-effects were observed in all unimodal rate conditions, but were not observed for any cross-modal pairings. Our results show that sensory timing abilities are adaptable but, crucially, that this change is modality-specific - an outcome that is consistent with a distributed sensory timing hypothesis.

Cathodal transcranial direct-current stimulation over right posterior parietal cortex enhances human temporal discrimination ability

Background

Time perception associated with durations from 1 s to several minutes involves activity in the right posterior parietal cortex (rPPC). It is unclear whether altering the activity of the rPPC affects an individual’s timing performance. Here, we investigated the human timing performance under the application of transcranial direct-current stimulation (tDCS) that altered the neural activities of the rPPC.

Methods

We measured the participants’ duration-discrimination threshold by administering a behavioral task during the tDCS application. The tDCS conditions consisted of anodal, cathodal, and sham conditions. The electrodes were placed over the P4 position (10-20 system) and on the left supraorbital forehead. On each task trial, the participant observed two visual stimuli and indicated which was longer. The amount of difference between the two stimulus durations was varied repeatedly throughout the trials according to the participant’s responses. The correct answer rate of the trials was calculated for each amount of difference, and the minimum amount with the correct answer rate exceeding 75% was selected as the threshold. The data were analyzed by a linear mixed-effects models procedure.

Results

Nineteen volunteers participated in the experiment. We excluded three participants from the analysis: two who reported extreme sleepiness while performing the task and one who could recognize the sham condition correctly with confidence. Our analysis of the 16 participants’ data showed that the average value of the thresholds observed under the cathodal condition was lower than that of the sham condition. This suggests that inhibition of the rPPC leads to an improvement in temporal discrimination performance, resulting in improved timing performance.

Conclusions

In the present study, we found a new effect that cathodal tDCS over the rPPC enhances temporal discrimination performance. In terms of the existence of anodal/cathodal tDCS effects on human timing performance, the results were consistent with a previous study that investigated temporal reproduction performance during tDCS application. However, the results of the current study further indicated that cathodal tDCS over the rPPC increases accuracy of observed time duration rather than inducing an overestimation as a previous study reported.

Supramodal representation of temporal priors calibrates interval timing

Human timing behaviors are consistent with Bayesian inference, according to which both previous knowledge (prior) and current sensory information determine final responses. However, it is unclear whether the brain represents temporal priors exclusively for individual modalities or in a supramodal manner when temporal information comes from different modalities at different times. Here we asked participants to reproduce time intervals in either a unisensory or a multisensory context. In unisensory tasks, sample intervals drawn from a uniform distribution were presented in a single visual or auditory modality. In multisensory tasks, sample intervals from the two modalities were randomly mixed; visual and auditory intervals were drawn from two adjacent uniform distributions, with the conjunction of the two being equal to the distribution in the unisensory tasks. In the unisensory tasks, participants' reproduced times exhibited classic central-tendency biases: shorter intervals were overestimated and longer intervals were underestimated. In the multisensory tasks, reproduced times were biased toward the mean of the whole distribution rather than the means of intervals in individual modalities. The Bayesian model with a supramodal prior (distribution of time intervals from both modalities) outperformed the model with modality-specific priors in describing participants' performance. With a generalized model assuming the weighted combination of unimodal priors, we further obtained the relative contribution of visual intervals and auditory intervals in forming the prior for each participant. These findings suggest a supramodal mechanism for encoding priors in temporal processing, although the extent of influence of one modality on another differs individually.NEW & NOTEWORTHY Visual timing and auditory timing influence each other when time intervals in the two modalities are drawn from two adjacent distributions and are randomly intermixed. A Bayesian model with a supramodal prior (distribution of intervals from both modalities) outperforms the model using sensory-specific priors in describing participants' performance. A generalized model further reveals that the prior is represented as a weighted average of the distribution of time intervals from the two modalities, which differ individually.

Monkeys Share the Human Ability to Internally Maintain a Temporal Rhythm

Timing is a fundamental variable for behavior. However, the mechanisms allowing human and non-human primates to synchronize their actions with periodic events are not yet completely understood. Here we characterize the ability of rhesus monkeys and humans to perceive and maintain rhythms of different paces in the absence of sensory cues or motor actions. In our rhythm task subjects had to observe and then internally follow a visual stimulus that periodically changed its location along a circular perimeter. Crucially, they had to maintain this visuospatial tempo in the absence of movements. Our results show that the probability of remaining in synchrony with the rhythm decreased, and the variability in the timing estimates increased, as a function of elapsed time, and these trends were well described by the generalized law of Weber. Additionally, the pattern of errors shows that human subjects tended to lag behind fast rhythms and to get ahead of slow ones, suggesting that a mean tempo might be incorporated as prior information. Overall, our results demonstrate that rhythm perception and maintenance are cognitive abilities that we share with rhesus monkeys, and these abilities do not depend on overt motor commands.

Temporal Processing by Intrinsic Neural Network Dynamics

It is becoming more apparent that there are rich contributions to temporal processing across the brain. Temporal dynamics have been found from lower brain structures all the way to cortical regions. Specifically,in vitrocortical preparations have been extremely useful in understanding how local circuits can time. While many of these results depict vastly different processing than a traditional central clock metaphor they still leave questions as to how this information is integrated. We therefore review evidence to place the results pertaining to local circuit timers into the larger context of temporal perception and generalization.

Sensory Re-education Today and Tomorrow: A Review of Evolving Concepts

Following surgical repair of major nerve trunks there is a rapid functional reorganisation in the brain, characterised by a changed cortical mapping of the hand secondary to incorrect reinnervation of peripheral targets. Sensory re-educational programmes are used in the rehabilitation phase to facilitate and positively influence the re-learning process, which is required to make possible an adaptation to the new synaptic organisation and to improve the recovery of functional sensibility - tactile gnosis. However, the outcome is often disappointing, especially in adults. The design of sensory re-education programmes has not changed for several decades. The purpose of this paper is to review evolving concepts in neuroscience and cognitive science, present a rationale for a modified approach to classic sensory re-education, and suggest new strategies for enhanced sensory re-learning following nerve repair.

The Crossed-Hands Deficit in Tactile Temporal-Order Judgments: The Effect of Training

Several recent studies have shown that judgments of temporal order for tactile stimuli presented to the two hands are greatly affected by crossing the hands. The size of the threshold for judging temporal order may be up to four times larger with the hands crossed as compared to the hands uncrossed. The results from these recent studies suggest that with crossed hands, contrary to many situations involving the integration of tactile and proprioceptive information, subjects have difficulty in adjusting their perception of tactile inputs to correspond with the spatial positions of the hands. In the present study we examined the effect of training in judging temporal order on the size of this crossed-hands deficit—the difference in the thresholds for temporal-order judgments when the hands are crossed and uncrossed. All training procedures produced significant declines in the size of the deficit. With training, the difference between crossed-hands and uncrossed-hands temporal-order thresholds dropped from several hundred milliseconds to as little as 19 ms. A group of percussionists with experience in playing with crossed hands showed the same crossed-hands effects as non-musicians. The results were consistent in showing that the crossed-hands deficit was never completely eliminated but was greatly reduced with training. The implication is that subjects are able to adjust to the crossed-hands posture with modest amounts of training. The results are discussed in terms of the explanations that have been offered for the crossed-hands deficit.

Neuronal responses to tactile stimuli and tactile sensations evoked by microstimulation in the human thalamic principal somatic sensory nucleus (ventral caudal)

The normal organization and plasticity of the cutaneous core of the thalamic principal somatosensory nucleus (ventral caudal, Vc) have been studied by single-neuron recordings and microstimulation in patients undergoing awake stereotactic operations for essential tremor (ET) without apparent somatic sensory abnormality and in patients with dystonia or chronic pain secondary to major nervous system injury. In patients with ET, most Vc neurons responded to one of the four stimuli, each of which optimally activates one mechanoreceptor type. Sensations evoked by microstimulation were similar to those evoked by the optimal stimulus only among rapidly adapting neurons. In patients with ET, Vc was highly segmented somatotopically, and vibration, movement, pressure, and sharp sensations were usually evoked by microstimulation at separate sites in Vc. In patients with conditions including spinal cord transection, amputation, or dystonia, RFs were mismatched with projected fields more commonly than in patients with ET. The representation of the border of the anesthetic area (e.g., stump) or of the dystonic limb was much larger than that of the same part of the body in patients with ET. This review describes the organization and reorganization of human Vc neuronal activity in nervous system injury and dystonia and then proposes basic mechanisms.

Generalization of multisensory perceptual learning

Life in a multisensory world requires the rapid and accurate integration of stimuli across the different senses. In this process, the temporal relationship between stimuli is critical in determining which stimuli share a common origin. Numerous studies have described a multisensory temporal binding window—the time window within which audiovisual stimuli are likely to be perceptually bound. In addition to characterizing this window’s size, recent work has shown it to be malleable, with the capacity for substantial narrowing following perceptual training. However, the generalization of these effects to other measures of perception is not known. This question was examined by characterizing the ability of training on a simultaneity judgment task to influence perception of the temporally-dependent sound-induced flash illusion (SIFI). Results do not demonstrate a change in performance on the SIFI itself following training. However, data do show an improved ability to discriminate rapidly-presented two-flash control conditions following training. Effects were specific to training and scaled with the degree of temporal window narrowing exhibited. Results do not support generalization of multisensory perceptual learning to other multisensory tasks. However, results do show that training results in improvements in visual temporal acuity, suggesting a generalization effect of multisensory training on unisensory abilities.

Transfer of tactile perceptual learning to untrained neighboring fingers reflects natural use relationships

Tactile learning transfers from trained to untrained fingers in a pattern that reflects overlap between the representations of fingers in the somatosensory system (e.g., neurons with multifinger receptive fields). While physical proximity on the body is known to determine the topography of somatosensory representations, tactile coactivation is also an established organizing principle of somatosensory topography. In this study we investigated whether tactile coactivation, induced by habitual inter-finger cooperative use (use pattern), shapes inter-finger overlap. To this end, we used psychophysics to compare the transfer of tactile learning from the middle finger to its adjacent fingers. This allowed us to compare transfer to two fingers that are both physically and cortically adjacent to the middle finger but have differing use patterns. Specifically, the middle finger is used more frequently with the ring than with the index finger. We predicted this should lead to greater representational overlap between the former than the latter pair. Furthermore, this difference in overlap should be reflected in differential learning transfer from the middle to index vs. ring fingers. Subsequently, we predicted temporary learning-related changes in the middle finger's representation (e.g., cortical magnification) would cause transient interference in perceptual thresholds of the ring, but not the index, finger. Supporting this, longitudinal analysis revealed a divergence where learning transfer was fast to the index finger but relatively delayed to the ring finger. Our results support the theory that tactile coactivation patterns between digits affect their topographic relationships. Our findings emphasize how action shapes perception and somatosensory organization.

How modality specific is processing of auditory and visual rhythms?

The present study used ERPs to test the extent to which temporal processing is modality specific or modality general. Participants were presented with auditory and visual temporal patterns that consisted of initial two- or three-event beginning patterns. This delineated a constant standard time interval, followed by a two-event ending pattern delineating a variable test interval. Participants judged whether they perceived the pattern as a whole to be speeding up or slowing down. The contingent negative variation (CNV), a negative potential reflecting temporal expectancy, showed a larger amplitude for the auditory modality compared to the visual modality but a high degree of similarity in scalp voltage patterns across modalities, suggesting that the CNV arises from modality-general processes. A late, memory-dependent positive component (P3) also showed similar patterns across modalities.

Visual duration aftereffect is position invariant

Adaptation to relatively long or short sensory events leads to a negative aftereffect, such that the durations of the subsequent events within a certain range appear to be contracted or expanded. The distortion in perceived duration is presumed to arise from the adaptation of duration detectors. Here, we focus on the positional sensitivity of those visual duration detectors by exploring whether the duration aftereffect may be constrained by the visual location of stimuli. We adopted two different paradigms, one that tests for transfer across visual hemifields, and the other that tests for simultaneous selectivity between visual hemifields. By employing these experimental designs, we show that the duration aftereffect strongly transfers across visual hemifields and is not contingent on them. The lack of position specificity suggests that duration detectors in the visual system may operate at a relatively later stage of sensory processing.

Time Adaptation Shows Duration Selectivity in the Human Parietal Cortex

Although psychological and computational models of time estimation have postulated the existence of neural representations tuned for specific durations, empirical evidence of this notion has been lacking. Here, using a functional magnetic resonance imaging (fMRI) adaptation paradigm, we show that the inferior parietal lobule (IPL) (corresponding to the supramarginal gyrus) exhibited reduction in neural activity due to adaptation when a visual stimulus of the same duration was repeatedly presented. Adaptation was strongest when stimuli of identical durations were repeated, and it gradually decreased as the difference between the reference and test durations increased. This tuning property generalized across a broad range of durations, indicating the presence of general time-representation mechanisms in the IPL. Furthermore, adaptation was observed irrespective of the subject’s attention to time. Repetition of a nontemporal aspect of the stimulus (i.e., shape) did not produce neural adaptation in the IPL. These results provide neural evidence for duration-tuned representations in the human brain.

A series of functional magnetic resonance imaging (fMRI) adaptation experiments provide empirical evidence for the existence of neural populations in the human inferior parietal lobule that are tuned to specific durations of time.

The human brain has the ability to estimate the passage of time, which allows us to perform complex cognitive tasks such as playing music, dancing, and understanding speech. Scientists have just begun to understand which brain areas become active when we estimate time. However, it still remains a mystery how exactly the information about time is represented in the brain. In this study, we hypothesized that time might be represented by neurons that are specifically tuned to a specific duration, as has been known for simple visual features such as the orientation and the motion direction in the visual cortex. To test this idea, we performed multiple functional magnetic resonance imaging (fMRI) adaptation experiments in which we sought evidence of neuronal adaptation, that is, a reduction in the responsiveness of neurons to repeated presentations of similar durations. Our experiments revealed that the level of brain activity in the right inferior parietal lobule (IPL) was strongly reduced when a stimulus of the same duration was repeatedly presented. This finding was reproduced for a range of subsecond durations. Our results indicate that neurons in the human IPL are tuned to specific preferred durations.

Context-Dependent Duration Signals in the Primate Prefrontal Cortex

The activity of some prefrontal (PF) cortex neurons distinguishes short from long time intervals. Here, we examined whether this property reflected a general timing mechanism or one dependent on behavioral context. In one task, monkeys discriminated the relative duration of 2 stimuli; in the other, they discriminated the relative distance of 2 stimuli from a fixed reference point. Both tasks had a pre-cue period (interval 1) and a delay period (interval 2) with no discriminant stimulus. Interval 1 elapsed before the presentation of the first discriminant stimulus, and interval 2 began after that stimulus. Both intervals had durations of either 400 or 800 ms. Most PF neurons distinguished short from long durations in one task or interval, but not in the others. When neurons did signal something about duration for both intervals, they did so in an uncorrelated or weakly correlated manner. These results demonstrate a high degree of context dependency in PF time processing. The PF, therefore, does not appear to signal durations abstractedly, as would be expected of a general temporal encoder, but instead does so in a highly context-dependent manner, both within and between tasks.

Percept of the duration of a vibrotactile stimulus is altered by changing its amplitude

There have been numerous studies conducted on time perception. However, very few of these have involved tactile stimuli to assess a subject’s capacity for duration discrimination. Previous optical imaging studies in non-human primates demonstrated that increasing the duration of a vibrotactile stimulus resulted in a consistently longer and more well defined evoked SI cortical response. Additionally, and perhaps more interestingly, increasing the amplitude of a vibrotactile stimulus not only evoked a larger magnitude optical intrinsic signal (OIS), but the return to baseline of the evoked response was much longer in duration for larger amplitude stimuli. This led the authors to hypothesize that the magnitude of a vibrotactile stimulus could influence the perception of its duration. In order to test this hypothesis, subjects were asked to compare two sets of vibrotactile stimuli. When vibrotactile stimuli differed only in duration, subjects typically had a difference limen (DL) of approximately 13%, and this followed Weber’s Law for standards between 500 and 1500 ms, as increasing the value of the standard yielded a proportional increase in DL. However, the percept of duration was impacted by variations in amplitude of the vibrotactile stimuli. Specifically, increasing the amplitude of the standard stimulus had the effect of increasing the DL, while increasing the amplitude of the test stimulus had the effect of decreasing the DL. A pilot study, conducted on individuals who were concussed, found that increasing the amplitude of the standard did not have an impact on the DL of this group of individuals. Since this effect did not parallel what was predicted from the optical imaging findings in somatosensory cortex of non-human primates, the authors suggest that this particular measure or observation could be sensitive to neuroinflammation and that neuron-glial interactions, impacted by concussion, could have the effect of ignoring, or not integrating, the increased amplitude.

Finding the beat: a neural perspective across humans and non-human primates

Humans possess an ability to perceive and synchronize movements to the beat in music ('beat perception and synchronization'), and recent neuroscientific data have offered new insights into this beat-finding capacity at multiple neural levels. Here, we review and compare behavioural and neural data on temporal and sequential processing during beat perception and entrainment tasks in macaques (including direct neural recording and local field potential (LFP)) and humans (including fMRI, EEG and MEG). These abilities rest upon a distributed set of circuits that include the motor cortico-basal-ganglia-thalamo-cortical (mCBGT) circuit, where the supplementary motor cortex (SMA) and the putamen are critical cortical and subcortical nodes, respectively. In addition, a cortical loop between motor and auditory areas, connected through delta and beta oscillatory activity, is deeply involved in these behaviours, with motor regions providing the predictive timing needed for the perception of, and entrainment to, musical rhythms. The neural discharge rate and the LFP oscillatory activity in the gamma- and beta-bands in the putamen and SMA of monkeys are tuned to the duration of intervals produced during a beat synchronization-continuation task (SCT). Hence, the tempo during beat synchronization is represented by different interval-tuned cells that are activated depending on the produced interval. In addition, cells in these areas are tuned to the serial-order elements of the SCT. Thus, the underpinnings of beat synchronization are intrinsically linked to the dynamics of cell populations tuned for duration and serial order throughout the mCBGT. We suggest that a cross-species comparison of behaviours and the neural circuits supporting them sets the stage for a new generation of neurally grounded computational models for beat perception and synchronization.

Shared timing variability in eye and finger movements increases with interval duration: Support for a distributed timing system below and above one second

The origins of the ability to produce action at will at the hundreds of millisecond to second range remain poorly understood. A central issue is whether such timing is governed by one mechanism or by several different mechanisms, possibly invoked by different effectors used to perform the timing task. If two effectors invoke similar timing mechanisms, then they should both produce similar variability increase with interval duration (interonset interval) and thus adhere to Weber's law (increasing linearly with the duration of the interval to be timed). Additionally, if both effectors invoke the same timing mechanism, the variability of the effectors should be highly correlated across participants. To test these possibilities, we assessed the behavioural characteristics across fingers and eyes as effectors and compared the timing variability between and within them as a function of the interval to be produced (interresponse interval). Sixty participants produced isochronous intervals from 524 to 1431 ms with their fingers and their eyes. High correlations within each effector indicated consistent performance within participants. Consistent with a single mechanism, temporal variability in both fingers and eyes followed Weber's law, and significant correlations between eye and finger variability were found for several intervals. These results can support neither the single clock nor the multiple clock hypotheses but instead suggest a partially overlapping distributed timing system.

Rhythmic complexity and predictive coding: a novel approach to modeling rhythm and meter perception in music

Musical rhythm, consisting of apparently abstract intervals of accented temporal events, has a remarkable capacity to move our minds and bodies. How does the cognitive system enable our experiences of rhythmically complex music? In this paper, we describe some common forms of rhythmic complexity in music and propose the theory of predictive coding (PC) as a framework for understanding how rhythm and rhythmic complexity are processed in the brain. We also consider why we feel so compelled by rhythmic tension in music. First, we consider theories of rhythm and meter perception, which provide hierarchical and computational approaches to modeling. Second, we present the theory of PC, which posits a hierarchical organization of brain responses reflecting fundamental, survival-related mechanisms associated with predicting future events. According to this theory, perception and learning is manifested through the brain’s Bayesian minimization of the error between the input to the brain and the brain’s prior expectations. Third, we develop a PC model of musical rhythm, in which rhythm perception is conceptualized as an interaction between what is heard (“rhythm”) and the brain’s anticipatory structuring of music (“meter”). Finally, we review empirical studies of the neural and behavioral effects of syncopation, polyrhythm and groove, and propose how these studies can be seen as special cases of the PC theory. We argue that musical rhythm exploits the brain’s general principles of prediction and propose that pleasure and desire for sensorimotor synchronization from musical rhythm may be a result of such mechanisms.