Effects of hearing the past, present, or future during music performance

Body motion of choral singers

Recent investigations on music performances have shown the relevance of singers' body motion for pedagogical as well as performance purposes. However, little is known about how the perception of voice-matching or task complexity affects choristers' body motion during ensemble singing. This study focussed on the body motion of choral singers who perform in duo along with a pre-recorded tune presented over a loudspeaker. Specifically, we examined the effects of the perception of voice-matching, operationalized in terms of sound spectral envelope, and task complexity on choristers' body motion. Fifteen singers with advanced choral experience first manipulated the spectral components of a pre-recorded short tune composed for the study, by choosing the settings they felt most and least together with. Then, they performed the tune in unison (i.e., singing the same melody simultaneously) and in canon (i.e., singing the same melody but at a temporal delay) with the chosen filter settings. Motion data of the choristers' upper body and audio of the repeated performances were collected and analyzed. Results show that the settings perceived as least together relate to extreme differences between the spectral components of the sound. The singers' wrists and torso motion was more periodic, their upper body posture was more open, and their bodies were more distant from the music stand when singing in unison than in canon. These findings suggest that unison singing promotes an expressive-periodic motion of the upper body.

The role of auditory feedback in the motor learning of music in experienced and novice performers

Musical learning is related to the development of audio-visuomotor associations linking gestures with musical sounds. To study the role of auditory feedback in learning, 115 students (56 guitarists, 59 pianists) at the beginner, intermediate and advanced levels were recruited. Playing with sound (audio-motor feedback), mute practice (motor feedback), and piece listening (auditory feedback) were compared to first sight reading to assess the role of auditory and motor feedback in procedural learning. The procedure consisted of the execution of a standard piece for determining the students' level and 4 further music executions (every week for 4 weeks), preceded by different practice conditions (for 12 min, once a day, for 5 days). Real musical pieces (e.g., Segovia, Schubert, Bartók) were used. Performance evaluation focused on four macro-categories: note, rhythm, dynamics and smoothness. For both instruments, first-sight reading (A - M -) was associated with the worst performance: silent motor practice (A - M +) resulted in learning the rhythmic structure of the piece and in a smoother performance. Listening to pieces (A + M -) resulted in learning the agogics and in improving articulation and smoothness. Listening during performance (A + M +) resulted in fewer intonation errors. Interestingly, auditory feedback was more relevant for beginners than for advanced students, as evidenced by the greater benefits of listening during practice.

The prevalence of the Val66Met polymorphism in musicians: Possible evidence for compensatory neuroplasticity from a pilot study

The study compared the prevalence of the Val66Met Brain-derived Neurotrophic Factor single nucleotide polymorphism (rs6265) in a sample of musicians (N = 50) to an ethnically matched general population sample from the 1000 Human Genome Project (N = 424). Met-carriers of the polymorphism (Val/Met and Met/Met genotypes) are typically present in 25–30% of the general population and have associated deficits in motor learning and plasticity. Many studies have assessed the benefits of long-term music training for neuroplasticity and motor learning. This study takes a unique genetic approach investigating if the prevalence of the Val66Met BDNF polymorphism, which negatively affects motor learning, is significantly different in musicians from the general population. Our genotype and allele frequency analyses revealed that the distribution of the Val66Met polymorphism was not significantly different in musicians versus the general population (p = 0.6447 for genotype analysis and p = 0.8513 allele analysis). In the Musician sample (N = 50), the prevalence of the Val/Met genotype was 40% and the prevalence of the Met/Met genotype was 2%. In the 1000 Human Genome Project subset (N = 424), the prevalence of Val/Met was 33.25% and the Met/Met genotype prevalence was 4%. Therefore, musicians do exist with the Val66Met polymorphism and the characteristics of long-term music training may compensate for genetic predisposition to motor learning deficits. Since the polymorphism has significant implications for stroke rehabilitation, future studies may consider the implications of the polymorphism in music-based interventions such as Neurologic Music Therapy.

Precise force controls enhance loudness discrimination of self-generated sound

Motor executions alter sensory processes. Studies have shown that loudness perception changes when a sound is generated by active movement. However, it is still unknown where and how the motor-related changes in loudness perception depend on the task demand of motor execution. We examined whether different levels of precision demands in motor control affects loudness perception. We carried out a loudness discrimination test, in which the sound stimulus was produced in conjunction with the force generation task. We tested three target force amplitude levels. The force target was presented on a monitor as a fixed visual target. The generated force was also presented on the same monitor as a movement of the visual cursor. Participants adjusted their force amplitude in a predetermined range without overshooting using these visual targets and moving cursor. In the control condition, the sound and visual stimuli were generated externally (without a force generation task). We found that the discrimination performance was significantly improved when the sound was produced by the force generation task compared to the control condition, in which the sound was produced externally, although we did not find that this improvement in discrimination performance changed depending on the different target force amplitude levels. The results suggest that the demand for precise control to produce a fixed amount of force may be key to obtaining the facilitatory effect of motor execution in auditory processes.

On the generalization of tones: A detailed exploration of non-speech auditory perception stimuli

The dynamic changes in natural sounds’ temporal structures convey important event-relevant information. However, prominent researchers have previously expressed concern that non-speech auditory perception research disproportionately uses simplistic stimuli lacking the temporal variation found in natural sounds. A growing body of work now demonstrates that some conclusions and models derived from experiments using simplistic tones fail to generalize, raising important questions about the types of stimuli used to assess the auditory system. To explore the issue empirically, we conducted a novel, large-scale survey of non-speech auditory perception research from four prominent journals. A detailed analysis of 1017 experiments from 443 articles reveals that 89% of stimuli employ amplitude envelopes lacking the dynamic variations characteristic of non-speech sounds heard outside the laboratory. Given differences in task outcomes and even the underlying perceptual strategies evoked by dynamic vs. invariant amplitude envelopes, this raises important questions of broad relevance to psychologists and neuroscientists alike. This lack of exploration of a property increasingly recognized as playing a crucial role in perception suggests future research using stimuli with time-varying amplitude envelopes holds significant potential for furthering our understanding of the auditory system’s basic processing capabilities.

Spatiotemporal perturbations in paced finger tapping suggest a common mechanism for the processing of time errors

Paced finger tapping is a sensorimotor synchronization task where a subject has to keep pace with a metronome while the time differences (asynchronies) between each stimulus and its response are recorded. A usual way to study the underlying error correction mechanism is to perform unexpected temporal perturbations to the stimuli sequence. An overlooked issue is that at the moment of a temporal perturbation two things change: the stimuli period (a parameter) and the asynchrony (a variable). In terms of experimental manipulation, it would be desirable to have separate, independent control of parameter and variable values. In this work we perform paced finger tapping experiments combining simple temporal perturbations (tempo step change) and spatial perturbations with temporal effect (raised or lowered point of contact). In this way we decouple the parameter-and-variable confounding, performing novel perturbations where either the parameter or the variable changes. Our results show nonlinear features like asymmetry and are compatible with a common error correction mechanism for all types of asynchronies. We suggest taking this confounding into account when analyzing perturbations of any kind in finger tapping tasks but also in other areas of sensorimotor synchronization, like music performance experiments and paced walking in gait coordination studies.

Tonal and textural influences on musical sight-reading

Two experiments investigated the impact of two structural factors-musical tonality and musical texture-on pianists' ability to play by sight without prior preparation, known as musical sight-reading. Tonality refers to the cognitive organization of tones around a central reference pitch, whereas texture refers to the organization of music in terms of the simultaneous versus successive onsets of tones as well as the number of hands (unimanual versus bimanual) involved in performance. Both experiments demonstrated that tonality and texture influenced sight-reading. For tonality, both studies found that errors in performance increased for passages with lesser perceived psychological stability (i.e., minor and atonal passages) relative to greater perceived stability (i.e., major passages). For texture, both studies found that errors in performance increased for passages that were more texturally complex, requiring two-handed versus one-handed performance, with some additional evidence that the relative simultaneity of note onsets (primarily simultaneous versus primarily successive) also influenced errors. These experiments are interpreted within a perception-action framework of music performance, highlighting influences of both top-down cognitive factors and bottom-up motoric processes on sight-reading behavior.

Ears, heads, and eyes: When singers synchronise

We examined the relationship between endogenous rhythms, auditory and visual cues, and body movement in the temporal coordination of duet singers. Sixteen pairs of experienced vocalists sang a familiar melody in Solo and two Duet conditions. Vocalists sang together in Unison (simultaneously producing identical pitches) and Round Duet conditions (one vocalist, the Follower, producing pitches at an eight-tone delay from their partner, the Leader) while facing Inward (full visual cues) and Outward (reduced visual cues). Larger tempo differences in partners' spontaneous (temporally unconstrained) Solo performances were associated with larger asynchrony in Duet performances, consistent with coupling predictions for oscillators with similar natural frequencies. Vocalists were slightly but consistently more synchronous in Duets when facing their partner (Inward) than when facing Outward; Unison and Round performances were equally synchronous. The greater difficulty of Rounds production was evidenced in vocalists' slower performance rates and more variable head movements; Followers directed their head gaze away from their partner and used bobbing head movements to mark the musical beat. The strength of Followers' head movements corresponded to the amount of tone onset asynchrony with their partners, indicating a strong association between timing and movement under increased attentional and working memory demands in music performance.

Electrical Brain Responses Reveal Sequential Constraints on Planning during Music Performance

Elements in speech and music unfold sequentially over time. To produce sentences and melodies quickly and accurately, individuals must plan upcoming sequence events, as well as monitor outcomes via auditory feedback. We investigated the neural correlates of sequential planning and monitoring processes by manipulating auditory feedback during music performance. Pianists performed isochronous melodies from memory at an initially cued rate while their electroencephalogram was recorded. Pitch feedback was occasionally altered to match either an immediately upcoming Near-Future pitch (next sequence event) or a more distant Far-Future pitch (two events ahead of the current event). Near-Future, but not Far-Future altered feedback perturbed the timing of pianists' performances, suggesting greater interference of Near-Future sequential events with current planning processes. Near-Future feedback triggered a greater reduction in auditory sensory suppression (enhanced response) than Far-Future feedback, reflected in the P2 component elicited by the pitch event following the unexpected pitch change. Greater timing perturbations were associated with enhanced cortical sensory processing of the pitch event following the Near-Future altered feedback. Both types of feedback alterations elicited feedback-related negativity (FRN) and P3a potentials and amplified spectral power in the theta frequency range. These findings suggest similar constraints on producers' sequential planning to those reported in speech production.

Effect of Instrument Structure Alterations on Violin Performance

Extensive training with a musical instrument results in the automatization of the bodily operations needed to manipulate the instrument: the performer no longer has to consciously think about the instrument while playing. The ability of the performer to automate operations on the instrument is due to sensorimotor mechanisms that can predict changes in the state of the body and the instrument in response to motor commands. But how strong are these mechanisms? To what extent can we alter the structure of the instrument before they disappear? We performed an exploratory study to understand whether and how sensorimotor predictions survive instrument modification. We asked seven professional violinists to perform repertoire pieces and sight-reading exercises on four different violins: their own, a cheap violin, a small violin, and a violin whose strings had been put on in reverse order. We performed a series of quantitative investigations on performance intonation and duration, and on bowing gestures and errors. The analysis revealed that participants struggled adapting to the altered instruments, suggesting that prediction mechanisms are a function of instrument configuration. In particular, the analysis of bowing errors, intonation, and of performance duration suggested that the performance with the reverse violin was much less fluent and precise than the performer's own instrument; the performance with the small violin was also sub-standard though to a lesser extent. We also observed that violinists were differently affected by instrument modifications, suggesting that the capability to adapt to a new instrument is highly personal.

Musical training induces functional and structural auditory-motor network plasticity in young adults

Playing music requires a strong coupling of perception and action mediated by multimodal integration of brain regions, which can be described as network connections measured by anatomical and functional correlations between regions. However, the structural and functional connectivities within and between the auditory and sensorimotor networks after long-term musical training remain largely uninvestigated. Here, we compared the structural connectivity (SC) and resting-state functional connectivity (rs-FC) within and between the two networks in 29 novice healthy young adults before and after musical training (piano) with those of another 27 novice participants who were evaluated longitudinally but with no intervention. In addition, a correlation analysis was performed between the changes in FC or SC with practice time in the training group. As expected, participants in the training group showed increased FC within the sensorimotor network and increased FC and SC of the auditory-motor network after musical training. Interestingly, we further found that the changes in FC within the sensorimotor network and SC of the auditory-motor network were positively correlated with practice time. Our results indicate that musical training could induce enhanced local interaction and global integration between musical performance-related regions, which provides insights into the mechanism of brain plasticity in young adults.

Cingulate and cerebellar beta oscillations are engaged in the acquisition of auditory-motor sequences

Singing, music performance, and speech rely on the retrieval of complex sounds, which are generated by the corresponding actions and are organized into sequences. It is crucial in these forms of behavior that the serial organization (i.e., order) of both the actions and associated sounds be monitored and learned. To investigate the neural processes involved in the monitoring of serial order during the initial learning of sensorimotor sequences, we performed magnetoencephalographic recordings while participants explicitly learned short piano sequences under the effect of occasional alterations of auditory feedback (AAF). The main result was a prominent and selective modulation of beta (13-30 Hz) oscillations in cingulate and cerebellar regions during the processing of AAF that simulated serial order errors. Furthermore, the AAF-induced modulation of beta oscillations was associated with higher error rates, reflecting compensatory changes in sequence planning. This suggests that cingulate and cerebellar beta oscillations play a role in tracking serial order during initial sensorimotor learning and in updating the mapping of the sensorimotor representations. The findings support the notion that the modulation of beta oscillations is a candidate mechanism for the integration of sequential motor and auditory information during an early stage of skill acquisition in music performance. This has potential implications for singing and speech. Hum Brain Mapp 38:5161-5179, 2017. © 2017 Wiley Periodicals, Inc.

Beta phase synchronization in the frontal-temporal-cerebellar network during auditory-to-motor rhythm learning

Rhythm is an essential element of dancing and music. To investigate the neural mechanisms underlying how rhythm is learned, we recorded electroencephalographic (EEG) data during a rhythm-reproducing task that asked participants to memorize an auditory stimulus and reproduce it via tapping. Based on the behavioral results, we divided the participants into Learning and No-learning groups. EEG analysis showed that error-related negativity (ERN) in the Learning group was larger than in the No-learning group. Time-frequency analysis of the EEG data showed that the beta power in right and left temporal area at the late learning stage was smaller than at the early learning stage in the Learning group. Additionally, the beta power in the temporal and cerebellar areas in the Learning group when learning to reproduce the rhythm were larger than in the No Learning group. Moreover, phase synchronization between frontal and temporal regions and between temporal and cerebellar regions at late stages of learning were larger than at early stages. These results indicate that the frontal-temporal-cerebellar beta neural circuits might be related to auditory-motor rhythm learning.

Auditory N1 reveals planning and monitoring processes during music performance

The current study investigated the relationship between planning processes and feedback monitoring during music performance, a complex task in which performers prepare upcoming events while monitoring their sensory outcomes. Theories of action planning in auditory-motor production tasks propose that the planning of future events co-occurs with the perception of auditory feedback. This study investigated the neural correlates of planning and feedback monitoring by manipulating the contents of auditory feedback during music performance. Pianists memorized and performed melodies at a cued tempo in a synchronization-continuation task while the EEG was recorded. During performance, auditory feedback associated with single melody tones was occasionally substituted with tones corresponding to future (next), present (current), or past (previous) melody tones. Only future-oriented altered feedback disrupted behavior: Future-oriented feedback caused pianists to slow down on the subsequent tone more than past-oriented feedback, and amplitudes of the auditory N1 potential elicited by the tone immediately following the altered feedback were larger for future-oriented than for past-oriented or noncontextual (unrelated) altered feedback; larger N1 amplitudes were associated with greater slowing following altered feedback in the future condition only. Feedback-related negativities were elicited in all altered feedback conditions. In sum, behavioral and neural evidence suggests that future-oriented feedback disrupts performance more than past-oriented feedback, consistent with planning theories that posit similarity-based interference between feedback and planning contents. Neural sensory processing of auditory feedback, reflected in the N1 ERP, may serve as a marker for temporal disruption caused by altered auditory feedback in auditory-motor production tasks.

An Adapting Auditory-motor Feedback Loop Can Contribute to Generating Vocal Repetition

Consecutive repetition of actions is common in behavioral sequences. Although integration of sensory feedback with internal motor programs is important for sequence generation, if and how feedback contributes to repetitive actions is poorly understood. Here we study how auditory feedback contributes to generating repetitive syllable sequences in songbirds. We propose that auditory signals provide positive feedback to ongoing motor commands, but this influence decays as feedback weakens from response adaptation during syllable repetitions. Computational models show that this mechanism explains repeat distributions observed in Bengalese finch song. We experimentally confirmed two predictions of this mechanism in Bengalese finches: removal of auditory feedback by deafening reduces syllable repetitions; and neural responses to auditory playback of repeated syllable sequences gradually adapt in sensory-motor nucleus HVC. Together, our results implicate a positive auditory-feedback loop with adaptation in generating repetitive vocalizations, and suggest sensory adaptation is important for feedback control of motor sequences.

Repetitions are common in animal vocalizations. Songs of many songbirds contain syllables that repeat a variable number of times, with non-Markovian distributions of repeat counts. The neural mechanism underlying such syllable repetitions is unknown. In this work, we show that auditory feedback plays an important role in sustaining syllable repetitions in the Bengalese finch. Deafening reduces syllable repetitions and skews the repeat number distribution towards short repeats. These effects are explained with our computational model, which suggests that syllable repeats are initially sustained by auditory feedback to the neural networks that drive the syllable production. The feedback strength weakens as the syllable repeats, increasing the likelihood that the syllable repetition stops. Neural recordings confirm such adaptation of auditory feedback to the auditory-motor circuit in the Bengalese finch. Our results suggests that sensory feedback can directly impact repetitions in motor sequences, and may provide insights into neural mechanisms of speech disorders such as stuttering.

Temporal coordination in joint music performance: effects of endogenous rhythms and auditory feedback

Many behaviors require that individuals coordinate the timing of their actions with others. The current study investigated the role of two factors in temporal coordination of joint music performance: differences in partners’ spontaneous (uncued) rate and auditory feedback generated by oneself and one’s partner. Pianists performed melodies independently (in a Solo condition), and with a partner (in a duet condition), either at the same time as a partner (Unison), or at a temporal offset (Round), such that pianists heard their partner produce a serially shifted copy of their own sequence. Access to self-produced auditory information during duet performance was manipulated as well: Performers heard either full auditory feedback (Full), or only feedback from their partner (Other). Larger differences in partners’ spontaneous rates of Solo performances were associated with larger asynchronies (less effective synchronization) during duet performance. Auditory feedback also influenced temporal coordination of duet performance: Pianists were more coordinated (smaller tone onset asynchronies and more mutual adaptation) during duet performances when self-generated auditory feedback aligned with partner-generated feedback (Unison) than when it did not (Round). Removal of self-feedback disrupted coordination (larger tone onset asynchronies) during Round performances only. Together, findings suggest that differences in partners’ spontaneous rates of Solo performances, as well as differences in self- and partner-generated auditory feedback, influence temporal coordination of joint sensorimotor behaviors.

A conceptual review on action-perception coupling in the musicians' brain: what is it good for?

Experience with a sensorimotor task, such as practicing a piano piece, leads to strong coupling of sensory (visual or auditory) and motor cortices. Here we review behavioral and neurophysiological (M/EEG, TMS and fMRI) research exploring this topic using the brain of musicians as a model system. Our review focuses on a recent body of evidence suggesting that this form of coupling might have (at least) two cognitive functions. First, it leads to the generation of equivalent predictions (concerning both when and what event is more likely to occur) during both perception and production of music. Second, it underpins the common coding of perception and action that supports the integration of the motor output of multiple musicians’ in the context of joint musical tasks. Essentially, training-based coupling of perception and action might scaffold the human ability to represent complex (structured) actions and to entrain multiple agents—via reciprocal prediction and adaptation—in the pursuit of shared goals.

Making and monitoring errors based on altered auditory feedback

Previous research has demonstrated that altered auditory feedback (AAF) disrupts music performance and causes disruptions in both action planning and the perception of feedback events. It has been proposed that this disruption occurs because of interference within a shared representation for perception and action (Pfordresher, 2006). Studies reported here address this claim from the standpoint of error monitoring. In Experiment 1 participants performed short melodies on a keyboard while hearing no auditory feedback, normal auditory feedback, or alterations to feedback pitch on some subset of events. Participants overestimated error frequency when AAF was present but not for normal feedback. Experiment 2 introduced a concurrent load task to determine whether error monitoring requires executive resources. Although the concurrent task enhanced the effect of AAF, it did not alter participants' tendency to overestimate errors when AAF was present. A third correlational study addressed whether effects of AAF are reduced for a subset of the population who may lack the kind of perception/action associations that lead to AAF disruption: poor-pitch singers. Effects of manipulations similar to those presented in Experiments 1 and 2 were reduced for these individuals. We propose that these results are consistent with the notion that AAF interference is based on associations between perception and action within a forward internal model of auditory-motor relationships.

Auditory and motor imagery modulate learning in music performance

Skilled performers such as athletes or musicians can improve their performance by imagining the actions or sensory outcomes associated with their skill. Performers vary widely in their auditory and motor imagery abilities, and these individual differences influence sensorimotor learning. It is unknown whether imagery abilities influence both memory encoding and retrieval. We examined how auditory and motor imagery abilities influence musicians' encoding (during Learning, as they practiced novel melodies), and retrieval (during Recall of those melodies). Pianists learned melodies by listening without performing (auditory learning) or performing without sound (motor learning); following Learning, pianists performed the melodies from memory with auditory feedback (Recall). During either Learning (Experiment 1) or Recall (Experiment 2), pianists experienced either auditory interference, motor interference, or no interference. Pitch accuracy (percentage of correct pitches produced) and temporal regularity (variability of quarter-note interonset intervals) were measured at Recall. Independent tests measured auditory and motor imagery skills. Pianists' pitch accuracy was higher following auditory learning than following motor learning and lower in motor interference conditions (Experiments 1 and 2). Both auditory and motor imagery skills improved pitch accuracy overall. Auditory imagery skills modulated pitch accuracy encoding (Experiment 1): Higher auditory imagery skill corresponded to higher pitch accuracy following auditory learning with auditory or motor interference, and following motor learning with motor or no interference. These findings suggest that auditory imagery abilities decrease vulnerability to interference and compensate for missing auditory feedback at encoding. Auditory imagery skills also influenced temporal regularity at retrieval (Experiment 2): Higher auditory imagery skill predicted greater temporal regularity during Recall in the presence of auditory interference. Motor imagery aided pitch accuracy overall when interference conditions were manipulated at encoding (Experiment 1) but not at retrieval (Experiment 2). Thus, skilled performers' imagery abilities had distinct influences on encoding and retrieval of musical sequences.

Speed, accuracy, and serial order in sequence production

The production of complex sequences like music or speech requires the rapid and temporally precise production of events (e.g., notes and chords), often at fast rates. Memory retrieval in these circumstances may rely on the simultaneous activation of both the current event and the surrounding context (Lashley, 1951). We describe an extension to a model of incremental retrieval in sequence production (Palmer & Pfordresher, 2003) that incorporates this logic to predict overall error rates and speed-accuracy trade-offs, as well as types of serial ordering errors. The model-assumes that retrieval of the current event is influenced by activations of surrounding events. Activations of surrounding events increase over time, such that both the accessibility of distant events and overall accuracy increases at slower production rates. The model's predictions were tested in an experiment in which pianists performed unfamiliar music at 8 different tempi. Model fits to speed-accuracy data and to serial ordering errors support model predictions. Parameter fits to individual data further suggest that working memory contributes to the retrieval of serial order and overall accuracy is influenced in addition by motor dexterity and domain-specific skill.

Effects of altered auditory feedback across effector systems: production of melodies by keyboard and singing

We report an experiment that tested whether effects of altered auditory feedback (AAF) during piano performance differ from its effects during singing. These effector systems differ with respect to the mapping between motor gestures and pitch content of auditory feedback. Whereas this action-effect mapping is highly reliable during phonation in any vocal motor task (singing or speaking), mapping between finger movements and pitch occurs only in limited situations, such as piano playing. Effects of AAF in both tasks replicated results previously found for keyboard performance (Pfordresher, 2003), in that asynchronous (delayed) feedback slowed timing whereas alterations to feedback pitch increased error rates, and the effect of asynchronous feedback was similar in magnitude across tasks. However, manipulations of feedback pitch had larger effects on singing than on keyboard production, suggesting effector-specific differences in sensitivity to action-effect mapping with respect to feedback content. These results support the view that disruption from AAF is based on abstract, effector independent, response-effect associations but that the strength of associations differs across effector systems.

The experience of agency in sequence production with altered auditory feedback

When speaking or producing music, people rely in part on auditory feedback - the sounds associated with the performed action. Three experiments investigated the degree to which alterations of auditory feedback (AAF) during music performances influence the experience of agency (i.e., the sense that your actions led to auditory events) and the possible link between agency and the disruptive effect of AAF on production. Participants performed short novel melodies from memory on a keyboard. Auditory feedback during performances was manipulated with respect to its pitch contents and/or its synchrony with actions. Participants rated their experience of agency after each trial. In all experiments, AAF reduced judgments of agency across conditions. Performance was most disrupted (measured by error rates and slowing) when AAF led to an ambiguous experience of agency, suggesting that there may be some causal relationship between agency and disruption. However, analyses revealed that these two effects were probably independent. A control experiment verified that performers can make veridical judgments of agency.

Activation of learned action sequences by auditory feedback

The present research addressed whether auditory feedback associated with a learned action sequence can activate the action representation of that sequence. Nonpianist participants learned to perform two melodies at a piano keyboard repeatedly during a trial. The participants heard feedback either from the melody they were performing (normal feedback) or from the other learned melody (termed alternate feedback). An additional tone functioned as an instruction cue to either switch melodies or continue the current melody. Following the instruction cues, participants typically paused just before switching, and paused similarly during trials with a continue cue. Participants paused longer after a continue cue when they experienced alternate rather than normal feedback. This effect was specific to instruction cues positioned at weak metrical accents--positions at which participants were less likely to switch overall. Feedback did not influence timing on switch trials. These findings indicate that influences of auditory feedback can activate learned action sequences, leading to longer latencies associated with cue evaluation.

Cortical plasticity induced by short-term multimodal musical rhythm training

Performing music is a multimodal experience involving the visual, auditory, and somatosensory modalities as well as the motor system. Therefore, musical training is an excellent model to study multimodal brain plasticity. Indeed, we have previously shown that short-term piano practice increase the magnetoencephalographic (MEG) response to melodic material in novice players. Here we investigate the impact of piano training using a rhythmic-focused exercise on responses to rhythmic musical material. Musical training with non musicians was conducted over a period of two weeks. One group (sensorimotor-auditory, SA) learned to play a piano sequence with a distinct musical rhythm, another group (auditory, A) listened to, and evaluated the rhythmic accuracy of the performances of the SA-group. Training-induced cortical plasticity was evaluated using MEG, comparing the mismatch negativity (MMN) in response to occasional rhythmic deviants in a repeating rhythm pattern before and after training. The SA-group showed a significantly greater enlargement of MMN and P2 to deviants after training compared to the A- group. The training-induced increase of the rhythm MMN was bilaterally expressed in contrast to our previous finding where the MMN for deviants in the pitch domain showed a larger right than left increase. The results indicate that when auditory experience is strictly controlled during training, involvement of the sensorimotor system and perhaps increased attentional recources that are needed in producing rhythms lead to more robust plastic changes in the auditory cortex compared to when rhythms are simply attended to in the auditory domain in the absence of motor production.

EEG oscillatory patterns are associated with error prediction during music performance and are altered in musician's dystonia

Skilled performance requires the ability to monitor ongoing behavior, detect errors in advance and modify the performance accordingly. The acquisition of fast predictive mechanisms might be possible due to the extensive training characterizing expertise performance. Recent EEG studies on piano performance reported a negative event-related potential (ERP) triggered in the ACC 70 ms before performance errors (pitch errors due to incorrect keypress). This ERP component, termed pre-error related negativity (pre-ERN), was assumed to reflect processes of error detection in advance. However, some questions remained to be addressed: (i) Does the electrophysiological marker prior to errors reflect an error signal itself or is it related instead to the implementation of control mechanisms? (ii) Does the posterior frontomedial cortex (pFMC, including ACC) interact with other brain regions to implement control adjustments following motor prediction of an upcoming error? (iii) Can we gain insight into the electrophysiological correlates of error prediction and control by assessing the local neuronal synchronization and phase interaction among neuronal populations? (iv) Finally, are error detection and control mechanisms defective in pianists with musician's dystonia (MD), a focal task-specific dystonia resulting from dysfunction of the basal ganglia-thalamic-frontal circuits? Consequently, we investigated the EEG oscillatory and phase synchronization correlates of error detection and control during piano performances in healthy pianists and in a group of pianists with MD. In healthy pianists, the main outcomes were increased pre-error theta and beta band oscillations over the pFMC and 13-15 Hz phase synchronization, between the pFMC and the right lateral prefrontal cortex, which predicted corrective mechanisms. In MD patients, the pattern of phase synchronization appeared in a different frequency band (6-8 Hz) and correlated with the severity of the disorder. The present findings shed new light on the neural mechanisms, which might implement motor prediction by means of forward control processes, as they function in healthy pianists and in their altered form in patients with MD.

Cortical plasticity induced by short-term unimodal and multimodal musical training

Learning to play a musical instrument requires complex multimodal skills involving simultaneous perception of several sensory modalities: auditory, visual, somatosensory, as well as the motor system. Therefore, musical training provides a good and adequate neuroscientific model to study multimodal brain plasticity effects in humans. Here, we investigated the impact of short-term unimodal and multimodal musical training on brain plasticity. Two groups of nonmusicians were musically trained over the course of 2 weeks. One group [sensorimotor-auditory (SA)] learned to play a musical sequence on the piano, whereas the other group [auditory (A)] listened to and made judgments about the music that had been played by participants of the sensorimotor-auditory group. Training-induced cortical plasticity was assessed by recording the musically elicited mismatch negativity (MMNm) from magnetoencephalographic measurements before and after training. SA and A groups showed significantly different cortical responses after training. Specifically, the SA group showed significant enlargement of MMNm after training compared with the A group, reflecting greater enhancement of musical representations in auditory cortex after sensorimotor-auditory training compared with after mere auditory training. Thus, we have experimentally demonstrated that not only are sensorimotor and auditory systems connected, but also that sensorimotor-auditory training causes plastic reorganizational changes in the auditory cortex over and above changes introduced by auditory training alone.

Nonconscious control of fundamental voice frequency

The aim of this paper is to answer the question whether "perception-action" dissociation, which is well documented in vision, may also be found in auditory information processing. Trained singers were asked to produce vowel sounds into a microphone. The sound that each singer produced was fed back to their ears via headphones. Two seconds after the sound production had begun, the auditory feedback was shifted in pitch by a certain degree (9, 19, 50, or 99 cents in either direction). In every set of sounds, instances without any pitch shifts also appeared. After each trial, participants reported whether they were aware of a pitch change or not. It was found that even though the participants were unaware of subtle pitch changes, the fundamental frequency of their vowel production was found to shift slightly in the opposite direction to the pitch shift. These results show that auditory information is processed by two separate systems: one for perception and one for action. They also show that the function of the auditory control system differs from the visual control system. The latter is used to control bodily movements while the function of the former is a nonconscious, instant control of vocalization.

When the brain plays music: auditory-motor interactions in music perception and production

Music performance is both a natural human activity, present in all societies, and one of the most complex and demanding cognitive challenges that the human mind can undertake. Unlike most other sensory-motor activities, music performance requires precise timing of several hierarchically organized actions, as well as precise control over pitch interval production, implemented through diverse effectors according to the instrument involved. We review the cognitive neuroscience literature of both motor and auditory domains, highlighting the value of studying interactions between these systems in a musical context, and propose some ideas concerning the role of the premotor cortex in integration of higher order features of music with appropriately timed and organized actions.

Temporal coordination between actions and sound during sequence production

Delayed auditory feedback (DAF) causes asynchronies between perception and action that disrupt sequence production. Different delay lengths cause differing amounts of disruption that may reflect the phase location of feedback onsets relative to produced inter-response intervals, or the absolute temporal separation between actions and sounds. Two experiments addressed this issue by comparing the effects of traditional DAF, which uses a constant temporal separation, with delays that adjust temporal separation to maintain the phase location of feedback onsets within inter-response intervals. Participants played simple isochronous melodies on a keyboard, or tapped an isochronous beat, at three production rates. Disruption was best predicted by the phase location of feedback onsets, and diminished when feedback onsets formed harmonic phase ratios (phase synchrony). Both delay types led to similar effects. Different movement tasks (melody production versus tapping) led to slightly different patterns of disruption across phase that may relate to differing task demands. In general, these results support the view that perception and action are coordinated in relative rather than absolute time.