Action representation of sound: audiomotor recognition network while listening to newly acquired actions

Effects of humanness and gender in voice processing

When we observe a producible human movement, the brain performs a specific perception-action matching process, which possibly facilitates perceptual processing. In this work, we wanted to study whether the producibility of a sound affects the speed at which it is categorized. Participants were presented with isolated sounds, either sung by a natural male or female voice ('producible') or distorted by saturation ('non-producible'), and had to categorize them as produced by a voice or by a machine. We analyzed reaction time variations as a function of the gender and humanness of the voice. Results corroborate the existence of a 'human bias' in auditory perception, and suggest a processing speed asymmetry between natural female and male voices.

Diminished whole-brain but enhanced peri-sylvian connectivity in absolute pitch musicians

Several anatomical studies have identified specific anatomical features within the peri-sylvian brain system of absolute pitch (AP) musicians. In this study we used graph theoretical analysis of cortical thickness covariations (as indirect indicator of connectivity) to examine whether AP musicians differ from relative pitch musicians and nonmusicians in small-world network characteristics. We measured "local connectedness" (local clustering = γ), "global efficiency of information transfer" (path length = λ), "small-worldness" (σ = γ/λ), and "degree" centrality as measures of connectivity. Although all groups demonstrated typical small-world features, AP musicians showed significant small-world alterations. "Degree" as a measure of interconnectedness was globally significantly decreased in AP musicians. These differences let us suggest that AP musicians demonstrate diminished neural integration (less connections) among distant brain regions. In addition, AP musicians demonstrated significantly increased local connectivity in peri-sylvian language areas of which the planum temporale, planum polare, Heschl's gyrus, lateral aspect of the superior temporal gyrus, STS, pars triangularis, and pars opercularis were hub regions. All of these brain areas are known to be involved in higher-order auditory processing, working or semantic memory processes. Taken together, whereas AP musicians demonstrate decreased global interconnectedness, the local connectedness in peri-sylvian brain areas is significantly higher than for relative pitch musicians and nonmusicians.

Searching for roots of entrainment and joint action in early musical interactions

When people play music and dance together, they engage in forms of musical joint action that are often characterized by a shared sense of rhythmic timing and affective state (i.e., temporal and affective entrainment). In order to understand the origins of musical joint action, we propose a model in which entrainment is linked to dual mechanisms (motor resonance and action simulation), which in turn support musical behavior (imitation and complementary joint action). To illustrate this model, we consider two generic forms of joint musical behavior: chorusing and turn-taking. We explore how these common behaviors can be founded on entrainment capacities established early in human development, specifically during musical interactions between infants and their caregivers. If the roots of entrainment are found in early musical interactions which are practiced from childhood into adulthood, then we propose that the rehearsal of advanced musical ensemble skills can be considered to be a refined, mimetic form of temporal and affective entrainment whose evolution begins in infancy.

When Sounds Become Actions: Higher-order Representation of Newly Learned Action Sounds in the Human Motor System

In the absence of visual information, our brain is able to recognize the actions of others by representing their sounds as a motor event. Previous studies have provided evidence for a somatotopic activation of the listener's motor cortex during perception of the sound of highly familiar motor acts. The present experiments studied (a) how the motor system is activated by action-related sounds that are newly acquired and (b) whether these sounds are represented with reference to extrinsic features related to action goals rather than with respect to lower-level intrinsic parameters related to the specific movements. TMS was used to measure the correspondence between auditory and motor codes in the listener's motor system. We compared the corticomotor excitability in response to the presentation of auditory stimuli void of previous motor meaning before and after a short training period in which these stimuli were associated with voluntary actions. Novel cross-modal representations became manifest very rapidly. By disentangling the representation of the muscle from that of the action's goal, we further showed that passive listening to newly learnt action-related sounds activated a precise motor representation that depended on the variable contexts to which the individual was exposed during testing. Our results suggest that the human brain embodies a higher-order audio-visuo-motor representation of perceived actions, which is muscle-independent and corresponds to the goals of the action.

Distinguishing self and other in joint action. Evidence from a musical paradigm

The capacity to distinguish between one's own and others' behavior is a cognitive prerequisite for successful joint action. We employed a musical joint action task to investigate how the brain achieves this distinction. Pianists performed the right-hand part of piano pieces, previously learned bimanually, while the complementary left-hand part either was not executed or was (believed to be) played by a co-performer. This experimental setting served to induce a co-representation of the left-hand part reflecting either the self or the co-performer. Single-pulse transcranial magnetic stimulation was applied to the right primary motor cortex and motor-evoked potentials (MEPs) were recorded from the resting left forearm. Results show that corticospinal excitability was modulated by whether the representation of the left hand was associated with the self or the other, with the MEP amplitude being low and high, respectively. This result remained unchanged in a separate session where participants could neither see nor hear the other but still infer his presence by means of contextual information. Furthermore, the amplitude of MEPs associated with co-performer presence increased with pianists' self-reported empathy. Thus, the sociality of the context modulates action attribution at the level of the motor control system.

EFFECTS OF SENSORI-MOTOR LEARNING ON MELODY PROCESSING ACROSS DEVELOPMENT

Actions influence perceptions, but how this occurs may change across the lifespan. Studies have investigated how object-directed actions (e.g., learning about objects through manipulation) affect subsequent perception, but how abstract actions affect perception, and how this may change across development, have not been well studied. In the present study, we address this question, teaching children (4-7 year-olds) and adults sung melodies, with or without an abstract motor component, and using functional Magnetic Resonance Imaging (fMRI) to determine how these melodies are subsequently processed. Results demonstrated developmental change in the motor cortices and Middle Temporal Gyrus. Results have implications for understanding sensori-motor integration in the developing brain, and may provide insight into motor learning use in some music education techniques.

Long-term music training tunes how the brain temporally binds signals from multiple senses

Practicing a musical instrument is a rich multisensory experience involving the integration of visual, auditory, and tactile inputs with motor responses. This combined psychophysics-fMRI study used the musician's brain to investigate how sensory-motor experience molds temporal binding of auditory and visual signals. Behaviorally, musicians exhibited a narrower temporal integration window than nonmusicians for music but not for speech. At the neural level, musicians showed increased audiovisual asynchrony responses and effective connectivity selectively for music in a superior temporal sulcus-premotor-cerebellar circuitry. Critically, the premotor asynchrony effects predicted musicians' perceptual sensitivity to audiovisual asynchrony. Our results suggest that piano practicing fine tunes an internal forward model mapping from action plans of piano playing onto visible finger movements and sounds. This internal forward model furnishes more precise estimates of the relative audiovisual timings and hence, stronger prediction error signals specifically for asynchronous music in a premotor-cerebellar circuitry. Our findings show intimate links between action production and audiovisual temporal binding in perception.

Disrupted cortical connectivity theory as an explanatory model for autism spectrum disorders

Recent findings of neurological functioning in autism spectrum disorder (ASD) point to altered brain connectivity as a key feature of its pathophysiology. The cortical underconnectivity theory of ASD (Just et al., 2004) provides an integrated framework for addressing these new findings. This theory suggests that weaker functional connections among brain areas in those with ASD hamper their ability to accomplish complex cognitive and social tasks successfully. We will discuss this theory, but will modify the term underconnectivity to 'disrupted cortical connectivity' to capture patterns of both under- and over-connectivity in the brain. In this paper, we will review the existing literature on ASD to marshal supporting evidence for hypotheses formulated on the disrupted cortical connectivity theory. These hypotheses are: 1) underconnectivity in ASD is manifested mainly in long-distance cortical as well as subcortical connections rather than in short-distance cortical connections; 2) underconnectivity in ASD is manifested only in complex cognitive and social functions and not in low-level sensory and perceptual tasks; 3) functional underconnectivity in ASD may be the result of underlying anatomical abnormalities, such as problems in the integrity of white matter; 4) the ASD brain adapts to underconnectivity through compensatory strategies such as overconnectivity mainly in frontal and in posterior brain areas. This may be manifested as deficits in tasks that require frontal-parietal integration. While overconnectivity can be tested by examining the cortical minicolumn organization, long-distance underconnectivity can be tested by cognitively demanding tasks; and 5) functional underconnectivity in brain areas in ASD will be seen not only during complex tasks but also during task-free resting states. We will also discuss some empirical predictions that can be tested in future studies, such as: 1) how disrupted connectivity relates to cognitive impairments in skills such as Theory-of-Mind, cognitive flexibility, and information processing; and 2) how connection abnormalities relate to, and may determine, behavioral symptoms hallmarked by the triad of Impairments in ASD. Furthermore, we will relate the disrupted cortical connectivity model to existing cognitive and neural models of ASD.

Mirror-sensory synaesthesia: exploring 'shared' sensory experiences as synaesthesia

Recent research suggests the observation or imagination of somatosensory stimulation in another (e.g., touch or pain) can induce a similar somatosensory experience in oneself. Some researchers have presented this experience as a type of synaesthesia, whereas others consider it an extreme experience of an otherwise normal perception. Here, we present an argument that these descriptions are not mutually exclusive. They may describe the extreme version of the normal process of understanding somatosensation in others. It becomes synaesthesia, however, when this process results in a conscious experience comparable to the observed person's state. We describe these experiences as 'mirror-sensory synaesthesia'; a type of synaesthesia identified by its distinct social component where the induced synaesthetic experience is a similar sensory experience to that perceived in another person. Through the operationalisation of this intriguing experience as synaesthesia, existing neurobiological models of synaesthesia can be used as a framework to explore how mechanisms may act upon social cognitive processes to produce conscious experiences similar to another person's observed state.

Auditory-motor mapping training as an intervention to facilitate speech output in non-verbal children with autism: a proof of concept study

Although up to 25% of children with autism are non-verbal, there are very few interventions that can reliably produce significant improvements in speech output. Recently, a novel intervention called Auditory-Motor Mapping Training (AMMT) has been developed, which aims to promote speech production directly by training the association between sounds and articulatory actions using intonation and bimanual motor activities. AMMT capitalizes on the inherent musical strengths of children with autism, and offers activities that they intrinsically enjoy. It also engages and potentially stimulates a network of brain regions that may be dysfunctional in autism. Here, we report an initial efficacy study to provide 'proof of concept' for AMMT. Six non-verbal children with autism participated. Prior to treatment, the children had no intelligible words. They each received 40 individual sessions of AMMT 5 times per week, over an 8-week period. Probe assessments were conducted periodically during baseline, therapy, and follow-up sessions. After therapy, all children showed significant improvements in their ability to articulate words and phrases, with generalization to items that were not practiced during therapy sessions. Because these children had no or minimal vocal output prior to treatment, the acquisition of speech sounds and word approximations through AMMT represents a critical step in expressive language development in children with autism.

Neuroarchitecture of verbal and tonal working memory in nonmusicians and musicians

Working memory (WM) for auditory information has been thought of as a unitary system, but whether WM for verbal and tonal information relies on the same or different functional neuroarchitectures has remained unknown. This fMRI study examines verbal and tonal WM in both nonmusicians (who are trained in speech, but not in music) and highly trained musicians (who are trained in both domains). The data show that core structures of WM are involved in both tonal and verbal WM (Broca's area, premotor cortex, pre-SMA/SMA, left insular cortex, inferior parietal lobe), although with significantly different structural weightings, in both nonmusicians and musicians. Additionally, musicians activated specific subcomponents only during verbal (right insular cortex) or only during tonal WM (right globus pallidus, right caudate nucleus, and left cerebellum). These results reveal the existence of two WM systems in musicians: A phonological loop supporting rehearsal of phonological information, and a tonal loop supporting rehearsal of tonal information. Differences between groups for tonal WM, and between verbal and tonal WM within musicians, were mainly related to structures involved in controlling, programming and planning of actions, thus presumably reflecting differences in action-related sensorimotor coding of verbal and tonal information.

Learning to associate novel words with motor actions: language-induced motor activity following short training

Action words referring to face, arm or leg actions activate areas along the motor strip that also control the planning and execution of the actions specified by the words. This electroencephalogram (EEG) study aimed to test the learning profile of this language-induced motor activity. Participants were trained to associate novel verbal stimuli to videos of object-oriented hand and arm movements or animated visual images on two consecutive days. Each training session was preceded and followed by a test-session with isolated videos and verbal stimuli. We measured motor-related brain activity (reflected by a desynchronization in the μ frequency bands; 8-12 Hz range) localized at centro-parietal and fronto-central electrodes. We compared activity from viewing the videos to activity resulting from processing the language stimuli only. At centro-parietal electrodes, stable action-related μ suppression was observed during viewing of videos in each test-session of the two days. For processing of verbal stimuli associated with motor actions, a similar pattern of activity was evident only in the second test-session of Day 1. Over the fronto-central regions, μ suppression was observed in the second test-session of Day 2 for the videos and in the second test-session of Day 1 for the verbal stimuli. Whereas the centro-parietal μ suppression can be attributed to motor events actually experienced during training, the fronto-central μ suppression seems to serve as a convergence zone that mediates underspecified motor information. Consequently, sensory-motor reactivations through which concepts are comprehended seem to differ in neural dynamics from those implicated in their acquisition.

The self in action effects: selective attenuation of self-generated sounds

The immediate experience of self-agency, that is, the experience of generating and controlling our actions, is thought to be a key aspect of selfhood. It has been suggested that this experience is intimately linked to internal motor signals associated with the ongoing actions. These signals should lead to an attenuation of the sensory consequences of one's own actions and thereby allow classifying them as self-generated. The discovery of shared representations of actions between self and other, however, challenges this idea and suggests similar attenuation of one's own and other's sensory action effects. Here, we tested these assumptions by comparing sensory attenuation of self-generated and observed sensory effects. More specifically, we compared the loudness perception of sounds that were either self-generated, generated by another person or a computer. In two experiments, we found a reduced perception of loudness intensity specifically related to self-generation. Furthermore, the perception of sounds generated by another person and a computer did not differ from each other. These findings indicate that one's own agentive influence upon the outside world has a special perceptual quality which distinguishes it from any sort of external influence, including human and non-human sources. This suggests that a real sense of self-agency is not a socially shared but rather a unique and private experience.

Experience modulates vicarious freezing in rats: a model for empathy

The study of the neural basis of emotional empathy has received a surge of interest in recent years but mostly employing human neuroimaging. A simpler animal model would pave the way for systematic single cell recordings and invasive manipulations of the brain regions implicated in empathy. Recent evidence has been put forward for the existence of empathy in rodents. In this study, we describe a potential model of empathy in female rats, in which we studied interactions between two rats: a witness observes a demonstrator experiencing a series of footshocks. By comparing the reaction of witnesses with or without previous footshock experience, we examine the role of prior experience as a modulator of empathy. We show that witnesses having previously experienced footshocks, but not naïve ones, display vicarious freezing behavior upon witnessing a cage-mate experiencing footshocks. Strikingly, the demonstrator's behavior was in turn modulated by the behavior of the witness: demonstrators froze more following footshocks if their witness froze more. Previous experiments have shown that rats emit ultrasonic vocalizations (USVs) when receiving footshocks. Thus, the role of USV in triggering vicarious freezing in our paradigm is examined. We found that experienced witness-demonstrator pairs emitted more USVs than naïve witness-demonstrator pairs, but the number of USVs was correlated with freezing in demonstrators, not in witnesses. Furthermore, playing back the USVs, recorded from witness-demonstrator pairs during the empathy test, did not induce vicarious freezing behavior in experienced witnesses. Thus, our findings confirm that vicarious freezing can be triggered in rats, and moreover it can be modulated by prior experience. Additionally, our result suggests that vicarious freezing is not triggered by USVs per se and it influences back onto the behavior of the demonstrator that had elicited the vicarious freezing in witnesses, introducing a paradigm to study empathy as a social loop.

Toward a neural basis of music perception - a review and updated model

Music perception involves acoustic analysis, auditory memory, auditory scene analysis, processing of interval relations, of musical syntax and semantics, and activation of (pre)motor representations of actions. Moreover, music perception potentially elicits emotions, thus giving rise to the modulation of emotional effector systems such as the subjective feeling system, the autonomic nervous system, the hormonal, and the immune system. Building on a previous article (Koelsch and Siebel, 2005), this review presents an updated model of music perception and its neural correlates. The article describes processes involved in music perception, and reports EEG and fMRI studies that inform about the time course of these processes, as well as about where in the brain these processes might be located.

Can we measure memes?

Memes are the fundamental unit of cultural evolution and have been left upon the periphery of cognitive neuroscience due to their inexact definition and the consequent presumption that they are impossible to measure. Here it is argued that although a precise definition of memes is rather difficult it does not preclude highly controlled experiments studying the neural substrates of their initiation and replication. In this paper, memes are termed as either internally or externally represented (i-memes/e-memes) in relation to whether they are represented as a neural substrate within the central nervous system or in some other form within our environment. It is argued that neuroimaging technology is now sufficiently advanced to image the connectivity profiles of i-memes and critically, to measure changes to i-memes over time, i.e., as they evolve. It is argued that it is wrong to simply pass off memes as an alternative term for "stimulus" and "learnt associations" as it does not accurately account for the way in which natural stimuli may dynamically "evolve" as clearly observed in our cultural lives.

Transfer of Training between Music and Speech: Common Processing, Attention, and Memory

After a brief historical perspective of the relationship between language and music, we review our work on transfer of training from music to speech that aimed at testing the general hypothesis that musicians should be more sensitive than non-musicians to speech sounds. In light of recent results in the literature, we argue that when long-term experience in one domain influences acoustic processing in the other domain, results can be interpreted as common acoustic processing. But when long-term experience in one domain influences the building-up of abstract and specific percepts in another domain, results are taken as evidence for transfer of training effects. Moreover, we also discuss the influence of attention and working memory on transfer effects and we highlight the usefulness of the event-related potentials method to disentangle the different processes that unfold in the course of music and speech perception. Finally, we give an overview of an on-going longitudinal project with children aimed at testing transfer effects from music to different levels and aspects of speech processing.

Music-supported therapy induces plasticity in the sensorimotor cortex in chronic stroke: a single-case study using multimodal imaging (fMRI-TMS)

PRIMARY OBJECTIVE

Music-Supported Therapy (MST) has been developed recently in order to improve the use of the affected upper extremity after stroke. This study investigated the neuroplastic mechanisms underlying effectiveness in a patient with chronic stroke.

METHODS

MST uses musical instruments, a midi piano and an electronic drum set emitting piano sounds, to retrain fine and gross movements of the paretic upper extremity. Data are presented from a patient with a chronic stroke (20 months post-stroke) with residual right-sided hemiparesis who took part in 20 MST sessions over the course of 4 weeks.

RESULTS

Post-therapy, a marked improvement of movement quality, assessed by 3D movement analysis, was observed. Moreover, functional magnetic resonance imaging (fMRI) of a sequential hand movement revealed distinct therapy-related changes in the form of a reduction of excess contralateral and ipsilateral activations. This was accompanied by changes in cortical excitability evidenced by transcranial magnetic stimulation (TMS). Functional MRI in a music listening task suggests that one of the effects of MST is the task-dependent coupling of auditory and motor cortical areas.

CONCLUSIONS

The MST appears to be a useful neurorehabilitation tool in patients with chronic stroke and leads to neural reorganization in the sensorimotor cortex.

Modulation of the motor system during visual and auditory language processing

Studies of embodied cognition have demonstrated the engagement of the motor system when people process action-related words and concepts. However, research using transcranial magnetic stimulation (TMS) to examine linguistic modulation in primary motor cortex has produced inconsistent results. Some studies report that action words produce an increase in corticospinal excitability; others, a decrease. Given the differences in methodology and modality, we re-examined this issue, comparing conditions in which participants either read or listened to the same set of action words. In separate blocks of trials, participants were presented with lists of words in the visual and auditory modality, and a TMS pulse was applied over left motor cortex, either 150 or 300 ms after the word onset. Motor evoked potentials (MEPs) elicited were larger following the presentation of action words compared with control words. However, this effect was only observed when the words were presented visually; no changes in MEPs were found when the words were presented auditorily. A review of the TMS literature on action word processing reveals a similar modality effect on corticospinal excitability. We discuss different hypotheses that might account for this differential modulation of action semantics by vision and audition.

Age-related increase in inferior frontal gyrus activity and social functioning in autism spectrum disorder

BACKGROUND

Hypoactivation of the inferior frontal gyrus during the perception of facial expressions has been interpreted as evidence for a deficit of the mirror neuron system in children with autism. We examined whether this dysfunction persists in adulthood, and how brain activity in the mirror neuron system relates to social functioning outside the laboratory.

METHODS

Twenty-one adult males with autism spectrum disorders and 21 typically developing subjects matched for age, sex, and IQ were scanned in three conditions: observing short movies showing facial expressions, performing a facial movement, and experiencing a disgusting taste. Symptom severity and level of social adjustment were measured with the Autism Diagnostic Observation Schedule and the Social Functioning Scale.

RESULTS

Inferior frontal gyrus activity during the observation of facial expressions increased with age in subjects with autism, but not in control subjects. The age-related increase in activity was associated with changes in gaze behavior and improvements in social functioning. These age-related neurocognitive improvements were not found in a group of individuals with schizophrenia, who had comparable levels of social functioning.

CONCLUSIONS

The results of this cross-sectional study suggest that mirror neuron system activity augments with age in autism and that this is accompanied by changes in gaze behavior and improved social functioning. It is the first demonstration of an age-related neurocognitive improvement in autism. Increased motor simulation may contribute to the amelioration in social functioning documented in adolescence and adulthood. This finding should encourage the development of new therapeutic interventions directed at emotion simulation.

Increased gray matter volume of left pars opercularis in male orchestral musicians correlate positively with years of musical performance

PURPOSE

To compare manual volumetry of gray matter (GM) / white matter (WM) of Broca's area subparts: pars opercularis (POP) and pars triangularis (PTR) in both hemispheres between musicians and nonmusician, as it has been shown that these regions are crucial for musical abilities. A previous voxel-based morphometric (VBM) study conducted in our laboratory reported increased GM density in Broca's area of left hemisphere in male orchestral musicians. Functional segregation of POP/PTR justified separate volumetric analysis of these parts.

MATERIALS AND METHODS

We used the same cohort for the VBM study. Manual morphometry (stereology) was used to compare volumes between 26/26 right-handed orchestral musicians/nonmusicians.

RESULTS

As expected, musicians showed significantly increased GM volume in the Broca's area, specifically in the left POP. No significant results were detected in right POP, left/right PTR GM volumes, and WM volumes for all regions. Results were positively correlated with years of musical performance (r = 0.7, P = 0.0001).

CONCLUSION

This result corroborates the VBM study and is in line with the hypothesis of critical involvement of POP in hearing-action integration being an integral component of frontoparietotemporal mirror neuron network. We hypothesize that increased size of musicians' left POP represent use-dependent structural adaptation in response to intensive audiomotor skill acquisition.

Action expertise reduces brain activity for audiovisual matching actions: an fMRI study with expert drummers

When we observe someone perform a familiar action, we can usually predict what kind of sound that action will produce. Musical actions are over-experienced by musicians and not by non-musicians, and thus offer a unique way to examine how action expertise affects brain processes when the predictability of the produced sound is manipulated. We used functional magnetic resonance imaging to scan 11 drummers and 11 age- and gender-matched novices who made judgments on point-light drumming movements presented with sound. In Experiment 1, sound was synchronized or desynchronized with drumming strikes, while in Experiment 2 sound was always synchronized, but the natural covariation between sound intensity and velocity of the drumming strike was maintained or eliminated. Prior to MRI scanning, each participant completed psychophysical testing to identify personal levels of synchronous and asynchronous timing to be used in the two fMRI activation tasks. In both experiments, the drummers' brain activation was reduced in motor and action representation brain regions when sound matched the observed movements, and was similar to that of novices when sound was mismatched. This reduction in neural activity occurred bilaterally in the cerebellum and left parahippocampal gyrus in Experiment 1, and in the right inferior parietal lobule, inferior temporal gyrus, middle frontal gyrus and precentral gyrus in Experiment 2. Our results indicate that brain functions in action-sound representation areas are modulated by multimodal action expertise.

The nature of consciousness in the visually deprived brain

Vision plays a central role in how we represent and interact with the world around us. The primacy of vision is structurally imbedded in cortical organization as about one-third of the cortical surface in primates is involved in visual processes. Consequently, the loss of vision, either at birth or later in life, affects brain organization and the way the world is perceived and acted upon. In this paper, we address a number of issues on the nature of consciousness in people deprived of vision. Do brains from sighted and blind individuals differ, and how? How does the brain of someone who has never had any visual perception form an image of the external world? What is the subjective correlate of activity in the visual cortex of a subject who has never seen in life? More in general, what can we learn about the functional development of the human brain in physiological conditions by studying blindness? We discuss findings from animal research as well from recent psychophysical and functional brain imaging studies in sighted and blind individuals that shed some new light on the answers to these questions.

Music making as a tool for promoting brain plasticity across the life span

Playing a musical instrument is an intense, multisensory, and motor experience that usually commences at an early age and requires the acquisition and maintenance of a range of skills over the course of a musician's lifetime. Thus, musicians offer an excellent human model for studying the brain effects of acquiring specialized sensorimotor skills. For example, musicians learn and repeatedly practice the association of motor actions with specific sound and visual patterns (musical notation) while receiving continuous multisensory feedback. This association learning can strengthen connections between auditory and motor regions (e.g., arcuate fasciculus) while activating multimodal integration regions (e.g., around the intraparietal sulcus). We argue that training of this neural network may produce cross-modal effects on other behavioral or cognitive operations that draw on this network. Plasticity in this network may explain some of the sensorimotor and cognitive enhancements that have been associated with music training. These enhancements suggest the potential for music making as an interactive treatment or intervention for neurological and developmental disorders, as well as those associated with normal aging.

Event-related spectral perturbation induced by action-related sound

It is now well established that human brain is endowed with an auditory-motor system which may depend on individual's motor experience. Here we designed an electroencephalography (EEG) experiment for investigating this dependency. A sound with not-so-obvious meaning was presented to subjects firstly. Then a visual exposure process was carried out to establish an association between the sound and action. By analyzing event-related spectral perturbation (ERSP) in the mu rhythm, we expected to find response differences in the motor cortex between the pre- and post-exposure periods. Results of 14 subjects indicated that the activation of motor cortex was stronger in the post-exposure phase. Our study suggests that the auditory-motor association can be established rapidly by a simple exposure process.

Dynamic emotional and neural responses to music depend on performance expression and listener experience

Apart from its natural relevance to cognition, music provides a window into the intimate relationships between production, perception, experience, and emotion. Here, emotional responses and neural activity were observed as they evolved together with stimulus parameters over several minutes. Participants listened to a skilled music performance that included the natural fluctuations in timing and sound intensity that musicians use to evoke emotional responses. A mechanical performance of the same piece served as a control. Before and after fMRI scanning, participants reported real-time emotional responses on a 2-dimensional rating scale (arousal and valence) as they listened to each performance. During fMRI scanning, participants listened without reporting emotional responses. Limbic and paralimbic brain areas responded to the expressive dynamics of human music performance, and both emotion and reward related activations during music listening were dependent upon musical training. Moreover, dynamic changes in timing predicted ratings of emotional arousal, as well as real-time changes in neural activity. BOLD signal changes correlated with expressive timing fluctuations in cortical and subcortical motor areas consistent with pulse perception, and in a network consistent with the human mirror neuron system. These findings show that expressive music performance evokes emotion and reward related neural activations, and that music's affective impact on the brains of listeners is altered by musical training. Our observations are consistent with the idea that music performance evokes an emotional response through a form of empathy that is based, at least in part, on the perception of movement and on violations of pulse-based temporal expectancies.

Neural pathways for language in autism: the potential for music-based treatments

Language deficits represent the core diagnostic characteristics of autism, and some of these individuals never develop functional speech. The language deficits in autism may be due to structural and functional abnormalities in certain language regions (e.g., frontal and temporal), or due to altered connectivity between these brain regions. In particular, a number of anatomical pathways that connect auditory and motor brain regions (e.g., the arcuate fasciculus, the uncinate fasciculus and the extreme capsule) may be altered in individuals with autism. These pathways may also provide targets for experimental treatments to facilitate communication skills in autism. We propose that music-based interventions (e.g., auditory-motor mapping training) would take advantage of the musical strengths of these children, and are likely to engage, and possibly strengthen, the connections between frontal and temporal regions bilaterally. Such treatments have important clinical potential in facilitating expressive language in nonverbal children with autism.

Motor learning with augmented feedback: modality-dependent behavioral and neural consequences

Sensory information is critical to correct performance errors online during the execution of complex tasks and can be complemented by augmented feedback (FB). Here, 2 groups of participants acquired a new bimanual coordination pattern under different augmented FB conditions: 1) visual input reflecting coordination between the 2 hands and 2) auditory pacing integrating the timing of both hands into a single temporal structure. Behavioral findings revealed that the visual group became dependent on this augmented FB for performance, whereas the auditory group performed equally well with or without augmented FB by the end of practice. Functional magnetic resonance imaging (fMRI) results corroborated these behavioral findings: the visual group showed neural activity increases in sensory-specific areas during practice, supporting increased reliance on augmented FB. Conversely, the auditory group showed a neural activity decrease, specifically in areas associated with cognitive/sensory monitoring of motor task performance, supporting the development of a control mode that was less reliant on augmented FB sources. Finally, some remnants of brain activity in sensory-specific areas in the absence of augmented FB were found for the visual group only, illustrating ongoing reliance on these areas. These findings provide the first neural account for the "guidance hypothesis of information FB," extensively supported by behavioral research.

An expanded role for the dorsal auditory pathway in sensorimotor control and integration

The dual-pathway model of auditory cortical processing assumes that two largely segregated processing streams originating in the lateral belt subserve the two main functions of hearing: identification of auditory "objects", including speech; and localization of sounds in space (Rauschecker and Tian, 2000). Evidence has accumulated, chiefly from work in humans and nonhuman primates, that an antero-ventral pathway supports the former function, whereas a postero-dorsal stream supports the latter, i.e processing of space and motion-in-space. In addition, the postero-dorsal stream has also been postulated to subserve some functions of speech and language in humans. A recent review (Rauschecker and Scott, 2009) has proposed the possibility that both functions of the postero-dorsal pathway can be subsumed under the same structural forward model: an efference copy sent from prefrontal and premotor cortex provides the basis for "optimal state estimation" in the inferior parietal lobe and in sensory areas of the posterior auditory cortex. The current article corroborates this model by adding and discussing recent evidence.

Auditory-motor expertise alters "speech selectivity" in professional musicians and actors

Several perisylvian brain regions show preferential activation for spoken language above and beyond other complex sounds. These “speech-selective” effects might be driven by regions’ intrinsic biases for processing the acoustical or informational properties of speech. Alternatively, such speech selectivity might emerge through extensive experience in perceiving and producing speech sounds. This functional magnetic resonance imaging (fMRI) study disambiguated such audiomotor expertise from speech selectivity by comparing activation for listening to speech and music in female professional violinists and actors. Audiomotor expertise effects were identified in several right and left superior temporal regions that responded to speech in all participants and music in violinists more than actresses. Regions associated with the acoustic/information content of speech were identified along the entire length of the superior temporal sulci bilaterally where activation was greater for speech than music in all participants. Finally, an effect of performing arts training was identified in bilateral premotor regions commonly activated by finger and mouth movements as well as in right hemisphere “language regions.” These results distinguish the seemingly speech-specific neural responses that can be abolished and even reversed by long-term audiomotor experience.

Cortical networks representing object categories and high-level attributes of familiar real-world action sounds

In contrast to visual object processing, relatively little is known about how the human brain processes everyday real-world sounds, transforming highly complex acoustic signals into representations of meaningful events or auditory objects. We recently reported a fourfold cortical dissociation for representing action (nonvocalization) sounds correctly categorized as having been produced by human, animal, mechanical, or environmental sources. However, it was unclear how consistent those network representations were across individuals, given potential differences between each participant's degree of familiarity with the studied sounds. Moreover, it was unclear what, if any, auditory perceptual attributes might further distinguish the four conceptual sound-source categories, potentially revealing what might drive the cortical network organization for representing acoustic knowledge. Here, we used functional magnetic resonance imaging to test participants before and after extensive listening experience with action sounds, and tested for cortices that might be sensitive to each of three different high-level perceptual attributes relating to how a listener associates or interacts with the sound source. These included the sound's perceived concreteness, effectuality (ability to be affected by the listener), and spatial scale. Despite some variation of networks for environmental sounds, our results verified the stability of a fourfold dissociation of category-specific networks for real-world action sounds both before and after familiarity training. Additionally, we identified cortical regions parametrically modulated by each of the three high-level perceptual sound attributes. We propose that these attributes contribute to the network-level encoding of category-specific acoustic knowledge representations.

From singing to speaking: facilitating recovery from nonfluent aphasia

It has been reported for more than 100 years that patients with severe nonfluent aphasia are better at singing lyrics than they are at speaking the same words. This observation led to the development of melodic intonation therapy (MIT). However, the efficacy of this therapy has yet to be substantiated in a randomized controlled trial. Furthermore, its underlying neural mechanisms remain unclear. The two unique components of MIT are the intonation of words and simple phrases using a melodic contour that follows the prosody of speech and the rhythmic tapping of the left hand that accompanies the production of each syllable and serves as a catalyst for fluency. Research has shown that both components are capable of engaging fronto-temporal regions in the right hemisphere, thereby making MIT particularly well suited for patients with large left hemisphere lesions who also suffer from nonfluent aphasia. Recovery from aphasia can happen in two ways: either through the recruitment of perilesional brain regions in the affected hemisphere, with variable recruitment of right-hemispheric regions if the lesion is small, or through the recruitment of homologous language and speech-motor regions in the unaffected hemisphere if the lesion of the affected hemisphere is extensive. Treatment-associated neural changes in patients undergoing MIT indicate that the unique engagement of right-hemispheric structures (e.g., the superior temporal lobe, primary sensorimotor, premotor and inferior frontal gyrus regions) and changes in the connections across these brain regions may be responsible for its therapeutic effect.

Processing of infant-directed speech by adults

Adults typically address infants in a special speech mode called infant-directed speech (IDS). IDS is characterized by a special prosody (i.e., higher pitched, slower and hyperarticulated) and a special lexicon ("baby talk"). Here we investigated which areas of the adult brain are involved in processing IDS, which aspects of IDS (prosodic or lexical) are processed, to what extent the experience of being a parent affects the way adults process IDS, and the effects of gender and personality on IDS processing. Using functional magnetic resonance imaging, we found that mothers with preverbal infants showed enhanced activation in the auditory dorsal pathway of the language areas, regardless of whether they listened to the prosodic or lexical component of IDS. We also found that extroverted mothers showed higher cortical activation in speech-related motor areas than did mothers with lower extroverted personality scores. Increased cortical activation levels were not found for fathers, non-parents, or mothers with older children.

Vocal accuracy and neural plasticity following micromelody-discrimination training

Background

Recent behavioral studies report correlational evidence to suggest that non-musicians with good pitch discrimination sing more accurately than those with poorer auditory skills. However, other studies have reported a dissociation between perceptual and vocal production skills. In order to elucidate the relationship between auditory discrimination skills and vocal accuracy, we administered an auditory-discrimination training paradigm to a group of non-musicians to determine whether training-enhanced auditory discrimination would specifically result in improved vocal accuracy.

Methodology/Principal Findings

We utilized micromelodies (i.e., melodies with seven different interval scales, each smaller than a semitone) as the main stimuli for auditory discrimination training and testing, and we used single-note and melodic singing tasks to assess vocal accuracy in two groups of non-musicians (experimental and control). To determine if any training-induced improvements in vocal accuracy would be accompanied by related modulations in cortical activity during singing, the experimental group of non-musicians also performed the singing tasks while undergoing functional magnetic resonance imaging (fMRI). Following training, the experimental group exhibited significant enhancements in micromelody discrimination compared to controls. However, we did not observe a correlated improvement in vocal accuracy during single-note or melodic singing, nor did we detect any training-induced changes in activity within brain regions associated with singing.

Conclusions/Significance

Given the observations from our auditory training regimen, we therefore conclude that perceptual discrimination training alone is not sufficient to improve vocal accuracy in non-musicians, supporting the suggested dissociation between auditory perception and vocal production.

Mirror systems

Mirror neurons are a class of visuomotor neurons, discovered in the monkey premotor cortex and in an anatomically connected area of the inferior parietal lobule, that activate both during action execution and action observation. They constitute a circuit dedicated to match actions made by others with the internal motor representations of the observer. It has been proposed that this matching system enables individuals to understand others' behavior and motor intentions. Here we will describe the main features of mirror neurons in monkeys. Then we will present evidence of the presence of a mirror system in humans and of its involvement in several social-cognitive functions, such as imitation, intention, and emotion understanding. This system may have several implications at a cognitive level and could be linked to specific social deficits in humans such as autism. Recent investigations addressed the issue of the plasticity of the mirror neuron system in both monkeys and humans, suggesting also their possible use in rehabilitation. WIREs Cogn Sci 2011 2 22-38 DOI: 10.1002/wcs.89 For further resources related to this article, please visit the WIREs website.

Action perception in individuals with congenital blindness or deafness: how does the loss of a sensory modality from birth affect perception-induced motor facilitation?

Seeing or hearing manual actions activates the mirror neuron system, that is, specialized neurons within motor areas which fire when an action is performed but also when it is passively perceived. Using TMS, it was shown that motor cortex of typically developed subjects becomes facilitated not only from seeing others' actions, but also from merely hearing action-related sounds. In the present study, TMS was used for the first time to explore the "auditory" and "visual" responsiveness of motor cortex in individuals with congenital blindness or deafness. TMS was applied over left primary motor cortex (M1) to measure cortico-motor facilitation while subjects passively perceived manual actions (either visually or aurally). Although largely unexpected, congenitally blind or deaf subjects displayed substantially lower resonant motor facilitation upon action perception compared to seeing/hearing control subjects. Moreover, muscle-specific changes in cortico-motor excitability within M1 appeared to be absent in individuals with profound blindness or deafness. Overall, these findings strongly argue against the hypothesis that an increased reliance on the remaining sensory modality in blind or deaf subjects is accompanied by an increased responsiveness of the "auditory" or "visual" perceptual-motor "mirror" system, respectively. Moreover, the apparent lack of resonant motor facilitation for the blind and deaf subjects may challenge the hypothesis of a unitary mirror system underlying human action recognition and may suggest that action perception in blind and deaf subjects engages a mode of action processing that is different from the human action recognition system recruited in typically developed subjects.