Early neuronal responses in right limbic structures mediate harmony incongruity processing in musical experts

Hierarchical syntax model of music predicts theta power during music listening

Linguistic research showed that the depth of syntactic embedding is reflected in brain theta power. Here, we test whether this also extends to non-linguistic stimuli, specifically music. We used a hierarchical model of musical syntax to continuously quantify two types of expert-annotated harmonic dependencies throughout a piece of Western classical music: prolongation and preparation. Prolongations can roughly be understood as a musical analogue to linguistic coordination between constituents that share the same function (e.g., 'pizza' and 'pasta' in 'I ate pizza and pasta'). Preparation refers to the dependency between two harmonies whereby the first implies a resolution towards the second (e.g., dominant towards tonic; similar to how the adjective implies the presence of a noun in 'I like spicy … '). Source reconstructed MEG data of sixty-five participants listening to the musical piece was then analysed. We used Bayesian Mixed Effects models to predict theta envelope in the brain, using the number of open prolongation and preparation dependencies as predictors whilst controlling for audio envelope. We observed that prolongation and preparation both carry independent and distinguishable predictive value for theta band fluctuation in key linguistic areas such as the Angular, Superior Temporal, and Heschl's Gyri, or their right-lateralised homologues, with preparation showing additional predictive value for areas associated with the reward system and prediction. Musical expertise further mediated these effects in language-related brain areas. Results show that predictions of precisely formalised music-theoretical models are reflected in the brain activity of listeners which furthers our understanding of the perception and cognition of musical structure.

Neural correlates of musical familiarity: a functional magnetic resonance study

Existing neuroimaging studies on neural correlates of musical familiarity often employ a familiar vs. unfamiliar contrast analysis. This singular analytical approach reveals associations between explicit musical memory and musical familiarity. However, is the neural activity associated with musical familiarity solely related to explicit musical memory, or could it also be related to implicit musical memory? To address this, we presented 130 song excerpts of varying familiarity to 21 participants. While acquiring their brain activity using functional magnetic resonance imaging (fMRI), we asked the participants to rate the familiarity of each song on a five-point scale. To comprehensively analyze the neural correlates of musical familiarity, we examined it from four perspectives: the intensity of local neural activity, patterns of local neural activity, global neural activity patterns, and functional connectivity. The results from these four approaches were consistent and revealed that musical familiarity is related to the activity of both explicit and implicit musical memory networks. Our findings suggest that: (1) musical familiarity is also associated with implicit musical memory, and (2) there is a cooperative and competitive interaction between the two types of musical memory in the perception of music.

Increased functional connectivity in the right dorsal auditory stream after a full year of piano training in healthy older adults

Learning to play an instrument at an advanced age may help to counteract or slow down age-related cognitive decline. However, studies investigating the neural underpinnings of these effects are still scarce. One way to investigate the effects of brain plasticity is using resting-state functional connectivity (FC). The current study compared the effects of learning to play the piano (PP) against participating in music listening/musical culture (MC) lessons on FC in 109 healthy older adults. Participants underwent resting-state functional magnetic resonance imaging at three time points: at baseline, and after 6 and 12 months of interventions. Analyses revealed piano training-specific FC changes after 12 months of training. These include FC increase between right Heschl's gyrus (HG), and other right dorsal auditory stream regions. In addition, PP showed an increased anticorrelation between right HG and dorsal posterior cingulate cortex and FC increase between the right motor hand area and a bilateral network of predominantly motor-related brain regions, which positively correlated with fine motor dexterity improvements. We suggest to interpret those results as increased network efficiency for auditory-motor integration. The fact that functional neuroplasticity can be induced by piano training in healthy older adults opens new pathways to countervail age related decline.

The hearing hippocampus

The hippocampus has a well-established role in spatial and episodic memory but a broader function has been proposed including aspects of perception and relational processing. Neural bases of sound analysis have been described in the pathway to auditory cortex, but wider networks supporting auditory cognition are still being established. We review what is known about the role of the hippocampus in processing auditory information, and how the hippocampus itself is shaped by sound. In examining imaging, recording, and lesion studies in species from rodents to humans, we uncover a hierarchy of hippocampal responses to sound including during passive exposure, active listening, and the learning of associations between sounds and other stimuli. We describe how the hippocampus' connectivity and computational architecture allow it to track and manipulate auditory information - whether in the form of speech, music, or environmental, emotional, or phantom sounds. Functional and structural correlates of auditory experience are also identified. The extent of auditory-hippocampal interactions is consistent with the view that the hippocampus makes broad contributions to perception and cognition, beyond spatial and episodic memory. More deeply understanding these interactions may unlock applications including entraining hippocampal rhythms to support cognition, and intervening in links between hearing loss and dementia.

Auditory affective processing, musicality, and the development of misophonic reactions

Misophonia can be characterized both as a condition and as a negative affective experience. Misophonia is described as feeling irritation or disgust in response to hearing certain sounds, such as eating, drinking, gulping, and breathing. Although the earliest misophonic experiences are often described as occurring during childhood, relatively little is known about the developmental pathways that lead to individual variation in these experiences. This literature review discusses evidence of misophonic reactions during childhood and explores the possibility that early heightened sensitivities to both positive and negative sounds, such as to music, might indicate a vulnerability for misophonia and misophonic reactions. We will review when misophonia may develop, how it is distinguished from other auditory conditions (e.g., hyperacusis, phonophobia, or tinnitus), and how it relates to developmental disorders (e.g., autism spectrum disorder or Williams syndrome). Finally, we explore the possibility that children with heightened musicality could be more likely to experience misophonic reactions and develop misophonia.

Music affects functional brain connectivity and is effective in the treatment of neurological disorders

In a million years, under the pressure of natural selection, hominins have acquired the abilities for vocal learning, music, and language. Music is a relevant human activity, highly effective in enhancing sociality, is a universal experience common to all known human cultures, although it varies in rhythmic and melodic complexity. It has been part of human life since the beginning of our history, or almost, and it strengthens the mother-baby relation even within the mother's womb. Music engages multiple cognitive functions, and promotes attention, concentration, imagination, creativity, elicits memories and emotions, and stimulates imagination, and harmony of movement. It changes the chemistry of the brain, by inducing the release of neurotransmitters and hormones (dopamine, serotonin, and oxytocin) and activates the reward and prosocial systems. In addition, music is also used to develop new therapies necessary to alleviate severe illness, especially neurological disorders, and brain injuries.

Neural Advantages of Older Musicians Involve the Cerebellum: Implications for Healthy Aging Through Lifelong Musical Instrument Training

This study compared 30 older musicians and 30 age-matched non-musicians to investigate the association between lifelong musical instrument training and age-related cognitive decline and brain atrophy (musicians: mean age 70.8 years, musical experience 52.7 years; non-musicians: mean age 71.4 years, no or less than 3 years of musical experience). Although previous research has demonstrated that young musicians have larger gray matter volume (GMV) in the auditory-motor cortices and cerebellum than non-musicians, little is known about older musicians. Music imagery in young musicians is also known to share a neural underpinning [the supramarginal gyrus (SMG) and cerebellum] with music performance. Thus, we hypothesized that older musicians would show superiority to non-musicians in some of the abovementioned brain regions. Behavioral performance, GMV, and brain activity, including functional connectivity (FC) during melodic working memory (MWM) tasks, were evaluated in both groups. Behaviorally, musicians exhibited a much higher tapping speed than non-musicians, and tapping speed was correlated with executive function in musicians. Structural analyses revealed larger GMVs in both sides of the cerebellum of musicians, and importantly, this was maintained until very old age. Task-related FC analyses revealed that musicians possessed greater cerebellar-hippocampal FC, which was correlated with tapping speed. Furthermore, musicians showed higher activation in the SMG during MWM tasks; this was correlated with earlier commencement of instrumental training. These results indicate advantages or heightened coupling in brain regions associated with music performance and imagery in musicians. We suggest that lifelong instrumental training highly predicts the structural maintenance of the cerebellum and related cognitive maintenance in old age.

How Musical Training Shapes the Adult Brain: Predispositions and Neuroplasticity

Learning to play a musical instrument is a complex task that integrates multiple sensory modalities and higher-order cognitive functions. Therefore, musical training is considered a useful framework for the research on training-induced neuroplasticity. However, the classical nature-or-nurture question remains, whether the differences observed between musicians and non-musicians are due to predispositions or result from the training itself. Here we present a review of recent publications with strong focus on experimental designs to better understand both brain reorganization and the neuronal markers of predispositions when learning to play a musical instrument. Cross-sectional studies identified structural and functional differences between the brains of musicians and non-musicians, especially in regions related to motor control and auditory processing. A few longitudinal studies showed functional changes related to training while listening to and producing music, in the motor network and its connectivity with the auditory system, in line with the outcomes of cross-sectional studies. Parallel changes within the motor system and between the motor and auditory systems were revealed for structural connectivity. In addition, potential predictors of musical learning success were found including increased brain activation in the auditory and motor systems during listening, the microstructure of the arcuate fasciculus, and the functional connectivity between the auditory and the motor systems. We show that “the musical brain” is a product of both the natural human neurodiversity and the training practice.

Train the brain with music (TBM): brain plasticity and cognitive benefits induced by musical training in elderly people in Germany and Switzerland, a study protocol for an RCT comparing musical instrumental practice to sensitization to music

BACKGROUND

Recent data suggest that musical practice prevents age-related cognitive decline. But experimental evidence remains sparse and no concise information on the neurophysiological bases exists, although cognitive decline represents a major impediment to healthy aging. A challenge in the field of aging is developing training regimens that stimulate neuroplasticity and delay or reverse symptoms of cognitive and cerebral decline. To be successful, these regimens should be easily integrated in daily life and intrinsically motivating. This study combines for the first-time protocolled music practice in elderly with cutting-edge neuroimaging and behavioral approaches, comparing two types of musical education.

METHODS

We conduct a two-site Hannover-Geneva randomized intervention study in altogether 155 retired healthy elderly (64-78) years, (63 in Geneva, 92 in Hannover), offering either piano instruction (experimental group) or musical listening awareness (control group). Over 12 months all participants receive weekly training for 1 hour, and exercise at home for ~ 30 min daily. Both groups study different music styles. Participants are tested at 4 time points (0, 6, and 12 months & post-training (18 months)) on cognitive and perceptual-motor aptitudes as well as via wide-ranging functional and structural neuroimaging and blood sampling.

DISCUSSION

We aim to demonstrate positive transfer effects for faculties traditionally described to decline with age, particularly in the piano group: executive functions, working memory, processing speed, abstract thinking and fine motor skills. Benefits in both groups may show for verbal memory, hearing in noise and subjective well-being. In association with these behavioral benefits we anticipate functional and structural brain plasticity in temporal (medial and lateral), prefrontal and parietal areas and the basal ganglia. We intend exhibiting for the first time that musical activities can provoke important societal impacts by diminishing cognitive and perceptual-motor decline supported by functional and structural brain plasticity.

TRIAL REGISTRATION

The Ethikkomission of the Leibniz Universität Hannover approved the protocol on 14.08.17 (no. 3604-2017), the neuroimaging part and blood sampling was approved by the Hannover Medical School on 07.03.18. The full protocol was approved by the Commission cantonale d'éthique de la recherche de Genève (no. 2016-02224) on 27.02.18 and registered at clinicaltrials.gov on 17.09.18 ( NCT03674931 , no. 81185).

Change in left inferior frontal connectivity with less unexpected harmonic cadence by musical expertise

In terms of harmonic expectancy, compared to an expected dominant-to-tonic and an unexpected dominant-to-supertonic, a dominant-to-submediant is a less unexpected cadence, the perception of which may depend on the subject’s musical expertise. The present study investigated how aforementioned 3 different cadences are processed in the networks of bilateral inferior frontal gyri (IFGs) and superior temporal gyri (STGs) with magnetoencephalography. We compared the correct rate and brain connectivity in 9 music-majors (mean age, 23.5 ± 3.4 years; musical training period, 18.7 ± 4.0 years) and 10 non-music-majors (mean age, 25.2 ± 2.6 years; musical training period, 4.2 ± 1.5 years). For the brain connectivity, we computed the summation of partial directed coherence (PDC) values for inflows/outflows to/from each area (sPDC_i/sPDC_o) in bilateral IFGs and STGs. In the behavioral responses, music-majors were better than non-music-majors for all 3 cadences (p < 0.05). However, sPDC_i/sPDC_o was prominent only for the dominant-to-submediant in the left IFG. The sPDC_i was more strongly enhanced in music-majors than in non-music-majors (p = 0.002, Bonferroni corrected), while the sPDC_o was vice versa (p = 0.005, Bonferroni corrected). Our data show that music-majors, with higher musical expertise, are better in identifying a less unexpected cadence than non-music-majors, with connectivity changes centered on the left IFG.

Tracking Training-Related Plasticity by Combining fMRI and DTI: The Right Hemisphere Ventral Stream Mediates Musical Syntax Processing

As a functional homolog for left-hemispheric syntax processing in language, neuroimaging studies evidenced involvement of right prefrontal regions in musical syntax processing, of which underlying white matter connectivity remains unexplored so far. In the current experiment, we investigated the underlying pathway architecture in subjects with 3 levels of musical expertise. Employing diffusion tensor imaging tractography, departing from seeds from our previous functional magnetic resonance imaging study on music syntax processing in the same participants, we identified a pathway in the right ventral stream that connects the middle temporal lobe with the inferior frontal cortex via the extreme capsule, and corresponds to the left hemisphere ventral stream, classically attributed to syntax processing in language comprehension. Additional morphometric consistency analyses allowed dissociating tract core from more dispersed fiber portions. Musical expertise related to higher tract consistency of the right ventral stream pathway. Specifically, tract consistency in this pathway predicted the sensitivity for musical syntax violations. We conclude that enduring musical practice sculpts ventral stream architecture. Our results suggest that training-related pathway plasticity facilitates the right hemisphere ventral stream information transfer, supporting an improved sound-to-meaning mapping in music.

Abnormal neural responses to harmonic syntactic structures in congenital amusia

In music, harmonic syntactic structures are organized hierarchically through local and long-distance dependencies. This study investigated whether congenital amusia, a neurodevelopmental disorder of pitch perception, is associated with impaired processing of harmonic syntactic structures. For stimuli, we used harmonic sequences containing two phrases, where the first phrase ended with a half cadence and the second with an authentic cadence. In Experiment 1, we manipulated the ending chord of the authentic cadence to be either syntactically regular or irregular based on local dependencies. Sixteen amusics and 16 controls judged the expectedness of these chords while their EEG waveforms were recorded. In comparison to the regular endings, irregular endings elicited an ERAN, an N5, and a late positive component in controls but not in amusics, indicating that amusics were impaired in processing local syntactic dependencies. In Experiment 2, we manipulated the half cadence of the harmonic sequences to either adhere to or violate long-distance syntactic dependencies. In response to irregular harmonic sequences, an ERAN-like component and an N5 were elicited in controls but not in amusics, suggesting that amusics were impaired in processing long-distance syntactic dependencies. Furthermore, for controls, the neural processing of local and long-distance syntactic dependencies was correlated at the later integration stage but not at the early detection stage. These findings indicate that amusia is associated with impairment in the detection and integration of local and long-distance syntactic violations. The implications of these findings in terms of hierarchical music-syntactic processing are discussed.

Auditory rhyme processing in expert freestyle rap lyricists and novices: An ERP study

Music and language processing share and sometimes compete for brain resources. An extreme case of such shared processing occurs in improvised rap music, in which performers, or 'lyricists', combine rhyming, rhythmic, and semantic structures of language with musical rhythm, harmony, and phrasing to create integrally meaningful musical expressions. We used event-related potentials (ERPs) to investigate how auditory rhyme sequence processing differed between expert lyricists and non-lyricists. Participants listened to rhythmically presented pseudo-word triplets each of which terminated in a full-rhyme (e.g., STEEK, PREEK; FLEEK), half-rhyme (e.g., STEEK, PREEK; FREET), or non-rhyme (e.g., STEEK, PREEK; YAME), then judged each sequence in its aesthetic (Do you 'like' the rhyme?) or technical (Is the rhyme 'perfect'?) aspect. Phonological N450 showed rhyming effects between conditions (i.e., non vs. full; half vs. full; non vs. half) similarly across groups in parietal electrodes. However, concurrent activity in frontocentral electrodes showed left-laterality in non-lyricists, but not lyricists. Furthermore, non-lyricists' responses to the three conditions were distinct in morphology and amplitude at left-hemisphere electrodes with no condition difference at right-hemisphere electrodes, while lyricists' responses to half-rhymes they deemed unsatisfactory were similar to full-rhyme at left-hemisphere electrodes, and similar to non-rhyme at right-hemisphere electrodes. The CNV response observed while waiting for the second and third pseudo-word in the sequence was more enhanced to aesthetic rhyme judgments tasks than to technical rhyme judgment tasks in non-lyricists, suggesting their investment of greater effort for aesthetic rhyme judgments. No task effects were observed in lyricists, suggesting that aesthetic and technical rhyme judgments may engage the same processes for experts. Overall, our findings suggest that extensive practice of improvised lyricism may uniquely encourage the neuroplasticity of integrated linguistic and musical feature processing in the brain.

Steady-state evoked potentials distinguish brain mechanisms of self-paced versus synchronization finger tapping

Sensorimotor synchronization (SMS) requires aligning motor actions to external events and represents a core part of both musical and dance performances. In the current study, to isolate the brain mechanisms involved in synchronizing finger tapping with a musical beat, we compared SMS to pure self-paced finger tapping and listen-only conditions at different tempi. We analyzed EEG data using frequency domain steady-state evoked potentials (SSEPs) to identify sustained electrophysiological brain activity during repetitive tasks. Behavioral results revealed different timing modes between SMS and self-paced finger tapping, associated with distinct scalp topographies, thus suggesting different underlying brain sources. After subtraction of the listen-only brain activity, SMS was compared to self-paced finger tapping. Resulting source estimations showed stronger activation of the left inferior frontal gyrus during SMS, and stronger activation of the bilateral inferior parietal lobule during self-paced finger tapping. These results point to the left inferior frontal gyrus as a pivot for perception-action coupling. We discuss our findings in the context of the ongoing debate about SSEPs interpretation given the variety of brain events contributing to SSEPs and similar EEG frequency responses.

The association between singing and/or playing a musical instrument and cognitive functions in older adults

OBJECTIVES

Cognitive decline happens to everyone when aging, but to some more than others. Studies with children, adults, and professional musicians suggest that making music could be associated with better cognitive functioning. In older adults however, this association is less well investigated, which is therefore the aim of this study.

METHODS

In this cross-sectional study data from 1101 participants aged 64 and older from the Longitudinal Aging Study Amsterdam were used. Multivariable linear regression analyses were performed to test the association between making music and cognitive functioning and time spent making music and cognitive functioning. ANCOVA analyses were performed to differentiate between participants who made no music, only sang, only played an instrument or both sang and played an instrument in terms of cognitive functioning.

RESULTS

Making music was significantly positively associated with letter fluency, learning and attention/short-term memory. Time spent making music yielded no significant results. The ANCOVA analyses showed higher scores for participants who only played an instrument compared to participants who made no music on learning, working memory and processing speed. For processing speed the instrument only group also had a higher score than participants who only sang.

DISCUSSION

Making music at least once every two weeks and especially playing a musical instrument, is associated with better attention, episodic memory and executive functions. The results suggest that making music might be a potential protective factor for cognitive decline; however, to support this notion a longitudinal study design is needed.

Dorsolateral Prefrontal Transcranial Direct Current Stimulation Modulates Language Processing but Does Not Facilitate Overt Second Language Word Production

Word retrieval in bilingual speakers partly depends on executive control systems in the left prefrontal cortex - including dorsolateral prefrontal cortex (DLPFC). We tested the hypothesis that DLPFC modulates word production of words specifically in a second language (L2) by measuring the effects of anodal transcranial direct current stimulation (anodal-tDCS) over the DLPFC on picture naming and word translation and on event-related potentials (ERPs) and their sources. Twenty-six bilingual participants with "unbalanced" proficiency in two languages were given 20 min of 1.5 mA anodal or sham tDCS (double-blind stimulation design, counterbalanced stimulation order, 1-week intersession delay). The participants then performed the following tasks: verbal and non-verbal fluency during anodal-tDCS stimulation and first and second language (L1 and L2) picture naming and translation [forward (L1 → L2) and backward (L2 → L1)] immediately after stimulation. The electroencephalogram (EEG) was recorded during picture naming and translation. On the behavioral level, anodal-tDCS had an influence on non-verbal fluency but neither on verbal fluency, nor on picture naming and translation. EEG measures revealed significant interactions between Language and Stimulation on picture naming around 380 ms post-stimulus onset and Translation direction and Stimulation on translation around 530 ms post-stimulus onset. These effects suggest that L2 phonological retrieval and phoneme encoding are spatially and temporally segregated in the brain. We conclude that anodal-tDCS stimulation has an effect at a neural level on phonological processes and, critically, that DLPFC-mediated activation is a constraint on language production specifically in L2.

Electrical Neuroimaging of Music Processing Reveals Mid-Latency Changes with Level of Musical Expertise

This original research focused on the effect of musical training intensity on cerebral and behavioral processing of complex music using high-density event-related potential (ERP) approaches. Recently we have been able to show progressive changes with training in gray and white matter, and higher order brain functioning using (f)MRI [(functional) Magnetic Resonance Imaging], as well as changes in musical and general cognitive functioning. The current study investigated the same population of non-musicians, amateur pianists and expert pianists using spatio-temporal ERP analysis, by means of microstate analysis, and ERP source imaging. The stimuli consisted of complex musical compositions containing three levels of transgression of musical syntax at closure that participants appraised. ERP waveforms, microstates and underlying brain sources revealed gradual differences according to musical expertise in a 300–500 ms window after the onset of the terminal chords of the pieces. Within this time-window, processing seemed to concern context-based memory updating, indicated by a P3b-like component or microstate for which underlying sources were localized in the right middle temporal gyrus, anterior cingulate and right parahippocampal areas. Given that the 3 expertise groups were carefully matched for demographic factors, these results provide evidence of the progressive impact of training on brain and behavior.

Towards Tunable Consensus Clustering for Studying Functional Brain Connectivity During Affective Processing

In the past decades, neuroimaging of humans has gained a position of status within neuroscience, and data-driven approaches and functional connectivity analyses of functional magnetic resonance imaging (fMRI) data are increasingly favored to depict the complex architecture of human brains. However, the reliability of these findings is jeopardized by too many analysis methods and sometimes too few samples used, which leads to discord among researchers. We propose a tunable consensus clustering paradigm that aims at overcoming the clustering methods selection problem as well as reliability issues in neuroimaging by means of first applying several analysis methods (three in this study) on multiple datasets and then integrating the clustering results. To validate the method, we applied it to a complex fMRI experiment involving affective processing of hundreds of music clips. We found that brain structures related to visual, reward, and auditory processing have intrinsic spatial patterns of coherent neuroactivity during affective processing. The comparisons between the results obtained from our method and those from each individual clustering algorithm demonstrate that our paradigm has notable advantages over traditional single clustering algorithms in being able to evidence robust connectivity patterns even with complex neuroimaging data involving a variety of stimuli and affective evaluations of them. The consensus clustering method is implemented in the R package “UNCLES” available on http://cran.r-project.org/web/packages/UNCLES/index.html .

It's Sad but I Like It: The Neural Dissociation Between Musical Emotions and Liking in Experts and Laypersons

Emotion-related areas of the brain, such as the medial frontal cortices, amygdala, and striatum, are activated during listening to sad or happy music as well as during listening to pleasurable music. Indeed, in music, like in other arts, sad and happy emotions might co-exist and be distinct from emotions of pleasure or enjoyment. Here we aimed at discerning the neural correlates of sadness or happiness in music as opposed those related to musical enjoyment. We further investigated whether musical expertise modulates the neural activity during affective listening of music. To these aims, 13 musicians and 16 non-musicians brought to the lab their most liked and disliked musical pieces with a happy and sad connotation. Based on a listening test, we selected the most representative 18 sec excerpts of the emotions of interest for each individual participant. Functional magnetic resonance imaging (fMRI) recordings were obtained while subjects listened to and rated the excerpts. The cortico-thalamo-striatal reward circuit and motor areas were more active during liked than disliked music, whereas only the auditory cortex and the right amygdala were more active for disliked over liked music. These results discern the brain structures responsible for the perception of sad and happy emotions in music from those related to musical enjoyment. We also obtained novel evidence for functional differences in the limbic system associated with musical expertise, by showing enhanced liking-related activity in fronto-insular and cingulate areas in musicians.

Temporal dynamics of musical emotions examined through intersubject synchrony of brain activity

To study emotional reactions to music, it is important to consider the temporal dynamics of both affective responses and underlying brain activity. Here, we investigated emotions induced by music using functional magnetic resonance imaging (fMRI) with a data-driven approach based on intersubject correlations (ISC). This method allowed us to identify moments in the music that produced similar brain activity (i.e. synchrony) among listeners under relatively natural listening conditions. Continuous ratings of subjective pleasantness and arousal elicited by the music were also obtained for the music outside of the scanner. Our results reveal synchronous activations in left amygdala, left insula and right caudate nucleus that were associated with higher arousal, whereas positive valence ratings correlated with decreases in amygdala and caudate activity. Additional analyses showed that synchronous amygdala responses were driven by energy-related features in the music such as root mean square and dissonance, while synchrony in insula was additionally sensitive to acoustic event density. Intersubject synchrony also occurred in the left nucleus accumbens, a region critically implicated in reward processing. Our study demonstrates the feasibility and usefulness of an approach based on ISC to explore the temporal dynamics of music perception and emotion in naturalistic conditions.

Neuroplasticity beyond Sounds: Neural Adaptations Following Long-Term Musical Aesthetic Experiences

Capitalizing from neuroscience knowledge on how individuals are affected by the sound environment, we propose to adopt a cybernetic and ecological point of view on the musical aesthetic experience, which includes subprocesses, such as feature extraction and integration, early affective reactions and motor actions, style mastering and conceptualization, emotion and proprioception, evaluation and preference. In this perspective, the role of the listener/composer/performer is seen as that of an active “agent” coping in highly individual ways with the sounds. The findings concerning the neural adaptations in musicians, following long-term exposure to music, are then reviewed by keeping in mind the distinct subprocesses of a musical aesthetic experience. We conclude that these neural adaptations can be conceived of as the immediate and lifelong interactions with multisensorial stimuli (having a predominant auditory component), which result in lasting changes of the internal state of the “agent”. In a continuous loop, these changes affect, in turn, the subprocesses involved in a musical aesthetic experience, towards the final goal of achieving better perceptual, motor and proprioceptive responses to the immediate demands of the sounding environment. The resulting neural adaptations in musicians closely depend on the duration of the interactions, the starting age, the involvement of attention, the amount of motor practice and the musical genre played.

Intracranial markers of emotional valence processing and judgments in music

The involvement of the amygdala and orbitofrontal cortex in the processing of valenced stimuli is well established. However, less is known about the extent to which activity in these regions reflects a stimulus' physical properties, the individual subjective experience it evokes, or both. We recorded cortical electrical activity from five epileptic patients implanted with depth electrodes for presurgical evaluation while they rated "consonant" and "dissonant" musical chords using a "pleasantness" scale. We compared the pattern of responses in the amygdala and orbitofrontal cortex when trials were sorted by pleasantness judgments relative to when they were sorted by the acoustic properties known to influence emotional reactions to musical chords. This revealed earlier differential activity in the amygdala in the physical properties-based, relative to in the judgment-based, analyses. Thus, our results demonstrate that the amygdala has, first and foremost, a high initial sensitivity to the physical properties of valenced stimuli. The finding that differentiations in the amygdala based on pleasantness ratings had a longer latency suggests that in this structure, mediation of emotional judgment follows accumulation of sensory information. This is in contrast to the orbitofrontal cortex where sensitivity to sensory information did not precede differentiation based on affective judgments.

The role of the medial temporal limbic system in processing emotions in voice and music

Subcortical brain structures of the limbic system, such as the amygdala, are thought to decode the emotional value of sensory information. Recent neuroimaging studies, as well as lesion studies in patients, have shown that the amygdala is sensitive to emotions in voice and music. Similarly, the hippocampus, another part of the temporal limbic system (TLS), is responsive to vocal and musical emotions, but its specific roles in emotional processing from music and especially from voices have been largely neglected. Here we review recent research on vocal and musical emotions, and outline commonalities and differences in the neural processing of emotions in the TLS in terms of emotional valence, emotional intensity and arousal, as well as in terms of acoustic and structural features of voices and music. We summarize the findings in a neural framework including several subcortical and cortical functional pathways between the auditory system and the TLS. This framework proposes that some vocal expressions might already receive a fast emotional evaluation via a subcortical pathway to the amygdala, whereas cortical pathways to the TLS are thought to be equally used for vocal and musical emotions. While the amygdala might be specifically involved in a coarse decoding of the emotional value of voices and music, the hippocampus might process more complex vocal and musical emotions, and might have an important role especially for the decoding of musical emotions by providing memory-based and contextual associations.

Electrophysiological evidence for a specific neural correlate of musical violation expectation in primary-school children

The majority of studies on music processing in children used simple musical stimuli. Here, primary schoolchildren judged the appropriateness of musical closure in expressive polyphone music, while high-density electroencephalography was recorded. Stimuli ended either regularly or contained refined in-key harmonic transgressions at closure. The children discriminated the transgressions well above chance. Regular and transgressed endings evoked opposite scalp voltage configurations peaking around 400ms after stimulus onset with bilateral frontal negativity for regular and centro-posterior negativity (CPN) for transgressed endings. A positive correlation could be established between strength of the CPN response and rater sensitivity (d-prime). We also investigated whether the capacity to discriminate the transgressions was supported by auditory domain specific or general cognitive mechanisms, and found that working memory capacity predicted transgression discrimination. Latency and distribution of the CPN are reminiscent of the N400, typically observed in response to semantic incongruities in language. Therefore our observation is intriguing, as the CPN occurred here within an intra-musical context, without any symbols referring to the external world. Moreover, the harmonic in-key transgressions that we implemented may be considered syntactical as they transgress structural rules. Such structural incongruities in music are typically followed by an early right anterior negativity (ERAN) and an N5, but not so here. Putative contributive sources of the CPN were localized in left pre-motor, mid-posterior cingulate and superior parietal regions of the brain that can be linked to integration processing. These results suggest that, at least in children, processing of syntax and meaning may coincide in complex intra-musical contexts.

Statistical learning of serial visual transitions by neurons in monkey inferotemporal cortex

If monkeys repeatedly, over the course of weeks, view displays in which two images appear in fixed sequence, then neurons of inferotemporal cortex (ITC) come to exhibit prediction suppression. The response to the trailing image is weaker if it follows the leading image with which it was paired during training than if it follows some other leading image. Prediction suppression is a plausible neural mechanism for statistical learning of visual transitions such as has been demonstrated in behavioral studies of human infants and adults. However, in the human studies, subjects are exposed to continuous sequences in which the same image can be both predicted and predicting and statistical dependency can exist between nonadjacent items. The aim of the present study was to investigate whether prediction suppression in ITC develops under such circumstances. To resolve this issue, we exposed monkeys repeatedly to triplets of images presented in fixed order. The results indicate that prediction suppression can be induced by training not only with pairs of images but also with longer sequences.

An Intracranial EEG Study of the Neural Dynamics of Musical Valence Processing

The processing of valence is known to recruit the amygdala, orbitofrontal cortex, and relevant sensory areas. However, how these regions interact remains unclear. We recorded cortical electrical activity from 7 epileptic patients implanted with depth electrodes for presurgical evaluation while they listened to positively and negatively valenced musical chords. Time-frequency analysis suggested a specific role of the orbitofrontal cortex in the processing of positively valenced stimuli while, most importantly, Granger causality analysis revealed that the amygdala tends to drive both the orbitofrontal cortex and the auditory cortex in theta and alpha frequency bands, during the processing of valenced stimuli. Results from the current study show the amygdala to be a critical hub in the emotion processing network: specifically one that influences not only the higher order areas involved in the evaluation of a stimulus's emotional value but also the sensory cortical areas involved in the processing of its low-level acoustic features.

EEG-microstate dependent emergence of perceptual awareness

We investigated whether the differences in perceptual awareness for stimuli at the threshold of awareness can arise from different global brain states before stimulus onset indexed by the EEG microstate. We used a metacontrast backward masking paradigm in which subjects had to discriminate between two weak stimuli and obtained measures of accuracy and awareness while their EEG was recorded from 256 channels. Comparing targets that were correctly identified with and without awareness allowed us to contrast differences in awareness while keeping performance constant for identical physical stimuli. Two distinct pre-stimulus scalp potential fields (microstate maps) dissociated correct identification with and without awareness, and their estimated intracranial generators were stronger in primary visual cortex before correct identification without awareness. This difference in activity cannot be explained by differences in alpha power or phase which were less reliably linked with differential pre-stimulus activation of primary visual cortex. Our results shed a new light on the function of pre-stimulus activity in early visual cortex in visual awareness and emphasize the importance of trial-by-trials analysis of the spatial configuration of the scalp potential field identified with multichannel EEG.

The role of functional neuroimaging in pre-surgical epilepsy evaluation

The prevalence of epilepsy is about 1% and one-third of cases do not respond to medical treatment. In an eligible subset of patients with drug-resistant epilepsy, surgical resection of the epileptogenic zone is the only treatment that can possibly cure the disease. Non-invasive techniques provide information for the localization of the epileptic focus in the majority of cases, whereas in others invasive procedures are required. In the last years, non-invasive neuroimaging techniques, such as simultaneous recording of functional magnetic resonance imaging and electroencephalogram (EEG-fMRI), positron emission tomography (PET), single photon emission computed tomography (SPECT), electric and magnetic source imaging (MSI, ESI), spectroscopy (MRS), have proved their usefulness in defining the epileptic focus. The combination of these functional techniques can yield complementary information and their concordance is crucial for guiding clinical decision, namely the planning of invasive EEG recordings or respective surgery. The aim of this review is to present these non-invasive neuroimaging techniques, their potential combination, and their role in the pre-surgical evaluation of patients with pharmaco-resistant epilepsy.

Cerebral activations related to audition-driven performance imagery in professional musicians

Functional Magnetic Resonance Imaging (fMRI) was used to study the activation of cerebral motor networks during auditory perception of music in professional keyboard musicians (n = 12). The activation paradigm implied that subjects listened to two-part polyphonic music, while either critically appraising the performance or imagining they were performing themselves. Two-part polyphonic audition and bimanual motor imagery circumvented a hemisphere bias associated with the convention of playing the melody with the right hand. Both tasks activated ventral premotor and auditory cortices, bilaterally, and the right anterior parietal cortex, when contrasted to 12 musically unskilled controls. Although left ventral premotor activation was increased during imagery (compared to judgment), bilateral dorsal premotor and right posterior-superior parietal activations were quite unique to motor imagery. The latter suggests that musicians not only recruited their manual motor repertoire but also performed a spatial transformation from the vertically perceived pitch axis (high and low sound) to the horizontal axis of the keyboard. Imagery-specific activations in controls were seen in left dorsal parietal-premotor and supplementary motor cortices. Although these activations were less strong compared to musicians, this overlapping distribution indicated the recruitment of a general 'mirror-neuron' circuitry. These two levels of sensori-motor transformations point towards common principles by which the brain organizes audition-driven music performance and visually guided task performance.

The role of functional neuroimaging in pre-surgical epilepsy evaluation

The prevalence of epilepsy is about 1% and one-third of cases do not respond to medical treatment. In an eligible subset of patients with drug-resistant epilepsy, surgical resection of the epileptogenic zone is the only treatment that can possibly cure the disease. Non-invasive techniques provide information for the localization of the epileptic focus in the majority of cases, whereas in others invasive procedures are required. In the last years, non-invasive neuroimaging techniques, such as simultaneous recording of functional magnetic resonance imaging and electroencephalogram (EEG-fMRI), positron emission tomography (PET), single photon emission computed tomography (SPECT), electric and magnetic source imaging (MSI, ESI), spectroscopy (MRS), have proved their usefulness in defining the epileptic focus. The combination of these functional techniques can yield complementary information and their concordance is crucial for guiding clinical decision, namely the planning of invasive EEG recordings or respective surgery. The aim of this review is to present these non-invasive neuroimaging techniques, their potential combination, and their role in the pre-surgical evaluation of patients with pharmaco-resistant epilepsy.

Professional musicians listen differently to music

INTRODUCTION

Experience-based adaptation of emotional responses is an important faculty for cognitive and emotional functioning. Professional musicians represent an ideal model in which to elicit experience-driven changes in the emotional processing domain. The changes of the central representation of emotional arousal due to musical expertise are still largely unknown. The aim of the present study was to investigate the electroencephalogram (EEG) correlates of experience-driven changes in the domain of emotional arousal. Therefore, the differences in perceived (subjective arousal via ratings) and physiologically measured (EEG) arousal between amateur and professional musicians were examined.

PROCEDURE

A total of 15 professional and 19 amateur musicians listened to the first movement of Ludwig van Beethoven's 5th symphony (duration=∼7.4min), during which a continuous 76-channel EEG was recorded. In a second session, the participants evaluated their emotional arousal during listening. In a tonic analysis, we examined the average EEG data over the time course of the music piece. For a phasic analysis, a fast Fourier transform was performed and covariance maps of spectral power were computed in association with the subjective arousal ratings.

RESULTS

The subjective arousal ratings of the professional musicians were more consistent than those of the amateur musicians. In the tonic EEG analysis, a mid-frontal theta activity was observed in the professionals. In the phasic EEG, the professionals exhibited an increase of posterior alpha, central delta, and beta rhythm during high arousal.

DISCUSSION

Professionals exhibited different and/or more intense patterns of emotional activation when they listened to the music. The results of the present study underscore the impact of music experience on emotional reactions.

Audio-tactile integration and the influence of musical training

Perception of our environment is a multisensory experience; information from different sensory systems like the auditory, visual and tactile is constantly integrated. Complex tasks that require high temporal and spatial precision of multisensory integration put strong demands on the underlying networks but it is largely unknown how task experience shapes multisensory processing. Long-term musical training is an excellent model for brain plasticity because it shapes the human brain at functional and structural levels, affecting a network of brain areas. In the present study we used magnetoencephalography (MEG) to investigate how audio-tactile perception is integrated in the human brain and if musicians show enhancement of the corresponding activation compared to non-musicians. Using a paradigm that allowed the investigation of combined and separate auditory and tactile processing, we found a multisensory incongruency response, generated in frontal, cingulate and cerebellar regions, an auditory mismatch response generated mainly in the auditory cortex and a tactile mismatch response generated in frontal and cerebellar regions. The influence of musical training was seen in the audio-tactile as well as in the auditory condition, indicating enhanced higher-order processing in musicians, while the sources of the tactile MMN were not influenced by long-term musical training. Consistent with the predictive coding model, more basic, bottom-up sensory processing was relatively stable and less affected by expertise, whereas areas for top-down models of multisensory expectancies were modulated by training.

Activation of the left superior temporal gyrus of musicians by music-derived sounds

Previous studies have suggested that professional musicians comprehend features of music-derived sound even if the sound sequence lacks the traditional temporal structure of music. We tested this hypothesis through behavioral and functional brain imaging experiments. Musicians were better than nonmusicians at identifying scrambled pieces of piano music in which the original temporal structure had been destroyed. Bilateral superior temporal gyri (STG) activity was observed while musicians listened to the scrambled stimuli, whereas this activity was present only in the right STG of nonmusicians under the same experimental conditions. We suggest that left STG activation is related to the processing of deviants, which appears to be enhanced in musicians. This may be because of the superior knowledge of musical temporal structure held by this population.

Hippocampal volume predicts fluid intelligence in musically trained people

Recently, age-related hippocampal (HP) volume loss could be associated with a decrease in general fluid intelligence (gF). In the present study we investigated whether and how extensive musical training modulates human HP volume and gF performance. Previously, some studies demonstrated positive effects of musical training on higher cognitive functions such as learning and memory, associated with neural adaptations beyond the auditory domain. In order to detect possible associations between musical training and gF, we bilaterally segmented the HP formation and assessed the individual gF performance of people with different levels of musical expertise. Multiple regression analyses revealed that HP volume predicts gF in musicians but not in nonmusicians; in particular, bilaterally enhanced HP volume is associated with increased gF exclusively in musically trained people (amateurs and experts). This result suggests that musical training facilitates the recruitment of cognitive resources, which are essential for gF and linked to HP functioning. Musical training, even at a moderate level of intensity, can thus be considered as a potential strategy to decelerate age-related effects of cognitive decline.

Degree of musical expertise modulates higher order brain functioning

Using functional magnetic resonance imaging, we show for the first time that levels of musical expertise stepwise modulate higher order brain functioning. This suggests that degree of training intensity drives such cerebral plasticity. Participants (non-musicians, amateurs, and expert musicians) listened to a comprehensive set of specifically composed string quartets with hierarchically manipulated endings. In particular, we implemented 2 irregularities at musical closure that differed in salience but were both within the tonality of the piece (in-key). Behavioral sensitivity scores (d') of both transgressions perfectly separated participants according to their level of musical expertise. By contrasting brain responses to harmonic transgressions against regular endings, functional brain imaging data showed compelling evidence for stepwise modulation of brain responses by both violation strength and expertise level in a fronto-temporal network hosting universal functions of working memory and attention. Additional independent testing evidenced an advantage in visual working memory for the professionals, which could be predicted by musical training intensity. The here introduced findings of brain plasticity demonstrate the progressive impact of musical training on cognitive brain functions that may manifest well beyond the field of music processing.

Music listening after stroke: beneficial effects and potential neural mechanisms

Music is an enjoyable leisure activity that also engages many emotional, cognitive, and motor processes in the brain. Here, we will first review previous literature on the emotional and cognitive effects of music listening in healthy persons and various clinical groups. Then we will present findings about the short- and long-term effects of music listening on the recovery of cognitive function in stroke patients and the underlying neural mechanisms of these music effects. First, our results indicate that listening to pleasant music can have a short-term facilitating effect on visual awareness in patients with visual neglect, which is associated with functional coupling between emotional and attentional brain regions. Second, daily music listening can improve auditory and verbal memory, focused attention, and mood as well as induce structural gray matter changes in the early poststroke stage. The psychological and neural mechanisms potentially underlying the rehabilitating effect of music after stroke are discussed.

Training of tonal similarity ratings in non-musicians: a "rapid learning" approach

Although cognitive music psychology has a long tradition of expert-novice comparisons, experimental training studies are rare. Studies on the learning progress of trained novices in hearing harmonic relationships are still largely lacking. This paper presents a simple training concept using the example of tone/triad similarity ratings, demonstrating the gradual progress of non-musicians compared to musical experts: In a feedback-based "rapid learning" paradigm, participants had to decide for single tones and chords whether paired sounds matched each other well. Before and after the training sessions, they provided similarity judgments for a complete set of sound pairs. From these similarity matrices, individual relational sound maps, intended to display mental representations, were calculated by means of non-metric multidimensional scaling (NMDS), and were compared to an expert model through procrustean transformation. Approximately half of the novices showed substantial learning success, with some participants even reaching the level of professional musicians. Results speak for a fundamental ability to quickly train an understanding of harmony, show inter-individual differences in learning success, and demonstrate the suitability of the scaling method used for learning research in music and other domains. Results are discussed in the context of the "giftedness" debate.

A strong parietal hub in the small-world network of coloured-hearing synaesthetes during resting state EEG

We investigated whether functional brain networks are different in coloured-hearing synaesthetes compared with non-synaesthetes. Based on resting state electroencephalographic (EEG) activity, graph-theoretical analysis was applied to functional connectivity data obtained from different frequency bands (theta, alpha1, alpha2, and beta) of 12 coloured-hearing synaesthetes and 13 non-synaesthetes. The analysis of functional connectivity was based on estimated intra-cerebral sources of brain activation using standardized low-resolution electrical tomography. These intra-cerebral sources of brain activity were subjected to graph-theoretical analysis yielding measures representing small-world network characteristics (cluster coefficients and path length). In addition, brain regions with strong interconnections were identified (so-called hubs), and the interconnectedness of these hubs were quantified using degree as a measure of connectedness. Our analysis was guided by the two-stage model proposed by Hubbard and Ramachandran (2005). In this model, the parietal lobe is thought to play a pivotal role in binding together the synaesthetic perceptions (hyperbinding). In addition, we hypothesized that the auditory cortex and the fusiform gyrus would qualify as strong hubs in synaesthetes. Although synaesthetes and non-synaesthetes demonstrated a similar small-world network topology, the parietal lobe turned out to be a stronger hub in synaesthetes than in non-synaesthetes supporting the two-stage model. The auditory cortex was also identified as a strong hub in these coloured-hearing synaesthetes (for the alpha2 band). Thus, our a priori hypotheses receive strong support. Several additional hubs (for which no a priori hypothesis has been formulated) were found to be different in terms of the degree measure in synaesthetes, with synaesthetes demonstrating stronger degree measures indicating stronger interconnectedness. These hubs were found in brain areas known to be involved in controlling memory processes (alpha1: hippocampus and retrosplenial area), executive functions (alpha1 and alpha2: ventrolateral prefrontal cortex; theta: inferior frontal cortex), and the generation of perceptions (theta: extrastriate cortex; beta: subcentral area). Taken together this graph-theoretical analysis of the resting state EEG supports the two-stage model in demonstrating that the left-sided parietal lobe is a strong hub region, which is stronger functionally interconnected in synaesthetes than in non-synaesthetes. The right-sided auditory cortex is also a strong hub supporting the idea that coloured-hearing synaesthetes demonstrate a specific auditory cortex. A further important point is that these hub regions are even differently operating at rest supporting the idea that these hub characteristics are predetermining factors of coloured-hearing synaesthesia.

Intrinsic Emotional Relevance of Outcomes and Prediction Error

Infrequent events, such as unexpected absence of outcomes (prediction errors), have a detrimental effect on performance of subsequent trial in various cognitive tasks. In the present event-related potential study, we tested whether the influence of prediction error manifests itself in the early cortical processing of subsequent stimuli. Participants performed a reversal learning task in which they saw two alternating pairs of faces and indicated for each pair which one would have a declared target stimulus on its nose. The target switched to the other face after several consecutive trials with correct response, thereby inducing a prediction error, with the switch being indicated by the appearance of a disk (unexpected neutral outcome) or a spider (unexpected unpleasant outcome), depending on the condition. Results showed that after both unexpected and expected unpleasant outcomes, the amplitude of P2 decreased, while after both unexpected neutral and unpleasant outcomes, the amplitude of P1 increased on the following presentation of the pair of faces. Source localization analysis suggested that the differences mainly emanated from the cuneus and precuneus with respect to the P1 and P2 time ranges respectively. We conclude that both the intrinsic emotional relevance of outcomes and prediction error may modulate attention allocation.

Appraisal of Musical Syntax Violations by Primary School Children

In Western tonal music, musical phrases end with an explicit, highly expected, harmonic consequent. Primary school children were exposed to musical stimuli at two levels of complexity: children’s songs and polyphonic piano pieces. The endings (cadences) of all stimuli were either congruous or contained subtle or marked syntax violations, resulting in three levels of syntactic congruity. The children rated the endings of musical stimuli with respect to goodness of fit by drawing a crossbar through a continuous line stretching between a happy and a sad icon. All children, independent of age, rated the three levels of syntactic congruity hierarchically, for both levels of complexity. Compared to younger children, older children gave more extreme positive and negative ratings to congruous and markedly incongruous endings, respectively, but no developmental trend was found for the intermediate ratings of subtly incongruous endings. We conclude that, as a consequence of mere exposure, implicit learning of musical syntax manifests already in 6-year-old children and develops progressively with age. Moreover, we found indications of modulation of this perceptual development by musical training, an effect reminiscent of the interaction between long-term spontaneous developmental processes and deliberate learning in general cognitive functioning.