The Promises of Change-Related Brain Potentials in Cognitive Neuroscience of Music

Mismatch negativity as a marker of auditory pattern separation

To what extent does incidental encoding of auditory stimuli influence subsequent episodic memory for the same stimuli? We examined whether the mismatch negativity (MMN), an event-related potential generated by auditory change detection, is correlated with participants' ability to discriminate those stimuli (i.e. targets) from highly similar lures and from dissimilar foils. We measured the MMN in 30 young adults (18-32 years, 18 females) using a passive auditory oddball task with standard and deviant 5-tone sequences differing in pitch contour. After exposure, all participants completed an incidental memory test for old targets, lures, and foils. As expected, participants at test exhibited high sensitivity in recognizing target items relative to foils and lower sensitivity in recognizing target items relative to lures. Notably, we found a significant correlation between MMN amplitude and lure discrimination, but not foil discrimination. Our investigation shows that our capacity to discriminate sensory inputs at encoding, as measured by the MMN, translates into precision in memory for those inputs.

The neuroscience of music – towards ecological validity

Studies in the neuroscience of music gained momentum in the 1990s as an integrated part of the well-controlled experimental research tradition. However, during the past two decades, these studies have moved toward more naturalistic, ecologically valid paradigms. Here, I introduce this move in three frameworks: (i) sound stimulation and empirical paradigms, (ii) study participants, and (iii) methods and contexts of data acquisition. I wish to provide a narrative historical overview of the development of the field and, in parallel, to stimulate innovative thinking to further advance the ecological validity of the studies without overlooking experimental rigor.

Early neural responses underlie advantages for consonance over dissonance

Consonant musical intervals tend to be more readily processed than dissonant intervals. In the present study, we explore the neural basis for this difference by registering how the brain responds after changes in consonance and dissonance, and how formal musical training modulates these responses. Event-related brain potentials (ERPs) were registered while participants were presented with sequences of consonant intervals interrupted by a dissonant interval, or sequences of dissonant intervals interrupted by a consonant interval. Participants were musicians and non-musicians. Our results show that brain responses triggered by changes in a consonant context differ from those triggered in a dissonant context. Changes in a sequence of consonant intervals are rapidly processed independently of musical expertise, as revealed by a change-related mismatch negativity (MMN, a component of the ERPs triggered by an odd stimulus in a sequence of stimuli) elicited in both musicians and non-musicians. In contrast, changes in a sequence of dissonant intervals elicited a late MMN only in participants with prolonged musical training. These different neural responses might form the basis for the processing advantages observed for consonance over dissonance and provide information about how formal musical training modulates them.

•

We registered ERPs after deviant intervals in consonant and dissonant sequences.

•

Violations of consonant sequences are detected independently of musical expertise.

•

Musical training modulates responses to violations of dissonant sequences.

•

These neural responses might form the basis for a processing advantage of consonance.

Influence of Musical Enculturation on Brain Responses to Metric Deviants

The ability to recognize metric accents is fundamental in both music and language perception. It has been suggested that music listeners prefer rhythms that follow simple binary meters, which are common in Western music. This means that listeners expect odd-numbered beats to be strong and even-numbered beats to be weak. In support of this, studies have shown that listeners exposed to Western music show stronger novelty and incongruity related P3 and irregularity detection related mismatch negativity (MMN) brain responses to attenuated odd- than attenuated even-numbered metric positions. Furthermore, behavioral evidence suggests that music listeners' preferences can be changed by long-term exposure to non-Western rhythms and meters, e.g., by listening to African or Balkan music. In our study, we investigated whether it might be possible to measure effects of music enculturation on neural responses to attenuated tones on specific metric positions. We compared the magnetic mismatch negativity (MMNm) to attenuated beats in a “Western group” of listeners (n = 12) mainly exposed to Western music and a “Bicultural group” of listeners (n = 13) exposed for at least 1 year to both Sub-Saharan African music in addition to Western music. We found that in the “Western group” the MMNm was higher in amplitude to deviant tones on odd compared to even metric positions, but not in the “Bicultural group.” In support of this finding, there was also a trend of the “Western group” to rate omitted beats as more surprising on odd than even metric positions, whereas the “Bicultural group” seemed to discriminate less between metric positions in terms of surprise ratings. Also, we observed that the overall latency of the MMNm was significantly shorter in the Bicultural group compared to the Western group. These effects were not biased by possible differences in rhythm perception ability or music training, measured with the Musical Ear Test (MET). Furthermore, source localization analyses suggest that auditory, inferior temporal, sensory-motor, superior frontal, and parahippocampal regions might be involved in eliciting the MMNm to the metric deviants. These findings suggest that effects of music enculturation can be measured on MMNm responses to attenuated tones on specific metric positions.

Vowel-speech versus pure-tone processing in healthy subjects

To investigate the characteristics of speech perception, we evaluated the differences in mismatch negativity (MMN) between vowel change and frequency change. Additionally, we examined the effects of gender, age, and educational length on MMN. Forty healthy adults (21 females), who were native Japanese speakers, participated in the study. A Japanese vowel-speech pair (standard/a/vs. deviant/o/) and a pure-tone pair (standard 1000 Hz vs. deviant 1050 Hz) were constructed. MMN elicited by vowel-speech sounds was larger and earlier compared with pure-tone sounds. Larger and earlier MMNs for vowel-speech sounds than for pure-tone sounds suggest different processing of linguistically relevant information at the early stage in the auditory cortex. In conclusion, the factors influencing on MMN are different between vowel-speech sounds and pure-tone sounds.

Toward a neural basis of music perception - a review and updated model

Music perception involves acoustic analysis, auditory memory, auditory scene analysis, processing of interval relations, of musical syntax and semantics, and activation of (pre)motor representations of actions. Moreover, music perception potentially elicits emotions, thus giving rise to the modulation of emotional effector systems such as the subjective feeling system, the autonomic nervous system, the hormonal, and the immune system. Building on a previous article (Koelsch and Siebel, 2005), this review presents an updated model of music perception and its neural correlates. The article describes processes involved in music perception, and reports EEG and fMRI studies that inform about the time course of these processes, as well as about where in the brain these processes might be located.

Top-down modulation of auditory processing: effects of sound context, musical expertise and attentional focus

By recording auditory electrical brain potentials, we investigated whether the basic sound parameters (frequency, duration and intensity) are differentially encoded among speech vs. music sounds by musicians and non-musicians during different attentional demands. To this end, a pseudoword and an instrumental sound of comparable frequency and duration were presented. The accuracy of neural discrimination was tested by manipulations of frequency, duration and intensity. Additionally, the subjects' attentional focus was manipulated by instructions to ignore the sounds while watching a silent movie or to attentively discriminate the different sounds. In both musicians and non-musicians, the pre-attentively evoked mismatch negativity (MMN) component was larger to slight changes in music than in speech sounds. The MMN was also larger to intensity changes in music sounds and to duration changes in speech sounds. During attentional listening, all subjects more readily discriminated changes among speech sounds than among music sounds as indexed by the N2b response strength. Furthermore, during attentional listening, musicians displayed larger MMN and N2b than non-musicians for both music and speech sounds. Taken together, the data indicate that the discriminative abilities in human audition differ between music and speech sounds as a function of the sound-change context and the subjective familiarity of the sound parameters. These findings provide clear evidence for top-down modulatory effects in audition. In other words, the processing of sounds is realized by a dynamically adapting network considering type of sound, expertise and attentional demands, rather than by a strictly modularly organized stimulus-driven system.

A mismatch negativity study of local-global auditory processing

We used mismatch negativity (MMN) to examine structural encoding of local and global auditory patterns in perceptual memory. Unlike previous MMN studies of local-global auditory perceptual organization that used interval-contour stimuli, here we presented hierarchical stimuli in which local pattern organization formed global patterns. Importantly, our stimuli allowed independent manipulation of the two structural levels. In separate blocks, participants were exposed to frequent local standard patterns and rare local deviant patterns, or to frequent global standard patterns and rare global deviant patterns. Within each deviant pattern, the variation from the standard pattern could occur at onset (early), towards the end of the pattern (late) or over both time windows (both). To isolate pattern indexing at one level, the other level continuously changed (e.g., in a global standard block, local elements varied trial-by-trial). MMN was found only for global deviant patterns, and only when deviation occurred late in the pattern. In a separate behavioral experiment, global deviants were detected more often than local ones, although initial similarity followed by a late deviation from the standard pattern was not required for explicit deviant detection (as with the MMN). This report demonstrates neural structural encoding for global information, when independently manipulated from local information. Furthermore, it extends previous MMN findings that have revealed indexing of complex abstract auditory information to the realm of hierarchical perceptual organization.

From air oscillations to music and speech: functional magnetic resonance imaging evidence for fine-tuned neural networks in audition

In the auditory modality, music and speech have high informational and emotional value for human beings. However, the degree of the functional specialization of the cortical and subcortical areas in encoding music and speech sounds is not yet known. We investigated the functional specialization of the human auditory system in processing music and speech by functional magnetic resonance imaging recordings. During recordings, the subjects were presented with saxophone sounds and pseudowords /ba:ba/ with comparable acoustical content. Our data show that areas encoding music and speech sounds differ in the temporal and frontal lobes. Moreover, slight variations in sound pitch and duration activated thalamic structures differentially. However, this was the case with speech sounds only while no such effect was evidenced with music sounds. Thus, our data reveal the existence of a functional specialization of the human brain in accurately representing sound information at both cortical and subcortical areas. They indicate that not only the sound category (speech/music) but also the sound parameter (pitch/duration) can be selectively encoded.

Does familiarity facilitate the cortical processing of music sounds?

Automatic cortical sound discrimination, as indexed by the mismatch negativity (MMN) component of the auditory evoked potential, is facilitated for familiar speech sounds (phonemes). In musicians as compared to non-musicians, an enhanced MMN has been observed for complex non-speech sounds. Here, musically trained subjects were presented with sequences of either familiar (tonal) or structurally matched unfamiliar (atonal) triad chords, both with either fixed or randomly transposed chord root pitch. The MMN elicited by deviant chords did not differ for familiar and unfamiliar triad sequences, and was undiminished even to unfamiliar deviant sounds which were consciously undetectable. Only subsequent attention-related components indicated facilitated cognitive processing of familiar sounds, corresponding to higher behavioral detection scores.