Tracking of pitch probabilities in congenital amusia

Explicit processing of melodic structure in congenital amusia can be improved by redescription-associate learning

Congenital amusia is a neurodevelopmental disorder of musical processing. Previous research demonstrates that although explicit musical processing is impaired in congenital amusia, implicit musical processing can be intact. However, little is known about whether implicit knowledge could improve explicit musical processing in individuals with congenital amusia. To this end, we developed a training method utilizing redescription-associate learning, aiming at transferring implicit representations of perceptual states into explicit forms through verbal description and then establishing the associations between the perceptual states reported and responses via feedback, to investigate whether the explicit processing of melodic structure could be improved in individuals with congenital amusia. Sixteen amusics and 11 controls rated the degree of expectedness of melodies during EEG recording before and after training. In the interim, half of the amusics received nine training sessions on melodic structure, while the other half received no training. Results, based on effect size estimation, showed that at pretest, amusics but not controls failed to explicitly distinguish the regular from the irregular melodies and to exhibit an ERAN in response to the irregular endings. At posttest, trained but not untrained amusics performed as well as controls at both the behavioral and neural levels. At the 3-month follow-up, the training effects still maintained. These findings present novel electrophysiological evidence of neural plasticity in the amusic brain, suggesting that redescription-associate learning may be an effective method to remediate impaired explicit processes for individuals with other neurodevelopmental disorders who have intact implicit knowledge.

Order of statistical learning depends on perceptive uncertainty

Statistical learning (SL) is an innate mechanism by which the brain automatically encodes the n-th order transition probability (TP) of a sequence and grasps the uncertainty of the TP distribution. Through SL, the brain predicts a subsequent event (e _n+1 ) based on the preceding events (e _n ) that have a length of "n". It is now known that uncertainty modulates prediction in top-down processing by the human predictive brain. However, the manner in which the human brain modulates the order of SL strategies based on the degree of uncertainty remains an open question. The present study examined how uncertainty modulates the neural effects of SL and whether differences in uncertainty alter the order of SL strategies. It used auditory sequences in which the uncertainty of sequential information is manipulated based on the conditional entropy. Three sequences with different TP ratios of 90:10, 80:20, and 67:33 were prepared as low-, intermediate, and high-uncertainty sequences, respectively (conditional entropy: 0.47, 0.72, and 0.92 bit, respectively). Neural responses were recorded when the participants listened to the three sequences. The results showed that stimuli with lower TPs elicited a stronger neural response than those with higher TPs, as demonstrated by a number of previous studies. Furthermore, we found that participants adopted higher-order SL strategies in the high uncertainty sequence. These results may indicate that the human brain has an ability to flexibly alter the order based on the uncertainty. This uncertainty may be an important factor that determines the order of SL strategies. Particularly, considering that a higher-order SL strategy mathematically allows the reduction of uncertainty in information, we assumed that the brain may take higher-order SL strategies when encountering high uncertain information in order to reduce the uncertainty. The present study may shed new light on understanding individual differences in SL performance across different uncertain situations.

Cross-Frequency Brain Network Dynamics Support Pitch Change Detection

Processing auditory sequences involves multiple brain networks and is crucial to complex perception associated with music appreciation and speech comprehension. We used time-resolved cortical imaging in a pitch change detection task to detail the underlying nature of human brain network activity, at the rapid time scales of neurophysiology. In response to tone sequence presentation to the participants, we observed slow inter-regional signaling at the pace of tone presentations (2-4 Hz) that was directed from auditory cortex toward both inferior frontal and motor cortices. Symmetrically, motor cortex manifested directed influence onto auditory and inferior frontal cortices via bursts of faster (15-35 Hz) activity. These bursts occurred precisely at the expected latencies of each tone in a sequence. This expression of interdependency between slow/fast neurophysiological activity yielded a form of local cross-frequency phase-amplitude coupling in auditory cortex, which strength varied dynamically and peaked when pitch changes were anticipated. We clarified the mechanistic relevance of these observations in relation to behavior by including a group of individuals afflicted by congenital amusia, as a model of altered function in processing sound sequences. In amusia, we found a depression of inter-regional slow signaling toward motor and inferior frontal cortices, and a chronic overexpression of slow/fast phase-amplitude coupling in auditory cortex. These observations are compatible with a misalignment between the respective neurophysiological mechanisms of stimulus encoding and internal predictive signaling, which was absent in controls. In summary, our study provides a functional and mechanistic account of neurophysiological activity for predictive, sequential timing of auditory inputs.SIGNIFICANCE STATEMENT Auditory sequences are processed by extensive brain networks, involving multiple systems. In particular, fronto-temporal brain connections participate in the encoding of sequential auditory events, but so far, their study was limited to static depictions. This study details the nature of oscillatory brain activity involved in these inter-regional interactions in human participants. It demonstrates how directed, polyrhythmic oscillatory interactions between auditory and motor cortical regions provide a functional account for predictive timing of incoming items in an auditory sequence. In addition, we show the functional relevance of these observations in relation to behavior, with data from both normal hearing participants and a rare cohort of individuals afflicted by congenital amusia, which we considered here as a model of altered function in processing sound sequences.

The relationship between acoustic and musical pitch processing in adolescents

Amusia is defined as a difficulty processing the tonal pitch structure of music such that an individual cannot tell the difference between notes that are in-key and out-of-key. A fine-grained pitch discrimination deficit is often observed in people with amusia. It is possible that an intervention, early in development, could mitigate amusia; however, one challenge identifying amusia early in development is that identifying in- and out-of-key notes is a meta-cognitive task. Given the common co-occurrence of difficulties with pitch discrimination, it would be easier to identify amusia in developing children by using a pitch change detection task. The goal of this study was to explore the behavioural and neurophysiological profiles of adolescents with poor pitch processing (Poor PP) abilities compared to those with normal pitch processing (Normal PP) abilities. Neurophysiologically, the Poor PPs exhibited a similar event-related potential (ERP) profile to adult amusics during both acoustic and musical pitch discrimination tasks. That is, early ERPs (ERAN, MMN) were similar in Poor PPs compared to Normal PPs, while late positivities (P300, P600) were absent in Poor PPs, but present in Normal PPs. At the same time behavioural data revealed a double dissociation between the abilities to detect a pitch deviant in acoustic and musical context, suggesting that about a third of the children would be missed by selecting a fine-grained acoustic pitch discrimination task to identify the presence of amusia in early childhood.

The Music of Silence: Part I: Responses to Musical Imagery Encode Melodic Expectations and Acoustics

Musical imagery is the voluntary internal hearing of music in the mind without the need for physical action or external stimulation. Numerous studies have already revealed brain areas activated during imagery. However, it remains unclear to what extent imagined music responses preserve the detailed temporal dynamics of the acoustic stimulus envelope and, crucially, whether melodic expectations play any role in modulating responses to imagined music, as they prominently do during listening. These modulations are important as they reflect aspects of the human musical experience, such as its acquisition, engagement, and enjoyment. This study explored the nature of these modulations in imagined music based on EEG recordings from 21 professional musicians (6 females and 15 males). Regression analyses were conducted to demonstrate that imagined neural signals can be predicted accurately, similarly to the listening task, and were sufficiently robust to allow for accurate identification of the imagined musical piece from the EEG. In doing so, our results indicate that imagery and listening tasks elicited an overlapping but distinctive topography of neural responses to sound acoustics, which is in line with previous fMRI literature. Melodic expectation, however, evoked very similar frontal spatial activation in both conditions, suggesting that they are supported by the same underlying mechanisms. Finally, neural responses induced by imagery exhibited a specific transformation from the listening condition, which primarily included a relative delay and a polarity inversion of the response. This transformation demonstrates the top-down predictive nature of the expectation mechanisms arising during both listening and imagery.SIGNIFICANCE STATEMENT It is well known that the human brain is activated during musical imagery: the act of voluntarily hearing music in our mind without external stimulation. It is unclear, however, what the temporal dynamics of this activation are, as well as what musical features are precisely encoded in the neural signals. This study uses an experimental paradigm with high temporal precision to record and analyze the cortical activity during musical imagery. This study reveals that neural signals encode music acoustics and melodic expectations during both listening and imagery. Crucially, it is also found that a simple mapping based on a time-shift and a polarity inversion could robustly describe the relationship between listening and imagery signals.

Perceptual uncertainty modulates auditory statistical learning: A magnetoencephalography study

Statistical learning allows comprehension of structured information, such as that in language and music. The brain computes a sequence's transition probability and predicts future states to minimise sensory reaction and derive entropy (uncertainty) from sequential information. Neurophysiological studies have revealed that early event-related neural responses (P1 and N1) reflect statistical learning - when the brain encodes transition probability in stimulus sequences, it predicts an upcoming stimulus with a high transition probability and suppresses the early event-related responses to a stimulus with a high transition probability. This amplitude difference between high and low transition probabilities reflects statistical learning effects. However, how a sequence's transition probability ratio affects neural responses contributing to statistical learning effects remains unknown. This study investigated how transition-probability ratios or conditional entropy (uncertainty) in auditory sequences modulate the early event-related neuromagnetic responses of P1m and N1m. Sequence uncertainties were manipulated using three different transition-probability ratios: 90:10%, 80:20%, and 67:33% (conditional entropy: 0.47, 0.72, and 0.92 bits, respectively). Neuromagnetic responses were recorded when participants listened to sequential sounds with these three transition probabilities. Amplitude differences between lower and higher probabilities were larger in sequences with transition-probability ratios of 90:10% and smaller in sequences with those of 67:33%, compared to sequences with those of 80:20%. This suggests that the transition-probability ratio finely tunes P1m and N1m. Our study also showed larger amplitude differences between frequent- and rare-transition stimuli in P1m than in N1m. This indicates that information about transition-probability differences may be calculated in earlier cognitive processes.

Listeners with congenital amusia are sensitive to context uncertainty in melodic sequences

In typical listeners, the perceptual salience of a surprising auditory event depends on the uncertainty of its context. For example, in melodies, pitch deviants are more easily detected and generate larger neural responses when the context is highly predictable than when it is less so. However, it is not known whether amusic listeners with abnormal pitch processing are sensitive to the degree of uncertainty of pitch sequences and, if so, whether they are to a different extent than typical non-musician listeners. To answer this question, we manipulated the uncertainty of short melodies while participants with and without congenital amusia underwent EEG recordings in a passive listening task. Uncertainty was manipulated by presenting melodies with different levels of complexity and familiarity, under the assumption that simpler and more familiar patterns would enhance pitch predictability. We recorded mismatch negativity (MMN) responses to pitch, intensity, timbre, location, and rhythm deviants as a measure of auditory surprise. In both participant groups, we observed reduced MMN amplitudes and longer peak latencies for all sound features with increasing levels of complexity, and putative familiarity effects only for intensity deviants. No significant group-by-complexity or group-by-familiarity interactions were detected. However, in contrast to previous studies, pitch MMN responses in amusics were disrupted in high complexity and unfamiliar melodies. The present results thus indicate that amusics are sensitive to the uncertainty of melodic sequences and that preattentive auditory change detection is greatly spared in this population across sound features and levels of predictability. However, our findings also hint at pitch-specific impairments in this population when uncertainty is high, thus suggesting that pitch processing under high uncertainty conditions requires an intact frontotemporal loop.

Comorbidity and cognitive overlap between developmental dyslexia and congenital amusia in children

Developmental dyslexia and congenital amusia are two specific neurodevelopmental disorders that affect reading and music perception, respectively. Similarities at perceptual, cognitive, and anatomical levels raise the possibility that a common factor is at play in their emergence, albeit in different domains. However, little consideration has been given to what extent they can co-occur. A first adult study suggested a 30% amusia rate in dyslexia and a 25% dyslexia rate in amusia (Couvignou et al., Cognitive Neuropsychology 2019). We present newly acquired data from 38 dyslexic and 38 typically developing children. These were assessed with literacy and phonological tests, as well as with three musical tests: the Montreal Battery of Evaluation of Musical Abilities, a pitch and time change detection task, and a singing task. Overall, about 34% of the dyslexic children were musically impaired, a proportion that is significantly higher than both the estimated 1.5-4% prevalence of congenital amusia in the general population and the rate of 5% observed within the control group. They were mostly affected in the pitch dimension, both in terms of perception and production. Correlations and prediction links were found between pitch processing skills and language measures after partialing out confounding factors. These findings are discussed with regard to cognitive and neural explanatory hypotheses of a comorbidity between dyslexia and amusia.

Melodic expectations in 5- and 6-year-old children

It has been argued that children implicitly acquire the rules relating to the structure of music in their environment using domain-general mechanisms such as statistical learning. Closely linked to statistical learning is the ability to form expectations about future events. Whether children as young as 5 years can make use of such internalized regularities to form expectations about the next note in a melody is still unclear. The possible effect of the home musical environment on the strength of musical expectations has also been under-explored. Using a newly developed melodic priming task that included melodies with either "expected" or "unexpected" endings according to rules of Western music theory, we tested 5- and 6-year-old children (N = 46). The stimuli in this task were constructed using the information dynamics of music (IDyOM) system, a probabilistic model estimating the level of "unexpectedness" of a note given the preceding context. Results showed that responses to expected versus unexpected tones were faster and more accurate, indicating that children have already formed robust melodic expectations at 5 years of age. Aspects of the home musical environment significantly predicted the strength of melodic expectations, suggesting that implicit musical learning may be influenced by the quantity of informal exposure to the surrounding musical environment.

Statistical Properties in Jazz Improvisation Underline Individuality of Musical Representation

Statistical learning is an innate function in the brain and considered to be essential for producing and comprehending structured information such as music. Within the framework of statistical learning the brain has an ability to calculate the transitional probabilities of sequences such as speech and music, and to predict a future state using learned statistics. This paper computationally examines whether and how statistical learning and knowledge partially contributes to musical representation in jazz improvisation. The results represent the time-course variations in a musician’s statistical knowledge. Furthermore, the findings show that improvisational musical representation might be susceptible to higher- but not lower-order statistical knowledge (i.e., knowledge of higher-order transitional probability). The evidence also demonstrates the individuality of improvisation for each improviser, which in part depends on statistical knowledge. Thus, this study suggests that statistical properties in jazz improvisation underline individuality of musical representation.

Statistical learning and the uncertainty of melody and bass line in music

Statistical learning is the ability to learn based on transitional probability (TP) in sequential information, which has been considered to contribute to creativity in music. The interdisciplinary theory of statistical learning examines statistical learning as a mechanism of human learning. This study investigated how TP distribution and conditional entropy in TP of the melody and bass line in music interact with each other, using the highest and lowest pitches in Beethoven’s piano sonatas and Johann Sebastian Bach’s Well-Tempered Clavier. Results for the two composers were similar. First, the results detected specific statistical characteristics that are unique to each melody and bass line as well as general statistical characteristics that are shared between the melody and bass line. Additionally, a correlation of the conditional entropies sampled from the TP distribution could be detected between the melody and bass line. This suggests that the variability of entropies interacts between the melody and bass line. In summary, this study suggested that TP distributions and the entropies of the melody and bass line interact with but are partly independent of each other.

Abnormal neural responses to harmonic syntactic structures in congenital amusia

In music, harmonic syntactic structures are organized hierarchically through local and long-distance dependencies. This study investigated whether congenital amusia, a neurodevelopmental disorder of pitch perception, is associated with impaired processing of harmonic syntactic structures. For stimuli, we used harmonic sequences containing two phrases, where the first phrase ended with a half cadence and the second with an authentic cadence. In Experiment 1, we manipulated the ending chord of the authentic cadence to be either syntactically regular or irregular based on local dependencies. Sixteen amusics and 16 controls judged the expectedness of these chords while their EEG waveforms were recorded. In comparison to the regular endings, irregular endings elicited an ERAN, an N5, and a late positive component in controls but not in amusics, indicating that amusics were impaired in processing local syntactic dependencies. In Experiment 2, we manipulated the half cadence of the harmonic sequences to either adhere to or violate long-distance syntactic dependencies. In response to irregular harmonic sequences, an ERAN-like component and an N5 were elicited in controls but not in amusics, suggesting that amusics were impaired in processing long-distance syntactic dependencies. Furthermore, for controls, the neural processing of local and long-distance syntactic dependencies was correlated at the later integration stage but not at the early detection stage. These findings indicate that amusia is associated with impairment in the detection and integration of local and long-distance syntactic violations. The implications of these findings in terms of hierarchical music-syntactic processing are discussed.

Intracranial Recordings and Computational Modeling of Music Reveal the Time Course of Prediction Error Signaling in Frontal and Temporal Cortices

Prediction is held to be a fundamental process underpinning perception, action, and cognition. To examine the time course of prediction error signaling, we recorded intracranial EEG activity from nine presurgical epileptic patients while they listened to melodies whose information theoretical predictability had been characterized using a computational model. We examined oscillatory activity in the superior temporal gyrus (STG), the middle temporal gyrus (MTG), and the pars orbitalis of the inferior frontal gyrus, lateral cortical areas previously implicated in auditory predictive processing. We also examined activity in anterior cingulate gyrus (ACG), insula, and amygdala to determine whether signatures of prediction error signaling may also be observable in these subcortical areas. Our results demonstrate that the information content (a measure of unexpectedness) of musical notes modulates the amplitude of low-frequency oscillatory activity (theta to beta power) in bilateral STG and right MTG from within 100 and 200 msec of note onset, respectively. Our results also show this cortical activity to be accompanied by low-frequency oscillatory modulation in ACG and insula-areas previously associated with mediating physiological arousal. Finally, we showed that modulation of low-frequency activity is followed by that of high-frequency (gamma) power from approximately 200 msec in the STG, between 300 and 400 msec in the left insula, and between 400 and 500 msec in the ACG. We discuss these results with respect to models of neural processing that emphasize gamma activity as an index of prediction error signaling and highlight the usefulness of musical stimuli in revealing the wide-reaching neural consequences of predictive processing.

The Montreal Protocol for Identification of Amusia

The Montreal Battery for the Evaluation of Amusia (MBEA; Peretz, Champod, & Hyde Annals of the New York Academy of Sciences, 999, 58-75, 2003) is an empirically grounded quantitative tool that is widely used to identify individuals with congenital amusia. The use of such a standardized measure ensures that the individuals tested will conform to a specific neuropsychological profile, allowing for comparisons across studies and research groups. Recently, a number of researchers have published credible critiques of the usefulness of the MBEA as a diagnostic tool for amusia. Here we argue that the MBEA and its online counterpart, the AMUSIA tests (Peretz et al. Music Perception, 25, 331-343, 2008), should be considered steps in a screening process for amusia, rather than standalone diagnostic tools. The goal of this article is to present, in detailed and easily replicable format, the full protocol through which congenital amusics should be identified. In providing information that has often gone unreported in published articles, we aim to clarify the strengths and limitations of the MBEA and to make recommendations for its continued use by the research community as part of the Montreal Protocol for Identification of Amusia.

Entropy, Uncertainty, and the Depth of Implicit Knowledge on Musical Creativity: Computational Study of Improvisation in Melody and Rhythm

Recent neurophysiological and computational studies have proposed the hypothesis that our brain automatically codes the nth-order transitional probabilities (TPs) embedded in sequential phenomena such as music and language (i.e., local statistics in nth-order level), grasps the entropy of the TP distribution (i.e., global statistics), and predicts the future state based on the internalized nth-order statistical model. This mechanism is called statistical learning (SL). SL is also believed to contribute to the creativity involved in musical improvisation. The present study examines the interactions among local statistics, global statistics, and different levels of orders (mutual information) in musical improvisation interact. Interactions among local statistics, global statistics, and hierarchy were detected in higher-order SL models of pitches, but not lower-order SL models of pitches or SL models of rhythms. These results suggest that the information-theoretical phenomena of local and global statistics in each order may be reflected in improvisational music. The present study proposes novel methodology to evaluate musical creativity associated with SL based on information theory.

Expectations for tonal cadences: Sensory and cognitive priming effects

Studies examining the formation of melodic and harmonic expectations during music listening have repeatedly demonstrated that a tonal context primes listeners to expect certain (tonally related) continuations over others. However, few such studies have (1) selected stimuli using ready examples of expectancy violation derived from real-world instances of tonal music, (2) provided a consistent account for the influence of sensory and cognitive mechanisms on tonal expectancies by comparing different computational simulations, or (3) combined melodic and harmonic representations in modelling cognitive processes of expectation. To resolve these issues, this study measures expectations for the most recurrent cadence patterns associated with tonal music and then simulates the reported findings using three sensory–cognitive models of auditory expectation. In Experiment 1, participants provided explicit retrospective expectancy ratings both before and after hearing the target melodic tone and chord of the cadential formula. In Experiment 2, participants indicated as quickly as possible whether those target events were in or out of tune relative to the preceding context. Across both experiments, cadences terminating with stable melodic tones and chords elicited the highest expectancy ratings and the fastest and most accurate responses. Moreover, the model simulations supported a cognitive interpretation of tonal processing, in which listeners with exposure to tonal music generate expectations as a consequence of the frequent (co-)occurrence of events on the musical surface.

The neural basis for understanding imitation-induced musical meaning: The role of the human mirror system

Music can convey meanings by imitating phenomena of the extramusical world, and these imitation-induced musical meanings can be understood by listeners. Although the human mirror system (HMS) is implicated in imitation, little is known about the HMS's role in making sense of meaning that derives from musical imitation. To answer this question, we used fMRI to examine listeners' brain activities during the processing of imitation-induced musical meaning with a cross-modal semantic priming paradigm. Eleven normal individuals and 11 individuals with congenital amusia, a neurodevelopmental disorder of musical processing, participated in the experiment. Target pictures with either an upward or downward movement were primed by semantically congruent or incongruent melodic sequences characterized by the direction of pitch change (upward or downward). When contrasting the incongruent with the congruent condition between the two groups, we found greater activations in the left supramarginal gyrus/inferior parietal lobule and inferior frontal gyrus in normals but not in amusics. The implications of these findings in terms of the role of the HMS in understanding imitation-induced musical meaning are discussed.

Statistical learning and probabilistic prediction in music cognition: mechanisms of stylistic enculturation

Music perception depends on internal psychological models derived through exposure to a musical culture. It is hypothesized that this musical enculturation depends on two cognitive processes: (1) statistical learning, in which listeners acquire internal cognitive models of statistical regularities present in the music to which they are exposed; and (2) probabilistic prediction based on these learned models that enables listeners to organize and process their mental representations of music. To corroborate these hypotheses, I review research that uses a computational model of probabilistic prediction based on statistical learning (the information dynamics of music (IDyOM) model) to simulate data from empirical studies of human listeners. The results show that a broad range of psychological processes involved in music perception-expectation, emotion, memory, similarity, segmentation, and meter-can be understood in terms of a single, underlying process of probabilistic prediction using learned statistical models. Furthermore, IDyOM simulations of listeners from different musical cultures demonstrate that statistical learning can plausibly predict causal effects of differential cultural exposure to musical styles, providing a quantitative model of cultural distance. Understanding the neural basis of musical enculturation will benefit from close coordination between empirical neuroimaging and computational modeling of underlying mechanisms, as outlined here.

Time-course variation of statistics embedded in music: Corpus study on implicit learning and knowledge

Learning and knowledge of transitional probability in sequences like music, called statistical learning and knowledge, are considered implicit processes that occur without intention to learn and awareness of what one knows. This implicit statistical knowledge can be alternatively expressed via abstract medium such as musical melody, which suggests this knowledge is reflected in melodies written by a composer. This study investigates how statistics in music vary over a composer's lifetime. Transitional probabilities of highest-pitch sequences in Ludwig van Beethoven's Piano Sonata were calculated based on different hierarchical Markov models. Each interval pattern was ordered based on the sonata opus number. The transitional probabilities of sequential patterns that are musical universal in music gradually decreased, suggesting that time-course variations of statistics in music reflect time-course variations of a composer's statistical knowledge. This study sheds new light on novel methodologies that may be able to evaluate the time-course variation of composer's implicit knowledge using musical scores.

Sensitivity to musical emotion is influenced by tonal structure in congenital amusia

Emotional communication in music depends on multiple attributes including psychoacoustic features and tonal system information, the latter of which is unique to music. The present study investigated whether congenital amusia, a lifelong disorder of musical processing, impacts sensitivity to musical emotion elicited by timbre and tonal system information. Twenty-six amusics and 26 matched controls made tension judgments on Western (familiar) and Indian (unfamiliar) melodies played on piano and sitar. Like controls, amusics used timbre cues to judge musical tension in Western and Indian melodies. While controls assigned significantly lower tension ratings to Western melodies compared to Indian melodies, thus showing a tonal familiarity effect on tension ratings, amusics provided comparable tension ratings for Western and Indian melodies on both timbres. Furthermore, amusics rated Western melodies as more tense compared to controls, as they relied less on tonality cues than controls in rating tension for Western melodies. The implications of these findings in terms of emotional responses to music are discussed.

A Probabilistic Model of Meter Perception: Simulating Enculturation

Enculturation is known to shape the perception of meter in music but this is not explicitly accounted for by current cognitive models of meter perception. We hypothesize that the induction of meter is a result of predictive coding: interpreting onsets in a rhythm relative to a periodic meter facilitates prediction of future onsets. Such prediction, we hypothesize, is based on previous exposure to rhythms. As such, predictive coding provides a possible explanation for the way meter perception is shaped by the cultural environment. Based on this hypothesis, we present a probabilistic model of meter perception that uses statistical properties of the relation between rhythm and meter to infer meter from quantized rhythms. We show that our model can successfully predict annotated time signatures from quantized rhythmic patterns derived from folk melodies. Furthermore, we show that by inferring meter, our model improves prediction of the onsets of future events compared to a similar probabilistic model that does not infer meter. Finally, as a proof of concept, we demonstrate how our model can be used in a simulation of enculturation. From the results of this simulation, we derive a class of rhythms that are likely to be interpreted differently by enculturated listeners with different histories of exposure to rhythms.

"Lost in time" but still moving to the beat

Motor synchronization to the beat of an auditory sequence (e.g., a metronome or music) is widespread in humans. However, some individuals show poor synchronization and impoverished beat perception. This condition, termed "beat deafness", has been linked to a perceptual deficit in beat tracking. Here we present single-case evidence (L.A. and L.C.) that poor beat tracking does not have to entail poor synchronization. In a first Experiment, L.A., L.C., and a third case (L.V.) were submitted to the Battery for The Assessment of Auditory Sensorimotor and Timing Abilities (BAASTA), which includes both perceptual and sensorimotor tasks. Compared to a control group, L.A. and L.C. performed poorly on rhythm perception tasks, such as detecting time shifts in a regular sequence, or estimating whether a metronome is aligned to the beat of the music or not. Yet, they could tap to the beat of the same stimuli. L.V. showed impairments in both beat perception and tapping. In a second Experiment, we tested whether L.A., L.C., and L.V.'s perceptual deficits extend to an implicit timing task, in which they had to respond as fast as possible to a different target pitch after a sequence of standard tones. The three beat-deaf participants benefited similarly to controls from a regular temporal pattern in detecting the pitch target. The fact that synchronization to a beat can occur in the presence of poor perception shows that perception and action can dissociate in explicit timing tasks. Beat tracking afforded by implicit timing mechanisms is likely to support spared synchronization to the beat in some beat-deaf participants. This finding suggests that separate pathways may subserve beat perception depending on the explicit/implicit nature of a task in a sample of beat-deaf participants.

Preserved processing of musical structure in a person with agrammatic aphasia

Evidence for shared processing of structure (or syntax) in language and in music conflicts with neuropsychological dissociations between the two. However, while harmonic structural processing can be impaired in patients with spared linguistic syntactic abilities (Peretz, I. (1993). Auditory atonalia for melodies. Cognitive Neuropsychology, 10, 21-56. doi:10.1080/02643299308253455), evidence for the opposite dissociation-preserved harmonic processing despite agrammatism-is largely lacking. Here, we report one such case: HV, a former musician with Broca's aphasia and agrammatic speech, was impaired in making linguistic, but not musical, acceptability judgments. Similarly, she showed no sensitivity to linguistic structure, but normal sensitivity to musical structure, in implicit priming tasks. To our knowledge, this is the first non-anecdotal report of a patient with agrammatic aphasia demonstrating preserved harmonic processing abilities, supporting claims that aspects of musical and linguistic structure rely on distinct neural mechanisms.

Pitch-Responsive Cortical Regions in Congenital Amusia

Congenital amusia is a lifelong deficit in music perception thought to reflect an underlying impairment in the perception and memory of pitch. The neural basis of amusic impairments is actively debated. Some prior studies have suggested that amusia stems from impaired connectivity between auditory and frontal cortex. However, it remains possible that impairments in pitch coding within auditory cortex also contribute to the disorder, in part because prior studies have not measured responses from the cortical regions most implicated in pitch perception in normal individuals. We addressed this question by measuring fMRI responses in 11 subjects with amusia and 11 age- and education-matched controls to a stimulus contrast that reliably identifies pitch-responsive regions in normal individuals: harmonic tones versus frequency-matched noise. Our findings demonstrate that amusic individuals with a substantial pitch perception deficit exhibit clusters of pitch-responsive voxels that are comparable in extent, selectivity, and anatomical location to those of control participants. We discuss possible explanations for why amusics might be impaired at perceiving pitch relations despite exhibiting normal fMRI responses to pitch in their auditory cortex: (1) individual neurons within the pitch-responsive region might exhibit abnormal tuning or temporal coding not detectable with fMRI, (2) anatomical tracts that link pitch-responsive regions to other brain areas (e.g., frontal cortex) might be altered, and (3) cortical regions outside of pitch-responsive cortex might be abnormal. The ability to identify pitch-responsive regions in individual amusic subjects will make it possible to ask more precise questions about their role in amusia in future work.

Music and literature: are there shared empathy and predictive mechanisms underlying their affective impact?

It has been suggested that music and language had a shared evolutionary precursor before becoming mainly responsible for the communication of emotive and referential meaning respectively. However, emphasis on potential differences between music and language may discourage a consideration of the commonalities that music and literature share. Indeed, one possibility is that common mechanisms underlie their affective impact, and the current paper carefully reviews relevant neuroscientific findings to examine such a prospect. First and foremost, it will be demonstrated that considerable evidence of a common role of empathy and predictive processes now exists for the two domains. However, it will also be noted that an important open question remains: namely, whether the mechanisms underlying the subjective experience of uncertainty differ between the two domains with respect to recruitment of phylogenetically ancient emotion areas. It will be concluded that a comparative approach may not only help to reveal general mechanisms underlying our responses to music and literature, but may also help us better understand any idiosyncrasies in their capacity for affective impact.

Basic, specific, mechanistic? Conceptualizing musical emotions in the brain

The number of studies investigating music processing in the human brain continues to increase, with a large proportion of them focussing on the correlates of so-called musical emotions. The current Review highlights the recent development whereby such studies are no longer concerned only with basic emotions such as happiness and sadness but also with so-called music-specific or "aesthetic" ones such as nostalgia and wonder. It also highlights how mechanisms such as expectancy and empathy, which are seen as inducing musical emotions, are enjoying ever-increasing investigation and substantiation with physiological and neuroimaging methods. It is proposed that a combination of these approaches, namely, investigation of the precise mechanisms through which so-called music-specific or aesthetic emotions may arise, will provide the most important advances for our understanding of the unique nature of musical experience.

Attending to pitch information inhibits processing of pitch information: the curious case of amusia

In normal listeners, the tonal rules of music guide musical expectancy. In a minority of individuals, known as amusics, the processing of tonality is disordered, which results in severe musical deficits. It has been shown that the tonal rules of music are neurally encoded, but not consciously available in amusics. Previous neurophysiological studies have not explicitly controlled the level of attention in tasks where participants ignored the tonal structure of the stimuli. Here, we test whether access to tonal knowledge can be demonstrated in congenital amusia when attention is controlled. Electric brain responses were recorded while asking participants to detect an individually adjusted near-threshold click in a melody. In half the melodies, a note was inserted that violated the tonal rules of music. In a second task, participants were presented with the same melodies but were required to detect the tonal deviation. Both tasks required sustained attention, thus conscious access to the rules of tonality was manipulated. In the click-detection task, the pitch deviants evoked an early right anterior negativity (ERAN) in both groups. In the pitch-detection task, the pitch deviants evoked an ERAN and P600 in controls but not in amusics. These results indicate that pitch regularities are represented in the cortex of amusics, but are not consciously available. Moreover, performing a pitch-judgment task eliminated the ERAN in amusics, suggesting that attending to pitch information interferes with perception of pitch. We propose that an impaired top-down frontotemporal projection is responsible for this disorder.

Revising the diagnosis of congenital amusia with the Montreal Battery of Evaluation of Amusia

This article presents a critical survey of the prevalent usage of the Montreal Battery of Evaluation of Amusia (MBEA; Peretz et al., 2003) to assess congenital amusia, a neuro-developmental disorder that has been claimed to be present in 4% of the population (Kalmus and Fry, 1980). It reviews and discusses the current usage of the MBEA in relation to cut-off scores, number of used subtests, manner of testing, and employed statistics, as these vary in the literature. Furthermore, data are presented from a large-scale experiment with 228 German undergraduate students who were assessed with the MBEA and a comprehensive questionnaire. This experiment tested the difference between scores that were obtained in a web-based study (at participants’ homes) and those obtained under laboratory conditions with a computerized version of the MBEA. In addition to traditional statistical procedures, the data were evaluated using Signal Detection Theory (SDT; Green and Swets, 1966), taking into consideration the individual’s ability to discriminate and their response bias. Results show that using SDT for scoring instead of proportion correct offers a bias-free and normally distributed measure of discrimination ability. It is also demonstrated that a diagnosis based on an average score leads to cases of misdiagnosis. The prevalence of congenital amusia is shown to depend highly on the statistical criterion that is applied as cut-off score and on the number of subtests that is considered for the diagnosis. In addition, three different subtypes of amusics were found in our sample. Lastly, significant differences between the web-based and the laboratory group were found, giving rise to questions about the validity of web-based experimentation.

Brainstem encoding of speech and musical stimuli in congenital amusia: evidence from Cantonese speakers

Congenital amusia is a neurodevelopmental disorder of musical processing that also impacts subtle aspects of speech processing. It remains debated at what stage(s) of auditory processing deficits in amusia arise. In this study, we investigated whether amusia originates from impaired subcortical encoding of speech (in quiet and noise) and musical sounds in the brainstem. Fourteen Cantonese-speaking amusics and 14 matched controls passively listened to six Cantonese lexical tones in quiet, two Cantonese tones in noise (signal-to-noise ratios at 0 and 20 dB), and two cello tones in quiet while their frequency-following responses (FFRs) to these tones were recorded. All participants also completed a behavioral lexical tone identification task. The results indicated normal brainstem encoding of pitch in speech (in quiet and noise) and musical stimuli in amusics relative to controls, as measured by FFR pitch strength, pitch error, and stimulus-to-response correlation. There was also no group difference in neural conduction time or FFR amplitudes. Both groups demonstrated better FFRs to speech (in quiet and noise) than to musical stimuli. However, a significant group difference was observed for tone identification, with amusics showing significantly lower accuracy than controls. Analysis of the tone confusion matrices suggested that amusics were more likely than controls to confuse between tones that shared similar acoustic features. Interestingly, this deficit in lexical tone identification was not coupled with brainstem abnormality for either speech or musical stimuli. Together, our results suggest that the amusic brainstem is not functioning abnormally, although higher-order linguistic pitch processing is impaired in amusia. This finding has significant implications for theories of central auditory processing, requiring further investigations into how different stages of auditory processing interact in the human brain.

Predictive uncertainty in auditory sequence processing

Previous studies of auditory expectation have focused on the expectedness perceived by listeners retrospectively in response to events. In contrast, this research examines predictive uncertainty—a property of listeners' prospective state of expectation prior to the onset of an event. We examine the information-theoretic concept of Shannon entropy as a model of predictive uncertainty in music cognition. This is motivated by the Statistical Learning Hypothesis, which proposes that schematic expectations reflect probabilistic relationships between sensory events learned implicitly through exposure. Using probability estimates from an unsupervised, variable-order Markov model, 12 melodic contexts high in entropy and 12 melodic contexts low in entropy were selected from two musical repertoires differing in structural complexity (simple and complex). Musicians and non-musicians listened to the stimuli and provided explicit judgments of perceived uncertainty (explicit uncertainty). We also examined an indirect measure of uncertainty computed as the entropy of expectedness distributions obtained using a classical probe-tone paradigm where listeners rated the perceived expectedness of the final note in a melodic sequence (inferred uncertainty). Finally, we simulate listeners' perception of expectedness and uncertainty using computational models of auditory expectation. A detailed model comparison indicates which model parameters maximize fit to the data and how they compare to existing models in the literature. The results show that listeners experience greater uncertainty in high-entropy musical contexts than low-entropy contexts. This effect is particularly apparent for inferred uncertainty and is stronger in musicians than non-musicians. Consistent with the Statistical Learning Hypothesis, the results suggest that increased domain-relevant training is associated with an increasingly accurate cognitive model of probabilistic structure in music.

Probabilistic models of expectation violation predict psychophysiological emotional responses to live concert music

We present the results of a study testing the often-theorized role of musical expectations in inducing listeners' emotions in a live flute concert experiment with 50 participants. Using an audience response system developed for this purpose, we measured subjective experience and peripheral psychophysiological changes continuously. To confirm the existence of the link between expectation and emotion, we used a threefold approach. (1) On the basis of an information-theoretic cognitive model, melodic pitch expectations were predicted by analyzing the musical stimuli used (six pieces of solo flute music). (2) A continuous rating scale was used by half of the audience to measure their experience of unexpectedness toward the music heard. (3) Emotional reactions were measured using a multicomponent approach: subjective feeling (valence and arousal rated continuously by the other half of the audience members), expressive behavior (facial EMG), and peripheral arousal (the latter two being measured in all 50 participants). Results confirmed the predicted relationship between high-information-content musical events, the violation of musical expectations (in corresponding ratings), and emotional reactions (psychologically and physiologically). Musical structures leading to expectation reactions were manifested in emotional reactions at different emotion component levels (increases in subjective arousal and autonomic nervous system activations). These results emphasize the role of musical structure in emotion induction, leading to a further understanding of the frequently experienced emotional effects of music.