Explicit processing of melodic structure in congenital amusia can be improved by redescription-associate learning

Congenital amusia is a neurodevelopmental disorder of musical processing. Previous research demonstrates that although explicit musical processing is impaired in congenital amusia, implicit musical processing can be intact. However, little is known about whether implicit knowledge could improve explicit musical processing in individuals with congenital amusia. To this end, we developed a training method utilizing redescription-associate learning, aiming at transferring implicit representations of perceptual states into explicit forms through verbal description and then establishing the associations between the perceptual states reported and responses via feedback, to investigate whether the explicit processing of melodic structure could be improved in individuals with congenital amusia. Sixteen amusics and 11 controls rated the degree of expectedness of melodies during EEG recording before and after training. In the interim, half of the amusics received nine training sessions on melodic structure, while the other half received no training. Results, based on effect size estimation, showed that at pretest, amusics but not controls failed to explicitly distinguish the regular from the irregular melodies and to exhibit an ERAN in response to the irregular endings. At posttest, trained but not untrained amusics performed as well as controls at both the behavioral and neural levels. At the 3-month follow-up, the training effects still maintained. These findings present novel electrophysiological evidence of neural plasticity in the amusic brain, suggesting that redescription-associate learning may be an effective method to remediate impaired explicit processes for individuals with other neurodevelopmental disorders who have intact implicit knowledge.

The Key to Singing Off-Key: The Trained Singer and Pitch Perception Distortion

OBJECTIVES

Pitch perception distortion (PPD) is a novel term describing a phenomenon in which an amplified, accompanied singer's perception of their sung pitch relative to band or accompaniment becomes ambiguous, leading to one of two conditions: a) the singer believes they are out of tune with the accompaniment, but are in tune as perceived by a listener, or b) the singer believes they are in tune with the accompaniment, but are not. This pilot study aims to investigate the existence and incidence of PPD among amplified, accompanied performers and identify associated variables.

DESIGN/METHODS

115 singers were recruited to participate in an online survey, which collected information on musical training, performance environment, and PPD experience.

RESULTS

Reported PPD incidence was 68%, with 92% of respondents indicating that PPD occurred rarely. The factors reported as most associated with PPD experiences included loud stage volume, poor song familiarity, singing outside one's habitual pitch range, and singing loudly. Contrary to previous studies and our hypotheses, no association was found between modality of auditory feedback (e.g., in-ears versus floor monitors) and incidence of PPD. Additionally, higher levels of training were found to be associated with higher incidence of PPD.

CONCLUSIONS

The reported incidence supports that PPD exists beyond chance and anecdotal experience. In light of the highly trained sample, the data suggest that pitch accuracy in accompanied, amplified performance may be more associated with aural environment-specifically loud stage volume-and a highly trained singer's tuning strategy in response to that environment rather than a singer's mastery of vocal intonation skills in isolation. Loud stage volume was implicated as a primary factor associated with PPD, which may be related to the stapedius reflex. Future investigations will target attempted elicitation of PPD in trained singers after establishing baseline auditory reflex thresholds and objective measurements of intonation accuracy.

Familiar Tonal Context Improves Accuracy of Pitch Interval Perception

A fundamental feature of everyday music perception is sensitivity to familiar tonal structures such as musical keys. Many studies have suggested that a tonal context can enhance the perception and representation of pitch. Most of these studies have measured response time, which may reflect expectancy as opposed to perceptual accuracy. We instead used a performance-based measure, comparing participants’ ability to discriminate between a “small, in-tune” interval and a “large, mistuned” interval in conditions that involved familiar tonal relations (diatonic, or major, scale notes), unfamiliar tonal relations (whole-tone or mistuned-diatonic scale notes), repetition of a single pitch, or no tonal context. The context was established with a brief sequence of tones in Experiment 1 (melodic context), and a cadence-like two-chord progression in Experiment 2 (harmonic context). In both experiments, performance significantly differed across the context conditions, with a diatonic context providing a significant advantage over no context; however, no correlation with years of musical training was observed. The diatonic tonal context also provided an advantage over the whole-tone scale context condition in Experiment 1 (melodic context), and over the mistuned scale or repetition context conditions in Experiment 2 (harmonic context). However, the relatively small benefit to performance suggests that the main advantage of tonal context may be priming of expected stimuli, rather than enhanced accuracy of pitch interval representation.

Sensory, Cognitive, and Sensorimotor Learning Effects in Recognition Memory for Music

Recent research suggests that perception and action are strongly interrelated and that motor experience may aid memory recognition. We investigated the role of motor experience in auditory memory recognition processes by musicians using behavioral, ERP, and neural source current density measures. Skilled pianists learned one set of novel melodies by producing them and another set by perception only. Pianists then completed an auditory memory recognition test during which the previously learned melodies were presented with or without an out-of-key pitch alteration while the EEG was recorded. Pianists indicated whether each melody was altered from or identical to one of the original melodies. Altered pitches elicited a larger N2 ERP component than original pitches, and pitches within previously produced melodies elicited a larger N2 than pitches in previously perceived melodies. Cortical motor planning regions were more strongly activated within the time frame of the N2 following altered pitches in previously produced melodies compared with previously perceived melodies, and larger N2 amplitudes were associated with greater detection accuracy following production learning than perception learning. Early sensory (N1) and later cognitive (P3a) components elicited by pitch alterations correlated with predictions of sensory echoic and schematic tonality models, respectively, but only for the perception learning condition, suggesting that production experience alters the extent to which performers rely on sensory and tonal recognition cues. These findings provide evidence for distinct time courses of sensory, schematic, and motoric influences within the same recognition task and suggest that learned auditory-motor associations influence responses to out-of-key pitches.

Tonal priming is resistant to changes in pitch height

Research on tonal priming has consistently shown that tonally expected events are processed more efficiently and has confirmed that the locus of the effect is cognitive rather than sensory. However, it is also important to investigate the role of pitch height, because models of tonal priming collapse across octaves, yet it is possible that pitch height may modulate the effectiveness of tonal priming. We systematically tested this issue by varying the pitch heights of a related (tonic) or a less-related (subdominant) target chord following a tonal context. Musically untrained participants (N = 30) made speeded consonant/dissonant judgments of the final chord of an eight-chord sequence. The effects of tonal priming emerged in accuracy and reaction time measures for all octaves, except for a ceiling effect on accuracy in the matching (original pitch height) condition. In a second experiment, we increased the shift to two octaves and compressed the chords to eliminate overlap between the target and context chords; again, tonal priming emerged. These findings have implications for the behavioral study of tonal priming and support the assumption of octave equivalence in computational models.

Electrical Brain Responses to Beat Irregularities in Two Cases of Beat Deafness

Beat deafness, a recently documented form of congenital amusia, provides a unique window into functional specialization of neural circuitry for the processing of musical stimuli: Beat-deaf individuals exhibit deficits that are specific to the detection of a regular beat in music and the ability to move along with a beat. Studies on the neural underpinnings of beat processing in the general population suggest that the auditory system is capable of pre-attentively generating a predictive model of upcoming sounds in a rhythmic pattern, subserved largely within auditory cortex and reflected in mismatch negativity (MMN) and P3 event-related potential (ERP) components. The current study examined these neural correlates of beat perception in two beat-deaf individuals, Mathieu and Marjorie, and a group of control participants under conditions in which auditory stimuli were either attended or ignored. Compared to control participants, Mathieu demonstrated reduced behavioral sensitivity to beat omissions in metrical patterns, and Marjorie showed a bias to identify irregular patterns as regular. ERP responses to beat omissions reveal an intact pre-attentive system for processing beat irregularities in cases of beat deafness, reflected in the MMN component, and provide partial support for abnormalities in later cognitive stages of beat processing, reflected in an unreliable P3b component exhibited by Mathieu-but not Marjorie-compared to control participants. P3 abnormalities observed in the current study resemble P3 abnormalities exhibited by individuals with pitch-based amusia, and are consistent with attention or auditory-motor coupling accounts of deficits in beat perception.

Effects of veridical expectations on syntax processing in music: Event-related potential evidence

Numerous past studies have investigated neurophysiological correlates of music-syntactic processing. However, only little is known about how prior knowledge about an upcoming syntactically irregular event modulates brain correlates of music-syntactic processing. Two versions of a short chord sequence were presented repeatedly to non-musicians (n = 20) and musicians (n = 20). One sequence version ended on a syntactically regular chord, and the other one ended on a syntactically irregular chord. Participants were either informed (cued condition), or not informed (non-cued condition) about whether the sequence would end on the regular or the irregular chord. Results indicate that in the cued condition (compared to the non-cued condition) the peak latency of the early right anterior negativity (ERAN), elicited by irregular chords, was earlier in both non-musicians and musicians. However, the expectations due to the knowledge about the upcoming event (veridical expectations) did not influence the amplitude of the ERAN. These results suggest that veridical expectations modulate only the speed, but not the principle mechanisms, of music-syntactic processing.

Prior experience biases subcortical sensitivity to sound patterns

To make sense of our ever-changing world, our brains search out patterns. This drive can be so strong that the brain imposes patterns when there are none. The opposite can also occur: The brain can overlook patterns because they do not conform to expectations. In this study, we examined this neural sensitivity to patterns within the auditory brainstem, an evolutionarily ancient part of the brain that can be fine-tuned by experience and is integral to an array of cognitive functions. We have recently shown that this auditory hub is sensitive to patterns embedded within a novel sound stream, and we established a link between neural sensitivity and behavioral indices of learning [Skoe, E., Krizman, J., Spitzer, E., & Kraus, N. The auditory brainstem is a barometer of rapid auditory learning. Neuroscience, 243, 104-114, 2013]. We now ask whether this sensitivity to stimulus statistics is biased by prior experience and the expectations arising from this experience. To address this question, we recorded complex auditory brainstem responses (cABRs) to two patterned sound sequences formed from a set of eight repeating tones. For both patterned sequences, the eight tones were presented such that the transitional probability (TP) between neighboring tones was either 33% (low predictability) or 100% (high predictability). Although both sequences were novel to the healthy young adult listener and had similar TP distributions, one was perceived to be more musical than the other. For the more musical sequence, participants performed above chance when tested on their recognition of the most predictable two-tone combinations within the sequence (TP of 100%); in this case, the cABR differed from a baseline condition where the sound sequence had no predictable structure. In contrast, for the less musical sequence, learning was at chance, suggesting that listeners were "deaf" to the highly predictable repeating two-tone combinations in the sequence. For this condition, the cABR also did not differ from baseline. From this, we posit that the brainstem acts as a Bayesian sound processor, such that it factors in prior knowledge about the environment to index the probability of particular events within ever-changing sensory conditions.

Metrical presentation boosts implicit learning of artificial grammar

The present study investigated whether a temporal hierarchical structure favors implicit learning. An artificial pitch grammar implemented with a set of tones was presented in two different temporal contexts, notably with either a strongly metrical structure or an isochronous structure. According to the Dynamic Attending Theory, external temporal regularities can entrain internal oscillators that guide attention over time, allowing for temporal expectations that influence perception of future events. Based on this framework, it was hypothesized that the metrical structure provides a benefit for artificial grammar learning in comparison to an isochronous presentation. Our study combined behavioral and event-related potential measurements. Behavioral results demonstrated similar learning in both participant groups. By contrast, analyses of event-related potentials showed a larger P300 component and an earlier N2 component for the strongly metrical group during the exposure phase and the test phase, respectively. These findings suggests that the temporal expectations in the strongly metrical condition helped listeners to better process the pitch dimension, leading to improved learning of the artificial grammar.

Sensorimotor Learning Enhances Expectations During Auditory Perception

Sounds that have been produced with one's own motor system tend to be remembered better than sounds that have only been perceived, suggesting a role of motor information in memory for auditory stimuli. To address potential contributions of the motor network to the recognition of previously produced sounds, we used event-related potential, electric current density, and behavioral measures to investigate memory for produced and perceived melodies. Musicians performed or listened to novel melodies, and then heard the melodies either in their original version or with single pitch alterations. Production learning enhanced subsequent recognition accuracy and increased amplitudes of N200, P300, and N400 responses to pitch alterations. Premotor and supplementary motor regions showed greater current density during the initial detection of alterations in previously produced melodies than in previously perceived melodies, associated with the N200. Primary motor cortex was more strongly engaged by alterations in previously produced melodies within the P300 and N400 timeframes. Motor memory traces may therefore interface with auditory pitch percepts in premotor regions as early as 200 ms following perceived pitch onsets. Outcomes suggest that auditory-motor interactions contribute to memory benefits conferred by production experience, and support a role of motor prediction mechanisms in the production effect.

The role of expectation in music: from the score to emotions and the brain

Like discourse, music is a dynamic process that occurs over time. Listeners usually expect some events or structures of events to occur in the prolongation of a given context. Part of the musical emotional experience would depend upon how composers (improvisers) fulfill these expectancies. Musical expectations are a core phenomenon of music cognition, and the present article provides an overview of its foundation in the score as well as in listeners' behavior and brain, and how it can be simulated by artificial neural networks. We highlight parallels to language processing and include the attentional and emotional dimensions of musical expectations. Studying musical expectations is thus valuable not only for our understanding of music perception and production but also for more general brain functioning. Some open and challenging issues are summarized in this article. WIREs Cogn Sci 2014, 5:105-113. doi: 10.1002/wcs.1262 CONFLICT OF INTEREST: The authors have no conflict of interest to declare. For further resources related to this article, please visit the WIREs website.

Segregating the Neural Correlates of Physical and Perceived Change in Auditory Input using the Change Deafness Effect

Psychophysical experiments show that auditory change detection can be disturbed in situations in which listeners have to monitor complex auditory input. We made use of this change deafness effect to segregate the neural correlates of physical change in auditory input from brain responses related to conscious change perception in an fMRI experiment. Participants listened to two successively presented complex auditory scenes, which consisted of six auditory streams, and had to decide whether scenes were identical or whether the frequency of one stream was changed between presentations. Our results show that physical changes in auditory input, independent of successful change detection, are represented at the level of auditory cortex. Activations related to conscious change perception, independent of physical change, were found in the insula and the ACC. Moreover, our data provide evidence for significant effective connectivity between auditory cortex and the insula in the case of correctly detected auditory changes, but not for missed changes. This underlines the importance of the insula/anterior cingulate network for conscious change detection.

Sensory-based and higher-order operations contribute to abnormal emotional prosody processing in schizophrenia: an electrophysiological investigation

BACKGROUND

Schizophrenia is characterized by deficits in emotional prosody (EP) perception. However, it is not clear which stages of processing prosody are abnormal and whether the presence of semantic content contributes to the abnormality. This study aimed to examine event-related potential (ERP) correlates of EP processing in 15 chronic schizophrenia individuals and 15 healthy controls.

METHOD

A total of 114 sentences with neutral semantic content [sentences with semantic content (SSC) condition] were generated by a female speaker (38 with happy, 38 with angry, and 38 with neutral intonation). The same sentences were synthesized and presented in the 'pure prosody' sentences (PPS) condition where semantic content was unintelligible.

RESULTS

Group differences were observed for N100 and P200 amplitude: patients were characterized by more negative N100 for SSC, and more positive P200 for angry and happy SSC and happy PPS. Correlations were found between delusions and P200 amplitude for happy SSC and PPS. Higher error rates in the recognition of EP were also observed in schizophrenia: higher error rates in neutral SSC were associated with reduced N100, and higher error rates in angry SSC were associated with reduced P200.

CONCLUSIONS

These results indicate that abnormalities in prosody processing occur at the three stages of EP processing, and are enhanced in SSC. Correlations between P200 amplitude for happy prosody and delusions suggest a role that abnormalities in the processing of emotionally salient acoustic cues may play in schizophrenia symptomatology. Correlations between ERP and behavioral data point to a relationship between early sensory abnormalities and prosody recognition in schizophrenia.