Interaction between the neuromagnetic responses to sound energy onset and pitch onset suggests common generators

Short-term plasticity of neuro-auditory processing induced by musical active listening training

Although there is strong evidence for the positive effects of musical training on auditory perception, processing, and training-induced neuroplasticity, there is still little knowledge on the auditory and neurophysiological short-term plasticity through listening training. In a sample of 37 adolescents (20 musicians and 17 nonmusicians) that was compared to a control group matched for age, gender, and musical experience, we conducted a 2-week active listening training (AULOS: Active IndividUalized Listening OptimizationS). Using magnetoencephalography and psychoacoustic tests, the short-term plasticity of auditory evoked fields and auditory skills were examined in a pre-post design, adapted to the individual neuro-auditory profiles. We found bilateral, but more pronounced plastic changes in the right auditory cortex. Moreover, we observed synchronization of the auditory evoked P1, N1, and P2 responses and threefold larger amplitudes of the late P2 response, similar to the reported effects of musical long-term training. Auditory skills and thresholds benefited largely from the AULOS training. Remarkably, after training, the mean thresholds improved by 12 dB for bone conduction and by 3-4 dB for air conduction. Thus, our findings indicate a strong positive influence of active listening training on neural auditory processing and perception in adolescence, when the auditory system is still developing.

Temporal Pitch Sensitivity in an Animal Model: Psychophysics and Scalp Recordings : Temporal Pitch Sensitivity in Cat

Cochlear implant (CI) users show limited sensitivity to the temporal pitch conveyed by electric stimulation, contributing to impaired perception of music and of speech in noise. Neurophysiological studies in cats suggest that this limitation is due, in part, to poor transmission of the temporal fine structure (TFS) by the brainstem pathways that are activated by electrical cochlear stimulation. It remains unknown, however, how that neural limit might influence perception in the same animal model. For that reason, we developed non-invasive psychophysical and electrophysiological measures of temporal (i.e., non-spectral) pitch processing in the cat. Normal-hearing (NH) cats were presented with acoustic pulse trains consisting of band-limited harmonic complexes that simulated CI stimulation of the basal cochlea while removing cochlear place-of-excitation cues. In the psychophysical procedure, trained cats detected changes from a base pulse rate to a higher pulse rate. In the scalp-recording procedure, the cortical-evoked acoustic change complex (ACC) and brainstem-generated frequency following response (FFR) were recorded simultaneously in sedated cats for pulse trains that alternated between the base and higher rates. The range of perceptual sensitivity to temporal pitch broadly resembled that of humans but was shifted to somewhat higher rates. The ACC largely paralleled these perceptual patterns, validating its use as an objective measure of temporal pitch sensitivity. The phase-locked FFR, in contrast, showed strong brainstem encoding for all tested pulse rates. These measures demonstrate the cat's perceptual sensitivity to pitch in the absence of cochlear-place cues and may be valuable for evaluating neural mechanisms of temporal pitch perception in the feline animal model of stimulation by a CI or novel auditory prostheses.

Cortical auditory evoked potentials (CAEPs) represent neural cues relevant to pitch perception

Components of auditory event-related potentials (ERPs) may represent various aspects of the cortical processing of pitch. However, evidence hints an earlier representation of pitch perception in auditory ERPs of cortical origin. In this study, we examined whether earlier waves in cortical auditory evoked potentials (CAEPs) might reflect pitch-relevant features of both listeners and stimuli. CAEPs were elicited by pure tones and sweeping tones, and individual behavioral performance in pitch discrimination reflected by frequency difference limen (FDL) was also measured. Results show that CAEPs evoked by sweeping tones significantly correlate to FDL around ~50 ms, but CAEPs evoked by pure tones do not. Also, CAEPs are significantly affected by pitch-shift direction around ~130 ms. CAEPs evoked by ascending sweeping tones are larger in magnitude than those evoked by descending ones. Therefore, listeners' personal attributes relevant to pitch perception have already been reflected at a very early stage of cortical auditory processing, whilst certain pitch-related features of stimuli are recognized and represented at a later stage.

Cortical pitch response components index stimulus onset/offset and dynamic features of pitch contours

Voice pitch is an important information-bearing component of language that is subject to experience dependent plasticity at both early cortical and subcortical stages of processing. We have already demonstrated that pitch onset component (Na) of the cortical pitch response (CPR) is sensitive to flat pitch and its salience … CPR responses from Chinese listeners were elicited by three citation forms varying in pitch acceleration and duration. Results showed that the pitch onset component (Na) was invariant to changes in acceleration. In contrast, Na–Pb and Pb–Nb showed a systematic decrease in the interpeak latency and decrease in amplitude with increase in pitch acceleration that followed the time course of pitch change across the three stimuli. A strong correlation with pitch acceleration was observed for these two components only – a putative index of pitch-relevant neural activity associated with the more rapidly-changing portions of the pitch contour. Pc–Nc marks unambiguously the stimulus offset … and their functional roles as related to sensory and cognitive properties of the stimulus. [Corrected]

Are interaural time and level differences represented by independent or integrated codes in the human auditory cortex?

Sound localization is important for orienting and focusing attention and for segregating sounds from different sources in the environment. In humans, horizontal sound localization mainly relies on interaural differences in sound arrival time and sound level. Despite their perceptual importance, the neural processing of interaural time and level differences (ITDs and ILDs) remains poorly understood. Animal studies suggest that, in the brainstem, ITDs and ILDs are processed independently by different specialized circuits. The aim of the current study was to investigate whether, at higher processing levels, they remain independent or are integrated into a common code of sound laterality. For that, we measured late auditory cortical potentials in response to changes in sound lateralization elicited by perceptually matched changes in ITD and/or ILD. The responses to the ITD and ILD changes exhibited significant morphological differences. At the same time, however, they originated from overlapping areas of the cortex and showed clear evidence for functional coupling. These results suggest that the auditory cortex contains an integrated code of sound laterality, but also retains independent information about ITD and ILD cues. This cue-related information might be used to assess how consistent the cues are, and thus, how likely they would have arisen from the same source.

Representations of pitch and slow modulation in auditory cortex

Iterated ripple noise (IRN) is a type of pitch-evoking stimulus that is commonly used in neuroimaging studies of pitch processing. When contrasted with a spectrally matched Gaussian noise, it is known to produce a consistent response in a region of auditory cortex that includes an area antero-lateral to the primary auditory fields (lateral Heschl's gyrus). The IRN-related response has often been attributed to pitch, although recent evidence suggests that it is more likely driven by slowly varying spectro-temporal modulations not related to pitch. The present functional magnetic resonance imaging (fMRI) study showed that both pitch-related temporal regularity and slow modulations elicited a significantly greater response than a baseline Gaussian noise in an area that has been pre-defined as pitch-responsive. The region was sensitive to both pitch salience and slow modulation salience. The responses to pitch and spectro-temporal modulations interacted in a saturating manner, suggesting that there may be an overlap in the populations of neurons coding these features. However, the interaction may have been influenced by the fact that the two pitch stimuli used (IRN and unresolved harmonic complexes) differed in terms of pitch salience. Finally, the results support previous findings suggesting that the cortical response to IRN is driven in part by slow modulations, not by pitch.

Pitch coding and pitch processing in the human brain

Neuroimaging studies have provided important information regarding how and where pitch is coded and processed in the human brain. Recordings of the frequency-following response (FFR), an electrophysiological measure of neural temporal coding in the brainstem, have shown that the precision of temporal pitch information is dependent on linguistic and musical experience, and can even be modified by short-term training. However, the FFR does not seem to represent the output of a pitch extraction process, and this raises questions regarding how the peripheral neural signal is processed to produce a unified sensation. Since stimuli with a wide variety of spectral and binaural characteristics can produce the same pitch, it has been suggested that there is a place in the ascending auditory pathway at which the representations converge. There is evidence from many different human neuroimaging studies that certain areas of auditory cortex are specifically sensitive to pitch, although the location is still a matter of debate. Taken together, the results suggest that the initial temporal pitch code in the auditory periphery is converted to a code based on neural firing rate in the brainstem. In the upper brainstem or auditory cortex, the information from the individual harmonics of complex tones is combined to form a general representation of pitch. This article is part of a Special Issue entitled Human Auditory Neuroimaging.

Achieving constancy in spoken word identification: time course of talker normalization

This event-related potential (ERP) study examines the time course of context-dependent talker normalization in spoken word identification. We found three ERP components, the N1 (100-220 ms), the N400 (250-500 ms) and the Late Positive Component (500-800 ms), which are conjectured to involve (a) auditory processing, (b) talker normalization and lexical retrieval, and (c) decisional process/lexical selection respectively. Talker normalization likely occurs in the time window of the N400 and overlaps with the lexical retrieval process. Compared with the nonspeech context, the speech contexts, no matter whether they have semantic content or not, enable listeners to tune to a talker's pitch range. In this way, speech contexts induce more efficient talker normalization during the activation of potential lexical candidates and lead to more accurate selection of the intended word in spoken word identification.

Cortical encoding of aperiodic and periodic speech sounds: evidence for distinct neural populations

Most speech sounds are periodic due to the vibration of the vocal folds. Non-invasive studies of the human brain have revealed a periodicity-sensitive population in the auditory cortex which might contribute to the encoding of speech periodicity. Since the periodicity of natural speech varies from (almost) periodic to aperiodic, one may argue that speech aperiodicity could similarly be represented by a dedicated neuron population. In the current magnetoencephalography study, cortical sensitivity to periodicity was probed with natural periodic vowels and their aperiodic counterparts in a stimulus-specific adaptation paradigm. The effects of intervening adaptor stimuli on the N1m elicited by the probe stimuli (the actual effective stimuli) were studied under interstimulus intervals (ISIs) of 800 and 200 ms. The results indicated a periodicity-dependent release from adaptation which was observed for aperiodic probes alternating with periodic adaptors under both ISIs. Such release from adaptation can be attributed to the activation of a distinct neural population responsive to aperiodic (probe) but not to periodic (adaptor) stimuli. Thus, the current results suggest that the aperiodicity of speech sounds may be represented not only by decreased activation of the periodicity-sensitive population but, additionally, by the activation of a distinct cortical population responsive to speech aperiodicity.

Auditory cortex tracks the temporal regularity of sustained noisy sounds

Neuroimaging studies have revealed dramatic asymmetries between the responses to temporally regular and irregular sounds in the antero-lateral part of Heschl's gyrus. For example, the magnetoencephalography (MEG) study of Krumbholz et al. [Cereb. Cortex 13, 765-772 (2003)] showed that the transition from a noise to a similar noise with sufficient temporal regularity to provoke a pitch evoked a pronounced temporal-regularity onset response (TRon response), whereas a comparable transition in the reverse direction revealed essentially no temporal-regularity offset response (TRoff response). The current paper presents a follow-up study in which the asymmetry is examined with much greater power, and the results suggest an intriguing reinterpretation of the onset/offset asymmetry. The TR-related activity in auditory cortex appears to be composed of a transient (TRon) and a TR-related sustained response (TRsus), with a highly variable TRon/TRsus amplitude ratio. The TRoff response is generally dominated by the break-down of the TRsus activity, which occurs so rapidly as to preclude the involvement of higher-level cortical processing. The time course of the TR-related activity suggests that TR processing might be involved in monitoring the environment and alerting the brain to the onset and offset of behaviourally relevant, animate sources.

The effect of stimulus context on pitch representations in the human auditory cortex

Neuroimaging studies of pitch coding seek to identify pitch-related responses separate from responses to other properties of the stimulus, such as its energy onset, and other general aspects of the listening context. The current study reports the first attempt to evaluate these modulatory influences using functional magnetic resonance imaging (fMRI) measures of cortical pitch representations. Stimulus context was manipulated using a 'classical stimulation paradigm' (whereby successive pitch stimuli were separated by gaps of silence) and a 'continuous stimulation paradigm' (whereby successive pitch stimuli were interspersed with noise to maintain a stable envelope). Pitch responses were measured for two types of pitch-evoking stimuli; a harmonic-complex tone and a complex Huggins pitch. Results for a group of 15 normally hearing listeners revealed that context effects were mostly observed in primary auditory regions, while the most significant pitch responses were localized to posterior nonprimary auditory cortex, specifically planum temporale. Sensitivity to pitch was greater for the continuous stimulation conditions perhaps because they better controlled for concurrent responses to the noise energy onset and reduced the potential problem of a non-linear fMRI response becoming saturated. These results provide support for hierarchical processing within human auditory cortex, with some parts of primary auditory cortex engaged by general auditory energy, some parts of planum temporale specifically responsible for representing pitch information and adjacent regions that are responsible for complex higher-level auditory processing such as representing pitch information as a function of listening context.

Sound level-dependent growth of N1m amplitude with low and high-frequency tones

The aim of this study was to determine whether the amplitude and/or latency of the N1m deflection of auditory-evoked magnetic fields are influenced by the level and frequency of sound. The results indicated that the amplitude of the N1m increased with sound level. The growth in amplitude with increasing sound level was almost constant with low frequencies (250-1000 Hz); however, this growth decreased with high frequencies (>2000 Hz). The behavior of the amplitude may reflect a difference in the increase in the activation of the peripheral and/or central auditory systems.

The effects of pitch and pitch strength on an auditory-evoked N1m

The aim of this paper was to determine whether the latency and/or amplitude of the N1m deflection of the auditory-evoked magnetic fields are influenced by the delay and number of iterations of iterated rippled noise, which are related to pitch and pitch strength, respectively. The results indicate that the N1m amplitude decreased sharply for delays between 16 and 32 ms, suggesting that the N1m amplitude reflects the lower limit of the audible pitch range. The N1m latency increases with increasing delay of up to 8-16 ms and then decreases again for delays longer than 16 ms. The behavior of the latency may reflect the balance between the pitch-related component of the N1m and a specific pitch-unrelated component.

Auditory temporal edge detection in human auditory cortex

Auditory objects are detected if they differ acoustically from the ongoing background. In simple cases, the appearance or disappearance of an object involves a transition in power, or frequency content, of the ongoing sound. However, it is more realistic that the background and object possess substantial non-stationary statistics, and the task is then to detect a transition in the pattern of ongoing statistics. How does the system detect and process such transitions? We use magnetoencephalography (MEG) to measure early auditory cortical responses to transitions between constant tones, regularly alternating, and randomly alternating tone-pip sequences. Such transitions embody key characteristics of natural auditory temporal edges. Our data demonstrate that the temporal dynamics and response polarity of the neural temporal-edge-detection processes depend in specific ways on the generalized nature of the edge (the context preceding and following the transition) and suggest that distinct neural substrates in core and non-core auditory cortex are recruited depending on the kind of computation (discovery of a violation of regularity, vs. the detection of a new regularity) required to extract the edge from the ongoing fluctuating input entering a listener's ears.

Tone sequences with conflicting fundamental pitch and timbre changes are heard differently by musicians and nonmusicians

An Auditory Ambiguity Test (AAT) was taken twice by nonmusicians, musical amateurs, and professional musicians. The AAT comprised different tone pairs, presented in both within-pair orders, in which overtone spectra rising in pitch were associated with missing fundamental frequencies (F0) falling in pitch, and vice versa. The F0 interval ranged from 2 to 9 semitones. The participants were instructed to decide whether the perceived pitch went up or down; no information was provided on the ambiguity of the stimuli. The majority of professionals classified the pitch changes according to F0, even at the smallest interval. By contrast, most nonmusicians classified according to the overtone spectra, except in the case of the largest interval. Amateurs ranged in between. A plausible explanation for the systematic group differences is that musical practice systematically shifted the perceptual focus from spectral toward missing-F0 pitch, although alternative explanations such as different genetic dispositions of musicians and nonmusicians cannot be ruled out. ((c) 2007 APA, all rights reserved).

Stimulus Context Affects Auditory Cortical Responses to Changes in Interaural Correlation

We use magnetoencephalography to study human auditory cortical processing of changes in interaural correlation (IAC). We studied transitions from correlated (identical signals at the 2 ears) to uncorrelated (different signals at the 2 ears) or vice versa for two types of wide-band noise stimuli: CHANGE signals contained a single IAC change (or none) and ALT signals alternated between correlated and uncorrelated at a constant rate. The relevant transitions, from correlated to uncorrelated or vice versa, are physically identical in both stimulus conditions, but auditory cortical response patterns differed substantially. CHANGE stimuli exhibited a response asymmetry in their temporal dynamics and magnetic field morphology according to the direction of change. Distinct field patterns indicate the involvement of separate neural substrates for processing, and distinct latencies are suggestive of different temporal integration windows. In contrast, the temporal dynamics of responses to change in the ALT stimuli did not differ substantially according to the direction of change. Notably, the uncorrelated-to-correlated transition in the ALT stimuli showed a first deflection ∼90 ms earlier than for the same transition in the CHANGE stimuli and with an opposite magnetic field distribution. This finding suggests that as early as 50 ms after the onset of an IAC transition, a given physical change is processed differentially depending on stimulus context. Consequently, even early cortical activation cannot be interpreted independently of the specific long-term stimulus context used in the experiment.

The human 'pitch center' responds differently to iterated noise and Huggins pitch

A magnetoencephalographic marker for pitch analysis (the pitch onset response) has been reported for different types of pitch-evoking stimuli, irrespective of whether the acoustic cues for pitch are monaurally or binaurally produced. It is claimed that the pitch onset response reflects a common cortical representation for pitch, putatively in lateral Heschl's gyrus. The result of this functional MRI study sheds doubt on this assertion. We report a direct comparison between iterated ripple noise and Huggins pitch in which we reveal a different pattern of auditory cortical activation associated with each pitch stimulus, even when individual variability in structure-function relations is accounted for. Our results suggest it may be premature to assume that lateral Heschl's gyrus is a universal pitch center.

Cortical processing of quasi-periodic versus random noise sounds

The first objective was to confirm using auditory evoked potentials (AEPs) the findings of magnetoencephalographic studies, that quasi-periodic iterated rippled noise (IRN) elicits a population response in the human auditory cortex which is topographically distinct from that elicited by random noise with a similar overall frequency spectrum. AEPs were recorded at the onset of random noise from silence, at the transition from random noise to IRN with a period of 5 ms, and in the two complementary conditions, IRN onset from silence and the transition from IRN to random noise. An N1/P2 complex was recorded to all four stimuli, that to the transition to IRN being significantly the most anteriorly distributed on the scalp. The second objective was to determine whether the response to the transition to IRN was due to detection of its quasi-periodicity, rather than its spectral "ripples". Virtually no effect was found of applying a 2 kHz low- or high-pass filter, above which it is unlikely that the spectral ripples at intervals of 200 Hz would have been resolved on the cochlear partition. It is concluded that a substantial neuronal population in the auditory cortex is influenced by temporal regularity in sounds, and that this population is equally responsive to spectral frequencies below and above 2 kHz.

From noise to pitch: transient and sustained responses of the auditory evoked field

In recent magnetoencephalographic studies, we established a novel component of the auditory evoked field, which is elicited by a transition from noise to pitch in the absence of a change in energy. It is referred to as the 'pitch onset response'. To extend our understanding of pitch-related neural activity, we compared transient and sustained auditory evoked fields in response to a 2000-ms segment of noise and a subsequent 1000-ms segment of regular interval sound (RIS). RIS provokes the same long-term spectral representation in the auditory system as noise, but is distinguished by a definite pitch, the salience of which depends on the degree of temporal regularity. The stimuli were presented at three steps of increasing regularity and two spectral bandwidths. The auditory evoked fields were recorded from both cerebral hemispheres of twelve subjects with a 37-channel magnetoencephalographic system. Both the transient and the sustained components evoked by noise and RIS were sensitive to spectral bandwidth. Moreover, the pitch salience of the RIS systematically affected the pitch onset response, the sustained field, and the off-response. This indicates that the underlying neural generators reflect the emergence, persistence and offset of perceptual attributes derived from the temporal regularity of a sound.

Evidence of pitch processing in the N100m component of the auditory evoked field

The latency of the N100m component of the auditory evoked field (AEF) is sensitive to the period and spectrum of a sound. However, little attention was paid so far to the wave shape at stimulus onset, which might have biased previous results. This problem was fixed in the present study by aligning the first major peaks in the acoustic waveforms. The stimuli were harmonic tones (spectral range: 800-5000 Hz) with periods corresponding to 100, 200, 400, and 800 Hz. The frequency components were in sine, alternating or random phase. Simulations with a computational model suggest that the auditory-nerve activity is strongly affected by both the period and the relative phase of the stimulus, whereas the output of the more central pitch processor only depends on the period. Our AEF data, recorded from the right hemisphere of seven subjects, are consistent with the latter prediction: The latency of the N100m depends on the period, but not on the relative phase of the stimulus components. This suggests that the N100m reflects temporal pitch extraction, not necessarily implying that the underlying generators are directly involved in this analysis.

Neuromagnetic responses reflect the temporal pitch change of regular interval sounds

The pitch onset response (POR) evoked by the transition between two regular interval sounds (RIS) with different pitch was studied by recording the neuromagnetic responses with a 122-channel whole head magnetoencephalograph (MEG). The parameters of RIS were varied giving rise to characteristic changes in the latency of the first prominent deflection occurring about 100 to 140 ms after the transition. These latency differences of the neurophysiological signal correlated strongly with the psychoacoustic findings obtained from the same individuals. Some of the observed changes cannot be explained by obvious physical differences as changes in the spectrum, but only by temporal processing mechanisms as the auditory image model (Patterson, R.D., Allerhand, M., Giguere, C., 1995. Time-domain modelling of peripheral auditory processing: a modular architecture and a software platform. J. Acoust. Soc. Am. 98, 1890-1894). The location of the POR evoked by the transition was found to be in lateral Heschl's Gyrus, which gives further evidence that this is the center of processing pitch changes in the auditory cortex.

Neural response correlates of detection of monaurally and binaurally created pitches in humans

Recent magnetoencephalography (MEG) and functional magnetic resonance imaging studies of human auditory cortex are pointing to brain areas on lateral Heschl's gyrus as the 'pitch-processing center'. Here we describe results of a combined MEG-psychophysical study designed to investigate the timing of the formation of the percept of pitch and the generality of the hypothesized 'pitch-center'. We compared the cortical and behavioral responses to Huggins pitch (HP), a stimulus requiring binaural processing to elicit a pitch percept, with responses to tones embedded in noise (TN)-perceptually similar but physically very different signals. The stimuli were crafted to separate the electrophysiological responses to onset of the pitch percept from the onset of the initial stimulus. Our results demonstrate that responses to monaural pitch stimuli are affected by cross-correlational processes in the binaural pathway. Additionally, we show that MEG illuminates processes not simply observable in behavior. Crucially, the MEG data show that, although physically disparate, both HP and TN are mapped onto similar representations by 150 ms post-onset, and provide critical new evidence that the 'pitch onset response' reflects central pitch mechanisms, in agreement with models postulating a single, central pitch extractor.

Auditory evoked magnetic fields in relation to iterated rippled noise

Auditory evoked magnetic fields in relation to iterated rippled noise (IRN) were examined by magnetoencephalography (MEG). IRN was used as the sound stimulus to control the peak amplitude of the autocorrelation function of the sound. The IRN was produced by a delay-and-add algorithm applied to bandpass noise that was filtered using fourth-order Butterworth filters between 400-2200 Hz. All sound signals had the same sound pressure level. The stimulus duration was 0.5 s, with rise and fall ramps of 10 ms. Ten normal-hearing subjects took part in the study. Auditory evoked fields were recorded using a 122 channel whole-head magnetometer in a magnetically shielded room. The results showed that the peak amplitude of N1m, which was found above the left and right temporal lobes around 100 ms after the stimulus onset, increased with increase in the number of iterations of the IRN. The latency and estimated equivalent current dipole (ECD) locations of N1m did not show any systematic variation as a function of the number of iterations.

MEG responses to rippled noise and Huggins pitch reveal similar cortical representations

The onset of pitch within an ongoing noise signal evokes a particular brain activity, the pitch onset response (POR). Using whole-head MEG, PORs to iterated rippled noise (IRN) and Huggins pitch (HP), representing prototypical pitch-in-noise signals, were measured in twenty subjects during a pitch identification task (333 Hz, 400 Hz, randomized). HP and IRN yielded similar responses, lateralized to the left hemisphere and peaking about 180 ms after pitch onset. The initial phase (140 ms) showed stronger activations to 400 than to 333 Hz whereas later stages (200-300 ms) showed target vs nontarget effects. These results suggest, first, that different pitches converge into a common cortical representation and, second, that the POR encompasses various successive processing stages.