MMN or no MMN: no magnitude of deviance effect on the MMN amplitude

Native language background affects the perception of duration and pitch

Estonian is a quantity language with both a primary duration cue and a secondary pitch cue, whereas Chinese is a tonal language with a dominant pitch use. Using a mismatch negativity experiment and a behavioral discrimination experiment, we investigated how native language background affects the perception of duration only, pitch only, and duration plus pitch information. Chinese participants perceived duration in Estonian as meaningless acoustic information due to a lack of phonological use of duration in their native language; however, they demonstrated a better pitch discrimination ability than Estonian participants. On the other hand, Estonian participants outperformed Chinese participants in perceiving the non-speech pure tones that resembled the Estonian quantity (i.e., containing both duration and pitch information). Our results indicate that native language background affects the perception of duration and pitch and that such an effect is not specific to processing speech sounds.

Involuntary motor responses are elicited both by rare sounds and rare pitch changes

Unpredictable deviations from an otherwise regular auditory sequence, as well as rare sounds following a period of silence, are detected automatically. Recent evidence suggests that the latter also elicit quick involuntary modulations of ongoing motor activity emerging as early as 100 ms following sound onset, which was attributed to supramodal processing. We explored such force modulations for both rare and deviant sounds. Participants (N = 29) pinched a force sensitive device and maintained a force of 1-2 N for periods of 1 min. Task-irrelevant tones were presented under two conditions. In the Rare condition, 4000 Hz tones were presented every 8-to-16 s. In the Roving condition, 4000 Hz and 2996 Hz tones were presented at rate of 1 s, with infrequent (p = 1/12) frequency changes. In the Rare condition, transient force modulations were observed with a significant increase at ~ 234 ms, and a decrease at ~ 350 ms. In the Roving condition with low frequency deviant tones, an increase in force was observed at ~ 277 ms followed by a decrease at ~ 413 ms. No significant modulations were observed during perception of high frequency deviants. These results suggest that both rare silence-breaking sounds and low-pitched deviants evoke automatic fluctuations of motor responses, which opens up the possibility that these force modulations are triggered by stimulus-specific change-detection processes.

Somatosensory temporal sensitivity in adults on the autism spectrum: A high-density electrophysiological mapping study using the mismatch negativity (MMN) sensory memory paradigm

Atypical reactivity to somatosensory inputs is common in autism spectrum disorder and carries considerable impact on downstream social communication and quality of life. While behavioral and survey work have established differences in the perception of somatosensory information, little has been done to elucidate the underlying neurophysiological processes that drive these characteristics. Here, we implemented a duration-based somatosensory mismatch negativity (MMN) paradigm to examine the role of temporal sensitivity and sensory memory in the processing of vibrotactile information in autistic (n = 30) and neurotypical (n = 30) adults. To capture the variability in responses between groups across a range of duration discrepancies, we compared the electrophysiological responses to frequent standard vibrations (100 ms) and four infrequent deviant vibrations (115, 130, 145, and 160 ms). The same stimuli were used in a follow-up behavioral task to determine active detection of the infrequent vibrations. We found no differences between the two groups with regard to discrimination between standard and deviant vibrations, demonstrating comparable neurologic and behavioral temporal somatosensory perception. However, exploratory analyses yielded subtle differences in amplitude at the N1 and P220 time points. Together, these results indicate that the temporal mechanisms of somatosensory discrimination are conserved in adults on the autism spectrum, though more general somatosensory processing may be affected. We discuss these findings in the broader context of the MMN literature in autism, as well as the potential role of cortical maturity in somatosensory mechanisms.

Tracking the habituation of the event-related EEG potential in automatic change detection using an auditory two-tone oddball paradigm

The mismatch negativity and the P3a of the event-related EEG potential reflect the electrocortical response to a deviant stimulus in a series of stimuli. Although both components have been investigated in various paradigms, these paradigms usually incorporate many repetitions of the same deviant, thus leaving open whether both components vary as a function of the deviant's position in a series of deviant stimuli-i.e. whether they are subject to qualitative/quantitative habituation from one instantiation of a deviant to the next. This is so because the detection of mismatch negativity/P3a in the event-related EEG potential requires an averaging over dozens or hundreds of stimuli, i.e. over many instantiations of the deviant per participant. The present study addresses this research gap. We used a two-tone oddball paradigm implementing only a small number of (deviant) stimuli per participant, but applying it to a large number of participants (n > 230). Our data show that the mismatch negativity amplitude exhibits no decrease as a function of the deviant's position in a series of (standard and) deviant stimuli. Importantly, only after the very first deviant stimulus, a distinct P3a could be detected, indicative of an orienting reaction and an attention shift, and thus documenting a dissociation of mismatch negativity and P3a.

ERP evidence for Slavic and German word stress cue sensitivity in English

Word stress is demanding for non-native learners of English, partly because speakers from different backgrounds weight perceptual cues to stress like pitch, intensity, and duration differently. Slavic learners of English and particularly those with a fixed stress language background like Czech and Polish have been shown to be less sensitive to stress in their native and non-native languages. In contrast, German English learners are rarely discussed in a word stress context. A comparison of these varieties can reveal differences in the foreign language processing of speakers from two language families. We use electroencephalography (EEG) to explore group differences in word stress cue perception between Slavic and German learners of English. Slavic and German advanced English speakers were examined in passive multi-feature oddball experiments, where they were exposed to the word impact as an unstressed standard and as deviants stressed on the first or second syllable through higher pitch, intensity, or duration. The results revealed a robust Mismatch Negativity (MMN) component of the event-related potential (ERP) in both language groups in response to all conditions, demonstrating sensitivity to stress changes in a non-native language. While both groups showed higher MMN responses to stress changes to the second than the first syllable, this effect was more pronounced for German than for Slavic participants. Such group differences in non-native English word stress perception from the current and previous studies are argued to speak in favor of customizable language technologies and diversified English curricula compensating for non-native perceptual variation.

Learning to Perceive Non-Native Tones via Distributional Training: Effects of Task and Acoustic Cue Weighting

As many distributional learning (DL) studies have shown, adult listeners can achieve discrimination of a difficult non-native contrast after a short repetitive exposure to tokens falling at the extremes of that contrast. Such studies have shown using behavioural methods that a short distributional training can induce perceptual learning of vowel and consonant contrasts. However, much less is known about the neurological correlates of DL, and few studies have examined non-native lexical tone contrasts. Here, Australian-English speakers underwent DL training on a Mandarin tone contrast using behavioural (discrimination, identification) and neural (oddball-EEG) tasks, with listeners hearing either a bimodal or a unimodal distribution. Behavioural results show that listeners learned to discriminate tones after both unimodal and bimodal training; while EEG responses revealed more learning for listeners exposed to the bimodal distribution. Thus, perceptual learning through exposure to brief sound distributions (a) extends to non-native tonal contrasts, and (b) is sensitive to task, phonetic distance, and acoustic cue-weighting. Our findings have implications for models of how auditory and phonetic constraints influence speech learning.

Standard Tone Stability as a Manipulation of Precision in the Oddball Paradigm: Modulation of Prediction Error Responses to Fixed-Probability Deviants

Electrophysiological sensory deviance detection signals, such as the mismatch negativity (MMN), have been interpreted from the predictive coding framework as manifestations of prediction error (PE). From a frequentist perspective of the classic oddball paradigm, deviant stimuli are unexpected because of their low probability. However, the amount of PE elicited by a stimulus can be dissociated from its probability of occurrence: when the observer cannot make confident predictions, any event holds little surprise value, no matter how improbable. Here we tested the hypothesis that the magnitude of the neural response elicited to an improbable sound (D) would scale with the precision of the prediction derived from the repetition of another sound (S), by manipulating repetition stability. We recorded the Electroencephalogram (EEG) from 20 participants while passively listening to 4 types of isochronous pure tone sequences differing in the probability of the S tone (880 Hz) while holding constant the probability of the D tone [1,046 Hz; p(D) = 1/11]: Oddball [p(S) = 10/11]; High confidence (7/11); Low confidence (4/11); and Random (1/11). Tones of 9 different frequencies were equiprobably presented as fillers [p(S) + p(D) + p(F) = 1]. Using a mass-univariate non-parametric, cluster-based correlation analysis controlling for multiple comparisons, we found that the amplitude of the deviant-elicited ERP became more negative with increasing S probability, in a time-electrode window consistent with the MMN (ca. 120–200 ms; frontal), suggesting that the strength of a PE elicited to an improbable event indeed increases with the precision of the predictive model.

Repeated Parental Singing During Kangaroo Care Improved Neural Processing of Speech Sound Changes in Preterm Infants at Term Age

Preterm birth carries a risk for adverse neurodevelopment. Cognitive dysfunctions, such as language disorders may manifest as atypical sound discrimination already in early infancy. As infant-directed singing has been shown to enhance language acquisition in infants, we examined whether parental singing during skin-to-skin care (kangaroo care) improves speech sound discrimination in preterm infants. Forty-five preterm infants born between 26 and 33 gestational weeks (GW) and their parents participated in this cluster-randomized controlled trial (ClinicalTrials ID IRB00003181SK). In both groups, parents conducted kangaroo care during 33-40 GW. In the singing intervention group (n = 24), a certified music therapist guided parents to sing or hum during daily kangaroo care. In the control group (n = 21), parents conducted standard kangaroo care and were not instructed to use their voices. Parents in both groups reported the duration of daily intervention. Auditory event-related potentials were recorded with electroencephalogram at term age using a multi-feature paradigm consisting of phonetic and emotional speech sound changes and a one-deviant oddball paradigm with pure tones. In the multi-feature paradigm, prominent mismatch responses (MMR) were elicited to the emotional sounds and many of the phonetic deviants in the singing intervention group and in the control group to some of the emotional and phonetic deviants. A group difference was found as the MMRs were larger in the singing intervention group, mainly due to larger MMRs being elicited to the emotional sounds, especially in females. The overall duration of the singing intervention (range 15-63 days) was positively associated with the MMR amplitudes for both phonetic and emotional stimuli in both sexes, unlike the daily singing time (range 8-120 min/day). In the oddball paradigm, MMRs for the non-speech sounds were elicited in both groups and no group differences nor connections between the singing time and the response amplitudes were found. These results imply that repeated parental singing during kangaroo care improved auditory discrimination of phonetic and emotional speech sounds in preterm infants at term age. Regular singing routines can be recommended for parents to promote the development of the auditory system and auditory processing of speech sounds in preterm infants.

Z. Wynne H, Lahiri A. Asymmetric Influence of Vocalic Context on Mandarin Sibilants: Evidence From ERP Studies

In the present study, we examine the interactive effect of vowels on Mandarin fricative sibilants using a passive oddball paradigm to determine whether the HEIGHT features of vowels can spread on the surface and influence preceding consonants with unspecified features. The stimuli are two pairs of Mandarin words ([sa] ∼ [ʂa] and [su] ∼ [ʂu]) contrasting in vowel HEIGHT ([LOW] vs. [HIGH]). Each word in the same pair was presented both as standard and deviant, resulting in four conditions (/standard/[deviant]: /sa/[ʂa] ∼ /ʂa/[sa] and /su/[ʂu] ∼ /ʂu/[su]). In line with the Featurally Underspecified Lexicon (FUL) model, asymmetric patterns of processing were found in the [su] ∼ [ʂu] word pair where both the MMN (mismatch negativity) and LDN (late discriminative negativity) components were more negative in /su/[ʂu] (mismatch) than in /ʂu/[su] (no mismatch), suggesting the spreading of the feature [HIGH] from the vowel [u] to [ʂ] on the surface. In the [sa] ∼ [ʂa] pair, however, symmetric negativities (for both MMN and LDN) were observed as there is no conflict between the surface feature [LOW] from [a] to [ʂ] and the underlying specified feature [LOW] of [s]. These results confirm that not all features are fully specified in the mental lexicon: features of vowels can spread on the surface and influence surrounding unspecified segments.

Change detection of auditory tonal patterns defined by absolute versus relative pitch information. A combined behavioural and EEG study

The human auditory system often relies on relative pitch information to extract and identify auditory objects; such as when the same melody is played in different keys. The current study investigated the mental chronometry underlying the active discrimination of unfamiliar melodic six-tone patterns by measuring behavioural performance and event-related potentials (ERPs). In a roving standard paradigm, such patterns were either repeated identically within a stimulus train, carrying absolute frequency information about the pattern, or shifted in pitch (transposed) between repetitions, so only relative pitch information was available to extract the pattern identity. Results showed that participants were able to use relative pitch to detect when a new melodic pattern occurred. Though in the absence of absolute pitch sensitivity significantly decreased and behavioural reaction time to pattern changes increased. Mismatch-Negativity (MMN), an ERP indicator of auditory deviance detection, was elicited at approximately 206 ms after stimulus onset at frontocentral electrodes, even when only relative pitch was available to inform pattern discrimination. A P3a was elicited in both conditions, comparable in amplitude and latency. Increased latencies but no differences in amplitudes of N2b, and P3b suggest that processing at higher levels is affected when, in the absence of absolute pitch cues, relative pitch has to be extracted to inform pattern discrimination. Interestingly, the response delay of approximately 70 ms on the behavioural level, already fully manifests at the level of N2b. This is in accordance with recent findings on implicit auditory learning processes and suggests that in the absence of absolute pitch cues a slowing of target selection rather than a slowing of the auditory pattern change detection process causes the deterioration in behavioural performance.

Neural Mechanisms of Hearing Recovery for Cochlear-Implanted Patients: An Electroencephalogram Follow-Up Study

Background

Patients with severe profound hearing loss could benefit from cochlear implantation (CI). However, the neural mechanism of such benefit is still unclear. Therefore, we analyzed the electroencephalogram (EEG) and behavioral indicators of auditory function remodeling in patients with CI. Both indicators were sampled at multiple time points after implantation (1, 90, and 180 days).

Methods

First, the speech perception ability was evaluated with the recording of a list of Chinese words and sentences in 15 healthy controls (HC group) and 10 patients with CI (CI group). EEG data were collected using an oddball paradigm. Then, the characteristics of event-related potentials (ERPs) and mismatch negative (MMN) were compared between the CI group and the HC group. In addition, we analyzed the phase lag indices (PLI) in the CI group and the HC group and calculated the difference in functional connectivity between the two groups at different stages after implantation.

Results

The behavioral indicator, speech recognition ability, in CI patients improved as the implantation time increased. The MMN analysis showed that CI patients could recognize the difference between standard and deviation stimuli just like the HCs 90 days after cochlear implantation. Comparing the latencies of N1/P2/MMN between the CI group and the HC group, we found that the latency of N1/P2 in CI patients was longer, while the latency of MMN in CI users was shorter. In addition, PLI-based whole-brain functional connectivity (PLI-FC) showed that the difference between the CI group and the HC group mainly exists in electrode pairs between the bilateral auditory area and the frontal area. Furthermore, all those differences gradually decreased with the increase in implantation time.

Conclusion

The N1 amplitude, N1/P2/MMN latency, and PLI-FC in the alpha band may reflect the process of auditory function remodeling and could be an objective index for the assessment of speech perception ability and the effect of cochlear implantation.

Hyperammonemia alters the mismatch negativity in the auditory evoked potential by altering functional connectivity and neurotransmission

Minimal hepatic encephalopathy (MHE) is a neuropsychiatric syndrome produced by central nervous system dysfunction subsequent to liver disease. Hyperammonemia and inflammation act synergistically to alter neurotransmission, leading to the cognitive and motor alterations in MHE, which are reproduced in rat models of chronic hyperammonemia. Patients with MHE show altered functional connectivity in different neural networks and a reduced response in the cognitive potential mismatch negativity (MMN), which correlates with attention deficits. The mechanisms by which MMN is altered in MHE remain unknown. The objectives of this work are as follows: To assess if rats with chronic hyperammonemia reproduce the reduced response in the MMN found in patients with MHE. Analyze the functional connectivity between the areas (CA1 area of the dorsal hippocampus, prelimbic cortex, primary auditory cortex, and central inferior colliculus) involved in the generation of the MMN and its possible alterations in hyperammonemia. Granger causality analysis has been applied to detect the net flow of information between the population neuronal activities recorded from a local field potential approach. Analyze if altered MMN response in hyperammonemia is associated with alterations in glutamatergic and GABAergic neurotransmission. Extracellular levels of the neurotransmitters and/or membrane expression of their receptors have been analyzed after the tissue isolation of the four target sites. The results show that rats with chronic hyperammonemia show reduced MMN response in hippocampus, mimicking the reduced MMN response of patients with MHE. This is associated with altered functional connectivity between the areas involved in the generation of the MMN. Hyperammonemia also alters membrane expression of glutamate and GABA receptors in hippocampus and reduces the changes in extracellular GABA and glutamate induced by the MMN paradigm of auditory stimulus in hippocampus of control rats. The changes in glutamatergic and GABAergic neurotransmission and in functional connectivity between the brain areas analyzed would contribute to the impairment of the MMN response in rats with hyperammonemia and, likely, also in patients with MHE.

Abstractness of human speech sound representations

We argue, based on a study of brain responses to speech sound differences in Japanese, that memory encoding of functional speech sounds-phonemes-are highly abstract. As an example, we provide evidence for a theory where the consonants/p t k b d g/ are not only made up of symbolic features but are underspecified with respect to voicing or laryngeal features, and that languages differ with respect to which feature value is underspecified. In a previous study we showed that voiced stops are underspecified in English [Hestvik, A., & Durvasula, K. (2016). Neurobiological evidence for voicing underspecification in English. Brain and Language], as shown by asymmetries in Mismatch Negativity responses to /t/ and /d/. In the current study, we test the prediction that the opposite asymmetry should be observed in Japanese, if voiceless stops are underspecified in that language. Our results confirm this prediction. This matches a linguistic architecture where phonemes are highly abstract and do not encode actual physical characteristics of the corresponding speech sounds, but rather different subsets of abstract distinctive features.

Auditory Mismatch Negativity Under Predictive Coding Framework and Its Role in Psychotic Disorders

Traditional neuroscience sees sensory perception as a simple feedforward process. This view is challenged by the predictive coding model in recent years due to the robust evidence researchers had found on how our prediction could influence perception. In the first half of this article, we reviewed the concept of predictive brain and some empirical evidence of sensory prediction in visual and auditory processing. The predictive function along the auditory pathway was mainly studied by mismatch negativity (MMN)-a brain response to an unexpected disruption of regularity. We summarized a range of MMN paradigms and discussed how they could contribute to the theoretical development of the predictive coding neural network by the mechanism of adaptation and deviance detection. Such methodological and conceptual evolution sharpen MMN as a tool to better understand the structural and functional brain abnormality for neuropsychiatric disorder such as schizophrenia.

Music Training Positively Influences the Preattentive Perception of Voice Onset Time in Children with Dyslexia: A Longitudinal Study

Previous results showed a positive influence of music training on linguistic abilities at both attentive and preattentive levels. Here, we investigate whether six months of active music training is more efficient than painting training to improve the preattentive processing of phonological parameters based on durations that are often impaired in children with developmental dyslexia (DD). Results were also compared to a control group of Typically Developing (TD) children matched on reading age. We used a Test–Training–Retest procedure and analysed the Mismatch Negativity (MMN) and the N1 and N250 components of the Event-Related Potentials to syllables that differed in Voice Onset Time (VOT), vowel duration, and vowel frequency. Results were clear-cut in showing a normalization of the preattentive processing of VOT in children with DD after music training but not after painting training. They also revealed increased N250 amplitude to duration deviant stimuli in children with DD after music but not painting training, and no training effect on the preattentive processing of frequency. These findings are discussed in view of recent theories of dyslexia pointing to deficits in processing the temporal structure of speech. They clearly encourage the use of active music training for the rehabilitation of children with language impairments.

Pre-attentive Mismatch Response and Involuntary Attention Switching to a Deviance in an Earlier-Than-Usual Auditory Stimulus: An ERP Study

An acoustic stimulus elicits an electroencephalographic response called auditory event-related potential (ERP). When some members of a stream of standard auditory stimuli are replaced randomly by a deviant stimulus and this stream is presented to a subject who ignores the stimuli, two different ERPs to deviant and standard stimuli are recorded. If the ERP to standard stimuli is subtracted from the ERP to deviant stimuli, the difference potential (DP) waveform typically exhibits a series of negative-positive-negative deflections called mismatch negativity (MMN), P3a, and reorienting negativity (RON), which are associated with pre-attentive change detection, involuntary attention switching, and reorienting of attention, respectively. The aim of the present study was to investigate how these pre-attentive processes are affected if the change occurs earlier than its usual timing implied by isochronous standard stimuli. In the MMN paradigm employed, 15% of the standards were randomly replaced by deviant stimuli which differed either in their pitch, their earlier onset time, or in both. Event-related responses to these three deviants [timely pitch change (R_TP), earlier onset (R_EO), earlier pitch change (R_EP)] and to standards (R_S) were recorded from 10 reading subjects. To maintain identical stimulation histories for the responses subtracted from each other, "deviant-standard" difference potentials (DP) for "timely" and "early" pitch deviances were derived as follows: DP_TP = R_TP - R_S and DP_EP = R_EP - R_EO. Interestingly, the MMN components of the DPs to timely and early pitch deviances had similar amplitudes, indicating that regularity of stimulus timing does not provide any benefit for the pre-attentive auditory change detection mechanism. However, different scalp current density (SCD) dynamics of the MMN/P3a complexes, elicited by timely and early pitch deviances, suggested that an auditory change in a stimulus occurring earlier-than-usual initiates a faster and more effective call-for-attention and causes stronger attention switching than a timely change. SCD results also indicated that the temporal, frontal, and parietal MMN components are simultaneously present rather than emerging sequentially in time, supporting the MMN models based on parallel deviance processing in the respective cortices. Similarity of the RONs to timely and early pitch deviances indicated that reorienting of attention is of the same strength in two cases.

Deviance detection is the dominant component of auditory contextual processing in the lateral superior temporal gyrus: A human ECoG study

Auditory contextual processing has been assumed to be based on a hierarchical structure consisting of the primary auditory cortex, superior temporal gyrus (STG), and frontal lobe. Recent invasive studies on mismatch negativity (MMN) have revealed functional segregation for auditory contextual processing such as neural adaptation in the primary auditory cortex and prediction in the frontal lobe. However, the role of the STG remains unclear. We obtained induced activity in the high gamma band as mismatch response (MMR), an electrocorticographic (ECoG) counterpart to scalp MMN, and the components of MMR by analyzing ECoG data from patients with refractory epilepsy in an auditory oddball task paradigm. We found that MMR localized mainly in the bilateral posterior STGs, and that deviance detection largely accounted for MMR. Furthermore, adaptation was identified in a limited number of electrodes on the superior temporal plane. Our findings reveal a mixed contribution of deviance detection and adaptation depending on location in the STG. Such spatial considerations could lead to further understanding of the pathophysiology of relevant psychiatric disorders.

Cascade and no-repetition rules are comparable controls for the auditory frequency mismatch negativity in oddball tasks

The mismatch negativity (MMN) has been widely studied with oddball tasks to index processing of unexpected auditory change. The MMN is computed as the difference of deviant minus standard and is used to capture the pattern violation by the deviant. However, this oddball MMN is confounded because the deviant differs physically from the standard and is presented less often. To improve measurement, the same tone as the deviant is presented in a separate condition. This control tone is equiprobable with other tones and is used to compute a corrected MMN (deviant minus control). Typically, the tones are in random order except that consecutive tones are not identical (no-repetition rule). In contrast, a recent study on frequency MMN presented tones in a regular up-and-down sequence (cascade rule). If the cascade rule is detected more easily than the no-repetition rule, there should be a lower risk of a confounding MMN within the cascade condition. However, in previous research, the cascade and no-repetition conditions differed not only in the regularity of the tone sequence but also in number of tones, frequency range, and proportion of tones. We controlled for these differences to isolate effects of regularity in the tone sequence. Results of our preregistered analyses provided moderate evidence (BF₀₁ >6) that the corrected MMN did not differ between cascade and no-repetition conditions. These findings imply that no-repetition and cascade rules are processed similarly and that the no-repetition condition provides an adequate control in frequency MMN.

Detecting change in stochastic sound sequences

Our ability to parse our acoustic environment relies on the brain's capacity to extract statistical regularities from surrounding sounds. Previous work in regularity extraction has predominantly focused on the brain's sensitivity to predictable patterns in sound sequences. However, natural sound environments are rarely completely predictable, often containing some level of randomness, yet the brain is able to effectively interpret its surroundings by extracting useful information from stochastic sounds. It has been previously shown that the brain is sensitive to the marginal lower-order statistics of sound sequences (i.e., mean and variance). In this work, we investigate the brain's sensitivity to higher-order statistics describing temporal dependencies between sound events through a series of change detection experiments, where listeners are asked to detect changes in randomness in the pitch of tone sequences. Behavioral data indicate listeners collect statistical estimates to process incoming sounds, and a perceptual model based on Bayesian inference shows a capacity in the brain to track higher-order statistics. Further analysis of individual subjects' behavior indicates an important role of perceptual constraints in listeners' ability to track these sensory statistics with high fidelity. In addition, the inference model facilitates analysis of neural electroencephalography (EEG) responses, anchoring the analysis relative to the statistics of each stochastic stimulus. This reveals both a deviance response and a change-related disruption in phase of the stimulus-locked response that follow the higher-order statistics. These results shed light on the brain's ability to process stochastic sound sequences.

The Duration of Auditory Sensory Memory for Vowel Processing: Neurophysiological and Behavioral Measures

Speech perception behavioral research suggests that rates of sensory memory decay are dependent on stimulus properties at more than one level (e.g., acoustic level, phonemic level). The neurophysiology of sensory memory decay rate has rarely been examined in the context of speech processing. In a lexical tone study, we showed that long-term memory representation of lexical tone slows the decay rate of sensory memory for these tones. Here, we tested the hypothesis that long-term memory representation of vowels slows the rate of auditory sensory memory decay in a similar way to that of lexical tone. Event-related potential (ERP) responses were recorded to Mandarin non-words contrasting the vowels /i/ vs. /u/ and /y/ vs. /u/ from first-language (L1) Mandarin and L1 American English participants under short and long interstimulus interval (ISI) conditions (short ISI: an average of 575 ms, long ISI: an average of 2675 ms). Results revealed poorer discrimination of the vowel contrasts for English listeners than Mandarin listeners, but with different patterns for behavioral perception and neural discrimination. As predicted, English listeners showed the poorest discrimination and identification for the vowel contrast /y/ vs. /u/, and poorer performance in the long ISI condition. In contrast to Yu et al. (2017), however, we found no effect of ISI reflected in the neural responses, specifically the mismatch negativity (MMN), P3a and late negativity ERP amplitudes. We did see a language group effect, with Mandarin listeners generally showing larger MMN and English listeners showing larger P3a. The behavioral results revealed that native language experience plays a role in echoic sensory memory trace maintenance, but the failure to find an effect of ISI on the ERP results suggests that vowel and lexical tone memory traces decay at different rates.

Highlights:

We examined the interaction between auditory sensory memory decay and language experience.

We compared MMN, P3a, LN and behavioral responses in short vs. long interstimulus intervals.

We found that different from lexical tone contrast, MMN, P3a, and LN changes to vowel contrasts are not influenced by lengthening the ISI to 2.6 s.

We also found that the English listeners discriminated the non-native vowel contrast with lower accuracy under the long ISI condition.

One Way or Another: Evidence for Perceptual Asymmetry in Pre-attentive Learning of Non-native Contrasts

Research investigating listeners' neural sensitivity to speech sounds has largely focused on segmental features. We examined Australian English listeners' perception and learning of a supra-segmental feature, pitch direction in a non-native tonal contrast, using a passive oddball paradigm and electroencephalography. The stimuli were two contours generated from naturally produced high-level and high-falling tones in Mandarin Chinese, differing only in pitch direction (Liu and Kager, 2014). While both contours had similar pitch onsets, the pitch offset of the falling contour was lower than that of the level one. The contrast was presented in two orientations (standard and deviant reversed) and tested in two blocks with the order of block presentation counterbalanced. Mismatch negativity (MMN) responses showed that listeners discriminated the non-native tonal contrast only in the second block, reflecting indications of learning through exposure during the first block. In addition, listeners showed a later MMN peak for their second block of test relative to listeners who did the same block first, suggesting linguistic (as opposed to acoustic) processing or a misapplication of perceptual strategies from the first to the second block. The results also showed a perceptual asymmetry for change in pitch direction: listeners who encountered a falling tone deviant in the first block had larger frontal MMN amplitudes than listeners who encountered a level tone deviant in the first block. The implications of our findings for second language speech and the developmental trajectory for tone perception are discussed.

Effect of EEG Referencing Methods on Auditory Mismatch Negativity

Auditory event-related potentials (ERPs) have consistently been used in the investigation of auditory and cognitive processing in the research and clinical laboratories. There is currently no consensus on the choice of appropriate reference for auditory ERPs. The most commonly used references in auditory ERP research are the mathematically linked-mastoids (LM) and average referencing (AVG). Since LM and AVG referencing procedures do not solve the issue of electrically-neutral reference, Reference Electrode Standardization Technique (REST) was developed to create a neutral reference for EEG recordings. The aim of the current research is to compare the influence of the reference on amplitude and latency of auditory mismatch negativity (MMN) as a function of magnitude of frequency deviance across three commonly used electrode montages (16, 32, and 64-channel) using REST, LM, and AVG reference procedures. The current study was designed to determine if the three reference methods capture the variation in amplitude and latency of MMN with the deviance magnitude. We recorded MMN from 12 normal hearing young adults in an auditory oddball paradigm with 1,000 Hz pure tone as standard and 1,030, 1,100, and 1,200 Hz as small, medium and large frequency deviants, respectively. The EEG data recorded to these sounds was re-referenced using REST, LM, and AVG methods across 16-, 32-, and 64-channel EEG electrode montages. Results revealed that while the latency of MMN decreased with increment in frequency of deviant sounds, no effect of frequency deviance was present for amplitude of MMN. There was no effect of referencing procedure on the experimental effect tested. The amplitude of MMN was largest when the ERP was computed using LM referencing and the REST referencing produced the largest amplitude of MMN for 64-channel montage. There was no effect of electrode-montage on AVG referencing induced ERPs. Contrary to our predictions, the results suggest that the auditory MMN elicited as a function of increments in frequency deviance does not depend on the choice of referencing procedure. The results also suggest that auditory ERPs generated using REST referencing is contingent on the electrode arrays more than the AVG referencing.

Neurophysiological and Behavioral Responses of Mandarin Lexical Tone Processing

Language experience enhances discrimination of speech contrasts at a behavioral- perceptual level, as well as at a pre-attentive level, as indexed by event-related potential (ERP) mismatch negativity (MMN) responses. The enhanced sensitivity could be the result of changes in acoustic resolution and/or long-term memory representations of the relevant information in the auditory cortex. To examine these possibilities, we used a short (ca. 600 ms) vs. long (ca. 2,600 ms) interstimulus interval (ISI) in a passive, oddball discrimination task while obtaining ERPs. These ISI differences were used to test whether cross-linguistic differences in processing Mandarin lexical tone are a function of differences in acoustic resolution and/or differences in long-term memory representations. Bisyllabic nonword tokens that differed in lexical tone categories were presented using a passive listening multiple oddball paradigm. Behavioral discrimination and identification data were also collected. The ERP results revealed robust MMNs to both easy and difficult lexical tone differences for both groups at short ISIs. At long ISIs, there was either no change or an enhanced MMN amplitude for the Mandarin group, but reduced MMN amplitude for the English group. In addition, the Mandarin listeners showed a larger late negativity (LN) discriminative response than the English listeners for lexical tone contrasts in the long ISI condition. Mandarin speakers outperformed English speakers in the behavioral tasks, especially under the long ISI conditions with the more similar lexical tone pair. These results suggest that the acoustic correlates of lexical tone are fairly robust and easily discriminated at short ISIs, when the auditory sensory memory trace is strong. At longer ISIs beyond 2.5 s language-specific experience is necessary for robust discrimination.

N1 response attenuation and the mismatch negativity (MMN) to within- and across-category phonetic contrasts

According to the neural adaptation model of the mismatch negativity (MMN), the sensitivity of this event-related response to both acoustic and categorical information in speech sounds can be accounted for by assuming that (a) the degree of overlapping between neural representations of two sounds depends on both the acoustic difference between them and whether or not they belong to distinct phonetic categories, and (b) a release from stimulus-specific adaptation causes an enhanced N1 obligatory response to infrequent deviant stimuli. On the basis of this view, we tested in Experiment 1 whether the N1 response to the second sound of a pair (S₂ ) would be more attenuated in pairs of identical vowels compared with pairs of different vowels, and in pairs of exemplars of the same vowel category compared with pairs of exemplars of different categories. The psychoacoustic distance between S₁ and S₂ was the same for all within-category and across-category pairs. While N1 amplitudes decreased markedly from S₁ to S₂ , responses to S₂ were quite similar across pair types, indicating that the attenuation effect in such conditions is not stimulus specific. In Experiment 2, a pronounced MMN was elicited by a deviant vowel sound in an across-category oddball sequence, but not when the exact same deviant vowel was presented in a within-category oddball sequence. This adds evidence that MMN reflects categorical phonetic processing. Taken together, the results suggest that different neural processes underlie the attenuation of the N1 response to S₂ and the MMN to vowels.

Rubberband Effect in Temporal Control of Mismatch Negativity

Mismatch negativity (MMN) is a difference event-related potential (ERP) wave reflecting the brain’s automatic reaction to deviant sensory stimuli, and it has been proven to be a useful tool in research on cognitive functions or clinical disorders. In most MMN studies, amplitude, peak latency, or the integral of the responses, in rare cases also the slopes of the responses, have been employed as parameters of the ERP responses for quantitative analyses. However, little is known about correlations between these parameters. To better understand the relations between different ERP parameters, we extracted and correlated several different parameters characterizing the MMN waves. We found an unexpected correlation which gives new insight into the temporal control of MMN: response amplitudes are positively correlated with downside slopes, whereas barely correlated with upside slopes. This result suggests an efficient feedback mechanism for the MMN to return to the baseline within a predefined time window, contradicting an exponential decay function as one might expect. As a metaphor we suggest a rubberband effect for the MMN responses, i.e., the larger the distance of the response from neural equilibrium, the stronger the return force to equilibrium.

Neural processing of amplitude and formant rise time in dyslexia

This study aimed to investigate how children with dyslexia weight amplitude rise time (ART) and formant rise time (FRT) cues in phonetic discrimination. Passive mismatch responses (MMR) were recorded for a/ba/-/wa/contrast in a multiple deviant odd-ball paradigm to identify the neural response to cue weighting in 17 children with dyslexia and 17 age-matched control children. The deviant stimuli had either partial or full ART or FRT cues. The results showed that ART did not generate an MMR in either group, whereas both partial and full FRT cues generated MMR in control children while only full FRT cues generated MMR in children with dyslexia. These findings suggest that children, both controls and those with dyslexia, discriminate speech based on FRT cues and not ART cues. However, control children have greater sensitivity to FRT cues in speech compared to children with dyslexia.

Electrophysiological Indicators of the Age-Related Deterioration in the Sensitivity to Auditory Duration Deviance

The present study investigates age-related changes in duration discrimination in millisecond time domain. We tested young (N = 20, mean age = 24.5, SD = 2.97) and elderly (N = 20, mean age = 65.2, SD = 2.94) subjects using the mismatch negativity (MMN) paradigm. White-noise bursts of two different durations (50 and 10 ms) were presented in two oddball blocks. In one block (Increment Condition), the repetitive sequence of 10 ms standards was interspersed by occasional 50 ms deviants. In the Decrement Condition, the roles of the two stimuli were reversed. We analyzed the P1-N1 complex, MMN and P3a and found the effect of age for all these components. Moreover, the impact of stimulus presentation condition (increment/decrement) was observed for MMN and P3a. Our results confirmed the previous evidence for deteriorated duration discrimination in elderly people. Additionally, we found that this effect may be influenced by procedural factors.

Repetition suppression and its contextual determinants in predictive coding

This paper presents a review of theoretical and empirical work on repetition suppression in the context of predictive coding. Predictive coding is a neurobiologically plausible scheme explaining how biological systems might perform perceptual inference and learning. From this perspective, repetition suppression is a manifestation of minimising prediction error through adaptive changes in predictions about the content and precision of sensory inputs. Simulations of artificial neural hierarchies provide a principled way of understanding how repetition suppression – at different time scales – can be explained in terms of inference and learning implemented under predictive coding. This formulation of repetition suppression is supported by results of numerous empirical studies of repetition suppression and its contextual determinants.

Statistical context shapes stimulus-specific adaptation in human auditory cortex

Stimulus-specific adaptation is the phenomenon whereby neural response magnitude decreases with repeated stimulation. Inconsistencies between recent nonhuman animal recordings and computational modeling suggest dynamic influences on stimulus-specific adaptation. The present human electroencephalography (EEG) study investigates the potential role of statistical context in dynamically modulating stimulus-specific adaptation by examining the auditory cortex-generated N1 and P2 components. As in previous studies of stimulus-specific adaptation, listeners were presented with oddball sequences in which the presentation of a repeated tone was infrequently interrupted by rare spectral changes taking on three different magnitudes. Critically, the statistical context varied with respect to the probability of small versus large spectral changes within oddball sequences (half of the time a small change was most probable; in the other half a large change was most probable). We observed larger N1 and P2 amplitudes (i.e., release from adaptation) for all spectral changes in the small-change compared with the large-change statistical context. The increase in response magnitude also held for responses to tones presented with high probability, indicating that statistical adaptation can overrule stimulus probability per se in its influence on neural responses. Computational modeling showed that the degree of coadaptation in auditory cortex changed depending on the statistical context, which in turn affected stimulus-specific adaptation. Thus the present data demonstrate that stimulus-specific adaptation in human auditory cortex critically depends on statistical context. Finally, the present results challenge the implicit assumption of stationarity of neural response magnitudes that governs the practice of isolating established deviant-detection responses such as the mismatch negativity.

Mismatch negativity (MMN) as an index of cognitive dysfunction

Cognition is often affected in a variety of neuropsychiatric, neurological, and neurodevelopmental disorders. The neural discriminative response, reflected in mismatch negativity (MMN) and its magnetoencephalographic equivalent (MMNm), has been used as a tool to study a variety of disorders involving auditory cognition. MMN/MMNm is an involuntary brain response to auditory change or, more generally, to pattern regularity violation. For a number of disorders, MMN/MMNm amplitude to sound deviance has been shown to be attenuated or the peak-latency of the component prolonged compared to controls. This general finding suggests that while not serving as a specific marker to any particular disorder, MMN may be useful for understanding factors of cognition in various disorders, and has potential to serve as an indicator of risk. This review presents a brief history of the MMN, followed by a description of how MMN has been used to index auditory processing capability in a range of neuropsychiatric, neurological, and neurodevelopmental disorders. Finally, we suggest future directions for research to further enhance our understanding of the neural substrate of deviance detection that could lead to improvements in the use of MMN as a clinical tool.

Residual neural processing of musical sound features in adult cochlear implant users

Auditory processing in general and music perception in particular are hampered in adult cochlear implant (CI) users. To examine the residual music perception skills and their underlying neural correlates in CI users implanted in adolescence or adulthood, we conducted an electrophysiological and behavioral study comparing adult CI users with normal-hearing age-matched controls (NH controls). We used a newly developed musical multi-feature paradigm, which makes it possible to test automatic auditory discrimination of six different types of sound feature changes inserted within a musical enriched setting lasting only 20 min. The presentation of stimuli did not require the participants’ attention, allowing the study of the early automatic stage of feature processing in the auditory cortex. For the CI users, we obtained mismatch negativity (MMN) brain responses to five feature changes but not to changes of rhythm, whereas we obtained MMNs for all the feature changes in the NH controls. Furthermore, the MMNs to deviants of pitch of CI users were reduced in amplitude and later than those of NH controls for changes of pitch and guitar timber. No other group differences in MMN parameters were found to changes in intensity and saxophone timber. Furthermore, the MMNs in CI users reflected the behavioral scores from a respective discrimination task and were correlated with patients’ age and speech intelligibility. Our results suggest that even though CI users are not performing at the same level as NH controls in neural discrimination of pitch-based features, they do possess potential neural abilities for music processing. However, CI users showed a disrupted ability to automatically discriminate rhythmic changes compared with controls. The current behavioral and MMN findings highlight the residual neural skills for music processing even in CI users who have been implanted in adolescence or adulthood. Highlights: -

Automatic brain responses to musical feature changes reflect the limitations of central auditory processing in adult Cochlear Implant users.

-

The brains of adult CI users automatically process sound features changes even when inserted in a musical context.

-

CI users show disrupted automatic discriminatory abilities for rhythm in the brain.

-

Our fast paradigm demonstrate residual musical abilities in the brains of adult CI users giving hope for their future rehabilitation.

Attention effects on auditory scene analysis: insights from event-related brain potentials

Sounds emitted by different sources arrive at our ears as a mixture that must be disentangled before meaningful information can be retrieved. It is still a matter of debate whether this decomposition happens automatically or requires the listener's attention. These opposite positions partly stem from different methodological approaches to the problem. We propose an integrative approach that combines the logic of previous measurements targeting either auditory stream segregation (interpreting a mixture as coming from two separate sources) or integration (interpreting a mixture as originating from only one source). By means of combined behavioral and event-related potential (ERP) measures, our paradigm has the potential to measure stream segregation and integration at the same time, providing the opportunity to obtain positive evidence of either one. This reduces the reliance on zero findings (i.e., the occurrence of stream integration in a given condition can be demonstrated directly, rather than indirectly based on the absence of empirical evidence for stream segregation, and vice versa). With this two-way approach, we systematically manipulate attention devoted to the auditory stimuli (by varying their task relevance) and to their underlying structure (by delivering perceptual tasks that require segregated or integrated percepts). ERP results based on the mismatch negativity (MMN) show no evidence for a modulation of stream integration by attention, while stream segregation results were less clear due to overlapping attention-related components in the MMN latency range. We suggest future studies combining the proposed two-way approach with some improvements in the ERP measurement of sequential stream segregation.

A neurocomputational model of the mismatch negativity

The mismatch negativity (MMN) is an event related potential evoked by violations of regularity. Here, we present a model of the underlying neuronal dynamics based upon the idea that auditory cortex continuously updates a generative model to predict its sensory inputs. The MMN is then modelled as the superposition of the electric fields evoked by neuronal activity reporting prediction errors. The process by which auditory cortex generates predictions and resolves prediction errors was simulated using generalised (Bayesian) filtering--a biologically plausible scheme for probabilistic inference on the hidden states of hierarchical dynamical models. The resulting scheme generates realistic MMN waveforms, explains the qualitative effects of deviant probability and magnitude on the MMN - in terms of latency and amplitude--and makes quantitative predictions about the interactions between deviant probability and magnitude. This work advances a formal understanding of the MMN and--more generally--illustrates the potential for developing computationally informed dynamic causal models of empirical electromagnetic responses.

Processing of complex distracting sounds in school-aged children and adults: evidence from EEG and MEG data

When a perceiver performs a task, rarely occurring sounds often have a distracting effect on task performance. The neural mismatch responses in event-related potentials to such distracting stimuli depend on age. Adults commonly show a negative response, whereas in children a positive as well as a negative mismatch response has been reported. Using electro- and magnetoencephalography (EEG/MEG), here we investigated the developmental changes of distraction processing in school-aged children (9–10 years) and adults. Participants took part in an auditory-visual distraction paradigm comprising a visuo-spatial primary task and task-irrelevant environmental sounds distracting from this task. Behaviorally, distractors delayed reaction times (RTs) in the primary task in both age groups, and this delay was of similar magnitude in both groups. The neurophysiological data revealed an early as well as a late mismatch response elicited by distracting stimuli in both age groups. Together with previous research, this indicates that deviance detection is accomplished in a hierarchical manner in the auditory system. Both mismatch responses were localized to auditory cortex areas. All mismatch responses were generally delayed in children, suggesting that not all neurophysiological aspects of deviance processing are mature in school-aged children. Furthermore, the P3a, reflecting involuntary attention capture, was present in both age groups in the EEG with comparable amplitudes and at similar latencies, but with a different topographical distribution. This suggests that involuntary attention shifts toward complex distractors operate comparably in school-aged children and adults, yet undergoing generator maturation.

Context effects on auditory distraction

The purpose of the study was to test the hypothesis that sound context modulates the magnitude of auditory distraction, indexed by behavioral and electrophysiological measures. Participants were asked to identify tone duration, while irrelevant changes occurred in tone frequency, tone intensity, and harmonic structure. Frequency deviants were randomly intermixed with standards (Uni-Condition), with intensity deviants (Bi-Condition), and with both intensity and complex deviants (Tri-Condition). Only in the Tri-Condition did the auditory distraction effect reflect the magnitude difference among the frequency and intensity deviants. The mixture of the different types of deviants in the Tri-Condition modulated the perceived level of distraction, demonstrating that the sound context can modulate the effect of deviance level on processing irrelevant acoustic changes in the environment. These findings thus indicate that perceptual contrast plays a role in change detection processes that leads to auditory distraction.

Oblique effect in visual mismatch negativity

We investigated whether visual orientation anisotropies (known as oblique effect) exist in non-attended visual changes using event-related potentials (ERP). We recorded visual mismatch negativity (vMMN) which signals violation of sequential regularities. In the visual periphery unattended, task-irrelevant Gábor patches were displayed in an oddball sequence while subjects performed a tracking task in the central field. A moderate change (50°) in the orientation of stimuli revealed no consistent change-related components. However, we found orientation-related differences around 170 ms in occipito-temporal areas in the amplitude of the ERPs evoked by standard stimuli. In a supplementary experiment we determined the amount of orientation difference that is needed for change detection in an active, attended paradigm. Results exhibited the classical oblique effect; subjects detected 10° deviations from cardinal directions, while threshold from oblique directions was 17°. These results provide evidence that perception of change could be accomplished at significantly smaller thresholds, than what elicits vMMN. In Experiment 2 we increased the orientation change to 90°. Deviant-minus-standard difference was negative in occipito-parietal areas, between 120 and 200 ms after stimulus onset. VMMNs to changes from cardinal angles were larger and more sustained than vMMNs evoked by changes from oblique angles. Changes from cardinal orientations represent a more detectable signal for the automatic change detection system than changes from oblique angles, thus increased vMMN to these “larger” deviances might be considered a variant of the magnitude of deviance effect rarely observed in vMMN studies.

The characteristic and changes of the event-related potentials (ERP) and brain topographic maps before and after treatment with rTMS in subjective tinnitus patients

OBJECTIVES

To compare the event-related potentials (ERPs) and brain topographic maps characteristic and change in normal controls and subjective tinnitus patients before and after repetitive transcranial magnetic stimulation (rTMS) treatment.

METHODS AND PARTICIPANTS

The ERPs and brain topographic maps elicited by target stimulus were compared before and after 1-week treatment with rTMS in 20 subjective tinnitus patients and 16 healthy controls.

RESULTS

Before rTMS, target stimulus elicited a larger N1 component than the standard stimuli (repeating sounds)in control group but not in tinnitus patients. Instead, the tinnitus group pre-treatment exhibited larger amplitude of N1 in response to standard stimuli than to deviant stimuli. Furthermore tinnitus patients had smaller mismatch negativity (MMN) and late discriminative negativity (LDN)component at Fz compared with the control group. After rTMS treatment, tinnitus patients showed increased N1 response to deviant stimuli and larger MMN and LDN compared with pre-treatment. The topographic maps for the tinnitus group before rTMS -treatment demonstrated global asymmetry between the left and right cerebral hemispheres with more negative activities in left side and more positive activities in right side. In contrast, the brain topographic maps for patients after rTMS-treatment and controls seem roughly symmetrical. The ERP amplitudes and brain topographic maps in post-treatment patient group showed no significant difference with those in controls.

CONCLUSIONS

The characterical changes in ERP and brain topographic maps in tinnitus patients maybe related with the electrophysiological mechanism of tinnitus induction and development. It can be used as an objective biomarker for the evaluation of auditory central in subjective tinnitus patients. These findings support the notion that rTMS treatment in tinnitus patients may exert a beneficial effect.

Multisensory representation of frequency across audition and touch: high density electrical mapping reveals early sensory-perceptual coupling

The frequency of environmental vibrations is sampled by two of the major sensory systems, audition and touch, notwithstanding that these signals are transduced through very different physical media and entirely separate sensory epithelia. Psychophysical studies have shown that manipulating frequency in audition or touch can have a significant cross-sensory impact on perceived frequency in the other sensory system, pointing to intimate links between these senses during computation of frequency. In this regard, the frequency of a vibratory event can be thought of as a multisensory perceptual construct. In turn, electrophysiological studies point to temporally early multisensory interactions that occur in hierarchically early sensory regions where convergent inputs from the auditory and somatosensory systems are to be found. A key question pertains to the level of processing at which the multisensory integration of featural information, such as frequency, occurs. Do the sensory systems calculate frequency independently before this information is combined, or is this feature calculated in an integrated fashion during preattentive sensory processing? The well characterized mismatch negativity, an electrophysiological response that indexes preattentive detection of a change within the context of a regular pattern of stimulation, served as our dependent measure. High-density electrophysiological recordings were made in humans while they were presented with separate blocks of somatosensory, auditory, and audio-somatosensory "standards" and "deviants," where the deviant differed in frequency. Multisensory effects were identified beginning at ∼200 ms, with the multisensory mismatch negativity (MMN) significantly different from the sum of the unisensory MMNs. This provides compelling evidence for preattentive coupling between the somatosensory and auditory channels in the cortical representation of frequency.

Spatial localization of auditory stimuli in human auditory cortex is based on both head-independent and head-centered coordinate systems

In humans, whose ears are fixed on the head, auditory stimuli are initially registered in space relative to the head. Eventually, locations of sound sources need to be encoded also relative to the body, or in absolute allocentric space, to allow orientation toward the sounds sources and consequent action. We can therefore distinguish between two spatial representation systems: a basic head-centered coordinate system and a more complex head-independent system. In an ERP experiment, we attempted to reveal which of these two coordinate systems is represented in the human auditory cortex. We dissociated the two systems using the mismatch negativity (MMN), a well studied EEG effect evoked by acoustic deviations. Contrary to previous findings suggesting that only primary head-related information is present at this early stage of processing, we observed significant MMN effects for both head-independent and head-centered deviant stimuli. Our findings thus reveal that both primary head-related and secondary body- or world-related reference frames are represented at this stage of auditory processing.

Regularity extraction from non-adjacent sounds

The regular behavior of sound sources helps us to make sense of the auditory environment. Regular patterns may, for instance, convey information on the identity of a sound source (such as the acoustic signature of a train moving on the rails). Yet typically, this signature overlaps in time with signals emitted from other sound sources. It is generally assumed that auditory regularity extraction cannot operate upon this mixture of signals because it only finds regularities between adjacent sounds. In this view, the auditory environment would be grouped into separate entities by means of readily available acoustic cues such as separation in frequency and location. Regularity extraction processes would then operate upon the resulting groups. Our new experimental evidence challenges this view. We presented two interleaved sound sequences which overlapped in frequency range and shared all acoustic parameters. The sequences only differed in their underlying regular patterns. We inserted deviants into one of the sequences to probe whether the regularity was extracted. In the first experiment, we found that these deviants elicited the mismatch negativity (MMN) component. Thus the auditory system was able to find the regularity between the non-adjacent sounds. Regularity extraction was not influenced by sequence cohesiveness as manipulated by the relative duration of tones and silent inter-tone-intervals. In the second experiment, we showed that a regularity connecting non-adjacent sounds was discovered only when the intervening sequence also contained a regular pattern, but not when the intervening sounds were randomly varying. This suggests that separate regular patterns are available to the auditory system as a cue for identifying signals coming from distinct sound sources. Thus auditory regularity extraction is not necessarily confined to a processing stage after initial sound grouping, but may precede grouping when other acoustic cues are unavailable.

Disentangling early sensory information processing deficits in schizophrenia

OBJECTIVE

The disentangling of early sensory information processing deficits and examination of their relationships to demographic and clinical factors are important steps for the validation of potential biomarkers and/or endophenotypes of schizophrenia. The aims of the present study were to characterize commonly used sensory event-related potential deficits, to determine whether they are (1) distinct from one another and (2) independently associated with important clinical characteristics.

METHODS

MMN, P3a and RON event-related potentials (ERP) were recorded from schizophrenia patients (SZ; n=429) and nonpsychiatric comparison subjects (NCS; n=286). Subgroup analyses on demographic and clinical variables were performed.

RESULTS

Schizophrenia patients exhibited robust ERP deficits at frontocentral electrodes (MMN: d=1.10; P3a: d=0.87; RON: d=0.77), consistent with previous studies. Each ERP component uniquely accounted for variance in amplitude and schizophrenia deficits. Amplitude reductions occurred with increasing age in both NCS and SZ patients. A small subset of patients prescribed combinations of 1st and 2nd generation antipsychotics exhibited significantly reduced MMN amplitude relative to other medication-defined subgroups.

CONCLUSIONS

MMN, P3a, and RON are dissociable deficits with distinct relationships to age and medication status in schizophrenia patients, potentially reflecting divergent pathophysiological processes. Reduced MMN in patients taking multiple antipsychotic medications appear to be attributable to greater severity of symptoms and functional impairments, rather than a medication effect.

SIGNIFICANCE

Independent information processing deficits in schizophrenia patients may differentially contribute to the commonly observed deficits in neurocognitive and psychosocial functioning.

Responses to deviants are modulated by subthreshold variability of the standard

Auditory mechanisms automatically detect both basic features of sounds and the rules governing their presentation. In the oddball paradigm, the auditory system detects the sameness (or no-variability) rule when the same reference tone is consistently repeated. We used two oddball protocols, the classical one with a fixed reference and a modified one with a jittered reference, to determine whether the auditory system can detect subthreshold violations of sameness. We found that the response to the repeated standard was not modified by the small jitter. However, the response to the frequency oddball was smaller under the jittered protocol, indicating hypersensitivity to sameness. The sensitivity to jitter was largest when the oddball deviated by 8%, was smaller for 40%, and disappeared at 100% deviation, indicating that sensitivity to sameness is context dependent; namely, it is scaled with respect to the overall range of stimuli.

Non-linear laws of echoic memory and auditory change detection in humans

BACKGROUND

The detection of any abrupt change in the environment is important to survival. Since memory of preceding sensory conditions is necessary for detecting changes, such a change-detection system relates closely to the memory system. Here we used an auditory change-related N1 subcomponent (change-N1) of event-related brain potentials to investigate cortical mechanisms underlying change detection and echoic memory.

RESULTS

Change-N1 was elicited by a simple paradigm with two tones, a standard followed by a deviant, while subjects watched a silent movie. The amplitude of change-N1 elicited by a fixed sound pressure deviance (70 dB vs. 75 dB) was negatively correlated with the logarithm of the interval between the standard sound and deviant sound (1, 10, 100, or 1000 ms), while positively correlated with the logarithm of the duration of the standard sound (25, 100, 500, or 1000 ms). The amplitude of change-N1 elicited by a deviance in sound pressure, sound frequency, and sound location was correlated with the logarithm of the magnitude of physical differences between the standard and deviant sounds.

CONCLUSIONS

The present findings suggest that temporal representation of echoic memory is non-linear and Weber-Fechner law holds for the automatic cortical response to sound changes within a suprathreshold range. Since the present results show that the behavior of echoic memory can be understood through change-N1, change-N1 would be a useful tool to investigate memory systems.

Mismatch negativity with visual-only and audiovisual speech

The functional organization of cortical speech processing is thought to be hierarchical, increasing in complexity and proceeding from primary sensory areas centrifugally. The current study used the mismatch negativity (MMN) obtained with electrophysiology (EEG) to investigate the early latency period of visual speech processing under both visual-only (VO) and audiovisual (AV) conditions. Current density reconstruction (CDR) methods were used to model the cortical MMN generator locations. MMNs were obtained with VO and AV speech stimuli at early latencies (approximately 82-87 ms peak in time waveforms relative to the acoustic onset) and in regions of the right lateral temporal and parietal cortices. Latencies were consistent with bottom-up processing of the visible stimuli. We suggest that a visual pathway extracts phonetic cues from visible speech, and that previously reported effects of AV speech in classical early auditory areas, given later reported latencies, could be attributable to modulatory feedback from visual phonetic processing.

Right Hemispheric Contributions to Fine Auditory Temporal Discriminations: High-Density Electrical Mapping of the Duration Mismatch Negativity (MMN)

That language processing is primarily a function of the left hemisphere has led to the supposition that auditory temporal discrimination is particularly well-tuned in the left hemisphere, since speech discrimination is thought to rely heavily on the registration of temporal transitions. However, physiological data have not consistently supported this view. Rather, functional imaging studies often show equally strong, if not stronger, contributions from the right hemisphere during temporal processing tasks, suggesting a more complex underlying neural substrate. The mismatch negativity (MMN) component of the human auditory evoked-potential provides a sensitive metric of duration processing in human auditory cortex and lateralization of MMN can be readily assayed when sufficiently dense electrode arrays are employed. Here, the sensitivity of the left and right auditory cortex for temporal processing was measured by recording the MMN to small duration deviants presented to either the left or right ear. We found that duration deviants differing by just 15% (i.e. rare 115 ms tones presented in a stream of 100 ms tones) elicited a significant MMN for tones presented to the left ear (biasing the right hemisphere). However, deviants presented to the right ear elicited no detectable MMN for this separation. Further, participants detected significantly more duration deviants and committed fewer false alarms for tones presented to the left ear during a subsequent psychophysical testing session. In contrast to the prevalent model, these results point to equivalent if not greater right hemisphere contributions to temporal processing of small duration changes.

The mismatch negativity: a review of underlying mechanisms

The mismatch negativity (MMN) is a brain response to violations of a rule, established by a sequence of sensory stimuli (typically in the auditory domain) [Näätänen R. Attention and brain function. Hillsdale, NJ: Lawrence Erlbaum; 1992]. The MMN reflects the brain's ability to perform automatic comparisons between consecutive stimuli and provides an electrophysiological index of sensory learning and perceptual accuracy. Although the MMN has been studied extensively, the neurophysiological mechanisms underlying the MMN are not well understood. Several hypotheses have been put forward to explain the generation of the MMN; amongst these accounts, the "adaptation hypothesis" and the "model adjustment hypothesis" have received the most attention. This paper presents a review of studies that focus on neuronal mechanisms underlying the MMN generation, discusses the two major explanatory hypotheses, and proposes predictive coding as a general framework that attempts to unify both.

Comparator and non-comparator mechanisms of change detection in the context of speech--an ERP study

Automatic change detection reflects a cognitive memory-based comparison mechanism as well as a sensorial non-comparator mechanism based on differential states of refractoriness. The purpose of this study was to examine whether the comparator mechanism of the mismatch negativity component (MMN) is differentially affected by the lexical status of the deviant. Event-related potential (ERP) data was collected during an "oddball" paradigm designed to elicit the MMN from 15 healthy subjects that were involved in a counting task. Topography pattern analysis and source estimation were utilized to examine the deviance (deviants vs. standards), cognitive (deviants vs. control counterparts) and refractoriness (standards vs. control counterparts) effects elicited by standard-deviant pairs ("deh-day"; "day-deh"; "teh-tay") embedded within "oddball" blocks. Our results showed that when the change was salient regardless of lexical status (i.e., the /e:/ to /eI/ transition) the response tapped the comparator based-mechanism of the MMN which was located in the cuneus/posterior cingulate, reflected sensitivity to the novelty of the auditory object, appeared in the P2 latency range and mainly involved topography modulations. In contrast, when the novelty was low (i.e., the /eI/ to /e:/ transition) an acoustic change complex was elicited which involved strength modulations over the P1/N1 range and implicated the middle temporal gyrus. This result pattern also resembled the one displayed by the non-comparator mechanism. These findings suggest spatially and temporally distinct brain activities of comparator mechanisms of change detection in the context of speech.