Allophonic familiarity differentiates word representations in the brain of native speakers of regional linguistic varieties

This study aims to shed light on the issue whether familiar allophonic variation is encoded in word representations. Both Italian speakers born in Trentino and speakers born in the Central-Southern regions of Italy took part in the experiment. We tested the MMN elicited by the same word encompassing two different allophones, one of which was more familiar to one group of participants than to the other, depending on their regional variety of Italian. The Trentino group showed an enhanced MMN for the word embedding the familiar variant while Central-Southern speakers showed no difference. The amplitude of the MMN for the unfamiliar word variant in Trentino speakers showed an inverse correlation with the passive exposure to the Trentino dialect. We conclude that words embedding familiar and unfamiliar allophones are differently represented in the brain of native speakers of regional language and the degree of differentiation is modulated by individual experience.

Electrophysiological Signatures of Perceiving Alternated Tone in Mandarin Chinese: Mismatch Negativity to Underlying Tone Conflict

Although phonological alternation is prevalent in languages, the process of perceiving phonologically alternated sounds is poorly understood, especially at the neurolinguistic level. We examined the process of perceiving Mandarin 3rd tone sandhi (T3 + T3 → T2 + T3) with a mismatch negativity (MMN) experiment. Our design has two independent variables (whether the deviant undergoes tone sandhi; whether the standard and the deviant have matched underlying tone). These two independent variables modulated ERP responses in both the first and the second syllables. Notably, despite the apparent segmental conflict between the standard and the deviant in all conditions, MMN is only observed when neither the standard nor the deviant undergoes tone sandhi, suggesting that discovering the underlying representation of an alternated sound could interfere with the generation of MMN. A tentative model with three hypothesized underlying processing mechanisms is proposed to explain the observed latency and amplitude differences across conditions. The results are also discussed in light of the potential electrophysiological signatures involved in the process of perceiving alternated sounds.

Word class and word frequency in the MMN looking glass

The effects of lexical meaning and lexical familiarity on auditory deviance detection were investigated by presenting oddball sequences of words, while participants ignored the stimuli. Stimulus sequences were composed of words that were varied in word class (nouns vs. functions words) and frequency of language use (high vs. low frequency) in a factorial design with the roles of frequently presented stimuli (Standards) and infrequently presented ones (Deviants) were fully crossed. Deviants elicited the Mismatch Negativity component of the event-related brain potential. Modulating effects of lexical meaning were obtained, revealing processing advantages for denotationally meaningful items. However, no effect of word frequency was observed. These results demonstrate that an apparently low-level function, such as auditory deviance detection utilizes information from the mental lexicon even for task-irrelevant stimuli.

Predictive coding of phonological rules in auditory cortex: A mismatch negativity study

The brain is constantly generating predictions of future sensory input to enable efficient adaptation. In the auditory domain, this applies also to the processing of speech. Here we aimed to determine whether the brain predicts the following segments of speech input on the basis of language-specific phonological rules that concern non-adjacent phonemes. Auditory event-related potentials (ERP) were recorded in a mismatch negativity (MMN) paradigm, where the Finnish vowel harmony, determined by the first syllables of pseudowords, either constrained or did not constrain the phonological composition of pseudoword endings. The phonological rule of vowel harmony was expected to create predictions about phonologically legal pseudoword endings. Results showed that MMN responses were larger for phonologically illegal than legal pseudowords, and P3a was elicited only for illegal pseudowords. This supports the hypothesis that speech input is evaluated against context-dependent phonological predictions that facilitate speech processing.

Repair or Violation Detection? Pre-Attentive Processing Strategies of Phonotactic Illegality Demonstrated on the Constraint of g-Deletion in German

PURPOSE

Effects of categorical phonotactic knowledge on pre-attentive speech processing were investigated by presenting illegal speech input that violated a phonotactic constraint in German called "g-deletion." The present study aimed to extend previous findings of automatic processing of phonotactic violations and to investigate the role of stimulus context in triggering either an automatic phonotactic repair or a detection of the violation.

METHOD

The mismatch negativity event-related potential component was obtained in 2 identical cross-sectional experiments with speaker variation and 16 healthy adult participants each. Four pseudowords were used as stimuli, 3 of them phonotactically legal and 1 illegal. Stimuli were contrasted pairwise in passive oddball conditions and presented binaurally via headphones. Results were analyzed by means of mixed design analyses of variance.

RESULTS

Phonotactically illegal stimuli were found to be processed differently compared to legal ones. Results indicate evidence for both automatic repair and detection of the phonotactic violation depending on the linguistic context the illegal stimulus was embedded in.

CONCLUSIONS

These findings corroborate notions that categorical phonotactic knowledge is activated and applied even in the absence of attention. Thus, our findings contribute to the general understanding of sublexical phonological processing and may be of use for further developing speech recognition models.

Temporal dynamics of contingency extraction from tonal and verbal auditory sequences

Consecutive sound events are often to some degree predictive of each other. Here we investigated the brain's capacity to detect contingencies between consecutive sounds by means of electroencephalography (EEG) during passive listening. Contingencies were embedded either within tonal or verbal stimuli. Contingency extraction was measured indirectly via the elicitation of the mismatch negativity (MMN) component of the event-related potential (ERP) by contingency violations. MMN results indicate that structurally identical forms of predictability can be extracted from both tonal and verbal stimuli. We also found similar generators to underlie the processing of contingency violations across stimulus types, as well as similar performance in an active-listening follow-up test. However, the process of passive contingency extraction was considerably slower (twice as many rule exemplars were needed) for verbal than for tonal stimuli These results suggest caution in transferring findings on complex predictive regularity processing obtained with tonal stimuli directly to the speech domain.

Evidence for the role of German final devoicing in pre-attentive speech processing: a mismatch negativity study

Results of a mismatch negativity experiment are reported in which the pre-attentive relevance of the German phonological alternation of final devoicing (FD) is shown in two ways. The experiment employs pseudowords. (1) A deviant [vus] paired with standard /vuzə/ did not show a mismatch effect for the voicing change in /z/ versus [s] because the two can be related by FD. When standard and deviant were reversed, the two could not be related by FD and a mismatch effect for the voicing difference occurred. (2) An ill-formed deviant that violates FD, *[vuz], triggered mismatch effects that were plausibly attributed to its ill-formedness. The results show that a syllable-related process like FD is already taken into account by the processing system in early pre-attentive processing.

Mismatch negativity (MMN) as an index of cognitive dysfunction

Cognition is often affected in a variety of neuropsychiatric, neurological, and neurodevelopmental disorders. The neural discriminative response, reflected in mismatch negativity (MMN) and its magnetoencephalographic equivalent (MMNm), has been used as a tool to study a variety of disorders involving auditory cognition. MMN/MMNm is an involuntary brain response to auditory change or, more generally, to pattern regularity violation. For a number of disorders, MMN/MMNm amplitude to sound deviance has been shown to be attenuated or the peak-latency of the component prolonged compared to controls. This general finding suggests that while not serving as a specific marker to any particular disorder, MMN may be useful for understanding factors of cognition in various disorders, and has potential to serve as an indicator of risk. This review presents a brief history of the MMN, followed by a description of how MMN has been used to index auditory processing capability in a range of neuropsychiatric, neurological, and neurodevelopmental disorders. Finally, we suggest future directions for research to further enhance our understanding of the neural substrate of deviance detection that could lead to improvements in the use of MMN as a clinical tool.

Immediate auditory repetition of words and nonwords: an ERP study of lexical and sublexical processing

ERPs were elicited to (1) words, (2) pseudowords derived from these words, and (3) nonwords with no lexical neighbors, in a task involving listening to immediately repeated auditory stimuli. There was a significant early (P200) effect of phonotactic probability in the first auditory presentation, which discriminated words and pseudowords from nonwords; and a significant somewhat later (N400) effect of lexicality, which discriminated words from pseudowords and nonwords. There was no reliable effect of lexicality in the ERPs to the second auditory presentation. We conclude that early sublexical phonological processing differed according to phonotactic probability of the stimuli, and that lexically-based redintegration occurred for words but did not occur for pseudowords or nonwords. Thus, in online word recognition and immediate retrieval, phonological and/or sublexical processing plays a more important role than lexical level redintegration.

Prediction in the service of comprehension: modulated early brain responses to omitted speech segments

Speech signals are often compromised by disruptions originating from external (e.g., masking noise) or internal (e.g., inaccurate articulation) sources. Speech comprehension thus entails detecting and replacing missing information based on predictive and restorative neural mechanisms. The present study targets predictive mechanisms by investigating the influence of a speech segment's predictability on early, modality-specific electrophysiological responses to this segment's omission. Predictability was manipulated in simple physical terms in a single-word framework (Experiment 1) or in more complex semantic terms in a sentence framework (Experiment 2). In both experiments, final consonants of the German words Lachs ([laks], salmon) or Latz ([lats], bib) were occasionally omitted, resulting in the syllable La ([la], no semantic meaning), while brain responses were measured with multi-channel electroencephalography (EEG). In both experiments, the occasional presentation of the fragment La elicited a larger omission response when the final speech segment had been predictable. The omission response occurred ∼125-165 msec after the expected onset of the final segment and showed characteristics of the omission mismatch negativity (MMN), with generators in auditory cortical areas. Suggestive of a general auditory predictive mechanism at work, this main observation was robust against varying source of predictive information or attentional allocation, differing between the two experiments. Source localization further suggested the omission response enhancement by predictability to emerge from left superior temporal gyrus and left angular gyrus in both experiments, with additional experiment-specific contributions. These results are consistent with the existence of predictive coding mechanisms in the central auditory system, and suggestive of the general predictive properties of the auditory system to support spoken word recognition.

The five myths of MMN: redefining how to use MMN in basic and clinical research

The goal of this review article is to redefine what the mismatch negativity (MMN) component of event-related potentials reflects in auditory scene analysis, and to provide an overview of how the MMN serves as a valuable tool in Cognitive Neuroscience research. In doing so, some of the old beliefs (five common 'myths') about MMN will be dispelled, such as the notion that MMN is a simple feature discriminator and that attention itself modulates MMN elicitation. A revised description of what MMN truly reflects will be provided, which includes a principal focus onto the highly context-dependent nature of MMN elicitation and new terminology to discuss MMN and attention. This revised framework will help clarify what has been a long line of seemingly contradictory results from studies in which behavioral ability to hear differences between sounds and passive elicitation of MMN have been inconsistent. Understanding what MMN is will also benefit clinical research efforts by providing a new picture of how to design appropriate paradigms suited to various clinical populations.

Mismatch negativity (MMN) to successive deviants within one hierarchically structured auditory object

The Mismatch Negativity (MMN), a component of the event-related potential (ERP), is elicited by a deviant following a series of standard stimuli. The present study addressed the question whether two deviants occurring successively in one hierarchically organized auditory object would elicit separate MMN responses. An example of such an object is a VC syllable (vowel+consonant). In a passive oddball protocol, the syllables [ɔx] and [ɛʃ] were presented both as standards and deviants so that both phonemes, the vowel and the consonant, changed in the respective deviant. Two negative responses were found in the deviant-minus-standard difference waves. Due to the latencies these effects could not be interpreted as separate MMN responses to the phonemic changes. Instead, the first effect (108ms) was taken as an N1 modulation whereas the second negativity (168ms) was interpreted as an MMN mainly reflecting the change of the initial vowel. Furthermore, the present data were statistically compared with related results from Steinberg et al. (2010a, b) obtained partly from the same stimuli presented in oddball blocks with simple mono-phonemic deviances due to changing vowels. Higher MMN amplitudes were found for the syllable [ɛʃ] in the present data compared to those previous findings. Although this difference was only present for one of the stimulus syllables, it is discussed as a possible indicator of an anticipatory MMN enhancement due to the predictability of the second change in the deviant of the present experiment.

The role of stimulus cross-splicing in an event-related potentials study. Misleading formant transitions hinder automatic phonological processing

The mental organization of linguistic knowledge and its involvement in speech processing can be investigated using the mismatch negativity (MMN) component of the auditory event-related potential. A contradiction arises, however, between the technical need for strict control of acoustic stimulus properties and the quest for naturalness and acoustic variability of the stimuli. Here, two methods of preparing speech stimulus material were compared. Focussing on the automatic processing of a phonotactic restriction in German, two corresponding sets of various vowel-fricative syllables were used as stimuli. The former syllables were naturally spoken while the latter ones were created by means of cross-splicing. Phonetically, natural and spliced syllables differed with respect to the appropriateness of coarticulatory information about the forthcoming fricative within the vowels. Spliced syllables containing clearly misleading phonetic information were found to elicit larger N2 responses compared to their natural counterparts. Furthermore, MMN results found for the natural syllables could not be replicated with these spliced stimuli. These findings indicate that the automatic processing of the stimuli was considerably affected by the stimulus preparation method. Thus, in spite of its unquestioned benefits for MMN experiments, the splicing technique may lead to interference effects on the linguistic factors under investigation.

Preattentive extraction of abstract auditory rules in speech sound stream: a mismatch negativity study using lexical tones

BACKGROUND

Extraction of linguistically relevant auditory features is critical for speech comprehension in complex auditory environments, in which the relationships between acoustic stimuli are often abstract and constant while the stimuli per se are varying. These relationships are referred to as the abstract auditory rule in speech and have been investigated for their underlying neural mechanisms at an attentive stage. However, the issue of whether or not there is a sensory intelligence that enables one to automatically encode abstract auditory rules in speech at a preattentive stage has not yet been thoroughly addressed.

METHODOLOGY/PRINCIPAL FINDINGS

We chose Chinese lexical tones for the current study because they help to define word meaning and hence facilitate the fabrication of an abstract auditory rule in a speech sound stream. We continuously presented native Chinese speakers with Chinese vowels differing in formant, intensity, and level of pitch to construct a complex and varying auditory stream. In this stream, most of the sounds shared flat lexical tones to form an embedded abstract auditory rule. Occasionally the rule was randomly violated by those with a rising or falling lexical tone. The results showed that the violation of the abstract auditory rule of lexical tones evoked a robust preattentive auditory response, as revealed by whole-head electrical recordings of the mismatch negativity (MMN), though none of the subjects acquired explicit knowledge of the rule or became aware of the violation.

CONCLUSIONS/SIGNIFICANCE

Our results demonstrate that there is an auditory sensory intelligence in the perception of Chinese lexical tones. The existence of this intelligence suggests that the humans can automatically extract abstract auditory rules in speech at a preattentive stage to ensure speech communication in complex and noisy auditory environments without drawing on conscious resources.

Linguistic multifeature MMN paradigm for extensive recording of auditory discrimination profiles

We studied whether a multifeature mismatch negativity (MMN) paradigm using naturally produced speech stimuli is feasible for studies of auditory discrimination accuracy of adult participants. A naturally produced trisyllabic pseudoword was used in the paradigm, and MMNs were recorded to changes that were acoustic (changes in fundamental frequency or intensity) or potentially phonological (changes in vowel identity or vowel duration). All the different changes were presented in three different word segments (initial, middle, or final syllable). All changes elicited an MMN response, but the vowel duration change elicited a different response pattern than the other deviant types. Changes in vowel duration and identity also had an effect on MMN lateralization. Our results show that assessing speech sound discrimination of several features in word context is possible in a short recording time (30 min) with the multifeature paradigm.