Regional differences in the listener's phonemic inventory affect semantic processing: A mismatch negativity (MMN) study

Exploring the impact of tonal inventory on speech perception across languages: a study of MMN responses in tonal language speakers

Previous research on the perception of segmental features of languages has established a correlation between the phoneme inventory of a language and its speakers' perceptual abilities, as indexed by discrimination tasks and Mismatch Negativity (MMN). Building on this background, the current study elucidated the relationship between perceptual ability and tonal inventory by utilizing two tonal languages. Two groups of participants were included in the present experiment: Mandarin speakers and Hakka-Mandarin speakers. Onset latency analysis revealed a significant difference in the Mandarin syllable condition, with Hakka-Mandarin speakers demonstrating earlier MMN latency than Mandarin speakers. This suggests a more efficient auditory processing mechanism in Hakka-Mandarin speakers. Both groups, however, showed similar MMN latency in the Hakka syllable condition. The interaction between language background and syllable type indicates that other factors, such as syllable sonority, also influence MMN responses. These findings highlight the importance of considering multiple phonemic inventories and syllable characteristics in studies of tonal perception.

Regionally specific cortical lateralization of abstract and concrete verb processing: Magnetic mismatch negativity study

The neural underpinnings of processing concrete and abstract semantics remain poorly understood. Previous fMRI studies have shown that multimodal and amodal neural networks respond differentially to different semantic types; importantly, abstract semantics activates more left-lateralized networks, as opposed to more bilateral activity for concrete words. Due to the lack of temporal resolution, these fMRI results do not allow to easily separate language- and task-specific brain responses and to disentangle early processing stages from later post-comprehension phenomena. To tackle this, we used magnetoencephalography (MEG), a time-resolved neuroimaging technique, in combination with a task-free oddball mismatch negativity (MMN) paradigm, an established approach to tracking early automatic activation of word-specific memory traces in the brain. We recorded the magnetic MMN responses in 30 healthy adults to auditorily presented abstract and concrete action verbs to assess lateralization of word-specific lexico-semantic processing in a set of neocortical areas. We found that MMN responses to these stimuli showed different lateralization patterns of activity in the upper limb motor area (BA4) and parts of Broca's area (BA45/BA47) within ∼100-350 ms after the word disambiguation point. Importantly, the greater leftward response lateralization for abstract semantics was due to the lesser involvement of the right-hemispheric homologues, not increased left-hemispheric activity. These findings suggest differential region-specific involvement of bilateral sensorimotor systems already in the early automatic stages of processing abstract and concrete action semantics.

Electrophysiological Signatures of Perceiving Alternated Tone in Mandarin Chinese: Mismatch Negativity to Underlying Tone Conflict

Although phonological alternation is prevalent in languages, the process of perceiving phonologically alternated sounds is poorly understood, especially at the neurolinguistic level. We examined the process of perceiving Mandarin 3rd tone sandhi (T3 + T3 → T2 + T3) with a mismatch negativity (MMN) experiment. Our design has two independent variables (whether the deviant undergoes tone sandhi; whether the standard and the deviant have matched underlying tone). These two independent variables modulated ERP responses in both the first and the second syllables. Notably, despite the apparent segmental conflict between the standard and the deviant in all conditions, MMN is only observed when neither the standard nor the deviant undergoes tone sandhi, suggesting that discovering the underlying representation of an alternated sound could interfere with the generation of MMN. A tentative model with three hypothesized underlying processing mechanisms is proposed to explain the observed latency and amplitude differences across conditions. The results are also discussed in light of the potential electrophysiological signatures involved in the process of perceiving alternated sounds.

Who speaks next? Adaptations to speaker identity in processing spoken sentences

When listening to a speaker, we need to adapt to her individual speaking characteristics, such as error proneness, accent, etc. The present study investigated two aspects of adaptation to speaker identity during processing spoken sentences in multi-speaker situations: the effect of speaker sequence across sentences and the effect of learning speaker-specific error probability. Spoken sentences were presented, cued, and accompanied by one of three portraits that were labeled as the speakers' faces. In Block 1 speaker-specific probabilities of syntax errors were 10%, 50%, or 90%; in Block 2 they were uniformly 50%. In both blocks, speech errors elicited P600 effects in the scalp recorded ERP. We found a speaker sequence effect only in Block 1: the P600 to target words was larger after speaker switches than after speaker repetitions, independent of sentence correctness. In Block 1, listeners showed higher accuracy in judging sentence correctness spoken by speakers with lower error proportions. No speaker-specific differences in target word P600 and accuracy were found in Block 2. When speakers differ in error proneness, listeners seem to flexibly adapt their speech processing for the upcoming sentence through attention reorientation and resource reallocation if the speaker is about to change, and through proactive maintenance of neural resources if the speaker remains the same.

One-week phonemic training rebuilds the memory traces of merged phonemes in merged speakers

The phonemic merger is a unique phenomenon which is referred to as acoustically very different phonemes are recognized as the same phoneme. In our previous study, we demonstrated that the merged speakers had lost the ability to discriminate the merged phonemes pre-attentively, as revealed by their failure in mismatch negativity (MMN) elicitation in the oddball stream of the merged phonemes /n/-/l/. In this study, we investigated the recovery of the discrimination ability via phonemic training and found that the merged speakers regained the ability of discriminating merged phonemes pre-attentively, after a 7-day /n/-/l/ phonemic training, as revealed by the reactivation of MMN brain response to the /n/-/l/ phoneme categories. Our finding indicates that separate memory traces of merged phonemes could be rebuilt during the training process.

Automatic processing of pragmatic information in the human brain: a mismatch negativity study

Language comprehension involves pragmatic information processing, which allows world knowledge to influence the interpretation of a sentence. This study explored whether pragmatic information can be automatically processed during spoken sentence comprehension. The experiment adopted the mismatch negativity (MMN) paradigm to capture the neurophysiological indicators of automatic processing of spoken sentences. Pragmatically incorrect ('Foxes have wings') and correct ('Butterflies have wings') sentences were used as the experimental stimuli. In condition 1, the pragmatically correct sentence was the deviant and the pragmatically incorrect sentence was the standard stimulus, whereas the opposite case was presented in condition 2. The experimental results showed that, compared with the condition that the pragmatically correct sentence is the deviant stimulus, when the condition that the pragmatically incorrect sentence is the deviant stimulus MMN effects were induced within 60-120 and 220-260 ms. The results indicated that the human brain can monitor for incorrect pragmatic information in the inattentive state and can automatically process pragmatic information at the beginning of spoken sentence comprehension.

The influence of sex information into spoken words: a mismatch negativity (MMN) study

When exposed to a spoken message, a listener takes into account several sources of linguistic and indexical information. Using the mismatch negativity (MMN) response, we examined whether the indexical information about the sex of the speaker influenced the processing of semantically gendered spoken words. Female participants listened two semantically gendered French words, one masculine and one feminine representing human beings, said either by five male or by five female speakers. The opposite sex voices produced an enhancement of MMN response. In line with interactive connections between indexical and linguistic information processing through activating lexical memory traces, the results showed more pronounced MMN response when the sex of the speaker matched with the gender of the word. Furthermore, there was a later detection of the incongruence between the sex information about the speaker and the gender of the word, shown by an enhancement of MMN response. Overall, these findings suggest that the listeners integrate the indexical information about the sex of the speakers both at the lexical selection level and at a higher-level processing such as the grammatical access.

Glasgow Gloom or Leeds Glue? Dialect-Specific Vowel Duration Constrains Lexical Segmentation and Access

Timing cues are important in many aspects of speech processing, fromidentifying segments to locating word and phrase boundaries. They vary across accents, yet representation and processing of this variation are poorly understood. We investigated whether an accent difference in vowel duration affects lexical segmentation and access. In Glasgow English (GE), /i u e o/ are shorter than in Leeds English (LE), especially for /i u/ before voiced stops and nasals. In a word-spotting experiment, GE and LE participants heard nonsense sequences (e.g. pobegloomezh) containing embedded words (gloom, glue), with segmental qualities intermediate between GE and LE. Critical vowel durations were manipulated according to accent (GE-appropriate vowels shorter than LE-appropriate ones) and phonological context (vowels shortest before voiceless stops < voiced stops/nasals < voiced fricatives). GE participants generally spotted words like gloom more accurately with GE-appropriate than LE-appropriate vowels. LE participants were less accurate than GE participants to spot words like gloom with GE-appropriate vowels, but more likely to spot embeddings like glue. These results were broadly as predicted based on the accent differences, but depended less than expected on the accent-specific phonological constraints. We discuss theoretical implications regarding the representation of duration and the time course of lexical access.

Neural indices of phonemic discrimination and sentence-level speech intelligibility in quiet and noise: A mismatch negativity study

Successful speech communication requires the extraction of important acoustic cues from irrelevant background noise. In order to better understand this process, this study examined the effects of background noise on mismatch negativity (MMN) latency, amplitude, and spectral power measures as well as behavioral speech intelligibility tasks. Auditory event-related potentials (AERPs) were obtained from 15 normal-hearing participants to determine whether pre-attentive MMN measures recorded in response to a consonant (from /ba/ to /bu/) and vowel change (from /ba/ to /da/) in a double-oddball paradigm can predict sentence-level speech perception. The results showed that background noise increased MMN latencies and decreased MMN amplitudes with a reduction in the theta frequency band power. Differential noise-induced effects were observed for the pre-attentive processing of consonant and vowel changes due to different degrees of signal degradation by noise. Linear mixed-effects models further revealed significant correlations between the MMN measures and speech intelligibility scores across conditions and stimuli. These results confirm the utility of MMN as an objective neural marker for understanding noise-induced variations as well as individual differences in speech perception, which has important implications for potential clinical applications.

Dialect Variation Influences the Phonological and Lexical-Semantic Word Processing in Sentences. Electrophysiological Evidence from a Cross-Dialectal Comprehension Study

This event-related potential (ERP) study examines the influence of dialectal competence differences (merged vs. unmerged dialect group) on cross-dialectal comprehension between Southern German dialects. It focuses on the question as to whether certain dialect phonemes (/oa⌢/, /oƱ⌢/), which are attributed to different lexemes in two dialect areas (Central Bavarian, Bavarian-Alemannic transition zone) evoke increased neural costs during sentence processing. In this context, the phonological and semantic processing of lexemes is compared in three types of potentially problematic communication settings (misunderstanding, incomprehension, allophonic variation = potential comprehension). For this purpose, an oddball design including whole sentences was combined with a semantic rating task. Listeners from the unmerged Central Bavarian dialect area heard sentences including either native or non-native lexemes from the merged neighboring dialect. These had to be evaluated with regard to their context acceptability. The main difference between the lexemes can be attributed to the fact that they have different meanings in the respective dialect areas or are non-existent in the linguistic competence of the Central Bavarians. The results provide evidence for the fact that non-native lexemes containing the /oa⌢/-diphthong lead to enhanced neural costs during sentence processing. The ERP results show a biphasic pattern (N2b/N400, LPC) for non-existent lexemes (incomprehension) as well as for semantically incongruous lexemes (misunderstanding), reflecting an early error detection mechanism and enhanced costs for semantic integration and evaluation. In contrast, allophonic /oƱ⌢/ deviations show reduced negativities and no LPC, indexing an unproblematic categorization and evaluation process. In the light of these results, an observed change of /oa⌢/ to /oƱ⌢/ in the Bavarian-Alemannic transition zone can be interpreted as a facilitation strategy of cross-dialectal comprehension to reduce both misunderstandings as well as neural costs in processing, which might be interpreted as the initial trigger for this particular phoneme change.

Are scalar implicatures automatically processed and different for each individual? A mismatch negativity (MMN) study

Scalar implicatures are ordinarily activated in human communication when the speaker uses a weak expression (e.g., some) from a set of stronger alternatives (e.g., many, all). It has been debated whether scalar inferences are generated by default. To clarify this issue and examine whether individual pragmatic ability will affect the mechanism of scalar inference processing, we performed experiment with an MMN paradigm to capture the neurophysiological indicators of automatic processing of spoken sentences and divided participants into high and low pragmatic ability groups. Experimental results showed that compared with the condition that an informative sentence ("Some animals have tails") is the deviant stimuli, when an underinformative sentence ("Some tigers have tails") is the deviant stimuli, the high pragmatic ability group induced mismatch negativity (MMN) and sustained negativity, while the low pragmatic ability group had no ERP effects. These results indicated that at least some people can automatically activate the scalar implicatures when encountering scalar trigger words, even in the inattentive status.

Influences of listeners' native and other dialects on cross-language vowel perception

This paper examines to what extent acoustic similarity between native and non-native vowels predicts non-native vowel perception and whether this process is influenced by listeners' native and other non-native dialects. Listeners with Northern and Southern British English dialects completed a perceptual assimilation task in which they categorized tokens of 15 Dutch vowels in terms of English vowel categories. While the cross-language acoustic similarity of Dutch vowels to English vowels largely predicted Southern listeners' perceptual assimilation patterns, this was not the case for Northern listeners, whose assimilation patterns resembled those of Southern listeners for all but three Dutch vowels. The cross-language acoustic similarity of Dutch vowels to Northern English vowels was re-examined by incorporating Southern English tokens, which resulted in considerable improvements in the predicting power of cross-language acoustic similarity. This suggests that Northern listeners' assimilation of Dutch vowels to English vowels was influenced by knowledge of both native Northern and non-native Southern English vowel categories. The implications of these findings for theories of non-native speech perception are discussed.

The five myths of MMN: redefining how to use MMN in basic and clinical research

The goal of this review article is to redefine what the mismatch negativity (MMN) component of event-related potentials reflects in auditory scene analysis, and to provide an overview of how the MMN serves as a valuable tool in Cognitive Neuroscience research. In doing so, some of the old beliefs (five common 'myths') about MMN will be dispelled, such as the notion that MMN is a simple feature discriminator and that attention itself modulates MMN elicitation. A revised description of what MMN truly reflects will be provided, which includes a principal focus onto the highly context-dependent nature of MMN elicitation and new terminology to discuss MMN and attention. This revised framework will help clarify what has been a long line of seemingly contradictory results from studies in which behavioral ability to hear differences between sounds and passive elicitation of MMN have been inconsistent. Understanding what MMN is will also benefit clinical research efforts by providing a new picture of how to design appropriate paradigms suited to various clinical populations.

Linguistic processing of accented speech across the lifespan

In most of the world, people have regular exposure to multiple accents. Therefore, learning to quickly process accented speech is a prerequisite to successful communication. In this paper, we examine work on the perception of accented speech across the lifespan, from early infancy to late adulthood. Unfamiliar accents initially impair linguistic processing by infants, children, younger adults, and older adults, but listeners of all ages come to adapt to accented speech. Emergent research also goes beyond these perceptual abilities, by assessing links with production and the relative contributions of linguistic knowledge and general cognitive skills. We conclude by underlining points of convergence across ages, and the gaps left to face in future work.

An ERP investigation of regional and foreign accent processing

This study used event-related potentials (ERPs) to examine whether we employ the same normalisation mechanisms when processing words spoken with a regional accent or foreign accent. Our results showed that the Phonological Mapping Negativity (PMN) following the onset of the final word of sentences spoken with an unfamiliar regional accent was greater than for those produced in the listener's own accent, whilst PMN for foreign accented speech was reduced. Foreign accents also resulted in a reduction in N400 amplitude when compared to both unfamiliar regional accents and the listener's own accent, with no significant difference found between the N400 of the regional and home accents. These results suggest that regional accent related variations are normalised at the earliest stages of spoken word recognition, requiring less top-down lexical intervention than foreign accents.