1
|
Lialiou M, Grice M, Röhr CT, Schumacher PB. Auditory Processing of Intonational Rises and Falls in German: Rises Are Special in Attention Orienting. J Cogn Neurosci 2024; 36:1099-1122. [PMID: 38358004 DOI: 10.1162/jocn_a_02129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/16/2024]
Abstract
This article investigates the processing of intonational rises and falls when presented unexpectedly in a stream of repetitive auditory stimuli. It examines the neurophysiological correlates (ERPs) of attention to these unexpected stimuli through the use of an oddball paradigm where sequences of repetitive stimuli are occasionally interspersed with a deviant stimulus, allowing for elicitation of an MMN. Whereas previous oddball studies on attention toward unexpected sounds involving pitch rises were conducted on nonlinguistic stimuli, the present study uses as stimuli lexical items in German with naturalistic intonation contours. Results indicate that rising intonation plays a special role in attention orienting at a pre-attentive processing stage, whereas contextual meaning (here a list of items) is essential for activating attentional resources at a conscious processing stage. This is reflected in the activation of distinct brain responses: Rising intonation evokes the largest MMN, whereas falling intonation elicits a less pronounced MMN followed by a P3 (reflecting a conscious processing stage). Subsequently, we also find a complex interplay between the phonological status (i.e., accent/head marking vs. boundary/edge marking) and the direction of pitch change in their contribution to attention orienting: Attention is not oriented necessarily toward a specific position in prosodic structure (head or edge). Rather, we find that the intonation contour itself and the appropriateness of the contour in the linguistic context are the primary cues to two core mechanisms of attention orienting, pre-attentive and conscious orientation respectively, whereas the phonological status of the pitch event plays only a supplementary role.
Collapse
|
2
|
Cappotto D, Luo D, Lai HW, Peng F, Melloni L, Schnupp JWH, Auksztulewicz R. "What" and "when" predictions modulate auditory processing in a mutually congruent manner. Front Neurosci 2023; 17:1180066. [PMID: 37781257 PMCID: PMC10540699 DOI: 10.3389/fnins.2023.1180066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Accepted: 08/04/2023] [Indexed: 10/03/2023] Open
Abstract
Introduction Extracting regularities from ongoing stimulus streams to form predictions is crucial for adaptive behavior. Such regularities exist in terms of the content of the stimuli and their timing, both of which are known to interactively modulate sensory processing. In real-world stimulus streams such as music, regularities can occur at multiple levels, both in terms of contents (e.g., predictions relating to individual notes vs. their more complex groups) and timing (e.g., pertaining to timing between intervals vs. the overall beat of a musical phrase). However, it is unknown whether the brain integrates predictions in a manner that is mutually congruent (e.g., if "beat" timing predictions selectively interact with "what" predictions falling on pulses which define the beat), and whether integrating predictions in different timing conditions relies on dissociable neural correlates. Methods To address these questions, our study manipulated "what" and "when" predictions at different levels - (local) interval-defining and (global) beat-defining - within the same stimulus stream, while neural activity was recorded using electroencephalogram (EEG) in participants (N = 20) performing a repetition detection task. Results Our results reveal that temporal predictions based on beat or interval timing modulated mismatch responses to violations of "what" predictions happening at the predicted time points, and that these modulations were shared between types of temporal predictions in terms of the spatiotemporal distribution of EEG signals. Effective connectivity analysis using dynamic causal modeling showed that the integration of "what" and "when" predictions selectively increased connectivity at relatively late cortical processing stages, between the superior temporal gyrus and the fronto-parietal network. Discussion Taken together, these results suggest that the brain integrates different predictions with a high degree of mutual congruence, but in a shared and distributed cortical network. This finding contrasts with recent studies indicating separable mechanisms for beat-based and memory-based predictive processing.
Collapse
Affiliation(s)
- Drew Cappotto
- Department of Neuroscience, City University of Hong Kong, Kowloon, Hong Kong SAR, China
- Ear Institute, University College London, London, United Kingdom
| | - Dan Luo
- Department of Neuroscience, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Hiu Wai Lai
- Department of Neuroscience, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Fei Peng
- Department of Neuroscience, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Lucia Melloni
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Department of Neurology, NYU Grossman School of Medicine, New York, NY, United States
| | | | - Ryszard Auksztulewicz
- Department of Neuroscience, City University of Hong Kong, Kowloon, Hong Kong SAR, China
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
| |
Collapse
|
3
|
Ivanova M, Neubert CR, Schmied J, Bendixen A. ERP evidence for Slavic and German word stress cue sensitivity in English. Front Psychol 2023; 14:1193822. [PMID: 37425183 PMCID: PMC10328821 DOI: 10.3389/fpsyg.2023.1193822] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2023] [Accepted: 05/31/2023] [Indexed: 07/11/2023] Open
Abstract
Word stress is demanding for non-native learners of English, partly because speakers from different backgrounds weight perceptual cues to stress like pitch, intensity, and duration differently. Slavic learners of English and particularly those with a fixed stress language background like Czech and Polish have been shown to be less sensitive to stress in their native and non-native languages. In contrast, German English learners are rarely discussed in a word stress context. A comparison of these varieties can reveal differences in the foreign language processing of speakers from two language families. We use electroencephalography (EEG) to explore group differences in word stress cue perception between Slavic and German learners of English. Slavic and German advanced English speakers were examined in passive multi-feature oddball experiments, where they were exposed to the word impact as an unstressed standard and as deviants stressed on the first or second syllable through higher pitch, intensity, or duration. The results revealed a robust Mismatch Negativity (MMN) component of the event-related potential (ERP) in both language groups in response to all conditions, demonstrating sensitivity to stress changes in a non-native language. While both groups showed higher MMN responses to stress changes to the second than the first syllable, this effect was more pronounced for German than for Slavic participants. Such group differences in non-native English word stress perception from the current and previous studies are argued to speak in favor of customizable language technologies and diversified English curricula compensating for non-native perceptual variation.
Collapse
Affiliation(s)
- Marina Ivanova
- Faculty of Humanities, English and Digital Linguistics, Institute of English and American Studies, Chemnitz University of Technology, Chemnitz, Germany
| | - Christiane R. Neubert
- Faculty of Natural Sciences, Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| | - Josef Schmied
- Faculty of Humanities, English and Digital Linguistics, Institute of English and American Studies, Chemnitz University of Technology, Chemnitz, Germany
| | - Alexandra Bendixen
- Faculty of Natural Sciences, Cognitive Systems Lab, Institute of Physics, Chemnitz University of Technology, Chemnitz, Germany
| |
Collapse
|
4
|
Coopmans CW, Struiksma ME, Coopmans PHA, Chen A. Processing of Grammatical Agreement in the Face of Variation in Lexical Stress: A Mismatch Negativity Study. LANGUAGE AND SPEECH 2023; 66:202-213. [PMID: 35652369 PMCID: PMC9976639 DOI: 10.1177/00238309221098116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Previous electroencephalography studies have yielded evidence for automatic processing of syntax and lexical stress. However, these studies looked at both effects in isolation, limiting their generalizability to everyday language comprehension. In the current study, we investigated automatic processing of grammatical agreement in the face of variation in lexical stress. Using an oddball paradigm, we measured the Mismatch Negativity (MMN) in Dutch-speaking participants while they listened to Dutch subject-verb sequences (linguistic context) or acoustically similar sequences in which the subject was replaced by filtered noise (nonlinguistic context). The verb forms differed in the inflectional suffix, rendering the subject-verb sequences grammatically correct or incorrect, and leading to a difference in the stress pattern of the verb forms. We found that the MMNs were modulated in both the linguistic and nonlinguistic condition, suggesting that the processing load induced by variation in lexical stress can hinder early automatic processing of grammatical agreement. However, as the morphological differences between the verb forms correlated with differences in number of syllables, an interpretation in terms of the prosodic structure of the sequences cannot be ruled out. Future research is needed to determine which of these factors (i.e., lexical stress, syllabic structure) most strongly modulate early syntactic processing.
Collapse
Affiliation(s)
- Cas W. Coopmans
- Max Planck Institute for Psycholinguistics, The Netherlands; Centre for Language Studies, Radboud University, The Netherlands
| | | | | | - Aoju Chen
- Aoju Chen, Utrecht Institute of Linguistics OTS, Utrecht University, Trans 10, 3512 JK Utrecht, The Netherlands.
| |
Collapse
|
5
|
Abstract
A cross-species perspective can extend and provide testable predictions for Savage et al.'s framework. Rhythm and melody, I argue, could bootstrap each other in the evolution of musicality. Isochrony may function as a temporal grid to support rehearsing and learning modulated, pitched vocalizations. Once this melodic plasticity is acquired, focus can shift back to refining rhythm processing and beat induction.
Collapse
|
6
|
Riedinger M, Nagels A, Werth A, Scharinger M. Asymmetries in Accessing Vowel Representations Are Driven by Phonological and Acoustic Properties: Neural and Behavioral Evidence From Natural German Minimal Pairs. Front Hum Neurosci 2021; 15:612345. [PMID: 33679344 PMCID: PMC7930067 DOI: 10.3389/fnhum.2021.612345] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Accepted: 01/26/2021] [Indexed: 11/21/2022] Open
Abstract
In vowel discrimination, commonly found discrimination patterns are directional asymmetries where discrimination is faster (or easier) if differing vowels are presented in a certain sequence compared to the reversed sequence. Different models of speech sound processing try to account for these asymmetries based on either phonetic or phonological properties. In this study, we tested and compared two of those often-discussed models, namely the Featurally Underspecified Lexicon (FUL) model (Lahiri and Reetz, 2002) and the Natural Referent Vowel (NRV) framework (Polka and Bohn, 2011). While most studies presented isolated vowels, we investigated a large stimulus set of German vowels in a more naturalistic setting within minimal pairs. We conducted an mismatch negativity (MMN) study in a passive and a reaction time study in an active oddball paradigm. In both data sets, we found directional asymmetries that can be explained by either phonological or phonetic theories. While behaviorally, the vowel discrimination was based on phonological properties, both tested models failed to explain the found neural patterns comprehensively. Therefore, we additionally examined the influence of a variety of articulatory, acoustical, and lexical factors (e.g., formant structure, intensity, duration, and frequency of occurrence) but also the influence of factors beyond the well-known (perceived loudness of vowels, degree of openness) in depth via multiple regression analyses. The analyses revealed that the perceptual factor of perceived loudness has a greater impact than considered in the literature and should be taken stronger into consideration when analyzing preattentive natural vowel processing.
Collapse
Affiliation(s)
- Miriam Riedinger
- Department of English and Linguistics, Johannes Gutenberg University, Mainz, Germany
| | - Arne Nagels
- Department of English and Linguistics, Johannes Gutenberg University, Mainz, Germany
| | - Alexander Werth
- Institute for German Linguistics, Philipps University, Marburg, Germany
| | - Mathias Scharinger
- Institute for German Linguistics, Philipps University, Marburg, Germany
- Department of Language and Literature, Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany
| |
Collapse
|
7
|
Wang S, Lin M, Sun L, Chen X, Fu X, Yan L, Li C, Zhang X. Neural Mechanisms of Hearing Recovery for Cochlear-Implanted Patients: An Electroencephalogram Follow-Up Study. Front Neurosci 2021; 14:624484. [PMID: 33633529 PMCID: PMC7901906 DOI: 10.3389/fnins.2020.624484] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2020] [Accepted: 12/22/2020] [Indexed: 12/11/2022] Open
Abstract
Background Patients with severe profound hearing loss could benefit from cochlear implantation (CI). However, the neural mechanism of such benefit is still unclear. Therefore, we analyzed the electroencephalogram (EEG) and behavioral indicators of auditory function remodeling in patients with CI. Both indicators were sampled at multiple time points after implantation (1, 90, and 180 days). Methods First, the speech perception ability was evaluated with the recording of a list of Chinese words and sentences in 15 healthy controls (HC group) and 10 patients with CI (CI group). EEG data were collected using an oddball paradigm. Then, the characteristics of event-related potentials (ERPs) and mismatch negative (MMN) were compared between the CI group and the HC group. In addition, we analyzed the phase lag indices (PLI) in the CI group and the HC group and calculated the difference in functional connectivity between the two groups at different stages after implantation. Results The behavioral indicator, speech recognition ability, in CI patients improved as the implantation time increased. The MMN analysis showed that CI patients could recognize the difference between standard and deviation stimuli just like the HCs 90 days after cochlear implantation. Comparing the latencies of N1/P2/MMN between the CI group and the HC group, we found that the latency of N1/P2 in CI patients was longer, while the latency of MMN in CI users was shorter. In addition, PLI-based whole-brain functional connectivity (PLI-FC) showed that the difference between the CI group and the HC group mainly exists in electrode pairs between the bilateral auditory area and the frontal area. Furthermore, all those differences gradually decreased with the increase in implantation time. Conclusion The N1 amplitude, N1/P2/MMN latency, and PLI-FC in the alpha band may reflect the process of auditory function remodeling and could be an objective index for the assessment of speech perception ability and the effect of cochlear implantation.
Collapse
Affiliation(s)
- Songjian Wang
- School of Biomedical Engineering, Capital Medical University, Beijing, China.,Beijing Key Laboratory of Fundamental Research on Biomechanics in Clinical Application, Capital Medical University, Beijing, China
| | - Meng Lin
- School of Biomedical Engineering, Capital Medical University, Beijing, China.,Beijing Key Laboratory of Fundamental Research on Biomechanics in Clinical Application, Capital Medical University, Beijing, China
| | - Liwei Sun
- School of Biomedical Engineering, Capital Medical University, Beijing, China.,Beijing Key Laboratory of Fundamental Research on Biomechanics in Clinical Application, Capital Medical University, Beijing, China
| | - Xueqing Chen
- Key Laboratory of Otolaryngology Head and Neck Surgery, Beijing Tongren Hospital, Beijing Institute of Otolaryngology, Ministry of Education, Beijing, China
| | - Xinxing Fu
- Key Laboratory of Otolaryngology Head and Neck Surgery, Beijing Tongren Hospital, Beijing Institute of Otolaryngology, Ministry of Education, Beijing, China
| | - LiLi Yan
- Key Laboratory of Otolaryngology Head and Neck Surgery, Beijing Tongren Hospital, Beijing Institute of Otolaryngology, Ministry of Education, Beijing, China
| | - Chunlin Li
- School of Biomedical Engineering, Capital Medical University, Beijing, China.,Beijing Key Laboratory of Fundamental Research on Biomechanics in Clinical Application, Capital Medical University, Beijing, China
| | - Xu Zhang
- School of Biomedical Engineering, Capital Medical University, Beijing, China.,Beijing Key Laboratory of Fundamental Research on Biomechanics in Clinical Application, Capital Medical University, Beijing, China
| |
Collapse
|