1
|
Coopmans CW, Struiksma ME, Coopmans PHA, Chen A. Processing of Grammatical Agreement in the Face of Variation in Lexical Stress: A Mismatch Negativity Study. LANGUAGE AND SPEECH 2023; 66:202-213. [PMID: 35652369 PMCID: PMC9976639 DOI: 10.1177/00238309221098116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Previous electroencephalography studies have yielded evidence for automatic processing of syntax and lexical stress. However, these studies looked at both effects in isolation, limiting their generalizability to everyday language comprehension. In the current study, we investigated automatic processing of grammatical agreement in the face of variation in lexical stress. Using an oddball paradigm, we measured the Mismatch Negativity (MMN) in Dutch-speaking participants while they listened to Dutch subject-verb sequences (linguistic context) or acoustically similar sequences in which the subject was replaced by filtered noise (nonlinguistic context). The verb forms differed in the inflectional suffix, rendering the subject-verb sequences grammatically correct or incorrect, and leading to a difference in the stress pattern of the verb forms. We found that the MMNs were modulated in both the linguistic and nonlinguistic condition, suggesting that the processing load induced by variation in lexical stress can hinder early automatic processing of grammatical agreement. However, as the morphological differences between the verb forms correlated with differences in number of syllables, an interpretation in terms of the prosodic structure of the sequences cannot be ruled out. Future research is needed to determine which of these factors (i.e., lexical stress, syllabic structure) most strongly modulate early syntactic processing.
Collapse
Affiliation(s)
- Cas W. Coopmans
- Max Planck Institute for Psycholinguistics, The Netherlands; Centre for Language Studies, Radboud University, The Netherlands
| | | | | | - Aoju Chen
- Aoju Chen, Utrecht Institute of Linguistics OTS, Utrecht University, Trans 10, 3512 JK Utrecht, The Netherlands.
| |
Collapse
|
2
|
Zora H, Csépe V. Perception of Prosodic Modulations of Linguistic and Paralinguistic Origin: Evidence From Early Auditory Event-Related Potentials. Front Neurosci 2022; 15:797487. [PMID: 35002610 PMCID: PMC8733303 DOI: 10.3389/fnins.2021.797487] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Accepted: 11/29/2021] [Indexed: 11/13/2022] Open
Abstract
How listeners handle prosodic cues of linguistic and paralinguistic origin is a central question for spoken communication. In the present EEG study, we addressed this question by examining neural responses to variations in pitch accent (linguistic) and affective (paralinguistic) prosody in Swedish words, using a passive auditory oddball paradigm. The results indicated that changes in pitch accent and affective prosody elicited mismatch negativity (MMN) responses at around 200 ms, confirming the brain’s pre-attentive response to any prosodic modulation. The MMN amplitude was, however, statistically larger to the deviation in affective prosody in comparison to the deviation in pitch accent and affective prosody combined, which is in line with previous research indicating not only a larger MMN response to affective prosody in comparison to neutral prosody but also a smaller MMN response to multidimensional deviants than unidimensional ones. The results, further, showed a significant P3a response to the affective prosody change in comparison to the pitch accent change at around 300 ms, in accordance with previous findings showing an enhanced positive response to emotional stimuli. The present findings provide evidence for distinct neural processing of different prosodic cues, and statistically confirm the intrinsic perceptual and motivational salience of paralinguistic information in spoken communication.
Collapse
Affiliation(s)
- Hatice Zora
- Max Planck Institute for Psycholinguistics, Nijmegen, Netherlands
| | - Valéria Csépe
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
| |
Collapse
|
3
|
Ragó A, Varga Z, Garami L, Honbolygó F, Csépe V. The effect of lexical status on prosodic processing in infants learning a fixed stress language. Psychophysiology 2021; 58:e13932. [PMID: 34432306 DOI: 10.1111/psyp.13932] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2020] [Revised: 07/26/2021] [Accepted: 07/27/2021] [Indexed: 11/30/2022]
Abstract
In speech processing, in the first year of life, prosody and phoneme-relevant aspects serve different functions. Recent studies have assumed that the two aspects become integrated at around 9 months of age. The present study investigates the effect of lexical status on stress processing in a fixed stress language. We hypothesize that lexicality modulates stress processing, and where the stress cue is in conflict with the lexical status (legal deviant condition), we will observe differences in age indicating the stage of integration. We tested 69 6 and 10 month-old infants in an acoustic oddball event-related potential paradigm. A frequent word stimulus (baba) and a pseudoword (bebe) were used with legal versus illegal stress. We systematically swapped the standard and deviant roles of the different stress variants in two conditions. In the illegal deviant condition in the case of the word stimulus, the response pattern typical for the pseudoword (an MMR to the absence of the stress cue) was missing. This implies the suppression effect of lexicality. In the legal deviant condition, negative MMR (N-MMR) in the second time window indicated a facilitation effect of lexicality in both age groups. As only the 6-month-olds produced an N-MMR in the first time window, we concluded that in a fixed stress language, integration starts at 6 months but is only completed by the age of 10 months. Our results show that lexical status modulates stress processing at word level in a highly regularly stressed language in which stable, long-term language-specific stress representation exists from early infancy.
Collapse
Affiliation(s)
- Anett Ragó
- Institute of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary
| | - Zsuzsanna Varga
- Division of Neonatology, Semmelweis University 1st Department of Pediatrics, Budapest, Hungary.,Doctoral School of Psychology, Budapest University of Technology and Economics, Budapest, Hungary
| | - Linda Garami
- Research Centre for Natural Sciences, Brain Imaging Centre, Budapest, Hungary.,Doctoral School of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary
| | - Ferenc Honbolygó
- Institute of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary.,Research Centre for Natural Sciences, Brain Imaging Centre, Budapest, Hungary
| | - Valéria Csépe
- Research Centre for Natural Sciences, Brain Imaging Centre, Budapest, Hungary.,Institute of Hungarian and Applied Linguistics, University of Pannonia, Veszprém, Hungary
| |
Collapse
|
4
|
German B, Honbolygó F, Csépe V, Kóbor A. Working memory contributes to word stress processing in a fixed-stress language. JOURNAL OF COGNITIVE PSYCHOLOGY 2021. [DOI: 10.1080/20445911.2021.1898411] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- Borbála German
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
- Department of Cognitive Science, Budapest University of Technology and Economics, Budapest, Hungary
| | - Ferenc Honbolygó
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
- Institute of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary
| | - Valéria Csépe
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
- Faculty of Modern Philology and Social Sciences, University of Pannonia, Veszprém, Hungary
| | - Andrea Kóbor
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
| |
Collapse
|
5
|
Zora H, Riad T, Ylinen S, Csépe V. Phonological Variations Are Compensated at the Lexical Level: Evidence From Auditory Neural Activity. Front Hum Neurosci 2021; 15:622904. [PMID: 33986650 PMCID: PMC8110822 DOI: 10.3389/fnhum.2021.622904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Accepted: 03/26/2021] [Indexed: 11/13/2022] Open
Abstract
Dealing with phonological variations is important for speech processing. This article addresses whether phonological variations introduced by assimilatory processes are compensated for at the pre-lexical or lexical level, and whether the nature of variation and the phonological context influence this process. To this end, Swedish nasal regressive place assimilation was investigated using the mismatch negativity (MMN) component. In nasal regressive assimilation, the coronal nasal assimilates to the place of articulation of a following segment, most clearly with a velar or labial place of articulation, as in utan mej “without me” > [ʉːtam mɛjː]. In a passive auditory oddball paradigm, 15 Swedish speakers were presented with Swedish phrases with attested and unattested phonological variations and contexts for nasal assimilation. Attested variations – a coronal-to-labial change as in utan “without” > [ʉːtam] – were contrasted with unattested variations – a labial-to-coronal change as in utom “except” > ∗[ʉːtɔn] – in appropriate and inappropriate contexts created by mej “me” [mɛjː] and dej “you” [dɛjː]. Given that the MMN amplitude depends on the degree of variation between two stimuli, the MMN responses were expected to indicate to what extent the distance between variants was tolerated by the perceptual system. Since the MMN response reflects not only low-level acoustic processing but also higher-level linguistic processes, the results were predicted to indicate whether listeners process assimilation at the pre-lexical and lexical levels. The results indicated no significant interactions across variations, suggesting that variations in phonological forms do not incur any cost in lexical retrieval; hence such variation is compensated for at the lexical level. However, since the MMN response reached significance only for a labial-to-coronal change in a labial context and for a coronal-to-labial change in a coronal context, the compensation might have been influenced by the nature of variation and the phonological context. It is therefore concluded that while assimilation is compensated for at the lexical level, there is also some influence from pre-lexical processing. The present results reveal not only signal-based perception of phonological units, but also higher-level lexical processing, and are thus able to reconcile the bottom-up and top-down models of speech processing.
Collapse
Affiliation(s)
- Hatice Zora
- Department of Linguistics, Stockholm University, Stockholm, Sweden
| | - Tomas Riad
- Department of Swedish Language and Multilingualism, Stockholm University, Stockholm, Sweden
| | - Sari Ylinen
- CICERO Learning, Faculty of Educational Sciences, University of Helsinki, Helsinki, Finland.,Cognitive Brain Research Unit, Faculty of Medicine, University of Helsinki, Helsinki, Finland
| | - Valéria Csépe
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
| |
Collapse
|
6
|
Honbolygó F, Kóbor A, German B, Csépe V. Word stress representations are language‐specific: Evidence from event‐related brain potentials. Psychophysiology 2020; 57:e13541. [DOI: 10.1111/psyp.13541] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2019] [Revised: 01/07/2020] [Accepted: 01/15/2020] [Indexed: 12/01/2022]
Affiliation(s)
- Ferenc Honbolygó
- Brain Imaging Centre Research Centre for Natural Sciences Budapest Hungary
- Institute of Psychology ELTE Eötvös Loránd University Budapest Hungary
| | - Andrea Kóbor
- Brain Imaging Centre Research Centre for Natural Sciences Budapest Hungary
| | - Borbála German
- Brain Imaging Centre Research Centre for Natural Sciences Budapest Hungary
- Department of Cognitive Science Budapest University of Technology and Economics Budapest Hungary
| | - Valéria Csépe
- Brain Imaging Centre Research Centre for Natural Sciences Budapest Hungary
- Faculty of Modern Philology and Social Sciences University of Pannonia Budapest Hungary
| |
Collapse
|
7
|
Honbolygó F, Kóbor A, Hermann P, Kettinger ÁO, Vidnyánszky Z, Kovács G, Csépe V. Expectations about word stress modulate neural activity in speech-sensitive cortical areas. Neuropsychologia 2020; 143:107467. [PMID: 32305299 DOI: 10.1016/j.neuropsychologia.2020.107467] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Revised: 03/06/2020] [Accepted: 04/12/2020] [Indexed: 10/24/2022]
Abstract
A recent dual-stream model of language processing proposed that the postero-dorsal stream performs predictive sequential processing of linguistic information via hierarchically organized internal models. However, it remains unexplored whether the prosodic segmentation of linguistic information involves predictive processes. Here, we addressed this question by investigating the processing of word stress, a major component of speech segmentation, using probabilistic repetition suppression (RS) modulation as a marker of predictive processing. In an event-related acoustic fMRI RS paradigm, we presented pairs of pseudowords having the same (Rep) or different (Alt) stress patterns, in blocks with varying Rep and Alt trial probabilities. We found that the BOLD signal was significantly lower for Rep than for Alt trials, indicating RS in the posterior and middle superior temporal gyrus (STG) bilaterally, and in the anterior STG in the left hemisphere. Importantly, the magnitude of RS was modulated by repetition probability in the posterior and middle STG. These results reveal the predictive processing of word stress in the STG areas and raise the possibility that words stress processing is related to the dorsal "where" auditory stream.
Collapse
Affiliation(s)
- Ferenc Honbolygó
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary; Institute of Psychology, Eötvös Loránd University, Budapest, Hungary.
| | - Andrea Kóbor
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
| | - Petra Hermann
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
| | - Ádám Ottó Kettinger
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary; Department of Nuclear Techniques, Budapest University of Technology and Economics, Budapest, Hungary
| | - Zoltán Vidnyánszky
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary
| | - Gyula Kovács
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary; Department of Biological Psychology and Cognitive Neuroscience, Institute of Psychology, Friedrich Schiller University Jena, Jena, Germany
| | - Valéria Csépe
- Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary; Faculty of Modern Philology and Social Sciences, University of Pannonia, Veszprém, Hungary
| |
Collapse
|
8
|
Varga Z, Garami L, Ragó A, Honbolygó F, Csépe V. Does intra-uterine language experience modulate word stress processing? An ERP study. RESEARCH IN DEVELOPMENTAL DISABILITIES 2019; 90:59-71. [PMID: 31078864 DOI: 10.1016/j.ridd.2019.04.011] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/22/2018] [Revised: 04/08/2019] [Accepted: 04/15/2019] [Indexed: 06/09/2023]
Abstract
BACKGROUND Preterm birth is associated with various risks, including delayed or atypical language development. The prenatal start of prosodic tuning may affect the processing of word stress, an important suprasegmental feature of spoken utterances. AIM Our study focused on the expected contribution of intra-uterine experience to word stress processing. We aimed to demonstrate the hypothesized effect of intra-uterine sound exposition on stress sensitivity. METHOD We recorded ERP responses of 34 preterm infants elicited by bisyllabic pseudo-words in two oddball conditions by switching the stress pattern (legal vs. illegal) and role (standard vs. deviant). RESULTS The mismatch responses found were synchronized to each syllable of the illegally stressed stimuli with no difference between pre- and full-term infants. However, the clear role of the preterm status was demonstrated by the exaggerated processing of the native stress information. The impact of intra-uterine exposure to prosody was confirmed by our finding that moderate-late preterm infants outperformed the very preterm ones. CONCLUSION Intra-uterine exposition to prosodic features appears to contribute to the emergence of stable long-term stress representation. When this tuning is missing it is considered a risk for the language acquisition process.
Collapse
Affiliation(s)
- Zsuzsanna Varga
- Neonatal Intensive Care Unit, Semmelweis University 1st Department of Paediatrics, Bókay János utca 53-54., H- 1083, Budapest, Hungary; Doctoral School of Psychology, Budapest University of Technology and Economics, Egry József utca 1., H-1111, Budapest, Hungary.
| | - Linda Garami
- Doctoral School of Psychology, Eötvös Lorand University, Izabella utca 46., H-1064, Budapest, Hungary; Brain Imaging Centre, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Magyar Tudósok körútja 2., H-1117, Budapest, Hungary.
| | - Anett Ragó
- Department of Cognitive Psychology, Eötvös Loránd University, Izabella utca 46., H-1064, Budapest, Hungary.
| | - Ferenc Honbolygó
- Brain Imaging Centre, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Magyar Tudósok körútja 2., H-1117, Budapest, Hungary; Department of Cognitive Psychology, Eötvös Loránd University, Izabella utca 46., H-1064, Budapest, Hungary.
| | - Valéria Csépe
- Brain Imaging Centre, Research Centre for Natural Sciences, Hungarian Academy of Sciences, Magyar Tudósok körútja 2., H-1117, Budapest, Hungary; Department of Cognitive Sciences, Budapest University of Technology and Economics, Egry József utca 1., H-1111, Budapest, Hungary; University of Pannonia, Institute of Hungarian and Applied Linguistics, Vár utca 39., H-8200, Veszprém, Hungary.
| |
Collapse
|