1
|
Lialiou M, Grice M, Röhr CT, Schumacher PB. Auditory Processing of Intonational Rises and Falls in German: Rises Are Special in Attention Orienting. J Cogn Neurosci 2024; 36:1099-1122. [PMID: 38358004 DOI: 10.1162/jocn_a_02129] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/16/2024]
Abstract
This article investigates the processing of intonational rises and falls when presented unexpectedly in a stream of repetitive auditory stimuli. It examines the neurophysiological correlates (ERPs) of attention to these unexpected stimuli through the use of an oddball paradigm where sequences of repetitive stimuli are occasionally interspersed with a deviant stimulus, allowing for elicitation of an MMN. Whereas previous oddball studies on attention toward unexpected sounds involving pitch rises were conducted on nonlinguistic stimuli, the present study uses as stimuli lexical items in German with naturalistic intonation contours. Results indicate that rising intonation plays a special role in attention orienting at a pre-attentive processing stage, whereas contextual meaning (here a list of items) is essential for activating attentional resources at a conscious processing stage. This is reflected in the activation of distinct brain responses: Rising intonation evokes the largest MMN, whereas falling intonation elicits a less pronounced MMN followed by a P3 (reflecting a conscious processing stage). Subsequently, we also find a complex interplay between the phonological status (i.e., accent/head marking vs. boundary/edge marking) and the direction of pitch change in their contribution to attention orienting: Attention is not oriented necessarily toward a specific position in prosodic structure (head or edge). Rather, we find that the intonation contour itself and the appropriateness of the contour in the linguistic context are the primary cues to two core mechanisms of attention orienting, pre-attentive and conscious orientation respectively, whereas the phonological status of the pitch event plays only a supplementary role.
Collapse
|
2
|
Han M, Chien YF, Zhang Z, Wei Z, Li W. Music training affects listeners' processing of different types of accentuation information: Evidence from ERPs. Brain Cogn 2024; 174:106120. [PMID: 38142535 DOI: 10.1016/j.bandc.2023.106120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 12/07/2023] [Accepted: 12/14/2023] [Indexed: 12/26/2023]
Abstract
Previous studies found that prolonged musical training can promote language processing, but few studies have examined whether and how musical training affects the processing of accentuation in spoken language. In this study, a vocabulary detection task was conducted, with Chinese single sentences as materials, to investigate how musicians and non-musicians process corrective accent and information accent in the sentence-middle and sentence-final positions. In the sentence-middle position, results of the cluster-based permutation t-tests showed significant differences in the 574-714 ms time window for the control group. In the sentence-final position, the cluster-based permutation t-tests revealed significant differences in the 612-810 ms time window for the music group and in the 616-812 ms time window for the control group. These significant positive effects were induced by the processing of information accent relative to that of corrective accent. These results suggest that both groups were able to distinguish corrective accent from information accent, but they processed the two accent types differently in the sentence-middle position. These findings show that musical training has a cross-domain effect on spoken language processing and that the accent position also affects its processing.
Collapse
Affiliation(s)
- Mei Han
- School of Public Health, Bengbu Medical University, China; Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, China
| | - Yu-Fu Chien
- Department of Chinese Language and Literature, Fudan University, China
| | - Zhenghua Zhang
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, China; Department of Psychology, Renmin University of China, Beijing, China
| | - Zhen Wei
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, China
| | - Weijun Li
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, China.
| |
Collapse
|
3
|
Sun Y, Sommer W, Li W. How accentuation influences the processing of emotional words in spoken language: An ERP study. Neuropsychologia 2022; 166:108144. [PMID: 35007616 DOI: 10.1016/j.neuropsychologia.2022.108144] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2021] [Revised: 12/12/2021] [Accepted: 01/06/2022] [Indexed: 11/17/2022]
Abstract
Pitch accent marks information structure in utterances in many languages but little is known about the effects of accent on the perception of emotional word meaning. The present study explored the processing of accentuation and its influence on the semantic integration of emotional words during spoken sentence comprehension. Twenty-five participants were presented with sets of spoken Chinese sentences while accentuation and emotional meaning of the adjectives were orthogonally manipulated. An implicit task required the recognition of words contained in the sentences, whereas an explicit task required judging the presence of an accented or emotional word. In the ERPs to the adjectives, accentuation induced a long-lasting anterior negativity starting around 150-250 ms and a late posterior positivity. More importantly, emotionally negative words elicited larger negativities between 300 and 700 ms as compared to neutral words but only when they were accented. Interestingly, these negativities showed a parietal N400-typical distribution when accent was implicit but strongly overlapped with the accent-induced anterior negativity when accent was task-relevant. Hence, accentuation may enable the processing of emotional meaning by directing attention towards the accented words. When accent and emotion are explicit parts of the task, similar frontal attentional networks are activated by emotion as by accent alone. In contrast, when accent and emotion are implicit to the task, emotion appears to merely activate parietal networks, typical for semantic integration effects. Together, these results suggest that accentuation plays an important role in spoken sentence comprehension, deserving further study.
Collapse
Affiliation(s)
- Yifan Sun
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, China
| | - Werner Sommer
- Institut für Psychologie, Humboldt-Universität zu Berlin, Berlin, Germany; Department of Psychology, Zhejiang Normal University, Jin Hua, China
| | - Weijun Li
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, China; Key Laboratory of Brain and Cognitive Neuroscience, Liaoning Province, China.
| |
Collapse
|
4
|
Abstract
Accentuation influences selective attention and the depth of semantic processing during online speech comprehension. We investigated the processing of semantically congruent and incongruent words in a language that presents cues to prosodic prominences in the region of the utterance occurring after the focussed information (the post-focal region). This language is Italian, in particular the variety spoken in Bari. In this variety, questions have a compressed, post-focal accent, whereas in statements there is a low-level pitch in this position. Using event-related potentials, we investigated the processing of congruent and incongruent target words with two prosodic realizations (focussed with accentuation, post-focal realization) and in two-sentence modalities (statement, question). Results indicate an N400 congruence effect that was modulated by position (focal, post-focal) and modality (statement, question): processing was deeper for questions in narrow focus than in post-focal position, while statements showed similar pronounced N400 effects across positions. The attenuated N400 difference for post-focal targets in questions was accompanied by a more enhanced late positivity when they were incongruent, indicating that attentional resources are allocated during updating of speech act information.
Collapse
|
5
|
La Rocca D, Masia V, Maiorana E, Lombardi Vallauri E, Campisi P. Brain response to Information Structure misalignments in linguistic contexts. Neurocomputing 2016. [DOI: 10.1016/j.neucom.2016.03.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
6
|
Dimitrova DV, Stowe LA, Hoeks JCJ. When correction turns positive: processing corrective prosody in Dutch. PLoS One 2015; 10:e0126299. [PMID: 25973607 PMCID: PMC4431819 DOI: 10.1371/journal.pone.0126299] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2014] [Accepted: 03/31/2015] [Indexed: 11/19/2022] Open
Abstract
Current research on spoken language does not provide a consistent picture as to whether prosody, the melody and rhythm of speech, conveys a specific meaning. Perception studies show that English listeners assign meaning to prosodic patterns, and, for instance, associate some accents with contrast, whereas Dutch listeners behave more controversially. In two ERP studies we tested how Dutch listeners process words carrying two types of accents, which either provided new information (new information accents) or corrected information (corrective accents), both in single sentences (experiment 1) and after corrective and new information questions (experiment 2). In both experiments corrective accents elicited a sustained positivity as compared to new information accents, which started earlier in context than in single sentences. The positivity was not modulated by the nature of the preceding question, suggesting that the underlying neural mechanism likely reflects the construction of an interpretation to the accented word, either by identifying an alternative in context or by inferring it when no context is present. Our experimental results provide strong evidence for inferential processes related to prosodic contours in Dutch.
Collapse
Affiliation(s)
- Diana V. Dimitrova
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, Nijmegen, The Netherlands
- Centre for Language Studies, Radboud University Nijmegen, Nijmegen, The Netherlands
| | - Laurie A. Stowe
- Center for Language and Cognition Groningen, University of Groningen, Groningen, The Netherlands
- Neuroimaging Center, University Medical Center Groningen, Groningen, The Netherlands
| | - John C. J. Hoeks
- Center for Language and Cognition Groningen, University of Groningen, Groningen, The Netherlands
- Neuroimaging Center, University Medical Center Groningen, Groningen, The Netherlands
| |
Collapse
|
7
|
Hung YC, Schumacher PB. Animacy matters: ERP evidence for the multi-dimensionality of topic-worthiness in Chinese. Brain Res 2014; 1555:36-47. [DOI: 10.1016/j.brainres.2014.01.046] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2013] [Revised: 12/06/2013] [Accepted: 01/28/2014] [Indexed: 10/25/2022]
|
8
|
Wang L, Schumacher PB. New is not always costly: evidence from online processing of topic and contrast in Japanese. Front Psychol 2013; 4:363. [PMID: 23825466 PMCID: PMC3695390 DOI: 10.3389/fpsyg.2013.00363] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2013] [Accepted: 06/03/2013] [Indexed: 11/28/2022] Open
Abstract
Two visual ERP experiments were conducted to investigate topic and contrast assigned by various cues such as discourse context, sentential position, and marker during referential processing in Japanese. Experiment 1 showed that there was no N400-difference for new vs. given noun phrases (NPs) when the new NP was expected (contrastively focused) based on its preceding context and sentential position. Experiment 2 further revealed that the N400 for new NPs can be modulated by the NP's contrastive meaning (exhaustivity) induced from the marker. Both experiments also showed that new NPs engendered an increased Late Positivity. The reduced N400 for new vs. given supports an expectation-based linking mechanism. In addition, costs that were consistently observed for new vs. given entities emerged in a subsequent process, in which the new NP's occurrence requires updating and correcting of the discourse representation built so far, which is indexed by an enhanced Late Positivity. We argue that the overall data pattern should be best explained within a multi-stream model of discourse processing.
Collapse
Affiliation(s)
- Luming Wang
- Department of English and Linguistics, Independent Emmy Noether Research Group, Johannes Gutenberg University of Mainz Mainz, Germany ; Department of Germanic Linguistics, Philipps University of Marburg Marburg, Germany
| | | |
Collapse
|