1
|
Wolpert M, Zhang H, Baum S, Steinhauer K. Native and non-native parsing of adjective placement - An ERP study of Mandarin and English sentence processing. BRAIN AND LANGUAGE 2024; 254:105427. [PMID: 38852263 DOI: 10.1016/j.bandl.2024.105427] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 05/28/2024] [Accepted: 05/29/2024] [Indexed: 06/11/2024]
Abstract
Adjectives in English and Mandarin are typically prenominal, but the corresponding grammatical rules vary in subtle ways. Our event-related potential (ERP) study shows that native speakers of both languages rely on similar processing mechanisms when reading sentences with anomalous noun-adjective order (e.g., the vase *white) in their first language, reflected by a biphasic N400-P600 profile. Only Mandarin native speakers showed an additional N400 on grammatical adjectives (e.g., the white vase), potentially due to atypical word-by-word presentation of lexicalized compounds. English native speakers with advanced Mandarin proficiency were tested in both languages. They processed ungrammatical noun-adjective pairs in English like English monolinguals (N400-P600), but only exhibited an N400 in Mandarin. The absent P600 effect corresponded to their (surprisingly) low proficiency with noun-adjective violations in Mandarin, questioning simple rule transfer from English grammar.
Collapse
Affiliation(s)
- Max Wolpert
- Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou 310027, China; Integrated Program in Neuroscience, McGill University, Room 302 Irving Ludmer Building, 1033 Pine Avenue West, Montreal, Quebec H3A 1A1, Canada; Centre for Research on Brain, Language and Music, 2001 Av. McGill College #6, Montreal, Quebec H3A 1G1, Canada.
| | - Hui Zhang
- School of Foreign Languages and Cultures, Nanjing Normal University, Suiyuan Campus, Building 500, Nanjing, Jiangsu 210024, China.
| | - Shari Baum
- Centre for Research on Brain, Language and Music, 2001 Av. McGill College #6, Montreal, Quebec H3A 1G1, Canada; School of Communication Sciences and Disorders, McGill University, 2001 Av. McGill College #8, Montréal, Quebec H3A 1G1, Canada.
| | - Karsten Steinhauer
- Centre for Research on Brain, Language and Music, 2001 Av. McGill College #6, Montreal, Quebec H3A 1G1, Canada; School of Communication Sciences and Disorders, McGill University, 2001 Av. McGill College #8, Montréal, Quebec H3A 1G1, Canada.
| |
Collapse
|
2
|
Contier F, Wartenburger I, Weymar M, Rabovsky M. Are the P600 and P3 ERP components linked to the task-evoked pupillary response as a correlate of norepinephrine activity? Psychophysiology 2024; 61:e14565. [PMID: 38469647 DOI: 10.1111/psyp.14565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Revised: 02/28/2024] [Accepted: 02/29/2024] [Indexed: 03/13/2024]
Abstract
During language comprehension, anomalies and ambiguities in the input typically elicit the P600 event-related potential component. Although traditionally interpreted as a specific signal of combinatorial operations in sentence processing, the component has alternatively been proposed to be a variant of the oddball-sensitive, domain-general P3 component. In particular, both components might reflect phasic norepinephrine release from the locus coeruleus (LC/NE) to motivationally significant stimuli. In this preregistered study, we tested this hypothesis by relating both components to the task-evoked pupillary response, a putative biomarker of LC/NE activity. 36 participants completed a sentence comprehension task (containing 25% morphosyntactic violations) and a non-linguistic oddball task (containing 20% oddballs), while the EEG and pupil size were co-registered. Our results showed that the task-evoked pupillary response and the ERP amplitudes of both components were similarly affected by both experimental tasks. In the oddball task, there was also a temporally specific relationship between the P3 and the pupillary response beyond the shared oddball effect, thereby further linking the P3 to NE. Because this link was less reliable in the linguistic context, we did not find conclusive evidence for or against a relationship between the P600 and the pupillary response. Still, our findings further stimulate the debate on whether language-related ERPs are indeed specific to linguistic processes or shared across cognitive domains. However, further research is required to verify a potential link between the two ERP positivities and the LC/NE system as the common neural generator.
Collapse
Affiliation(s)
- Friederike Contier
- Cognitive Sciences, Department of Psychology, University of Potsdam, Potsdam, Germany
| | - Isabell Wartenburger
- Cognitive Sciences, Department of Linguistics, University of Potsdam, Potsdam, Germany
| | - Mathias Weymar
- Cognitive Sciences, Department of Psychology, University of Potsdam, Potsdam, Germany
| | - Milena Rabovsky
- Cognitive Sciences, Department of Psychology, University of Potsdam, Potsdam, Germany
| |
Collapse
|
3
|
Matchin W, Almeida D, Hickok G, Sprouse J. Cortical networks responsive to phrase structure and subject island violations. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.05.592579. [PMID: 38746262 PMCID: PMC11092748 DOI: 10.1101/2024.05.05.592579] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2024]
Abstract
In principle, functional neuroimaging provides uniquely informative data in addressing linguistic questions, because it can indicate distinct processes that are not apparent from behavioral data alone. This could involve adjudicating the source of unacceptability via the different patterns of elicited brain responses to different ungrammatical sentence types. However, it is difficult to interpret brain activations to syntactic violations. Such responses could reflect processes that have nothing intrinsically related to linguistic representations, such as domain-general executive function abilities. In order to facilitate the potential use of functional neuroimaging methods to identify the source of different syntactic violations, we conducted an fMRI experiment to identify the brain activation maps associated with two distinct syntactic violation types: phrase structure (created by inverting the order of two adjacent words within a sentence) and subject islands (created by extracting a wh-phrase out of an embedded subject). The comparison of these violations to control sentences surprisingly showed no indication of a generalized violation response, with almost completely divergent activation patterns. Phrase structure violations seemingly activated regions previously implicated in verbal working memory and structural complexity in sentence processing, whereas the subject islands appeared to activate regions previously implicated in conceptual-semantic processing, broadly defined. We review our findings in the context of previous research on syntactic and semantic violations using event-related potentials. We suggest that functional neuroimaging is a potentially fruitful technique in unpacking the distinct sets of cognitive processes elicited by theoretically-relevant syntactic violations, when interpreted with care and paired with appropriate control conditions.
Collapse
Affiliation(s)
- William Matchin
- Dept. of Communication Sciences and Disorders, University of South Carolina
| | | | - Gregory Hickok
- Dept. of Cognitive Sciences and Dept. of Language Science, University of California, Irvine
| | | |
Collapse
|
4
|
He Y, Sommer J, Hansen-Schirra S, Nagels A. Multivariate pattern analysis of EEG reveals nuanced impact of negation on sentence processing in the N400 and later time windows. Psychophysiology 2024; 61:e14491. [PMID: 38014642 DOI: 10.1111/psyp.14491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Revised: 10/13/2023] [Accepted: 11/06/2023] [Indexed: 11/29/2023]
Abstract
The neurocognitive mechanism underlying negation processing remains controversial. While negation is suggested to modulate the access of word meaning, no such evidence has been observed in the event-related potential (ERP) literature on sentence processing. In the current study, we applied both univariate ERP and multivariate pattern analysis (MVPA) methods to examine the processing of sentence negation. We investigated two types of negative congruent/incongruent sentence pairs with truth-value evaluation (e.g., "A robin is a/not a bird") and without (e.g., "The woman reads a/no book"). In the N400 time window, ERPs consistently showed increased negativity for negative and incongruent conditions. MVPA, on the other hand, revealed nuanced interactions between polarity and congruency. In the later P600 time window, MVPA but not the ERPs revealed an effect of congruency, which may be functionally distinct from the N400 window. We further used cross-decoding to show that the cognitive processes underlying the N400 window for both affirmative and negative sentences are comparable, whereas in the P600 window, only for the truth sentences, negative sentences showed a distinct pattern from their affirmative counterparts. Our results thus speak for a more interactive, but nevertheless serial and biphasic, and potentially construction-specific processing account of negation. We also discuss the advantage of applying MVPA in addition to the classical univariate methods for a better understanding of the neurobiology of negation processing and language comprehension alike.
Collapse
Affiliation(s)
- Yifei He
- Philipps University Marburg, Marburg, Germany
| | | | | | - Arne Nagels
- Johannes Gutenberg University Mainz, Mainz, Germany
| |
Collapse
|
5
|
Moore-Cantwell C, Pater J, Staubs R, Zobel B, Sanders L. Violations of Lab-Learned Phonological Patterns Elicit a Late Positive Component. LANGUAGE AND SPEECH 2024; 67:19-39. [PMID: 36927226 DOI: 10.1177/00238309231152492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
The experimental study of artificial language learning has become a widely used means of investigating the predictions of theories of language learning and representation. Although much is now known about the generalizations that learners make from various kinds of data, relatively little is known about how those representations affect speech processing. This paper presents an event-related potential (ERP) study of brain responses to violations of lab-learned phonotactics. Novel words that violated a learned phonotactic constraint elicited a larger Late Positive Component (LPC) than novel words that satisfied it. Similar LPCs have been found for violations of natively acquired linguistic structure, as well as for violations of other types of abstract generalizations, such as musical structure. We argue that lab-learned phonotactic generalizations are represented abstractly and affect the evaluation of speech in a manner that is similar to natively acquired syntactic and phonological rules.
Collapse
Affiliation(s)
| | - Joe Pater
- University of Massachusetts Amherst, USA
| | | | | | | |
Collapse
|
6
|
Gimeno-Martínez M, Baus C. Characterizing language production across modalities. Cogn Neuropsychol 2024; 41:1-17. [PMID: 38377394 DOI: 10.1080/02643294.2024.2315823] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 12/02/2023] [Indexed: 02/22/2024]
Abstract
ABSTRACTThis study investigates factors influencing lexical access in language production across modalities (signed and oral). Data from deaf and hearing signers were reanalyzed (Baus and Costa, 2015, On the temporal dynamics of sign production: An ERP study in Catalan Sign Language (LSC). Brain Research, 1609(1), 40-53. https://doi.org/10.1016/j.brainres.2015.03.013; Gimeno-Martínez and Baus, 2022, Iconicity in sign language production: Task matters. Neuropsychologia, 167, 108166. https://doi.org/10.1016/j.neuropsychologia.2022.108166) testing the influence of psycholinguistic variables and ERP mean amplitudes on signing and naming latencies. Deaf signers' signing latencies were influenced by sign iconicity in the picture signing task, and by spoken psycholinguistic variables in the word-to-sign translation task. Additionally, ERP amplitudes before response influenced signing but not translation latencies. Hearing signers' latencies, both signing and naming, were influenced by sign iconicity and word frequency, with early ERP amplitudes predicting only naming latencies. These findings highlight general and modality-specific determinants of lexical access in language production.
Collapse
Affiliation(s)
- Marc Gimeno-Martínez
- Department of Cognition, Development and Educational Psychology, University of Barcelona, Barcelona, Spain
| | - Cristina Baus
- Department of Cognition, Development and Educational Psychology, University of Barcelona, Barcelona, Spain
| |
Collapse
|
7
|
Stone K, Nicenboim B, Vasishth S, Rösler F. Understanding the Effects of Constraint and Predictability in ERP. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2023; 4:221-256. [PMID: 37229506 PMCID: PMC10205153 DOI: 10.1162/nol_a_00094] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/30/2020] [Accepted: 12/05/2022] [Indexed: 05/27/2023]
Abstract
Intuitively, strongly constraining contexts should lead to stronger probabilistic representations of sentences in memory. Encountering unexpected words could therefore be expected to trigger costlier shifts in these representations than expected words. However, psycholinguistic measures commonly used to study probabilistic processing, such as the N400 event-related potential (ERP) component, are sensitive to word predictability but not to contextual constraint. Some research suggests that constraint-related processing cost may be measurable via an ERP positivity following the N400, known as the anterior post-N400 positivity (PNP). The PNP is argued to reflect update of a sentence representation and to be distinct from the posterior P600, which reflects conflict detection and reanalysis. However, constraint-related PNP findings are inconsistent. We sought to conceptually replicate Federmeier et al. (2007) and Kuperberg et al. (2020), who observed that the PNP, but not the N400 or the P600, was affected by constraint at unexpected but plausible words. Using a pre-registered design and statistical approach maximising power, we demonstrated a dissociated effect of predictability and constraint: strong evidence for predictability but not constraint in the N400 window, and strong evidence for constraint but not predictability in the later window. However, the constraint effect was consistent with a P600 and not a PNP, suggesting increased conflict between a strong representation and unexpected input rather than greater update of the representation. We conclude that either a simple strong/weak constraint design is not always sufficient to elicit the PNP, or that previous PNP constraint findings could be an artifact of smaller sample size.
Collapse
Affiliation(s)
- Kate Stone
- Department of Psychology, University of Potsdam, Potsdam, Germany
| | - Bruno Nicenboim
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, Netherlands
- Department of Linguistics, University of Potsdam, Potsdam, Germany
| | - Shravan Vasishth
- Department of Linguistics, University of Potsdam, Potsdam, Germany
| | - Frank Rösler
- Department of Biological Psychology and Neuropsychology, University of Hamburg, Hamburg, Germany
| |
Collapse
|
8
|
Jachmann TK, Drenhaus H, Staudte M, Crocker MW. When a look is enough: Neurophysiological correlates of referential speaker gaze in situated comprehension. Cognition 2023; 236:105449. [PMID: 37030139 DOI: 10.1016/j.cognition.2023.105449] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Revised: 03/16/2023] [Accepted: 03/23/2023] [Indexed: 04/10/2023]
Abstract
Behavioral studies have shown that speaker gaze to objects in a co-present scene can influence listeners' expectations about how the utterance will unfold. These findings have recently been supported by ERP studies that linked the underlying mechanisms of the integration of speaker gaze with an utterance meaning representation to multiple ERP components. This leads to the question, however, as to whether speaker gaze should be considered part of the communicative signal itself, such that the referential information conveyed by gaze can help listeners not only form expectations but also to confirm referential expectations induced by the prior linguistic context. In the current study, we investigated this question by conducting an ERP experiment (N=24, Age:[19,31]), in which referential expectations were established by linguistic context together with several depicted objects in the scene. Those expectations then could be confirmed by subsequent speaker gaze that preceded the referential expression. Participants were presented with a centrally positioned face performing gaze actions aligned to utterances comparing two out of three displayed objects, with the task to judge whether the sentence was true given the provided scene. We manipulated the gaze cue to be either Present (toward the subsequently named object) or Absent preceding contextually Expected or Unexpected referring nouns. The results provided strong evidence for gaze as being treated as an integral part of the communicative signal: While in the absence of gaze, effects of phonological verification (PMN), word meaning retrieval (N400) and sentence meaning integration/evaluation (P600) were found on the unexpected noun, in the presence of gaze effects of retrieval (N400) and integration/evaluation (P300) were solely found in response to the pre-referent gaze cue when it was directed toward the unexpected referent with attenuated effects on the following referring noun.
Collapse
Affiliation(s)
- Torsten Kai Jachmann
- Language Science and Technology, Campus C7, Saarland University, D-66123 Saarbrücken, Germany.
| | - Heiner Drenhaus
- Language Science and Technology, Campus C7, Saarland University, D-66123 Saarbrücken, Germany
| | - Maria Staudte
- Language Science and Technology, Campus C7, Saarland University, D-66123 Saarbrücken, Germany
| | - Matthew W Crocker
- Language Science and Technology, Campus C7, Saarland University, D-66123 Saarbrücken, Germany
| |
Collapse
|
9
|
Aydın Ö, Uzun İP. Pupil Dilation Response to Prosody and Syntax During Auditory Sentence Processing. JOURNAL OF PSYCHOLINGUISTIC RESEARCH 2023; 52:153-177. [PMID: 35028824 DOI: 10.1007/s10936-021-09830-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/10/2021] [Indexed: 06/14/2023]
Abstract
Pupil dilation response has been shown to reflect different levels of sentence processing during prosodic and syntactic processing in language comprehension. Our pupillometry experiment aimed to investigate whether pupil diameter was sensitive to the auditory sentence processing involved in comprehending congruent and incongruent statements. Twenty-one participants were presented with 300 auditory stimuli consisting of syntactically and/or prosodically congruent and incongruent sentences in Turkish. The pupillary response results were significant only for syntactically incongruent sentences and for sentences that were both syntactically and prosodically incongruent. This indicates that prosody had no significant effect on its own. Based on the hypothesis that prosodic and syntactic processing require cognitive sensitivity for auditory sentence comprehension, we expected an increase in pupil diameter for both processes. However, our findings are consistent with the previous assumptions that pupil size increases during syntactic manipulation, but our findings showed that prosodic processing does not increase pupil size, contrary to previous studies.
Collapse
Affiliation(s)
- Özgür Aydın
- Department of Linguistics, Faculty of Languages and History-Geography, Ankara University, No 45/45A, Sıhhiye, 06100, Ankara, Turkey
- Neuroscience and Neurotechnology Center of Excellence, Ankara University, METU, & Gazi University, Ankara, Turkey
- Department of Interdisciplinary Neuroscience, Faculty of Health Sciences, Ankara University, Ankara, Turkey
| | - İpek Pınar Uzun
- Department of Linguistics, Faculty of Languages and History-Geography, Ankara University, No 45/45A, Sıhhiye, 06100, Ankara, Turkey.
- Neuroscience and Neurotechnology Center of Excellence, Ankara University, METU, & Gazi University, Ankara, Turkey.
| |
Collapse
|
10
|
Fabre EF, Rumiati R, Causse M, Mailliez M, Cacciari C, Lotto L. Investigating the impact of offer frame manipulations on responders playing the ultimatum game. Int J Psychophysiol 2022; 182:129-141. [DOI: 10.1016/j.ijpsycho.2022.10.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 09/21/2022] [Accepted: 10/12/2022] [Indexed: 11/05/2022]
|
11
|
Cofresí RU, Piasecki TM, Bartholow BD. Acute sensitization of the P3 event-related potential response to beverage images and the risk for alcohol use disorder. ADDICTION NEUROSCIENCE 2022; 4:100041. [PMID: 36425356 PMCID: PMC9681121 DOI: 10.1016/j.addicn.2022.100041] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Previous research suggests the amplitude of the P3 event-related potential (ERP) response reflects the incentive value of the eliciting stimulus, and that individuals with trait-like lower sensitivity (LS) to the acute effects of alcohol, a potent risk factor for alcohol use disorder (AUD), tend to show exaggerated P3 ERP responses to alcohol beverage cues (compared to their peers with higher sensitivity; HS). No prior research has examined trajectories of the cue-elicited P3 response across repeated trials of nonreinforced cue presentations. Characterizing these trajectories can be informative as to potential mechanisms linking LS with increased AUD risk. Here, we tested whether individual differences in alcohol sensitivity are associated with different trial-by-trial trajectories of the P3 elicited by alcohol and nonalcohol reward cues (infrequent oddball/target stimuli) using a large sample of emerging adults (M age = 19.53; N = 287; 55% female; 86% White; 90% right-handed) stratified for alcohol sensitivity. Multilevel models adjusted for age, sex, handedness, and alcohol use indicated that: (i) the P3 response to alcohol and nonalcohol reward cues alike sensitized (i.e., increased) across trials; (ii) across the task, the P3 response to alcohol cues was larger for the LS than the HS phenotype; and (iii) the P3 difference score (alcohol - nonalcohol) was larger for the LS than HS phenotype only across the first half of task. Findings suggest that whereas incentive value attribution may be a mechanism for alcohol cue-triggered attentional biases for both LS and HS individuals, LS individuals more consistently over-attribute incentive value to alcohol cues.
Collapse
Affiliation(s)
- Roberto U. Cofresí
- Department of Psychological Sciences, University of Missouri, Columbia, MO 65211, United States
| | - Thomas M. Piasecki
- Center for Tobacco Research and Intervention and Department of Medicine, University of Wisconsin, Madison, United States
| | - Bruce D. Bartholow
- Department of Psychological Sciences, University of Missouri, Columbia, MO 65211, United States
| |
Collapse
|
12
|
Voola M, Nguyen AT, Marinovic W, Rajan G, Tavora-Vieira D. Odd-even oddball task: Evaluating event-related potentials during word discrimination compared to speech-token and tone discrimination. Front Neurosci 2022; 16:983498. [PMID: 36312013 PMCID: PMC9614253 DOI: 10.3389/fnins.2022.983498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 09/29/2022] [Indexed: 11/21/2022] Open
Abstract
Tonal and speech token auditory oddball tasks have been commonly used to assess auditory processing in various populations; however, tasks using non-word sounds may fail to capture the higher-level ability to interpret and discriminate stimuli based on meaning, which are critical to language comprehension. As such, this study examines how neural signals associated with discrimination and evaluation-processes (P3b) from semantic stimuli compare with those elicited by tones and speech tokens. This study comprises of two experiments, both containing thirteen adults with normal hearing in both ears (PTA ≤ 20 dB HL). Scalp electroencephalography and auditory event related potentials were recorded in free field while they completed three different oddball tasks: (1) tones, (2) speech tokens and (3) odd/even numbers. Based on the findings of experiment one, experiment two was conducted to understand if the difference in responses from the three tasks was attributable to stimulus duration or other factors. Therefore, in experiment one, stimulus duration was not controlled and in experiment two, the duration of each stimulus was modified to be the same across all three tasks (∼400 ms). In both experiments, P3b peak latency was significantly different between all three tasks. P3b amplitude was sensitive to reaction time, with tasks that had a large reaction time variability resulting in the P3b amplitude to be smeared, thereby reducing the amplitude size. The findings from this study highlight the need to consider all factors of the task before attributing any effects to any additional process, such as semantic processing and mental effort. Furthermore, it highlights the need for more cautious interpretation of P3b results in auditory oddball tasks.
Collapse
Affiliation(s)
- Marcus Voola
- Division of Surgery, Medical School, The University of Western Australia, Perth, WA, Australia
- Department of Audiology, Fiona Stanley Fremantle Hospitals Group, Perth, WA, Australia
- *Correspondence: Marcus Voola,
| | - An T. Nguyen
- School of Population Health, Curtin University, Perth, WA, Australia
| | - Welber Marinovic
- School of Population Health, Curtin University, Perth, WA, Australia
| | - Gunesh Rajan
- Division of Surgery, Medical School, The University of Western Australia, Perth, WA, Australia
- Department of Otolaryngology, Head and Neck Surgery, Luzerner Kantonsspital, Luzern, Switzerland
| | - Dayse Tavora-Vieira
- Division of Surgery, Medical School, The University of Western Australia, Perth, WA, Australia
- Department of Audiology, Fiona Stanley Fremantle Hospitals Group, Perth, WA, Australia
- School of Population Health, Curtin University, Perth, WA, Australia
| |
Collapse
|
13
|
Computational complexity explains neural differences in quantifier verification. Cognition 2022; 223:105013. [DOI: 10.1016/j.cognition.2022.105013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2021] [Revised: 12/29/2021] [Accepted: 01/04/2022] [Indexed: 11/20/2022]
|
14
|
Children with autism spectrum disorder show atypical electroencephalographic response to processing contextual incongruencies. Sci Rep 2022; 12:8948. [PMID: 35624226 PMCID: PMC9142591 DOI: 10.1038/s41598-022-12475-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Accepted: 05/03/2022] [Indexed: 11/08/2022] Open
Abstract
Children with autism spectrum disorder (ASD) experience difficulties with social communication, making it challenging to interpret contextual information that aids in accurately interpreting language. To investigate how the brain processes the contextual information and how this is different in ASD, we compared event-related potentials (ERPs) in response to processing visual and auditory congruent and incongruent information. Two groups of children participated in the study: 37 typically developing children and 15 children with ASD (age range = 6 to 12). We applied a language task involving auditory sentences describing congruent or incongruent images. We investigated two ERP components associated with language processing: the N400 and P600. Our results showed how children with ASD present significant differences in their neural responses in comparison with the TD group, even when their reaction times and correct trials are not significantly different from the TD group.
Collapse
|
15
|
Weyers I, Mueller J. A Special Role of Syllables, But Not Vowels or Consonants, for Nonadjacent Dependency Learning. J Cogn Neurosci 2022; 34:1467-1487. [PMID: 35604359 DOI: 10.1162/jocn_a_01874] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Successful language processing entails tracking (morpho)syntactic relationships between distant units of speech, so-called nonadjacent dependencies (NADs). Many cues to such dependency relations have been identified, yet the linguistic elements encoding them have received little attention. In the present investigation, we tested whether and how these elements, here syllables, consonants, and vowels, affect behavioral learning success as well as learning-related changes in neural activity in relation to item-specific NAD learning. In a set of two EEG studies with adults, we compared learning under conditions where either all segment types (Experiment 1) or only one segment type (Experiment 2) was informative. The collected behavioral and ERP data indicate that, when all three segment types are available, participants mainly rely on the syllable for NAD learning. With only one segment type available for learning, adults also perform most successfully with syllable-based dependencies. Although we find no evidence for successful learning across vowels in Experiment 2, dependencies between consonants seem to be identified at least passively at the phonetic-feature level. Together, these results suggest that successful item-specific NAD learning may depend on the availability of syllabic information. Furthermore, they highlight consonants' distinctive power to support lexical processes. Although syllables show a clear facilitatory function for NAD learning, the underlying mechanisms of this advantage require further research.
Collapse
|
16
|
Almeida VN. The neural hierarchy of consciousness. Neuropsychologia 2022; 169:108202. [PMID: 35271856 DOI: 10.1016/j.neuropsychologia.2022.108202] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Revised: 02/25/2022] [Accepted: 03/01/2022] [Indexed: 01/08/2023]
Abstract
The chief undertaking in the studies of consciousness is that of unravelling "the minimal set of neural processes that are together sufficient for the conscious experience of a particular content - the neural correlates of consciousness". To this day, this crusade remains at an impasse, with a clash of two main theories: consciousness may arise either in a graded and cortically-localised fashion, or in an all-or-none and widespread one. In spite of the long-lasting theoretical debates, neurophysiological theories of consciousness have been mostly dissociated from them. Herein, a theoretical review will be put forth with the aim to change that. In its first half, we will cover the hard available evidence on the neurophysiology of consciousness, whereas in its second half we will weave a series of considerations on both theories and substantiate a novel take on conscious awareness: the levels of processing approach, partitioning the conscious architecture into lower- and higher-order, graded and nonlinear.
Collapse
Affiliation(s)
- Victor N Almeida
- Faculdade de Letras, Universidade Federal de Minas Gerais (UFMG), Av. Pres. Antônio Carlos, 6627, Pampulha, Belo Horizonte, MG, 31270-901, Brazil.
| |
Collapse
|
17
|
Dudschig C. Language and non-linguistic cognition: Shared mechanisms and principles reflected in the N400. Biol Psychol 2022; 169:108282. [DOI: 10.1016/j.biopsycho.2022.108282] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 01/25/2022] [Accepted: 01/26/2022] [Indexed: 11/17/2022]
|
18
|
The more you know: Schema-congruency supports associative encoding of novel compound words. Evidence from event-related potentials. Brain Cogn 2021; 155:105813. [PMID: 34773860 DOI: 10.1016/j.bandc.2021.105813] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Revised: 10/16/2021] [Accepted: 10/17/2021] [Indexed: 11/23/2022]
Abstract
We aimed to investigate the neurocognitive mechanisms of event congruency with prior (schema) knowledge for the learning of novel compound words. Event-related potentials (ERPs) were recorded during an incidental learning task, in which novel noun-noun compounds were presented in a semantically congruent context, enabling schema-supported processing, or in a neutral context. As expected, associative memory performance was better for compounds preceded by a congruent context. Although the N400 was attenuated in the congruent condition, subsequent memory effects (SMEs) in the N400 time interval did not differ across conditions, suggesting that the processes reflected in the N400 cannot account for the memory advantage in the congruent condition. However, a parietal SME was obtained for compounds preceded by a congruent context, only, which we interpret as reflecting the schema-supported formation of a conceptual compound representation. A late frontal SME was obtained in both conditions, presumably reflecting the more general inter-item associative encoding of compound constituents.
Collapse
|
19
|
Volpert-Esmond HI, Bartholow BD. A Functional Coupling of Brain and Behavior During Social Categorization of Faces. PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN 2021; 47:1580-1595. [PMID: 33419384 PMCID: PMC8263806 DOI: 10.1177/0146167220976688] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Considerable research has focused on how people derive information about others' social category memberships from their faces. Theoretical models posit that early extraction of task-relevant information from a face should determine the efficiency with which that face is categorized, but evidence supporting this idea has been elusive. Here, we used a novel trial-level data analytic approach to examine the relationship between two event-related potential components-the P2, indexing early attention to category-relevant information, and the P3, indexing stimulus evaluation-and the speed of overt categorization judgments. As predicted, a larger face-elicited P2 on a particular trial was associated with faster overt race or gender categorization of that face. Moreover, this association was mediated by P3 latency, indicating that extraction of more category-relevant information early in processing facilitated stimulus evaluation. These findings support continuous flow models of information processing and the long-theorized functional significance of face-elicited neurophysiological responses for social categorization.
Collapse
Affiliation(s)
| | - Bruce D. Bartholow
- Department of Psychological Sciences, University of Missouri, Columbia, MO 65211, USA
| |
Collapse
|
20
|
Xu J, Abdel Rahman R, Sommer W. Who speaks next? Adaptations to speaker identity in processing spoken sentences. Psychophysiology 2021; 59:e13948. [PMID: 34587288 DOI: 10.1111/psyp.13948] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 07/22/2021] [Accepted: 09/13/2021] [Indexed: 11/30/2022]
Abstract
When listening to a speaker, we need to adapt to her individual speaking characteristics, such as error proneness, accent, etc. The present study investigated two aspects of adaptation to speaker identity during processing spoken sentences in multi-speaker situations: the effect of speaker sequence across sentences and the effect of learning speaker-specific error probability. Spoken sentences were presented, cued, and accompanied by one of three portraits that were labeled as the speakers' faces. In Block 1 speaker-specific probabilities of syntax errors were 10%, 50%, or 90%; in Block 2 they were uniformly 50%. In both blocks, speech errors elicited P600 effects in the scalp recorded ERP. We found a speaker sequence effect only in Block 1: the P600 to target words was larger after speaker switches than after speaker repetitions, independent of sentence correctness. In Block 1, listeners showed higher accuracy in judging sentence correctness spoken by speakers with lower error proportions. No speaker-specific differences in target word P600 and accuracy were found in Block 2. When speakers differ in error proneness, listeners seem to flexibly adapt their speech processing for the upcoming sentence through attention reorientation and resource reallocation if the speaker is about to change, and through proactive maintenance of neural resources if the speaker remains the same.
Collapse
Affiliation(s)
- Jue Xu
- Institut für Psychologie, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Rasha Abdel Rahman
- Institut für Psychologie, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Werner Sommer
- Institut für Psychologie, Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
21
|
Busch-Moreno S, Tuomainen J, Vinson D. Trait anxiety effects on late phase threatening speech processing: Evidence from electroencephalography. Eur J Neurosci 2021; 54:7152-7175. [PMID: 34553432 DOI: 10.1111/ejn.15470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2020] [Revised: 09/13/2021] [Accepted: 09/16/2021] [Indexed: 11/27/2022]
Abstract
The effects of threatening stimuli, including threatening language, on trait anxiety have been widely studied. However, whether anxiety levels have a direct effect on language processing has not been so consistently explored. The present study focuses on event-related potential (ERP) patterns resulting from electroencephalographic (EEG) measurement of participants' (n = 36) brain activity while they perform a dichotic listening task. Participants' anxiety level was measured via a behavioural inhibition system scale (BIS). Later, participants listened to dichotically paired sentences, one neutral and the other threatening, and indicated at which ear they heard the threatening stimulus. Threatening sentences expressed threat semantically-only, prosodically-only, or both combined (congruent threat). ERPs showed a late positivity, interpreted as a late positive complex (LPC). Results from Bayesian hierarchical models provided strong support for an association between LPC and BIS score. This was interpreted as an effect of trait anxiety on deliberation processes. We discuss two possible interpretations. On the one hand, verbal repetitive thinking, as associated with anxious rumination and worry, can be the mechanism disrupting late phase deliberation processes. Instantiated by inner speech, verbal repetitive thinking might be the vehicle of anxiety-related reappraisal and/or rehearsal. On the other hand, increased BIS could be simply affecting an extended evaluation stage as proposed by multistep models, maybe due to over-engagement with threat or to task-related effects.
Collapse
Affiliation(s)
- Simon Busch-Moreno
- Division of Psychology and Language Sciences, University College London, London, UK
| | - Jyrki Tuomainen
- Division of Psychology and Language Sciences, University College London, London, UK
| | - David Vinson
- Division of Psychology and Language Sciences, University College London, London, UK
| |
Collapse
|
22
|
Brilmayer I, Schumacher PB. Referential Chains Reveal Predictive Processes and Form-to-Function Mapping: An Electroencephalographic Study Using Naturalistic Story Stimuli. Front Psychol 2021; 12:623648. [PMID: 34489770 PMCID: PMC8417467 DOI: 10.3389/fpsyg.2021.623648] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 07/12/2021] [Indexed: 11/13/2022] Open
Abstract
In discourse pragmatics, different referential forms are claimed to be indicative of the cognitive status of a referent in the current discourse. Referential expressions thereby possess a double function: They point back to an (existing) referent (form-to-function mapping), and they are used to derive predictions about a referent’s subsequent recurrence in discourse. Existing event-related potential (ERP) research has mainly focused on the form-to-function mapping of referential expression. In the present ERP study, we explore the relationship of form-to-function mapping and prediction derived from the antecedent of referential expressions in naturalistic auditory language comprehension. Specifically, the study investigates the relationship between the form of a referential expression (pronoun vs. noun) and the form of its antecedent (pronoun vs. noun); i.e., it examines the influence of the interplay of predictions derived from an antecedent (forward-looking function) and the form-to-function mapping of an anaphor (backward-looking function) on the ERPs time-locked to anaphoric expressions. The results in the time range of the P300 and N400 allow for a dissociation of these two functions during online language comprehension.
Collapse
Affiliation(s)
- Ingmar Brilmayer
- Department of German Language and Literature I-Linguistics, University of Cologne, Cologne, Germany
| | - Petra B Schumacher
- Department of German Language and Literature I-Linguistics, University of Cologne, Cologne, Germany
| |
Collapse
|
23
|
Henke L, Meyer L. Endogenous Oscillations Time-Constrain Linguistic Segmentation: Cycling the Garden Path. Cereb Cortex 2021; 31:4289-4299. [PMID: 33949654 PMCID: PMC8328215 DOI: 10.1093/cercor/bhab086] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
Speech is transient. To comprehend entire sentences, segments consisting of multiple words need to be memorized for at least a while. However, it has been noted previously that we struggle to memorize segments longer than approximately 2.7 s. We hypothesized that electrophysiological processing cycles within the delta band (<4 Hz) underlie this time constraint. Participants’ EEG was recorded while they listened to temporarily ambiguous sentences. By manipulating the speech rate, we aimed at biasing participants’ interpretation: At a slow rate, segmentation after 2.7 s would trigger a correct interpretation. In contrast, at a fast rate, segmentation after 2.7 s would trigger a wrong interpretation and thus an error later in the sentence. In line with the suggested time constraint, the phase of the delta-band oscillation at the critical point in the sentence mirrored segmentation on the level of single trials, as indicated by the amplitude of the P600 event-related brain potential (ERP) later in the sentence. The correlation between upstream delta-band phase and downstream P600 amplitude implies that segmentation took place when an underlying neural oscillator had reached a specific angle within its cycle, determining comprehension. We conclude that delta-band oscillations set an endogenous time constraint on segmentation.
Collapse
Affiliation(s)
- Lena Henke
- Research Group Language Cycles, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Lars Meyer
- Research Group Language Cycles, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany.,Clinic for Phoniatrics and Pedaudiology, University Hospital Münster, 48149 Münster, Germany
| |
Collapse
|
24
|
Kroczek LOH, Gunter TC. The time course of speaker-specific language processing. Cortex 2021; 141:311-321. [PMID: 34118750 DOI: 10.1016/j.cortex.2021.04.017] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2020] [Revised: 04/27/2021] [Accepted: 04/27/2021] [Indexed: 10/21/2022]
Abstract
Listeners are sensitive to a speaker's individual language use and generate expectations for particular speakers. It is unclear, however, how such expectations affect online language processing. In the present EEG study, we presented thirty-two participants with auditory sentence stimuli of two speakers. Speakers differed in their use of two particular syntactic structures, easy subject-initial SOV structures and more difficult object-initial OSV structures. One speaker, the SOV-Speaker, had a high proportion of SOV sentences (75%) and a low proportion of OSV sentences (25%), and vice-versa for the OSV-Speaker. Participants were exposed to the speakers' individual language use in a training session followed by a test session on the consecutive day. ERP-results show that early stages of sentence processing are driven by syntactic processing only and are unaffected by speaker-specific expectations. In a late stage, however, an interaction between speaker and syntax information was observed. For the SOV-Speaker condition, the classical P600-effect reflected the effort of processing difficult and unexpected sentence structures. For the OSV-Speaker condition, both structures elicited different responses on frontal electrodes, possibly indexing effort to switch from a local speaker model to a global model of language use. Overall, the study identifies distinct neural mechanisms related to speaker-specific expectations.
Collapse
Affiliation(s)
- Leon O H Kroczek
- Department of Clinical Psychology and Psychotherapy, University of Regensburg, Germany.
| | - Thomas C Gunter
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Germany
| |
Collapse
|
25
|
Hernández-Gutiérrez D, Muñoz F, Sánchez-García J, Sommer W, Abdel Rahman R, Casado P, Jiménez-Ortega L, Espuny J, Fondevila S, Martín-Loeches M. Situating language in a minimal social context: how seeing a picture of the speaker's face affects language comprehension. Soc Cogn Affect Neurosci 2021; 16:502-511. [PMID: 33470410 PMCID: PMC8094999 DOI: 10.1093/scan/nsab009] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2020] [Revised: 11/29/2020] [Accepted: 01/19/2021] [Indexed: 11/14/2022] Open
Abstract
Natural use of language involves at least two individuals. Some studies have focused on the interaction between senders in communicative situations and how the knowledge about the speaker can bias language comprehension. However, the mere effect of a face as a social context on language processing remains unknown. In the present study, we used event-related potentials to investigate the semantic and morphosyntactic processing of speech in the presence of a photographic portrait of the speaker. In Experiment 1, we show that the N400, a component related to semantic comprehension, increased its amplitude when processed within this minimal social context compared to a scrambled face control condition. Hence, the semantic neural processing of speech is sensitive to the concomitant perception of a picture of the speaker's face, even if irrelevant to the content of the sentences. Moreover, a late posterior negativity effect was found to the presentation of the speaker's face compared to control stimuli. In contrast, in Experiment 2, we found that morphosyntactic processing, as reflected in left anterior negativity and P600 effects, is not notably affected by the presence of the speaker's portrait. Overall, the present findings suggest that the mere presence of the speaker's image seems to trigger a minimal communicative context, increasing processing resources for language comprehension at the semantic level.
Collapse
Affiliation(s)
- David Hernández-Gutiérrez
- Cognitive Neuroscience Section, Center UCM-ISCIII for Human Evolution and Behaviour, Madrid 28029, Spain
| | - Francisco Muñoz
- Cognitive Neuroscience Section, Center UCM-ISCIII for Human Evolution and Behaviour, Madrid 28029, Spain
- Department of Psychobiology & Methods for the Behavioural Sciences, Complutense University of Madrid, Madrid 28040, Spain
| | - Jose Sánchez-García
- Cognitive Neuroscience Section, Center UCM-ISCIII for Human Evolution and Behaviour, Madrid 28029, Spain
| | - Werner Sommer
- Department of Psychology, Humboldt Universität zu Berlin, Berlin 10117, Germany
| | - Rasha Abdel Rahman
- Department of Psychology, Humboldt Universität zu Berlin, Berlin 10117, Germany
| | - Pilar Casado
- Cognitive Neuroscience Section, Center UCM-ISCIII for Human Evolution and Behaviour, Madrid 28029, Spain
- Department of Psychobiology & Methods for the Behavioural Sciences, Complutense University of Madrid, Madrid 28040, Spain
| | - Laura Jiménez-Ortega
- Cognitive Neuroscience Section, Center UCM-ISCIII for Human Evolution and Behaviour, Madrid 28029, Spain
- Department of Psychobiology & Methods for the Behavioural Sciences, Complutense University of Madrid, Madrid 28040, Spain
| | - Javier Espuny
- Cognitive Neuroscience Section, Center UCM-ISCIII for Human Evolution and Behaviour, Madrid 28029, Spain
| | - Sabela Fondevila
- Cognitive Neuroscience Section, Center UCM-ISCIII for Human Evolution and Behaviour, Madrid 28029, Spain
- Department of Psychobiology & Methods for the Behavioural Sciences, Complutense University of Madrid, Madrid 28040, Spain
| | - Manuel Martín-Loeches
- Cognitive Neuroscience Section, Center UCM-ISCIII for Human Evolution and Behaviour, Madrid 28029, Spain
- Department of Psychobiology & Methods for the Behavioural Sciences, Complutense University of Madrid, Madrid 28040, Spain
| |
Collapse
|
26
|
Ryskin R, Stearns L, Bergen L, Eddy M, Fedorenko E, Gibson E. An ERP index of real-time error correction within a noisy-channel framework of human communication. Neuropsychologia 2021; 158:107855. [PMID: 33865848 DOI: 10.1016/j.neuropsychologia.2021.107855] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2020] [Revised: 03/31/2021] [Accepted: 04/06/2021] [Indexed: 10/21/2022]
Abstract
Recent evidence suggests that language processing is well-adapted to noise in the input (e.g., spelling or speech errors, misreading or mishearing) and that comprehenders readily correct the input via rational inference over possible intended sentences given probable noise corruptions. In the current study, we probed the processing of noisy linguistic input, asking whether well-studied ERP components may serve as useful indices of this inferential process. In particular, we examined sentences where semantic violations could be attributed to noise-for example, in "The storyteller could turn any incident into an amusing antidote", where the implausible word "antidote" is orthographically and phonologically close to the intended "anecdote". We found that the processing of such sentences-where the probability that the message was corrupted by noise exceeds the probability that it was produced intentionally and perceived accurately-was associated with a reduced (less negative) N400 effect and an increased P600 effect, compared to semantic violations which are unlikely to be attributed to noise ("The storyteller could turn any incident into an amusing hearse"). Further, the magnitudes of these ERP effects were correlated with the probability that the comprehender retrieved a plausible alternative. This work thus adds to the growing body of literature that suggests that many aspects of language processing are optimized for dealing with noise in the input, and opens the door to electrophysiologic investigations of the computations that support the processing of imperfect input.
Collapse
Affiliation(s)
| | | | - Leon Bergen
- University of California, San Diego, United States
| | - Marianna Eddy
- Massachusetts Institute of Technology, United States
| | - Evelina Fedorenko
- Massachusetts Institute of Technology, United States; McGovern Institute for Brain Research, United States
| | - Edward Gibson
- Massachusetts Institute of Technology, United States
| |
Collapse
|
27
|
García-Sierra A, Silva-Pereyra J, Alatorre-Cruz GC, Wig N. An Event-Related Brain Potential (ERP) Study of Complex Anaphora in Spanish. Front Psychol 2021; 12:625314. [PMID: 33815209 PMCID: PMC8012726 DOI: 10.3389/fpsyg.2021.625314] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2020] [Accepted: 02/22/2021] [Indexed: 11/13/2022] Open
Abstract
This study examines the event- related brain potential (ERP) of 25 Mexican monolingual Spanish-speakers when reading Spanish sentences with single entity anaphora or complex anaphora. Complex anaphora is an expression that refer to propositions, states, facts or events while, a single entity anaphora is an expression that refers back to a concrete object. Here we compare the cognitive cost in processing a single entity anaphora [ésta feminine; La renuncia (resignation)] from a complex anaphora [esto neuter; La renuncia fue aceptada (The resignation was accepted)]. Ésta elicited a larger positive peak at 200 ms, and esto elicited a larger frontal negativity around 400 ms. The positivity resembles the P200 component, and its amplitude is thought to represent an interaction between predictive qualities in sentence processing (i.e., graphical similarity and frequency of occurrence). Unlike parietal negativities (typical N400), frontal negativities are thought to represent the ease by which pronouns are linked with its antecedent, and how easy the information is recovered from short-term memory. Thus, the complex anaphora recruited more cognitive resources than the single entity anaphora. We also included an ungrammatical control sentence [éste masculine; La renuncia (resignation)] to better understand the unique processes behind complex anaphoric resolution, as opposed to just general difficulty in sentence processing. In this case, event-related potentials (ERPs) elicited by éste masculine and ésta feminine were compared. Again, ésta elicited a larger P200. However, different from the experimental condition, a left anterior negativity (LAN) effect was observed for éste; the ungrammatical condition. Altogether, the present research provides electrophysiological evidence indicating that demonstrative pronouns with different morphosyntactic features (i.e., gender) and discourse parameters (i.e., single entity or complex referent) interact during the first stage of anaphoric processing of anaphora. This stage initiated as early as 200 milliseconds after the pronoun onset and probably ends around 400 ms.
Collapse
Affiliation(s)
- Adrián García-Sierra
- Department of Speech, Language and Hearing Sciences, University of Connecticut, Mansfield, CT, United States
- The Connecticut Institute for the Brain and Cognitive Sciences, Storrs, CT, United States
| | - Juan Silva-Pereyra
- Proyecto de Neurociencias, Facultad de Estudios Superiores Iztacala, Universidad Nacional Autónoma de México, Mexico City, Mexico
| | | | - Noelle Wig
- Department of Speech, Language and Hearing Sciences, University of Connecticut, Mansfield, CT, United States
- The Connecticut Institute for the Brain and Cognitive Sciences, Storrs, CT, United States
| |
Collapse
|
28
|
Xu J, Abdel Rahman R, Sommer W. Sequential adaptation effects reveal proactive control in processing spoken sentences: Evidence from event-related potentials. BRAIN AND LANGUAGE 2021; 214:104904. [PMID: 33454515 DOI: 10.1016/j.bandl.2020.104904] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2020] [Revised: 11/15/2020] [Accepted: 12/22/2020] [Indexed: 06/12/2023]
Abstract
How domain-general cognitive control is engaged in language processing remains debated. We address how linguistic processes are monitored and regulated by analyzing the effects of previous-trial sentence correctness on the P600 component of the event-related potential (ERP) in the current-trial. In data from a previous experiment about processing spoken sentences, P600 amplitudes to both correct and incorrect words in current sentences were smaller after incorrect as compared to correct previous sentences. Therefore, the detection of speech errors may initiate sustained proactive control over the monitoring demands for upcoming sentences. No sequential adaptation was found in the difference between P600 amplitudes to incorrect and correct current conditions. We propose that the P600 reflects the reactive reanalysis of speech processing and/or the resolution of linguistic conflicts, but is also sensitive to proactive speech monitoring, an important aspect of cognitive control.
Collapse
Affiliation(s)
- Jue Xu
- Institut für Psychologie, Humboldt-Universität zu Berlin, Rudower Chaussee 18, 12489 Berlin, Germany.
| | - Rasha Abdel Rahman
- Institut für Psychologie, Humboldt-Universität zu Berlin, Rudower Chaussee 18, 12489 Berlin, Germany.
| | - Werner Sommer
- Institut für Psychologie, Humboldt-Universität zu Berlin, Rudower Chaussee 18, 12489 Berlin, Germany.
| |
Collapse
|
29
|
Volpert-Esmond HI, Page-Gould E, Bartholow BD. Using multilevel models for the analysis of event-related potentials. Int J Psychophysiol 2021; 162:145-156. [PMID: 33600841 DOI: 10.1016/j.ijpsycho.2021.02.006] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2020] [Revised: 02/01/2021] [Accepted: 02/03/2021] [Indexed: 01/02/2023]
Abstract
Multilevel modeling (MLM) is becoming increasingly accessible and popular in the analysis of event-related potentials (ERPs). In this article, we review the benefits of MLM for analyzing psychophysiological data, which often contains repeated observations within participants, and introduce some of the decision-making points in the analytic process, including how to set up the data set, specify the model, conduct hypothesis tests, and visualize the model estimates. We highlight how the use of MLM can extend the types of theoretical questions that can be answered using ERPs, including investigations of how ERPs vary meaningfully across trials within a testing session. We also address reporting practices and provide tools to calculate effect sizes and simulate power curves. Ultimately, we hope this review contributes to emerging best practices for the use of MLM with psychophysiological data.
Collapse
Affiliation(s)
| | | | - Bruce D Bartholow
- Department of Psychological Sciences, University of Missouri, Columbia, MO 65211, USA
| |
Collapse
|
30
|
Brouwer H, Delogu F, Venhuizen NJ, Crocker MW. Neurobehavioral Correlates of Surprisal in Language Comprehension: A Neurocomputational Model. Front Psychol 2021; 12:615538. [PMID: 33643143 PMCID: PMC7905034 DOI: 10.3389/fpsyg.2021.615538] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2020] [Accepted: 01/11/2021] [Indexed: 11/13/2022] Open
Abstract
Expectation-based theories of language comprehension, in particular Surprisal Theory, go a long way in accounting for the behavioral correlates of word-by-word processing difficulty, such as reading times. An open question, however, is in which component(s) of the Event-Related brain Potential (ERP) signal Surprisal is reflected, and how these electrophysiological correlates relate to behavioral processing indices. Here, we address this question by instantiating an explicit neurocomputational model of incremental, word-by-word language comprehension that produces estimates of the N400 and the P600-the two most salient ERP components for language processing-as well as estimates of "comprehension-centric" Surprisal for each word in a sentence. We derive model predictions for a recent experimental design that directly investigates "world-knowledge"-induced Surprisal. By relating these predictions to both empirical electrophysiological and behavioral results, we establish a close link between Surprisal, as indexed by reading times, and the P600 component of the ERP signal. The resultant model thus offers an integrated neurobehavioral account of processing difficulty in language comprehension.
Collapse
Affiliation(s)
- Harm Brouwer
- Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
| | - Francesca Delogu
- Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
| | - Noortje J Venhuizen
- Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
| | - Matthew W Crocker
- Department of Language Science and Technology, Saarland University, Saarbrücken, Germany
| |
Collapse
|
31
|
Yano M, Suwazono S, Arao H, Yasunaga D, Oishi H. Selective adaptation in sentence comprehension: Evidence from event-related brain potentials. Q J Exp Psychol (Hove) 2021; 74:645-668. [PMID: 33319641 DOI: 10.1177/1747021820984623] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
In this study, two event-related potential experiments were conducted to investigate whether readers adapt their expectations to morphosyntactically (Experiment 1) or semantically (Experiment 2) anomalous sentences when they are repeatedly exposed to them. To address this issue, we experimentally manipulated the probability of occurrence of grammatical sentences and syntactically and semantically anomalous sentences through experiments. For the low probability block, anomalous sentences were presented less frequently than grammatical sentences (with a ratio of 1 to 4), while they were presented as frequently as grammatical sentences in the equal probability block. Experiment 1 revealed a smaller P600 effect for morphosyntactic violations in the equal probability block than in the low probability block. Linear mixed-effects models were used to examine how the size of the P600 effect changed as the experiment went along. The results showed that the smaller P600 effect of the equal probability block resulted from an amplitude's decline in morphosyntactically violated sentences over the course of the experiment, suggesting an adaptation to morphosyntactic violations. In Experiment 2, semantically anomalous sentences elicited a larger N400 effect than their semantically natural counterparts regardless of probability manipulation. Little evidence was found in favour of adaptation to semantic violations in that the processing cost associated with the N400 did not decrease over the course of the experiment. Therefore, a dynamic aspect of language-processing system was demonstrated in this study. We will discuss why the language-processing system shows a selective adaptation to morphosyntactic violations.
Collapse
Affiliation(s)
- Masataka Yano
- Department of Language Sciences, Tokyo Metropolitan University, Tokyo, Japan.,Faculty of Humanities, Kyushu University, Fukuoka, Japan.,Department of Linguistics, Graduate School of Arts and Letters, Tohoku University, Sendai, Japan
| | - Shugo Suwazono
- Department of Neurology and Centre for Clinical Neuroscience, National Hospital Organization Okinawa National Hospital, Okinawa, Japan
| | - Hiroshi Arao
- Department of Human Sciences, Taisho University, Tokyo, Japan
| | - Daichi Yasunaga
- Faculty of Letters, Institute of Human and Social Sciences, Kanazawa University, Ishikawa, Japan
| | - Hiroaki Oishi
- College of Comprehensive Psychology, Ritsumeikan University, Osaka, Japan
| |
Collapse
|
32
|
Vega-Mendoza M, Pickering MJ, Nieuwland MS. Concurrent use of animacy and event-knowledge during comprehension: Evidence from event-related potentials. Neuropsychologia 2021; 152:107724. [PMID: 33347913 DOI: 10.1016/j.neuropsychologia.2020.107724] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Revised: 10/02/2020] [Accepted: 12/08/2020] [Indexed: 10/22/2022]
Abstract
In two ERP experiments, we investigated whether readers prioritize animacy over real-world event-knowledge during sentence comprehension. We used the paradigm of Paczynski and Kuperberg (2012), who argued that animacy is prioritized based on the observations that the 'related anomaly effect' (reduced N400s for context-related anomalous words compared to unrelated words) does not occur for animacy violations, and that animacy violations but not relatedness violations elicit P600 effects. Participants read passive sentences with plausible agents (e.g., The prescription for the mental disorder was written by the psychiatrist) or implausible agents that varied in animacy and semantic relatedness (schizophrenic/guard/pill/fence). In Experiment 1 (with a plausibility judgment task), plausible sentences elicited smaller N400s relative to all types of implausible sentences. Crucially, animate words elicited smaller N400s than inanimate words, and related words elicited smaller N400s than unrelated words, but Bayesian analysis revealed substantial evidence against an interaction between animacy and relatedness. Moreover, at the P600 time-window, we observed more positive ERPs for animate than inanimate words and for related than unrelated words at anterior regions. In Experiment 2 (without judgment task), we observed an N400 effect with animacy violations, but no other effects. Taken together, the results of our experiments fail to support a prioritized role of animacy information over real-world event-knowledge, but they support an interactive, constraint-based view on incremental semantic processing.
Collapse
Affiliation(s)
- Mariana Vega-Mendoza
- Department of Psychology, School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, Scotland, UK; Department of Business Administration, Technology and Social Sciences. Engineering Psychology, Luleå University of Technology, Luleå, Sweden.
| | - Martin J Pickering
- Department of Psychology, School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, Scotland, UK
| | - Mante S Nieuwland
- Department of Psychology, School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, Scotland, UK; Max Planck Institute for Psycholinguistics, Nijmegen, the Netherlands; Donders Institute for Cognition, Brain and Behaviour, Nijmegen, the Netherlands; Heinrich-Heine-University, Düsseldorf, Germany
| |
Collapse
|
33
|
Kuperberg GR. Tea With Milk? A Hierarchical Generative Framework of Sequential Event Comprehension. Top Cogn Sci 2021; 13:256-298. [PMID: 33025701 PMCID: PMC7897219 DOI: 10.1111/tops.12518] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Revised: 07/11/2020] [Accepted: 07/11/2020] [Indexed: 10/23/2022]
Abstract
To make sense of the world around us, we must be able to segment a continual stream of sensory inputs into discrete events. In this review, I propose that in order to comprehend events, we engage hierarchical generative models that "reverse engineer" the intentions of other agents as they produce sequential action in real time. By generating probabilistic predictions for upcoming events, generative models ensure that we are able to keep up with the rapid pace at which perceptual inputs unfold. By tracking our certainty about other agents' goals and the magnitude of prediction errors at multiple temporal scales, generative models enable us to detect event boundaries by inferring when a goal has changed. Moreover, by adapting flexibly to the broader dynamics of the environment and our own comprehension goals, generative models allow us to optimally allocate limited resources. Finally, I argue that we use generative models not only to comprehend events but also to produce events (carry out goal-relevant sequential action) and to continually learn about new events from our surroundings. Taken together, this hierarchical generative framework provides new insights into how the human brain processes events so effortlessly while highlighting the fundamental links between event comprehension, production, and learning.
Collapse
Affiliation(s)
- Gina R. Kuperberg
- Department of Psychology and Center for Cognitive Science, Tufts University
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School
| |
Collapse
|
34
|
Richter M, Paul M, Höhle B, Wartenburger I. Common Ground Information Affects Reference Resolution: Evidence From Behavioral Data, ERPs, and Eye-Tracking. Front Psychol 2020; 11:565651. [PMID: 33329197 PMCID: PMC7734025 DOI: 10.3389/fpsyg.2020.565651] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Accepted: 11/10/2020] [Indexed: 11/13/2022] Open
Abstract
One of the most important social cognitive skills in humans is the ability to “put oneself in someone else’s shoes,” that is, to take another person’s perspective. In socially situated communication, perspective taking enables the listener to arrive at a meaningful interpretation of what is said (sentence meaning) and what is meant (speaker’s meaning) by the speaker. To successfully decode the speaker’s meaning, the listener has to take into account which information he/she and the speaker share in their common ground (CG). We here further investigated competing accounts about when and how CG information affects language comprehension by means of reaction time (RT) measures, accuracy data, event-related potentials (ERPs), and eye-tracking. Early integration accounts would predict that CG information is considered immediately and would hence not expect to find costs of CG integration. Late integration accounts would predict a rather late and effortful integration of CG information during the parsing process that might be reflected in integration or updating costs. Other accounts predict the simultaneous integration of privileged ground (PG) and CG perspectives. We used a computerized version of the referential communication game with object triplets of different sizes presented visually in CG or PG. In critical trials (i.e., conflict trials), CG information had to be integrated while privileged information had to be suppressed. Listeners mastered the integration of CG (response accuracy 99.8%). Yet, slower RTs, and enhanced late positivities in the ERPs showed that CG integration had its costs. Moreover, eye-tracking data indicated an early anticipation of referents in CG but an inability to suppress looks to the privileged competitor, resulting in later and longer looks to targets in those trials, in which CG information had to be considered. Our data therefore support accounts that foresee an early anticipation of referents to be in CG but a rather late and effortful integration if conflicting information has to be processed. We show that both perspectives, PG and CG, contribute to socially situated language processing and discuss the data with reference to theoretical accounts and recent findings on the use of CG information for reference resolution.
Collapse
Affiliation(s)
- Maria Richter
- Cognitive Sciences, Department of Linguistics, University of Potsdam, Potsdam, Germany
| | - Mariella Paul
- Cognitive Sciences, Department of Linguistics, University of Potsdam, Potsdam, Germany.,Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany.,Berlin School of Mind and Brain, Humboldt-Universität Zu Berlin, Berlin, Germany.,Psychology of Language Department, University of Göttingen, Göttingen, Germany
| | - Barbara Höhle
- Cognitive Sciences, Department of Linguistics, University of Potsdam, Potsdam, Germany
| | - Isabell Wartenburger
- Cognitive Sciences, Department of Linguistics, University of Potsdam, Potsdam, Germany.,Berlin School of Mind and Brain, Humboldt-Universität Zu Berlin, Berlin, Germany
| |
Collapse
|
35
|
Beatty-Martínez AL, Bruni MR, Bajo MT, Dussias PE. Brain potentials reveal differential processing of masculine and feminine grammatical gender in native Spanish speakers. Psychophysiology 2020; 58:e13737. [PMID: 33263933 DOI: 10.1111/psyp.13737] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Revised: 10/14/2020] [Accepted: 11/12/2020] [Indexed: 11/29/2022]
Abstract
Studies of Spanish grammatical gender have shown that native speakers exploit gender cues in determiners to facilitate speech processing and are sensitive to gender mismatches. However, past research has not considered attested distributional asymmetries between masculine and feminine gender, collapsing performance on trials with one or the other gender into a single analysis. We use event-related potentials to investigate whether masculine and feminine grammatical gender elicit qualitatively different brain responses. Forty monolingual Spanish speakers read sentences that were well-formed or contained determiner-noun gender violations. Half of the nouns were masculine and the other half were feminine. Consistent with previous research, brain responses varied along a continuum between LAN- and P600-dominant effects for both gender categories. However, results showed that individuals' ERP response dominance (LAN/P600) systematically differed across the two genders: participants who showed a LAN-dominant response to masculine-noun violations were more likely to show a P600 effect in response to feminine-noun violations. Correlations with individual difference measures further revealed that responses to masculine-noun violations were modulated by performance on the AX-CPT, a measure of cognitive control, whereas responses to feminine-noun violations were modulated by lexical knowledge, as indexed by verbal fluency. Together, the results demonstrate that even when processing features of language that belong to the same "natural class," native speakers can exhibit patterns of brain activity attuned to distributional patterns of language use. The inherent variability in native speaker processing is, therefore, an important factor when explaining purported deviations from the "native norm" reported in other types of populations.
Collapse
Affiliation(s)
- Anne L Beatty-Martínez
- Department of Psychology, McGill University, Montreal, QC, Canada.,Centre for Research on Brain, Language, and Music, Montreal, QC, Canada
| | - Michelle R Bruni
- Department of Psychology, University of California-Riverside, Riverside, CA, USA
| | - María Teresa Bajo
- Department of Experimental Psychology, University of Granada, Granada, Spain.,Mind, Brain and Behavior Research Center, University of Granada, Granada, Spain
| | - Paola E Dussias
- Department of Spanish, Italian and Portuguese, Pennsylvania State University, State College, PA, USA.,Center for Language Science, Pennsylvania State University, State College, PA, USA
| |
Collapse
|
36
|
Augurzky P, Franke M, Ulrich R. Gricean Expectations in Online Sentence Comprehension: An ERP Study on the Processing of Scalar Inferences. Cogn Sci 2020; 43:e12776. [PMID: 31446651 DOI: 10.1111/cogs.12776] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2019] [Revised: 04/21/2019] [Accepted: 05/28/2018] [Indexed: 11/28/2022]
Abstract
There is substantial support for the general idea that a formalization of comprehenders' expectations about the likely next word in a sentence helps explaining data related to online sentence processing. While much research has focused on syntactic, semantic, and discourse expectations, the present event-related potentials (ERPs) study investigates neurolinguistic correlates of pragmatic expectations, which arise when comprehenders expect a sentence to conform to Gricean Maxims of Conversation. For predicting brain responses associated with pragmatic processing, we introduce a formal model of such Gricean pragmatic expectations, using an idealized incremental interpreter. We examine whether pragmatic expectancies derived from this model modulate the amplitude of the N400, a component that has been associated with predictive processing. As part of its parameterization, the model distinguishes genuine pragmatic interpreters, who expect maximally informative true utterances, from literal interpreters, who only expect truthfulness. We explore the model's non-trivial predictions for an experimental setup which uses picture-sentence verification with ERPs recorded at several critical positions in sentences containing the scalar implicature trigger some. We find that Gricean expectations indeed affect the N400, largely in line with the predictions of our model, but also discuss discrepancies between model predictions and observations critically.
Collapse
Affiliation(s)
- Petra Augurzky
- Department of Linguistics, University of Tübingen.,Sonderforschungsbereich 833, University of Tübingen
| | - Michael Franke
- Department of Linguistics, University of Tübingen.,Sonderforschungsbereich 833, University of Tübingen.,Institute of Cognitive Science, University of Osnabrück
| | - Rolf Ulrich
- Sonderforschungsbereich 833, University of Tübingen.,Department of Psychology, University of Tübingen
| |
Collapse
|
37
|
Fedorenko E, Blank IA, Siegelman M, Mineroff Z. Lack of selectivity for syntax relative to word meanings throughout the language network. Cognition 2020; 203:104348. [PMID: 32569894 DOI: 10.1101/477851] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2018] [Revised: 05/14/2020] [Accepted: 05/31/2020] [Indexed: 05/25/2023]
Abstract
To understand what you are reading now, your mind retrieves the meanings of words and constructions from a linguistic knowledge store (lexico-semantic processing) and identifies the relationships among them to construct a complex meaning (syntactic or combinatorial processing). Do these two sets of processes rely on distinct, specialized mechanisms or, rather, share a common pool of resources? Linguistic theorizing, empirical evidence from language acquisition and processing, and computational modeling have jointly painted a picture whereby lexico-semantic and syntactic processing are deeply inter-connected and perhaps not separable. In contrast, many current proposals of the neural architecture of language continue to endorse a view whereby certain brain regions selectively support syntactic/combinatorial processing, although the locus of such "syntactic hub", and its nature, vary across proposals. Here, we searched for selectivity for syntactic over lexico-semantic processing using a powerful individual-subjects fMRI approach across three sentence comprehension paradigms that have been used in prior work to argue for such selectivity: responses to lexico-semantic vs. morpho-syntactic violations (Experiment 1); recovery from neural suppression across pairs of sentences differing in only lexical items vs. only syntactic structure (Experiment 2); and same/different meaning judgments on such sentence pairs (Experiment 3). Across experiments, both lexico-semantic and syntactic conditions elicited robust responses throughout the left fronto-temporal language network. Critically, however, no regions were more strongly engaged by syntactic than lexico-semantic processing, although some regions showed the opposite pattern. Thus, contra many current proposals of the neural architecture of language, syntactic/combinatorial processing is not separable from lexico-semantic processing at the level of brain regions-or even voxel subsets-within the language network, in line with strong integration between these two processes that has been consistently observed in behavioral and computational language research. The results further suggest that the language network may be generally more strongly concerned with meaning than syntactic form, in line with the primary function of language-to share meanings across minds.
Collapse
Affiliation(s)
- Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA.
| | - Idan Asher Blank
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; Department of Psychology, UCLA, Los Angeles, CA 90095, USA
| | - Matthew Siegelman
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; Department of Psychology, Columbia University, New York, NY 10027, USA
| | - Zachary Mineroff
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; Eberly Center for Teaching Excellence & Educational Innovation, CMU, Pittsburgh, PA 15213, USA
| |
Collapse
|
38
|
Fedorenko E, Blank IA, Siegelman M, Mineroff Z. Lack of selectivity for syntax relative to word meanings throughout the language network. Cognition 2020; 203:104348. [PMID: 32569894 PMCID: PMC7483589 DOI: 10.1016/j.cognition.2020.104348] [Citation(s) in RCA: 72] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2018] [Revised: 05/14/2020] [Accepted: 05/31/2020] [Indexed: 12/31/2022]
Abstract
To understand what you are reading now, your mind retrieves the meanings of words and constructions from a linguistic knowledge store (lexico-semantic processing) and identifies the relationships among them to construct a complex meaning (syntactic or combinatorial processing). Do these two sets of processes rely on distinct, specialized mechanisms or, rather, share a common pool of resources? Linguistic theorizing, empirical evidence from language acquisition and processing, and computational modeling have jointly painted a picture whereby lexico-semantic and syntactic processing are deeply inter-connected and perhaps not separable. In contrast, many current proposals of the neural architecture of language continue to endorse a view whereby certain brain regions selectively support syntactic/combinatorial processing, although the locus of such "syntactic hub", and its nature, vary across proposals. Here, we searched for selectivity for syntactic over lexico-semantic processing using a powerful individual-subjects fMRI approach across three sentence comprehension paradigms that have been used in prior work to argue for such selectivity: responses to lexico-semantic vs. morpho-syntactic violations (Experiment 1); recovery from neural suppression across pairs of sentences differing in only lexical items vs. only syntactic structure (Experiment 2); and same/different meaning judgments on such sentence pairs (Experiment 3). Across experiments, both lexico-semantic and syntactic conditions elicited robust responses throughout the left fronto-temporal language network. Critically, however, no regions were more strongly engaged by syntactic than lexico-semantic processing, although some regions showed the opposite pattern. Thus, contra many current proposals of the neural architecture of language, syntactic/combinatorial processing is not separable from lexico-semantic processing at the level of brain regions-or even voxel subsets-within the language network, in line with strong integration between these two processes that has been consistently observed in behavioral and computational language research. The results further suggest that the language network may be generally more strongly concerned with meaning than syntactic form, in line with the primary function of language-to share meanings across minds.
Collapse
Affiliation(s)
- Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA.
| | - Idan Asher Blank
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; Department of Psychology, UCLA, Los Angeles, CA 90095, USA
| | - Matthew Siegelman
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; Department of Psychology, Columbia University, New York, NY 10027, USA
| | - Zachary Mineroff
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; Eberly Center for Teaching Excellence & Educational Innovation, CMU, Pittsburgh, PA 15213, USA
| |
Collapse
|
39
|
Weng YL, Lee CL. Reduced right-hemisphere ERP P600 grammaticality effect is associated with greater right-hemisphere inhibition: Evidence from right-handers with familial sinistrality. Brain Res 2020; 1738:146815. [PMID: 32243986 DOI: 10.1016/j.brainres.2020.146815] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2018] [Revised: 02/29/2020] [Accepted: 03/29/2020] [Indexed: 11/18/2022]
Abstract
The present study examined the hypothesis that left hemisphere (LH) equivalent language capabilities in the right hemisphere (RH) are inhibited in neurologically intact individuals by testing healthy young right-handers with a history of familial sinistrality (FS+, i.e. with at least one left handed biological relative), a population documented to show greater variability for RH language processing. Event-Related Potential (ERP) and split visual field presentation techniques were combined to assess LH- and RH- biased responses to syntactic category violations. In addition, a bilateral flanker task was used to measure inter-hemispheric inhibition ability in the same set of participants. Replicating prior findings, in addition to the LH-biased P600 grammaticality effect previously seen for right-handers in general, a fair amount, though not all, of FS + right-handers showed RH-biased P600 responses, leading to a reliable RH P600 grammaticality effect at the group level. Capitalizing on the variability of RH P600 responses, our results further revealed that reduced RH-biased P600 effects were reliably correlated with more effective RH inhibition (indexed by smaller reaction time differences between incongruent and neutral flankers presented to the RH via the left visual field). These results corroborated previous findings that the RH is capable of processing syntactic information in a manner qualitatively similar to that in the LH and further demonstrated that LH-equivalent processing in the RH as indexed by the P600 responses is modulated by RH inhibition, contributing to inter-individual variability in syntactic lateralization.
Collapse
Affiliation(s)
- Yi-Lun Weng
- Department of Linguistics and Cognitive Science, University of Delaware, USA; Graduate Institute of Linguistics, National Taiwan University, Taiwan
| | - Chia-Lin Lee
- Graduate Institute of Linguistics, National Taiwan University, Taiwan; Department of Psychology, National Taiwan University, Taiwan; Graduate Institute of Brain and Mind Sciences, National Taiwan University, Taiwan; Neurobiology and Cognitive Neuroscience Center, National Taiwan University, Taiwan.
| |
Collapse
|
40
|
Popov S, Miceli G, Ćurčić-Blake B, Bastiaanse R. The role of semantics and repair processes in article-noun gender disagreement in Italian: An ERP study. BRAIN AND LANGUAGE 2020; 206:104787. [PMID: 32244057 DOI: 10.1016/j.bandl.2020.104787] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/12/2019] [Revised: 01/23/2020] [Accepted: 02/27/2020] [Indexed: 06/11/2023]
Abstract
In this sentence reading study, we used event-related potentials (ERPs) to investigate the processing mechanism of article-noun gender disagreement in two kinds of nouns in Italian. The first are nouns with syntactic gender (il trenoM 'train'; la sediaF 'chair') for which the processing and repair of gender disagreement entails only one repair option, namely for the article (morphosyntactic repair). The second kind are nouns with semantic gender (il bambinoM 'boy', la bambinaF 'girl'). Here, there are two options for processing and repairing gender mismatch: repairing the article (morphosyntactic repair) or repairing the noun (both morphosyntactic and semantic repair). Both classes of nouns elicited the LAN, indicating that gender disagreement is always registered at the morphosyntactic level. In addition, the P600 was elicited in both conditions, but was larger for semantic gender, reflecting a more complex repair for this class of nouns.
Collapse
Affiliation(s)
- Srđan Popov
- International Doctorate for Experimental Approaches to Language and Brain (IDEALAB), Universities of Groningen (NL), Newcastle (UK), Potsdam (DE), Trento (IT), Macquarie University (AU); Center for Language and Cognition Groningen, University of Groningen, The Netherlands.
| | - Gabriele Miceli
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Rovereto, Italy; Centro Interdisciplinare 'Beniamino Segre', Accademia dei Lincei, Rome, Italy
| | - Branislava Ćurčić-Blake
- Department of Neuroscience, University of Groningen, University Medical Center Groningen, The Netherlands
| | - Roelien Bastiaanse
- Center for Language and Cognition Groningen, University of Groningen, The Netherlands; Center for Language and Brain, National Research University Higher School of Economics, Russian Federation
| |
Collapse
|
41
|
Kyriaki L, Schlesewsky M, Bornkessel-Schlesewsky I. Semantic reversal anomalies under the microscope: Task and modality influences on language-associated event-related potentials. Eur J Neurosci 2020; 52:3803-3827. [PMID: 32537795 DOI: 10.1111/ejn.14862] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2020] [Revised: 05/22/2020] [Accepted: 05/30/2020] [Indexed: 11/26/2022]
Abstract
Semantic reversal anomalies (SRAs)-sentences where an implausibility is created by reversing participant roles-have attracted much attention in the literature on the electrophysiology of language. In spite of being syntactically well formed but semantically implausible, these sentences unexpectedly elicited a monophasic P600 effect in English and Dutch rather than an N400 effect. Subsequent research revealed variability in the presence/absence of an N400 effect to SRAs depending on the language examined and the choice of verb type in English. However, most previous studies employed the same presentation modality (visual) and task (acceptability judgement). Here, we conducted two experiments and three statistical analyses to investigate the influence of stimulus modality, task demand and statistical choices on event-related potential (ERP) response patterns to SRAs in English. We reproduced a previous study's procedure and analysis (N. Bourguignon et al. (2012) Brain and Language, 122, 179-189) and further introduced between-subjects factors of task type and modality, using mixed-effects modelling to analyse the data. We observed an N400 effect to typical English SRAs (agent subject verbs, e.g. "the fries will eat the boys"), which contrasts existing literature and was not predicted by existing theories that account for SRA processing. Task demand modulated the ERPs elicited by SRAs, while auditory presentation led to increased comprehension accuracy and a more broadly distributed ERP. Finally, the statistical methods used influenced the presence/absence of ERP effects. Our results suggest a sensitivity of language-related ERP patterns to methodological parameters, and we conclude that future experiments should take this into careful consideration.
Collapse
Affiliation(s)
- Louise Kyriaki
- Cognitive and Systems Neuroscience Research Hub, University of South Australia, Adelaide, SA, Australia
| | - Matthias Schlesewsky
- Cognitive and Systems Neuroscience Research Hub, University of South Australia, Adelaide, SA, Australia
| | | |
Collapse
|
42
|
Fromont LA, Royle P, Steinhauer K. Growing Random Forests reveals that exposure and proficiency best account for individual variability in L2 (and L1) brain potentials for syntax and semantics. BRAIN AND LANGUAGE 2020; 204:104770. [PMID: 32114146 DOI: 10.1016/j.bandl.2020.104770] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/14/2019] [Revised: 01/18/2020] [Accepted: 02/01/2020] [Indexed: 06/10/2023]
Abstract
Late second language (L2) learners report difficulties in specific linguistic areas such as syntactic processing, presumably because brain plasticity declines with age (following the critical period hypothesis). While there is also evidence that L2 learners can achieve native-like online-processing with sufficient proficiency (following the convergence hypothesis), considering multiple mediating factors and their impact on language processing has proven challenging. We recorded EEG while native (n = 36) and L2-speakers of French (n = 40) read sentences that were either well-formed or contained a syntactic-category error. a lexical-semantic anomaly, or both. Consistent with the critical period hypothesis, group differences revealed that while native speakers elicited a biphasic N400-P600 in response to ungrammatical sentences, L2 learners as a group only elicited an N400. However, individual data modeling using a Random Forests approach revealed that language exposure and proficiency are the most reliable predictors in explaining ERP responses, with N400 and P600 effects becoming larger as exposure to French as well as proficiency increased, as predicted by the convergence hypothesis.
Collapse
Affiliation(s)
- Lauren A Fromont
- École d'orthophonie et d'audiologie Université de Montréal, Montréal, Canada; Centre for Research on Brain, Language and Music, Montreal, Canada.
| | - Phaedra Royle
- École d'orthophonie et d'audiologie Université de Montréal, Montréal, Canada; Centre for Research on Brain, Language and Music, Montreal, Canada.
| | - Karsten Steinhauer
- Centre for Research on Brain, Language and Music, Montreal, Canada; School of Communication Sciences and Disorders, McGill University, Montreal, Canada.
| |
Collapse
|
43
|
Goregliad Fjaellingsdal T, Schwenke D, Scherbaum S, Kuhlen AK, Bögels S, Meekes J, Bleichner MG. Expectancy effects in the EEG during joint and spontaneous word-by-word sentence production in German. Sci Rep 2020; 10:5460. [PMID: 32214133 PMCID: PMC7096441 DOI: 10.1038/s41598-020-62155-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2019] [Accepted: 03/10/2020] [Indexed: 11/13/2022] Open
Abstract
Our aim in the present study is to measure neural correlates during spontaneous interactive sentence production. We present a novel approach using the word-by-word technique from improvisational theatre, in which two speakers jointly produce one sentence. This paradigm allows the assessment of behavioural aspects, such as turn-times, and electrophysiological responses, such as event-related-potentials (ERPs). Twenty-five participants constructed a cued but spontaneous four-word German sentence together with a confederate, taking turns for each word of the sentence. In 30% of the trials, the confederate uttered an unexpected gender-marked article. To complete the sentence in a meaningful way, the participant had to detect the violation and retrieve and utter a new fitting response. We found significant increases in response times after unexpected words and - despite allowing unscripted language production and naturally varying speech material - successfully detected significant N400 and P600 ERP effects for the unexpected word. The N400 EEG activity further significantly predicted the response time of the subsequent turn. Our results show that combining behavioural and neuroscientific measures of verbal interactions while retaining sufficient experimental control is possible, and that this combination provides promising insights into the mechanisms of spontaneous spoken dialogue.
Collapse
Affiliation(s)
| | - Diana Schwenke
- Department of Psychology, Technische Universität Dresden, Dresden, Germany
| | - Stefan Scherbaum
- Department of Psychology, Technische Universität Dresden, Dresden, Germany
| | - Anna K Kuhlen
- Institute of Psychology, Humboldt-Universität zu Berlin, Berlin, Germany
| | - Sara Bögels
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - Joost Meekes
- Department of Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
| | - Martin G Bleichner
- Department of Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
- Cluster of Excellence Hearing4all, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
44
|
Goregliad Fjaellingsdal T, Schwenke D, Ruigendijk E, Scherbaum S, Bleichner MG. Studying brain activity during word-by-word interactions using wireless EEG. PLoS One 2020; 15:e0230280. [PMID: 32208429 PMCID: PMC7092963 DOI: 10.1371/journal.pone.0230280] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2019] [Accepted: 02/26/2020] [Indexed: 11/19/2022] Open
Abstract
We introduce here the word-by-word paradigm, a dynamic setting, in which two people take turns in producing a single sentence. This task requires a high degree of coordination between the partners and the simplicity of the task allows us to study with sufficient experimental control behavioral and neural processes that underlie this controlled interaction. For this study, 13 pairs of individuals engaged in a scripted word-by-word interaction, while we recorded the neural activity of both participants simultaneously using wireless EEG. To study expectation building, different semantic contexts were primed for each participant. Semantically unexpected continuations were introduced in 25% of all sentences. In line with the hypothesis, we observed amplitude differences for the P200-N400-P600 ERPs for unexpected compared to expected words. Moreover, we could successfully assess speech and reaction times. Our results show that it is possible to measure ERPs and RTs to semantically unexpected words in a dyadic interactive scenario.
Collapse
Affiliation(s)
| | - Diana Schwenke
- Department of Psychology, Technische Universität Dresden, Dresden, Germany
| | - Esther Ruigendijk
- Cluster of Excellence Hearing4all, University of Oldenburg, Oldenburg, Germany
- Department of Dutch, University of Oldenburg, Oldenburg, Germany
| | - Stefan Scherbaum
- Department of Psychology, Technische Universität Dresden, Dresden, Germany
| | - Martin Georg Bleichner
- Department of Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
- Cluster of Excellence Hearing4all, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
45
|
Jiang X, Zhou X. An alternative structure rescues failed semantics? Strong global expectancy reduces local-mismatch N400 in Chinese flexible structures. Neuropsychologia 2020; 140:107380. [PMID: 32087203 DOI: 10.1016/j.neuropsychologia.2020.107380] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2019] [Revised: 02/04/2020] [Accepted: 02/05/2020] [Indexed: 01/08/2023]
Abstract
During comprehension of a hierarchical structure, semantic integration between sequential, mismatched sentential constituents does not proceed when the later word in the sequence (e.g., the noun in the verb + classifier + noun) can be assigned an alternative role in the sentence (e.g., as a modifier of a subsequent object noun) (Zhang et al., 2011). Using electrophysiological measures, we examined how the availability of an alternative structure and whether the reader is motivated to generate an alternative structure affect semantic integration in a hierarchical structure. The same set of sentences was employed in three experiments in which the semantic congruency between the adjective and the object noun in the local structure and the sentential-contextual expectancy towards a noun were manipulated simultaneously. The reader's motivation was manipulated by tasks in which they made semantic acceptability judgment (Experiment 1), passively viewed sentences for comprehension (Experiment 2), or actively predicted the upcoming word and monitored the compatibility between the anticipated and the actual input (Experiment 3). Stronger contextual expectancy reduced N400 responses to the object noun regardless of semantic congruency, indicating that strengthening the constraints of an alternative argument decreased the effort of semantic integration between incompatible local constituents. Relative to weaker expectancy, the incongruent noun preceded by a stronger expectancy context elicited reduced N400 responses when no active prediction was demanded but showed equal amplitudes when such a demand was high. These findings demonstrate that the semantic failure in a flexible structure is likely to be resolved by the comprehender's motivation to generate an alternative structure based on the active use of contextual expectancy information, thus highlighting the "role-dependent semantic processing" during sentence comprehension.
Collapse
Affiliation(s)
- Xiaoming Jiang
- Institute of Linguistics, Shanghai International Studies University, Shanghai, China; Department of Psychology, Tongji University, Shanghai, China; School of Psychological and Cognitive Sciences, Peking University, Beijing, China
| | - Xiaolin Zhou
- Institute of Linguistics, Shanghai International Studies University, Shanghai, China; Department of Psychology, Tongji University, Shanghai, China; School of Psychological and Cognitive Sciences, Peking University, Beijing, China; Beijing Key Laboratory of Behavior and Mental Health, Peking University, Beijing, China; PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, China.
| |
Collapse
|
46
|
Fromont LA, Steinhauer K, Royle P. Verbing nouns and nouning verbs: Using a balanced design provides ERP evidence against "syntax-first" approaches to sentence processing. PLoS One 2020; 15:e0229169. [PMID: 32168357 PMCID: PMC7069651 DOI: 10.1371/journal.pone.0229169] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2019] [Accepted: 01/31/2020] [Indexed: 11/23/2022] Open
Abstract
In this event-related potential (ERP) study we reevaluate syntax-first approaches to sentence processing by implementing a novel paradigm in French that includes correct sentences, pure syntactic category violations, lexical-semantic anomalies, and combined anomalies. Our balanced design systematically controlled for target word (noun vs. verb) and the context immediately preceding it. Group results from 36 native speakers of Quebec French revealed that, up to 300 ms, ERPs elicited by syntactic category violations were comparable with ERP responses to correct sentences, showing that there is no early activation reflecting syntactic category identification. Instead, in response to all anomalous conditions, we observed an N400 followed by a P600. Combined anomalies yielded additive effects of syntactic category and lexical-semantic anomalies on the N400, and a large P600 effect similar to the one observed in the pure syntactic condition. These results provide strong evidence against the hypothesis that (i) syntactic categories are processed first, and (ii) that syntactic category errors "block" lexical-semantic processing. Further, the N400 effect in response to pure syntactic category violations reflects a mismatch detection between a predicted word-stem and the actual target. This mechanism takes place simultaneously (and potentially in parallel) with lexical-semantic processing. In contrast, an interaction of syntax and semantics for the P600 reveals that the same neurocognitive resources are recruited for syntactic and semantic integration, both promoted by the implementation of an acceptability judgement task in our design. Additional analyses of individual data complemented these observations: during sentence processing, participants did not rely on one single cognitive mechanism reflected by either the N400 or the P600 effect but on both, suggesting that the biphasic N400-P600 ERP wave can indeed be considered to be an index of phrase-structure violations in most individuals, at least if they are realized on content words.
Collapse
Affiliation(s)
- Lauren A Fromont
- École d'orthophonie et d'audiologie, Université de Montréal, Montréal, Canada
- Centre for Research on Brain, Language and Music, Montreal, Canada
| | - Karsten Steinhauer
- Centre for Research on Brain, Language and Music, Montreal, Canada
- School of Communication Sciences and Disorders, McGill University, Montreal, Canada
| | - Phaedra Royle
- École d'orthophonie et d'audiologie, Université de Montréal, Montréal, Canada
- Centre for Research on Brain, Language and Music, Montreal, Canada
| |
Collapse
|
47
|
Dijkstra KV, Farquhar JDR, Desain PWM. The N400 for brain computer interfacing: complexities and opportunities. J Neural Eng 2020; 17:022001. [PMID: 31986492 DOI: 10.1088/1741-2552/ab702e] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
The N400 is an event related potential that is evoked in response to conceptually meaningful stimuli. It is for instance more negative in response to incongruent than congruent words in a sentence, and more negative for unrelated than related words following a prime word. This sensitivity to semantic content of a stimulus in relation to the mental context of an individual makes it a signal of interest for Brain Computer Interfaces. A complicating aspect is the number of factors that can affect the N400 amplitude. In this paper, we provide an accessible overview of this range of N400 effects, and survey the three main BCI application areas that currently exploit the N400: (1) exploiting the semantic processing of faces to enhance matrix speller performance, (2) detecting language processing in patients with Disorders of Consciousness, and (3) using semantic stimuli to probe what is on a user's mind. Drawing on studies from these application areas, we illustrate that the N400 can successfully be exploited for BCI purposes, but that the signal-to-noise ratio is a limiting factor, with signal strength also varying strongly across subjects. Furthermore, we put findings in context of the general N400 literature, noting open questions and identifying opportunities for further research.
Collapse
Affiliation(s)
- K V Dijkstra
- Author to whom any correspondence should be addressed
| | | | | |
Collapse
|
48
|
Strauss M, Dehaene S. Detection of arithmetic violations during sleep. Sleep 2020; 42:5209361. [PMID: 30476318 DOI: 10.1093/sleep/zsy232] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2018] [Revised: 10/07/2018] [Accepted: 11/23/2018] [Indexed: 12/31/2022] Open
Abstract
Can the sleeping brain develop predictions of future auditory stimuli? Past research demonstrated disrupted prediction capabilities during sleep in the context of novel, arbitrary auditory sequences, but the availability of overlearned knowledge already stored in long-term memory could still be preserved. We tested the sleeping brain capabilities to detect violations of simple arithmetic facts. Sleeping participants were presented with spoken arithmetic facts such as "two plus two is nine" and brain responses to correct or incorrect results were recorded in electro and magneto-encephalography. Sleep responses were compared to both attentive and inattentive wakefulness. During attentive wakefulness, arithmetic violations elicited a succession of N400 and P600 effects, whereas no such activations could be recorded in sleep or in inattentive wakefulness. Still, small but significant effects remained in sleep, advocating for a preserved but partial accessibility to arithmetic facts stored in long-term memory and preserved predictions of low-level and already learned knowledge. Those effects were very different from residual activities seen in inattention, highlighting the differences of information processing between the sleeping and the inattentive brain.
Collapse
Affiliation(s)
- Mélanie Strauss
- Cognitive Neuroimaging Unit, CEA DSV/I2BM, INSERM, NeuroSpin Center, Université Paris-Sud, Université Paris-Saclay, Gif-sur-Yvette, France.,Université Paris Descartes, Sorbonne Paris Cité, APHP, Hôtel-Dieu de Paris, Centre du Sommeil et de la Vigilance, VIFASOM Sommeil-Vigilance-Fatigue et Santé Publique, Paris, France.,Neuropsychology and Functional Imaging Research Group, Center for Research in Cognition and Neurosciences, Université Libre de Bruxelles, Brussels, Belgium
| | - Stanislas Dehaene
- Cognitive Neuroimaging Unit, CEA DSV/I2BM, INSERM, NeuroSpin Center, Université Paris-Sud, Université Paris-Saclay, Gif-sur-Yvette, France.,Collège de France, Paris, France
| |
Collapse
|
49
|
Bornkessel-Schlesewsky I, Roehm D, Mailhammer R, Schlesewsky M. Language Processing as a Precursor to Language Change: Evidence From Icelandic. Front Psychol 2020; 10:3013. [PMID: 32010032 PMCID: PMC6978737 DOI: 10.3389/fpsyg.2019.03013] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2019] [Accepted: 12/19/2019] [Indexed: 11/30/2022] Open
Abstract
One of the main characteristics of human languages is that they are subject to fundamental changes over time. However, because of the long transitional periods involved, the internal dynamics of such changes are typically inaccessible. Here, we present a new approach to examining language change via its connection to language comprehension. By means of an EEG experiment on Icelandic, a prominent current example of a language in transition, we show that the neurophysiological responses of native speakers already reflect projected changes that are not yet apparent in their overt behavior. Neurocognitive measures thus offer a means of predicting, rather than only retracing, language change.
Collapse
Affiliation(s)
- Ina Bornkessel-Schlesewsky
- Cognitive and Systems Neuroscience Research Hub, University of South Australia, Adelaide, SA, Australia.,School of Psychology, Social Work and Social Policy, University of South Australia, Adelaide, SA, Australia
| | - Dietmar Roehm
- Centre for Cognitive Neuroscience, University of Salzburg, Salzburg, Austria.,Department of Linguistics, University of Salzburg, Salzburg, Austria
| | - Robert Mailhammer
- School of Humanities and Communication Arts, Western Sydney University, Penrith, NSW, Australia.,The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, Australia
| | - Matthias Schlesewsky
- Cognitive and Systems Neuroscience Research Hub, University of South Australia, Adelaide, SA, Australia.,School of Psychology, Social Work and Social Policy, University of South Australia, Adelaide, SA, Australia
| |
Collapse
|
50
|
Kuperberg GR, Brothers T, Wlotko EW. A Tale of Two Positivities and the N400: Distinct Neural Signatures Are Evoked by Confirmed and Violated Predictions at Different Levels of Representation. J Cogn Neurosci 2020; 32:12-35. [PMID: 31479347 PMCID: PMC7299186 DOI: 10.1162/jocn_a_01465] [Citation(s) in RCA: 87] [Impact Index Per Article: 21.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
It has been proposed that hierarchical prediction is a fundamental computational principle underlying neurocognitive processing. Here, we ask whether the brain engages distinct neurocognitive mechanisms in response to inputs that fulfill versus violate strong predictions at different levels of representation during language comprehension. Participants read three-sentence scenarios in which the third sentence constrained for a broad event structure, for example, {Agent caution animate-Patient}. High constraint contexts additionally constrained for a specific event/lexical item, for example, a two-sentence context about a beach, lifeguards, and sharks constrained for the event, {Lifeguards cautioned Swimmers}, and the specific lexical item swimmers. Low constraint contexts did not constrain for any specific event/lexical item. We measured ERPs on critical nouns that fulfilled and/or violated each of these constraints. We found clear, dissociable effects to fulfilled semantic predictions (a reduced N400), to event/lexical prediction violations (an increased late frontal positivity), and to event structure/animacy prediction violations (an increased late posterior positivity/P600). We argue that the late frontal positivity reflects a large change in activity associated with successfully updating the comprehender's current situation model with new unpredicted information. We suggest that the late posterior positivity/P600 is triggered when the comprehender detects a conflict between the input and her model of the communicator and communicative environment. This leads to an initial failure to incorporate the unpredicted input into the situation model, which may be followed by second-pass attempts to make sense of the discourse through reanalysis, repair, or reinterpretation. Together, these findings provide strong evidence that confirmed and violated predictions at different levels of representation manifest as distinct spatiotemporal neural signatures.
Collapse
Affiliation(s)
- Gina R. Kuperberg
- Department of Psychology, Tufts University, Medford, MA USA
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Boston, MA USA
| | - Trevor Brothers
- Department of Psychology, Tufts University, Medford, MA USA
- Department of Psychiatry and the Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Boston, MA USA
| | - Edward W. Wlotko
- Department of Psychology, Tufts University, Medford, MA USA
- Moss Rehabilitation Research Institute, Elkins Park, PA USA
| |
Collapse
|