1
|
James AN, Minnihan CJ, Watson DG. Correction: Language Experience Predicts Eye Movements During Online Auditory Comprehension. J Cogn 2024; 7:29. [PMID: 38405635 PMCID: PMC10885832 DOI: 10.5334/joc.354] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2024] [Accepted: 02/09/2024] [Indexed: 02/27/2024] Open
Abstract
[This corrects the article DOI: 10.5334/joc.285.].
Collapse
Affiliation(s)
- Ariel N. James
- Department of Psychology, Macalester College, United States
| | | | - Duane G. Watson
- Department of Psychology and Human Development, Peabody College, Vanderbilt University, United States
| |
Collapse
|
2
|
Darzhinova L, Luk ZPS. Processing and Comprehension of Locally Ambiguous Participial Relative Clause Sentences in Russian. J Psycholinguist Res 2024; 53:15. [PMID: 38381228 PMCID: PMC10881615 DOI: 10.1007/s10936-024-10041-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 11/27/2023] [Indexed: 02/22/2024]
Abstract
The study tested how the Recency Preference and Predicate Proximity model (Gibson et al. in Cognition 59(1):23-59, 1996, https://doi.org/10.1016/0010-0277(88)90004-2 ) plays out by examining the attachment preferences of native Russian speakers when processing locally ambiguous participial relative clause sentences with three potential NP attachment sites in Russian. Using a self-paced reading task, reading times and noun phrase selection responses were collected. Results showed significantly shorter reading times at the disambiguating region and higher accuracy rate of selection in the high-attaching condition than in the middle- and low-attaching conditions. No significant differences were found between the middle- and low-attaching conditions. We argue that Predicate Proximity is a much stronger factor than Recency Preference in Russian.
Collapse
Affiliation(s)
- Liubov Darzhinova
- Department of English Language Education, Faculty of Humanities, The Education University of Hong Kong, 10 Lo Ping Road, Tai Po, New Territories, Hong Kong, China.
| | - Zoe Pei-Sui Luk
- Department of Linguistics and Modern Language Studies, Faculty of Humanities, The Education University of Hong Kong, Hong Kong, China
| |
Collapse
|
3
|
Zhan M, Chen S, Levy R, Lu J, Gibson E. Rational Sentence Interpretation in Mandarin Chinese. Cogn Sci 2023; 47:e13383. [PMID: 38073607 DOI: 10.1111/cogs.13383] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 11/03/2023] [Accepted: 11/08/2023] [Indexed: 12/18/2023]
Abstract
Previous work has shown that English native speakers interpret sentences as predicted by a noisy-channel model: They integrate both the real-world plausibility of the meaning-the prior-and the likelihood that the intended sentence may be corrupted into the perceived sentence. In this study, we test the noisy-channel model in Mandarin Chinese, a language taxonomically different from English. We present native Mandarin speakers sentences in a written modality (Experiment 1) and an auditory modality (Experiment 2) in three pairs of syntactic alternations. The critical materials are literally implausible but require differing numbers and types of edits in order to form more plausible sentences. Each sentence is followed by a comprehension question that allows us to infer whether the speakers interpreted the item literally, or made an inference toward a more likely meaning. Similar to previous research on related English constructions, Mandarin participants made the most inferences for implausible materials that could be inferred as plausible by deleting a single morpheme or inserting a single morpheme. Participants were less likely to infer a plausible meaning for materials that could be inferred as plausible by making an exchange across a preposition. And participants were least likely to infer a plausible meaning for materials that could be inferred as plausible by making an exchange across a main verb. Moreover, we found more inferences in written materials than spoken materials, possibly a result of a lack of word boundaries in written Chinese. Overall, the fact that the results were so similar to those found in related constructions in English suggests that the noisy-channel proposal is robust.
Collapse
Affiliation(s)
- Meilin Zhan
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology
| | - Sihan Chen
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology
| | - Roger Levy
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology
| | - Jiayi Lu
- Department of Linguistics, Stanford University
| | - Edward Gibson
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology
| |
Collapse
|
4
|
Tung TY, Brennan JR. Expectations modulate retrieval interference during ellipsis resolution. Neuropsychologia 2023; 190:108680. [PMID: 37739260 DOI: 10.1016/j.neuropsychologia.2023.108680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2023] [Revised: 09/01/2023] [Accepted: 09/07/2023] [Indexed: 09/24/2023]
Abstract
Memory operations during language comprehension are subject to interference: retrieval is harder when items are linguistically similar to each other. We test how such interference effects might be modulated by linguistic expectations. Theories differ in how these factors might interact; we consider three possibilities: (i) predictability determines the need for retrieval, (ii) predictability affects cue-preference during retrieval, or (iii) word predictability moderates the effect of noise in memory during retrieval. We first demonstrate that expectations for a target word modulate retrieval interference in Mandarin noun-phrase ellipsis in an electroencephalography (EEG) experiment. This result obtains in globally ungrammatical sentences - termed "facilitatory interference." Such a pattern is inconsistent with theories that focus only on the need for retrieval. To tease apart cue-preferences from noisy-memory representations, we operationalize the latter using a Transformer neural network language model. Confronting the model with our stimuli reveals an interference effect, consistent with prior work, but that effect does not interact with predictability in contrast to human EEG results. Together, these data are most consistent with the hypothesis that the predictability of target items affects cue-preferences during retrieval.
Collapse
Affiliation(s)
- Tzu-Yun Tung
- Department of Linguistics, University of Michigan, Ann Arbor, MI, USA.
| | | |
Collapse
|
5
|
El Ouardi L, Yeou M, Faroqi-Shah Y. Neural correlates of pronoun processing: An activation likelihood estimation meta-analysis. Brain Lang 2023; 246:105347. [PMID: 37847932 DOI: 10.1016/j.bandl.2023.105347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Revised: 08/30/2023] [Accepted: 10/10/2023] [Indexed: 10/19/2023]
Abstract
Pronouns are unique linguistic devices that allow for the expression of referential relationships. Despite their communicative utility, the neural correlates of the operations involved in reference assignment and/or resolution, are not well-understood. The present study synthesized the neuroimaging literature on pronoun processing to test extant theories of pronoun comprehension. Following the PRISMA guidelines and thebest-practice recommendations for neuroimaging meta-analyses, a systematic literature search and record assessment were performed. As a result, 16 fMRI studies were included in the meta-analysis, and were coded in Scribe 3.6 for inclusion in the BrainMap database. The activation coordinates for the contrasts of interest were transformed into Talairach space and submitted to an Activation Likelihood Estimation (ALE) meta-analysis in GingerALE 3.0.1. The results indicated that pronoun processing had functional convergence in the left posterior middle and superior temporal gyri, potentially reflecting the retrieval, prediction and integration roles of these areas for pronoun processing.
Collapse
Affiliation(s)
- Loubna El Ouardi
- Department of Hearing and Speech Sciences, University of Maryland, College Park, Maryland, United States; Applied Language and Culture Studies Laboratory, Chouaib Doukkali University, El Jadida, Morocco.
| | - Mohamed Yeou
- Applied Language and Culture Studies Laboratory, Chouaib Doukkali University, El Jadida, Morocco
| | - Yasmeen Faroqi-Shah
- Department of Hearing and Speech Sciences, University of Maryland, College Park, Maryland, United States
| |
Collapse
|
6
|
Akhavan N, Blumenfeld HK, Shapiro L, Love T. Using lexical semantic cues to mitigate interference effects during real-time sentence processing in aphasia. J Neurolinguistics 2023; 68:101159. [PMID: 37946740 PMCID: PMC10634522 DOI: 10.1016/j.jneuroling.2023.101159] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/12/2023]
Abstract
We examined the auditory sentence processing of neurologically unimpaired listeners and individuals with aphasia on canonical sentence structures in real-time using a visual-world eye-tracking paradigm. The canonical sentence constructions contained multiple noun phrases and an unaccusative verb, the latter of which formed a long-distance dependency link between the unaccusative verb and its single argument (which was base generated in the object position and then displaced to the subject position). To explore the likelihood of similarity-based interference during the real time linking of the verb and the sentence's subject noun, we manipulated the animacy feature of the noun phrases (matched or mismatched). The study's objectives were to examine whether (a) reducing the similarity-based interference by mismatching animacy features would modulate the encoding and retrieval dynamics of noun phrases in real-time; and (b) whether individuals with aphasia would demonstrate on time sensitivity to this lexical-semantic cue. Results revealed a significant effect of this manipulation in individuals both with and without aphasia. In other words, the mismatch in the representational features of the noun phrases increased the distinctiveness of the unaccusative verb's subject target at the time of syntactic retrieval (verb offset) for individuals in both groups. Moreover, individuals with aphasia were shown to be sensitive to the lexical-semantic cue, even though they appeared to process it slower than unimpaired listeners. This study extends to the cue-based retrieval model by providing new insight on the real-time mechanisms underpinning sentence comprehension.
Collapse
Affiliation(s)
- Niloofar Akhavan
- School of Speech, Language, and Hearing Sciences, San Diego State University, San Diego, CA, USA
- Joint Doctoral Program in Language and Communicative Disorders, San Diego State University/UC San Diego, San Diego, CA, USA
| | - Henrike K. Blumenfeld
- School of Speech, Language, and Hearing Sciences, San Diego State University, San Diego, CA, USA
- Joint Doctoral Program in Language and Communicative Disorders, San Diego State University/UC San Diego, San Diego, CA, USA
| | - Lewis Shapiro
- School of Speech, Language, and Hearing Sciences, San Diego State University, San Diego, CA, USA
- Joint Doctoral Program in Language and Communicative Disorders, San Diego State University/UC San Diego, San Diego, CA, USA
| | - Tracy Love
- School of Speech, Language, and Hearing Sciences, San Diego State University, San Diego, CA, USA
- Joint Doctoral Program in Language and Communicative Disorders, San Diego State University/UC San Diego, San Diego, CA, USA
| |
Collapse
|
7
|
Kim J, Wessel JR, Hendrickson K. Inhibition of lexical representations after violated semantic predictions. Cognition 2023; 240:105585. [PMID: 37556941 DOI: 10.1016/j.cognition.2023.105585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Revised: 07/21/2023] [Accepted: 07/31/2023] [Indexed: 08/11/2023]
Abstract
There is a consensus that humans predict upcoming words during sentence processing. Prediction makes language comprehension fast and efficient if this anticipatory processing is accurate. However, often times, predictions are not correct. There is a lack of research investigating the cognitive operations at play when predictions are violated. According to several proposals, such violations lead to an inhibition of the predicted word to facilitate the integration of the unexpected word. Across four experiments, we have tested whether predicted words are indeed inhibited when listeners encounter unexpected stimuli, and whether the linguistic status (word or sound) and semantic congruency of a word (plausible or implausible) influences this purported inhibitory process. Using a Cross-Modal Lexical Priming paradigm, we showed that when predictions are violated, the activation of the predicted word is inhibited, resulting in increased reaction times. These inhibitory effects appear to be language specific, in that they are only observed after unexpected words, as opposed to non-linguistic sounds (tones). However, contrary to a long-held assumption in the field of sentence processing, inhibitory effects are not modulated by the semantic congruency of the unexpected word (i.e., whether the unexpected word is plausible within the sentence context). Indeed, in the current study, any linguistic information that violated listeners' semantic prediction resulted in the inhibition of the predicted word. Thus, the current findings are more compatible with a view in which unexpected linguistic events that are meaningful engage inhibitory processes with the specific purpose of inhibiting the predicted, though out-of-date, word.
Collapse
Affiliation(s)
- Jina Kim
- Department of Communication Sciences and Disorders, University of Iowa, 250 Hawkins Drive, 52242 Iowa City, IA, USA.
| | - Jan R Wessel
- Department of Psychological and Brain Sciences, University of Iowa, 376 Psychological and Brain Sciences Building, 340 Iowa Avenue, 52240, Iowa City, IA, USA; Department of Neurology, University of Iowa Hospitals and Clinics, 250 Hawkins Drive, 52242, Iowa City, IA, USA.
| | - Kristi Hendrickson
- Department of Communication Sciences and Disorders, University of Iowa, 250 Hawkins Drive, 52242 Iowa City, IA, USA.
| |
Collapse
|
8
|
Pulido MF, López-Beltrán P. When Native Speakers Are Not "Native-Like:" Chunking Ability Predicts (Lack of) Sensitivity to Gender Agreement During Online Processing. Cogn Sci 2023; 47:e13366. [PMID: 37867346 DOI: 10.1111/cogs.13366] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2022] [Revised: 07/24/2023] [Accepted: 09/29/2023] [Indexed: 10/24/2023]
Abstract
Previous work on individual differences has revealed limitations in the ability of existing measures (e.g., working memory) to predict language processing. Recent evidence suggests that an individual's sensitivity to detect the statistical regularities present in language (i.e., "chunk sensitivity") may significantly modulate online sentence processing. We investigated whether individual chunk sensitivity predicted the online processing of gender cues, a core linguistic feature of Spanish. In a self-paced reading task, we examined native speakers' processing of relative clauses in which gender cues were variably exploited to induce processing costs. Even after considering the effect of working memory and cognitive control, the results revealed a significant effect of chunking ability in modulating online sentence processing. Critically, higher-chunking ability speakers' reading times showed online sensitivity to core linguistic cues online; while low-chunking ability readers showed no sensitivity to manipulations, indicating shallow real-time processing of their native language.
Collapse
Affiliation(s)
- Manuel F Pulido
- Department of Spanish, Italian and Portuguese, Center for Language Science, The Pennsylvania State University
| | - Priscila López-Beltrán
- Department of Spanish, Italian and Portuguese, Center for Language Science, The Pennsylvania State University
| |
Collapse
|
9
|
Frade S, Santi A, Raposo A. Filling the gap: Cloze probability and sentence constraint norms for 807 European Portuguese sentences. Behav Res Methods 2023:10.3758/s13428-023-02196-0. [PMID: 37553535 DOI: 10.3758/s13428-023-02196-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/10/2023] [Indexed: 08/10/2023]
Abstract
Sentence processing is affected by the sentence context and word expectancy. To investigate sentence comprehension experimentally, it is useful to have sentence completion norms with both context constraint and word expectancy measures. In this study, two experiments were conducted to collect norms for completion of 807 European Portuguese sentences. Context constraint was measured through type-token ratio and proportion idiosyncratic responses, while word expectancy was assessed by cloze probability. Besides establishing norms for a large sample of sentences, the study investigated the impact of the production procedure and method of analysis. In Experiment 1, a single-production procedure was used, i.e., participants completed each sentence fragment with only a single response, whereas in Experiment 2, a multiple-production procedure was used, i.e., participants have to provide up to three completion words for each sentence fragment. In Experiment 2, the analyses were obtained using two distinct methods: first-response analysis and combined-response analysis. The results showed that cloze and context measures are comparable between production paradigms and that the results from both analysis methods were correlated. The advantages of each production procedure and analysis method are discussed.
Collapse
Affiliation(s)
- Sofia Frade
- Iscte-Instituto Universitário de Lisboa, CIS-Iscte, Lisboa, Portugal.
- Research Center for Psychological Science, Faculdade de Psicologia, Universidade de Lisboa, Lisboa, Portugal.
| | - Andrea Santi
- Department of Linguistics, University College London, London, UK
| | - Ana Raposo
- Research Center for Psychological Science, Faculdade de Psicologia, Universidade de Lisboa, Lisboa, Portugal
| |
Collapse
|
10
|
Prystauka Y, Altmann GTM, Rothman J. Online eye tracking and real-time sentence processing: On opportunities and efficacy for capturing psycholinguistic effects of different magnitudes and diversity. Behav Res Methods 2023:10.3758/s13428-023-02176-4. [PMID: 37528290 DOI: 10.3758/s13428-023-02176-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/15/2023] [Indexed: 08/03/2023]
Abstract
Online research methods have the potential to facilitate equitable accessibility to otherwise-expensive research resources, as well as to more diverse populations and language combinations than currently populate our studies. In psycholinguistics specifically, webcam-based eye tracking is emerging as a powerful online tool capable of capturing sentence processing effects in real time. The present paper asks whether webcam-based eye tracking provides the necessary granularity to replicate effects-crucially both large and small-that tracker-based eye tracking has shown. Using the Gorilla Experiment Builder platform, this study set out to replicate two psycholinguistic effects: a robust one, the verb semantic constraint effect, first reported in Altmann and Kamide, Cognition 73(3), 247-264 (1999), and a smaller one, the lexical interference effect, first examined by Kukona et al. Journal of Experimental Psychology: Learning, Memory, and Cognition, 40(2), 326 (2014). Webcam-based eye tracking was able to replicate both effects, thus showing that its functionality is not limited to large effects. Moreover, the paper also reports two approaches to computing statistical power and discusses the differences in their outputs. Beyond discussing several important methodological, theoretical, and practical implications, we offer some further technical details and advice on how to implement webcam-based eye-tracking studies. We believe that the advent of webcam-based eye tracking, at least in respect of the visual world paradigm, will kickstart a new wave of more diverse studies with more diverse populations.
Collapse
Affiliation(s)
- Yanina Prystauka
- Department of Language and Culture, UiT The Arctic University of Norway, Tromsø, Norway.
| | - Gerry T M Altmann
- Department of Psychological Sciences, University of Connecticut, Storrs, CT, USA
| | - Jason Rothman
- Department of Language and Culture, UiT The Arctic University of Norway, Tromsø, Norway
- Centro de Investigación Nebrija en Cognición (CINC), University Nebrija, Madrid, Spain
| |
Collapse
|
11
|
James AN, Minnihan CJ, Watson DG. Language Experience Predicts Eye Movements During Online Auditory Comprehension. J Cogn 2023; 6:30. [PMID: 37397351 PMCID: PMC10312251 DOI: 10.5334/joc.285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 06/03/2023] [Indexed: 07/04/2023] Open
Abstract
Experience-based theories of language processing suggest that listeners use the properties of their previous linguistic input to constrain comprehension in real time (e.g. MacDonald & Christiansen, 2002; Smith & Levy, 2013; Stanovich & West, 1989; Mishra, Pandey, Singh, & Huettig, 2012). This project investigates the prediction that individual differences in experience will predict differences in sentence comprehension. Participants completed a visual world eye-tracking task following Altmann and Kamide (1999) which manipulates whether the verb licenses the anticipation of a specific referent in the scene (e.g. The boy will eat/move the cake). Within this paradigm, we ask (1) are there reliable individual differences in language-mediated eye movements during this task? If so, (2) do individual differences in language experience correlate with these differences, and (3) can this relationship be explained by other, more general cognitive abilities? Study 1 finds evidence that language experience predicts an overall facilitation in fixating the target, and Study 2 replicates this effect and finds that it remains when controlling for working memory, inhibitory control, phonological ability, and perceptual speed.
Collapse
Affiliation(s)
| | | | - Duane G. Watson
- Department of Psychology and Human Development, Peabody College, Vanderbilt University, US
| |
Collapse
|
12
|
Lee C, Jessop A, Bidgood A, Peter MS, Pine JM, Rowland CF, Durrant S. How executive functioning, sentence processing, and vocabulary are related at 3 years of age. J Exp Child Psychol 2023; 233:105693. [PMID: 37207474 DOI: 10.1016/j.jecp.2023.105693] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2022] [Revised: 03/30/2023] [Accepted: 04/10/2023] [Indexed: 05/21/2023]
Abstract
There is a wealth of evidence demonstrating that executive function (EF) abilities are positively associated with language development during the preschool years, such that children with good executive functions also have larger vocabularies. However, why this is the case remains to be discovered. In this study, we focused on the hypothesis that sentence processing abilities mediate the association between EF skills and receptive vocabulary knowledge, in that the speed of language acquisition is at least partially dependent on a child's processing ability, which is itself dependent on executive control. We tested this hypothesis in longitudinal data from a cohort of 3- and 4-year-old children at three age points (37, 43, and 49 months). We found evidence, consistent with previous research, for a significant association between three EF skills (cognitive flexibility, working memory [as measured by the Backward Digit Span], and inhibition) and receptive vocabulary knowledge across this age range. However, only one of the tested sentence processing abilities (the ability to maintain multiple possible referents in mind) significantly mediated this relationship and only for one of the tested EFs (inhibition). The results suggest that children who are better able to inhibit incorrect responses are also better able to maintain multiple possible referents in mind while a sentence unfolds, a sophisticated sentence processing ability that may facilitate vocabulary learning from complex input.
Collapse
Affiliation(s)
- Crystal Lee
- Department of Psychology, Princeton University, Princeton, NJ 08540, USA
| | - Andrew Jessop
- Department of Psychology, University of Liverpool, Liverpool L69 7ZA, UK
| | - Amy Bidgood
- School of Psychology, Liverpool John Moores University, Liverpool L3 3AF, UK
| | - Michelle S Peter
- North Thames Genomic Laboratory Hub, Great Ormond Street Hospital for Children, London WC1N 3BH, UK
| | - Julian M Pine
- Department of Psychology, University of Liverpool, Liverpool L69 7ZA, UK
| | - Caroline F Rowland
- Department of Psychology, University of Liverpool, Liverpool L69 7ZA, UK; Language Development Department, Max Planck Institute for Psycholinguistics, 6525 XD Nijmegen, The Netherlands; Donders Centre for Cognition, Radboud University, 6525 GD Nijmegen, The Netherlands.
| | - Samantha Durrant
- School of Health Sciences, University of Manchester, Manchester M13 9PL, UK
| |
Collapse
|
13
|
Stinkeste C, Vincent MA, Delrue L, Brunellière A. Between alpha and gamma oscillations: Neural signatures of linguistic predictions and listener's attention to speaker's communication intention. Biol Psychol 2023; 180:108583. [PMID: 37156325 DOI: 10.1016/j.biopsycho.2023.108583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 05/04/2023] [Accepted: 05/05/2023] [Indexed: 05/10/2023]
Abstract
When listeners hear a message produced by their interlocutor, they can predict upcoming words thanks to the sentential context and their attention can be focused on the speaker's communication intention. In two electroencephalographical (EEG) studies, we investigated the oscillatory correlates of prediction in spoken-language comprehension and how they are modulated by the listener's attention. Sentential contexts which were strongly predictive of a particular word were ended by a possessive adjective either matching the gender of the predicted word or not. Alpha, beta and gamma oscillations were studied as they were considered to play a crucial role in the predictive process. While evidence of word prediction was related to alpha fluctuations when listeners focused their attention on sentence meaning, changes in high-gamma oscillations were triggered by word prediction when listeners focused their attention on the speaker's communication intention. Independently of the endogenous attention to a level of linguistic information, the oscillatory correlates of word predictions in language comprehension were sensitive to the prosodic emphasis produced by the speaker at a late stage. These findings thus bear major implications for understanding the neural mechanisms that support predictive processing in spoken-language comprehension.
Collapse
Affiliation(s)
- Charlotte Stinkeste
- Univ. Lille, CNRS, UMR 9193 - SCALab - Sciences Cognitives et Sciences Affectives, F-59000 Lille, France
| | - Marion A Vincent
- Univ. Lille, CNRS, UMR 9193 - SCALab - Sciences Cognitives et Sciences Affectives, F-59000 Lille, France
| | - Laurence Delrue
- Univ. Lille, CNRS, UMR 8163 - STL - Savoirs Textes Langage, F-59000 Lille, France
| | - Angèle Brunellière
- Univ. Lille, CNRS, UMR 9193 - SCALab - Sciences Cognitives et Sciences Affectives, F-59000 Lille, France.
| |
Collapse
|
14
|
Kukona A. Predictive Sentence Processing at Speed: Evidence from Online Mouse Cursor Tracking. Cogn Sci 2023; 47:e13285. [PMID: 37186474 DOI: 10.1111/cogs.13285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 02/28/2023] [Accepted: 03/27/2023] [Indexed: 05/17/2023]
Abstract
Three online mouse cursor-tracking experiments investigated predictive sentence processing at speed. Participants viewed visual arrays with objects like a bike and kite while hearing predictive sentences like, "What the man will ride, which is shown on this page, is the bike," or non-predictive sentences like, "What the man will spot, which is shown on this page, is the bike." Based on the selectional restrictions of "ride" (i.e., vs. "spot"), participants made mouse cursor movements to the bike before hearing the noun "bike." Compellingly, this effect was observed at speech rates of ∼3 (Experiment 1), ∼6 (Experiment 2), and ∼9 (Experiment 3) syllables/s. While prior research suggests striking limits on prediction, these results highlight temporal dynamics that may impact comprehenders' ability to preactivate information when hearing impressively rapid speech. Implications for theories of sentence processing are discussed.
Collapse
Affiliation(s)
- Anuenue Kukona
- Division of Psychology, De Montfort University
- School of Human Sciences, University of Greenwich
| |
Collapse
|
15
|
Sarvasy HS, Morgan AM, Yu J, Ferreira VS, Momma S. Cross-clause planning in Nungon (Papua New Guinea): Eye-tracking evidence. Mem Cognit 2023; 51:666-80. [PMID: 35230658 DOI: 10.3758/s13421-021-01253-3] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/10/2021] [Indexed: 11/08/2022]
Abstract
Hundreds of languages worldwide use a sentence structure known as the "clause chain," in which 20 or more clauses can be stacked to form a sentence. The Papuan language Nungon is among a subset of clause chaining languages that require "switch-reference" suffixes on nonfinal verbs in chains. These suffixes announce whether the subject of each upcoming clause will differ from the subject of the previous clause. We examine two major issues in psycholinguistics: predictive processing in comprehension, and advance planning in production. Whereas previous work on other languages has demonstrated that sentence planning can be incremental, switch-reference marking would seem to prohibit strictly incremental planning, as it requires speakers to plan the next clause before they can finish producing the current one. This suggests an intriguing possibility: planning strategies may be fundamentally different in Nungon. We used a mobile eye-tracker and solar-powered laptops in a remote village in Papua, New Guinea, to track Nungon speakers' gaze in two experiments: comprehension and production. Curiously, during comprehension, fixation data failed to find evidence that switch-reference marking is used for predictive processing. However, during production, we found evidence for advance planning of switch-reference markers, and, by extension, the subjects they presage. We propose that this degree of advance syntactic planning pushes the boundaries of what is known about sentence planning, drawing on data from a novel morpheme type in an understudied language.
Collapse
|
16
|
Onnis L, Lim A, Cheung S, Huettig F. Is the Mind Inherently Predicting? Exploring Forward and Backward Looking in Language Processing. Cogn Sci 2022; 46:e13201. [PMID: 36240464 PMCID: PMC9786242 DOI: 10.1111/cogs.13201] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 08/23/2022] [Accepted: 08/29/2022] [Indexed: 12/30/2022]
Abstract
Prediction is one characteristic of the human mind. But what does it mean to say the mind is a "prediction machine" and inherently forward looking as is frequently claimed? In natural languages, many contexts are not easily predictable in a forward fashion. In English, for example, many frequent verbs do not carry unique meaning on their own but instead, rely on another word or words that follow them to become meaningful. Upon reading take a the processor often cannot easily predict walk as the next word. But the system can "look back" and integrate walk more easily when it follows take a (e.g., as opposed to *make|get|have a walk). In the present paper, we provide further evidence for the importance of both forward and backward-looking in language processing. In two self-paced reading tasks and an eye-tracking reading task, we found evidence that adult English native speakers' sensitivity to word forward and backward conditional probability significantly predicted reading times over and above psycholinguistic predictors of reading latencies. We conclude that both forward and backward-looking (prediction and integration) appear to be important characteristics of language processing. Our results thus suggest that it makes just as much sense to call the mind an "integration machine" which is inherently backward 'looking.'
Collapse
Affiliation(s)
- Luca Onnis
- Centre for Multilingualism in Society across the LifespanUniversity of Oslo,Department of Linguistics and Scandinavian StudiesUniversity of Oslo
| | - Alfred Lim
- School of PsychologyUniversity of Nottingham Malaysia Campus
| | | | | |
Collapse
|
17
|
Poll GH, Martin A. Moment-to-Moment Processing of Complex Sentences by Adults with and without Developmental Language Disorder. J Commun Disord 2022; 99:106258. [PMID: 36029614 PMCID: PMC9536528 DOI: 10.1016/j.jcomdis.2022.106258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Revised: 08/19/2022] [Accepted: 08/19/2022] [Indexed: 06/15/2023]
Abstract
INTRODUCTION . Limited evidence suggests that adults with developmental language disorder (DLD) take different information into account as they process sentences as compared to peers with typical language. The purpose of this study was to evaluate how two factors affect sentence processing in adults with DLD: online storage costs and lexical expectations created by nouns. METHODS . Forty-three adults, 21 with DLD, listened to complex sentences presented word-by-word, and their listening times were recorded. The sentences included either object relative clauses or sentential complements which differed in online storage demands. The main clause subject nouns differed in co-occurrence frequency with "that" in sentences produced by typical adults. Participants completed a running span task to assess verbal working memory capacity. RESULTS . Mixed effects models found differences by sentence region. Participants with DLD processed embedded clause verbs faster than participants with typical language, and poorer language ability was associated with faster processing of conjunctions "that" and "which." Participants with greater verbal working memory capacity or typical language were affected by noun co-occurrence frequencies but those with lower working memory or DLD were not. CONCLUSIONS . The results align with prior findings that verbal working memory capacity influences what information affects moment-to-moment sentence processing. Those with greater capacity appeared to be more affected by temporary ambiguity. As compared to adults with typical language, processing times of adults with DLD were less sensitive to information on words that frequently co-occur with nouns. This aligns with prior findings suggesting that adults with DLD are less sensitive to the frequency of the structures and arguments that co-occur with verbs.
Collapse
Affiliation(s)
- Gerard H Poll
- Department of Speech Pathology and Audiology, Miami University, Oxford, OH USA.
| | - Alanna Martin
- Department of Speech Pathology and Audiology, Miami University, Oxford, OH USA.
| |
Collapse
|
18
|
Chantavarin S, Morgan E, Ferreira F. Robust Processing Advantage for Binomial Phrases with Variant Conjunctions. Cogn Sci 2022; 46:e13187. [PMID: 36036152 DOI: 10.1111/cogs.13187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 07/18/2022] [Accepted: 07/28/2022] [Indexed: 11/27/2022]
Abstract
Prior research has shown that various types of conventional multiword chunks are processed faster than matched novel strings, but it is unclear whether this processing advantage extends to variant multiword chunks that are less formulaic. To determine whether the processing advantage of multiword chunks accommodates variations in the canonical phrasal template, we examined the robustness of the processing advantage (i.e., Predictability) of binomial phrases with non-canonical conjunctions (e.g., salt and also pepper; salt as well as pepper). Results from the cloze study (Experiment 1) showed that there was a high tendency of producing the canonical conjunct (pepper), even in the binomials that contained non-formulaic conjunctions. Consistent with these findings, results from two eye tracking studies (Experiments 2a and 2b) showed that canonical conjuncts were read faster than novel conjuncts that were matched on word length (e.g., paprika), even in the binomials with variant conjunctions. This robust online processing advantage was replicated in a self-paced reading study that compared all three Conjunction Types (Experiment 3). Taken together, these findings show that binomials with variant function words also receive facilitated processing relative to matched novel strings, even though both types of strings are neither conventional nor relatively frequent. Exploratory analyses revealed that this processing speed advantage was driven by the lexical-semantic association between the canonical conjuncts (salt-pepper), rather than lexical and phrasal frequency. Overall, these results highlight flexibility in the processing of multiword chunks that current models of multiword storage and processing must take into account.
Collapse
Affiliation(s)
| | - Emily Morgan
- Department of Linguistics, University of California Davis, Davis, CA, 95616, USA
| | - Fernanda Ferreira
- Department of Psychology, University of California Davis, Davis, CA, 95616, USA
| |
Collapse
|
19
|
Brothers T. Capacity limits in sentence comprehension: Evidence from dual-task judgements and event-related potentials. Cognition 2022; 225:105153. [PMID: 35551040 DOI: 10.1016/j.cognition.2022.105153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Revised: 04/15/2022] [Accepted: 04/26/2022] [Indexed: 11/29/2022]
Abstract
There is an ongoing controversy over whether readers can access the meaning of multiple words, simultaneously. To date, different experimental methods have generated seemingly contradictory evidence in support of serial or parallel processing accounts. For example, dual-task studies suggest that readers can process a maximum of one word at a time (White, Palmer & Boynton, 2018), while ERP studies have demonstrated neural priming effects that are more consistent with parallel activation (Wen, Snell & Grainger, 2019). To help reconcile these views, I measured neural responses and behavioral accuracy in a dual-task sentence comprehension paradigm. Participants saw masked sentences and two-word phrases and had to judge whether or not they were grammatical. Grammatically correct sentences (This girl is neat) produced smaller N400 responses compared to scrambled sentences (Those girl is fled): an N400 sentence superiority effect. Critically, participants' grammaticality judgements on the same trials showed striking capacity limitations, with dual-task deficits closely matching the predictions of a serial, all-or-none processing account. Together, these findings suggest that the N400 sentence superiority effect is fully compatible with serial word recognition, and that readers are unable to process multiple sentence positions simultaneously.
Collapse
Affiliation(s)
- Trevor Brothers
- Tufts University, Department of Psychology, United States of America.
| |
Collapse
|
20
|
Acunzo DJ, Low DM, Fairhall SL. Deep neural networks reveal topic-level representations of sentences in medial prefrontal cortex, lateral anterior temporal lobe, precuneus, and angular gyrus. Neuroimage 2022; 251:119005. [PMID: 35176493 PMCID: PMC10184870 DOI: 10.1016/j.neuroimage.2022.119005] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Revised: 02/11/2022] [Accepted: 02/13/2022] [Indexed: 11/17/2022] Open
Abstract
When reading a sentence, individual words can be combined to create more complex meaning. In this study, we sought to uncover brain regions that reflect the representation of the meaning of sentences at the topic level, as opposed to the meaning of their individual constituent words when considered irrespective of their context. Using fMRI, we recorded the neural activity of participants while reading sentences. We constructed a topic-level sentence representations using the final layer of a convolutional neural network (CNN) trained to classify Wikipedia sentences into broad semantic categories. This model was contrasted with word-level sentence representations constructed using the average of the word embeddings constituting the sentence. Using representational similarity analysis, we found that the medial prefrontal cortex, lateral anterior temporal lobe, precuneus, and angular gyrus more strongly represent sentence topic-level, compared to word-level, meaning, uncovering the important role of these semantic system regions in the representation of topic-level meaning. Results were comparable when sentence meaning was modelled with a multilayer perceptron that was not sensitive to word order within a sentence, suggesting that the learning objective, in the terms of the topic being modelled, is the critical factor in capturing these neural representational spaces.
Collapse
Affiliation(s)
- David J Acunzo
- CIMeC/University of Trento, Corso Bettini 31, Rovereto 38068, Italy
| | - Daniel M Low
- Program in Speech and Hearing Bioscience and Technology, Harvard Medical School, United States; Brain and Cognitive Sciences Department, MIT, United States
| | - Scott L Fairhall
- CIMeC/University of Trento, Corso Bettini 31, Rovereto 38068, Italy.
| |
Collapse
|
21
|
Bongaerts FLP, Schutter DJLG, Klaus J. Cerebellar tDCS does not modulate language processing performance in healthy individuals. Neuropsychologia 2022; 169:108206. [PMID: 35278462 DOI: 10.1016/j.neuropsychologia.2022.108206] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 03/03/2022] [Accepted: 03/03/2022] [Indexed: 10/18/2022]
Abstract
Clinical and neuroscientific studies in healthy volunteers have established that the cerebellum contributes to language comprehension and production. Yet most evidence is correlational and the exact role of the cerebellum remains unclear. The aim of this study was to investigate the role of the right cerebellum in unimpaired language comprehension and production using non-invasive brain stimulation. In this double-blind, sham-controlled experiment, thirty-six healthy participants received anodal or sham transcranial direct current (tDCS) stimulation to the right cerebellum while performing a lexical decision, sentence comprehension, verbal fluency and a non-language control task. Active tDCS did not modulate performance in any of the tasks. Additional exploratory analyses suggest difficulty-specific performance modulation in the sentence comprehension and lexical decision task, with tDCS improving performance in easy trials of the sentence comprehension task and difficult trials in the lexical decision task. Overall, our findings provide no evidence for the involvement of the right posterior cerebellum in language processing. Further research is needed to dissociate the influence of task difficulty of the underlying cognitive processes.
Collapse
Affiliation(s)
| | | | - Jana Klaus
- Utrecht University, Helmholtz Institute, the Netherlands.
| |
Collapse
|
22
|
Laurinavichyute A, von der Malsburg T. Semantic Attraction in Sentence Comprehension. Cogn Sci 2022; 46:e13086. [PMID: 35122319 DOI: 10.1111/cogs.13086] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Revised: 12/09/2021] [Accepted: 12/14/2021] [Indexed: 12/22/2022]
Abstract
Agreement attraction is a cross-linguistic phenomenon where a verb occasionally agrees not with its subject, as required by grammar, but instead with an unrelated noun ("The key to the cabinets were…"). Despite the clear violation of grammatical rules, comprehenders often rate these sentences as acceptable. Contenders for explaining agreement attraction fall into two broad classes: Morphosyntactic accounts specifically designed to explain agreement attraction, and more general sentence processing models, such as the Lewis and Vasishth model, which explain attraction as a consequence of how linguistic structure is stored and accessed in content-addressable memory. In the present research, we disambiguate between these two classes by testing a surprising prediction made by the Lewis and Vasishth model but not by the morphosyntactic accounts, namely, that attraction should not be limited to morphosyntax, but that semantic features of unrelated nouns equally induce attraction. A recent study by Cunnings and Sturt provided initial evidence that this may be the case. Here, we report three single-trial experiments in English that compared semantic and agreement attraction and tested whether and how the two interact. All three experiments showed strong semantically induced attraction effects closely mirroring agreement attraction effects. We complement these results with computational simulations which confirmed that the Lewis and Vasishth model can faithfully reproduce the observed results. In sum, our findings suggest that attraction is a more general phenomenon than is commonly believed, and therefore favor more general sentence processing models, such as the Lewis and Vasishth model.
Collapse
Affiliation(s)
- Anna Laurinavichyute
- Department of Linguistics, University of Potsdam.,Center for Language and Brain, HSE University
| | - Titus von der Malsburg
- Institute of Linguistics, University of Stuttgart.,Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology
| |
Collapse
|
23
|
Sheppard SM, Meier EL, Kim KT, Breining BL, Keator LM, Tang B, Caffo BS, Hillis AE. Neural correlates of syntactic comprehension: A longitudinal study. Brain Lang 2022; 225:105068. [PMID: 34979477 PMCID: PMC9232253 DOI: 10.1016/j.bandl.2021.105068] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/07/2021] [Revised: 12/18/2021] [Accepted: 12/20/2021] [Indexed: 06/14/2023]
Abstract
Broca's area is frequently implicated in sentence comprehension but its specific role is debated. Most lesion studies have investigated deficits at the chronic stage. We aimed (1) to use acute imaging to predict which left hemisphere stroke patients will recover sentence comprehension; and (2) to better understand the role of Broca's area in sentence comprehension by investigating acute deficits prior to functional reorganization. We assessed comprehension of canonical and noncanonical sentences in 15 patients with left hemisphere stroke at acute and chronic stages. LASSO regression was used to conduct lesion symptom mapping analyses. Patients with more severe word-level comprehension deficits and a greater proportion of damage to supramarginal gyrus and superior longitudinal fasciculus were likely to experience acute deficits prior to functional reorganization. Broca's area was only implicated in chronic deficits. We propose that when temporoparietal regions are damaged, intact Broca's area can support syntactic processing after functional reorganization occurs.
Collapse
Affiliation(s)
- Shannon M Sheppard
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD 21287, United States; Department of Communication Sciences & Disorders, Chapman University, Irvine, CA 92618, United States.
| | - Erin L Meier
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD 21287, United States
| | - Kevin T Kim
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD 21287, United States
| | - Bonnie L Breining
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD 21287, United States
| | - Lynsey M Keator
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD 21287, United States
| | - Bohao Tang
- Department of Biostatics, Johns Hopkins School of Public Health, Baltimore, MD 21287, United States
| | - Brian S Caffo
- Department of Biostatics, Johns Hopkins School of Public Health, Baltimore, MD 21287, United States
| | - Argye E Hillis
- Department of Neurology, Johns Hopkins University School of Medicine, Baltimore, MD 21287, United States; Department of Physical Medicine and Rehabilitation, Johns Hopkins University School of Medicine, Baltimore, MD 21287, United States; Department of Cognitive Science, Krieger School of Arts and Sciences, Johns Hopkins University, Baltimore, MD 21218, United States
| |
Collapse
|
24
|
Maguire MJ, Schneider JM, Melamed TC, Ralph YK, Poudel S, Raval VM, Mikhail D, Abel AD. Temporal and topographical changes in theta power between middle childhood and adolescence during sentence comprehension. Dev Cogn Neurosci 2021; 53:101056. [PMID: 34979479 PMCID: PMC8728578 DOI: 10.1016/j.dcn.2021.101056] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2021] [Revised: 12/15/2021] [Accepted: 12/29/2021] [Indexed: 11/08/2022] Open
Abstract
Time frequency analysis of the EEG is increasingly used to study the neural oscillations supporting language comprehension. Although this method holds promise for developmental research, most existing work focuses on adults. Theta power (4–8 Hz) in particular often corresponds to semantic processing of words in isolation and in ongoing text. Here we investigated how the timing and topography of theta engagement to individual words during written sentence processing changes between childhood and adolescence (8–15 years). Results show that topographically, the theta response is broadly distributed in children, occurring over left and right central-posterior and midline frontal areas, and localizes to left central-posterior areas by adolescence. There were two notable developmental shifts. First, in response to each word, early (150–300 msec) theta engagement over frontal areas significantly decreases between 8 and 9 years and 10–11 years. Second, throughout the sentence, theta engagement over the right parietal areas significantly decreases between 10 and 11 years and 12–13 years with younger children’s theta response remaining significantly elevated between words compared to adolescents’. We found no significant differences between 12 and 13 years and 14–15 years. These findings indicate that children’s engagement of the language network during sentence processing continues to change through middle childhood but stabilizes into adolescence.
Collapse
Affiliation(s)
- Mandy J Maguire
- University of Texas at Dallas Callier Center for Communication Disorders, 1966 Inwood Rd, Dallas, TX 75235, USA.
| | - Julie M Schneider
- Louisiana State University, 217 Thomas Boyd Hall, Baton Rouge, LA 70803, USA
| | - Tina C Melamed
- University of Texas at Dallas Callier Center for Communication Disorders, 1966 Inwood Rd, Dallas, TX 75235, USA
| | - Yvonne K Ralph
- University of Texas at Dallas Callier Center for Communication Disorders, 1966 Inwood Rd, Dallas, TX 75235, USA
| | - Sonali Poudel
- University of Texas at Dallas Callier Center for Communication Disorders, 1966 Inwood Rd, Dallas, TX 75235, USA
| | - Vyom M Raval
- University of Texas at Dallas Callier Center for Communication Disorders, 1966 Inwood Rd, Dallas, TX 75235, USA
| | - David Mikhail
- University of Texas at Dallas Callier Center for Communication Disorders, 1966 Inwood Rd, Dallas, TX 75235, USA
| | - Alyson D Abel
- San Diego State University, 5500 Campanile Dr, San Diego, CA 92182, USA
| |
Collapse
|
25
|
Defenderfer J, Forbes S, Wijeakumar S, Hedrick M, Plyler P, Buss AT. Frontotemporal activation differs between perception of simulated cochlear implant speech and speech in background noise: An image-based fNIRS study. Neuroimage 2021; 240:118385. [PMID: 34256138 PMCID: PMC8503862 DOI: 10.1016/j.neuroimage.2021.118385] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 06/10/2021] [Accepted: 07/09/2021] [Indexed: 10/27/2022] Open
Abstract
In this study we used functional near-infrared spectroscopy (fNIRS) to investigate neural responses in normal-hearing adults as a function of speech recognition accuracy, intelligibility of the speech stimulus, and the manner in which speech is distorted. Participants listened to sentences and reported aloud what they heard. Speech quality was distorted artificially by vocoding (simulated cochlear implant speech) or naturally by adding background noise. Each type of distortion included high and low-intelligibility conditions. Sentences in quiet were used as baseline comparison. fNIRS data were analyzed using a newly developed image reconstruction approach. First, elevated cortical responses in the middle temporal gyrus (MTG) and middle frontal gyrus (MFG) were associated with speech recognition during the low-intelligibility conditions. Second, activation in the MTG was associated with recognition of vocoded speech with low intelligibility, whereas MFG activity was largely driven by recognition of speech in background noise, suggesting that the cortical response varies as a function of distortion type. Lastly, an accuracy effect in the MFG demonstrated significantly higher activation during correct perception relative to incorrect perception of speech. These results suggest that normal-hearing adults (i.e., untrained listeners of vocoded stimuli) do not exploit the same attentional mechanisms of the frontal cortex used to resolve naturally degraded speech and may instead rely on segmental and phonetic analyses in the temporal lobe to discriminate vocoded speech.
Collapse
Affiliation(s)
- Jessica Defenderfer
- Speech and Hearing Science, University of Tennessee Health Science Center, Knoxville, TN, United States.
| | - Samuel Forbes
- Psychology, University of East Anglia, Norwich, England.
| | | | - Mark Hedrick
- Speech and Hearing Science, University of Tennessee Health Science Center, Knoxville, TN, United States.
| | - Patrick Plyler
- Speech and Hearing Science, University of Tennessee Health Science Center, Knoxville, TN, United States.
| | - Aaron T Buss
- Psychology, University of Tennessee, Knoxville, TN, United States.
| |
Collapse
|
26
|
Yan H, Liu J. Subject Filled-gap Effects: A Self-paced Reading Study with Mandarin Learners of English. J Psycholinguist Res 2021; 50:1049-1064. [PMID: 34008096 DOI: 10.1007/s10936-021-09781-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/24/2021] [Indexed: 06/12/2023]
Abstract
This study examined how L1 Mandarin L2 English learners with different L2 proficiency levels processed the syntactic structure of English sentences. Using a self-paced reading paradigm, this study investigated three issues: first, whether Mandarin learners of English were able to predict the syntactic structure, subject filled-gap, in online English sentence reading; second, whether the parser would commit more strongly to the subject gap analysis when there is a longer distance between the filler and the potential gap; third, how L2 proficiency levels would influence this process. The results showed that regardless of their English proficiency levels, Mandarin learners of English were capable to predict a subject filled-gap when processing English sentences. Besides, the subject filled-gap effect was not found in the sentences with adjuncts between the filler and the potential gap. This indicated that L2 learners' predictive ability in syntactic processing did not need to be activated by the increase of processing time or difficulty. Due to the efficiency of sentence processing, there is no need to increase the processing burden for L2 learners.
Collapse
Affiliation(s)
- Hanbo Yan
- School of Chinese Studies and Exchange, Shanghai International Studies University, Hongkou District, Room 418, Building 2, Number 550 West Dalian Road, Shanghai, 200083, China.
| | - Jie Liu
- Defense Language Institute, Monterey, USA
| |
Collapse
|
27
|
Liu Y, Ryskin R, Futrell R, Gibson E. A verb-frame frequency account of constraints on long-distance dependencies in English. Cognition 2021; 222:104902. [PMID: 34583835 DOI: 10.1016/j.cognition.2021.104902] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2020] [Revised: 08/20/2021] [Accepted: 09/02/2021] [Indexed: 11/03/2022]
Abstract
Going back to Ross (1967) and Chomsky (1973), researchers have sought to understand what conditions permit long-distance dependencies in language, such as between the wh-word what and the verb bought in the sentence 'What did John think that Mary bought?'. In the present work, we attempt to understand why changing the main verb in wh-questions affects the acceptability of long-distance dependencies out of embedded clauses. In particular, it has been claimed that factive and manner-of-speaking verbs block such dependencies (e.g., 'What did John know/whisper that Mary bought?'), whereas verbs like think and believe allow them. Here we provide 3 acceptability judgment experiments of filler-gap constructions across embedded clauses to evaluate four types of accounts based on (1) discourse; (2) syntax; (3) semantics; and (4) our proposal related to verb-frame frequency. The patterns of acceptability are most simply explained by two factors: verb-frame frequency, such that dependencies with verbs that rarely take embedded clauses are less acceptable; and construction type, such that wh-questions and clefts are less acceptable than declaratives. We conclude that the low acceptability of filler-gap constructions formed by certain sentence complement verbs is due to infrequent linguistic exposure.
Collapse
Affiliation(s)
- Yingtong Liu
- Department of Linguistics, Harvard University, Cambridge, MA 02138, USA; Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA.
| | - Rachel Ryskin
- Department of Cognitive and Information Sciences, University of California, Merced, CA 95343, USA.
| | - Richard Futrell
- Department of Language Science, University of California, Irvine, CA 92697, USA.
| | - Edward Gibson
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA.
| |
Collapse
|
28
|
Lowder MW, Gordon PC. Relative Clause Effects at the Matrix Verb Depend on Type of Intervening Material. Cogn Sci 2021; 45:e13039. [PMID: 34490911 DOI: 10.1111/cogs.13039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2019] [Revised: 07/27/2021] [Accepted: 08/03/2021] [Indexed: 11/28/2022]
Abstract
Although a large literature demonstrates that object-extracted relative clauses (ORCs) are harder to process than subject-extracted relative clauses (SRCs), there is less agreement regarding where during processing this difficulty emerges, as well as how best to explain these effects. An eye-tracking study by Staub, Dillon, and Clifton (2017) demonstrated that readers experience more processing difficulty at the matrix verb for ORCs than for SRCs when the matrix verb immediately follows the relative clause (RC), but the difficulty is eliminated if a prepositional phrase (PP) intervenes. A careful examination of Staub et al.'s materials reveals that the types of PPs used in the experiment were a mixture of locative and temporal PPs. This is important in that locative PPs can modify either a noun phrase or a verb phrase (VP), whereas temporal PPs typically modify VPs, resulting in systematic differences in PP attachment across ORCs versus SRCs. In the current eye-tracking experiment, we systematically manipulated RC type and PP type in the same sentences used by Staub et al. The manipulation of PP type resulted in a crossover pattern at the matrix verb such that there was a trend for reading times to be longer for ORCs than SRCs when the PP was locative, but reading times were longer for SRCs than ORCs when the PP was temporal. These results provide important information regarding the locus of RC-processing effects and highlight the importance of carefully considering how intervening material might unintentionally alter the structure or the meaning of a sentence.
Collapse
Affiliation(s)
| | - Peter C Gordon
- Department of Psychology, University of North Carolina at Chapel Hill
| |
Collapse
|
29
|
Hilton CB, Goldwater MB. Linguistic syncopation: Meter-syntax alignment affects sentence comprehension and sensorimotor synchronization. Cognition 2021; 217:104880. [PMID: 34419725 DOI: 10.1016/j.cognition.2021.104880] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2020] [Revised: 07/01/2021] [Accepted: 08/11/2021] [Indexed: 02/08/2023]
Abstract
The hierarchical organization of speech rhythm into meter putatively confers cognitive affordances for perception, memory, and motor coordination. Meter also aligns with phrasal structure in systematic ways. In this paper, we show that this alignment affects the robustness of syntactic comprehension and discuss possible underlying mechanisms. In two experiments, we manipulated meter-syntax alignment while sentences with relative clause structures were either read as text (experiment 1, n = 40) or listened to as speech (experiment 2, n = 40). In experiment 2, we also measured the stability with which participants could tap in time with the metrical accents in the sentences they were comprehending. In addition to making more mistakes, sensorimotor synchronization was disrupted when syntactic cues clashed with the metrical context. We suggest that this reflects a tight coordination of top-down linguistic knowledge with the sensorimotor system to optimize comprehension.
Collapse
|
30
|
Abstract
Various studies within the Good-Enough Approach observe that people often make errors in answering comprehension questions after reading garden-path sentences such as While Anna dressed the baby played in the crib. Recently, it has been claimed that readers form a full syntactic analysis of these sentences, but they do not completely prune the original misanalysis. This article presents evidence that these findings do not hold for all garden-path sentences. The main finding of the Good-Enough Approach-that the comprehension questions targeting the initial misanalysis yield significantly higher rates of incorrect answers after garden-path sentences, in comparison with after control sentences-was replicated here in three self-paced reading experiments on Czech. However, these experiments show a similar pattern of results for other comprehension questions, such as questions targeting an analysis that is not syntactically licensed at any point of processing. These results point out that certain garden-path structures may be very hard to process and that the process of garden-path repair might not be successful at all. Based on these results and the results of previous studies, the idea of a range of difficulty levels for garden-path structures is proposed.
Collapse
Affiliation(s)
- Jan Chromý
- Institute of the Czech Language and Theory of Communication, Faculty of Arts, Charles University, Prague, Czech Republic
| |
Collapse
|
31
|
Gosselin L, Sabourin L. Lexical-semantic processing costs are not inherent to intra-sentential code-switching: The role of switching habits. Neuropsychologia 2021; 159:107922. [PMID: 34174298 DOI: 10.1016/j.neuropsychologia.2021.107922] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Revised: 06/17/2021] [Accepted: 06/17/2021] [Indexed: 10/21/2022]
Abstract
A bank of past electrophysiological research suggests that code-switching (i.e., the use of multiple languages during a single conversational event) is characterized by increased processing costs. However, the majority of these studies tested bilinguals who did not necessarily code-switch on a regular basis. In order to investigate the impact of switching habits on language processing, two groups of French-English bilinguals (habitual code-switchers and non-habitual code-switchers) read sentences containing unilingual and switched determiner phrases while their EEG was recorded. The findings indicate important processing differences between the groups. Notably, switched trials (particularly those with a French determiner) generated an increased negativity from 300 to 500 ms for non-habitual code-switchers, but not for habitual code-switchers. The veritable impact of switching habits were also supported by a correlation analysis. This finding suggests that code-switching is not inherently effortful to process, but rather, that comprehension costs are related to idiosyncratic factors, such as the extent of prior exposure to code-switched input. An LPC was also observed from 500 to 900 for habitual code-switchers; for non-habitual switchers, this effect may have been attenuated by the long-lasting N400 effect. We advance several possible interpretations for the late positivity. Altogether, the results from the current study support the claim that the code-switching cost observed in previous literature may be linked to the bilingual samples tested in those studies: habitual code-switchers may not find switches effortful to process, but not all bilinguals code-switch. We highlight the importance of experience and individual differences in the study of bilingual cognition.
Collapse
Affiliation(s)
- Leah Gosselin
- University of Ottawa, Department of Linguistics, 70 Laurier Ave. E., Ottawa, ON, K1N 6N6, Canada.
| | - Laura Sabourin
- University of Ottawa, Department of Linguistics, 70 Laurier Ave. E., Ottawa, ON, K1N 6N6, Canada
| |
Collapse
|
32
|
Baker C, Love T. It's about time! Time as a parameter for lexical and syntactic processing: an eye-tracking-while-listening investigation. Lang Cogn Neurosci 2021; 37:42-62. [PMID: 34957314 PMCID: PMC8697737 DOI: 10.1080/23273798.2021.1941147] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Accepted: 06/04/2021] [Indexed: 06/13/2023]
Abstract
We examined the time-course of lexical activation, deactivation, and the syntactic operation of dependency linking during the online processing of object-relative sentence constructions using eye-tracking-while-listening. We explored how manipulating temporal aspects of the language input affects the tight lexical and syntactic temporal constraints found in sentence processing. The three temporal manipulations were (1) increasing the duration of the direct object noun, (2) adding the disfluency uh after the noun, and (3) replacing the disfluency with a silent pause. The findings from this experiment revealed that the disfluent and silence temporal manipulations enhanced the processing of subject and object noun phrases by modulating activation and deactivation. The manipulations also changed the time-course of dependency linking (increased reactivation of the direct object). The modulated activation dynamics of these lexical items are thought to play a role in mitigating interference and suggest that deactivation plays a beneficial role in complex sentence processing.
Collapse
Affiliation(s)
- Carolyn Baker
- SDSU/UCSD Joint Doctoral Program in Language and Communicative Disorders, San Diego State University, San Diego, USA
| | - Tracy Love
- SDSU/UCSD Joint Doctoral Program in Language and Communicative Disorders, San Diego State University, San Diego, USA
- School of Speech, Language, and Hearing Sciences, SDSU, San Diego, USA
- Department of Cognitive Science, UCSD, San Diego, USA
| |
Collapse
|
33
|
Kim H, Shin GH. Effects of Long-Term Language Use Experience in Sentence Processing: Evidence from Korean. J Psycholinguist Res 2021; 50:523-541. [PMID: 33074355 DOI: 10.1007/s10936-020-09737-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/01/2020] [Indexed: 06/11/2023]
Abstract
Attraction effects arise when a comprehender erroneously retrieves a distractor instead of a target item during memory retrieval operations. In Korean, considerable processing difficulties occur in the agreement relation checking between a subject and an honorific-marked predicate when an intervening distractor carries a non-honorific feature. We investigate how attraction effects are managed during the processing of Korean subject-predicate honorific agreement by two Korean-speaking groups with different language use experience backgrounds: college students and airline workers. Results showed that both groups demonstrated stable knowledge of the honorific agreement in the acceptability judgment task. In the self-paced reading task, the airline group, who used honorifics extensively in their workplace, was less affected by the attraction effect than the student group. Our findings suggest that long-term language use experience can modulate how language users manage potential influence from attraction effects in real-time sentence processing.
Collapse
Affiliation(s)
- Hyunwoo Kim
- Department of English Language and Literature, Yonsei University, Seoul, South Korea
| | - Gyu-Ho Shin
- Department of Asian Studies, Palacký University Olomouc, Křížkovského 512/10, 771 80, Olomouc, Czech Republic.
| |
Collapse
|
34
|
Foucart A, Hartsuiker RJ. Are foreign-accented speakers that 'incredible'? The impact of the speaker's indexical properties on sentence processing. Neuropsychologia 2021; 158:107902. [PMID: 34052231 DOI: 10.1016/j.neuropsychologia.2021.107902] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2020] [Revised: 03/16/2021] [Accepted: 05/16/2021] [Indexed: 12/31/2022]
Abstract
This study investigated the impact of the speaker's identity generated by the voice on sentence processing. We examined the relation between ERP components associated with the processing of the voice (N100 and P200) from voice onset and those associated with sentence processing (N400 and late positivity) from critical word onset. We presented Dutch native speakers with sentences containing true (and known) information, unknown (but true) information or information violating world knowledge and had them perform a truth evaluation task. Sentences were spoken either in a native or a foreign accent. Truth evaluation judgments were not different for statements spoken by the native-accented and the foreign-accented speakers. Reduced N100 and P200 were observed in response to the foreign speaker's voice compared to the native speaker's. While statements containing unknown information or world knowledge violations generated a larger N400 than true statements in the native condition, they were not significantly different in the foreign condition, suggesting shallower processing of foreign-accented speech. The N100 was a significant predictor for the N400 in that the reduced N100 observed for the foreign speaker compared to the native speaker was related to a smaller N400 effect. These finding suggest that the impression of the speaker that listeners rapidly form from the voice affects semantic processing, which confirms that speaker's identity and language comprehension cannot be dissociated.
Collapse
Affiliation(s)
- Alice Foucart
- - Centro de Ciencia Cognitiva C3, Facultad de Lenguas y Educación, Universidad Nebrija, Spain.
| | | |
Collapse
|
35
|
Muralikrishnan R, Idrissi A. Salience-weighted agreement feature hierarchy modulates language comprehension. Cortex 2021; 141:168-189. [PMID: 34058618 DOI: 10.1016/j.cortex.2021.03.029] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2019] [Revised: 03/01/2020] [Accepted: 03/21/2021] [Indexed: 10/21/2022]
Abstract
The brain establishes relations between elements of an unfolding sentence in order to incrementally build a representation of who is doing what based on various linguistic cues. Many languages systematically mark the verb and/or its arguments to imply the manner in which they are related. A common mechanism to this end is subject-verb agreement, whereby the marking on the verb covaries with one or more of the features such as person, number and gender of the subject argument in a sentence. The cross-linguistic variability of these features would suggest that they may modulate language comprehension differentially based on their relative weightings in a given language. To test this, we investigated the processing of subject-verb agreement in simple intransitive Arabic sentences in a visual event-related brain potential (ERP) study. Specifically, we examined the differences, if any, that ensue in the processing of person, number and gender features during online comprehension, employing sentences in which the verb either showed full agreement with the subject noun (singular or plural) or did not agree in one of the features. ERP responses were measured at the post-nominal verb. Results showed a biphasic negativity-late-positivity effect when the verb did not agree with its subject noun in either of the features, in line with similar findings from other languages. Crucially however, the biphasic effect for agreement violations was systematically graded based on the feature that was violated, which is a novel finding in view of results from other languages. Furthermore, this graded effect was qualitatively different for singular and plural subjects based on the differing salience of the features for each subject-type. These results suggest that agreement features, varying in their salience due to their language-specific weightings, differentially modulate language comprehension. We postulate a Salience-weighted Feature Hierarchy based on our findings and argue that this parsimoniously accounts for the diversity of existing cross-linguistic neurophysiological results on verb agreement processing.
Collapse
Affiliation(s)
- R Muralikrishnan
- Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany.
| | | |
Collapse
|
36
|
Lissón P, Pregla D, Nicenboim B, Paape D, van Het Nederend ML, Burchert F, Stadie N, Caplan D, Vasishth S. A Computational Evaluation of Two Models of Retrieval Processes in Sentence Processing in Aphasia. Cogn Sci 2021; 45:e12956. [PMID: 33877698 DOI: 10.1111/cogs.12956] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2020] [Revised: 01/18/2021] [Accepted: 01/24/2021] [Indexed: 11/30/2022]
Abstract
Can sentence comprehension impairments in aphasia be explained by difficulties arising from dependency completion processes in parsing? Two distinct models of dependency completion difficulty are investigated, the Lewis and Vasishth (2005) activation-based model and the direct-access model (DA; McElree, 2000). These models' predictive performance is compared using data from individuals with aphasia (IWAs) and control participants. The data are from a self-paced listening task involving subject and object relative clauses. The relative predictive performance of the models is evaluated using k-fold cross-validation. For both IWAs and controls, the activation-based model furnishes a somewhat better quantitative fit to the data than the DA. Model comparisons using Bayes factors show that, assuming an activation-based model, intermittent deficiencies may be the best explanation for the cause of impairments in IWAs, although slowed syntax and lexical delayed access may also play a role. This is the first computational evaluation of different models of dependency completion using data from impaired and unimpaired individuals. This evaluation develops a systematic approach that can be used to quantitatively compare the predictions of competing models of language processing.
Collapse
Affiliation(s)
- Paula Lissón
- Department of Linguistics, University of Potsdam
| | | | - Bruno Nicenboim
- Department of Linguistics, University of Potsdam.,Department of Cognitive Science and Artificial Intelligence, Tilburg University
| | - Dario Paape
- Department of Linguistics, University of Potsdam
| | | | | | | | | | | |
Collapse
|
37
|
Frank SL, Ernst P, Thompson RL, Cozijn R. The missing-VP effect in readers of English as a second language. Mem Cognit 2021; 49:1204-19. [PMID: 33864238 DOI: 10.3758/s13421-021-01159-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/21/2021] [Indexed: 11/08/2022]
Abstract
English sentences with double center-embedded clauses are read faster when they are made ungrammatical by removing one of the required verb phrases. This phenomenon is known as the missing-VP effect. German and Dutch speakers do not experience the missing-VP effect when reading their native language, but they do when reading English as a second language (L2). We investigate whether the missing-VP effect when reading L2 English occurs in native Dutch speakers because their knowledge of English is similar to that of native English speakers (the high exposure account), or because of the difficulty of L2 reading (the low proficiency account). In an eye-tracking study, we compare the size of the missing-VP effect between native Dutch and native English participants, and across native Dutch participants with varying L2 English proficiency and exposure. Results provide evidence for both accounts, suggesting that both native-like knowledge of English and L2 reading difficulty play a role.
Collapse
|
38
|
van der Burght CL, Friederici AD, Goucha T, Hartwigsen G. Pitch accents create dissociable syntactic and semantic expectations during sentence processing. Cognition 2021; 212:104702. [PMID: 33857845 DOI: 10.1016/j.cognition.2021.104702] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Revised: 03/20/2021] [Accepted: 03/22/2021] [Indexed: 11/17/2022]
Abstract
The language system uses syntactic, semantic, as well as prosodic cues to efficiently guide auditory sentence comprehension. Prosodic cues, such as pitch accents, can build expectations about upcoming sentence elements. This study investigates to what extent syntactic and semantic expectations generated by pitch accents can be dissociated and if so, which cues take precedence when contradictory information is present. We used sentences in which one out of two nominal constituents was placed in contrastive focus with a third one. All noun phrases carried overt syntactic information (case-marking of the determiner) and semantic information (typicality of the thematic role of the noun). Two experiments (a sentence comprehension and a sentence completion task) show that focus, marked by pitch accents, established expectations in both syntactic and semantic domains. However, only the syntactic expectations, when violated, were strong enough to interfere with sentence comprehension. Furthermore, when contradictory cues occurred in the same sentence, the local syntactic cue (case-marking) took precedence over the semantic cue (thematic role), and overwrote previous information cued by prosody. The findings indicate that during auditory sentence comprehension the processing system integrates different sources of information for argument role assignment, yet primarily relies on syntactic information.
Collapse
Affiliation(s)
- Constantijn L van der Burght
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany; Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany.
| | - Angela D Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Tomás Goucha
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Gesa Hartwigsen
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany; Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| |
Collapse
|
39
|
Knoeferle P. Grounding Language Processing: The Added Value of Specifying Linguistic/Compositional Representations and Processes. J Cogn 2021; 4:24. [PMID: 33829122 PMCID: PMC8015707 DOI: 10.5334/joc.155] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Accepted: 02/24/2021] [Indexed: 11/30/2022] Open
Abstract
Abundant empirical evidence suggests that visual perception and motor responses are involved in language comprehension ('grounding'). However, when modeling the grounding of sentence comprehension on a word-by-word basis, linguistic representations and cognitive processes are rarely made fully explicit. This article reviews representational formalisms and associated (computational) models with a view to accommodating incremental and compositional grounding effects. Are different representation formats equally suitable and what mechanisms and representations do models assume to accommodate grounding effects? I argue that we must minimally specify compositional semantic representations, a set of incremental processes/mechanisms, and an explicit link from the assumed processes to measured behavior. Different representational formats can be contrasted in psycholinguistic modeling by holding the set of processes/mechanisms constant; contrasting different processes/mechanisms is possible by holding representations constant. Such psycholinguistic modeling could be applied across a wide range of experimental investigations and complement computational modeling.
Collapse
Affiliation(s)
- Pia Knoeferle
- Institut für deutsche Sprache und Linguistik, Unter den Linden 6, Humboldt-Universität zu Berlin, 10099 Berlin
| |
Collapse
|
40
|
Rivero-Contreras M, Engelhardt PE, Saldaña D. An experimental eye-tracking study of text adaptation for readers with dyslexia: effects of visual support and word frequency. Ann Dyslexia 2021; 71:170-187. [PMID: 33580863 DOI: 10.1007/s11881-021-00217-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/07/2020] [Accepted: 02/04/2021] [Indexed: 06/12/2023]
Abstract
Easy-to-read guidelines recommend visual support and lexical simplification to facilitate text processing, but few empirical studies confirm a positive effect from these recommendations in individuals with dyslexia. This study examined the influence of the visual support and lexical simplification on sentence processing through eye movements at both the text- and word-level, and the differences between readers with and without dyslexia. Furthermore, we explored the influence of reading experience and vocabulary, as control variables. We tested 20 young adults with dyslexia and 20 chronological age-matched controls. Participants read 60 sentences in total. Half the sentences contained an image and the other half did not, and half contained a low-frequency word and half a high-frequency word. Results showed that visual support and lexical simplification facilitated sentence processing, potentially by jointly facilitating lexical semantic access. We also found that participants with lower print exposure and lower vocabulary benefited more from word-level lexical simplification. We conclude that both adaptations could benefit readers with low print exposure and smaller vocabularies, and therefore, to many dyslexic readers who show these characteristics.
Collapse
|
41
|
Kolberg L, de Carvalho A, Babineau M, Havron N, Fiévet AC, Abaurre B, Christophe A. "The tiger is hitting! the duck too!" 3-year-olds can use prosodic information to constrain their interpretation of ellipsis. Cognition 2021; 213:104626. [PMID: 33593594 DOI: 10.1016/j.cognition.2021.104626] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2020] [Revised: 01/07/2021] [Accepted: 02/04/2021] [Indexed: 11/19/2022]
Abstract
This work aims to investigate French children's ability to use phrasal boundaries for disambiguation of a type of ambiguity not yet studied, namely stripping sentences versus simple transitive sentences. We used stripping sentences such as "[Le tigre tape]! [Le canard aussi]!" ("[The tiger is hitting]! [The duck too]!", in which both the tiger and the duck are hitting), which, without the prosodic information, would be ambiguous with a transitive sentence such as "[Le tigre] [tape le canard aussi]!" ("[The tiger] [is hitting the duck too]!", in which the tiger is hitting the duck). We presented 3-to-4-year-olds and 28-month-olds with one of the two types of sentence above, while they watched two videos side-by-side on a screen: one depicting the transitive interpretation of the sentences, and another depicting the stripping interpretation. The stripping interpretation video showed the two characters as agents of the named action (e.g. a duck and a tiger hitting a bunny), and the transitive interpretation video showed only the first character as an agent, and the second character as a patient of the action (e.g. the tiger hitting the duck and the bunny). The results showed that 3-to-4-year-olds use prosodic information to correctly distinguish stripping sentences from transitive sentences, as they looked significantly more at the appropriate video, while 28-month-olds show only a trend in the same direction. While recent studies demonstrated that from 18 months of age, infants are able to use phrasal prosody to guide the syntactic analysis of ambiguous sentences, our results show that only 3-to-4-year-olds were able to reliably use phrasal prosody to constrain the parsing of stripping sentences. We discuss several factors that can explain this delay, such as differences in the frequency of these structures in child-directed speech, as well as in the complexity of the sentences and of the experimental task. Our findings add to the growing body of evidence on the role of prosody in constraining parsing in young children.
Collapse
Affiliation(s)
- Letícia Kolberg
- Departamento de Linguística, Universidade Estadual de Campinas, Campinas, Brazil.
| | - Alex de Carvalho
- Laboratoire de Psychologie du Développement et de l'Éducation de l'Enfant (LaPsyDÉ), Department of Psychology, UniversitÉ de Paris, CNRS, F-75005 Paris, France
| | - Mireille Babineau
- Laboratoire de Sciences Cognitives et Psycholinguistique, DEC-ENS/EHESS/CNRS, Ecole Normale Supérieure, PSL University, Paris, France; Maternité Port-Royal, AP-HP, Université Paris Descartes, France
| | - Naomi Havron
- Laboratoire de Sciences Cognitives et Psycholinguistique, DEC-ENS/EHESS/CNRS, Ecole Normale Supérieure, PSL University, Paris, France; University of Haifa, Haifa, Israel
| | - Anne-Caroline Fiévet
- Laboratoire de Sciences Cognitives et Psycholinguistique, DEC-ENS/EHESS/CNRS, Ecole Normale Supérieure, PSL University, Paris, France; Maternité Port-Royal, AP-HP, Université Paris Descartes, France
| | - Bernadete Abaurre
- Departamento de Linguística, Universidade Estadual de Campinas, Campinas, Brazil
| | - Anne Christophe
- Laboratoire de Sciences Cognitives et Psycholinguistique, DEC-ENS/EHESS/CNRS, Ecole Normale Supérieure, PSL University, Paris, France; Maternité Port-Royal, AP-HP, Université Paris Descartes, France
| |
Collapse
|
42
|
Barbieri E, Litcofsky KA, Walenski M, Chiappetta B, Mesulam MM, Thompson CK. Online sentence processing impairments in agrammatic and logopenic primary progressive aphasia: Evidence from ERP. Neuropsychologia 2021; 151:107728. [PMID: 33326758 PMCID: PMC7875464 DOI: 10.1016/j.neuropsychologia.2020.107728] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2020] [Revised: 12/07/2020] [Accepted: 12/09/2020] [Indexed: 10/22/2022]
Abstract
Evidence from psycholinguistic research indicates that sentence processing is impaired in Primary Progressive Aphasia (PPA), and more so in individuals with agrammatic (PPA-G) than logopenic (PPA-L) subtypes. Studies have mostly focused on offline sentence production ability, reporting impaired production of verb morphology (e.g., tense, agreement) and verb-argument structure (VAS) in PPA-G, and mixed findings in PPA-L. However, little is known about real-time sentence comprehension in PPA. The present study is the first to compare real-time semantic, morphosyntactic and VAS processing in individuals with PPA (10 with PPA-G and 9 with PPA-L), and in two groups of healthy (22 young and 19 older) individuals, using event-related potentials (ERP). Participants were instructed to listen to sentences that were either well-formed (n = 150) or contained a violation of semantics (e.g., *Owen was mentoring pumpkins at the party, n = 50), morphosyntax (e.g., *The actors was singing in the theatre, n = 50) or VAS (*Ryan was devouring on the couch, n = 50), and were required to perform a sentence acceptability judgment task while EEG was recorded. Results indicated that in the semantic task both healthy and PPA groups showed an N400 response to semantic violations, which was delayed in PPA and older (vs. younger) groups. Morphosyntactic violations elicited a P600 in both groups of healthy individuals and in PPA-L, but not in PPA-G. A similar P600 response was also found only in healthy individuals for VAS violations; whereas, abnormal ERP responses were observed in both PPA groups, with PPA-G showing no evidence of VAS violation detection and PPA-L showing a delayed and abnormally-distributed positive component that was negatively associated with offline sentence comprehension scores. These findings support characterizations of sentence processing impairments in PPA-G, by providing online evidence that VAS and morphosyntactic processing are impaired, in the face of substantially preserved semantic processing. In addition, the results indicate that on-line processing of VAS information may also be impaired in PPA-L, despite their near-normal accuracy on standardized language tests of argument structure production.
Collapse
Affiliation(s)
- Elena Barbieri
- Aphasia and Neurolinguistics Research Laboratory, Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States.
| | - Kaitlyn A Litcofsky
- Aphasia and Neurolinguistics Research Laboratory, Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States
| | - Matthew Walenski
- Aphasia and Neurolinguistics Research Laboratory, Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States
| | - Brianne Chiappetta
- Aphasia and Neurolinguistics Research Laboratory, Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States
| | - Marek-Marsel Mesulam
- Mesulam Center for Cognitive Neurology and Alzheimer's Disease, Northwestern University, Chicago, IL, United States; Department of Neurology, Northwestern University, Chicago, IL, United States
| | - Cynthia K Thompson
- Aphasia and Neurolinguistics Research Laboratory, Department of Communication Sciences and Disorders, Northwestern University, Evanston, IL, United States; Mesulam Center for Cognitive Neurology and Alzheimer's Disease, Northwestern University, Chicago, IL, United States; Department of Neurology, Northwestern University, Chicago, IL, United States
| |
Collapse
|
43
|
Meylan SC, Nair S, Griffiths TL. Evaluating models of robust word recognition with serial reproduction. Cognition 2021; 210:104553. [PMID: 33482474 DOI: 10.1016/j.cognition.2020.104553] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2019] [Revised: 12/13/2020] [Accepted: 12/14/2020] [Indexed: 11/20/2022]
Abstract
Spoken communication occurs in a "noisy channel" characterized by high levels of environmental noise, variability within and between speakers, and lexical and syntactic ambiguity. Given these properties of the received linguistic input, robust spoken word recognition-and language processing more generally-relies heavily on listeners' prior knowledge to evaluate whether candidate interpretations of that input are more or less likely. Here we compare several broad-coverage probabilistic generative language models in their ability to capture human linguistic expectations. Serial reproduction, an experimental paradigm where spoken utterances are reproduced by successive participants similar to the children's game of "Telephone," is used to elicit a sample that reflects the linguistic expectations of English-speaking adults. When we evaluate a suite of probabilistic generative language models against the yielded chains of utterances, we find that those models that make use of abstract representations of preceding linguistic context (i.e., phrase structure) best predict the changes made by people in the course of serial reproduction. A logistic regression model predicting which words in an utterance are most likely to be lost or changed in the course of spoken transmission corroborates this result. We interpret these findings in light of research highlighting the interaction of memory-based constraints and representations in language processing.
Collapse
|
44
|
Abstract
Embodied theories propose that language is understood via mental simulations of sensory states related to perception and action. Given that direct speech (e.g., She says, "It's a lovely day!") is perceived to be more vivid than indirect speech (e.g., She says (that) it's a lovely day) in perception, recent research shows in silent reading that more vivid speech representations are mentally simulated for direct speech than for indirect speech. This 'simulated' speech is found to contain suprasegmental prosodic representations (e.g., speech prosody) but its phonological detail and its causal role in silent reading of direct speech remain unclear. Here in three experiments, I explored the phonological aspect and the causal role of speech simulations in silent reading of tongue twisters in direct speech, indirect speech and non-speech sentences. The results demonstrated greater visual tongue-twister effects (phonemic interference) during silent reading (Experiment 1) but not oral reading (Experiment 2) of direct speech as compared to indirect speech and non-speech. The tongue-twister effects in silent reading of direct speech were selectively disrupted by phonological interference (concurrent articulation) as compared to manual interference (finger tapping) (Experiment 3). The results replicated more vivid speech simulations in silent reading of direct speech, and additionally extended them to the phonological dimension. Crucially, they demonstrated a causal role of phonological simulations in silent reading of direct speech, at least in tongue-twister reading. The findings are discussed in relation to multidimensionality and task dependence of mental simulation and its mechanisms.
Collapse
|
45
|
Keshev M, Meltzer-Asscher A. Noisy is better than rare: Comprehenders compromise subject-verb agreement to form more probable linguistic structures. Cogn Psychol 2020; 124:101359. [PMID: 33254044 DOI: 10.1016/j.cogpsych.2020.101359] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2020] [Revised: 11/15/2020] [Accepted: 11/15/2020] [Indexed: 11/29/2022]
Abstract
Production and perception errors are common in everyday language use. Recent studies suggest that in order to overcome the flawed speech signal, comprehenders engage in rational noisy-channel processing, which can pull their interpretation towards more probable "near-neighbor" analyses, based on the assumption that an error may have occurred in the transmission of the sentence. We investigate this type of processing using subject/object relative clause ambiguity in Hebrew. In four self-paced reading experiments and a sentence completion experiment, we find that during online processing, readers apply elaborate knowledge regarding the distribution of structures in the language, and that they are willing to compromise subject-verb agreement to refrain from (grammatical but) highly improbable structures. The results suggest that the prior probability of alternative analyses modulates the interpretation of agreement.
Collapse
Affiliation(s)
- Maayan Keshev
- Linguistics Department, Tel-Aviv University, Tel-Aviv, Israel.
| | - Aya Meltzer-Asscher
- Linguistics Department, Tel-Aviv University, Tel-Aviv, Israel; Sagol School of Neuroscience, Tel-Aviv University, Tel-Aviv, Israel
| |
Collapse
|
46
|
Ness T, Meltzer-Asscher A. Love thy neighbor: Facilitation and inhibition in the competition between parallel predictions. Cognition 2020; 207:104509. [PMID: 33213831 DOI: 10.1016/j.cognition.2020.104509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Revised: 09/22/2020] [Accepted: 10/31/2020] [Indexed: 11/28/2022]
Abstract
Ample evidence suggests that during word recognition and production, simultaneously activated lexical and sublexical representations interact, demonstrating varied patterns of facilitation and inhibition in various tasks and measures. A separate line of research has led to a growing consensus that prediction during sentence processing involves activating multiple possible predictions. However, very little is known about the nature of the interactions between parallel predictions. The current study employed a speeded cloze task to probe competition between simultaneously activated predictions. We focused on the modal response (the most probable completion for a sentence) and its strongest competitor (the second most probable completion). Examining production latencies of the modal response, the results showed an interaction between competitor strength and the semantic relatedness between the competitor and the modal: when the two were related, the stronger the competitor was, the more it facilitated production; however, when the two were unrelated, the stronger the competitor was, the more inhibition it caused. These results contrast with the pattern observed for the influences of near and distant semantic neighbors on word recognition and production. However, we show that when the different nature of the tasks is taken into consideration, these patterns of interaction between parallel predictions can be accounted for by the interactive activation and competition (IAC) model used to account for previous neighborhood effects (Chen & Mirman, 2012).
Collapse
Affiliation(s)
- Tal Ness
- Sagol School of Neuroscience, Tel Aviv University, Israel.
| | - Aya Meltzer-Asscher
- Sagol School of Neuroscience, Tel Aviv University, Israel; Linguistics Department, Tel Aviv University, Israel
| |
Collapse
|
47
|
Cross ZR, Zou-Williams L, Wilkinson EM, Schlesewsky M, Bornkessel-Schlesewsky I. Mini Pinyin: A modified miniature language for studying language learning and incremental sentence processing. Behav Res Methods 2021; 53:1218-39. [PMID: 33021699 DOI: 10.3758/s13428-020-01473-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Artificial grammar learning (AGL) paradigms are used extensively to characterise (neuro)cognitive bases of language learning. However, despite their effectiveness in characterising the capacity to learn complex structured sequences, AGL paradigms lack ecological validity and typically do not account for cross-linguistic differences in sentence comprehension. Here, we describe a new modified miniature language paradigm - Mini Pinyin - that mimics natural language as it is based on an existing language (Mandarin Chinese) and includes both structure and meaning. Mini Pinyin contains a number of cross-linguistic elements, including varying word orders and classifier-noun rules. To evaluate the effectiveness of Mini Pinyin, 76 (mean age = 24.9; 26 female) monolingual native English speakers completed a learning phase followed by a sentence acceptability judgement task. Generalised mixed effects modelling revealed that participants attained a moderate degree of accuracy on the judgement task, with performance scores ranging from 25% to 100% accuracy depending on the word order of the sentence. Further, sentences compatible with the canonical English word order were learned more efficiently than non-canonical word orders. We controlled for inter-individual differences in statistical learning ability, which accounted for ~20% of the variance in performance on the sentence judgement task. We provide stimuli and statistical analysis scripts as open-source resources and discuss how future research can utilise this paradigm to study the neurobiological basis of language learning. Mini Pinyin affords a convenient tool for improving the future of language learning research by building on the parameters of traditional AGL or existing miniature language paradigms.
Collapse
|
48
|
Engelmann F, Jӓger LA, Vasishth S. The Effect of Prominence and Cue Association on Retrieval Processes: A Computational Account. Cogn Sci 2020; 43:e12800. [PMID: 31858626 DOI: 10.1111/cogs.12800] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2018] [Revised: 10/03/2019] [Accepted: 10/10/2019] [Indexed: 11/30/2022]
Abstract
We present a comprehensive empirical evaluation of the ACT-R-based model of sentence processing developed by Lewis and Vasishth (2005) (LV05). The predictions of the model are compared with the results of a recent meta-analysis of published reading studies on retrieval interference in reflexive-/reciprocal-antecedent and subject-verb dependencies (Jäger, Engelmann, & Vasishth, 2017). The comparison shows that the model has only partial success in explaining the data; and we propose that its prediction space is restricted by oversimplifying assumptions. We then implement a revised model that takes into account differences between individual experimental designs in terms of the prominence of the target and the distractor in memory- and context-dependent cue-feature associations. The predictions of the original and the revised model are quantitatively compared with the results of the meta-analysis. Our simulations show that, compared to the original LV05 model, the revised model accounts for the data better. The results suggest that effects of prominence and variable cue-feature associations need to be considered in the interpretation of existing empirical results and in the design and planning of future experiments. With regard to retrieval interference in sentence processing and to the broader field of psycholinguistic studies, we conclude that well-specified models in tandem with high-powered experiments are needed in order to uncover the underlying cognitive processes.
Collapse
Affiliation(s)
- Felix Engelmann
- Development and Hearing, Division of Human Communication, University of Manchester
| | - Lena A Jӓger
- Department of Computer Science, University of Potsdam
| | | |
Collapse
|
49
|
Vercesi L, Sabnis P, Finocchiaro C, Cattaneo L, Tonolli E, Miceli G. The role of the l-IPS in the comprehension of reversible and irreversible sentences: an rTMS study. Brain Struct Funct 2020; 225:2403-14. [PMID: 32844277 DOI: 10.1007/s00429-020-02130-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2020] [Accepted: 08/07/2020] [Indexed: 11/20/2022]
Abstract
Thematic roles can be seen as semantic labels assigned to who/what is taking part in the event denoted by a verb. Encoding thematic relations is crucial for sentence interpretation since it relies on both syntactic and semantic aspects. In previous studies, repetitive transcranial magnetic stimulation (rTMS) over the left inferior intraparietal sulcus (l-IPS) selectively influenced performance accuracy on reversible passive (but not active) sentences. The effect was attributed to the fact that in these sentences the assignment of the agent and theme roles requires re-analysis of the first-pass sentence parsing.
To evaluate the role of reversibility and non-canonical word order (passive voice) on the effect, rTMS was applied over l-IPS during a sentence comprehension task that included reversible and irreversible, active and passive sentences. Participants were asked to identify who/what was performing the action or who/what the action was being performed on.
Stimulation of the l-IPS increased response time on reversible passive sentences but not on reversible active sentences. Importantly, no effect was found on irreversible sentences, irrespective of sentence diathesis. Results suggest that neither reversibility nor sentence diathesis alone are responsible for the effect and that the effect is likely to be triggered/constrained by a combination of semantic reversibility and non-canonical word order. Combined with the results of previous studies, and irrespective of the specific role of each feature, these findings support the view that the l-IPS is critically involved in the assignment of thematic roles in reversible sentences.
Collapse
|
50
|
Futrell R, Gibson E, Levy RP. Lossy-Context Surprisal: An Information-Theoretic Model of Memory Effects in Sentence Processing. Cogn Sci 2020; 44:e12814. [PMID: 32100918 PMCID: PMC7065005 DOI: 10.1111/cogs.12814] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2019] [Revised: 10/31/2019] [Accepted: 11/14/2019] [Indexed: 11/29/2022]
Abstract
A key component of research on human sentence processing is to characterize the processing difficulty associated with the comprehension of words in context. Models that explain and predict this difficulty can be broadly divided into two kinds, expectation-based and memory-based. In this work, we present a new model of incremental sentence processing difficulty that unifies and extends key features of both kinds of models. Our model, lossy-context surprisal, holds that the processing difficulty at a word in context is proportional to the surprisal of the word given a lossy memory representation of the context-that is, a memory representation that does not contain complete information about previous words. We show that this model provides an intuitive explanation for an outstanding puzzle involving interactions of memory and expectations: language-dependent structural forgetting, where the effects of memory on sentence processing appear to be moderated by language statistics. Furthermore, we demonstrate that dependency locality effects, a signature prediction of memory-based theories, can be derived from lossy-context surprisal as a special case of a novel, more general principle called information locality.
Collapse
Affiliation(s)
- Richard Futrell
- Department of Language ScienceUniversity of California, Irvine
| | - Edward Gibson
- Department of Brain and Cognitive SciencesMassachusetts Institute of Technology
| | - Roger P. Levy
- Department of Brain and Cognitive SciencesMassachusetts Institute of Technology
| |
Collapse
|