1
|
Mamashli F, Khan S, Hatamimajoumerd E, Jas M, Uluç I, Lankinen K, Obleser J, Friederici AD, Maess B, Ahveninen J. Characterizing directional dynamics of semantic prediction based on inter-regional temporal generalization. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.13.580183. [PMID: 38405823 PMCID: PMC10888763 DOI: 10.1101/2024.02.13.580183] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/27/2024]
Abstract
The event-related potential/field component N400(m) has been widely used as a neural index for semantic prediction. It has long been hypothesized that feedback information from inferior frontal areas plays a critical role in generating the N400. However, due to limitations in causal connectivity estimation, direct testing of this hypothesis has remained difficult. Here, magnetoencephalography (MEG) data was obtained during a classic N400 paradigm where the semantic predictability of a fixed target noun was manipulated in simple German sentences. To estimate causality, we implemented a novel approach based on machine learning and temporal generalization to estimate the effect of inferior frontal gyrus (IFG) on temporal areas. In this method, a support vector machine (SVM) classifier is trained on each time point of the neural activity in IFG to classify less predicted (LP) and highly predicted (HP) nouns and then tested on all time points of superior/middle temporal sub-regions activity (and vice versa, to establish spatio-temporal evidence for or against causality). The decoding accuracy was significantly above chance level when the classifier was trained on IFG activity and tested on future activity in superior and middle temporal gyrus (STG/MTG). The results present new evidence for a model predictive speech comprehension where predictive IFG activity is fed back to shape subsequent activity in STG/MTG, implying a feedback mechanism in N400 generation. In combination with the also observed strong feedforward effect from left STG/MTG to IFG, our findings provide evidence of dynamic feedback and feedforward influences between IFG and temporal areas during N400 generation.
Collapse
Affiliation(s)
- Fahimeh Mamashli
- Department of Radiology, Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Harvard Medical School, Boston, MA 02129
| | - Sheraz Khan
- Department of Radiology, Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Harvard Medical School, Boston, MA 02129
| | - Elaheh Hatamimajoumerd
- Department of Electrical and Computer Engineering, Northeastern University, Boston, MA 02115
| | - Mainak Jas
- Department of Radiology, Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Harvard Medical School, Boston, MA 02129
| | - Işıl Uluç
- Department of Radiology, Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Harvard Medical School, Boston, MA 02129
| | - Kaisu Lankinen
- Department of Radiology, Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Harvard Medical School, Boston, MA 02129
| | - Jonas Obleser
- Department of Psychology, University of Lübeck, Lübeck 23562, Germany
| | - Angela D. Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - Burkhard Maess
- MEG and Cortical Networks Group, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany
| | - Jyrki Ahveninen
- Department of Radiology, Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Harvard Medical School, Boston, MA 02129
| |
Collapse
|
2
|
Bruera A, Tao Y, Anderson A, Çokal D, Haber J, Poesio M. Modeling Brain Representations of Words' Concreteness in Context Using GPT-2 and Human Ratings. Cogn Sci 2023; 47:e13388. [PMID: 38103208 DOI: 10.1111/cogs.13388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 09/12/2023] [Accepted: 10/27/2023] [Indexed: 12/18/2023]
Abstract
The meaning of most words in language depends on their context. Understanding how the human brain extracts contextualized meaning, and identifying where in the brain this takes place, remain important scientific challenges. But technological and computational advances in neuroscience and artificial intelligence now provide unprecedented opportunities to study the human brain in action as language is read and understood. Recent contextualized language models seem to be able to capture homonymic meaning variation ("bat", in a baseball vs. a vampire context), as well as more nuanced differences of meaning-for example, polysemous words such as "book", which can be interpreted in distinct but related senses ("explain a book", information, vs. "open a book", object) whose differences are fine-grained. We study these subtle differences in lexical meaning along the concrete/abstract dimension, as they are triggered by verb-noun semantic composition. We analyze functional magnetic resonance imaging (fMRI) activations elicited by Italian verb phrases containing nouns whose interpretation is affected by the verb to different degrees. By using a contextualized language model and human concreteness ratings, we shed light on where in the brain such fine-grained meaning variation takes place and how it is coded. Our results show that phrase concreteness judgments and the contextualized model can predict BOLD activation associated with semantic composition within the language network. Importantly, representations derived from a complex, nonlinear composition process consistently outperform simpler composition approaches. This is compatible with a holistic view of semantic composition in the brain, where semantic representations are modified by the process of composition itself. When looking at individual brain areas, we find that encoding performance is statistically significant, although with differing patterns of results, suggesting differential involvement, in the posterior superior temporal sulcus, inferior frontal gyrus and anterior temporal lobe, and in motor areas previously associated with processing of concreteness/abstractness.
Collapse
Affiliation(s)
- Andrea Bruera
- School of Electronic Engineering and Computer Science, Cognitive Science Research Group, Queen Mary University of London
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences
| | - Yuan Tao
- Department of Cognitive Science, Johns Hopkins University
| | | | - Derya Çokal
- Department of German Language and Literature I-Linguistics, University of Cologne
| | - Janosch Haber
- School of Electronic Engineering and Computer Science, Cognitive Science Research Group, Queen Mary University of London
- Chattermill, London
| | - Massimo Poesio
- School of Electronic Engineering and Computer Science, Cognitive Science Research Group, Queen Mary University of London
- Department of Information and Computing Sciences, University of Utrecht
| |
Collapse
|
3
|
Piñango MM. Solving the elusiveness of word meanings: two arguments for a continuous meaning space for language. Front Artif Intell 2023; 6:1025293. [PMID: 37404340 PMCID: PMC10315845 DOI: 10.3389/frai.2023.1025293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Accepted: 03/28/2023] [Indexed: 07/06/2023] Open
Abstract
I explore the hypothesis that the experience of meaning discreteness when we think about the "meaning" of a word is a "communicative" illusion. The illusion is created by processing-contextual constraints that impose disambiguation on the semantic input making salient a specific interpretation within a conceptual space that is otherwise continuous. It is this salience that we experience as discreteness. The understanding of word meaning as non-discrete raises the question of what is context; what are the mechanisms of constraint that it imposes and what is the nature of the conceptual space with which pronunciations (i.e., visual/oral signs) associate themselves. I address these questions by leveraging an algebraic continuous system for word meaning that is itself constrained by two fundamental parameters: control-asymmetry and connectedness. I evaluate this model by meeting two challenges to word meaning discreteness (1) cases where the same pronunciation is associated with multiple senses that are nonetheless interdependent, e.g., English "smoke," and (2) cases where the same pronunciation is associated with a family of meanings, minimally distinct from each other organized as a "cline," e.g., English "have." These cases are not marginal-they are ubiquitous in languages across the world. Any model that captures them is accounting for the meaning system for language. At the heart of the argumentation is the demonstration of how the parameterized space naturally organizes these kinds of cases without appeal for further categorization or segmentation of any kind. From this, I conclude that discreteness in word meaning is epiphenomenal: it is the experience of salience produced by contextual constraints. And that this is possible because, by and large, every time that we become consciously aware of the conceptual structure associated with a pronunciation, i.e., its meaning, we do so under real-time processing conditions which are biased toward producing a specific interpretation in reference to a specific situation in the world. Supporting it is a parameterized space that gives rise to lexico-conceptual representations: generalized algebraic structures necessary for the identification, processing, and encoding of an individual's understanding of the world.
Collapse
|
4
|
Toneva M, Mitchell TM, Wehbe L. Combining computational controls with natural text reveals aspects of meaning composition. NATURE COMPUTATIONAL SCIENCE 2022; 2:745-757. [PMID: 36777107 PMCID: PMC9912822 DOI: 10.1038/s43588-022-00354-6] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
To study a core component of human intelligence-our ability to combine the meaning of words-neuroscientists have looked to linguistics. However, linguistic theories are insufficient to account for all brain responses reflecting linguistic composition. In contrast, we adopt a data-driven approach to study the composed meaning of words beyond their individual meaning, which we term 'supra-word meaning'. We construct a computational representation for supra-word meaning and study its brain basis through brain recordings from two complementary imaging modalities. Using functional magnetic resonance imaging, we reveal that hubs that are thought to process lexical meaning also maintain supra-word meaning, suggesting a common substrate for lexical and combinatorial semantics. Surprisingly, we cannot detect supra-word meaning in magnetoencephalography, which suggests that composed meaning might be maintained through a different neural mechanism than the synchronized firing of pyramidal cells. This sensitivity difference has implications for past neuroimaging results and future wearable neurotechnology.
Collapse
Affiliation(s)
- Mariya Toneva
- Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA, USA.,Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA.,Max Planck Institute for Software Systems, Saarbrücken, Germany
| | - Tom M. Mitchell
- Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA, USA.,Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Leila Wehbe
- Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA, USA.,Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA.,Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, USA.,Correspondence and requests for materials should be addressed to Leila Wehbe.
| |
Collapse
|
5
|
Huizeling E, Arana S, Hagoort P, Schoffelen JM. Lexical Frequency and Sentence Context Influence the Brain's Response to Single Words. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2022; 3:149-179. [PMID: 37215333 PMCID: PMC10158670 DOI: 10.1162/nol_a_00054] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Accepted: 09/03/2021] [Indexed: 05/24/2023]
Abstract
Typical adults read remarkably quickly. Such fast reading is facilitated by brain processes that are sensitive to both word frequency and contextual constraints. It is debated as to whether these attributes have additive or interactive effects on language processing in the brain. We investigated this issue by analysing existing magnetoencephalography data from 99 participants reading intact and scrambled sentences. Using a cross-validated model comparison scheme, we found that lexical frequency predicted the word-by-word elicited MEG signal in a widespread cortical network, irrespective of sentential context. In contrast, index (ordinal word position) was more strongly encoded in sentence words, in left front-temporal areas. This confirms that frequency influences word processing independently of predictability, and that contextual constraints affect word-by-word brain responses. With a conservative multiple comparisons correction, only the interaction between lexical frequency and surprisal survived, in anterior temporal and frontal cortex, and not between lexical frequency and entropy, nor between lexical frequency and index. However, interestingly, the uncorrected index × frequency interaction revealed an effect in left frontal and temporal cortex that reversed in time and space for intact compared to scrambled sentences. Finally, we provide evidence to suggest that, in sentences, lexical frequency and predictability may independently influence early (<150 ms) and late stages of word processing, but also interact during late stages of word processing (>150-250 ms), thus helping to converge previous contradictory eye-tracking and electrophysiological literature. Current neurocognitive models of reading would benefit from accounting for these differing effects of lexical frequency and predictability on different stages of word processing.
Collapse
Affiliation(s)
- Eleanor Huizeling
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - Sophie Arana
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - Peter Hagoort
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | | |
Collapse
|
6
|
Nour Eddine S, Brothers T, Kuperberg GR. The N400 in silico: A review of computational models. PSYCHOLOGY OF LEARNING AND MOTIVATION 2022. [DOI: 10.1016/bs.plm.2022.03.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
7
|
Composition within and between Languages in the Bilingual Mind: MEG Evidence from Korean/English Bilinguals. eNeuro 2021; 8:8/6/ENEURO.0084-21.2021. [PMID: 34732542 PMCID: PMC8570682 DOI: 10.1523/eneuro.0084-21.2021] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Revised: 07/14/2021] [Accepted: 08/16/2021] [Indexed: 12/04/2022] Open
Abstract
The ability of the human brain to build complex expressions from simpler parts is fascinating, but the ability of the bilingual brain to do so is perhaps even more remarkable. When highly proficient bilinguals converse, they can fluidly switch from one language to another even inside sentences. Thus, they build expressions using words from more than one language. How are bilinguals able to compose words across different languages in real time? While robust evidence has implicated the left anterior temporal lobe (LATL) for the composition of words within one language, we do not know how the LATL, or other regions implicated for composition, operates when the language switches. We also do not know whether prefrontal regions associated with language control are recruited for language switching during composition. We addressed these questions with magnetoencephalography measurements in bilinguals who are fluent in two typologically distant languages, English and Korean. We observed early composition effects in the LATL at ∼200 ms that were unaffected by either language or orthography switching, which was also varied (Hangul vs Roman alphabet). Thus, the combinatory mechanism at 200 ms housed in the anterior temporal cortex appears blind to the language in which its input concepts are expressed. However, in later time windows, language and orthography switching interacted both in regions implicated for composition [LATL, ventromedial prefrontal cortex, left inferior frontal gyrus (LIFG)] as well as in regions associated with language control (ACC, LIFG). This establishes a starting point for understanding how bilingual brains code switch: words are initially combined without consideration of which language they come from, but language switching affects later processing.
Collapse
|
8
|
Antal C, de Almeida RG. Indeterminate and Enriched Propositions in Context Linger: Evidence From an Eye-Tracking False Memory Paradigm. Front Psychol 2021; 12:741685. [PMID: 34744914 PMCID: PMC8567172 DOI: 10.3389/fpsyg.2021.741685] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2021] [Accepted: 09/07/2021] [Indexed: 11/29/2022] Open
Abstract
A sentence such as We finished the paper is indeterminate with regards to what we finished doing with the paper. Indeterminate sentences constitute a test case for two major issues regarding language comprehension: (1) how we compose sentence meaning; and (2) what is retained in memory about what we read in context over time. In an eye-tracking experiment, participants read short stories that were unexpectedly followed by one of three recognition probes: (a) an indeterminate sentence (Lisa began the book), that is identical to the one in the story; (b) an enriched but false probe (Lisa began reading the book); and (c) a contextually unrelated probe (Lisa began writing the book). The probes were presented either at the offset of the original indeterminate sentence in context or following additional neutral discourse. We measured accuracy, probe recognition time, and reading times of the probe sentences. Results showed that, at the immediate time point, participants correctly accepted the identical probes with high accuracy and short recognition times, but that this effect reversed to chance-level accuracy and significantly longer recognition times at the delayed time point. We also found that participants falsely accept the enriched probe at both time points 50% of the time. There were no reading-time differences between identical and enriched probes, suggesting that enrichment might not be an early, mandatory process for indeterminate sentences. Overall, results suggest that while context produces an enriched proposition, an unenriched proposition true to the indeterminate sentence also lingers in memory.
Collapse
Affiliation(s)
- Caitlyn Antal
- Department of Psychology, Concordia University, Montreal, QC, Canada
| | | |
Collapse
|
9
|
Xue W, Liu M. Complement Coercion in Mandarin Chinese: Evidence from a Self-paced Reading Study. JOURNAL OF PSYCHOLINGUISTIC RESEARCH 2021; 50:757-776. [PMID: 33206288 DOI: 10.1007/s10936-020-09744-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/31/2020] [Indexed: 06/11/2023]
Abstract
The study aims to explore the processing pattern of Mandarin Chinese sentences with complement coercion. Complement coercion is a known linguistic phenomenon in which some verbs, semantically requiring an event-denoting complement, are combined with an entity-denoting complement, as in Mary began the book. The combination (i.e., event-selecting verb + entity-denoting noun) has been reported to involve type mismatch, and thus elicits processing difficulty. While the phenomenon has been extensively studied in Indo-European languages, such as English and German, it is debatable if the phenomenon exists in a typologically distinct language from English (e.g., in structural complexity of words), such as Mandarin. To provide empirical evidence, the study conducted a self-paced reading experiment to compare the processing patterns of coercion sentences and non-coercion controls in Mandarin. The results showed longer reading times for the coercion sentences than the non-coercion counterparts, which supported previous findings about the processing difficulty of complement coercion.
Collapse
Affiliation(s)
- Wenting Xue
- Department of Linguistics and Translation, City University of Hong Kong, Q78, B7704, Blue Zone, Yeung Kin Man Academic Building, 83, Tat Chee Avenue, Kowloon, Hong Kong SAR, China.
| | - Meichun Liu
- Department of Linguistics and Translation, City University of Hong Kong, Q78, B7704, Blue Zone, Yeung Kin Man Academic Building, 83, Tat Chee Avenue, Kowloon, Hong Kong SAR, China
| |
Collapse
|
10
|
Xue W, Liu M, Politzer-Ahles S. Processing of Complement Coercion With Aspectual Verbs in Mandarin Chinese: Evidence From a Self-Paced Reading Study. Front Psychol 2021; 12:643571. [PMID: 34135811 PMCID: PMC8201986 DOI: 10.3389/fpsyg.2021.643571] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Accepted: 05/03/2021] [Indexed: 11/13/2022] Open
Abstract
This study examines whether Chinese complement coercion sentences with aspectual verbs will elicit processing difficulty during real-time comprehension. Complement coercion is a linguistic phenomenon in which certain verbs (e.g., start, enjoy), requiring an event-denoting complement, are combined with an entity-denoting complement (e.g., book), as in The author started a book. Previous studies have reported that the entity-denoting complement elicited processing difficulty following verbs that require event argument compared with verbs that do not (e.g., The author wrote a book). While the processing of complement coercion has been extensively studied in Indo-European languages such as English and German, it is relatively under-researched in Sino-Tibetan languages such as Mandarin Chinese. Given the fact that there are many linguistic elements behaving distinctly in the different language families, for instance, verbs with respect to their semantic properties and syntactic representations of the complement, it is meaningful to investigate whether or not the existing linguistic differences have any effect on the processing of complement coercion in Mandarin. With this research goal, we recorded self-paced reading time of 61 native Mandarin speakers to investigate the processing of the entity-denoting complement in sentences with three different verb types (aspectual verbs which require an event-denoting complement, preferred verbs which denote a preferred interpretation of the aspectual expressions, and non-preferred verbs which denote a non-preferred but plausible interpretation of the aspectual expressions), as exemplified in 顾客开始/填写/查看这份问卷 gù-kè kāi-shǐ/tián-xiě/chá-kàn zhè-fèn wèn-juàn “The customer started/filled in/checked the questionnaire.” It was found that the entity noun complement (e.g., 这份问卷 zhè-fèn wèn-juàn “the questionnaire”) elicited significantly longer reading times in coercion sentences than non-coercion counterparts. The results are compatible with the previous findings in English that complement coercion sentences impose processing cost during real-time comprehension. The study contributes empirical evidence to coercion studies cross-linguistically.
Collapse
Affiliation(s)
- Wenting Xue
- Department of Linguistics and Translation, City University of Hong Kong, Hong Kong, China
| | - Meichun Liu
- Department of Linguistics and Translation, City University of Hong Kong, Hong Kong, China
| | - Stephen Politzer-Ahles
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, China
| |
Collapse
|
11
|
Jackson RL, Bajada CJ, Lambon Ralph MA, Cloutman LL. The Graded Change in Connectivity across the Ventromedial Prefrontal Cortex Reveals Distinct Subregions. Cereb Cortex 2021; 30:165-180. [PMID: 31329834 PMCID: PMC7029692 DOI: 10.1093/cercor/bhz079] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2018] [Revised: 02/21/2019] [Accepted: 03/19/2019] [Indexed: 11/20/2022] Open
Abstract
The functional heterogeneity of the ventromedial prefrontal cortex (vmPFC) suggests it may include distinct functional subregions. To date these have not been well elucidated. Regions with differentiable connectivity (and as a result likely dissociable functions) may be identified using emergent data-driven approaches. However, prior parcellations of the vmPFC have only considered hard splits between distinct regions, although both hard and graded connectivity changes may exist. Here we determine the full pattern of change in structural and functional connectivity across the vmPFC for the first time and extract core distinct regions. Both structural and functional connectivity varied along a dorsomedial to ventrolateral axis from relatively dorsal medial wall regions to relatively lateral basal orbitofrontal cortex. The pattern of connectivity shifted from default mode network to sensorimotor and multimodal semantic connections. This finding extends the classical distinction between primate medial and orbital regions by demonstrating a similar gradient in humans for the first time. Additionally, core distinct regions in the medial wall and orbitofrontal cortex were identified that may show greater correspondence to functional differences than prior hard parcellations. The possible functional roles of the orbitofrontal cortex and medial wall are discussed.
Collapse
Affiliation(s)
- Rebecca L Jackson
- Medical Research Council Cognition & Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Claude J Bajada
- Faculty of Medicine and Surgery, University of Malta, Msida, MSD, Malta
| | - Matthew A Lambon Ralph
- Medical Research Council Cognition & Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Lauren L Cloutman
- Neuroscience and Aphasia Research Unit (NARU), Division of Neuroscience & Experimental Psychology (Zochonis Building), University of Manchester, Manchester, UK
| |
Collapse
|
12
|
Riven L, de Almeida RG. Context Breeds False Memories for Indeterminate Sentences. Front Psychol 2021; 12:616065. [PMID: 33776841 PMCID: PMC7994259 DOI: 10.3389/fpsyg.2021.616065] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2020] [Accepted: 02/10/2021] [Indexed: 11/19/2022] Open
Abstract
What are the roles of semantic and pragmatic processes in the interpretation of sentences in context? And how do we attain such interpretations when sentences are deemed indeterminate? Consider a sentence such as "Lisa began the book" which does not overtly express the activity that Lisa began doing with the book. Although it is believed that individuals compute a specified event to enrich the sentential representation - yielding, e.g., "began [reading] the book" - there is no evidence that a default event meaning is attained. Moreover, if indeterminate sentences are enriched, it is not clear where the information required to generate enriched interpretations come from. Experiment 1 showed that, in isolation, there is no default interpretation for indeterminate sentences. The experiment also showed that biasing contexts constrain event interpretations and improve plausibility judgments, suggesting that event representations for indeterminate sentences are generated by context. In Experiment 2, participants heard biasing discourse contexts and later falsely recognized foil sentences containing the biased events ("Lisa began reading the book") at the same proportion and with the same confidence as the original indeterminate sentence ("Lisa began the book"). We suggest that indeterminate sentences trigger event-enriching inferences but only in sufficiently constraining contexts. We also suggest that indeterminate sentences create two memory traces, one for the proposition consistent with the denotational, compositional meaning, and another for the proposition that is enriched pragmatically over time.
Collapse
|
13
|
Frankland SM, Greene JD. Two Ways to Build a Thought: Distinct Forms of Compositional Semantic Representation across Brain Regions. Cereb Cortex 2020; 30:3838-3855. [PMID: 32279078 DOI: 10.1093/cercor/bhaa001] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2019] [Revised: 11/30/2019] [Accepted: 01/02/2020] [Indexed: 12/23/2022] Open
Abstract
To understand a simple sentence such as "the woman chased the dog", the human mind must dynamically organize the relevant concepts to represent who did what to whom. This structured recombination of concepts (woman, dog, chased) enables the representation of novel events, and is thus a central feature of intelligence. Here, we use functional magnetic resonance (fMRI) and encoding models to delineate the contributions of three brain regions to the representation of relational combinations. We identify a region of anterior-medial prefrontal cortex (amPFC) that shares representations of noun-verb conjunctions across sentences: for example, a combination of "woman" and "chased" to encode woman-as-chaser, distinct from woman-as-chasee. This PFC region differs from the left-mid superior temporal cortex (lmSTC) and hippocampus, two regions previously implicated in representing relations. lmSTC represents broad role combinations that are shared across verbs (e.g., woman-as-agent), rather than narrow roles, limited to specific actions (woman-as-chaser). By contrast, a hippocampal sub-region represents events sharing narrow conjunctions as dissimilar. The success of the hippocampal conjunctive encoding model is anti-correlated with generalization performance in amPFC on a trial-by-trial basis, consistent with a pattern separation mechanism. Thus, these three regions appear to play distinct, but complementary, roles in encoding compositional event structure.
Collapse
Affiliation(s)
- Steven M Frankland
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08540
| | - Joshua D Greene
- Department of Psychology, Center for Brain Science, Harvard University, Cambridge, MA 02138
| |
Collapse
|
14
|
Pylkkänen L. Neural basis of basic composition: what we have learned from the red-boat studies and their extensions. Philos Trans R Soc Lond B Biol Sci 2019; 375:20190299. [PMID: 31840587 DOI: 10.1098/rstb.2019.0299] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Language is our mind's most powerful generative system for the expression of meaning and thought. What are the neural mechanisms of our ability to compose complex meanings from simpler representations? This question is impossible to answer unless we decompose the notion of 'meaning composition' in some theoretically guided way and then begin to assess the extent to which brain activity tracks the posited subroutines. Here, I summarize results from a body of MEG research that has begun to address this question from the ground up, first focusing on simple combinations of two words. The work sets off with a hypothesis space offered by theoretical linguistics, positing syntactic and logico-semantic composition as the main combinatory routines, but then reveals that the most consistent and prominent reflection of composition, localized in the left anterior temporal cortex at 200-250 ms, cannot be described with this toolkit. Instead, this activity tracks a much more conceptually driven process, robustly sensitive to the density of the conceptual feature space of the composing items. I will describe our functional understanding of this activity and how it may operate within a broader 'combinatory network.' This article is part of the theme issue 'Towards mechanistic models of meaning composition'.
Collapse
Affiliation(s)
- Liina Pylkkänen
- Department of Linguistics, New York University, New York, NY, USA.,Department of Psychology, New York University, New York, NY, USA.,NYUAD Institute, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| |
Collapse
|
15
|
Abstract
Morphemes (e.g. [tune], [-ful], [-ly]) are the basic blocks with which complex meaning is built. Here, I explore the critical role that morpho-syntactic rules play in forming the meaning of morphologically complex words, from two primary standpoints: (i) how semantically rich stem morphemes (e.g. explode, bake, post) combine with syntactic operators (e.g. -ion, -er, -age) to output a semantically predictable result; (ii) how this process can be understood in terms of mathematical operations, easily allowing the brain to generate representations of novel morphemes and comprehend novel words. With these ideas in mind, I offer a model of morphological processing that incorporates semantic and morpho-syntactic operations in service to meaning composition, and discuss how such a model could be implemented in the human brain. This article is part of the theme issue 'Towards mechanistic models of meaning composition'.
Collapse
Affiliation(s)
- Laura Gwilliams
- Psychology Department, New York University, New York, NY 10003, USA
| |
Collapse
|
16
|
Stockall L, Manouilidou C, Gwilliams L, Neophytou K, Marantz A. Prefix Stripping Re-Re-Revisited: MEG Investigations of Morphological Decomposition and Recomposition. Front Psychol 2019; 10:1964. [PMID: 31551860 PMCID: PMC6743348 DOI: 10.3389/fpsyg.2019.01964] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2019] [Accepted: 08/09/2019] [Indexed: 11/25/2022] Open
Abstract
We revisit a long-standing question in the psycholinguistic and neurolinguistic literature on comprehending morphologically complex words: are prefixes and suffixes processed using the same cognitive mechanisms? Recent work using Magnetoencephalography (MEG) to uncover the dynamic temporal and spatial responses evoked by visually presented complex suffixed single words provide us with a comprehensive picture of morphological processing in the brain, from early, form-based decomposition, through lexical access, grammatically constrained recomposition, and semantic interpretation. In the present study, we find that MEG responses to prefixed words reveal interesting early differences in the lateralization of the form-based decomposition response compared to the effects reported in the literature for suffixed words, but a very similar post-decomposition profile. These results not only address a question stretching back to the earliest days of modern psycholinguistics, but also add critical support and nuance to our much newer emerging understanding of spatial organization and temporal dynamics of morphological processing in the human brain.
Collapse
Affiliation(s)
- Linnaea Stockall
- Department of Linguistics, Queen Mary University of London, London, United Kingdom
| | - Christina Manouilidou
- Department of Comparative and General Linguistics, University of Ljubljana, Ljubljana, Slovenia
| | - Laura Gwilliams
- Department of Psychology, New York University, New York, NY, United States.,New York University Abu Dhabi Institute, New York University, Abu Dhabi, United Arab Emirates
| | - Kyriaki Neophytou
- New York University Abu Dhabi Institute, New York University, Abu Dhabi, United Arab Emirates.,Department of Cognitive Science, Johns Hopkins University, Baltimore, MD, United States
| | - Alec Marantz
- Department of Psychology, New York University, New York, NY, United States.,New York University Abu Dhabi Institute, New York University, Abu Dhabi, United Arab Emirates.,Department of Linguistics, New York University, New York, NY, United States
| |
Collapse
|
17
|
How Does iReadMore Therapy Change the Reading Network of Patients with Central Alexia? J Neurosci 2019; 39:5719-5727. [PMID: 31085605 DOI: 10.1523/jneurosci.1426-18.2019] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2018] [Revised: 03/07/2019] [Accepted: 03/16/2019] [Indexed: 11/21/2022] Open
Abstract
Central alexia (CA) is an acquired reading disorder co-occurring with a generalized language deficit (aphasia). The roles of perilesional and ipsilesional tissue in recovery from poststroke aphasia are unclear. We investigated the impact of reading training (using iReadMore, a therapy app) on the connections within and between the right and left hemisphere of the reading network of patients with CA. In patients with pure alexia, iReadMore increased feedback from left inferior frontal gyrus (IFG) region to the left occipital (OCC) region. We aimed to identify whether iReadMore therapy was effective through a similar mechanism in patients with CA. Participants with chronic poststroke CA (n = 23) completed 35 h of iReadMore training over 4 weeks. Reading accuracy for trained and untrained words was assessed before and after therapy. The neural response to reading trained and untrained words in the left and right OCC, ventral occipitotemporal, and IFG regions was examined using event-related magnetoencephalography. The training-related modulation in effective connectivity between regions was modeled at the group level with dynamic causal modeling. iReadMore training improved participants' reading accuracy by an average of 8.4% (range, -2.77 to 31.66) while accuracy for untrained words was stable. Training increased regional sensitivity in bilateral frontal and occipital regions, and strengthened feedforward connections within the left hemisphere. Our data suggest that iReadMore training in these patients modulates lower-order visual representations, as opposed to higher-order, more abstract representations, to improve word-reading accuracy.SIGNIFICANCE STATEMENT This is the first study to conduct a network-level analysis of therapy effects in participants with poststroke central alexia. When patients trained with iReadMore (a multimodal, behavioral, mass practice, computer-based therapy), reading accuracy improved by an average 8.4% on trained items. A network analysis of the magnetoencephalography data associated with this improvement revealed an increase in regional sensitivity in bilateral frontal and occipital regions and strengthening of feedforward connections within the left hemisphere. This indicates that in patients with CA iReadMore engages lower-order, intact resources within the left hemisphere (posterior to their lesion locations) to improve word reading. This provides a foundation for future research to investigate reading network modulation in different CA subtypes, or for sentence-level therapy.
Collapse
|
18
|
Bekemeier N, Brenner D, Klepp A, Biermann-Ruben K, Indefrey P. Electrophysiological correlates of concept type shifts. PLoS One 2019; 14:e0212624. [PMID: 30835763 PMCID: PMC6400391 DOI: 10.1371/journal.pone.0212624] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2018] [Accepted: 02/06/2019] [Indexed: 11/17/2022] Open
Abstract
A recent semantic theory of nominal concepts by Löbner [1] posits that–due to their inherent uniqueness and relationality properties–noun concepts can be classified into four concept types (CTs): sortal, individual, relational, functional. For sortal nouns the default determination is indefinite (a stone), for individual nouns it is definite (the sun), for relational and functional nouns it is possessive (his ear, his father). Incongruent determination leads to a concept type shift: his father (functional concept: unique, relational)–a father (sortal concept: non-unique, non-relational). Behavioral studies on CT shifts have demonstrated a CT congruence effect, with congruent determiners triggering faster lexical decision times on the subsequent noun than incongruent ones [2, 3]. The present ERP study investigated electrophysiological correlates of congruent and incongruent determination in German noun phrases, and specifically, whether the CT congruence effect could be indexed by such classic ERP components as N400, LAN or P600. If incongruent determination affects the lexical retrieval or semantic integration of the noun, it should be reflected in the amplitude of the N400 component. If, however, CT congruence is processed by the same neuronal mechanisms that underlie morphosyntactic processing, incongruent determination should trigger LAN or/and P600. These predictions were tested in two ERP studies. In Experiment 1, participants just listened to noun phrases. In Experiment 2, they performed a wellformedness judgment task. The processing of (in)congruent CTs (his sun vs. the sun) was compared to the processing of morphosyntactic and semantic violations in control conditions. Whereas the control conditions elicited classic electrophysiological violation responses (N400, LAN, & P600), CT-incongruences did not. Instead they showed novel concept-type specific response patterns. The absence of the classic ERP components suggests that CT-incongruent determination is not perceived as a violation of the semantic or morphosyntactic structure of the noun phrase.
Collapse
Affiliation(s)
- Natalia Bekemeier
- Department of Linguistics, Heinrich Heine University, Düsseldorf, Germany
| | - Dorothea Brenner
- Department of Linguistics, Heinrich Heine University, Düsseldorf, Germany
| | - Anne Klepp
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich Heine University, Düsseldorf, Germany
| | - Katja Biermann-Ruben
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich Heine University, Düsseldorf, Germany
| | - Peter Indefrey
- Department of Linguistics, Heinrich Heine University, Düsseldorf, Germany.,Max Planck Institute for Psycholinguistics and Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| |
Collapse
|
19
|
Matchin W, Liao CH, Gaston P, Lau E. Same words, different structures: An fMRI investigation of argument relations and the angular gyrus. Neuropsychologia 2019; 125:116-128. [DOI: 10.1016/j.neuropsychologia.2019.01.019] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2018] [Revised: 01/09/2019] [Accepted: 01/31/2019] [Indexed: 01/01/2023]
|
20
|
Semantic composition of sentences word by word: MEG evidence for shared processing of conceptual and logical elements. Neuropsychologia 2018; 119:392-404. [DOI: 10.1016/j.neuropsychologia.2018.08.016] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2018] [Revised: 08/17/2018] [Accepted: 08/18/2018] [Indexed: 11/21/2022]
|
21
|
Yuk V, Urbain C, Pang EW, Anagnostou E, Buchsbaum D, Taylor MJ. Do you know what I'm thinking? Temporal and spatial brain activity during a theory-of-mind task in children with autism. Dev Cogn Neurosci 2018; 34:139-147. [PMID: 30415185 PMCID: PMC6969351 DOI: 10.1016/j.dcn.2018.08.001] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2017] [Revised: 08/15/2018] [Accepted: 08/30/2018] [Indexed: 01/31/2023] Open
Abstract
First MEG study of neural underpinnings of theory of mind differences in autism. Children with autism show decreased LTPJ activity from 300 to 375 and 425 to 500 ms. Children with autism also show increased RIFG activity from 325 to 375 ms. Co-incident lower LTPJ and higher RIFG activity implies compensatory use of RIFG. Executive functions may augment impaired theory of mind in autism.
The social impairments observed in children with autism spectrum disorder are thought to arise in part from deficits in theory of mind, the ability to understand other people’s thoughts and feelings. To determine the temporal-spatial dynamics of brain activity underlying these atypical theory-of-mind processes, we used magnetoencephalography to characterize the sequence of functional brain patterns (i.e. when and where) related to theory-of-mind reasoning in 19 high-functioning children with autism compared to 22 age- and sex-matched typically-developing children aged 8–12 during a false-belief (theory-of-mind) task. While task performance did not differ between the two groups, children with autism showed reduced activation in the left temporoparietal junction between 300–375 and 425–500 ms, as well as increased activation in the right inferior frontal gyrus from 325 to 375 ms compared to controls. The overlap in decreased temporoparietal junction activity and increased right inferior frontal gyrus activation from 325 to 375 ms suggests that in children with autism, the right inferior frontal gyrus may compensate for deficits in the temporoparietal junction, a neural theory-of-mind network hub. As the right inferior frontal gyrus is involved in inhibitory control, this finding suggests that children with autism rely on executive functions to bolster their false-belief understanding.
Collapse
Affiliation(s)
- Veronica Yuk
- Department of Diagnostic Imaging, The Hospital for Sick Children, Toronto, ON, Canada; Neurosciences and Mental Health Program, SickKids Research Institute, The Hospital for Sick Children, Toronto, ON, Canada; Department of Psychology, University of Toronto, Toronto, ON, Canada.
| | - Charline Urbain
- Department of Diagnostic Imaging, The Hospital for Sick Children, Toronto, ON, Canada; Neurosciences and Mental Health Program, SickKids Research Institute, The Hospital for Sick Children, Toronto, ON, Canada
| | - Elizabeth W Pang
- Neurosciences and Mental Health Program, SickKids Research Institute, The Hospital for Sick Children, Toronto, ON, Canada; Department of Neurology, The Hospital for Sick Children, Toronto, ON, Canada
| | - Evdokia Anagnostou
- Department of Neurology, The Hospital for Sick Children, Toronto, ON, Canada; Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
| | - Daphna Buchsbaum
- Department of Psychology, University of Toronto, Toronto, ON, Canada
| | - Margot J Taylor
- Department of Diagnostic Imaging, The Hospital for Sick Children, Toronto, ON, Canada; Neurosciences and Mental Health Program, SickKids Research Institute, The Hospital for Sick Children, Toronto, ON, Canada; Department of Psychology, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
22
|
Shared neural correlates for building phrases in signed and spoken language. Sci Rep 2018; 8:5492. [PMID: 29615785 PMCID: PMC5882945 DOI: 10.1038/s41598-018-23915-0] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2017] [Accepted: 03/21/2018] [Indexed: 11/08/2022] Open
Abstract
Research on the mental representation of human language has convincingly shown that sign languages are structured similarly to spoken languages. However, whether the same neurobiology underlies the online construction of complex linguistic structures in sign and speech remains unknown. To investigate this question with maximally controlled stimuli, we studied the production of minimal two-word phrases in sign and speech. Signers and speakers viewed the same pictures during magnetoencephalography recording and named them with semantically identical expressions. For both signers and speakers, phrase building engaged left anterior temporal and ventromedial cortices with similar timing, despite different linguistic articulators. Thus the neurobiological similarity of sign and speech goes beyond gross measures such as lateralization: the same fronto-temporal network achieves the planning of structured linguistic expressions.
Collapse
|
23
|
Zarcone A, McRae K, Lenci A, Padó S. Complement Coercion: The Joint Effects of Type and Typicality. Front Psychol 2017; 8:1987. [PMID: 29225585 PMCID: PMC5705615 DOI: 10.3389/fpsyg.2017.01987] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2017] [Accepted: 10/30/2017] [Indexed: 11/30/2022] Open
Abstract
Complement coercion (begin a book →reading) involves a type clash between an event-selecting verb and an entity-denoting object, triggering a covert event (reading). Two main factors involved in complement coercion have been investigated: the semantic type of the object (event vs. entity), and the typicality of the covert event (the author began a book →writing). In previous research, reading times have been measured at the object. However, the influence of the typicality of the subject–object combination on processing an aspectual verb such as begin has not been studied. Using a self-paced reading study, we manipulated semantic type and subject–object typicality, exploiting German word order to measure reading times at the aspectual verb. These variables interacted at the target verb. We conclude that both type and typicality probabilistically guide expectations about upcoming input. These results are compatible with an expectation-based view of complement coercion and language comprehension more generally in which there is rapid interaction between what is typically viewed as linguistic knowledge, and what is typically viewed as domain general knowledge about how the world works.
Collapse
Affiliation(s)
- Alessandra Zarcone
- Department of Computational Linguistics, Universität des Saarlandes, Saarbrücken, Germany
| | - Ken McRae
- Department of Psychology, Social Science Centre, University of Western Ontario, London, ON, Canada
| | - Alessandro Lenci
- Dipartimento di Filologia, Letteratura e Linguistica, Università di Pisa, Pisa, Italy
| | - Sebastian Padó
- Institut für Maschinelle Sprachverarbeitung, Universität Stuttgart, Stuttgart, Germany
| |
Collapse
|
24
|
Blanco-Elorrieta E, Ferreira VS, Del Prato P, Pylkkänen L. The priming of basic combinatory responses in MEG. Cognition 2017; 170:49-63. [PMID: 28942354 DOI: 10.1016/j.cognition.2017.09.010] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2016] [Revised: 09/14/2017] [Accepted: 09/15/2017] [Indexed: 10/18/2022]
Abstract
Priming has been a powerful tool for the study of human memory and especially the memory representations relevant for language. However, although it is well established that lexical access can be primed, we do not know exactly what types of computations can be primed above the word level. This work took a neurobiological approach and assessed the ways in which the complex representation of a minimal combinatory phrase, such as red boat, can be primed, as evidenced by the spatiotemporal profiles of magnetoencephalography (MEG) signals. Specifically, we built upon recent progress on the neural signatures of phrasal composition and tested whether the brain activities implicated for the basic combination of two words could be primed. In two experiments, MEG was recorded during a picture naming task where the prime trials were designed to replicate previously reported combinatory effects and the target trials to test whether those combinatory effects could be primed. The manipulation of the primes was successful in eliciting larger activity for adjective-noun combinations than single nouns in left anterior temporal and ventromedial prefrontal cortices, replicating prior MEG studies on parallel contrasts. Priming of similarly timed activity was observed during target trials in anterior temporal cortex, but only when the prime and target shared an adjective. No priming in temporal cortex was observed for single word repetition and two control tasks showed that the priming effect was not elicited if the prime pictures were simply viewed but not named. In sum, this work provides evidence that very basic combinatory operations can be primed, with the necessity for some lexical overlap between prime and target suggesting combinatory conceptual, as opposed to syntactic processing. Both our combinatory and priming effects were early, onsetting between 100 and 150ms after picture onset and thus are likely to reflect the very earliest planning stages of a combinatory message. Thus our findings suggest that at the earliest stages of combinatory planning in production, a combinatory memory representation is formed that affects the planning of a relevantly similar combination on a subsequent trial.
Collapse
Affiliation(s)
- Esti Blanco-Elorrieta
- Department of Psychology, New York University, New York, NY 10003, USA; NYUAD Institute, New York University Abu Dhabi, Abu Dhabi, P.O. Box 129188, United Arab Emirates
| | - Victor S Ferreira
- Department of Psychology, University of California, San Diego, La Jolla, CA 92093-0109, USA
| | - Paul Del Prato
- Department of Psychology, New York University, New York, NY 10003, USA
| | - Liina Pylkkänen
- Department of Psychology, New York University, New York, NY 10003, USA; NYUAD Institute, New York University Abu Dhabi, Abu Dhabi, P.O. Box 129188, United Arab Emirates; Department of Linguistics, New York University, New York, NY 10003, USA.
| |
Collapse
|
25
|
Boylan C, Trueswell JC, Thompson-Schill SL. Relational vs. attributive interpretation of nominal compounds differentially engages angular gyrus and anterior temporal lobe. BRAIN AND LANGUAGE 2017; 169:8-21. [PMID: 28236762 PMCID: PMC5810541 DOI: 10.1016/j.bandl.2017.01.008] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/22/2015] [Revised: 12/22/2016] [Accepted: 01/26/2017] [Indexed: 05/30/2023]
Abstract
The angular gyrus (AG) and anterior temporal lobe (ATL) have been found to respond to a number of tasks involving combinatorial processing. In this study, we investigate the conceptual combination of nominal compounds, and ask whether ATL/AG activity is modulated by the type of combinatorial operation applied to a nominal compound. We compare relational and attributive interpretations of nominal compounds and find that ATL and AG both discriminate these two types, but in distinct ways. While right AG demonstrated greater positive task-responsive activity for relational compounds, there was a greater negative deflection in the BOLD response in left AG for relational compounds. In left ATL, we found an earlier peak in subjects' BOLD response curves for attributive interpretations. In other words, we observed dissociations in both AG and ATL between relational and attributive nominal compounds, with regard to magnitude in the former and to timing in the latter. These findings expand on prior studies that posit roles for both AG and ATL in conceptual processing generally, and in conceptual combination specifically, by indicating possible functional specializations of these two regions within a larger conceptual knowledge network.
Collapse
Affiliation(s)
- Christine Boylan
- Department of Psychology, University of Pennsylvania, United States.
| | - John C Trueswell
- Department of Psychology, University of Pennsylvania, United States
| | | |
Collapse
|
26
|
Williams A, Reddigari S, Pylkkänen L. Early sensitivity of left perisylvian cortex to relationality in nouns and verbs. Neuropsychologia 2017; 100:131-143. [DOI: 10.1016/j.neuropsychologia.2017.04.029] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2016] [Revised: 04/09/2017] [Accepted: 04/23/2017] [Indexed: 10/19/2022]
|
27
|
Rabagliati H, Doumas LA, Bemis DK. Representing composed meanings through temporal binding. Cognition 2017; 162:61-72. [DOI: 10.1016/j.cognition.2017.01.013] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2016] [Revised: 01/09/2017] [Accepted: 01/19/2017] [Indexed: 11/27/2022]
|
28
|
Delogu F, Crocker MW, Drenhaus H. Teasing apart coercion and surprisal: Evidence from eye-movements and ERPs. Cognition 2017; 161:46-59. [PMID: 28109781 DOI: 10.1016/j.cognition.2016.12.017] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2015] [Revised: 12/16/2016] [Accepted: 12/31/2016] [Indexed: 11/25/2022]
Abstract
Previous behavioral and electrophysiological studies have presented evidence suggesting that coercion expressions (e.g., began the book) are more difficult to process than control expressions like read the book. While this processing cost has been attributed to a specific coercion operation for recovering an event-sense of the complement (e.g., began reading the book), an alternative view based on the Surprisal Theory of language processing would attribute the cost to the relative unpredictability of the complement noun in the coercion compared to the control condition, with no need to postulate coercion-specific mechanisms. In two experiments, monitoring eye-tracking and event-related potentials (ERPs), respectively, we sought to determine whether there is any evidence for coercion-specific processing cost above-and-beyond the difficulty predicted by surprisal, by contrasting coercing and control expressions with a further control condition in which the predictability of the complement noun was similar to that in the coercion condition (e.g., bought the book). While the eye-tracking study showed significant effects of surprisal and a marginal effect of coercion on late reading measures, the ERP study clearly supported the surprisal account. Overall, our findings suggest that the coercion cost largely reflects the surprisal of the complement noun with coercion specific operations possibly influencing later processing stages.
Collapse
|
29
|
de Almeida RG, Riven L, Manouilidou C, Lungu O, Dwivedi VD, Jarema G, Gillon B. The Neuronal Correlates of Indeterminate Sentence Comprehension: An fMRI Study. Front Hum Neurosci 2016; 10:614. [PMID: 28066204 PMCID: PMC5168646 DOI: 10.3389/fnhum.2016.00614] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2016] [Accepted: 11/17/2016] [Indexed: 12/01/2022] Open
Abstract
Sentences such as The author started the book are indeterminate because they do not make explicit what the subject (the author) started doing with the object (the book). In principle, indeterminate sentences allow for an infinite number of interpretations. One theory, however, assumes that these sentences are resolved by semanticcoercion, a linguistic process that forces the noun book to be interpreted as an activity (e.g., writing the book) or by a process that interpolates this activity information in the resulting enriched semantic composition. An alternative theory, pragmatic, assumes classical semantic composition, whereby meaning arises from the denotation of words and how they are combined syntactically, with enrichment obtained via pragmatic inferences beyond linguistic-semantic processes. Cognitive neuroscience studies investigating the neuroanatomical and functional correlates of indeterminate sentences have shown activations either at the ventromedial pre-frontal cortex (vmPFC) or at the left inferior frontal gyrus (L-IFG). These studies have supported the semantic coercion theory assuming that one of these regions is where enriched semantic composition takes place. Employing functional magnetic resonance imaging (fMRI), we found that indeterminate sentences activate bilaterally the superior temporal gyrus (STG), the right inferior frontal gyrus (R-IFG), and the anterior cingulate cortex (ACC), more so than control sentences (The author wrote the book). Activation of indeterminate sentences exceeded that of anomalous sentences (…drank the book) and engaged more left- and right-hemisphere areas than other sentence types. We suggest that the widespread activations for indeterminate sentences represent the deployment of pragmatic-inferential processes, which seek to enrich sentence content without necessarily resorting to semantic coercion.
Collapse
Affiliation(s)
| | - Levi Riven
- Department of Psychology, Concordia University Montreal, QC, Canada
| | - Christina Manouilidou
- Department of Comparative and General Linguistics, University of Ljubljana Ljubljana, Slovenia
| | - Ovidiu Lungu
- Unité de Neuroimagerie Fonctionnelle, Institute Universitaire de Gériatrie de Montréal, Université de Montréal Montreal, QC, Canada
| | - Veena D Dwivedi
- Department of Applied Linguistics, Brock University St. Catharines, ON, Canada
| | - Gonia Jarema
- Centre de Recherche, Institut Universitaire de Gériatrie de Montréal, Université de Montréal Montreal, QC, Canada
| | - Brendan Gillon
- Department of Linguistics, McGill University Montreal, QC, Canada
| |
Collapse
|
30
|
Maess B, Mamashli F, Obleser J, Helle L, Friederici AD. Prediction Signatures in the Brain: Semantic Pre-Activation during Language Comprehension. Front Hum Neurosci 2016; 10:591. [PMID: 27895573 PMCID: PMC5108799 DOI: 10.3389/fnhum.2016.00591] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2016] [Accepted: 11/04/2016] [Indexed: 11/13/2022] Open
Abstract
There is broad agreement that context-based predictions facilitate lexical-semantic processing. A robust index of semantic prediction during language comprehension is an evoked response, known as the N400, whose amplitude is modulated as a function of semantic context. However, the underlying neural mechanisms that utilize relations of the prior context and the embedded word within it are largely unknown. We measured magnetoencephalography (MEG) data while participants were listening to simple German sentences in which the verbs were either highly predictive for the occurrence of a particular noun (i.e., provided context) or not. The identical set of nouns was presented in both conditions. Hence, differences for the evoked responses of the nouns can only be due to differences in the earlier context. We observed a reduction of the N400 response for highly predicted nouns. Interestingly, the opposite pattern was observed for the preceding verbs: highly predictive (that is more informative) verbs yielded stronger neural magnitude compared to less predictive verbs. A negative correlation between the N400 effect of the verb and that of the noun was found in a distributed brain network, indicating an integral relation between the predictive power of the verb and the processing of the subsequent noun. This network consisted of left hemispheric superior and middle temporal areas and a subcortical area; the parahippocampus. Enhanced activity for highly predictive relative to less predictive verbs, likely reflects establishing semantic features associated with the expected nouns, that is a pre-activation of the expected nouns.
Collapse
Affiliation(s)
- Burkhard Maess
- MEG and Cortical Networks Group, Max Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany
| | - Fahimeh Mamashli
- MEG and Cortical Networks Group, Max Planck Institute for Human Cognitive and Brain SciencesLeipzig, Germany; Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain SciencesLeipzig, Germany; Department of Neurology, Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Harvard Medical SchoolBoston, MA, USA
| | - Jonas Obleser
- Max Planck Research Group "Auditory Cognition", Max Planck Institute for Human Cognitive and Brain SciencesLeipzig, Germany; Department of Psychology, University of LübeckLübeck, Germany
| | - Liisa Helle
- Elekta OyHelsinki, Finland; Department of Neuroscience and Biomedical Engineering, School of Science, Aalto UniversityEspoo, Finland
| | - Angela D Friederici
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany
| |
Collapse
|
31
|
Baggio G, Granello G, Verriello L, Eleopra R. Formal Semantics in the Neurology Clinic: Atypical Understanding of Aspectual Coercion in ALS Patients. Front Psychol 2016; 7:1733. [PMID: 27867369 PMCID: PMC5095610 DOI: 10.3389/fpsyg.2016.01733] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2016] [Accepted: 10/20/2016] [Indexed: 12/11/2022] Open
Abstract
Amyotrophic lateral sclerosis (ALS) is a neurodegenerative disease of the motor system with subtle adverse effects on cognition. It is still unclear whether ALS also affects language and semantics, and if so, what aspects and processes exactly. We investigated how ALS patients understand verb phrases modified by temporal preposition phrases, e.g., "To watch TV for half an hour." Interpretation here requires operations such as aspectual coercion that add or delete elements from event structures, depending on temporal modifiers, and constraints on coercion, which make combinations with certain modifiers not viable. Using a theoretically-motivated experimental design, we observed that acceptance rates for aspectual coercion were abnormally high in ALS patients. The effect was largest for the more complex cases of coercion: not those that involve enrichment of event structures ("To switch on the TV in half an hour," where a number of failed attempts must be included in the interpretation) but those that, if applied, would result in deletion of event structure elements ("To repair the TV for half an hour"). Our experimental results are consistent with a deficit of constraints on coercion, and not with impaired semantic processes or representations, in line with recent studies suggesting that verb semantics is largely spared in ALS.
Collapse
Affiliation(s)
- Giosuè Baggio
- Language Acquisition and Language Processing Lab, Norwegian University of Science and TechnologyTrondheim, Norway
| | - Giulia Granello
- Neurology Unit, Azienda Ospedaliero Universitaria Ospedali RiunitiTrieste, Italy
| | - Lorenzo Verriello
- Neurology Unit, Azienda Ospedaliero Universitaria Santa Maria della MisericordiaUdine, Italy
| | - Roberto Eleopra
- Neurology Unit, Azienda Ospedaliero Universitaria Santa Maria della MisericordiaUdine, Italy
| |
Collapse
|
32
|
Brennan JR, Pylkkänen L. MEG Evidence for Incremental Sentence Composition in the Anterior Temporal Lobe. Cogn Sci 2016; 41 Suppl 6:1515-1531. [PMID: 27813182 DOI: 10.1111/cogs.12445] [Citation(s) in RCA: 38] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2015] [Revised: 07/27/2016] [Accepted: 08/12/2016] [Indexed: 11/28/2022]
Abstract
Research investigating the brain basis of language comprehension has associated the left anterior temporal lobe (ATL) with sentence-level combinatorics. Using magnetoencephalography (MEG), we test the parsing strategy implemented in this brain region. The number of incremental parse steps from a predictive left-corner parsing strategy that is supported by psycholinguistic research is compared with those from a less-predictive strategy. We test for a correlation between parse steps and source-localized MEG activity recorded while participants read a story. Left-corner parse steps correlated with activity in the left ATL around 350-500 ms after word onset. No other correlations specific to sentence comprehension were observed. These data indicate that the left ATL engages in combinatoric processing that is well characterized by a predictive left-corner parsing strategy.
Collapse
Affiliation(s)
| | - Liina Pylkkänen
- Department of Linguistics, New York University.,Department of Psychology, New York University.,NYUAD Institute, New York University Abu Dhabi
| |
Collapse
|
33
|
Neufeld C, Kramer SE, Lapinskaya N, Heffner CC, Malko A, Lau EF. The Electrophysiology of Basic Phrase Building. PLoS One 2016; 11:e0158446. [PMID: 27711111 PMCID: PMC5053407 DOI: 10.1371/journal.pone.0158446] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2015] [Accepted: 06/16/2016] [Indexed: 11/18/2022] Open
Abstract
A defining trait of linguistic competence is the ability to combine elements into increasingly complex structures to denote, and to comprehend, a potentially infinite number of meanings. Recent magnetoencephalography (MEG) work has investigated these processes by comparing the response to nouns in combinatorial (blue car) and non-combinatorial (rnsh car) contexts. In the current study we extended this paradigm using electroencephalography (EEG) to dissociate the role of semantic content from phonological well-formedness (yerl car). We used event-related potential (ERP) recordings in order to better relate the observed neurophysiological correlates of basic combinatorial operations to prior ERP work on comprehension. We found that nouns in combinatorial contexts (blue car) elicited a greater centro-parietal negativity between 180-400ms, independent of the phonological well-formedness of the context word. We discuss the potential relationship between this ‘combinatorial’ effect and classic N400 effects. We also report preliminary evidence for an early anterior negative deflection immediately preceding the critical noun in combinatorial contexts, which we tentatively interpret as an electrophysiological reflex of syntactic structure initialization.
Collapse
Affiliation(s)
- Chris Neufeld
- Department of Linguistics, University of Maryland, College Park, Maryland, United States of America
- * E-mail:
| | - Stephanie E. Kramer
- Department of Linguistics, Georgetown University, Washington, District of Colombia, United States of America
| | - Natalia Lapinskaya
- Department of Linguistics, University of Maryland, College Park, Maryland, United States of America
| | - Christopher C. Heffner
- Department of Linguistics, University of Maryland, College Park, Maryland, United States of America
- Program in Neuroscience and Cognitive Science, University of Maryland, College Park, Maryland, United States of America
- Department of Hearing and Speech Sciences, University of Maryland, College Park, Maryland, United States of America
| | - Anton Malko
- Department of Linguistics, University of Maryland, College Park, Maryland, United States of America
| | - Ellen F. Lau
- Department of Linguistics, University of Maryland, College Park, Maryland, United States of America
- Program in Neuroscience and Cognitive Science, University of Maryland, College Park, Maryland, United States of America
| |
Collapse
|
34
|
Cavalli E, Colé P, Badier JM, Zielinski C, Chanoine V, Ziegler JC. Spatiotemporal Dynamics of Morphological Processing in Visual Word Recognition. J Cogn Neurosci 2016; 28:1228-42. [DOI: 10.1162/jocn_a_00959] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Abstract
The spatiotemporal dynamics of morphological, orthographic, and semantic processing were investigated in a primed lexical decision task in French using magnetoencephalography (MEG). The goal was to investigate orthographic and semantic contributions to morphological priming and compare these effects with pure orthographic and semantic priming. The time course of these effects was analyzed in anatomically defined ROIs that were selected according to previous MEG and fMRI findings. The results showed that morphological processing was not localized in one specific area but distributed over a vast network that involved left inferior temporal gyrus, left superior temporal gyrus, left inferior frontal gyrus, and left orbitofrontal gyrus. Second, all morphological effects were specific, that is, in none of the ROIs could morphology effects be explained by pure orthographic or pure semantic overlap. Third, the ventral route was sensitive to both the orthographic and semantic “part” of the morphological priming effect in the M350 time window. Fourth, the earliest effects of morphology occurred in left superior temporal gyrus around 250 msec and reflected the semantic contribution to morphological facilitation. Together then, the present results show that morphological processing is not just an emergent property of processing form or meaning and that semantic contributions to morphological facilitation can occur as early as 250 msec in the left superior temporal gyrus.
Collapse
|
35
|
Lowder MW, Gordon PC. Eye-Tracking and Corpus-Based Analyses of Syntax-Semantics Interactions in Complement Coercion. LANGUAGE, COGNITION AND NEUROSCIENCE 2016; 31:921-939. [PMID: 28529960 PMCID: PMC5435376 DOI: 10.1080/23273798.2016.1183798] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/17/2014] [Accepted: 04/17/2016] [Indexed: 06/07/2023]
Abstract
Previous work has shown that the difficulty associated with processing complex semantic expressions is reduced when the critical constituents appear in separate clauses as opposed to when they appear together in the same clause. We investigated this effect further, focusing in particular on complement coercion, in which an event-selecting verb (e.g., began) combines with a complement that represents an entity (e.g., began the memo). Experiment 1 compared reading times for coercion versus control expressions when the critical verb and complement appeared together in a subject-extracted relative clause (SRC) (e.g., The secretary that began/wrote the memo) compared to when they appeared together in a simple sentence. Readers spent more time processing coercion expressions than control expressions, replicating the typical coercion cost. In addition, readers spent less time processing the verb and complement in SRCs than in simple sentences; however, the magnitude of the coercion cost did not depend on sentence structure. In contrast, Experiment 2 showed that the coercion cost was reduced when the complement appeared as the head of an object-extracted relative clause (ORC) (e.g., The memo that the secretary began/wrote) compared to when the constituents appeared together in an SRC. Consistent with the eye-tracking results of Experiment 2, a corpus analysis showed that expressions requiring complement coercion are more frequent when the constituents are separated by the clause boundary of an ORC compared to when they are embedded together within an SRC. The results provide important information about the types of structural configurations that contribute to reduced difficulty with complex semantic expressions, as well as how these processing patterns are reflected in naturally occurring language.
Collapse
|
36
|
Brederoo SG, Bos LS, Dragoy O, Bastiaanse R, Baggio G. Gamma oscillations as a neural signature of shifting times in narrative language. PLoS One 2015; 10:e0121146. [PMID: 25874576 PMCID: PMC4395362 DOI: 10.1371/journal.pone.0121146] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2014] [Accepted: 01/29/2015] [Indexed: 11/18/2022] Open
Abstract
Verbs and other temporal expressions allow speakers to specify the location of events in time, as well as to move back and forth in time, shifting in a narrative between past, present and future. The referential flexibility of temporal expressions is well understood in linguistics but its neurocognitive bases remain unknown. We aimed at obtaining a neural signature of shifting times in narrative language. We recorded and analyzed event-related brain potentials (ERPs) and oscillatory responses to the adverb 'now' and to the second main verb in Punctual ('An hour ago the boy stole a candy and now he peeled the fruit') and Iterative ('The entire afternoon the boy stole candy and now he peeled the fruit') contexts. 'An hour ago' introduces a time frame that lies entirely in the past, 'now' shifts the narrative to the present, and 'peeled' shifts it back to the past. These two referential shifts in Punctual contexts are expected to leave very similar traces on neural responses. In contrast, 'The entire afternoon' specifies a time frame that may encompass past, present and future, such that both 'now' and 'peeled' are consistent with it. Here, no time shift is required. We found no difference in ERPs between Punctual and Iterative contexts either at 'now' or at the second verb. However, reference shifts modulated oscillatory signals. 'Now' and the second verb in Punctual contexts resulted in similar responses: an increase in gamma power with a left-anterior distribution. Gamma bursts were absent in Iterative contexts. We propose that gamma oscillations here reflect the binding of temporal variables to the values allowed by constraints introduced by temporal expressions in discourse.
Collapse
Affiliation(s)
- Sanne Gøren Brederoo
- Center for Language and Cognition, University of Groningen, Groningen, Netherlands
- NeuroImaging Center, University Medical Center Groningen, Groningen, Netherlands
| | - Laura Simone Bos
- Center for Language and Cognition, University of Groningen, Groningen, Netherlands
- NeuroImaging Center, University Medical Center Groningen, Groningen, Netherlands
| | - Olga Dragoy
- Center for Language and Cognition, University of Groningen, Groningen, Netherlands
- National Research University Higher School of Economics, Moscow, Russia
| | - Roelien Bastiaanse
- Center for Language and Cognition, University of Groningen, Groningen, Netherlands
| | - Giosuè Baggio
- Brain and Language Lab, International School for Advanced Studies, Trieste, Italy
- Language Acquisition and Language Processing Lab, Department of Language and Literature, Norwegian University of Science and Technology, Trondheim, Norway
- * E-mail:
| |
Collapse
|
37
|
Fruchter J, Marantz A. Decomposition, lookup, and recombination: MEG evidence for the full decomposition model of complex visual word recognition. BRAIN AND LANGUAGE 2015; 143:81-96. [PMID: 25797098 DOI: 10.1016/j.bandl.2015.03.001] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2014] [Revised: 01/27/2015] [Accepted: 03/01/2015] [Indexed: 06/04/2023]
Abstract
There is much evidence that visual recognition of morphologically complex words (e.g., teacher) proceeds via a decompositional route, first involving recognition of their component morphemes (teach + -er). According to the Full Decomposition model, after the visual decomposition stage, followed by morpheme lookup, there is a final "recombination" stage, in which the decomposed morphemes are combined and the well-formedness of the complex form is evaluated. Here, we use MEG to provide evidence for the temporally-differentiated stages of this model. First, we demonstrate an early effect of derivational family entropy, corresponding to the stem lookup stage; this is followed by a surface frequency effect, corresponding to the later recombination stage. We also demonstrate a late effect of a novel statistical measure, semantic coherence, which quantifies the gradient semantic well-formedness of complex words. Our findings illustrate the usefulness of corpus measures in investigating the component processes within visual word recognition.
Collapse
Affiliation(s)
- Joseph Fruchter
- Department of Psychology, New York University, New York, NY, USA.
| | - Alec Marantz
- Department of Psychology, New York University, New York, NY, USA; Department of Linguistics, New York University, New York, NY, USA; NYUAD Institute, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| |
Collapse
|
38
|
Westerlund M, Kastner I, Al Kaabi M, Pylkkänen L. The LATL as locus of composition: MEG evidence from English and Arabic. BRAIN AND LANGUAGE 2015; 141:124-134. [PMID: 25585277 DOI: 10.1016/j.bandl.2014.12.003] [Citation(s) in RCA: 41] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/24/2013] [Revised: 12/12/2014] [Accepted: 12/14/2014] [Indexed: 06/04/2023]
Abstract
Neurolinguistic investigations into the processing of structured sentences as well as simple adjective-noun phrases point to the left anterior temporal lobe (LATL) as a leading candidate for basic linguistic composition. Here, we characterized the combinatory profile of the LATL over a variety of syntactic and semantic environments, and across two languages, English and Arabic. The contribution of the LATL was investigated across two types of composition: the optional modification of a predicate (modification) and the satisfaction of a predicate's argument position (argument saturation). Target words were presented during MEG recordings, either in combinatory contexts (e.g. "eats meat") or in non-combinatory contexts (preceded by an unpronounceable consonant string, e.g. "xqkr meat"). Across both languages, the LATL showed increased responses to words in combinatory contexts, an effect that was robust to composition type and word order. Together with related findings, these results solidify the role of the LATL in basic semantic composition.
Collapse
Affiliation(s)
- Masha Westerlund
- Department of Psychology, New York University, 6 Washington Place, New York, NY 10003, USA.
| | - Itamar Kastner
- Department of Linguistics, New York University, 10 Washington Place, New York, NY 10003, USA
| | - Meera Al Kaabi
- Department of Linguistics, New York University, 10 Washington Place, New York, NY 10003, USA
| | - Liina Pylkkänen
- Department of Psychology, New York University, 6 Washington Place, New York, NY 10003, USA; Department of Linguistics, New York University, 10 Washington Place, New York, NY 10003, USA; NYUAD Institute, New York University Abu Dhabi, PO Box 129188, Abu Dhabi, United Arab Emirates
| |
Collapse
|
39
|
Lin CC, Yang CM. Evidence of sleep-facilitating effect on formation of novel semantic associations: An event-related potential (ERP) study. Neurobiol Learn Mem 2014; 116:69-78. [DOI: 10.1016/j.nlm.2014.08.011] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2014] [Revised: 08/18/2014] [Accepted: 08/20/2014] [Indexed: 10/24/2022]
|
40
|
Pylkkänen L, Bemis DK, Blanco Elorrieta E. Building phrases in language production: An MEG study of simple composition. Cognition 2014; 133:371-84. [DOI: 10.1016/j.cognition.2014.07.001] [Citation(s) in RCA: 56] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2012] [Revised: 05/21/2014] [Accepted: 07/07/2014] [Indexed: 10/24/2022]
|
41
|
Lowder MW, Gordon PC. The manuscript that we finished: structural separation reduces the cost of complement coercion. J Exp Psychol Learn Mem Cogn 2014; 41:526-40. [PMID: 24999707 DOI: 10.1037/xlm0000042] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Two eye-tracking experiments examined the effects of sentence structure on the processing of complement coercion, in which an event-selecting verb combines with a complement that represents an entity (e.g., began the memo). Previous work has demonstrated that these expressions impose a processing cost, which has been attributed to the need to type-shift the entity into an event in order for the sentence to be interpretable (e.g., began writing the memo). Both experiments showed that the magnitude of the coercion cost was reduced when the verb and complement appeared in separate clauses (e.g., The memo that was begun by the secretary; What the secretary began was the memo) compared with when the constituents appeared together in the same clause. The moderating effect of sentence structure on coercion is similar to effects that have been reported for the processing of 2 other types of semantically complex expressions (inanimate subject-verb integration and metonymy). We propose that sentence structure influences the depth at which complex semantic relationships are computed. When the constituents that create the need for a complex semantic interpretation appear in a single clause, readers experience processing difficulty stemming from the need to detect or resolve the semantic mismatch. In contrast, the need to engage in additional processing is reduced when the expression is established across a clause boundary or other structure that deemphasizes the complex relationship.
Collapse
Affiliation(s)
- Matthew W Lowder
- Department of Psychology, University of North Carolina at Chapel Hill
| | - Peter C Gordon
- Department of Psychology, University of North Carolina at Chapel Hill
| |
Collapse
|
42
|
Paczynski M, Jackendoff R, Kuperberg G. When events change their nature: the neurocognitive mechanisms underlying aspectual coercion. J Cogn Neurosci 2014; 26:1905-17. [PMID: 24702457 DOI: 10.1162/jocn_a_00638] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
The verb "pounce" describes a single, near-instantaneous event. Yet, we easily understand that, "For several minutes the cat pounced…" describes a situation in which multiple pounces occurred, although this interpretation is not overtly specified by the sentence's syntactic structure or by any of its individual words--a phenomenon known as "aspectual coercion." Previous psycholinguistic studies have reported processing costs in association with aspectual coercion, but the neurocognitive mechanisms giving rise to these costs remain contentious. Additionally, there is some controversy about whether readers commit to a full interpretation of the event when the aspectual information becomes available, or whether they leave it temporarily underspecified until later in the sentence. Using ERPs, we addressed these questions in a design that fully crossed context type (punctive, durative, frequentative) with verb type (punctive, durative). We found a late, sustained negativity to punctive verbs in durative contexts, but not in frequentative (e.g., explicitly iterative) contexts. This effect was distinct from the N400 in both its time course and scalp distribution, suggesting that it reflected a different underlying neurocognitive mechanism. We also found that ERPs to durative verbs were unaffected by context type. Together, our results provide strong evidence that neural activity associated with aspectual coercion is driven by the engagement of a morphosyntactically unrealized semantic operator rather than by violations of real-world knowledge, more general shifts in event representation, or event iterativity itself. More generally, our results add to a growing body of evidence that a set of late-onset sustained negativities reflect elaborative semantic processing that goes beyond simply combining the meaning of individual words with syntactic structure to arrive at a final representation of meaning.
Collapse
|
43
|
ERPs reveal individual differences in morphosyntactic processing. Neuropsychologia 2014; 56:289-301. [DOI: 10.1016/j.neuropsychologia.2014.02.002] [Citation(s) in RCA: 149] [Impact Index Per Article: 14.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2013] [Revised: 12/28/2013] [Accepted: 02/03/2014] [Indexed: 11/20/2022]
|
44
|
Schumacher PB. When combinatorial processing results in reconceptualization: toward a new approach of compositionality. Front Psychol 2013; 4:677. [PMID: 24098293 PMCID: PMC3787603 DOI: 10.3389/fpsyg.2013.00677] [Citation(s) in RCA: 81] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2013] [Accepted: 09/08/2013] [Indexed: 11/13/2022] Open
Abstract
Propositional content is often incomplete but comprehenders appear to adjust meaning and add unarticulated meaning constituents effortlessly. This happens at the propositional level (The baby drank the bottle) but also at the phrasal level (the wooden turtle). In two ERP experiments, combinatorial processing was investigated in container/content alternations and adjective-noun combination transforming an animate entity into a physical object. Experiment 1 revealed that container-for-content alternations (The baby drank the bottle) engendered a Late Positivity on the critical expression and on the subsequent segment, while content-for-container alternations (Chris put the beer on the table) did not exert extra costs. In Experiment 2, adjective-noun combinations (the wooden turtle) also evoked a Late Positivity on the critical noun. First, the Late Positivities are taken to reflect discourse updating demands resulting from reference shift from the original denotation to the contextually appropriate interpretation (e.g., the reconceptualization form animal to physical object). This shift is supported by the linguistic unavailability of the original meaning, exemplified by copredication tests. Second, the data reveal that meaning alternations differ qualitatively. Some alternations involve (cost-free) meaning selection, while others engender processing demands associated with reconceptualization. This dissociation thus calls for a new typology of metonymic shifts that centers around the status of the involved discourse referents.
Collapse
Affiliation(s)
- Petra B Schumacher
- Department of English and Linguistics, Independent Emmy Noether Research Group, Johannes Gutenberg University of Mainz Mainz, Germany
| |
Collapse
|
45
|
Dikker S, Pylkkänen L. Predicting language: MEG evidence for lexical preactivation. BRAIN AND LANGUAGE 2013; 127:55-64. [PMID: 23040469 DOI: 10.1016/j.bandl.2012.08.004] [Citation(s) in RCA: 83] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/29/2012] [Revised: 08/08/2012] [Accepted: 08/12/2012] [Indexed: 06/01/2023]
Abstract
It is widely assumed that prediction plays a substantial role in language processing. However, despite numerous studies demonstrating that contextual information facilitates both syntactic and lexical-semantic processing, there exists no direct evidence pertaining to the neural correlates of the prediction process itself. Using magnetoencephalography (MEG), this study found that brain activity was modulated by whether or not a specific noun could be predicted, given a picture prime. Specifically, before the noun was presented, predictive contexts triggered enhanced activation in left mid-temporal cortex (implicated in lexical access), ventro-medial prefrontal cortex (previously associated with top-down processing), and visual cortex (hypothesized to index the preactivation of predicted form features), successively. This finding suggests that predictive language processing recruits a top-down network where predicted words are activated at different levels of representation, from more 'abstract' lexical-semantic representations in temporal cortex, all the way down to visual word form features. The same brain regions that exhibited enhanced activation for predictive contexts before the onset of the noun showed effects of congruence during the target word. To our knowledge, this study is one of the first to directly investigate the anticipatory stage of predictive language processing.
Collapse
Affiliation(s)
- Suzanne Dikker
- Sackler Institute for Developmental Psychobiology, Weill Cornell Medical College, NY, USA; New York University, Department of Psychology, NY, USA.
| | | |
Collapse
|
46
|
Bemis DK, Pylkkänen L. Flexible composition: MEG evidence for the deployment of basic combinatorial linguistic mechanisms in response to task demands. PLoS One 2013; 8:e73949. [PMID: 24069253 PMCID: PMC3771885 DOI: 10.1371/journal.pone.0073949] [Citation(s) in RCA: 40] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2013] [Accepted: 07/25/2013] [Indexed: 11/24/2022] Open
Abstract
The present study investigates whether a minimal manipulation in task demands can induce core linguistic combinatorial mechanisms to extend beyond the bounds of normal grammatical phrases. Using magnetoencephalography, we measured neural activity evoked by the processing of adjective-noun phrases in canonical (red cup) and reversed order (cup red). During a task not requiring composition (verification against a color blob and shape outline), we observed significant combinatorial activity during canonical phrases only – as indexed by minimum norm source activity localized to the left anterior temporal lobe at 200–250 ms(cf. [1], [2]). When combinatorial task demands were introduced (by simply combining the blob and outline into a single colored shape) we observed significant combinatorial activity during reversed sequences as well. These results demonstrate the first direct evidence that basic linguistic combinatorial mechanisms can be deployed outside of normal grammatical expressions in response to task demands, independent of changes in lexical or attentional factors.
Collapse
Affiliation(s)
- Douglas K. Bemis
- Department of Psychology, New York University, New York, New York, United States of America
| | - Liina Pylkkänen
- Department of Psychology, New York University, New York, New York, United States of America
- Department of Linguistics, New York University, New York, New York, United States of America
- NYU Abu Dhabi Institute, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
- * E-mail:
| |
Collapse
|
47
|
Huang J, Wang S, Jia S, Mo D, Chen HC. Cortical dynamics of semantic processing during sentence comprehension: evidence from event-related optical signals. PLoS One 2013; 8:e70671. [PMID: 23936464 PMCID: PMC3731242 DOI: 10.1371/journal.pone.0070671] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2013] [Accepted: 06/21/2013] [Indexed: 11/24/2022] Open
Abstract
Using the event-related optical signal (EROS) technique, this study investigated the dynamics of semantic brain activation during sentence comprehension. Participants read sentences constituent-by-constituent and made a semantic judgment at the end of each sentence. The EROSs were recorded simultaneously with ERPs and time-locked to expected or unexpected sentence-final target words. The unexpected words evoked a larger N400 and a late positivity than the expected ones. Critically, the EROS results revealed activations first in the left posterior middle temporal gyrus (LpMTG) between 128 and 192 ms, then in the left anterior inferior frontal gyrus (LaIFG), the left middle frontal gyrus (LMFG), and the LpMTG in the N400 time window, and finally in the left posterior inferior frontal gyrus (LpIFG) between 832 and 864 ms. Also, expected words elicited greater activation than unexpected words in the left anterior temporal lobe (LATL) between 192 and 256 ms. These results suggest that the early lexical-semantic retrieval reflected by the LpMTG activation is followed by two different semantic integration processes: a relatively rapid and transient integration in the LATL and a relatively slow but enduring integration in the LaIFG/LMFG and the LpMTG. The late activation in the LpIFG, however, may reflect cognitive control.
Collapse
Affiliation(s)
- Jian Huang
- Center for Studies of Psychological Application and School of Psychology, South China Normal University, Guangzhou, China
- Key Laboratory of Mental Health and Cognitive Science of Guangdong Province, South China Normal University, Guangzhou, China
- Department of Psychology, Chinese University of Hong Kong, Shatin, N.T., Hong Kong S.A.R., China
| | - Suiping Wang
- Center for Studies of Psychological Application and School of Psychology, South China Normal University, Guangzhou, China
- Key Laboratory of Mental Health and Cognitive Science of Guangdong Province, South China Normal University, Guangzhou, China
- * E-mail: ) (SW); (HCC)
| | - Shiwei Jia
- Department of Psychology, Chinese University of Hong Kong, Shatin, N.T., Hong Kong S.A.R., China
| | - Deyuan Mo
- Department of Psychology, Chinese University of Hong Kong, Shatin, N.T., Hong Kong S.A.R., China
| | - Hsuan-Chih Chen
- Department of Psychology, Chinese University of Hong Kong, Shatin, N.T., Hong Kong S.A.R., China
- * E-mail: ) (SW); (HCC)
| |
Collapse
|
48
|
Bemis DK, Pylkkänen L. Combination Across Domains: An MEG Investigation into the Relationship between Mathematical, Pictorial, and Linguistic Processing. Front Psychol 2013; 3:583. [PMID: 23293621 PMCID: PMC3535734 DOI: 10.3389/fpsyg.2012.00583] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2012] [Accepted: 12/11/2012] [Indexed: 11/21/2022] Open
Abstract
Debates surrounding the evolution of language often hinge upon its relationship to cognition more generally and many investigations have attempted to demark the boundary between the two. Though results from these studies suggest that language may recruit domain-general mechanisms during certain types of complex processing, the domain-generality of basic combinatorial mechanisms that lie at the core of linguistic processing is still unknown. Our previous work (Bemis and Pylkkänen, 2011, 2012) used magnetoencephalography to isolate neural activity associated with the simple composition of an adjective and a noun (“red boat”) and found increased activity during this processing localized to the left anterior temporal lobe (lATL), ventro-medial prefrontal cortex (vmPFC), and left angular gyrus (lAG). The present study explores the domain-generality of these effects and their associated combinatorial mechanisms through two parallel non-linguistic combinatorial tasks designed to be as minimal and natural as the linguistic paradigm. In the first task, we used pictures of colored shapes to elicit combinatorial conceptual processing similar to that evoked by the linguistic expressions and find increased activity again localized to the vmPFC during combinatorial processing. This result suggests that a domain-general semantic combinatorial mechanism operates during basic linguistic composition, and that activity generated by its processing localizes to the vmPFC. In the second task, we recorded neural activity as subjects performed simple addition between two small numerals. Consistent with a wide array of recent results, we find no effects related to basic addition that coincide with our linguistic effects and instead find increased activity localized to the intraparietal sulcus. This result suggests that the scope of the previously identified linguistic effects is restricted to compositional operations and does not extend generally to all tasks that are merely similar in form.
Collapse
Affiliation(s)
- Douglas K Bemis
- Department of Psychology, NYU-Abu Dhabi Institute, New York University New York, NY, USA
| | | |
Collapse
|
49
|
The dynamics of language-related high-gamma activity assessed on a spatially-normalized brain. Clin Neurophysiol 2013; 124:91-100. [DOI: 10.1016/j.clinph.2012.06.006] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2011] [Revised: 06/04/2012] [Accepted: 06/08/2012] [Indexed: 11/22/2022]
|
50
|
Woodhead ZVJ, Barnes GR, Penny W, Moran R, Teki S, Price CJ, Leff AP. Reading front to back: MEG evidence for early feedback effects during word recognition. Cereb Cortex 2012; 24:817-25. [PMID: 23172772 PMCID: PMC3920772 DOI: 10.1093/cercor/bhs365] [Citation(s) in RCA: 61] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Magnetoencephalography studies in humans have shown word-selective activity in the left inferior frontal gyrus (IFG) approximately 130 ms after word presentation (
Pammer et al. 2004; Cornelissen et al. 2009; Wheat et al. 2010). The role of this early frontal response is currently not known. We tested the hypothesis that the IFG provides top-down constraints on word recognition using dynamic causal modeling of magnetoencephalography data collected, while subjects viewed written words and false font stimuli. Subject-specific dipoles in left and right occipital, ventral occipitotemporal and frontal cortices were identified using Variational Bayesian Equivalent Current Dipole source reconstruction. A connectivity analysis tested how words and false font stimuli differentially modulated activity between these regions within the first 300 ms after stimulus presentation. We found that left inferior frontal activity showed stronger sensitivity to words than false font and a stronger feedback connection onto the left ventral occipitotemporal cortex (vOT) in the first 200 ms. Subsequently, the effect of words relative to false font was observed on feedforward connections from left occipital to ventral occipitotemporal and frontal regions. These findings demonstrate that left inferior frontal activity modulates vOT in the early stages of word processing and provides a mechanistic account of top-down effects during word recognition.
Collapse
Affiliation(s)
- Z V J Woodhead
- Wellcome Trust Centre for Neuroimaging, University College London, London, UK
| | | | | | | | | | | | | |
Collapse
|