1
|
Levari T, Snedeker J. Understanding words in context: A naturalistic EEG study of children's lexical processing. JOURNAL OF MEMORY AND LANGUAGE 2024; 137:104512. [PMID: 38855737 PMCID: PMC11160963 DOI: 10.1016/j.jml.2024.104512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2024]
Abstract
When listening to speech, adults rely on context to anticipate upcoming words. Evidence for this comes from studies demonstrating that the N400, an event-related potential (ERP) that indexes ease of lexical-semantic processing, is influenced by the predictability of a word in context. We know far less about the role of context in children's speech comprehension. The present study explored lexical processing in adults and 5-10-year-old children as they listened to a story. ERPs time-locked to the onset of every word were recorded. Each content word was coded for frequency, semantic association, and predictability. In both children and adults, N400s reflect word predictability, even when controlling for frequency and semantic association. These findings suggest that both adults and children use top-down constraints from context to anticipate upcoming words when listening to stories.
Collapse
Affiliation(s)
- Tatyana Levari
- Department of Psychology, Harvard University, United States
| | - Jesse Snedeker
- Department of Psychology, Harvard University, United States
| |
Collapse
|
2
|
Rojas JC, Contero M, Vergara M, Higuera-Trujillo JL. Using Event-Related Potentials to Evidence the Visual and Semantic Impact: A Pilot Study with N400 Effect and Food Packaging. Foods 2024; 13:1876. [PMID: 38928817 PMCID: PMC11202883 DOI: 10.3390/foods13121876] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2024] [Revised: 05/25/2024] [Accepted: 05/28/2024] [Indexed: 06/28/2024] Open
Abstract
Packaging design is pivotal in motivating consumer decisions, as a key communication tool from creation to purchase. Currently, the interpretation and evaluation of packaging's impact are shifting toward non-traditional methods. This pilot study evaluated the packaging perception of York Ham and Turkey Breast products. The event-related potential (ERP) technique, the methodology priming words (positive and negative), and target images (original and modified packaging) were applied. A total of 23 participants were sampled using a 32-channels scalp elastic electrode cap and viewed 200 trials of word-image matching. Participants responded whether the images and adjectives matched or not, using the two groups of images. The results demonstrate an N400 effect in the parietal area. This region was observed to show evidence of cognitive processing related to congruency or incongruency, by contrasting the priming and target of this study. The evaluation positioned the York Ham packaging as the best rated. The findings show a relevant contribution to ERPs and research related to the food packaging perception.
Collapse
Affiliation(s)
- Juan-Carlos Rojas
- Escuela de Arquitectura, Arte y Diseño, Tecnologico de Monterrey, Monterrey 64700, Mexico
| | - Manuel Contero
- Instituto Universitario de Investigación en Tecnología Centrada en el Ser Humano, 46022 Valencia, Spain;
| | - Margarita Vergara
- Departamento de Ingeniería Mecánica y Construcción, Universitat Jaume I, 12071 Castelló de la Plana, Spain;
| | - Juan Luis Higuera-Trujillo
- Departamento de Ingeniería Mecánica y Diseño Industrial, Universidad de Cádiz, 11510 Puerto Real, Spain;
| |
Collapse
|
3
|
Michaelov JA, Bardolph MD, Van Petten CK, Bergen BK, Coulson S. Strong Prediction: Language Model Surprisal Explains Multiple N400 Effects. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2024; 5:107-135. [PMID: 38645623 PMCID: PMC11025652 DOI: 10.1162/nol_a_00105] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Accepted: 03/24/2023] [Indexed: 04/23/2024]
Abstract
Theoretical accounts of the N400 are divided as to whether the amplitude of the N400 response to a stimulus reflects the extent to which the stimulus was predicted, the extent to which the stimulus is semantically similar to its preceding context, or both. We use state-of-the-art machine learning tools to investigate which of these three accounts is best supported by the evidence. GPT-3, a neural language model trained to compute the conditional probability of any word based on the words that precede it, was used to operationalize contextual predictability. In particular, we used an information-theoretic construct known as surprisal (the negative logarithm of the conditional probability). Contextual semantic similarity was operationalized by using two high-quality co-occurrence-derived vector-based meaning representations for words: GloVe and fastText. The cosine between the vector representation of the sentence frame and final word was used to derive contextual cosine similarity estimates. A series of regression models were constructed, where these variables, along with cloze probability and plausibility ratings, were used to predict single trial N400 amplitudes recorded from healthy adults as they read sentences whose final word varied in its predictability, plausibility, and semantic relationship to the likeliest sentence completion. Statistical model comparison indicated GPT-3 surprisal provided the best account of N400 amplitude and suggested that apparently disparate N400 effects of expectancy, plausibility, and contextual semantic similarity can be reduced to variation in the predictability of words. The results are argued to support predictive coding in the human language network.
Collapse
Affiliation(s)
- James A. Michaelov
- Department of Cognitive Science, University of California, San Diego, La Jolla, CA, USA
| | - Megan D. Bardolph
- Department of Cognitive Science, University of California, San Diego, La Jolla, CA, USA
| | - Cyma K. Van Petten
- Department of Psychology, Binghamton University, State University of New York, Binghamton, NY, USA
| | - Benjamin K. Bergen
- Department of Cognitive Science, University of California, San Diego, La Jolla, CA, USA
| | - Seana Coulson
- Department of Cognitive Science, University of California, San Diego, La Jolla, CA, USA
| |
Collapse
|
4
|
Michaelov JA, Bergen BK. Ignoring the alternatives: The N400 is sensitive to stimulus preactivation alone. Cortex 2023; 168:82-101. [PMID: 37678069 DOI: 10.1016/j.cortex.2023.08.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Revised: 05/12/2023] [Accepted: 08/03/2023] [Indexed: 09/09/2023]
Abstract
The N400 component of the event-related brain potential is a neural signal of processing difficulty. In the language domain, it is widely believed to be sensitive to the degree to which a given word or its semantic features have been preactivated in the brain based on the preceding context. However, it has also been shown that the brain often preactivates many words in parallel. It is currently unknown whether the N400 is also affected by the preactivations of alternative words other than the stimulus that is actually presented. This leaves a weak link in the derivation chain-how can we use the N400 to understand the mechanisms of preactivation if we do not know what it indexes? This study directly addresses this gap. We estimate the extent to which all words in a lexicon are preactivated in a given context using the predictions of contemporary large language models. We then directly compare two competing possibilities: that the amplitude of the N400 is sensitive only to the extent to which the stimulus is preactivated, and that it is also sensitive to the preactivation states of the alternatives. We find evidence of the former. This result allows for better grounded inferences about the mechanisms underlying the N400, lexical preactivation in the brain, and language processing more generally.
Collapse
Affiliation(s)
- James A Michaelov
- Department of Cognitive Science, University of California San Diego, La Jolla, CA, USA.
| | - Benjamin K Bergen
- Department of Cognitive Science, University of California San Diego, La Jolla, CA, USA.
| |
Collapse
|
5
|
Mauchand M, Pell MD. Complain like you mean it! How prosody conveys suffering even about innocuous events. BRAIN AND LANGUAGE 2023; 244:105305. [PMID: 37562118 DOI: 10.1016/j.bandl.2023.105305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Revised: 07/28/2023] [Accepted: 07/30/2023] [Indexed: 08/12/2023]
Abstract
When complaining, speakers can use their voice to convey a feeling of pain, even when describing innocuous events. Rapid detection of emotive and identity features of the voice may constrain how the semantic content of complaints is processed, as indexed by N400 and P600 effects evoked by the final, pain-related word. Twenty-six participants listened to statements describing painful and innocuous events expressed in a neutral or complaining voice, produced by ingroup and outgroup accented speakers. Participants evaluated how hurt the speaker felt under EEG monitoring. Principal Component Analysis of Event-Related Potentials from the final word onset demonstrated N400 and P600 increases when complainers described innocuous vs. painful events in a neutral voice, but these effects were altered when utterances were expressed in a complaining voice. Independent of prosody, N400 amplitudes increased for complaints spoken in outgroup vs. ingroup accents. Results demonstrate that prosody and accent constrain the processing of spoken complaints as proposed in a parallel-constraint-satisfaction model.
Collapse
Affiliation(s)
- Maël Mauchand
- McGill University, School of Communication Sciences and Disorders, Montréal, Québec, Canada.
| | - Marc D Pell
- McGill University, School of Communication Sciences and Disorders, Montréal, Québec, Canada
| |
Collapse
|
6
|
Meaning above (and in) the head: Combinatorial visual morphology from comics and emoji. Mem Cognit 2022; 50:1381-1398. [PMID: 35235175 PMCID: PMC9508049 DOI: 10.3758/s13421-022-01294-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/15/2022] [Indexed: 11/08/2022]
Abstract
Compositionality is a primary feature of language, but graphics can also create combinatorial meaning, like with items above faces (e.g., lightbulbs to mean inspiration). We posit that these “upfixes” (i.e., upwards affixes) involve a productive schema enabling both stored and novel face–upfix dyads. In two experiments, participants viewed either conventional (e.g., lightbulb) or unconventional (e.g., clover-leaves) upfixes with faces which either matched (e.g., lightbulb/smile) or mismatched (e.g., lightbulb/frown). In Experiment 1, matching dyads sponsored higher comprehensibility ratings and faster response times, modulated by conventionality. In Experiment 2, event-related brain potentials (ERPs) revealed conventional upfixes, regardless of matching, evoked larger N250s, indicating perceptual expertise, but mismatching and unconventional dyads elicited larger semantic processing costs (N400) than conventional-matching dyads. Yet mismatches evoked a late negativity, suggesting congruent novel dyads remained construable compared with violations. These results support that combinatorial graphics involve a constrained productive schema, similar to the lexicon of language.
Collapse
|
7
|
Elmer S, Besson M, Rodríguez-Fornells A. The electrophysiological correlates of word pre-activation during associative word learning. Int J Psychophysiol 2022; 182:12-22. [PMID: 36167179 DOI: 10.1016/j.ijpsycho.2022.09.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Revised: 09/14/2022] [Accepted: 09/21/2022] [Indexed: 10/14/2022]
Abstract
Human beings continuously make use of learned associations to generate predictions about future occurrences in the environment. Such memory-related predictive processes provide a scaffold for learning in that mental representations of foreseeable events can be adjusted or strengthened based on a specific outcome. Learning the meaning of novel words through picture-word associations constitutes a prime example of associative learning because pictures preceding words can trigger word prediction through the pre-activation of the related mnemonic representations. In the present electroencephalography (EEG) study, we used event-related potentials (ERPs) to compare neural indices of word pre-activation between a word learning condition with maximal prediction likelihood and a non-learning control condition with low prediction. Results revealed that prediction-related N400 amplitudes in response to pictures decreased over time at central electrodes as a function of word learning, whereas late positive component (LPC) amplitudes increased. Notably, N400 but not LPC changes were also predictive of word learning performance, suggesting that the N400 component constitutes a sensitive marker of word pre-activation during associative word learning.
Collapse
Affiliation(s)
- Stefan Elmer
- Computational Neuroscience of Speech & Hearing, Department of Computational Linguistics, University of Zurich, Switzerland; Cognition and Brain Plasticity Group, Bellvitge Biomedical Research Institute, L'Hospitalet de Llobregat, 08097 Barcelona, Spain.
| | - Mireille Besson
- Université Publique de France, CNRS & Aix-Marseille University, Laboratoire de Neurosciences Cognitives (LNC, UMR 7291) & Institute for Language and Communication in the Brain (ILCB), Marseille, France.
| | - Antoni Rodríguez-Fornells
- Cognition and Brain Plasticity Group, Bellvitge Biomedical Research Institute, L'Hospitalet de Llobregat, 08097 Barcelona, Spain; Department of Cognition, Development and Educational Psychology, Campus Bellvitge, University of Barcelona, L'Hospitalet de Llobregat, 08097 Barcelona, Spain; Institució Catalana de Recerca i Estudis Avançats, ICREA, 08010 Barcelona, Spain.
| |
Collapse
|
8
|
Köksal Ersöz E, Chossat P, Krupa M, Lavigne F. Dynamic branching in a neural network model for probabilistic prediction of sequences. J Comput Neurosci 2022; 50:537-557. [PMID: 35948839 DOI: 10.1007/s10827-022-00830-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Revised: 07/11/2022] [Accepted: 07/13/2022] [Indexed: 10/15/2022]
Abstract
An important function of the brain is to predict which stimulus is likely to occur based on the perceived cues. The present research studied the branching behavior of a computational network model of populations of excitatory and inhibitory neurons, both analytically and through simulations. Results show how synaptic efficacy, retroactive inhibition and short-term synaptic depression determine the dynamics of selection between different branches predicting sequences of stimuli of different probabilities. Further results show that changes in the probability of the different predictions depend on variations of neuronal gain. Such variations allow the network to optimize the probability of its predictions to changing probabilities of the sequences without changing synaptic efficacy.
Collapse
Affiliation(s)
- Elif Köksal Ersöz
- Univ Rennes, INSERM, LTSI - UMR 1099, Campus Beaulieu, Rennes, F-35000, France. .,Project Team MathNeuro, INRIA-CNRS-UNS, 2004 route des Lucioles-BP 93, Sophia Antipolis, 06902, France.
| | - Pascal Chossat
- Project Team MathNeuro, INRIA-CNRS-UNS, 2004 route des Lucioles-BP 93, Sophia Antipolis, 06902, France.,Université Côte d'Azur, Laboratoire Jean-Alexandre Dieudonné, Campus Valrose, Nice, 06300, France
| | - Martin Krupa
- Project Team MathNeuro, INRIA-CNRS-UNS, 2004 route des Lucioles-BP 93, Sophia Antipolis, 06902, France.,Université Côte d'Azur, Laboratoire Jean-Alexandre Dieudonné, Campus Valrose, Nice, 06300, France
| | - Frédéric Lavigne
- Université Côte d'Azur, CNRS-BCL, Campus Saint Jean d'Angely, Nice, 06300, France
| |
Collapse
|
9
|
Canal P, Bischetti L, Bertini C, Ricci I, Lecce S, Bambini V. N400 differences between physical and mental metaphors: The role of Theories of Mind. Brain Cogn 2022; 161:105879. [PMID: 35777125 DOI: 10.1016/j.bandc.2022.105879] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2021] [Revised: 02/21/2022] [Accepted: 05/02/2022] [Indexed: 12/19/2022]
Abstract
Whether Theory of Mind (ToM) contributes to metaphor understanding has been largely investigated in language acquisition and decay. Yet we know very little about the role of ToM in real-time processing of metaphors in neurotypical adults. Here, we tested the relationship between ToM and metaphor through Event Related Potentials (ERPs) by capitalizing on the difference between metaphors inviting inferences on physical (Boxers are pandas) vs. mental aspects (Teachers are books). Physical metaphors involved a larger and sustained negativity compared to mental ones. This pattern resembled concreteness effects and suggests that physical metaphors may benefit from both verbal and perceptual information. Moreover, higher scores in the Reading the Mind in the Eyes Test (RMET), but not in the Animation task, were associated with a reduction of the N400 amplitude for both physical and mental metaphors. When exploring the ERP temporal trajectory with Generalized Additive Mixed Modeling, earlier differences between metaphors characterized individuals with higher RMET scores. Among the various ToM components, thus, emotion recognition seems to be involved in the processing of metaphors in general, with an earlier impact on the mental type. These findings highlight the multifaceted nature of metaphor, at the crossroad of language, social and perceptual experience.
Collapse
Affiliation(s)
- Paolo Canal
- Department of Humanities and Life Sciences, University School for Advanced Studies IUSS, Pavia, Italy
| | - Luca Bischetti
- Department of Humanities and Life Sciences, University School for Advanced Studies IUSS, Pavia, Italy
| | | | | | - Serena Lecce
- Department of Brain and Behavioral Sciences, University of Pavia, Pavia, Italy
| | - Valentina Bambini
- Department of Humanities and Life Sciences, University School for Advanced Studies IUSS, Pavia, Italy.
| |
Collapse
|
10
|
Federmeier KD. Connecting and considering: Electrophysiology provides insights into comprehension. Psychophysiology 2022; 59:e13940. [PMID: 34520568 PMCID: PMC9009268 DOI: 10.1111/psyp.13940] [Citation(s) in RCA: 31] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Revised: 08/27/2021] [Accepted: 08/30/2021] [Indexed: 11/29/2022]
Abstract
The ability to rapidly and systematically access knowledge stored in long-term memory in response to incoming sensory information-that is, to derive meaning from the world-lies at the core of human cognition. Research using methods that can precisely track brain activity over time has begun to reveal the multiple cognitive and neural mechanisms that make this possible. In this article, I delineate how a process of connecting affords an effortless, continuous infusion of meaning into human perception. In a relatively invariant time window, uncovered through studies using the N400 component of the event-related potential, incoming sensory information naturally induces a graded landscape of activation across long-term semantic memory, creating what might be called "proto-concepts". Connecting can be (but is not always) followed by a process of further considering those activations, wherein a set of more attentionally demanding "active comprehension" mechanisms mediate the selection, augmentation, and transformation of the initial semantic representations. The result is a limited set of more stable bindings that can be arranged in time or space, revised as needed, and brought to awareness. With this research, we are coming closer to understanding how the human brain is able to fluidly link sensation to experience, to appreciate language sequences and event structures, and, sometimes, to even predict what might be coming up next.
Collapse
Affiliation(s)
- Kara D Federmeier
- Department of Psychology, Program in Neuroscience, and the Beckman Institute for Advanced Science and Technology, University of Illinois, Champaign, Illinois, USA
| |
Collapse
|
11
|
Dudschig C. Language and non-linguistic cognition: Shared mechanisms and principles reflected in the N400. Biol Psychol 2022; 169:108282. [DOI: 10.1016/j.biopsycho.2022.108282] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 01/25/2022] [Accepted: 01/26/2022] [Indexed: 11/17/2022]
|
12
|
Nicoladis E, Westbury C, Foursha-Stevenson C. English Speakers' Implicit Gender Concepts Influence Their Processing of French Grammatical Gender: Evidence for Semantically Mediated Cross-Linguistic Influence. Front Psychol 2021; 12:740920. [PMID: 34721215 PMCID: PMC8555711 DOI: 10.3389/fpsyg.2021.740920] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2021] [Accepted: 09/27/2021] [Indexed: 11/13/2022] Open
Abstract
Second language (L2) learners often show influence from their first language (L1) in all domains of language. This cross-linguistic influence could, in some cases, be mediated by semantics. The purpose of the present study was to test whether implicit English gender connotations affect L1 English speakers’ judgments of the L2 French gender of objects. We hypothesized that gender estimates derived from word embedding models that measure similarity of word contexts in English would affect accuracy and response time on grammatical gender (GG) decision in L2 French. L2 French learners were asked to identify the GG of French words estimated to be either congruent or incongruent with the implicit gender in English. The results showed that they were more accurate with words that were congruent with English gender connotations than words that were incongruent, suggesting that English gender connotations can influence grammatical judgments in French. Response times showed the same pattern. The results are consistent with semantics-mediated cross-linguistic influence.
Collapse
Affiliation(s)
- Elena Nicoladis
- Department of Psychology, University of British Columbia, Kelowna, BC, Canada
| | - Chris Westbury
- Department of Psychology, University of Alberta, Edmonton, AB, Canada
| | | |
Collapse
|
13
|
Verosky NJ, Morgan E. Pitches that Wire Together Fire Together: Scale Degree Associations Across Time Predict Melodic Expectations. Cogn Sci 2021; 45:e13037. [PMID: 34606140 DOI: 10.1111/cogs.13037] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 07/22/2021] [Accepted: 07/23/2021] [Indexed: 11/29/2022]
Abstract
The ongoing generation of expectations is fundamental to listeners' experience of music, but research into types of statistical information that listeners extract from musical melodies has tended to emphasize transition probabilities and n-grams, with limited consideration given to other types of statistical learning that may be relevant. Temporal associations between scale degrees represent a different type of information present in musical melodies that can be learned from musical corpora using expectation networks, a computationally simple method based on activation and decay. Expectation networks infer the expectation of encountering one scale degree followed in the near (but not necessarily immediate) future by another given scale degree, with previous work suggesting that scale degree associations learned by expectation networks better predict listener ratings of pitch similarity than transition probabilities. The current work outlines how these learned scale degree associations can be combined to predict melodic continuations and tests the resulting predictions on a dataset of listener responses to a musical cloze task previously used to compare two other models of melodic expectation, a variable-order Markov model (IDyOM) and Temperley's music-theoretically motivated model. Under multinomial logistic regression, all three models explain significant unique variance in human melodic expectations, with coefficient estimates highest for expectation networks. These results suggest that generalized scale degree associations informed by both adjacent and nonadjacent relationships between melodic notes influence listeners' melodic predictions above and beyond n-gram context, highlighting the need to consider a broader range of statistical learning processes that may underlie listeners' expectations for upcoming musical events.
Collapse
Affiliation(s)
| | - Emily Morgan
- Department of Linguistics, University of California, Davis
| |
Collapse
|
14
|
Nieuwland MS. How 'rational' is semantic prediction? A critique and re-analysis of. Cognition 2021; 215:104848. [PMID: 34274557 DOI: 10.1016/j.cognition.2021.104848] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2020] [Revised: 05/08/2021] [Accepted: 07/11/2021] [Indexed: 01/04/2023]
Abstract
In a recent article in Cognition, Delaney-Busch et al. (2019) claim evidence for 'rational', Bayesian adaptation of semantic predictions, using ERP data from Lau, Holcomb, and Kuperberg (2013). Participants read associatively related and unrelated prime-target word pairs in a first block with only 10% related trials and a second block with 50%. Related words elicited smaller N400s than unrelated words, and this difference was strongest in the second block, suggesting greater engagement in predictive processing. Using a rational adaptor model, Delaney-Busch et al. argue that the stronger N400 reduction for related words in the second block developed as a function of the number of related trials, and concluded therefore that participants predicted related words more strongly when their predictions were fulfilled more often. In this critique, I discuss two critical flaws in their analyses, namely the confounding of prediction effects with those of lexical frequency and the neglect of data from the first block. Re-analyses suggest a different picture: related words by themselves did not yield support for their conclusion, and the effect of relatedness gradually strengthened in othe two blocks in a similar way. Therefore, the N400 did not yield evidence that participants rationally adapted their semantic predictions. Within the framework proposed by Delaney-Busch et al., presumed semantic predictions may even be thought of as 'irrational'. While these results yielded no evidence for rational or probabilistic prediction, they do suggest that participants became increasingly better at predicting target words from prime words.
Collapse
Affiliation(s)
- Mante S Nieuwland
- Max-Planck-Institute for Psycholinguistics, The Netherlands; Donders Centre for Cognition, Brain and Behaviour, The Netherlands.
| |
Collapse
|
15
|
Kyriaki L, Schlesewsky M, Bornkessel-Schlesewsky I. Semantic reversal anomalies under the microscope: Task and modality influences on language-associated event-related potentials. Eur J Neurosci 2020; 52:3803-3827. [PMID: 32537795 DOI: 10.1111/ejn.14862] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2020] [Revised: 05/22/2020] [Accepted: 05/30/2020] [Indexed: 11/26/2022]
Abstract
Semantic reversal anomalies (SRAs)-sentences where an implausibility is created by reversing participant roles-have attracted much attention in the literature on the electrophysiology of language. In spite of being syntactically well formed but semantically implausible, these sentences unexpectedly elicited a monophasic P600 effect in English and Dutch rather than an N400 effect. Subsequent research revealed variability in the presence/absence of an N400 effect to SRAs depending on the language examined and the choice of verb type in English. However, most previous studies employed the same presentation modality (visual) and task (acceptability judgement). Here, we conducted two experiments and three statistical analyses to investigate the influence of stimulus modality, task demand and statistical choices on event-related potential (ERP) response patterns to SRAs in English. We reproduced a previous study's procedure and analysis (N. Bourguignon et al. (2012) Brain and Language, 122, 179-189) and further introduced between-subjects factors of task type and modality, using mixed-effects modelling to analyse the data. We observed an N400 effect to typical English SRAs (agent subject verbs, e.g. "the fries will eat the boys"), which contrasts existing literature and was not predicted by existing theories that account for SRA processing. Task demand modulated the ERPs elicited by SRAs, while auditory presentation led to increased comprehension accuracy and a more broadly distributed ERP. Finally, the statistical methods used influenced the presence/absence of ERP effects. Our results suggest a sensitivity of language-related ERP patterns to methodological parameters, and we conclude that future experiments should take this into careful consideration.
Collapse
Affiliation(s)
- Louise Kyriaki
- Cognitive and Systems Neuroscience Research Hub, University of South Australia, Adelaide, SA, Australia
| | - Matthias Schlesewsky
- Cognitive and Systems Neuroscience Research Hub, University of South Australia, Adelaide, SA, Australia
| | | |
Collapse
|
16
|
Activating words beyond the unfolding sentence: Contributions of event simulation and word associations to discourse reading. Neuropsychologia 2020; 141:107409. [DOI: 10.1016/j.neuropsychologia.2020.107409] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2019] [Revised: 01/10/2020] [Accepted: 02/21/2020] [Indexed: 11/20/2022]
|
17
|
Nieuwland MS, Barr DJ, Bartolozzi F, Busch-Moreno S, Darley E, Donaldson DI, Ferguson HJ, Fu X, Heyselaar E, Huettig F, Matthew Husband E, Ito A, Kazanina N, Kogan V, Kohút Z, Kulakova E, Mézière D, Politzer-Ahles S, Rousselet G, Rueschemeyer SA, Segaert K, Tuomainen J, Von Grebmer Zu Wolfsthurn S. Dissociable effects of prediction and integration during language comprehension: evidence from a large-scale study using brain potentials. Philos Trans R Soc Lond B Biol Sci 2019; 375:20180522. [PMID: 31840593 DOI: 10.1098/rstb.2018.0522] [Citation(s) in RCA: 83] [Impact Index Per Article: 16.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023] Open
Abstract
Composing sentence meaning is easier for predictable words than for unpredictable words. Are predictable words genuinely predicted, or simply more plausible and therefore easier to integrate with sentence context? We addressed this persistent and fundamental question using data from a recent, large-scale (n = 334) replication study, by investigating the effects of word predictability and sentence plausibility on the N400, the brain's electrophysiological index of semantic processing. A spatio-temporally fine-grained mixed-effect multiple regression analysis revealed overlapping effects of predictability and plausibility on the N400, albeit with distinct spatio-temporal profiles. Our results challenge the view that the predictability-dependent N400 reflects the effects of either prediction or integration, and suggest that semantic facilitation of predictable words arises from a cascade of processes that activate and integrate word meaning with context into a sentence-level meaning. This article is part of the theme issue 'Towards mechanistic models of meaning composition'.
Collapse
Affiliation(s)
- Mante S Nieuwland
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands.,Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands.,School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, UK
| | - Dale J Barr
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
| | - Federica Bartolozzi
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands.,School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, UK
| | - Simon Busch-Moreno
- Division of Psychology and Language Sciences, University College London, London, UK
| | - Emily Darley
- School of Experimental Psychology, University of Bristol, Bristol, UK
| | - David I Donaldson
- Psychology, Faculty of Natural Sciences, University of Stirling, Stirling, UK
| | | | - Xiao Fu
- Division of Psychology and Language Sciences, University College London, London, UK
| | - Evelien Heyselaar
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands.,School of Psychology, University of Birmingham, Birmingham, UK
| | - Falk Huettig
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | - E Matthew Husband
- Faculty of Linguistics, Philology and Phonetics, University of Oxford, Oxford, UK
| | - Aine Ito
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, UK.,Faculty of Linguistics, Philology and Phonetics, University of Oxford, Oxford, UK
| | - Nina Kazanina
- School of Experimental Psychology, University of Bristol, Bristol, UK
| | - Vita Kogan
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, UK
| | - Zdenko Kohút
- Department of Psychology, University of York, York, UK
| | - Eugenia Kulakova
- Institute of Cognitive Neuroscience, University College London, London, UK
| | - Diane Mézière
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, UK
| | - Stephen Politzer-Ahles
- Faculty of Linguistics, Philology and Phonetics, University of Oxford, Oxford, UK.,Department of Chinese and Bilingual Studies, the Hong Kong Polytechnic University, Kowloon, Hong Kong, People's Republic of China
| | - Guillaume Rousselet
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK
| | | | - Katrien Segaert
- School of Psychology, University of Kent, Canterbury, UK.,Centre for Human Brain Health, University of Birmingham, Birmingham, UK
| | - Jyrki Tuomainen
- Division of Psychology and Language Sciences, University College London, London, UK
| | | |
Collapse
|
18
|
Camarrone F, Van Hulle MM. Measuring brand association strength with EEG: A single-trial N400 ERP study. PLoS One 2019; 14:e0217125. [PMID: 31181083 PMCID: PMC6557491 DOI: 10.1371/journal.pone.0217125] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2017] [Accepted: 05/07/2019] [Indexed: 11/19/2022] Open
Abstract
Companies need to ensure that customers perceive their brands as intended, with strong and unique associations, when facing a competitive market. Traditionally, brand associations are measured using conventional techniques such as surveys and questionnaires albeit both conscious and unconscious factors can influence the collected data and the outcome of a campaign. Neuromarketing can shed light on how the customer’s brain processes marketing stimuli. We report here on an EEG study aimed at gauging mental associations with brands. We focus on the N400 event-related potential, an EEG component most strongly elicited in response to a concept unrelated to a preceding concept. We considered two video on demand brands, Netflix and Rex&Rio, and selected a set of words grouped in 4 categories that were either related (Television, Relaxation, and Price), in varying degrees, or unrelated (Unrelated) to the said brands. The experiment started with both brands’ TV commercials, as a common reference for our participants. We then applied a semantic priming paradigm in which a brand logo (“prime”) was followed by a word (“target”), and the strength of the N400 response to the word used as an inverted measure of the association strength with the brand logo. We clustered N400 responses to identify, for each brand, natural groups of associated words. As a result, for Netflix the cluster with the smallest N400 responses (i.e., strongest associations) consisted of words related to Television but for Rex&Rio it consisted of words related to Relaxation. We also evaluated the relationship between the two brands and determined which associations they share or which ones not. It turned out that associations related to Relaxation and Television distinguish the two brands. Interestingly, survey data did not show any difference between the two brands as they were equally associated with Television and Relaxation. These findings show that our N400 technique can reveal brand associations, and natural categories thereof, that would otherwise go unnoticed when using conventional surveys.
Collapse
Affiliation(s)
- Flavio Camarrone
- Laboratory for Neuro- & Psychophysiology, Department of Neurosciences, KU Leuven—University of Leuven, Leuven, Belgium
- * E-mail:
| | - Marc M. Van Hulle
- Laboratory for Neuro- & Psychophysiology, Department of Neurosciences, KU Leuven—University of Leuven, Leuven, Belgium
| |
Collapse
|
19
|
Smith CM, Federmeier KD. What does "it" mean, anyway? Examining the time course of semantic activation in reference resolution. LANGUAGE, COGNITION AND NEUROSCIENCE 2018; 34:115-136. [PMID: 31555718 PMCID: PMC6760867 DOI: 10.1080/23273798.2018.1513540] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/06/2017] [Accepted: 07/30/2018] [Indexed: 06/10/2023]
Abstract
Pronouns serve a critical referential function, yet the cognitive processes engaged during pronoun comprehension remain incompletely understood. One view is that encountering a pronoun leads the comprehender to reactivate the semantic features of its antecedent. We examined this by manipulating the concreteness of a noun antecedent and assessing whether an Event Related Potential (ERP) concreteness effect was elicited at a downstream pronoun. We observed a robust concreteness effect at the noun, but no similar effect at the pronoun. We also examined whether N400 semantic priming from the antecedent would increase on content words shortly following the pronoun, relative to those preceding it. Again, although we observed semantic priming following the noun, it did not increase following the pronoun. Our data suggest that pronouns do not induce the activation of (much) new semantic information in long-term memory, perhaps instead triggering an attentional shift towards their antecedents' extant representations within working memory.
Collapse
Affiliation(s)
- Cybelle M Smith
- Department of Psychology, University of Illinois, Urbana-Champaign, USA
| | - Kara D Federmeier
- Department of Psychology, University of Illinois, Urbana-Champaign, USA
- Beckman Institute for Advanced Science and Technology, University of Illinois, Urbana-Champaign, USA
- Program in Neuroscience, University of Illinois, Urbana-Champaign, USA
| |
Collapse
|
20
|
Hanna J, Pulvermüller F. Congruency of Separable Affix Verb Combinations Is Linearly Indexed by the N400. Front Hum Neurosci 2018; 12:219. [PMID: 29892220 PMCID: PMC5985318 DOI: 10.3389/fnhum.2018.00219] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2017] [Accepted: 05/09/2018] [Indexed: 11/17/2022] Open
Abstract
Separable affix verbs consist of a stem and a derivational affix, which, in some languages can appear together or in discontinuous, distributed form, e.g., German “aufgreifen” and “greifen … auf” [“up-pick(ing)” and “pick … up”]. Certain stems can combine with only certain affixes. However, many such combinations are evaluated not as clearly correct or incorrect, but frequently take an intermediate status with participants rating them ambiguously. Here, we mapped brain responses to combinations of verb stems and affixes realized in short sentences, including more and less common particle verbs, borderline acceptable combinations and clear violations. Event-related potential responses to discontinuous particle verbs were obtained for five affixes re-combined with 10 verb stems, situated within short, German sentences, i.e., “sie <stem>en es <affix>,” English: “they <stem> it <affix>.” The congruity of combinations was assessed both with behavioral ratings of the stimuli and corpus-derived probability measures. The size of a frontal N400 correlated with the degree of incongruency between stem and affix, as assessed by both measures. Behavioral ratings performed better than corpus-derived measures in predicting N400 magnitudes, and a combined model performed best of all. No evidence for a discrete, right/wrong effect was found. We discuss methodological implications and integrate the results into past research on the N400 and neurophysiological studies on separable-affix verbs, generally.
Collapse
Affiliation(s)
- Jeff Hanna
- Department of Neurosurgery, University Hospital Erlangen, Erlangen, Germany.,Department of Philosophy and Humanities, Institute for German and Dutch Philology, Freie Universität Berlin, Berlin, Germany
| | - Friedemann Pulvermüller
- Department of Philosophy and Humanities, Institute for German and Dutch Philology, Freie Universität Berlin, Berlin, Germany.,Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
21
|
Payne BR, Federmeier KD. Contextual constraints on lexico-semantic processing in aging: Evidence from single-word event-related brain potentials. Brain Res 2018; 1687:117-128. [PMID: 29462609 DOI: 10.1016/j.brainres.2018.02.021] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2017] [Revised: 02/14/2018] [Accepted: 02/15/2018] [Indexed: 01/27/2023]
Abstract
The current study reports the effects of accumulating contextual constraints on neural indices of lexico-semantic processing (i.e., effects of word frequency and orthographic neighborhood) as a function of normal aging. Event-related brain potentials were measured from a sample of older adults as they read sentences that were semantically congruent, provided only syntactic constraints (syntactic prose), or were random word strings. A linear mixed-effects modeling approach was used to probe the effects of accumulating contextual constraints on N400 responses to individual words. Like young adults in prior work, older adults exhibited a classic word position context effect on the N400 in congruent sentences, although the magnitude of the effect was reduced in older relative to younger adults. Moreover, by modeling single-word variability in N400 responses, we observed robust effects of orthographic neighborhood density that were larger in older adults than the young, and preserved effects word frequency. Importantly, in older adults, frequency effects were not modulated by accumulating contextual constraints, unlike in the young. Collectively, these findings indicate that older adults are less likely (or able) to use accumulating top-down contextual constraints, and therefore rely more strongly on bottom-up lexical features to guide semantic access of individual words during sentence comprehension.
Collapse
Affiliation(s)
- Brennan R Payne
- Department of Psychology, Interdepartmental Program in Neuroscience, and Center on Aging, University of Utah, United States.
| | - Kara D Federmeier
- Department of Psychology, Neuroscience Program, and the Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, United States
| |
Collapse
|
22
|
Yi A, Chen Z, Chang Y, Wang H, Wu L. Electrophysiological evidence of language switching for bidialectals. Neuroreport 2018; 29:181-190. [DOI: 10.1097/wnr.0000000000000950] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
|
23
|
van Vliet M, Van Hulle MM, Salmelin R. Exploring the Organization of Semantic Memory through Unsupervised Analysis of Event-related Potentials. J Cogn Neurosci 2017; 30:381-392. [PMID: 29211653 DOI: 10.1162/jocn_a_01211] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Modern multivariate methods have enabled the application of unsupervised techniques to analyze neurophysiological data without strict adherence to predefined experimental conditions. We demonstrate a multivariate method that leverages priming effects on the evoked potential to perform hierarchical clustering on a set of word stimuli. The current study focuses on the semantic relationships that play a key role in the organization of our mental lexicon of words and concepts. The N400 component of the event-related potential is considered a reliable neurophysiological response that is indicative of whether accessing one concept facilitates subsequent access to another (i.e., one "primes" the other). To further our understanding of the organization of the human mental lexicon, we propose to utilize the N400 component to drive a clustering algorithm that can uncover, given a set of words, which particular subsets of words show mutual priming. Such a scheme requires a reliable measurement of the amplitude of the N400 component without averaging across many trials, which was here achieved using a recently developed multivariate analysis method based on beamforming. We validated our method by demonstrating that it can reliably detect, without any prior information about the nature of the stimuli, a well-known feature of the organization of our semantic memory: the distinction between animate and inanimate concepts. These results motivate further application of our method to data-driven exploration of disputed or unknown relationships between stimuli.
Collapse
|
24
|
Brunellière A, Perre L, Tran T, Bonnotte I. Co-occurrence frequency evaluated with large language corpora boosts semantic priming effects. Q J Exp Psychol (Hove) 2017; 70:1922-1934. [DOI: 10.1080/17470218.2016.1215479] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
In recent decades, many computational techniques have been developed to analyse the contextual usage of words in large language corpora. The present study examined whether the co-occurrence frequency obtained from large language corpora might boost purely semantic priming effects. Two experiments were conducted: one with conscious semantic priming, the other with subliminal semantic priming. Both experiments contrasted three semantic priming contexts: an unrelated priming context and two related priming contexts with word pairs that are semantically related and that co-occur either frequently or infrequently. In the conscious priming presentation (166-ms stimulus-onset asynchrony, SOA), a semantic priming effect was recorded in both related priming contexts, which was greater with higher co-occurrence frequency. In the subliminal priming presentation (66-ms SOA), no significant priming effect was shown, regardless of the related priming context. These results show that co-occurrence frequency boosts pure semantic priming effects and are discussed with reference to models of semantic network.
Collapse
Affiliation(s)
- Angèle Brunellière
- UMR 9193–SCALab–Sciences Cognitives et Sciences Affectives, University of Lille, CNRS, Lille, France
| | - Laetitia Perre
- UMR 9193–SCALab–Sciences Cognitives et Sciences Affectives, University of Lille, CNRS, Lille, France
| | - ThiMai Tran
- CNRS, UMR 8163–STL–Savoirs Textes Langage, University of Lille, Lille, France
| | - Isabelle Bonnotte
- UMR 9193–SCALab–Sciences Cognitives et Sciences Affectives, University of Lille, CNRS, Lille, France
| |
Collapse
|
25
|
Aguilar C, Chossat P, Krupa M, Lavigne F. Latching dynamics in neural networks with synaptic depression. PLoS One 2017; 12:e0183710. [PMID: 28846727 PMCID: PMC5573234 DOI: 10.1371/journal.pone.0183710] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2017] [Accepted: 08/09/2017] [Indexed: 12/02/2022] Open
Abstract
Prediction is the ability of the brain to quickly activate a target concept in response to a related stimulus (prime). Experiments point to the existence of an overlap between the populations of the neurons coding for different stimuli, and other experiments show that prime-target relations arise in the process of long term memory formation. The classical modelling paradigm is that long term memories correspond to stable steady states of a Hopfield network with Hebbian connectivity. Experiments show that short term synaptic depression plays an important role in the processing of memories. This leads naturally to a computational model of priming, called latching dynamics; a stable state (prime) can become unstable and the system may converge to another transiently stable steady state (target). Hopfield network models of latching dynamics have been studied by means of numerical simulation, however the conditions for the existence of this dynamics have not been elucidated. In this work we use a combination of analytic and numerical approaches to confirm that latching dynamics can exist in the context of a symmetric Hebbian learning rule, however lacks robustness and imposes a number of biologically unrealistic restrictions on the model. In particular our work shows that the symmetry of the Hebbian rule is not an obstruction to the existence of latching dynamics, however fine tuning of the parameters of the model is needed.
Collapse
Affiliation(s)
- Carlos Aguilar
- Bases, Corpus, Langage, UMR 7320 CNRS, Université de Nice - Sophia Antipolis, 06357 Nice, France
| | - Pascal Chossat
- Laboratoire J.A.Dieudonné UMR CNRS-UNS 7351, Université de Nice - Sophia Antipolis, 06108 Nice, France
- MathNeuro team, Inria Sophia Antipolis, 06902 Valbonne-Sophia Antipolis, France
| | - Martin Krupa
- Laboratoire J.A.Dieudonné UMR CNRS-UNS 7351, Université de Nice - Sophia Antipolis, 06108 Nice, France
- MathNeuro team, Inria Sophia Antipolis, 06902 Valbonne-Sophia Antipolis, France
- Department of Applied Mathematics, University College Cork, Cork, Ireland
| | - Frédéric Lavigne
- Bases, Corpus, Langage, UMR 7320 CNRS, Université de Nice - Sophia Antipolis, 06357 Nice, France
| |
Collapse
|
26
|
Lavigne F, Longrée D, Mayaffre D, Mellet S. Semantic integration by pattern priming: experiment and cortical network model. Cogn Neurodyn 2016; 10:513-533. [PMID: 27891200 PMCID: PMC5106460 DOI: 10.1007/s11571-016-9410-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2016] [Revised: 07/18/2016] [Accepted: 09/06/2016] [Indexed: 01/09/2023] Open
Abstract
Neural network models describe semantic priming effects by way of mechanisms of activation of neurons coding for words that rely strongly on synaptic efficacies between pairs of neurons. Biologically inspired Hebbian learning defines efficacy values as a function of the activity of pre- and post-synaptic neurons only. It generates only pair associations between words in the semantic network. However, the statistical analysis of large text databases points to the frequent occurrence not only of pairs of words (e.g., "the way") but also of patterns of more than two words (e.g., "by the way"). The learning of these frequent patterns of words is not reducible to associations between pairs of words but must take into account the higher level of coding of three-word patterns. The processing and learning of pattern of words challenges classical Hebbian learning algorithms used in biologically inspired models of priming. The aim of the present study was to test the effects of patterns on the semantic processing of words and to investigate how an inter-synaptic learning algorithm succeeds at reproducing the experimental data. The experiment manipulates the frequency of occurrence of patterns of three words in a multiple-paradigm protocol. Results show for the first time that target words benefit more priming when embedded in a pattern with the two primes than when only associated with each prime in pairs. A biologically inspired inter-synaptic learning algorithm is tested that potentiates synapses as a function of the activation of more than two pre- and post-synaptic neurons. Simulations show that the network can learn patterns of three words to reproduce the experimental results.
Collapse
Affiliation(s)
- Frédéric Lavigne
- BCL, UMR 7320 CNRS et Université de Nice-Sophia Antipolis, Campus Saint Jean d’Angely - SJA3/MSHS Sud-Est/BCL, 24 Avenue des diables bleus, 06357 Nice Cedex 4, France
| | | | | | | |
Collapse
|
27
|
Khachatryan E, Camarrone F, Fias W, Van Hulle MM. ERP Response Unveils Effect of Second Language Manipulation on First Language Processing. PLoS One 2016; 11:e0167194. [PMID: 27893807 PMCID: PMC5125703 DOI: 10.1371/journal.pone.0167194] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2015] [Accepted: 11/10/2016] [Indexed: 11/18/2022] Open
Abstract
Lexical access in bilinguals has been considered either selective or non-selective and evidence exists in favor of both hypotheses. We conducted a linguistic experiment to assess whether a bilingual’s language mode influences the processing of first language information. We recorded event related potentials during a semantic priming paradigm with a covert manipulation of the second language (L2) using two types of stimulus presentations (short and long). We observed a significant facilitation of word pairs related in L2 in the short version reflected by a decrease in N400 amplitude in response to target words related to the English meaning of an inter-lingual homograph (homograph-unrelated group). This was absent in the long version, as the N400 amplitude for this group was similar to the one for the control-unrelated group. We also interviewed the participants whether they were aware of the importance of L2 in the experiment. We conclude that subjects participating in the long and short versions were in different language modes: closer to monolingual mode for the long and closer to bilingual mode for the short version; and that awareness about covert manipulation of L2 can influence the language mode, which in its turn influences the processing of the first language.
Collapse
Affiliation(s)
- Elvira Khachatryan
- Laboratory for Neuro- & Psychophysiology, Department of Neurosciences, KU Leuven, Leuven, Belgium
- Neurology Department, Yerevan State Medical University, Yerevan, Armenia
- * E-mail:
| | - Flavio Camarrone
- Laboratory for Neuro- & Psychophysiology, Department of Neurosciences, KU Leuven, Leuven, Belgium
| | - Wim Fias
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Marc M. Van Hulle
- Laboratory for Neuro- & Psychophysiology, Department of Neurosciences, KU Leuven, Leuven, Belgium
| |
Collapse
|
28
|
Günther F, Dudschig C, Kaup B. Predicting Lexical Priming Effects from Distributional Semantic Similarities: A Replication with Extension. Front Psychol 2016; 7:1646. [PMID: 27822195 PMCID: PMC5076462 DOI: 10.3389/fpsyg.2016.01646] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2016] [Accepted: 10/07/2016] [Indexed: 11/28/2022] Open
Abstract
In two experiments, we attempted to replicate and extend findings by Günther et al. (2016) that word similarity measures obtained from distributional semantics models—Latent Semantic Analysis (LSA) and Hyperspace Analog to Language (HAL)—predict lexical priming effects. To this end, we used the pseudo-random method to generate item material while systematically controlling for word similarities introduced by Günther et al. (2016) which was based on LSA cosine similarities (Experiment 1) and HAL cosine similarities (Experiment 2). Extending the original study, we used semantic spaces created from far larger corpora, and implemented several additional methodological improvements. In Experiment 1, we only found a significant effect of HAL cosines on lexical decision times, while we found significant effects for both LSA and HAL cosines in Experiment 2. As further supported by an analysis of the pooled data from both experiments, this indicates that HAL cosines are a better predictor of priming effects than LSA cosines. Taken together, the results replicate the finding that priming effects can be predicted from distributional semantic similarity measures.
Collapse
Affiliation(s)
- Fritz Günther
- Department of Psychology, University of Tübingen Tübingen, Germany
| | - Carolin Dudschig
- Department of Psychology, University of Tübingen Tübingen, Germany
| | - Barbara Kaup
- Department of Psychology, University of Tübingen Tübingen, Germany
| |
Collapse
|
29
|
Hunter CR. Is the time course of lexical activation and competition in spoken word recognition affected by adult aging? An event-related potential (ERP) study. Neuropsychologia 2016; 91:451-464. [DOI: 10.1016/j.neuropsychologia.2016.09.007] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2016] [Revised: 09/05/2016] [Accepted: 09/07/2016] [Indexed: 10/21/2022]
|
30
|
These lemons are sour: Investigating the influence of demonstrative determiners on the N400 complex. Neurosci Lett 2016; 630:141-146. [DOI: 10.1016/j.neulet.2016.07.031] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2016] [Revised: 07/11/2016] [Accepted: 07/18/2016] [Indexed: 11/22/2022]
|
31
|
Is there a difference between stripy journeys and stripy ladybirds? The N400 response to semantic and world-knowledge violations during sentence processing. Brain Cogn 2016; 103:38-49. [DOI: 10.1016/j.bandc.2016.01.001] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2015] [Revised: 12/08/2015] [Accepted: 01/04/2016] [Indexed: 01/23/2023]
|
32
|
van Vliet M, Chumerin N, De Deyne S, Wiersema JR, Fias W, Storms G, Van Hulle MM. Single-Trial ERP Component Analysis Using a Spatiotemporal LCMV Beamformer. IEEE Trans Biomed Eng 2016; 63:55-66. [PMID: 26285053 DOI: 10.1109/tbme.2015.2468588] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
33
|
Payne BR, Lee CL, Federmeier KD. Revisiting the incremental effects of context on word processing: Evidence from single-word event-related brain potentials. Psychophysiology 2015; 52:1456-69. [PMID: 26311477 DOI: 10.1111/psyp.12515] [Citation(s) in RCA: 70] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2015] [Accepted: 07/26/2015] [Indexed: 11/28/2022]
Abstract
The amplitude of the N400-an event-related potential (ERP) component linked to meaning processing and initial access to semantic memory-is inversely related to the incremental buildup of semantic context over the course of a sentence. We revisited the nature and scope of this incremental context effect, adopting a word-level linear mixed-effects modeling approach, with the goal of probing the continuous and incremental effects of semantic and syntactic context on multiple aspects of lexical processing during sentence comprehension (i.e., effects of word frequency and orthographic neighborhood). First, we replicated the classic word-position effect at the single-word level: Open-class words showed reductions in N400 amplitude with increasing word position in semantically congruent sentences only. Importantly, we found that accruing sentence context had separable influences on the effects of frequency and neighborhood on the N400. Word frequency effects were reduced with accumulating semantic context. However, orthographic neighborhood was unaffected by accumulating context, showing robust effects on the N400 across all words, even within congruent sentences. Additionally, we found that N400 amplitudes to closed-class words were reduced with incrementally constraining syntactic context in sentences that provided only syntactic constraints. Taken together, our findings indicate that modeling word-level variability in ERPs reveals mechanisms by which different sources of information simultaneously contribute to the unfolding neural dynamics of comprehension.
Collapse
Affiliation(s)
- Brennan R Payne
- Department of Psychology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA.,The Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| | - Chia-Lin Lee
- Graduate Institute of Linguistics, Department of Psychology, Graduate Institute of Brain and Mind Sciences, and Neurobiology and Cognitive Neuroscience Center National Taiwan University, Taipei, Taiwan
| | - Kara D Federmeier
- Department of Psychology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA.,The Beckman Institute for Advanced Science and Technology, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA.,The Neuroscience Program, University of Illinois at Urbana-Champaign, Urbana, Illinois, USA
| |
Collapse
|