1
|
Jiménez-Ortega L, Casado-Palacios M, Rubianes M, Martínez-Mejias M, Casado P, Fondevila S, Hernández-Gutiérrez D, Muñoz F, Sánchez-García J, Martín-Loeches M. The bigger your pupils, the better my comprehension: an ERP study of how pupil size and gaze of the speaker affect syntactic processing. Soc Cogn Affect Neurosci 2024; 19:nsae047. [PMID: 38918898 PMCID: PMC11246839 DOI: 10.1093/scan/nsae047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Revised: 05/16/2024] [Accepted: 06/25/2024] [Indexed: 06/27/2024] Open
Abstract
Gaze direction and pupil dilation play a critical role in communication and social interaction due to their ability to redirect and capture our attention and their relevance for emotional information. The present study aimed to explore whether the pupil size and gaze direction of the speaker affect language comprehension. Participants listened to sentences that could be correct or contain a syntactic anomaly, while the static face of a speaker was manipulated in terms of gaze direction (direct, averted) and pupil size (mydriasis, miosis). Left anterior negativity (LAN) and P600 linguistic event-related potential components were observed in response to syntactic anomalies across all conditions. The speaker's gaze did not impact syntactic comprehension. However, the amplitude of the LAN component for mydriasis (dilated pupil) was larger than for miosis (constricted pupil) condition. Larger pupils are generally associated with care, trust, interest, and attention, which might facilitate syntactic processing at early automatic stages. The result also supports the permeable and context-dependent nature of syntax. Previous studies also support an automatic nature of syntax (fast and efficient), which combined with the permeability to relevant sources of communicative information, such as pupil size and emotions, is highly adaptive for language comprehension and social interaction.
Collapse
Affiliation(s)
- Laura Jiménez-Ortega
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid 28029, Spain
- Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid 28040, Spain
| | - María Casado-Palacios
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid 28029, Spain
- DIBRIS, University of Genoa, Genoa 16145, Italy
- UVIP – Unit for Visually Impaired People, Italian Institute of Technology, Genova 16164, Italy
| | - Miguel Rubianes
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid 28029, Spain
- Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid 28040, Spain
- Facultad de Ciencias de la Salud UNIE Universidad, Madrid 28015, Spain
| | - Mario Martínez-Mejias
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid 28029, Spain
| | - Pilar Casado
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid 28029, Spain
- Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid 28040, Spain
| | - Sabela Fondevila
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid 28029, Spain
- Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid 28040, Spain
| | - David Hernández-Gutiérrez
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid 28029, Spain
- BCBL, Basque Center on Cognition, Brain and Language, Donostia/San Sebastián 20009, Spain
| | - Francisco Muñoz
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid 28029, Spain
- Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid 28040, Spain
| | - José Sánchez-García
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid 28029, Spain
- Facultad de Psicología, Universidad Internacional de la Rioja UNIR, Oviedo, Asturias 33003, Spain
| | - Manuel Martín-Loeches
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid 28029, Spain
- Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid 28040, Spain
| |
Collapse
|
2
|
Forgács B. Meaning as mentalization. Front Hum Neurosci 2024; 18:1384116. [PMID: 38855407 PMCID: PMC11158629 DOI: 10.3389/fnhum.2024.1384116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2024] [Accepted: 05/02/2024] [Indexed: 06/11/2024] Open
Abstract
The way we establish meaning has been a profound question not only in language research but in developmental science as well. The relation between linguistic form and content has been loosened up in recent pragmatic approaches to communication, showing that code-based models of language comprehension must be augmented by context-sensitive, pragmatic-inferential mechanisms to recover the speaker's intended meaning. Language acquisition has traditionally been thought to involve building a mental lexicon and extracting syntactic rules from noisy linguistic input, while communicative-pragmatic inferences have also been argued to be indispensable. Recent research findings exploring the electrophysiological indicator of semantic processing, the N400, have raised serious questions about the traditional separation between semantic decoding and pragmatic inferential processes. The N400 appears to be sensitive to mentalization-the ability to attribute beliefs to social partners-already from its developmental onset. This finding raises the possibility that mentalization may not simply contribute to pragmatic inferences that enrich linguistic decoding processes but that the semantic system may be functioning in a fundamentally mentalistic manner. The present review first summarizes the key contributions of pragmatic models of communication to language comprehension. Then, it provides an overview of how communicative intentions are interpreted in developmental theories of communication, with a special emphasis on mentalization. Next, it discusses the sensitivity of infants to the information-transmitting potential of language, their ability to pick up its code-like features, and their capacity to track language comprehension of social partners using mentalization. In conclusion, I argue that the recovery of meaning during linguistic communication is not adequately modeled as a process of code-based semantic retrieval complemented by pragmatic inferences. Instead, the semantic system may establish meaning, as intended, during language comprehension and acquisition through mentalistic attribution of content to communicative partners.
Collapse
Affiliation(s)
- Bálint Forgács
- Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin, Berlin, Germany
- Department of Cognitive Psychology, ELTE Eötvös Loránd University, Budapest, Hungary
| |
Collapse
|
3
|
Rubianes M, Drijvers L, Muñoz F, Jiménez-Ortega L, Almeida-Rivera T, Sánchez-García J, Fondevila S, Casado P, Martín-Loeches M. The Self-reference Effect Can Modulate Language Syntactic Processing Even Without Explicit Awareness: An Electroencephalography Study. J Cogn Neurosci 2024; 36:460-474. [PMID: 38165746 DOI: 10.1162/jocn_a_02104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2024]
Abstract
Although it is well established that self-related information can rapidly capture our attention and bias cognitive functioning, whether this self-bias can affect language processing remains largely unknown. In addition, there is an ongoing debate as to the functional independence of language processes, notably regarding the syntactic domain. Hence, this study investigated the influence of self-related content on syntactic speech processing. Participants listened to sentences that could contain morphosyntactic anomalies while the masked face identity (self, friend, or unknown faces) was presented for 16 msec preceding the critical word. The language-related ERP components (left anterior negativity [LAN] and P600) appeared for all identity conditions. However, the largest LAN effect followed by a reduced P600 effect was observed for self-faces, whereas a larger LAN with no reduction of the P600 was found for friend faces compared with unknown faces. These data suggest that both early and late syntactic processes can be modulated by self-related content. In addition, alpha power was more suppressed over the left inferior frontal gyrus only when self-faces appeared before the critical word. This may reflect higher semantic demands concomitant to early syntactic operations (around 150-550 msec). Our data also provide further evidence of self-specific response, as reflected by the N250 component. Collectively, our results suggest that identity-related information is rapidly decoded from facial stimuli and may impact core linguistic processes, supporting an interactive view of syntactic processing. This study provides evidence that the self-reference effect can be extended to syntactic processing.
Collapse
Affiliation(s)
- Miguel Rubianes
- Complutense University of Madrid, Spain
- UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain
| | - Linda Drijvers
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
- Donders Institute for Brain, Cognition and Behaviour, Nijmegen, The Netherlands
| | - Francisco Muñoz
- Complutense University of Madrid, Spain
- UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain
| | - Laura Jiménez-Ortega
- Complutense University of Madrid, Spain
- UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain
| | | | | | - Sabela Fondevila
- Complutense University of Madrid, Spain
- UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain
| | - Pilar Casado
- Complutense University of Madrid, Spain
- UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain
| | - Manuel Martín-Loeches
- Complutense University of Madrid, Spain
- UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain
| |
Collapse
|
4
|
Sinha S, Del Goleto S, Kostova M, Debruille JB. Unveiling the need of interactions for social N400s and supporting the N400 inhibition hypothesis. Sci Rep 2023; 13:12613. [PMID: 37537222 PMCID: PMC10400652 DOI: 10.1038/s41598-023-39345-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 07/24/2023] [Indexed: 08/05/2023] Open
Abstract
When participants (Pps) are presented with stimuli in the presence of another person, they may consider that person's perspective. Indeed, five recent ERP studies show that the amplitudes of their N400s are increased. The two most recent ones reveal that these social-N400 increases occur even when instructions do not require a focus on the other's perspective. These increases also happen when Pps know that this other person has the same stimulus information as they have. However, in all these works, Pps could see the other person. Here, we tested whether the interaction occurring with this sight is important or whether these social N400 increases also occur when the other person is seated a bit behind Pps, who are aware of it. All had to decide whether the word ending short stories was coherent, incoherent, or equivocal. No social N400 increase was observed: N400s elicited by those words in Pps who were with a confederate (n = 50) were similar to those of Pps who were alone (n = 51). On the other hand, equivocal endings did not elicit larger N400s than coherent ones but triggered larger late posterior positivities (LPPs), like in previous studies. The discussion focuses on the circumstances in which perspective-taking occurs and on the functional significance of the N400 and the LPP.
Collapse
Affiliation(s)
- Sujata Sinha
- Department of Neurosciences, Faculty of Medicine, McGill University, Montréal, Canada
- Research Center of the Douglas Mental Health University Institute, Montréal, Canada
| | - Sarah Del Goleto
- UR Paragraphe, Université Paris 8 Vincennes-Saint-Denis, Saint-Denis, France
| | - Milena Kostova
- UR Paragraphe, Université Paris 8 Vincennes-Saint-Denis, Saint-Denis, France
| | - J Bruno Debruille
- Department of Neurosciences, Faculty of Medicine, McGill University, Montréal, Canada.
- Research Center of the Douglas Mental Health University Institute, Montréal, Canada.
- Department of Psychiatry, Faculty of Medicine, McGill University, Montréal, Canada.
| |
Collapse
|
5
|
Semantic systems are mentalistically activated for and by social partners. Sci Rep 2022; 12:4866. [PMID: 35318349 PMCID: PMC8941134 DOI: 10.1038/s41598-022-08306-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Accepted: 03/03/2022] [Indexed: 11/17/2022] Open
Abstract
A recently discovered electrophysiological response, the social N400, suggests that we use our language system to track how social partners comprehend language. Listeners show an increased N400 response, when themselves not, only a communicative partner experiences a semantic incongruity. Does the N400 reflect purely semantic or mentalistic computations as well? Do we attribute language comprehension to communicative partners using our semantic systems? In five electrophysiological experiments we identified two subcomponents of the social N400. First, we manipulated the presence-absence of an Observer during object naming: the semantic memory system was activated by the presence of a social partner in addition to semantic predictions for the self. Next, we induced a false belief—and a consequent miscomprehension—in the Observer. Participants showed the social N400, over and above the social presence effect, to labels that were incongruent for the Observer, even though they were congruent for them. This effect appeared only if participants received explicit instructions to track the comprehension of the Observer. These findings suggest that the semantic systems of the brain are not merely sensitive to social information and contribute to the attribution of comprehension, but they appear to be mentalistic in nature.
Collapse
|
6
|
Fairs A, Strijkers K. Can we use the internet to study speech production? Yes we can! Evidence contrasting online versus laboratory naming latencies and errors. PLoS One 2021; 16:e0258908. [PMID: 34679082 PMCID: PMC8535377 DOI: 10.1371/journal.pone.0258908] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Accepted: 10/07/2021] [Indexed: 11/19/2022] Open
Abstract
The closure of cognitive psychology labs around the world due to the COVID-19 pandemic has prevented in-person testing. This has caused a particular challenge for speech production researchers, as before the pandemic there were no studies demonstrating that reliable overt speech production data could be collected via the internet. Here, we present evidence that both accurate and reliable overt articulation data can be collected from internet-based speech production experiments. We tested 100 participants in a picture naming paradigm, where we manipulated the word and phonotactic frequency of the picture names. We compared our results to a lab-based study conducted on different participants which used the same materials and design. We found a significant word frequency effect but no phonotactic frequency effect, fully replicating the lab-based results. Effect sizes were similar between experiments, but with significantly longer latencies in the internet-collected data. We found no evidence that internet upload or download speed affected either naming latencies or errors. In addition, we carried out a permutation-style analysis which recommends a minimum sample size of 40 participants for online production paradigms. In sum, our study demonstrates that internet-based testing of speech production is a feasible and promising endeavour, with less challenges than many researchers (anecdotally) assumed.
Collapse
Affiliation(s)
- Amie Fairs
- Laboratoire Parole et Langage, Aix-Marseille Université & CNRS, Aix-en-Provence, France
| | - Kristof Strijkers
- Laboratoire Parole et Langage, Aix-Marseille Université & CNRS, Aix-en-Provence, France
| |
Collapse
|
7
|
Jiménez-Ortega L, Badaya E, Casado P, Fondevila S, Hernández-Gutiérrez D, Muñoz F, Sánchez-García J, Martín-Loeches M. The Automatic but Flexible and Content-Dependent Nature of Syntax. Front Hum Neurosci 2021; 15:651158. [PMID: 34177488 PMCID: PMC8226263 DOI: 10.3389/fnhum.2021.651158] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Accepted: 05/07/2021] [Indexed: 11/13/2022] Open
Abstract
Syntactic processing has often been considered an utmost example of unconscious automatic processing. In this line, it has been demonstrated that masked words containing syntactic anomalies are processed by our brain triggering event related potential (ERP) components similar to the ones triggered by conscious syntactic anomalies, thus supporting the automatic nature of the syntactic processing. Conversely, recent evidence also points out that regardless of the level of awareness, emotional information and other relevant extralinguistic information modulate conscious syntactic processing too. These results are also in line with suggestions that, under certain circumstances, syntactic processing could also be flexible and context-dependent. However, the study of the concomitant automatic but flexible conception of syntactic parsing is very scarce. Hence, to this aim, we examined whether and how masked emotional words (positive, negative, and neutral masked adjectives) containing morphosyntactic anomalies (half of the cases) affect linguistic comprehension of an ongoing unmasked sentence that also can contain a number agreement anomaly between the noun and the verb. ERP components were observed to emotional information (EPN), masked anomalies (LAN and a weak P600), and unmasked ones (LAN/N400 and P600). Furthermore, interactions in the processing of conscious and unconscious morphosyntactic anomalies and between unconscious emotional information and conscious anomalies were detected. The findings support, on the one hand, the automatic nature of syntax, given that syntactic components LAN and P600 were observed to unconscious anomalies. On the other hand, the flexible, permeable, and context-dependent nature of the syntactic processing is also supported, since unconscious information modulated conscious syntactic components. This double nature of syntactic processing is in line with theories of automaticity, suggesting that even unconscious/automatic, syntactic processing is flexible, adaptable, and context-dependent.
Collapse
Affiliation(s)
- Laura Jiménez-Ortega
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain.,Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid, Spain
| | - Esperanza Badaya
- School of Philosophy, Psychology and Language Sciences, The University of Edinburgh, Edinburgh, United Kingdom
| | - Pilar Casado
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain.,Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid, Spain
| | - Sabela Fondevila
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain.,Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid, Spain
| | | | - Francisco Muñoz
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain.,Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid, Spain
| | - José Sánchez-García
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain
| | - Manuel Martín-Loeches
- Cognitive Neuroscience Section, UCM-ISCIII Center for Human Evolution and Behavior, Madrid, Spain.,Department of Psychobiology & Behavioral Sciences Methods, Complutense University of Madrid, Madrid, Spain
| |
Collapse
|