1
|
Reilly J, Shain C, Borghesani V, Kuhnke P, Vigliocco G, Peelle JE, Mahon BZ, Buxbaum LJ, Majid A, Brysbaert M, Borghi AM, De Deyne S, Dove G, Papeo L, Pexman PM, Poeppel D, Lupyan G, Boggio P, Hickok G, Gwilliams L, Fernandino L, Mirman D, Chrysikou EG, Sandberg CW, Crutch SJ, Pylkkänen L, Yee E, Jackson RL, Rodd JM, Bedny M, Connell L, Kiefer M, Kemmerer D, de Zubicaray G, Jefferies E, Lynott D, Siew CSQ, Desai RH, McRae K, Diaz MT, Bolognesi M, Fedorenko E, Kiran S, Montefinese M, Binder JR, Yap MJ, Hartwigsen G, Cantlon J, Bi Y, Hoffman P, Garcea FE, Vinson D. What we mean when we say semantic: Toward a multidisciplinary semantic glossary. Psychon Bull Rev 2024:10.3758/s13423-024-02556-7. [PMID: 39231896 DOI: 10.3758/s13423-024-02556-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/19/2024] [Indexed: 09/06/2024]
Abstract
Tulving characterized semantic memory as a vast repository of meaning that underlies language and many other cognitive processes. This perspective on lexical and conceptual knowledge galvanized a new era of research undertaken by numerous fields, each with their own idiosyncratic methods and terminology. For example, "concept" has different meanings in philosophy, linguistics, and psychology. As such, many fundamental constructs used to delineate semantic theories remain underspecified and/or opaque. Weak construct specificity is among the leading causes of the replication crisis now facing psychology and related fields. Term ambiguity hinders cross-disciplinary communication, falsifiability, and incremental theory-building. Numerous cognitive subdisciplines (e.g., vision, affective neuroscience) have recently addressed these limitations via the development of consensus-based guidelines and definitions. The project to follow represents our effort to produce a multidisciplinary semantic glossary consisting of succinct definitions, background, principled dissenting views, ratings of agreement, and subjective confidence for 17 target constructs (e.g., abstractness, abstraction, concreteness, concept, embodied cognition, event semantics, lexical-semantic, modality, representation, semantic control, semantic feature, simulation, semantic distance, semantic dimension). We discuss potential benefits and pitfalls (e.g., implicit bias, prescriptiveness) of these efforts to specify a common nomenclature that other researchers might index in specifying their own theoretical perspectives (e.g., They said X, but I mean Y).
Collapse
Affiliation(s)
| | - Cory Shain
- Massachusetts Institute of Technology, Cambridge, MA, USA
| | | | - Philipp Kuhnke
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Leipzig University, Leipzig, Germany
| | | | | | | | - Laurel J Buxbaum
- Thomas Jefferson University, Moss Rehabilitation Research Institute, Elkins Park, PA, USA
| | | | | | | | | | - Guy Dove
- University of Louisville, Louisville, KY, USA
| | - Liuba Papeo
- Centre National de La Recherche Scientifique (CNRS), University Claude-Bernard Lyon, Lyon, France
| | | | | | | | - Paulo Boggio
- Universidade Presbiteriana Mackenzie, São Paulo, Brazil
| | | | | | | | | | | | | | | | | | - Eiling Yee
- University of Connecticut, Storrs, CT, USA
| | | | | | | | | | | | | | | | | | | | | | | | - Ken McRae
- Western University, London, ON, Canada
| | | | | | | | | | | | | | - Melvin J Yap
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- National University of Singapore, Singapore, Singapore
| | - Gesa Hartwigsen
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Leipzig University, Leipzig, Germany
| | | | - Yanchao Bi
- University of Edinburgh, Edinburgh, UK
- Beijing Normal University, Beijing, China
| | | | | | | |
Collapse
|
2
|
Antoine S, Grisoni L, Tomasello R, Pulvermüller F. The prediction potential indexes the meaning and communicative function of upcoming utterances. Cortex 2024; 177:346-362. [PMID: 38917725 DOI: 10.1016/j.cortex.2024.05.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Revised: 03/15/2024] [Accepted: 05/03/2024] [Indexed: 06/27/2024]
Abstract
Prediction has a fundamental role in language processing. However, predictions can be made at different levels, and it is not always clear whether speech sounds, morphemes, words, meanings, or communicative functions are anticipated during dialogues. Previous studies reported specific brain signatures of communicative pragmatic function, in particular enhanced brain responses immediately after encountering an utterance used to request an object from a partner, but relatively smaller ones when the same utterance was used for naming the object. The present experiment now investigates whether similar neuropragmatic signatures emerge in recipients before the onset of upcoming utterances carrying different predictable communicative functions. Trials started with a context question and object pictures displayed on the screen, raising the participant's expectation that words from a specific semantic category (food or tool) would subsequently be used to either name or request one of the objects. Already 600 msec before utterance onset, a larger prediction potential was observed when a request was anticipated relative to naming expectation. As this result is congruent with the neurophysiological difference previously observed right after the critical utterance, the anticipatory brain activity may index predictions about the social-communicative function of upcoming utterances. In addition, we also found that the predictable semantic category of the upcoming word was likewise reflected in the anticipatory brain potential. Thus, the neurophysiological characteristics of the prediction potential can capture different types of upcoming linguistic information, including semantic and pragmatic aspects of an upcoming utterance and communicative action.
Collapse
Affiliation(s)
- Salomé Antoine
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany.
| | - Luigi Grisoni
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Berlin, Germany
| | - Rosario Tomasello
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Berlin, Germany
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, Freie Universität Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Berlin, Germany; Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Berlin, Germany; Einstein Center for Neurosciences, Berlin, Germany.
| |
Collapse
|
3
|
Fischer MH. On the embodied nature of knowledge: From neurons to numbers. Ann N Y Acad Sci 2024; 1537:5-12. [PMID: 38943430 DOI: 10.1111/nyas.15182] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/01/2024]
Abstract
Interdisciplinary investigations of the human mind through the cognitive sciences have identified a key role of the body in representing knowledge. After characterizing knowledge at grounded, embodied, and situated levels, number knowledge is analyzed from this hierarchical perspective. Lateralized cortical processing of coarse versus fine detail is identified as a grounding substrate for the population stereotype few/left, many/right, which then contributes to number-related sensory and motor biases at the embodied and situated levels. Implications of this perspective for education and rehabilitation are discussed.
Collapse
Affiliation(s)
- Martin H Fischer
- Department of Psychology, University of Potsdam, Potsdam, Germany
| |
Collapse
|
4
|
Trumpp NM, Ulrich M, Kiefer M. Experiential grounding of abstract concepts: Processing of abstract mental state concepts engages brain regions involved in mentalizing, automatic speech, and lip movements. Neuroimage 2024; 288:120539. [PMID: 38342187 DOI: 10.1016/j.neuroimage.2024.120539] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 01/22/2024] [Accepted: 02/09/2024] [Indexed: 02/13/2024] Open
Abstract
concepts like mental state concepts lack a physical referent, which can be directly perceived. Classical theories therefore claim that abstract concepts require amodal representations detached from experiential brain systems. However, grounded cognition approaches suggest an involvement of modal experiential brain regions in the processing of abstract concepts. In the present functional magnetic resonance imaging study, we investigated the relation of the processing of abstract mental state concepts to modal experiential brain systems in a fine-grained fashion. Participants performed lexical decisions on abstract mental state as well as on verbal association concepts as control category. Experiential brain systems related to the processing of mental states, generating verbal associations, automatic speech as well as hand and lip movements were determined by corresponding localizer tasks. Processing of abstract mental state concepts neuroanatomically overlapped with activity patterns associated with processing of mental states, generating verbal associations, automatic speech and lip movements. Hence, mental state concepts activate the mentalizing brain network, complemented by perceptual-motor brain regions involved in simulation of visual or action features associated with social interactions, linguistic brain regions as well as face-motor brain regions recruited for articulation. The present results provide compelling evidence for the rich grounding of abstract mental state concepts in experiential brain systems related to mentalizing, verbal communication and mouth action.
Collapse
Affiliation(s)
- Natalie M Trumpp
- Department of Psychiatry, Section for Cognitive Electrophysiology, Ulm University, Leimgrubenweg 12, Ulm D-89075, Germany.
| | - Martin Ulrich
- Department of Psychiatry, Section for Cognitive Electrophysiology, Ulm University, Leimgrubenweg 12, Ulm D-89075, Germany
| | - Markus Kiefer
- Department of Psychiatry, Section for Cognitive Electrophysiology, Ulm University, Leimgrubenweg 12, Ulm D-89075, Germany
| |
Collapse
|
5
|
Pulvermüller F. Neurobiological mechanisms for language, symbols and concepts: Clues from brain-constrained deep neural networks. Prog Neurobiol 2023; 230:102511. [PMID: 37482195 PMCID: PMC10518464 DOI: 10.1016/j.pneurobio.2023.102511] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2022] [Revised: 05/02/2023] [Accepted: 07/18/2023] [Indexed: 07/25/2023]
Abstract
Neural networks are successfully used to imitate and model cognitive processes. However, to provide clues about the neurobiological mechanisms enabling human cognition, these models need to mimic the structure and function of real brains. Brain-constrained networks differ from classic neural networks by implementing brain similarities at different scales, ranging from the micro- and mesoscopic levels of neuronal function, local neuronal links and circuit interaction to large-scale anatomical structure and between-area connectivity. This review shows how brain-constrained neural networks can be applied to study in silico the formation of mechanisms for symbol and concept processing and to work towards neurobiological explanations of specifically human cognitive abilities. These include verbal working memory and learning of large vocabularies of symbols, semantic binding carried by specific areas of cortex, attention focusing and modulation driven by symbol type, and the acquisition of concrete and abstract concepts partly influenced by symbols. Neuronal assembly activity in the networks is analyzed to deliver putative mechanistic correlates of higher cognitive processes and to develop candidate explanations founded in established neurobiological principles.
Collapse
Affiliation(s)
- Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, 14195 Berlin, Germany; Berlin School of Mind and Brain, Humboldt Universität zu Berlin, 10099 Berlin, Germany; Einstein Center for Neurosciences Berlin, 10117 Berlin, Germany; Cluster of Excellence 'Matters of Activity', Humboldt Universität zu Berlin, 10099 Berlin, Germany.
| |
Collapse
|
6
|
Bechtold L, Cosper SH, Malyshevskaya A, Montefinese M, Morucci P, Niccolai V, Repetto C, Zappa A, Shtyrov Y. Brain Signatures of Embodied Semantics and Language: A Consensus Paper. J Cogn 2023; 6:61. [PMID: 37841669 PMCID: PMC10573703 DOI: 10.5334/joc.237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2022] [Accepted: 07/29/2022] [Indexed: 10/17/2023] Open
Abstract
According to embodied theories (including embodied, embedded, extended, enacted, situated, and grounded approaches to cognition), language representation is intrinsically linked to our interactions with the world around us, which is reflected in specific brain signatures during language processing and learning. Moving on from the original rivalry of embodied vs. amodal theories, this consensus paper addresses a series of carefully selected questions that aim at determining when and how rather than whether motor and perceptual processes are involved in language processes. We cover a wide range of research areas, from the neurophysiological signatures of embodied semantics, e.g., event-related potentials and fields as well as neural oscillations, to semantic processing and semantic priming effects on concrete and abstract words, to first and second language learning and, finally, the use of virtual reality for examining embodied semantics. Our common aim is to better understand the role of motor and perceptual processes in language representation as indexed by language comprehension and learning. We come to the consensus that, based on seminal research conducted in the field, future directions now call for enhancing the external validity of findings by acknowledging the multimodality, multidimensionality, flexibility and idiosyncrasy of embodied and situated language and semantic processes.
Collapse
Affiliation(s)
- Laura Bechtold
- Institute for Experimental Psychology, Department for Biological Psychology, Heinrich-Heine University Düsseldorf, Germany
| | - Samuel H. Cosper
- Institute of Cognitive Science, University of Osnabrück, Germany
| | - Anastasia Malyshevskaya
- Centre for Cognition and Decision making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Potsdam Embodied Cognition Group, Cognitive Sciences, University of Potsdam, Germany
| | | | | | - Valentina Niccolai
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University Düsseldorf, Germany
| | - Claudia Repetto
- Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy
| | - Ana Zappa
- Laboratoire parole et langage, Aix-Marseille Université, Aix-en-Provence, France
| | - Yury Shtyrov
- Centre for Cognition and Decision making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Center of Functionally Integrative Neuroscience, Department of Clinical Medicine, Aarhus University, Denmark
| |
Collapse
|
7
|
Reggin LD, Gómez Franco LE, Horchak OV, Labrecque D, Lana N, Rio L, Vigliocco G. Consensus Paper: Situated and Embodied Language Acquisition. J Cogn 2023; 6:63. [PMID: 37841673 PMCID: PMC10573584 DOI: 10.5334/joc.308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2022] [Accepted: 07/10/2023] [Indexed: 10/17/2023] Open
Abstract
Theories of embodied cognition postulate that perceptual, sensorimotor, and affective properties of concepts support language learning and processing. In this paper, we argue that language acquisition, as well as processing, is situated in addition to being embodied. In particular, first, it is the situated nature of initial language development that affords for the developing system to become embodied. Second, the situated nature of language use changes across development and adulthood. We provide evidence from empirical studies for embodied effects of perception, action, and valence as they apply to both embodied cognition and situated cognition across developmental stages. Although the evidence is limited, we urge researchers to consider differentiating embodied cognition within situated context, in order to better understand how these separate mechanisms interact for learning to occur. This delineation also provides further clarity to the study of classroom-based applications and the role of embodied and situated cognition in the study of developmental disorders. We argue that theories of language acquisition need to address for the complex situated context of real-world learning by completing a "circular notion": observing experimental paradigms in real-world settings and taking these observations to later refine lab-based experiments.
Collapse
Affiliation(s)
| | | | | | | | - Nadia Lana
- McMaster University, Hamilton, ON, Canada
| | - Laura Rio
- Universitàdi Bologna, Bologna, Italy
| | | |
Collapse
|
8
|
Banks B, Borghi AM, Fargier R, Fini C, Jonauskaite D, Mazzuca C, Montalti M, Villani C, Woodin G. Consensus Paper: Current Perspectives on Abstract Concepts and Future Research Directions. J Cogn 2023; 6:62. [PMID: 37841672 PMCID: PMC10573588 DOI: 10.5334/joc.238] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Accepted: 08/12/2022] [Indexed: 10/17/2023] Open
Abstract
concepts are relevant to a wide range of disciplines, including cognitive science, linguistics, psychology, cognitive, social, and affective neuroscience, and philosophy. This consensus paper synthesizes the work and views of researchers in the field, discussing current perspectives on theoretical and methodological issues, and recommendations for future research. In this paper, we urge researchers to go beyond the traditional abstract-concrete dichotomy and consider the multiple dimensions that characterize concepts (e.g., sensorimotor experience, social interaction, conceptual metaphor), as well as the mediating influence of linguistic and cultural context on conceptual representations. We also promote the use of interactive methods to investigate both the comprehension and production of abstract concepts, while also focusing on individual differences in conceptual representations. Overall, we argue that abstract concepts should be studied in a more nuanced way that takes into account their complexity and diversity, which should permit us a fuller, more holistic understanding of abstract cognition.
Collapse
Affiliation(s)
- Briony Banks
- Department of Psychology, Lancaster University, UK
| | - Anna M. Borghi
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome, Italy
- Institute of Cognitive Sciences and Technologies, Italian National Research Council, Rome, Italy
| | - Raphaël Fargier
- Department of Special Needs Education, University of Oslo, Norway
| | - Chiara Fini
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome, Italy
| | - Domicele Jonauskaite
- Faculty of Psychology, University of Vienna, Vienna, Austria
- Institute of Psychology, University of Lausanne, Lausanne, Switzerland
| | - Claudia Mazzuca
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome, Italy
| | - Martina Montalti
- Department of Clinical and Experimental Sciences, University of Brescia, Italy
- Department of Medicine and Surgery – Unit of Neuroscience, University of Parma, Italy
| | - Caterina Villani
- Department of Modern Languages, Literatures, and Cultures, University of Bologna, Italy
| | - Greg Woodin
- Department of English Language and Linguistics, University of Birmingham, UK
| |
Collapse
|
9
|
Reyes-Aguilar A, Licea-Haquet G, Arce BI, Giordano M. Contribution and functional connectivity between cerebrum and cerebellum on sub-lexical and lexical-semantic processing of verbs. PLoS One 2023; 18:e0291558. [PMID: 37708205 PMCID: PMC10501569 DOI: 10.1371/journal.pone.0291558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 09/01/2023] [Indexed: 09/16/2023] Open
Abstract
Language comprehension involves both sub-lexical (e.g., phonological) and lexical-semantic processing. We conducted a task using functional magnetic resonance imaging (fMRI) to compare the processing of verbs in these two domains. Additionally, we examined the representation of concrete-motor and abstract-non-motor concepts by including two semantic categories of verbs: motor and mental. The findings indicate that sub-lexical processing during the reading of pseudo-verbs primarily involves the left dorsal stream of the perisylvian network, while lexical-semantic representation during the reading of verbs predominantly engages the ventral stream. According to the embodied or grounded cognition approach, modality-specific mechanisms (such as sensory-motor systems) and the well-established multimodal left perisylvian network contribute to the semantic representation of both concrete and abstract verbs. Our study identified the visual system as a preferential modality-specific system for abstract-mental verbs, which exhibited functional connectivity with the right crus I/lobule VI of the cerebellum. Taken together, these results confirm the dissociation between sub-lexical and lexical-semantic processing and provide neurobiological evidence of functional coupling between specific visual modality regions and the right cerebellum, forming a network that supports the semantic representation of abstract concepts. Further, the results shed light on the underlying mechanisms of semantic processing and contribute to our understanding of how the brain processes abstract concepts.
Collapse
Affiliation(s)
- Azalea Reyes-Aguilar
- Department of Psychobiology and Neuroscience, Faculty of Psychology, Universidad Nacional Autónoma de México, Mexico City, Mexico
| | - Giovanna Licea-Haquet
- Department of Behavioral and Cognitive Neurobiology, Instituto de Neurobiología, Universidad Nacional Autónoma de México, Queretaro, Mexico
| | - Brenda I. Arce
- Department of Psychobiology and Neuroscience, Faculty of Psychology, Universidad Nacional Autónoma de México, Mexico City, Mexico
| | - Magda Giordano
- Department of Behavioral and Cognitive Neurobiology, Instituto de Neurobiología, Universidad Nacional Autónoma de México, Queretaro, Mexico
| |
Collapse
|
10
|
Monaco E, Mouthon M, Britz J, Sato S, Stefanos-Yakoub I, Annoni JM, Jost LB. Embodiment of action-related language in the native and a late foreign language - An fMRI-study. BRAIN AND LANGUAGE 2023; 244:105312. [PMID: 37579516 DOI: 10.1016/j.bandl.2023.105312] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Revised: 08/05/2023] [Accepted: 08/07/2023] [Indexed: 08/16/2023]
Abstract
Theories of embodied cognition postulate that language processing activates similar sensory-motor structures as when interacting with the environment. Only little is known about the neural substrate of embodiment in a foreign language (L2) as compared to the mother tongue (L1). In this fMRI study, we investigated embodiment of motor and non-motor action verbs in L1 and L2 including 31 late bilinguals. Half had German as L1 and French as L2, and the other half vice-versa. We collapsed across languages to avoid the confound between language and order of language acquisition. Region of interest analyses showed stronger activation in motor regions during L2 than during L1 processing, independently of the motor-relatedness of the verbs. Moreover, a stronger involvement of motor regions for motor-related as compared to non-motor-related verbs, similarly for L1 and L2, was found. Overall, the similarity between L1 and L2 embodiment seems to depend on individual and contextual factors.
Collapse
Affiliation(s)
- E Monaco
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland
| | - M Mouthon
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland
| | - J Britz
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland
| | - S Sato
- Department of Psychology, University of Fribourg, Switzerland
| | - I Stefanos-Yakoub
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland
| | - J M Annoni
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland
| | - L B Jost
- Department of Neuroscience and Movement Science, Faculty of Science and Medicine, University of Fribourg, Switzerland.
| |
Collapse
|
11
|
Tokuhama-Espinosa T, Simmers K, Batchelor D, Nelson AD, Borja C. A Theory of Mental Frameworks. Front Psychol 2023; 14:1220664. [PMID: 37546472 PMCID: PMC10400359 DOI: 10.3389/fpsyg.2023.1220664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Accepted: 06/21/2023] [Indexed: 08/08/2023] Open
Abstract
Problem-solving skills are highly valued in modern society and are often touted as core elements of school mission statements, desirable traits for job applicants, and as some of the most complex thinking that the brain is capable of executing. While learning to problem-solve is a goal of education, and many strategies, methodologies, and activities exist to help teachers guide the development of these skills, there are few formal curriculum structures or broader frameworks that guide teachers toward the achievement of this educational objective. Problem-solving skills have been called "higher order cognitive functions" in cognitive neuroscience as they involve multiple complex networks in the brain, rely on constant rehearsal, and often take years to form. Children of all ages employ problem solving, from a newborn seeking out food to children learning in school settings, or adults tackling real-world conflicts. These skills are usually considered the end product of a good education when in fact, in order to be developed they comprise an ongoing process of learning. "Ways of thinking" have been studied by philosophers and neuroscientists alike, to pinpoint cognitive preferences for problem solving approaches that develop from exposure to distinct models, derived from and resulting in certain heuristics used by learners. This new theory paper suggests a novel understanding of the brain's approach to problem solving that structures existing problem-solving frameworks into an organized design. The authors surveyed problem-solving frameworks from business administration, design, engineering, philosophy, psychology, education, neuroscience and other learning sciences to assess their differences and similarities. This review lead to an appreciation that different problem-solving frameworks from different fields respond more or less accurately and efficiently depending on the kinds of problems being tackled, leading to our conclusion that a wider range of frameworks may help individuals approach more varied problems across fields, and that such frameworks can be organized in school curriculum. This paper proposes that explicit instruction of "mental frameworks" may help organize and formalize the instruction of thinking skills that underpin problem-solving-and by extension-that the more such models a person learns, the more tools they will have for future complex problem-solving. To begin, this paper explains the theoretical underpinnings of the mental frameworks concept, then explores some existing mental frameworks which are applicable to all age groups and subject areas. The paper concludes with a list of five limitations to this proposal and pairs them with counter-balancing benefits.
Collapse
Affiliation(s)
- Tracey Tokuhama-Espinosa
- Harvard University Extension School, Faculty of Arts and Sciences, Cambridge, MA, United States
- Connections: The Learning Sciences Platform, Quito, Ecuador
| | - Kristin Simmers
- Neag School of Education, CT Institute for Brain and Cognitive Science University of Connecticut, Storrs, CT, United States
| | - Danielle Batchelor
- Harvard University Extension School, Faculty of Arts and Sciences, Cambridge, MA, United States
| | - Allen Drew Nelson
- Harvard University Extension School, Faculty of Arts and Sciences, Cambridge, MA, United States
| | - Cynthia Borja
- Connections: The Learning Sciences Platform, Quito, Ecuador
- The Decision Lab, Independent Behavioral Science Research, Montreal, QC, Canada
| |
Collapse
|
12
|
Tian L, Chen H, Heikkinen PP, Liu W, Parviainen T. Spatiotemporal Dynamics of Activation in Motor and Language Areas Suggest a Compensatory Role of the Motor Cortex in Second Language Processing. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2023; 4:178-197. [PMID: 37229145 PMCID: PMC10205076 DOI: 10.1162/nol_a_00093] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/15/2022] [Accepted: 11/14/2022] [Indexed: 05/27/2023]
Abstract
The involvement of the motor cortex in language understanding has been intensively discussed in the framework of embodied cognition. Although some studies have provided evidence for the involvement of the motor cortex in different receptive language tasks, the role that it plays in language perception and understanding is still unclear. In the present study, we explored the degree of involvement of language and motor areas in a visually presented sentence comprehension task, modulated by language proficiency (L1: native language, L2: second language) and linguistic abstractness (literal, metaphorical, and abstract). Magnetoencephalography data were recorded from 26 late Chinese learners of English. A cluster-based permutation F test was performed on the amplitude of the source waveform for each motor and language region of interest (ROI). Results showed a significant effect of language proficiency in both language and motor ROIs, manifested as overall greater involvement of language ROIs (short insular gyri and planum polare of the superior temporal gyrus) in the L1 than the L2 during 300-500 ms, and overall greater involvement of motor ROI (central sulcus) in the L2 than the L1 during 600-800 ms. We interpreted the over-recruitment of the motor area in the L2 as a higher demand for cognitive resources to compensate for the inadequate engagement of the language network. In general, our results indicate a compensatory role of the motor cortex in L2 understanding.
Collapse
Affiliation(s)
- Lili Tian
- Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
- Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä, Finland
- School of Foreign Languages, Dalian University of Technology, Dalian, China
- Language and Brain Research Centre, Sichuan International Studies University, Chongqing, China
| | - Hongjun Chen
- School of Foreign Languages, Dalian University of Technology, Dalian, China
| | - Pyry Petteri Heikkinen
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
- Faculty of Educational Sciences, University of Helsinki, Helsinki, Finland
| | - Wenya Liu
- Faculty of Information Technology, University of Jyväskylä, Jyväskylä, Finland
| | - Tiina Parviainen
- Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
- Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä, Finland
| |
Collapse
|
13
|
Henningsen-Schomers MR, Garagnani M, Pulvermüller F. Influence of language on perception and concept formation in a brain-constrained deep neural network model. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210373. [PMID: 36571136 PMCID: PMC9791487 DOI: 10.1098/rstb.2021.0373] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Abstract
A neurobiologically constrained model of semantic learning in the human brain was used to simulate the acquisition of concrete and abstract concepts, either with or without verbal labels. Concept acquisition and semantic learning were simulated using Hebbian learning mechanisms. We measured the network's category learning performance, defined as the extent to which it successfully (i) grouped partly overlapping perceptual instances into a single (abstract or concrete) conceptual representation, while (ii) still distinguishing representations for distinct concepts. Co-presence of linguistic labels with perceptual instances of a given concept generally improved the network's learning of categories, with a significantly larger beneficial effect for abstract than concrete concepts. These results offer a neurobiological explanation for causal effects of language structure on concept formation and on perceptuo-motor processing of instances of these concepts: supplying a verbal label during concept acquisition improves the cortical mechanisms by which experiences with objects and actions along with the learning of words lead to the formation of neuronal ensembles for specific concepts and meanings. Furthermore, the present results make a novel prediction, namely, that such 'Whorfian' effects should be modulated by the concreteness/abstractness of the semantic categories being acquired, with language labels supporting the learning of abstract concepts more than that of concrete ones. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.
Collapse
Affiliation(s)
- Malte R. Henningsen-Schomers
- Department of Philosophy and Humanities, Brain Language Laboratory, Freie Universität Berlin, Habelschwerdter Allee 45, 14195 Berlin, Germany,Cluster of Excellence ‘Matters of Activity. Image Space Material’, Humboldt-Universität zu Berlin, 10099 Berlin, Germany
| | - Max Garagnani
- Department of Philosophy and Humanities, Brain Language Laboratory, Freie Universität Berlin, Habelschwerdter Allee 45, 14195 Berlin, Germany,Department of Computing, Goldsmiths, University of London, London, SE14 6NW, UK
| | - Friedemann Pulvermüller
- Department of Philosophy and Humanities, Brain Language Laboratory, Freie Universität Berlin, Habelschwerdter Allee 45, 14195 Berlin, Germany,Berlin School of Mind and Brain, 10099 Berlin, Germany,Einstein Center for Neurosciences, 10117 Berlin, Germany,Cluster of Excellence ‘Matters of Activity. Image Space Material’, Humboldt-Universität zu Berlin, 10099 Berlin, Germany
| |
Collapse
|
14
|
Borghi AM, Fernyhough C. Concepts, abstractness and inner speech. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210371. [PMID: 36571134 PMCID: PMC9791492 DOI: 10.1098/rstb.2021.0371] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Accepted: 06/23/2022] [Indexed: 12/27/2022] Open
Abstract
We explore the role of inner speech (covert self-directed talk) during the acquisition and use of concepts differing in abstractness. Following Vygotsky, inner speech results from the internalization of linguistically mediated interactions that regulate cognition and behaviour. When we acquire and process abstract concepts, uncertainties about word meaning might lead us to search actively for their meaning. Inner speech might play a role in this searching process and be differentially involved in concept learning compared with use of known concepts. Importantly, inner speech comes in different varieties-e.g. it can be expanded or condensed (with the latter involving syntactic and semantic forms of abbreviation). Do we use inner speech differently with concepts varying in abstractness? Which kinds of inner speech do we preferentially use with different kinds of abstract concepts (e.g. emotions versus numbers)? What other features of inner speech, such as dialogicality, might facilitate our use of concepts varying in abstractness (by allowing us to monitor the limits of our knowledge in simulated social exchanges, through a process we term inner social metacognition)? In tackling these questions, we address the possibility that different varieties of inner speech are flexibly used during the acquisition of concepts and their everyday use. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.
Collapse
Affiliation(s)
- Anna M. Borghi
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome and Institute of Cognitive Sciences and Technologies, Italian National Research Council, Rome 00185, Italy
| | - Charles Fernyhough
- Department of Psychology, Durham University, South Road, Durham DH1 3LE, UK
| |
Collapse
|
15
|
Bayram M, Palluel-Germain R, Lebon F, Durand E, Harquel S, Perrone-Bertolotti M. Motor imagery training to improve language processing: What are the arguments? Front Hum Neurosci 2023; 17:982849. [PMID: 36816506 PMCID: PMC9929469 DOI: 10.3389/fnhum.2023.982849] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 01/09/2023] [Indexed: 02/04/2023] Open
Abstract
Studies showed that motor expertise was found to induce improvement in language processing. Grounded and situated approaches attributed this effect to an underlying automatic simulation of the motor experience elicited by action words, similar to motor imagery (MI), and suggest shared representations of action conceptualization. Interestingly, recent results also suggest that the mental simulation of action by MI training induces motor-system modifications and improves motor performance. Consequently, we hypothesize that, since MI training can induce motor-system modifications, it could be used to reinforce the functional connections between motor and language system, and could thus lead to improved language performance. Here, we explore these potential interactions by reviewing recent fundamental and clinical literature in the action-language and MI domains. We suggested that exploiting the link between action language and MI could open new avenues for complementary language improvement programs. We summarize the current literature to evaluate the rationale behind this novel training and to explore the mechanisms underlying MI and its impact on language performance.
Collapse
Affiliation(s)
- Mariam Bayram
- Univ. Grenoble Alpes, Univ. Savoie Mont Blanc, CNRS, LPNC, 38000 Grenoble, France
| | | | - Florent Lebon
- Laboratoire INSERM U1093 Cognition, Action, et Plasticité Sensorimotrice, Université de Bourgogne, Faculté des Sciences du Sport (UFR STAPS), Dijon, France,Institut Universitaire de France (IUF), Paris, France
| | - Edith Durand
- Département d’Orthophonie, Université du Québec à Trois-Rivières, Trois-Rivières, QC, Canada
| | - Sylvain Harquel
- Defitech Chair of Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), École Polytechnique Fédérale de Lausanne (EPFL), Geneva, Switzerland
| | - Marcela Perrone-Bertolotti
- Univ. Grenoble Alpes, Univ. Savoie Mont Blanc, CNRS, LPNC, 38000 Grenoble, France,Institut Universitaire de France (IUF), Paris, France,*Correspondence: Marcela Perrone-Bertolotti,
| |
Collapse
|
16
|
Muraki EJ, Doyle A, Protzner AB, Pexman PM. Context matters: How do task demands modulate the recruitment of sensorimotor information during language processing? Front Hum Neurosci 2023; 16:976954. [PMID: 36733894 PMCID: PMC9886877 DOI: 10.3389/fnhum.2022.976954] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Accepted: 12/30/2022] [Indexed: 01/18/2023] Open
Abstract
Many theories of semantic representation propose that simulations of sensorimotor experience contribute to language processing. This can be seen in the body-object interaction effect (BOI; how easily the human body can interact with a word's referent). Words with high BOI ratings (e.g., ball) are processed more quickly than words with low BOI ratings (e.g., cloud) in various language tasks. This effect can be modulated by task demands. Previous research established that when asked to decide if a word is an object (entity condition), a BOI effect is observed, but when asked to decide if a word is an action (action condition), there is no BOI effect. It is unclear whether the null behavioral effect in the action condition reflects top-down modulation of task-relevant sensorimotor information or the absence of bottom-up activation of sensorimotor simulations. We investigated this question using EEG. In Experiment 1 we replicated the previous behavioral findings. In Experiment 2, 50 participants were assigned to either the entity or action conditions and responded to the same word stimuli. In both conditions we observed differences in ERP components related to the BOI effect. In the entity condition the P2 mean amplitude was significantly more positive for high compared to low BOI words. In the action condition the N400 peak latency was significantly later for high compared to low BOI words. Our findings suggest that BOI information is generated bottom-up regardless of task demands and modulated by top-down processes that recruit sensorimotor information relevant to the task decision.
Collapse
Affiliation(s)
- Emiko J. Muraki
- Department of Psychology, University of Calgary, Calgary, AB, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Alison Doyle
- Department of Psychology, University of Calgary, Calgary, AB, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Andrea B. Protzner
- Department of Psychology, University of Calgary, Calgary, AB, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| | - Penny M. Pexman
- Department of Psychology, University of Calgary, Calgary, AB, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, AB, Canada
| |
Collapse
|
17
|
Embodied empathy and abstract concepts' concreteness: Evidence from contemplative practices. PROGRESS IN BRAIN RESEARCH 2023. [DOI: 10.1016/bs.pbr.2022.12.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/15/2023]
|
18
|
Montalti M, Calbi M, Cuccio V, Umiltà MA, Gallese V. Is motor inhibition involved in the processing of sentential negation? An assessment via the Stop-Signal Task. PSYCHOLOGICAL RESEARCH 2023; 87:339-352. [PMID: 33905001 PMCID: PMC9873753 DOI: 10.1007/s00426-021-01512-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
In the last decades, the embodied approach to cognition and language gained momentum in the scientific debate, leading to evidence in different aspects of language processing. However, while the bodily grounding of concrete concepts seems to be relatively not controversial, abstract aspects, like the negation logical operator, are still today one of the main challenges for this research paradigm. In this framework, the present study has a twofold aim: (1) to assess whether mechanisms for motor inhibition underpin the processing of sentential negation, thus, providing evidence for a bodily grounding of this logic operator, (2) to determine whether the Stop-Signal Task, which has been used to investigate motor inhibition, could represent a good tool to explore this issue. Twenty-three participants were recruited in this experiment. Ten hand-action-related sentences, both in affirmative and negative polarity, were presented on a screen. Participants were instructed to respond as quickly and accurately as possible to the direction of the Go Stimulus (an arrow) and to withhold their response when they heard a sound following the arrow. This paradigm allows estimating the Stop Signal Reaction Time (SSRT), a covert reaction time underlying the inhibitory process. Our results show that the SSRT measured after reading negative sentences are longer than after reading affirmative ones, highlighting the recruitment of inhibitory mechanisms while processing negative sentences. Furthermore, our methodological considerations suggest that the Stop-Signal Task is a good paradigm to assess motor inhibition's role in the processing of sentence negation.
Collapse
Affiliation(s)
- Martina Montalti
- grid.10383.390000 0004 1758 0937Department of Medicine and Surgery Unit of Neuroscience, University of Parma, Parma, Italy
| | - Marta Calbi
- grid.10383.390000 0004 1758 0937Department of Medicine and Surgery Unit of Neuroscience, University of Parma, Parma, Italy
| | - Valentina Cuccio
- grid.10438.3e0000 0001 2178 8421Department of Cognitive, Psychological, Pedagogical Sciences and Cultural Studies, University of Messina, Messina, Italy
| | - Maria Alessandra Umiltà
- grid.10383.390000 0004 1758 0937Department of Food and Drug, University of Parma, Parma, Italy
| | - Vittorio Gallese
- grid.10383.390000 0004 1758 0937Department of Medicine and Surgery Unit of Neuroscience, University of Parma, Parma, Italy ,grid.7468.d0000 0001 2248 7639Berlin School of Mind and Brain, Humboldt-Universität Zu Berlin, Berlin, Germany
| |
Collapse
|
19
|
Ulrich M, Harpaintner M, Trumpp NM, Berger A, Kiefer M. Academic training increases grounding of scientific concepts in experiential brain systems. Cereb Cortex 2022; 33:5646-5657. [PMID: 36514124 DOI: 10.1093/cercor/bhac449] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Revised: 10/18/2022] [Accepted: 10/19/2022] [Indexed: 12/15/2022] Open
Abstract
Scientific concepts typically transcendent our sensory experiences. Traditional approaches to science education therefore assume a shift towards amodal or verbal knowledge representations during academic training. Grounded cognition approaches, in contrast, predict a maintenance of grounding of the concepts in experiential brain networks or even an increase. To test these competing approaches, the present study investigated the semantic content of scientific psychological concepts and identified the corresponding neural circuits using functional magnetic resonance imaging (fMRI) in undergraduate psychology students (beginners) and in graduated psychologists (advanced learners). During fMRI scanning, participants were presented with words denoting scientific psychological concepts within a lexical decision task (e.g. "conditioning", "habituation"). The individual semantic property content of each concept was related to brain activity during abstract concept processing. In both beginners and advanced learners, visual and motor properties activated brain regions also involved in perception and action, while mental state properties increased activity in brain regions also recruited by emotional-social scene observation. Only in advanced learners, social constellation properties elicited brain activity overlapping with emotional-social scene observation. In line with grounded cognition approaches, the present results highlight the importance of experiential information for constituting the meaning of abstract scientific concepts during the course of academic training.
Collapse
Affiliation(s)
- Martin Ulrich
- Department of Psychiatry, Ulm University, Leimgrubenweg 12, Ulm 89075, Germany
| | - Marcel Harpaintner
- Department of Psychiatry, Ulm University, Leimgrubenweg 12, Ulm 89075, Germany
| | - Natalie M Trumpp
- Department of Psychiatry, Ulm University, Leimgrubenweg 12, Ulm 89075, Germany
| | - Alexander Berger
- Department of Psychiatry, Ulm University, Leimgrubenweg 12, Ulm 89075, Germany
| | - Markus Kiefer
- Department of Psychiatry, Ulm University, Leimgrubenweg 12, Ulm 89075, Germany
| |
Collapse
|
20
|
Chang W, Wang L, Yang R, Wang X, Gao Z, Zhou X. Representing linguistic communicative functions in the premotor cortex. Cereb Cortex 2022; 33:5671-5689. [PMID: 36437790 DOI: 10.1093/cercor/bhac451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 10/18/2022] [Indexed: 11/29/2022] Open
Abstract
Abstract
Linguistic communication is often regarded as an action that serves a function to convey the speaker's goal to the addressee. Here, with an functional magnetic resonance imaging (fMRI) study and a lesion study, we demonstrated that communicative functions are represented in the human premotor cortex. Participants read scripts involving 2 interlocutors. Each script contained a critical sentence said by the speaker with a communicative function of either making a Promise, a Request, or a Reply to the addressee's query. With various preceding contexts, the critical sentences were supposed to induce neural activities associated with communicative functions rather than specific actions literally described by these sentences. The fMRI results showed that the premotor cortex contained more information, as revealed by multivariate analyses, on communicative functions and relevant interlocutors' attitudes than the perisylvian language regions. The lesion study results showed that, relative to healthy controls, the understanding of communicative functions was impaired in patients with lesions in the premotor cortex, whereas no reliable difference was observed between the healthy controls and patients with lesions in other brain regions. These findings convergently suggest the crucial role of the premotor cortex in representing the functions of linguistic communications, supporting that linguistic communication can be seen as an action.
Collapse
Affiliation(s)
- Wenshuo Chang
- Institute of Linguistics, Shanghai International Studies University , 1550 Wenxiang Road, Shanghai 201620 , China
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University , 5 Yiheyuan Road, Beijing 100871 , China
| | - Lihui Wang
- Institute of Psychology and Behavioral Science, Shanghai Jiao Tong University , 1954 Huashan Road, Shanghai 200030 , China
- Shanghai Key Laboratory of Psychotic Disorders, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine , 600 Wan Ping Nan Road, Shanghai 200030 , China
- Shanghai Center for Brain Science and Brain-Inspired Intelligence Technology , 555 Qiangye Road Shanghai 200125 , China
| | - Ruolin Yang
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University , 5 Yiheyuan Road, Beijing 100871 , China
- Beijing Neurosurgical Institute, Capital Medical University , 119 South Fourth Ring West Road, Beijing 100070 , China
- Peking-Tsinghua Center for Life Sciences, Peking University , 5 Yiheyuan Road, Beijing 100871 , China
- IDG/McGovern Institute for Brain Research, Peking University , 5 Yiheyuan Road, Beijing 100871 , China
| | - Xingchao Wang
- Beijing Tiantan Hospital, Capital Medical University Department of Neurosurgery, , 119 South Fourth Ring West Road, Beijing 100070 , China
- China National Clinical Research Center for Neurological Diseases , 119 South Fourth Ring West Road, Beijing 100070 , China
| | - Zhixian Gao
- Beijing Tiantan Hospital, Capital Medical University Department of Neurosurgery, , 119 South Fourth Ring West Road, Beijing 100070 , China
- China National Clinical Research Center for Neurological Diseases , 119 South Fourth Ring West Road, Beijing 100070 , China
| | - Xiaolin Zhou
- Institute of Linguistics, Shanghai International Studies University , 1550 Wenxiang Road, Shanghai 201620 , China
- Beijing Key Laboratory of Behavior and Mental Health, School of Psychological and Cognitive Sciences, Peking University , 5 Yiheyuan Road, Beijing 100871 , China
- IDG/McGovern Institute for Brain Research, Peking University , 5 Yiheyuan Road, Beijing 100871 , China
- Shanghai Key Laboratory of Mental Health and Psychological Crisis Intervention, School of Psychology and Cognitive Science, East China Normal University , 3663 North Zhongshan Road, Shanghai 200062 , China
| |
Collapse
|
21
|
Borghi AM, Shaki S, Fischer MH. Abstract concepts: external influences, internal constraints, and methodological issues. PSYCHOLOGICAL RESEARCH 2022; 86:2370-2388. [PMID: 35788903 PMCID: PMC9674746 DOI: 10.1007/s00426-022-01698-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
There is a longstanding and widely held misconception about the relative remoteness of abstract concepts from concrete experiences. This review examines the current evidence for external influences and internal constraints on the processing, representation, and use of abstract concepts, like truth, friendship, and number. We highlight the theoretical benefit of distinguishing between grounded and embodied cognition and then ask which roles do perception, action, language, and social interaction play in acquiring, representing and using abstract concepts. By reviewing several studies, we show that they are, against the accepted definition, not detached from perception and action. Focussing on magnitude-related concepts, we also discuss evidence for cultural influences on abstract knowledge and explore how internal processes such as inner speech, metacognition, and inner bodily signals (interoception) influence the acquisition and retrieval of abstract knowledge. Finally, we discuss some methodological developments. Specifically, we focus on the importance of studies that investigate the time course of conceptual processing and we argue that, because of the paramount role of sociality for abstract concepts, new methods are necessary to study concepts in interactive situations. We conclude that bodily, linguistic, and social constraints provide important theoretical limitations for our theories of conceptual knowledge.
Collapse
Affiliation(s)
- Anna M Borghi
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome, 00185, Rome, Italy.
- Institute of Cognitive Sciences and Technologies, Italian National Research Council, 00185, Rome, Italy.
| | - Samuel Shaki
- Department of Behavioral Sciences, Ariel University, 44837, Ariel, Israel
| | | |
Collapse
|
22
|
Abstract
Concepts allow us to make sense of the world. Most evidence on their acquisition and representation comes from studies of single decontextualized words and focuses on the opposition between concrete and abstract concepts (e.g., "bottle" vs. "truth"). A significant step forward in research on concepts consists in investigating them in online interaction during their use. Our study examines linguistic exchanges analyzing the differences between sub-kinds of concepts. Participants were submitted to an online task in which they had to simulate a conversational exchange by responding to sentences involving sub-kinds of concrete (tools, animals, food) and abstract concepts (PS, philosophical-spiritual; EMSS, emotional-social, PSTQ, physical-spatio-temporal-quantitative). We found differences in content: foods evoked interoception; tools and animals elicited materials, spatial, auditive features, confirming their sensorimotor grounding. PS and EMSS yielded inner experiences (e.g., emotions, cognitive states, introspections) and opposed PSTQ, tied to visual properties and concrete agency. More crucially, the various concepts elicited different interactional dynamics: more abstract concepts generated higher uncertainty and more interactive exchanges than concrete ones. Investigating concepts in situated interactions opens new possibilities for studying conceptual knowledge and its pragmatic and social aspects.
Collapse
|
23
|
De Marco D, De Stefani E, Vecchiato G. Embodying Language through Gestures: Residuals of Motor Memories Modulate Motor Cortex Excitability during Abstract Words Comprehension. SENSORS (BASEL, SWITZERLAND) 2022; 22:7734. [PMID: 36298083 PMCID: PMC9610064 DOI: 10.3390/s22207734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/02/2022] [Revised: 10/04/2022] [Accepted: 10/10/2022] [Indexed: 06/16/2023]
Abstract
There is a debate about whether abstract semantics could be represented in a motor domain as concrete language. A contextual association with a motor schema (action or gesture) seems crucial to highlighting the motor system involvement. The present study with transcranial magnetic stimulation aimed to assess motor cortex excitability changes during abstract word comprehension after conditioning word reading to a gesture execution with congruent or incongruent meaning. Twelve healthy volunteers were engaged in a lexical-decision task responding to abstract words or meaningless verbal stimuli. Motor cortex (M1) excitability was measured at different after-stimulus intervals (100, 250, or 500 ms) before and after an associative-learning training where the execution of the gesture followed word processing. Results showed a significant post-training decrease in hand motor evoked potentials at an early processing stage (100 ms) in correspondence to words congruent with the gestures presented during the training. We hypothesized that traces of individual semantic memory, combined with training effects, induced M1 inhibition due to the redundancy of evoked motor representation. No modulation of cortical excitability was found for meaningless or incongruent words. We discuss data considering the possible implications in research to understand the neural basis of language development and language rehabilitation protocols.
Collapse
Affiliation(s)
- Doriana De Marco
- Istituto di Neuroscienze, Consiglio Nazionale delle Ricerche, 43125 Parma, Italy
- Dipartimento di Medicina e Chirurgia, Università degli Studi di Parma, 43125 Parma, Italy
| | - Elisa De Stefani
- Child and Adolescent Neuropsychiatry-NPIA District of Scandiano, AUSL of Reggio Emilia, 42019 Reggio Emilia, Italy
| | - Giovanni Vecchiato
- Istituto di Neuroscienze, Consiglio Nazionale delle Ricerche, 43125 Parma, Italy
- Dipartimento di Medicina e Chirurgia, Università degli Studi di Parma, 43125 Parma, Italy
| |
Collapse
|
24
|
Yao Z, Chai Y, Yang P, Zhao R, Wang F. Effects of social experience on abstract concepts in semantic priming. Front Psychol 2022; 13:912176. [PMID: 36118490 PMCID: PMC9480607 DOI: 10.3389/fpsyg.2022.912176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Accepted: 07/18/2022] [Indexed: 11/13/2022] Open
Abstract
Humans can understand thousands of abstract words, even when they do not have clearly perceivable referents. Recent views highlight an important role of social experience in grounding of abstract concepts and sub-kinds of abstract concepts, but empirical work in this area is still in its early stages. In the present study, a picture-word semantic priming paradigm was employed to investigate the contribution effect of social experience that is provided by real-life pictures to social abstract (SA, e.g., friendship, betrayal) concepts and emotional abstract (EA, e.g., happiness, anger) concepts. Using a lexical decision task, we examined responses to picture-SA word pairs (Experiment 1) and picture-EA word pairs (Experiment 2) in social/emotional semantically related and unrelated conditions. All pairs shared either positive or negative valence. The results showed quicker responses to positive SA and EA words that were preceded by related vs. unrelated prime pictures. Specifically, positive SA words were facilitated by the corresponding social scene pictures, whereas positive EA words were facilitated by pictures depict the corresponding facial expressions and gestures. However, such facilitatory effect was not observed in negative picture-SA/EA word conditions. This pattern of results suggests that a facilitatory effect of social experience on abstract concepts varies with different sub-kinds of abstract concepts, that seems to be limited to positive SA concepts. Overall, our findings confirm the crucial role of social experience for abstract concepts and further suggest that not all abstract concepts can benefit from social experience, at least in the semantic priming.
Collapse
Affiliation(s)
- Zhao Yao
- School of Foreign Studies, Xi’an Jiaotong University, Xi’an, China
- *Correspondence: Zhao Yao,
| | - Yu Chai
- School of Foreign Studies, Xi’an Jiaotong University, Xi’an, China
| | - Peiying Yang
- School of Humanities, Xidian University, Xi’an, China
| | - Rong Zhao
- School of Foreign Studies, Xi’an Jiaotong University, Xi’an, China
| | - Fei Wang
- School of Foreign Studies, Xi’an Jiaotong University, Xi’an, China
- Fei Wang,
| |
Collapse
|
25
|
Li X, Luo D, Wang C, Xia Y, Jin H. Motor features of abstract verbs determine their representations in the motor system. Front Psychol 2022; 13:957426. [PMID: 36110272 PMCID: PMC9469731 DOI: 10.3389/fpsyg.2022.957426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 07/19/2022] [Indexed: 11/13/2022] Open
Abstract
Embodied cognition theory posits that concept representations inherently rely on sensorimotor experiences that accompany their acquisitions. This is well established through concrete concepts. However, it is debatable whether representations of abstract concepts are based on sensorimotor representations. This study investigated the causal role of associated motor experiences that accompany concept acquisition in the involvement of the motor system in the abstract verb processing. Through two experiments, we examined the action–sentence compatibility effect, in the test phase after an increase in motor features during the learning phase for abstract verbs with low motor features (Experiment 1) or novel words with no conceptual features at all (Experiment 2). After associated motor experiences were added in the word learning phase, action–sentence compatibility effect was found in the semantic processing tasks during the test phase for abstract verbs (Experiment 1a) and novel words (Experiment 2). This was lacking in the word font color judgment task requiring no semantic processing (Experiment 1b). Coupled with our previous study, these findings suggest that motor features formed during word learning could causally affect embodiment in the motor system for abstract verbs, and reactivation of motor experiences in abstract verb processing depends on a given task’s demands. Our study supports the view that conceptual representations, even abstract concepts, can be grounded in sensorimotor experiences.
Collapse
Affiliation(s)
- Xiang Li
- Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, China
- Faculty of Psychology, Tianjin Normal University, Tianjin, China
- Department of Psychology, Xinxiang Medical University, Xinxiang, China
| | - Dan Luo
- Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, China
- Faculty of Psychology, Tianjin Normal University, Tianjin, China
- Faculty of Education, Henan Normal University, Xinxiang, China
| | - Chao Wang
- Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, China
- Faculty of Psychology, Tianjin Normal University, Tianjin, China
| | - Yaoyuan Xia
- Department of Physical Education, Zhejiang University of Finance and Economics, Hangzhou, China
| | - Hua Jin
- Academy of Psychology and Behavior, Tianjin Normal University, Tianjin, China
- Faculty of Psychology, Tianjin Normal University, Tianjin, China
- *Correspondence: Hua Jin,
| |
Collapse
|
26
|
Wang Y, Ji Q, Zhou C, Wang Y. Brain mechanisms linking language processing and open motor skill training. Front Hum Neurosci 2022; 16:911894. [PMID: 35992938 PMCID: PMC9386041 DOI: 10.3389/fnhum.2022.911894] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2022] [Accepted: 07/19/2022] [Indexed: 11/13/2022] Open
Abstract
Given the discovery of a distributed language and motor functional network, surprisingly few studies have explored whether language processing is related to motor skill training. To address this issue, the present study used functional magnetic resonance imaging to compare whole-brain activation between nonexperts and experts in table tennis, an open skill sport in which players make rapid decisions in response to an ever-changing environment. Whole-brain activation was assessed in 30 expert table tennis players with more than 7 years’ experience and 35 age-matched nonexpert college students while they performed both a size and a semantic judgment task of words presented on a monitor. Compared with nonexperts, expert table tennis players showed greater activation in the left middle occipital gyrus and right precuneus while judging the size of the words versus during baseline fixation. They also showed greater activation in the left lingual gyrus during the semantic judgment task versus during baseline fixation. Our findings indicate that the visual regions engaged in language processing are associated with open motor skill training.
Collapse
Affiliation(s)
- Yixuan Wang
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Qingchun Ji
- Department of Physical Education, Shanghai University of Engineering Science, Shanghai, China
| | - Chenglin Zhou
- School of Psychology, Shanghai University of Sport, Shanghai, China
| | - Yingying Wang
- School of Psychology, Shanghai University of Sport, Shanghai, China
- *Correspondence: Yingying Wang,
| |
Collapse
|
27
|
Borghi AM, Fini C, Mazzuca C. Abstract Concepts, Social Interaction, and Beliefs. Front Psychol 2022; 13:919808. [PMID: 35846674 PMCID: PMC9278159 DOI: 10.3389/fpsyg.2022.919808] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Accepted: 05/31/2022] [Indexed: 11/23/2022] Open
Affiliation(s)
- Anna M. Borghi
- Laboratory BALLAB (Body Action Language LAB), Department of Dynamic and Clinical Psychology and Health Studies, Sapienza University of Rome, Rome, Italy
- Institute of Cognitive Sciences and Technologies, Italian National Research Council, Rome, Italy
| | - Chiara Fini
- Laboratory BALLAB (Body Action Language LAB), Department of Dynamic and Clinical Psychology and Health Studies, Sapienza University of Rome, Rome, Italy
| | - Claudia Mazzuca
- Laboratory BALLAB (Body Action Language LAB), Department of Dynamic and Clinical Psychology and Health Studies, Sapienza University of Rome, Rome, Italy
| |
Collapse
|
28
|
Giacobbe C, Raimo S, Cropano M, Santangelo G. Neural correlates of embodied action language processing: a systematic review and meta-analytic study. Brain Imaging Behav 2022; 16:2353-2374. [PMID: 35754077 DOI: 10.1007/s11682-022-00680-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/21/2022] [Indexed: 12/01/2022]
Abstract
The neural correlates of action language processing are still debated within embodied cognition research and little is known about the flexible involvement of modality-specific pre-motor system and multimodal high-level temporo-parietal regions as a function of explicit and implicit tasks. A systematic review and the Activation likelihood estimation (ALE) meta-analyses on functional neuroimaging studies were performed to identify neural correlates of action language processing activated during explicit and implicit tasks. The contrast ALE meta-analysis revealed activation of modality-specific premotor area and inferior frontal areas during explicit action language tasks while a greater activation of posterior temporo-occipital areas emerged for implicit tasks. The conjunction analysis revealed overlap in the temporo-parietal multimodal high-level regions for both types of tasks. Functional specialization of the middle temporal gyrus was found where the more posterior-occipital part resulted activated during implicit action language tasks whereas the antero-lateral part was involved in explicit tasks. Our findings were discussed within a conceptual flexibility perspective about the involvement of both the modality-specific and multimodal brain system during action language processing depending on different types of tasks.
Collapse
Affiliation(s)
- Chiara Giacobbe
- Department of Psychology, University of Campania Luigi Vanvitelli, Viale Ellittico, 31, 81100, Caserta, Italy
| | - Simona Raimo
- Department of Medical and Surgical Sciences, University "Magna Graecia" of Catanzaro, Viale Europa, 88100, Catanzaro, Italy.
| | - Maria Cropano
- Department of Psychology, University of Campania Luigi Vanvitelli, Viale Ellittico, 31, 81100, Caserta, Italy
| | - Gabriella Santangelo
- Department of Psychology, University of Campania Luigi Vanvitelli, Viale Ellittico, 31, 81100, Caserta, Italy
| |
Collapse
|
29
|
Shirai M, Soshi T. Hierarchical memory representation of verbal and nonverbal features for emotion. CURRENT PSYCHOLOGY 2022. [DOI: 10.1007/s12144-022-03200-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
30
|
Borghi AM. Concepts for Which We Need Others More: The Case of Abstract Concepts. CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE 2022. [DOI: 10.1177/09637214221079625] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The capability to form and use concepts is a core component of human cognition. Although all concepts are grounded in sensorimotor processes, more abstract concepts (e.g., “truth”) collect more heterogeneous and perceptually dissimilar exemplars; thus, linguistic interaction and social interaction are particularly crucial for their acquisition and use. Because of their indeterminacy, abstract concepts generate more uncertainty than more concrete concepts; hence, they induce people to monitor their inner knowledge longer and then to consult others to ask for information and negotiate the concept’s meaning. I propose that people need others more for abstract concepts than for concrete concepts: Other people are essential to acquire, process, and use abstract concepts. Conceiving abstract concepts in these terms requires the employment of novel, interactive methods to investigate how people represent them during their use.
Collapse
Affiliation(s)
- Anna M. Borghi
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome, and Institute of Cognitive Sciences and Technologies, Italian National Research Council, Rome, Italy
| |
Collapse
|
31
|
Gnedykh D, Tsvetova D, Mkrtychian N, Blagovechtchenski E, Kostromina S, Shtyrov Y. Broca’s area involvement in abstract and concrete word acquisition: tDCS evidence. Neurobiol Learn Mem 2022; 192:107622. [DOI: 10.1016/j.nlm.2022.107622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Revised: 02/01/2022] [Accepted: 04/19/2022] [Indexed: 10/18/2022]
|
32
|
Vargas R, Just MA. Similarities and differences in the neural representations of abstract concepts across English and Mandarin. Hum Brain Mapp 2022; 43:3195-3206. [PMID: 35344245 PMCID: PMC9188971 DOI: 10.1002/hbm.25844] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2021] [Revised: 02/28/2022] [Accepted: 03/12/2022] [Indexed: 11/07/2022] Open
Abstract
Recent research suggests there is a neural organization for representing abstract concepts that is common across English speakers. To investigate the possible role of language on the representation of abstract concepts, multivariate pattern analytic (MVPA) techniques were applied to fMRI data to compare the neural representations of 28 individual abstract concepts between native English and Mandarin speakers. Factor analyses of the activation patterns of the 28 abstract concepts from both languages characterized this commonality in terms of a set of four underlying neurosemantic dimensions, indicating the degree to which a concept is verbally represented, internal to the person, contains social content, and is rule‐based. These common semantic dimensions (factors) underlying the 28 concepts provided a sufficient basis for reliably identifying the individual abstract concepts from their neural signature in the other language with a mean rank accuracy of 0.65 (p < .001). Although the neural dimensions used for representing abstract concepts are common across languages, differences in the meaning of some individual concepts can be accommodated in terms of differential salience of particular dimensions. These semantic dimensions constitute a set of neurocognitive resources for abstract concept representations within a larger set of regions responsible for general semantic processing.
Collapse
Affiliation(s)
- Robert Vargas
- Department of Psychology, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA
| | - Marcel Adam Just
- Department of Psychology, Carnegie Mellon University, Pittsburgh, Pennsylvania, USA
| |
Collapse
|
33
|
Kiefer M, Pielke L, Trumpp NM. Differential temporo-spatial pattern of electrical brain activity during the processing of abstract concepts related to mental states and verbal associations. Neuroimage 2022; 252:119036. [PMID: 35219860 DOI: 10.1016/j.neuroimage.2022.119036] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Revised: 02/21/2022] [Accepted: 02/23/2022] [Indexed: 11/30/2022] Open
Abstract
Refined grounded cognition accounts propose that abstract concepts might be grounded in brain circuits involved in mentalizing. In the present event-related potential (ERP) study, we compared the time course of neural processing in response to semantically predefined abstract mental states and verbal association concepts during a lexical decision task. In addition to scalp ERPs, source estimates of underlying volume brain activity were determined to reveal spatio-temporal clusters of greater electrical brain activity to abstract mental state vs. verbal association concepts, and vice versa. Source estimates suggested early (onset 194 ms), but short-lived enhanced activity (offset 210 ms) to verbal association concepts in left occipital regions. Increased occipital activity might reflect retrieval of visual word form or access to visual conceptual features of associated words. Increased estimated source activity to mental state concepts was obtained in visuo-motor (superior parietal, pre- and postcentral areas) and mentalizing networks (lateral and medial prefrontal areas, insula, precuneus, temporo-parietal junction) with an onset of 212 ms, which extended to later time windows. The time course data indicated two processing phases: An initial conceptual access phase, in which linguistic and modal brain circuits rapidly process features depending on their relevance, and a later conceptual elaboration phase, in which elaborative processing within feature-specific networks further refines the concept. This study confirms the proposal that abstract concepts are based on representations in distinct neural circuits depending on their semantic feature content. The present research also highlights the importance of investigating sets of abstract concepts with a defined semantic content.
Collapse
Affiliation(s)
- Markus Kiefer
- Department of Psychiatry, Section for Cognitive Electrophysiology, Ulm University, Leimgrubenweg 12, Ulm D-89075, Germany.
| | - Lena Pielke
- Department of Psychiatry, Section for Cognitive Electrophysiology, Ulm University, Leimgrubenweg 12, Ulm D-89075, Germany
| | - Natalie M Trumpp
- Department of Psychiatry, Section for Cognitive Electrophysiology, Ulm University, Leimgrubenweg 12, Ulm D-89075, Germany
| |
Collapse
|
34
|
Beck J, Loretz E, Rasch B. Stress dynamically reduces sleep depth: temporal proximity to the stressor is crucial. Cereb Cortex 2022; 33:96-113. [PMID: 35196708 PMCID: PMC9758584 DOI: 10.1093/cercor/bhac055] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2021] [Revised: 01/22/2022] [Accepted: 01/23/2022] [Indexed: 11/12/2022] Open
Abstract
The anticipation of a future stressor can increase worry and cognitive arousal and has a detrimental effect on sleep. Similarly, experiencing a stressful event directly before sleep increases physiological and cognitive arousal and impairs subsequent sleep. However, the effects of post- vs. pre-sleep stress on sleep and their temporal dynamics have never been directly compared. Here, we examined the effect of an anticipated psychosocial stressor on sleep and arousal in a 90-min daytime nap, in 33 healthy female participants compared to an anticipated within-subject relaxation task. We compared the results to an additional group (n = 34) performing the same tasks directly before sleep. Anticipating stress after sleep reduced slow-wave activity/beta power ratio, slow-wave sleep, sleep spindles, and slow-wave parameters, in particular during late sleep, without a concomitant increase in physiological arousal. In contrast, pre-sleep psychosocial stress deteriorated the same parameters during early sleep with a concomitant increase in physiological arousal. Our results show that presleep cognitions directly affect sleep in temporal proximity to the stressor. While physiological arousal mediates the effects of presleep stress on early sleep, we suggest that effects during late sleep originate from a repeated reactivation of mental concepts associated with the stressful event during sleep.
Collapse
Affiliation(s)
- Jonas Beck
- Department of Psychology, University of Fribourg, Rue P.-A-de-Faucigny 2, CH-1700 Fribourg, Switzerland
| | - Erna Loretz
- The Siesta Group Schlafanalyse GmbH, Schlosshofer Strasse 11, 1210 Vienna, Austria
| | - Björn Rasch
- Corresponding author: Department of Psychology, University of Fribourg, Rue P.-A-de-Faucigny 2, CH-1700 Fribourg, Switzerland.
| |
Collapse
|
35
|
Nagata K, Kunii N, Shimada S, Fujitani S, Takasago M, Saito N. Spatiotemporal target selection for intracranial neural decoding of abstract and concrete semantics. Cereb Cortex 2022; 32:5544-5554. [PMID: 35169837 PMCID: PMC9753048 DOI: 10.1093/cercor/bhac034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2021] [Revised: 01/18/2022] [Accepted: 01/19/2021] [Indexed: 01/25/2023] Open
Abstract
Decoding the inner representation of a word meaning from human cortical activity is a substantial challenge in the development of speech brain-machine interfaces (BMIs). The semantic aspect of speech is a novel target of speech decoding that may enable versatile communication platforms for individuals with impaired speech ability; however, there is a paucity of electrocorticography studies in this field. We decoded the semantic representation of a word from single-trial cortical activity during an imageability-based property identification task that required participants to discriminate between the abstract and concrete words. Using high gamma activity in the language-dominant hemisphere, a support vector machine classifier could discriminate the 2-word categories with significantly high accuracy (73.1 ± 7.5%). Activities in specific time components from two brain regions were identified as significant predictors of abstract and concrete dichotomy. Classification using these feature components revealed that comparable prediction accuracy could be obtained based on a spatiotemporally targeted decoding approach. Our study demonstrated that mental representations of abstract and concrete word processing could be decoded from cortical high gamma activities, and the coverage of implanted electrodes and time window of analysis could be successfully minimized. Our findings lay the foundation for the future development of semantic-based speech BMIs.
Collapse
Affiliation(s)
- Keisuke Nagata
- Department of Neurosurgery, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8655, Japan
| | - Naoto Kunii
- Corresponding author: Department of Neurosurgery, The University of Tokyo, 73-1 Hongo, Bunkyo-ku, Tokyo 113-8655, Japan.
| | - Seijiro Shimada
- Department of Neurosurgery, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8655, Japan
| | - Shigeta Fujitani
- Department of Neurosurgery, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8655, Japan
| | - Megumi Takasago
- Department of Neurosurgery, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8655, Japan
| | - Nobuhito Saito
- Department of Neurosurgery, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8655, Japan
| |
Collapse
|
36
|
Kaiser D, Jacobs AM, Cichy RM. Modelling brain representations of abstract concepts. PLoS Comput Biol 2022; 18:e1009837. [PMID: 35120139 PMCID: PMC8849470 DOI: 10.1371/journal.pcbi.1009837] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Revised: 02/16/2022] [Accepted: 01/14/2022] [Indexed: 11/18/2022] Open
Abstract
Abstract conceptual representations are critical for human cognition. Despite their importance, key properties of these representations remain poorly understood. Here, we used computational models of distributional semantics to predict multivariate fMRI activity patterns during the activation and contextualization of abstract concepts. We devised a task in which participants had to embed abstract nouns into a story that they developed around a given background context. We found that representations in inferior parietal cortex were predicted by concept similarities emerging in models of distributional semantics. By constructing different model families, we reveal the models’ learning trajectories and delineate how abstract and concrete training materials contribute to the formation of brain-like representations. These results inform theories about the format and emergence of abstract conceptual representations in the human brain. How do we conceive abstract concepts, like love, peace, or truth? In this study, we investigate how our brains support the activation and contextualization of such abstract concepts. We asked participants to embed abstract nouns into a coherent story while we recorded functional MRI. Using multivariate analysis techniques, we computed how similar different abstract concepts were represented during this task. We then modelled these neural similarities among concepts with computational models of distributional semantics which capture the words’ co-occurance statistics in large natural language corpora. Our results reveal a correspondence between the computational models and brain representations in the inferior parietal cortex. This correspondence held when the computational models were only trained on subsets of the corpora that contained as few as 100,000 sentences and only abstract or concrete words. Our findings establish a neural correlate of abstract concept representation in the inferior parietal cortex, and they provide a first characterization of the format of these representations.
Collapse
Affiliation(s)
- Daniel Kaiser
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus-Liebig-Universität Gießen, Gießen, Germany
- Center for Mind, Brain and Behavior (CMBB), Philipps-Universität Marburg and Justus-Liebig-Universität Gießen, Marburg, Germany
- Department of Psychology, University of York, York, United Kingdom
- * E-mail:
| | - Arthur M. Jacobs
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
- Center for Cognitive Neuroscience Berlin, Freie Universität Berlin, Berlin, Germany
| | - Radoslaw M. Cichy
- Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
- Bernstein Center for Computational Neuroscience Berlin, Berlin, Germany
| |
Collapse
|
37
|
Del Maschio N, Fedeli D, Garofalo G, Buccino G. Evidence for the Concreteness of Abstract Language: A Meta-Analysis of Neuroimaging Studies. Brain Sci 2021; 12:32. [PMID: 35053776 PMCID: PMC8773921 DOI: 10.3390/brainsci12010032] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2021] [Revised: 12/06/2021] [Accepted: 12/13/2021] [Indexed: 11/17/2022] Open
Abstract
The neural mechanisms subserving the processing of abstract concepts remain largely debated. Even within the embodiment theoretical framework, most authors suggest that abstract concepts are coded in a linguistic propositional format, although they do not completely deny the role of sensorimotor and emotional experiences in coding it. To our knowledge, only one recent proposal puts forward that the processing of concrete and abstract concepts relies on the same mechanisms, with the only difference being in the complexity of the underlying experiences. In this paper, we performed a meta-analysis using the Activation Likelihood Estimates (ALE) method on 33 functional neuroimaging studies that considered activations related to abstract and concrete concepts. The results suggest that (1) concrete and abstract concepts share the recruitment of the temporo-fronto-parietal circuits normally involved in the interactions with the physical world, (2) processing concrete concepts recruits fronto-parietal areas better than abstract concepts, and (3) abstract concepts recruit Broca's region more strongly than concrete ones. Based on anatomical and physiological evidence, Broca's region is not only a linguistic region mainly devoted to speech production, but it is endowed with complex motor representations of different biological effectors. Hence, we propose that the stronger recruitment of this region for abstract concepts is expression of the complex sensorimotor experiences underlying it, rather than evidence of a purely linguistic format of its processing.
Collapse
Affiliation(s)
- Nicola Del Maschio
- Faculty of Psychology, Università Vita-Salute San Raffaele, 20132 Milano, Italy; (N.D.M.); (D.F.)
| | - Davide Fedeli
- Faculty of Psychology, Università Vita-Salute San Raffaele, 20132 Milano, Italy; (N.D.M.); (D.F.)
| | - Gioacchino Garofalo
- Divisione di Neuroscienze, Università Vita-Salute San Raffaele, 20132 Milano, Italy;
- IRCCS San Raffaele, 20132 Milano, Italy
| | - Giovanni Buccino
- Divisione di Neuroscienze, Università Vita-Salute San Raffaele, 20132 Milano, Italy;
- IRCCS San Raffaele, 20132 Milano, Italy
| |
Collapse
|
38
|
In search of different categories of abstract concepts: a fMRI adaptation study. Sci Rep 2021; 11:22587. [PMID: 34799624 PMCID: PMC8604982 DOI: 10.1038/s41598-021-02013-8] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2021] [Accepted: 10/26/2021] [Indexed: 12/18/2022] Open
Abstract
Concrete conceptual knowledge is supported by a distributed neural network representing different semantic features according to the neuroanatomy of sensory and motor systems. If and how this framework applies to abstract knowledge is currently debated. Here we investigated the specific brain correlates of different abstract categories. After a systematic a priori selection of brain regions involved in semantic cognition, i.e. responsible of, respectively, semantic representations and cognitive control, we used a fMRI-adaptation paradigm with a passive reading task, in order to modulate the neural response to abstract (emotions, cognitions, attitudes, human actions) and concrete (biological entities, artefacts) categories. Different portions of the left anterior temporal lobe responded selectively to abstract and concrete concepts. Emotions and attitudes adapted the left middle temporal gyrus, whereas concrete items adapted the left fusiform gyrus. Our results suggest that, similarly to concrete concepts, some categories of abstract knowledge have specific brain correlates corresponding to the prevalent semantic dimensions involved in their representation.
Collapse
|
39
|
Beck J, Loretz E, Rasch B. Exposure to relaxing words during sleep promotes slow-wave sleep and subjective sleep quality. Sleep 2021; 44:zsab148. [PMID: 34115139 PMCID: PMC8598180 DOI: 10.1093/sleep/zsab148] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2021] [Revised: 05/07/2021] [Indexed: 12/14/2022] Open
Abstract
Our thoughts alter our sleep, but the underlying mechanisms are still unknown. We propose that mental processes are active to a greater or lesser extent during sleep and that this degree of activation affects our sleep depth. We examined this notion by activating the concept of "relaxation" during sleep using relaxation-related words in 50 healthy participants. In support of our hypothesis, playing relaxing words during non-rapid eye movement sleep extended the time spent in slow-wave sleep, increased power in the slow-wave activity band after the word cue, and abolished an asymmetrical sleep depth during the word presentation period. In addition, participants reported a higher sleep quality and elevated subjective alertness. Our results support the notion that the activation of mental concepts during sleep can influence sleep depth. They provide a basis for interventions using targeted activations to promote sleep depth and sleep quality to foster well-being and health.
Collapse
Affiliation(s)
- Jonas Beck
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| | - Erna Loretz
- The Siesta Group Schlafanalyse GmbH, Vienna, Austria
| | - Björn Rasch
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| |
Collapse
|
40
|
Henningsen-Schomers MR, Pulvermüller F. Modelling concrete and abstract concepts using brain-constrained deep neural networks. PSYCHOLOGICAL RESEARCH 2021; 86:2533-2559. [PMID: 34762152 DOI: 10.1007/s00426-021-01591-6] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
A neurobiologically constrained deep neural network mimicking cortical areas relevant for sensorimotor, linguistic and conceptual processing was used to investigate the putative biological mechanisms underlying conceptual category formation and semantic feature extraction. Networks were trained to learn neural patterns representing specific objects and actions relevant to semantically 'ground' concrete and abstract concepts. Grounding sets consisted of three grounding patterns with neurons representing specific perceptual or action-related features; neurons were either unique to one pattern or shared between patterns of the same set. Concrete categories were modelled as pattern triplets overlapping in their 'shared neurons', thus implementing semantic feature sharing of all instances of a category. In contrast, abstract concepts had partially shared feature neurons common to only pairs of category instances, thus, exhibiting family resemblance, but lacking full feature overlap. Stimulation with concrete and abstract conceptual patterns and biologically realistic unsupervised learning caused formation of strongly connected cell assemblies (CAs) specific to individual grounding patterns, whose neurons were spread out across all areas of the deep network. After learning, the shared neurons of the instances of concrete concepts were more prominent in central areas when compared with peripheral sensorimotor ones, whereas for abstract concepts the converse pattern of results was observed, with central areas exhibiting relatively fewer neurons shared between pairs of category members. We interpret these results in light of the current knowledge about the relative difficulty children show when learning abstract words. Implications for future neurocomputational modelling experiments as well as neurobiological theories of semantic representation are discussed.
Collapse
Affiliation(s)
- Malte R Henningsen-Schomers
- Department of Philosophy of Humanities, Brain Language Laboratory, Freie Universität Berlin, Habelschwerdter Allee 45, 14195, Berlin, Germany.
- Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt-Universität zu Berlin, Berlin, Germany.
| | - Friedemann Pulvermüller
- Department of Philosophy of Humanities, Brain Language Laboratory, Freie Universität Berlin, Habelschwerdter Allee 45, 14195, Berlin, Germany
- Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany
- Einstein Center for Neurosciences, Berlin, Germany
- Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt-Universität zu Berlin, Berlin, Germany
| |
Collapse
|
41
|
Fischer MH, Glenberg AM, Moeller K, Shaki S. Grounding (fairly) complex numerical knowledge: an educational example. PSYCHOLOGICAL RESEARCH 2021; 86:2389-2397. [PMID: 34757438 DOI: 10.1007/s00426-021-01577-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
In this article, we contextualize and discuss an on-line contribution to this special issue in which a video-recorded lecture demonstrates the teaching of an abstract mathematical concept, namely regression to the mean. We first motivate the pertinence of this example from the perspective of embodied cognition. Then, we identify mechanisms of teaching that reflect embodied cognitive practices, such as the concreteness fading approach. Rather than a comprehensive review of multiple extensive literatures, this article provides the interested reader with several sources or entries into those literatures.
Collapse
Affiliation(s)
| | - Arthur M Glenberg
- Department of Psychology, Arizona State University, Tempe, AZ, 85287-1104, USA.
- University of Wisconsin-Madison, Madison, WI, USA.
- Universidad de Salamanca, INICO, Salamanca, Spain.
| | - Korbinian Moeller
- Loughborough University, Loughborough, UK
- Leibniz-Institut Für Wissensmedien, Tübingen, Germany
- LEAD Graduate School and Research Network, University of Tübingen, Tübingen, Germany
- Individual Development and Adaptive Education for Children at Risk Center, Frankfurt am Main, Germany
| | | |
Collapse
|
42
|
Fini C, Zannino GD, Orsoni M, Carlesimo GA, Benassi M, Borghi AM. Articulatory suppression delays processing of abstract words: The role of inner speech. Q J Exp Psychol (Hove) 2021; 75:1343-1354. [PMID: 34623202 DOI: 10.1177/17470218211053623] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Compared to concrete concepts, like "book," abstract concepts expressed by words like "justice" are more detached from sensorial experiences, even though they are also grounded in sensorial modalities. Abstract concepts lack a single object as referent and are characterised by higher variability both within and across participants. According to the Word as Social Tool (WAT) proposal, owing to their complexity, abstract concepts need to be processed with the help of inner language. Inner language can namely help participants to re-explain to themselves the meaning of the word, to keep information active in working memory, and to prepare themselves to ask information from more competent people. While previous studies have demonstrated that the mouth is involved during abstract concepts' processing, both the functional role and the mechanisms underlying this involvement still need to be clarified. We report an experiment in which participants were required to evaluate whether 78 words were abstract or concrete by pressing two different pedals. During the judgement task, they were submitted, in different blocks, to a baseline, an articulatory suppression, and a manipulation condition. In the last two conditions, they had to repeat a syllable continually and to manipulate a softball with their dominant hand. Results showed that articulatory suppression slowed down the processing of abstract more than that of concrete words. Overall results confirm the WAT proposal's hypothesis that abstract concepts processing involves the mouth motor system and specifically inner speech. We discuss the implications for current theories of conceptual representation.
Collapse
Affiliation(s)
- Chiara Fini
- Department of Dynamic, Clinical Psychology and Health Studies, Sapienza University of Rome, Rome, Italy
| | - Gian Daniele Zannino
- Laboratory of Clinical and Behavioral Neurology, I.R.C.C.S. Santa Lucia Foundation, Rome, Italy
| | - Matteo Orsoni
- Department of Psychology, University of Bologna, Bologna, Italy
| | - Giovanni A Carlesimo
- Laboratory of Clinical and Behavioral Neurology, I.R.C.C.S. Santa Lucia Foundation, Rome, Italy.,Department of Systems Medicine, Tor Vergata University of Rome, Rome, Italy
| | | | - Anna M Borghi
- Department of Dynamic, Clinical Psychology and Health Studies, Sapienza University of Rome, Rome, Italy.,Institute of Cognitive Sciences and Technologies, Italian National Research Council, Rome, Italy
| |
Collapse
|
43
|
Canessa E, Chaigneau SE, Moreno S. Language Processing Differences Between Blind and Sighted Individuals and the Abstract Versus Concrete Concept Difference. Cogn Sci 2021; 45:e13044. [PMID: 34606124 DOI: 10.1111/cogs.13044] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2020] [Revised: 08/18/2021] [Accepted: 08/22/2021] [Indexed: 11/29/2022]
Abstract
In the property listing task (PLT), participants are asked to list properties for a concept (e.g., for the concept dog, "barks," and "is a pet" may be produced). In conceptual property norming (CPNs) studies, participants are asked to list properties for large sets of concepts. Here, we use a mathematical model of the property listing process to explore two longstanding issues: characterizing the difference between concrete and abstract concepts, and characterizing semantic knowledge in the blind versus sighted population. When we apply our mathematical model to a large CPN reporting properties listed by sighted and blind participants, the model uncovers significant differences between concrete and abstract concepts. Though we also find that blind individuals show many of the same processing differences between abstract and concrete concepts found in sighted individuals, our model shows that those differences are noticeably less pronounced than in sighted individuals. We discuss our results vis-a-vis theories attempting to characterize abstract concepts.
Collapse
Affiliation(s)
- Enrique Canessa
- Center for Cognition Research (CINCO), School of Psychology, Universidad Adolfo Ibáñe.,Faculty of Engineering and Science, Universidad Adolfo Ibáñez
| | - Sergio E Chaigneau
- Center for Cognition Research (CINCO), School of Psychology, Universidad Adolfo Ibáñe.,Center for Social and Cognitive Neuroscience, School of Psychology, Universidad Adolfo Ibáñez
| | | |
Collapse
|
44
|
Mazzuca C, Fini C, Michalland AH, Falcinelli I, Da Rold F, Tummolini L, Borghi AM. From Affordances to Abstract Words: The Flexibility of Sensorimotor Grounding. Brain Sci 2021; 11:1304. [PMID: 34679369 PMCID: PMC8534254 DOI: 10.3390/brainsci11101304] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2021] [Revised: 09/23/2021] [Accepted: 09/24/2021] [Indexed: 11/18/2022] Open
Abstract
The sensorimotor system plays a critical role in several cognitive processes. Here, we review recent studies documenting this interplay at different levels. First, we concentrate on studies that have shown how the sensorimotor system is flexibly involved in interactions with objects. We report evidence demonstrating how social context and situations influence affordance activation, and then focus on tactile and kinesthetic components in body-object interactions. Then, we turn to word use, and review studies that have shown that not only concrete words, but also abstract words are grounded in the sensorimotor system. We report evidence that abstract concepts activate the mouth effector more than concrete concepts, and discuss this effect in light of studies on adults, children, and infants. Finally, we pinpoint possible sensorimotor mechanisms at play in the acquisition and use of abstract concepts. Overall, we show that the involvement of the sensorimotor system is flexibly modulated by context, and that its role can be integrated and flanked by that of other systems such as the linguistic system. We suggest that to unravel the role of the sensorimotor system in cognition, future research should fully explore the complexity of this intricate, and sometimes slippery, relation.
Collapse
Affiliation(s)
- Claudia Mazzuca
- Body Action Language Lab (BALLAB), Sapienza University of Rome and ISTC-CNR, 00185 Rome, Italy; (C.M.); (C.F.); (A.H.M.); (I.F.); (F.D.R.); (L.T.)
| | - Chiara Fini
- Body Action Language Lab (BALLAB), Sapienza University of Rome and ISTC-CNR, 00185 Rome, Italy; (C.M.); (C.F.); (A.H.M.); (I.F.); (F.D.R.); (L.T.)
- IRCCS Fondazione Santa Lucia, 00179 Rome, Italy
| | - Arthur Henri Michalland
- Body Action Language Lab (BALLAB), Sapienza University of Rome and ISTC-CNR, 00185 Rome, Italy; (C.M.); (C.F.); (A.H.M.); (I.F.); (F.D.R.); (L.T.)
- Department of Psychology, Université Paul Valéry Montpellier, EPSYLON EA 4556, 34199 Montpellier, France
| | - Ilenia Falcinelli
- Body Action Language Lab (BALLAB), Sapienza University of Rome and ISTC-CNR, 00185 Rome, Italy; (C.M.); (C.F.); (A.H.M.); (I.F.); (F.D.R.); (L.T.)
| | - Federico Da Rold
- Body Action Language Lab (BALLAB), Sapienza University of Rome and ISTC-CNR, 00185 Rome, Italy; (C.M.); (C.F.); (A.H.M.); (I.F.); (F.D.R.); (L.T.)
| | - Luca Tummolini
- Body Action Language Lab (BALLAB), Sapienza University of Rome and ISTC-CNR, 00185 Rome, Italy; (C.M.); (C.F.); (A.H.M.); (I.F.); (F.D.R.); (L.T.)
- Institute of Cognitive Sciences and Technologies, National Research Council (CNR), 00185 Rome, Italy
| | - Anna M. Borghi
- Body Action Language Lab (BALLAB), Sapienza University of Rome and ISTC-CNR, 00185 Rome, Italy; (C.M.); (C.F.); (A.H.M.); (I.F.); (F.D.R.); (L.T.)
- Institute of Cognitive Sciences and Technologies, National Research Council (CNR), 00185 Rome, Italy
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome, 00185 Rome, Italy
| |
Collapse
|
45
|
Rotaru AS, Vigliocco G. Constructing Semantic Models From Words, Images, and Emojis. Cogn Sci 2021; 44:e12830. [PMID: 32237093 DOI: 10.1111/cogs.12830] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2019] [Revised: 02/17/2020] [Accepted: 02/20/2020] [Indexed: 01/30/2023]
Abstract
A number of recent models of semantics combine linguistic information, derived from text corpora, and visual information, derived from image collections, demonstrating that the resulting multimodal models are better than either of their unimodal counterparts, in accounting for behavioral data. Empirical work on semantic processing has shown that emotion also plays an important role especially in abstract concepts; however, models integrating emotion along with linguistic and visual information are lacking. Here, we first improve on visual and affective representations, derived from state-of-the-art existing models, by choosing models that best fit available human semantic data and extending the number of concepts they cover. Crucially then, we assess whether adding affective representations (obtained from a neural network model designed to predict emojis from co-occurring text) improves the model's ability to fit semantic similarity/relatedness judgments from a purely linguistic and linguistic-visual model. We find that, given specific weights assigned to the models, adding both visual and affective representations improves performance, with visual representations providing an improvement especially for more concrete words, and affective representations improving especially the fit for more abstract words.
Collapse
Affiliation(s)
- Armand S Rotaru
- Experimental Psychology Department, University College London
| | | |
Collapse
|
46
|
Repetto C, Mathias B, Weichselbaum O, Macedonia M. Visual recognition of words learned with gestures induces motor resonance in the forearm muscles. Sci Rep 2021; 11:17278. [PMID: 34446772 PMCID: PMC8390650 DOI: 10.1038/s41598-021-96792-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Accepted: 08/03/2021] [Indexed: 02/07/2023] Open
Abstract
According to theories of Embodied Cognition, memory for words is related to sensorimotor experiences collected during learning. At a neural level, words encoded with self-performed gestures are represented in distributed sensorimotor networks that resonate during word recognition. Here, we ask whether muscles involved in gesture execution also resonate during word recognition. Native German speakers encoded words by reading them (baseline condition) or by reading them in tandem with picture observation, gesture observation, or gesture observation and execution. Surface electromyogram (EMG) activity from both arms was recorded during the word recognition task and responses were detected using eye-tracking. The recognition of words encoded with self-performed gestures coincided with an increase in arm muscle EMG activity compared to the recognition of words learned under other conditions. This finding suggests that sensorimotor networks resonate into the periphery and provides new evidence for a strongly embodied view of recognition memory.
Collapse
Affiliation(s)
- Claudia Repetto
- Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy.
| | - Brian Mathias
- Chair of Cognitive and Clinical Neuroscience, Faculty of Psychology, Technical University Dresden, Dresden, Germany
- Research Group Neural Mechanisms of Human Communication, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Otto Weichselbaum
- Department of Information Engineering, Johannes Kepler University, Linz, Austria
| | - Manuela Macedonia
- Department of Information Engineering, Johannes Kepler University, Linz, Austria
- Research Group Ilse Meitner Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Linz Center of Mechatronics, Johannes Kepler University, Linz, Austria
| |
Collapse
|
47
|
Contextual Acquisition of Concrete and Abstract Words: Behavioural and Electrophysiological Evidence. Brain Sci 2021; 11:brainsci11070898. [PMID: 34356132 PMCID: PMC8306547 DOI: 10.3390/brainsci11070898] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2021] [Revised: 06/28/2021] [Accepted: 07/02/2021] [Indexed: 12/01/2022] Open
Abstract
Abstract and concrete words differ in their cognitive and neuronal underpinnings, but the exact mechanisms underlying these distinctions are unclear. We investigated differences between these two semantic types by analysing brain responses to newly learnt words with fully controlled psycholinguistic properties. Experimental participants learned 20 novel abstract and concrete words in the context of short stories. After the learning session, event-related potentials (ERPs) to newly learned items were recorded, and acquisition outcomes were assessed behaviourally in a range of lexical and semantic tasks. Behavioural results showed better performance on newly learnt abstract words in lexical tasks, whereas semantic assessments showed a tendency for higher accuracy for concrete words. ERPs to novel abstract and concrete concepts differed early on, ~150 ms after the word onset. Moreover, differences between novel words and control untrained pseudowords were observed earlier for concrete (~150 ms) than for abstract (~200 ms) words. Distributed source analysis indicated bilateral temporo-parietal activation underpinning newly established memory traces, suggesting a crucial role of Wernicke’s area and its right-hemispheric homologue in word acquisition. In sum, we report behavioural and neurophysiological processing differences between concrete and abstract words evident immediately after their controlled acquisition, confirming distinct neurocognitive mechanisms underpinning these types of semantics.
Collapse
|
48
|
Fini C, Era V, Da Rold F, Candidi M, Borghi AM. Abstract concepts in interaction: the need of others when guessing abstract concepts smooths dyadic motor interactions. ROYAL SOCIETY OPEN SCIENCE 2021; 8:201205. [PMID: 34350007 PMCID: PMC8316795 DOI: 10.1098/rsos.201205] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2020] [Accepted: 06/21/2021] [Indexed: 06/04/2023]
Abstract
concepts (ACs, e.g. 'justice') are more complex compared with concrete concepts (CCs) (e.g. 'table'). Indeed, they do not possess a single object as a referent, they assemble quite heterogeneous members and they are more detached from exteroceptive and more grounded in interoceptive experience. Recent views have hypothesized that interpersonal communication is particularly crucial to acquire and use ACs. The current study investigates the reliance of ACs/CCs representation on interpersonal behaviour. We asked participants to perform a motor interaction task with two avatars who embodied two real confederates. Before and after the motor interaction task, the two confederates provided participants with hints in a concept guessing task associated with visual stimuli: one helped in guessing ACs and the other, CCs. A control study we performed both with the materials employed in the main experiment and with other materials, confirmed that associating verbal concepts with visual images was more difficult with ACs than with CCs. Consistently, the results of the main experiment showed that participants asked for more hints with ACs than CCs and were more synchronous when interacting with the avatar corresponding to the AC's confederate. The results highlight an important role of sociality in grounding ACs.
Collapse
Affiliation(s)
- Chiara Fini
- Department of Dynamic and Clinical Psychology and Health Studies, ‘Sapienza’ University of Rome, Italy
| | - Vanessa Era
- SCNLab Department of Psychology, ‘Sapienza’ University of Rome, Italy
- IRCCS, Fondazione Santa Lucia, Rome, Italy
| | - Federico Da Rold
- Institute of Cognitive Sciences and Technologies, National Research Council (CNR), Rome, Italy
| | - Matteo Candidi
- SCNLab Department of Psychology, ‘Sapienza’ University of Rome, Italy
- IRCCS, Fondazione Santa Lucia, Rome, Italy
| | - Anna M. Borghi
- Department of Dynamic and Clinical Psychology and Health Studies, ‘Sapienza’ University of Rome, Italy
- Institute of Cognitive Sciences and Technologies, National Research Council (CNR), Rome, Italy
| |
Collapse
|
49
|
Reggin LD, Muraki EJ, Pexman PM. Development of Abstract Word Knowledge. Front Psychol 2021; 12:686478. [PMID: 34163413 PMCID: PMC8215159 DOI: 10.3389/fpsyg.2021.686478] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2021] [Accepted: 05/10/2021] [Indexed: 11/13/2022] Open
Abstract
The development of children's word knowledge is an important testing ground for the embodied account of word meaning, which proposes that word meanings are grounded in sensorimotor systems. Acquisition of abstract words, in particular, is a noted challenge for strong accounts of embodiment. We examined acquisition of abstract word meanings, using data on development of vocabulary knowledge from early school to University ages. We tested two specific proposals for how abstract words are learned: the affective embodiment account, that emotional experience is key to learning abstract word meanings, and the learning through language proposal, that abstract words are acquired through language experience. We found support for the affective embodiment account: word valence, interoception, and mouth action all facilitated abstract word acquisition more than concrete word acquisition. We tested the learning through language proposal by investigating whether words that appear in more diverse linguistic contexts are earlier acquired. Results showed that contextual diversity facilitated vocabulary acquisition, but did so for both abstract and concrete words. Our results provide evidence that emotion and sensorimotor systems are important to children's acquisition of abstract words, but there is still considerable variance to be accounted for by other factors. We offer suggestions for future research to examine the acquisition of abstract vocabulary.
Collapse
|
50
|
Conca F, Borsa VM, Cappa SF, Catricalà E. The multidimensionality of abstract concepts: A systematic review. Neurosci Biobehav Rev 2021; 127:474-491. [PMID: 33979574 DOI: 10.1016/j.neubiorev.2021.05.004] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2020] [Revised: 05/01/2021] [Accepted: 05/06/2021] [Indexed: 11/16/2022]
Abstract
The neuroscientific study of conceptual representation has largely focused on categories of concrete entities (biological entities, tools…), while abstract knowledge has been less extensively investigated. The possible presence of a categorical organization of abstract knowledge is a debated issue. An embodied cognition framework predicts an organization of the abstract domain into different dimensions, grounded in the brain regions engaged by the corresponding experience. Here we review the types of experience that have been proposed to characterize different categories of abstract concepts, and the evidence supporting a corresponding organization derived from behavioural, neuroimaging (i.e., fMRI, MRI, PET, SPECT), EEG, and neurostimulation (i.e., TMS) studies in healthy and clinical populations. The available data provide substantial converging evidence in favour of the presence of distinct neural representations of social and emotional knowledge, mental states and magnitude concepts, engaging brain systems involved in the corresponding experiences. This evidence is supporting an extension of embodied models of semantic memory organization to several types of abstract knowledge.
Collapse
Affiliation(s)
- F Conca
- Institute for Advanced Studies, IUSS, Pavia, Italy; IRCCS Fondazione Istituto Neurologico Casimiro Mondino, Pavia, Italy
| | - V M Borsa
- Università degli Studi di Bergamo, Bergamo, Italy
| | - S F Cappa
- Institute for Advanced Studies, IUSS, Pavia, Italy; IRCCS Fondazione Istituto Neurologico Casimiro Mondino, Pavia, Italy.
| | - E Catricalà
- Institute for Advanced Studies, IUSS, Pavia, Italy
| |
Collapse
|