1
|
Arvidsson C, Torubarova E, Pereira A, Uddén J. Conversational production and comprehension: fMRI-evidence reminiscent of but deviant from the classical Broca-Wernicke model. Cereb Cortex 2024; 34:bhae073. [PMID: 38501383 PMCID: PMC10949358 DOI: 10.1093/cercor/bhae073] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 02/02/2024] [Accepted: 02/03/2024] [Indexed: 03/20/2024] Open
Abstract
A key question in research on the neurobiology of language is to which extent the language production and comprehension systems share neural infrastructure, but this question has not been addressed in the context of conversation. We utilized a public fMRI dataset where 24 participants engaged in unscripted conversations with a confederate outside the scanner, via an audio-video link. We provide evidence indicating that the two systems share neural infrastructure in the left-lateralized perisylvian language network, but diverge regarding the level of activation in regions within the network. Activity in the left inferior frontal gyrus was stronger in production compared to comprehension, while comprehension showed stronger recruitment of the left anterior middle temporal gyrus and superior temporal sulcus, compared to production. Although our results are reminiscent of the classical Broca-Wernicke model, the anterior (rather than posterior) temporal activation is a notable difference from that model. This is one of the findings that may be a consequence of the conversational setting, another being that conversational production activated what we interpret as higher-level socio-pragmatic processes. In conclusion, we present evidence for partial overlap and functional asymmetry of the neural infrastructure of production and comprehension, in the above-mentioned frontal vs temporal regions during conversation.
Collapse
Affiliation(s)
- Caroline Arvidsson
- Department of Linguistics, Stockholm University, Universitetsvägen 10 C, 114 18 Stockholm, Sweden
| | - Ekaterina Torubarova
- Division of Speech, Music, and Hearing, KTH Royal Institute of Technology, Lindstedtsvägen 24, 114 28 Stockholm, Sweden
| | - André Pereira
- Division of Speech, Music, and Hearing, KTH Royal Institute of Technology, Lindstedtsvägen 24, 114 28 Stockholm, Sweden
| | - Julia Uddén
- Department of Linguistics, Stockholm University, Universitetsvägen 10 C, 114 18 Stockholm, Sweden
- Department of Psychology, Stockholm University, Albanovägen 12, 114 19 Stockholm, Sweden
| |
Collapse
|
2
|
Olson HA, Chen EM, Lydic KO, Saxe RR. Left-Hemisphere Cortical Language Regions Respond Equally to Observed Dialogue and Monologue. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2023; 4:575-610. [PMID: 38144236 PMCID: PMC10745132 DOI: 10.1162/nol_a_00123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Accepted: 09/20/2023] [Indexed: 12/26/2023]
Abstract
Much of the language we encounter in our everyday lives comes in the form of conversation, yet the majority of research on the neural basis of language comprehension has used input from only one speaker at a time. Twenty adults were scanned while passively observing audiovisual conversations using functional magnetic resonance imaging. In a block-design task, participants watched 20 s videos of puppets speaking either to another puppet (the dialogue condition) or directly to the viewer (the monologue condition), while the audio was either comprehensible (played forward) or incomprehensible (played backward). Individually functionally localized left-hemisphere language regions responded more to comprehensible than incomprehensible speech but did not respond differently to dialogue than monologue. In a second task, participants watched videos (1-3 min each) of two puppets conversing with each other, in which one puppet was comprehensible while the other's speech was reversed. All participants saw the same visual input but were randomly assigned which character's speech was comprehensible. In left-hemisphere cortical language regions, the time course of activity was correlated only among participants who heard the same character speaking comprehensibly, despite identical visual input across all participants. For comparison, some individually localized theory of mind regions and right-hemisphere homologues of language regions responded more to dialogue than monologue in the first task, and in the second task, activity in some regions was correlated across all participants regardless of which character was speaking comprehensibly. Together, these results suggest that canonical left-hemisphere cortical language regions are not sensitive to differences between observed dialogue and monologue.
Collapse
|
3
|
Boux IP, Pulvermüller F. Does the right temporo-parietal junction play a role in processing indirect speech acts? A transcranial magnetic stimulation study. Neuropsychologia 2023; 188:108588. [PMID: 37244393 PMCID: PMC10498423 DOI: 10.1016/j.neuropsychologia.2023.108588] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 05/12/2023] [Accepted: 05/22/2023] [Indexed: 05/29/2023]
Abstract
In communication, much information is conveyed not explicitly but rather covertly, based on shared assumptions and common knowledge. For instance, when asked "Did you bring your cat to the vet?" a person could reply "It got hurt jumping down the table", thereby implicating that, indeed, the cat was brought to the vet. The assumption that getting hurt jumping down a table motivates a vet visit is tacitly attributed to the speaker by the listener, which implies Theory of Mind (ToM) processes. In the present study, we apply repetitive transcranial magnetic stimulation to the right temporo-parietal junction (rTPJ), a key brain region underlying ToM, with the aim to disrupt ToM processes necessary for language understanding. We then assess effects on the comprehension of indirect speech acts and their matched direct controls. In one set of conditions, the direct and indirect stimuli where not matched for speech act type, whereas, in the other, these were matched, therefore providing an unconfounded test case for in/directness. When indirect speech acts and direct controls were matched for speech act type (both statements), the indirect ones took longer to process both following sham and verum TMS. However, when the indirect and direct speech acts were not matched for communicative function (accept/decline offer vs. descriptive statement respectively), then a delay was detected for the indirect ones following sham TMS but, crucially, not following verum TMS. Additionally, TMS affected behavior in a ToM task. We therefore do not find evidence that the rTPJ is causally involved in comprehending of indirectness per se, but conclude that it could be involved instead in the processing of specific social communicative activity of rejecting of accepting offers, or to a combination of differing in/directness and communicative function. Our findings are consistent with the view that ToM processing in rTPJ is more important and/or more pronounced for offer acceptance/rejection than for descriptive answers.
Collapse
Affiliation(s)
- Isabella P Boux
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, Habelschwerdter Allee 45, 14195, Berlin, Germany; Einstein Center for Neurosciences, Charitéplatz 1, 10117, Berlin, Germany; Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Luisenstraße 56, 10117, Berlin, Germany.
| | - Friedemann Pulvermüller
- Brain Language Laboratory, Department of Philosophy and Humanities, WE4, Freie Universität Berlin, Habelschwerdter Allee 45, 14195, Berlin, Germany; Einstein Center for Neurosciences, Charitéplatz 1, 10117, Berlin, Germany; Berlin School of Mind and Brain, Humboldt Universität zu Berlin, Luisenstraße 56, 10117, Berlin, Germany; Cluster of Excellence 'Matters of Activity. Image Space Material', Humboldt Universität zu Berlin, Unter Den Linden 6, 10099, Berlin, Germany
| |
Collapse
|
4
|
Lai YY, Sakai H, Makuuchi M. Neural underpinnings of processing combinatorial unstated meaning and the influence of individual cognitive style. Cereb Cortex 2023; 33:10013-10027. [PMID: 37557907 PMCID: PMC10502793 DOI: 10.1093/cercor/bhad261] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Revised: 06/29/2023] [Accepted: 06/30/2023] [Indexed: 08/11/2023] Open
Abstract
We investigated the neurocognitive mechanisms underlying the processing of combinatorial unstated meaning. Sentences like "Charles jumped for 5 minutes." engender an iterative meaning that is not explicitly stated but enriched by comprehenders beyond simple composition. Comprehending unstated meaning involves meaning contextualization-integrative meaning search in sentential-discourse context. Meanwhile, people differ in how they process information with varying context sensitivity. We hypothesized that unstated meaning processing would vary with individual socio-cognitive propensity indexed by the Autism-Spectrum Quotient (AQ), accompanied by differential cortical engagements. Using functional magnetic resonance imaging, we examined the processing of sentences with unstated iterative meaning in typically-developed individuals and found an engagement of the fronto-parietal network, including the left pars triangularis (L.PT), right intraparietal (R.IPS), and parieto-occipital sulcus (R.POS). We suggest that the L.PT subserves a contextual meaning search, while the R.IPS/POS supports enriching unstated iteration in consideration of event durations and interval lengths. Moreover, the activation level of these regions negatively correlated with AQ. Higher AQ ties to lower L.PT activation, likely reflecting weaker context sensitivity, along with lower IPS activation, likely reflecting weaker computation of events' numerical-temporal specifications. These suggest that the L.PT and R.IPS/POS support the processing of combinatorial unstated meaning, with the activation level modulated by individual cognitive styles.
Collapse
Affiliation(s)
- Yao-Ying Lai
- Graduate Institute of Linguistics, National Chengchi University, Taipei, Taiwan
| | - Hiromu Sakai
- Faculty of Science and Engineering, Waseda University, Tokyo, Japan
| | - Michiru Makuuchi
- Section of Neuropsychology, Research Institute, National Rehabilitation Center for Persons with Disabilities, Tokorozawa, Japan
| |
Collapse
|
5
|
Hauptman M, Blank I, Fedorenko E. Non-literal language processing is jointly supported by the language and theory of mind networks: Evidence from a novel meta-analytic fMRI approach. Cortex 2023; 162:96-114. [PMID: 37023480 PMCID: PMC10210011 DOI: 10.1016/j.cortex.2023.01.013] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Revised: 11/08/2022] [Accepted: 01/11/2023] [Indexed: 03/12/2023]
Abstract
Going beyond the literal meaning of language is key to communicative success. However, the mechanisms that support non-literal inferences remain debated. Using a novel meta-analytic approach, we evaluate the contribution of linguistic, social-cognitive, and executive mechanisms to non-literal interpretation. We identified 74 fMRI experiments (n = 1,430 participants) from 2001 to 2021 that contrasted non-literal language comprehension with a literal control condition, spanning ten phenomena (e.g., metaphor, irony, indirect speech). Applying the activation likelihood estimation approach to the 825 activation peaks yielded six left-lateralized clusters. We then evaluated the locations of both the individual-study peaks and the clusters against probabilistic functional atlases (cf. anatomical locations, as is typically done) for three candidate brain networks-the language-selective network (Fedorenko, Behr, & Kanwisher, 2011), which supports language processing, the Theory of Mind (ToM) network (Saxe & Kanwisher, 2003), which supports social inferences, and the domain-general Multiple-Demand (MD) network (Duncan, 2010), which supports executive control. These atlases were created by overlaying individual activation maps of participants who performed robust and extensively validated 'localizer' tasks that selectively target each network in question (n = 806 for language; n = 198 for ToM; n = 691 for MD). We found that both the individual-study peaks and the ALE clusters fell primarily within the language network and the ToM network. These results suggest that non-literal processing is supported by both i) mechanisms that process literal linguistic meaning, and ii) mechanisms that support general social inference. They thus undermine a strong divide between literal and non-literal aspects of language and challenge the claim that non-literal processing requires additional executive resources.
Collapse
Affiliation(s)
- Miriam Hauptman
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA; Department of Psychological & Brain Sciences, Johns Hopkins University, Baltimore, MD 21218, USA.
| | - Idan Blank
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA; Department of Psychology, UCLA, Los Angeles, CA 90095, USA; Department of Linguistics, UCLA, Los Angeles, CA 90095, USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, MIT, Cambridge, MA 02139, USA; McGovern Institute for Brain Research, MIT, Cambridge, MA 02139, USA; Program in Speech and Hearing in Bioscience and Technology, Harvard University, Boston, MA 02114, USA.
| |
Collapse
|
6
|
Arvidsson C, Pagmar D, Uddén J. When did you stop speaking to yourself? Age-related differences in adolescents' world knowledge-based audience design. ROYAL SOCIETY OPEN SCIENCE 2022; 9:220305. [PMID: 36465686 PMCID: PMC9709564 DOI: 10.1098/rsos.220305] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/10/2022] [Accepted: 11/06/2022] [Indexed: 06/17/2023]
Abstract
The ability to adapt utterances to the world knowledge of one's addressee is undeniably ubiquitous in human social cognition, but its development and association with other cognitive mechanisms during adolescence have not been studied. In an online production task, we measured the ability of children entering adolescence (ages 11-12, M = 11.8, N = 29 , 17 girls ) and adolescents (ages 15-16, M = 15.9, N = 29 , 17 girls ) to tailor referential expressions in accordance with the inferred world knowledge of their addressee-an ability we refer to as world knowledge-based audience design (AD). A post-test survey showed that both age groups held similar assumptions about the addressees' knowledge of referents, but the younger age group did not consistently adapt their utterances in accordance with these assumptions during online production, resulting in a significantly improved AD behaviour across age groups. We also investigated the reliance of AD on executive functions (EF). Executive functioning (as reflected by performance on the Wisconsin card sorting task) increased significantly with age, but did not explain the age-related increase in AD performance. We thus provide evidence in support of an adolescent development of world knowledge-based AD over and above development of EF.
Collapse
Affiliation(s)
| | - David Pagmar
- Department of Linguistics, Stockholm University, Stockholm, Sweden
| | - Julia Uddén
- Department of Linguistics, Stockholm University, Stockholm, Sweden
- Department of Psychology, Stockholm University, Stockholm, Sweden
| |
Collapse
|