1
|
Patel T, Morales M, Pickering MJ, Hoffman P. A common neural code for meaning in discourse production and comprehension. Neuroimage 2023; 279:120295. [PMID: 37536526 DOI: 10.1016/j.neuroimage.2023.120295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2023] [Revised: 06/28/2023] [Accepted: 07/23/2023] [Indexed: 08/05/2023] Open
Abstract
How does the brain code the meanings conveyed by language? Neuroimaging studies have investigated this by linking neural activity patterns during discourse comprehension to semantic models of language content. Here, we applied this approach to the production of discourse for the first time. Participants underwent fMRI while producing and listening to discourse on a range of topics. We used a distributional semantic model to quantify the similarity between different speech passages and identified where similarity in neural activity was predicted by semantic similarity. When people produced discourse, speech on similar topics elicited similar activation patterns in a widely distributed and bilateral brain network. This network was overlapping with, but more extensive than, the regions that showed similarity effects during comprehension. Critically, cross-task neural similarities between comprehension and production were also predicted by similarities in semantic content. This result suggests that discourse semantics engages a common neural code that is shared between comprehension and production. Effects of semantic similarity were bilateral in all three RSA analyses, even while univariate activation contrasts in the same data indicated left-lateralised BOLD responses. This indicates that right-hemisphere regions encode semantic properties even when they are not activated above baseline. We suggest that right-hemisphere regions play a supporting role in processing the meaning of discourse during both comprehension and production.
Collapse
Affiliation(s)
- Tanvi Patel
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, 7 George Square, Edinburgh EH8 9JZ, UK
| | - Matías Morales
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, 7 George Square, Edinburgh EH8 9JZ, UK
| | - Martin J Pickering
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, 7 George Square, Edinburgh EH8 9JZ, UK
| | - Paul Hoffman
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, 7 George Square, Edinburgh EH8 9JZ, UK.
| |
Collapse
|
2
|
Wu W, Morales M, Patel T, Pickering MJ, Hoffman P. Modulation of brain activity by psycholinguistic information during naturalistic speech comprehension and production. Cortex 2022; 155:287-306. [DOI: 10.1016/j.cortex.2022.08.002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Revised: 06/23/2022] [Accepted: 08/01/2022] [Indexed: 11/25/2022]
|
3
|
Morales M, Patel T, Tamm A, Pickering MJ, Hoffman P. Similar Neural Networks Respond to Coherence during Comprehension and Production of Discourse. Cereb Cortex 2022; 32:4317-4330. [PMID: 35059718 PMCID: PMC9528896 DOI: 10.1093/cercor/bhab485] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2021] [Revised: 11/22/2021] [Accepted: 11/23/2021] [Indexed: 12/03/2022] Open
Abstract
When comprehending discourse, listeners engage default-mode regions associated with integrative semantic processing to construct a situation model of its content. We investigated how similar networks are engaged when we produce, as well as comprehend, discourse. During functional magnetic resonance imaging, participants spoke about a series of specific topics and listened to discourse on other topics. We tested how activation was predicted by natural fluctuations in the global coherence of the discourse, that is, the degree to which utterances conformed to the expected topic. The neural correlates of coherence were similar across speaking and listening, particularly in default-mode regions. This network showed greater activation when less coherent speech was heard or produced, reflecting updating of mental representations when discourse did not conform to the expected topic. In contrast, regions that exert control over semantic activation showed task-specific effects, correlating negatively with coherence during listening but not during production. Participants who showed greater activation in left inferior prefrontal cortex also produced more coherent discourse, suggesting a specific role for this region in goal-directed regulation of speech content. Results suggest strong correspondence of discourse representations during speaking and listening. However, they indicate that the semantic control network plays different roles in comprehension and production.
Collapse
Affiliation(s)
- Matías Morales
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, UK
| | - Tanvi Patel
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, UK
| | - Andres Tamm
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, UK
| | - Martin J Pickering
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, UK
| | - Paul Hoffman
- Address correspondence to Dr Paul Hoffman, School of Philosophy, Psychology and Language Sciences, University of Edinburgh, 7 George Square, Edinburgh EH8 9JZ, UK.
| |
Collapse
|
4
|
Creyaufmüller M, Heim S, Habel U, Mühlhaus J. The influence of semantic associations on sentence production in schizophrenia: an fMRI study. Eur Arch Psychiatry Clin Neurosci 2020; 270:359-372. [PMID: 30094543 DOI: 10.1007/s00406-018-0936-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/01/2018] [Accepted: 07/30/2018] [Indexed: 11/24/2022]
Abstract
One of the most prominent symptoms of schizophrenia is thought disorder, which manifests itself in language production difficulties. In patients with thought disorders the associations are loosened and sentence production is impaired. The determining behavioral and neural mechanisms of sentence production are still an important subject of recent research and have not yet been fully understood. The aim of the current study was to examine the influence of associative relations and distractor modalities on sentence production in healthy participants and participants with schizophrenia. Therefore, reaction times and neural activation of 12 healthy subjects and 13 subjects with schizophrenia were compared in an adapted picture word interference paradigm (PWI). No significant group differences were found, neither on the behavioral nor on the neural level. On the behavioral level, for the entire group incremental sentence processing was found, i.e. processing of the second noun only starts after the first noun was processed. At the neural level, activation was discovered in the bilateral caudate nuclei and the cerebellum. Those activations could be related to response enhancement and suppression as well as to the modulation of cognitive processes.
Collapse
Affiliation(s)
- Maike Creyaufmüller
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Pauwelsstrasse 30, 52074, Aachen, Germany
| | - Stefan Heim
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Pauwelsstrasse 30, 52074, Aachen, Germany. .,JARA Translational Brain Medicine, Aachen, Germany. .,AG Neuroanatomy of Language, Institute of Neurosciences and Medicine (INM-1), Research Centre Jülich, Leo-Brand-Straße 5, 52428, Jülich, Germany.
| | - Ute Habel
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Pauwelsstrasse 30, 52074, Aachen, Germany.,JARA Translational Brain Medicine, Aachen, Germany
| | - Juliane Mühlhaus
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen University, Pauwelsstrasse 30, 52074, Aachen, Germany.,JARA Translational Brain Medicine, Aachen, Germany.,Department of Computer Science, Speech and Language Therapy, Trier University of Applied Sciences, Trier, Germany
| |
Collapse
|
5
|
Hoffman P. Reductions in prefrontal activation predict off-topic utterances during speech production. Nat Commun 2019; 10:515. [PMID: 30705284 PMCID: PMC6355898 DOI: 10.1038/s41467-019-08519-0] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2018] [Accepted: 01/15/2019] [Indexed: 11/09/2022] Open
Abstract
The ability to speak coherently is essential for effective communication but declines with age: older people more frequently produce tangential, off-topic speech. Little is known, however, about the neural systems that support coherence in speech production. Here, fMRI was used to investigate extended speech production in healthy older adults. Computational linguistic analyses were used to quantify the coherence of utterances produced in the scanner, allowing identification of the neural correlates of coherence for the first time. Highly coherent speech production was associated with increased activity in bilateral inferior prefrontal cortex (BA45), an area implicated in selection of task-relevant knowledge from semantic memory, and in bilateral rostrolateral prefrontal cortex (BA10), implicated more generally in planning of complex goal-directed behaviours. These findings demonstrate that neural activity during spontaneous speech production can be predicted from formal analysis of speech content, and that multiple prefrontal systems contribute to coherence in speech. The ability to speak coherently is essential for effective communication, but little is known about the neural systems that support coherence. Here, the authors show that activity in two prefrontal cortex regions, BA10 and BA45, predicts the level of coherence in the speech of healthy older adults.
Collapse
Affiliation(s)
- Paul Hoffman
- School of Philosophy, Psychology and Language Sciences, University of Edinburgh, Edinburgh, EH8 9JZ, UK.
| |
Collapse
|
6
|
Stiers P, Falbo L, Goulas A, van Gog T, de Bruin A. Reverse inference of memory retrieval processes underlying metacognitive monitoring of learning using multivariate pattern analysis. Neuroimage 2016; 132:11-23. [PMID: 26883066 DOI: 10.1016/j.neuroimage.2016.02.008] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2015] [Revised: 12/02/2015] [Accepted: 02/07/2016] [Indexed: 12/18/2022] Open
Abstract
Monitoring of learning is only accurate at some time after learning. It is thought that immediate monitoring is based on working memory, whereas later monitoring requires re-activation of stored items, yielding accurate judgements. Such interpretations are difficult to test because they require reverse inference, which presupposes specificity of brain activity for the hidden cognitive processes. We investigated whether multivariate pattern classification can provide this specificity. We used a word recall task to create single trial examples of immediate and long term retrieval and trained a learning algorithm to discriminate them. Next, participants performed a similar task involving monitoring instead of recall. The recall-trained classifier recognized the retrieval patterns underlying immediate and long term monitoring and classified delayed monitoring examples as long-term retrieval. This result demonstrates the feasibility of decoding cognitive processes, instead of their content.
Collapse
Affiliation(s)
- Peter Stiers
- Department of Neuropsychology and Psychopharmacology, Maastricht University, Maastricht, The Netherlands.
| | - Luciana Falbo
- Department of Neuropsychology and Psychopharmacology, Maastricht University, Maastricht, The Netherlands
| | - Alexandros Goulas
- Department of Neuropsychology and Psychopharmacology, Maastricht University, Maastricht, The Netherlands
| | - Tamara van Gog
- Department of Educational Psychology, Erasmus University Rotterdam, The Netherlands
| | - Anique de Bruin
- Department of Educational Research & Development, Maastricht University, The Netherlands
| |
Collapse
|
7
|
Acoustic-integrated dynamic MR imaging for a patient with obstructive sleep apnea. Magn Reson Imaging 2015; 33:1350-1352. [DOI: 10.1016/j.mri.2015.08.004] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2014] [Revised: 02/11/2015] [Accepted: 08/08/2015] [Indexed: 11/21/2022]
|
8
|
Abel S, Weiller C, Huber W, Willmes K, Specht K. Therapy-induced brain reorganization patterns in aphasia. ACTA ACUST UNITED AC 2015; 138:1097-112. [PMID: 25688082 DOI: 10.1093/brain/awv022] [Citation(s) in RCA: 73] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Both hemispheres are engaged in recovery from word production deficits in aphasia. Lexical therapy has been shown to induce brain reorganization even in patients with chronic aphasia. However, the interplay of factors influencing reorganization patterns still remains unresolved. We were especially interested in the relation between lesion site, therapy-induced recovery, and beneficial reorganization patterns. Thus, we applied intensive lexical therapy, which was evaluated with functional magnetic resonance imaging, to 14 chronic patients with aphasic word retrieval deficits. In a group study, we aimed to illuminate brain reorganization of the naming network in comparison with healthy controls. Moreover, we intended to analyse the data with joint independent component analysis to relate lesion sites to therapy-induced brain reorganization, and to correlate resulting components with therapy gain. As a result, we found peri-lesional and contralateral activations basically overlapping with premorbid naming networks observed in healthy subjects. Reduced activation patterns for patients compared to controls before training comprised damaged left hemisphere language areas, right precentral and superior temporal gyrus, as well as left caudate and anterior cingulate cortex. There were decreasing activations of bilateral visuo-cognitive, articulatory, attention, and language areas due to therapy, with stronger decreases for patients in right middle temporal gyrus/superior temporal sulcus, bilateral precuneus as well as left anterior cingulate cortex and caudate. The joint independent component analysis revealed three components indexing lesion subtypes that were associated with patient-specific recovery patterns. Activation decreases (i) of an extended frontal lesion disconnecting language pathways occurred in left inferior frontal gyrus; (ii) of a small frontal lesion were found in bilateral inferior frontal gyrus; and (iii) of a large temporo-parietal lesion occurred in bilateral inferior frontal gyrus and contralateral superior temporal gyrus. All components revealed increases in prefrontal areas. One component was negatively correlated with therapy gain. Therapy was associated exclusively with activation decreases, which could mainly be attributed to higher processing efficiency within the naming network. In our joint independent component analysis, all three lesion patterns disclosed involved deactivation of left inferior frontal gyrus. Moreover, we found evidence for increased demands on control processes. As expected, we saw partly differential reorganization profiles depending on lesion patterns. There was no compensatory deactivation for the large left inferior frontal lesion, with its less advantageous outcome probably being related to its disconnection from crucial language processing pathways.
Collapse
Affiliation(s)
- Stefanie Abel
- 1 Department of Neurology, Section Neuropsychology, RWTH Aachen, Germany 2 School of Psychological Sciences, Faculty of Medical and Human Sciences, University of Manchester, UK 3 SRH University of Applied Sciences, Gera, Germany 4 JARA-BRAIN, Aachen Juelich Research Alliance, Translational Brain Medicine, Germany
| | - Cornelius Weiller
- 5 Department of Neurology, University Medical Centre Freiburg, Germany
| | - Walter Huber
- 4 JARA-BRAIN, Aachen Juelich Research Alliance, Translational Brain Medicine, Germany
| | - Klaus Willmes
- 1 Department of Neurology, Section Neuropsychology, RWTH Aachen, Germany 4 JARA-BRAIN, Aachen Juelich Research Alliance, Translational Brain Medicine, Germany 6 Interdisciplinary Centre for Clinical Research, RWTH Aachen, Germany
| | - Karsten Specht
- 7 Department of Biological and Medical Psychology, University of Bergen, and Department of Clinical Engineering, Haukeland University Hospital Bergen, Norway
| |
Collapse
|
9
|
Chang YC, Huon LK, Pham VT, Chen YJ, Jiang SF, Shih TTF, Tran TT, Wang YH, Lin C, Tsao J, Lo MT, Wang PC. Synchronized imaging and acoustic analysis of the upper airway in patients with sleep-disordered breathing. Physiol Meas 2014; 35:2501-12. [PMID: 25402604 DOI: 10.1088/0967-3334/35/12/2501] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Abstract
Progressive narrowing of the upper airway increases airflow resistance and can produce snoring sounds and apnea/hypopnea events associated with sleep-disordered breathing due to airway collapse. Recent studies have shown that acoustic properties during snoring can be altered with anatomic changes at the site of obstruction. To evaluate the instantaneous association between acoustic features of snoring and the anatomic sites of obstruction, a novel method was developed and applied in nine patients to extract the snoring sounds during sleep while performing dynamic magnetic resonance imaging (MRI). The degree of airway narrowing during the snoring events was then quantified by the collapse index (ratio of airway diameter preceding and during the events) and correlated with the synchronized acoustic features. A total of 201 snoring events (102 pure retropalatal and 99 combined retropalatal and retroglossal events) were recorded, and the collapse index as well as the soft tissue vibration time were significantly different between pure retropalatal (collapse index, 2 ± 11%; vibration time, 0.2 ± 0.3 s) and combined (retropalatal and retroglossal) snores (collapse index, 13 ± 7% [P ≤ 0.0001]; vibration time, 1.2 ± 0.7 s [P ≤ 0.0001]). The synchronized dynamic MRI and acoustic recordings successfully characterized the sites of obstruction and established the dynamic relationship between the anatomic site of obstruction and snoring acoustics.
Collapse
Affiliation(s)
- Yi-Chung Chang
- Research Center for Adaptive Data Analysis and Center for Dynamical Biomarkers and Translational Medicine, National Central University, Chungli, Taiwan. Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
10
|
Peelle JE. Methodological challenges and solutions in auditory functional magnetic resonance imaging. Front Neurosci 2014; 8:253. [PMID: 25191218 PMCID: PMC4139601 DOI: 10.3389/fnins.2014.00253] [Citation(s) in RCA: 49] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2014] [Accepted: 07/29/2014] [Indexed: 02/06/2023] Open
Abstract
Functional magnetic resonance imaging (fMRI) studies involve substantial acoustic noise. This review covers the difficulties posed by such noise for auditory neuroscience, as well as a number of possible solutions that have emerged. Acoustic noise can affect the processing of auditory stimuli by making them inaudible or unintelligible, and can result in reduced sensitivity to auditory activation in auditory cortex. Equally importantly, acoustic noise may also lead to increased listening effort, meaning that even when auditory stimuli are perceived, neural processing may differ from when the same stimuli are presented in quiet. These and other challenges have motivated a number of approaches for collecting auditory fMRI data. Although using a continuous echoplanar imaging (EPI) sequence provides high quality imaging data, these data may also be contaminated by background acoustic noise. Traditional sparse imaging has the advantage of avoiding acoustic noise during stimulus presentation, but at a cost of reduced temporal resolution. Recently, three classes of techniques have been developed to circumvent these limitations. The first is Interleaved Silent Steady State (ISSS) imaging, a variation of sparse imaging that involves collecting multiple volumes following a silent period while maintaining steady-state longitudinal magnetization. The second involves active noise control to limit the impact of acoustic scanner noise. Finally, novel MRI sequences that reduce the amount of acoustic noise produced during fMRI make the use of continuous scanning a more practical option. Together these advances provide unprecedented opportunities for researchers to collect high-quality data of hemodynamic responses to auditory stimuli using fMRI.
Collapse
Affiliation(s)
- Jonathan E Peelle
- Department of Otolaryngology, Washington University in St. Louis St. Louis, MO, USA
| |
Collapse
|
11
|
Neural underpinnings for model-oriented therapy of aphasic word production. Neuropsychologia 2014; 57:154-65. [DOI: 10.1016/j.neuropsychologia.2014.03.010] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2013] [Revised: 03/03/2014] [Accepted: 03/20/2014] [Indexed: 11/23/2022]
|
12
|
Kragel JE, Polyn SM. Functional Interactions Between Large-Scale Networks During Memory Search. Cereb Cortex 2013; 25:667-79. [DOI: 10.1093/cercor/bht258] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
|
13
|
Grande M, Meffert E, Schoenberger E, Jung S, Frauenrath T, Huber W, Hussmann K, Moormann M, Heim S. From a concept to a word in a syntactically complete sentence: An fMRI study on spontaneous language production in an overt picture description task. Neuroimage 2012; 61:702-14. [DOI: 10.1016/j.neuroimage.2012.03.087] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2011] [Revised: 03/15/2012] [Accepted: 03/29/2012] [Indexed: 11/27/2022] Open
|
14
|
Polyn SM, Kragel JE, Morton NW, McCluey JD, Cohen ZD. The neural dynamics of task context in free recall. Neuropsychologia 2012; 50:447-57. [DOI: 10.1016/j.neuropsychologia.2011.08.025] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2011] [Revised: 08/03/2011] [Accepted: 08/25/2011] [Indexed: 10/17/2022]
|
15
|
Kuypers KPC, Wingen M, Heinecke A, Formisano E, Ramaekers JG. MDMA intoxication and verbal memory performance: a placebo-controlled pharmaco-MRI study. J Psychopharmacol 2011; 25:1053-61. [PMID: 21616977 DOI: 10.1177/0269881111405361] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The aim of the present study was to identify the neural substrate underlying memory impairment due to a single dose of MDMA (3,4-methylenedioxymethamphetamine) by means of pharmaco-MRI. Based on previous behavioral results it was hypothesized that this deficit could be attributed to a specific influence of MDMA on encoding. Fourteen Ecstasy users participated in this double-blind, placebo-controlled, within-subject study with two treatment conditions: MDMA (75 mg) and placebo. Memory performance was tested by means of a word learning task including two words lists, one addressing reading processes (control task, CWL) and a second (experimental task, EWL) addressing encoding and reading processes. Behavioral data showed that under the influence of MDMA, EWL performance was worse than placebo. Imaging data showed that Encoding was situated mainly in (pre)frontal, temporal and parietal areas. MDMA by Encoding interaction was situated in three areas: the left middle frontal gyrus (BA10), the right fusiform gyrus (BA19), and the left cuneus (BA18). Behavioral and functional data only correlated in BA10. It appeared that EWL performance caused BOLD signal change in BA10 during placebo treatment but not during MDMA intoxication. It is concluded that MDMA influences middle frontal gyrus processes resulting in impoverished memory encoding.
Collapse
Affiliation(s)
- Kim P C Kuypers
- Department of Neuropsychology and Psychopharmacology, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, The Netherlands.
| | | | | | | | | |
Collapse
|
16
|
Kalm K, Davis MH, Norris D. Neural mechanisms underlying the grouping effect in short-term memory. Hum Brain Mapp 2011; 33:1634-47. [PMID: 21739525 DOI: 10.1002/hbm.21308] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2010] [Revised: 02/23/2011] [Accepted: 02/23/2011] [Indexed: 11/07/2022] Open
Abstract
Dividing auditory sequence into groups, or imposing rhythmic, tonal, or spatial structure during presentation, improves recall performance. Several competing computational models have been proposed to account for these effects, but little is known about the neural correlates of grouping and hence the representations that encode grouped sequences. The present study used functional magnetic resonance imaging (fMRI) to compare the auditory encoding of grouped and ungrouped lists of sub-span (six letters) and supra-span (nine letters) length in an immediate serial recall (ISR) task. Analysis of activation revealed an extensive premotor and prefrontal network, which was significantly less active when short-term memory (STM) span was exceeded during encoding. Only primary auditory cortex showed an increase in activation when memory span was exceeded. Comparison of activation for grouped and ungrouped lists showed that during the subspan phase bilateral planum temporale showed less activation for grouped stimuli, while during the supra-span phase supramarginal and inferior parietal areas were more active for grouped lists. The magnitude of both temporal and parietal activations predicted enhanced recall of grouped lists. Thus neural signatures of grouping seem to reflect more structured processing in parietal areas instead of reliance on perceptual-auditory processing in temporal regions.
Collapse
Affiliation(s)
- Kristjan Kalm
- MRC Cognition and Brain Sciences Unit, Cambridge, UK.
| | | | | |
Collapse
|
17
|
Blackman GA, Hall DA. Reducing the effects of background noise during auditory functional magnetic resonance imaging of speech processing: qualitative and quantitative comparisons between two image acquisition schemes and noise cancellation. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2011; 54:693-704. [PMID: 20844253 DOI: 10.1044/1092-4388(2010/10-0143)] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
PURPOSE The intense sound generated during functional magnetic resonance imaging (fMRI) complicates studies of speech and hearing. This experiment evaluated the benefits of using active noise cancellation (ANC), which attenuates the level of the scanner sound at the participant's ear by up to 35 dB around the peak at 600 Hz. METHOD Speech and narrowband noise were presented at a low sound level to 8 listeners during fMRI using 2 common scanning protocols: short ("continuous") and long ("sparse") temporal schemes. Three outcome measures were acquired simultaneously during fMRI: ratings of listening quality, discrimination performance, and brain activity. RESULTS Subjective ratings and discrimination performance were significantly improved by ANC and sparse acquisition. Sparse acquisition was the more robust method for detecting auditory cortical activity. ANC reduced some of the "extra-auditory" activity that might be associated with the effort required for perceptual discrimination in a noisy environment and also offered small improvements for detecting activity within Heschl's gyrus and planum polare. CONCLUSIONS For the scanning protocols evaluated here, the sparse temporal scheme was the more preferable for detecting sound-evoked activity. In addition, ANC ensures that listening difficulty is determined more by the chosen stimulus parameters and less by the adverse testing environment.
Collapse
|
18
|
Bae Y, Kuehn DP, Conway CA, Sutton BP. Real-time magnetic resonance imaging of velopharyngeal activities with simultaneous speech recordings. Cleft Palate Craniofac J 2010; 48:695-707. [PMID: 21214321 DOI: 10.1597/09-158] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
OBJECTIVE To examine the relationships between acoustic and physiologic aspects of the velopharyngeal mechanism during acoustically nasalized segments of speech in normal individuals by combining fast magnetic resonance imaging (MRI) with simultaneous speech recordings and subsequent acoustic analyses. DESIGN Ten normal Caucasian adult individuals participated in the study. Midsagittal dynamic magnetic resonance imaging (MRI) and simultaneous speech recordings were performed while participants were producing repetitions of two rate-controlled nonsense syllables including /zanaza/ and /zunuzu/. Acoustic features of nasalization represented as the peak amplitude and the bandwidth of the first resonant frequency (F1) were derived from speech at the rate of 30 sets per second. Physiologic information was based on velar and tongue positional changes measured from the dynamic MRI data, which were acquired at a rate of 21.4 images per second and resampled with a corresponding rate of 30 images per second. Each acoustic feature of nasalization was regressed on gender, vowel context, and velar and tongue positional variables. RESULTS Acoustic features of nasalization represented by F1 peak amplitude and bandwidth changes were significantly influenced by the vowel context surrounding the nasal consonant, velar elevated position, and tongue height at the tip. CONCLUSIONS Fast MRI combined with acoustic analysis was successfully applied to the investigation of acoustic-physiologic relationships of the velopharyngeal mechanism with the type of speech samples employed in the present study. Future applications are feasible to examine how anatomic and physiologic deviations of the velopharyngeal mechanism would be acoustically manifested in individuals with velopharyngeal incompetence.
Collapse
|
19
|
Andres M, Pelgrims B, Michaux N, Olivier E, Pesenti M. Role of distinct parietal areas in arithmetic: an fMRI-guided TMS study. Neuroimage 2010; 54:3048-56. [PMID: 21073958 DOI: 10.1016/j.neuroimage.2010.11.009] [Citation(s) in RCA: 72] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2010] [Revised: 09/23/2010] [Accepted: 11/01/2010] [Indexed: 01/02/2023] Open
Abstract
Although several parietal areas are known to be involved in number processing, their possible role in arithmetic operations remains debated. It has been hypothesized that the horizontal segment of the intraparietal sulcus (hIPS) and the posterior superior parietal lobule (PSPL) contribute to operations solved by calculation procedures, such as subtraction, but whether these areas are also involved in operations solved by memory retrieval, such as multiplication, is controversial. In the present study, we first identified the parietal areas involved in subtraction and multiplication by means of functional magnetic resonance imaging (fMRI) and we found an increased activation, bilaterally, in the hIPS and PSPL during both arithmetic operations. In order to test whether these areas are causally involved in subtraction and multiplication, we used transcranial magnetic stimulation (TMS) to create, in each participant, a virtual lesion of either the hIPS or PSPL, over the sites corresponding to the peaks of activation gathered in fMRI. When compared to a control site, we found an increase in response latencies in both operations after a virtual lesion of either the left or right hIPS, but not of the PSPL. Moreover, TMS over the hIPS increased the error rate in the multiplication task. The present results indicate that even operations solved by memory retrieval, such as multiplication, rely on the hIPS. In contrast, the PSPL seems to underlie processes that are nonessential to solve basic subtraction and multiplication problems.
Collapse
Affiliation(s)
- Michael Andres
- Institut de Recherche en Sciences Psychologiques, Faculty of Psychology, Université catholique de Louvain, Louvain-la-Neuve, Belgium.
| | | | | | | | | |
Collapse
|
20
|
Oztekin I, Long NM, Badre D. Optimizing design efficiency of free recall events for FMRI. J Cogn Neurosci 2010; 22:2238-50. [PMID: 19803690 DOI: 10.1162/jocn.2009.21350] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Free recall is a fundamental paradigm for studying memory retrieval in the context of minimal cue support. Accordingly, free recall has been extensively studied using behavioral methods. However, the neural mechanisms that support free recall have not been fully investigated due to technical challenges associated with probing individual recall events with neuroimaging methods. Of particular concern is the extent to which the uncontrolled latencies associated with recall events can confer sufficient design efficiency to permit neural activation for individual conditions to be distinguished. The present study sought to rigorously assess the feasibility of testing individual free recall events with fMRI. We used both theoretically and empirically derived free recall latency distributions to generate simulated fMRI data sets and assessed design efficiency across a range of parameters that describe free recall performance and fMRI designs. In addition, two fMRI experiments empirically assessed whether differential neural activation in visual cortex at onsets determined by true free recall performance across different conditions can be resolved. Collectively, these results specify the design and performance parameters that can provide comparable efficiency between free recall designs and more traditional jittered event-related designs. These findings suggest that assessing BOLD response during free recall using fMRI is feasible, under certain conditions, and can serve as a powerful tool in understanding the neural bases of memory search and overt retrieval.
Collapse
Affiliation(s)
- Ilke Oztekin
- Department of Cognitive and Linguistic Sciences, Brown University, Box 1978, Providence, RI 02912, USA.
| | | | | |
Collapse
|
21
|
Zvyagintsev M, Klasen M, Mathiak KA, Weber R, Edgar JC, Mathiak K. Real-time noise cancellation for speech acquired in interactive functional magnetic resonance imaging studies. J Magn Reson Imaging 2010; 32:705-13. [PMID: 20815071 DOI: 10.1002/jmri.22285] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
Abstract
PURPOSE To present online scanner noise cancellation for speech acquired in functional magnetic resonance imaging (fMRI) studies. MATERIALS AND METHODS An online active noise cancellation method for speech acquired in fMRI studies was developed. The approach consists of two automated steps: 1) creation of an MR noise template in a short "test" fMRI scan; 2) application of the template for automatic recognition and subtraction of the MR noise from the acquired microphone signal during an fMRI study. The method was applied in an experimental paradigm where a subject and an investigator communicated in an interactive verbal generation task during fMRI. RESULTS By applying online active noise cancellation, the quality of the subject's speech was substantially improved. The present approach was found to be flexible, reliable, and easy to implement, providing a method for fMRI studies that investigate the neural correlates of interactive speech communication. CONCLUSION Using online noise cancellation it is possible to improve the quality of acquired speech in fMRI. This approach may be recommended for interactive fMRI studies.
Collapse
Affiliation(s)
- Mikhail Zvyagintsev
- Department of Psychiatry and Psychotherapy, JARA-Translational Brain Research, RWTH Aachen University, Aachen, Germany.
| | | | | | | | | | | |
Collapse
|
22
|
Graves WW, Desai R, Humphries C, Seidenberg MS, Binder JR. Neural systems for reading aloud: a multiparametric approach. Cereb Cortex 2010; 20:1799-815. [PMID: 19920057 PMCID: PMC2901017 DOI: 10.1093/cercor/bhp245] [Citation(s) in RCA: 207] [Impact Index Per Article: 14.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023] Open
Abstract
Reading aloud involves computing the sound of a word from its visual form. This may be accomplished 1) by direct associations between spellings and phonology and 2) by computation from orthography to meaning to phonology. These components have been studied in behavioral experiments examining lexical properties such as word frequency; length in letters or phonemes; spelling-sound consistency; semantic factors such as imageability, measures of orthographic, or phonological complexity; and others. Effects of these lexical properties on specific neural systems, however, are poorly understood, partially because high intercorrelations among lexical factors make it difficult to determine if they have independent effects. We addressed this problem by decorrelating several important lexical properties through careful stimulus selection. Functional magnetic resonance imaging data revealed distributed neural systems for mapping orthography directly to phonology, involving left supramarginal, posterior middle temporal, and fusiform gyri. Distinct from these were areas reflecting semantic processing, including left middle temporal gyrus/inferior-temporal sulcus, bilateral angular gyrus, and precuneus/posterior cingulate. Left inferior frontal regions generally showed increased activation with greater task load, suggesting a more general role in attention, working memory, and executive processes. These data offer the first clear evidence, in a single study, for the separate neural correlates of orthography-phonology mapping and semantic access during reading aloud.
Collapse
Affiliation(s)
- William W. Graves
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Rutvik Desai
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Colin Humphries
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| | - Mark S. Seidenberg
- Department of Psychology, University of Wisconsin, Madison, WI 53706, USA
| | - Jeffrey R. Binder
- Department of Neurology, Medical College of Wisconsin, Milwaukee, WI 53226, USA
| |
Collapse
|
23
|
Ramachandran VR, Panahi IM, Milani AA. Objective and subjective evaluation of adaptive speech enhancement methods for functional MRI. J Magn Reson Imaging 2009; 31:46-55. [DOI: 10.1002/jmri.21993] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
|
24
|
Hocking J, McMahon KL, de Zubicaray GI. Semantic context and visual feature effects in object naming: an fMRI study using arterial spin labeling. J Cogn Neurosci 2009; 21:1571-83. [PMID: 18823254 DOI: 10.1162/jocn.2009.21114] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Previous behavioral studies reported a robust effect of increased naming latencies when objects to be named were blocked within semantic category, compared to items blocked between category. This semantic context effect has been attributed to various mechanisms including inhibition or excitation of lexico-semantic representations and incremental learning of associations between semantic features and names, and is hypothesized to increase demands on verbal self-monitoring during speech production. Objects within categories also share many visual structural features, introducing a potential confound when interpreting the level at which the context effect might occur. Consistent with previous findings, we report a significant increase in response latencies when naming categorically related objects within blocks, an effect associated with increased perfusion fMRI signal bilaterally in the hippocampus and in the left middle to posterior superior temporal cortex. No perfusion changes were observed in the middle section of the left middle temporal cortex, a region associated with retrieval of lexical-semantic information in previous object naming studies. Although a manipulation of visual feature similarity did not influence naming latencies, we observed perfusion increases in the perirhinal cortex for naming objects with similar visual features that interacted with the semantic context in which objects were named. These results provide support for the view that the semantic context effect in object naming occurs due to an incremental learning mechanism, and involves increased demands on verbal self-monitoring.
Collapse
|
25
|
Li M, Lim TC, Lee JH. Simulation study on active noise control for a 4-T MRI scanner. Magn Reson Imaging 2007; 26:393-400. [PMID: 18060719 DOI: 10.1016/j.mri.2007.08.003] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2007] [Revised: 07/26/2007] [Accepted: 08/08/2007] [Indexed: 11/16/2022]
Abstract
The purpose of this work is to study computationally the possibility of the application of a hybrid active noise control technique for magnetic resonance imaging (MRI) acoustic noise reduction. A hybrid control system combined with both feedforward and feedback loops embedded is proposed for potential application on active MRI noise reduction. A set of computational simulation studies were performed. Sets of MRI acoustic noise emissions measured at the patient's left ear location were recorded and used in the simulation study. By comparing three different control systems, namely, the feedback, the feedforward and the hybrid control, our results revealed that the hybrid control system is the most effective. The hybrid control system achieved approximately a 20-dB reduction at the principal frequency component. We concluded that the proposed hybrid active control scheme could have a potential application for MRI scanner noise reduction.
Collapse
Affiliation(s)
- Mingfeng Li
- Department of Mechanical, Industrial and Nuclear Engineering, University of Cincinnati, Cincinnati, OH 45221, USA
| | | | | |
Collapse
|
26
|
Farthing JP, Cummine J, Borowsky R, Chilibeck PD, Binsted G, Sarty GE. False activation in the brain ventricles related to task-correlated breathing in fMRI speech and motor paradigms. MAGNETIC RESONANCE MATERIALS IN PHYSICS BIOLOGY AND MEDICINE 2007; 20:157-68. [PMID: 17564734 DOI: 10.1007/s10334-007-0077-z] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/28/2006] [Revised: 04/05/2007] [Accepted: 05/09/2007] [Indexed: 10/23/2022]
Abstract
OBJECT We demonstrate, and show how to eliminate, a task-correlated breathing activation artefact created while performing exercise tasks during a gap in functional magnetic resonance imaging (fMRI). MATERIALS AND METHODS Two studies are presented. The first was intended to isolate a reliable fMRI paradigm for intense handgrip contractions. A gapped acquisition was used to reduce motion artefact, where the contraction was performed during a gap, and image acquisition was between contractions. The second study involved naming regular words (REGs) and nonwords (NWs), where a gap is required for the analysis of participants' overt speech. RESULTS For study 1, brain ventricle activation was present when breathing responses were task-correlated, and was only eliminated by removing the gap from the sequence. For study 2, NWs were associated with activation artefact in the ventricles, and slower reaction time (RT), reflecting a strategy whereby breathing falls in synchrony with image acquisition. REGs showed the expected RT distribution and frequency effect (reflecting lexical access), with no ventricle activation, and consequently no synchrony with image acquisition. CONCLUSION The gapped paradigm increased the likelihood of breathing correlated T2* signal changes in brain ventricles. FMRI researchers should examine the brain ventricles for activation artefact as they are likely associated with false activations in other brain regions.
Collapse
Affiliation(s)
- Jonathan P Farthing
- College of Kinesiology, University of Saskatchewan, 87 Campus Drive, Saskatoon, SK, Canada, S7N 5B2.
| | | | | | | | | | | |
Collapse
|
27
|
Basho S, Palmer ED, Rubio MA, Wulfeck B, Müller RA. Effects of generation mode in fMRI adaptations of semantic fluency: paced production and overt speech. Neuropsychologia 2007; 45:1697-706. [PMID: 17292926 PMCID: PMC1894937 DOI: 10.1016/j.neuropsychologia.2007.01.007] [Citation(s) in RCA: 93] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2006] [Revised: 12/29/2006] [Accepted: 01/07/2007] [Indexed: 11/29/2022]
Abstract
Verbal fluency is a widely used neuropsychological paradigm. In fMRI implementations, conventional unpaced (self-paced) versions are suboptimal due to uncontrolled timing of responses, and overt responses carry the risk of motion artifact. We investigated the behavioral and neurofunctional effects of response pacing and overt speech in semantic category-driven word generation. Twelve right-handed adults (8 females), ages 21-37 were scanned in four conditions each: paced-overt, paced-covert, unpaced-overt, and unpaced-covert. There was no significant difference in the number of exemplars generated between overt versions of the paced and unpaced conditions. Imaging results for category-driven word generation overall showed left-hemispheric activation in inferior frontal cortex, premotor cortex, cingulate gyrus, thalamus, and basal ganglia. Direct comparison of generation modes revealed significantly greater activation for the paced compared to unpaced conditions in right superior temporal, bilateral middle frontal, and bilateral anterior cingulate cortex, including regions associated with sustained attention, motor planning, and response inhibition. Covert (compared to overt) conditions showed significantly greater effects in right parietal and anterior cingulate, as well as left middle temporal and superior frontal regions. We conclude that paced overt paradigms are useful adaptations of conventional semantic fluency in fMRI, given their superiority with regard to control over and monitoring of behavioral responses. However, response pacing is associated with additional non-linguistic effects related to response inhibition, motor preparation, and sustained attention.
Collapse
Affiliation(s)
- Surina Basho
- Brain Development Imaging Laboratory, Department of Psychology, San Diego State University
- Eliot-Pearson Department of Child Development, Tufts University
| | - Erica D. Palmer
- Brain Development Imaging Laboratory, Department of Psychology, San Diego State University
| | - Miguel A. Rubio
- Brain Development Imaging Laboratory, Department of Psychology, San Diego State University
| | - Beverly Wulfeck
- School of Speech, Language, & Hearing Sciences, San Diego State University
| | - Ralph-Axel Müller
- Brain Development Imaging Laboratory, Department of Psychology, San Diego State University
- Department of Cognitive Science, University of California, San Diego
| |
Collapse
|
28
|
Bor D, Owen AM. A Common Prefrontal–Parietal Network for Mnemonic and Mathematical Recoding Strategies within Working Memory. Cereb Cortex 2006; 17:778-86. [PMID: 16707737 DOI: 10.1093/cercor/bhk035] [Citation(s) in RCA: 75] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Previous studies have indicated that the lateral prefrontal cortex (LPFC) is closely involved in strategic recoding, even when such processes lessen task demands. For example, 2 studies presented, in the spatial and verbal domains, sequences of stimuli for participants to retain during a short interval and then retrieve. Stimuli were either randomly arranged or structured (forming symmetries and regular shapes for the spatial task and mathematical patterns for the verbal task). Although participants performed the structured tasks better by reorganizing or "chunking" them into more efficient forms, LPFC activity was greater for the structured compared with the random sequences. However, although these results demonstrate that LPFC is involved in strategic recoding, regardless of the type of modality, it remains to be seen whether such a result generalizes to different types of strategic recoding processes. To test this, we presented digit sequence trials that separately emphasized mnemonic or mathematical recoding strategies. While participants were able to gain a performance benefit from either type of recoding strategy, increased LPFC activity was observed for both mathematical and mnemonic recoding trials, compared with either unstructured sequences or control conditions matched for mathematical or mnemonic processes. However, mathematically structured trials activated the LPFC significantly more than mnemonic recoding trials. In addition, lateral posterior parietal cortex was consistently coactivated with LPFC for strategic recoding trials, both in the current experiments and in previous related studies. We conclude that a prefrontal-parietal network is involved in strategic recoding in working memory, regardless of the type of recoding process.
Collapse
Affiliation(s)
- Daniel Bor
- Medical Research Council Cognition and Brain Sciences Unit, Cambridge CB2 2EF, UK.
| | | |
Collapse
|