The neural substrates of spoken idiom comprehension

Engagement of the speech motor system in challenging speech perception: Activation likelihood estimation meta-analyses

The relationship between speech production and perception is a topic of ongoing debate. Some argue that there is little interaction between the two, while others claim they share representations and processes. One perspective suggests increased recruitment of the speech motor system in demanding listening situations to facilitate perception. However, uncertainties persist regarding the specific regions involved and the listening conditions influencing its engagement. This study used activation likelihood estimation in coordinate-based meta-analyses to investigate the neural overlap between speech production and three speech perception conditions: speech-in-noise, spectrally degraded speech and linguistically complex speech. Neural overlap was observed in the left frontal, insular and temporal regions. Key nodes included the left frontal operculum (FOC), left posterior lateral part of the inferior frontal gyrus (IFG), left planum temporale (PT), and left pre-supplementary motor area (pre-SMA). The left IFG activation was consistently observed during linguistic processing, suggesting sensitivity to the linguistic content of speech. In comparison, the left pre-SMA activation was observed when processing degraded and noisy signals, indicating sensitivity to signal quality. Activations of the left PT and FOC activation were noted in all conditions, with the posterior FOC area overlapping in all conditions. Our meta-analysis reveals context-independent (FOC, PT) and context-dependent (pre-SMA, posterior lateral IFG) regions within the speech motor system during challenging speech perception. These regions could contribute to sensorimotor integration and executive cognitive control for perception and production.

Non-literal language processing is jointly supported by the language and theory of mind networks: Evidence from a novel meta-analytic fMRI approach

Going beyond the literal meaning of language is key to communicative success. However, the mechanisms that support non-literal inferences remain debated. Using a novel meta-analytic approach, we evaluate the contribution of linguistic, social-cognitive, and executive mechanisms to non-literal interpretation. We identified 74 fMRI experiments (n = 1,430 participants) from 2001 to 2021 that contrasted non-literal language comprehension with a literal control condition, spanning ten phenomena (e.g., metaphor, irony, indirect speech). Applying the activation likelihood estimation approach to the 825 activation peaks yielded six left-lateralized clusters. We then evaluated the locations of both the individual-study peaks and the clusters against probabilistic functional atlases (cf. anatomical locations, as is typically done) for three candidate brain networks-the language-selective network (Fedorenko, Behr, & Kanwisher, 2011), which supports language processing, the Theory of Mind (ToM) network (Saxe & Kanwisher, 2003), which supports social inferences, and the domain-general Multiple-Demand (MD) network (Duncan, 2010), which supports executive control. These atlases were created by overlaying individual activation maps of participants who performed robust and extensively validated 'localizer' tasks that selectively target each network in question (n = 806 for language; n = 198 for ToM; n = 691 for MD). We found that both the individual-study peaks and the ALE clusters fell primarily within the language network and the ToM network. These results suggest that non-literal processing is supported by both i) mechanisms that process literal linguistic meaning, and ii) mechanisms that support general social inference. They thus undermine a strong divide between literal and non-literal aspects of language and challenge the claim that non-literal processing requires additional executive resources.

The impact of transparency on hemispheric lateralization of idiom comprehension: An rTMS study

Previous neuropsychological data have equivocal suggestions concerning hemispheric involvement during idiom comprehension. The possible contribution of idioms transparency to the lateralization of figurative language comprehension has not been investigated using an interference technique. To analyse the cortical lateralization of idiom transparency processing, we employed inhibitory repetitive transcranial magnetic stimulation (rTMS) to the left and right dorsolateral prefrontal cortex (DLPFC) during the processing of opaque idioms, transparent idioms, and non-idiomatic literal phrases. Based on the Coarse Semantic Coding theory, we predicted a greater right hemisphere involvement when processing opaque than transparent idioms. Eighteen young healthy participants underwent rTMS pulses at 1 Hz frequency, 110% of motor threshold intensity for 15 min (900 pulses) in two sessions at one-week intervals. In a semantic decision task, participants judged the relatedness of an idiom and a target word. The target word was figuratively or literally related to the idiom, or unrelated. The study also included non-idiomatic sentences. We found that left DLPFC functions are more critical for comprehension of opaque rather than transparent idioms when referring to the figurative associations of the idioms. Opaque idioms, in the context of their figurative meaning, rely more heavily on left hemisphere resources. This finding suggests that opaque idioms are seemingly processed as one unit. Taken together, we believe that the transparency of idiomatic expressions may play an important role in modulating hemispheric functions involved in figurative language processing.

Reorganization of the Neurobiology of Language After Sentence Overlearning

It is assumed that there are a static set of "language regions" in the brain. Yet, language comprehension engages regions well beyond these, and patients regularly produce familiar "formulaic" expressions when language regions are severely damaged. These suggest that the neurobiology of language is not fixed but varies with experiences, like the extent of word sequence learning. We hypothesized that perceiving overlearned sentences is supported by speech production and not putative language regions. Participants underwent 2 sessions of behavioral testing and functional magnetic resonance imaging (fMRI). During the intervening 15 days, they repeated 2 sentences 30 times each, twice a day. In both fMRI sessions, they "passively" listened to those sentences, novel sentences, and produced sentences. Behaviorally, evidence for overlearning included a 2.1-s decrease in reaction times to predict the final word in overlearned sentences. This corresponded to the recruitment of sensorimotor regions involved in sentence production, inactivation of temporal and inferior frontal regions involved in novel sentence listening, and a 45% change in global network organization. Thus, there was a profound whole-brain reorganization following sentence overlearning, out of "language" and into sensorimotor regions. The latter are generally preserved in aphasia and Alzheimer's disease, perhaps explaining residual abilities with formulaic expressions in both.

Functional anatomy of idiomatic expressions

Idiomatic expressions (IE) are groups of words whose meaning is different from the sum of its components. Neural mechanisms underlying their processing are still debated, especially regarding lateralization, main structures involved, and whether this neural network is independent from the spoken language. To investigate the neural correlates of IE processing in healthy Spanish speakers.Twenty one native speakers of Spanish were asked to select one of 4 possible meanings for IE or literal sentences. fMRI scans were performed in a 3.0T scanner and processed by SPM 12 comparing IE vs. literal sentences. Laterality indices were calculated at the group level. IE activated a bilateral, slightly right-sided network comprising the pars triangularis and areas 9 and 10. In the left hemisphere (LH): the pars orbitalis, superior frontal, angular and fusiform gyrus. In the right hemisphere (RH): anterior insula, middle frontal, and superior temporal gyrus. This network reveals the importance of the RH, besides traditional LH areas, to comprehend IE. This agrees with the semantic coding model: the LH activates narrow semantic fields choosing one single meaning and ignoring others, and the RH detects distant semantic relationships, activating diffuse semantic fields. It is also in line with the configuration hypothesis: both meanings, literal and figurative, are executed simultaneously, until the literal meaning is definitively rejected and the figurative one is accepted. Processing IE requires the activation of fronto-temporal networks in both hemispheres. The results concur with previous studies in other languages, so these networks are independent from the spoken language. Understanding these mechanisms sheds light on IE processing difficulties in different clinical populations and must be considered when planning resective surgery.

Idiomatic expressions evoke stronger emotional responses in the brain than literal sentences

Recent neuroscientific research shows that metaphors engage readers at the emotional level more strongly than literal expressions. What still remains unclear is what makes metaphors more engaging, and whether this generalises to all figurative expressions, no matter how conventionalised they are. This fMRI study aimed to investigate whether idiomatic expressions - the least creative part of figurative language - indeed trigger a higher affective resonance than literal expressions, and to explore possible interactions between activation in emotion-relevant neural structures and regions associated with figurative language processing. Participants silently read for comprehension a set of emotionally positive, negative and neutral idioms embedded in short sentences, and similarly valenced literal sentences. As in studies on metaphors, we found enhanced activation of the left inferior frontal gyrus and left amygdala in response to idioms, indexing stronger recruitment of executive control functions and enhanced emotional engagement, respectively. This suggests that the comprehension of even highly conventionalised and familiar figurative expressions, namely idioms, recruits regions involved in emotional processing. Furthermore, increased activation of the IFG interacted positively with activation in the amygdala, suggesting that the stronger cognitive engagement driven by idioms may in turn be coupled with stronger involvement at the emotional level.

A Quantitative Meta-analysis of Neuroimaging Studies of Pragmatic Language Comprehension: In Search of a Universal Neural Substrate

Pragmatics may be defined as the ability to communicate by expressing and recognizing intentions. The objective of this meta-analysis was to identify neural substrates for comprehension of pragmatic content in general, as well as the differences between pragmatic forms, and to describe if there is differential recruitment of brain areas according to natural language. This meta-analysis included 48 functional magnetic resonance imaging studies that reported pragmatic versus literal language contrasts. The pragmatic forms were speech acts, metaphors, idioms, and irony. Effect Size-Signed Differential Mapping software was used to calculate the mean for all contrasts as well as for each pragmatic form, and make comparisons among all forms. Due to variations in pragmatic content configuration such as natural language, stimulus modality, and writing systems, these variations were also analyzed with subgroups' analyses. The analyses found a highly reproducible bilateral fronto-temporal and medial prefrontal cortex network for pragmatic comprehension. Each pragmatic form showed a specific convergence pattern within this bilateral network. Natural language analyses showed that fronto-temporal regions were recruited by Germanic languages, while only left frontal areas were recruited by Romance languages, and right medial prefrontal cortex by Japanese. In conclusion, pragmatic language comprehension involves classical language areas in bilateral perisylvian regions, along with the medial prefrontal cortex, an area involved in social cognition. Together, these areas could represent the "pragmatic language network". Nonetheless, when proposing a universal neural substrate for all forms of pragmatic language, the diversity among studies in terms of pragmatic form, and configuration, must be taken into consideration.

The role of the ventro-lateral prefrontal cortex in idiom comprehension: An rTMS study

Previous research is equivocal with respect to the neural substrates of idiom processing. Particularly elusive is the role of the left ventro-lateral prefrontal cortex (VLPFC), a region implicated in semantic control generally. Although fMRI studies have shown that the left VLPFC is active during idiom processing (see Rapp et al. (2012), for review), rTMS studies have failed to corroborate a clear role of this prefrontal region (e.g., Oliveri et al., 2004). We investigated this issue using a semantic meaningfulness judgment task that compared idiom comprehension following rTMS-stimulation to the left VLPFC relative to a control site (vertex). We also investigated whether individual differences in general cognitive capacity among comprehenders modulated the effects of rTMS. The results indicate that left VLPFC stimulation particularly affected the processing of low-familiar idioms, possibly because these items involve a maximal semantic conflict between a salient literal and less-known figurative meaning. Of note, this pattern only emerged for comprehenders with higher cognitive control capacity, possibly because they were more likely to activate or maintain multiple semantic representations during idiom processing, which required VLPFC integrity. Taken together, the results support the importance of the left VLPFC to idiom processing.

Decoding of Covert Vowel Articulation Using Electroencephalography Cortical Currents

With the goal of providing assistive technology for the communication impaired, we proposed electroencephalography (EEG) cortical currents as a new approach for EEG-based brain-computer interface spellers. EEG cortical currents were estimated with a variational Bayesian method that uses functional magnetic resonance imaging (fMRI) data as a hierarchical prior. EEG and fMRI data were recorded from ten healthy participants during covert articulation of Japanese vowels /a/ and /i/, as well as during a no-imagery control task. Applying a sparse logistic regression (SLR) method to classify the three tasks, mean classification accuracy using EEG cortical currents was significantly higher than that using EEG sensor signals and was also comparable to accuracies in previous studies using electrocorticography. SLR weight analysis revealed vertices of EEG cortical currents that were highly contributive to classification for each participant, and the vertices showed discriminative time series signals according to the three tasks. Furthermore, functional connectivity analysis focusing on the highly contributive vertices revealed positive and negative correlations among areas related to speech processing. As the same findings were not observed using EEG sensor signals, our results demonstrate the potential utility of EEG cortical currents not only for engineering purposes such as brain-computer interfaces but also for neuroscientific purposes such as the identification of neural signaling related to language processing.

Norms and comprehension times for 305 French idiomatic expressions

We report psycholinguistic norms for 305 French idiomatic expressions (Study 1). For each of the idiomatic expressions, the following variables are reported: knowledge, predictability, literality, compositionality, subjective and objective frequency, familiarity, age of acquisition (AoA), and length. In addition, we have collected comprehension times for each idiom (Study 2). The psycholinguistic relevance of the collected norms is explained, and different analyses (descriptive statistics, correlation and multiple regression analyses) performed on the norms are reported and discussed. The entire set of norms and reading times are provided as supplemental material.

Do nonnative language speakers chew the fat and spill the beans with different brain hemispheres? Investigating idiom decomposability with the divided visual field paradigm

The purpose of this study was to explore possible cerebral asymmetries in the processing of decomposable and nondecomposable idioms by fluent nonnative speakers of English. In the study, native language (Polish) and foreign language (English) decomposable and nondecomposable idioms were embedded in ambiguous (neutral) and unambiguous (biasing figurative meaning) context and presented centrally, followed by laterally presented target words related to the figurative meaning of the idiom or literal meaning of the last word of the idiom. The target appeared either immediately at sentence offset (Experiment 1), or 400 ms (Experiment 2) after sentence offset. Results are inconsistent with the Idiom Decomposition Hypothesis (Gibbs et al. in Mem Cogn 17:58-68, 1989a; J Mem Lang 28:576-593, 1989b) and only partially consistent with the idea of the differential cerebral involvement in processing (non)decomposable idioms [the Fine/Coarse Coding Theory, Beeman (Right hemisphere language comprehension: perspectives from cognitive neuroscience, Lawrence Erlbaum Associates, Mahwah, NJ, 1998)]. A number of factors, rather than compositionality per se, emerge as crucial in determining idiom processing, such as language status (native vs. nonnative), salience, or context.

Impairments in proverb interpretation following focal frontal lobe lesions

The proverb interpretation task (PIT) is often used in clinical settings to evaluate frontal "executive" dysfunction. However, only a relatively small number of studies have investigated the relationship between frontal lobe lesions and performance on the PIT. We compared 52 patients with unselected focal frontal lobe lesions with 52 closely matched healthy controls on a proverb interpretation task. Participants also completed a battery of neuropsychological tests, including a fluid intelligence task (Raven's Advanced Progressive Matrices). Lesions were firstly analysed according to a standard left/right sub-division. Secondly, a finer-grained analysis compared the performance of patients with medial, left lateral and right lateral lesions with healthy controls. Thirdly, a contrast of specific frontal subgroups compared the performance of patients with medial lesions with patients with lateral frontal lesions. The results showed that patients with left frontal lesions were significantly impaired on the PIT, while in patients with right frontal lesions the impairments approached significance. Medial frontal patients were the only frontal subgroup impaired on the PIT, relative to healthy controls and lateral frontal patients. Interestingly, an error analysis indicated that a significantly higher number of concrete responses were found in the left lateral subgroup compared to healthy controls. We found no correlation between scores on the PIT and on the fluid intelligence task. Overall our results suggest that specific regions of the frontal lobes contribute to the performance on the PIT.

Can clouds dance? Neural correlates of passive conceptual expansion using a metaphor processing task: Implications for creative cognition

Creativity has emerged in the focus of neurocognitive research in the past decade. However, a heterogeneous pattern of brain areas has been implicated as underpinning the neural correlates of creativity. One explanation for these divergent findings lies in the fact that creativity is not usually investigated in terms of its many underlying cognitive processes. The present fMRI study focuses on the neural correlates of conceptual expansion, a central component of all creative processes. The study aims to avoid pitfalls of previous fMRI studies on creativity by employing a novel paradigm. Participants were presented with phrases and made judgments regarding both the unusualness and the appropriateness of the stimuli, corresponding to the two defining criteria of creativity. According to their respective evaluation, three subject-determined experimental conditions were obtained. Phrases judged as both unusual and appropriate were classified as indicating conceptual expansion in participants. The findings reveal the involvement of frontal and temporal regions when engaging in passive conceptual expansion as opposed to the information processing of mere unusualness (novelty) or appropriateness (relevance). Taking this new experimental approach to uncover specific processes involved in creative cognition revealed that frontal and temporal regions known to be involved in semantic cognition and relational reasoning play a role in passive conceptual expansion. Adopting a different vantage point on the investigation of creativity would allow for critical advances in future research on this topic.

Nonliteral language in Alzheimer dementia: a review

The use of nonliteral language in clinical assessment, especially testing the patients' ability to interpret proverbs, has a long tradition in psychiatry. However, its diagnostic sensitivity and specificity in dementias is not yet clear. The aim of this review article is to examine the current evidence on nonliteral/figurative language (proverb, metaphor, metonymy, idiom, irony, sarcasm) comprehension in Alzheimer's disease and related disorders. A comprehensive literature search identified 25 studies (16 proverb, 3 metaphor, 0 metonymy, 5 idiom, 3 sarcasm) on nonliteral language comprehension in dementia. Studies predominantly indicate a deficit. Most studies investigated Alzheimer's dementia. Applied correctly, nonliteral language is a worthwhile diagnostic tool to evaluate language and abstract thinking in dementias. During assessment, familiarity testing (e.g., by asking "are you familiar with the proverb XY") is obligatory. Still, future research is needed in several areas: evidence on decline of nonliteral language over the course of the illness is limited. So far, almost no studies delineated proverb comprehension in high risk populations such as patients with mild cognitive impairment. Currently, there is a lack of studies addressing performance in direct comparison to relevant differential diagnosis like older-age depression, delirium, brain lesion, or other psychiatric conditions.