"Neural overlap of L1 and L2 semantic representations across visual and auditory modalities: a decoding approach"

LexCHI: A quick lexical test for estimating language proficiency in Chinese

A prominent methodological issue in cognitive research on bilingualism is the lack of consistency in measuring second language (L2) proficiency. To reduce the inconsistency in L2 proficiency measurements, brief and valid vocabulary tests have been developed as an objective measure of proficiency in a variety of languages (e.g., English, French, Spanish). Here, we present LexCHI, a valid lexical test to measure Chinese proficiency. This freely available short test consists of 60 two-character items presented in simplified Chinese. Although it only takes a few minutes to complete LexCHI, the LexCHI scores in two studies correlated significantly with L2 participants' performance in a translation task and a cloze test. We believe that LexCHI is a useful tool for researchers who need to objectively measure Chinese proficiency as part of their investigations.

Domain-general and language-specific contributions to speech production in a second language: an fMRI study using functional localizers

For bilinguals, speaking in a second language (L2) compared to the native language (L1) is usually more difficult. In this study we asked whether the difficulty in L2 production reflects increased demands imposed on domain-general or core language mechanisms. We compared the brain response to speech production in L1 and L2 within two functionally-defined networks in the brain: the Multiple Demand (MD) network and the language network. We found that speech production in L2 was linked to a widespread increase of brain activity in the domain-general MD network. The language network did not show a similarly robust differences in processing speech in the two languages, however, we found increased response to L2 production in the language-specific portion of the left inferior frontal gyrus (IFG). To further explore our results, we have looked at domain-general and language-specific response within the brain structures postulated to form a Bilingual Language Control (BLC) network. Within this network, we found a robust increase in response to L2 in the domain-general, but also in some language-specific voxels including in the left IFG. Our findings show that L2 production strongly engages domain-general mechanisms, but only affects language sensitive portions of the left IFG. These results put constraints on the current model of bilingual language control by precisely disentangling the domain-general and language-specific contributions to the difficulty in speech production in L2.

Effects of short-term second language learning on the development of individual semantic networks in written and spoken language

Previous studies have primarily focused on the relationship between native language (L1) and second language (L2) in the brain, specifically in one language modality, such as written or spoken language. However, there is limited research on how L2 proficiency impacts both modalities. This study aimed to investigate the functional networks involved in reading and speech comprehension for both L1 and L2, and observe changes in these networks as L2 proficiency improves. The dataset used in this study was obtained from a previous research conducted by Gurunandan et al., which involved Spanish-English bilingual participants undergoing a three-month English training program. Participants underwent fMRI scanning and performed a semantic animacy judgment task in both spoken and written language before and after training. Through analysis, distinct neural networks associated with spoken and written language were found between individuals' L1 and L2, both before and after training. Moreover, as L2 proficiency improved, the spoken and written networks for L2 remained distinct from those of the L1. These findings suggest that short-term L2 learning experiences can modify neural networks, but may not be enough to achieve native-like proficiency, supporting the accommodation hypothesis. These results have important implications for language learning and education, indicating that additional short-term training and exposure alone may not bridge the gap between L1 and L2 processing networks.

Changes in fear-associated learning task brain activation over the COVID-19 pandemic period: a preliminary longitudinal analysis

Background

The COVID-19 pandemic has had profound impacts on people worldwide. Previous studies have shown that fear learning, extinction, recall, and contextual information processing involve the activation of emotion and sensory brain systems, which can be modified. However, it remains unclear whether brain functions associated with these processes have been altered over the pandemic period.

Methods

We compared pre- and peri-pandemic brain activation during a fear-associated learning task (FALT) using previously collected data. The participants were divided into two groups: the pandemic group (n = 16), who completed a baseline FALT before the pandemic and repeated the task during the pandemic, and the non-pandemic group (n = 77), who completed both sessions before the pandemic began.

Results

Compared with the non-pandemic group, the pandemic group exhibited significant decreases in brain activation from baseline to follow-up assessments, including activation in the brainstem during early fear learning, the posterior thalamus/hippocampus during late extinction, and the occipital pole during late recall phases for contextual processing. Furthermore, activations associated with retrieving safety cues were reduced in the posterior cingulate, premotor, and calcarine cortices during the early recall phase, and activations associated with retrieving dangerous cues decreased in the occipital pole during the late recall phase. Additionally, correlations between decreased activation and elevated posttraumatic stress symptoms were observed.

Conclusion

These findings suggest that activations associated with processing low arousal contextual information, safety cues, and extinguished fear cues decreased during the pandemic. These changes in brain activation may have contributed to the increase in mental health disturbances observed during this time.

EEG-based BCI Dataset of Semantic Concepts for Imagination and Perception Tasks

Electroencephalography (EEG) is a widely-used neuroimaging technique in Brain Computer Interfaces (BCIs) due to its non-invasive nature, accessibility and high temporal resolution. A range of input representations has been explored for BCIs. The same semantic meaning can be conveyed in different representations, such as visual (orthographic and pictorial) and auditory (spoken words). These stimuli representations can be either imagined or perceived by the BCI user. In particular, there is a scarcity of existing open source EEG datasets for imagined visual content, and to our knowledge there are no open source EEG datasets for semantics captured through multiple sensory modalities for both perceived and imagined content. Here we present an open source multisensory imagination and perception dataset, with twelve participants, acquired with a 124 EEG channel system. The aim is for the dataset to be open for purposes such as BCI related decoding and for better understanding the neural mechanisms behind perception, imagination and across the sensory modalities when the semantic category is held constant.

Neuroanatomical correlates of macrostructural receptive abilities in narrative discourse in unilateral left hemisphere stroke: A behavioural and voxel-based morphometry study

BACKGROUND

Little is known about story retelling and comprehension abilities in groups with lower levels of education and socio-economic status (SES). A growing body of evidence suggests the role of an extended network supporting narrative comprehension, but few studies have been conducted in clinical populations, even less in developing countries.

AIMS

To extend our knowledge of the impact of a stroke on macrostructural aspects of discourse processes, namely main and complementary information, in individuals with middle-low to low SES and low levels of education. Relationships were tested between the performance in story retell and comprehension and reading and writing habits (RWH). Also, the associations between retelling and comprehension measures and their structural grey matter (GM) correlates were explored.

METHODS & PROCEDURES

A total of 17 adults with unilateral left hemisphere (LH) chronic ischaemic stroke without the presence of significant aphasia and 10 matched (age, education and SES) healthy controls (HC) participated in the study. Retell and comprehension tasks were performed after listening or reading narrative stories. Voxel-based morphometry (VBM) analysis was conducted on a subgroup of nine individuals with LH stroke and the 10 matched controls using structural magnetic resonance imaging (MRI).

OUTCOMES & RESULTS

Retelling and comprehension abilities were not significantly different between LH and HC, nonetheless quantitively lower in LH. Exploratory correlations showed that retelling and comprehension abilities in both written and auditory modalities were correlated with naming abilities. At the neural level, written comprehension positively correlated with GM density of the LH, including areas in the temporal pole, superior and middle temporal gyrus as well as the orbitofrontal cortex, precentral and postcentral gyri. Auditory narrative comprehension was associated with GM density of the lingual gyrus in the right hemisphere.

CONCLUSIONS & IMPLICATIONS

The present results suggest that retelling and comprehension of auditory and written narratives are relatively well-preserved in individuals with a LH stroke without significant aphasia, but poorer than in HC. The findings replicate previous studies conducted in groups with higher levels of education and SES both at the behavioural and neural levels. Considering that naming seems to be associated with narrative retell and comprehension in individuals with lower SES and education, this research provides evidence on the importance of pursuing further studies including larger samples with and without aphasia as well as with various SES and education levels.

WHAT THIS PAPER ADDS

What is already known on this subject Story retell and comprehension of auditory and written discourse have been shown to be affected after stroke, but most studies have been conducted on individuals with middle to high SES and high educational levels. What this paper adds to existing knowledge The study reports on narrative retell and comprehension in both auditory and written modalities in groups of HC and individuals with LH brain damage, with low-to-middle SES and lower levels of education. What are the potential or actual clinical implications of this work? This study highlights the importance of taking into consideration the sociodemographic and RWH of patients when assessing discourse retell and comprehension in both auditory and written modalities. It also underlines the importance of including patients without significant aphasia following LH stroke to look at the effect of both stroke and aphasia on narrative comprehension and story retelling.

The influence of visual deprivation on the development of the thalamocortical network: Evidence from congenitally blind children and adults

The thalamus is heavily involved in relaying sensory signals to the cerebral cortex. A relevant issue is how the deprivation of congenital visual sensory information modulates the development of the thalamocortical network. The answer is unclear because previous studies on this topic did not investigate network development, structure-function combinations, and cognition-related behaviors in the same study. To overcome these limitations, we recruited 30 congenitally blind subjects (8 children, 22 adults) and 31 sighted subjects (10 children, 21 adults), and conducted multiple analyses [i.e., gray matter volume (GMV) analysis using the voxel-based morphometry (VBM) method, resting-state functional connectivity (FC), and brain-behavior correlation]. We found that congenital blindness elicited significant changes in the development of GMV in visual and somatosensory thalamic regions. Blindness also resulted in significant changes in the development of FC between somatosensory thalamic regions and visual cortical regions as well as advanced information processing regions. Moreover, the somatosensory thalamic regions and their FCs with visual cortical regions were reorganized to process high-level tactile language information in blind individuals. These findings provide a refined understanding of the neuroanatomical and functional plasticity of the thalamocortical network.

Increased Gray Matter Volume Induced by Chinese Language Acquisition in Adult Alphabetic Language Speakers

It is interesting to explore the effects of second language (L2) acquisition on anatomical change in brain at different stages for the neural structural adaptations are dynamic. Short-term Chinese training effects on brain anatomical structures in alphabetic language speakers have been already studied. However, little is known about the adaptations of the gray matter induced by acquiring Chinese language for a relatively long learning period in adult alphabetic language speakers. To explore this issue, we recruited 38 Indian overseas students in China as our subjects. The learned group included 17 participants who had learned Mandarin Chinese for an average of 3.24 years and achieved intermediate Chinese language proficiency. The control group included 21 subjects who had no knowledge about Chinese. None of the participants had any experience in learning logographic and tonal language before Chinese learning. We found that (1) the learned group had significantly greater gray matter volume (GMV) in the left lingual gyrus (LG) compared with the control group; (2) the Chinese characters’ reading accuracy was significantly and positively correlated to the GMV in the left LG and fusiform gyrus (FG) across the two groups; and (3) in the learned group, the duration of Chinese learning was significantly and positively correlated with the GMV in the left inferior frontal gyrus (IFG) after correction for multiple comparisons with small volume corrections. Our structural imaging findings are in line with the functional imaging studies reporting increased brain activation induced by Chinese acquisition in alphabetic language speakers. The regional gray matter changes reflected the additional requirements imposed by the more difficult processing of Chinese characters and tones. The present study also show that the biological bases of the adaptations induced by a relatively long period of Chinese learning were limited in the common areas for first and foreign language processing.

The neuroanatomical consequences and pathological implications of bilingualism

In recent years, there has been a rise in the number of people who are able to speak two or more languages. This has been paralleled by an increase in research related to bilingualism. Despite this, much of the neuroanatomical consequences and pathological implications of bilingualism are still subject to discussion. This review aims to evaluate the neuroanatomical structures related to language and to the acquisition of a second language as well as exploring how learning a second language can alter one's susceptibility to and the progression of certain cerebral pathologies. A literature search was conducted on the Medline, Embase, and Web of Science databases. A total of 137 articles regarding the neuroanatomical or pathological implications of bilingualism were included for review. Following analysis of the included papers, this review finds that bilingualism induces significant gray and white matter cerebral changes, particularly in the frontal lobes, anterior cingulate cortex, left inferior parietal lobule and subcortical areas, and that native language and acquired language largely recruit the same neuroanatomical structures with however, subtle functional and anatomical differences dependent on proficiency and age of language acquisition. There is adequate evidence to suggest that bilingualism offsets the symptoms and diagnosis of dementia, and that it is protective against both pathological and age-related cognitive decline. While many of the neuroanatomical changes are known, more remains to be elucidated and the relationship between bilingualism and other neurological pathologies remains unclear.

Watershed Brain Regions for Characterizing Brand Equity-Related Mental Processes

Brand equity is an important intangible for enterprises. As one advantage, products with brand equity can increase revenue, compared with those without such equity. However, unlike tangibles, it is difficult for enterprises to manage brand equity because it exists within consumers’ minds. Although, over the past two decades, numerous consumer neuroscience studies have revealed the brain regions related to brand equity, the identification of unique brain regions related to such equity is still controversial. Therefore, this study identifies the unique brain regions related to brand equity and assesses the mental processes derived from these regions. For this purpose, three analysis methods (i.e., the quantitative meta-analysis, chi-square tests, and machine learning) were conducted. The data were collected in accordance with the general procedures of a qualitative meta-analysis. In total, 65 studies (1412 foci) investigating branded objects with brand equity and unbranded objects without brand equity were examined, whereas the neural systems involved for these two brain regions were contrasted. According to the results, the parahippocampal gyrus and the lingual gyrus were unique brand equity-related brain regions, whereas automatic mental processes based on emotional associative memories derived from these regions were characteristic mental processes that discriminate branded from unbranded objects.

Early Top-Down Modulation in Visual Word Form Processing: Evidence From an Intracranial SEEG Study

Visual word recognition, at a minimum, involves the processing of word form and lexical information. Opinions diverge on the spatiotemporal distribution of and interaction between the two types of information. Feedforward theory argues that they are processed sequentially, whereas interactive theory advocates that lexical information is processed fast and modulates early word form processing. To distinguish between the two theories, we applied stereoelectroencephalography (SEEG) to 33 human adults with epilepsy (25 males and eight females) during visual lexical decisions. The stimuli included real words (RWs), pseudowords (PWs) with legal radical positions, nonwords (NWs) with illegal radical positions, and stroked-changed words (SWs) in Chinese. Word form and lexical processing were measured by the word form effect (PW versus NW) and lexical effect (RW versus PW), respectively. Gamma-band (60 ∼ 140 Hz) SEEG activity was treated as an electrophysiological measure. A word form effect was found in eight left brain regions (i.e., the inferior parietal lobe, insula, fusiform, inferior temporal, middle temporal, middle occipital, precentral and postcentral gyri) from 50 ms poststimulus onset, whereas a lexical effect was observed in five left brain regions (i.e., the calcarine, middle temporal, superior temporal, precentral, and postcentral gyri) from 100 ms poststimulus onset. The two effects overlapped in the precentral (300 ∼ 500 ms) and postcentral (100 ∼ 200 ms and 250 ∼ 600 ms) gyri. Moreover, high-level regions provide early feedback to word form regions. These results demonstrate that lexical processing occurs early and modulates word form recognition, providing vital supportive evidence for interactive theory.SIGNIFICANCE STATEMENT A pivotal unresolved dispute in the field of word processing is whether word form recognition is obligatorily modulated by high-level lexical top-down information. To address this issue, we applied intracranial SEEG to 33 adults with epilepsy to precisely delineate the spatiotemporal dynamics between processing word form and lexical information during visual word recognition. We observed that lexical processing occurred from 100 ms poststimulus presentation and even spatiotemporally overlapped with word form processing. Moreover, the high-order regions provided feedback to the word form regions in the early stage of word recognition. These results revealed the crucial role of high-level lexical information in word form recognition, deepening our understanding of the functional coupling among brain regions in word processing networks.

Brain decoding in multiple languages: Can cross-language brain decoding work?

The approach of cross-language brain decoding is to use models of brain decoding from one language to decode stimuli of another language. It has the potential to provide new insights into how our brain represents multiple languages. While it is possible to decode semantic information across different languages from neuroimaging data, the approach's overall success remains to be tested and depends on a number of factors such as cross-language similarity, age of acquisition/proficiency levels, and depth of language processing. We expect to see continued progress in this domain, from a traditional focus on words and concrete concepts toward the use of naturalistic experimental tasks involving higher-level language processing (e.g., discourse processing). The approach can also be applied to understand how cross-modal, cross-cultural, and other nonlinguistic factors may influence neural representations of different languages. This article provides an overview of cross-language brain decoding with suggestions for future research directions.

Word learning in two languages: Neural overlap and representational differences

We investigated the neural basis of newly learned words in Spanish as a mother tongue (L1) and English as a second language (L2). Participants acquired new names for real but unfamiliar concepts in both languages over the course of two days. On day 3, they completed a semantic categorization task during fMRI scanning. The results revealed largely overlapping brain regions for newly learned words in Spanish and English. However, Spanish showed a heightened BOLD response within prefrontal cortex (PFC), due to increased competition of existing lexical representations. In contrast, English displayed higher activity than Spanish within primary auditory cortex, which suggests increased phonological processing due to more irregular phonological-orthographic mappings. Overall, these results suggest that novel words are learned similarly in Spanish L1 and English L2, and that they are represented in largely overlapping brain regions. However, they differ in terms of cognitive control and phonological processes.

Functional reorganization of the reading network in the course of foreign language acquisition

During foreign language acquisition neural representations of native language and foreign language assimilate. In the reading network, this assimilation leads to a shift from effortful processing to automated reading. Longitudinal studies can track this transition and reveal dynamics that might not become apparent in behavior. Here, we report results from a longitudinal functional magnetic resonance imaging (fMRI) study, which tracked functional changes in the reading network of beginning learners of Greek over one year. We deliberately chose Greek as foreign language that would have similar orthographic transparency but a different alphabet than the native language (Polish). fMRI scans with lexical and semantic decision tasks were performed at five different time points (every ~3 months). Classical language areas (the left inferior frontal gyrus, the left precentral gyrus, and the bilateral supplementary motor cortex), and cognitive control areas (left inferior parietal lobe and bilateral anterior cingulate cortex) showed stronger activation after the first months of instruction as compared to the activation before instruction. This pattern occured in both tasks. Task-related activity in the reading network remained constant throughout the remaining 6 months of learning and was also present in a follow-up scan 3 months after the end of the course. A similar pattern was demonstrated by the analysis of convergence between foreign and native languages occurring within the first months of learning. Additionally, in the lexical task, the extent of spatial overlap, between foreign and native language in Broca's area increased constantly from the beginning till the end of training. Our findings support the notion that reorganization of language networks is achieved after a relatively short time of foreign language instruction. We also demonstrate that cognitive control areas are recruited in foreign language reading at low proficiency levels. No apparent changes in the foreign or native reading network occur after the initial 3 months of learning. This suggests that task demand might be more important than proficiency in regulating the resources needed for efficient foreign language reading.

Neural representational similarity between L1 and L2 in spoken and written language processing

Despite substantial research on the brain mechanisms of L1 and L2 processing in bilinguals, it is still unknown whether language modality (i.e., visual vs. auditory) plays a role in determining whether L1 and L2 are processed similarly. Therefore, we examined the neural representational similarity in neural networks between L1 and L2 in spoken and written word processing in Korean-English-Chinese trilinguals. Participants performed both visual and auditory rhyming judgments in the three languages: Korean, English, and Chinese. The results showed greater similarity among the three languages in the auditory modality than in the visual modality, suggesting more differentiated networks for written word processing in the three languages than spoken word processing. In addition, there was less similarity between spoken and written word processing in L1 than the L2s, suggesting a more specialized network for each modality in L1 than L2s. Finally, the similarity between the two L2s (i.e., Chinese and English) was greater than that between each L2 and L1 after task performance was regressed out, especially in the visual modality, suggesting that L2s are processed similarly. These findings provide important insights about spoken and written language processing in the bilingual brain.

Sign and Speech Share Partially Overlapping Conceptual Representations

Conceptual knowledge is fundamental to human cognition. Yet, the extent to which it is influenced by language is unclear. Studies of semantic processing show that similar neural patterns are evoked by the same concepts presented in different modalities (e.g., spoken words and pictures or text) [1, 2, 3]. This suggests that conceptual representations are “modality independent.” However, an alternative possibility is that the similarity reflects retrieval of common spoken language representations. Indeed, in hearing spoken language users, text and spoken language are co-dependent [4, 5], and pictures are encoded via visual and verbal routes [6]. A parallel approach investigating semantic cognition shows that bilinguals activate similar patterns for the same words in their different languages [7, 8]. This suggests that conceptual representations are “language independent.” However, this has only been tested in spoken language bilinguals. If different languages evoke different conceptual representations, this should be most apparent comparing languages that differ greatly in structure. Hearing people with signing deaf parents are bilingual in sign and speech: languages conveyed in different modalities. Here, we test the influence of modality and bilingualism on conceptual representation by comparing semantic representations elicited by spoken British English and British Sign Language in hearing early, sign-speech bilinguals. We show that representations of semantic categories are shared for sign and speech, but not for individual spoken words and signs. This provides evidence for partially shared representations for sign and speech and shows that language acts as a subtle filter through which we understand and interact with the world.

•

RSA analyses show that semantic categories are shared for sign and speech

•

Neural patterns for individual spoken words and signs differ

•

Spoken word and sign form representations are found in auditory and visual cortices

•

Language acts as a subtle filter through which we interact with the world

Are you really cursing? Neural processing of taboo words in native and foreign language

The use of socially opprobrious words (taboo words) is a cross-cultural phenomenon occurring between individuals from almost all social extractions. The neurocognitive correlates of using taboo words in the native language (L1) as compared to their use in a second (L2) language are largely unknown. We used fMRI to investigate the processing of taboo and non-taboo stimuli in monolinguals (Experiment 1) and highly proficient bilinguals (Experiment 2) engaged in lexical decision tasks. We report that for L1 socio-pragmatic knowledge is automatically conveyed and taboo words are processed with less effort than non-taboo words. For L2 the processing of taboo words is more effortful and engages additional structures (anterior cingulate cortex, insula) involved in social-norm representation and evaluation. Our results contribute to understand the interface between language and social-norm processing indicating that lexical processing is affected by socio-pragmatic knowledge, but only when the speaker has a contextual use of the language.