Where do you know what you know? The representation of semantic knowledge in the human brain

Semantic processing in older adults is associated with distributed neural activation which varies by association and abstractness of words

The extent to which the neural systems underlying semantic processes degrade with advanced age remains unresolved, which motivated the current study of neural activation on functional magnetic resonance imaging (fMRI) during semantic judgments of associated vs. unassociated, semantic vs. rhyme, and abstract vs. rhyme word pairs. Thirty-eight older adults, 55-85 years of age, performed semantic association decision tasks in a mixed event-related block fMRI paradigm involving binary judgments as to whether word pairs were related (i.e., semantically associated). As hypothesized, significantly greater activation was evident during processing of associated (vs. unassociated) word pairs in cortical areas implicated in semantic processing, including the angular gyrus, temporal cortex, and inferior frontal cortex. Cortical areas showed greater activation to unassociated (vs. associated) word pairs, primarily within a large occipital cluster. Greater activation was evident in cortical areas when response to semantic vs. phonemic word pairs. Contrasting activation during abstract vs. concrete semantic processing revealed areas of co-activation to both semantic classes, and areas that had greater response to either abstract or concrete word pairs. Neural activation across conditions did not vary as a function of greater age, indicating only minimal age-associated perturbation in neural activation during semantic processing. Therefore, the response of the semantic hubs, semantic control, and secondary association areas appear to be largely preserved with advanced age among older adults exhibiting successful cognitive aging. These findings may provide a useful clinical contrast if compared to activation among adults experiencing cognitive decline due Alzheimer's, frontal-temporal dementia, and other neurodegenerative diseases.

Differential reorganization of episodic and semantic memory systems in epilepsy-related mesiotemporal pathology

Declarative memory encompasses episodic and semantic divisions. Episodic memory captures singular events with specific spatiotemporal relationships, whereas semantic memory houses context-independent knowledge. Behavioural and functional neuroimaging studies have revealed common and distinct neural substrates of both memory systems, implicating mesiotemporal lobe (MTL) regions such as the hippocampus and distributed neocortices. Here, we explored declarative memory system reorganization in patients with unilateral temporal lobe epilepsy (TLE) as a human disease model to test the impact of variable degrees of MTL pathology on memory function. Our cohort included 31 patients with TLE and 60 age- and sex-matched healthy controls, and all participants underwent episodic and semantic retrieval tasks during a multimodal MRI session. The functional MRI tasks were closely matched in terms of stimuli and trial design. Capitalizing on non-linear connectome gradient-mapping techniques, we derived task-based functional topographies during episodic and semantic memory states, in both the MTL and neocortical networks. Comparing neocortical and hippocampal functional gradients between TLE patients and healthy controls, we observed a marked topographic reorganization of both neocortical and MTL systems during episodic memory states. Neocortical alterations were characterized by reduced functional differentiation in TLE across lateral temporal and midline parietal cortices in both hemispheres. In the MTL, in contrast, patients presented with a more marked functional differentiation of posterior and anterior hippocampal segments ipsilateral to the seizure focus and pathological core, indicating perturbed intrahippocampal connectivity. Semantic memory reorganization was also found in bilateral lateral temporal and ipsilateral angular regions, whereas hippocampal functional topographies were unaffected. Furthermore, leveraging MRI proxies of MTL pathology, we observed alterations in hippocampal microstructure and morphology that were associated with TLE-related functional reorganization during episodic memory. Moreover, correlation analysis and statistical mediation models revealed that these functional alterations contributed to behavioural deficits in episodic memory, but again not in semantic memory in patients. Altogether, our findings suggest that semantic processes rely on distributed neocortical networks, whereas episodic processes are supported by a network involving both the hippocampus and the neocortex. Alterations of such networks can provide a compact signature of state-dependent reorganization in conditions associated with MTL damage, such as TLE.

Functional and Effective Connectivity Underlying Semantic Verbal Fluency

Semantic verbal fluency (SVF) impairment is present in several neurological disorders. Although activation in SVF-related areas has been reported, how these regions are connected and their functional roles in the network remain divergent. We assessed SVF static and dynamic functional connectivity (FC) and effective connectivity in healthy participants using functional magnetic resonance imaging. We observed activation in the inferior frontal (IFG), middle temporal (pMTG) and angular gyri (AG), anterior cingulate (AC), insular cortex, and regions of the superior, middle, and medial frontal gyri (SFG, MFG, MidFG). Our static FC analysis showed a highly interconnected task and resting state network. Increased connectivity of AC with the pMTG and AG was observed for the task. The dynamic FC analysis provided circuits with connections similarly modulated across time and regions related to category identification, language comprehension, word selection and recovery, word generation, inhibition of speaking, speech planning, and articulatory planning of orofacial movements. Finally, the effective connectivity analysis provided a network that best explained our data, starting at the AG and going to the pMTG, from which there was a division between the ventral and dorsal streams. The SFG and MFG regions were connected and modulated by the MidFG, while the inferior regions formed the ventral stream. Therefore, we successfully assessed the SVF network, exploring regions associated with the entire processing, from category identification to word generation. The methodological approach can be helpful for further investigation of the SVF network in neurological disorders.

Is semantic dementia an outdated entity?

Does it still make clinical sense to talk about semantic dementia? For more than 10 years, some researchers and clinicians have highlighted the need for new diagnostic criteria, arguing for this entity either to be redefined or, more recently, to be divided into two partially distinct entities, each with its own supposed characteristics, namely the semantic variant primary progressive aphasia and the semantic behavioral variant frontotemporal dementia. Why such a shift? Is it no longer appropriate to talk about semantic dementia? Is it really useful to divide the concept of semantic dementia into verbal and socioemotional semantic subcomponents? Does this proposal have any clinical merit or does it solely reflect theoretical considerations? To shed light on these questions, the purpose of the present review was to explore theoretical considerations on the nature of the knowledge that is disturbed in this disease which might justify such terminological changes.

Association of glymphatic system dysfunction with cognitive impairment in temporal lobe epilepsy

Objectives

To explore the relationship between glymphatic dysfunction and cognitive impairment in unilateral temporal lobe epilepsy (TLE).

Methods

This study retrospectively included 38 patients with unilateral TLE and 26 age- and gender-matched healthy controls (HCs). The diffusion tensor image analysis along the perivascular space (DTI-ALPS) index, choroid plexus volume (CPV), and cognitive assessment were obtained for each participant. Neuropsychological test batteries included Montreal Cognitive Assessment (MoCA), Minimum Mental State Examination, Arithmetic Test (AT), Digit Symbol Substitution Test (DSST), Digit Span Test (DST), Boston Naming Test, Block design, Phonological Fluency Test (PFT), and Semantic Verbal Fluency (SVF).

Results

Compared to HCs, TLE patients had lower scores of MoCA, AT, DSST, DST, Block design, PFT and SVF (all p < 0.05) and lower values of mean DTI-ALPS index (1.491 ± 0.142 vs. 1.642 ± 0.123, p < 0.001). Significantly lower DTI-ALPS index values were observed in the ipsilateral hemisphere than in the contralateral hemisphere (1.466 ± 0.129 vs. 1.517 ± 0.175, p = 0.013) for patients with unilateral TLE. Correlation analyses found that SVF performance was significantly or borderline significantly associated with glymphatic function (FDR-corrected p < 0.05 for all DTI-ALPS index and FDR-corrected p = 0.057 for CPV) in TLE patients. Linear regression analyses showed that increased CPV and decreased DTI-ALPS index were independent risk factors for semantic fluency impairment (all p < 0.05). Furthermore, mediation analyses found the mediator role of the mean DTI-ALPS index in the relationship between choroid plexus enlargement and semantic fluency impairment (indirect effect: β = -0.182, 95%CI = -0.486 to -0.037).

Conclusion

These findings reveal the important role of the DTI-ALPS index and CPV in SVF performance in unilateral TLE. Decreased DTI-ALPS index and increased CPV are the independent risk factors for semantic fluency impairment. The DTI-ALPS index may fully mediate the relationship between CP enlargement and SVF performance. These insights provide a radiological foundation for further investigations into the mechanism of the glymphatic system in TLE pathophysiology.

Mapping the basal temporal language network: a SEEG functional connectivity study

The Basal Temporal Language Area (BTLA) is recognized in epilepsy surgery setting when cortical electrical stimulation (CES) of the ventral temporal cortex (VTC) trigger anomia or paraphasia during naming tasks. Despite acknowledging a ventral language stream, current cognitive language models fail to properly integrate this entity. In this SEEG study we used cortico-cortical evoked potentials in nine epileptic patients to assess and compare the effective connectivity of 73 sites in the left VTC of which 26 were deemed eloquent for naming after CES (BTLA). Eloquent sites connectivity supports the existence of a basal temporal language network (BTLN) structured around posterior projectors while the fusiform gyrus behaved as an integrator. BTLN was strongly connected to the amygdala and hippocampus unlike the non-eloquent sites, except for the anterior fusiform gyrus (FG). These observations support the FG as a multimodal functional hub and add to our understanding of ventral temporal language processing.

Examining modal and amodal language processing in proficient bilinguals: evidence from the modality-switch paradigm

Recent discussions have emphasized the significance of embodied processing in language comprehension. Nevertheless, continuous debates persist regarding the relative contribution of modal (embodied) and amodal (abstract) processing of language. The current study investigated the contribution of modal processing in the first (L1) and second (L2) language, hypothesizing higher level of abstract amodal symbol processing in L2 than L1, since the correspondence of L1 and L2 (i.e., the symbol-to-symbol assignment) is in the foreground when learning L2. We employed the modality-switch paradigm (Pecher et al., 2003) in both German and French versions with proficient sequential German and French bilinguals (N = 79). Participants were presented with noun-adjective pairs (e.g., keys - jingling) in both languages and decided whether the adjective could be applied to the noun. This task repeatedly requires switching modality between trials, (e.g., from auditory [keys - jingling] to olfactory [soap - perfumed]), typically causing switch costs on response latency as compared to maintaining the modality. Contrary to the hypothesis, we observed modality switch effects (MSE) in both L1 and L2. This result suggests that embodied language processing occurs not only in the first language but also extends to the second language thus challenging the assumption that L2 processing predominantly involves abstract amodal symbol processing. Notably, however, significant L1 and L2 MSEs were found for French, whereas for German already the L1 effect was rather weak (though significant); the corresponding L2 effect was not significant. Thus, the results hinted at differences between languages regarding the relative role of modal and amodal processing.

Noun imageability and the processing of sensory-based information

The aim of this study was to test whether the availability of internal imagery elicited by words is related to ratings of word imageability. Participants are presented with target words and, after a delay allowing for processing of the word, answer questions regarding the size or weight of the word referents. Target words differ with respect to imageability. Results show faster responses to questions for high imageability words than for low imageability words. The type of question (size/weight) modulates reaction times suggesting a dominance of the visual domain over the physical-experience domain in concept representation. Results hold across two different languages (Czech/German). These findings provide further insights into the representations underlying word meaning and the role of word imageability in language acquisition and processing.

Reorganization of structural connectivity in the brain supports preservation of cognitive ability in healthy aging

The global population is aging rapidly, and a research question of critical importance is why some older adults suffer tremendous cognitive decline while others are mostly spared. Past aging research has shown that older adults with spared cognitive ability have better local short-range information processing while global long-range processing is less efficient. We took this research a step further to investigate whether the underlying structural connections, measured in vivo using diffusion magnetic resonance imaging (dMRI), show a similar shift to support cognitive ability. We analyzed the structural connectivity streamline probability (representing the probability of connection between regions) and nodal efficiency and local efficiency regional graph theory metrics to determine whether age and cognitive ability are related to structural network differences. We found that the relationship between structural connectivity and cognitive ability with age was nuanced, with some differences with age that were associated with poorer cognitive outcomes, but other reorganizations that were associated with spared cognitive ability. These positive changes included strengthened local intrahemispheric connectivity and increased nodal efficiency of the ventral occipital-temporal stream, nucleus accumbens, and hippocampus for older adults, and widespread local efficiency primarily for middle-aged individuals.

Does epilepsy differentially affect different types of memory?

Despite the recognition that epilepsy can substantially disrupt memory, there are few published accounts of whether and how this disruption varies across different types of memory and/or different types of epilepsy. This review explores four main questions: (1) Are working, episodic and semantic memory differentially affected by epilepsy? (2) Do various types of epilepsy, and their treatment, have different, specifiable effects on memory? (3) Are the usual forms of neuropsychological assessments of memory - many or most designed for other conditions - appropriate for patients with epilepsy? (4) How can research on epilepsy contribute to our understanding of the neuroscience of memory? We conclude that widespread and multifactorial problems are seen in working memory in all patient groups, while patients with temporal lobe epilepsy seem particularly prone to episodic memory deficit, and those with frontal lobe epilepsy to executive function deficits that may in turn impair semantic control. Currently, it is difficult to make individual patient predictions about likely memory deficits based on seizure aetiology and type, but it is possible to guide and tailor neuropsychological assessments in an individualised way. We make recommendations for future directions in validating and optimising neuropsychological assessments, and consider how to approach effective shared decision making about the pros and cons of seizure treatment strategies, especially at crucial educational stages such as adolescence.

Differential Mnemonic Contributions of Cortical Representations during Encoding and Retrieval

Several recent fMRI studies of episodic and working memory representations converge on the finding that visual information is most strongly represented in occipito-temporal cortex during the encoding phase but in parietal regions during the retrieval phase. It has been suggested that this location shift reflects a change in the content of representations, from predominantly visual during encoding to primarily semantic during retrieval. Yet, direct evidence on the nature of encoding and retrieval representations is lacking. It is also unclear how the representations mediating the encoding-retrieval shift contribute to memory performance. To investigate these two issues, in the current fMRI study, participants encoded pictures (e.g., picture of a cardinal) and later performed a word recognition test (e.g., word "cardinal"). Representational similarity analyses examined how visual (e.g., red color) and semantic representations (e.g., what cardinals eat) support successful encoding and retrieval. These analyses revealed two novel findings. First, successful memory was associated with representational changes in cortical location (from occipito-temporal at encoding to parietal at retrieval) but not with changes in representational content (visual vs. semantic). Thus, the representational encoding-retrieval shift cannot be easily attributed to a change in the nature of representations. Second, in parietal regions, stronger representations predicted encoding failure but retrieval success. This encoding-retrieval "flip" in representations mimics the one previously reported in univariate activation studies. In summary, by answering important questions regarding the content and contributions to the performance of the representations mediating the encoding-retrieval shift, our findings clarify the neural mechanisms of this intriguing phenomenon.

Exploring the late maturation of an intrinsic episodic memory network: A resting-state fMRI study

Previous research suggests that episodic memory relies on functional neural networks,which are present even in the absence of an explicit task. The regions that integrate.these networks and the developmental changes in intrinsic functional connectivity.remain elusive. In the present study, we outlined an intrinsic episodic memory network.(iEMN) based on a systematic selection of functional connectivity studies, and.inspected network differences in resting-state fMRI between adolescents (13-17 years.old) and adults (23-27 years old) from the publicly available NKI-Rockland Sample.Through a review of brain regions commonly associated with episodic memory.networks, we identified a potential iEMN composed by 14 bilateral ROIs, distributed.across temporal, frontal and parietal lobes. Within this network, we found an increase.in resting-state connectivity from adolescents to adults between the right temporal pole.and two regions in the right lateral prefrontal cortex. We argue that the coordination of.these brain regions, connecting areas of semantic processing and areas of controlled.retrieval, arises as an important feature towards the full maturation of the episodic.memory system. The findings add to evidence suggesting that adolescence is a key.period in memory development and highlights the role of intrinsic functional.connectivity in such development.

Cortico-hippocampal interactions underlie schema-supported memory encoding in older adults

Although episodic memory is typically impaired in older adults (OAs) compared to young adults (YAs), this deficit is attenuated when OAs can leverage their rich semantic knowledge, such as their knowledge of schemas. Memory is better for items consistent with pre-existing schemas and this effect is larger in OAs. Neuroimaging studies have associated schema use with the ventromedial prefrontal cortex (vmPFC) and hippocampus (HPC), but most of this research has been limited to YAs. This fMRI study investigated the neural mechanisms underlying how schemas boost episodic memory in OAs. Participants encoded scene-object pairs with varying congruency, and memory for the objects was tested the following day. Congruency with schemas enhanced object memory for YAs and, more substantially, for OAs. FMRI analyses examined how cortical modulation of HPC predicted subsequent memory. Congruency-related vmPFC modulation of left HPC enhanced subsequent memory in both age groups, while congruency-related modulation from angular gyrus (AG) boosted subsequent memory only in OAs. Individual differences in cortico-hippocampal modulations indicated that OAs preferentially used their semantic knowledge to facilitate encoding via an AG-HPC interaction, suggesting a compensatory mechanism. Collectively, our findings illustrate age-related differences in how schemas influence episodic memory encoding via distinct routes of cortico-hippocampal interactions.

From long-term to short-term: Distinct neural networks underlying semantic knowledge and its recruitment in working memory

Although numerous studies suggest that working memory (WM) and semantic long-term knowledge interact, the nature and underlying neural mechanisms of this intervention remain poorly understood. Using functional magnetic resonance imaging (fMRI), this study investigated the extent to which neural markers of semantic knowledge in long-term memory (LTM) are activated during the WM maintenance stage in 32 young adults. First, the multivariate neural patterns associated with four semantic categories were determined via an implicit semantic activation task. Next, the participants maintained words - the names of the four semantic categories implicitly activated in the first task - in a verbal WM task. Multi-voxel pattern analyses showed reliable neural decoding of the four semantic categories in the implicit semantic activation and the verbal WM tasks. Critically, however, no between-task classification of semantic categories was observed. Searchlight analyses showed that for the WM task, semantic category information could be decoded in anterior temporal areas associated with abstract semantic category knowledge. In the implicit semantic activation task, semantic category information was decoded in superior temporal, occipital and frontal cortices associated with domain-specific semantic feature representations. These results indicate that item-level semantic activation during verbal WM involves shallow rather than deep semantic information.

Tailoring Semantic Interventions for Older Adults: Task-Focused and Person-Centered Approaches

In this narrative review, we explore the latest evidence on semantic interventions for older adults, including both prevention and rehabilitation/remediation efforts, discussing them particularly in the context of dementia. Cognitive interventions vary in their level of structure, encompassing standardized (task-focused tasks) and unstandardized tasks (person-centered tasks). These interventions also differ in their target: rehabilitation or prevention. Addressing semantic knowledge/semantic memory/semantics is important, primarily because its efficiency impacts other cognitive domains. Semantic tasks are commonly included in preventive and rehabilitation programs, typically as standardized tasks with pre-defined semantic referents. On the other hand, person-centered approaches introduce personally relevant semantics, allowing patients to share thoughts and experiences with expressive language. Although these approaches offer benefits beyond cognitive improvement, their lack of structure may pose challenges. Our question club (CQ) program blends structured activities with personally relevant semantics, aiming to harness the advantages of both methods. Additionally, in this narrative review, we discuss future challenges and directions in the field of semantic interventions.

What we mean when we say semantic: Toward a multidisciplinary semantic glossary

Tulving characterized semantic memory as a vast repository of meaning that underlies language and many other cognitive processes. This perspective on lexical and conceptual knowledge galvanized a new era of research undertaken by numerous fields, each with their own idiosyncratic methods and terminology. For example, "concept" has different meanings in philosophy, linguistics, and psychology. As such, many fundamental constructs used to delineate semantic theories remain underspecified and/or opaque. Weak construct specificity is among the leading causes of the replication crisis now facing psychology and related fields. Term ambiguity hinders cross-disciplinary communication, falsifiability, and incremental theory-building. Numerous cognitive subdisciplines (e.g., vision, affective neuroscience) have recently addressed these limitations via the development of consensus-based guidelines and definitions. The project to follow represents our effort to produce a multidisciplinary semantic glossary consisting of succinct definitions, background, principled dissenting views, ratings of agreement, and subjective confidence for 17 target constructs (e.g., abstractness, abstraction, concreteness, concept, embodied cognition, event semantics, lexical-semantic, modality, representation, semantic control, semantic feature, simulation, semantic distance, semantic dimension). We discuss potential benefits and pitfalls (e.g., implicit bias, prescriptiveness) of these efforts to specify a common nomenclature that other researchers might index in specifying their own theoretical perspectives (e.g., They said X, but I mean Y).

COVID-19 is associated with changes in brain function and structure: A multimodal meta-analysis of neuroimaging studies

The actual role of coronavirus disease 2019 (COVID-19) in brain damage has been increasingly reported, necessitating a meta-analysis to collate and summarize the inconsistent findings from functional imaging and voxel-based morphometry (VBM) studies. A comprehensive voxel-wise meta-analysis of the whole brain was conducted to identify alterations in functional activity and gray matter volume (GMV) between COVID-19 patients and healthy controls (HCs) by using Seed-based d Mapping software. We included 15 functional imaging studies (484 patients with COVID-19, 534 HCs) and 9 VBM studies (449 patients with COVID-19, 388 HCs) in the analysis. Overall, patients with COVID-19 exhibited decreased functional activity in the right superior temporal gyrus (STG) (extending to the right middle and inferior temporal gyrus, insula, and temporal pole [TP]), left insula, right orbitofrontal cortex (OFC) (extending to the right olfactory cortex), and left cerebellum compared to HCs. For VBM, patients with COVID-19, relative to HCs, showed decreased GMV in the bilateral anterior cingulate cortex/medial prefrontal cortex (extending to the bilateral OFC), and left cerebellum, and increased GMV in the bilateral amygdala (extending to the bilateral hippocampus, STG, TP, MTG, and right striatum). Moreover, overlapping analysis revealed that patients with COVID-19 exhibited both decreased functional activity and increased GMV in the right TP (extending to the right STG). The multimodal meta-analysis suggests that brain changes of function and structure in the temporal lobe, OFC and cerebellum, and functional or structural alterations in the insula and the limbic system in COVID-19. These findings contribute to a better understanding of the pathophysiology of brain alterations in COVID-19. SIGNIFICANCE STATEMENT: This first large-scale multimodal meta-analysis collates existing neuroimaging studies and provides voxel-wise functional and structural whole-brain abnormalities in COVID-19. Findings of this meta-analysis provide valuable insights into the dynamic brain changes (from infection to recovery) and offer further explanations for the pathophysiological basis of brain alterations in COVID-19.

The good, the bad, and the ambivalent: Extrapolating affective values for 38,000+ Chinese words via a computational model

Word affective ratings are important tools in psycholinguistic research, natural language processing, and many other fields. However, even for well-studied languages, such norms are usually limited in scale. To extrapolate affective (i.e., valence and arousal) values for words in the SUBTLEX-CH database (Cai & Brysbaert, 2010, PLoS ONE, 5(6):e10729), we implemented a computational neural network which captured how words' vector-based semantic representations corresponded to the probability densities of their valence and arousal. Based on these probability density functions, we predicted not only a word's affective values, but also their respective degrees of variability that could characterize individual differences in human affective ratings. The resulting estimates of affective values largely converged with human ratings for both valence and arousal, and the estimated degrees of variability also captured important features of the variability in human ratings. We released the extrapolated affective values, together with their corresponding degrees of variability, for over 38,000 Chinese words in the Open Science Framework ( https://osf.io/s9zmd/ ). We also discussed how the view of embodied cognition could be illuminated by this computational model.

Clinical and structural disconnectome evaluation in a case of optic aphasia

Optic Aphasia (OA) and Associative Visual Agnosia (AVA) are neuropsychological disorders characterized by impaired naming on visual presentation. From a cognitive point of view, while stimulus identification is largely unimpaired in OA (where access to semantic knowledge is still possible), in AVA it is not. OA has been linked with right hemianopia and disconnection of the occipital right-hemisphere (RH) visual processing from the left hemisphere (LH) language areas.In this paper, we describe the case of AA, an 81-year-old housewife suffering from a deficit in naming visually presented stimuli after left occipital lesion and damage to the interhemispheric splenial pathway. AA has been tested through a set of tasks assessing different levels of visual object processing. We discuss behavioral performance as well as the pattern of lesion and disconnection in relation to a neurocognitive model adapted from Luzzatti and colleagues (1998). Despite the complexity of the neuropsychological picture, behavioral data suggest that semantic access from visual input is possible, while a lesion-based structural disconnectome investigation demonstrated the splenial involvement.Altogether, neuropsychological and neuroanatomical findings support the assumption of visuo-verbal callosal disconnection compatible with a diagnosis of OA.

Reconstructing Spatiotemporal Trajectories of Visual Object Memories in the Human Brain

How the human brain reconstructs, step-by-step, the core elements of past experiences is still unclear. Here, we map the spatiotemporal trajectories along which visual object memories are reconstructed during associative recall. Specifically, we inquire whether retrieval reinstates feature representations in a copy-like but reversed direction with respect to the initial perceptual experience, or alternatively, this reconstruction involves format transformations and regions beyond initial perception. Participants from two cohorts studied new associations between verbs and randomly paired object images, and subsequently recalled the objects when presented with the corresponding verb cue. We first analyze multivariate fMRI patterns to map where in the brain high- and low-level object features can be decoded during perception and retrieval, showing that retrieval is dominated by conceptual features, represented in comparatively late visual and parietal areas. A separately acquired EEG dataset is then used to track the temporal evolution of the reactivated patterns using similarity-based EEG-fMRI fusion. This fusion suggests that memory reconstruction proceeds from anterior frontotemporal to posterior occipital and parietal regions, in line with a conceptual-to-perceptual gradient but only partly following the same trajectories as during perception. Specifically, a linear regression statistically confirms that the sequential activation of ventral visual stream regions is reversed between image perception and retrieval. The fusion analysis also suggests an information relay to frontoparietal areas late during retrieval. Together, the results shed light onto the temporal dynamics of memory recall and the transformations that the information undergoes between the initial experience and its later reconstruction from memory.

Why concepts are (probably) vectors

For decades, cognitive scientists have debated what kind of representation might characterize human concepts. Whatever the format of the representation, it must allow for the computation of varied properties, including similarities, features, categories, definitions, and relations. It must also support the development of theories, ad hoc categories, and knowledge of procedures. Here, we discuss why vector-based representations provide a compelling account that can meet all these needs while being plausibly encoded into neural architectures. This view has become especially promising with recent advances in both large language models and vector symbolic architectures. These innovations show how vectors can handle many properties traditionally thought to be out of reach for neural models, including compositionality, definitions, structures, and symbolic computational processes.

Temporo-frontoparietal hypoconnectivity as a biomarker for isolated language impairment in mild cognitive impairment: A cross-cohort comparison

INTRODUCTION

Whether brain functional connectivity (FC) is consistently disrupted in individuals with mild cognitive impairment (MCI) with isolated language impairment (ilMCI), and its potential to differentiate between MCI subtypes remains uncertain.

METHODS

Cross-sectional data from 404 participants in two cohorts (the Chinese Preclinical Alzheimer's Disease Study and the Alzheimer's Disease Neuroimaging Initiative) were analyzed, including neuropsychological tests, resting-state functional magnetic resonance imaging (fMRI), cerebral amyloid positivity, and apolipoprotein E (APOE) status.

RESULTS

Temporo-frontoparietal FC, particularly between the bilateral superior temporal pole and the left inferior frontal/supramarginal gyri, was consistently decreased in ilMCI compared to amnestic MCI (aMCI) and normal controls, which was correlated with semantic impairment. Using mean temporo-frontoparietal FC as a classifier could improve accuracy in identifying ilMCI subgroups with positive cerebral amyloid deposition and APOE risk alleles.

DISCUSSION

Temporal-frontoparietal hypoconnectivity was observed in individuals with ilMCI, which may reflect semantic impairment and serve as a valuable biomarker to indicate potential mechanisms of underlying neuropathology.

HIGHLIGHTS

Temporo-frontoparietal hypoconnectivity was observed in impaired language mild cognitive impairment (ilMCI). Temporo-frontoparietal hypoconnectivity may reflect semantic impairment. Temporo-frontoparietal functional connectivity can classify ilMCI subtypes.

Impaired processing of conspecifics in Parkinson's disease

Experimental evidence indicates that the inferior frontal gyrus (IFG) processes emotional/affective features crucial to elaborate knowledge about social groups and that knowledge of social concepts is stored in the anterior temporal lobe (ATL).We investigated whether knowledge about social groups is impaired in Parkinson's disease (PD), in which dysfunctional connectivity between IFG and ATL has been demonstrated.PD patients (N = 20) and healthy controls (HC, N = 16) were given a lexical decision task in a semantic priming paradigm: the prime-targets included 144 words and 144 pseudowords, each preceded by three types of prime ("animals," "things," "persons"). Out of these 288 prime-targets, forty-eight were congruent (same category) and 96 incongruent (different category). Out of 48 congruent prime-targets, 24 denoted social items and 24 nonsocial items. Thus, four types of trials were obtained: congruent social; congruent nonsocial; incongruent social; incongruent nonsocial.Congruent target-words were recognized better than incongruent target-words by all groups. The semantic priming effect was preserved in PD; however, accuracy was significantly lower in PD than in HC in social items. No difference emerged between the two groups in nonsocial items.Impaired processing of words denoting social groups in PD may be due to impairment in accessing the affective/emotional features that characterize conceptual knowledge of social groups, for the functional disconnection between the IFG and the ATL.

Emotional concepts shape the perceptual representation of body expressions

Emotion perception interacts with how we think and speak, including our concept of emotions. Body expression is an important way of emotion communication, but it is unknown whether and how its perception is modulated by conceptual knowledge. In this study, we employed representational similarity analysis and conducted three experiments combining semantic similarity, mouse-tracking task, and one-back behavioral task with electroencephalography and functional magnetic resonance imaging techniques, the results of which show that conceptual knowledge predicted the perceptual representation of body expressions. Further, this prediction effect occurred at approximately 170 ms post-stimulus. The neural encoding of body expressions in the fusiform gyrus and lingual gyrus was impacted by emotion concept knowledge. Taken together, our results indicate that conceptual knowledge of emotion categories shapes the configural representation of body expressions in the ventral visual cortex, which offers compelling evidence for the constructed emotion theory.

The impact of bilateral versus unilateral anterior temporal lobe damage on face recognition, person knowledge and semantic memory

The functional importance of the anterior temporal lobes (ATLs) has come to prominence in two active, albeit unconnected literatures-(i) face recognition and (ii) semantic memory. To generate a unified account of the ATLs, we tested the predictions from each literature and examined the effects of bilateral versus unilateral ATL damage on face recognition, person knowledge, and semantic memory. Sixteen people with bilateral ATL atrophy from semantic dementia (SD), 17 people with unilateral ATL resection for temporal lobe epilepsy (TLE; left = 10, right = 7), and 14 controls completed tasks assessing perceptual face matching, person knowledge and general semantic memory. People with SD were impaired across all semantic tasks, including person knowledge. Despite commensurate total ATL damage, unilateral resection generated mild impairments, with minimal differences between left- and right-ATL resection. Face matching performance was largely preserved but slightly reduced in SD and right TLE. All groups displayed the familiarity effect in face matching; however, it was reduced in SD and right TLE and was aligned with the level of item-specific semantic knowledge in all participants. We propose a neurocognitive framework whereby the ATLs underpin a resilient bilateral representation system that supports semantic memory, person knowledge and face recognition.

Helpless infants are learning a foundation model

Humans have a protracted postnatal helplessness period, typically attributed to human-specific maternal constraints causing an early birth when the brain is highly immature. By aligning neurodevelopmental events across species, however, it has been found that humans are not born with especially immature brains compared with animal species with a shorter helpless period. Consistent with this, the rapidly growing field of infant neuroimaging has found that brain connectivity and functional activation at birth share many similarities with the mature brain. Inspired by machine learning, where deep neural networks also benefit from a 'helpless period' of pre-training, we propose that human infants are learning a foundation model: a set of fundamental representations that underpin later cognition with high performance and rapid generalisation.

The role of frontal cortex in novel-word learning and consolidation: Evidence from focal transcranial direct current stimulation

Previous studies have demonstrated that conventional transcranial direct current stimulation (tDCS) can enhance novel-word learning. However, because of the widespread current that is induced by these setups and lack of appropriate control conditions, little is known about the underlying neural mechanisms. In the present double-blinded and sham-tDCS controlled study, we investigated for the first time if regionally precise focal tDCS targeting two key nodes of the novel-word learning network at different time points would result in regionally and temporally distinct effects. 156 participants completed a contextual novel-word-learning paradigm and learning success was probed immediately after the acquisition period and 30-min later. Participants were randomly assigned to six stimulation conditions: Active tDCS (1.5 mA) was administered to left inferior frontal (IFG) or middle temporal gyrus (MTG), either during acquisition or delayed recall. Control groups received sham-tDCS either during acquisition or delayed recall (50% IFG/MTG). Data were analyzed with a generalized linear mixed model with a binomial link function in a Bayesian framework. Our results showed that frontal tDCS selectively increased accuracy gains from immediate to delayed recall, irrespective of timing of the stimulation. There was no evidence for beneficial effects of middle temporal gyrus tDCS. Our findings confirm that IFG tDCS can enhance novel-word learning in a regionally, but not timing specific way. Tentatively, this may be explained by enhancement of semantic selection processes resulting in more effective consolidation and/or retrieval. Future studies using longer time intervals between assessments are required to clarify the potential contribution of neurophysiological after-effects of IFG tDCS administered during acquisition to enhanced consolidation.

High-Pitched Sound is Open and Low-Pitched Sound is Closed: Representing the Spatial Meaning of Pitch Height

Research shows that high- and low-pitch sounds can be associated with various meanings. For example, high-pitch sounds are associated with small concepts, whereas low-pitch sounds are associated with large concepts. This study presents three experiments revealing that high-pitch sounds are also associated with open concepts and opening hand actions, while low-pitch sounds are associated with closed concepts and closing hand actions. In Experiment 1, this sound-meaning correspondence effect was shown using the two-alternative forced-choice task, while Experiments 2 and 3 used reaction time tasks to show this interaction. In Experiment 2, high-pitch vocalizations were found to facilitate opening hand gestures, and low-pitch vocalizations were found to facilitate closing hand gestures, when performed simultaneously. In Experiment 3, high-pitched vocalizations were produced particularly rapidly when the visual target stimulus presented an open object, and low-pitched vocalizations were produced particularly rapidly when the target presented a closed object. These findings are discussed concerning the meaning of intonational cues. They are suggested to be based on cross-modally representing conceptual spatial knowledge in sensory, motor, and affective systems. Additionally, this pitch-opening effect might share cognitive processes with other pitch-meaning effects.

Overlapping neural correlates underpin theory of mind and semantic cognition: Evidence from a meta-analysis of 344 functional neuroimaging studies

Key unanswered questions for cognitive neuroscience include whether social cognition is underpinned by specialised brain regions and to what extent it simultaneously depends on more domain-general systems. Until we glean a better understanding of the full set of contributions made by various systems, theories of social cognition will remain fundamentally limited. In the present study, we evaluate a recent proposal that semantic cognition plays a crucial role in supporting social cognition. While previous brain-based investigations have focused on dissociating these two systems, our primary aim was to assess the degree to which the neural correlates are overlapping, particularly within two key regions, the anterior temporal lobe (ATL) and the temporoparietal junction (TPJ). We focus on activation associated with theory of mind (ToM) and adopt a meta-analytic activation likelihood approach to synthesise a large set of functional neuroimaging studies and compare their results with studies of semantic cognition. As a key consideration, we sought to account for methodological differences across the two sets of studies, including the fact that ToM studies tend to use nonverbal stimuli while the semantics literature is dominated by language-based tasks. Overall, we observed consistent overlap between the two sets of brain regions, especially in the ATL and TPJ. This supports the claim that tasks involving ToM draw upon more general semantic retrieval processes. We also identified activation specific to ToM in the right TPJ, bilateral anterior mPFC, and right precuneus. This is consistent with the view that, nested amongst more domain-general systems, there is specialised circuitry that is tuned to social processes.

Normative Data for the Famous People Fluency Test in the Adult French-Quebec Population and Validation Study in Mild Cognitive Impairment and Alzheimer's Disease

OBJECTIVE

The production of words in verbal fluency tests relies heavily on executive functions and linguistic abilities. New tests such as the famous people fluency test can also be useful in clinical practice and research. This test, in which participants are asked to name so many famous people, has the potential to distinguish healthy individuals from participants with neurological disorders such as mild cognitive impairment or Alzheimer's disease.

METHOD

The aim of this study was to determine the psychometric validity of the test (Study 1) and to provide normative data in the adult population of French Quebec for the famous people fluency test (Study 2).

RESULTS

The results of the normative study, derived from a sample of 378 healthy individuals between the ages of 50 and 92, showed that age and educational level significantly influence performance on the test. Therefore, percentile ranks were calculated for performance on the famous people fluency test, stratified for these two variables. The results of Study 2 showed that the test differentiated the performance of healthy participants from the performance of participants with mild cognitive impairment or Alzheimer's disease. The results also showed that the famous people fluency test has adequate convergent validity, established with a semantic fluency test, and that the results showed good stability over time (test-retest validity).

CONCLUSION

Norms and psychometric data for the famous people fluency test will improve the ability of clinicians and researchers to better recognize executive and language impairments associated with pathological conditions.

Spontaneous cortical activity is altered in persons with HIV and related to domain-specific cognitive function

Whilst the average lifespan of persons with HIV now approximates that of the general population, these individuals are at a much higher risk of developing cognitive impairment with ∼35-70% experiencing at least subtle cognitive deficits. Previous works suggest that HIV impacts both low-level primary sensory regions and higher-level association cortices. Notably, multiple neuroHIV studies have reported elevated levels of spontaneous cortical activity during the pre-stimulus baseline period of task-based experiments, but only a few have examined such activity during resting-state conditions. In the current study, we examined such spontaneous cortical activity using magnetoencephalography in 79 persons with HIV and 83 demographically matched seronegative controls and related this neural activity to performance on neuropsychological assessments of cognitive function. Consistent with previous works, persons with HIV exhibited stronger spontaneous gamma activity, particularly in inferior parietal, prefrontal and superior temporal cortices. In addition, serostatus moderated the relationship between spontaneous beta activity and attention, motor and processing speed scores, with controls but not persons with HIV showing stronger beta activity with better performance. The current results suggest that HIV predominantly impacts spontaneous activity in association cortices, consistent with alterations in higher-order brain function, and may be attributable to deficient GABAergic signalling, given its known role in the generation of gamma and beta oscillations. Overall, these effects align with previous studies showing aberrant spontaneous activity in persons with HIV and provide a critical new linkage to domain-specific cognitive dysfunction.

Creative connections: the neural correlates of semantic relatedness are associated with creativity

The associative theory of creativity proposes that creative ideas result from connecting remotely related concepts in memory. Previous research found that higher creative individuals exhibit a more flexible organization of semantic memory, generate more uncommon word associations, and judge remote concepts as more related. In this study (N = 93), we used fMRI to investigate brain regions involved in judging the relatedness of concepts that vary in their semantic distance, and how such neural involvement relates to individual differences in creativity. Brain regions where activity increased with semantic relatedness mainly overlapped with default, control, salience, semantic control, and multiple demand networks. The default and semantic control networks exhibited increased involvement when evaluating more remote associations. Finally, higher creative people, who provided higher relatedness judgements on average, exhibited lower activity in those regions, possibly reflecting higher neural efficiency. We discuss these findings in the context of the neurocognitive processing underlying creativity. Overall, our findings indicate that judging remote concepts as related reflects a cognitive mechanism underlying creativity and shed light on the neural correlates of this mechanism.

Long-term motor training enhances functional connectivity between semantic and motor regions in an effector-specific manner: evidence from elite female football athletes

The relation between the action verb semantic processing and sensorimotor experience remains controversial. In this study, we examined whether plasticity changes in brain are specifically related to semantic processing of foot action verbs when long-term motor training is mainly aimed at the foot. To address this question, we acquired resting-state functional magnetic resonance imaging scans and behavioral data from a verb two-choice task from female expertise football players and football novices. We compared the resting-state functional connectivity (rsFC) differences between experts and novices using motor execution regions and general semantic regions (left anterior temporal lobe, lATL) as seed, and explored the neural correlates of behavioral performance. Here, the drift rate (v) parameter of the drift diffusion model (DDM) was used to capture the semantic processing capability. We found experts showed increased correlation between lATL subregions and important brain regions for motor processing, including supplementary motor area (SMA), bilateral paracentral lobule (PL), superior parietal lobule and inferior parietal lobule, in contrast to novices. Further predictive model analysis showed the FC found in rsFC analysis can significantly predict drift rate of foot action verb in both experts and novices, but not drift rate of hand action verb. Our findings therefore establish a connection between effector-related semantic processing and the plasticity changes in brain functional connectivity, attributable to long-term foot-related motor training. This provides evidence supporting the view that semantic processing is fundamentally rooted in the sensorimotor system.

Differences in perceptual representations in multilinguals' first, second, and third language

Two experiments were conducted to investigate the differences in perceptual representations among multilingual individuals. In Experiment 1, the immediate sentence-picture verification paradigm was used to investigate perceptual representations in the working memory stage. The results suggest a match effect within the first language (Cantonese), but not within the second language (Mandarin) or the third language (English), showing perceptual representations only in first language comprehension. In Experiment 2, the delayed sentence-picture verification paradigm was used to investigate perceptual representations in long-term memory. Similarly, the results suggest a match effect within the first language (Mandarin), but not within the second language (English). The findings of both experiments suggest that the first language was perceptually represented, regardless of whether it was Cantonese or Mandarin, regardless of the processing in working memory or long-term memory. No evidence was found for perceptual representations in the later-learned languages, regardless of high or low proficiency. Our study has implications for theories of language comprehension and embodied cognition.

Registered report: Age-preserved semantic memory and the CRUNCH effect manifested as differential semantic control networks: An fMRI study

Semantic memory representations are generally well maintained in aging, whereas semantic control is thought to be more affected. To explain this phenomenon, this study tested the predictions of the Compensation-Related Utilization of Neural Circuits Hypothesis (CRUNCH), focusing on task demands in aging as a possible framework. The CRUNCH effect would manifest itself in semantic tasks through a compensatory increase in neural activation in semantic control network regions but only up to a certain threshold of task demands. This study compares 39 younger (20-35 years old) with 39 older participants (60-75 years old) in a triad-based semantic judgment task performed in an fMRI scanner while manipulating task demand levels (low versus high) through semantic distance. In line with the CRUNCH predictions, differences in neurofunctional activation and behavioral performance (accuracy and response times) were expected in younger versus older participants in the low- versus high-demand conditions, which should be manifested in semantic control Regions of Interest (ROIs). Our older participants had intact behavioral performance, as proposed in the literature for semantic memory tasks (maintained accuracy and slower response times (RTs)). Age-invariant behavioral performance in the older group compared to the younger one is necessary to test the CRUNCH predictions. The older adults were also characterized by high cognitive reserve, as our neuropsychological tests showed. Our behavioral results confirmed that our task successfully manipulated task demands: error rates, RTs and perceived difficulty increased with increasing task demands in both age groups. We did not find an interaction between age group and task demand, or a statistically significant difference in activation between the low- and high-demand conditions for either RTs or accuracy. As for brain activation, we did not find the expected age group by task demand interaction, or a significant main effect of task demand. Overall, our results are compatible with some neural activation in the semantic network and the semantic control network, largely in frontotemporoparietal regions. ROI analyses demonstrated significant effects (but no interactions) of task demand in the left and right inferior frontal gyrus, the left posterior middle temporal gyrus, the posterior inferior temporal gyrus and the prefrontal gyrus. Overall, our test did not confirm the CRUNCH predictions.

Comparative Analysis of Human-Chimpanzee Divergence in Brain Connectivity and its Genetic Correlates

Chimpanzees (Pan troglodytes) are humans' closest living relatives, making them the most directly relevant comparison point for understanding human brain evolution. Zeroing in on the differences in brain connectivity between humans and chimpanzees can provide key insights into the specific evolutionary changes that might have occured along the human lineage. However, conducting comparisons of brain connectivity between humans and chimpanzees remains challenging, as cross-species brain atlases established within the same framework are currently lacking. Without the availability of cross-species brain atlases, the region-wise connectivity patterns between humans and chimpanzees cannot be directly compared. To address this gap, we built the first Chimpanzee Brainnetome Atlas (ChimpBNA) by following a well-established connectivity-based parcellation framework. Leveraging this new resource, we found substantial divergence in connectivity patterns across most association cortices, notably in the lateral temporal and dorsolateral prefrontal cortex between the two species. Intriguingly, these patterns significantly deviate from the patterns of cortical expansion observed in humans compared to chimpanzees. Additionally, we identified regions displaying connectional asymmetries that differed between species, likely resulting from evolutionary divergence. Genes associated with these divergent connectivities were found to be enriched in cell types crucial for cortical projection circuits and synapse formation. These genes exhibited more pronounced differences in expression patterns in regions with higher connectivity divergence, suggesting a potential foundation for brain connectivity evolution. Therefore, our study not only provides a fine-scale brain atlas of chimpanzees but also highlights the connectivity divergence between humans and chimpanzees in a more rigorous and comparative manner and suggests potential genetic correlates for the observed divergence in brain connectivity patterns between the two species. This can help us better understand the origins and development of uniquely human cognitive capabilities.

The pattern of cortical thickness associated with executive dysfunction in MCI and SCC: The MEMENTO cohort

BACKGROUND

The association between the pattern of cortical thickness (CT) and executive dysfunction (ED) in mild cognitive impairment (MCI) and subjective cognitive complaints (SCC) is still poorly understood. We aimed to investigate the association between CT and ED in a large French cohort (MEMENTO) of 2323 participants with MCI or SCC.

METHODS

All participants with available CT and executive function data (verbal fluency and Trail Making Test [TMT]) were selected (n=1924). Linear regressions were performed to determine relationships between executive performance and the brain parenchymal fraction (BPF) and CT using FreeSurfer.

RESULTS

The global executive function score was related to the BPF (sß: 0.091, P<0.001) and CT in the right supramarginal (sß: 0.060, P=0.041) and right isthmus cingulate (sß: 0.062, P=0.011) regions. Literal verbal fluency was related to the BPF (sß: 0.125, P<0.001) and CT in the left parsorbitalis region (sß: 0.045, P=0.045). Semantic verbal fluency was related to the BPF (sß: 0.101, P<0.001) and CT in the right supramarginal region (sß: 0.061, P=0.042). The time difference between the TMT parts B and A was related to the BPF (sß: 0.048, P=0.045) and CT in the right precuneus (sß: 0.073, P=0.019) and right isthmus cingulate region (sß: 0.054, P=0.032).

CONCLUSIONS

In a large clinically based cohort of participants presenting with either MCI or SCC (a potential early stage of Alzheimer's disease [AD]), ED was related to the BPF and CT in the left pars orbitalis, right precuneus, right supramarginal, and right isthmus cingulate regions. This pattern of lesions adds knowledge to the conventional anatomy of ED and could contribute to the early diagnosis of AD.

Reciprocal interactions among parietal and occipito-temporal representations support everyday object-directed actions

Everyday interactions with common manipulable objects require the integration of conceptual knowledge about objects and actions with real-time sensory information about the position, orientation and volumetric structure of the grasp target. The ability to successfully interact with everyday objects involves analysis of visual form and shape, surface texture, material properties, conceptual attributes such as identity, function and typical context, and visuomotor processing supporting hand transport, grasp form, and object manipulation. Functionally separable brain regions across the dorsal and ventral visual pathways support the processing of these different object properties and, in cohort, are necessary for functional object use. Object-directed grasps display end-state-comfort: they anticipate in form and force the shape and material properties of the grasp target, and how the object will be manipulated after it is grasped. End-state-comfort is the default for everyday interactions with manipulable objects and implies integration of information across the ventral and dorsal visual pathways. We propose a model of how visuomotor and action representations in parietal cortex interact with object representations in ventral and lateral occipito-temporal cortex. One pathway, from the supramarginal gyrus to the middle and inferior temporal gyrus, supports the integration of action-related information, including hand and limb position (supramarginal gyrus) with conceptual attributes and an appreciation of the action goal (middle temporal gyrus). A second pathway, from posterior IPS to the fusiform gyrus and collateral sulcus supports the integration of grasp parameters (IPS) with the surface texture and material properties (e.g., weight distribution) of the grasp target. Reciprocal interactions among these regions are part of a broader network of regions that support everyday functional object interactions.

Basal temporal language area revisited in Japanese language with a language function density map

We revisited the anatomo-functional characteristics of the basal temporal language area (BTLA), first described by Lüders et al. (1986), using electrical cortical stimulation (ECS) in the context of Japanese language and semantic networks. We recruited 11 patients with focal epilepsy who underwent chronic subdural electrode implantation and ECS mapping with multiple language tasks for presurgical evaluation. A semiquantitative language function density map delineated the anatomo-functional characteristics of the BTLA (66 electrodes, mean 3.8 cm from the temporal tip). The ECS-induced impairment probability was higher in the following tasks, listed in a descending order: spoken-word picture matching, picture naming, Kanji word reading, paragraph reading, spoken-verbal command, and Kana word reading. The anterior fusiform gyrus (FG), adjacent anterior inferior temporal gyrus (ITG), and the anterior end where FG and ITG fuse, were characterized by stimulation-induced impairment during visual and auditory tasks requiring verbal output or not, whereas the middle FG was characterized mainly by visual input. The parahippocampal gyrus was the least impaired of the three gyri in the basal temporal area. We propose that the BTLA has a functional gradient, with the anterior part involved in amodal semantic processing and the posterior part, especially the middle FG in unimodal semantic processing.

A neuroanatomical and cognitive model of impaired social behaviour in frontotemporal dementia

Impaired social cognition is a core deficit in frontotemporal dementia (FTD). It is most commonly associated with the behavioural-variant of FTD, with atrophy of the orbitofrontal and ventromedial prefrontal cortex. Social cognitive changes are also common in semantic dementia, with atrophy centred on the anterior temporal lobes. The impairment of social behaviour in FTD has typically been attributed to damage to the orbitofrontal cortex and/or temporal poles and/or the uncinate fasciculus that connects them. However, the relative contributions of each region are unresolved. In this review, we present a unified neurocognitive model of controlled social behaviour that not only explains the observed impairment of social behaviours in FTD, but also assimilates both consistent and potentially contradictory findings from other patient groups, comparative neurology and normative cognitive neuroscience. We propose that impaired social behaviour results from damage to two cognitively- and anatomically-distinct components. The first component is social-semantic knowledge, a part of the general semantic-conceptual system supported by the anterior temporal lobes bilaterally. The second component is social control, supported by the orbitofrontal cortex, medial frontal cortex and ventrolateral frontal cortex, which interacts with social-semantic knowledge to guide and shape social behaviour.

The Language Network Reliably "Tracks" Naturalistic Meaningful Nonverbal Stimuli

The language network, comprised of brain regions in the left frontal and temporal cortex, responds robustly and reliably during language comprehension but shows little or no response during many nonlinguistic cognitive tasks (e.g., Fedorenko & Blank, 2020). However, one domain whose relationship with language remains debated is semantics-our conceptual knowledge of the world. Given that the language network responds strongly to meaningful linguistic stimuli, could some of this response be driven by the presence of rich conceptual representations encoded in linguistic inputs? In this study, we used a naturalistic cognition paradigm to test whether the cognitive and neural resources that are responsible for language processing are also recruited for processing semantically rich nonverbal stimuli. To do so, we measured BOLD responses to a set of ∼5-minute-long video and audio clips that consisted of meaningful event sequences but did not contain any linguistic content. We then used the intersubject correlation (ISC) approach (Hasson et al., 2004) to examine the extent to which the language network "tracks" these stimuli, that is, exhibits stimulus-related variation. Across all the regions of the language network, meaningful nonverbal stimuli elicited reliable ISCs. These ISCs were higher than the ISCs elicited by semantically impoverished nonverbal stimuli (e.g., a music clip), but substantially lower than the ISCs elicited by linguistic stimuli. Our results complement earlier findings from controlled experiments (e.g., Ivanova et al., 2021) in providing further evidence that the language network shows some sensitivity to semantic content in nonverbal stimuli.

Dissociating language and thought in large language models

Large language models (LLMs) have come closest among all models to date to mastering human language, yet opinions about their linguistic and cognitive capabilities remain split. Here, we evaluate LLMs using a distinction between formal linguistic competence (knowledge of linguistic rules and patterns) and functional linguistic competence (understanding and using language in the world). We ground this distinction in human neuroscience, which has shown that formal and functional competence rely on different neural mechanisms. Although LLMs are surprisingly good at formal competence, their performance on functional competence tasks remains spotty and often requires specialized fine-tuning and/or coupling with external modules. We posit that models that use language in human-like ways would need to master both of these competence types, which, in turn, could require the emergence of separate mechanisms specialized for formal versus functional linguistic competence.

Lesion-symptom Mapping of Acceptability Judgments in Chronic Poststroke Aphasia Reveals the Neurobiological Underpinnings of Receptive Syntax

Disagreements persist regarding the neural basis of syntactic processing, which has been linked both to inferior frontal and posterior temporal regions of the brain. One focal point of the debate concerns the role of inferior frontal areas in receptive syntactic ability, which is mostly assessed using sentence comprehension involving complex syntactic structures, a task that is potentially confounded with working memory. Syntactic acceptability judgments may provide a better measure of receptive syntax by reducing the need to use high working memory load and complex sentences and by enabling assessment of various types of syntactic violations. We therefore tested the perception of grammatical violations by people with poststroke aphasia (n = 25), along with matched controls (n = 16), using English sentences involving errors in word order, agreement, or subcategorization. Lesion data were also collected. Control participants performed near ceiling in accuracy with higher discriminability of agreement and subcategorization violations than word order; aphasia participants were less able to discriminate violations, but, on average, paralleled control participants discriminability of types of violations. Lesion-symptom mapping showed a correlation between discriminability and posterior temporal regions, but not inferior frontal regions. We argue that these results diverge from models holding that frontal areas are amodal core regions in syntactic structure building and favor models that posit a core hierarchical system in posterior temporal regions.

How the intrinsic functional connectivity patterns of the semantic network support semantic processing

Semantic processing, a core of language comprehension, involves the activation of brain regions dispersed extensively across the frontal, temporal, and parietal cortices that compose the semantic network. To comprehend the functional structure of this semantic network and how it prepares for semantic processing, we investigated its intrinsic functional connectivity (FC) and the relation between this pattern and semantic processing ability in a large sample from the Human Connectome Project (HCP) dataset. We first defined a well-studied brain network for semantic processing, and then we characterized the within-network connectivity (WNC) and the between-network connectivity (BNC) within this network using a voxel-based global brain connectivity (GBC) method based on resting-state functional magnetic resonance imaging (fMRI). The results showed that 97.73% of the voxels in the semantic network displayed considerably greater WNC than BNC, demonstrating that the semantic network is a fairly encapsulated network. Moreover, multiple connector hubs in the semantic network were identified after applying the criterion of WNC > 1 SD above the mean WNC of the semantic network. More importantly, three of these connector hubs (i.e., the left anterior temporal lobe, angular gyrus, and orbital part of the inferior frontal gyrus) were reliably associated with semantic processing ability. Our findings suggest that the three identified regions use WNC as the central mechanism for supporting semantic processing and that task-independent spontaneous connectivity in the semantic network is essential for semantic processing.

Healthy ageing has divergent effects on verbal and non-verbal semantic cognition

Semantic cognition refers to the storage and appropriate use of knowledge acquired over the lifespan and underpins our everyday verbal and non-verbal behaviours. Successful semantic cognition requires representation of knowledge and control processes which ensure that currently relevant aspects of knowledge are retrieved and selected. Although these abilities have been widely studied in healthy young populations and semantically impaired patients, it is unclear how they change as a function of healthy ageing, especially for non-verbal semantic processing. Here, we addressed this issue by comparing the performance profiles of young and older people on a semantic knowledge task and a semantic control task, across verbal (word) and non-verbal (picture) versions. The results revealed distinct patterns of change during adulthood for semantic knowledge and semantic control. Older people performed better in both verbal and non-verbal knowledge tasks than young people. However, although the older group showed preserved controlled retrieval for verbal semantics, they demonstrated a specific impairment for non-verbal semantic control. These findings indicate that the effects of ageing on semantic cognition are more complex than previously assumed, and that input modality plays an important role in the shifting cognitive architecture of semantics in later life.

Using drawings and deep neural networks to characterize the building blocks of human visual similarity

Early in life and without special training, human beings discern resemblance between abstract visual stimuli, such as drawings, and the real-world objects they represent. We used this capacity for visual abstraction as a tool for evaluating deep neural networks (DNNs) as models of human visual perception. Contrasting five contemporary DNNs, we evaluated how well each explains human similarity judgments among line drawings of recognizable and novel objects. For object sketches, human judgments were dominated by semantic category information; DNN representations contributed little additional information. In contrast, such features explained significant unique variance perceived similarity of abstract drawings. In both cases, a vision transformer trained to blend representations of images and their natural language descriptions showed the greatest ability to explain human perceptual similarity-an observation consistent with contemporary views of semantic representation and processing in the human mind and brain. Together, the results suggest that the building blocks of visual similarity may arise within systems that learn to use visual information, not for specific classification, but in service of generating semantic representations of objects.

Multidimensional neural representations of social features during movie viewing

The social world is dynamic and contextually embedded. Yet, most studies utilize simple stimuli that do not capture the complexity of everyday social episodes. To address this, we implemented a movie viewing paradigm and investigated how everyday social episodes are processed in the brain. Participants watched one of two movies during an MRI scan. Neural patterns from brain regions involved in social perception, mentalization, action observation and sensory processing were extracted. Representational similarity analysis results revealed that several labeled social features (including social interaction, mentalization, the actions of others, characters talking about themselves, talking about others and talking about objects) were represented in the superior temporal gyrus (STG) and middle temporal gyrus (MTG). The mentalization feature was also represented throughout the theory of mind network, and characters talking about others engaged the temporoparietal junction (TPJ), suggesting that listeners may spontaneously infer the mental state of those being talked about. In contrast, we did not observe the action representations in the frontoparietal regions of the action observation network. The current findings indicate that STG and MTG serve as key regions for social processing, and that listening to characters talk about others elicits spontaneous mental state inference in TPJ during natural movie viewing.

Drawing from name in semantic dementia reveals graded object knowledge representations in anterior temporal lobe

Semantic dementia (SD) is characterized by progressive impairment in conceptual knowledge due to anterior temporal lobe (ATL) neurodegeneration. Extended neuropsychological assessments can quantitatively demonstrate the semantic impairment, but this graded loss of knowledge can also be readily observed in the qualitative observation of patients' recall of single concepts. Here, we present the results of a simple task of object drawing-from-name, by patients with SD (N = 19), who have isolated atrophy of the ATL bilaterally. Both cross-sectionally and longitudinally, patient drawings demonstrated a pattern of degradation in which rare and distinctive features (such as the hump on a camel) were lost earliest in disease course, and there was an increase in the intrusion of prototypical features (such as the typical small ears of most mammals on an elephant) with more advanced disease. Crucially, patient drawings showed a continuum of conceptual knowledge loss rather than a binary 'present' or 'absent' state. Overall, we demonstrate that qualitative evaluation of line drawings of animals and objects provides fascinating insights into the transmodal semantic deficit in SD. Our results are consistent with a distributed-plus-hub model of semantic memory. The graded nature of the deficit in semantic performance observed in our subset of longitudinally observed patients suggests that the temporal lobe binds feature-based semantic attributes in its central convergence zone.

Toward the Emergence of Intelligent Control: Episodic Generalization and Optimization

Human cognition is unique in its ability to perform a wide range of tasks and to learn new tasks quickly. Both abilities have long been associated with the acquisition of knowledge that can generalize across tasks and the flexible use of that knowledge to execute goal-directed behavior. We investigate how this emerges in a neural network by describing and testing the Episodic Generalization and Optimization (EGO) framework. The framework consists of an episodic memory module, which rapidly learns relationships between stimuli; a semantic pathway, which more slowly learns how stimuli map to responses; and a recurrent context module, which maintains a representation of task-relevant context information, integrates this over time, and uses it both to recall context-relevant memories (in episodic memory) and to bias processing in favor of context-relevant features and responses (in the semantic pathway). We use the framework to address empirical phenomena across reinforcement learning, event segmentation, and category learning, showing in simulations that the same set of underlying mechanisms accounts for human performance in all three domains. The results demonstrate how the components of the EGO framework can efficiently learn knowledge that can be flexibly generalized across tasks, furthering our understanding of how humans can quickly learn how to perform a wide range of tasks-a capability that is fundamental to human intelligence.

Default mode network shows distinct emotional and contextual responses yet common effects of retrieval demands across tasks

The default mode network (DMN) lies towards the heteromodal end of the principal gradient of intrinsic connectivity, maximally separated from the sensory-motor cortex. It supports memory-based cognition, including the capacity to retrieve conceptual and evaluative information from sensory inputs, and to generate meaningful states internally; however, the functional organisation of DMN that can support these distinct modes of retrieval remains unclear. We used fMRI to examine whether activation within subsystems of DMN differed as a function of retrieval demands, or the type of association to be retrieved, or both. In a picture association task, participants retrieved semantic associations that were either contextual or emotional in nature. Participants were asked to avoid generating episodic associations. In the generate phase, these associations were retrieved from a novel picture, while in the switch phase, participants retrieved a new association for the same image. Semantic context and emotion trials were associated with dissociable DMN subnetworks, indicating that a key dimension of DMN organisation relates to the type of association being accessed. The frontotemporal and medial temporal DMN showed a preference for emotional and semantic contextual associations, respectively. Relative to the generate phase, the switch phase recruited clusters closer to the heteromodal apex of the principal gradient-a cortical hierarchy separating unimodal and heteromodal regions. There were no differences in this effect between association types. Instead, memory switching was associated with a distinct subnetwork associated with controlled internal cognition. These findings delineate distinct patterns of DMN recruitment for different kinds of associations yet common responses across tasks that reflect retrieval demands.