The representation of object concepts in the brain

How Do Living Systems Create Meaning?

Meaning has traditionally been regarded as a problem for philosophers and psychologists. Advances in cognitive science since the early 1960s, however, broadened discussions of meaning, or more technically, the semantics of perceptions, representations, and/or actions, into biology and computer science. Here, we review the notion of “meaning” as it applies to living systems, and argue that the question of how living systems create meaning unifies the biological and cognitive sciences across both organizational and temporal scales.

Correlated Brain Indexes of Semantic Prediction and Prediction Error: Brain Localization and Category Specificity

With strong and valid predictions, grasping a message is easy, whereas more demanding processing is required in the absence of robust expectations. We here demonstrate that brain correlates of the interplay between prediction and perception mechanisms in the understanding of meaningful sentences. Sentence fragments that strongly predict subsequent words induced anticipatory brain activity preceding the expected words; this potential was absent if context did not strongly predict subsequent words. Subjective reports of certainty about upcoming words and objective corpus-based measures correlated with the size of the anticipatory signal, thus establishing its status as a semantic prediction potential (SPP). Crucially, there was an inverse correlation between the SPP and the N400 brain response. The main cortical generators of SPP and N400 were found in inferior prefrontal cortex and posterior temporal cortex, respectively. Interestingly, sentence meaning was reflected by both measures, with additional category-specific sources of SPPs and N400s falling into parieto-temporo-occipital (visual) and frontocentral (sensorimotor) areas for animal- and tool-related words, respectively. These results show that the well-known brain index of semantic comprehension, N400, has an antecedent with different brain localization but similar semantic discriminatory function. We discuss whether N400 dynamics may causally depend on mechanisms underlying SPP size and sources.

Distinct fronto-temporal substrates of distributional and taxonomic similarity among words: evidence from RSA of BOLD signals

A class of semantic theories defines concepts in terms of statistical distributions of lexical items, basing meaning on vectors of word co-occurrence frequencies. A different approach emphasizes abstract hierarchical taxonomic relationships among concepts. However, the functional relevance of these different accounts and how they capture information-encoding of lexical meaning in the brain still remains elusive. We investigated to what extent distributional and taxonomic models explained word-elicited neural responses using cross-validated representational similarity analysis (RSA) of functional magnetic resonance imaging (fMRI) and model comparisons. Our findings show that the brain encodes both types of semantic information, but in distinct cortical regions. Posterior middle temporal regions reflected lexical-semantic similarity based on hierarchical taxonomies, in coherence with the action-relatedness of specific semantic word categories. In contrast, distributional semantics best predicted the representational patterns in left inferior frontal gyrus (LIFG, BA 47). Both representations coexisted in the angular gyrus supporting semantic binding and integration. These results reveal that neuronal networks with distinct cortical distributions across higher-order association cortex encode different representational properties of word meanings. Taxonomy may shape long-term lexical-semantic representations in memory consistently with the sensorimotor details of semantic categories, whilst distributional knowledge in the LIFG (BA 47) may enable semantic combinatorics in the context of language use. Our approach helps to elucidate the nature of semantic representations essential for understanding human language.

The neurophysiological architecture of semantic dementia: spectral dynamic causal modelling of a neurodegenerative proteinopathy

The selective destruction of large-scale brain networks by pathogenic protein spread is a ubiquitous theme in neurodegenerative disease. Characterising the circuit architecture of these diseases could illuminate both their pathophysiology and the computational architecture of the cognitive processes they target. However, this is challenging using standard neuroimaging techniques. Here we addressed this issue using a novel technique-spectral dynamic causal modelling-that estimates the effective connectivity between brain regions from resting-state fMRI data. We studied patients with semantic dementia-the paradigmatic disorder of the brain system mediating world knowledge-relative to healthy older individuals. We assessed how the effective connectivity of the semantic appraisal network targeted by this disease was modulated by pathogenic protein deposition and by two key phenotypic factors, semantic impairment and behavioural disinhibition. The presence of pathogenic protein in SD weakened the normal inhibitory self-coupling of network hubs in both antero-mesial temporal lobes, with development of an abnormal excitatory fronto-temporal projection in the left cerebral hemisphere. Semantic impairment and social disinhibition were linked to a similar but more extensive profile of abnormally attenuated inhibitory self-coupling within temporal lobe regions and excitatory projections between temporal and inferior frontal regions. Our findings demonstrate that population-level dynamic causal modelling can disclose a core pathophysiological feature of proteinopathic network architecture-attenuation of inhibitory connectivity-and the key elements of distributed neuronal processing that underwrite semantic memory.

Challenges and Opportunities for Grounding Cognition

According to the grounded perspective, cognition emerges from the interaction of classic cognitive processes with the modalities, the body, and the environment. Rather than being an autonomous impenetrable module, cognition incorporates these other domains intrinsically into its operation. The Situated Action Cycle offers one way of understanding how the modalities, the body, and the environment become integrated to ground cognition. Seven challenges and opportunities are raised for this perspective: (1) How does cognition emerge from the Situated Action Cycle and in turn support it? (2) How can we move beyond simply equating embodiment with action, additionally establishing how embodiment arises in the autonomic, neuroendocrine, immune, cardiovascular, respiratory, digestive, and integumentary systems? (3) How can we better understand the mechanisms underlying multimodal simulation, its functions across the Situated Action Cycle, and its integration with other representational systems? (4) How can we develop and assess theoretical accounts of symbolic processing from the grounded perspective (perhaps using the construct of simulators)? (5) How can we move beyond the simplistic distinction between concrete and abstract concepts, instead addressing how concepts about the external and internal worlds pattern to support the Situated Action Cycle? (6) How do individual differences emerge from different populations of situational memories as the Situated Action Cycle manifests itself differently across individuals? (7) How can constructs from grounded cognition provide insight into the replication and generalization crises, perhaps from a quantum perspective on mechanisms (as exemplified by simulators).

Neural modelling of the semantic predictability gain under challenging listening conditions

When speech intelligibility is reduced, listeners exploit constraints posed by semantic context to facilitate comprehension. The left angular gyrus (AG) has been argued to drive this semantic predictability gain. Taking a network perspective, we ask how the connectivity within language-specific and domain-general networks flexibly adapts to the predictability and intelligibility of speech. During continuous functional magnetic resonance imaging (fMRI), participants repeated sentences, which varied in semantic predictability of the final word and in acoustic intelligibility. At the neural level, highly predictable sentences led to stronger activation of left-hemispheric semantic regions including subregions of the AG (PGa, PGp) and posterior middle temporal gyrus when speech became more intelligible. The behavioural predictability gain of single participants mapped onto the same regions but was complemented by increased activity in frontal and medial regions. Effective connectivity from PGa to PGp increased for more intelligible sentences. In contrast, inhibitory influence from pre-supplementary motor area to left insula was strongest when predictability and intelligibility of sentences were either lowest or highest. This interactive effect was negatively correlated with the behavioural predictability gain. Together, these results suggest that successful comprehension in noisy listening conditions relies on an interplay of semantic regions and concurrent inhibition of cognitive control regions when semantic cues are available.

The Social Neuroscience of Prejudice

The social neuroscience approach to prejudice investigates the psychology of intergroup bias by integrating models and methods of neuroscience with the social psychology of prejudice, stereotyping, and discrimination. Here, we review major contemporary lines of inquiry, including current accounts of group-based categorization; formation and updating of prejudice and stereotypes; effects of prejudice on perception, emotion, and decision making; and the self-regulation of prejudice. In each section, we discuss key social neuroscience findings, consider interpretational challenges and connections with the behavioral literature, and highlight how they advance psychological theories of prejudice. We conclude by discussing the next-generation questions that will continue to guide the social neuroscience approach toward addressing major societal issues of prejudice and discrimination.

Where the action could be: Speakers look at graspable objects and meaningful scene regions when describing potential actions

The world is visually complex, yet we can efficiently describe it by extracting the information that is most relevant to convey. How do the properties of real-world scenes help us decide where to look and what to say? Image salience has been the dominant explanation for what drives visual attention and production as we describe displays, but new evidence shows scene meaning predicts attention better than image salience. Here we investigated the relevance of one aspect of meaning, graspability (the grasping interactions objects in the scene afford), given that affordances have been implicated in both visual and linguistic processing. We quantified image salience, meaning, and graspability for real-world scenes. In 3 eyetracking experiments, native English speakers described possible actions that could be carried out in a scene. We hypothesized that graspability would preferentially guide attention due to its task-relevance. In 2 experiments using stimuli from a previous study, meaning explained visual attention better than graspability or salience did, and graspability explained attention better than salience. In a third experiment we quantified image salience, meaning, graspability, and reach-weighted graspability for scenes that depicted reachable spaces containing graspable objects. Graspability and meaning explained attention equally well in the third experiment, and both explained attention better than salience. We conclude that speakers use object graspability to allocate attention to plan descriptions when scenes depict graspable objects within reach, and otherwise rely more on general meaning. The results shed light on what aspects of meaning guide attention during scene viewing in language production tasks. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

The Hippocampus Maps Concept Space, Not Feature Space

The hippocampal formation encodes maps of space and a key question in neuroscience is whether its spatial coding principles also provide a universal metric for the organization of nonspatial, conceptual information. Previous work demonstrated directional coding during navigation through a continuous stimulus feature space as well as mapping of distances in a feature space that was relevant for concept learning. Here we provide the first unambiguous evidence for a hippocampal representation of the actual concept space, by showing that the hippocampal distance signal selectively reflects the mapping of specifically conceptually relevant rather than of all feature dimensions. During fMRI scanning of 32 human participants (21 females), we presented everyday objects, which had beforehand been associated with specific values on three continuous feature dimensions. Crucially, only two dimensions were relevant to prior concept learning. We find that hippocampal responses to the objects reflect their relative distances in a space defined along conceptually relevant dimensions compared with distances in a space defined along all feature dimensions. These findings suggest that the hippocampus supports knowledge acquisition by dynamically encoding information in a space spanned along dimensions that are relevant in relation to define concepts.SIGNIFICANCE STATEMENT How are neural representations of conceptual knowledge organized, such that humans are able to infer never experienced relations or categorize new exemplars? Map-like representations as supported by the hippocampal formation to encode physical space during navigation have been suggested as a suitable format. Here we provide the first evidence for a hippocampal representation of a conceptual space compared with a general feature-based space.

Transient Neural Activation of Abstract Relations on an Incidental Analogy Task

Although a large proportion of the lexicon consists of abstract concepts, little is known about how they are represented by the brain. Here, we investigated how the mind represents relations shared between sets of mental representations that are superficially unrelated, such as car-engine and dog-tongue, but that nonetheless share a more general, abstract relation, such as whole-part. Participants saw a pair of words on each trial and were asked to indicate whether they could think of a relation between them. Importantly, they were not explicitly asked whether different word pairs shared the same relation, as in analogical reasoning tasks. We observed representational similarity for abstract relations in regions in the "conceptual hub" network, even when controlling for semantic relatedness between word pairs. By contrast, we did not observe representational similarity in regions previously implicated in explicit analogical reasoning. A given relation was sometimes repeated across sequential word pairs, allowing us to test for behavioral and neural priming of abstract relations. Indeed, we observed faster RTs and greater representational similarity for primed than unprimed trials, suggesting that mental representations of abstract relations are transiently activated on this incidental analogy task. Finally, we found a significant correlation between behavioral and neural priming across participants. To our knowledge, this is the first study to investigate relational priming using functional neuroimaging and to show that neural representations are strengthened by relational priming. This research shows how abstract concepts can be brought to mind momentarily, even when not required for task performance.

White matter basis for the hub-and-spoke semantic representation: evidence from semantic dementia

The hub-and-spoke semantic representation theory posits that semantic knowledge is processed in a neural network, which contains an amodal hub, the sensorimotor modality-specific regions, and the connections between them. The exact neural basis of the hub, regions and connectivity remains unclear. Semantic dementia could be an ideal lesion model to construct the semantic network as this disease presents both amodal and modality-specific semantic processing (e.g. colour) deficits. The goal of the present study was to identify, using an unbiased data-driven approach, the semantic hub and its general and modality-specific semantic white matter connections by investigating the relationship between the lesion degree of the network and the severity of semantic deficits in 33 patients with semantic dementia. Data of diffusion-weighted imaging and behavioural performance in processing knowledge of general semantic and six sensorimotor modalities (i.e. object form, colour, motion, sound, manipulation and function) were collected from each subject. Specifically, to identify the semantic hub, we mapped the white matter nodal degree value (a graph theoretical index) of the 90 regions in the automated anatomical labelling atlas with the general semantic abilities of the patients. Of the regions, only the left fusiform gyrus was identified as the hub because its structural connectivity strength (i.e. nodal degree value) could significantly predict the general semantic processing of the patients. To identify the general and modality-specific semantic connections of the semantic hub, we separately correlated the white matter integrity values of each tract connected with the left fusiform gyrus, with the performance for general semantic processing and each of six semantic modality processing. The results showed that the hub region worked in concert with nine other regions in the semantic memory network for general semantic processing. Moreover, the connection between the hub and the left calcarine was associated with colour-specific semantic processing. The observed effects could not be accounted for by potential confounding variables (e.g. total grey matter volume, regional grey matter volume and performance on non-semantic control tasks). Our findings refine the neuroanatomical structure of the semantic network and underline the critical role of the left fusiform gyrus and its connectivity in the network.

Structural Disconnection of the Tool Use Network after Left Hemisphere Stroke Predicts Limb Apraxia Severity

Producing a tool use gesture is a complex process drawing upon the integration of stored knowledge of tools and their associated actions with sensory-motor mechanisms supporting the planning and control of hand and arm actions. Understanding how sensory-motor systems in parietal cortex interface with semantic representations of actions and objects in the temporal lobe remains a critical issue and is hypothesized to be a key determinant of the severity of limb apraxia, a deficit in producing skilled action after left hemisphere stroke. We used voxel-based and connectome-based lesion-symptom mapping with data from 57 left hemisphere stroke participants to assess the lesion sites and structural disconnection patterns associated with poor tool use gesturing. We found that structural disconnection among the left inferior parietal lobule, lateral and ventral temporal cortices, and middle and superior frontal gyri predicted the severity of tool use gesturing performance. Control analyses demonstrated that reductions in right-hand grip strength were associated with motor system disconnection, largely bypassing regions supporting tool use gesturing. Our findings provide evidence that limb apraxia may arise, in part, from a disconnection between conceptual representations in the temporal lobe and mechanisms enabling skilled action production in the inferior parietal lobule.

Hot coffee: associative memory with bump attractor cell assemblies of spiking neurons

Networks of spiking neurons can have persistently firing stable bump attractors to represent continuous spaces (like temperature). This can be done with a topology with local excitatory synapses and local surround inhibitory synapses. Activating large ranges in the attractor can lead to multiple bumps, that show repeller and attractor dynamics; however, these bumps can be merged by overcoming the repeller dynamics. A simple associative memory can include these bump attractors, allowing the use of continuous variables in these memories, and these associations can be learned by Hebbian rules. These simulations are related to biological networks, showing that this is a step toward a more complete neural cognitive associative memory.

Design and evaluation of the effectiveness of a corpus of congruent and incongruent English sentences for the study of event related potentials

OBJECTIVE

To design and evaluate the effectiveness of a stimulus material in eliciting the N400 event related potential (ERP).

DESIGN

A set of 700 semantically congruent and incongruent sentences was developed in accordance with current linguistic norms, and validated with an electroencephalography (EEG) study, in which the influence of age and gender on the N400 ERP magnitude was analysed.

STUDY SAMPLE

Forty-five normal-hearing subjects (19-57 years, 21 females) participated in the EEG study.

RESULTS

The stimulus material used in the EEG study elicited a robust N400 ERP, with a morphology consistent with the literature. Results also showed no statistically significant effect of age or gender on the N400 magnitude.

CONCLUSIONS

The material presented in this paper constitutes the largest complete stimulus set suitable for both auditory and text-based N400 experiments. This material may help facilitate the efficient implementation of future N400 ERP studies, as well as promote standardisation and consistency across studies.

Memory Engrams in the Neocortex

While in the past much of our knowledge about memory representations in the brain has relied on loss-of-function studies in which whole brain regions were temporarily inactivated or permanently lesioned, the recent development of new methods has ushered in a new era of downright "engram excitement." Animal research is now able to specifically label, track, and manipulate engram cells in the brain. While early studies have mostly focused on single brain regions like the hippocampus, recently more and more evidence for brain-wide distributed engram networks is emerging. Memory research in humans has also picked up pace, fueled by promising magnetic resonance imaging (MRI)-based methods like diffusion-weighted MRI (DW-MRI) and brain decoding. In this review, we will outline recent advancements in engram research, with a focus on human data and neocortical representations. We will illustrate the available noninvasive methods for the detection of engrams in different neocortical regions like the medial prefrontal cortex and the posterior parietal cortex and discuss evidence for systems consolidation and parallel memory encoding. Finally, we will explore how reactivation and prior knowledge can lead to and enhance engram formation in the neocortex.

Cortical network responses map onto data-driven features that capture visual semantics of movie fragments

Research on how the human brain extracts meaning from sensory input relies in principle on methodological reductionism. In the present study, we adopt a more holistic approach by modeling the cortical responses to semantic information that was extracted from the visual stream of a feature film, employing artificial neural network models. Advances in both computer vision and natural language processing were utilized to extract the semantic representations from the film by combining perceptual and linguistic information. We tested whether these representations were useful in studying the human brain data. To this end, we collected electrocorticography responses to a short movie from 37 subjects and fitted their cortical patterns across multiple regions using the semantic components extracted from film frames. We found that individual semantic components reflected fundamental semantic distinctions in the visual input, such as presence or absence of people, human movement, landscape scenes, human faces, etc. Moreover, each semantic component mapped onto a distinct functional cortical network involving high-level cognitive regions in occipitotemporal, frontal and parietal cortices. The present work demonstrates the potential of the data-driven methods from information processing fields to explain patterns of cortical responses, and contributes to the overall discussion about the encoding of high-level perceptual information in the human brain.

Positive effects of grasping virtual objects on memory for novel words in a second language

Theories of embodied cognition describe language processing and representation as inherently connected to the sensorimotor experiences collected during acquisition. While children grasp their world, collect bodily experiences and name them, in second language (L2), students learn bilingual word lists. Experimental evidence shows that embodiment by mean of gestures enhances memory for words in L2. However, no study has been conducted on the effects of grasping in L2. In a virtual scenario, we trained 46 participants on 18 two- and three-syllabic words of Vimmi, an artificial corpus created for experimental purposes. The words were assigned concrete meanings of graspable objects. Six words were learned audio-visually, by reading the words projected on the wall and by hearing them. Another 6 words were trained by observation of virtual objects. Another 6 words were learned by observation and additional grasping the virtual objects. Thereafter participants were subministered free, cued recall, and reaction time tests in order to assess the word retention and the word recognition. After 30 days, the recall tests were repeated remotely to assess the memory in the long term. The results show that grasping of virtual objects can lead to superior memory performance and to lower reaction times during recognition.

Developmental Differences of Structural Connectivity and Effective Connectivity in Semantic Judgments of Chinese Characters

Previous studies have investigated the developmental differences of semantic processing regarding brain activation between adults and children. However, little is known about whether the patterns of structural connectivity and effective connectivity differ between adults and children during semantic processing. Functional magnetic resonance imaging (fMRI), diffusion spectrum imaging (DSI), and dynamic causal modeling (DCM) were used to study the developmental differences of brain activation, structural connectivity, and effective connectivity during semantic judgments. Twenty-six children (8- to 12-year-olds) and 26 adults were asked to indicate if character pairs were related in meaning. Compared to children, adults showed greater activation in the left ventral inferior frontal gyrus (IFG) and left middle temporal gyrus (MTG). Also, adults had significantly greater structural connectivity in the left ventral pathway (inferior frontal occipital fasciculus, IFOF) than children. Moreover, adults showed significantly stronger bottom-up effects from left fusiform gyrus (FG) to ventral IFG than children in the related condition. In conclusion, our findings suggest that age-related increases in brain activation (ventral IFG and MTG), IFOF, and effective connectivity (from FG to ventral IFG) might be associated with the bottom-up influence of orthographic representations on retrieving semantic representations for processing Chinese characters.

Memorability of words in arbitrary verbal associations modulates memory retrieval in the anterior temporal lobe

Despite large individual differences in memory performance, people remember certain stimuli with overwhelming consistency. This phenomenon is referred to as the memorability of an individual item. However, it remains unknown whether memorability also affects our ability to retrieve associations between items. Here, using a paired-associates verbal memory task, we combine behavioural data, computational modelling and direct recordings from the human brain to examine how memorability influences associative memory retrieval. We find that certain words are correctly retrieved across participants irrespective of the cues used to initiate memory retrieval. These words, which share greater semantic similarity with other words, are more readily available during retrieval and lead to more intrusions when retrieval fails. Successful retrieval of these memorable items, relative to less memorable ones, results in faster reinstatement of neural activity in the anterior temporal lobe. Collectively, our data reveal how the brain prioritizes certain information to facilitate memory retrieval.

Multimodal semantic battery to monitor progressive loss of concepts in the semantic variant of primary progressive aphasia (svPPA): an innovative proposal

Semantic variant primary progressive aphasia (svPPA) is a rare neurodegenerative disease characterized by a progressive loss of semantic knowledge. Patients with svPPA show anomia, impaired word comprehension, poor object recognition, and difficulties in retrieving semantic information. svPPA is also a unique "natural" model that allows clinicians and cognitive neuroscientists to study the organization of semantic memory because only semantic knowledge is affected in the initial period of the disease, with relative sparing of other cognitive domains. In the clinical practice, semantic memory is commonly tested only with verbal tests. The aim of the present study was to preliminary test a new Multimodal Semantic Battery developed in our laboratory, which comprised 11 subtests designed to assess the semantic knowledge of multiple items via all input modalities. The battery was administered twice, over four years, to a patient diagnosed with svPPA. We found that when extensively tested with multiple tests, in some cases, he was still able to recall semantic features of the items that otherwise would not have emerged with standard semantic tests. These results are discussed for the clinical practice: monitoring semantic memory through all modalities in a practical and reliable way could be useful for both clinicians and experimental researchers to better investigate the breakdown of semantic knowledge.

Roles of Category, Shape, and Spatial Frequency in Shaping Animal and Tool Selectivity in the Occipitotemporal Cortex

Does the nature of representation in the category-selective regions in the occipitotemporal cortex reflect visual or conceptual properties? Previous research showed that natural variability in visual features across categories, quantified by image gist statistics, is highly correlated with the different neural responses observed in the occipitotemporal cortex. Using fMRI, we examined whether category selectivity for animals and tools would remain, when image gist statistics were comparable across categories. Critically, we investigated how category, shape, and spatial frequency may contribute to the category selectivity in the animal- and tool-selective regions. Female and male human observers viewed low- or high-passed images of round or elongated animals and tools that shared comparable gist statistics in the main experiment, and animal and tool images of naturally varied gist statistics in a separate localizer. Univariate analysis revealed robust category-selective responses for images with comparable gist statistics across categories. Successful classification for category (animals/tools), shape (round/elongated), and spatial frequency (low/high) was also observed, with highest classification accuracy for category. Representational similarity analyses further revealed that the activation patterns in the animal-selective regions were most correlated with a model that represents only animal information, whereas the activation patterns in the tool-selective regions were most correlated with a model that represents only tool information, suggesting that these regions selectively represent information of only animals or tools. Together, in addition to visual features, the distinction between animal and tool representations in the occipitotemporal cortex is likely shaped by higher-level conceptual influences such as categorization or interpretation of visual inputs.

SIGNIFICANCE STATEMENT Since different categories often vary systematically in both visual and conceptual features, it remains unclear what kinds of information determine category-selective responses in the occipitotemporal cortex. To minimize the influences of low- and mid-level visual features, here we used a diverse image set of animals and tools that shared comparable gist statistics. We manipulated category (animals/tools), shape (round/elongated), and spatial frequency (low/high), and found that the representational content of the animal- and tool-selective regions is primarily determined by their preferred categories only, regardless of shape or spatial frequency. Our results show that category-selective responses in the occipitotemporal cortex are influenced by higher-level processing such as categorization or interpretation of visual inputs, and highlight the specificity in these category-selective regions.

Brain Activation During Conceptual Processing of Action and Sound Verbs

Grounded cognition approaches to conceptual representations postulate a close link between conceptual knowledge and the sensorimotor brain systems. The present fMRI study tested, whether a feature-specific representation of concepts, as previously demonstrated for nouns, can also be found for action- and sound-related verbs. Participants were presented with action- and soundrelated verbs along with pseudoverbs while performing a lexical decision task. Sound-related verbs activated auditory areas in the temporal cortex, whereas action-related verbs activated brain regions in the superior frontal gyrus and the cerebellum, albeit only at a more liberal threshold. This differential brain activation during conceptual verb processing partially overlapped with or was adjacent to brain regions activated during the functional localizers probing sound perception or action execution. Activity in brain areas involved in the processing of action information was parametrically modulated by ratings of action relevance. Comparisons of action- and sound-related verbs with pseudoverbs revealed activation for both verb categories in auditory and motor areas. In contrast to proposals of strong grounded cognition approaches, our study did not demonstrate a considerable overlap of activations for action- and sound-related verbs and for the corresponding functional localizer tasks. However, in line with weaker variants of grounded cognition theories, the differential activation pattern for action- and sound-related verbs was near corresponding sensorimotor brain regions depending on conceptual feature relevance. Possibly, action-sound coupling resulted in a mutual activation of the motor and the auditory system for both action- and sound-related verbs, thereby reducing the effect sizes for the differential contrasts.

Neural correlates of object and action naming practice

Word retrieval deficits are a common problem in patients with stroke-induced brain damage. While complete recovery of language in chronic aphasia is rare, patients' naming ability can be significantly improved by speech therapy. A growing number of neuroimaging studies have tried to pinpoint the neural changes associated with successful outcome of naming treatment. However, the mechanisms supporting naming practice in the healthy brain have received little attention. Yet, understanding these mechanisms is crucial for teasing them apart from functional reorganization following brain damage. To address this issue, we trained a group of healthy monolingual Italian speakers on naming pictured objects and actions for ten consecutive days and scanned them before and after training. Although activity during object versus action naming dissociated in several regions (lateral occipitotemporal, parietal and left inferior frontal cortices), training effects for the two word classes were similar and included activation decreases in classical language regions of the left hemisphere (posterior inferior frontal gyrus, anterior insula), potentially due to decreased lexical selection demands. Additionally, MVPA revealed training-related activation changes in the left parietal and temporal cortices associated with the retrieval of knowledge from episodic memory (precuneus, angular gyrus) and facilitated access to phonological word forms (posterior superior temporal sulcus).

Feature Uncertainty Predicts Behavioral and Neural Responses to Combined Concepts

The cognitive and neural structure of conceptual knowledge affects how concepts combine in language and thought. Examining the principles by which individual concepts (e.g., diamond, baseball) combine into more complex phrases (e.g., "baseball diamond") can illuminate not only how the brain combines concepts but also the key ingredients of conceptual structure. Here we specifically tested the role of feature uncertainty in the modulation of conceptual brightness evoked by adjective-noun combinations (e.g., "dark diamond") in male and female human subjects. We collected explicit ratings of conceptual brightness for 45 noun concepts and their "dark" and "light" combinations, resulting in a measure reflecting the degree of conceptual brightness modulation in each noun concept. Feature uncertainty was captured in an entropy measure, as well as in a predictive Bayesian model of feature modulation. We found that feature uncertainty (i.e., entropy) and the Bayesian model were both strong predictors of these behavioral effects. Using fMRI, we observed the neural responses evoked by the concepts and combinations in a priori ROIs. Feature uncertainty predicted univariate responses in left inferior frontal gyrus, and multivariate responses in left anterior temporal lobe were predicted by degree of conceptual brightness modulation. These findings suggest that feature uncertainty is a key ingredient of conceptual structure, and inform cognitive neuroscience theories of conceptual combination by highlighting the role of left inferior frontal gyrus and left anterior temporal lobe in the process of flexible feature modulation during comprehension of complex language.SIGNIFICANCE STATEMENT The meaning of a word depends on the words surrounding it. The challenge of understanding how flexible meaning emerges in language can be simplified by studying adjective-noun phrases. We tested whether the uncertainty of a feature (i.e., brightness) in a given noun concept (e.g., diamond) influences how the adjective and noun concepts combine. We analyzed feature uncertainty using two probabilistic measures, and found that feature uncertainty predicted people's explicit interpretations of adjective-noun phrases (e.g., "dark diamond"). Using fMRI, we found that combined concepts evoked responses in left inferior frontal gyrus and left anterior temporal lobe that related to our measures of feature modulation and uncertainty. These findings reveal the cognitive and neural processes supporting conceptual combination and complex language use.

Multimodal feature binding in object memory retrieval using event-related potentials: Implications for models of semantic memory

To test the hypothesis that semantic processes are represented in multiple subsystems, we recorded electroencephalogram (EEG) as we elicited object memories using the modified Semantic Object Retrieval Test, during which an object feature, presented as a visual word [VW], an auditory word [AW], or a picture [Pic], was followed by a second feature always presented as a visual word. We performed both hypothesis-driven and data-driven analyses using event-related potentials (ERPs) time locked to the second stimulus. We replicated a previously reported left fronto-temporal ERP effect (750-1000 ms post-stimulus) in the VW task, and also found that this ERP component was only present during object memory retrieval in verbal (VW, AW) as opposed to non-verbal (Pic) stimulus types. We also found a right temporal ERP effect (850-1000 ms post-stimulus) that was present in auditory (AW) but not in visual (VW, Pic) stimulus types. In addition, we found an earlier left temporo-parietal ERP effect between 350 and 700 ms post-stimulus and a later midline parietal ERP effect between 700 and 1100 ms post-stimulus, present in all stimulus types, suggesting common neural mechanisms for object retrieval processes and object activation, respectively. These findings support multiple semantic subsystems that respond to varying stimulus modalities, and argue against an ultimate unitary amodal semantic analysis.

Representation of associative and affective semantic similarity of abstract words in the lateral temporal perisylvian language regions

The examination of semantic cognition has traditionally identified word concreteness as well as valence as two of the principal dimensions in the representation of conceptual knowledge. More recently, corpus-based vector space models as well as graph-theoretical analysis of large-scale task-related behavioural responses have revolutionized our insight into how the meaning of words is structured. In this fMRI study, we apply representational similarity analysis to investigate the conceptual representation of abstract words. Brain activity patterns were related to a cued-association based graph as well as to a vector-based co-occurrence model of word meaning. Twenty-six subjects (19 females and 7 males) performed an overt repetition task during fMRI. First, we performed a searchlight classification procedure to identify regions where activity is discriminable between abstract and concrete words. These regions were left inferior frontal gyrus, the upper and lower bank of the superior temporal sulcus bilaterally, posterior middle temporal gyrus and left fusiform gyrus. Representational Similarity Analysis demonstrated that for abstract words, the similarity of activity patterns in the cortex surrounding the superior temporal sulcus bilaterally and in the left anterior superior temporal gyrus reflects the similarity in word meaning. These effects were strongest for semantic similarity derived from the cued association-based graph and for affective similarity derived from either of the two models. The latter effect was mainly driven by positive valence words. This research highlights the close neurobiological link between the information structure of abstract and affective word content and the similarity in activity pattern in the lateral and anterior temporal language system.

Core features: measures and characterization for different languages

According to the feature-based view of semantic representation, concepts can be represented as distributed networks of semantic features, which contribute with different weights to determine the overall meaning of a concept. The study of semantic features, typically collected in property generation tasks, is enriched with measures indicating the informativeness and distinctiveness of a given feature for the related concepts. However, while these measures have been provided in several languages (e.g. Italian, Spanish and English), they have hardly been applied comparatively across languages. The purpose of this paper is to investigate language-related differences and similarities emerging from the semantic representation of aggregated core features. Features with higher salience for a set of concrete concepts are identified and described in terms of their feature type. Then, comparisons are made between domains (natural vs. artefacts) and languages (Italian, Spanish and English) and descriptive statistics are provided. These results show that the characterization of concrete concepts is overall fairly stable across languages, although interesting cross-linguistic differences emerged. We will discuss the implications of our findings in relation to the theoretical paradigm of semantic feature norms, as well as in relation to speakers' mutual understanding in multilingual settings.

Connecting concepts in the brain by mapping cortical representations of semantic relations

In the brain, the semantic system is thought to store concepts. However, little is known about how it connects different concepts and infers semantic relations. To address this question, we collected hours of functional magnetic resonance imaging data from human subjects listening to natural stories. We developed a predictive model of the voxel-wise response and further applied it to thousands of new words. Our results suggest that both semantic categories and relations are represented by spatially overlapping cortical patterns, instead of anatomically segregated regions. Semantic relations that reflect conceptual progression from concreteness to abstractness are represented by cortical patterns of activation in the default mode network and deactivation in the frontoparietal attention network. We conclude that the human brain uses distributed networks to encode not only concepts but also relationships between concepts. In particular, the default mode network plays a central role in semantic processing for abstraction of concepts.

Hemispheric Organization for Visual Object Recognition: A Theoretical Account and Empirical Evidence

Despite the similarity in structure, the hemispheres of the human brain have somewhat different functions. A traditional view of hemispheric organization asserts that there are independent and largely lateralized domain-specific regions in ventral occipitotemporal (VOTC), specialized for the recognition of distinct classes of objects. Here, we offer an alternative account of the organization of the hemispheres, with a specific focus on face and word recognition. This alternative account relies on three computational principles: distributed representations and knowledge, cooperation and competition between representations, and topography and proximity. The crux is that visual recognition results from a network of regions with graded functional specialization that is distributed across both hemispheres. Specifically, the claim is that face recognition, which is acquired relatively early in life, is processed by VOTC regions in both hemispheres. Once literacy is acquired, word recognition, which is co-lateralized with language areas, primarily engages the left VOTC and, consequently, face recognition is primarily, albeit not exclusively, mediated by the right VOTC. We review psychological and neural evidence from a range of studies conducted with normal and brain-damaged adults and children and consider findings which challenge this account. Last, we offer suggestions for future investigations whose findings may further refine this account.

Spatiotemporal dynamics of predictive brain mechanisms during speech processing: an MEG study

Rapid and efficient speech processing benefits from the prediction derived from prior expectations based on the identification of individual words. It is known that speech processing is carried out within a distributed frontotemporal network. However, the spatiotemporal causal dynamics of predictive brain mechanisms in sound-to-meaning mapping within this network remain unclear. Using magnetoencephalography, we adopted a semantic anomaly paradigm which consists of expected, unexpected and time-reversed Mandarin Chinese speech, and localized the effects of violated expectation in frontotemporal brain regions, the sensorimotor cortex and the supramarginal gyrus from 250 ms relative to the target words. By further investigating the causal cortical dynamics, we provided the description of the causal dynamic network within the framework of the dual stream model, and highlighted the importance of the connections within the ventral pathway, the top-down modulation from the left inferior frontal gyrus and the cross-stream integration during the speech processing of violated expectation.

Representional and connectivity-based accounts of the cognitive consequences of atrophy of the right and left anterior temporal lobes

According to the original "hub-and-spoke" model of conceptual representations, the neural network for semantic memory requires a single convergence zone located in the anterior temporal lobes (ATLs). However, a more recent version of this model acknowledges that a graded specialization of the left and right ATLs might emerge as a consequence of their differential connectivity with language and sensory-motor regions. A recent influential paper maintained that both the format of semantic representations (representational account) and their differential connectivity (connectivity account) could contribute to the cognitive consequences of atrophy to the left versus the right ATL atrophy. That paper, however, also raised questions as to whether the distinction between representational and connectivity accounts is a meaningful question. I argue that an important theoretical difference exists between the representational and the connectivity-based models and that investigations, based on this difference, should allow to choose between these alternative accounts.

Dissociating the neural correlates of the sociality and plausibility effects in simple conceptual combination

Neuroimaging studies have indicated that a brain network distributed in the supramodal cortical regions of the frontal, temporal, and parietal lobes plays a central role in conceptual processing. The activation of this network is modulated by two orthogonal dimensions in conceptual processing-the semantic features of individual concepts and the meaningfulness of conceptual combinations-but it remains unclear how the network is functionally organized along these two dimensions. In this fMRI study, we focused on two specific factors, i.e. the social semantic richness of words and the semantic plausibility of word combinations, along the two dimensions. In literature, the distributions of the effects of the two factors are very similar, but have not been rigorously compared in one study. We orthogonally manipulated the two factors in a phrase comprehension task and found a clear dissociation between their effects. The combination of these results with our previous findings reveals three adjacently distributed subnetworks of the supramodal semantic network, associated with the sociality effect, imageability effect, and semantic plausibility effect, respectively. Further analysis of the resting-state functional connectivity data indicated that the functional dissociation among the three subnetworks is associated with their underlying intrinsic connectivity structures.

Left Inferior Frontal Gyrus Integrates Multisensory Information in Category Learning

Humans are able to categorize things they encounter in the world (e.g., a cat) by integrating multisensory information from the auditory and visual modalities with ease and speed. However, how the brain learns multisensory categories remains elusive. The present study used functional magnetic resonance imaging to investigate, for the first time, the neural mechanisms underpinning multisensory information-integration (II) category learning. A sensory-modality-general network, including the left insula, right inferior frontal gyrus (IFG), supplementary motor area, left precentral gyrus, bilateral parietal cortex, and right caudate and globus pallidus, was recruited for II categorization, regardless of whether the information came from a single modality or from multiple modalities. Putamen activity was higher in correct categorization than incorrect categorization. Critically, the left IFG and left body and tail of the caudate were activated in multisensory II categorization but not in unisensory II categorization, which suggests this network plays a specific role in integrating multisensory information during category learning. The present results extend our understanding of the role of the left IFG in multisensory processing from the linguistic domain to a broader role in audiovisual learning.

Imageability effect on the functional brain activity during a naming to definition task

Lexical competence includes both the ability to relate words to the external world as accessed through (mainly) visual perception (referential competence) and the ability to relate words to other words (inferential competence). We investigated the role of visual imagery in lexical inferential competence by using an auditory version of an inferential naming-to-definition task, in which visual imageability of both definitions and target words was manipulated. A visual imageability-related brain activity (bilateral posterior-parietal lobe and ventrotemporal cortex, including fusiform gyrus) was found during a "pure" inferential performance. The definition effect in high vs. low imageability contrast suggests that a visual-imagery strategy is spontaneously activated during the retrieval of a word from a high imageable definition; such an effect appears to be independent of whether the target word is high or low imageable. This contributes to the understanding of the neural correlates of semantic processing and the differential role of spontaneous visual imagery, depending on the semantic properties of the processed stimuli.

An historical perspective on Endel Tulving's episodic-semantic distinction

The distinction between episodic and semantic memory, proposed by Endel Tulving in 1972, remains a key concept in contemporary Cognitive Neuroscience. Here we review how this distinction evolved in Tulving's writings over the years. Crucially, from 1972 onward, he argued that the two forms of memory were inter-dependent and that their interaction was an essential feature of normal episodic memory function. Moreover, later elaborations of the theory clearly proposed that these interactions formed the basis of normal declarative memory functioning. A later but crucial aspect of Tulving's contribution was his stress on the importance of subjective experience, which, according to him, "should be the ultimate object of interest, the central aspect of remembering that is to be explained and understood". We relate these and his numerous other ideas to current perspectives about the organization and function of human memory.

Visual and auditory perceptual strength norms for 3,596 French nouns and their relationship with other psycholinguistic variables

Perceptual experience plays a critical role in the conceptual representation of words. Higher levels of semantic variables such as imageability, concreteness, and sensory experience are generally associated with faster and more accurate word processing. Nevertheless, these variables tend to be assessed mostly on the basis of visual experience. This underestimates the potential contributions of other perceptual modalities. Accordingly, recent evidence has stressed the importance of providing modality-specific perceptual strength norms. In the present study, we developed French Canadian norms of visual and auditory perceptual strength (i.e., the modalities that have major impact on word processing) for 3,596 nouns. We then explored the relationship between these newly developed variables and other lexical, orthographic, and semantic variables. Finally, we demonstrated the contributions of visual and auditory perceptual strength ratings to visual word processing beyond those of other semantic variables related to perceptual experience (e.g., concreteness, imageability, and sensory experience ratings). The ratings developed in this study are a meaningful contribution toward the implementation of new studies that will shed further light on the interaction between linguistic, semantic, and perceptual systems.

Concepts and Compositionality: In Search of the Brain's Language of Thought

Imagine Genghis Khan, Aretha Franklin, and the Cleveland Cavaliers performing an opera on Maui. This silly sentence makes a serious point: As humans, we can flexibly generate and comprehend an unbounded number of complex ideas. Little is known, however, about how our brains accomplish this. Here we assemble clues from disparate areas of cognitive neuroscience, integrating recent research on language, memory, episodic simulation, and computational models of high-level cognition. Our review is framed by Fodor's classic language of thought hypothesis, according to which our minds employ an amodal, language-like system for combining and recombining simple concepts to form more complex thoughts. Here, we highlight emerging work on combinatorial processes in the brain and consider this work's relation to the language of thought. We review evidence for distinct, but complementary, contributions of map-like representations in subregions of the default mode network and sentence-like representations of conceptual relations in regions of the temporal and prefrontal cortex.

Mapping eloquent cortex: A voxel-based lesion-symptom mapping study of core speech production capacities in brain tumour patients

This study used voxel-based lesion-symptom mapping to examine the cortical and white matter regions associated with language production impairments in a sample of 63 preoperative tumour patients. We identified four cognitive functions considered crucial for spoken language production: semantic-to-lexical mapping (selecting the appropriate lexical label for the intended concept); phonological encoding (retrieving the word's phonological form); articulatory-motor planning (programming the articulatory motor movements); and goal-driven language selection (exerting top-down control over the words selected for production). Each participant received a score estimating their competence on each function. We then mapped the region(s) where pathology was significantly associated with low scores. For semantic-to-lexical mapping, the critical map encompassed portions of the left posterior middle and inferior temporal gyri, extending into posterior fusiform gyrus, overlapping substantially with the territory of the inferior longitudinal fasciculus. For phonological encoding, the map encompassed the left inferior parietal lobe and posterior middle temporal gyrus, overlapping with the territory of the inferior longitudinal and posterior arcuate fasciculi. For articulatory-motor planning, the map encompassed parts of the left frontal pole, frontal operculum, and inferior frontal gyrus, and overlapped with the territory of the frontal aslant tract. Finally, the map for goal-driven language selection encompassed the left frontal pole and the anterior cingulate cortex. We compare our findings with those from other neuropsychological samples, and conclude that the study of tumour patients offers evidence that complements that available from other populations.

Using the force: STEM knowledge and experience construct shared neural representations of engineering concepts

How does STEM knowledge learned in school change students' brains? Using fMRI, we presented photographs of real-world structures to engineering students with classroom-based knowledge and hands-on lab experience, examining how their brain activity differentiated them from their "novice" peers not pursuing engineering degrees. A data-driven MVPA and machine-learning approach revealed that neural response patterns of engineering students were convergent with each other and distinct from novices' when considering physical forces acting on the structures. Furthermore, informational network analysis demonstrated that the distinct neural response patterns of engineering students reflected relevant concept knowledge: learned categories of mechanical structures. Information about mechanical categories was predominantly represented in bilateral anterior ventral occipitotemporal regions. Importantly, mechanical categories were not explicitly referenced in the experiment, nor does visual similarity between stimuli account for mechanical category distinctions. The results demonstrate how learning abstract STEM concepts in the classroom influences neural representations of objects in the world.

Perspective in the conceptualization of categories

The ability to differently perceive and represent entities depending on their perspective is crucial for humans. We report five experiments that investigate how the different perspectives adopted while experiencing entities are reflected in conceptualizations (towards vs. away, near vs. far, beside vs. above, inside vs. outside and vision vs. audition vs. touch). Different groups of participants generated object properties while imagining the same scenario from different perspectives (e.g. entities coming toward them/going away from them while on a highway overpass). If conceptualizations have perspectives, then participants should produce features from a perspective entrenched in memory that reflects typical interactions with objects, independently of their assigned perspective (entrenched perspective). In addition, the perspective adopted in a given experiment should influence the properties generated (situated perspective). Results across the experiments indicate that conceptualizations contain both entrenched and situational perspectives. While entrenched perspectives emerge from canonical actions typically performed with objects, locations and entities, situational perspectives reflect online adaptations to current task contexts. The implications of the interplay between entrenched and situational perspectives for grounded cognition are discussed.

Beyond the target area: an integrative view of tDCS-induced motor cortex modulation in patients and athletes

Transcranial Direct Current Stimulation (tDCS) is a non-invasive technique used to modulate neural tissue. Neuromodulation apparently improves cognitive functions in several neurologic diseases treatment and sports performance. In this study, we present a comprehensive, integrative review of tDCS for motor rehabilitation and motor learning in healthy individuals, athletes and multiple neurologic and neuropsychiatric conditions. We also report on neuromodulation mechanisms, main applications, current knowledge including areas such as language, embodied cognition, functional and social aspects, and future directions. We present the use and perspectives of new developments in tDCS technology, namely high-definition tDCS (HD-tDCS) which promises to overcome one of the main tDCS limitation (i.e., low focality) and its application for neurological disease, pain relief, and motor learning/rehabilitation. Finally, we provided information regarding the Transcutaneous Spinal Direct Current Stimulation (tsDCS) in clinical applications, Cerebellar tDCS (ctDCS) and its influence on motor learning, and TMS combined with electroencephalography (EEG) as a tool to evaluate tDCS effects on brain function.

A structural connectivity convergence zone in the ventral and anterior temporal lobes: Data-driven evidence from structural imaging

The hub-and-spoke model of semantic cognition seeks to reconcile embodied views of a fully distributed semantic network with patient evidence, primarily from semantic dementia, who demonstrate modality-independent conceptual deficits associated with atrophy centred on the ventrolateral anterior temporal lobe. The proponents of this model have recently suggested that the temporal cortex is a graded representational space where concepts become less linked to a specific modality as they are processed farther away from primary and secondary sensory cortices and towards the ventral anterior temporal lobe. To explore whether there is evidence that the connectivity patterns of the temporal lobe converge in its ventral anterior end the current study uses three dimensional Laplacian eigenmapping, a technique that allows visualisation of similarity in a low dimensional space. In this space similarity is encoded in terms of distances between data points. We found that the ventral and anterior temporal lobe is in a unique position of being at the centre of mass of the data points within the connective similarity space. This can be interpreted as the area where the connectivity profiles of all other temporal cortex voxels converge. This study is the first to explicitly investigate the pattern of connectivity and thus provides the missing link in the evidence that the ventral anterior temporal lobe can be considered a multi-modal graded hub.