Anteromedial temporal cortex supports fine-grained differentiation among objects

Insights from simultaneous EEG-fMRI and patient data illuminate the role of the anterior medial temporal lobe in N400 generation

The N400, a negative event-related potential (ERP) peaking approximately 400 ms after stimulus onset, is known to reflect the processing of semantic information. While scalp recordings have contributed to understanding the psychological processes underlying the N400, they have been limited in identifying its neural basis. However, recent intracranial ERP recordings and fMRI studies have shed light on the crucial role of the anterior medial temporal lobe (AMTL) in semantic information processing. These findings suggest that the N400 partially represents activity in the AMTL structures. To investigate the neural underpinnings of the N400 effect, we simultaneously recorded ERPs and event-related fMRI during a semantic priming paradigm in a sample of 12 young, healthy subjects. Additionally, we collected ERPs and structural brain data from older healthy adults and patients with amnestic mild cognitive impairment (aMCI), a population characterized by neurodegenerative changes in the AMTL. In our fMRI results, we identified bilateral loci in the AMTL as the global maxima. Employing an EEG-informed fMRI analysis, we explored trial-to-trial fluctuations in semantic processing by linking single-trial N400 amplitudes to the Blood Oxygen Level Dependent (BOLD) signal. This approach provided the first direct evidence linking the N400 recorded at the scalp level to the corresponding BOLD signal in the AMTL. Consistent with these findings, patients with aMCI exhibited a diminished N400 effect compared to healthy older adults. Furthermore, voxel-based morphometry analysis revealed a correlation between the magnitude of the N400 effect and the integrity of the AMTL. By integrating data from simultaneous EEG-fMRI, and patient studies, our research advances our understanding of the neural substrate of the N400 and highlights the critical involvement of the AMTL in semantic processing.

Perception and Memory in the Ventral Visual Stream and Medial Temporal Lobe

Perception and memory are traditionally thought of as separate cognitive functions, supported by distinct brain regions. The canonical perspective is that perceptual processing of visual information is supported by the ventral visual stream, whereas long-term declarative memory is supported by the medial temporal lobe. However, this modular framework cannot account for the increasingly large body of evidence that reveals a role for early visual areas in long-term recognition memory and a role for medial temporal lobe structures in high-level perceptual processing. In this article, we review relevant research conducted in humans, nonhuman primates, and rodents. We conclude that the evidence is largely inconsistent with theoretical proposals that draw sharp functional boundaries between perceptual and memory systems in the brain. Instead, the weight of the empirical findings is best captured by a representational-hierarchical model that emphasizes differences in content, rather than in cognitive processes within the ventral visual stream and medial temporal lobe.

Episodic Memory formation: A review of complex Hippocampus input pathways

Memories of everyday experiences involve the encoding of a rich and dynamic representation of present objects and their contextual features. Traditionally, the resulting mnemonic trace is referred to as Episodic Memory, i.e. the "what", "where" and "when" of a lived episode. The journey for such memory trace encoding begins with the perceptual data of an experienced episode handled in sensory brain regions. The information is then streamed to cortical areas located in the ventral Medio Temporal Lobe, which produces multi-modal representations concerning either the objects (in the Perirhinal cortex) or the spatial and contextual features (in the parahippocampal region) of the episode. Then, this high-level data is gated through the Entorhinal Cortex and forwarded to the Hippocampal Formation, where all the pieces get bound together. Eventually, the resulting encoded neural pattern is relayed back to the Neocortex for a stable consolidation. This review will detail these different stages and provide a systematic overview of the major cortical streams toward the Hippocampus relevant for Episodic Memory encoding.

Semantic cognition in healthy ageing: Neural signatures of representation and control mechanisms in naming typical and atypical objects

Effective use of conceptual knowledge engages semantic representation and control processes to access information in a goal-driven manner. Neuropsychological findings of patients presenting either degraded knowledge (e.g., semantic dementia) or disrupted control (e.g., semantic aphasia) converge with neuroimaging evidence from young adults, and delineate the neural segregation of representation and control mechanisms. However, there is still scarce research on the neurofunctional underpinnings of such mechanisms in healthy ageing. To address this, we conducted an fMRI study, wherein young and older adults performed a covert naming task of typical and atypical objects. Three main age-related differences were found. As shown by age group and typicality interactions, older adults exhibited overactivation during naming of atypical (e.g., avocado) relative to typical concepts in brain regions associated to semantic representation, including anterior and medial portions of left temporal lobe (respectively, ATL and MTG). This provides evidence for the reorganization of neural activity in these brain regions contingent to the enrichment of semantic repositories in older ages. The medial orbitofrontal gyrus was also overactivated, indicating that the processing of atypical concepts (relative to typical items) taxes additional control resources in the elderly. Increased activation in the inferior frontal gyrus (IFG) was observed in naming typical items (relative to atypical ones), but only for young adults. This suggests that naming typical items (e.g., strawberry) taxes more on control processes in younger ages, presumably due to the semantic competition set by other items that share multiple features with the target (e.g., raspberry, blackberry, cherry). Together, these results reveal the dynamic nature of semantic control interplaying with conceptual representations as people grow older, by indicating that distinct neural bases uphold semantic performance from young to older ages. These findings may be explained by neural compensation mechanisms coming into play to support neurocognitive changes in healthy ageing.

Neural distinctiveness and reinstatement of hippocampal representations support unitization for associations

The medial temporal lobe (MTL) is critical to associative memory success, yet not all types of associations may be processed in a similar manner within MTL subregions. In particular, previous work suggests intra- and inter-item associations not only exhibit differences in overall rates of recollection, but also recruit different MTL subregions. Whereas intra-item associations, akin to unitization, take advantage of associations between within-item features, inter-item associations form links across discrete items. The current work examines the neural differences between these two types of associations using fMRI and multivoxel analyses. Specifically, the current study examines differences across face-occupation as a function of whether the pairing was viewed as a person performing the given job (intra-item binding) or a person saying they knew someone who had a particular job (inter-item binding). The results show that at encoding, successfully recollected neural patterns related to intra- and inter-item associations are distinct from one another in the hippocampus, parahippocampal and perirhinal cortex. Additionally, the two trial types are reinstated distinctly such that inter-item trials have higher neural reinstatement from encoding to retrieval compared to intra-item trials in the hippocampus. We conclude that intra- and inter- associative pairs may utilize similar neural regions that represent patterns of activation differentially at encoding. However, to reinstate information to the same degree (i.e., subsequently successfully recollected) inter-item associations, that are all encoded in the same manner, may be reinstated more similarly compared to intra-item associations that are encoded by imagining pairs differently and occupation specific. This may indicate that intra-item associations promote more efficient reinstatement.

A category-selective semantic memory deficit for animate objects in semantic variant primary progressive aphasia

Data are mixed on whether patients with semantic variant primary progressive aphasia exhibit a category-selective semantic deficit for animate objects. Moreover, there is little consensus regarding the neural substrates of this category-selective semantic deficit, though prior literature has suggested that the perirhinal cortex and the lateral posterior fusiform gyrus may support semantic memory functions important for processing animate objects. In this study, we investigated whether patients with semantic variant primary progressive aphasia exhibited a category-selective semantic deficit for animate objects in a word-picture matching task, controlling for psycholinguistic features of the stimuli, including frequency, familiarity, typicality and age of acquisition. We investigated the neural bases of this category selectivity by examining its relationship with cortical atrophy in two primary regions of interest: bilateral perirhinal cortex and lateral posterior fusiform gyri. We analysed data from 20 patients with semantic variant primary progressive aphasia (mean age = 64 years, S.D. = 6.94). For each participant, we calculated an animacy index score to denote the magnitude of the category-selective semantic deficit for animate objects. Multivariate regression analysis revealed a main effect of animacy (β = 0.52, t = 4.03, P < 0.001) even after including all psycholinguistic variables in the model, such that animate objects were less likely to be identified correctly relative to inanimate objects. Inspection of each individual patient's data indicated the presence of a disproportionate impairment in animate objects in most patients. A linear regression analysis revealed a relationship between the right perirhinal cortex thickness and animacy index scores (β = -0.57, t = -2.74, P = 0.015) such that patients who were more disproportionally impaired for animate relative to inanimate objects exhibited thinner right perirhinal cortex. A vertex-wise general linear model analysis restricted to the temporal lobes revealed additional associations between positive animacy index scores (i.e. a disproportionately poorer performance on animate objects) and cortical atrophy in the right perirhinal and entorhinal cortex, superior, middle, and inferior temporal gyri, and the anterior fusiform gyrus, as well as the left anterior fusiform gyrus. Taken together, our results indicate that a category-selective semantic deficit for animate objects is a characteristic feature of semantic variant primary progressive aphasia that is detectable in most individuals. Our imaging findings provide further support for the role of the right perirhinal cortex and other temporal lobe regions in the semantic processing of animate objects.

From letters to composed concepts: A magnetoencephalography study of reading

Language comprehension requires the recognition of individual words and the combination of their meanings to yield complex concepts or interpretations. This combinatory process often requires the insertion of unstated semantic material between words, based on thematic or feature knowledge. For example, the phrase horse barn is not interpreted as a blend of a horse and a barn, but specifically a barn where horses are kept. Previous neuroscientific evidence suggests that left posterior and anterior temporal cortex underpin thematic and feature‐based concept knowledge, respectively, but much remains unclear about how these areas contribute to combinatory language processing. Using magnetoencephalography, we contrasted source‐localized responses to modifier‐noun phrases involving thematic relations versus feature modifications, while also examining how lower‐level orthographic processing fed composition. Participants completed three procedures examining responses to letter‐strings, adjective‐noun phrases, and noun–noun combinations that varied the semantic relations between words. We found that sections of the left anterior temporal lobe, posterior temporal lobe, and cortex surrounding the angular gyrus were all engaged in the minimal composition of adjective‐noun phrases, a more distributed network than in most prior studies of minimal composition. Of these regions, only the left posterior temporal lobe was additionally sensitive to implicit thematic relations between composing words, suggesting that it houses a specialized relational processing component in a wider composition network. We additionally identified a left occipitotemporal progression from orthographic to lexical processing, feeding ventral anterior areas engaged in the combination of word meanings. Finally, by examining source signal leakage, we characterized the degree to which these responses could be distinguished from one another using source estimation.

Modularity and granularity across the language network-A primary progressive aphasia perspective

Tests of grammar, repetition and semantics were administered to 62 prospectively enrolled right-handed participants with primary progressive aphasia (PPA). Structural brain images were obtained at the time of testing. Regression analyses uncovered 3 clearly delineated non-overlapping left hemisphere clusters where cortical thinning (atrophy) was significantly correlated with impaired performance. A morphosyntactic cluster associated with the grammaticality of sentence construction was located predominantly within the middle and inferior frontal gyri; a phonolexical cluster associated with language repetition was located in the temporoparietal junction; a lexicosemantic cluster associated with object naming and single word comprehension was located within the middle and anterior parts of the temporal lobe and extended into insular, orbitofrontal, and mediotemporal cortices. Commonality analyses were undertaken to explore whether these three clusters were as modular as indicated by the regression analyses or whether some underlying functional granularity could be uncovered. Modularity was defined as the exclusive association of an anatomical cluster with a single type of language task whereas granularity was defined as the association of a single anatomical cluster with more than one type of language task. The commonality analyses revealed a predominantly modular organization with quantitatively minor instances of inter-cluster granularity. The results also reconfirmed previous work on PPA which had shown that Wernicke's area is not essential for word comprehension, that naming impairments can be based either on deficits of lexical retrieval or word comprehension, and that the essential substrates of word comprehension encompass much wider areas of the temporal lobe than the temporal pole. The anatomy of the language network has traditionally been explored through patients with focal cerebrovascular accidents and experiments based on functional activation. Investigations on PPA are showing that focal neurodegenerations can add new perspectives to existing models of the language network.

Cross-Modal Interaction Between Auditory and Visual Input Impacts Memory Retrieval

How we perceive and learn about our environment is influenced by our prior experiences and existing representations of the world. Top-down cognitive processes, such as attention and expectations, can alter how we process sensory stimuli, both within a modality (e.g., effects of auditory experience on auditory perception), as well as across modalities (e.g., effects of visual feedback on sound localization). Here, we demonstrate that experience with different types of auditory input (spoken words vs. environmental sounds) modulates how humans remember concurrently-presented visual objects. Participants viewed a series of line drawings (e.g., picture of a cat) displayed in one of four quadrants while listening to a word or sound that was congruent (e.g., "cat" or ), incongruent (e.g., "motorcycle" or ), or neutral (e.g., a meaningless pseudoword or a tonal beep) relative to the picture. Following the encoding phase, participants were presented with the original drawings plus new drawings and asked to indicate whether each one was "old" or "new." If a drawing was designated as "old," participants then reported where it had been displayed. We find that words and sounds both elicit more accurate memory for what objects were previously seen, but only congruent environmental sounds enhance memory for where objects were positioned - this, despite the fact that the auditory stimuli were not meaningful spatial cues of the objects' locations on the screen. Given that during real-world listening conditions, environmental sounds, but not words, reliably originate from the location of their referents, listening to sounds may attune the visual dorsal pathway to facilitate attention and memory for objects' locations. We propose that audio-visual associations in the environment and in our previous experience jointly contribute to visual memory, strengthening visual memory through exposure to auditory input.

Cats and Apples: Semantic Fluency Performance for Living Things Identifies Patients with Very Early Alzheimer's Disease

Objective: Reduced semantic memory performance is a known neuropsychological marker of very early Alzheimer’s disease (AD), but the task format that best predicts disease status is an open question. The present study aimed to identify the semantic fluency task and measure that best discriminates early-stage AD patients (PATs) from cognitively healthy controls. Method: Semantic fluency performance for animals, fruits, tools, and vehicles was assessed in 70 early-stage AD PATs and 67 cognitively healthy participants. Logistic regressions and receiver operating characteristics were calculated for five total score semantic fluency measures. Results: Compared with all other measures, living things (i.e., total correct animals + total correct fruits) achieved highest z-statistics, highest area under the curve and smallest difference between the upper and lower 95% confidence intervals. Conclusion: Living things total correct is a powerful tool to detect the earliest signs of incipient AD.

Neural dynamics of semantic categorization in semantic variant of primary progressive aphasia

Semantic representations are processed along a posterior-to-anterior gradient reflecting a shift from perceptual (e.g., it has eight legs) to conceptual (e.g., venomous spiders are rare) information. One critical region is the anterior temporal lobe (ATL): patients with semantic variant primary progressive aphasia (svPPA), a clinical syndrome associated with ATL neurodegeneration, manifest a deep loss of semantic knowledge. We test the hypothesis that svPPA patients perform semantic tasks by over-recruiting areas implicated in perceptual processing. We compared MEG recordings of svPPA patients and healthy controls during a categorization task. While behavioral performance did not differ, svPPA patients showed indications of greater activation over bilateral occipital cortices and superior temporal gyrus, and inconsistent engagement of frontal regions. These findings suggest a pervasive reorganization of brain networks in response to ATL neurodegeneration: the loss of this critical hub leads to a dysregulated (semantic) control system, and defective semantic representations are seemingly compensated via enhanced perceptual processing.

Is there a serial bottleneck in visual object recognition?

Divided attention has little effect for simple tasks, such as luminance detection, but it has large effects for complex tasks, such as semantic categorization of masked words. Here, we asked whether the semantic categorization of visual objects shows divided attention effects as large as those observed for words, or as small as those observed for simple feature judgments. Using a dual-task paradigm with nameable object stimuli, performance was compared with the predictions of serial and parallel models. At the extreme, parallel processes with unlimited capacity predict no effect of divided attention; alternatively, an all-or-none serial process makes two predictions: a large divided attention effect (lower accuracy for dual-task trials, compared to single-task trials) and a negative response correlation in dual-task trials (a given response is more likely to be incorrect when the response about the other stimulus is correct). These predictions were tested in two experiments examining object judgments. In both experiments, there was a large divided attention effect and a small negative correlation in responses. The magnitude of these effects was larger than for simple features, but smaller than for words. These effects were consistent with serial models, and rule out some but not all parallel models. More broadly, the results help establish one of the first examples of likely serial processing in perception.

Visual and Semantic Representations Predict Subsequent Memory in Perceptual and Conceptual Memory Tests

It is generally assumed that the encoding of a single event generates multiple memory representations, which contribute differently to subsequent episodic memory. We used functional magnetic resonance imaging (fMRI) and representational similarity analysis to examine how visual and semantic representations predicted subsequent memory for single item encoding (e.g., seeing an orange). Three levels of visual representations corresponding to early, middle, and late visual processing stages were based on a deep neural network. Three levels of semantic representations were based on normative observed ("is round"), taxonomic ("is a fruit"), and encyclopedic features ("is sweet"). We identified brain regions where each representation type predicted later perceptual memory, conceptual memory, or both (general memory). Participants encoded objects during fMRI, and then completed both a word-based conceptual and picture-based perceptual memory test. Visual representations predicted subsequent perceptual memory in visual cortices, but also facilitated conceptual and general memory in more anterior regions. Semantic representations, in turn, predicted perceptual memory in visual cortex, conceptual memory in the perirhinal and inferior prefrontal cortex, and general memory in the angular gyrus. These results suggest that the contribution of visual and semantic representations to subsequent memory effects depends on a complex interaction between representation, test type, and storage location.

Distinguishing Syntactic Operations in the Brain: Dependency and Phrase-Structure Parsing

Finding the structure of a sentence-the way its words hold together to convey meaning-is a fundamental step in language comprehension. Several brain regions, including the left inferior frontal gyrus, the left posterior superior temporal gyrus, and the left anterior temporal pole, are supposed to support this operation. The exact role of these areas is nonetheless still debated. In this paper we investigate the hypothesis that different brain regions could be sensitive to different kinds of syntactic computations. We compare the fit of phrase-structure and dependency structure descriptors to activity in brain areas using fMRI. Our results show a division between areas with regard to the type of structure computed, with the left anterior temporal pole and left inferior frontal gyrus favouring dependency structures and left posterior superior temporal gyrus favouring phrase structures.

Knowing what you need to know in advance: The neural processes underpinning flexible semantic retrieval of thematic and taxonomic relations

Semantic retrieval is flexible, allowing us to focus on subsets of features and associations that are relevant to the current task or context: for example, we use taxonomic relations to locate items in the supermarket (carrots are a vegetable), but thematic associations to decide which tools we need when cooking (carrot goes with peeler). We used fMRI to investigate the neural basis of this form of semantic flexibility; in particular, we asked how retrieval unfolds differently when participants have advanced knowledge of the type of link to retrieve between concepts (taxonomic or thematic). Participants performed a semantic relatedness judgement task: on half the trials, they were cued to search for a taxonomic or thematic link, while on the remaining trials, they judged relatedness without knowing which type of semantic relationship would be relevant. Left inferior frontal gyrus showed greater activation when participants knew the trial type in advance. An overlapping region showed a stronger response when the semantic relationship between the items was weaker, suggesting this structure supports both top-down and bottom-up forms of semantic control. Multivariate pattern analysis further revealed that the neural response in left inferior frontal gyrus reflects goal information related to different conceptual relationships. Top-down control specifically modulated the response in visual cortex: when the goal was unknown, there was greater deactivation to the first word, and greater activation to the second word. We conclude that top-down control of semantic retrieval is primarily achieved through the gating of task-relevant 'spoke' regions.

Intrinsic connectivity of anterior temporal lobe relates to individual differences in semantic retrieval for landmarks

Contemporary neuroscientific accounts suggest that ventral anterior temporal lobe (ATL) acts as a bilateral heteromodal semantic hub, which is particularly critical for the specific-level knowledge needed to recognise unique entities, such as familiar landmarks and faces. There may also be graded functional differences between left and right ATL, relating to effects of modality (linguistic versus non-linguistic) and category (e.g., knowledge of people and places). Individual differences in intrinsic connectivity from left and right ATL might be associated with variation in semantic categorisation performance across these categories and modalities. We recorded resting-state fMRI in 74 individuals and, in a separate session, examined semantic categorisation. People with greater connectivity between left and right ATL were more efficient at categorising landmarks (e.g., Eiffel Tower), especially when these were presented visually. In addition, participants who showed stronger connectivity from right than left ATL to medial occipital cortex showed more efficient semantic categorisation of landmarks regardless of modality of presentation. These results can be interpreted in terms of graded differences in the patterns of connectivity across left and right ATL, which give rise to a bilateral yet partially segregated semantic 'hub'. More specifically, right ATL connectivity supports the efficient semantic categorisation of landmarks.

Perceptual and conceptual processing of visual objects across the adult lifespan

Making sense of the external world is vital for multiple domains of cognition, and so it is crucial that object recognition is maintained across the lifespan. We investigated age differences in perceptual and conceptual processing of visual objects in a population-derived sample of 85 healthy adults (24-87 years old) by relating measures of object processing to cognition across the lifespan. Magnetoencephalography (MEG) was recorded during a picture naming task to provide a direct measure of neural activity, that is not confounded by age-related vascular changes. Multiple linear regression was used to estimate neural responsivity for each individual, namely the capacity to represent visual or semantic information relating to the pictures. We find that the capacity to represent semantic information is linked to higher naming accuracy, a measure of task-specific performance. In mature adults, the capacity to represent semantic information also correlated with higher levels of fluid intelligence, reflecting domain-general performance. In contrast, the latency of visual processing did not relate to measures of cognition. These results indicate that neural responsivity measures relate to naming accuracy and fluid intelligence. We propose that maintaining neural responsivity in older age confers benefits in task-related and domain-general cognitive processes, supporting the brain maintenance view of healthy cognitive ageing.

The Shape of Things to Come in Speech Production: A Functional Magnetic Resonance Imaging Study of Visual Form Interference during Lexical Access

Studies of context effects in speech production have shown that semantic feature overlap produces interference in naming of categorically related objects. In neuroimaging studies, this semantic interference effect is consistently associated with involvement of left superior and middle temporal gyri. However, at least part of this effect has recently been shown to be attributable to visual form similarity, as categorically related objects typically share visual features. This fMRI study examined interference produced by visual form overlap in the absence of a category relation in a picture-word interference paradigm. Both visually similar and visually dissimilar distractors led to increased BOLD responses in the left inferior frontal gyrus compared with the congruent condition. Naming pictures in context with a distractor word denoting an object visually similar in form slowed RTs compared with unrelated words and was associated with reduced activity in the left posterior middle temporal gyrus. This area is reliably observed in lexical level processing during language production tasks. No significant differential activity was observed in areas typically engaged by early perceptual or conceptual feature level processing or in areas proposed to be engaged by postlexical language processes, suggesting that visual form interference does not arise from uncertainty or confusion during perceptual or conceptual identification or after lexical processing. We conclude that visual form interference has a lexical locus, consistent with the predictions of competitive lexical selection models.

Word comprehension in temporal cortex and Wernicke area: A PPA perspective

OBJECTIVE

To explore atrophy-deficit correlations of word comprehension and repetition in temporoparietal cortices encompassing the Wernicke area, based on patients with primary progressive aphasia (PPA).

METHODS

Cortical thickness in regions within and outside the classical Wernicke area, measured by FreeSurfer, was correlated with repetition and single word comprehension scores in 73 right-handed patients at mild to moderate stages of PPA.

RESULTS

Atrophy in the Wernicke area was correlated with repetition (r = 0.42, p = 0.001) but not single word comprehension (r = -0.072, p = 0.553). Correlations with word comprehension were confined to more anterior parts of the temporal lobe, especially its anterior third (r = 0.60, p < 0.001). A single case with postmortem autopsy illustrated preservation of word comprehension but not repetition 6 months prior to death despite nearly 50% loss of cortical volume and severe neurofibrillary degeneration in core components of the Wernicke area.

CONCLUSIONS

Temporoparietal cortices containing the Wernicke area are critical for language repetition. Contrary to the formulations of classic aphasiology, their role in word and sentence comprehension is ancillary rather than critical. Thus, the Wernicke area is not sufficient to sustain word comprehension if the anterior temporal lobe is damaged. Traditional models of the role of the Wernicke area in comprehension are based almost entirely on patients with cerebrovascular lesions. Such lesions also cause deep white matter destruction and acute network diaschisis, whereas progressive neurodegenerative diseases associated with PPA do not. Conceptualizations of the Wernicke area that appear to conflict, therefore, can be reconciled by considering the hodologic and physiologic differences of the underlying lesions.

Dynamic integration of conceptual information during learning

The development and application of concepts is a critical component of cognition. Although concepts can be formed on the basis of simple perceptual or semantic features, conceptual representations can also capitalize on similarities across feature relationships. By representing these types of higher-order relationships, concepts can simplify the learning problem and facilitate decisions. Despite this, little is known about the neural mechanisms that support the construction and deployment of these kinds of higher-order concepts during learning. To address this question, we combined a carefully designed associative learning task with computational model-based functional magnetic resonance imaging (fMRI). Participants were scanned as they learned and made decisions about sixteen pairs of cues and associated outcomes. Associations were structured such that individual cues shared feature relationships, operationalized as shared patterns of cue pair-outcome associations. In order to capture the large number of possible conceptual representational structures that participants might employ and to evaluate how conceptual representations are used during learning, we leveraged a well-specified Bayesian computational model of category learning [1]. Behavioral and model-based results revealed that participants who displayed a tendency to link experiences in memory benefitted from faster learning rates, suggesting that the use of the conceptual structure in the task facilitated decisions about cue pair-outcome associations. Model-based fMRI analyses revealed that trial-by-trial integration of cue information into higher-order conceptual representations was supported by an anterior temporal (AT) network of regions previously implicated in representing complex conjunctions of features and meaning-based information.

Integrated deep visual and semantic attractor neural networks predict fMRI pattern-information along the ventral object processing pathway

Recognising an object involves rapid visual processing and activation of semantic knowledge about the object, but how visual processing activates and interacts with semantic representations remains unclear. Cognitive neuroscience research has shown that while visual processing involves posterior regions along the ventral stream, object meaning involves more anterior regions, especially perirhinal cortex. Here we investigate visuo-semantic processing by combining a deep neural network model of vision with an attractor network model of semantics, such that visual information maps onto object meanings represented as activation patterns across features. In the combined model, concept activation is driven by visual input and co-occurrence of semantic features, consistent with neurocognitive accounts. We tested the model’s ability to explain fMRI data where participants named objects. Visual layers explained activation patterns in early visual cortex, whereas pattern-information in perirhinal cortex was best explained by later stages of the attractor network, when detailed semantic representations are activated. Posterior ventral temporal cortex was best explained by intermediate stages corresponding to initial semantic processing, when visual information has the greatest influence on the emerging semantic representation. These results provide proof of principle of how a mechanistic model of combined visuo-semantic processing can account for pattern-information in the ventral stream.

Animacy and real-world size shape object representations in the human medial temporal lobes

Identifying what an object is, and whether an object has been encountered before, is a crucial aspect of human behavior. Despite this importance, we do not yet have a complete understanding of the neural basis of these abilities. Investigations into the neural organization of human object representations have revealed category specific organization in the ventral visual stream in perceptual tasks. Interestingly, these categories fall within broader domains of organization, with reported distinctions between animate, inanimate large, and inanimate small objects. While there is some evidence for category specific effects in the medial temporal lobe (MTL), in particular in perirhinal and parahippocampal cortex, it is currently unclear whether domain level organization is also present across these structures. To this end, we used fMRI with a continuous recognition memory task. Stimuli were images of objects from several different categories, which were either animate or inanimate, or large or small within the inanimate domain. We employed representational similarity analysis (RSA) to test the hypothesis that object-evoked responses in MTL structures during recognition-memory judgments also show evidence for domain-level organization along both dimensions. Our data support this hypothesis. Specifically, object representations were shaped by either animacy, real-world size, or both, in perirhinal and parahippocampal cortex, and the hippocampus. While sensitivity to these dimensions differed across structures when probed individually, hinting at interesting links to functional differentiation, similarities in organization across MTL structures were more prominent overall. These results argue for continuity in the organization of object representations in the ventral visual stream and the MTL.

Why do herpes simplex encephalitis and semantic dementia show a different pattern of semantic impairment in spite of their main common involvement within the anterior temporal lobes?

A very challenging problem in the domain of the cognitive neurosciences is to explain why herpes simplex encephalitis and semantic dementia show, respectively, a category-specific semantic disorder for biological entities and an across-categories semantic disruption, despite highly overlapping areas of anterior temporal lobe damage. The aim of the present review consisted in trying to make a separate survey of anatomo-clinical investigations (single-case studies and group studies) and of activation studies, in order to analyse the factors that could explain these different patterns of semantic disruption. Factors taken into account in this review were laterality of lesions, disease aetiology, kind of brain pathology and locus of damage within the temporal lobes. Locus of damage within the temporal lobes and kind of brain pathology seemed to play the most important role, because in patients with herpes simplex encephalitis and category-specific semantic disorder for biological entities the lesions prevailed in the anteromedial temporal lobes. Furthermore, the neuropathology concerned both the anterior temporal cortices and the white matter pathways connecting these areas with the posterior visual areas, whereas in semantic dementia the inferior longitudinal fasciculus involvement was restricted to the rostral temporal lobe and did not extend into the cortically uninvolved occipital lobe.

Integrative and distinctive coding of visual and conceptual object features in the ventral visual stream

A significant body of research in cognitive neuroscience is aimed at understanding how object concepts are represented in the human brain. However, it remains unknown whether and where the visual and abstract conceptual features that define an object concept are integrated. We addressed this issue by comparing the neural pattern similarities among object-evoked fMRI responses with behavior-based models that independently captured the visual and conceptual similarities among these stimuli. Our results revealed evidence for distinctive coding of visual features in lateral occipital cortex, and conceptual features in the temporal pole and parahippocampal cortex. By contrast, we found evidence for integrative coding of visual and conceptual object features in perirhinal cortex. The neuroanatomical specificity of this effect was highlighted by results from a searchlight analysis. Taken together, our findings suggest that perirhinal cortex uniquely supports the representation of fully specified object concepts through the integration of their visual and conceptual features.

The Anatomy of Object Processing: The Role of Anteromedial Temporal Cortex

How objects are represented and processed in the brain remains a key issue in cognitive neuroscience. We have developed a conceptual structure account in which category-specific semantic deficits emerge due to differences in the structure and content of concepts rather than from explicit divisions of conceptual knowledge in separate stores. The primary claim is that concepts associated with particular categories (e.g., animals, tools) differ in the number and type of properties and the extent to which these properties are correlated with each other. In this review, we describe recent neuropsychological and neuroimaging studies in which we have extended our theoretical account by incorporating recent claims about the neuroanatomical basis of feature integration and differentiation that arise from research into hierarchical object processing streams in nonhuman primates and humans. A clear picture has emerged in which the human perirhinal cortex and neighbouring anteromedial temporal structures appear to provide the neural infrastructure for making fine-grained discriminations among objects, suggesting that damage within the perirhinal cortex may underlie the emergence of category-specific semantic deficits in brain-damaged patients.

The priming of basic combinatory responses in MEG

Priming has been a powerful tool for the study of human memory and especially the memory representations relevant for language. However, although it is well established that lexical access can be primed, we do not know exactly what types of computations can be primed above the word level. This work took a neurobiological approach and assessed the ways in which the complex representation of a minimal combinatory phrase, such as red boat, can be primed, as evidenced by the spatiotemporal profiles of magnetoencephalography (MEG) signals. Specifically, we built upon recent progress on the neural signatures of phrasal composition and tested whether the brain activities implicated for the basic combination of two words could be primed. In two experiments, MEG was recorded during a picture naming task where the prime trials were designed to replicate previously reported combinatory effects and the target trials to test whether those combinatory effects could be primed. The manipulation of the primes was successful in eliciting larger activity for adjective-noun combinations than single nouns in left anterior temporal and ventromedial prefrontal cortices, replicating prior MEG studies on parallel contrasts. Priming of similarly timed activity was observed during target trials in anterior temporal cortex, but only when the prime and target shared an adjective. No priming in temporal cortex was observed for single word repetition and two control tasks showed that the priming effect was not elicited if the prime pictures were simply viewed but not named. In sum, this work provides evidence that very basic combinatory operations can be primed, with the necessity for some lexical overlap between prime and target suggesting combinatory conceptual, as opposed to syntactic processing. Both our combinatory and priming effects were early, onsetting between 100 and 150ms after picture onset and thus are likely to reflect the very earliest planning stages of a combinatory message. Thus our findings suggest that at the earliest stages of combinatory planning in production, a combinatory memory representation is formed that affects the planning of a relevantly similar combination on a subsequent trial.

Semantic control deficits impair understanding of thematic relationships more than object identity

Recent work has suggested a potential link between the neurocognitive mechanisms supporting the retrieval of events and thematic associations (i.e., knowledge about how concepts relate in a meaningful context) and semantic control processes that support the capacity to shape retrieval to suit the circumstances. Thematic associations and events are inherently flexible: the meaning of an item changes depending on the context (for example, lamp goes with reading, bicycle and police). Control processes might stabilise weak yet currently-relevant interpretations during event understanding. In contrast, semantic retrieval for objects (to understand what items are, and the categories they belong to) is potentially constrained by sensory-motor features (e.g., bright light) that change less across contexts. Semantic control and event understanding produce overlapping patterns of activation in healthy participants in left prefrontal and temporoparietal regions, but the potential causal link between these aspects of semantic cognition has not been examined. We predict that event understanding relies on semantic control, due to associations being necessarily context-dependent and variable. We tested this hypothesis in two ways: (i) by examining thematic associations and object identity in patients with semantic aphasia, who have well-documented deficits of semantic control following left frontoparietal stroke and (ii) using the same tasks in healthy controls under dual-task conditions that depleted the capacity for cognitive control. The patients were impaired on both identity and thematic matching tasks, and they showed particular difficulty on non-dominant thematic associations which required greater control over semantic retrieval. Healthy participants showed the same pattern under conditions of divided attention. These findings support the view that semantic control is necessary for organising and constraining the retrieval of thematic associations.

Two areas for familiar face recognition in the primate brain

Familiarity alters face recognition: Familiar faces are recognized more accurately than unfamiliar ones and under difficult viewing conditions when unfamiliar face recognition fails. The neural basis for this fundamental difference remains unknown. Using whole-brain functional magnetic resonance imaging, we found that personally familiar faces engage the macaque face-processing network more than unfamiliar faces. Familiar faces also recruited two hitherto unknown face areas at anatomically conserved locations within the perirhinal cortex and the temporal pole. These two areas, but not the core face-processing network, responded to familiar faces emerging from a blur with a characteristic nonlinear surge, akin to the abruptness of familiar face recognition. In contrast, responses to unfamiliar faces and objects remained linear. Thus, two temporal lobe areas extend the core face-processing network into a familiar face-recognition system.

Discrimination of a medial functional module within the temporal lobe using an effective connectivity model: A CCEP study

The temporal lobe is classically divided in two functional systems: the ventral visual pathway and the medial temporal memory system. However, their functional separation has been challenged by studies suggesting that the medial temporal lobe could be best understood as an extension of the hierarchically organized ventral visual pathway. Our purpose was to investigate (i) whether cerebral regions within the temporal lobe could be grouped into distinct functional assemblies, and (ii) which regions were central within these functional assemblies. We studied low intensity and low frequency electrical stimulations (0.5 mA, 1 Hz, 4 ms) performed during sixteen pre-surgical intracerebral EEG investigations in patients with medically intractable temporal or temporo-occipital lobe epilepsies. Eleven regions of interest were delineated per anatomical landmarks such as gyri and sulci. Effective connectivity based on electrophysiological feature (amplitude) of cortico-cortical evoked potentials (CCEPs) was evaluated and subjected to graph metrics. The amplitudes discriminated one medial module where the hippocampus could act as a signal amplifier. Mean amplitudes of CCEPs in regions of the temporal lobe showed a generalized Pareto distribution of probability suggesting neural synchronies to be self-organized critically. Our description of effective interactions within the temporal lobe provides a regional electrophysiological model of effective connectivity which is discussed in the context of the current hypothesis of pattern completion.

Integrative Priming of Compositional and Locative Relations

Integrative priming refers to the facilitated recognition of a target word (bench) as a real word following a prime (park). Prior integrative priming studies have used a wide variety of integrative relations including temporal (summer rain), topical (travel book), locative (forest river), and compositional (peach pie) relations. Yet differences in the types of integrative relations may yield differences in the underlying explanatory processes of integrative priming. In this study, we compared the magnitude, time course, and three theoretically based correlates of integrative priming for compositional (stone table) and locative (patio table) pairs in a lexical decision task across four stimulus onset asynchronies (SOAs; 50, 300, 800, and 1,600 ms). Based on the Complementary Role Activation theory, integrative ratings (the extent to which the prime and target can be combined into a meaningful phrase) were predicted to facilitate target RTs. Based on the Embodied Conceptual Combination (ECCo) theory, the local co-occurrence of the prime and target, and the ability to perceptually simulate (visually experience) the prime-target pair were tested as predictors. In comparison to unrelated pairs (nose table), target RTs were faster for the compositional and locative pairs, though did not differ between these relations. In support of the Complementary Role Activation theory, integrative ratings predicted target RTs above and beyond our control variables. In support of the ECCo theory, co-occurrence emerged as an early predictor of target RTs, and visual experience ratings was a reliable predictor at the 300 ms SOA, though only for the compositional relations.

Neuropsychological Markers of Medial Perirhinal and Entorhinal Cortex Functioning are Impaired Twelve Years Preceding Diagnosis of Alzheimer's Dementia

Neurofibrillary pathology in Alzheimer's dementia (AD) is associated with cognitive impairments and cortical thinning, and begins in medial perirhinal cortex (mPRC) before entering entorhinal cortex (ERC). Thus, mPRC dysfunction (e.g., semantic object memory impairments) may predate or accompany ERC (i.e., episodic memory) dysfunction in the preclinical course of typical AD. We developed formulae estimating mPRC and ERC integrity (i.e., cortical thickness) using common neuropsychological tests in 31 healthy individuals and 58 early AD patients. These formulae estimated the longitudinal courses of mPRC and ERC functioning in independent groups of 28 optimally healthy individuals who developed AD (NC-AD) over 2.8-13.4 years and 28 pairwise-matched, stable, healthy individuals (NC-NC). Mixed models demonstrated significantly worse NC-AD than NC-NC estimated mPRC and ERC functioning at the earliest observation, 12 years preceding diagnosis, and a significant decline 4 years preceding the AD diagnosis. These findings demonstrate that specific neuropsychological impairments occur early in the course of preclinical AD and that tasks measuring mPRC functioning may serve as additional, powerful markers of preclinical AD.

Oscillatory Dynamics Supporting Semantic Cognition: MEG Evidence for the Contribution of the Anterior Temporal Lobe Hub and Modality-Specific Spokes

The "hub and spoke model" of semantic representation suggests that the multimodal features of objects are drawn together by an anterior temporal lobe (ATL) "hub", while modality-specific "spokes" capture perceptual/action features. However, relatively little is known about how these components are recruited through time to support object identification. We used magnetoencephalography to measure neural oscillations within left ATL, lateral fusiform cortex (FC) and central sulcus (CS) during word-picture matching at different levels of specificity (employing superordinate vs. specific labels) for different categories (manmade vs. animal). This allowed us to determine (i) when each site was sensitive to semantic category and (ii) whether this was modulated by task demands. In ATL, there were two phases of response: from around 100 ms post-stimulus there were phasic bursts of low gamma activity resulting in reductions in oscillatory power, relative to a baseline period, that were modulated by both category and specificity; this was followed by more sustained power decreases across frequency bands from 250 ms onwards. In the spokes, initial power increases were not stronger for specific identification, while later power decreases were stronger for specific-level identification in FC for animals and in CS for manmade objects (from around 150 ms and 200 ms, respectively). These data are inconsistent with a temporal sequence in which early sensory-motor activity is followed by later retrieval in ATL. Instead, knowledge emerges from the rapid recruitment of both hub and spokes, with early specificity and category effects in the ATL hub. The balance between these components depends on semantic category and task, with visual cortex playing a greater role in the fine-grained identification of animals and motor cortex contributing to the identification of tools.

Understanding What We See: How We Derive Meaning From Vision

Recognising objects goes beyond vision, and requires models that incorporate different aspects of meaning. Most models focus on superordinate categories (e.g., animals, tools) which do not capture the richness of conceptual knowledge. We argue that object recognition must be seen as a dynamic process of transformation from low-level visual input through categorical organisation to specific conceptual representations. Cognitive models based on large normative datasets are well-suited to capture statistical regularities within and between concepts, providing both category structure and basic-level individuation. We highlight recent research showing how such models capture important properties of the ventral visual pathway. This research demonstrates that significant advances in understanding conceptual representations can be made by shifting the focus from studying superordinate categories to basic-level concepts.

Predicting the Time Course of Individual Objects with MEG

To respond appropriately to objects, we must process visual inputs rapidly and assign them meaning. This involves highly dynamic, interactive neural processes through which information accumulates and cognitive operations are resolved across multiple time scales. However, there is currently no model of object recognition which provides an integrated account of how visual and semantic information emerge over time; therefore, it remains unknown how and when semantic representations are evoked from visual inputs. Here, we test whether a model of individual objects--based on combining the HMax computational model of vision with semantic-feature information--can account for and predict time-varying neural activity recorded with magnetoencephalography. We show that combining HMax and semantic properties provides a better account of neural object representations compared with the HMax alone, both through model fit and classification performance. Our results show that modeling and classifying individual objects is significantly improved by adding semantic-feature information beyond ∼200 ms. These results provide important insights into the functional properties of visual processing across time.

Neural microgenesis of personally familiar face recognition

Despite a wealth of information provided by neuroimaging research, the neural basis of familiar face recognition in humans remains largely unknown. Here, we isolated the discriminative neural responses to unfamiliar and familiar faces by slowly increasing visual information (i.e., high-spatial frequencies) to progressively reveal faces of unfamiliar or personally familiar individuals. Activation in ventral occipitotemporal face-preferential regions increased with visual information, independently of long-term face familiarity. In contrast, medial temporal lobe structures (perirhinal cortex, amygdala, hippocampus) and anterior inferior temporal cortex responded abruptly when sufficient information for familiar face recognition was accumulated. These observations suggest that following detailed analysis of individual faces in core posterior areas of the face-processing network, familiar face recognition emerges categorically in medial temporal and anterior regions of the extended cortical face network.

Time-varying effective connectivity during visual object naming as a function of semantic demands

Accumulating evidence suggests that visual object understanding involves a rapid feedforward sweep, after which subsequent recurrent interactions are necessary. The extent to which recurrence plays a critical role in object processing remains to be determined. Recent studies have demonstrated that recurrent processing is modulated by increasing semantic demands. Differentially from previous studies, we used dynamic causal modeling to model neural activity recorded with magnetoencephalography while 14 healthy humans named two sets of visual objects that differed in the degree of semantic accessing demands, operationalized in terms of the values of basic psycholinguistic variables associated with the presented objects (age of acquisition, frequency, and familiarity). This approach allowed us to estimate the directionality of the causal interactions among brain regions and their associated connectivity strengths. Furthermore, to understand the dynamic nature of connectivity (i.e., the chronnectome; Calhoun et al., 2014) we explored the time-dependent changes of effective connectivity during a period (200-400 ms) where adding semantic-feature information improves modeling and classifying visual objects, at 50 ms increments. First, we observed a graded involvement of backward connections, that became active beyond 200 ms. Second, we found that semantic demands caused a suppressive effect in the backward connection from inferior frontal cortex (IFC) to occipitotemporal cortex over time. These results complement those from previous studies underscoring the role of IFC as a common source of top-down modulation, which drives recurrent interactions with more posterior regions during visual object recognition. Crucially, our study revealed the inhibitory modulation of this interaction in situations that place greater demands on the conceptual system.

Dynamic information processing states revealed through neurocognitive models of object semantics

Recognising objects relies on highly dynamic, interactive brain networks to process multiple aspects of object information. To fully understand how different forms of information about objects are represented and processed in the brain requires a neurocognitive account of visual object recognition that combines a detailed cognitive model of semantic knowledge with a neurobiological model of visual object processing. Here we ask how specific cognitive factors are instantiated in our mental processes and how they dynamically evolve over time. We suggest that coarse semantic information, based on generic shared semantic knowledge, is rapidly extracted from visual inputs and is sufficient to drive rapid category decisions. Subsequent recurrent neural activity between the anterior temporal lobe and posterior fusiform supports the formation of object-specific semantic representations - a conjunctive process primarily driven by the perirhinal cortex. These object-specific representations require the integration of shared and distinguishing object properties and support the unique recognition of objects. We conclude that a valuable way of understanding the cognitive activity of the brain is though testing the relationship between specific cognitive measures and dynamic neural activity. This kind of approach allows us to move towards uncovering the information processing states of the brain and how they evolve over time.

The perirhinal cortex and conceptual processing: Effects of feature-based statistics following damage to the anterior temporal lobes

The anterior temporal lobe (ATL) plays a prominent role in models of semantic knowledge, although it remains unclear how the specific subregions within the ATL contribute to semantic memory. Patients with neurodegenerative diseases, like semantic dementia, have widespread damage to the ATL thus making inferences about the relationship between anatomy and cognition problematic. Here we take a detailed anatomical approach to ask which substructures within the ATL contribute to conceptual processing, with the prediction that the perirhinal cortex (PRc) will play a critical role for concepts that are more semantically confusable. We tested two patient groups, those with and without damage to the PRc, across two behavioural experiments - picture naming and word-picture matching. For both tasks, we manipulated the degree of semantic confusability of the concepts. By contrasting the performance of the two groups, along with healthy controls, we show that damage to the PRc results in worse performance in processing concepts with higher semantic confusability across both experiments. Further by correlating the degree of damage across anatomically defined regions of interest with performance, we find that PRc damage is related to performance for concepts with increased semantic confusability. Our results show that the PRc supports a necessary and crucial neurocognitve function that enables fine-grained conceptual processes to take place through the resolution of semantic confusability.

Inborn and experience-dependent models of categorical brain organization. A position paper

The present review aims to summarize the debate in contemporary neuroscience between inborn and experience-dependent models of conceptual representations that goes back to the description of category-specific semantic disorders for biological and artifact categories. Experience-dependent models suggest that categorical disorders are the by-product of the differential weighting of different sources of knowledge in the representation of biological and artifact categories. These models maintain that semantic disorders are not really category-specific, because they do not respect the boundaries between different categories. They also argue that the brain structures which are disrupted in a given type of category-specific semantic disorder should correspond to the areas of convergence of the sensory-motor information which play a major role in the construction of that category. Furthermore, they provide a simple interpretation of gender-related categorical effects and are supported by studies assessing the importance of prior experience in the cortical representation of objects On the other hand, inborn models maintain that category-specific semantic disorders reflect the disruption of innate brain networks, which are shaped by natural selection to allow rapid identification of objects that are very relevant for survival. From the empirical point of view, these models are mainly supported by observations of blind subjects, which suggest that visual experience is not necessary for the emergence of category-specificity in the ventral stream of visual processing. The weight of the data supporting experience-dependent and inborn models is thoroughly discussed, stressing the fact observations made in blind subjects are still the subject of intense debate. It is concluded that at the present state of knowledge it is not possible to choose between experience-dependent and inborn models of conceptual representations.

Functional correlates of preserved naming performance in amnestic Mild Cognitive Impairment

Naming abilities are typically preserved in amnestic Mild Cognitive Impairment (aMCI), a condition associated with increased risk of progression to Alzheimer's disease (AD). We compared the functional correlates of covert picture naming and word reading between a group of aMCI subjects and matched controls. Unimpaired picture naming performance was associated with more extensive activations, in particular involving the parietal lobes, in the aMCI group. In addition, in the condition associated with higher processing demands (blocks of categorically homogeneous items, living items), increased activity was observed in the aMCI group, in particular in the left fusiform gyrus. Graph analysis provided further evidence of increased modularity and reduced integration for the homogenous sets in the aMCI group. The functional modifications associated with preserved performance may reflect, in the case of more demanding tasks, compensatory mechanisms for the subclinical involvement of semantic processing areas by AD pathology.

Language disturbances associated to insular and entorhinal damage: study of a patient affected by herpetic encephalitis

The herpes simplex encephalitis (HSE) patient reported in this study presented a left hemisphere lesion limited to the left insula and to the left anterior parahippocampal region. The patient was followed longitudinally, focusing on the aphasia type, the language recovery, and the integrity of semantic representations. The language deficit was of fluent type, without phonological impairment, and showed a good but incomplete recovery after four months. A semantic impairment was possible at the onset, but recovered quickly and did not present a disproportionate impairment of living categories.

The end point of the ventral visual stream: face and non-face perceptual deficits following unilateral anterior temporal lobe damage

While it has been claimed that the ventral visual stream ends in the inferior aspects of the anterior temporal lobe (ATL), little is known about whether this region is important for visual perception. Here the performance of two patients with unilateral ATL damage was assessed across four visual perception tasks that parametrically varied stimulus similarity. Patients performed normally on difficult judgments of circle size or face age but were impaired on face identity and dot pattern matching tasks. Portions of the ATL, most likely the ventral surface, may have a functional role in visual perception tasks requiring detailed configural processing, most commonly used to discern facial identity.

Medial temporal and neocortical contributions to remote memory for semantic narratives: evidence from amnesia

Studies of remote memory for semantic facts and concepts suggest that hippocampal lesions lead to a temporally graded impairment that extends no more than ten years prior to the onset of amnesia. Such findings have led to the notion that once consolidated, semantic memories are represented neocortically and are no longer dependent on the hippocampus. Here, we examined the fate of well-established semantic narratives following medial temporal lobe (MTL) lesions. Seven amnesic patients, five with lesions restricted to the MTL and two with lesions extending into lateral temporal cortex (MTL+), were asked to recount fairy tales and bible stories that they rated as familiar. Narratives were scored for number and type of details, number of main thematic elements, and order in which the main thematic elements were recounted. In comparison to controls, patients with MTL lesions produced fewer details, but the number and order of main thematic elements generated was intact. By contrast, patients with MTL+ lesions showed a pervasive impairment, affecting not only the generation of details, but also the generation and ordering of main steps. These findings challenge the notion that, once consolidated, semantic memories are no longer dependent on the hippocampus for retrieval. Possible hippocampal contributions to the retrieval of detailed semantic narratives are discussed.

Object-specific semantic coding in human perirhinal cortex

Category-specificity has been demonstrated in the human posterior ventral temporal cortex for a variety of object categories. Although object representations within the ventral visual pathway must be sufficiently rich and complex to support the recognition of individual objects, little is known about how specific objects are represented. Here, we used representational similarity analysis to determine what different kinds of object information are reflected in fMRI activation patterns and uncover the relationship between categorical and object-specific semantic representations. Our results show a gradient of informational specificity along the ventral stream from representations of image-based visual properties in early visual cortex, to categorical representations in the posterior ventral stream. A key finding showed that object-specific semantic information is uniquely represented in the perirhinal cortex, which was also increasingly engaged for objects that are more semantically confusable. These findings suggest a key role for the perirhinal cortex in representing and processing object-specific semantic information that is more critical for highly confusable objects. Our findings extend current distributed models by showing coarse dissociations between objects in posterior ventral cortex, and fine-grained distinctions between objects supported by the anterior medial temporal lobes, including the perirhinal cortex, which serve to integrate complex object information.

The role of the left anterior temporal lobe in semantic composition vs. semantic memory

The left anterior temporal lobe (LATL) is robustly implicated in semantic processing by a growing body of literature. However, these results have emerged from two distinct bodies of work, addressing two different processing levels. On the one hand, the LATL has been characterized as a 'semantic hub׳ that binds features of concepts across a distributed network, based on results from semantic dementia and hemodynamic findings on the categorization of specific compared to basic exemplars. On the other, the LATL has been implicated in combinatorial operations in language, as shown by increased activity in this region associated with the processing of sentences and of basic phrases. The present work aimed to reconcile these two literatures by independently manipulating combination and concept specificity within a minimal MEG paradigm. Participants viewed simple nouns that denoted either low specificity (fish) or high specificity categories (trout) presented in either combinatorial (spotted fish/trout) or non-combinatorial contexts (xhsl fish/trout). By combining these paradigms from the two literatures, we directly compared the engagement of the LATL in semantic memory vs. semantic composition. Our results indicate that although noun specificity subtly modulates the LATL activity elicited by single nouns, it most robustly affects the size of the composition effect when these nouns are adjectivally modified, with low specificity nouns eliciting a much larger effect. We conclude that these findings are compatible with an account in which the specificity and composition effects arise from a shared mechanism of meaning specification.

Stimulus familiarity modulates functional connectivity of the perirhinal cortex and anterior hippocampus during visual discrimination of faces and objects

Recent research suggests that the medial temporal lobe (MTL) is involved in perception as well as in declarative memory. Amnesic patients with focal MTL lesions and semantic dementia patients showed perceptual deficits when discriminating faces and objects. Interestingly, these two patient groups showed different profiles of impairment for familiar and unfamiliar stimuli. For MTL amnesics, the use of familiar relative to unfamiliar stimuli improved discrimination performance. By contrast, patients with semantic dementia—a neurodegenerative condition associated with anterolateral temporal lobe damage—showed no such facilitation from familiar stimuli. Given that the two patient groups had highly overlapping patterns of damage to the perirhinal cortex, hippocampus, and temporal pole, the neuroanatomical substrates underlying their performance discrepancy were unclear. Here, we addressed this question with a multivariate reanalysis of the data presented by Barense et al. (2011), using functional connectivity to examine how stimulus familiarity affected the broader networks with which the perirhinal cortex, hippocampus, and temporal poles interact. In this study, healthy participants were scanned while they performed an odd-one-out perceptual task involving familiar and novel faces or objects. Seed-based analyses revealed that functional connectivity of the right perirhinal cortex and right anterior hippocampus was modulated by the degree of stimulus familiarity. For familiar relative to unfamiliar faces and objects, both right perirhinal cortex and right anterior hippocampus showed enhanced functional correlations with anterior/lateral temporal cortex, temporal pole, and medial/lateral parietal cortex. These findings suggest that in order to benefit from stimulus familiarity, it is necessary to engage not only the perirhinal cortex and hippocampus, but also a network of regions known to represent semantic information.

A perfusion fMRI investigation of thematic and categorical context effects in the spoken production of object names

The context in which objects are presented influences the speed at which they are named. We employed the blocked cyclic naming paradigm and perfusion functional magnetic resonance imaging (fMRI) to investigate the mechanisms responsible for interference effects reported for thematically and categorically related compared to unrelated contexts. Naming objects in categorically homogeneous contexts induced a significant interference effect that accumulated from the second cycle onwards. This interference effect was associated with significant perfusion signal decreases in left middle and posterior lateral temporal cortex and the hippocampus. By contrast, thematically homogeneous contexts facilitated naming latencies significantly in the first cycle and did not differ from heterogeneous contexts thereafter, nor were they associated with any perfusion signal changes compared to heterogeneous contexts. These results are interpreted as being consistent with an account in which the interference effect both originates and has its locus at the lexical level, with an incremental learning mechanism adapting the activation levels of target lexical representations following access. We discuss the implications of these findings for accounts that assume thematic relations can be active lexical competitors or assume mandatory involvement of top-down control mechanisms in interference effects during naming.

Representational similarity analysis reveals commonalities and differences in the semantic processing of words and objects

Understanding the meanings of words and objects requires the activation of underlying conceptual representations. Semantic representations are often assumed to be coded such that meaning is evoked regardless of the input modality. However, the extent to which meaning is coded in modality-independent or amodal systems remains controversial. We address this issue in a human fMRI study investigating the neural processing of concepts, presented separately as written words and pictures. Activation maps for each individual word and picture were used as input for searchlight-based multivoxel pattern analyses. Representational similarity analysis was used to identify regions correlating with low-level visual models of the words and objects and the semantic category structure common to both. Common semantic category effects for both modalities were found in a left-lateralized network, including left posterior middle temporal gyrus (LpMTG), left angular gyrus, and left intraparietal sulcus (LIPS), in addition to object- and word-specific semantic processing in ventral temporal cortex and more anterior MTG, respectively. To explore differences in representational content across regions and modalities, we developed novel data-driven analyses, based on k-means clustering of searchlight dissimilarity matrices and seeded correlation analysis. These revealed subtle differences in the representations in semantic-sensitive regions, with representations in LIPS being relatively invariant to stimulus modality and representations in LpMTG being uncorrelated across modality. These results suggest that, although both LpMTG and LIPS are involved in semantic processing, only the functional role of LIPS is the same regardless of the visual input, whereas the functional role of LpMTG differs for words and objects.