Conceptual object representations in human anterior temporal cortex

The primacy of taxonomic semantic organization over thematic semantic organization during picture naming

Different organizational structures have been argued to underlie semantic knowledge about concepts; taxonomic organization, based on shared features, and thematic organization based on co-occurrence in common scenes and scenarios. The goal of the current study is to examine which of the two organizational systems are more engaged in the semantic context of a picture naming task. To address this question, we examined the representational structure underlying the semantic space in different picture naming tasks by applying representational similarity analysis (RSA) to electroencephalography (EEG) datasets. In a series of experiments, EEG signals were collected while participants named pictures under different semantic contexts. Study 1 reanalyzes existing data from semantic contexts directing attention to taxonomic organization and semantic contexts that are not biased towards either taxonomic or thematic organization. In Study 2 we keep the stimuli the same and vary semantic contexts to draw attention to either taxonomic or thematic organization. The RSA approach allows us to examine the pairwise similarity in scalp-recorded amplitude patterns at each time point following the onset of the picture and relate it to theoretical taxonomic and thematic measures derived from computational models of semantics. Across all tasks, the similarity structure of scalp-recorded neural activity correlated better with taxonomic than thematic measures, in time windows associated with semantic processing. Most strikingly, we found that the scalp-recorded patterns of neural activity between taxonomically related items were more similar to each other than the scalp-recorded patterns of neural activity for thematically related or unrelated items, even in tasks that makes thematic information more salient. These results suggest that the principle semantic organization of these concepts during picture naming is taxonomic, at least in the context of picture naming.

MEG Evidence That Modality-Independent Conceptual Representations Contain Semantic and Visual Features

The semantic knowledge stored in our brains can be accessed from different stimulus modalities. For example, a picture of a cat and the word "cat" both engage similar conceptual representations. While existing research has found evidence for modality-independent representations, their content remains unknown. Modality-independent representations could be semantic, or they might also contain perceptual features. We developed a novel approach combining word/picture cross-condition decoding with neural network classifiers that learned latent modality-independent representations from MEG data (25 human participants, 15 females, 10 males). We then compared these representations to models representing semantic, sensory, and orthographic features. Results show that modality-independent representations correlate both with semantic and visual representations. There was no evidence that these results were due to picture-specific visual features or orthographic features automatically activated by the stimuli presented in the experiment. These findings support the notion that modality-independent concepts contain both perceptual and semantic representations.

Basal temporal language area revisited in Japanese language with a language function density map

We revisited the anatomo-functional characteristics of the basal temporal language area (BTLA), first described by Lüders et al. (1986), using electrical cortical stimulation (ECS) in the context of Japanese language and semantic networks. We recruited 11 patients with focal epilepsy who underwent chronic subdural electrode implantation and ECS mapping with multiple language tasks for presurgical evaluation. A semiquantitative language function density map delineated the anatomo-functional characteristics of the BTLA (66 electrodes, mean 3.8 cm from the temporal tip). The ECS-induced impairment probability was higher in the following tasks, listed in a descending order: spoken-word picture matching, picture naming, Kanji word reading, paragraph reading, spoken-verbal command, and Kana word reading. The anterior fusiform gyrus (FG), adjacent anterior inferior temporal gyrus (ITG), and the anterior end where FG and ITG fuse, were characterized by stimulation-induced impairment during visual and auditory tasks requiring verbal output or not, whereas the middle FG was characterized mainly by visual input. The parahippocampal gyrus was the least impaired of the three gyri in the basal temporal area. We propose that the BTLA has a functional gradient, with the anterior part involved in amodal semantic processing and the posterior part, especially the middle FG in unimodal semantic processing.

Neurological Effects of Repeated Blast Exposure in Special Operations Personnel

Exposure to blast overpressure has been a pervasive feature of combat-related injuries. Studies exploring the neurological correlates of repeated low-level blast exposure in career "breachers" demonstrated higher levels of tumor necrosis factor alpha (TNFα) and interleukin (IL)-6 and decreases in IL-10 within brain-derived extracellular vesicles (BDEVs). The current pilot study was initiated in partnership with the U.S. Special Operations Command (USSOCOM) to explore whether neuroinflammation is seen within special operators with prior blast exposure. Data were analyzed from 18 service members (SMs), inclusive of 9 blast-exposed special operators with an extensive career history of repeated blast exposures and 9 controls matched by age and duration of service. Neuroinflammation was assessed utilizing positron emission tomography (PET) imaging with [18F]DPA-714. Serum was acquired to assess inflammatory biomarkers within whole serum and BDEVs. The Blast Exposure Threshold Survey (BETS) was acquired to determine blast history. Both self-report and neurocognitive measures were acquired to assess cognition. Similarity-driven Multi-view Linear Reconstruction (SiMLR) was used for joint analysis of acquired data. Analysis of BDEVs indicated significant positive associations with a generalized blast exposure value (GBEV) derived from the BETS. SiMLR-based analyses of neuroimaging demonstrated exposure-related relationships between GBEV, PET-neuroinflammation, cortical thickness, and volume loss within special operators. Affected brain networks included regions associated with memory retrieval and executive functioning, as well as visual and heteromodal processing. Post hoc assessments of cognitive measures failed to demonstrate significant associations with GBEV. This emerging evidence suggests neuroinflammation may be a key feature of the brain response to blast exposure over a career in operational personnel. The common thread of neuroinflammation observed in blast-exposed populations requires further study.

Representation of event and object concepts in ventral anterior temporal lobe and angular gyrus

Semantic knowledge includes understanding of objects and their features and also understanding of the characteristics of events. The hub-and-spoke theory holds that these conceptual representations rely on multiple information sources that are integrated in a central hub in the ventral anterior temporal lobes. The dual-hub theory expands this framework with the claim that the ventral anterior temporal lobe hub is specialized for object representation, while a second hub in angular gyrus is specialized for event representation. To test these ideas, we used representational similarity analysis, univariate and psychophysiological interaction analyses of fMRI data collected while participants processed object and event concepts (e.g. "an apple," "a wedding") presented as images and written words. Representational similarity analysis showed that angular gyrus encoded event concept similarity more than object similarity, although the left angular gyrus also encoded object similarity. Bilateral ventral anterior temporal lobes encoded both object and event concept structure, and left ventral anterior temporal lobe exhibited stronger coding for events. Psychophysiological interaction analysis revealed greater connectivity between left ventral anterior temporal lobe and right pMTG, and between right angular gyrus and bilateral ITG and middle occipital gyrus, for event concepts compared to object concepts. These findings support the specialization of angular gyrus for event semantics, though with some involvement in object coding, but do not support ventral anterior temporal lobe specialization for object concepts.

Neural and behavioral signatures of the multidimensionality of manipulable object processing

Understanding how we recognize objects requires unravelling the variables that govern the way we think about objects and the neural organization of object representations. A tenable hypothesis is that the organization of object knowledge follows key object-related dimensions. Here, we explored, behaviorally and neurally, the multidimensionality of object processing. We focused on within-domain object information as a proxy for the decisions we typically engage in our daily lives - e.g., identifying a hammer in the context of other tools. We extracted object-related dimensions from subjective human judgments on a set of manipulable objects. We show that the extracted dimensions are cognitively interpretable and relevant - i.e., participants are able to consistently label them, and these dimensions can guide object categorization; and are important for the neural organization of knowledge - i.e., they predict neural signals elicited by manipulable objects. This shows that multidimensionality is a hallmark of the organization of manipulable object knowledge.

A dissociable functional relevance of theta- and beta-band activities during complex sensorimotor integration

Sensorimotor integration processes play a central role in daily life and require that different sources of sensory information become integrated: i.e. the information related to the object being under control of the agent (i.e. indicator) and the information about the goal of acting. Yet, how this is accomplished on a neurophysiological level is contentious. We focus on the role of theta- and beta-band activities and examine which neuroanatomical structures are involved. Healthy participants (n = 41) performed 3 consecutive pursuit-tracking EEG experiments in which the source of visual information available for tracking was varied (i.e. that of the indicator and the goal of acting). The initial specification of indicator dynamics is determined through beta-band activity in parietal cortices. When information about the goal was not accessible, but operating the indicator was required nevertheless, this incurred increased theta-band activity in the superior frontal cortex, signaling a higher need for control. Later, theta- and beta-band activities encode distinct information within the ventral processing stream: Theta-band activity is affected by the indicator information, while beta-band activity is affected by the information about the action goal. Complex sensorimotor integration is realized through a cascade of theta- and beta-band activities in a ventral-stream-parieto-frontal network.

Semantic feature production norms for manipulable objects

Feature generation tasks and feature databases are important for understanding how knowledge is organized in semantic memory, as they reflect not only the kinds of information that individuals hold about objects but also how objects are conceptually represented. Traditionally, semantic norms focus on a variety of object categories and, as a result, have a small number of concepts per semantic category. Here, our main goal is to create a more fine-grained feature database exclusively for one category of objects-manipulable objects. This database contributes to the understanding of within-category, content-specific processing. To achieve this, we asked 130 participants to freely generate features for 80 manipulable objects and another group of 32 participants to generate action features for the same objects. We then compared our databases with other published semantic norms and found high similarity between them. In our databases, we calculated the similarity between objects in terms of visual, functional, encyclopaedic, and action feature types using Spearman correlation, Baker's gamma index, and cophenetic correlation. We discovered that objects were grouped in a distinctive and meaningful way according to feature type. Finally, we tested the validity of our databases by asking three groups of participants to perform a feature verification experiment while manipulating production frequency. Our results demonstrate that participants can recognize and associate the features of our databases with specific manipulable objects. Participants were faster to verify high-frequency features than low-frequency features. Overall, our data provide important insights into how we process manipulable objects and can be used to further inform cognitive and neural theories of object processing and identification.

Category Trumps Shape as an Organizational Principle of Object Space in the Human Occipitotemporal Cortex

The organizational principles of the object space represented in the human ventral visual cortex are debated. Here we contrast two prominent proposals that, in addition to an organization in terms of animacy, propose either a representation related to aspect ratio (stubby-spiky) or to the distinction between faces and bodies. We designed a critical test that dissociates the latter two categories from aspect ratio and investigated responses from human fMRI (of either sex) and deep neural networks (BigBiGAN). Representational similarity and decoding analyses showed that the object space in the occipitotemporal cortex and BigBiGAN was partially explained by animacy but not by aspect ratio. Data-driven approaches showed clusters for face and body stimuli and animate-inanimate separation in the representational space of occipitotemporal cortex and BigBiGAN, but no arrangement related to aspect ratio. In sum, the findings go in favor of a model in terms of an animacy representation combined with strong selectivity for faces and bodies.SIGNIFICANCE STATEMENT We contrasted animacy, aspect ratio, and face-body as principal dimensions characterizing object space in the occipitotemporal cortex. This is difficult to test, as typically faces and bodies differ in aspect ratio (faces are mostly stubby and bodies are mostly spiky). To dissociate the face-body distinction from the difference in aspect ratio, we created a new stimulus set in which faces and bodies have a similar and very wide distribution of values along the shape dimension of the aspect ratio. Brain imaging (fMRI) with this new stimulus set showed that, in addition to animacy, the object space is mainly organized by the face-body distinction and selectivity for aspect ratio is minor (despite its wide distribution).

Angular Gyrus Responses Show Joint Statistical Dependence with Brain Regions Selective for Different Categories

Category selectivity is a fundamental principle of organization of perceptual brain regions. Human occipitotemporal cortex is subdivided into areas that respond preferentially to faces, bodies, artifacts, and scenes. However, observers need to combine information about objects from different categories to form a coherent understanding of the world. How is this multicategory information encoded in the brain? Studying the multivariate interactions between brain regions of male and female human subjects with fMRI and artificial neural networks, we found that the angular gyrus shows joint statistical dependence with multiple category-selective regions. Adjacent regions show effects for the combination of scenes and each other category, suggesting that scenes provide a context to combine information about the world. Additional analyses revealed a cortical map of areas that encode information across different subsets of categories, indicating that multicategory information is not encoded in a single centralized location, but in multiple distinct brain regions.SIGNIFICANCE STATEMENT Many cognitive tasks require combining information about entities from different categories. However, visual information about different categorical objects is processed by separate, specialized brain regions. How is the joint representation from multiple category-selective regions implemented in the brain? Using fMRI movie data and state-of-the-art multivariate statistical dependence based on artificial neural networks, we identified the angular gyrus encoding responses across face-, body-, artifact-, and scene-selective regions. Further, we showed a cortical map of areas that encode information across different subsets of categories. These findings suggest that multicategory information is not encoded in a single centralized location, but at multiple cortical sites which might contribute to distinct cognitive functions, offering insights to understand integration in a variety of domains.

Semantic cognition in healthy ageing: Neural signatures of representation and control mechanisms in naming typical and atypical objects

Effective use of conceptual knowledge engages semantic representation and control processes to access information in a goal-driven manner. Neuropsychological findings of patients presenting either degraded knowledge (e.g., semantic dementia) or disrupted control (e.g., semantic aphasia) converge with neuroimaging evidence from young adults, and delineate the neural segregation of representation and control mechanisms. However, there is still scarce research on the neurofunctional underpinnings of such mechanisms in healthy ageing. To address this, we conducted an fMRI study, wherein young and older adults performed a covert naming task of typical and atypical objects. Three main age-related differences were found. As shown by age group and typicality interactions, older adults exhibited overactivation during naming of atypical (e.g., avocado) relative to typical concepts in brain regions associated to semantic representation, including anterior and medial portions of left temporal lobe (respectively, ATL and MTG). This provides evidence for the reorganization of neural activity in these brain regions contingent to the enrichment of semantic repositories in older ages. The medial orbitofrontal gyrus was also overactivated, indicating that the processing of atypical concepts (relative to typical items) taxes additional control resources in the elderly. Increased activation in the inferior frontal gyrus (IFG) was observed in naming typical items (relative to atypical ones), but only for young adults. This suggests that naming typical items (e.g., strawberry) taxes more on control processes in younger ages, presumably due to the semantic competition set by other items that share multiple features with the target (e.g., raspberry, blackberry, cherry). Together, these results reveal the dynamic nature of semantic control interplaying with conceptual representations as people grow older, by indicating that distinct neural bases uphold semantic performance from young to older ages. These findings may be explained by neural compensation mechanisms coming into play to support neurocognitive changes in healthy ageing.

Flexible reuse of cortico-hippocampal representations during encoding and recall of naturalistic events

Although every life event is unique, there are considerable commonalities across events. However, little is known about whether or how the brain flexibly represents information about different event components at encoding and during remembering. Here, we show that different cortico-hippocampal networks systematically represent specific components of events depicted in videos, both during online experience and during episodic memory retrieval. Regions of an Anterior Temporal Network represented information about people, generalizing across contexts, whereas regions of a Posterior Medial Network represented context information, generalizing across people. Medial prefrontal cortex generalized across videos depicting the same event schema, whereas the hippocampus maintained event-specific representations. Similar effects were seen in real-time and recall, suggesting reuse of event components across overlapping episodic memories. These representational profiles together provide a computationally optimal strategy to scaffold memory for different high-level event components, allowing efficient reuse for event comprehension, recollection, and imagination.

Distinct but cooperating brain networks supporting semantic cognition

Semantic cognition is a complex multifaceted brain function involving multiple processes including sensory, semantic, and domain-general cognitive systems. However, it remains unclear how these systems cooperate with each other to achieve effective semantic cognition. Here, we used independent component analysis (ICA) to investigate the functional brain networks that support semantic cognition. We used a semantic judgment task and a pattern-matching control task, each with 2 levels of difficulty, to disentangle task-specific networks from domain-general networks. ICA revealed 2 task-specific networks (the left-lateralized semantic network [SN] and a bilateral, extended semantic network [ESN]) and domain-general networks including the frontoparietal network (FPN) and default mode network (DMN). SN was coupled with the ESN and FPN but decoupled from the DMN, whereas the ESN was synchronized with the FPN alone and did not show a decoupling with the DMN. The degree of decoupling between the SN and DMN was associated with semantic task performance, with the strongest decoupling for the poorest performing participants. Our findings suggest that human higher cognition is achieved by the multiple brain networks, serving distinct and shared cognitive functions depending on task demands, and that the neural dynamics between these networks may be crucial for efficient semantic cognition.

Imagining the future self through thought experiments

The ability of the mind to conceptualize what is not present is essential. It allows us to reason counterfactually about what might have happened had events unfolded differently or had another course of action been taken. It allows us to think about what might happen - to perform 'Gedankenexperimente' (thought experiments) - before we act. However, the cognitive and neural mechanisms mediating this ability are poorly understood. We suggest that the frontopolar cortex (FPC) keeps track of and evaluates alternative choices (what we might have done), whereas the anterior lateral prefrontal cortex (alPFC) compares simulations of possible future scenarios (what we might do) and evaluates their reward values. Together, these brain regions support the construction of suppositional scenarios.

Gesture profiles distinguish primary progressive aphasia variants

Primary progressive aphasia (PPA) is a neurodegenerative syndrome characterized by progressive language deficits. There are three main variants of PPA - semantic (svPPA), logopenic (lvPPA), and nonfluent (nfvPPA) - that can be challenging to distinguish. Limb praxis may also be affected in PPA, but it is unclear whether different variants of PPA are associated with differences in gesture production. Prior research with neurotypical individuals indicates that the left temporal lobe is a critical locus of manipulable object and hand posture representations. Moreover, when imitating gestures, individuals whose strokes include the left temporal lobe show reduced benefit of gesture meaning and disproportionate impairment in hand posture as compared to arm kinematics. We tested the hypothesis that svPPA - who typically exhibit primarily temporal lobe atrophy - would differentially show these expected patterns of gesture imitation performance. Nineteen participants with PPA completed meaningful and meaningless gesture imitation tasks, and performance was scored for hand posture and arm kinematics accuracy. Generalized logistic mixed-effect regression models controlling for dementia severity showed overall benefits from gesture meaning, and greater impairments in hand posture than arm kinematics. We also found that svPPA participants were the most impaired in gesture imitation overall. Critically, there was also a significant three-way interaction of group, meaning, and gesture component: only svPPA participants showed relative impairments of hand posture for meaningful gestures as well as meaningless gestures. Thus, unlike lvPPA and nfvPPA, the hand postures of svPPA failed to benefit from gesture meaning. This research extends prior findings on the role of the temporal lobe in hand posture representations associated with manipulable objects, and is the first to indicate that there may be distinct gesture imitation patterns as a function of PPA variant. Characterizing componential gesture deficits in PPA may help to inform differential diagnosis, compensatory communication strategies, and cognitive praxis models of PPA.

Grounding Context in Embodied Cognitive Robotics

Biological agents are context-dependent systems that exhibit behavioral flexibility. The internal and external information agents process, their actions, and emotions are all grounded in the context within which they are situated. However, in the field of cognitive robotics, the concept of context is far from being clear with most studies making little to no reference to it. The aim of this paper is to provide an interpretation of the notion of context and its core elements based on different studies in natural agents, and how these core contextual elements have been modeled in cognitive robotics, to introduce a new hypothesis about the interactions between these contextual elements. Here, global context is categorized as agent-related, environmental, and task-related context. The interaction of their core elements, allows agents to first select self-relevant tasks depending on their current needs, or for learning and mastering their environment through exploration. Second, to perform a task and continuously monitor its performance. Third, to abandon a task in case its execution is not going as expected. Here, the monitoring of prediction error, the difference between sensorimotor predictions and incoming sensory information, is at the core of behavioral flexibility during situated action cycles. Additionally, monitoring prediction error dynamics and its comparison with the expected reduction rate should indicate the agent its overall performance on executing the task. Sensitivity to performance evokes emotions that function as the driving element for autonomous behavior which, at the same time, depends on the processing of the interacting core elements. Taking all these into account, an interactionist model of contexts and their core elements is proposed. The model is embodied, affective, and situated, by means of the processing of the agent-related and environmental core contextual elements. Additionally, it is grounded in the processing of the task-related context and the associated situated action cycles during task execution. Finally, the model proposed here aims to guide how artificial agents should process the core contextual elements of the agent-related and environmental context to give rise to the task-related context, allowing agents to autonomously select a task, its planning, execution, and monitoring for behavioral flexibility.

The role of the anterior temporal cortex in action: evidence from fMRI multivariate searchlight analysis during real object grasping

Intelligent manipulation of handheld tools marks a major discontinuity between humans and our closest ancestors. Here we identified neural representations about how tools are typically manipulated within left anterior temporal cortex, by shifting a searchlight classifier through whole-brain real action fMRI data when participants grasped 3D-printed tools in ways considered typical for use (i.e., by their handle). These neural representations were automatically evocated as task performance did not require semantic processing. In fact, findings from a behavioural motion-capture experiment confirmed that actions with tools (relative to non-tool) incurred additional processing costs, as would be suspected if semantic areas are being automatically engaged. These results substantiate theories of semantic cognition that claim the anterior temporal cortex combines sensorimotor and semantic content for advanced behaviours like tool manipulation.

Language systems from lesion-symptom mapping in aphasia: A meta-analysis of voxel-based lesion mapping studies

•

Meta-analysis of 2,007 individuals with aphasia from 25 voxel-based lesion mapping studies.

•

Distinctive patterns of lesions in aphasia are associated with different language functions.

•

The patterns of lesion in aphasia support the dual pathway model of language processing.

Background

Aphasia is one of the most common causes of post-stroke disabilities. As the symptoms and impact of post-stroke aphasia are heterogeneous, it is important to understand how topographical lesion heterogeneity in patients with aphasia is associated with different domains of language impairments. Here, we aim to provide a comprehensive overview of neuroanatomical basis in post-stroke aphasia through coordinate based meta-analysis of voxel-based lesion-symptom mapping studies.

Methods

We performed a meta-analysis of lesion-symptom mapping studies in post-stroke aphasia. We obtained coordinate-based structural neuroimaging data for 2,007 individuals with aphasia from 25 studies that met predefined inclusion criteria.

Results

Overall, our results revealed that the distinctive patterns of lesions in aphasia are associated with different language functions and tasks. Damage to the insular-motor areas impaired speech with preserved comprehension and a similar pattern was observed when the lesion covered the insular-motor and inferior parietal lobule. Lesions in the frontal area severely impaired speaking with relatively good comprehension. The repetition-selective deficits only arise from lesions involving the posterior superior temporal gyrus. Damage in the anterior-to-posterior temporal cortex was associated with semantic deficits.

Conclusion

The association patterns of lesion topography and specific language deficits provide key insights into the specific underlying language pathways. Our meta-analysis results strongly support the dual pathway model of language processing, capturing the link between the different symptom complexes of aphasias and the different underlying location of damage.

Lexical Frequency and Sentence Context Influence the Brain's Response to Single Words

Typical adults read remarkably quickly. Such fast reading is facilitated by brain processes that are sensitive to both word frequency and contextual constraints. It is debated as to whether these attributes have additive or interactive effects on language processing in the brain. We investigated this issue by analysing existing magnetoencephalography data from 99 participants reading intact and scrambled sentences. Using a cross-validated model comparison scheme, we found that lexical frequency predicted the word-by-word elicited MEG signal in a widespread cortical network, irrespective of sentential context. In contrast, index (ordinal word position) was more strongly encoded in sentence words, in left front-temporal areas. This confirms that frequency influences word processing independently of predictability, and that contextual constraints affect word-by-word brain responses. With a conservative multiple comparisons correction, only the interaction between lexical frequency and surprisal survived, in anterior temporal and frontal cortex, and not between lexical frequency and entropy, nor between lexical frequency and index. However, interestingly, the uncorrected index × frequency interaction revealed an effect in left frontal and temporal cortex that reversed in time and space for intact compared to scrambled sentences. Finally, we provide evidence to suggest that, in sentences, lexical frequency and predictability may independently influence early (<150 ms) and late stages of word processing, but also interact during late stages of word processing (>150-250 ms), thus helping to converge previous contradictory eye-tracking and electrophysiological literature. Current neurocognitive models of reading would benefit from accounting for these differing effects of lexical frequency and predictability on different stages of word processing.

Analogy-Related Information Can Be Accessed by Simple Addition and Subtraction of fMRI Activation Patterns, Without Participants Performing any Analogy Task

Analogical reasoning, for example, inferring that teacher is to chalk as mechanic is to wrench, plays a fundamental role in human cognition. However, whether brain activity patterns of individual words are encoded in a way that could facilitate analogical reasoning is unclear. Recent advances in computational linguistics have shown that information about analogical problems can be accessed by simple addition and subtraction of word embeddings (e.g., wrench = mechanic + chalk - teacher). Critically, this property emerges in artificial neural networks that were not trained to produce analogies but instead were trained to produce general-purpose semantic representations. Here, we test whether such emergent property can be observed in representations in human brains, as well as in artificial neural networks. fMRI activation patterns were recorded while participants viewed isolated words but did not perform analogical reasoning tasks. Analogy relations were constructed from word pairs that were categorically or thematically related, and we tested whether the predicted fMRI pattern calculated with simple arithmetic was more correlated with the pattern of the target word than other words. We observed that the predicted fMRI patterns contain information about not only the identity of the target word but also its category and theme (e.g., teaching-related). In summary, this study demonstrated that information about analogy questions can be reliably accessed with the addition and subtraction of fMRI patterns, and that, similar to word embeddings, this property holds for task-general patterns elicited when participants were not explicitly told to perform analogical reasoning.

Human Primary Olfactory Amygdala Subregions Form Distinct Functional Networks, Suggesting Distinct Olfactory Functions

Three subregions of the amygdala receive monosynaptic projections from the olfactory bulb, making them part of the primary olfactory cortex. These primary olfactory areas are located at the anterior-medial aspect of the amygdala and include the medial amygdala (MeA), cortical amygdala (CoA), and the periamygdaloid complex (PAC). The vast majority of research on the amygdala has focused on the larger basolateral and basomedial subregions, which are known to be involved in implicit learning, threat responses, and emotion. Fewer studies have focused on the MeA, CoA, and PAC, with most conducted in rodents. Therefore, our understanding of the functions of these amygdala subregions is limited, particularly in humans. Here, we first conducted a review of existing literature on the MeA, CoA, and PAC. We then used resting-state fMRI and unbiased k-means clustering techniques to show that the anatomical boundaries of human MeA, CoA, and PAC accurately parcellate based on their whole-brain resting connectivity patterns alone, suggesting that their functional networks are distinct, relative both to each other and to the amygdala subregions that do not receive input from the olfactory bulb. Finally, considering that distinct functional networks are suggestive of distinct functions, we examined the whole-brain resting network of each subregion and speculated on potential roles that each region may play in olfactory processing. Based on these analyses, we speculate that the MeA could potentially be involved in the generation of rapid motor responses to olfactory stimuli (including fight/flight), particularly in approach/avoid contexts. The CoA could potentially be involved in olfactory-related reward processing, including learning and memory of approach/avoid responses. The PAC could potentially be involved in the multisensory integration of olfactory information with other sensory systems. These speculations can be used to form the basis of future studies aimed at clarifying the olfactory functions of these under-studied primary olfactory areas.

A Data-Driven Functional Mapping of the Anterior Temporal Lobes

Although the anterior temporal lobe (ATL) comprises several anatomic and functional subdivisions, it is often reduced to a homogeneous theoretical entity, such as a domain-general convergence zone, or "hub," for semantic information. Methodological limitations are largely to blame for the imprecise mapping of function to structure in the ATL. There are two major obstacles to using fMRI to identify the precise functional organization of the ATL: the difficult choice of stimuli and tasks to activate, and dissociate, specific regions within the ATL; and poor signal quality because of magnetic field distortions near the sinuses. To circumvent these difficulties, we developed a data-driven parcellation routine using resting-state fMRI data (24 females, 64 males) acquired using a sequence that was optimized to enhance signal in the ATL. Focusing on patterns of functional connectivity between each ATL voxel and the rest of the brain, we found that the ATL comprises at least 34 distinct functional parcels that are arranged into bands along the lateral and ventral cortical surfaces, extending from the posterior temporal lobes into the temporal poles. In addition, the anterior region of the fusiform gyrus, most often cited as the location of the semantic hub, was found to be part of a domain-specific network associated with face and social processing, rather than a domain-general semantic hub. These findings offer a fine-grained functional map of the ATL and offer an initial step toward using more precise language to describe the locations of functional responses in this heterogeneous region of human cortex.SIGNIFICANCE STATEMENT The functional role of the anterior aspects of the temporal lobes (ATL) is a contentious issue. While it is likely that different regions within the ATL subserve unique cognitive functions, most studies revert to vaguely referring to particular functional regions as "the ATL," and, thus, the mapping of function to anatomy remains unclear. We used resting-state fMRI connectivity patterns between the ATL and the rest of the brain to reveal that the ATL comprises at least 34 distinct functional parcels that are organized into a three-level functional hierarchy. These results provide a detailed functional map of the anterior temporal lobes that can guide future research on how distinct regions within the ATL support diverse cognitive functions.

Neural dynamics of semantic categorization in semantic variant of primary progressive aphasia

Semantic representations are processed along a posterior-to-anterior gradient reflecting a shift from perceptual (e.g., it has eight legs) to conceptual (e.g., venomous spiders are rare) information. One critical region is the anterior temporal lobe (ATL): patients with semantic variant primary progressive aphasia (svPPA), a clinical syndrome associated with ATL neurodegeneration, manifest a deep loss of semantic knowledge. We test the hypothesis that svPPA patients perform semantic tasks by over-recruiting areas implicated in perceptual processing. We compared MEG recordings of svPPA patients and healthy controls during a categorization task. While behavioral performance did not differ, svPPA patients showed indications of greater activation over bilateral occipital cortices and superior temporal gyrus, and inconsistent engagement of frontal regions. These findings suggest a pervasive reorganization of brain networks in response to ATL neurodegeneration: the loss of this critical hub leads to a dysregulated (semantic) control system, and defective semantic representations are seemingly compensated via enhanced perceptual processing.

The neural bases of resilient semantic system: evidence of variable neuro-displacement in cognitive systems

The purpose of this study was to explore an important research goal in cognitive and clinical neuroscience: What are the neurocomputational mechanisms that make cognitive systems "well engineered" and thus resilient across a range of performance demands and to mild levels of perturbation or even damage? A new hypothesis called 'variable neuro-displacement' suggests that cognitive systems are formed with dynamic, spare processing capacity, which balances energy consumption against performance requirements and can be resilient to changes in performance demands. Here, we tested this hypothesis by investigating the neural dynamics of the semantic system by manipulating performance demand. The performance demand was manipulated with two levels of task difficulty (easy vs. hard) in two different ways (stimulus type and response timing). We found that the demanding semantic processing increased regional activity in both the domain-specific semantic representational system (anterior temporal lobe) and the parallel executive control networks (prefrontal, posterior temporal, and parietal regions). Functional connectivity between these regions was also increased during demanding semantic processing and these increases were related to better semantic task performance. Our results suggest that semantic cognition is made resilient by flexible, dynamic changes including increased regional activity and functional connectivity across both domain-specific and domain-general systems. It reveals the intrinsic resilience-related mechanisms of semantic cognition, mimicking alterations caused by perturbation or brain damage. Our findings provide a strong implication that the intrinsic mechanisms of a well-engineered semantic system might be attributed to the compensatory functional alterations in the impaired brain.

A network linking scene perception and spatial memory systems in posterior cerebral cortex

The neural systems supporting scene-perception and spatial-memory systems of the human brain are well-described. But how do these neural systems interact? Here, using fine-grained individual-subject fMRI, we report three cortical areas of the human brain, each lying immediately anterior to a region of the scene perception network in posterior cerebral cortex, that selectively activate when recalling familiar real-world locations. Despite their close proximity to the scene-perception areas, network analyses show that these regions constitute a distinct functional network that interfaces with spatial memory systems during naturalistic scene understanding. These "place-memory areas" offer a new framework for understanding how the brain implements memory-guided visual behaviors, including navigation.

Enhancing vs. inhibiting semantic performance with transcranial magnetic stimulation over the anterior temporal lobe: Frequency- and task-specific effects

Accumulating, converging evidence indicates that the anterior temporal lobe (ATL) appears to be the transmodal hub for semantic representation. A series of repetitive transcranial magnetic stimulation (rTMS) investigations utilizing the ‘virtual lesion’ approach have established the brain-behavioural relationship between the ATL and semantic processing by demonstrating that inhibitory rTMS over the ATL induced impairments in semantic performance in healthy individuals. However, a growing body of rTMS studies suggest that rTMS might also be a tool for cognitive enhancement and rehabilitation, though there has been no previous exploration in semantic cognition. Here, we explored a potential role of rTMS in enhancing and inhibiting semantic performance with contrastive rTMS protocols (1 Hz vs. 20 Hz) by controlling practice effects. Twenty-one healthy participants were recruited and performed an object category judgement task and a pattern matching task serving as a control task before and after the stimulation over the ATL (1 Hz, 20 Hz, and sham). A task familiarization procedure was performed prior to the experiment in order to establish a ‘stable baseline’ prior to stimulation and thus minimize practice effect. Our results demonstrated that it is possible to modulate semantic performance positively or negatively depending on the ATL stimulation frequency: 20 Hz rTMS was optimal for facilitating cortical processing (faster RT in a semantic task) contrasting with diminished semantic performance after 1 Hz rTMS. In addition to cementing the importance of the ATL to semantic representation, our findings suggest that 20 Hz rTMS leads to semantic enhancement in healthy individuals and potentially could be used for patients with semantic impairments as a therapeutic tool.

Within-category representational stability through the lens of manipulable objects

Our ability to recognize an object amongst many exemplars is one of our most important features, and one that putatively distinguishes humans from non-human animals and potentially from (current) computational and artificial intelligence models. We can recognize objects consistently regardless of when we see them suggesting that we have stable representations across time and different contexts. Importantly, little is known about how humans can replicate within-category object representations across time. Here, we investigate neural stability of within-category object representations by computing the similarity between representational geometries of activity patterns for 80 images of tools obtained on different functional magnetic resonance imaging (fMRI) scanning days. We show that within-category representational stability is observable in regions that span lateral and ventral temporal cortex, inferior and superior parietal cortex, and premotor cortex - regions typically associated with tool processing and visuospatial processing. We then focus on what kinds of representations best explain the representational geometries within these regions. We test the similarity of these geometries with those coming from the different layers of a convolutional neural network, and those coming from perceived and veridical visual similarity models. We find that regions supporting within-category representational stability show stronger relationship with higher-level visual/semantic features, suggesting that neural replicability is derived from perceived and higher-level visual information. Within category representational stability may thus originate from long-range cross talk between category-specific regions (and in this case strongly within ventral and lateral temporal cortex) over more abstract, rather than veridical/lower-level, visual (sensorial) representations, and perhaps in the service of object-centered representations.

Knowing what you need to know in advance: The neural processes underpinning flexible semantic retrieval of thematic and taxonomic relations

Semantic retrieval is flexible, allowing us to focus on subsets of features and associations that are relevant to the current task or context: for example, we use taxonomic relations to locate items in the supermarket (carrots are a vegetable), but thematic associations to decide which tools we need when cooking (carrot goes with peeler). We used fMRI to investigate the neural basis of this form of semantic flexibility; in particular, we asked how retrieval unfolds differently when participants have advanced knowledge of the type of link to retrieve between concepts (taxonomic or thematic). Participants performed a semantic relatedness judgement task: on half the trials, they were cued to search for a taxonomic or thematic link, while on the remaining trials, they judged relatedness without knowing which type of semantic relationship would be relevant. Left inferior frontal gyrus showed greater activation when participants knew the trial type in advance. An overlapping region showed a stronger response when the semantic relationship between the items was weaker, suggesting this structure supports both top-down and bottom-up forms of semantic control. Multivariate pattern analysis further revealed that the neural response in left inferior frontal gyrus reflects goal information related to different conceptual relationships. Top-down control specifically modulated the response in visual cortex: when the goal was unknown, there was greater deactivation to the first word, and greater activation to the second word. We conclude that top-down control of semantic retrieval is primarily achieved through the gating of task-relevant 'spoke' regions.

Distinct Representational Structure and Localization for Visual Encoding and Recall during Visual Imagery

During memory recall and visual imagery, reinstatement is thought to occur as an echoing of the neural patterns during encoding. However, the precise information in these recall traces is relatively unknown, with previous work primarily investigating either broad distinctions or specific images, rarely bridging these levels of information. Using ultra-high-field (7T) functional magnetic resonance imaging with an item-based visual recall task, we conducted an in-depth comparison of encoding and recall along a spectrum of granularity, from coarse (scenes, objects) to mid (e.g., natural, manmade scenes) to fine (e.g., living room, cupcake) levels. In the scanner, participants viewed a trial-unique item, and after a distractor task, visually imagined the initial item. During encoding, we observed decodable information at all levels of granularity in category-selective visual cortex. In contrast, information during recall was primarily at the coarse level with fine-level information in some areas; there was no evidence of mid-level information. A closer look revealed segregation between voxels showing the strongest effects during encoding and those during recall, and peaks of encoding-recall similarity extended anterior to category-selective cortex. Collectively, these results suggest visual recall is not merely a reactivation of encoding patterns, displaying a different representational structure and localization from encoding, despite some overlap.

A case study investigating the role of the anterior temporal lobes in general semantics and semantics specific to persons, emotions and social conceptual knowledge

The role of the anterior temporal lobes (ATLs) in semantic representation remains still much debated. Long thought to support domain-general semantic processing, recent accounts have alternatively suggested that they may be preferentially involved in the processing of person-related semantic knowledge. Several studies have supported such a distinction, but few have either examined both types of semantic processing together, or considered the role of potentially important confounding variables. Here, we address these issues by investigating both domain-general and person-specific semantic processing in a patient with focal ATL damage. The patient presents with dense anterograde and retrograde amnesia. Performance was impaired on tests of general semantic knowledge, but most striking deficits were for person-related semantics, including recognition and identification, knowledge of emotions and social conceptual knowledge. This unique case provides compelling evidence that, in addition to the role in general semantic knowledge, the ATLs are critical for person-related semantics.

Transforming the Concept of Memory Reactivation

Reactivation refers to the phenomenon wherein patterns of neural activity expressed during perceptual experience are re-expressed at a later time, a putative neural marker of memory. Reactivation of perceptual content has been observed across many cortical areas and correlates with objective and subjective expressions of memory in humans. However, because reactivation emphasizes similarities between perceptual and memory-based representations, it obscures differences in how perceptual events and memories are represented. Here, we highlight recent evidence of systematic differences in how (and where) perceptual events and memories are represented in the brain. We argue that neural representations of memories are best thought of as spatially transformed versions of perceptual representations. We consider why spatial transformations occur and identify critical questions for future research.

Psychopathy is associated with fear-specific reductions in neural activity during affective perspective-taking

Psychopathic individuals are notorious for their callous disregard for others' emotions. Prior research has linked psychopathy to deficits in affective mechanisms underlying empathy (e.g., affective sharing), yet research relating psychopathy to cognitive mechanisms underlying empathy (e.g., affective perspective-taking and Theory of Mind) requires further clarification. To elucidate the neurobiology of cognitive mechanisms of empathy in psychopathy, we administered an fMRI task and tested for global as well as emotion-specific deficits in affective perspective-taking. Adult male incarcerated offenders (N = 94) viewed images of two people interacting, with one individual's face obscured by a shape. Participants were cued to either identify the emotion of the obscured individual or identify the shape from one of two emotion or shape choices presented on each trial. Target emotions included anger, fear, happiness, sadness, and neutral. Contrary to predictions, psychopathy was unrelated to neural activity in the Affective Perspective-taking > Shape contrast. In line with predictions, psychopathy was negatively related to task accuracy during affective perspective-taking for fear, happiness, and sadness. Psychopathy was related to reduced hemodynamic activity exclusively during fear perspective-taking in several areas: left anterior insula extending into posterior orbitofrontal cortex, right precuneus, left superior parietal lobule, and left superior occipital cortex. Although much prior research has emphasized psychopathy-related abnormalities in affective mechanisms mediating empathy, current results add to growing evidence of psychopathy-related abnormalities in a cognitive mechanism related to empathy. These findings highlight brain regions that are hypoactive in psychopathy when explicitly processing another's fear.

The Effect of Object Type on Building Scene Imagery-an MEG Study

Previous studies have reported that some objects evoke a sense of local three-dimensional space (space-defining; SD), while others do not (space-ambiguous; SA), despite being imagined or viewed in isolation devoid of a background context. Moreover, people show a strong preference for SD objects when given a choice of objects with which to mentally construct scene imagery. When deconstructing scenes, people retain significantly more SD objects than SA objects. It, therefore, seems that SD objects might enjoy a privileged role in scene construction. In the current study, we leveraged the high temporal resolution of magnetoencephalography (MEG) to compare the neural responses to SD and SA objects while they were being used to build imagined scene representations, as this has not been examined before using neuroimaging. On each trial, participants gradually built a scene image from three successive auditorily-presented object descriptions and an imagined 3D space. We then examined the neural dynamics associated with the points during scene construction when either SD or SA objects were being imagined. We found that SD objects elicited theta changes relative to SA objects in two brain regions, the right ventromedial prefrontal cortex (vmPFC) and the right superior temporal gyrus (STG). Furthermore, using dynamic causal modeling, we observed that the vmPFC drove STG activity. These findings may indicate that SD objects serve to activate schematic and conceptual knowledge in vmPFC and STG upon which scene representations are then built.

Barking up the right tree: Univariate and multivariate fMRI analyses of homonym comprehension

Homonyms are a critical test case for investigating how the brain resolves ambiguity in language and, more generally, how context influences semantic processing. Previous neuroimaging studies have associated processing of homonyms with greater engagement of regions involved in executive control of semantic processing. However, the precise role of these areas and the involvement of semantic representational regions in homonym comprehension remain elusive. We addressed this by combining univariate and multivariate fMRI analyses of homonym processing. We tested whether multi-voxel activation patterns could discriminate between presentations of the same homonym in different contexts (e.g., bark following tree vs. bark following dog). The ventral anterior temporal lobe, implicated in semantic representation but not previously in homonym comprehension, showed this meaning-specific coding, despite not showing increased mean activation for homonyms. Within inferior frontal gyrus (IFG), a key site for semantic control, there was a dissociation between pars orbitalis, which also showed meaning-specific coding, and pars triangularis, which discriminated more generally between semantically related and unrelated word pairs. IFG effects were goal-dependent, only occurring when the task required semantic decisions, in line with a top-down control function. Finally, posterior middle temporal cortex showed a hybrid pattern of responses, supporting the idea that it acts as an interface between semantic representations and the control system. The study provides new evidence for context-dependent coding in the semantic system and clarifies the role of control regions in processing ambiguity. It also highlights the importance of combining univariate and multivariate neuroimaging data to fully elucidate the role of a brain region in semantic cognition.

Prior knowledge promotes hippocampal separation but cortical assimilation in the left inferior frontal gyrus

An adaptive memory system rarely learns information tabula rasa, but rather builds on prior knowledge to facilitate learning. How prior knowledge influences the neural representation of novel associations remains unknown. Here, participants associated pairs of faces in two conditions: a famous, highly familiar face with a novel face or two novel faces while undergoing fMRI. We examine multivoxel activity patterns corresponding to individual faces before and after learning. The activity patterns representing members of famous-novel pairs becomes separated in the hippocampus, that is, more distinct from one another through learning, in striking contrast to paired novel faces that become similar. In the left inferior frontal gyrus, however, prior knowledge leads to integration, and in a specific direction: the representation of the novel face becomes similar to that of the famous face after learning, suggesting assimilation of new into old memories. We propose that hippocampal separation might resolve interference between existing and newly learned information, allowing cortical assimilation. Thus, associative learning with versus without prior knowledge relies on radically different computations.

Prior knowledge strongly impacts new learning, but its influence on the neural representation of novel information is unknown. Here, the authors show multiple neural codes for learning: prior knowledge leads to integrated cortical representations, while promoting hippocampal separation.

Cortical network responses map onto data-driven features that capture visual semantics of movie fragments

Research on how the human brain extracts meaning from sensory input relies in principle on methodological reductionism. In the present study, we adopt a more holistic approach by modeling the cortical responses to semantic information that was extracted from the visual stream of a feature film, employing artificial neural network models. Advances in both computer vision and natural language processing were utilized to extract the semantic representations from the film by combining perceptual and linguistic information. We tested whether these representations were useful in studying the human brain data. To this end, we collected electrocorticography responses to a short movie from 37 subjects and fitted their cortical patterns across multiple regions using the semantic components extracted from film frames. We found that individual semantic components reflected fundamental semantic distinctions in the visual input, such as presence or absence of people, human movement, landscape scenes, human faces, etc. Moreover, each semantic component mapped onto a distinct functional cortical network involving high-level cognitive regions in occipitotemporal, frontal and parietal cortices. The present work demonstrates the potential of the data-driven methods from information processing fields to explain patterns of cortical responses, and contributes to the overall discussion about the encoding of high-level perceptual information in the human brain.

Dynamic activity patterns in the anterior temporal lobe represents object semantics

The anterior temporal lobe (ATL) is considered a crucial area for the representation of transmodal concepts. Recent evidence suggests that specific regions within the ATL support the representation of individual object concepts, as shown by studies combining multivariate analysis methods and explicit measures of semantic knowledge. This research looks to further our understanding by probing conceptual representations at a spatially and temporally resolved neural scale. Representational similarity analysis was applied to human intracranial recordings from anatomically defined lateral to medial ATL sub-regions. Neural similarity patterns were tested against semantic similarity measures, where semantic similarity was defined by a hybrid corpus-based and feature-based approach. Analyses show that the perirhinal cortex, in the medial ATL, significantly related to semantic effects around 200 to 400 ms, and were greater than more lateral ATL regions. Further, semantic effects were present in low frequency (theta and alpha) oscillatory phase signals. These results provide converging support that more medial regions of the ATL support the representation of basic-level visual object concepts within the first 400 ms, and provide a bridge between prior fMRI and MEG work by offering detailed evidence for the presence of conceptual representations within the ATL.

Intracranial-EEG evidence for medial temporal pole driving amygdala activity induced by multi-modal emotional stimuli

The temporal pole (TP) is an associative cortical region required for complex cognitive functions such as social and emotional cognition. However, mapping the TP with functional magnetic resonance imaging is technically challenging and thus understanding its interaction with other key emotional circuitry, such as the amygdala, remains elusive. We exploited the unique advantages of stereo-electroencephalography (sEEG) to assess the responses of the TP and the amygdala during the perception of emotionally salient stimuli of pictures, music and movies. These stimuli consistently elicited high gamma responses (70-140 Hz) in both the TP and the amygdala, accompanied by functional connectivity in the low frequency range (2-12 Hz). Computational analyses suggested that the TP drove this effect in the theta frequency range, modulated by the emotional valence of the stimuli. Notably, cross-frequency analysis indicated the phase of theta oscillations in the TP modulated the amplitude of high gamma activity in the amygdala. These results were reproducible across three types of sensory inputs including naturalistic stimuli. Our results suggest that multimodal emotional stimuli induce a hierarchical influence of the TP over the amygdala.

White matter networks dissociate semantic control from semantic knowledge representations: Evidence from voxel-based lesion-symptom mapping

Although semantic system is composed of two distinctive processes (i.e., semantic knowledge and semantic control), it remains unknown in which way these two processes dissociate from each other. Investigating the white matter neuroanatomy underlying these processes helps improve understanding of this question. To address this issue, we recruited brain-damaged patients with semantic dementia (SD) and semantic aphasia (SA), who had selective predominant deficits in semantic knowledge and semantic control, respectively. We built regression models to identify the white matter network associated with the semantic performance of each patient group. Semantic knowledge deficits in the SD patients were associated with damage to the left medial temporal network, while semantic control deficits in the SA patients were associated with damage to the other two networks (left frontal-temporal/occipital and frontal-subcortical networks). The further voxel-based analysis revealed additional semantic-relevant white matter tracts. These findings specify different processing principles of the components in semantic system.

A unified neurocognitive model of semantics language social behaviour and face recognition in semantic dementia

The anterior temporal lobes (ATL) have become a key brain region of interest in cognitive neuroscience founded upon neuropsychological investigations of semantic dementia (SD). The purposes of this investigation are to generate a single unified model that captures the known cognitive-behavioural variations in SD and map these to the patients' distribution of frontotemporal atrophy. Here we show that the degree of generalised semantic impairment is related to the patients' total, bilateral ATL atrophy. Verbal production ability is related to total ATL atrophy as well as to the balance of left > right ATL atrophy. Apathy is found to relate positively to the degree of orbitofrontal atrophy. Disinhibition is related to right ATL and orbitofrontal atrophy, and face recognition to right ATL volumes. Rather than positing mutually-exclusive sub-categories, the data-driven model repositions semantics, language, social behaviour and face recognition into a continuous frontotemporal neurocognitive space.

Evaluating the granularity and statistical structure of lesions and behaviour in post-stroke aphasia

The pursuit of relating the location of neural damage to the pattern of acquired language and general cognitive deficits post-stroke stems back to the 19th century behavioural neurology. While spatial specificity has improved dramatically over time, from the large areas of damage specified by post-mortem investigation to the millimetre precision of modern MRI, there is an underlying issue that is rarely addressed, which relates to the fact that damage to a given area of the brain is not random but constrained by the brain’s vasculature. Accordingly, the aim of this study was to uncover the statistical structure underlying the lesion profile in chronic aphasia post-stroke. By applying varimax-rotated principal component analysis to the lesions of 70 patients with chronic post-stroke aphasia, we identified 17 interpretable clusters, largely reflecting the vascular supply of middle cerebral artery sub-branches and other sources of individual variation in vascular supply as shown in classical angiography studies. This vascular parcellation produced smaller displacement error in simulated lesion–symptom analysis compared with individual voxels and Brodmann regions. A second principal component analysis of the patients’ detailed neuropsychological data revealed a four-factor solution reflecting phonological, semantic, executive-demand and speech fluency abilities. As a preliminary exploration, stepwise regression was used to relate behavioural factor scores to the lesion principal components. Phonological ability was related to two components, which covered the posterior temporal region including the posterior segment of the arcuate fasciculus, and the inferior frontal gyrus. Three components were linked to semantic ability and were located in the white matter underlying the anterior temporal lobe, the supramarginal gyrus and angular gyrus. Executive-demand related to two components covering the dorsal edge of the middle cerebral artery territory, while speech fluency was linked to two components that were located in the middle frontal gyrus, precentral gyrus and subcortical regions (putamen and thalamus). Future studies can explore in formal terms the utility of these principal component analysis-derived lesion components for relating post-stroke lesions and symptoms.

Object responses are highly malleable, rather than invariant, with changes in object appearance

Theoretical frameworks of human vision argue that object responses remain stable, or 'invariant', despite changes in viewing conditions that can alter object appearance but not identity. Here, in a major departure from previous approaches that have relied on two-dimensional (2-D) images to study object processing, we demonstrate that changes in an object's appearance, but not its identity, can lead to striking shifts in behavioral responses to objects. We used inverse multidimensional scaling (MDS) to measure the extent to which arrangements of objects in a sorting task were similar or different when the stimuli were displayed as scaled 2-D images, three-dimensional (3-D) augmented reality (AR) projections, or real-world solids. We were especially interested in whether sorting behavior in each display format was based on conceptual (e.g., typical location) versus physical object characteristics. We found that 2-D images of objects were arranged according to conceptual (typical location), but not physical, properties. AR projections, conversely, were arranged primarily according to physical properties such as real-world size, elongation and weight, but not conceptual properties. Real-world solid objects, unlike both 2-D and 3-D images, were arranged using multidimensional criteria that incorporated both conceptual and physical object characteristics. Our results suggest that object responses can be strikingly malleable, rather than invariant, with changes in the visual characteristics of the stimulus. The findings raise important questions about limits of invariance in object processing, and underscore the importance of studying responses to richer stimuli that more closely resemble those we encounter in real-world environments.

Power of mind: Attentional focus rather than palatability dominates neural responding to visual food stimuli in females with overweight

Research investigating neural responses to visual food stimuli has produced inconsistent results. Crucially, high-caloric palatable foods have a double-sided nature - they are often craved but are also considered unhealthy - which may have contributed to the inconsistency in the literature. Taking this double-sided nature into account in the current study, neural responses to individually tailored palatable and unpalatable high caloric food stimuli were measured, while participants' (females with overweight: n = 23) attentional focus was manipulated to be either hedonic or neutral. Notably, results showed that the level of neural activity was not significantly different for palatable than for unpalatable food stimuli. Instead, independent of food palatability, several brain regions (including regions in the mesocorticolimbic system) responded more strongly when attentional focus was hedonic than when neutral (p < 0.05, cluster-based FWE corrected). Multivariate analyses showed that food palatability could be decoded from multi-voxel patterns of neural activity (p < 0.05, FDR corrected), mostly with a hedonic attentional focus. These findings illustrate that the level of neural activity might not be proportionate to the palatability of foods, but that food palatability can be decoded from multi-voxel patterns of neural activity. Moreover, they underline the importance of considering attentional focus when measuring food-related neural responses.

The Effects of Attentional Focus on Brain Function During a Gross Motor Task

CONTEXT

Although the beneficial effects of using an external focus of attention are well documented in attainment and performance of movement execution, neural mechanisms underlying external focus' benefits are mostly unknown.

OBJECTIVE

To assess brain function during a lower-extremity gross motor movement while manipulating an internal and external focus of attention.

DESIGN

Cross-over study.

SETTING

Neuroimaging center Participants: A total of 10 healthy subjects (5 males and 5 females) Intervention: Participants completed external and internal focus of attention unilateral left 45° knee extension/flexion movements at a rate of 1.2 Hz laying supine in a magnetic resonance imaging scanner for 4 blocks of 30 seconds interspersed with 30-second rest blocks. During the internal condition, participants were instructed to "squeeze their quadriceps." During the external condition, participants were instructed to "focus on a target" positioned above their tibia.

MAIN OUTCOME MEASURES

T1 brain structural imaging was performed for registration of the functional data. For each condition, 3T functional magnetic resonance imaging blood oxygenation level dependent data representing 90 whole-brain volumes were acquired.

RESULTS

During the external relative to internal condition, increased activation was detected in the right occipital pole, cuneal cortex, anterior portion of the lingual gyrus, and intracalcarine cortex (Zmax = 4.5-6.2, P < .001). During the internal relative to external condition, increased activation was detected in the left primary motor cortex, left supplementary motor cortex, and cerebellum (Zmax = 3.4-3.5, P < .001).

CONCLUSIONS

Current results suggest that an external focus directed toward a visual target produces more brain activity in regions associated with vision and ventral streaming pathways, whereas an internal focus manipulated through instruction increases activation in brain regions that are responsible for motor control. Results from this study serve as baseline information for future prevention and rehabilitation investigations of how manipulating focus of attention can constructively affect neuroplasticity during training and rehabilitation.