Knowledge of visual attributes in the right hemisphere

Functional imaging analyses reveal prototype and exemplar representations in a perceptual single-category task

Similarity-based categorization can be performed by memorizing category members as exemplars or by abstracting the central tendency of the category – the prototype. In similarity-based categorization of stimuli with clearly identifiable dimensions from two categories, prototype representations were previously located in the hippocampus and the ventromedial prefrontal cortex (vmPFC) and exemplar representations in areas supporting visual memory. However, the neural implementation of exemplar and prototype representations in perceptual similarity-based categorization of single categories is unclear. To investigate these representations, we applied model-based univariate and multivariate analyses of functional imaging data from a dot-pattern paradigm-based task. Univariate prototype and exemplar representations occurred bilaterally in visual areas. Multivariate analyses additionally identified prototype representations in parietal areas and exemplar representations in the hippocampus. Bayesian analyses supported the non-presence of prototype representations in the hippocampus and the vmPFC. We additionally demonstrate that some individuals form both representation types simultaneously, probably granting flexibility in categorization strategies.

Model-based univariate and multivariate analyses of fMRI data from 62 healthy participants in a dot-pattern paradigm-based task provide further insight into the neural basis of similarity-based categorization.

Changes in the language system as amyloid-β accumulates

Language dysfunction is common in Alzheimer's disease. There is increasing interest in the preclinical or asymptomatic phase of Alzheimer's disease. Here we examined in 35 cognitively intact older adults (age range 52-78 years at baseline, 17 male) in a longitudinal study design the association between accumulation of amyloid over a 5-6-year period, measured using PET, and functional changes in the language network measured over the same time period using task-related functional MRI. In the same participants, we also determined the association between the longitudinal functional MRI changes and a cross-sectional measure of tau load as measured with 18F-AV1451 PET. As predicted, the principal change occurred in posterior temporal cortex. In the cortex surrounding the right superior temporal sulcus, the response amplitude during the associative-semantic versus visuo-perceptual task increased over time as amyloid load accumulated (Pcorrected = 0.008). In a whole-brain voxel-wise analysis, amyloid accumulation was also associated with a decrease in response amplitude in the left inferior frontal sulcus (Pcorrected = 0.009) and the right dorsomedial prefrontal cortex (Pcorrected = 0.005). In cognitively intact older adults, cross-sectional tau load was not associated with longitudinal changes in functional MRI response amplitude. Our findings confirm the central role of the neocortex surrounding the posterior superior temporal sulcus as the area of predilection within the language network in the earliest stages of Alzheimer's disease. Amyloid accumulation has an impact on cognitive brain circuitry in the asymptomatic phase of Alzheimer's disease.

Orienting to Different Dimensions of Word Meaning Alters the Representation of Word Meaning in Early Processing Regions

Conscious processing of word meaning can be guided by attention. In this event-related functional magnetic resonance imaging study in 22 healthy young volunteers, we examined in which regions orienting attention to two fundamental and generic dimensions of word meaning, concreteness versus valence, alters the semantic representations coded in activity patterns. The stimuli consisted of 120 nouns in written or spoken modality which varied factorially along the concreteness and valence axis. Participants performed a forced-choice judgement of either concreteness or valence. Rostral and subgenual anterior cingulate were strongly activated during valence judgement, and precuneus and the dorsal attention network during concreteness judgement. Task and stimulus type interacted in right posterior fusiform gyrus, left lingual gyrus, precuneus, and insula. In the right posterior fusiform gyrus and the left lingual gyrus, the correlation between the pairwise similarity in activity patterns evoked by words and the pairwise distance in valence and concreteness was modulated by the direction of attention, word valence or concreteness. The data indicate that orienting attention to basic dimensions of word meaning exerts effects on the representation of word meaning in more peripheral nodes, such as the ventral occipital cortex, rather than the core perisylvian language regions.

Neural Representations of Belief Concepts: A Representational Similarity Approach to Social Semantics

The present experiment identified neural regions that represent a class of concepts that are independent of perceptual or sensory attributes. During functional magnetic resonance imaging scanning, participants viewed names of social groups (e.g. Atheists, Evangelicals, and Economists) and performed a one-back similarity judgment according to 1 of 2 dimensions of belief attributes: political orientation (Liberal to Conservative) or spiritualism (Spiritualist to Materialist). By generalizing across a wide variety of social groups that possess these beliefs, these attribute concepts did not coincide with any specific sensory quality, allowing us to target conceptual, rather than perceptual, representations. Multi-voxel pattern searchlight analysis was used to identify regions in which activation patterns distinguished the 2 ends of both dimensions: Conservative from Liberal social groups when participants focused on the political orientation dimension, and spiritual from Materialist groups when participants focused on the spiritualism dimension. A cluster in right precuneus exhibited such a pattern, indicating that it carries information about belief-attribute concepts and forms part of semantic memory—perhaps a component particularly concerned with psychological traits. This region did not overlap with the theory of mind network, which engaged nearby, but distinct, parts of precuneus. These findings have implications for the neural organization of conceptual knowledge, especially the understanding of social groups.

For a cognitive neuroscience of concepts: Moving beyond the grounding issue

Cognitive neuroscience research on conceptual knowledge often is discussed with respect to "embodiment" or "grounding." We tried to disentangle at least three distinct claims made using these terms. One of these, the view that concepts are entirely reducible to sensory-motor representations, is untenable and diminishing in the literature. A second is the view that concepts and sensory-motor representations "interact," and a third view addresses the question of how concepts are neurally organized-the neural partitions among concepts of different kinds, and where these partitions are localized in cortex. We argue that towards the second and third issues, much fruitful research can be pursued, but that no position on them is specifically related to "grounding." Furthermore, to move forward on them, it is important to precisely distinguish different kinds of representations-conceptual vs. sensory-motor-from each other theoretically and empirically. Neuroimaging evidence often lacks such specificity. We take an approach that distinguishes conceptual from sensory-motor representations by virtue of two properties: broad generality and tolerance to the absence of sensory-motor associations. We review three of our recent experiments that employ these criteria in order to localize neural representations of several specific kinds of nonsensory attributes: functions, intentions, and belief traits. Building on past work, we find that neuroimaging evidence can be used fruitfully to distinguish interesting hypotheses about neural organization. On the other hand, most such evidence does not speak to any clear notion of "grounding" or "embodiment," because these terms do not make clear, specific, empirical predictions. We argue that cognitive neuroscience will proceed most fruitfully by relinquishing these terms.

Representation of Semantic Similarity in the Left Intraparietal Sulcus: Functional Magnetic Resonance Imaging Evidence

According to a recent study, semantic similarity between concrete entities correlates with the similarity of activity patterns in left middle IPS during category naming. We examined the replicability of this effect under passive viewing conditions, the potential role of visuoperceptual similarity, where the effect is situated compared to regions that have been previously implicated in visuospatial attention, and how it compares to effects of object identity and location. Forty-six subjects participated. Subjects passively viewed pictures from two categories, musical instruments and vehicles. Semantic similarity between entities was estimated based on a concept-feature matrix obtained in more than 1,000 subjects. Visuoperceptual similarity was modeled based on the HMAX model, the AlexNet deep convolutional learning model, and thirdly, based on subjective visuoperceptual similarity ratings. Among the IPS regions examined, only left middle IPS showed a semantic similarity effect. The effect was significant in hIP1, hIP2, and hIP3. Visuoperceptual similarity did not correlate with similarity of activity patterns in left middle IPS. The semantic similarity effect in left middle IPS was significantly stronger than in the right middle IPS and also stronger than in the left or right posterior IPS. The semantic similarity effect was similar to that seen in the angular gyrus. Object identity effects were much more widespread across nearly all parietal areas examined. Location effects were relatively specific for posterior IPS and area 7 bilaterally. To conclude, the current findings replicate the semantic similarity effect in left middle IPS under passive viewing conditions, and demonstrate its anatomical specificity within a cytoarchitectonic reference frame. We propose that the semantic similarity effect in left middle IPS reflects the transient uploading of semantic representations in working memory.

Patterns of neural activity predict picture-naming performance of a patient with chronic aphasia

Naming objects represents a substantial challenge for patients with chronic aphasia. This could be in part because the reorganized compensatory language networks of persons with aphasia may be less stable than the intact language systems of healthy individuals. Here, we hypothesized that the degree of stability would be instantiated by spatially differential neural patterns rather than either increased or diminished amplitudes of neural activity within a putative compensatory language system. We recruited a chronic aphasic patient (KL; 66 year-old male) who exhibited a semantic deficit (e.g., often said "milk" for "cow" and "pillow" for "blanket"). Over the course of four behavioral sessions involving a naming task performed in a mock scanner, we identified visual objects that yielded an approximately 50% success rate. We then conducted two fMRI sessions in which the patient performed a naming task for multiple exemplars of those objects. Multivoxel pattern analysis (MVPA) searchlight revealed differential activity patterns associated with correct and incorrect trials throughout intact brain regions. The most robust and largest cluster was found in the right occipito-temporal cortex encompassing fusiform cortex, lateral occipital cortex (LOC), and middle occipital cortex, which may account for the patient's propensity for semantic naming errors. None of these areas were found by a conventional univariate analysis. By using an alternative approach, we extend current evidence for compensatory naming processes that operate through spatially differential patterns within the reorganized language system.

Representation of Functional Category in the Monkey Prefrontal Cortex and Its Rule-Dependent Use for Behavioral Selection

Humans, monkeys, and other animals are considered to have the cognitive ability to use functional categories--that is, stimulus groups based on functional equivalence independent of physical properties. To investigate the underlying neural mechanisms of the use of functional categories, we recorded single-unit activity in the prefrontal cortex of monkeys performing a behavioral task in which the rule-dependent usage of functional category was needed to select an appropriate response. We found a neural correlate of functional categories on the single-neuron level and found that category information is coded independently of other task-relevant information such as rule and contingency information. Analysis of the time course of the information activation suggested that contingency information used for action selection is derived by integrating incoming category information with rule information maintained throughout a session. Such neural computation can be considered as the neural background of flexible behavioral control based on category and rule.

Visual event-related potential studies supporting the validity of VARK learning styles' visual and read/write learners

The validity of learning styles needs supports of additional objective evidence. The identification of learning styles using subjective evidence from VARK questionnaires (where V is visual, A is auditory, R is read/write, and K is kinesthetic) combined with objective evidence from visual event-related potential (vERP) studies has never been investigated. It is questionable whether picture superiority effects exist in V learners and R learners. Thus, the present study aimed to investigate whether vERP could show the relationship between vERP components and VARK learning styles and to identify the existence of picture superiority effects in V learners and R learners. Thirty medical students (15 V learners and 15 R learners) performed recognition tasks with vERP and an intermediate-term memory (ITM) test. The results of within-group comparisons showed that pictures elicited larger P200 amplitudes than words at the occipital 2 site (P < 0.05) in V learners and at the occipital 1 and 2 sites (P < 0.05) in R learners. The between-groups comparison showed that P200 amplitudes elicited by pictures in V learners were larger than those of R learners at the parietal 4 site (P < 0.05). The ITM test result showed that a picture set showed distinctively more correct responses than that of a word set for both V learners (P < 0.001) and R learners (P < 0.01). In conclusion, the result indicated that the P200 amplitude at the parietal 4 site could be used to objectively distinguish V learners from R learners. A lateralization existed to the right brain (occipital 2 site) in V learners. The ITM test demonstrated the existence of picture superiority effects in both learners. The results revealed the first objective electrophysiological evidence partially supporting the validity of the subjective psychological VARK questionnaire study.

Longitudinal gray matter contraction in three variants of primary progressive aphasia: A tenser-based morphometry study

The present study investigated the pattern of longitudinal changes in cognition and anatomy in three variants of primary progressive aphasia (PPA). Eight patients with the non-fluent variant of PPA (nfvPPA), 13 patients with the semantic variant (svPPA), seven patients with the logopenic variant (lvPPA), and 29 age-matched, neurologically healthy controls were included in the study. All participants underwent longitudinal MRI, neuropsychological and language testing at baseline and at a 1-year follow-up. Tenser-based morphometry (TBM) was applied to T1-weighted MRI images in order to map the progression of gray and white matter atrophy over a 1-year period. Results showed that each patient group was characterized by a specific pattern of cognitive and anatomical changes. Specifically, nfvPPA patients showed gray matter atrophy progression in the left frontal and subcortical areas as well as a decline in motor speech and executive functions; svPPA patients presented atrophy progression in the medial and lateral temporal lobe and decline in semantic memory abilities; and lvPPA patients showed atrophy progression in lateral/posterior temporal and medial parietal regions with a decline in memory, sentence repetition and calculations. In addition, in all three variants, the white matter fibers underlying the abovementioned cortical areas underwent significant volume contraction over a 1-year period. Overall, these results indicate that the three PPA variants present distinct patterns of neuroanatomical contraction, which reflect their clinical and cognitive progression.

Semantic deficits in amyotrophic lateral sclerosis

Our objective was to investigate, and establish neuroanatomical correlates of, semantic deficits in amyotrophic lateral sclerosis (ALS) and amyotrophic lateral sclerosis-frontotemporal dementia (ALS-FTD), compared to semantic dementia (SD) and controls. Semantic deficits were evaluated using a naming and semantic knowledge composite score, comprising verbal and non-verbal neuropsychological measures of single-word processing (confrontational naming, comprehension, and semantic association) from the Sydney Language Battery (SYDBAT) and Addenbrooke's Cognitive Examination - Revised (ACE-R). Voxel based morphometry (VBM) analysis was conducted using the region of interest approach. In total, 84 participants were recruited from a multidisciplinary research clinic in Sydney. Participants included 17 patients with ALS, 19 with ALS-FTD, 22 with SD and 26 age- and education-matched healthy controls. Significant semantic deficits were observed in ALS and ALS-FTD compared to controls. The severity of semantic deficits varied across the clinical phenotypes: ALS patients were less impaired than ALS-FTD patients, who in turn were not as impaired as SD patients. Anterior temporal lobe atrophy significantly correlated with semantic deficits. In conclusion, semantic impairment is a feature of ALS and ALS-FTD, and reflects the severity of temporal lobe pathology.

Functional Changes in the Language Network in Response to Increased Amyloid β Deposition in Cognitively Intact Older Adults

Word finding symptoms are frequent early in the course of Alzheimer's disease and relate principally to functional changes in left posterior temporal cortex. In cognitively intact older adults, we examined whether amyloid load affects the network for language and associative-semantic processing. Fifty-six community-recruited subjects (52-74 years), stratified for apolipoprotein E and brain-derived neurotrophic factor genotype, received a neurolinguistic assessment, (18)F-flutemetamol positron emission tomography, and a functional MRI of the associative-semantic system. The primary measure of amyloid load was the cerebral-to-cerebellar gray matter standardized uptake value ratio in a composite cortical volume of interest (SUVR(comp)). The primary outcome analysis consisted of a whole-brain voxelwise linear regression between SUVR(comp) and fMRI response during associative-semantic versus visuoperceptual processing. Higher activity in one region, the posterior left middle temporal gyrus, correlated positively with increased amyloid load. The correlation remained significant when only the word conditions were contrasted but not for pictures. According to a stepwise linear regression analysis, offline naming reaction times correlated positively with SUVR(comp). A binary classification into amyloid-positive and amyloid-negative cases confirmed our findings. The left posterior temporal activity increase may reflect higher demands for semantic control in the presence of a higher amyloid burden.

Noun and knowledge retrieval for biological and non-biological entities following right occipitotemporal lesions

We investigated the critical contribution of right ventral occipitotemporal cortex to knowledge of visual and functional-associative attributes of biological and non-biological entities and how this relates to category-specificity during confrontation naming. In a consecutive series of 7 patients with lesions confined to right ventral occipitotemporal cortex, we conducted an extensive assessment of oral generation of visual-sensory and functional-associative features in response to the names of biological and nonbiological entities. Subjects also performed a confrontation naming task for these categories. Our main novel finding related to a unique case with a small lesion confined to right medial fusiform gyrus who showed disproportionate naming impairment for nonbiological versus biological entities, specifically for tools. Generation of visual and functional-associative features was preserved for biological and non-biological entities. In two other cases, who had a relatively small posterior lesion restricted to primary visual and posterior fusiform cortex, retrieval of visual attributes was disproportionately impaired compared to functional-associative attributes, in particular for biological entities. However, these cases did not show a category-specific naming deficit. Two final cases with the largest lesions showed a classical dissociation between biological versus nonbiological entities during naming, with normal feature generation performance. This is the first lesion-based evidence of a critical contribution of the right medial fusiform cortex to tool naming. Second, dissociations along the dimension of attribute type during feature generation do not co-occur with category-specificity during naming in the current patient sample.

The associative-semantic network for words and pictures: effective connectivity and graph analysis

Explicit associative-semantic processing of words and pictures activates a distributed set of brain areas that has been replicated across a wide range of studies. We applied graph analysis to examine the structure of this network. We determined how the left ventral occipitotemporal transition zone (vOT) was connected to word-specific areas. A modularity analysis discerned four communities: one corresponded to the classical perisylvian language system, including superior temporal sulcus (STS), middle temporal gyrus (GTm) and pars triangularis of the inferior frontal gyrus (GFi), among other nodes. A second subsystem consisted of vOT and anterior fusiform gyrus along with hippocampus and intraparietal sulcus. The two subsystems were linked through a unique connection between vOT and GTm, which were hubs with a high betweenness centrality compared to STS and GFi which had a high local clustering coefficient. Graph analysis reveals novel insights into the structure of the network for associative-semantic processing.

Right fusiform response patterns reflect visual object identity rather than semantic similarity

We previously reported the neuropsychological consequences of a lesion confined to the middle and posterior part of the right fusiform gyrus (case JA) causing a partial loss of knowledge of visual attributes of concrete entities in the absence of category-selectivity (animate versus inanimate). We interpreted this in the context of a two-step model that distinguishes structural description knowledge from associative-semantic processing and implicated the lesioned area in the former process. To test this hypothesis in the intact brain, multi-voxel pattern analysis was used in a series of event-related fMRI studies in a total of 46 healthy subjects. We predicted that activity patterns in this region would be determined by the identity of rather than the conceptual similarity between concrete entities. In a prior behavioral experiment features were generated for each entity by more than 1000 subjects. Based on a hierarchical clustering analysis the entities were organised into 3 semantic clusters (musical instruments, vehicles, tools). Entities were presented as words or pictures. With foveal presentation of pictures, cosine similarity between fMRI response patterns in right fusiform cortex appeared to reflect both the identity of and the semantic similarity between the entities. No such effects were found for words in this region. The effect of object identity was invariant for location, scaling, orientation axis and color (grayscale versus color). It also persisted for different exemplars referring to a same concrete entity. The apparent semantic similarity effect however was not invariant. This study provides further support for a neurobiological distinction between structural description knowledge and processing of semantic relationships and confirms the role of right mid-posterior fusiform cortex in the former process, in accordance with previous lesion evidence.

Heteromodal conceptual processing in the angular gyrus

Concepts bind together the features commonly associated with objects and events to form networks in long-term semantic memory. These conceptual networks are the basis of human knowledge and underlie perception, imagination, and the ability to communicate about experiences and the contents of the environment. Although it is often assumed that this distributed semantic information is integrated in higher-level heteromodal association cortices, open questions remain about the role and anatomic basis of heteromodal representations in semantic memory. Here we used combined neuroimaging evidence from functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI) to characterize the cortical networks underlying concept representation. Using a lexical decision task, we examined the processing of concepts in four semantic categories that varied on their sensory-motor feature associations (sight, sound, manipulation, and abstract). We found that the angular gyrus was activated across all categories regardless of their modality-specific feature associations, consistent with a heteromodal account for the angular gyrus. Exploratory analyses suggested that categories with weighted sensory-motor features additionally recruited modality-specific association cortices. Furthermore, DTI tractography identified white matter tracts connecting these regions of modality-specific functional activation with the angular gyrus. These findings are consistent with a distributed semantic network that includes a heteromodal, integrative component in the angular gyrus in combination with sensory-motor feature representations in modality-specific association cortices.

Chronometry of word and picture identification: common and modality-specific effects

Based on a previous fMRI connectivity analysis, we previously proposed that long-distance connections between left inferior frontal sulcus and left occipitotemporal sulcus mediate access to visual short-term memory both for written words and pictures enhancing conscious perception and successful encoding in an amodal manner. Using a 64-channel event-related potential electrode system in 19 young cognitively intact volunteers, we determined the chronometry of common and input-modality specific effects of word and picture identification and subsequent memory retrieval. Stimulus durations were calibrated per subject, modality and run so as to reach a 50% positive identification report. The earliest main effect of a positive identification report occurred between 180 and 200 ms, was common for both input-modalities, had a positive polarity and was located at around CPz. This effect was followed between 270 and 450 ms by additional common positive-polarity effects at centrofrontal electrode sites and by common negative effects at P7/P8, TP7/TP8 and T8. Each of the later effects was closely associated not only with identification but also with subsequent memory retrieval. The earliest input-modality specific effect of conscious identification that we detected occurred from 280 till 440 ms at P8. Our findings are in line with a model where the initial stages of perceptual identification and visual short-term memory access rely on long-distance connections that are shared between written words and pictures.

Broad and narrow conceptual tuning in the human frontal lobes

Previous work has implicated prefrontal cortices in selecting among and retrieving conceptual information stored elsewhere. However, recent neurophysiological work in monkeys suggests that prefrontal cortex may play a more direct role in representing conceptual information in a flexible context-specific manner. Here, we investigate the nature of visual object representations from perceptual to conceptual levels in an unbiased data-driven manner using a functional magnetic resonance imaging adaptation paradigm with pictures of animals. Throughout much of occipital cortex, activity was highly sensitive to changes in 2D stimulus form, consistent with tuning to form and position within retinotopic coordinates and matching an automated measure of shape similarity. Broad superordinate conceptual information was represented as early as extrastriate and posterior ventral temporal cortex. These regions were not completely invariant to form, suggesting that form similarity remains an important organizational constraint into the temporal cortex. Separate sites within prefrontal cortex represented broad and narrow conceptual tuning, with more anterior sites tuned narrowly to close conceptual associates in a manner that was invariant to stimulus form/position and that matched independent similarity ratings of the stimuli. The combination of broad and narrow conceptual tuning within prefrontal cortex may support flexible selection, retrieval, and classification of objects at different levels of categorical abstraction.

Gesture discrimination in primary progressive aphasia: the intersection between gesture and language processing pathways

The issue of the relationship between language and gesture processing and the partial overlap of their neural representations is of fundamental importance to neurology, psychology, and social sciences. Patients suffering from primary progressive aphasia, a clinical syndrome characterized by comparatively isolated language deficits, may provide direct evidence for anatomical and functional association between specific language deficits and gesture discrimination deficits. A consecutive series of 16 patients with primary progressive aphasia and 16 matched control subjects participated. Our nonverbal gesture discrimination task consisted of 19 trials. In each trial, participants observed three video clips showing the same gesture performed correctly in one clip and incorrectly in the other two. Subjects had to indicate which of the three versions was correct. Language and gesture production were evaluated by means of conventional tasks. All participants underwent high-resolution structural and diffusion tensor magnetic resonance imaging. Ten of the primary progressive aphasia patients showed a significant deficit on the nonverbal gesture discrimination task. A factor analysis revealed that this deficit clustered with gesture imitation, word and pseudoword repetition, and writing-to-dictation. Individual scores on this cluster correlated with volume in the left anterior inferior parietal cortex extending into the posterior superior temporal gyrus. Probabilistic tractography indicated this region comprised the cortical relay station of the indirect pathway connecting the inferior frontal gyrus and the superior temporal cortex. Thus, the left perisylvian temporoparietal area may underpin verbal imitative behavior, gesture imitation, and gesture discrimination indicative of a partly shared neural substrate for language and gesture resonance.

Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies

Semantic memory refers to knowledge about people, objects, actions, relations, self, and culture acquired through experience. The neural systems that store and retrieve this information have been studied for many years, but a consensus regarding their identity has not been reached. Using strict inclusion criteria, we analyzed 120 functional neuroimaging studies focusing on semantic processing. Reliable areas of activation in these studies were identified using the activation likelihood estimate (ALE) technique. These activations formed a distinct, left-lateralized network comprised of 7 regions: posterior inferior parietal lobe, middle temporal gyrus, fusiform and parahippocampal gyri, dorsomedial prefrontal cortex, inferior frontal gyrus, ventromedial prefrontal cortex, and posterior cingulate gyrus. Secondary analyses showed specific subregions of this network associated with knowledge of actions, manipulable artifacts, abstract concepts, and concrete concepts. The cortical regions involved in semantic processing can be grouped into 3 broad categories: posterior multimodal and heteromodal association cortex, heteromodal prefrontal cortex, and medial limbic regions. The expansion of these regions in the human relative to the nonhuman primate brain may explain uniquely human capacities to use language productively, plan, solve problems, and create cultural and technological artifacts, all of which depend on the fluid and efficient retrieval and manipulation of semantic knowledge.

Neural correlates of word production stages delineated by parametric modulation of psycholinguistic variables

Word production is a complex multistage process linking conceptual representations, lexical entries, phonological forms and articulation. Previous studies have revealed a network of predominantly left-lateralized brain regions supporting this process, but many details regarding the precise functions of different nodes in this network remain unclear. To better delineate the functions of regions involved in word production, we used event-related functional magnetic resonance imaging (fMRI) to identify brain areas where blood oxygen level-dependent (BOLD) responses to overt picture naming were modulated by three psycholinguistic variables: concept familiarity, word frequency, and word length, and one behavioral variable: reaction time. Each of these variables has been suggested by prior studies to be associated with different aspects of word production. Processing of less familiar concepts was associated with greater BOLD responses in bilateral occipitotemporal regions, reflecting visual processing and conceptual preparation. Lower frequency words produced greater BOLD signal in left inferior temporal cortex and the left temporoparietal junction, suggesting involvement of these regions in lexical selection and retrieval and encoding of phonological codes. Word length was positively correlated with signal intensity in Heschl's gyrus bilaterally, extending into the mid-superior temporal gyrus (STG) and sulcus (STS) in the left hemisphere. The left mid-STS site was also modulated by reaction time, suggesting a role in the storage of lexical phonological codes.

Cortical mapping of naming errors in aphasia

Persons with aphasia vary greatly with regard to clinical profile; yet, they all share one common feature-anomia-an impairment in naming common objects. Previous research has demonstrated that particular naming errors are associated with specific left hemisphere lesions. However, we know very little about the cortical activity in the preserved brain areas that is associated with aphasic speech errors. Utilizing functional magnetic resonance imaging (fMRI), we show for the first time that specific speech errors are associated with common cortical activity in different types and severities of aphasia. Specifically, productions of phonemic errors recruited the left posterior perilesional occipital and temporal lobe areas. A similar pattern of activity was associated with semantic errors, albeit in the right hemisphere. This study does not discount variability in cortical activity following left hemisphere stroke; rather, it highlights commonalities in brain modulation in a population of patients with a common diagnosis but vastly different clinical profiles.

The neural correlates of verbal and nonverbal semantic processing deficits in neurodegenerative disease

OBJECTIVE

To investigate the neural correlates of verbal and nonverbal semantic processing in neurodegenerative disease.

BACKGROUND

Semantic memory is often impaired in neurodegenerative disease. Neuropsychologic and functional neuroimaging studies suggest that the semantic processing of verbal and nonverbal stimuli may depend on partially distinct brain networks.

METHODS

We examined this possibility using voxel-based morphometry to correlate performance on verbal and nonverbal versions of a semantic association task with regional gray matter atrophy in 144 individuals with a variety of neurodegenerative diseases.

RESULTS

Results showed that, regardless of stimulus type, semantic processing correlated with atrophy in both temporal lobes. In addition, material-specific correlations were found in left temporal regions for verbal stimuli and the right fusiform gyrus for nonverbal stimuli.

CONCLUSIONS

These results provide evidence for a differential role of the left and right hemispheres in the extraction of semantic information from verbal and pictorial representations. Areas in right inferior temporal lobe may be necessary to access structural descriptions of visually presented objects.

The neural correlates of verbal short-term memory in Alzheimer's disease: an fMRI study

Although many studies have shown diminished performance in verbal short-term memory tasks in Alzheimer's disease, few studies have explored the neural correlates of impaired verbal short-term memory in Alzheimer's disease patients. In this fMRI study, we examined alterations in brain activation patterns during a verbal short-term memory recognition task, by differentiating encoding and retrieval phases. Sixteen mild Alzheimer's disease patients and 16 elderly controls were presented with lists of four words followed, after a few seconds, by a probe word. Participants had to judge whether the probe matched one of the items of the memory list. In both groups, the short-term memory task elicited a distributed fronto-parieto-temporal activation that encompassed bilateral inferior frontal, insular, supplementary motor, precentral and postcentral areas, consistent with previous studies of verbal short-term memory in young subjects. Most notably, Alzheimer's disease patients showed reduced activation in several regions during the encoding phase, including the bilateral middle frontal and the left inferior frontal gyri (associated with executive control processes) as well as the transverse temporal gyri (associated with phonological processing). During the recognition phase, we found decreased activation in the left supramarginal gyrus and the right middle frontal gyrus in Alzheimer's disease patients compared with healthy seniors, possibly related to deficits in manipulation and decision processes for phonological information. At the same time, Alzheimer's disease patients showed increased activation in several brain areas, including the left parahippocampus and hippocampus, suggesting that Alzheimer's disease patients may recruit alternative recognition mechanisms when performing a short-term memory task. Overall, our results indicate that Alzheimer's disease patients show differences in the functional networks underlying memory over short delays, mostly in brain areas known to support phonological processing or executive functioning.

The neural correlates of visual and verbal cognitive styles

It has long been thought that propensities for visual or verbal learning styles influence how children acquire knowledge successfully and how adults reason in everyday life. There is no direct evidence to date, however, linking these cognitive styles to specific neural systems. In the present study, visual and verbal cognitive styles are measured by self-report survey, and cognitive abilities are measured by scored tests of visual and verbal skills. Specifically, we administered the Verbalizer-Visualizer Questionnaire (VVQ) and modality-specific subtests of the Wechsler Adult Intelligence Scale (WAIS) to 18 subjects who subsequently participated in a functional magnetic resonance imaging experiment. During the imaging session, participants performed a novel psychological task involving both word-based and picture-based feature matching conditions that was designed to permit the use of either a visual or a verbal processing style during all conditions of the task. Results demonstrated a pattern of activity in modality-specific cortex that distinguished visual from verbal cognitive styles. During the word-based condition, activity in a functionally defined brain region that responded to viewing pictorial stimuli (fusiform gyrus) correlated with self-reported visualizer ratings on the VVQ. In contrast, activity in a phonologically related brain region (supramarginal gyrus) correlated with the verbalizer dimension of the VVQ during the picture-based condition. Scores from the WAIS subtests did not reliably correlate with brain activity in either of these regions. These findings suggest that modality-specific cortical activity underlies processing in visual and verbal cognitive styles.

Searching for the elusive neural substrates of body part terms: a neuropsychological study

Previous neuropsychological studies suggest that, compared to other categories of concrete entities, lexical and conceptual aspects of body part knowledge are frequently spared in brain-damaged patients. To further investigate this issue, we administered a battery of 12 tests assessing lexical and conceptual aspects of body part knowledge to 104 brain-damaged patients with lesions distributed throughout the telencephalon. There were two main outcomes. First, impaired oral naming of body parts, attributable to a disturbance of the mapping between lexical-semantic and lexical-phonological structures, was most reliably and specifically associated with lesions in the left frontal opercular and anterior/inferior parietal opercular cortices and in the white matter underlying these regions (8 patients). Also, 1 patient with body part anomia had a left occipital lesion that included the "extrastriate body area" (EBA). Second, knowledge of the meanings of body part terms was remarkably resistant to impairment, regardless of lesion site; in fact, we did not uncover a single patient who exhibited significantly impaired understanding of the meanings of these terms. In the 9 patients with body part anomia, oral naming of concrete entities was evaluated, and this revealed that 4 patients had disproportionately worse naming of body parts relative to other types of concrete entities. Taken together, these findings extend previous neuropsychological and functional neuroimaging studies of body part knowledge and add to our growing understanding of the nuances of how different linguistic and conceptual categories are operated by left frontal and parietal structures.

Neuroanatomical distribution of five semantic components of verbs: evidence from fMRI

The Simulation Framework, also known as the Embodied Cognition Framework, maintains that conceptual knowledge is grounded in sensorimotor systems. To test several predictions that this theory makes about the neural substrates of verb meanings, we used functional magnetic resonance imaging (fMRI) to scan subjects' brains while they made semantic judgments involving five classes of verbs-specifically, Running verbs (e.g., run, jog, walk), Speaking verbs (e.g., shout, mumble, whisper), Hitting verbs (e.g., hit, poke, jab), Cutting verbs (e.g., cut, slice, hack), and Change of State verbs (e.g., shatter, smash, crack). These classes were selected because they vary with respect to the presence or absence of five distinct semantic components-specifically, ACTION, MOTION, CONTACT, CHANGE OF STATE, and TOOL USE. Based on the Simulation Framework, we hypothesized that the ACTION component depends on the primary motor and premotor cortices, that the MOTION component depends on the posterolateral temporal cortex, that the CONTACT component depends on the intraparietal sulcus and inferior parietal lobule, that the CHANGE OF STATE component depends on the ventral temporal cortex, and that the TOOL USE component depends on a distributed network of temporal, parietal, and frontal regions. Virtually all of the predictions were confirmed. Taken together, these findings support the Simulation Framework and extend our understanding of the neuroanatomical distribution of different aspects of verb meaning.

Knowledge-based Correction of Flash-lag Illusion

A flash is perceived to lag spatially behind a moving object even when the two retinal images are physically aligned (flash-lag effect, FLE). Here we show that this robust illusion can be diminished by a knowledge of letters in the observer's brain. When moving and flashed segments in the FLE made the shape of a Kanji letter (ideographic characters used in Japan), the magnitude of the illusory lag perceived by Japanese subjects was significantly reduced compared to when conventional geometric (nonletter) segments were used. This diminishment was not observed when a pseudo-Kanji letter was presented to Japanese subjects or when non-Japanese English-speakers (who do not have a knowledge of Kanji) saw a real Kanji letter, indicating that the reduction in the FLE was induced by a retrieval of the knowledge (shapes of letters) stored in the observer's brain. Furthermore, measurements of neural activities by magnetoencephalography showed that the initial brain response, in which the effect of the knowledge became evident, occurred as early as 160 msec after the appearance of the flashed segment. These results demonstrated a substantial influence of knowledge on the flash-lag illusion and further suggest a rapid response of the knowledge-based perceptual pathway in the human brain.

Conceptual knowledge in the brain: fMRI evidence for a featural organization

The organization and representation of conceptual knowledge in the brain remains a controversial issue in terms of both neuropsychological and imaging evidence. We report the results of a functional magnetic resonance study in which the role of the most debated dimensions (domain and feature type) was evaluated through a concept-feature verification task. The scope of the task was to eliminate serious methodological concerns that weighed down previous imaging research in this area, and to allow more definitive conclusions regarding the specific contribution of these dimensions. The results show differential patterns of brain activity according to feature type (both motion and visual form/surface features) but not according to concept domain (living vs. nonliving things). These findings are in accord with a modality-specific account of conceptual knowledge organization in the brain, in which specific kinds of features (e.g. form, color, motion, etc) have differential importance for representing different concepts.

The neural basis of scene preferences

What is the neural correlate of preference that governs our spontaneous selection of visual information? With a rapid, event-related functional magnetic resonance imaging design, we showed that the viewing of highly preferred compared to less preferred scenes (as assessed by participant ratings) was associated with greater blood-oxygen level dependent responses in the right parahippocampal cortex but not in the lateral occipital complex, ruling out feed forward and attentional effects. Highly preferred images also produced greater activation in the ventral striatum, suggesting that perceptual preference might engage the conventional reward system. These results are consistent with the hypothesis that high activity in the parahippocampal cortex, an area with a high density of cortical mu-opioid receptors, may be experienced as cognitively pleasurable.

Inter-individual differences in the polarity of early visual responses and attention effects

While there is a general agreement about the sensory properties of the early-latency C1 (P/N80) and P1 components of visual evoked potentials (VEPs), the literature is not consistent about the timing of modulatory attention effects at an early sensory stage for either space- or object-based stimulus features. The aim of this study was to investigate whether inter-individual differences in VEP morphology might affect the nature and polarity of amplitude changes via selective visual attention. EEG was recorded in 20 right-handed individuals while they viewed drawings of familiar objects presented slightly lateralized and performed a categorization task. It consisted in paying attention and responding to a conjunction of space and object features. On the basis of VEP morphology, and independently of task factors, subjects were subdivided in two groups: one group exhibited a prominent N80 and the other a prominent P80 in the same latency range from the same electrode sites. RTs to targets were identical in the two groups, suggesting that morphology was independent of task-related factors. VEP morphology affected the direction and amplitude of spatial and non-spatial attention effects. While attention effects always resulted in increased positivity for the P80 group (at both the C1 and P1 levels), shape relevance was associated with enhanced N80 and P1 responses in the N80 group. These data provide evidence for an inversion of attention effects, in addition to inversion of C1 polarity, in people exhibiting negative C1 at mesial occipital sites.