Explaining category-related effects in the retrieval of conceptual and lexical knowledge for concrete entities: operationalization and analysis of factors

The Semantic Similarity Effect on Short-Term Memory: Null Effects of Affectively Defined Semantic Similarity

Studies on short-term memory have repeatedly demonstrated the beneficial effect of semantic similarity. Although the effect seems robust, the aspects of semantics targeted by these studies (e.g., categorical structure, associative relationship, or dimension of meaning) should be clarified. A recent meta-regression study inspired by Osgood's view, which highlights affective dimensions in semantics, introduced a novel index for quantifying semantic similarity using affective values. Building on the results of the meta-regression of past studies' data with that index, this study predicts that semantic similarity is deleterious to short-term memory if it is manipulated by affective dimensions, after controlling for other confounding factors. This prediction was directly tested. The experimental results of the immediate serial recall task (Study 1) and immediate serial reconstruction of order task (Study 2) indicated null effects of semantic similarity by affective dimensions and thus falsified the prediction. These results suggest that semantic similarity based on affective dimensions is negligible.

Neural specialization for 'visual' concepts emerges in the absence of vision

Vision provides a key source of information about many concepts, including 'living things' (e.g., tiger) and visual events (e.g., sparkle). According to a prominent theoretical framework, neural specialization for different conceptual categories is shaped by sensory features, e.g., living things are neurally dissociable from navigable places because living things concepts depend more on visual features. We tested this framework by comparing the neural basis of 'visual' concepts across sighted (n=22) and congenitally blind (n=21) adults. Participants judged the similarity of words varying in their reliance on vision while undergoing fMRI. We compared neural responses to living things nouns (birds, mammals) and place nouns (natural, manmade). In addition, we compared visual event verbs (e.g., 'sparkle') to non-visual events (sound emission, hand motion, mouth motion). People born blind exhibited distinctive univariate and multivariate responses to living things in a temporo-parietal semantic network activated by nouns, including the precuneus (PC). To our knowledge, this is the first demonstration that neural selectivity for living things does not require vision. We additionally observed preserved neural signatures of 'visual' light events in the left middle temporal gyrus (LMTG+). Across a wide range of semantic types, neural representations of sensory concepts develop independent of sensory experience.

The Effects of Digital Addiction on Brain Function and Structure of Children and Adolescents: A Scoping Review

The escalating prevalence of studies investigating digital addiction (DA) and its detrimental impact on the human brain's structure and functionality has been noticeable in recent years. Yet, an overwhelming majority of these reviews have been predominantly geared towards samples comprising college students or adults and have only inspected a single variant of DA, such as internet gaming disorder, internet addiction disorder, problematic smartphone use, tablet overuse, and so forth. Reviews focusing on young children and adolescents (ages 0-18), or those which amalgamate various types of DA, are decidedly scarce. Given this context, summarizing the effects of DA on brain structure and functionality during the vital developmental stage (0-18 years) is of immense significance. A scoping review, complying with the PRISMA extension for such reviews, was conducted to amalgamate findings from 28 studies spanning a decade (2013-2023) and to examine the influence of assorted forms of DA on the brains of children and adolescents (0-18 years). The synthesized evidence indicated two primary results: (1) DA exerts harmful effects on the structure and functionality of the brains of children and adolescents, and (2) the prefrontal lobe is the region most consistently reported as impacted across all research. Furthermore, this review discerned a notable void of studies investigating the neural indices of digital addiction, along with a shortage of studies focusing on young children (0-6 years old) and longitudinal evidence. This research could provide the necessary theoretical basis for the thwarting and intervention of digital addiction, a measure indispensable for ensuring healthy brain development in children and adolescents.

Altered sensory integration from body and language development in children with autism spectrum disorder

Aim

Although atypical sensory motor processing has been investigated in children with autism spectrum disorder (ASD), whether or not atypical sensory motor processing is related to altered language function in children with ASD remains unclear.

Methods

This study examined the relationship between sensory motor processing and language conceptual inference ability in 3-10-year-old children with (n = 61) and without (n = 114) ASD. Language performance was assessed using the language conceptual inference task of the Kaufman Assessment Battery for Children (K-ABC). Sensory processing was assessed using the Caregiver Sensory Profile.

Results

In children with ASD, altered processing of the fine motor/perceptual factor scored by sensory profile was found to be significantly related to language conceptual inference ability in the K-ABC, representing the integrated abilities of language comprehension and language expression, which reflect language semantic concept formation.

Conclusions

For children with ASD, the results suggest a relationship between difficulties of integrating sensory information perceived from the body adjusting fine movement and deficiencies of language semantic conceptual formation.

Machine learning algorithm performance evaluation in structural magnetic resonance imaging-based classification of pediatric bipolar disorders type I patients

The diagnosis based on clinical assessment of pediatric bipolar disorder (PBD) may sometimes lead to misdiagnosis in clinical practice. For the past several years, machine learning (ML) methods were introduced for the classification of bipolar disorder (BD), which were helpful in the diagnosis of BD. In this study, brain cortical thickness and subcortical volume of 33 PBD-I patients and 19 age-sex matched healthy controls (HCs) were extracted from the magnetic resonance imaging (MRI) data and set as features for classification. The dimensionality reduced feature subset, which was filtered by Lasso or f_classif, was sent to the six classifiers (logistic regression (LR), support vector machine (SVM), random forest classifier, naïve Bayes, k-nearest neighbor, and AdaBoost algorithm), and the classifiers were trained and tested. Among all the classifiers, the top two classifiers with the highest accuracy were LR (84.19%) and SVM (82.80%). Feature selection was performed in the six algorithms to obtain the most important variables including the right middle temporal gyrus and bilateral pallidum, which is consistent with structural and functional anomalous changes in these brain regions in PBD patients. These findings take the computer-aided diagnosis of BD a step forward.

Revealing the multidimensional mental representations of natural objects underlying human similarity judgements

Objects can be characterized according to a vast number of possible criteria (such as animacy, shape, colour and function), but some dimensions are more useful than others for making sense of the objects around us. To identify these core dimensions of object representations, we developed a data-driven computational model of similarity judgements for real-world images of 1,854 objects. The model captured most explainable variance in similarity judgements and produced 49 highly reproducible and meaningful object dimensions that reflect various conceptual and perceptual properties of those objects. These dimensions predicted external categorization behaviour and reflected typicality judgements of those categories. Furthermore, humans can accurately rate objects along these dimensions, highlighting their interpretability and opening up a way to generate similarity estimates from object dimensions alone. Collectively, these results demonstrate that human similarity judgements can be captured by a fairly low-dimensional, interpretable embedding that generalizes to external behaviour.

The famous melodies stimulus set

Famous musical melodies, such as "Row, Row, Row Your Boat" and "Hot Cross Buns," are frequently used in psychological research. Such melodies have been used to assess the degree of cognitive impairments in various neurological disorders, and to investigate differences between "naming" vs. "knowing." Despite their utility as an experimental stimulus, there is currently no standardized, openly available set of famous musical melodies based on a United States population, as prior work on the topic has primarily relied on creating stimuli in an ad hoc manner. Therefore, the goal of the present work was to create a set of famous musical melodies. Here, we describe the development of the Famous Melodies Stimulus Set, a set of 107 melodies. We provide normative data for the melodies on five dimensions: familiarity, age of acquisition, emotional valence, emotional arousal, and naming ability. Participants (N = 397) rated the melodies on these five variables, validating that most melodies were highly familiar and reliably named. While familiarity ratings were skewed, all other rating scales covered a relatively broad range, allowing for researchers to select melodies for future work based on particular attributes.

THINGS: A database of 1,854 object concepts and more than 26,000 naturalistic object images

In recent years, the use of a large number of object concepts and naturalistic object images has been growing strongly in cognitive neuroscience research. Classical databases of object concepts are based mostly on a manually curated set of concepts. Further, databases of naturalistic object images typically consist of single images of objects cropped from their background, or a large number of naturalistic images of varying quality, requiring elaborate manual image curation. Here we provide a set of 1,854 diverse object concepts sampled systematically from concrete picturable and nameable nouns in the American English language. Using these object concepts, we conducted a large-scale web image search to compile a database of 26,107 high-quality naturalistic images of those objects, with 12 or more object images per concept and all images cropped to square size. Using crowdsourcing, we provide higher-level category membership for the 27 most common categories and validate them by relating them to representations in a semantic embedding derived from large text corpora. Finally, by feeding images through a deep convolutional neural network, we demonstrate that they exhibit high selectivity for different object concepts, while at the same time preserving variability of different object images within each concept. Together, the THINGS database provides a rich resource of object concepts and object images and offers a tool for both systematic and large-scale naturalistic research in the fields of psychology, neuroscience, and computer science.

Why Is There So Much More Research on Vision Than on Any Other Sensory Modality?

Why is there so much more research on vision than on any other sensory modality? There is a seemingly easy answer to this question: It is because vision is our most important and most complex sense. Although there are arguments in favor of this explanation, it can be challenged in two ways: by showing that the arguments regarding the importance and complexity of vision are debatable and by demonstrating that there are other aspects that need to be taken into account. Here, I argue that the explanation is debatable, as there are various ways of defining “importance” and “complexity” and, as there is no clear consensus that vision is indeed the most important and most complex of our senses. Hence, I propose two additional explanations: According to the methodological-structural explanation, there is more research on vision because the available, present-day technology is better suited for studying vision than for studying other modalities – an advantage which most likely is the result of an initial bias toward vision, which reinforces itself. Possible reasons for such an initial bias are discussed. The cultural explanation emphasizes that the dominance of the visual is not an unchangeable constant, but rather the result of the way our societies are designed and thus heavily influenced by human decision-making. As it turns out, there is no universal hierarchy of the senses, but great historical and cross-cultural variation. Realizing that the dominance of the visual is socially and culturally reinforced and not simply a law of nature, gives us the opportunity to take a step back and to think about the kind of sensory environments we want to create and about the kinds of theories that need to be developed in research.

Classification of schizophrenia and normal controls using 3D convolutional neural network and outcome visualization

BACKGROUND

The recent deep learning-based studies on the classification of schizophrenia (SCZ) using MRI data rely on manual extraction of feature vector, which destroys the 3D structure of MRI data. In order to both identify SCZ and find relevant biomarkers, preserving the 3D structure in classification pipeline is critical.

OBJECTIVES

The present study investigated whether the proposed 3D convolutional neural network (CNN) model produces higher accuracy compared to the support vector machine (SVM) and other 3D-CNN models in distinguishing individuals with SCZ spectrum disorders (SSDs) from healthy controls. We sought to construct saliency map using class saliency visualization (CSV) method.

METHODS

Task-based fMRI data were obtained from 103 patients with SSDs and 41 normal controls. To preserve spatial locality, we used 3D activation map as input for the 3D convolutional autoencoder (3D-CAE)-based CNN model. Data on 62 patients with SSDs were used for unsupervised pretraining with 3D-CAE. Data on the remaining 41 patients and 41 normal controls were processed for training and testing with CNN. The performance of our model was analyzed and compared with SVM and other 3D-CNN models. The learned CNN model was visualized using CSV method.

RESULTS

Using task-based fMRI data, our model achieved 84.15%∼84.43% classification accuracies, outperforming SVM and other 3D-CNN models. The inferior and middle temporal lobes were identified as key regions for classification.

CONCLUSIONS

Our findings suggest that the proposed 3D-CAE-based CNN can classify patients with SSDs and controls with higher accuracy compared to other models. Visualization of salient regions provides important clinical information.

The left temporal pole is a convergence region mediating the relation between names and semantic knowledge for unique entities: Further evidence from a "recognition-from-name" study in neurological patients

Prior research has implicated the left temporal pole (LTP) as a critical region for naming semantically unique items, including famous faces, landmarks, and musical melodies. Most studies have used a confrontation naming paradigm, where a participant is presented with a stimulus and asked to retrieve its name. We have proposed previously that the LTP functions as a two-way, bidirectional convergence region brokering between conceptual knowledge and proper names for unique entities. Under this hypothesis, damage to the LTP should result in a "two way" impairment: (1) defective proper name retrieval when presented with a unique stimulus (as shown in prior work); and (2) defective concept retrieval when presented with a proper name. Here, we directly tested the second prediction using a "recognition-from-name" paradigm. Participants were patients with LTP damage, brain-damaged comparisons with damage outside the LTP, and healthy comparisons. Participants were presented with names of famous persons (e.g., "Marilyn Monroe"), landmarks (e.g., "Leaning Tower of Pisa"), or melodies (e.g., "Rudolph the Red-Nosed Reindeer") and were asked to provide conceptual knowledge about each. We found that individuals with damage to the LTP were significantly impaired at conceptual knowledge retrieval when given names of famous people and landmarks (but this finding did not hold for melodies). This outcome supports the theory that the LTP is a bidirectional convergence region for proper naming, but suggests that melody retrieval may rely on processes different from those supported by the LTP.

Involuntary polymodal imagery involving olfaction, audition, touch, taste, and vision

Percepts and urges often enter consciousness involuntarily. The Reflexive Imagery Task (RIT) reveals how high-level cognitions, too, can enter consciousness involuntarily. In the task, the eliciting stimuli are visual (e.g., picture of a cat), and the involuntary imagery is verbal (e.g., the subvocalization "cat"). The generalizability of the RIT effect has been questioned because verbal imagery is an easily elicited form of imagery. Do such effects arise for other kinds of imagery? It is known that imagery is more elicitable in some senses (e.g., vision) than in other senses (e.g., olfaction). We found such differences in an RIT in which food items were presented as orthographic stimuli or as drawings. Although subjects were instructed to suppress mental imagery, involuntary imagery still arose: Olfactory (effect in ∼40% of trials), taste (∼54%), touch (∼60%), and visual/auditory (∼79%). Of theoretical import, effects were comparable when the eliciting stimuli were orthographs or visual objects.

Anomia for musical entities

BACKGROUND

Previous work has investigated extensively the neuroanatomical correlates of lexical retrieval for words for concrete entities. Musical entities, such as musical instruments, are often included in studies of category-specific naming deficits, but have rarely been the focus of such work.

AIMS

This article reviews a program of research investigating the neuroanatomical basis for lexical retrieval of words for unique (i.e., melodies) and non-unique (i.e., musical instruments) musical entities.

MAIN CONTRIBUTION

We begin by reporting findings on the retrieval of words for unique musical entities, including musical melodies. We then consider work focusing on retrieval of words for non-unique musical entities, specifically musical instruments. We highlight similarities between the two lines of work, and then report results from new analyses including direct comparisons between the two. These comparisons suggest that impairments in naming musical melodies and in naming musical instruments are both associated with damage to the left temporal pole (LTP). However, musical instrument naming appears to rely on a more distributed set of brain regions, possibly including those relating to sensorimotor interactions with such instruments, whereas melody naming relies more exclusively on the left temporal pole.

CONCLUSIONS

Retrieval of names for musical melodies appears to rely on similar neuroanatomical correlates as for other proper nouns, namely the LTP. Musical instrument naming seems to rely on a broader network of regions, including the LTP and sensorimotor areas. Overall, melody naming seems to coincide with naming of other proper nouns, while musical instrument naming appears distinct from other categories of non-unique items.

Different Measures of Structural Similarity Tap Different Aspects of Visual Object Processing

The structural similarity of objects has been an important variable in explaining why some objects are easier to categorize at a superordinate level than to individuate, and also why some patients with brain injury have more difficulties in recognizing natural (structurally similar) objects than artifacts (structurally distinct objects). In spite of its merits as an explanatory variable, structural similarity is not a unitary construct, and it has been operationalized in different ways. Furthermore, even though measures of structural similarity have been successful in explaining task and category-effects, this has been based more on implication than on direct empirical demonstrations. Here, the direct influence of two different measures of structural similarity, contour overlap and within-item structural diversity, on object individuation (object decision) and superordinate categorization performance is examined. Both measures can account for performance differences across objects, but in different conditions. It is argued that this reflects differences between the measures in whether they tap: (i) global or local shape characteristics, and (ii) between- or within-category structural similarity.

The neuro-cognitive representations of symbols: the case of concrete words

We live our lives surrounded by symbols (e.g., road signs, logos, but especially words and numbers), and throughout our life we use them to evoke, communicate and reflect upon ideas and things that are not currently present to our senses. Symbols are represented in our brains at different levels of complexity: at the first and most simple level, as physical entities, in the corresponding primary and secondary sensory cortices. The crucial property of symbols, however, is that, despite the simplicity of their surface forms, they have the power of evoking higher order multifaceted representations that are implemented in distributed neural networks spanning a large portion of the cortex. The rich internal states that reflect our knowledge of the meaning of symbols are what we call semantic representations. In this review paper, we summarize our current knowledge of both the cognitive and neural substrates of semantic representations, focusing on concrete words (i.e., nouns or verbs referring to concrete objects and actions), which, together with numbers, are the most-studied and well defined classes of symbols. Following a systematic descriptive approach, we will organize this literature review around two key questions: what is the content of semantic representations? And, how are semantic representations implemented in the brain, in terms of localization and dynamics? While highlighting the main current opposing perspectives on these topics, we propose that a fruitful way to make substantial progress in this domain would be to adopt a geometrical view of semantic representations as points in high dimensional space, and to operationally partition the space of concrete word meaning into motor-perceptual and conceptual dimensions. By giving concrete examples of the kinds of research that can be done within this perspective, we illustrate how we believe this framework will foster theoretical speculations as well as empirical research.

Are Sex-Related Category-Specific Differences in Semantic Tasks Innate or Influenced by Social Roles? A Viewpoint

In semantic tasks, sex-related categorical differences, in the form of better processing of fruits and vegetables by women and of artifacts (human-made objects) and animals by men, have been reported both in healthy participants and in brain-damaged patients. Researchers' interpretation of these sex-related categorical asymmetries has, however, been controversial, being connected with the more general (innatist versus experience-dependent) interpretations that had been given of the mechanisms subsuming the categorical organization of the brain. I begin this review with a brief reminder of the debate between supporters of the innatist and the experience-related accounts of categorical brain organization. Then I summarize results that have documented a preference by women for fruits and vegetables and a preference by men for artifacts and animals, and I discuss the innatist and social role-related interpretations that have been given of these results. I conclude that sex-related categorical effects disappear in generations in which the traditional social roles have almost completely disappeared, and these differences are not seen in young individuals raised in societies that emphasize sex equality.

Arguments about the nature of concepts: Symbols, embodiment, and beyond

How are the meanings of words, events, and objects represented and organized in the brain? This question, perhaps more than any other in the field, probes some of the deepest and most foundational puzzles regarding the structure of the mind and brain. Accordingly, it has spawned a field of inquiry that is diverse and multidisciplinary, has led to the discovery of numerous empirical phenomena, and has spurred the development of a wide range of theoretical positions. This special issue brings together the most recent theoretical developments from the leaders in the field, representing a range of viewpoints on issues of fundamental significance to a theory of meaning representation. Here we introduce the special issue by way of pulling out some key themes that cut across the contributions that form this issue and situating those themes in the broader literature. The core issues around which research on conceptual representation can be organized are representational format, representational content, the organization of concepts in the brain, and the processing dynamics that govern interactions between the conceptual system and sensorimotor representations. We highlight areas in which consensus has formed; for those areas in which opinion is divided, we seek to clarify the relation of theory and evidence and to set in relief the bridging assumptions that undergird current discussions.

Influences of visual and action information on object identification and action production

To evaluate the impact of semantic information elicited by labels, participants learned to identify or use novel graspable objects associated with novel actions. We identified each object/action pair with labels that elicited visual form or action semantics and varied the congruence between the label's information and the visual form or action of novel objects. In Experiment 1, participants named objects, and in Experiment 2 they produced the action associated with objects. Generally, congruent labels facilitated performance. Furthermore, for participants who learned incongruent associations, the visual form and semantic information elicited by labels influenced performance in opposite patterns. These findings support the notion that naming may be required before actions are produced when object/action associations are novel. Our findings further support the notion that links between the structural properties of objects and their actions may already be stronger than the links between verbal labels and actions in novel object/action associations.

Structural Similarity Exerts Opposing Effects on Perceptual Differentiation and Categorization: An fMRI Study

We manipulated the degree of structural similarity between objects that had to be matched either according to whether they represented the same object (perceptual matching) or belonged to the same category (conceptual matching). Behaviorally, performance improved as a linear function of increased structural similarity during conceptual matching but deteriorated as a linear function of increased structural similarity during perceptual matching. These effects were mirrored in fMRI recordings where activation in several ventral posterior areas exhibited a similar interaction between match type and structural similarity. Our findings provide direct support for the notion that structural similarity exerts opposing effects on classification depending on whether objects are to be perceptually differentiated or categorized—a notion that has been based on rather circumstantial evidence. In particular, the finding that structural similarity plays a major role in categorization of instances according to taxonomy challenges the view that the organization of superordinate categories is not driven by shared structural features.

Inborn and experience-dependent models of categorical brain organization. A position paper

The present review aims to summarize the debate in contemporary neuroscience between inborn and experience-dependent models of conceptual representations that goes back to the description of category-specific semantic disorders for biological and artifact categories. Experience-dependent models suggest that categorical disorders are the by-product of the differential weighting of different sources of knowledge in the representation of biological and artifact categories. These models maintain that semantic disorders are not really category-specific, because they do not respect the boundaries between different categories. They also argue that the brain structures which are disrupted in a given type of category-specific semantic disorder should correspond to the areas of convergence of the sensory-motor information which play a major role in the construction of that category. Furthermore, they provide a simple interpretation of gender-related categorical effects and are supported by studies assessing the importance of prior experience in the cortical representation of objects On the other hand, inborn models maintain that category-specific semantic disorders reflect the disruption of innate brain networks, which are shaped by natural selection to allow rapid identification of objects that are very relevant for survival. From the empirical point of view, these models are mainly supported by observations of blind subjects, which suggest that visual experience is not necessary for the emergence of category-specificity in the ventral stream of visual processing. The weight of the data supporting experience-dependent and inborn models is thoroughly discussed, stressing the fact observations made in blind subjects are still the subject of intense debate. It is concluded that at the present state of knowledge it is not possible to choose between experience-dependent and inborn models of conceptual representations.

Proper name anomia in poststroke aphasics: evidence from a multiple-case study

We aimed to characterize difficulties in famous face naming in three poststroke aphasic patients with a lesion limited to the left mid-posterior temporal language regions, sparing the anterior temporal lobe. The patients did not present semantic deficits specific to known people. Nonetheless, they showed difficulties naming famous buildings in addition to famous faces, but they were comparable to healthy controls in generating proper names. Our results support the critical role of the mid-posterior temporal language regions in the lexical retrieval of proper names, namely from pictorial stimuli, in absence of semantic impairments.

ERP signs of categorical and supra-categorical processing of visual information

BACKGROUND

The aim of the present study was to investigate to what extent shared and distinct brain mechanisms are possibly subserving the processing of visual supra-categorical and categorical knowledge as observed with event-related potentials of the brain. Access time to these knowledge types was also investigated. Picture pairs of animals, objects, and mixed types were presented. Participants were asked to decide whether each pair contained pictures belonging to the same category (either animals or man-made objects) or to different categories by pressing one of two buttons. Response accuracy and reaction times (RTs) were also recorded.

RESULTS

Both ERPs and RTs were grand-averaged separately for the same-different supra-categories and the animal-object categories. Behavioral performance was faster for more endomorphic pairs, i.e., animals vs. objects and same vs. different category pairs. For ERPs, a modulation of the earliest C1 and subsequent P1 responses to the same vs. different supra-category pairs, but not to the animal vs. object category pairs, was found. This finding supports the view that early afferent processing in the striate cortex can be boosted as a by-product of attention allocated to the processing of shapes and basic features that are mismatched, but not to their semantic quintessence, during same-different supra-categorical judgment. Most importantly, the fact that this processing accrual occurred independent of a traditional experimental condition requiring selective attention to a stimulus source out of the various sources addressed makes it conceivable that this processing accrual may arise from the attentional demand deriving from the alternate focusing of visual attention within and across stimulus categorical pairs' basic structural features. Additional posterior ERP reflections of the brain more prominently processing animal category and same-category pairs were observed at the N1 and N2 levels, respectively, as well as at a late positive complex level, overall most likely related to different stages of analysis of the greater endomorphy of these shape groups. Conversely, an enhanced fronto-central and fronto-lateral N2 as well as a centro-parietal N400 to man-made objects and different-category pairs were found, possibly indexing processing of these entities' lower endomorphy and isomorphy at the basic features and semantic levels, respectively.

CONCLUSION

Overall, the present ERP results revealed shared and distinct mechanisms of access to supra-categorical and categorical knowledge in the same way in which shared and distinct neural representations underlie the processing of diverse semantic categories. Additionally, they outlined the serial nature of categorical and supra-categorical representations, indicating the sequential steps of access to these separate knowledge types.

Independent and collaborative contributions of the cerebral hemispheres to emotional processing

Presented is a model suggesting that the right hemisphere (RH) directly mediates the identification and comprehension of positive and negative emotional stimuli, whereas the left hemisphere (LH) contributes to higher level processing of emotional information that has been shared via the corpus callosum. RH subcortical connections provide initial processing of emotional stimuli, and their innervation to cortical structures provides a secondary pathway by which the hemispheres process emotional information more fully. It is suggested that the LH contribution to emotion processing is in emotional regulation, social well-being, and adaptation, and transforming the RH emotional experience into propositional and verbal codes. Lastly, it is proposed that the LH has little ability at the level of emotion identification, having a default positive bias and no ability to identify a stimulus as negative. Instead, the LH must rely on the transfer of emotional information from the RH to engage higher-order emotional processing. As such, either hemisphere can identify positive emotions, but they must collaborate for complete processing of negative emotions. Evidence presented draws from behavioral, neurological, and clinical research, including discussions of subcortical and cortical pathways, callosal agenesis, commissurotomy, emotion regulation, mood disorders, interpersonal interaction, language, and handedness. Directions for future research are offered.

Recall strategies for the verbal fluency test in patients with multiple sclerosis

Multiple sclerosis (MS) is a neurodegenerative disease characterised by inflammation and demyelination. It generates irreversible myelin changes, which in turn give rise to physical and cognitive disorders. The verbal fluency test (VF) has been shown to be a sensitive tool for detecting cognitive impairment in these patients.

OBJECTIVE

To compare quantitative and qualitative aspects of performance on semantic and phonological fluency tests between MS patients and healthy controls by analysing total words produced and strategies used (clusters and switching).

METHOD

We evaluated 46 patients with MS and 33 healthy controls using the VF test.

RESULTS

The semantic VF task revealed no significant differences between groups; for the phonological task, patients demonstrated reduced word production (F [77]=2.286 P<.001) and poorer use of grouping strategies, resulting in more frequent switching (F [77]=3.808 P<.005).

CONCLUSIONS

These results support using qualitative analysis for recall strategies, since the technique provides data about which components of the task are affected by brain damage. Clusters depend on the integrity of semantic memory, while switching has to do with developing effective search strategies, cognitive flexibility, and the ability to modify responses. Frontal lobe damage has been reported in MS, and this is consistent with results from the phonological VF test.

Phase synchronization of delta and theta oscillations increase during the detection of relevant lexical information

During monitoring of the discourse, the detection of the relevance of incoming lexical information could be critical for its incorporation to update mental representations in memory. Because, in these situations, the relevance for lexical information is defined by abstract rules that are maintained in memory, a central aspect to elucidate is how an abstract level of knowledge maintained in mind mediates the detection of the lower-level semantic information. In the present study, we propose that neuronal oscillations participate in the detection of relevant lexical information, based on "kept in mind" rules deriving from more abstract semantic information. We tested our hypothesis using an experimental paradigm that restricted the detection of relevance to inferences based on explicit information, thus controlling for ambiguities derived from implicit aspects. We used a categorization task, in which the semantic relevance was previously defined based on the congruency between a kept in mind category (abstract knowledge), and the lexical semantic information presented. Our results show that during the detection of the relevant lexical information, phase synchronization of neuronal oscillations selectively increases in delta and theta frequency bands during the interval of semantic analysis. These increments occurred irrespective of the semantic category maintained in memory, had a temporal profile specific for each subject, and were mainly induced, as they had no effect on the evoked mean global field power. Also, recruitment of an increased number of pairs of electrodes was a robust observation during the detection of semantic contingent words. These results are consistent with the notion that the detection of relevant lexical information based on a particular semantic rule, could be mediated by increasing the global phase synchronization of neuronal oscillations, which may contribute to the recruitment of an extended number of cortical regions.

Famous face identification in temporal lobe epilepsy: support for a multimodal integration model of semantic memory

This study aims to demonstrate that the left and right anterior temporal lobes (ATLs) perform critical but unique roles in famous face identification, with damage to either leading to differing deficit patterns reflecting decreased access to lexical or semantic concepts but not their degradation. Famous face identification was studied in 22 presurgical and 14 postsurgical temporal lobe epilepsy (TLE) patients and 20 healthy comparison subjects using free recall and multiple choice (MC) paradigms. Right TLE patients exhibited presurgical deficits in famous face recognition, and postsurgical deficits in both famous face recognition and familiarity judgments. However, they did not exhibit any problems with naming before or after surgery. In contrast, left TLE patients demonstrated both pre- and postsurgical deficits in famous face naming but no significant deficits in recognition or familiarity. Double dissociations in performance between groups were alleviated by altering task demands. Postsurgical right TLE patients provided with MC options correctly identified greater than 70% of famous faces they initially rated as unfamiliar. Left TLE patients accurately chose the name for nearly all famous faces they recognized (based on their verbal description) but initially failed to name, although they tended to rapidly lose access to this name. We believe alterations in task demands activate alternative routes to semantic and lexical networks, demonstrating that unique pathways to such stored information exist, and suggesting a different role for each ATL in identifying visually presented famous faces. The right ATL appears to play a fundamental role in accessing semantic information from a visual route, with the left ATL serving to link semantic information to the language system to produce a specific name. These findings challenge several assumptions underlying amodal models of semantic memory, and provide support for the integrated multimodal theories of semantic memory and a distributed representation of concepts.

The evaluation of sources of knowledge underlying different conceptual categories

According to the “embodied cognition” theory and the “sensory-motor model of semantic knowledge”: (a) concepts are represented in the brain in the same format in which they are constructed by the sensory-motor system and (b) various conceptual categories differ according to the weight of different kinds of information in their representation. In this study, we tried to check the second assumption by asking normal elderly subjects to subjectively evaluate the role of various perceptual, motor and language-mediated sources of knowledge in the construction of different semantic categories. Our first aim was to rate the influence of different sources of knowledge in the representation of animals, plant life and artifact categories, rather than in living and non-living beings, as many previous studies on this subject have done. We also tried to check the influence of age and stimulus modality on these evaluations of the “sources of knowledge” underlying different conceptual categories. The influence of age was checked by comparing results obtained in our group of elderly subjects with those obtained in a previous study, conducted with a similar methodology on a sample of young students. And the influence of stimulus modality was assessed by presenting the stimuli in the verbal modality to 50 subjects and in the pictorial modality to 50 other subjects. The distinction between “animals” and “plant life” in the “living” categories was confirmed by analyzing their prevalent sources of knowledge and by a cluster analysis, which allowed us to distinguish “plant life” items from animals. Furthermore, results of the study showed: (a) that our subjects considered the visual modality as the main source of knowledge for all categories taken into account; and (b) that in biological categories the next most important source of information was represented by other perceptual modalities, whereas in artifacts it was represented by the actions performed with them. Finally, age and stimulus modality did not significantly influence judgment of relevance of the sources of knowledge involved in the construction of different conceptual categories.

Shapes, scents and sounds: quantifying the full multi-sensory basis of conceptual knowledge

Contemporary neuroscience theories assume that concepts are formed through experience in multiple sensory-motor modalities. Quantifying the contribution of each modality to different object categories is critical to understanding the structure of the conceptual system and to explaining category-specific knowledge deficits. Verbal feature listing is typically used to elicit this information but has a number of drawbacks: sensory knowledge often cannot easily be translated into verbal features and many features are experienced in multiple modalities. Here, we employed a more direct approach in which subjects rated their knowledge of objects in each sensory-motor modality separately. Compared with these ratings, feature listing over-estimated the importance of visual form and functional knowledge and under-estimated the contributions of other sensory channels. An item's sensory rating proved to be a better predictor of lexical-semantic processing speed than the number of features it possessed, suggesting that ratings better capture the overall quantity of sensory information associated with a concept. Finally, the richer, multi-modal rating data not only replicated the sensory-functional distinction between animals and non-living things but also revealed novel distinctions between different types of artefact. Hierarchical cluster analyses indicated that mechanical devices (e.g., vehicles) were distinct from other non-living objects because they had strong sound and motion characteristics, making them more similar to animals in this respect. Taken together, the ratings align with neuroscience evidence in suggesting that a number of distinct sensory processing channels make important contributions to object knowledge. Multi-modal ratings for 160 objects are provided as supplementary materials.

The role of body-related and environmental sources of knowledge in the construction of different conceptual categories

CONTROVERSIES EXIST REGARDING: (a) the relationships between perceptual and conceptual activities and (b) the format and neuro-anatomical substrates of concepts. Some authors maintain that concepts are represented in the brain in a propositional, abstract way, which is totally unrelated to the sensory-motor functions of the brain. Other authors argue that concepts are represented in the same format in which they are constructed by the sensory-motor system and can be considered as activity patterns distributed across different perceptual and motor domains. The present paper examines two groups of investigations that support the second view. Particular attention is given to the role of body movements and somatosensory inputs in the representation of artifacts and, respectively, of visual and other perceptual sources of knowledge in the construction of biological categories. The first group of studies aimed to assess the weight of various kinds of information in the representation of different conceptual categories by asking normal subjects to subjectively evaluate the role of various perceptual, motor, and encyclopedic sources of knowledge in the construction of different semantic categories. The second group of studies investigated the neuro-anatomical correlates of various types of categorical disorders. These last investigations showed that the cortical areas damaged in patients with a disorder selectively affecting a given category have a critical role in processing the information that has contributed most to constructing the affected category. Both lines of research suggest that body movements and somatosensory information have a major role in the representation of actions and artifacts mainly known through manipulations and other actions, whereas visual and other perceptual information has a dominant role in the representation of animals and other living things.

An exaggerated effect for proper nouns in a case of superior written over spoken word production

We describe a brain-damaged subject, RR, who manifests superior written over spoken naming of concrete entities from a wide range of conceptual domains. His spoken naming difficulties are due primarily to an impairment of lexical-phonological processing, which implies that his successful written naming does not depend on prior access to the sound structures of words. His performance therefore provides further support for the "orthographic autonomy hypothesis," which maintains that written word production is not obligatorily mediated by phonological knowledge. The case of RR is especially interesting, however, because for him the dissociation between impaired spoken naming and relatively preserved written naming is significantly greater for two categories of unique concrete entities that are lexicalised as proper nouns-specifically, famous faces and famous landmarks-than for five categories of nonunique (i.e., basic level) concrete entities that are lexicalised as common nouns-specifically, animals, fruits/vegetables, tools/utensils, musical instruments, and vehicles. Furthermore, RR's predominant error types in the oral modality are different for the two types of stimuli: omissions for unique entities vs. semantic errors for nonunique entities. We consider two alternative explanations for RR's extreme difficulty in producing the spoken forms of proper nouns: (1) a disconnection between the meanings of proper nouns and the corresponding word nodes in the phonological output lexicon; or (2) damage to the word nodes themselves. We argue that RR's combined behavioural and lesion data do not clearly adjudicate between the two explanations, but that they favour the first explanation over the second.

An ecological alternative to Snodgrass & Vanderwart: 360 high quality colour images with norms for seven psycholinguistic variables

This work presents a new set of 360 high quality colour images belonging to 23 semantic subcategories. Two hundred and thirty-six Spanish speakers named the items and also provided data from seven relevant psycholinguistic variables: age of acquisition, familiarity, manipulability, name agreement, typicality and visual complexity. Furthermore, we also present lexical frequency data derived from Internet search hits. Apart from the high number of variables evaluated, knowing that it affects the processing of stimuli, this new set presents important advantages over other similar image corpi: (a) this corpus presents a broad number of subcategories and images; for example, this will permit researchers to select stimuli of appropriate difficulty as required, (e.g., to deal with problems derived from ceiling effects); (b) the fact of using coloured stimuli provides a more realistic, ecologically-valid, representation of real life objects. In sum, this set of stimuli provides a useful tool for research on visual object- and word-processing, both in neurological patients and in healthy controls.

Grey and white matter correlates of picture naming: evidence from a voxel-based lesion analysis of the Boston Naming Test

A number of recent studies utilizing both functional neuroimaging and lesion analysis techniques in neurologic patients have produced conflicting results with respect to the neural correlates of picture naming. Picture naming involves a number of cognitive processes, from visual perception/recognition to lexical-semantic retrieval to articulation. This middle process, the ability to retrieve a name associated with an object, has been attributed in some cases to posterior portions of the left lateral temporal lobe and in other cases, to anterior temporal cortex. In the current study, we used voxel-based lesion symptom mapping (VLSM) to identify neural correlates of picture naming in a large sample of well-characterized left hemisphere (LH) patients suffering from a range of naming deficits. We tested patients on the Boston Naming Test (BNT), a clinical, standardized measure of picture naming that is widely used in both clinical and research settings. We found that overall performance on the BNT was associated with a network of LH regions that included significant portions of the left anterior to posterior middle temporal gyrus (MTG) and superior temporal gyrus (STG) and underlying white matter, and extended into left inferior parietal cortex. However, when we added covariates to this analysis that controlled for deficits in visual recognition and motor speech in order to isolate brain regions specific to lexical-semantic retrieval, the significant regions that remained were confined almost exclusively to the left mid-posterior MTG and underlying white matter. These findings support the notion that a large network in left peri-Sylvian cortex supports picture naming, but that the left mid-posterior MTG and underlying white matter play a critical role in the core ability to retrieve a name associated with an object or picture.

What's unique about unique entities? An fMRI investigation of the semantics of famous faces and landmarks

Famous people and artifacts are referred to as "unique entities" (UEs) due to the unique nature of the knowledge we have about them. Past imaging and lesion experiments have indicated that the anterior temporal lobes (ATLs) as having a special role in the processing of UEs. It has remained unclear which attributes of UEs were responsible for the observed effects in imaging experiments. In this study, we investigated what factors of UEs influence brain activity. In a training paradigm, we systematically varied the uniqueness of semantic associations, the presence/absence of a proper name, and the number of semantic associations to determine factors modulating activity in regions subserving the processing of UEs. We found that a conjunction of unique semantic information and proper names modulated activity within a section of the left ATL. Overall, the processing of UEs involved a wider left-hemispheric cortical network. Within these regions, brain activity was significantly affected by the unique semantic attributes especially in the presence of a proper name, but we could not find evidence for an effect of the number of semantic associations. Findings are discussed in regard to current models of ATL function, the neurophysiology of semantics, and social cognitive processing.

Semantic category effects modulate visual priming in neglect patients

Previous studies indicate that extinguished stimuli can still be unconsciously processed, leading to implicit priming effects. Here we investigated whether these implicit effects might be modulated by the semantic nature of the stimuli. Five neglect patients and ten controls performed an identification task of items belonging to living and non-living categories. In the study phase photographs of animals and artifacts were presented either to the left visual field (LVF) or to the right visual field (RVF). In the identification phase, each stimulus was displayed centrally and was revealed in a sequence of frames where the item was represented by an increasingly less and less filtered image up to a complete version. The results showed that lateralized stimuli differentially affected controls' and neglect patients' memory retrieval. In controls memory traces from the study phase served as efficient primes, thereby reducing the amount of information necessary for the identification of both stimulus categories. Moreover, hemispheric differences emerged with an advantage of the RVF/left hemisphere for artifact items, while no difference was found for living things. Neglect patients showed a priming effect for artifact items presented either to the RVF/left hemisphere or LVF/right hemisphere, as well as for living items presented to the RVF/left hemisphere, but not for living items presented to the LVF/right hemisphere. The priming effect observed for extinguished artifacts is consistent with the evidence of the existence of a specific mechanism destined to analyze, in an automatic and implicit fashion, motor-relevant information of manipulable objects and tools, which are important for identification process. Results are discussed in relation to current models of organization of conceptual knowledge within the framework of different processes performed by the two hemispheres.

A set of high quality colour images with Spanish norms for seven relevant psycholinguistic variables: the Nombela naming test

This paper presents a new corpus of 140 high quality colour images belonging to 14 subcategories and covering a range of naming difficulty. One hundred and six Spanish speakers named the items and provided data for several psycholinguistic variables: age of acquisition, familiarity, manipulability, name agreement, typicality and visual complexity. Furthermore, we also present lexical frequency data derived internet search hits. Apart from the large number of variables evaluated, these stimuli present an important advantage with respect to other comparable image corpora in so far as naming performance in healthy individuals is less prone to ceiling effect problems. Reliability and validity indexes showed that our items display similar psycholinguistic characteristics to those of other corpora. In sum, this set of ecologically valid stimuli provides a useful tool for scientists engaged in cognitive and neuroscience-based research.

The neural basis for spatial relations

Studies in semantics traditionally focus on knowledge of objects. By contrast, less is known about how objects relate to each other. In an fMRI study, we tested the hypothesis that the neural processing of categorical spatial relations between objects is distinct from the processing of the identity of objects. Attending to the categorical spatial relations compared with attending to the identity of objects resulted in greater activity in superior and inferior parietal cortices (especially on the left) and posterior middle frontal cortices bilaterally. In an accompanying lesion study, we tested the hypothesis that comparable areas would be necessary to represent categorical spatial relations and that the hemispheres differ in their biases to process categorical or coordinate spatial relations. Voxel-based lesion symptom mapping results were consistent with the fMRI observations. Damage to a network comprising left inferior frontal, supramarginal, and angular gyri resulted in behavioral impairment on categorical spatial judgments. Homologous right brain damage also produced such deficits, albeit less severely. The reverse pattern was observed for coordinate spatial processing. Right brain damage to the middle temporal gyrus produced more severe deficits than left hemisphere damage. Additional analyses suggested that some areas process both kinds of spatial relations conjointly and others distinctly. The left angular and inferior frontal gyrus processes coordinate spatial information over and above the categorical processing. The anterior superior temporal gyrus appears to process categorical spatial information uniquely. No areas within the right hemisphere processed categorical spatial information uniquely. Taken together, these findings suggest that the functional neuroanatomy of categorical and coordinate processing is more nuanced than implied by a simple hemispheric dichotomy.

Visual and semantic processing of living things and artifacts: an FMRI study

We carried out an fMRI study with a twofold purpose: to investigate the relationship between networks dedicated to semantic and visual processing and to address the issue of whether semantic memory is subserved by a unique network or by different subsystems, according to semantic category or feature type. To achieve our goals, we administered a word-picture matching task, with within-category foils, to 15 healthy subjects during scanning. Semantic distance between the target and the foil and semantic domain of the target-foil pairs were varied orthogonally. Our results suggest that an amodal, undifferentiated network for the semantic processing of living things and artifacts is located in the anterolateral aspects of the temporal lobes; in fact, activity in this substrate was driven by semantic distance, not by semantic category. By contrast, activity in ventral occipito-temporal cortex was driven by category, not by semantic distance. We interpret the latter finding as the effect exerted by systematic differences between living things and artifacts at the level of their structural representations and possibly of their lower-level visual features. Finally, we attempt to reconcile contrasting data in the neuropsychological and functional imaging literature on semantic substrate and category specificity.

Further lesion evidence for the neural basis of conceptual knowledge for persons and other concrete entities

The neural underpinnings of conceptual knowledge have been studied intensively, but many unanswered questions remain. In a previous study examining recognition of persons, animals, and tools in 116 participants with unilateral brain lesions, we found no instance of a patient who manifested defective recognition in all three categories. We reasoned that the spatial distribution of the lesion loci critical for the appearance of recognition defects for these different categories explained why this 'three-way' defect could not be found in patients with unilateral lesions, and we proposed that only a suitable bilateral lesion would be likely to produce such a combined defect. In the study reported here, we tested this hypothesis by investigating recognition performances in 55 participants with bilateral cortical lesions. In support of the hypothesis, nine patients, all of whose lesions included bilateral occipitotemporal and/or temporal cortices, had a three-way recognition impairment (persons, M = 18.3%; animals, M = 35.7%; tools, M = 71.3%; all scores >2 SDs below normal). As expected, bilateral lesions to other neural sectors, for example prefrontal cortices, did not lead to recognition impairments. These findings provide further support for the notion that retrieval of knowledge for concrete entities from different conceptual categories depends on partially segregated neural systems, located in different sectors of occipitotemporal and temporal regions in right and left hemisphere.