Nouns, verbs, objects, actions, and abstractions: local fMRI activity indexes semantics, not lexical categories

Action (verb) fluency deficits in schizophrenia spectrum disorders: linking language, cognition and interpersonal functioning

Deficits in action (verb) fluency have previously been reported in schizophrenia spectrum disorders. The degree to which this reflects difficulties generating verbs in different semantic categories is unknown. Here, action fluency responses of 46 patients with schizophrenia spectrum disorders and 76 healthy controls were classified as action or mental state verbs, using well-established taxonomies. The word length, frequency, age of acquisition, valence and concreteness of the verbs produced were also examined. Participants also completed measures of cognitive function, and clinical symptoms. Independent inter-rater agreement of semantic categorization was high. The percentage of action verbs produced was significantly lower in patients than controls, whilst the percentage of mental state verbs produced did not differ. Patients' action verbs were: significantly less concrete; positively correlated with memory and intelligence; and negatively correlated with interpersonal symptoms. Impaired action verb, but intact mental state verb generation is consistent with the neural separability of these processes.

EEG source reconstruction evidence for the noun-verb neural dissociation along semantic dimensions

One of the long-standing issues in neurolinguistic research is about the neural basis of word representation, concerning whether grammatical classification or semantic difference causes the neural dissociation of brain activity patterns when processing different word categories, especially nouns and verbs. To disentangle this puzzle, four orthogonalized word categories in Chinese: unambiguous nouns (UN), unambiguous verbs (UV), ambiguous words with noun-biased semantics (AN), and ambiguous words with verb-biased semantics (AV) were adopted in an auditory task for recording electroencephalographic (EEG) signals from 128 electrodes on the scalps of twenty-two subjects. With the advanced current density reconstruction (CDR) algorithm and the constraint of standardized low-resolution electromagnetic tomography, the spatiotemporal brain dynamics of word processing were explored with the results that in multiple time periods including P1 (60-90ms), N1 (100-140ms), P200 (150-250ms) and N400 (350-450ms), noun-verb dissociation over the parietal-occipital and frontal-central cortices appeared not only between the UN-UV grammatical classes but also between the grammatically identical but semantically different AN-AV pairs. The apparent semantic dissociation within one grammatical class strongly suggests that the semantic difference rather than grammatical classification could be interpreted as the origin of the noun-verb neural dissociation. Our results also revealed that semantic dissociation occurs from an early stage and repeats in multiple phases, thus supporting a functionally hierarchical word processing mechanism.

Auditory attention enhances processing of positive and negative words in inferior and superior prefrontal cortex

Visually presented emotional words are processed preferentially and effects of emotional content are similar to those of explicit attention deployment in that both amplify visual processing. However, auditory processing of emotional words is less well characterized and interactions between emotional content and task-induced attention have not been fully understood. Here, we investigate auditory processing of emotional words, focussing on how auditory attention to positive and negative words impacts their cerebral processing. A Functional magnetic resonance imaging (fMRI) study manipulating word valence and attention allocation was performed. Participants heard negative, positive and neutral words to which they either listened passively or attended by counting negative or positive words, respectively. Regardless of valence, active processing compared to passive listening increased activity in primary auditory cortex, left intraparietal sulcus, and right superior frontal gyrus (SFG). The attended valence elicited stronger activity in left inferior frontal gyrus (IFG) and left SFG, in line with these regions' role in semantic retrieval and evaluative processing. No evidence for valence-specific attentional modulation in auditory regions or distinct valence-specific regional activations (i.e., negative > positive or positive > negative) was obtained. Thus, allocation of auditory attention to positive and negative words can substantially increase their processing in higher-order language and evaluative brain areas without modulating early stages of auditory processing. Inferior and superior frontal brain structures mediate interactions between emotional content, attention, and working memory when prosodically neutral speech is processed.

The role of the motor system in action naming in patients with neurodegenerative extrapyramidal syndromes

Previous studies of patients with brain damage have suggested a close relationship between aphasia and movement disorders. Neurodegenerative extrapyramidal syndromes associated with cognitive impairment provide an interesting model for studying the neural substrates of cognitive and motor symptoms. In this review, we focused on studies investigating language production abilities in patients with Parkinson's disease (PD), Corticobasal Syndrome (CBS) and Progressive Supranuclear Palsy (PSP). According to some reports, these patients exhibit a reduction in performance in both action and object naming or verb production compared to healthy individuals. Furthermore, a disproportional impairment of action naming compared to object naming was systematically observed in patients with these disorders. The study of these clinical conditions offers the unique opportunity to examine the close link between linguistic features and motor characteristics of action. This particular pattern of language impairment may contribute to the debate on embodiment theory and on the involvement of the basal ganglia in language and in integrating language and movement. From a translational perspective, we suggest that language ability assessments are useful in the clinical work-up, along with neuropsychological and motor evaluations. Specific protocols should be developed in the near future to better characterize language deficits and to permit an early cognitive diagnosis. Moreover, the link between language deficits and motor impairment opens a new issue for treatment approaches. Treatment of one of these two symptoms may ameliorate the other, and treating both may produce a greater improvement in patients' global clinical conditions.

EEG beta-power changes reflect motor involvement in abstract action language processing

Brain oscillations in the α- and β-range become suppressed during motor processing and motor imagery. It has recently been discussed that such power changes also occur during action language processing. In our study, we compared β₂-oscillations (16-25Hz) during the observation of prototypical arm movements (revealed via motion tracking) as well as during semantic processing of concrete and abstract sentences containing arm-related action verbs. Whereas we did find a strong desynchronization in the β₂-range during action observation, the processing of action sentences evoked a rather weak desynchronization. However, this desynchronization occurred for action verbs in both concrete and abstract contexts. These results might indicate a tendency for abstract action language to be processed similar to concrete action language rather than abstract sentences. The oscillation patterns reflect the close relationship between language comprehension and motor functions - one of the core claims of current theories on embodied cognition.

A Spiking Neurocomputational Model of High-Frequency Oscillatory Brain Responses to Words and Pseudowords

Experimental evidence indicates that neurophysiological responses to well-known meaningful sensory items and symbols (such as familiar objects, faces, or words) differ from those to matched but novel and senseless materials (unknown objects, scrambled faces, and pseudowords). Spectral responses in the high beta- and gamma-band have been observed to be generally stronger to familiar stimuli than to unfamiliar ones. These differences have been hypothesized to be caused by the activation of distributed neuronal circuits or cell assemblies, which act as long-term memory traces for learned familiar items only. Here, we simulated word learning using a biologically constrained neurocomputational model of the left-hemispheric cortical areas known to be relevant for language and conceptual processing. The 12-area spiking neural-network architecture implemented replicates physiological and connectivity features of primary, secondary, and higher-association cortices in the frontal, temporal, and occipital lobes of the human brain. We simulated elementary aspects of word learning in it, focussing specifically on semantic grounding in action and perception. As a result of spike-driven Hebbian synaptic plasticity mechanisms, distributed, stimulus-specific cell-assembly (CA) circuits spontaneously emerged in the network. After training, presentation of one of the learned "word" forms to the model correlate of primary auditory cortex induced periodic bursts of activity within the corresponding CA, leading to oscillatory phenomena in the entire network and spontaneous across-area neural synchronization. Crucially, Morlet wavelet analysis of the network's responses recorded during presentation of learned meaningful "word" and novel, senseless "pseudoword" patterns revealed stronger induced spectral power in the gamma-band for the former than the latter, closely mirroring differences found in neurophysiological data. Furthermore, coherence analysis of the simulated responses uncovered dissociated category specific patterns of synchronous oscillations in distant cortical areas, including indirectly connected primary sensorimotor areas. Bridging the gap between cellular-level mechanisms, neuronal-population behavior, and cognitive function, the present model constitutes the first spiking, neurobiologically, and anatomically realistic model able to explain high-frequency oscillatory phenomena indexing language processing on the basis of dynamics and competitive interactions of distributed cell-assembly circuits which emerge in the brain as a result of Hebbian learning and sensorimotor experience.

Feature-Specific Event-Related Potential Effects to Action- and Sound-Related Verbs during Visual Word Recognition

Grounded cognition theories suggest that conceptual representations essentially depend on modality-specific sensory and motor systems. Feature-specific brain activation across different feature types such as action or audition has been intensively investigated in nouns, while feature-specific conceptual category differences in verbs mainly focused on body part specific effects. The present work aimed at assessing whether feature-specific event-related potential (ERP) differences between action and sound concepts, as previously observed in nouns, can also be found within the word class of verbs. In Experiment 1, participants were visually presented with carefully matched sound and action verbs within a lexical decision task, which provides implicit access to word meaning and minimizes strategic access to semantic word features. Experiment 2 tested whether pre-activating the verb concept in a context phase, in which the verb is presented with a related context noun, modulates subsequent feature-specific action vs. sound verb processing within the lexical decision task. In Experiment 1, ERP analyses revealed a differential ERP polarity pattern for action and sound verbs at parietal and central electrodes similar to previous results in nouns. Pre-activation of the meaning of verbs in the preceding context phase in Experiment 2 resulted in a polarity-reversal of feature-specific ERP effects in the lexical decision task compared with Experiment 1. This parallels analogous earlier findings for primed action and sound related nouns. In line with grounded cognitions theories, our ERP study provides evidence for a differential processing of action and sound verbs similar to earlier observation for concrete nouns. Although the localizational value of ERPs must be viewed with caution, our results indicate that the meaning of verbs is linked to different neural circuits depending on conceptual feature relevance.

Commonality of neural representations of sentences across languages: Predicting brain activation during Portuguese sentence comprehension using an English-based model of brain function

The aim of the study was to test the cross-language generative capability of a model that predicts neural activation patterns evoked by sentence reading, based on a semantic characterization of the sentence. In a previous study on English monolingual speakers (Wang et al., submitted), a computational model performed a mapping from a set of 42 concept-level semantic features (Neurally Plausible Semantic Features, NPSFs) as well as 6 thematic role markers to neural activation patterns (assessed with fMRI), to predict activation levels in a network of brain locations. The model used two types of information gained from the English-based fMRI data to predict the activation for individual sentences in Portuguese. First, it used the mapping weights from NPSFs to voxel activation levels derived from the model for English reading. Second, the brain locations for which the activation levels were predicted were derived from a factor analysis of the brain activation patterns during English reading. These meta-language locations were defined by the clusters of voxels with high loadings on each of the four main dimensions (factors), namely people, places, actions and feelings, underlying the neural representations of the stimulus sentences. This cross-language model succeeded in predicting the brain activation patterns associated with the reading of 60 individual Portuguese sentences that were entirely new to the model, attaining accuracies reliably above chance level. The prediction accuracy was not affected by whether the Portuguese speaker was monolingual or Portuguese-English bilingual. The model's confusion errors indicated an accurate capture of the events or states described in the sentence at a conceptual level. Overall, the cross-language predictive capability of the model demonstrates the neural commonality between speakers of different languages in the representations of everyday events and states, and provides an initial characterization of the common meta-language neural basis.

Exploring the Neural Representation of Novel Words Learned through Enactment in a Word Recognition Task

Vocabulary learning in a second language is enhanced if learners enrich the learning experience with self-performed iconic gestures. This learning strategy is called enactment. Here we explore how enacted words are functionally represented in the brain and which brain regions contribute to enhance retention. After an enactment training lasting 4 days, participants performed a word recognition task in the functional Magnetic Resonance Imaging (fMRI) scanner. Data analysis suggests the participation of different and partially intertwined networks that are engaged in higher cognitive processes, i.e., enhanced attention and word recognition. Also, an experience-related network seems to map word representation. Besides core language regions, this latter network includes sensory and motor cortices, the basal ganglia, and the cerebellum. On the basis of its complexity and the involvement of the motor system, this sensorimotor network might explain superior retention for enactment.

An fMRI study of perception and action in deaf signers

Since the discovery of mirror neurons, there has been a great deal of interest in understanding the relationship between perception and action, and the role of the human mirror system in language comprehension and production. Two questions have dominated research. One concerns the role of Broca's area in speech perception. The other concerns the role of the motor system more broadly in understanding action-related language. The current study investigates both of these questions in a way that bridges research on language with research on manual actions. We studied the neural basis of observing and executing American Sign Language (ASL) object and action signs. In an fMRI experiment, deaf signers produced signs depicting actions and objects as well as observed/comprehended signs of actions and objects. Different patterns of activation were found for observation and execution although with overlap in Broca's area, providing prima facie support for the claim that the motor system participates in language perception. In contrast, we found no evidence that action related signs differentially involved the motor system compared to object related signs. These findings are discussed in the context of lesion studies of sign language execution and observation. In this broader context, we conclude that the activation in Broca's area during ASL observation is not causally related to sign language understanding.

Neural dynamics of object noun, action verb and action noun production in picture naming

The verb/noun dissociation has often involved the semantic/grammatical confound. We conducted two event-related potentials (ERPs) studies with the aim of minimizing this confound. In Experiment 1 participants named pictures depicting actions, with verbs or nouns and pictures depicting objects with nouns. In Experiment 2, participants named objects (nouns) or actions (verbs/nouns) from the same set of action pictures. Compatible with lexical-semantic processes, semantic category modulated waveform amplitudes and topographic patterns between 250 and 380 ms after picture-onset in Experiment 1. No such effects were observed in Experiment 2. No effects were found for grammatical class in both experiments suggesting that grammatical information is not mandatorily activated during lexical-semantic processes. Given the absence of dissociation when same pictures were used the results are described as feed-forward effects from visual to semantic processing, indicating differential neural networks for lexical selection of action and object words from their corresponding visual referents.

Contributions to a neurophysiology of meaning: the interpretation of written messages could be an automatic stimulus-reaction mechanism before becoming conscious processing of information

Background. Even though the interpretation of natural language messages is generally conceived as the result of a conscious processing of the message content, the influence of unconscious factors is also well known. What is still insufficiently known is the way such factors work. We have tackled interpretation assuming it is a process, whose basic features are the same for the whole humankind, and employing a naturalistic approach (careful observation of phenomena in conditions the closest to "natural" ones, and precise description before and independently of data statistical analysis). Methodology. Our field research involved a random sample of 102 adults. We presented them with a complete real world-like case of written communication using unabridged message texts. We collected data (participants' written reports on their interpretations) in controlled conditions through a specially designed questionnaire (closed and opened answers); then, we treated it through qualitative and quantitative methods. Principal Findings. We gathered some evidence that, in written message interpretation, between reading and the attribution of conscious meaning, an intermediate step could exist (we named it "disassembling") which looks like an automatic reaction to the text words/expressions. Thus, the process of interpretation would be a discontinuous sequence of three steps having different natures: the initial "decoding" step (i.e., reading, which requires technical abilities), disassembling (the automatic reaction, an unconscious passage) and the final conscious attribution of meaning. If this is true, words and expressions would firstly function like physical stimuli, before being taken into account as symbols. Such hypothesis, once confirmed, could help explaining some links between the cultural (human communication) and the biological (stimulus-reaction mechanisms as the basis for meanings) dimension of humankind.

Grounding grammatical categories: attention bias in hand space influences grammatical congruency judgment of Chinese nominal classifiers

Embodied cognitive theories predict that linguistic conceptual representations are grounded and continually represented in real world, sensorimotor experiences. However, there is an on-going debate on whether this also holds for abstract concepts. Grammar is the archetype of abstract knowledge, and therefore constitutes a test case against embodied theories of language representation. Former studies have largely focussed on lexical-level embodied representations. In the present study we take the grounding-by-modality idea a step further by using reaction time (RT) data from the linguistic processing of nominal classifiers in Chinese. We take advantage of an independent body of research, which shows that attention in hand space is biased. Specifically, objects near the hand consistently yield shorter RTs as a function of readiness for action on graspable objects within reaching space, and the same biased attention inhibits attentional disengagement. We predicted that this attention bias would equally apply to the graspable object classifier but not to the big object classifier. Chinese speakers (N = 22) judged grammatical congruency of classifier-noun combinations in two conditions: graspable object classifier and big object classifier. We found that RTs for the graspable object classifier were significantly faster in congruent combinations, and significantly slower in incongruent combinations, than the big object classifier. There was no main effect on grammatical violations, but rather an interaction effect of classifier type. Thus, we demonstrate here grammatical category-specific effects pertaining to the semantic content and by extension the visual and tactile modality of acquisition underlying the acquisition of these categories. We conclude that abstract grammatical categories are subjected to the same mechanisms as general cognitive and neurophysiological processes and may therefore be grounded.

Imaginative Language: What Event-Related Potentials have Revealed about the Nature and Source of Concreteness Effects

Behavioral and neuropsychological evidence suggest that abstract and concrete concepts may be represented, retrieved, and processed differently in the human brain. As reviewed in this paper, data using event-related potential measures, some in combination with visual half-field presentation methods, have offered a detailed picture of the nature and source of concreteness effects. In particular, the results provide strong evidence for multiple mechanisms underlying the behavioral processing differences that have long been noted for concrete and abstract words and, further, suggest an intriguing, unique role for the right hemisphere in associating words with sensory imagery.

Task type affects location of language-positive cortical regions by repetitive navigated transcranial magnetic stimulation mapping

Objectives

Recent repetitive TMS (rTMS) mapping protocols for language mapping revealed deficits of this method, mainly in posterior brain regions. Therefore this study analyzed the impact of different language tasks on the localization of language-positive brain regions and compared their effectiveness, especially with regard to posterior brain regions.

Methods

Nineteen healthy, right-handed subjects performed object naming, pseudoword reading, verb generation, and action naming during rTMS language mapping of the left hemisphere. Synchronically, 5 Hz/10 pulses were applied with a 0 ms delay

Results

The object naming task evoked the highest error rate (14%), followed by verb generation (13%) and action naming (11%). The latter revealed more errors in posterior than in anterior areas. Pseudoword reading barely generated errors, except for phonological paraphasias.

Conclusions

In general, among the evaluated language tasks, object naming is the most discriminative task to detect language-positive regions via rTMS. However, other tasks might be used for more specific questions.

Bringing back the body into the mind: gestures enhance word learning in foreign language

Foreign language education in the twenty-first century still teaches vocabulary mainly through reading and listening activities. This is due to the link between teaching practice and traditional philosophy of language, where language is considered to be an abstract phenomenon of the mind. However, a number of studies have shown that accompanying words or phrases of a foreign language with gestures leads to better memory results. In this paper, I review behavioral research on the positive effects of gestures on memory. Then I move to the factors that have been addressed as contributing to the effect, and I embed the reviewed evidence in the theoretical framework of embodiment. Finally, I argue that gestures accompanying foreign language vocabulary learning create embodied representations of those words. I conclude by advocating the use of gestures in future language education as a learning tool that enhances the mind.