Event-related potentials and semantics: an overview and an integrative proposal

Functional Role of the N400 and P600 in Language-Related ERP Studies with Respect to Semantic Anomalies: An Overview

In this study, the language-related ERP studies relevant to the functional role of the N400 and P600 in semantically anomalous sentences and the underlying reasons which may affect their functions were reviewed. Since their discovery, the N400 and P600 have been the most important language-related ERP components. The N400 has been mostly elicited as a result of processing sentences with lexical and semantic anomalies, but later on, in many studies instead of the expected lexical-semantic N400 effect, semantic anomalies elicited a P600 effect called semantic P600. However, the functional interpretation of these two ERP components has constantly been a matter of debate. Perhaps most notably, it is proposed that it is not just the N400 which is related to semantic anomalies but the P600 can also be reflected as a result of these kinds of anomalies. Reviewing the literature for explaining the functions of the two ERP components, the N400 and the P600, during the processing of semantic anomalies revealed that still there is a need for more research on language processing in order to make the researchers capable of describing the underlying factors influencing them, especially more focused investigations of the functional-anatomical and neurocomputational models may provide a clearer understanding of them. Moreover, any practical theory or model of the N400 and the P600 in language comprehension needs to consider the apparent inconsistencies in the elicitation pattern of the N400 and the P600 in order to successfully capture the full data spectrum.

Corroborating behavioral evidence for the interplay of representational richness and semantic control in semantic word processing

This study aimed to replicate and validate concreteness and context effects on semantic word processing. In Experiment 1, we replicated the behavioral findings of Hoffman et al. (Cortex 63,250–266, https://doi.org/10.1016/j.cortex.2014.09.001, 2015) by applying their cueing paradigm with their original stimuli translated into German. We found concreteness and contextual cues to facilitate word processing in a semantic judgment task with 55 healthy adults. The two factors interacted in their effect on reaction times: abstract word processing profited more strongly from a contextual cue, while the concrete words’ processing advantage was reduced but still present. For accuracy, the descriptive pattern of results suggested an interaction, which was, however, not significant. In Experiment 2, we reformulated the contextual cues to avoid repetition of the to-be-processed word. In 83 healthy adults, the same pattern of results emerged, further validating the findings. Our corroborating evidence supports theories integrating representational richness and semantic control mechanisms as complementary mechanisms in semantic word processing.

Electrophysiological Evidence for Early and Interactive Symbol Access and Rule Processing in Retrieving and Combining Language Constructions

The human brain stores an immense repertoire of linguistic symbols (morphemes, words) and combines them into a virtually unlimited set of well-formed strings (phrases, sentences) that serve as efficient communicative tools. Communication is hampered, however, if strings include meaningless items (e.g., "pseudomorphemes"), or if the rules for combining string elements are violated. Prior research suggests that, when participants attentively process sentences in a linguistic task, syntactic processing can occur quite early, but lexicosemantic processing, or any interaction involving this factor, is manifest later in time (ca. 400 msec or later). In contrast, recent evidence from passive speech perception paradigms suggests early processing of both combinatorial (morphosyntactic) and storage-related (lexicosemantic) properties. A crucial question is whether these parallel processes might also interact early in processing. Using ERPs in an orthogonal design, we presented spoken word strings to participants while they were distracted from incoming speech to obtain information about automatic language processing mechanisms unaffected by task-related strategies. Stimuli were either (1) well-formed miniconstructions (short pronoun-verb sentences), (2) "unstored" strings containing a pseudomorpheme, (3) "ill-combined" strings violating subject-verb agreement rules, or (4) double violations including both types of errors. We found that by 70-210 msec after the onset of the phrase-final syllable that disambiguated the strings, interactions of lexicosemantic and morphosyntactic deviance were evident in the ERPs. These results argue against serial processing of lexical storage, morphosyntactic combination and their interaction, and in favor of early, simultaneous, and interactive processing of symbols and their combinatorial structures.

The effects of gender and self-insight on early semantic processing

This event-related potential (ERP) study explored individual differences associated with gender and level of self-insight in early semantic processing. Forty-eight Chinese native speakers completed a semantic judgment task with three different categories of words: abstract neutral words (e.g., logic, effect), concrete neutral words (e.g., teapot, table), and emotion words (e.g., despair, guilt). They then assessed their levels of self-insight. Results showed that women engaged in greater processing than did men. Gender differences also manifested in the relationship between level of self-insight and word processing. For women, level of self-insight was associated with level of semantic activation for emotion words and abstract neutral words, but not for concrete neutral words. For men, level of self-insight was related to processing speed, particularly in response to abstract and concrete neutral words. These findings provide electrophysiological evidence for the effects of gender and self-insight on semantic processing and highlight the need to take into consideration subject variables in related research.

Argument structure and the representation of abstract semantics

According to the dual coding theory, differences in the ease of retrieval between concrete and abstract words are related to the exclusive dependence of abstract semantics on linguistic information. Argument structure can be considered a measure of the complexity of the linguistic contexts that accompany a verb. If the retrieval of abstract verbs relies more on the linguistic codes they are associated to, we could expect a larger effect of argument structure for the processing of abstract verbs. In this study, sets of length- and frequency-matched verbs including 40 intransitive verbs, 40 transitive verbs taking simple complements, and 40 transitive verbs taking sentential complements were presented in separate lexical and grammatical decision tasks. Half of the verbs were concrete and half were abstract. Similar results were obtained in the two tasks, with significant effects of imageability and transitivity. However, the interaction between these two variables was not significant. These results conflict with hypotheses assuming a stronger reliance of abstract semantics on linguistic codes. In contrast, our data are in line with theories that link the ease of retrieval with availability and robustness of semantic information.

Detecting self-produced speech errors before and after articulation: an ERP investigation

It has been argued that speech production errors are monitored by the same neural system involved in monitoring other types of action errors. Behavioral evidence has shown that speech errors can be detected and corrected prior to articulation, yet the neural basis for such pre-articulatory speech error monitoring is poorly understood. The current study investigated speech error monitoring using a phoneme-substitution task known to elicit speech errors. Stimulus-locked event-related potential (ERP) analyses comparing correct and incorrect utterances were used to assess pre-articulatory error monitoring and response-locked ERP analyses were used to assess post-articulatory monitoring. Our novel finding in the stimulus-locked analysis revealed that words that ultimately led to a speech error were associated with a larger P2 component at midline sites (FCz, Cz, and CPz). This early positivity may reflect the detection of an error in speech formulation, or a predictive mechanism to signal the potential for an upcoming speech error. The data also revealed that general conflict monitoring mechanisms are involved during this task as both correct and incorrect responses elicited an anterior N2 component typically associated with conflict monitoring. The response-locked analyses corroborated previous observations that self-produced speech errors led to a fronto-central error-related negativity (ERN). These results demonstrate that speech errors can be detected prior to articulation, and that speech error monitoring relies on a central error monitoring mechanism.

Combined ERP/fMRI evidence for early word recognition effects in the posterior inferior temporal gyrus

Two brain regions with established roles in reading are the posterior middle temporal gyrus and the posterior fusiform gyrus (FG). Lesion studies have also suggested that the region located between them, the posterior inferior temporal gyrus (pITG), plays a central role in word recognition. However, these lesion results could reflect disconnection effects since neuroimaging studies have not reported consistent lexicality effects in pITG. Here we tested whether these reported pITG lesion effects are due to disconnection effects or not using parallel Event-related Potentials (ERP)/functional magnetic resonance imaging (fMRI) studies. We predicted that the Recognition Potential (RP), a left-lateralized ERP negativity that peaks at about 200-250 msec, might be the electrophysiological correlate of pITG activity and that conditions that evoke the RP (perceptual degradation) might therefore also evoke pITG activity. In Experiment 1, twenty-three participants performed a lexical decision task (temporally flanked by supraliminal masks) while having high-density 129-channel ERP data collected. In Experiment 2, a separate group of fifteen participants underwent the same task while having fMRI data collected in a 3T scanner. Examination of the ERP data suggested that a canonical RP effect was produced. The strongest corresponding effect in the fMRI data was in the vicinity of the pITG. In addition, results indicated stimulus-dependent functional connectivity between pITG and a region of the posterior FG near the Visual Word Form Area (VWFA) during word compared to nonword processing. These results provide convergent spatiotemporal evidence that the pITG contributes to early lexical access through interaction with the VWFA.

Neural correlates of written emotion word processing: a review of recent electrophysiological and hemodynamic neuroimaging studies

A growing body of literature investigating the neural correlates of emotion word processing has emerged in recent years. Written words have been shown to represent a suitable means to study emotion processing and most importantly to address the distinct and interactive contributions of the two dimensions of emotion: valence and arousal. The aim of the present review is to integrate findings from electrophysiological (ERP) and hemodynamic neuroimaging (fMRI) studies in order to provide a better understanding of emotion word processing. It provides an up-to-date review of recent ERP studies since the review by Kissler et al. (2006) as well as the first review of hemodynamic brain imaging studies in the field. A discussion of theoretical and methodological issues is also presented, along with suggestions for future research.

High arousal words influence subsequent processing of neutral information: evidence from event-related potentials

Recent data suggest that word valence modulates subsequent cognitive processing. However, the contribution of word arousal is less understood. In this study, behavioral and electrophysiological measures to neutral nouns and pseudowords that were preceded by either a high-arousal or a low-arousal word were recorded during a lexical decision task. Effects were found at an electrophysiological level. Target words and pseudowords elicited enhanced N100 amplitudes when they were preceded by high- compared to low-arousing words. This effect may reflect perceptual potentiation during the allocation of attentional resources when the new stimulus is processed. Enhanced amplitudes in a late positivity when target words and pseudowords followed high-arousal primes were also observed, which could be related to sustained attention during supplementary analyses at a post-lexical level.

What Iconic Gesture Fragments Reveal about Gesture–Speech Integration: When Synchrony Is Lost, Memory Can Help

The present series of experiments explores several issues related to gesture–speech integration and synchrony during sentence processing. To be able to more precisely manipulate gesture–speech synchrony, we used gesture fragments instead of complete gestures, thereby avoiding the usual long temporal overlap of gestures with their coexpressive speech. In a pretest, the minimal duration of an iconic gesture fragment needed to disambiguate a homonym (i.e., disambiguation point) was therefore identified. In three subsequent ERP experiments, we then investigated whether the gesture information available at the disambiguation point has immediate as well as delayed consequences on the processing of a temporarily ambiguous spoken sentence, and whether these gesture–speech integration processes are susceptible to temporal synchrony. Experiment 1, which used asynchronous stimuli as well as an explicit task, showed clear N400 effects at the homonym as well as at the target word presented further downstream, suggesting that asynchrony does not prevent integration under explicit task conditions. No such effects were found when asynchronous stimuli were presented using a more shallow task (Experiment 2). Finally, when gesture fragment and homonym were synchronous, similar results as in Experiment 1 were found, even under shallow task conditions (Experiment 3). We conclude that when iconic gesture fragments and speech are in synchrony, their interaction is more or less automatic. When they are not, more controlled, active memory processes are necessary to be able to combine the gesture fragment and speech context in such a way that the homonym is disambiguated correctly.

Effects of long-time reading experience on reaction time and the recognition potential

The proposition that long-time experience in reading a language gradually builds up rapidly acting neural processes that facilitate the processing of words in that language and speed them into conscious awareness was examined. Behavioral reaction time (RT) and electrophysiological responsiveness to visually displayed words and non-language images were measured in persons who differed in how much experience they had in reading English. The electrophysiological response was the recognition potential (RP). Behavioral RT and the latency of the RP to English words were both expected to depend upon how much English reading experience a person had. The short latency of the RP was expected to free it from the influence of non-perceptual factors that affect RT, such as speed/accuracy tradeoff. This expectation yielded the prediction that the behavioral and electrophysiological results would differ in a specific way. Long-time readers of English were expected to show shorter RP latency to English words than less experienced (China-educated) readers of English but no RP latency difference for non-language images, with which neither group had greater experience. In contrast, due to speed accuracy tradeoff, the China-educated subjects were expected to show longer RT for both the words and the non-language images. The prediction was confirmed. The amount of language experience that a person had showed a stronger relationship to RP latency than it did to RT. This helped to validate the use of the RP as a tool for investigating perception and demonstrated definite advantages that it has for studying acquired perceptual processes in humans.

Understanding in an instant: neurophysiological evidence for mechanistic language circuits in the brain

How long does it take the human mind to grasp the idea when hearing or reading a sentence? Neurophysiological methods looking directly at the time course of brain activity indexes of comprehension are critical for finding the answer to this question. As the dominant cognitive approaches, models of serial/cascaded and parallel processing, make conflicting predictions on the time course of psycholinguistic information access, they can be tested using neurophysiological brain activation recorded in MEG and EEG experiments. Seriality and cascading of lexical, semantic and syntactic processes receives support from late (latency approximately 1/2s) sequential neurophysiological responses, especially N400 and P600. However, parallelism is substantiated by early near-simultaneous brain indexes of a range of psycholinguistic processes, up to the level of semantic access and context integration, emerging already 100-250ms after critical stimulus information is present. Crucially, however, there are reliable latency differences of 20-50ms between early cortical area activations reflecting lexical, semantic and syntactic processes, which are left unexplained by current serial and parallel brain models of language. We here offer a mechanistic model grounded in cortical nerve cell circuits that builds upon neuroanatomical and neurophysiological knowledge and explains both near-simultaneous activations and fine-grained delays. A key concept is that of discrete distributed cortical circuits with specific inter-area topographies. The full activation, or ignition, of specifically distributed binding circuits explains the near-simultaneity of early neurophysiological indexes of lexical, syntactic and semantic processing. Activity spreading within circuits determined by between-area conduction delays accounts for comprehension-related regional activation differences in the millisecond range.

Double dissociation between rules and memory in music: an event-related potential study

Language and music share a number of characteristics. Crucially, both domains depend on both rules and memorized representations. Double dissociations between the neurocognition of rule-governed and memory-based knowledge have been found in language but not music. Here, the neural bases of both of these aspects of music were examined with an event-related potential (ERP) study of note violations in melodies. Rule-only violations consisted of out-of-key deviant notes that violated tonal harmony rules in novel (unfamiliar) melodies. Memory-only violations consisted of in-key deviant notes in familiar well-known melodies; these notes followed musical rules but deviated from the actual melodies. Finally, out-of-key notes in familiar well-known melodies constituted violations of both rules and memory. All three conditions were presented, within-subjects, to healthy young adults, half musicians and half non-musicians. The results revealed a double dissociation, independent of musical training, between rules and memory: both rule violation conditions, but not the memory-only violations, elicited an early, somewhat right-lateralized anterior-central negativity (ERAN), consistent with previous studies of rule violations in music, and analogous to the early left-lateralized anterior negativities elicited by rule violations in language. In contrast, both memory violation conditions, but not the rule-only violation, elicited a posterior negativity that might be characterized as an N400, an ERP component that depends, at least in part, on the processing of representations stored in long-term memory, both in language and in other domains. The results suggest that the neurocognitive rule/memory dissociation extends from language to music, further strengthening the similarities between the two domains.

The Role of Iconic Gestures in Speech Disambiguation: ERP Evidence

The present series of experiments explored the extent to which iconic gestures convey information not found in speech. Electroencephalogram (EEG) was recorded as participants watched videos of a person gesturing and speaking simultaneously. The experimental sentences contained an unbalanced homonym in the initial part of the sentence (e.g., She controlled the ball …) and were disambiguated at a target word in the subsequent clause (which during the game … vs. which during the dance …). Coincident with the initial part of the sentence, the speaker produced an iconic gesture which supported either the dominant or the subordinate meaning. Event-related potentials were time-locked to the onset of the target word. In Experiment 1, participants were explicitly asked to judge the congruency between the initial homonym-gesture combination and the subsequent target word. The N400 at target words was found to be smaller after a congruent gesture and larger after an incongruent gesture, suggesting that listeners can use gestural information to disambiguate speech. Experiment 2 replicated the results using a less explicit task, indicating that the disambiguating effect of gesture is somewhat task-independent. Unrelated grooming movements were added to the paradigm in Experiment 3. The N400 at subordinate targets was found to be smaller after subordinate gestures and larger after dominant gestures as well as grooming, indicating that an iconic gesture can facilitate the processing of a lesser frequent word meaning. The N400 at dominant targets no longer varied as a function of the preceding gesture in Experiment 3, suggesting that the addition of meaningless movements weakened the impact of gesture. Thus, the integration of gesture and speech in comprehension does not appear to be an obligatory process but is modulated by situational factors such as the amount of observed meaningful hand movements.

Big brown dog or brown big dog? An electrophysiological study of semantic constraints on prenominal adjective order

Event-related brain potentials (ERPs) were recorded while participants read and made acceptability judgments about sentences containing three types of adjective sequences: (1) normal sequences--e.g., Jennifer rode a huge gray elephant; (2) reversed sequences that violate grammatical-semantic constraints on linear order--e.g., *Jennifer rode a gray huge elephant; and (3) contradictory sequences that violate lexical-semantic constraints on compositionality--e.g., *Jennifer rode a small huge elephant. Relative to the control condition, the second adjective elicited a reduced N400 and an enhanced P600 in both the reversal condition and the contradiction condition. We present several alternative accounts of these two effects, but favor an interpretation which treats them as reflecting semantic and syntactic aspects of a temporary reanalysis of the adjective order construction. Furthermore, relative to the control condition, the final noun elicited a robust N400 in the contradiction condition but not in the reversal condition. We suggest that this effect indexes the full registration of the lexical-semantic incompatibility of the two adjectives in the contradiction condition. Finally, we discuss how all of these findings fit into the broader context of recent ERP studies that have reported atypical N400s and robust P600s in response to certain types of semantic anomalies.

Semantic processing is affected in inhibition of return: evidence from an event-related potentials study

Inhibition of return refers to a slower responding to a target stimulus appearing at previously cued locations. We used the event-related potentials technique to investigate the effects of inhibition of return in semantic processing with the combination of a spatial cueing task and semantic N400 paradigm. The results showed that the N400 component, as an index of semantic processing, was suppressed when the target words were presented in the cued location relative to the uncued location. The results indicated that the semantic processing of the target word presented on the cued location is affected by inhibition of return. Moreover, our findings provided event-related potential evidence for the inhibition of attention theory of inhibition of return.

Auditory sensory memory and working memory processes in children with normal hearing and cochlear implants

There can be wide variation in the level of oral/aural language ability that prelingually hearing-impaired children develop after cochlear implantation. Automatic perceptual processing mechanisms have come under increasing scrutiny in attempts to explain this variation. Using mismatch negativity methods, this study explored associations between auditory sensory memory mechanisms and verbal working memory function in children with cochlear implants and a group of hearing controls of similar age. Whilst clear relationships were observed in the hearing children between mismatch activation and working memory measures, this association appeared to be disrupted in the implant children. These findings would fit with the proposal that early auditory deprivation and a degraded auditory signal can cause changes in the processes underpinning the development of oral/aural language skills in prelingually hearing-impaired children with cochlear implants and thus alter their developmental trajectory.

Differential integration efforts of mandatory and optional sentence constituents

We investigated the online sensitivity of the semantic integration system to the different roles played by sentence constituents that are necessary (verbs and nouns) or optional (adjectives) for argument completion. We compared the effect of semantic incongruities introduced in both types of words on the N400 ERP component. Participants read sentences for meaning, half of which were rendered anomalous by an incongruent verb, noun, or an early/late adjective. Incongruent adjectives led to smaller N400 effects than did incongruent nouns and verbs, and the congruity effect for sentence-final adjectives was not significant. All incongruities are therefore not created equal: Incongruent optional sentence constituents create less of an integrative burden than incongruent mandatory sentence constituents, suggesting that online sentence integration processes are sensitive to the distinct roles played by different words in shaping sentence meaning.

The role of the right cerebral hemisphere in processing novel metaphoric expressions taken from poetry: a divided visual field study

Previous research suggests that the right hemisphere (RH) may contribute uniquely to the processing of metaphoric language. However, most studies have focused on familiar metaphoric expressions. The present study used the divided visual field paradigm to examine the role of the right cerebral hemisphere in processing novel metaphoric expressions taken from poetry. In two experiments, participants were presented with four types of word pairs, literal, conventional metaphoric and novel metaphoric expressions and unrelated word pairs, and asked to perform a semantic judgment task. Two different SOAs: 400 and 1100 ms were used. The results of both experiments showed that responses to LVF/RH presented target words were more accurate and faster than responses to RVF/LH target words for novel metaphoric expressions, but not for other types of word pairs. These results support previous research indicating that during word recognition, the RH activates a broader range of related meanings than the LH, including novel, nonsalient meanings. The findings thus suggest that the RH may be critically involved in at least one important component of novel metaphor comprehension, i.e., the integration of the individual meanings of two seemingly unrelated concepts into a meaningful metaphoric expression.

[Q:] When would you prefer a SOSSAGE to a SAUSAGE? [A:] At about 100 msec. ERP correlates of orthographic typicality and lexicality in written word recognition

Using a speeded lexical decision task, event-related potentials (ERPs), and minimum norm current source estimates, we investigated early spatiotemporal aspects of cortical activation elicited by words and pseudo-words that varied in their orthographic typicality, that is, in the frequency of their component letter pairs (bi-grams) and triplets (tri-grams). At around 100 msec after stimulus onset, the ERP pattern revealed a significant typicality effect, where words and pseudo-words with atypical orthography (e.g., yacht, cacht) elicited stronger brain activation than items characterized by typical spelling patterns (cart, yart). At approximately 200 msec, the ERP pattern revealed a significant lexicality effect, with pseudo-words eliciting stronger brain activity than words. The two main factors interacted significantly at around 160 msec, where words showed a typicality effect but pseudo-words did not. The principal cortical sources of the effects of both typicality and lexicality were localized in the inferior temporal cortex. Around 160 msec, atypical words elicited the stronger source currents in the left anterior inferior temporal cortex, whereas the left perisylvian cortex was the site of greater activation to typical words. Our data support distinct but interactive processing stages in word recognition, with surface features of the stimulus being processed before the word as a meaningful lexical entry. The interaction of typicality and lexicality can be explained by integration of information from the early form-based system and lexicosemantic processes.

The time course of visual word recognition as revealed by linear regression analysis of ERP data

EEG correlates of a range of psycholinguistic word properties were used to investigate the time course of access to psycholinguistic information during visual word recognition. Neurophysiological responses recorded in a visual lexical decision task were submitted to linear regression analysis. First, 10 psycholinguistic features of each of 300 stimulus words were submitted to a principal component analysis, which yielded four orthogonal variables likely to reflect separable processes in visual word recognition: Word length, Letter n-gram frequency, Lexical frequency and Semantic coherence of a word's morphological family. Since the lexical decision task required subjects to distinguish between words and pseudowords, the binary variable Lexicality was also investigated using a factorial design. Word-pseudoword differences in the event-related potential first appeared at 160 ms after word onset. However, regression analysis of EEG data documented a much earlier effect of both Word length and Letter n-gram frequency around 90 ms. Lexical frequency showed its earliest effect slightly later, at 110 ms, and Semantic coherence significantly correlated with neurophysiological measures around 160 ms, simultaneously with the lexicality effect. Source estimates indicated parieto-temporo-occipital generators for the factors Length, Letter n-gram frequency and Word frequency, but widespread activation with foci in left anterior temporal lobe and inferior frontal cortex related to Semantic coherence. At later stages (>200 ms), all variables exhibited simultaneous EEG correlates. These results indicate that information about surface form and meaning of a lexical item is first accessed at different times in different brain systems and then processed simultaneously, thus supporting cascaded interactive processing models.

Event-related potentials, cognition, and behavior: A biological approach

The prevailing cognitive-psychological accounts of event-related brain potentials (ERPs) assume that ERP components manifest information processing operations leading from stimulus to response. Since this view encounters numerous difficulties already analyzed in previous studies, an alternative view is presented here that regards cortical control of behavior as a repetitive sensorimotor cycle consisting of two phases: (i) feedforward anticipation and (ii) feedback cortical performance. This view allows us to interpret in an integrative manner numerous data obtained from very different domains of ERP studies: from biophysics of ERP waves to their relationship to the processing of language, in which verbal behavior is viewed as likewise controlled by the same two basic control processes: feedforward (hypothesis building) and feedback (hypothesis checking). The proposed approach is intentionally simplified, explaining numerous effects on the basis of few assumptions and relating several levels of analysis: neurophysiology, macroelectrical processes (i.e. ERPs), cognition and behavior. It can, therefore, be regarded as a first approximation to a general theory of ERPs.

Emotional and semantic networks in visual word processing: insights from ERP studies

The event-related brain potential (ERP) literature concerning the impact of emotional content on visual word processing is reviewed and related to general knowledge on semantics in word processing: emotional connotation can enhance cortical responses at all stages of visual word processing following the assembly of visual word form (up to 200 ms), such as semantic access (around 200 ms), allocation of attentional resources (around 300 ms), contextual analysis (around 400 ms), and sustained processing and memory encoding (around 500 ms). Even earlier effects have occasionally been reported with subliminal or perceptual threshold presentation, particularly in clinical populations. Here, the underlying mechanisms are likely to diverge from the ones operational in standard natural reading. The variability in timing of the effects can be accounted for by dynamically changing lexical representations that can be activated as required by the subjects' motivational state, the task at hand, and additional contextual factors. Throughout, subcortical structures such as the amygdala are likely to contribute these enhancements. Further research will establish whether or when emotional arousal, valence, or additional emotional properties drive the observed effects and how experimental factors interact with these. Meticulous control of other word properties known to affect ERPs in visual word processing, such as word class, length, frequency, and concreteness and the use of more standardized EEG procedures is vital. Mapping the interplay between cortical and subcortical mechanisms that give rise to amplified cortical responses to emotional words will be of highest priority for future research.

Developmental change in neutral processing of words by children with autism

This study examined the development of neural processing of auditorally presented words in high functioning children with autism. The purpose was to test the hypothesis that electrophysiological abnormalities associated with impairments in early cortical processing and in semantic processing persist into early adolescence in autistic individuals. Eighteen children with autism and 18 normally developing children participated in the study. Ten of the children in each group were 8-9 years old, and 8 in each group were 11-12 years old (n = 36). Lists of words were presented auditorally; half were words belonging to a specified semantic category and half were words outside the category. Results revealed that while early cortical processing abnormalities appeared to resolve with development, children with autism in both age groups failed to exhibit differential semantic processing of in-versus out-of-category words. Further, while 8 year-olds with autism generated a large N4 (a late cognitive ERP component, which is sensitive to semantic deviance from a context) to words in both stimulus classes the 11 year-olds showed attenuated N4 relative to normal controls in response to both stimulus types. An attempt is made to integrate findings with current cognitive theories toward a parsimonious explanation of semantic classification deficits in autism.

The recognition potential: Semantic processing or the detection of differences between stimuli?

The recognition potential is traditionally described as an electrical index elicited when subjects view a recognizable stimulus. Recent studies further show that it may be influenced by semantic processing. In this study, we investigated whether this observed influence is really produced by differences in semantic processing or whether it might be caused by the detection of differences between sequentially presented stimuli. In two different experiments, we systematically altered the type of background images presented while keeping the recognizable word constant. Analyses revealed that the same recognizable words elicited an RP with different amplitudes and latencies when viewed under different background conditions. Control stimuli, which were identical to background stimuli, did not elicit the RP. Hence, we postulate that when using the rapid stream stimulation paradigm, RP might also be influenced by the detection of differences between sequentially input stimuli. It is necessary to clarify whether RP changes are caused by the processing of the stimuli or by the detection of difference between successively input stimuli before any conclusion could be made.

Neural activity associated with metaphor comprehension: spatial analysis

Though neuropsychological data indicate that the right hemisphere (RH) plays a major role in metaphor processing, other studies suggest that, at least during some phases of this processing, a RH advantage may not exist. The present study explores, through a temporally agile neural signal--the event-related potentials (ERPs)--, and through source-localization algorithms applied to ERP recordings, whether the crucial phase of metaphor comprehension presents or not a RH advantage. Participants (n=24) were submitted to a S1-S2 experimental paradigm. S1 consisted of visually presented metaphoric sentences (e.g., "Green lung of the city"), followed by S2, which consisted of words that could (i.e., "Park") or could not (i.e., "Semaphore") be defined by S1. ERPs elicited by S2 were analyzed using temporal principal component analysis (tPCA) and source-localization algorithms. These analyses revealed that metaphorically related S2 words showed significantly higher N400 amplitudes than non-related S2 words. Source-localization algorithms showed differential activity between the two S2 conditions in the right middle/superior temporal areas. These results support the existence of an important RH contribution to (at least) one phase of metaphor processing and, furthermore, implicate the temporal cortex with respect to that contribution.

Syntactic expectancy: an event-related potentials study

Although extensive work has been conducted in order to study expectancies about semantic information, little effort has been dedicated to the study of the influence of expectancies in the processing of forthcoming syntactic information. The present study tries to examine the issue by presenting participants with grammatically correct sentences of two types. In the first type the critical word of the sentence belonged to the most expected word category type on the basis of the previous context (an article following a verb). In the second sentence type, the critical word was an unexpected but correct word category (an article following an adjective) when a verb is highly expected. Event-related potentials (ERPs) were measured to critical words in both sentence types. Brain waves evoked by the correct but syntactically unexpected word revealed the presence of a negativity with a central distribution around 300-500 ms after stimuli onset, an N400, that was absent in the case of syntactically expected words. No differences were present in previous time windows. These results support models that differentiate between the processing of expected and unexpected syntactic structures.

Memory structures for encoding and retrieving a piece of music: an ERP investigation

This study examined behavioral and neural correlates of expert musical memory, specifically the hypothesis that particular bars within a complex piece of music would serve as structural markers for encoding to and retrieval from memory. Six pianists were asked to learn and memorize a set prelude by J.S. Bach for performance, and to identify bars that they employed for structuring the prelude into component sections. Following performance from memory, the participants took part in a visual recognition memory task, in which single bars from the prelude had to be distinguished from matched new bars. During the recognition task, the electroencephalogram (EEG) was recorded, and event-related potentials (ERPs) from correctly identified prelude stimulus trials were averaged according to their hypothesized status into "structural" and "nonstructural" bars. The results showed that correct identification of structural bars was significantly faster (and tended to display higher accuracy) than recognition of non-structural ones. In addition, recognition of structural bars was associated with a significantly greater negative ERP peak of 300-400 ms latency and a right centro-parietal scalp distribution. This mid-latency negativity appears to index processing of stimuli that served as cues for encoding and retrieval of a complex semantic structure, and is qualitatively and conceptually different from other previously identified recognition memory ERPs (such as the "old/new" effect), as well as from the classic N400 ERP. The data support existing theories of expert memory and music cognition.

Number-word reading as challenging task in dyslexia? An ERP study

The aim of the present study was to evaluate processes of lexical access, selection and early semantic access in young native Hungarian students as well as in dyslexics compensating successfully for their reading problems of developmental origin. The present study made use of the well-known lexical decision paradigm in which event-related potentials (ERPs) elicited by words, number-words and pseudowords were measured. Subjects had to judge whether the letter strings seen were meaningful or meaningless. Our results suggest that in good readers additional activity occurs in the sensory or selection stage of lexical access when words of low sight frequency, e.g. number-words are read. Significant processing differences for words vs. number-words were found in the later stage of processing. Based on our ERP data we do not suggest number-words for judging general features of lexical processing, especially when developmental dyslexia is the focus of study. Our results show that young adults may develop a particular compensation strategy for reading words of different frequency. We found that: (1) Lexical access is fast and accurate in good readers and the early components elicited by words and number-words do not differ. (2) Attentional effort is reflected by enhanced early components to number-words. (3) Dyslexics may compensate for the weakness of sight word vocabulary, characteristic for frequent words as well, during lexical selection and at a later stage of processing. (4) Dyslexic adults, who compensate well for reading difficulties, differ significantly in this later stage when words have to be read. (5) The late positive component of ERPs reflects additional activation allocated to word reading when low frequency words such as number-words are read. Good readers show this effect as well, therefore, the largest difference found between dyslexics and controls is found for frequent words. (6) The early semantic access is absent in dyslexics when pseudowords are read and this process may be one of the strategies used by dyslexics in a transparent orthography.

Parametric analysis of event-related potentials in semantic comprehension: evidence for parallel brain mechanisms

In event-related potential (ERP) studies of cognitive processes, the electrophysiological responses are typically contrasted between experimental conditions that are taken to represent discrete categories (e.g. attended vs. unattended stimuli, or real vs. nonsense words). Because categorical variation is less powerful than continuous or parametric variation, a more effective method may be to relate continuous variation in the cognitive process with matching variation in the electrophysiological responses. We assessed continuous variation in the expectancy and meaningfulness of words in different sentence contexts by having subjects rate the words along these two dimensions. ERP averages were then created for each word by averaging the ERP across all subjects' responses to that word. A parametric principal components analysis was then conducted by multiplying the factor topographies from the temporal PCA by the parameter correlation maps for each rating parameter. This analysis showed that both expectancy and meaningfulness begin to influence lexical processing around 200 ms. Source localization of the expectancy N2 (recognition potential) pointed to a source in the left fusiform gyrus region (visual word form area). Source localization of the meaningfulness N2 (meaning recognition potential) suggested a right inferior posterior source, such as in the right cerebellum or right fusiform area. Further research with parametric analysis of dense array ERPs may clarify the multiple neural mechanisms of word recognition.

Studying semantics in the brain: the rapid stream stimulation paradigm

Event-related potentials (ERPs) provide information about the temporal course of cognitive processes in the brain. They have proved to be a valuable tool in order to explore semantic aspects of word processing. However, to date, research in this field has been mostly concerned with the study of post-lexical features by means of the N400-paradigm. We introduce here the rapid stream stimulation paradigm, in which stimuli reflecting different levels of linguistic information are presented to subjects at a high rate of stimulation. The present protocol shows in detail how this paradigm can be applied. The application of the rapid stream stimulation paradigm evokes the recognition potential (RP), an ERP component that peaks at around 260 ms after stimuli onset and seems to be reflecting lexical selection processes. Results of studies that revealed the sensibility of the RP to visual-semantic aspects and the location of its neural generators within basal extrastriate areas are reported. Although some research has been conducted with the rapid stream stimulation paradigm much remains still to be done. Some of the possibilities that this paradigm offers are further discussed.