The strong, the weak, and the first: The impact of phonological stress on processing of orthographic errors in silent reading

In auditory speech processing, phonological stress functions as an attention holding cue, which facilitates detection of mispronunciations and phonetic deviants in strong syllables as compared to weak ones. Whereas silent reading involves activation of phonological information including word stress, it is not clear whether it has any functional relevance for visual language processing. We investigated whether phonological stress impacts orthographic processing such as detection of misspellings in silent reading. In an ERP experiment, participants silently read intact and misspelled German words. We manipulated the strength of the misspelled syllable (strong vs. weak) as well as its position (word-initial vs. word-middle). No effect of stress was observed for misspellings occurring in a word-initial position suggesting that misspellings in word-initial position disrupt visual word processing regardless of the phonological strength of the first syllable. In contrast, phonological strength modulated the ERPs when misspellings occurred in the middle of the word: misspellings embedded in strong syllables enhanced the P600 and the N400-like component compared to misspellings in weak syllables. In this case, i.e., when misspellings occur in the middle of a letter string, lexical access may be hindered more when errors occur in strong syllables, as reflected in the enhanced N400 in strong compared to weak syllables. This in turn may facilitate active reanalysis as mirrored in the increased P600 in the strong condition. The findings are discussed in the context of the relatively late activation of phonological form in visual word recognition and its interaction with other perceptual visual information. Overall, the results demonstrate the functional significance of phonological stress in visual word processing.

Electrophysiological Correlates of Second-Language Syntactic Processes Are Related to Native and Second Language Distance Regardless of Age of Acquisition

In the present study, we investigate how early and late L2 learners process L2 grammatical traits that are either present or absent in their native language (L1). Thirteen early (AoA = 4 years old) and 13 late (AoA = 18 years old) Spanish learners of Basque performed a grammatical judgment task on auditory Basque sentences while their event-related brain potentials (ERPs) were recorded. The sentences contained violations of a syntactic property specific to participants' L2, i.e., ergative case, or violations of a syntactic property present in both of the participants' languages, i.e., verb agreement. Two forms of verb agreement were tested: subject agreement, found in participants' L1 and L2, and object agreement, present only in participants' L2. Behaviorally, early bilinguals were more accurate in the judgment task than late L2 learners. Early bilinguals showed native-like ERPs for verb agreement, which differed from the late learners' ERP pattern. Nonetheless, approximation to native-likeness was greater for the subject-verb agreement processing, the type of verb-agreement present in participants' L1, compared to object-verb agreement, the type of verb-agreement present only in participants' L2. For the ergative argument alignment, unique to L2, the two non-native groups showed similar ERP patterns which did not correspond to the natives' ERP pattern. We conclude that non-native syntactic processing approximates native processing for early L2 acquisition and high proficiency levels when the syntactic property is common to the L1 and L2. However, syntactic traits that are not present in the L1 do not rely on native-like processing, despite early AoA and high proficiency.

Beyond Gender Stereotypes in Language Comprehension: Self Sex-Role Descriptions Affect the Brain's Potentials Associated with Agreement Processing

We recorded Event-Related Potentials to investigate differences in the use of gender information during the processing of reflexive pronouns. Pronouns either matched the gender provided by role nouns (such as "king" or "engineer") or did not. We compared two types of gender information, definitional information, which is semantic in nature (a mother is female), or stereotypical (a nurse is likely to be female). When they followed definitional role-nouns, gender-mismatching pronouns elicited a P600 effect reflecting a failure in the agreement process. When instead the gender violation occurred after stereotypical role-nouns the Event Related Potential response was biphasic, being positive in parietal electrodes and negative in anterior left electrodes. The use of a correlational approach showed that those participants with more "feminine" or "expressive" self sex-role descriptions showed a P600 response for stereotype violations, suggesting that they experienced the mismatch as an agreement violation; whereas less "expressive" participants showed an Nref effect, indicating more effort spent in linking the pronouns with the possible, although less likely, counter-stereotypical referent.

Topic shift impairs pronoun resolution during sentence comprehension: Evidence from event-related potentials

This study investigated how topic shift and topic continuation influence pronoun interpretation in Chinese. ERPs recorded on pronouns in topic structure showed stronger and earlier late positive responses (P600) for the topic-shift than for the topic-continuation conditions. However, in nontopic structure where the subject (denoting only subjecthood), rather than the topic (denoting both topichood and subjecthood), acted as the antecedent of the pronoun, almost indistinguishable P600 responses were obtained on the pronoun regardless of whether it was referring to the subject (i.e., subject continuation) or the object (i.e., subject shift). Moreover, stronger and earlier P600 responses were elicited by pronouns in the topic-shift than in the subject-shift conditions, although there was no difference between the topic-continuation and the subject-continuation conditions. These findings suggest that topic shift results in greater difficulty in the resolution stage of referential processing, although the bonding process is not sensitive to the manipulation of topic status, and that topic has a privileged cognitive status relative to other nontopic entities (e.g., subject) in real-time language processing.

The role of prominence in Spanish sentence comprehension: An ERP study

Prominence is the hierarchical relation among arguments that allows us to understand 'Who did what to whom' in a sentence. The present study aimed to provide evidence about the role of prominence information for the incremental interpretation of arguments in Spanish. We investigated the time course of neural correlates associated to the comprehension of sentences that require a reversal of argument prominence hierarchization. We also studied how the amount of available prominence information may affect the incremental build-up of verbal expectations. Results of the ERP data revealed that at the disambiguating verb region, object-initial sentences (only one argument available) elicited a centro-parietal negativity with a peak at 400 ms post-onset. Subject-initial sentences (two arguments available) yielded a broadly distributed positivity at around 650 ms. This dissociation suggests that argument interpretation may depend on their morphosyntactic features, and also on the amount of prominence information available before the verb is encountered.

Electrophysiology of subject-verb agreement mediated by speakers' gender

An important property of speech is that it explicitly conveys features of a speaker's identity such as age or gender. This event-related potential (ERP) study examined the effects of social information provided by a speaker's gender, i.e., the conceptual representation of gender, on subject-verb agreement. Despite numerous studies on agreement, little is known about syntactic computations generated by speaker characteristics extracted from the acoustic signal. Slovak is well suited to investigate this issue because it is a morphologically rich language in which agreement involves features for number, case, and gender. Grammaticality of a sentence can be evaluated by checking a speaker's gender as conveyed by his/her voice. We examined how conceptual information about speaker gender, which is not syntactic but rather social and pragmatic in nature, is interpreted for the computation of agreement patterns. ERP responses to verbs disagreeing with the speaker's gender (e.g., a sentence including a masculine verbal inflection spoken by a female person 'the neighbors were upset because I (∗)stoleMASC plums') elicited a larger early posterior negativity compared to correct sentences. When the agreement was purely syntactic and did not depend on the speaker's gender, a disagreement between a formally marked subject and the verb inflection (e.g., the womanFEM (∗)stoleMASC plums) resulted in a larger P600 preceded by a larger anterior negativity compared to the control sentences. This result is in line with proposals according to which the recruitment of non-syntactic information such as the gender of the speaker results in N400-like effects, while formally marked syntactic features lead to structural integration as reflected in a LAN/P600 complex.

How inappropriate high-pass filters can produce artifactual effects and incorrect conclusions in ERP studies of language and cognition

Although it is widely known that high-pass filters can reduce the amplitude of slow ERP components, these filters can also introduce artifactual peaks that lead to incorrect conclusions. To demonstrate this and provide evidence about optimal filter settings, we recorded ERPs in a typical language processing paradigm involving syntactic and semantic violations. Unfiltered results showed standard N400 and P600 effects in the semantic and syntactic violation conditions, respectively. However, high-pass filters with cutoffs at 0.3 Hz and above produced artifactual effects of opposite polarity before the true effect. That is, excessive high-pass filtering introduced a significant N400 effect preceding the P600 in the syntactic condition, and a significant P2 effect preceding the N400 in the semantic condition. Thus, inappropriate use of high-pass filters can lead to false conclusions about which components are influenced by a given manipulation. The present results also lead to practical recommendations for high-pass filter settings that maximize statistical power while minimizing filtering artifacts.

Reversing expectations during discourse comprehension

In two ERP experiments, we asked whether comprehenders used the concessive connective, even so, to predict upcoming events. Participants read coherent and incoherent scenarios, with and without even so, e.g. "Elizabeth had a history exam on Monday. She took the test and aced/failed it. (Even so), she went home and celebrated wildly.", as they rated coherence (Experiment 1) or simply answered intermittent comprehension questions (Experiment 2). The semantic function of even so was used to reverse real-world knowledge predictions, leading to an attenuated N400 to coherent versus incoherent target words ("celebrated"). Moreover, its pragmatic communicative function enhanced predictive processing, leading to more N400 attenuation to coherent targets in scenarios with than without even so. This benefit however, did not come for free: the detection of failed event predictions triggered a later posterior positivity and/or an anterior negativity effect, and costs of maintaining alternative likelihood relations manifest as a sustained negativity effect on sentence-final words.

Is Semantic Processing During Sentence Reading Autonomous or Controlled? Evidence from the N400 Component in a Dual Task Paradigm

The present study contributes to the discussion on the automaticity of semantic processing. Whereas most previous research investigated semantic processing at word level, the present study addressed semantic processing during sentence reading. A dual task paradigm was combined with the recording of event-related brain potentials. Previous research at word level processing reported different patterns of interference with the N400 by additional tasks: attenuation of amplitude or delay of latency. In the present study, we presented Spanish sentences that were semantically correct or contained a semantic violation in a critical word. At different intervals preceding the critical word a tone was presented that required a high-priority choice response. At short intervals/high temporal overlap between the tasks mean amplitude of the N400 was reduced relative to long intervals/low temporal overlap, but there were no shifts of peak latency. We propose that processing at sentence level exerts a protective effect against the additional task. This is in accord with the attentional sensitization model (Kiefer & Martens, 2010), which suggests that semantic processing is an automatic process that can be enhanced by the currently activated task set. The present experimental sentences also induced a P600, which is taken as an index of integrative processing. Additional task effects are comparable to those in the N400 time window and are briefly discussed.

The influence of emotional salience on the integration of person names into context

Previous event-related potentials (ERP) studies on the processing of emotional information in sentence/discourse context have yielded inconsistent findings. An important reason for the discrepancies is the different lexico-semantic properties of the emotional words. The present study controlled for the lexico-semantic meaning of emotional information by endowing the same person names with either positive or negative valence. ERPs were computed for positively and negatively valenced person names that were either congruent or incongruent to previous emotional contexts. We found that positive names elicited an N400 effect while negative names elicited a P600 effect in response to the incongruence. These results suggest that the integration of positive and negative information into emotional context exhibits different time courses, with a relatively delayed integration for negative information. Our study demonstrates that using person names constitutes a new and improved tool for investigating the integration of emotional information into context.

Distinct brain signatures of content and structure violation during action observation

Sentences, musical phrases and goal-directed actions are composed of elements that are linked by specific rules to form meaningful outcomes. In goal-directed actions including a non-canonical element or scrambling the order of the elements alters the action's content and structure, respectively. In the present study we investigated event-related potentials of the electroencephalographic (EEG) activity recorded during observation of both alterations of the action content (obtained by violating the semantic components of an action, e.g. making coffee with cola) and alterations of the action structure (obtained by inverting the order of two temporally adjacent pictures of sequences depicting daily life actions) interfering with the normal flow of the motor acts that compose an action. Action content alterations elicited a bilateral posterior distributed EEG negativity, peaking at around 400 ms after stimulus onset similar to the ERPs evoked by semantic violations in language studies. Alteration of the action structure elicited an early left anterior negativity followed by a late left anterior positivity, which closely resembles the ERP pattern found in language syntax violation studies. Our results suggest a functional dissociation between the processing of action content and structure, reminiscent of a similar dissociation found in the language or music domains. Importantly, this study provides further support to the hypothesis that some basic mechanisms, such as the rule-based structuring of sequential events, are shared between different cognitive domains.

From incoherence to mirth: neuro-cognitive processing of garden-path jokes

In so-called garden-path jokes, an initial semantic representation is violated, and semantic revision reestablishes a coherent representation. 48 jokes were manipulated in three conditions: (i) a coherent ending, (ii) a joke ending, and (iii) a discourse-incoherent ending. A reading times study (N = 24) and three studies with recordings of ERP and pupil changes (N = 21, 24, and 24, respectively) supported the hypothesized cognitive processes. Jokes showed increased reading times of the final word compared to coherent endings. ERP data mainly indicated semantic integration difficulties (N400). Larger pupil diameters to joke endings presumably reflect emotional responses. ERP evidence for increased discourse processing efforts and emotional responses, as assumed to be reflected in modulations of the late left anterior negativity (LLAN) and in an enhanced late frontal positivity (fP600), respectively, remains however incomplete. Processing of incoherent endings was also accompanied by increased reading times, a stronger and sustained N400, and context-sensitive P600 effects. Together, these findings provide evidence for a sequential, non-monotonic, and incremental discourse comprehension of garden-path jokes.

It's All in the Family: Brain Asymmetry and Syntactic Processing of Word Class

Although left-hemisphere (LH) specialization for language is often viewed as a key example of functional lateralization, there is increasing evidence that the right hemisphere (RH) can also extract meaning from words and sentences. However, the right hemisphere's ability to appreciate syntactic aspects of language remains poorly understood. In the current study, we used separable, functionally well-characterized electrophysiological indices of lexico-semantic and syntactic processes to demonstrate RH sensitivity to syntactic violations among right-handers with a strong manual preference. Critically, however, the nature of this RH sensitivity to structural information was modulated by a genetically determined factor--familial sinistrality. The right hemisphere in right-handers without left-handed family members processed syntactic violations via the words' accompanying lexico-semantic unexpectedness. In contrast, the right hemisphere in right-handers with left-handed family members could process syntactic information in a manner qualitatively similar to that of the left hemisphere.

Attending to pitch information inhibits processing of pitch information: the curious case of amusia

In normal listeners, the tonal rules of music guide musical expectancy. In a minority of individuals, known as amusics, the processing of tonality is disordered, which results in severe musical deficits. It has been shown that the tonal rules of music are neurally encoded, but not consciously available in amusics. Previous neurophysiological studies have not explicitly controlled the level of attention in tasks where participants ignored the tonal structure of the stimuli. Here, we test whether access to tonal knowledge can be demonstrated in congenital amusia when attention is controlled. Electric brain responses were recorded while asking participants to detect an individually adjusted near-threshold click in a melody. In half the melodies, a note was inserted that violated the tonal rules of music. In a second task, participants were presented with the same melodies but were required to detect the tonal deviation. Both tasks required sustained attention, thus conscious access to the rules of tonality was manipulated. In the click-detection task, the pitch deviants evoked an early right anterior negativity (ERAN) in both groups. In the pitch-detection task, the pitch deviants evoked an ERAN and P600 in controls but not in amusics. These results indicate that pitch regularities are represented in the cortex of amusics, but are not consciously available. Moreover, performing a pitch-judgment task eliminated the ERAN in amusics, suggesting that attending to pitch information interferes with perception of pitch. We propose that an impaired top-down frontotemporal projection is responsible for this disorder.

Contributions of emotional state and attention to the processing of syntactic agreement errors: evidence from P600

The classic account of language is that language processing occurs in isolation from other cognitive systems, like perception, motor action, and emotion. The central theme of this paper is the relationship between a participant's emotional state and language comprehension. Does emotional context affect how we process neutral words? Recent studies showed that processing of word meaning - traditionally conceived as an automatic process - is affected by emotional state. The influence of emotional state on syntactic processing is less clear. One study reported a mood-related P600 modulation, while another study did not observe an effect of mood on syntactic processing. The goals of this study were: First, to clarify whether and if so how mood affects syntactic processing. Second, to shed light on the underlying mechanisms by separating possible effects of mood from those of attention on syntactic processing. Event-related potentials (ERPs) were recorded while participants read syntactically correct or incorrect sentences. Mood (happy vs. sad) was manipulated by presenting film clips. Attention was manipulated by directing attention to syntactic features vs. physical features. The mood induction was effective. Interactions between mood, attention and syntactic correctness were obtained, showing that mood and attention modulated P600. The mood manipulation led to a reduction in P600 for sad as compared to happy mood when attention was directed at syntactic features. The attention manipulation led to a reduction in P600 when attention was directed at physical features compared to syntactic features for happy mood. From this we draw two conclusions: First, emotional state does affect syntactic processing. We propose mood-related differences in the reliance on heuristics as the underlying mechanism. Second, attention can contribute to emotion-related ERP effects in syntactic language processing. Therefore, future studies on the relation between language and emotion will have to control for effects of attention.

Processing changes when listening to foreign-accented speech

This study investigates the mechanisms responsible for fast changes in processing foreign-accented speech. Event Related brain Potentials (ERPs) were obtained while native speakers of Spanish listened to native and foreign-accented speakers of Spanish. We observed a less positive P200 component for foreign-accented speech relative to native speech comprehension. This suggests that the extraction of spectral information and other important acoustic features was hampered during foreign-accented speech comprehension. However, the amplitude of the N400 component for foreign-accented speech comprehension decreased across the experiment, suggesting the use of a higher level, lexical mechanism. Furthermore, during native speech comprehension, semantic violations in the critical words elicited an N400 effect followed by a late positivity. During foreign-accented speech comprehension, semantic violations only elicited an N400 effect. Overall, our results suggest that, despite a lack of improvement in phonetic discrimination, native listeners experience changes at lexical-semantic levels of processing after brief exposure to foreign-accented speech. Moreover, these results suggest that lexical access, semantic integration and linguistic re-analysis processes are permeable to external factors, such as the accent of the speaker.

Dispositional mindfulness and semantic integration of emotional words: Evidence from event-related brain potentials

Initial research shows that mindfulness training can enhance attention and modulate the affective response. However, links between mindfulness and language processing remain virtually unexplored despite the prominent role of overt and silent negative ruminative speech in depressive and anxiety-related symptomatology. Here, we measured dispositional mindfulness and recorded participants' event-related brain potential responses to positive and negative target words preceded by words congruent or incongruent with the targets in terms of semantic relatedness and emotional valence. While the low mindfulness group showed similar N400 effect pattern for positive and negative targets, high dispositional mindfulness was associated with larger N400 effect to negative targets. This result suggests that negative meanings are less readily accessible in people with high dispositional mindfulness. Furthermore, high dispositional mindfulness was associated with reduced P600 amplitudes to emotional words, suggesting less post-analysis and attentional effort which possibly relates to a lower inclination to ruminate. Overall, these findings provide initial evidence on associations between modifications in language systems and mindfulness.

The notion of the motion: the neurocognition of motion lines in visual narratives

Motion lines appear ubiquitously in graphic representation to depict the path of a moving object, most popularly in comics. Some researchers have argued that these graphic signs directly tie to the "streaks" appearing in the visual system when a viewer tracks an object (Burr, 2000), despite the fact that previous studies have been limited to offline measurements. Here, we directly examine the cognition of motion lines by comparing images in comic strips that depicted normal motion lines with those that either had no lines or anomalous, reversed lines. In Experiment 1, shorter viewing times appeared to images with normal lines than those with no lines, which were shorter than those with anomalous lines. In Experiment 2, measurements of event-related potentials (ERPs) showed that, compared to normal lines, panels with no lines elicited a posterior positivity that was distinct from the frontal positivity evoked by anomalous lines. These results suggested that motion lines aid in the comprehension of depicted events. LORETA source localization implicated greater activation of visual and language areas when understanding was made more difficult by anomalous lines. Furthermore, in both experiments, participants' experience reading comics modulated these effects, suggesting motion lines are not tied to aspects of the visual system, but rather are conventionalized parts of the "vocabulary" of the visual language of comics.

Auditory and motion metaphors have different scalp distributions: an ERP study

While many links have been established between sensory-motor words used literally (kick the ball) and sensory-motor regions of the brain, it is less clear whether metaphorically used words (kick the habit) also show such signs of “embodiment.” Additionally, not much is known about the timing or nature of the connection between language and sensory-motor neural processing. We used stimuli divided into three figurativeness conditions—literal, metaphor, and anomalous—and two modality conditions—auditory (Her limousine was a privileged snort) and motion (The editorial was a brass-knuckle punch). The conditions were matched on a large number of potentially confounding factors including cloze probability. The electroencephalographic response to the final word of each sentence was measured at 64 electrode sites on the scalp of 22 participants and event-related potentials (ERPs) calculated. Analysis revealed greater amplitudes for metaphorical than literal sentences in both 350–500 ms and 500–650 ms timeframes. Results supported the possibility of different neural substrates for motion and auditory sentences. Greater differences for motion sentences were seen in the left posterior and left central electrode sites than elsewhere on the scalp. These findings are consistent with a sensory-motor neural categorization of language and with the integration of modal and amodal information during the N400 and P600 timeframes.

Inconsistent use of gesture space during abstract pointing impairs language comprehension

Pointing toward concrete objects is a well-known and efficient communicative strategy. Much less is known about the communicative effectiveness of abstract pointing where the pointing gestures are directed to “empty space.” McNeill's (2003) observations suggest that abstract pointing can be used to establish referents in gesture space, without the referents being physically present. Recently, however, it has been shown that abstract pointing typically provides redundant information to the uttered speech thereby suggesting a very limited communicative value (So et al., 2009). In a first approach to tackle this issue we were interested to know whether perceivers are sensitive at all to this gesture cue or whether it is completely discarded as irrelevant add-on information. Sensitivity to for instance a gesture-speech mismatch would suggest a potential communicative function of abstract pointing. Therefore, we devised a mismatch paradigm in which participants watched a video where a female was interviewed on various topics. During her responses, she established two concepts in space using abstract pointing (e.g., pointing to the left when saying Donald, and pointing to the right when saying Mickey). In the last response to each topic, the pointing gesture accompanying a target word (e.g., Donald) was either consistent or inconsistent with the previously established location. Event related brain potentials showed an increased N400 and P600 when gesture and speech referred to different referents, indicating that inconsistent use of gesture space impairs language comprehension. Abstract pointing was found to influence comprehension even though gesture was not crucial to understanding the sentences or conducting the experimental task. These data suggest that a referent was retrieved via abstract pointing and that abstract pointing can potentially be used for referent indication in a discourse. We conclude that abstract pointing has a potential communicative function.

Neurodevelopment for syntactic processing distinguishes childhood stuttering recovery versus persistence

BACKGROUND

Characterized by the presence of involuntary speech disfluencies, developmental stuttering is a neurodevelopmental disorder of atypical speech-motor coordination. Although the etiology of stuttering is multifactorial, language development during early childhood may influence both the onset of the disorder and the likelihood of recovery. The purpose of this study was to determine whether differences in neural indices mediating language processing are associated with persistence or recovery in school-age children who stutter.

METHODS

Event-related brain potentials (ERPs) were obtained from 31 6-7-year-olds, including nine children who do not stutter (CWNS), 11 children who had recovered from stuttering (CWS-Rec), and 11 children who persisted in stuttering (CWS-Per), matched for age, and all with similar socioeconomic status, nonverbal intelligence, and language ability. We examined ERPs elicited by semantic and syntactic (phrase structure) violations within an auditory narrative consisting of English and Jabberwocky sentences. In Jabberwocky sentences, content words were replaced with pseudowords to limit semantic context. A mixed effects repeated measures analysis of variance (ANOVA) was computed for ERP components with four within-subject factors, including condition, hemisphere, anterior/posterior distribution, and laterality.

RESULTS

During the comprehension of English sentences, ERP activity mediating semantic and syntactic (phrase structure) processing did not distinguish CWS-Per, CWS-Rec, and CWNS. Semantic violations elicited a qualitatively similar N400 component across groups. Phrase structure violations within English sentences also elicited a similar P600 component in all groups. However, identical phrase structure violations within Jabberwocky sentences elicited a P600 in CWNS and CWS-Rec, but an N400-like effect in CWS-Per.

CONCLUSIONS

The distinguishing neural patterns mediating syntactic, but not semantic, processing provide evidence that specific brain functions for some aspects of language processing may be associated with stuttering persistence. Unlike CWS-Rec and CWNS, the lack of semantic context in Jabberwocky sentences seemed to affect the syntactic processing strategies of CWS-Per, resulting in the elicitation of semantically based N400-like activity during syntactic (phrase structure) violations. This vulnerability suggests neural mechanisms associated with the processing of syntactic structure may be less mature in 6-7-year-old children whose stuttering persisted compared to their fluent or recovered peers.

Processing classifier-noun agreement in a long distance: an ERP study on Mandarin Chinese

The classifier system categorizes nouns on a semantic basis. By inserting an object-gap relative clause (RC) between a classifier and its associate noun, we examined how temporary classifier-noun semantic incongruity and long-distance classifier-noun dependency are processed. Instead of a typical N400 effect, a midline anterior negativity was elicited by the temporary semantic incongruity, suggesting that the anticipation of coming words influences semantic processing and that metacognitive processes are involved in resolving the conflict. The lack of reduced P600 effects at the RC marker suggests that classifier-noun mismatch may not be effective in RC prediction. The N400 observed at the head noun suggests that the parser retains the temporary incongruity in the memory and computes the classifier-noun semantic agreement over a long distance. In addition, both successful and unsuccessful long-distance integration elicited P600 effects, supporting the view that P600 indexes more than just syntactic processing. Detailed discussion and implications are provided.

The P600-as-P3 hypothesis revisited: single-trial analyses reveal that the late EEG positivity following linguistically deviant material is reaction time aligned

The P600, a late positive ERP component following linguistically deviant stimuli, is commonly seen as indexing structural, high-level processes, e.g. of linguistic (re)analysis. It has also been identified with the P3 (P600-as-P3 hypothesis), which is thought to reflect a systemic neuromodulator release facilitating behavioural shifts and is usually response time aligned. We investigated single-trial alignment of the P600 to response, a critical prediction of the P600-as-P3 hypothesis. Participants heard sentences containing morphosyntactic and semantic violations and responded via a button press. The elicited P600 was perfectly response aligned, while an N400 following semantic deviations was stimulus aligned. This is, to our knowledge, the first single-trial analysis of language processing data using within-sentence behavioural responses as temporal covariates. Results support the P600-as-P3 perspective and thus constitute a step towards a neurophysiological grounding of language-related ERPs.

The time-course of feature interference in agreement comprehension: Multiple mechanisms and asymmetrical attraction

Attraction interference in language comprehension and production may be as a result of common or different processes. In the present paper, we investigate attraction interference during language comprehension, focusing on the contexts in which interference arises and the time-course of these effects. Using evidence from event-related brain potentials (ERPs) and sentence judgment times, we show that agreement attraction in comprehension is best explained as morphosyntactic interference during memory retrieval. This stands in contrast to attraction as a message-level process involving the representation of the subject NP's number features, which is a strong contributor to attraction in production. We thus argue that the cognitive antecedents of agreement attraction in comprehension are non-identical with those of attraction in production, and moreover, that attraction in comprehension is primarily a consequence of similarity-based interference in cue-based memory retrieval processes. We suggest that mechanisms responsible for attraction during language comprehension are a subset of those involved in language production.

An ERP study on L2 syntax processing: When do learners fail?

Event-related brain potentials (ERPs) can reveal online processing differences between native speakers and second language (L2) learners during language comprehension. Using the P600 as a measure of native-likeness, we investigated processing of grammatical gender agreement in highly proficient immersed Romance L2 learners of Dutch. We demonstrate that these late learners consistently fail to show native-like sensitivity to gender violations. This appears to be due to a combination of differences from the gender marking in their L1 and the relatively opaque Dutch gender system. We find that L2 use predicts the effect magnitude of non-finite verb violations, a relatively regular and transparent construction, but not that of gender agreement violations. There were no effects of age of acquisition, length of residence, proficiency or offline gender knowledge. Additionally, a within-subject comparison of stimulus modalities (written vs. auditory) shows that immersed learners may show some of the effects only in the auditory modality; in non-finite verb violations, an early native-like N400 was only present for auditory stimuli. However, modality failed to influence the response to gender. Taken together, the results confirm the persistent problems of Romance learners of Dutch with online gender processing and show that they cannot be overcome by reducing task demands related to the modality of stimulus presentation.

Agreement attraction during comprehension of grammatical sentences: ERP evidence from ellipsis

Successful dependency resolution during language comprehension relies on accessing certain representations in memory, and not others. We recently reported event-related potential (ERP) evidence that syntactically unavailable, intervening attractor-nouns interfered during comprehension of Spanish noun-phrase ellipsis (the determiner otra/otro): grammatically correct determiners that mismatched the gender of attractor-nouns elicited a sustained negativity as also observed for incorrect determiners (Martin, Nieuwland, & Carreiras, 2012). The current study sought to extend this novel finding in sentences containing object-extracted relative clauses, where the antecedent may be less prominent. Whereas correct determiners that matched the gender of attractor-nouns now elicited an early anterior negativity as also observed for mismatching determiners, the previously reported interaction pattern was replicated in P600 responses to subsequent words. Our results suggest that structural and gender information is simultaneously taken into account, providing further evidence for retrieval interference during comprehension of grammatical sentences.

Reasoning from transitive premises: an EEG study

Neuroimaging studies have contributed to a major advance in understanding the neural and cognitive mechanisms underpinning deductive reasoning. However, the dynamics of cognitive events associated with inference making have been largely neglected. Using electroencephalography, the present study aims at describing the rapid sequence of processes involved in performing transitive inference (A B; B C therefore "A C"; with AB meaning "A is to the left of B"). The results indicate that when the second premise can be integrated into the first one (e.g. A B; B C) its processing elicits a P3b component. In contrast, when the second premise cannot be integrated into the first premise (e.g. A B; D C), a P600-like components is elicited. These ERP components are discussed with respect to cognitive expectations.

Predictability, plausibility, and two late ERP positivities during written sentence comprehension

Van Petten and Luka's (2012, International Journal of Psychophysiology, 83(2), 176-190) literature survey of late positive ERP components elicited by more or less predictable words during sentence processing led them to propose two topographically and functionally distinct positivities: a parietal one associated with semantically incongruent words related to semantic reanalysis and a frontal one with unknown significance associated with congruent but lexically unpredicted words. With the goal of testing this hypothesis within a single set of experimental materials and participants, we report results from two ERP studies: Experiment 1, a post-hoc analysis of a dataset that varied on dimensions of both cloze probability (predictability) and plausibility, and Experiment 2, a follow-up study in which these factors were manipulated in a controlled fashion. In both studies, we observed distinct post-N400 positivities: a more anterior one to plausible, but not anomalous, low cloze probability sentence medial words, and a more posterior one to semantically anomalous sentence continuations. Taken together with an observed canonical cloze-modulated N400, these dual positivities indicate a dissociation between brain processes relating to written words׳ sentential predictability versus plausibility, clearly an important distinction for any viable neural or psycholinguistic model of written sentence processing.

Neurocognitive mechanisms of statistical-sequential learning: what do event-related potentials tell us?

Statistical-sequential learning (SL) is the ability to process patterns of environmental stimuli, such as spoken language, music, or one's motor actions, that unfold in time. The underlying neurocognitive mechanisms of SL and the associated cognitive representations are still not well understood as reflected by the heterogeneity of the reviewed cognitive models. The purpose of this review is: (1) to provide a general overview of the primary models and theories of SL, (2) to describe the empirical research - with a focus on the event-related potential (ERP) literature - in support of these models while also highlighting the current limitations of this research, and (3) to present a set of new lines of ERP research to overcome these limitations. The review is articulated around three descriptive dimensions in relation to SL: the level of abstractness of the representations learned through SL, the effect of the level of attention and consciousness on SL, and the developmental trajectory of SL across the life-span. We conclude with a new tentative model that takes into account these three dimensions and also point to several promising new lines of SL research.

The association between aerobic fitness and language processing in children: implications for academic achievement

Event-related brain potentials (ERPs) have been instrumental for discerning the relationship between children's aerobic fitness and aspects of cognition, yet language processing remains unexplored. ERPs linked to the processing of semantic information (the N400) and the analysis of language structure (the P600) were recorded from higher and lower aerobically fit children as they read normal sentences and those containing semantic or syntactic violations. Results revealed that higher fit children exhibited greater N400 amplitude and shorter latency across all sentence types, and a larger P600 effect for syntactic violations. Such findings suggest that higher fitness may be associated with a richer network of words and their meanings, and a greater ability to detect and/or repair syntactic errors. The current findings extend previous ERP research explicating the cognitive benefits associated with greater aerobic fitness in children and may have important implications for learning and academic performance.

Cross-linguistic variation in the neurophysiological response to semantic processing: evidence from anomalies at the borderline of awareness

The N400 event-related brain potential (ERP) has played a major role in the examination of how the human brain processes meaning. For current theories of the N400, classes of semantic inconsistencies which do not elicit N400 effects have proven particularly influential. Semantic anomalies that are difficult to detect are a case in point ("borderline anomalies", e.g. "After an air crash, where should the survivors be buried?"), engendering a late positive ERP response but no N400 effect in English (Sanford, Leuthold, Bohan, & Sanford, 2011). In three auditory ERP experiments, we demonstrate that this result is subject to cross-linguistic variation. In a German version of Sanford and colleagues' experiment (Experiment 1), detected borderline anomalies elicited both N400 and late positivity effects compared to control stimuli or to missed borderline anomalies. Classic easy-to-detect semantic (non-borderline) anomalies showed the same pattern as in English (N400 plus late positivity). The cross-linguistic difference in the response to borderline anomalies was replicated in two additional studies with a slightly modified task (Experiment 2a: German; Experiment 2b: English), with a reliable LANGUAGE×ANOMALY interaction for the borderline anomalies confirming that the N400 effect is subject to systematic cross-linguistic variation. We argue that this variation results from differences in the language-specific default weighting of top-down and bottom-up information, concluding that N400 amplitude reflects the interaction between the two information sources in the form-to-meaning mapping.

Time-driven effects on processing grammatical agreement

“Agreement” is a grammatical relation between words; e.g., the verbal suffix –s reflects agreement with a singular subject (He run-s). Previous studies with time intervals under 2.5 s between disagreeing words have found a left-lateralized negative brain potential, arguably reflecting detection of the morphosyntactic violation. We tested the neurophysiological effects of number agreement between the first and last word in sentences at temporal distances between 1.75 and 3.25 s. Distances were varied by visually presenting sentences word by word at different rates. For distances under 2.5 s, a left-lateralized negativity was observed. At a 3.25-s interval, an anterior, slightly right-lateralized negativity was found. At an intermediate distance of 2.75 s, the difference between disagreement and agreement at left electrodes correlated with participants' working memory span. Results indicate that different brain processes occur when agreement involves agreement domains approaching and exceeding 3 s than when the agreement dependency involves shorter temporal intervals.

Abnormal semantic processing in females with fragile X-associated tremor/ataxia syndrome

Fragile X-associated tremor/ataxia syndrome (FXTAS), a neurodegenerative disorder, affects fragile X (FMR1) gene premutation carriers in late life. Studies have shown cognitive impairments in FXTAS including executive dysfunction, working memory and visuospatial deficits. However, less is known about cognition in females with FXTAS. Thus, we examined semantic processing and verbal memory in female FXTAS patients with event-related potentials (ERPs) and neuropsychological testing. Sixty-one females (34 FXTAS, Mage  = 62.7; 27 controls, Mage  = 60.4) were studied with 32-channel ERPs during a category judgment task in which semantically congruous (50%) and incongruous items were repeated approximately 10-140 seconds later. N400 and P600 amplitude data were submitted to analysis of covariance. Neuropsychological testing demonstrated lower performance in verbal learning and executive function in females with FXTAS. Event-related potential analyses showed a significant reduction of the N400 congruity effect (incongruous - congruous) in the FXTAS group. The N400 congruity effect reduction in females with FXTAS was mainly due to increased N400 amplitude to congruous new words. No significant abnormalities of the N400 repetition effect or the P600 repetition effect were found, indicating preserved implicit memory and verbal memory, respectively, in females with FXTAS. The decreased N400 congruity effect suggests abnormal semantic expectancy and/or semantic network disorganization in female FXTAS patients. The enhanced N400 amplitude to congruous new words may reflect decreased cognitive flexibility among FXTAS women, making access to less typical category exemplar words more difficult.

Grammatical number agreement processing using the visual half-field paradigm: an event-related brain potential study

Despite indications in the split-brain and lesion literatures that the right hemisphere is capable of some syntactic analysis, few studies have investigated right hemisphere contributions to syntactic processing in people with intact brains. Here we used the visual half-field paradigm in healthy adults to examine each hemisphere's processing of correct and incorrect grammatical number agreement marked either lexically, e.g., antecedent/reflexive pronoun ("The grateful niece asked herself/*themselves…") or morphologically, e.g., subject/verb ("Industrial scientists develop/*develops…"). For reflexives, response times and accuracy of grammaticality decisions suggested similar processing regardless of visual field of presentation. In the subject/verb condition, we observed similar response times and accuracies for central and right visual field (RVF) presentations. For left visual field (LVF) presentation, response times were longer and accuracy rates were reduced relative to RVF presentation. An event-related brain potential (ERP) study using the same materials revealed similar ERP responses to the reflexive pronouns in the two visual fields, but very different ERP effects to the subject/verb violations. For lexically marked violations on reflexives, P600 was elicited by stimuli in both the LVF and RVF; for morphologically marked violations on verbs, P600 was elicited only by RVF stimuli. These data suggest that both hemispheres can process lexically marked pronoun agreement violations, and do so in a similar fashion. Morphologically marked subject/verb agreement errors, however, showed a distinct LH advantage.

A time and place for language comprehension: mapping the N400 and the P600 to a minimal cortical network

We propose a new functional-anatomical mapping of the N400 and the P600 to a minimal cortical network for language comprehension. Our work is an example of a recent research strategy in cognitive neuroscience, where researchers attempt to align data regarding the nature and time-course of cognitive processing (from ERPs) with data on the cortical organization underlying it (from fMRI). The success of this "alignment" approach critically depends on the functional interpretation of relevant ERP components. Models of language processing that have been proposed thus far do not agree on these interpretations, and present a variety of complicated functional architectures. We put forward a very basic functional-anatomical mapping based on the recently developed Retrieval-Integration account of language comprehension (Brouwer et al., 2012). In this mapping, the left posterior part of the Middle Temporal Gyrus (BA 21) serves as an epicenter (or hub) in a neurocognitive network for the retrieval of word meaning, the ease of which is reflected in N400 amplitude. The left Inferior Frontal Gyrus (BA 44/45/47), in turn, serves a network epicenter for the integration of this retrieved meaning with the word's preceding context, into a mental representation of what is being communicated; these semantic and pragmatic integrative processes are reflected in P600 amplitude. We propose that our mapping describes the core of the language comprehension network, a view that is parsimonious, has broad empirical coverage, and can serve as the starting point for a more focused investigation into the coupling of brain anatomy and electrophysiology.

Mathematical anxiety effects on simple arithmetic processing efficiency: an event-related potential study

This study uses event-related brain potentials to investigate the difficulties that high math anxious individuals face when processing dramatically incorrect solutions to simple arithmetical problems. To this end, thirteen high math-anxious (HMA) and thirteen low math-anxious (LMA) individuals were presented with simple addition problems in a verification task. The proposed solution could be correct, incorrect but very close to the correct one (small-split), or dramatically incorrect (large-split). The two groups did not differ in mathematical ability or trait anxiety. We reproduced previous results for flawed scores suggesting HMA difficulties in processing large-split solutions. Moreover, large-split solutions elicited a late positive component (P600/P3b) which was more enhanced and delayed in the HMA group. Our study proposes that the pattern of flawed scores found by previous studies (and that we replicate) has to do with HMA individuals'difficulties in inhibiting an extended processing of irrelevant information (large-split solutions).

An ERP study of structural anomalies in native and semantic free artificial grammar: evidence for shared processing mechanisms

Artificial grammars have been widely applied to the study of sequential learning in language, but few studies have directly compared the neural correlates of artificial and native grammar processing. In this study, we examined Event Related Potentials (ERPs) elicited by structural anomalies in semantic-free artificial grammar sequences and sentences in the subjects' native language (Spanish). Although ERPs differed during early stages, we observed similar posterior negativities (N400) and P600 effects in a late stage. We interpret these results as evidence of at least partially shared neural mechanisms for processing of language and artificial grammars. We suggest that in both the natural and artificial grammars, the N400 and P600 components we observed can be explained as the result of unfulfilled predictions about incoming stimuli.

Recurrent temporal networks and language acquisition-from corticostriatal neurophysiology to reservoir computing

One of the most paradoxical aspects of human language is that it is so unlike any other form of behavior in the animal world, yet at the same time, it has developed in a species that is not far removed from ancestral species that do not possess language. While aspects of non-human primate and avian interaction clearly constitute communication, this communication appears distinct from the rich, combinatorial and abstract quality of human language. So how does the human primate brain allow for language? In an effort to answer this question, a line of research has been developed that attempts to build a language processing capability based in part on the gross neuroanatomy of the corticostriatal system of the human brain. This paper situates this research program in its historical context, that begins with the primate oculomotor system and sensorimotor sequencing, and passes, via recent advances in reservoir computing to provide insight into the open questions, and possible approaches, for future research that attempts to model language processing. One novel and useful idea from this research is that the overlap of cortical projections onto common regions in the striatum allows for adaptive binding of cortical signals from distinct circuits, under the control of dopamine, which has a strong adaptive advantage. A second idea is that recurrent cortical networks with fixed connections can represent arbitrary sequential and temporal structure, which is the basis of the reservoir computing framework. Finally, bringing these notions together, a relatively simple mechanism can be built for learning the grammatical constructions, as the mappings from surface structure of sentences to their meaning. This research suggests that the components of language that link conceptual structure to grammatical structure may be much simpler that has been proposed in other research programs. It also suggests that part of the residual complexity is in the conceptual system itself.

Event-related brain potential evidence for animacy processing asymmetries during sentence comprehension

The animacy distinction is deeply rooted in the language faculty. A key example is differential object marking, the phenomenon where animate sentential objects receive specific marking. We used event-related potentials to examine the neural processing consequences of case-marking violations on animate and inanimate direct objects in Spanish. Inanimate objects with incorrect prepositional case marker 'a' ('al suelo') elicited a P600 effect compared to unmarked objects, consistent with previous literature. However, animate objects without the required prepositional case marker ('el obispo') only elicited an N400 effect compared to marked objects. This novel finding, an exclusive N400 modulation by a straightforward grammatical rule violation, does not follow from extant neurocognitive models of sentence processing, and mirrors unexpected "semantic P600" effects for thematically problematic sentences. These results may reflect animacy asymmetry in competition for argument prominence: following the article, thematic interpretation difficulties are elicited only by unexpectedly animate objects.

Musical expertise modulates early processing of syntactic violations in language

Syntactic violations in speech and music have been shown to elicit an anterior negativity (AN) as early as 100 ms after violation onset and a posterior positivity that peaks at roughly 600 ms (P600/LPC). The language AN is typically reported as left-lateralized (LAN), whereas the music AN is typically reported as right-lateralized (RAN). However, several lines of evidence suggest syntactic processing of language and music rely on overlapping neural systems. The current study tested the hypothesis that syntactic processing of speech and music share neural resources by examining whether musical proficiency modulates ERP indices of linguistic syntactic processing. ERPs were measured in response to syntactic violations in sentences and chord progressions in musicians and non-musicians. Violations in speech were insertion errors in normal and semantically impoverished English sentences. Violations in music were out-of-key chord substitutions from distantly and closely related keys. Phrase-structure violations elicited an AN and P600 in both groups. Harmonic violations elicited an LPC in both groups, blatant harmonic violations also elicited a RAN in musicians only. Cross-domain effects of musical proficiency were similar to previously reported within-domain effects of linguistic proficiency on the distribution of the language AN; syntactic violations in normal English sentences elicited a LAN in musicians and a bilateral AN in non-musicians. The late positivities elicited by violations differed in latency and distribution between domains. These results suggest that initial processing of syntactic violations in language and music relies on shared neural resources in the general population, and that musical expertise results in more specialized cortical organization of syntactic processing in both domains.

Gesture facilitates the syntactic analysis of speech

Recent research suggests that the brain routinely binds together information from gesture and speech. However, most of this research focused on the integration of representational gestures with the semantic content of speech. Much less is known about how other aspects of gesture, such as emphasis, influence the interpretation of the syntactic relations in a spoken message. Here, we investigated whether beat gestures alter which syntactic structure is assigned to ambiguous spoken German sentences. The P600 component of the Event Related Brain Potential indicated that the more complex syntactic structure is easier to process when the speaker emphasizes the subject of a sentence with a beat. Thus, a simple flick of the hand can change our interpretation of who has been doing what to whom in a spoken sentence. We conclude that gestures and speech are integrated systems. Unlike previous studies, which have shown that the brain effortlessly integrates semantic information from gesture and speech, our study is the first to demonstrate that this integration also occurs for syntactic information. Moreover, the effect appears to be gesture-specific and was not found for other stimuli that draw attention to certain parts of speech, including prosodic emphasis, or a moving visual stimulus with the same trajectory as the gesture. This suggests that only visual emphasis produced with a communicative intention in mind (that is, beat gestures) influences language comprehension, but not a simple visual movement lacking such an intention.

Similar Neural Correlates for Language and Sequential Learning: Evidence from Event-Related Brain Potentials

We used event-related potentials (ERPs) to investigate the time course and distribution of brain activity while adults performed (a) a sequential learning task involving complex structured sequences, and (b) a language processing task. The same positive ERP deflection, the P600 effect, typically linked to difficult or ungrammatical syntactic processing, was found for structural incongruencies in both sequential learning as well as natural language, and with similar topographical distributions. Additionally, a left anterior negativity (LAN) was observed for language but not for sequential learning. These results are interpreted as an indication that the P600 provides an index of violations and the cost of integration of expectations for upcoming material when processing complex sequential structure. We conclude that the same neural mechanisms may be recruited for both syntactic processing of linguistic stimuli and sequential learning of structured sequence patterns more generally.

Why pitch sensitivity matters: event-related potential evidence of metric and syntactic violation detection among spanish late learners of german

Event-related potential (ERP) data in monolingual German speakers have shown that sentential metric expectancy violations elicit a biphasic ERP pattern consisting of an anterior negativity and a posterior positivity (P600). This pattern is comparable to that elicited by syntactic violations. However, proficient French late learners of German do not detect violations of metric expectancy in German. They also show qualitatively and quantitatively different ERP responses to metric and syntactic violations. We followed up the questions whether (1) latter evidence results from a potential pitch cue insensitivity in speech segmentation in French speakers, or (2) if the result is founded in rhythmic language differences. Therefore, we tested Spanish late learners of German, as Spanish, contrary to French, uses pitch as a segmentation cue even though the basic segmentation unit is the same in French and Spanish (i.e., the syllable). We report ERP responses showing that Spanish L2 learners are sensitive to syntactic as well as metric violations in German sentences independent of attention to task in a P600 response. Overall, the behavioral performance resembles that of German native speakers. The current data suggest that Spanish L2 learners are able to extract metric units (trochee) in their L2 (German) even though their basic segmentation unit in Spanish is the syllable. In addition Spanish in contrast to French L2 learners of German are sensitive to syntactic violations indicating a tight link between syntactic and metric competence. This finding emphasizes the relevant role of metric cues not only in L2 prosodic but also in syntactic processing.