Masked repetition priming and event-related brain potentials: a new approach for tracking the time-course of object perception

EEG dynamic source imaging using a regularized optimization with spatio-temporal constraints

One of the most important needs in neuroimaging is brain dynamic source imaging with high spatial and temporal resolution. EEG source imaging estimates the underlying sources from EEG recordings, which provides enhanced spatial resolution with intrinsically high temporal resolution. To ensure identifiability in the underdetermined source reconstruction problem, constraints on EEG sources are essential. This paper introduces a novel method for estimating source activities based on spatio-temporal constraints and a dynamic source imaging algorithm. The method enhances time resolution by incorporating temporal evolution of neural activity into a regularization function. Additionally, two spatial regularization constraints based on L 1 and L 2 norms are applied in the transformed domain to address both focal and spread neural activities, achieved through spatial gradient and Laplacian transform. Performance evaluation, conducted quantitatively using synthetic datasets, discusses the influence of parameters such as source extent, number of sources, correlation level, and SNR level on temporal and spatial metrics. Results demonstrate that the proposed method provides superior spatial and temporal reconstructions compared to state-of-the-art inverse solutions including STRAPS, sLORETA, SBL, dSPM, and MxNE. This improvement is attributed to the simultaneous integration of transformed spatial and temporal constraints. When applied to a real auditory ERP dataset, our algorithm accurately reconstructs brain source time series and locations, effectively identifying the origins of auditory evoked potentials. In conclusion, our proposed method with spatio-temporal constraints outperforms the state-of-the-art algorithms in estimating source distribution and time courses.

Expectation Modulates Repetition Suppression at Late But Not Early Stages during Visual Word Recognition: Evidence from Event-related Potentials

Visual word recognition is commonly rapid and efficient, incorporating top-down predictive processing mechanisms. Neuroimaging studies with face stimuli suggest that repetition suppression (RS) reflects predictive processing at the neural level, as this effect is larger when repetitions are more frequent, that is, more expected. It remains unclear, however, at the temporal level whether and how RS and its modulation by expectation occur in visual word recognition. To address this gap, the present study aimed to investigate the presence and time course of these effects during visual word recognition using EEG. Thirty-six native Cantonese speakers were presented with pairs of Chinese written words and performed a nonlinguistic oddball task. The second word of a pair was either a repetition of the first or a different word (alternation). In repetition blocks, 75% of trials were repetitions and 25% were alternations, whereas the reverse was true in alternation blocks. Topographic analysis of variance of EEG at each time point showed robust RS effects in three time windows (141-227 msec, 242-445 msec, and 467-513 msec) reflecting facilitation of visual word recognition. Importantly, the modulation of RS by expectation was observed at the late rather than early intervals (334-387 msec, 465-550 msec, and 559-632 msec) and more than 100 msec after the first RS effects. In the predictive coding view of RS, only late repetition effects are modulated by expectation, whereas early RS effects may be mediated by lower-level predictions. Taken together, our findings provide the first EEG evidence revealing distinct temporal dynamics of RS effects and repetition probability on RS effects in visual processing of Chinese words.

Asymetric Event-Related Potential Priming Effects Between English Letters and American Sign Language Fingerspelling Fonts

Letter recognition plays an important role in reading and follows different phases of processing, from early visual feature detection to the access of abstract letter representations. Deaf ASL-English bilinguals experience orthography in two forms: English letters and fingerspelling. However, the neurobiological nature of fingerspelling representations, and the relationship between the two orthographies, remains unexplored. We examined the temporal dynamics of single English letter and ASL fingerspelling font processing in an unmasked priming paradigm with centrally presented targets for 200 ms preceded by 100 ms primes. Event-related brain potentials were recorded while participants performed a probe detection task. Experiment 1 examined English letter-to-letter priming in deaf signers and hearing non-signers. We found that English letter recognition is similar for deaf and hearing readers, extending previous findings with hearing readers to unmasked presentations. Experiment 2 examined priming effects between English letters and ASL fingerspelling fonts in deaf signers only. We found that fingerspelling fonts primed both fingerspelling fonts and English letters, but English letters did not prime fingerspelling fonts, indicating a priming asymmetry between letters and fingerspelling fonts. We also found an N400-like priming effect when the primes were fingerspelling fonts which might reflect strategic access to the lexical names of letters. The studies suggest that deaf ASL-English bilinguals process English letters and ASL fingerspelling differently and that the two systems may have distinct neural representations. However, the fact that fingerspelling fonts can prime English letters suggests that the two orthographies may share abstract representations to some extent.

The Effects of Directional and Non-Directional Stimuli during a Visuomotor Task and Their Correlation with Reaction Time: An ERP Study

Different visual stimuli can capture and shift attention into different directions. Few studies have explored differences in brain response due to directional (DS) and non-directional visual stimuli (nDS). To explore the latter, event-related potentials (ERP) and contingent negative variation (CNV) during a visuomotor task were evaluated in 19 adults. To examine the relation between task performance and ERPs, the participants were divided into faster (F) and slower (S) groups based on their reaction times (RTs). Moreover, to reveal ERP modulation within the same subject, each recording from the single participants was subdivided into F and S trials based on the specific RT. ERP latencies were analysed between conditions ((DS, nDS); (F, S subjects); (F, S trials)). Correlation was analysed between CNV and RTs. Our results reveal that the ERPs' late components are modulated differently by DS and nDS conditions in terms of amplitude and location. Differences in ERP amplitude, location and latency, were also found according to subjects' performance, i.e., between F and S subjects and trials. In addition, results show that the CNV slope is modulated by the directionality of the stimulus and contributes to motor performance. A better understanding of brain dynamics through ERPs could be useful to explain brain states in healthy subjects and to support diagnoses and personalized rehabilitation in patients with neurological diseases.

Taxonomic and thematic semantic relationships in picture naming as revealed by Laplacian-transformed event-related potentials

Semantically related concepts co-activate when we speak. Prior research reported both behavioral interference and facilitation due to co-activation during picture naming. Different word relationships may account for some of this discrepancy. Taxonomically related words (e.g., WOLF-DOG) have been associated with semantic interference; thematically related words (e.g., BONE-DOG) have been associated with facilitation. Although these different semantic relationships have been associated with opposite behavioral outcomes, electrophysiological studies have found inconsistent effects on event-related potentials. We conducted a picture-word interference electroencephalography experiment to examine word retrieval dynamics in these different semantic relationships. Importantly, we used traditional monopolar analysis as well as Laplacian transformation allowing us to examine spatially deblurred event-related components. Both analyses revealed greater negativity (150-250 ms) for unrelated than related taxonomic pairs, though more restricted in space for thematic pairs. Critically, Laplacian analyses revealed a larger negative-going component in the 300 to 500 ms time window in taxonomically related versus unrelated pairs which were restricted to a left frontal recording site. In parallel, an opposite effect was found in the same time window but localized to a left parietal site. Finding these opposite effects in the same time window was feasible thanks to the use of the Laplacian transformation and suggests that frontal control processes are concurrently engaged with cascading effects of the spread of activation through semantically related representations.

Is there magnocellular facilitation of early neural processes underlying visual word recognition? Evidence from masked repetition priming with ERPs

An influential theory in the field of visual object recognition proposes that it is the fast magnocellular (M) system that facilitates neural processing of spatially more fine-grained information rather the slower parvocellular (P) system. While written words can be considered as a special type of visual objects, it is unknown whether magnocellular facilitation also plays a role in reading. We used a masked priming paradigm that has been shown to result in neural facilitation in visual word processing and tested whether these facilitating effects are mediated by the magnocellular system. In two experiments, we manipulated the influence of magnocellular and parvocellular systems on visual processing of a contextually predictable target character by contrasting high versus low spatial frequency and luminance versus color contrast, respectively. In addition, unchanged (normal) primes were included in both experiments as a manipulation check. As expected, unchanged primes elicited typical repetition effects in the N1, N250 and P3 components of the ERP in both experiments. In the experiment manipulating spatial contrast, we obtained repetition effects only for the N1 component for both M- and P-biased primes. In the luminance versus color contrast experiment, repetition effects were found in N1 and N250 for both M- and P- biased primes. Furthermore, no interactions were found between M-vs. P-biased prime types and repetition. Together these results indicate that M- and P- information contributes jointly to early neural processes underlying visual word recognition.

Characteristics of N400 component elicited in patients who have migraine with aura

Background

This study aimed to examine the N400 effect and event-related potentials (ERPs) elicited from congruent and incongruent stimuli in patients who have migraines with aura (MwA).

Methods

A total of 33 MwA patients and 20 healthy controls (HCs) were studied. They were balanced in age (35.12 ± 8.94 vs 34.70 ± 9.59 years, p = 0.872) and sex (69.7 vs 75.0% females, p = 0.761). ERPs were measured in response to both stimuli, where pictures were preceded with an object name that either matched or mismatched with the object. Averaged amplitudes, peaks, peak latencies, difference waves and topography were compared between MwA and HCs.

Results

MwA patients had significantly lower averaged amplitudes at the Fz and F4 sites during incongruent stimuli, as well as reduced peaks at the C3 and Pz sites. Topography showed a more widespread N400 effect over scalp relative to HCs. The difference ERP waveforms did not differ in the N400 effect between groups, but the P600 effect was significantly stronger in the HCs group relative to the MwA group at the Pz (6.52 ± 2.57 vs. 3.50 ± 3.15, p = 0.001) and P4 (5.86 ± 2.79 vs. 3.95 ± 3.64, p = 0.040) sites.

Conclusions

Picture-word matching tasks could serve as a potential new method for the investigation of semantic processing in MwA patients.

Conceptual representation of real-world surface material: Early integration with linguistic-labels indicated in the N400-component

Research in perception in the visual and auditory domains has traditionally focused on investigating highly controlled artificial stimulus material. However, a key feature of our perceptual system is the ease with which the input of a wide set of naturalistic co-occurring information is dealt with. This study investigated whether, during perception of real-world surface material, a conceptual representation is built that has the potential to interact with a linguistic description of the material directly. Short sentences were presented (e.g., This surface is smooth) followed by a matching or mismatching picture of a real-world surface material. The results showed early cross-modal integration effects during material surface perception in an N400-like potential, originating approximately 280 ms after stimulus presentation. Overall, these findings suggest a rather early influence of linguistic information on material perception, suggesting that in line with object representation, real-world materials are represented in the brain in a format that allows interaction with non-visual information.

How to do Better N400 Studies: Reproducibility, Consistency and Adherence to Research Standards in the Existing Literature

Given the complexity of ERP recording and processing pipeline, the resulting variability of methodological options, and the potential for these decisions to influence study outcomes, it is important to understand how ERP studies are conducted in practice and to what extent researchers are transparent about their data collection and analysis procedures. The review gives an overview of methodology reporting in a sample of 132 ERP papers, published between January 1980 – June 2018 in journals included in two large databases: Web of Science and PubMed. Because ERP methodology partly depends on the study design, we focused on a well-established component (the N400) in the most commonly assessed population (healthy neurotypical adults), in one of its most common modalities (visual images). The review provides insights into 73 properties of study design, data pre-processing, measurement, statistics, visualization of results, and references to supplemental information across studies within the same subfield. For each of the examined methodological decisions, the degree of consistency, clarity of reporting and deviations from the guidelines for best practice were examined. Overall, the results show that each study had a unique approach to ERP data recording, processing and analysis, and that at least some details were missing from all papers. In the review, we highlight the most common reporting omissions and deviations from established recommendations, as well as areas in which there was the least consistency. Additionally, we provide guidance for a priori selection of the N400 measurement window and electrode locations based on the results of previous studies.

Timing of repetition suppression of event-related potentials to unattended objects

Current theories of object perception emphasize the automatic nature of perceptual inference. Repetition suppression (RS), the successive decrease of brain responses to repeated stimuli, is thought to reflect the optimization of perceptual inference through neural plasticity. While functional imaging studies revealed brain regions that show suppressed responses to the repeated presentation of an object, little is known about the intra-trial time course of repetition effects to everyday objects. Here, we used event-related potentials (ERPs) to task-irrelevant line-drawn objects, while participants engaged in a distractor task. We quantified changes in ERPs over repetitions using three general linear models that modeled RS by an exponential, linear, or categorical "change detection" function in each subject. Our aim was to select the model with highest evidence and determine the within-trial time-course and scalp distribution of repetition effects using that model. Model comparison revealed the superiority of the exponential model indicating that repetition effects are observable for trials beyond the first repetition. Model parameter estimates revealed a sequence of RS effects in three time windows (86-140, 322-360, and 400-446 ms) and with occipital, temporoparietal, and frontotemporal distribution, respectively. An interval of repetition enhancement (RE) was also observed (320-340 ms) over occipitotemporal sensors. Our results show that automatic processing of task-irrelevant objects involves multiple intervals of RS with distinct scalp topographies. These sequential intervals of RS and RE might reflect the short-term plasticity required for optimization of perceptual inference and the associated changes in prediction errors and predictions, respectively, over stimulus repetitions during automatic object processing.

Implicit outcomes expectancies shape memory process: Electrophysiological evidence

The simple manipulation of pairing specific outcomes with the sample stimuli strongly affects discriminative learning and memory processes. This procedure has been named the Differential Outcomes Procedure (DOP) and is usually compared to a control condition (the non-differential procedure, NOP) consisting in the random administration of the outcomes after each correct response. Recent research has revealed that the DOP effect arises even under unconscious conditions. In this study, we explored the temporal dynamics of short-term memory processes in both the DOP and the NOP in the absence of awareness of either the outcome (Experiment 1A) or the initial sample stimulus (Experiment 1B) through the evoked-related potentials technique. Results showed distinctive electrophysiological activation patterns in the DOP compared with the NOP at encoding, maintenance and retrieval phases. The present findings provide electrophysiological evidence of implicit-prospective processes involved in the DOP. They elucidate the processes that result in improved visual recognition memory.

Flexing Gender Perception: Brain Potentials Reveal the Cognitive Permeability of Grammatical Information

A growing body of recent research suggests that verbal categories, particularly labels, impact categorization and perception. These findings are commonly interpreted as demonstrating the involvement of language on cognition; however, whether these assumptions hold true for grammatical structures has yet to be investigated. In the present study, we investigated the extent to which linguistic information, namely, grammatical gender categories, structures cognition to subsequently influence categorical judgments and perception. In a nonverbal categorization task, French-English bilinguals and monolingual English speakers made gender-associated judgments about a set of image pairs while event-related potentials were recorded. The image sets were composed of an object paired with either a female or male face, wherein the object was manipulated for their conceptual gender relatedness and grammatical gender congruency to the sex of the following target face. The results showed that grammatical gender modulated the N1 and P2/VPP, as well as the N300 exclusively for the French-English bilinguals, indicating the inclusion of language in the mechanisms associated with attentional bias and categorization. In contrast, conceptual gender information impacted the monolingual English speakers in the later N300 time window given the absence of a comparable grammatical feature. Such effects of grammatical categories in the early perceptual stream have not been found before, and further provide grounds to suggest that language shapes perception.

Cross-modal nonspatial repetition inhibition: An ERP study

Previous studies have demonstrated that nonspatial repetition inhibition can occur across modalities. However, the underlying mechanism of such cross-modal nonspatial repetition inhibition is unknown. The present experiment adopted a cross-modal prime-neutral cue-target paradigm in which in consecutive trials the prime and the target were matched or mismatched, not only in identity but also in modality. Meanwhile, event-related potentials (ERPs) to visual and auditory targets were recorded. The present study aimed to answer two questions: which ERP components reflect nonspatial repetition inhibition across modalities, and is the ERP component modality specific or supramodal? The results showed that for visual targets, robust nonspatial repetition inhibition occurred similarly for both unimodal (visual-visual) and cross-modal (audio-visual) target pairings, as indexed by an N400 repetition-induced increment in the typical N400 window but null effects during the N2 epoch. For auditory targets, similar modulation of cross-modal nonspatial repetition inhibition on the auditory-evoked N400 repetition-induced increment was observed. These results suggest that the N400 repetition-induced increment occurs during the N400 epoch that underlies cross-modal nonspatial repetition inhibition and that this N400 component is a supramodal component.

Perceptual elaboration paradigm (PEP): A new approach for investigating mental representations of language

To examine hemispheric differences in accessing a mental representation that embodies perceptual elements and their spatial relationships (i.e., perceptual elaboration and integration), we developed a cross-modal perceptual elaboration paradigm (PEP) in which an imagined percept, rather than a propositional concept, determined congruency. Three target image conditions allow researchers to test which mental representation is primarily accessed when the target is laterally presented. For example, the “Integrated” condition is congruent with either propositional or perceptual mental representations; therefore, results from both hemifield conditions (RVF/LH vs. LVF/RH) should be comparable. Similarly, the “Unrelated” condition is incongruent with either propositional or perceptual mental representations; therefore, results from both hemifield conditions should be comparable as well. However, the “Unintegrated” condition is congruent with the propositional mental representation but not the perceptual mental representation. Should either hemisphere access one representation initially, differences will be revealed in either behavioural or electroencephalography results. This paradigm:•

is distinct from existing paired paradigms that emphasize semantic associations.

•

is important given increasing evidence that discourse comprehension involves accessing perceptual information.

•

allows researchers to examine the extent to which a mental representation of discourse can embody perceptual elaboration and integration.

When a second language hits a native language. What ERPs (do and do not) tell us about language retrieval difficulty in bilingual language production

The accumulating evidence suggests that prior usage of a second language (L2) leads to processing costs on the subsequent production of a native language (L1). However, it is unclear what mechanism underlies this effect. It has been proposed that the L1 cost reflects inhibition of L1 representation acting during L1 production; however, previous studies exploring this issue were inconclusive. It is also unsettled whether the mechanism operates on the whole-language level or is restricted to translation equivalents in the two languages. We report a study that allowed us to address both issues behaviorally with the use of ERPs while focusing on the consequences of using L2 on the production of L1. In our experiment, native speakers of Polish (L1) and learners of English (L2) named a set of pictures in L1 following a set of pictures in either L1 or L2. Half of the pictures were repeated from the preceding block and half were new; this enabled dissociation of the effects on the level of the whole language from those specific to individual lexical items. Our results are consistent with the notion that language after-effects operate at a whole-language level. Behaviorally, we observed a clear processing cost on the whole-language level and a small facilitation on the item-specific level. The whole-language effect was accompanied by an enhanced, fronto-centrally distributed negativity in the 250-350 ms time-window which we identified as the N300 (in contrast to previous research, which probably misidentified the effect as the N2), a component that presumably reflects retrieval difficulty of relevant language representations during picture naming. As such, unlike previous studies that reported N2 for naming pictures in L1 after L2 use, we propose that the reported ERPs (N300) indicate that prior usage of L2 hampers lexical access to names in L1. Based on the literature, the after-effects could be caused by L1 inhibition and/or L2 interference, but the ERPs so far have not been informative about the causal mechanism.

Multiple routes to word recognition: evidence from event-related potentials

We used event-related potentials to determine whether lexical access during semantic processing is achieved solely by the letter-based route, or by both a letter-based and word-based route. Participants determined whether words were related or unrelated to a prespecified category. To disrupt the word-based route (i.e., disrupt the processing of overall word shape), we manipulated case type. We measured the N170, assumed to be an index of holistic processing, and the N400, an index of semantic activation. Surprisingly, mixed-case words elicited a larger N170 effect than either consistent lowercase words (Experiment 1) or consistent uppercase words (Experiment 2). The N400, meanwhile, was unaffected by case mixing. In contrast, LEET words (e.g., T4BL3 instead of TABLE), which preserve overall word shape but distort letter shape, increased the N400 but did not reduce the N170 (Experiment 3). The results indicate that the N170 is in fact not a reliable index of holistic word processing. Implications for word recognition models are discussed.

Electrophysiological correlates of masked repetition and conceptual priming for visual objects

BACKGROUND

Previous studies have investigated the time course of visual object processing using event-related potential (ERP) and the masked repetition priming paradigm. However, it is unclear how the ERP correlates associated with masked repetition priming differentiate from masked conceptual priming of visual objects.

METHOD

The present study used semantically related picture pairs of visual objects to compare the ERPs associated with masked repetition and conceptual priming of visual objects.

RESULTS

The results revealed that masked repetition priming was associated with N/P190 and N400 effects, whereas masked conceptual priming was only associated with N400 effect. Moreover, the topography of repetition N/P190 effect was different from repetition and conceptual N400 effects, whereas the topography of repetition N400 effect was similar to conceptual N400 effect.

CONCLUSIONS

These results indicated that masked repetition and conceptual priming were associated with spatiotemporally different ERP effects and that the N400 of visual objects was sensitive to automatic semantic spreading.

Revisiting mental rotation with stereoscopic disparity: A new spin for a classic paradigm

To understand how the presence of stereoscopic disparity influences cognitive and neural processing, we recorded participants' behavior and scalp electrical activity while they performed a mental rotation task. Participants wore active shutter 3D goggles, allowing us to present stimuli with or without stereoscopic disparity on a trial-by-trial basis. Participants were more accurate and faster when stimuli were presented with stereoscopic disparity. This improvement in performance was accompanied by changes in neural activity recorded from scalp electrodes at parietal and occipital regions; stereoscopic disparity produced earlier P2 peaks, larger N2 amplitudes, and earlier, smaller P300 peak amplitudes. The presence of stereoscopic disparity also produced greater neural entropy at occipital electrode sites, and lower entropy at frontal sites. These findings suggest that the nature of the benefit afforded by stereoscopic disparity occurs at both low-level perceptual processing and higher-level cognitive processing, and results in more accurate and rapid performance.

An electrophysiological investigation of orthographic spatial integration in reading

During reading, word recognition speed is influenced by the amount of orthographic overlap with surrounding words. The nature of this phenomenon is not understood: some theories attribute it to low-level visual operations (i.e., parafoveal feature detectors influencing foveal letter detectors), whereas other theories assume that orthographic processing (i.e., letter position coding and word activation) occurs across multiple words in parallel. To arbitrate between these theories, we used electroencephalography to reveal the time course of orthographic spatial integration in a lexical decision task. Foveal target words were flanked on each side by parafoveal words, manipulated across three conditions: repetition flankers (e.g. rock rock rock), unrelated flankers (step rock step) and a no-flanker condition. Linear mixed-effect models were constructed to analyze EEG data on a trial-by-trial basis. Word recognition was worse in the unrelated flanker condition than in the repetition and no-flanker conditions. This behavioral pattern was accompanied by increased negativity in the N250 and N400 windows, associated with the activation of sub-lexical and lexico-semantic representations, respectively. Crucially, the absence of effects prior to 200 ms post-stimulus onset provides evidence against the involvement of low-level visual processes. We conclude that orthographic spatial integration is driven by parallel processing of multiple words, which leads to the activation of a larger set of sub-lexical nodes and more difficult processing at the lexical level when those words are orthographically unrelated.

•

Words are recognized faster when they share many letters with surrounding words.

•

EEG measurements suggest that this effect unfolds 200 ms after stimulus onset.

•

The locus of effects contradicts the involvement of low-level visual processing.

•

Instead, the phenomenon appears to be driven by parallel orthographic processing.

Subliminal Priming-State of the Art and Future Perspectives

The influence of subliminal priming (behavior outside of awareness) in humans is an interesting phenomenon and its understanding is crucial as it can impact behavior, choices, and actions. Given this, research about the impact of priming continues to be an area of investigative interest, and this paper provides a technical overview of research design strengths and issues in subliminal priming research. Efficient experiments and protocols, as well as associated electroencephalographic and eye movement data analyses, are discussed in detail. We highlight the strengths and weaknesses of different priming experiments that have measured affective (emotional) and cognitive responses. Finally, very recent approaches and findings are described to summarize and emphasize state-of-the-art methods and potential future directions in research marketing and other commercial applications.

Comparing the temporal dynamics of thematic and taxonomic processing using event-related potentials

We report the results of a study comparing the temporal dynamics of thematic and taxonomic knowledge activation in a picture-word priming paradigm using event-related potentials. Although we found no behavioral differences between thematic and taxonomic processing, ERP data revealed distinct patterns of N400 and P600 amplitude modulation for thematic and taxonomic priming. Thematically related target stimuli elicited less negativity than taxonomic targets between 280–460 ms after stimulus onset, suggesting easier semantic processing of thematic than taxonomic relationships. Moreover, P600 mean amplitude was significantly increased for taxonomic targets between 520–600 ms, consistent with a greater need for stimulus reevaluation in that condition. These results offer novel evidence in favor of a dissociation between thematic and taxonomic thinking in the early phases of conceptual evaluation.

Sensory and semantic activations evoked by action attributes of manipulable objects: Evidence from ERPs

"Two route" theories of object-related action processing posit different temporal activation profiles of grasp-to-move actions (rapidly evoked based on object structure) versus skilled use actions (more slowly activated based on semantic knowledge). We capitalized on the exquisite temporal resolution and multidimensionality of Event-Related Potentials (ERPs) to directly test this hypothesis. Participants viewed manipulable objects (e.g., calculator) preceded by objects sharing either "grasp", "use", or no action attributes (e.g., bar of soap, keyboard, earring, respectively), as well as by action-unrelated but taxonomically-related objects (e.g., abacus); participants judged whether the two objects were related. The results showed more positive responses to "grasp-to-move" primed objects than "skilled use" primed objects or unprimed objects starting in the P1 (0-150 ms) time window and continuing onto the subsequent N1 and P2 components (150-300 ms), suggesting that only "grasp-to-move", but not "skilled use", actions may facilitate visual attention to object attributes. Furthermore, reliably reduced N400s (300-500 ms), an index of semantic processing, were observed to taxonomically primed and "skilled use" primed objects relative to unprimed objects, suggesting that "skilled use" action attributes are a component of distributed, multimodal semantic representations of objects. Together, our findings provide evidence supporting two-route theories by demonstrating that "grasp-to-move" and "skilled use" actions impact different aspects of object processing and highlight the relationship of "skilled use" information to other aspects of semantic memory.

Event-Related Potential Effects of Object Repetition Depend on Attention and Part-Whole Configuration

The effects of spatial attention and part-whole configuration on recognition of repeated objects were investigated with behavioral and event-related potential (ERP) measures. Short-term repetition effects were measured for probe objects as a function of whether a preceding prime object was shown as an intact image or coarsely scrambled (split into two halves) and whether or not it had been attended during the prime display. In line with previous behavioral experiments, priming effects were observed from both intact and split primes for attended objects, but only from intact (repeated same-view) objects when they were unattended. These behavioral results were reflected in ERP waveforms at occipital–temporal locations as more negative-going deflections for repeated items in the time window between 220 and 300 ms after probe onset (N250r). Attended intact images showed generally more enhanced repetition effects than split ones. Unattended images showed repetition effects only when presented in an intact configuration, and this finding was limited to the right-hemisphere electrodes. Repetition effects in earlier (before 200 ms) time windows were limited to attended conditions at occipito-temporal sites during the N1, a component linked to the encoding of object structure, while repetition effects at central locations during the same time window (P150) were found for attended and unattended probes but only when repeated in the same intact configuration. The data indicate that view-generalization is mediated by a combination of analytic (part-based) representations and automatic view-dependent representations.

Surprise as an ideal case for the interplay of cognition and emotion

The target article is a timely exposition on the impact of how emotion and cognition interact, a specifically important issue in surprise research. Psychologists debate whether disconfirmed expectations or sense-making processes determine surprise levels experienced for an event. We posit that, in surprise, cognition and emotion are intertwined, making it an interesting test case for the proposals in this article.

Processing fluency hinders subsequent recollection: an electrophysiological study

Although many behavioral studies have investigated the effect of processing fluency on subsequent recognition memory, little research has examined the neural mechanism of this phenomenon. The present study aimed to explore the electrophysiological correlates of the effects of processing fluency on subsequent recognition memory by using an event-related potential (ERP) approach. The masked repetition priming paradigm was used to manipulate processing fluency in the study phase, and the R/K paradigm was utilized to investigate which recognition memory process (familiarity or recollection) was affected by processing fluency in the test phase. Converging behavioral and ERP results indicated that increased processing fluency impaired subsequent recollection. Results from the analysis of ERP priming effects in the study phase indicated that increased perceptual processing fluency of object features, reflected by the N/P 190 priming effect, can hinder encoding activities, reflected by the LPC priming effect, which leads to worse subsequent recollection based recognition memory. These results support the idea that processing fluency can influence subsequent recognition memory and provide a potential neural mechanism underlying this effect. However, further studies are needed to examine whether processing fluency can affect subsequent familiarity.

A saw is first identified as an object used on wood: ERP evidence for temporal differences between Thematic and Functional similarity relations

The role of functional and motor information in manipulable artifact object semantic organization is still poorly understood. In particular, several types of semantic relations involving object functional knowledge may be distinguished. Functional similarity relations group objects with similar functions at relatively specific (e.g. saw-axe, both used to cut wood) or general (saw-knife, both used to cut) levels. Thematic relations group objects based on their complementarity in events (saw used upon/with wood). Recent eye-tracking data showed distinct temporal time courses for the different semantic relations, with fastest processing of thematic relations and slowest processing of general function similarity relations. Behavioral data suggest the involvement of distinct cognitive mechanisms in manipulable artifact object semantic processing. The aim of the present study was to assess the neural correlates of thematic, and specific and general function similarity relation processing. Specifically, we investigated whether time course differences between semantic relations could be highlighted at the neurophysiological level. We used a protocol combining semantic priming with electroencephalography, and manipulated the type of semantic relation and the duration of the interval between prime and target objects. Two consistent and complementary results were shown. On N1 and P3 components, semantic priming was observed for thematic relations only. On N400 component, the type of semantic relation interacted with interval duration, and semantic priming was visible for all 3 relations after the longest interval only. Results revealed graded processing time courses for thematic, specific function similarity, and general function similarity relations at the neural level, and further indicate that thematic relations impact object processing during the early stages of object recognition. Findings suggest a hierarchical organization of three types of semantic relations based on functional knowledge. The parallel between semantic relations involving manipulable artifact objects and levels of action representations is discussed.

EEG source connectivity analysis: from dense array recordings to brain networks

The recent past years have seen a noticeable increase of interest for electroencephalography (EEG) to analyze functional connectivity through brain sources reconstructed from scalp signals. Although considerable advances have been done both on the recording and analysis of EEG signals, a number of methodological questions are still open regarding the optimal way to process the data in order to identify brain networks. In this paper, we analyze the impact of three factors that intervene in this processing: i) the number of scalp electrodes, ii) the combination between the algorithm used to solve the EEG inverse problem and the algorithm used to measure the functional connectivity and iii) the frequency bands retained to estimate the functional connectivity among neocortical sources. Using High-Resolution (hr) EEG recordings in healthy volunteers, we evaluated these factors on evoked responses during picture recognition and naming task. The main reason for selection this task is that a solid literature background is available about involved brain networks (ground truth). From this a priori information, we propose a performance criterion based on the number of connections identified in the regions of interest (ROI) that belong to potentially activated networks. Our results show that the three studied factors have a dramatic impact on the final result (the identified network in the source space) as strong discrepancies were evidenced depending on the methods used. They also suggest that the combination of weighted Minimum Norm Estimator (wMNE) and the Phase Synchronization (PS) methods applied on High-Resolution EEG in beta/gamma bands provides the best performance in term of topological distance between the identified network and the expected network in the above-mentioned cognitive task.

Real-time processing in picture naming in adults who stutter: ERP evidence

OBJECTIVE

The aim was to compare real-time language/cognitive processing in picture naming in adults who stutter (AWS) versus typically-fluent adults (TFA).

METHODS

Participants named pictures preceded by masked prime words. Primes and target picture labels were identical or mismatched. Priming effects on naming and picture-elicited ERP activity were analyzed. Vocabulary knowledge correlations with these measures were assessed.

RESULTS

Priming improved naming RTs and accuracy in both groups. RTs were longer for AWS, and correlated positively with receptive vocabulary in TFA. Electrophysiologically, posterior-P1 amplitude negatively correlated with expressive vocabulary in TFA versus receptive vocabulary in AWS. Frontal/temporal-P1 amplitude correlated positively with expressive vocabulary in AWS. Identity priming enhanced frontal/posterior-N2 amplitude in both groups, and attenuated P280 amplitude in AWS. N400 priming was topographically-restricted in AWS.

CONCLUSIONS

Results suggest that conceptual knowledge was perceptually-grounded in expressive vocabulary in TFA versus receptive vocabulary in AWS. Poorer expressive vocabulary in AWS was potentially associated with greater suppression of irrelevant conceptual information. Priming enhanced N2-indexed cognitive control and visual attention in both groups. P280-indexed focal attention attenuated with priming in AWS only. Topographically-restricted N400 priming suggests that lemma/word form connections were weaker in AWS.

SIGNIFICANCE

Real-time language/cognitive processing in picture naming operates differently in AWS.

Unconscious automatic brain activation of acoustic and action-related conceptual features during masked repetition priming

Classical theories of semantic memory assume that concepts are represented in a unitary amodal memory system. In challenging this classical view, pure or hybrid modality-specific theories propose that conceptual representations are grounded in the sensory-motor brain areas, which typically process sensory and action-related information. Although neuroimaging studies provided evidence for a functional-anatomical link between conceptual processing of sensory or action-related features and the sensory-motor brain systems, it has been argued that aspects of such sensory-motor activation may not directly reflect conceptual processing but rather strategic imagery or postconceptual elaboration. In the present ERP study, we investigated masked effects of acoustic and action-related conceptual features to probe unconscious automatic conceptual processing in isolation. Subliminal feature-specific ERP effects at frontocentral electrodes were observed, which differed with regard to polarity, topography, and underlying brain electrical sources in congruency with earlier findings under conscious viewing conditions. These findings suggest that conceptual acoustic and action representations can also be unconsciously accessed, thereby excluding any postconceptual strategic processes. This study therefore further substantiates a grounding of conceptual and semantic processing in action and perception.

Decision-making in information seeking on texts: an eye-fixation-related potentials investigation

Reading on a web page is known to be not linear and people need to make fast decisions about whether they have to stop or not reading. In such context, reading, and decision-making processes are intertwined and this experiment attempts to separate them through electrophysiological patterns provided by the Eye-Fixation-Related Potentials technique (EFRPs). We conducted an experiment in which EFRPs were recorded while participants read blocks of text that were semantically highly related, moderately related, and unrelated to a given goal. Participants had to decide as fast as possible whether the text was related or not to the semantic goal given at a prior stage. Decision making (stopping information search) may occur when the paragraph is highly related to the goal (positive decision) or when it is unrelated to the goal (negative decision). EFRPs were analyzed on and around typical eye fixations: either on words belonging to the goal (target), subjected to a high rate of positive decisions, or on low frequency unrelated words (incongruent), subjected to a high rate of negative decisions. In both cases, we found EFRPs specific patterns (amplitude peaking between 51 to 120 ms after fixation onset) spreading out on the next words following the goal word and the second fixation after an incongruent word, in parietal and occipital areas. We interpreted these results as delayed late components (P3b and N400), reflecting the decision to stop information searching. Indeed, we show a clear spill-over effect showing that the effect on word N spread out on word N + 1 and N + 2.

Differential electrophysiological signatures of semantic and syntactic scene processing

In sentence processing, semantic and syntactic violations elicit differential brain responses observable in event-related potentials: An N400 signals semantic violations, whereas a P600 marks inconsistent syntactic structure. Does the brain register similar distinctions in scene perception? To address this question, we presented participants with semantic inconsistencies, in which an object was incongruent with a scene's meaning, and syntactic inconsistencies, in which an object violated structural rules. We found a clear dissociation between semantic and syntactic processing: Semantic inconsistencies produced negative deflections in the N300-N400 time window, whereas mild syntactic inconsistencies elicited a late positivity resembling the P600 found for syntactic inconsistencies in sentence processing. Extreme syntactic violations, such as a hovering beer bottle defying gravity, were associated with earlier perceptual processing difficulties reflected in the N300 response, but failed to produce a P600 effect. We therefore conclude that different neural populations are active during semantic and syntactic processing of scenes, and that syntactically impossible object placements are processed in a categorically different manner than are syntactically resolvable object misplacements.

An ERP investigation of visual word recognition in syllabary scripts

The bimodal interactive-activation model has been successfully applied to understanding the neurocognitive processes involved in reading words in alphabetic scripts, as reflected in the modulation of ERP components in masked repetition priming. In order to test the generalizability of this approach, in the present study we examined word recognition in a different writing system, the Japanese syllabary scripts hiragana and katakana. Native Japanese participants were presented with repeated or unrelated pairs of Japanese words in which the prime and target words were both in the same script (within-script priming, Exp. 1) or were in the opposite script (cross-script priming, Exp. 2). As in previous studies with alphabetic scripts, in both experiments the N250 (sublexical processing) and N400 (lexical-semantic processing) components were modulated by priming, although the time course was somewhat delayed. The earlier N/P150 effect (visual feature processing) was present only in "Experiment 1: Within-script priming", in which the prime and target words shared visual features. Overall, the results provide support for the hypothesis that visual word recognition involves a generalizable set of neurocognitive processes that operate in similar manners across different writing systems and languages, as well as pointing to the viability of the bimodal interactive-activation framework for modeling such processes.

Masked priming of conceptual features reveals differential brain activation during unconscious access to conceptual action and sound information

Previous neuroimaging studies suggested an involvement of sensory-motor brain systems during conceptual processing in support of grounded cognition theories of conceptual memory. However, in these studies with visible stimuli, contributions of strategic imagery or semantic elaboration processes to observed sensory-motor activity cannot be entirely excluded. In the present study, we therefore investigated the electrophysiological correlates of unconscious feature-specific priming of action- and sound-related concepts within a novel feature-priming paradigm to specifically probe automatic processing of conceptual features without the contribution of possibly confounding factors such as orthographic similarity or response congruency. Participants were presented with a masked subliminal prime word and a subsequent visible target word. In the feature-priming conditions primes as well as targets belonged to the same conceptual feature dimension (action or sound, e.g., typewriter or radio) whereas in the two non-priming conditions, either the primes or the targets consisted of matched control words with low feature relevance (e.g., butterfly or candle). Event-related potential analyses revealed unconscious feature-specific priming effects at fronto-central electrodes within 100 to 180 ms after target stimulus onset that differed with regard to topography and underlying neural generators. In congruency with previous findings under visible stimulation conditions, these differential subliminal ERP feature-priming effects demonstrate an unconscious automatic access to action versus sound features of concepts. The present results therefore support grounded cognition theory suggesting that activity in sensory and motor areas during conceptual processing can also occur unconsciously and is not mandatorily accompanied by a vivid conscious experience of the conceptual content such as in imagery.

Detection is unaffected by the deployment of focal attention

There has been much debate regarding how much information humans can extract from their environment without the use of limited attentional resources. In a recent study, Theeuwes et al. (2008) argued that even detection of simple feature targets is not possible without selection by focal attention. Supporting this claim, they found response time (RT) benefits in a simple feature (color) detection task when a target letter's identity was repeated on consecutive trials, suggesting that the letter was selected by focal attention and identified prior to detection. This intertrial repetition benefit remained even when observers were required to simultaneously identify a central digit. However, we found that intertrial repetition benefits disappeared when a simple color target was presented among a heterogeneously (rather than homogeneously) colored set of distractors, thus reducing its bottom–up salience. Still, detection performance remained high. Thus, detection performance was unaffected by whether a letter was focally attended and identified prior to detection or not. Intertrial identity repetition benefits also disappeared when observers were required to perform a simultaneous, attention-demanding central task (Experiment 2), or when unfamiliar Chinese characters were used (Experiment 3). Together, these results suggest that while shifts of focal attention can be affected by target salience, by the availability of excess cognitive resources, and by target familiarity, detection performance itself is unaffected by these manipulations and is thus unaffected by the deployment of focal attention.

Semantic processing in subliminal face stimuli: an EEG and tDCS study

Whether visual subliminal processing involves semantic processing is still being debated. To examine this, we combined a passive electroencephalogram (EEG) study with an application of transcranial direct current stimulation (tDCS). In the masked-face priming paradigm, we presented a subliminal prime preceding the target stimulus. Participants were asked to determine whether the target face was a famous face, indicated by a button press. The prime and target pair were either the same person's face (congruent) or different person's faces (incongruent), and were always both famous or both non-famous faces. Experiments were performed over 2 days: 1 day for a real tDCS session and another for a sham session as a control condition. In the sham session, a priming effect, reflected in the difference in amplitude of the late positive component (250-500 ms to target onset), was observed only in the famous prime condition. According to a previous study, this effect might indicate a subliminal semantic process [10]. Alternatively, a priming effect toward famous primes disappeared after tDCS stimulation. Our results suggested that a subliminal process might not be limited to processes in the occipital and temporal areas, but may proceed to the semantic level processed in prefrontal cortex.

The effects of visual imagery on face identification: an ERP study

The present study tested the hypothesis that the effects of mental imagery on subsequent perception occur at a later matching stage in perceptual identification, but not in the early perceptual stage as in perceptual detection. The behavioral results suggested that the effect of visual imagery on visual identification is content-specific, i.e., imagining a congruent face facilitates face identification, whereas a mismatch between imagery and perception leads to an interference effect. More importantly, the ERP results revealed that a more negative N2 response to the subsequent visual face stimuli was elicited over fronto-central sites in the mismatch and no-imagery conditions as compared to that in the match condition, with the early P1 and N170 components independent of manipulations. The latency and distribution of the neural effects demonstrate that the matching step, but not the earlier perceptual process, is affected by the preceding visual imagery in the context of face identification. We discuss these results in a broader context that the imagery-perception interaction may depend on task demand.

Early, equivalent ERP masked priming effects for regular and irregular morphology

Converging evidence from behavioral masked priming (Rastle & Davis, 2008), EEG masked priming (Morris, Frank, Grainger, & Holcomb, 2007) and single word MEG (Zweig & Pylkkänen, 2008) experiments has provided robust support for a model of lexical processing which includes an early, automatic, visual word form based stage of morphological parsing that applies to all derivationally affixed words. The mechanisms by which regularly (walked, birds) and irregularly (gave, geese) inflected forms are processed are less well established. We combine the masked priming paradigm with EEG recording to directly compare the ERPs evoked by regularly and irregularly inflected forms. We find equivalent N250 priming effects for both types of morphological complexity, which argues for rapid, form based morphological parsing of all morphologically complex word forms.

Conscious intention to speak proactively facilitates lexical access during overt object naming

The present study explored when and how the top-down intention to speak influences the language production process. We did so by comparing the brain's electrical response for a variable known to affect lexical access, namely word frequency, during overt object naming and non-verbal object categorization. We found that during naming, the event-related brain potentials elicited for objects with low frequency names started to diverge from those with high frequency names as early as 152 ms after stimulus onset, while during non-verbal categorization the same frequency comparison appeared 200 ms later eliciting a qualitatively different brain response. Thus, only when participants had the conscious intention to name an object the brain rapidly engaged in lexical access. The data offer evidence that top-down intention to speak proactively facilitates the activation of words related to perceived objects.

Electrophysiological correlates of object-repetition effects: sLORETA imaging with 64-channel EEG and individual MRI

BACKGROUND

We investigated the electrophysiological correlates of object-repetition effects using an object categorization task, standardized low-resolution electromagnetic tomography (sLORETA), and individual magnetic resonance imaging. Sixteen healthy adults participated, and a total of 396 line drawings of living and non-living objects were used as stimuli. Of these stimuli, 274 were presented only once, and 122 were repeated after one to five intervening pictures. Participants were asked to categorize the objects as living or non-living things by pressing one of two buttons.

RESULTS

The old/new effect (i.e., a faster response time and more positive potentials in response to repeated stimuli than to stimuli initially presented) was observed at 350-550 ms post-stimulus. The distributions of cortical sources for the old and new stimuli were very similar at 250-650 ms after stimulus-onset. Activation in the right middle occipital gyrus/cuneus, right fusiform gyrus, left superior temporal gyrus, and right inferior frontal gyrus was significantly reduced in response to old compared with new stimuli at 250-350, 350-450, 450-550, and 550-650 ms after stimulus-onset, respectively. Priming in response time was correlated with the electrophysiological priming at left parietal area and repetition suppression at left superior temporal gyrus in 450-550 ms.

CONCLUSIONS

These results suggest processing of repeated objects is facilitated by sharpening perceptual representation and by efficient detection or attentional control of repeated objects.

Stimulus-classification traces are dominant in response learning

Priming can reflect the stimulus-driven retrieval of output-related memory traces, commonly referred to as stimulus-response associations. The purpose of the current study was to investigate which aspects of the output exactly are preserved in these traces using electroencephalography (EEG). We orthogonally manipulated the repetition of action and classification whilst participants performed one of the two semantic tasks according to the cue. We found no evidence of stimulus-action associations but significant effects relevant to the retrieval of stimulus-classification associations in participants' accuracy and RT. Event-related potential (ERP) and oscillatory analysis further revealed a classification-related modulation at around 200 ms after stimulus onset, which appeared much earlier than the one reported in previous studies. These classification effects possibly indicate the modification of memory traces which requires the dynamic interaction of temporal and frontal cortices. The finding of classification effects across behavioural and EEG data suggested that the formation of stimulus-classification traces is rather spontaneous and may be dominant in single trial stimulus-response binding.

Electrophysiological potentials reveal cortical mechanisms for mental imagery, mental simulation, and grounded (embodied) cognition

Grounded cognition theory proposes that cognition, including meaning, is grounded in sensorimotor processing. The mechanism for grounding cognition is mental simulation, which is a type of mental imagery that re-enacts modal processing. To reveal top-down, cortical mechanisms for mental simulation of shape, event-related potentials were recorded to face and object pictures preceded by mental imagery. Mental imagery of the identical face or object picture (congruous condition) facilitated not only categorical perception (VPP/N170) but also later visual knowledge [N3(00) complex] and linguistic knowledge (N400) for faces more than objects, and strategic semantic analysis (late positive complex) between 200 and 700 ms. The later effects resembled semantic congruity effects with pictures. Mental imagery also facilitated category decisions, as a P3 peaked earlier for congruous than incongruous (other category) pictures, resembling the case when identical pictures repeat immediately. Thus mental imagery mimics semantic congruity and immediate repetition priming processes with pictures. Perception control results showed the opposite for faces and were in the same direction for objects: Perceptual repetition adapts (and so impairs) processing of perceived faces from categorical perception onward, but primes processing of objects during categorical perception, visual knowledge processes, and strategic semantic analysis. For both imagery and perception, differences between faces and objects support domain-specificity and indicate that cognition is grounded in modal processing. Altogether, this direct neural evidence reveals that top-down processes of mental imagery sustain an imagistic representation that mimics perception well enough to prime subsequent perception and cognition. Findings also suggest that automatic mental simulation of the visual shape of faces and objects operates between 200 and 400 ms, and strategic mental simulation operates between 400 and 700 ms.

Electrophysiological correlates of object location and object identity processing in spatial scenes

The ability to quickly detect changes in our surroundings has been crucial to human adaption and survival. In everyday life we often need to identify whether an object is new and if an object has changed its location. In the current event-related potential (ERP) study we investigated the electrophysiological correlates and the time course in detecting different types of changes of an objecṫs location and identity. In a delayed match-to-sample task participants had to indicate whether two consecutive scenes containing a road, a house, and two objects, were either the same or different. In six randomly intermixed conditions the second scene was identical, one of the objects had changed its identity, one of the objects had changed its location, or the objects had switched locations. The results reveal different time courses for the processing of identity and location changes in spatial scenes. Whereas location changes elicited a posterior N2 effect, indicating early mismatch detection, followed by a P3 effect reflecting post-perceptual processing, identity changes elicited an anterior N3 effect, which was delayed and functionally distinct from the N2 effect found for the location changes. The condition in which two objects switched position elicited a late ERP effect, reflected by a P3 effect similar to that obtained for the location changes. In sum, this study is the first to cohesively show different time courses for the processing of location changes, identity changes, and object switches in spatial scenes, which manifest themselves in different electrophysiological correlates.