A large N400 but no BOLD effect--comparing source activations of semantic priming in simultaneous EEG-fMRI

Single-neuron mechanisms of neural adaptation in the human temporal lobe

A central function of the human brain is to adapt to new situations based on past experience. Adaptation is reflected behaviorally by shorter reaction times to repeating or similar stimuli, and neurophysiologically by reduced neural activity in bulk-tissue measurements with fMRI or EEG. Several potential single-neuron mechanisms have been hypothesized to cause this reduction of activity at the macroscopic level. We here explore these mechanisms using an adaptation paradigm with visual stimuli bearing abstract semantic similarity. We recorded intracranial EEG (iEEG) simultaneously with spiking activity of single neurons in the medial temporal lobes of 25 neurosurgical patients. Recording from 4917 single neurons, we demonstrate that reduced event-related potentials in the macroscopic iEEG signal are associated with a sharpening of single-neuron tuning curves in the amygdala, but with an overall reduction of single-neuron activity in the hippocampus, entorhinal cortex, and parahippocampal cortex, consistent with fatiguing in these areas.

Predictive coding across the left fronto-temporal hierarchy during language comprehension

We used magnetoencephalography (MEG) and event-related potentials (ERPs) to track the time-course and localization of evoked activity produced by expected, unexpected plausible, and implausible words during incremental language comprehension. We suggest that the full pattern of results can be explained within a hierarchical predictive coding framework in which increased evoked activity reflects the activation of residual information that was not already represented at a given level of the fronto-temporal hierarchy ("error" activity). Between 300 and 500 ms, the three conditions produced progressively larger responses within left temporal cortex (lexico-semantic prediction error), whereas implausible inputs produced a selectively enhanced response within inferior frontal cortex (prediction error at the level of the event model). Between 600 and 1,000 ms, unexpected plausible words activated left inferior frontal and middle temporal cortices (feedback activity that produced top-down error), whereas highly implausible inputs activated left inferior frontal cortex, posterior fusiform (unsuppressed orthographic prediction error/reprocessing), and medial temporal cortex (possibly supporting new learning). Therefore, predictive coding may provide a unifying theory that links language comprehension to other domains of cognition.

Multiple functions of the angular gyrus at high temporal resolution

Here, the functions of the angular gyrus (AG) are evaluated in the light of current evidence from transcranial magnetic/electric stimulation (TMS/TES) and EEG/MEG studies. 65 TMS/TES and 52 EEG/MEG studies were examined in this review. TMS/TES literature points to a causal role in semantic processing, word and number processing, attention and visual search, self-guided movement, memory, and self-processing. EEG/MEG studies reported AG effects at latencies varying between 32 and 800 ms in a wide range of domains, with a high probability to detect an effect at 300-350 ms post-stimulus onset. A three-phase unifying model revolving around the process of sensemaking is then suggested: (1) early AG involvement in defining the current context, within the first 200 ms, with a bias toward the right hemisphere; (2) attention re-orientation and retrieval of relevant information within 200-500 ms; and (3) cross-modal integration at late latencies with a bias toward the left hemisphere. This sensemaking process can favour accuracy (e.g. for word and number processing) or plausibility (e.g. for comprehension and social cognition). Such functions of the AG depend on the status of other connected regions. The much-debated semantic role is also discussed as follows: (1) there is a strong TMS/TES evidence for a causal semantic role, (2) current EEG/MEG evidence is however weak, but (3) the existing arguments against a semantic role for the AG are not strong. Some outstanding questions for future research are proposed. This review recognizes that cracking the role(s) of the AG in cognition is possible only when its exact contributions within the default mode network are teased apart.

Aging-Related Dissociation of Spatial and Temporal N400 in Sentence-Level Semantic Processing: Evidence From Source Analyses

Age-related differences in sentence-level lexical-semantic processes have been extensively studied, based on the N400 component of event-related potential (ERP). However, there is still a lack of understanding in this regard at the brain-region level. This study explores aging effects on sentence-level semantic processing by comparing the characteristics of the N400 ERP component and brain engagement patterns within individual N400 time windows for two age groups (16 younger adults aged 24.38 ± 3.88 years and 15 older adults aged 67.00 ± 5.04 years) during sentence processing with different plausibility conditions. Our results demonstrated that the N400 effect according to the plausibility condition occurred in different temporal windows in the two age groups, with a delay in the older group. Moreover, it was identified that there was a distinct difference between the groups in terms of the source location of the condition-dependent N400 effect even though no significant difference was derived in its magnitude itself at the sensor-level. Interestingly, the source analysis results indicated that the two groups involved different functional networks to resolve the same semantic violations: the younger group activated the regions corresponding to the typical lexical-semantic network more, whereas the older group recruited the regions belonging to the multiple-demand network more. The findings of this study could be used as a basis for understanding the aging brain in a linguistic context.

Using electrophysiological correlates of early semantic priming to test models of reading aloud

The speed at which semantics is accessed by words with consistent (simple) and inconsistent (difficult) spelling–sound correspondences can be used to test predictions of models of reading aloud. Dual-route models that use a word-form lexicon predict consistent words may access semantics before inconsistent words. The Triangle model, alternatively, uses only a semantic system and no lexicons. It predicts inconsistent words may access semantics before consistent words, at least for some readers. We tested this by examining event-related potentials in a semantic priming task using consistent and inconsistent target words with either unrelated/related or unrelated/nonword primes. The unrelated/related primes elicited an early effect of priming on the N1 with consistent words. This result supports dual-route models but not the Triangle model. Correlations between the size of early priming effects between the two prime groups with inconsistent words were also very weak, suggesting early semantic effects with inconsistent words were not predictable by individual differences. Alternatively, there was a moderate strength correlation between the size of the priming effect with consistent and inconsistent words in the related/unrelated prime group on the N400. This offers a possible locus of individual differences in semantic processing that has not been previously reported.

Connecting and considering: Electrophysiology provides insights into comprehension

The ability to rapidly and systematically access knowledge stored in long-term memory in response to incoming sensory information-that is, to derive meaning from the world-lies at the core of human cognition. Research using methods that can precisely track brain activity over time has begun to reveal the multiple cognitive and neural mechanisms that make this possible. In this article, I delineate how a process of connecting affords an effortless, continuous infusion of meaning into human perception. In a relatively invariant time window, uncovered through studies using the N400 component of the event-related potential, incoming sensory information naturally induces a graded landscape of activation across long-term semantic memory, creating what might be called "proto-concepts". Connecting can be (but is not always) followed by a process of further considering those activations, wherein a set of more attentionally demanding "active comprehension" mechanisms mediate the selection, augmentation, and transformation of the initial semantic representations. The result is a limited set of more stable bindings that can be arranged in time or space, revised as needed, and brought to awareness. With this research, we are coming closer to understanding how the human brain is able to fluidly link sensation to experience, to appreciate language sequences and event structures, and, sometimes, to even predict what might be coming up next.

No fruits without color: Cross-modal priming and EEG reveal different roles for different features across semantic categories

Category-specific impairments witnessed in patients with semantic deficits have broadly dissociated into natural and artificial kinds. However, how the category of food (more specifically, fruits and vegetables) fits into this distinction has been difficult to interpret, given a pattern of deficit that has inconsistently mapped onto either kind, despite its intuitive membership to the natural domain. The present study explores the effects of a manipulation of a visual sensory (i.e., color) or functional (i.e., orientation) feature on the consequential semantic processing of fruits and vegetables (and tools, by comparison), first at the behavioral and then at the neural level. The categorization of natural (i.e., fruits/vegetables) and artificial (i.e., utensils) entities was investigated via cross-modal priming. Reaction time analysis indicated a reduction in priming for color-modified natural entities and orientation-modified artificial entities. Standard event-related potentials (ERP) analysis was performed, in addition to linear classification. For natural entities, a N400 effect at central channel sites was observed for the color-modified condition compared relative to normal and orientation conditions, with this difference confirmed by classification analysis. Conversely, there was no significant difference between conditions for the artificial category in either analysis. These findings provide strong evidence that color is an integral property to the categorization of fruits/vegetables, thus substantiating the claim that feature-based processing guides as a function of semantic category.

The role of the corpus callosum in language network connectivity in children

The specific role of the corpus callosum (CC) in language network organization remains unclear, two contrasting models have been proposed: inhibition of homotopic areas allowing for independent functioning of the hemispheres versus integration of information from both hemispheres. This study aimed to add to this discussion with the first investigation of language network connectivity in combination with CC volume measures. In 38 healthy children aged 6–12, we performed task‐based functional magnetic resonance imaging to measure language network connectivity, used structural magnetic resonance imaging to quantify CC subsection volumes, and administered various language tests to examine language abilities. We found an increase in left intrahemispheric and bilateral language network connectivity and a decrease in right intrahemispheric connectivity associated with larger volumes of the posterior, mid‐posterior, and central subsections of the CC. Consistent with that, larger volumes of the posterior parts of the CC were significantly associated with better verbal fluency and vocabulary, the anterior CC volume was positively correlated with verbal span. Thus, children with larger volumes of CC subsections showed increased interhemispheric language network connectivity and were better in different language domains. This study presents the first evidence that the CC is directly linked to language network connectivity and underlines the excitatory role of the CC in the integration of information from both hemispheres.

Non-invasive inference of information flow using diffusion MRI, functional MRI, and MEG

OBJECTIVE

To infer information flow in the white matter of the brain and recover cortical activity using functional MRI, diffusion MRI, and MEG without a manual selection of the white matter connections of interest.

APPROACH

A Bayesian network which encodes the priors knowledge of possible brain states is built from imaging data. Diffusion MRI is used to enumerate all possible connections between cortical regions. Functional MRI is used to prune connections without manual intervention and increase the likelihood of specific regions being active. MEG data is used as evidence into this network to obtain a posterior distribution on cortical regions and connections.

MAIN RESULTS

We show that our proposed method is able to identify connections associated with the a sensory-motor task. This allows us to build the Bayesian network with no manual selection of connections of interest. Using sensory-motor MEG evoked response as evidence into this network, our method identified areas known to be involved in a visuomotor task. In addition, information flow along white matter fiber bundles connecting those regions was also recovered.

SIGNIFICANCE

Current methods to estimate white matter information flow are extremely invasive, therefore limiting our understanding of the interaction between cortical regions. The proposed method makes use of functional MRI, diffusion MRI, and M/EEG to infer communication between cortical regions, therefore opening the door to the non-invasive exploration of information flow in the white matter.

Spatiotemporal and spectral dynamics of multi-item working memory as revealed by the n-back task using MEG

Multi‐item working memory (WM) is a complex cognitive function thought to arise from specific frequency band oscillations and their interactions. While some theories and consistent findings have been established, there is still a lot of unclarity about the sources, temporal dynamics, and roles of event‐related fields (ERFs) and theta, alpha, and beta oscillations during WM activity. In this study, we performed an extensive whole‐brain ERF and time‐frequency analysis on n‐back magnetoencephalography data from 38 healthy controls. We identified the previously unknown sources of the n‐back M300, the right inferior temporal and parahippocampal gyrus and left inferior temporal gyrus, and frontal theta power increase, the orbitofrontal cortex. We shed new light on the role of the precuneus during n‐back activity, based on an early ERF and theta power increase, and suggest it to be a crucial link between lower‐level and higher‐level information processing. In addition, we provide strong evidence for the central role of the hippocampus in multi‐item WM behavior through the dynamics of theta and alpha oscillatory changes. Almost simultaneous alpha power decreases observed in the hippocampus and occipital fusiform gyri, regions known to be involved in letter processing, suggest that these regions together enable letter recognition, encoding and storage in WM. In summary, this study offers an extensive investigation into the spatial, temporal, and spectral characteristics of n‐back multi‐item WM activity.

Cracking the Black Box: Capturing the Role of Expectation States in Status Processes

A fundamental task for sociology is to uncover the mechanisms that produce and reproduce social inequalities. While status characteristics theory is the favored account of how social status contributes independently to the maintenance of inequality, it hinges on an unobserved construct, expectation states, in the middle of the causal chain between status and behavior. Efforts to test the mediation mechanism have been complicated by the implicit, often unconscious, nature of status expectations. To solve this “black box” problem, we offer a new conceptualization and research approach that capitalizes on the accuracy and precision of neurological measurement to shed new light on the biasing role of expectations in the status–behavior relationship. Results from an experimental study provide a unique illustration of ways in which social status is inscribed in the brain and how, in turn, these inscriptions are related to behavioral inequalities that emerge during interaction.

Simultaneous fMRI-EEG-DTI recording of MMN in patients with schizophrenia

Functional magnetic resonance imaging (fMRI), electroencephalogram (EEG), and diffusion tensor imaging (DTI) recording have complementary spatiotemporal resolution limitations but can be powerful methods when used together to enable both functional and anatomical modeling, with each neuroimaging procedure used to maximum advantage. We recorded EEGs during event-related fMRI followed by DTI in 15 healthy volunteers and 12 patients with schizophrenia using an omission mismatch negativity (MMN) paradigm. Blood oxygenation level-dependent (BOLD) signal changes were calculated in a region of interest (ROI) analysis, and fractional anisotropy (FA) in the white matter fibers related to each area was compared between groups using tract-specific analysis. Patients with schizophrenia had reduced BOLD activity in the left middle temporal gyrus, and BOLD activity in the right insula and right parahippocampal gyrus significantly correlated with positive symptoms on the Positive and Negative Syndrome Scale (PANSS) and hostility subscores. BOLD activation of Heschl’s gyri also correlated with the limbic system, including the insula. FA values in the left anterior cingulate cortex (ACC) significantly correlated with changes in the BOLD signal in the right superior temporal gyrus (STG), and FA values in the right ACC significantly correlated with PANSS scores. This is the first study to examine MMN using simultaneous fMRI, EEG, and DTI recording in patients with schizophrenia to investigate the potential implications of abnormalities in the ACC and limbic system, including the insula and parahippocampal gyrus, as well as the STG. Structural changes in the ACC during schizophrenia may represent part of the neural basis for the observed MMN deficits. The deficits seen in the feedback/feedforward connections between the prefrontal cortex and STG modulated by the ACC and insula may specifically contribute to impaired MMN generation and clinical manifestations.

Steady-state evoked potentials distinguish brain mechanisms of self-paced versus synchronization finger tapping

Sensorimotor synchronization (SMS) requires aligning motor actions to external events and represents a core part of both musical and dance performances. In the current study, to isolate the brain mechanisms involved in synchronizing finger tapping with a musical beat, we compared SMS to pure self-paced finger tapping and listen-only conditions at different tempi. We analyzed EEG data using frequency domain steady-state evoked potentials (SSEPs) to identify sustained electrophysiological brain activity during repetitive tasks. Behavioral results revealed different timing modes between SMS and self-paced finger tapping, associated with distinct scalp topographies, thus suggesting different underlying brain sources. After subtraction of the listen-only brain activity, SMS was compared to self-paced finger tapping. Resulting source estimations showed stronger activation of the left inferior frontal gyrus during SMS, and stronger activation of the bilateral inferior parietal lobule during self-paced finger tapping. These results point to the left inferior frontal gyrus as a pivot for perception-action coupling. We discuss our findings in the context of the ongoing debate about SSEPs interpretation given the variety of brain events contributing to SSEPs and similar EEG frequency responses.

Spoken words are processed during dexmedetomidine-induced unresponsiveness

BACKGROUND

Studying the effects of anaesthetic drugs on the processing of semantic stimuli could yield insights into how brain functions change in the transition from wakefulness to unresponsiveness. Here, we explored the N400 event-related potential during dexmedetomidine- and propofol-induced unresponsiveness.

METHODS

Forty-seven healthy subjects were randomised to receive either dexmedetomidine (n=23) or propofol (n=24) in this open-label parallel-group study. Loss of responsiveness was achieved by stepwise increments of pseudo-steady-state plasma concentrations, and presumed loss of consciousness was induced using 1.5 times the concentration required for loss of responsiveness. Pre-recorded spoken sentences ending either with an expected (congruous) or an unexpected (incongruous) word were presented during unresponsiveness. The resulting electroencephalogram data were analysed for the presence of the N400 component, and for the N400 effect defined as the difference between the N400 components elicited by congruous and incongruous stimuli, in the time window 300-600 ms post-stimulus. Recognition of the presented stimuli was tested after recovery of responsiveness.

RESULTS

The N400 effect was not observed during dexmedetomidine- or propofol-induced unresponsiveness. The N400 component, however, persisted during dexmedetomidine administration. The N400 component elicited by congruous stimuli during unresponsiveness in the dexmedetomidine group resembled the large component evoked by incongruous stimuli at the awake baseline. After recovery, no recognition of the stimuli heard during unresponsiveness occurred.

CONCLUSIONS

Dexmedetomidine and propofol disrupt the discrimination of congruous and incongruous spoken sentences, and recognition memory at loss of responsiveness. However, the processing of words is partially preserved during dexmedetomidine-induced unresponsiveness.

CLINICAL TRIAL REGISTRATION

NCT01889004.

Electrical Neuroimaging of Music Processing Reveals Mid-Latency Changes with Level of Musical Expertise

This original research focused on the effect of musical training intensity on cerebral and behavioral processing of complex music using high-density event-related potential (ERP) approaches. Recently we have been able to show progressive changes with training in gray and white matter, and higher order brain functioning using (f)MRI [(functional) Magnetic Resonance Imaging], as well as changes in musical and general cognitive functioning. The current study investigated the same population of non-musicians, amateur pianists and expert pianists using spatio-temporal ERP analysis, by means of microstate analysis, and ERP source imaging. The stimuli consisted of complex musical compositions containing three levels of transgression of musical syntax at closure that participants appraised. ERP waveforms, microstates and underlying brain sources revealed gradual differences according to musical expertise in a 300–500 ms window after the onset of the terminal chords of the pieces. Within this time-window, processing seemed to concern context-based memory updating, indicated by a P3b-like component or microstate for which underlying sources were localized in the right middle temporal gyrus, anterior cingulate and right parahippocampal areas. Given that the 3 expertise groups were carefully matched for demographic factors, these results provide evidence of the progressive impact of training on brain and behavior.

Single-Neuron Correlates of Conscious Perception in the Human Medial Temporal Lobe

The neuronal mechanisms giving rise to conscious perception remain largely elusive [1]. It is known that the strength of single-neuron activity correlates with conscious perception, especially in anterior regions of the ventral pathway in non-human primates [2-4] and in the human medial temporal lobe (MTL) [5, 6]. It is unclear, however, whether single-neuron correlates of conscious perception are characterized solely by the magnitude of neuronal responses, and whether the correlates of perception are equally prominent across different regions of the human MTL. While recording from 2,735 neurons in 21 neurosurgical patients during 40 experimental sessions, we created experimental conditions in which otherwise identical visual stimuli are sometimes seen and sometimes not detected at all by means of the attentional blink, i.e., the phenomenon that the second of two target stimuli in close succession often goes unnoticed to conscious perception [7]. Remarkably, responses to unseen versus seen stimuli were delayed and temporally more dispersed, in addition to being attenuated in firing rate. This finding suggests precise timing of neuronal responses as a novel candidate physiological marker of conscious perception. In addition, we found modulation of neuronal response timing and strength in response to seen versus unseen stimuli to increase along an anatomical gradient from the posterior to the anterior MTL. Our results thus map out the neuronal correlates of conscious perception in the human MTL both in time and in space.

Functional near infra-red spectroscopy (fNIRS) in schizophrenia: A review

The research on the alterations in functional connectivity in schizophrenia has been facilitated by development of an array of functional neuroimaging techniques. Functional Near Infra Red Spectroscopy (fNIRS) is a novel diffuse optical neuromonitring method with its own advantages and limitations. The advantages of fNIRS have made it to be frequently used as a research tool by medical community in different settings. In fNIRS the property of haemoglobin to absorb near infrared light is used to measure brain activity. It provides the indirect measurement of the neuronal activity in the areas of interest. The advantage of fNIRS being less restrictive has made it to be used more commonly in the research of psychiatric disorders in general, schizophrenia in particular. The fNIRS studies on patients with schizophrenia have shown haemodynamic hypo activation primarily in the prefrontal cortex during various cognitive tasks. In this review, initially we have briefly explained the basic principles of fNIRS followed by detailed review of fNIRS findings in patients with schizophrenia.

Simultaneous resting-state functional MRI and electroencephalography recordings of functional connectivity in patients with schizophrenia

AIM

It remains unclear how functional connectivity (FC) may be related to specific cognitive domains in neuropsychiatric disorders. Here we used simultaneous resting-state functional magnetic resonance imaging (rsfMRI) and electroencephalography (EEG) recording in patients with schizophrenia, to evaluate FC within and outside the default mode network (DMN).

METHODS

Our study population included 14 patients with schizophrenia and 15 healthy control participants. From all participants, we acquired rsfMRI data, and simultaneously recorded EEG data using an MR-compatible amplifier. We analyzed the rsfMRI-EEG data, and used the CONN toolbox to calculate the FC between regions of interest. We also performed between-group comparisons of standardized low-resolution electromagnetic tomography-based intracortical lagged coherence for each EEG frequency band.

RESULTS

FC within the DMN, as measured by rsfMRI and EEG, did not significantly differ between groups. Analysis of rsfMRI data showed that FC between the right posterior inferior temporal gyrus and medial prefrontal cortex was stronger among patients with schizophrenia compared to control participants.

CONCLUSION

Analysis of FC within the DMN using rsfMRI and EEG data revealed no significant differences between patients with schizophrenia and control participants. However, rsfMRI data revealed over-modulated FC between the medial prefrontal cortex and right posterior inferior temporal gyrus in patients with schizophrenia compared to control participants, suggesting that the patients had altered FC, with higher correlations across nodes within and outside of the DMN. Further studies using simultaneous rsfMRI and EEG are required to determine whether altered FC within the DMN is associated with schizophrenia.

Presupplementary Motor Area Contributes to Altered Error Monitoring in Obsessive-Compulsive Disorder

BACKGROUND

Hyperactive performance monitoring, as measured by the error-related negativity (ERN) in the event-related potential, is a reliable finding in obsessive-compulsive disorder (OCD) research and may be an endophenotype of the disorder. Imaging studies revealed inconsistent results as to which brain regions are involved in altered performance monitoring in OCD. We investigated performance monitoring in OCD with simultaneous recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) signals to determine the neural source of the enhanced ERN.

METHODS

Concurrent EEG and fMRI data were collected from 20 patients with OCD and 22 healthy control subjects during a flanker task. Independent component analysis was used separately on EEG and fMRI to segment the data functionally and focus on processes of interest. The ERN, hemodynamic responses following errors, and intraindividual correlation of the ERN and blood oxygen level-dependent activity were compared between groups.

RESULTS

Patients with OCD showed significantly increased ERN amplitudes. Blood oxygen level-dependent activity in midcingulate cortex was not significantly different between groups. Increased activation of the right amygdala and the subgenual anterior cingulate cortex following errors was observed in patients with OCD. Increased intraindividual correlation of the ERN and activity of the presupplementary motor area was found in patients with OCD compared with healthy controls.

CONCLUSIONS

Higher error-related activity was found in the amygdala and subgenual anterior cingulate cortex, suggesting a stronger affective response toward errors in patients with OCD. Additionally, increased correlation of the ERN and presupplementary motor area may indicate stronger recruitment of proactive control in OCD.

The 'when' and 'where' of semantic coding in the anterior temporal lobe: Temporal representational similarity analysis of electrocorticogram data

Electrocorticograms (ECoG) provide a unique opportunity to monitor neural activity directly at the cortical surface. Ten patients with subdural electrodes covering ventral and lateral anterior temporal regions (ATL) performed a picture naming task. Temporal representational similarity analysis (RSA) was used, for the first time, to compare spatio-temporal neural patterns from the ATL surface with pre-defined theoretical models. The results indicate that the neural activity in the ventral subregion of the ATL codes semantic representations from 250 msec after picture onset. The observed activation similarity was not related to the visual similarity of the pictures or the phonological similarity of their names. In keeping with convergent evidence for the importance of the ATL in semantic processing, these results provide the first direct evidence of semantic coding from the surface of the ventral ATL and its time-course.

Song Perception by Professional Singers and Actors: An MEG Study

The cortical correlates of speech and music perception are essentially overlapping, and the specific effects of different types of training on these networks remain unknown. We compared two groups of vocally trained professionals for music and speech, singers and actors, using recited and sung rhyme sequences from German art songs with semantic and/ or prosodic/melodic violations (i.e. violations of pitch) of the last word, in order to measure the evoked activation in a magnetoencephalographic (MEG) experiment. MEG data confirmed the existence of intertwined networks for the sung and spoken modality in an early time window after word violation. In essence for this early response, higher activity was measured after melodic/prosodic than semantic violations in predominantly right temporal areas. For singers as well as for actors, modality-specific effects were evident in predominantly left-temporal lateralized activity after semantic expectancy violations in the spoken modality, and right-dominant temporal activity in response to melodic violations in the sung modality. As an indication of a special group-dependent audiation process, higher neuronal activity for singers appeared in a late time window in right temporal and left parietal areas, both after the recited and the sung sequences.

Semantic Relations between Visual Objects Can Be Unconsciously Processed but Not Reported under Change Blindness

Change blindness—the failure to detect changes in visual scenes—has often been interpreted as a result of impoverished visual information encoding or as a failure to compare the prechange and postchange scene. In the present electroencephalography study, we investigated whether semantic features of prechange and postchange information are processed unconsciously, even when observers are unaware that a change has occurred. We presented scenes composed of natural objects in which one object changed from one presentation to the next. Object changes were either semantically related (e.g., rail car changed to rail) or unrelated (e.g., rail car changed to sausage). Observers were first asked to detect whether any change had occurred and then to judge the semantic relation of the two objects involved in the change. We found a semantic mismatch ERP effect, that is, a more negative-going ERP for semantically unrelated compared to related changes, originating from a cortical network including the left middle temporal gyrus and occipital cortex and resembling the N400 effect, albeit at longer latencies. Importantly, this semantic mismatch effect persisted even when observers were unaware of the change and the semantic relationship of prechange and postchange object. This finding implies that change blindness does not preclude the encoding of the prechange and postchange objects' identities and possibly even the comparison of their semantic content. Thus, change blindness cannot be interpreted as resulting from impoverished or volatile visual representations or as a failure to process the prechange and postchange object. Instead, change detection appears to be limited at a later, postperceptual stage.

Behavioural and electrophysiological effects related to semantic violations during braille reading

This study investigated the potential to detect event related potentials (ERPs) occurring in response to a specific task in braille reading. This would expand current methodologies for studying the cognitive processes underlying braille reading. An N400 effect paradigm was utilised, whereby proficient blind braille readers read congruent- and incongruent-ending braille sentences. Kinematic and electroencephalography (EEG) data were obtained simultaneously and synchronised. The ERPs differed between the incongruent and congruent sentences in a manner consistent with the N400 effect found with a previous sighted reading paradigm, demonstrating that ERPs can be obtained during braille reading. The frequency of finger reversals and the degree of intermittency in the finger velocity were significantly higher when reading incongruent versus congruent sentence endings. Both reversals and the potential N400 effect may reflect processes involved in semantic unification. These findings have significant implications for the modelling of braille reading. The refinement of the technique will enable other ERPs to be identified and related to behavioural responses, to further our understanding of the braille reading process.

Haemodynamic and electrophysiological markers of pragmatic language comprehension in schizophrenia

OBJECTIVES

The present study aimed at investigating neurophysiological markers of language perception in schizophrenia using simultaneous near-infrared spectroscopy (NIRS) and event-related potentials (ERPs), which have been proven to be useful for studying language processing abilities in psychiatric patients. The study shall help to integrate previous findings from ERP and fMRI studies on figurative language comprehension in schizophrenia and elucidate how electrophysiological and haemodynamic markers of language processing are related.

METHODS

Twenty-two healthy subjects and 22 schizophrenia patients judged 120 sentences regarding their meaningfulness. Phrases were literal, metaphoric, or meaningless. EEG-fNIRS signals were recorded throughout the entire experiment.

RESULTS

Schizophrenia patients showed deficient and delayed sentence comprehension. Both the early N400 and left-hemispheric activation during language comprehension were altered in patients. Correlation analyses showed that metaphor-related ERPs were strongly linked to haemodynamic cortical activity in healthy subjects, but not in patients.

CONCLUSIONS

Our results indicate group differences in cortical electrophysiological and haemodynamic activation that represent rather general impairments in the processing of complex language. Simultaneous EEG/NIRS applications are useful to depict these neural markers and to investigate their relationship. Future studies are needed to clarify the nature of respective anomalies and their potential as putative neural markers in schizophrenia research.

Early and Late Electrophysiological Effects of Distractor Frequency in Picture Naming: Reconciling Input and Output Accounts

The "distractor-frequency effect" refers to the finding that high-frequency (HF) distractor words slow picture naming less than low-frequency distractors in the picture-word interference paradigm. Rival input and output accounts of this effect have been proposed. The former attributes the effect to attentional selection mechanisms operating during distractor recognition, whereas the latter attributes it to monitoring/decision mechanisms operating on distractor and target responses in an articulatory buffer. Using high-density (128-channel) EEG, we tested hypotheses from these rival accounts. In addition to conducting stimulus- and response-locked whole-brain corrected analyses, we investigated the correct-related negativity, an ERP observed on correct trials at fronto-central electrodes proposed to reflect the involvement of domain general monitoring. The whole-brain ERP analysis revealed a significant effect of distractor frequency at inferior right frontal and temporal sites between 100 and 300-msec post-stimulus onset, during which lexical access is thought to occur. Response-locked, region of interest (ROI) analyses of fronto-central electrodes revealed a correct-related negativity starting 121 msec before and peaking 125 msec after vocal onset on the grand averages. Slope analysis of this component revealed a significant difference between HF and low-frequency distractor words, with the former associated with a steeper slope on the time window spanning from 100 msec before to 100 msec after vocal onset. The finding of ERP effects in time windows and components corresponding to both lexical processing and monitoring suggests the distractor frequency effect is most likely associated with more than one physiological mechanism.

A saw is first identified as an object used on wood: ERP evidence for temporal differences between Thematic and Functional similarity relations

The role of functional and motor information in manipulable artifact object semantic organization is still poorly understood. In particular, several types of semantic relations involving object functional knowledge may be distinguished. Functional similarity relations group objects with similar functions at relatively specific (e.g. saw-axe, both used to cut wood) or general (saw-knife, both used to cut) levels. Thematic relations group objects based on their complementarity in events (saw used upon/with wood). Recent eye-tracking data showed distinct temporal time courses for the different semantic relations, with fastest processing of thematic relations and slowest processing of general function similarity relations. Behavioral data suggest the involvement of distinct cognitive mechanisms in manipulable artifact object semantic processing. The aim of the present study was to assess the neural correlates of thematic, and specific and general function similarity relation processing. Specifically, we investigated whether time course differences between semantic relations could be highlighted at the neurophysiological level. We used a protocol combining semantic priming with electroencephalography, and manipulated the type of semantic relation and the duration of the interval between prime and target objects. Two consistent and complementary results were shown. On N1 and P3 components, semantic priming was observed for thematic relations only. On N400 component, the type of semantic relation interacted with interval duration, and semantic priming was visible for all 3 relations after the longest interval only. Results revealed graded processing time courses for thematic, specific function similarity, and general function similarity relations at the neural level, and further indicate that thematic relations impact object processing during the early stages of object recognition. Findings suggest a hierarchical organization of three types of semantic relations based on functional knowledge. The parallel between semantic relations involving manipulable artifact objects and levels of action representations is discussed.

How to use fMRI functional localizers to improve EEG/MEG source estimation

EEG and MEG have excellent temporal resolution, but the estimation of the neural sources that generate the signals recorded by the sensors is a difficult, ill-posed problem. The high spatial resolution of functional MRI makes it an ideal tool to improve the localization of the EEG/MEG sources using data fusion. However, the combination of the two techniques remains challenging, as the neural generators of the EEG/MEG and BOLD signals might in some cases be very different. Here we describe a data fusion approach that was developed by our team over the last decade in which fMRI is used to provide source constraints that are based on functional areas defined individually for each subject. This mini-review describes the different steps that are necessary to perform source estimation using this approach. It also provides a list of pitfalls that should be avoided when doing fMRI-informed EEG/MEG source imaging. Finally, it describes the advantages of using a ROI-based approach for group-level analysis and for the study of sensory systems.