An improved method for measuring mismatch negativity using ensemble empirical mode decomposition

Exploring the impact of tonal inventory on speech perception across languages: a study of MMN responses in tonal language speakers

Previous research on the perception of segmental features of languages has established a correlation between the phoneme inventory of a language and its speakers' perceptual abilities, as indexed by discrimination tasks and Mismatch Negativity (MMN). Building on this background, the current study elucidated the relationship between perceptual ability and tonal inventory by utilizing two tonal languages. Two groups of participants were included in the present experiment: Mandarin speakers and Hakka-Mandarin speakers. Onset latency analysis revealed a significant difference in the Mandarin syllable condition, with Hakka-Mandarin speakers demonstrating earlier MMN latency than Mandarin speakers. This suggests a more efficient auditory processing mechanism in Hakka-Mandarin speakers. Both groups, however, showed similar MMN latency in the Hakka syllable condition. The interaction between language background and syllable type indicates that other factors, such as syllable sonority, also influence MMN responses. These findings highlight the importance of considering multiple phonemic inventories and syllable characteristics in studies of tonal perception.

Spatial prediction modulates the rhythm of attentional sampling

Recent studies demonstrate that behavioral performance during visual spatial attention fluctuates at theta (4 to 8 Hz) and alpha (8 to 16 Hz) frequencies, linked to phase-amplitude coupling of neural oscillations within the visual and attentional system depending on task demands. To investigate the influence of prior spatial prediction, we employed an adaptive discrimination task with variable cue-target onset asynchronies (300 to 1,300 ms) and different cue validity (100% & 50%). We recorded electroencephalography concurrently and adopted adaptive electroencephalography data analytical methods, namely, Holo-Holo-Hilbert spectral analysis and Holo-Hilbert cross-frequency phase clustering. Our findings indicate that response precision for near-threshold Landolt rings fluctuates at the theta band (4 Hz) under certain predictions and at alpha & beta bands (15 & 19 Hz) with uncertain predictions. Furthermore, spatial prediction strengthens theta-alpha modulations at parietal-occipital areas, frontal theta/parietal-occipital alpha phase-amplitude coupling, and within frontal theta-alpha phase-amplitude coupling. Notably, during the pretarget period, beta-modulated gamma oscillations in parietal-occipital areas predict response precision under uncertain prediction, while frontal theta/parietal-occipital alpha phase-amplitude coupling predicts response precision in spatially certain conditions. In conclusion, our study highlights the critical role of spatial prediction in attentional sampling rhythms with both behavioral and electroencephalography evidence.

Reduction or enhancement? Repetition effects on early brain potentials during visual word recognition are frequency dependent

Most studies on word repetition have demonstrated that repeated stimuli yield reductions in brain activity. Despite the well-known repetition reduction effect, some literature reports repetition enhancements in electroencephalogram (EEG) activities. However, although studies of object and face recognition have consistently demonstrated both repetition reduction and enhancement effects, the results of repetition enhancement effects were not consistent in studies of visual word recognition. Therefore, the present study aimed to further investigate the repetition effect on the P200, an early event-related potential (ERP) component that indexes the coactivation of lexical candidates during visual word recognition. To achieve a high signal-to-noise ratio, EEG signals were decomposed into various modes by using the Hilbert-Huang transform. Results demonstrated a repetition enhancement effect on P200 activity in alpha-band oscillation and that lexicality and orthographic neighborhood size would influence the magnitude of the repetition enhancement effect on P200. These findings suggest that alpha activity during visual word recognition might reflect the coactivation of orthographically similar words in the early stages of lexical processing. Meantime, there were repetition reduction effects on ERP activities in theta-delta band oscillation, which might index that the lateral inhibition between lexical candidates would be omitted in repetition.

Neural correlates of understanding emotional words in late childhood

Prior studies involving adults have shown that words can elicit emotional processing, with emotion-label (e.g., happiness) and emotion-laden words (e.g., gift) having distinct processes. However, limited studies have explored the developmental changes in these processes in relation to emotional valence. To address this question, this exploratory study measured event-related potentials (ERPs) in 11-14-year-old children/adolescents (N = 25) and adults (N = 23) while performing an emotional categorization task. The stimuli used were two-character Chinese words, with factors for word type (emotion-label versus emotion-laden) and valence (positive versus negative). To confirm word emotionality, neutral words were also included and compared with all emotional words. The results showed that adults exhibited reduced N400 amplitudes to emotion-label words compared to emotion-laden ones in both positive and negative valence contexts. The differentiation was only sustained for negative valence in the late positive component (LPC). Similar scalp distributions of the effects of word type were found in children/adolescents; however, they exhibited a more prolonged processing of all emotional words than adults. These results suggest that the processing of emotion-label and emotion-laden words are distinct in late childhood, and this discrepancy varies with emotional valence and increasing age.

Speech comprehension in noisy environments: Evidence from the predictability effects on the N400 and LPC

Introduction

Speech comprehension involves context-based lexical predictions for efficient semantic integration. This study investigated how noise affects the predictability effect on event-related potentials (ERPs) such as the N400 and late positive component (LPC) in speech comprehension.

Methods

Twenty-seven listeners were asked to comprehend sentences in clear and noisy conditions (hereinafter referred to as "clear speech" and "noisy speech," respectively) that ended with a high-or low-predictability word during electroencephalogram (EEG) recordings.

Results

The study results regarding clear speech showed the predictability effect on the N400, wherein low-predictability words elicited a larger N400 amplitude than did high-predictability words in the centroparietal and frontocentral regions. Noisy speech showed a reduced and delayed predictability effect on the N400 in the centroparietal regions. Additionally, noisy speech showed a predictability effect on the LPC in the centroparietal regions.

Discussion

These findings suggest that listeners achieve comprehension outcomes through different neural mechanisms according to listening conditions. Noisy speech may be comprehended with a second-pass process that possibly functions to recover the phonological form of degraded speech through phonetic reanalysis or repair, thus compensating for decreased predictive efficiency.

Recording EEG in Cochlear Implant Users: Guidelines for Experimental Design and Data Analysis for Optimizing Signal Quality and Minimizing Artifacts

Cochlear implants (CI) are neural prostheses that can restore hearing in individuals with severe to profound hearing loss. Although CIs significantly improve quality of life, clinical outcomes are still highly variable. An important part of this variability is explained by the brain reorganization following cochlear implantation. Therefore, clinicians and researchers are seeking objective measurements to investigate post-implantation brain plasticity. Electroencephalography (EEG) is a promising technique because it is objective, non-invasive, and implant-compatible, but is nonetheless susceptible to massive artifacts generated by the prosthesis's electrical activity. CI artifacts can blur and distort brain responses; thus, it is crucial to develop reliable techniques to remove them from EEG recordings. Despite numerous artifact removal techniques used in previous studies, there is a paucity of documentation and consensus on the optimal EEG procedures to reduce these artifacts. Herein, and through a comprehensive review process, we provide a guideline for designing an EEG-CI experiment minimizing the effect of the artifact. We provide some technical guidance for recording an accurate neural response from CI users and discuss the current challenges in detecting and removing CI-induced artifacts from a recorded signal. The aim of this paper is also to provide recommendations to better appraise and report EEG-CI findings.

Multiscale Temporal Variations of Atmospheric Mercury Distinguished by the Hilbert-Huang Transform Analysis Reveals Multiple El Niño-Southern Oscillation Links

Atmospheric mercury (Hg) cycling is sensitive to climate-driven changes, but links with various teleconnections remain unestablished. Here, we revealed the El Niño-Southern Oscillation (ENSO) influence on gaseous elemental mercury (GEM) concentrations recorded at a background station in East Asia using the Hilbert-Huang transform (HHT). The timing and magnitude of GEM intrinsic variations were clearly distinguished by ensemble empirical mode decomposition (EEMD), revealing the amplitude of the GEM concentration interannual variability (IAV) is greater than that for diurnal and seasonal variability. We show that changes in the annual cycle of GEM were modulated by significant IAVs at time scales of 2-7 years, highlighted by a robust GEM IAV-ENSO relationship of the associated intrinsic mode functions. With confirmation that ENSO modulates the GEM annual cycle, we then found that weaker GEM annual cycles may have resulted from El Niño-accelerated Hg evasion from the ocean. Furthermore, the relationship between ENSO and GEM is sensitive to extreme events (i.e., 2015-2016 El Niño), resulting in perturbation of the long-term trend and atmospheric Hg cycling. Future climate change will likely increase the number of extreme El Niño events and, hence, could alter atmospheric Hg cycling and influence the effectiveness evaluation of the Minamata Convention on Mercury.

Deficits in Processing of Lexical Tones in Mandarin-Speaking Children With Developmental Language Disorder: Electrophysiological Evidence

Purpose This study explored the neural marker indexing deficits in discriminating lexical tone changes in Mandarin-speaking children with developmental language disorders (DLDs) using mismatch negativity, an event-related potential component for auditory change detection. Mandarin has four lexical tones characterized by a high-level tone (T1), high-rising tone (T2), low-dipping tone (T3), and high-falling tone (T4), in which the T2/T3 contrast is acoustically less discriminable in developmental groups. Therefore, this study further examined how deficits in children with DLD would vary with tonal contrasts' acoustic saliency. Method Event-related potentials were measured using the multideviant oddball paradigm described by Lee et al. (2012), who used Mandarin syllables [i] in T3 as the standard sound (80%), T1 as the large deviant (10%), and T2 as the small deviant (10%). Twelve children with DLD aged between 4 and 6 years participated in this study, and 12 age-matched children with typical development were selected from the data set of Lee et al. (2012) as the controls. Results The T1/T3 change elicited adultlike mismatch negativity in both the DLD and control groups, while no group difference was revealed. The T2/T3 change elicited a robust positive mismatch response (P-MMR) in children with DLD, while the P-MMR was less significant in the control group. The group comparisons revealed a larger P-MMR in children with DLD than in the control group. Furthermore, children with lower scores in language assessments tend to reveal larger P-MMRs. Conclusions This study demonstrated that deficits in children with DLD in discriminating subtle lexical tone changes reflect greater positivity of P-MMR to T2/T3 change. This implies that MMR to T2/T3 may serve as a neural marker for evaluating language delay in preschoolers.

Event-related components are structurally represented by intrinsic event-related potentials

The detection of event-related potentials (ERPs) through electroencephalogram (EEG) analysis is a well-established method for understanding brain functions during a cognitive process. To increase the signal-to-noise ratio (SNR) and stationarity of the data, ERPs are often filtered to a wideband frequency range, such as 0.05–30 Hz. Alternatively, a natural-filtering procedure can be performed through empirical mode decomposition (EMD), which yields intrinsic mode functions (IMFs) for each trial of the EEG data, followed by averaging over trials to generate the event-related modes. However, although the EMD-based filtering procedure has advantages such as a high SNR, suitable waveform shape, and high statistical power, one fundamental drawback of the procedure is that it requires the selection of an IMF (or a partial sum of a range of IMFs) to determine an ERP component effectively. Therefore, in this study, we propose an intrinsic ERP (iERP) method to overcome the drawbacks and retain the advantages of event-related mode analysis for investigating ERP components. The iERP method can reveal multiple ERP components at their characteristic time scales and suitably cluster statistical effects among modes by using a tailored definition of each mode’s neighbors. We validated the iERP method by using realistic EEG data sets acquired from a face perception task and visual working memory task. By using these two data sets, we demonstrated how to apply the iERP method to a cognitive task and incorporate existing cluster-based tests into iERP analysis. Moreover, iERP analysis revealed the statistical effects between (or among) experimental conditions more effectively than the conventional ERP method did.

To Go or Not to Go: Degrees of Dynamic Inhibitory Control Revealed by the Function of Grip Force and Early Electrophysiological Indices

A critical issue in executive control is how the nervous system exerts flexibility to inhibit a prepotent response and adapt to sudden changes in the environment. In this study, force measurement was used to capture “partial” unsuccessful trials that are highly relevant in extending the current understanding of motor inhibition processing. Moreover, a modified version of the stop-signal task was used to control and eliminate potential attentional capture effects from the motor inhibition index. The results illustrate that the non-canceled force and force rate increased as a function of stop-signal delay (SSD), offering new objective indices for gauging the dynamic inhibitory process. Motor response (time and force) was a function of delay in the presentation of novel/infrequent stimuli. A larger lateralized readiness potential (LRP) amplitude in go and novel stimuli indicated an influence of the novel stimuli on central motor processing. Moreover, an early N1 component reflects an index of motor inhibition in addition to the N2 component reported in previous studies. Source analysis revealed that the activation of N2 originated from inhibitory control associated areas: the right inferior frontal gyrus (rIFG), pre-motor cortex, and primary motor cortex. Regarding partial responses, LRP and error-related negativity (ERNs) were associated with error correction processes, whereas the N2 component may indicate the functional overlap between inhibition and error correction. In sum, the present study has developed reliable and objective indices of motor inhibition by introducing force, force-rate and electrophysiological measures, further elucidating our understandings of dynamic motor inhibition and error correction.

Neural Underpinnings of Early Speech Perception and Emergent Literacy

Mismatch negativity (MMN) is an event-related potential component used to index automatic auditory change detection. Thus, MMN provides an excellent tool to assess the speech sensitivity of infants and children. Although MMN is well established in adults, the polarity and latency of mismatch responses (MMRs) in infants are highly inconsistent across studies. This paper aims to provide a comprehensive review of MMN studies of speech perception in early infancy. In particular, data from a series of MMN studies of Mandarin lexical tone, vowels, and initial consonants will be presented to demonstrate how phonological saliency, size of deviance, and neural maturation modulate MMRs in early infancy. These data suggest that MMN and positive MMRs index different functional characteristics and may provide information on when and how children's speech perception becomes automatic at different developmental stages. By using MMN to index sensitivity to speech discrimination, dyslexic children usually show reduced or absent MMN, which supports the relationship between phonological sensitivity and literacy. However, children with attention deficit/hyperactivity disorder showed the typical MMN, but attenuated P3a and enhanced late discriminative negativity. Taken together, the MMR characteristics, including amplitude, peak latency, and the transition of polarity, may be used to index the maturation of speech development and for the early identification of children with atypical language development.

Cochlear implant artifact reduction on one channel Mismatch Negativity recordings based on Ensemble Empirical Mode Decomposition and Independent Component Analysis

Artifact generated by cochlear implants has been a problem for being able to register Mismatch Negativity (MMN) response. There are methods for reducing the artifact using multiple channels from the EEG but in this paper are presented the first results of a method using only the channel with the artifact using Ensemble Empirical Mode Decomposition (EEMD) and Independent Component Analysis (ICA). The first results showed that it was possible to get the MMN registers from the group of normal recordings and partially with the group of recordings from patients with cochlear implant. It is possible to suggest that EEMD in conjunction with ICA can be used for studies searching MMN.

Meditation Effects on the Control of Involuntary Contingent Reorienting Revealed With Electroencephalographic and Behavioral Evidence

Prior studies have reported that meditation may improve cognitive functions and those related to attention in particular. Here, the dynamic process of attentional control, which allows subjects to focus attention on their current interests, was investigated. Concentrative meditation aims to cultivate the abilities of continuous focus and redirecting attention from distractions to the object of focus during meditation. However, it remains unclear how meditation may influence attentional reorientation, which involves interaction between both top-down and bottom-up processes. We aimed to investigate the modulating effect of meditation on the mechanisms of contingent reorienting by employing a rapid serial visual presentation (RSVP) task in conjunction with electrophysiological recording. We recruited 26 meditators who had an average of 2.9 years of meditation experience and a control group comprising 26 individuals without any prior experience of meditation. All subjects performed a 30-min meditation and a rest condition with data collected pre- and post-intervention, with each intervention given on different days. The state effect of meditation improved overall accuracy for all subjects irrespective of their group. A group difference was observed across interventions, showing that meditators were more accurate and more efficient at attentional suppression, represented by a larger Pd (distractor positive) amplitude of event related modes (ERMs), for target-like distractors than the control group. The findings suggested that better attentional control with respect to distractors might be facilitated by acquiring experience of and skills related to meditation training.

Spectrum Reconstruction of a Spatially Modulated Fourier Transform Spectrometer Based on Stepped Mirrors

Based on the basic configuration and interference principle of a static step-mirror-based Fourier transform spectrometer, an image segmentation method is proposed to obtain a one-dimensional interferogram. The direct current component of the interferogram is fit using the least squares (LS) method and is subsequently removed. An empirical-mode decomposition-method-based high-pass filter is constructed to denoise the spectrum and enhance the spectral resolution simultaneously. Several experiments were performed and the spectrum is reconstructed based on these methods. The spectrum resolution is 81 cm^-1 at 2254 cm^-1.

Analysis of Gamma-Band Activity from Human EEG Using Empirical Mode Decomposition

The purpose of this paper is to determine whether gamma-band activity detection is improved when a filter, based on empirical mode decomposition (EMD), is added to the pre-processing block of single-channel electroencephalography (EEG) signals. EMD decomposes the original signal into a finite number of intrinsic mode functions (IMFs). EEGs from 25 control subjects were registered in basal and motor activity (hand movements) using only one EEG channel. Over the basic signal, IMF signals are computed. Gamma-band activity is computed using power spectrum density in the 30-60 Hz range. Event-related synchronization (ERS) was defined as the ratio of motor and basal activity. To evaluate the performance of the new EMD based method, ERS was computed from the basic and IMF signals. The ERS obtained using IMFs improves, from 31.00% to 73.86%, on the original ERS for the right hand, and from 22.17% to 47.69% for the left hand. As EEG processing is improved, the clinical applications of gamma-band activity will expand.

The Acquisition of Orthographic Knowledge: Evidence from the Lexicality Effects on N400

This study aimed to understand how reading ability shapes the lexicality effects on N400. Fifty-three typical developing children from the second to the sixth grades were asked to perform the pronounceability judgment task on a set of Chinese real characters (RC), pseudocharacters (PC) and non-characters (NC), as ERPs were recorded. The cluster-based permutation analysis revealed that children with low- to medium-reading ability showed greater negativity to NCs than to RCs and PCs in frontal sites from 300 to 450 ms, while children with high ability group showed a greater positivity to NCs than both RCs and PCs at central to posterior sites. Furthermore, the linear mixed model (LMM) analysis was applied to investigate the relationship between lexicality effects on N400 and reading-related behavioral assessments on a set of standardized tests (including character recognition, vocabulary size, phonological awareness, and working memory). The results found that in children with lower reading ability, the N400 elicited by NCs becomes more negative in the frontal sites. For children with higher reading ability, the N400 elicited by NCs became more positive than that elicited by RCs or PCs in the posterior sites. These findings demonstrate the developmental changes in the lexicality effects on N400 as children become more advanced readers and suggested that the lexicality effects on N400 can serve as neural markers for the evaluation of orthographic proficiency in reading development.

Theta Oscillation Reveals the Temporal Involvement of Different Attentional Networks in Contingent Reorienting

In the visual world, rapidly reorienting to relevant objects outside the focus of attention is vital for survival. This ability from the interaction between goal-directed and stimulus-driven attentional control is termed contingent reorienting. Neuroimaging studies have demonstrated activations of the ventral and dorsal attentional networks (DANs) which exhibit right hemisphere dominance, but the temporal dynamics of the attentional networks still remain unclear. The present study used event-related potential (ERP) to index the locus of spatial attention and Hilbert-Huang transform (HHT) to acquire the time-frequency information during contingent reorienting. The ERP results showed contingent reorienting induced significant N2pc on both hemispheres. In contrast, our time-frequency analysis found further that, unlike the N2pc, theta oscillation during contingent reorienting differed between hemispheres and experimental sessions. The inter-trial coherence (ITC) of the theta oscillation demonstrated that the two sides of the attentional networks became phase-locked to contingent reorienting at different stages. The left attentional networks were associated with contingent reorienting in the first experimental session whereas the bilateral attentional networks play a more important role in this process in the subsequent session. This phase-locked information suggests a dynamic temporal evolution of the involvement of different attentional networks in contingent reorienting and a potential role of the left ventral network in the first session.

Effects of orthographic consistency and homophone density on Chinese spoken word recognition

Studies of alphabetic language have shown that orthographic knowledge influences phonological processing during spoken word recognition. This study utilized the Event-Related Potentials (ERPs) to differentiate two types of phonology-to-orthography (P-to-O) mapping consistencies in Chinese, namely homophone density and orthographic consistency. The ERP data revealed an orthographic consistency effect in the frontal-centrally distributed N400, and a homophone density effect in central-posteriorly distributed late positive component (LPC). Further source analyses using the standardized low-resolution electromagnetic tomography (sLORETA) demonstrated that the orthographic effect was not only localized in the frontal and temporal-parietal regions for phonological processing, but also in the posterior visual cortex for orthographic processing, while the homophone density effect was found in middle temporal gyrus for lexical-semantic selection, and in the temporal-occipital junction for orthographic processing. These results suggest that orthographic information not only shapes the nature of phonological representations, but may also be activated during on-line spoken word recognition.