Decoding of single-trial auditory mismatch responses for online perceptual monitoring and neurofeedback

Sharpening Working Memory With Real-Time Electrophysiological Brain Signals: Which Neurofeedback Paradigms Work?

Growing evidence supports the idea that the ultimate biofeedback is to reward sensory pleasure (e.g., enhanced visual clarity) in real-time to neural circuits that are associated with a desired performance, such as excellent memory retrieval. Neurofeedback is biofeedback that uses real-time sensory reward to brain activity associated with a certain performance (e.g., accurate and fast recall). Working memory is a key component of human intelligence. The challenges are in our current limited understanding of neurocognitive dysfunctions as well as in technical difficulties for closed-loop feedback in true real-time. Here we review recent advancements of real time neurofeedback to improve memory training in healthy young and older adults. With new advancements in neuromarkers of specific neurophysiological functions, neurofeedback training should be better targeted beyond a single frequency approach to include frequency interactions and event-related potentials. Our review confirms the positive trend that neurofeedback training mostly works to improve memory and cognition to some extent in most studies. Yet, the training typically takes multiple weeks with 2-3 sessions per week. We review various neurofeedback reward strategies and outcome measures. A well-known issue in such training is that some people simply do not respond to neurofeedback. Thus, we also review the literature of individual differences in psychological factors e.g., placebo effects and so-called "BCI illiteracy" (Brain Computer Interface illiteracy). We recommend the use of Neural modulation sensitivity or BCI insensitivity in the neurofeedback literature. Future directions include much needed research in mild cognitive impairment, in non-Alzheimer's dementia populations, and neurofeedback using EEG features during resting and sleep for memory enhancement and as sensitive outcome measures.

Trial-Specific Feature Performance on Single-Channel Auditory Mismatch Negativity Detection

Successful detection of uncommon events is vital in the survival of an organism. Specifically, the study of neuro-sensory detection lends itself widely to understanding the human brain. Mismatch Negativity (MMN) is an important Event-Related Potential (ERP) response to an oddball stimulus which is preceded by repeated homogeneous stimulation. MMN is associated with perceptual learning and medical diagnostics among other applications. Currently, MMN detection relies on visual inspection of ERPs by skilled clinicians which makes for a costly, slow and subjective tool. In this paper, we use MMN to quantify the discriminative abilities of healthy or diagnosed subjects. We introduce a novel algorithmic method to extract and select important trial-specific features for discriminating standard from deviant responses. We utilize machine learning and classification approaches to evaluate our novel model using single-subject trial data while minimizing the number of necessary selection features provided by statistical test parameters and Genetic Algorithm (GA). In this work, a large variety of methods with 27 subjects, hundreds of trials and electrode counts compete for the definitive discrimination of MMN events. Our model requires only one EEG channel, a single subject and as low as five deviant tones. The results show statistically significant detection improvement over the traditional methods while maximizing resource economy.

Towards a Pragmatic Approach to a Psychophysiological Unit of Analysis for Mental and Brain Disorders: An EEG-Copeia for Neurofeedback

This article proposes what we call an "EEG-Copeia" for neurofeedback, like the "Pharmacopeia" for psychopharmacology. This paper proposes to define an "EEG-Copeia" as an organized list of scientifically validated EEG markers, characterized by a specific association with an identified cognitive process, that define a psychophysiological unit of analysis useful for mental or brain disorder evaluation and treatment. A characteristic of EEG neurofeedback for mental and brain disorders is that it targets a EEG markers related to a supposed cognitive process, whereas conventional treatments target clinical manifestations. This could explain why EEG neurofeedback studies encounter difficulty in achieving reproducibility and validation. The present paper suggests that a first step to optimize EEG neurofeedback protocols and future research is to target a valid EEG marker. The specificity of the cognitive skills trained and learned during real time feedback of the EEG marker could be enhanced and both the reliability of neurofeedback training and the therapeutic impact optimized. However, several of the most well-known EEG markers have seldom been applied for neurofeedback. Moreover, we lack a reliable and valid EEG targets library for further RCT to evaluate the efficacy of neurofeedback in mental and brain disorders. With the present manuscript, our aim is to foster dialogues between cognitive neuroscience and EEG neurofeedback according to a psychophysiological perspective. The primary objective of this review was to identify the most robust EEG target. EEG markers linked with one or several clearly identified cognitive-related processes will be identified. The secondary objective was to organize these EEG markers and related cognitive process in a psychophysiological unit of analysis matrix inspired by the Research Domain Criteria (RDoC) project.

EEG neurofeedback research: A fertile ground for psychiatry?

The clinical efficacy of neurofeedback is still a matter of debate. This paper analyzes the factors that should be taken into account in a transdisciplinary approach to evaluate the use of EEG NFB as a therapeutic tool in psychiatry. Neurofeedback is a neurocognitive therapy based on human-computer interaction that enables subjects to train voluntarily and modify functional biomarkers that are related to a defined mental disorder. We investigate three kinds of factors related to this definition of neurofeedback. We focus this article on EEG NFB. The first part of the paper investigates neurophysiological factors underlying the brain mechanisms driving NFB training and learning to modify a functional biomarker voluntarily. Two kinds of neuroplasticity involved in neurofeedback are analyzed: Hebbian neuroplasticity, i.e. long-term modification of neural membrane excitability and/or synaptic potentiation, and homeostatic neuroplasticity, i.e. homeostasis attempts to stabilize network activity. The second part investigates psychophysiological factors related to the targeted biomarker. It is demonstrated that neurofeedback involves clearly defining which kind of relationship between EEG biomarkers and clinical dimensions (symptoms or cognitive processes) is to be targeted. A nomenclature of accurate EEG biomarkers is proposed in the form of a short EEG encyclopedia (EEGcopia). The third part investigates human-computer interaction factors for optimizing NFB training and learning during the closed loop interaction. A model is proposed to summarize the different features that should be controlled to optimize learning. The need for accurate and reliable metrics of training and learning in line with human-computer interaction is also emphasized, including targeted biomarkers and neuroplasticity. All these factors related to neurofeedback show that it can be considered as a fertile ground for innovative research in psychiatry.

Toward Automated Cochlear Implant Fitting Procedures Based on Event-Related Potentials

OBJECTIVES

Cochlear implants (CIs) restore hearing to the profoundly deaf by direct electrical stimulation of the auditory nerve. To provide an optimal electrical stimulation pattern the CI must be individually fitted to each CI user. To date, CI fitting is primarily based on subjective feedback from the user. However, not all CI users are able to provide such feedback, for example, small children. This study explores the possibility of using the electroencephalogram (EEG) to objectively determine if CI users are able to hear differences in tones presented to them, which has potential applications in CI fitting or closed loop systems.

DESIGN

Deviant and standard stimuli were presented to 12 CI users in an active auditory oddball paradigm. The EEG was recorded in two sessions and classification of the EEG data was performed with shrinkage linear discriminant analysis. Also, the impact of CI artifact removal on classification performance and the possibility to reuse a trained classifier in future sessions were evaluated.

RESULTS

Overall, classification performance was above chance level for all participants although performance varied considerably between participants. Also, artifacts were successfully removed from the EEG without impairing classification performance. Finally, reuse of the classifier causes only a small loss in classification performance.

CONCLUSIONS

Our data provide first evidence that EEG can be automatically classified on single-trial basis in CI users. Despite the slightly poorer classification performance over sessions, classifier and CI artifact correction appear stable over successive sessions. Thus, classifier and artifact correction weights can be reused without repeating the set-up procedure in every session, which makes the technique easier applicable. With our present data, we can show successful classification of event-related cortical potential patterns in CI users. In the future, this has the potential to objectify and automate parts of CI fitting procedures.

Effects of Background Music on Objective and Subjective Performance Measures in an Auditory BCI

Several studies have explored brain computer interface (BCI) systems based on auditory stimuli, which could help patients with visual impairments. Usability and user satisfaction are important considerations in any BCI. Although background music can influence emotion and performance in other task environments, and many users may wish to listen to music while using a BCI, auditory, and other BCIs are typically studied without background music. Some work has explored the possibility of using polyphonic music in auditory BCI systems. However, this approach requires users with good musical skills, and has not been explored in online experiments. Our hypothesis was that an auditory BCI with background music would be preferred by subjects over a similar BCI without background music, without any difference in BCI performance. We introduce a simple paradigm (which does not require musical skill) using percussion instrument sound stimuli and background music, and evaluated it in both offline and online experiments. The result showed that subjects preferred the auditory BCI with background music. Different performance measures did not reveal any significant performance effect when comparing background music vs. no background. Since the addition of background music does not impair BCI performance but is preferred by users, auditory (and perhaps other) BCIs should consider including it. Our study also indicates that auditory BCIs can be effective even if the auditory channel is simultaneously otherwise engaged.

Decoding auditory EEG responses in healthy and clinical populations: A comparative study

BACKGROUND

Analyses of brain responses to external stimuli are typically based on the means computed across conditions. However in many cognitive and clinical applications, taking into account their variability across trials has turned out to be statistically more sensitive than comparing their means.

NEW METHOD

In this study we present a novel implementation of a single-trial topographic analysis (STTA) for discriminating auditory evoked potentials at predefined time-windows. This analysis has been previously introduced for extracting spatio-temporal features at the level of the whole neural response. Adapting the STTA on specific time windows is an essential step for comparing its performance to other time-window based algorithms.

RESULTS

We analyzed responses to standard vs. deviant sounds and showed that the new implementation of the STTA gives above-chance decoding results in all subjects (in comparison to 7 out of 11 with the original method). In comatose patients, the improvement of the decoding performance was even more pronounced than in healthy controls and doubled the number of significant results.

COMPARISON WITH EXISTING METHOD(S)

We compared the results obtained with the new STTA to those based on a logistic regression in healthy controls and patients. We showed that the first of these two comparisons provided a better performance of the logistic regression; however only the new STTA provided significant results in comatose patients at group level.

CONCLUSIONS

Our results provide quantitative evidence that a systematic investigation of the accuracy of established methods in normal and clinical population is an essential step for optimizing decoding performance.