Noisy EEG signals classification based on entropy metrics. Performance assessment using first and second generation statistics

Towards discovery and implementation of neurophysiologic biomarkers of Alzheimer's disease using entropy methods

Alzheimer's disease (AD) is a prevalent and debilitating neurodegenerative disease that leads to substantial loss of quality of life. Therapies currently available for AD do not modify the disease course and have limited efficacy in symptom control. As such, novel and precise therapies tailored to individual patients' neurophysiologic profiles are needed. Functional neuroimaging tools have demonstrated substantial potential to provide quantifiable insight into brain function in various neurologic disorders, particularly AD. Entropy, a novel analysis for better understanding the nonlinear nature of neurophysiological data, has demonstrated consistent accuracy in disease detection. This literature review characterizes the use of entropy-based analyses from functional neuroimaging tools, including electroencephalography (EEG) and magnetoencephalography (MEG), in patients with AD for disease detection, therapeutic response measurement, and providing clinical insights.

Slope Entropy Normalisation by Means of Analytical and Heuristic Reference Values

Slope Entropy (SlpEn) is a very recently proposed entropy calculation method. It is based on the differences between consecutive values in a time series and two new input thresholds to assign a symbol to each resulting difference interval. As the histogram normalisation value, SlpEn uses the actual number of unique patterns found instead of the theoretically expected value. This maximises the information captured by the method but, as a consequence, SlpEn results do not usually fall within the classical [0,1] interval. Although this interval is not necessary at all for time series classification purposes, it is a convenient and common reference framework when entropy analyses take place. This paper describes a method to keep SlpEn results within this interval, and improves the interpretability and comparability of this measure in a similar way as for other methods. It is based on a max-min normalisation scheme, described in two steps. First, an analytic normalisation is proposed using known but very conservative bounds. Afterwards, these bounds are refined using heuristics about the behaviour of the number of patterns found in deterministic and random time series. The results confirm the suitability of the approach proposed, using a mixture of the two methods.

Feasibility study of personalized speed adaptation method based on mental state for teleoperated robots

The teleoperated robotic system can support humans to complete tasks in high-risk, high-precision and difficult special environments. Because this kind of special working environment is easy to cause stress, high mental workload, fatigue and other mental states of the operator, which will reduce the quality of operation and even cause safety accidents, so the mental state of the people in this system has received extensive attention. However, the existence of individual differences and mental state diversity is often ignored, so that most of the existing adjustment strategy is out of a match between mental state and adaptive decision, which cannot effectively improve operational quality and safety. Therefore, a personalized speed adaptation (PSA) method based on policy gradient reinforcement learning was proposed in this paper. It can use electroencephalogram and electro-oculogram to accurately perceive the operator’s mental state, and adjust the speed of the robot individually according to the mental state of different operators, in order to perform teleoperation tasks efficiently and safely. The experimental results showed that the PSA method learns the mapping between the mental state and the robot’s speed regulation action by means of rewards and punishments, and can adjust the speed of the robot individually according to the mental state of different operators, thereby improving the operating quality of the system. And the feasibility and superiority of this method were proved. It is worth noting that the PSA method was validated on 6 real subjects rather than a simulation model. To the best of our knowledge, the PSA method is the first implementation of online reinforcement learning control of teleoperated robots involving human subjects.

An asynchronous artifact-enhanced electroencephalogram based control paradigm assisted by slight facial expression

In this study, an asynchronous artifact-enhanced electroencephalogram (EEG)-based control paradigm assisted by slight-facial expressions (sFE-paradigm) was developed. The brain connectivity analysis was conducted to reveal the dynamic directional interactions among brain regions under sFE-paradigm. The component analysis was applied to estimate the dominant components of sFE-EEG and guide the signal processing. Enhanced by the artifact within the detected electroencephalogram (EEG), the sFE-paradigm focused on the mainstream defect as the insufficiency of real-time capability, asynchronous logic, and robustness. The core algorithm contained four steps, including “obvious non-sFE-EEGs exclusion,” “interface ‘ON’ detection,” “sFE-EEGs real-time decoding,” and “validity judgment.” It provided the asynchronous function, decoded eight instructions from the latest 100 ms signal, and greatly reduced the frequent misoperation. In the offline assessment, the sFE-paradigm achieved 96.46% ± 1.07 accuracy for interface “ON” detection and 92.68% ± 1.21 for sFE-EEGs real-time decoding, with the theoretical output timespan less than 200 ms. This sFE-paradigm was applied to two online manipulations for evaluating stability and agility. In “object-moving with a robotic arm,” the averaged intersection-over-union was 60.03 ± 11.53%. In “water-pouring with a prosthetic hand,” the average water volume was 202.5 ± 7.0 ml. During online, the sFE-paradigm performed no significant difference (P = 0.6521 and P = 0.7931) with commercial control methods (i.e., FlexPendant and Joystick), indicating a similar level of controllability and agility. This study demonstrated the capability of sFE-paradigm, enabling a novel solution to the non-invasive EEG-based control in real-world challenges.

Detection of Focal and Non-Focal Electroencephalogram Signals Using Fast Walsh-Hadamard Transform and Artificial Neural Network

The discrimination of non-focal class (NFC) and focal class (FC), is vital in localizing the epileptogenic zone (EZ) during neurosurgery. In the conventional diagnosis method, the neurologist has to visually examine the long hour electroencephalogram (EEG) signals, which consumes time and is prone to error. Hence, in this present work, automated diagnosis of FC EEG signals from NFC EEG signals is developed using the Fast Walsh-Hadamard Transform (FWHT) method, entropies, and artificial neural network (ANN). The FWHT analyzes the EEG signals in the frequency domain and decomposes it into the Hadamard coefficients. Five different nonlinear features, namely approximate entropy (ApEn), log-energy entropy (LogEn), fuzzy entropy (FuzzyEn), sample entropy (SampEn), and permutation entropy (PermEn) are extracted from the decomposed Hadamard coefficients. The extracted features detail the nonlinearity in the NFC and the FC EEG signals. The judicious entropy features are supplied to the ANN classifier, with a 10-fold cross-validation method to classify the NFC and FC classes. Two publicly available datasets such as the University of Bonn and Bern-Barcelona dataset are used to evaluate the proposed approach. A maximum sensitivity of 99.70%, the accuracy of 99.50%, and specificity of 99.30% with the 3750 pairs of NFC and FC signal are achieved using the Bern-Barcelona dataset, while the accuracy of 92.80%, the sensitivity of 91%, and specificity of 94.60% is achieved using University of Bonn dataset. Compared to the existing technique, the proposed approach attained a maximum classification performance in both the dataset.

Using the Information Provided by Forbidden Ordinal Patterns in Permutation Entropy to Reinforce Time Series Discrimination Capabilities

Despite its widely tested and proven usefulness, there is still room for improvement in the basic permutation entropy (PE) algorithm, as several subsequent studies have demonstrated in recent years. Some of these new methods try to address the well-known PE weaknesses, such as its focus only on ordinal and not on amplitude information, and the possible detrimental impact of equal values found in subsequences. Other new methods address less specific weaknesses, such as the PE results' dependence on input parameter values, a common problem found in many entropy calculation methods. The lack of discriminating power among classes in some cases is also a generic problem when entropy measures are used for data series classification. This last problem is the one specifically addressed in the present study. Toward that purpose, the classification performance of the standard PE method was first assessed by conducting several time series classification tests over a varied and diverse set of data. Then, this performance was reassessed using a new Shannon Entropy normalisation scheme proposed in this paper: divide the relative frequencies in PE by the number of different ordinal patterns actually found in the time series, instead of by the theoretically expected number. According to the classification accuracy obtained, this last approach exhibited a higher class discriminating power. It was capable of finding significant differences in six out of seven experimental datasets-whereas the standard PE method only did in four-and it also had better classification accuracy. It can be concluded that using the additional information provided by the number of forbidden/found patterns, it is possible to achieve a higher discriminating power than using the classical PE normalisation method. The resulting algorithm is also very similar to that of PE and very easy to implement.

Permutation Entropy: Enhancing Discriminating Power by Using Relative Frequencies Vector of Ordinal Patterns Instead of Their Shannon Entropy

Many measures to quantify the nonlinear dynamics of a time series are based on estimating the probability of certain features from their relative frequencies. Once a normalised histogram of events is computed, a single result is usually derived. This process can be broadly viewed as a nonlinear IRn mapping into IR, where n is the number of bins in the histogram. However, this mapping might entail a loss of information that could be critical for time series classification purposes. In this respect, the present study assessed such impact using permutation entropy (PE) and a diverse set of time series. We first devised a method of generating synthetic sequences of ordinal patterns using hidden Markov models. This way, it was possible to control the histogram distribution and quantify its influence on classification results. Next, real body temperature records are also used to illustrate the same phenomenon. The experiments results confirmed the improved classification accuracy achieved using raw histogram data instead of the PE final values. Thus, this study can provide a very valuable guidance for the improvement of the discriminating capability not only of PE, but of many similar histogram-based measures.

Entropy Analysis of High-Definition Transcranial Electric Stimulation Effects on EEG Dynamics

A foundation of medical research is time series analysis—the behavior of variables of interest with respect to time. Time series data are often analyzed using the mean, with statistical tests applied to mean differences, and has the assumption that data are stationary. Although widely practiced, this method has limitations. Here we present an alternative statistical approach with sample analysis that provides a summary statistic accounting for the non-stationary nature of time series data. This work discusses the use of entropy as a measurement of the complexity of time series, in the context of Neuroscience, due to the non-stationary characteristic of the data. To elucidate our argument, we conducted entropy analysis on a sample of electroencephalographic (EEG) data from an interventional study using non-invasive electrical brain stimulation. We demonstrated that entropy analysis could identify intervention-related change in EEG data, supporting that entropy can be a useful “summary” statistic in non-linear dynamical systems.

Embedded Dimension and Time Series Length. Practical Influence on Permutation Entropy and Its Applications

Permutation Entropy (PE) is a time series complexity measure commonly used in a variety of contexts, with medicine being the prime example. In its general form, it requires three input parameters for its calculation: time series length N, embedded dimension m, and embedded delay τ. Inappropriate choices of these parameters may potentially lead to incorrect interpretations. However, there are no specific guidelines for an optimal selection of N, m, or τ, only general recommendations such as N>>m!, τ=1, or m=3,…,7. This paper deals specifically with the study of the practical implications of N>>m!, since long time series are often not available, or non-stationary, and other preliminary results suggest that low N values do not necessarily invalidate PE usefulness. Our study analyses the PE variation as a function of the series length N and embedded dimension m in the context of a diverse experimental set, both synthetic (random, spikes, or logistic model time series) and real–world (climatology, seismic, financial, or biomedical time series), and the classification performance achieved with varying N and m. The results seem to indicate that shorter lengths than those suggested by N>>m! are sufficient for a stable PE calculation, and even very short time series can be robustly classified based on PE measurements before the stability point is reached. This may be due to the fact that there are forbidden patterns in chaotic time series, not all the patterns are equally informative, and differences among classes are already apparent at very short lengths.

An Approach for Brain-Controlled Prostheses Based on a Facial Expression Paradigm

One of the most exciting areas of rehabilitation research is brain-controlled prostheses, which translate electroencephalography (EEG) signals into control commands that operate prostheses. However, the existing brain-control methods have an obstacle between the selection of brain computer interface (BCI) and its performance. In this paper, a novel BCI system based on a facial expression paradigm is proposed to control prostheses that uses the characteristics of theta and alpha rhythms of the prefrontal and motor cortices. A portable brain-controlled prosthesis system was constructed to validate the feasibility of the facial-expression-based BCI (FE-BCI) system. Four types of facial expressions were used in this study. An effective filtering algorithm based on noise-assisted multivariate empirical mode decomposition (NA-MEMD) and sample entropy (SampEn) was used to remove electromyography (EMG) artifacts. A wavelet transform (WT) was applied to calculate the feature set, and a back propagation neural network (BPNN) was employed as a classifier. To prove the effectiveness of the FE-BCI system for prosthesis control, 18 subjects were involved in both offline and online experiments. The grand average accuracy over 18 subjects was 81.31 ± 5.82% during the online experiment. The experimental results indicated that the proposed FE-BCI system achieved good performance and can be efficiently applied for prosthesis control.

Characterization of Artifact Influence on the Classification of Glucose Time Series Using Sample Entropy Statistics

This paper analyses the performance of SampEn and one of its derivatives, Fuzzy Entropy (FuzzyEn), in the context of artifacted blood glucose time series classification. This is a difficult and practically unexplored framework, where the availability of more sensitive and reliable measures could be of great clinical impact. Although the advent of new blood glucose monitoring technologies may reduce the incidence of the problems stated above, incorrect device or sensor manipulation, patient adherence, sensor detachment, time constraints, adoption barriers or affordability can still result in relatively short and artifacted records, as the ones analyzed in this paper or in other similar works. This study is aimed at characterizing the changes induced by such artifacts, enabling the arrangement of countermeasures in advance when possible. Despite the presence of these disturbances, results demonstrate that SampEn and FuzzyEn are sufficiently robust to achieve a significant classification performance, using records obtained from patients with duodenal-jejunal exclusion. The classification results, in terms of area under the ROC of up to 0.9, with several tests yielding AUC values also greater than 0.8, and in terms of a leave-one-out average classification accuracy of 80%, confirm the potential of these measures in this context despite the presence of artifacts, with SampEn having slightly better performance than FuzzyEn.

Model Selection for Body Temperature Signal Classification Using Both Amplitude and Ordinality-Based Entropy Measures

Many entropy-related methods for signal classification have been proposed and exploited successfully in the last several decades. However, it is sometimes difficult to find the optimal measure and the optimal parameter configuration for a specific purpose or context. Suboptimal settings may therefore produce subpar results and not even reach the desired level of significance. In order to increase the signal classification accuracy in these suboptimal situations, this paper proposes statistical models created with uncorrelated measures that exploit the possible synergies between them. The methods employed are permutation entropy (PE), approximate entropy (ApEn), and sample entropy (SampEn). Since PE is based on subpattern ordinal differences, whereas ApEn and SampEn are based on subpattern amplitude differences, we hypothesized that a combination of PE with another method would enhance the individual performance of any of them. The dataset was composed of body temperature records, for which we did not obtain a classification accuracy above 80% with a single measure, in this study or even in previous studies. The results confirmed that the classification accuracy rose up to 90% when combining PE and ApEn with a logistic model.

Sample Entropy Analysis of Noisy Atrial Electrograms during Atrial Fibrillation

Most cardiac arrhythmias can be classified as atrial flutter, focal atrial tachycardia, or atrial fibrillation. They have been usually treated using drugs, but catheter ablation has proven more effective. This is an invasive method devised to destroy the heart tissue that disturbs correct heart rhythm. In order to accurately localise the focus of this disturbance, the acquisition and processing of atrial electrograms form the usual mapping technique. They can be single potentials, double potentials, or complex fractionated atrial electrogram (CFAE) potentials, and last ones are the most effective targets for ablation. The electrophysiological substrate is then localised by a suitable signal processing method. Sample Entropy is a statistic scarcely applied to electrograms but can arguably become a powerful tool to analyse these time series, supported by its results in other similar biomedical applications. However, the lack of an analysis of its dependence on the perturbations usually found in electrogram data, such as missing samples or spikes, is even more marked. This paper applied SampEn to the segmentation between non-CFAE and CFAE records and assessed its class segmentation power loss at different levels of these perturbations. The results confirmed that SampEn was able to significantly distinguish between non-CFAE and CFAE records, even under very unfavourable conditions, such as 50% of missing data or 10% of spikes.