Comparative Study of Entropy Sensitivity to Missing Biosignal Data

Optimizing the measurement of sample entropy in resting-state fMRI data

Introduction

The complexity of brain signals may hold clues to understand brain-based disorders. Sample entropy, an index that captures the predictability of a signal, is a promising tool to measure signal complexity. However, measurement of sample entropy from fMRI signals has its challenges, and numerous questions regarding preprocessing and parameter selection require research to advance the potential impact of this method. For one example, entropy may be highly sensitive to the effects of motion, yet standard approaches to addressing motion (e.g., scrubbing) may be unsuitable for entropy measurement. For another, the parameters used to calculate entropy need to be defined by the properties of data being analyzed, an issue that has frequently been ignored in fMRI research. The current work sought to rigorously address these issues and to create methods that could be used to advance this field.

Methods

We developed and tested a novel windowing approach to select and concatenate (ignoring connecting volumes) low-motion windows in fMRI data to reduce the impact of motion on sample entropy estimates. We created utilities (implementing autoregressive models and a grid search function) to facilitate selection of the matching length m parameter and the error tolerance r parameter. We developed an approach to apply these methods at every grayordinate of the brain, creating a whole-brain dense entropy map. These methods and tools have been integrated into a publicly available R package ("powseR"). We demonstrate these methods using data from the ABCD study. After applying the windowing procedure to allow sample entropy calculation on the lowest-motion windows from runs 1 and 2 (combined) and those from runs 3 and 4 (combined), we identified the optimal m and r parameters for these data. To confirm the impact of the windowing procedure, we compared entropy values and their relationship with motion when entropy was calculated using the full set of data vs. those calculated using the windowing procedure. We then assessed reproducibility of sample entropy calculations using the windowed procedure by calculating the intraclass correlation between the earlier and later entropy measurements at every grayordinate.

Results

When applying these optimized methods to the ABCD data (from the subset of individuals who had enough windows of continuous "usable" volumes), we found that the novel windowing procedure successfully mitigated the large inverse correlation between entropy values and head motion seen when using a standard approach. Furthermore, using the windowed approach, entropy values calculated early in the scan (runs 1 and 2) are largely reproducible when measured later in the scan (runs 3 and 4), although there is some regional variability in reproducibility.

Discussion

We developed an optimized approach to measuring sample entropy that addresses concerns about motion and that can be applied across datasets through user-identified adaptations that allow the method to be tailored to the dataset at hand. We offer preliminary results regarding reproducibility. We also include recommendations for fMRI data acquisition to optimize sample entropy measurement and considerations for the field.

Exploring Complexity of Facial Dynamics in Autism Spectrum Disorder

Atypical facial expression is one of the early symptoms of autism spectrum disorder (ASD) characterized by reduced regularity and lack of coordination of facial movements. Automatic quantification of these behaviors can offer novel biomarkers for screening, diagnosis, and treatment monitoring of ASD. In this work, 40 toddlers with ASD and 396 typically developing toddlers were shown developmentally-appropriate and engaging movies presented on a smart tablet during a well-child pediatric visit. The movies consisted of social and non-social dynamic scenes designed to evoke certain behavioral and affective responses. The front-facing camera of the tablet was used to capture the toddlers' face. Facial landmarks' dynamics were then automatically computed using computer vision algorithms. Subsequently, the complexity of the landmarks' dynamics was estimated for the eyebrows and mouth regions using multiscale entropy. Compared to typically developing toddlers, toddlers with ASD showed higher complexity (i.e., less predictability) in these landmarks' dynamics. This complexity in facial dynamics contained novel information not captured by traditional facial affect analyses. These results suggest that computer vision analysis of facial landmark movements is a promising approach for detecting and quantifying early behavioral symptoms associated with ASD.

Complexity analysis of head movements in autistic toddlers

BACKGROUND

Early differences in sensorimotor functioning have been documented in young autistic children and infants who are later diagnosed with autism. Previous research has demonstrated that autistic toddlers exhibit more frequent head movement when viewing dynamic audiovisual stimuli, compared to neurotypical toddlers. To further explore this behavioral characteristic, in this study, computer vision (CV) analysis was used to measure several aspects of head movement dynamics of autistic and neurotypical toddlers while they watched a set of brief movies with social and nonsocial content presented on a tablet.

METHODS

Data were collected from 457 toddlers, 17-36 months old, during their well-child visit to four pediatric primary care clinics. Forty-one toddlers were subsequently diagnosed with autism. An application (app) displayed several brief movies on a tablet, and the toddlers watched these movies while sitting on their caregiver's lap. The front-facing camera in the tablet recorded the toddlers' behavioral responses. CV was used to measure the participants' head movement rate, movement acceleration, and complexity using multiscale entropy.

RESULTS

Autistic toddlers exhibited significantly higher rate, acceleration, and complexity in their head movements while watching the movies compared to neurotypical toddlers, regardless of the type of movie content (social vs. nonsocial). The combined features of head movement acceleration and complexity reliably distinguished the autistic and neurotypical toddlers.

CONCLUSIONS

Autistic toddlers exhibit differences in their head movement dynamics when viewing audiovisual stimuli. Higher complexity of their head movements suggests that their movements were less predictable and less stable compared to neurotypical toddlers. CV offers a scalable means of detecting subtle differences in head movement dynamics, which may be helpful in identifying early behaviors associated with autism and providing insight into the nature of sensorimotor differences associated with autism.

Slope Entropy Normalisation by Means of Analytical and Heuristic Reference Values

Slope Entropy (SlpEn) is a very recently proposed entropy calculation method. It is based on the differences between consecutive values in a time series and two new input thresholds to assign a symbol to each resulting difference interval. As the histogram normalisation value, SlpEn uses the actual number of unique patterns found instead of the theoretically expected value. This maximises the information captured by the method but, as a consequence, SlpEn results do not usually fall within the classical [0,1] interval. Although this interval is not necessary at all for time series classification purposes, it is a convenient and common reference framework when entropy analyses take place. This paper describes a method to keep SlpEn results within this interval, and improves the interpretability and comparability of this measure in a similar way as for other methods. It is based on a max-min normalisation scheme, described in two steps. First, an analytic normalisation is proposed using known but very conservative bounds. Afterwards, these bounds are refined using heuristics about the behaviour of the number of patterns found in deterministic and random time series. The results confirm the suitability of the approach proposed, using a mixture of the two methods.

A Pragmatic Ensemble Strategy for Missing Values Imputation in Health Records

Pristine and trustworthy data are required for efficient computer modelling for medical decision-making, yet data in medical care is frequently missing. As a result, missing values may occur not just in training data but also in testing data that might contain a single undiagnosed episode or a participant. This study evaluates different imputation and regression procedures identified based on regressor performance and computational expense to fix the issues of missing values in both training and testing datasets. In the context of healthcare, several procedures are introduced for dealing with missing values. However, there is still a discussion concerning which imputation strategies are better in specific cases. This research proposes an ensemble imputation model that is educated to use a combination of simple mean imputation, k-nearest neighbour imputation, and iterative imputation methods, and then leverages them in a manner where the ideal imputation strategy is opted among them based on attribute correlations on missing value features. We introduce a unique Ensemble Strategy for Missing Value to analyse healthcare data with considerable missing values to identify unbiased and accurate prediction statistical modelling. The performance metrics have been generated using the eXtreme gradient boosting regressor, random forest regressor, and support vector regressor. The current study uses real-world healthcare data to conduct experiments and simulations of data with varying feature-wise missing frequencies indicating that the proposed technique surpasses standard missing value imputation approaches as well as the approach of dropping records holding missing values in terms of accuracy.

Near-Infrared Spectroscopy to Assess Cerebral Autoregulation and Optimal Mean Arterial Pressure in Patients With Hypoxic-Ischemic Brain Injury: A Prospective Multicenter Feasibility Study

Supplemental Digital Content is available in the text.

We provide preliminary multicenter data to suggest that recruitment and collection of physiologic data necessary to quantify cerebral autoregulation and individualized blood pressure targets are feasible in postcardiac arrest patients. We evaluated the feasibility of a multicenter protocol to enroll patients across centers, as well as collect continuous recording (≥ 80% of monitoring time) of regional cerebral oxygenation and mean arterial pressure, which is required to quantify cerebral autoregulation, using the cerebral oximetry index, and individualized optimal mean arterial pressure thresholds. Additionally, we conducted an exploratory analysis to assess if an increased percentage of monitoring time where mean arterial pressure was greater than or equal to 5 mm Hg below optimal mean arterial pressure, percentage of monitoring time with dysfunctional cerebral autoregulation (i.e., cerebral oximetry index ≥ 0.3), and time to return of spontaneous circulation were associated with an unfavorable neurologic outcome (i.e., 6-mo Cerebral Performance Category score ≥ 3).

Application of the Variance Delay Fuzzy Approximate Entropy for Autonomic Nervous System Fluctuation Analysis in Obstructive Sleep Apnea Patients

Obstructive sleep apnea (OSA) is a fatal respiratory disease occurring in sleep. OSA can induce declined heart rate variability (HRV) and was reported to have autonomic nerve system (ANS) dysfunction. Variance delay fuzzy approximate entropy (VD_fApEn) was proposed as a nonlinear index to study the fluctuation change of ANS in OSA patients. Sixty electrocardiogram (ECG) recordings of the PhysioNet database (20 normal, 14 mild-moderate OSA, and 26 severe OSA) were intercepted for 6 h and divided into 5-min segments. HRV analysis were adopted in traditional frequency domain, and nonlinear HRV indices were also calculated. Among these indices, VD_fApEn could significantly differentiate among the three groups (p < 0.05) compared with the ratio of low frequency power and high frequency power (LF/HF ratio) and fuzzy approximate entropy (fApEn). Moreover, the VD_fApEn (90%) reached a higher OSA screening accuracy compared with LF/HF ratio (80%) and fApEn (78.3%). Therefore, VD_fApEn provides a potential clinical method for ANS fluctuation analysis in OSA patients and OSA severity analysis.

Augmentation of Dispersion Entropy for Handling Missing and Outlier Samples in Physiological Signal Monitoring

Entropy quantification algorithms are becoming a prominent tool for the physiological monitoring of individuals through the effective measurement of irregularity in biological signals. However, to ensure their effective adaptation in monitoring applications, the performance of these algorithms needs to be robust when analysing time-series containing missing and outlier samples, which are common occurrence in physiological monitoring setups such as wearable devices and intensive care units. This paper focuses on augmenting Dispersion Entropy (DisEn) by introducing novel variations of the algorithm for improved performance in such applications. The original algorithm and its variations are tested under different experimental setups that are replicated across heart rate interval, electroencephalogram, and respiratory impedance time-series. Our results indicate that the algorithmic variations of DisEn achieve considerable improvements in performance while our analysis signifies that, in consensus with previous research, outlier samples can have a major impact in the performance of entropy quantification algorithms. Consequently, the presented variations can aid the implementation of DisEn to physiological monitoring applications through the mitigation of the disruptive effect of missing and outlier samples.

An Improved Method of Handling Missing Values in the Analysis of Sample Entropy for Continuous Monitoring of Physiological Signals

Medical devices generate huge amounts of continuous time series data. However, missing values commonly found in these data can prevent us from directly using analytic methods such as sample entropy to reveal the information contained in these data. To minimize the influence of missing points on the calculation of sample entropy, we propose a new method to handle missing values in continuous time series data. We use both experimental and simulated datasets to compare the performance (in percentage error) of our proposed method with three currently used methods: skipping the missing values, linear interpolation, and bootstrapping. Unlike the methods that involve modifying the input data, our method modifies the calculation process. This keeps the data unchanged which is less intrusive to the structure of the data. The results demonstrate that our method has a consistent lower average percentage error than other three commonly used methods in multiple common physiological signals. For missing values in common physiological signal type, different data size and generating mechanism, our method can more accurately extract the information contained in continuously monitored data than traditional methods. So it may serve as an effective tool for handling missing values and may have broad utility in analyzing sample entropy for common physiological signals. This could help develop new tools for disease diagnosis and evaluation of treatment effects.

A Novel Approach for Real-Time Recognition of Epileptic Seizures Using Minimum Variance Modified Fuzzy Entropy

OBJECTIVE

Validation of epileptic seizures annotations from long-term electroencephalogram (EEG) recordings is a tough and tedious task for the neurological community. It is a well-known fact that computerized qualitative methods thoroughly assess the complex brain dynamics toward seizure detection and proven as one of the acceptable clinical indicators.

METHODS

This research study suggests a novel approach for real-time recognition of epileptic seizure from EEG recordings by a technique referred as minimum variance modified fuzzy entropy (MVMFzEn). Multichannel EEG recordings of 4.36 h of epileptic seizures and 25.74 h of normal EEG were considered. Signal processing techniques such as filters and independent component analysis were appropriated to reduce noise and artifacts. Unlike, the predefined fuzzy membership function, the modified fuzzy entropy utilizes relative energy as a membership function followed by scaling operation to obtain the feature.

RESULTS

Results revealed that MVMFzEn drops abruptly during an epileptic activity and this fact was used to set a threshold. An automated threshold derived from MVMFzEn assesses the classification efficiency of the given data during validation. It was observed from the results that the proposed method yields a classification accuracy of 100% without the use of any classifier.

CONCLUSION

The graphical user interface was designed in MATLAB to automatically label the normal and epileptic segments in the long-term EEG recordings.

SIGNIFICANCE

The ground truth clinical validation using validation specificity and validation sensitivity confirms the suitability of the proposed technique for automated annotation of epileptic seizures in real time.

Fuzzy Entropy Analysis of the Electroencephalogram in Patients with Alzheimer's Disease: Is the Method Superior to Sample Entropy?

Alzheimer’s disease (AD) is the most prevalent form of dementia in the world, which is characterised by the loss of neurones and the build-up of plaques in the brain, causing progressive symptoms of memory loss and confusion. Although definite diagnosis is only possible by necropsy, differential diagnosis with other types of dementia is still needed. An electroencephalogram (EEG) is a cheap, portable, non-invasive method to record brain signals. Previous studies with non-linear signal processing methods have shown changes in the EEG due to AD, which is characterised reduced complexity and increased regularity. EEGs from 11 AD patients and 11 age-matched control subjects were analysed with Fuzzy Entropy (FuzzyEn), a non-linear method that was introduced as an improvement over the frequently used Approximate Entropy (ApEn) and Sample Entropy (SampEn) algorithms. AD patients had significantly lower FuzzyEn values than control subjects (p < 0.01) at electrodes T6, P3, P4, O1, and O2. Furthermore, when diagnostic accuracy was calculated using Receiver Operating Characteristic (ROC) curves, FuzzyEn outperformed both ApEn and SampEn, reaching a maximum accuracy of 86.36%. These results suggest that FuzzyEn could increase the insight into brain dysfunction in AD, providing potentially useful diagnostic information. However, results depend heavily on the input parameters that are used to compute FuzzyEn.

A Novel and Effective Method for Congestive Heart Failure Detection and Quantification Using Dynamic Heart Rate Variability Measurement

Risk assessment of congestive heart failure (CHF) is essential for detection, especially helping patients make informed decisions about medications, devices, transplantation, and end-of-life care. The majority of studies have focused on disease detection between CHF patients and normal subjects using short-/long-term heart rate variability (HRV) measures but not much on quantification. We downloaded 116 nominal 24-hour RR interval records from the MIT/BIH database, including 72 normal people and 44 CHF patients. These records were analyzed under a 4-level risk assessment model: no risk (normal people, N), mild risk (patients with New York Heart Association (NYHA) class I-II, P1), moderate risk (patients with NYHA III, P2), and severe risk (patients with NYHA III-IV, P3). A novel multistage classification approach is proposed for risk assessment and rating CHF using the non-equilibrium decision-tree-based support vector machine classifier. We propose dynamic indices of HRV to capture the dynamics of 5-minute short term HRV measurements for quantifying autonomic activity changes of CHF. We extracted 54 classical measures and 126 dynamic indices and selected from these using backward elimination to detect and quantify CHF patients. Experimental results show that the multistage risk assessment model can realize CHF detection and quantification analysis with total accuracy of 96.61%. The multistage model provides a powerful predictor between predicted and actual ratings, and it could serve as a clinically meaningful outcome providing an early assessment and a prognostic marker for CHF patients.

Combined nonlinear metrics to evaluate spontaneous EEG recordings from chronic spinal cord injury in a rat model: a pilot study

Spinal cord injury (SCI) is a high-cost disability and may cause permanent loss of movement and sensation below the injury location. The chance of cure in human after SCI is extremely limited. Instead, neural regeneration could have been seen in animals after SCI, and such regeneration could be retarded by blocking neural plasticity pathways, showing the importance of neural plasticity in functional recovery. As an indicator of nonlinear dynamics in the brain, sample entropy was used here in combination with detrended fluctuation analysis (DFA) and Kolmogorov complexity to quantify functional plasticity changes in spontaneous EEG recordings of rats before and after SCI. The results showed that the sample entropy values were decreased at the first day following injury then gradually increased during recovery. DFA and Kolmogorov complexity results were in consistent with sample entropy, showing the complexity of the EEG time series was lost after injury and partially regained in 1 week. The tendency to regain complexity is in line with the observation of behavioral rehabilitation. A critical time point was found during the recovery process after SCI. Our preliminary results suggested that the combined use of these nonlinear dynamical metrics could provide a quantitative and predictive way to assess the change of neural plasticity in a spinal cord injury rat model.