Multiscale Entropy Approaches and Their Applications

Benefits of Zero-Phase or Linear Phase Filters to Design Multiscale Entropy: Theory and Application

In various applications, multiscale entropy (MSE) is often used as a feature to characterize the complexity of the signals in order to classify them. It consists of estimating the sample entropies (SEs) of the signal under study and its coarse-grained (CG) versions, where the CG process amounts to (1) filtering the signal with an average filter whose order is the scale and (2) decimating the filter output by a factor equal to the scale. In this paper, we propose to derive a new variant of the MSE. Its novelty stands in the way to get the sequences at different scales by avoiding distortions during the decimation step. To this end, a linear-phase or null-phase low-pass filter whose cutoff frequency is well suited to the scale is used. Interpretations on how the MSE behaves and illustrations with a sum of sinusoids, as well as white and pink noises, are given. Then, an application to detect attentional tunneling is presented. It shows the benefit of the new approach in terms of p value when one aims at differentiating the set of MSEs obtained in the attentional tunneling state from the set of MSEs obtained in the nominal state. It should be noted that CG versions can be replaced not only for the MSE but also for other variants.

Major Role of Multiscale Entropy Evolution in Complex Systems and Data Science

Complex systems are prevalent in various disciplines encompassing the natural and social sciences, such as physics, biology, economics, and sociology. Leveraging data science techniques, particularly those rooted in artificial intelligence and machine learning, offers a promising avenue for comprehending the intricacies of complex systems without necessitating detailed knowledge of underlying dynamics. In this paper, we demonstrate that multiscale entropy (MSE) is pivotal in describing the steady state of complex systems. Introducing the multiscale entropy dynamics (MED) methodology, we provide a framework for dissecting system dynamics and uncovering the driving forces behind their evolution. Our investigation reveals that the MED methodology facilitates the expression of complex system dynamics through a Generalized Nonlinear Schrödinger Equation (GNSE) that thus demonstrates its potential applicability across diverse complex systems. By elucidating the entropic underpinnings of complexity, our study paves the way for a deeper understanding of dynamic phenomena. It offers insights into the behavior of complex systems across various domains.

A Novel Metric for Alzheimer's Disease Detection Based on Brain Complexity Analysis via Multiscale Fuzzy Entropy

Alzheimer's disease (AD) is a neurodegenerative brain disorder that affects cognitive functioning and memory. Current diagnostic tools, including neuroimaging techniques and cognitive questionnaires, present limitations such as invasiveness, high costs, and subjectivity. In recent years, interest has grown in using electroencephalography (EEG) for AD detection due to its non-invasiveness, low cost, and high temporal resolution. In this regard, this work introduces a novel metric for AD detection by using multiscale fuzzy entropy (MFE) to assess brain complexity, offering clinicians an objective, cost-effective diagnostic tool to aid early intervention and patient care. To this purpose, brain entropy patterns in different frequency bands for 35 healthy subjects (HS) and 35 AD patients were investigated. Then, based on the resulting MFE values, a specific detection algorithm, able to assess brain complexity abnormalities that are typical of AD, was developed and further validated on 24 EEG test recordings. This MFE-based method achieved an accuracy of 83% in differentiating between HS and AD, with a diagnostic odds ratio of 25, and a Matthews correlation coefficient of 0.67, indicating its viability for AD diagnosis. Furthermore, the algorithm showed potential for identifying anomalies in brain complexity when tested on a subject with mild cognitive impairment (MCI), warranting further investigation in future research.

Research on Pig Sound Recognition Based on Deep Neural Network and Hidden Markov Models

In order to solve the problem of low recognition accuracy of traditional pig sound recognition methods, deep neural network (DNN) and Hidden Markov Model (HMM) theory were used as the basis of pig sound signal recognition in this study. In this study, the sounds made by 10 landrace pigs during eating, estrus, howling, humming and panting were collected and preprocessed by Kalman filtering and an improved endpoint detection algorithm based on empirical mode decomposition-Teiger energy operator (EMD-TEO) cepstral distance. The extracted 39-dimensional mel-frequency cepstral coefficients (MFCCs) were then used as a dataset for network learning and recognition to build a DNN- and HMM-based sound recognition model for pig states. The results show that in the pig sound dataset, the recognition accuracy of DNN-HMM reaches 83%, which is 22% and 17% higher than that of the baseline models HMM and GMM-HMM, and possesses a better recognition effect. In a sub-dataset of the publicly available dataset AudioSet, DNN-HMM achieves a recognition accuracy of 79%, which is 8% and 4% higher than the classical models SVM and ResNet18, respectively, with better robustness.

Use of Intrinsic Entropy to Assess the Instantaneous Complexity of Thoracoabdominal Movement Patterns to Indicate the Effect of the Iso-Volume Maneuver Trial on the Performance of the Step Test

The recent surge in interest surrounds the analysis of physiological signals with a non-linear dynamic approach. The measurement of entropy serves as a renowned method for indicating the complexity of a signal. However, there is a dearth of research concerning the non-linear dynamic analysis of respiratory signals. Therefore, this study employs a novel method known as intrinsic entropy (IE) to assess the short-term dynamic changes in thoracoabdominal movement patterns, as measured by respiratory inductance plethysmography (RIP), during various states such as resting, step test, recovery, and iso-volume maneuver (IVM) trials. The findings reveal a decrease in IE of thoracic wall movement (TWM) and an increase in IE of abdominal wall movement (AWM) following the IVM trial. This suggests that AWM may dominate the breathing exercise after the IVM trial. Moreover, due to the high temporal resolution of IE, it proves to be a suitable measure for assessing the complexity of thoracoabdominal movement patterns under non-stationary states such as the step test and recovery. The results also demonstrate that the instantaneous complexity of TWM and AWM can effectively capture instantaneous changes during non-stationary states, which may prove valuable in understanding the respiratory mechanism for healthcare purposes in daily life.

Multiscale relevance of natural images

We use an agnostic information-theoretic approach to investigate the statistical properties of natural images. We introduce the Multiscale Relevance (MSR) measure to assess the robustness of images to compression at all scales. Starting in a controlled environment, we characterize the MSR of synthetic random textures as function of image roughness [Formula: see text] and other relevant parameters. We then extend the analysis to natural images and find striking similarities with critical ([Formula: see text]) random textures. We show that the MSR is more robust and informative of image content than classical methods such as power spectrum analysis. Finally, we confront the MSR to classical measures for the calibration of common procedures such as color mapping and denoising. Overall, the MSR approach appears to be a good candidate for advanced image analysis and image processing, while providing a good level of physical interpretability.

Associations between spontaneous electroencephalogram oscillations and oxygen saturation across normobaric and hypobaric hypoxia

High-altitude indoctrination (HAI) trains individuals to recognize symptoms of hypoxia by simulating high-altitude conditions using normobaric (NH) or hypobaric (HH) hypoxia. Previous studies suggest that despite equivalent inspired oxygen levels, physiological differences could exist between these conditions. In particular, differences in neurophysiological responses to these conditions are not clear. Our study aimed to investigate correlations between oxygen saturation (SpO₂ ) and neural responses in NH and HH. We recorded 5-min of resting-state eyes-open electroencephalogram (EEG) and SpO₂ during control, NH, and HH conditions from 13 participants. We applied a multivariate framework to characterize correlations between SpO₂ and EEG measures (spectral power and multiscale entropy [MSE]), within each participant and at the group level. Participants were desaturating during the first 150 s of NH versus steadily desaturated in HH. We considered the entire time interval, first and second half intervals, separately. All the conditions were characterized by statistically significant participant-specific patterns of EEG-SpO₂ correlations. However, at the group level, the desaturation period expressed a robust pattern of these correlations across frequencies and brain locations. Specifically, the first 150 s of NH during desaturation differed significantly from the other conditions with negative absolute alpha power-SpO₂ correlations and positive MSE-SpO₂ correlations. Once steadily desaturated, NH and HH had no significant differences in EEG-SpO₂ correlations. Our findings indicate that the desaturating phase of hypoxia is a critical period in HAI courses, which would require developing strategies for mitigating the hypoxic stimulus in a real-world situation.

On the Genuine Relevance of the Data-Driven Signal Decomposition-Based Multiscale Permutation Entropy

Ordinal pattern-based approaches have great potential to capture intrinsic structures of dynamical systems, and therefore, they continue to be developed in various research fields. Among these, the permutation entropy (PE), defined as the Shannon entropy of ordinal probabilities, is an attractive time series complexity measure. Several multiscale variants (MPE) have been proposed in order to bring out hidden structures at different time scales. Multiscaling is achieved by combining linear or nonlinear preprocessing with PE calculation. However, the impact of such a preprocessing on the PE values is not fully characterized. In a previous study, we have theoretically decoupled the contribution of specific signal models to the PE values from that induced by the inner correlations of linear preprocessing filters. A variety of linear filters such as the autoregressive moving average (ARMA), Butterworth, and Chebyshev were tested. The current work is an extension to nonlinear preprocessing and especially to data-driven signal decomposition-based MPE. The empirical mode decomposition, variational mode decomposition, singular spectrum analysis-based decomposition and empirical wavelet transform are considered. We identify possible pitfalls in the interpretation of PE values induced by these nonlinear preprocessing, and hence, we contribute to improving the PE interpretation. The simulated dataset of representative processes such as white Gaussian noise, fractional Gaussian processes, ARMA models and synthetic sEMG signals as well as real-life sEMG signals are tested.

PV System Failures Diagnosis Based on Multiscale Dispersion Entropy

Photovoltaic (PV) system diagnosis is a growing research domain likewise solar energy's ongoing significant expansion. Indeed, efficient Fault Detection and Diagnosis (FDD) tools are crucial to guarantee reliability, avoid premature aging and improve the profitability of PV plants. In this paper, an on-line diagnosis method using the PV plant electrical output is presented. This entirely signal-based method combines variational mode decomposition (VMD) and multiscale dispersion entropy (MDE) for the purpose of detecting and isolating faults in a real grid-connected PV plant. The present method seeks a low-cost design, an ease of implementation and a low computation cost. Taking into account the innovation of applying these techniques to PV FDD, the VMD and MDE procedures as well as parameters identification are carefully detailed. The proposed FFD approach performance is assessed on a real rooftop PV plant with experimentally induced faults, and the first results reveal the MDE approach has good suitability for PV plants diagnosis.

Quantification of Small-Scale Heterogeneity at the Core–Mantle Boundary Using Sample Entropy of SKS and SPdKS Synthetic Waveforms

Qualitative and quantitative analysis of seismic waveforms sensitive to the core–mantle boundary (CMB) region reveal the presence of ultralow-velocity zones (ULVZs) that have a strong decrease in compressional (P) and shear (S) wave velocity, and an increase in density within thin structures. However, understanding their physical origin and relation to the other large-scale structures in the lowermost mantle are limited due to an incomplete mapping of ULVZs at the CMB. The SKS and SPdKS seismic waveforms is routinely used to infer ULVZ presence, but has thus far only been used in a limited epicentral distance range. As the SKS/SPdKS wavefield interacts with a ULVZ it generates additional seismic arrivals, thus increasing the complexity of the recorded wavefield. Here, we explore utilization of the multi-scale sample entropy method to search for ULVZ structures. We investigate the feasibility of this approach through analysis of synthetic seismograms computed for PREM, 1-, 2.5-, and 3-D ULVZs as well as heterogeneous structures with a strong increase in velocity in the lowermost mantle in 1- and 2.5-D. We find that the sample entropy technique may be useful across a wide range of epicentral distances from 100° to 130°. Such an analysis, when applied to real waveforms, could provide coverage of roughly 85% by surface area of the CMB.

Acute Effects of Various Movement Noise in Differential Learning of Rope Skipping on Brain and Heart Recovery Analyzed by Means of Multiscale Fuzzy Measure Entropy

In search of more detailed explanations for body-mind interactions in physical activity, neural and physiological effects, especially regarding more strenuous sports activities, increasingly attract interest. Little is known about the underlying manifold (neuro-)physiological impacts induced by different motor learning approaches. The various influences on brain or cardiac function are usually studied separately and modeled linearly. Limitations of these models have recently led to a rapidly growing application of nonlinear models. This study aimed to investigate the acute effects of various sequences of rope skipping on irregularity of the electrocardiography (ECG) and electroencephalography (EEG) signals as well as their interaction and whether these depend on different levels of active movement noise, within the framework of differential learning theory. Thirty-two males were randomly and equally distributed to one of four rope skipping conditions with similar cardiovascular but varying coordinative demand. ECG and EEG were measured simultaneously at rest before and immediately after rope skipping for 25 mins. Signal irregularity of ECG and EEG was calculated via the multiscale fuzzy measure entropy (MSFME). Statistically significant ECG and EEG brain area specific changes in MSFME were found with different pace of occurrence depending on the level of active movement noise of the particular rope skipping condition. Interaction analysis of ECG and EEG MSFME specifically revealed an involvement of the frontal, central, and parietal lobe in the interplay with the heart. In addition, the number of interaction effects indicated an inverted U-shaped trend presenting the interaction level of ECG and EEG MSFME dependent on the level of active movement noise. In summary, conducting rope skipping with varying degrees of movement variation appears to affect the irregularity of cardiac and brain signals and their interaction during the recovery phase differently. These findings provide enough incentives to foster further constructive nonlinear research in exercise-recovery relationship and to reconsider the philosophy of classical endurance training.

Coarse-graining and the Haar wavelet transform for multiscale analysis

BACKGROUND

Multiscale entropy (MSE) has become increasingly common as a quantitative tool for analysis of physiological signals. The MSE computation involves first decomposing a signal into multiple sub-signal 'scales' using a coarse-graining algorithm.

METHODS

The coarse-graining algorithm averages adjacent values in a time series to produce a coarser scale time series. The Haar wavelet transform convolutes a time series with a scaled square wave function to produce an approximation which is equivalent to averaging points.

RESULTS

Coarse-graining is mathematically identical to the Haar wavelet transform approximations. Thus, multiscale entropy is entropy computed on sub-signals derived from approximations of the Haar wavelet transform. By describing coarse-graining algorithms properly as Haar wavelet transforms, the meaning of 'scales' as wavelet approximations becomes transparent. The computed value of entropy is different with different wavelet basis functions, suggesting further research is needed to determine optimal methods for computing multiscale entropy.

CONCLUSION

Coarse-graining is mathematically identical to Haar wavelet approximations at power-of-two scales. Referring to coarse-graining as a Haar wavelet transform motivates research into the optimal approach to signal decomposition for entropy analysis.

An Intelligent Control Model of Credit Line Computing in Intelligence Health-Care Systems

Technologies such as machine learning and artificial intelligence have brought about a tremendous change to biomedical computing and intelligence health care. As a principal component of the intelligence healthcare system, the hospital information system (HIS) has provided great convenience to hospitals and patients, but incidents of leaking private information of patients through HIS occasionally occur at times. Therefore, it is necessary to properly control excessive access behavior. To reduce the risk of patient privacy leakage when medical data are accessed, this article proposes a dynamic permission intelligent access control model that introduces credit line calculation. According to the target given by the doctor in HIS and the actual access record, the International Classification of Diseases (ICD)-10 code is used to describe the degree of correlation, and the rationality of the access is formally described by a mathematical formula. The concept of intelligence healthcare credit lines is redefined with relevance and time Windows. The access control policy matches the corresponding credit limit and credit interval according to the authorization rules to achieve the purpose of intelligent control. Finally, with the actual data provided by a Grade-III Level-A hospital in Kunming, the program code is written through machine learning and biomedical computing-related technologies to complete the experimental test. The experiment proves that the intelligent access control model based on credit computing proposed in this study can play a role in protecting the privacy of patients to a certain extent.

Brain Dynamics Altered by Photic Stimulation in Patients with Alzheimer's Disease and Mild Cognitive Impairment

Individuals with mild cognitive impairment (MCI) are at high risk of developing Alzheimer's disease (AD). Repetitive photic stimulation (PS) is commonly used in routine electroencephalogram (EEG) examinations for rapid assessment of perceptual functioning. This study aimed to evaluate neural oscillatory responses and nonlinear brain dynamics under the effects of PS in patients with mild AD, moderate AD, severe AD, and MCI, as well as healthy elderly controls (HC). EEG power ratios during PS were estimated as an index of oscillatory responses. Multiscale sample entropy (MSE) was estimated as an index of brain dynamics before, during, and after PS. During PS, EEG harmonic responses were lower and MSE values were higher in the AD subgroups than in HC and MCI groups. PS-induced changes in EEG complexity were less pronounced in the AD subgroups than in HC and MCI groups. Brain dynamics revealed a "transitional change" between MCI and Mild AD. Our findings suggest a deficiency in brain adaptability in AD patients, which hinders their ability to adapt to repetitive perceptual stimulation. This study highlights the importance of combining spectral and nonlinear dynamical analysis when seeking to unravel perceptual functioning and brain adaptability in the various stages of neurodegenerative diseases.