1
|
Huang Y, Zhao Y, Capstick A, Palermo F, Haddadi H, Barnaghi P. Analyzing entropy features in time-series data for pattern recognition in neurological conditions. Artif Intell Med 2024; 150:102821. [PMID: 38553161 DOI: 10.1016/j.artmed.2024.102821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Revised: 02/14/2024] [Accepted: 02/21/2024] [Indexed: 04/02/2024]
Abstract
In the field of medical diagnosis and patient monitoring, effective pattern recognition in neurological time-series data is essential. Traditional methods predominantly based on statistical or probabilistic learning and inference often struggle with multivariate, multi-source, state-varying, and noisy data while also posing privacy risks due to excessive information collection and modeling. Furthermore, these methods often overlook critical statistical information, such as the distribution of data points and inherent uncertainties. To address these challenges, we introduce an information theory-based pipeline that leverages specialized features to identify patterns in neurological time-series data while minimizing privacy risks. We incorporate various entropy methods based on the characteristics of different scenarios and entropy. For stochastic state transition applications, we incorporate Shannon's entropy, entropy rates, entropy production, and the von Neumann entropy of Markov chains. When state modeling is impractical, we select and employ approximate entropy, increment entropy, dispersion entropy, phase entropy, and slope entropy. The pipeline's effectiveness and scalability are demonstrated through pattern analysis in a dementia care dataset and also an epileptic and a myocardial infarction dataset. The results indicate that our information theory-based pipeline can achieve average performance improvements across various models on the recall rate, F1 score, and accuracy by up to 13.08 percentage points, while enhancing inference efficiency by reducing the number of model parameters by an average of 3.10 times. Thus, our approach opens a promising avenue for improved, efficient, and critical statistical information-considered pattern recognition in medical time-series data.
Collapse
Affiliation(s)
- Yushan Huang
- Dyson School of Design Engineering, Imperial College London, London, UK; Great Ormond Street Hospital for Children, London, UK
| | - Yuchen Zhao
- Department of Computer Science, University of York, York, UK
| | - Alexander Capstick
- Department of Brain Sciences, Imperial College London, London, UK; Great Ormond Street Hospital for Children, London, UK
| | - Francesca Palermo
- Department of Brain Sciences, Imperial College London, London, UK; Great Ormond Street Hospital for Children, London, UK
| | - Hamed Haddadi
- Department of Computing, Imperial College London, London, UK
| | - Payam Barnaghi
- Department of Brain Sciences, Imperial College London, London, UK; The Great Ormond Street Institute of Child Health, University College London, London, UK; Great Ormond Street Hospital for Children, London, UK; Care Research and Technology Centre, The UK Dementia Research Institute, London, UK.
| |
Collapse
|
2
|
Li Y, Gu Z, Fan X. Research on Sea State Signal Recognition Based on Beluga Whale Optimization-Slope Entropy and One Dimensional-Convolutional Neural Network. SENSORS (BASEL, SWITZERLAND) 2024; 24:1680. [PMID: 38475216 DOI: 10.3390/s24051680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/17/2023] [Revised: 02/18/2024] [Accepted: 03/02/2024] [Indexed: 03/14/2024]
Abstract
This study introduces a novel nonlinear dynamic analysis method, known as beluga whale optimization-slope entropy (BWO-SlEn), to address the challenge of recognizing sea state signals (SSSs) in complex marine environments. A method of underwater acoustic signal recognition based on BWO-SlEn and one-dimensional convolutional neural network (1D-CNN) is proposed. Firstly, particle swarm optimization-slope entropy (PSO-SlEn), BWO-SlEn, and Harris hawk optimization-slope entropy (HHO-SlEn) were used for feature extraction of noise signal and SSS. After 1D-CNN classification, BWO-SlEn were found to have the best recognition effect. Secondly, fuzzy entropy (FE), sample entropy (SE), permutation entropy (PE), and dispersion entropy (DE) were used to extract the signal features. After 1D-CNN classification, BWO-SlEn and 1D-CNN were found to have the highest recognition rate compared with them. Finally, compared with the other six recognition methods, the recognition rates of BWO-SlEn and 1D-CNN for the noise signal and SSS are at least 6% and 4.75% higher, respectively. Therefore, the BWO-SlEn and 1D-CNN recognition methods proposed in this paper are more effective in the application of SSS recognition.
Collapse
Affiliation(s)
- Yuxing Li
- School of Automation and Information Engineering, Xi'an University of Technology, Xi'an 710048, China
- Shaanxi Key Laboratory of Complex System Control and Intelligent Information Processing, Xi'an University of Technology, Xi'an 710048, China
| | - Zhaoyu Gu
- School of Automation and Information Engineering, Xi'an University of Technology, Xi'an 710048, China
| | - Xiumei Fan
- School of Automation and Information Engineering, Xi'an University of Technology, Xi'an 710048, China
| |
Collapse
|
3
|
Kouka M, Cuesta-Frau D, Moltó-Gallego V. Slope Entropy Characterisation: An Asymmetric Approach to Threshold Parameters Role Analysis. ENTROPY (BASEL, SWITZERLAND) 2024; 26:82. [PMID: 38248207 PMCID: PMC10814979 DOI: 10.3390/e26010082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 01/15/2024] [Accepted: 01/15/2024] [Indexed: 01/23/2024]
Abstract
Slope Entropy (SlpEn) is a novel method recently proposed in the field of time series entropy estimation. In addition to the well-known embedded dimension parameter, m, used in other methods, it applies two additional thresholds, denoted as δ and γ, to derive a symbolic representation of a data subsequence. The original paper introducing SlpEn provided some guidelines for recommended specific values of these two parameters, which have been successfully followed in subsequent studies. However, a deeper understanding of the role of these thresholds is necessary to explore the potential for further SlpEn optimisations. Some works have already addressed the role of δ, but in this paper, we extend this investigation to include the role of γ and explore the impact of using an asymmetric scheme to select threshold values. We conduct a comparative analysis between the standard SlpEn method as initially proposed and an optimised version obtained through a grid search to maximise signal classification performance based on SlpEn. The results confirm that the optimised version achieves higher time series classification accuracy, albeit at the cost of significantly increased computational complexity.
Collapse
Affiliation(s)
- Mahdy Kouka
- Department of System Informatics and Computers, Universitat Politècnica de València, 03801 Alcoy, Spain; (M.K.); (V.M.-G.)
| | - David Cuesta-Frau
- Department of System Informatics and Computers, Universitat Politècnica de València, 03801 Alcoy, Spain; (M.K.); (V.M.-G.)
- Technological Institute of Informatics, Universitat Politècnica de València, 03801 Alcoy, Spain
| | - Vicent Moltó-Gallego
- Department of System Informatics and Computers, Universitat Politècnica de València, 03801 Alcoy, Spain; (M.K.); (V.M.-G.)
| |
Collapse
|
4
|
Yu Z, Zhang L, Kim J. The Performance Analysis of PSO-ResNet for the Fault Diagnosis of Vibration Signals Based on the Pipeline Robot. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23094289. [PMID: 37177498 PMCID: PMC10181494 DOI: 10.3390/s23094289] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Accepted: 04/23/2023] [Indexed: 05/15/2023]
Abstract
In the context of pipeline robots, the timely detection of faults is crucial in preventing safety incidents. In order to ensure the reliability and safety of the entire application process, robots' fault diagnosis techniques play a vital role. However, traditional diagnostic methods for motor drive end-bearing faults in pipeline robots are often ineffective when the operating conditions are variable. An efficient solution for fault diagnosis is the application of deep learning algorithms. This paper proposes a rolling bearing fault diagnosis method (PSO-ResNet) that combines a Particle Swarm Optimization algorithm (PSO) with a residual network. A number of vibration signal sensors are placed at different locations in the pipeline robot to obtain vibration signals from different parts. The input to the PSO-ResNet algorithm is a two-bit image obtained by continuous wavelet transform of the vibration signal. The accuracy of this fault diagnosis method is compared with different types of fault diagnosis algorithms, and the experimental analysis shows that PSO-ResNet has higher accuracy. The algorithm was also deployed on an Nvidia Jetson Nano and a Raspberry Pi 4B. Through comparative experimental analysis, the proposed fault diagnosis algorithm was chosen to be deployed on the Nvidia Jetson Nano and used as the core fault diagnosis control unit of the pipeline robot for practical scenarios. However, the PSO-ResNet model needs further improvement in terms of accuracy, which is the focus of future research work.
Collapse
Affiliation(s)
- Zhaotao Yu
- School of Mechanical, Electrical and Information Engineering, Shandong University, Weihai 264200, China
| | - Liang Zhang
- School of Mechanical, Electrical and Information Engineering, Shandong University, Weihai 264200, China
- WeiHai Research Institute of Industrial Technology of Shandong University, 180 Wenhua Xilu, Shandong University, Weihai 264209, China
| | - Jongwon Kim
- Department of Electromechanical Convergence Engineering, Korea University of Technology and Education, Cheonan-si 31253, Republic of Korea
| |
Collapse
|
5
|
Armah M, Bossman A, Amewu G. Information flow between global financial market stress and African equity markets: An EEMD-based transfer entropy analysis. Heliyon 2023; 9:e13899. [PMID: 36895379 PMCID: PMC9988586 DOI: 10.1016/j.heliyon.2023.e13899] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 02/07/2023] [Accepted: 02/15/2023] [Indexed: 02/24/2023] Open
Abstract
The flow of information between markets is important to guide investors and policymakers in the effective allocation of assets and proactive market regulation, respectively. This study examines the impact of information flow from global financial market stress on the African stock markets using the daily US financial stress index (USFSI) and other advanced economies' financial stress index (OAEFSI) to proxy the global financial stress index. To understand the information flow dynamics across various investment horizons, the ensemble empirical mode decomposition (EEMD)-based transfer entropy is employed. Our findings reveal that African equity markets are highly risky for information flow from global financial market stress. However, we identify diversification prospects based on market conditions for Ghana and Egypt in the short term and Tanzania, Cote D'Ivoire, and Egypt in the medium term. Empirical results also show that the information flow from global financial stress to African stock markets depends on time scales, economic relations, and the state of global financial markets. The findings are important for investors, portfolio managers, practitioners, and policymakers.
Collapse
Affiliation(s)
- Mohammed Armah
- Department of Accounting and Finance, School of Business, Ghana Institute of Management and Public Administration (GIMPA), Achimota, Ghana
| | - Ahmed Bossman
- Department of Finance, School of Business, CC-191-7613, University of Cape Coast, Cape Coast, Ghana
| | - Godfred Amewu
- Department of Finance, School of Business, University of Ghana, Legon, Ghana
| |
Collapse
|
6
|
Gong Z. Novel entropy and distance measures of linguistic interval-valued q-Rung orthopair fuzzy sets. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2023. [DOI: 10.3233/jifs-223729] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/19/2023]
Abstract
Entropy is an important tool to describe the degree of uncertainty of fuzzy sets. In this study, we first define a new entropy and distance measure in the linguistic q-Rung orthopair fuzzy (LIVqROF) environment, and verify its correctness and rationality. Secondly, in the LIVqROF environment, the new entropy formula is effectively applied to the multi-attribute decision making (MADM) with unknown attribute weights, which provides a new idea for solving the MADM problems. Finally, the feasibility and effectiveness of the proposed method are verified by a numerical example.
Collapse
Affiliation(s)
- Zhiwei Gong
- College of Computer and Information Sciences, Fujian Agriculture and Forestry University, Fuzhou, Fujian, P.R. China
| |
Collapse
|
7
|
Cuesta-Frau D, Kouka M, Silvestre-Blanes J, Sempere-Payá V. Slope Entropy Normalisation by Means of Analytical and Heuristic Reference Values. ENTROPY (BASEL, SWITZERLAND) 2022; 25:66. [PMID: 36673207 PMCID: PMC9858583 DOI: 10.3390/e25010066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/04/2022] [Revised: 12/22/2022] [Accepted: 12/23/2022] [Indexed: 06/17/2023]
Abstract
Slope Entropy (SlpEn) is a very recently proposed entropy calculation method. It is based on the differences between consecutive values in a time series and two new input thresholds to assign a symbol to each resulting difference interval. As the histogram normalisation value, SlpEn uses the actual number of unique patterns found instead of the theoretically expected value. This maximises the information captured by the method but, as a consequence, SlpEn results do not usually fall within the classical [0,1] interval. Although this interval is not necessary at all for time series classification purposes, it is a convenient and common reference framework when entropy analyses take place. This paper describes a method to keep SlpEn results within this interval, and improves the interpretability and comparability of this measure in a similar way as for other methods. It is based on a max-min normalisation scheme, described in two steps. First, an analytic normalisation is proposed using known but very conservative bounds. Afterwards, these bounds are refined using heuristics about the behaviour of the number of patterns found in deterministic and random time series. The results confirm the suitability of the approach proposed, using a mixture of the two methods.
Collapse
Affiliation(s)
- David Cuesta-Frau
- Technological Institute of Informatics (ITI), Universitat Politècnica de València, Alcoi Campus, 03801 Alcoi, Spain
| | - Mahdy Kouka
- Department of System Informatics and Computers, Universitat Politècnica de València, 46022 Valencia, Spain
| | - Javier Silvestre-Blanes
- Technological Institute of Informatics (ITI), Universitat Politècnica de València, Alcoi Campus, 03801 Alcoi, Spain
| | - Víctor Sempere-Payá
- Technological Institute of Informatics (ITI), Universitat Politècnica de València, Alcoi Campus, 03801 Alcoi, Spain
| |
Collapse
|
8
|
Load Balancing Algorithms for Hadoop Cluster in Unbalanced Environment. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:1545024. [PMID: 36248928 PMCID: PMC9568311 DOI: 10.1155/2022/1545024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 09/12/2022] [Accepted: 09/16/2022] [Indexed: 11/25/2022]
Abstract
Considering that in the process of job scheduling, the cluster load should be prebalanced rather than remedied when the load is seriously unbalanced; therefore, in this paper, the task scheduling flow of the Hadoop cluster is analyzed deeply. On the Hadoop platform, a self-dividing algorithm is proposed for load balancing. An intelligent optimization algorithm is used to solve load balance. A dynamic feedback load balancing scheduling method is proposed from the point of view of task scheduling. In order to solve the shortcoming of the fair scheduling algorithm, this paper proposes two ways to improve the resource utilization and overall performance of Hadoop. When the mapping task is completed and the tasks to be reduced are assigned, the task assignment is based on the performance of the nodes to be reduced. It gives full play to the advantages of the ant colony algorithm and the hive colony algorithm so that the fusion algorithm can better deal with load balance. Then, three existing scheduling algorithms are introduced in detail: single queue scheduling, capacity scheduling, and fair scheduling. On this basis, an improved task scheduling strategy based on genetic algorithm is proposed to allocate and execute application tasks to reduce task completion time. The experiment verifies the effectiveness of the algorithm. The LBNP algorithm greatly improves the efficiency of reducing task execution and job execution. The delay capacity scheduling algorithm can ensure that most tasks can achieve localization scheduling, improve resource utilization, improve load balance, and speed up job completion time.
Collapse
|
9
|
Li Y, Tang B, Jiao S. Optimized Ship-Radiated Noise Feature Extraction Approaches Based on CEEMDAN and Slope Entropy. ENTROPY (BASEL, SWITZERLAND) 2022; 24:e24091265. [PMID: 36141150 PMCID: PMC9497670 DOI: 10.3390/e24091265] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/18/2022] [Revised: 09/04/2022] [Accepted: 09/06/2022] [Indexed: 05/28/2023]
Abstract
Slope entropy (Slopen) has been demonstrated to be an excellent approach to extracting ship-radiated noise signals (S-NSs) features by analyzing the complexity of the signals; however, its recognition ability is limited because it extracts the features of undecomposed S-NSs. To solve this problem, in this study, we combined complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) to explore the differences of Slopen between the intrinsic mode components (IMFs) of the S-NSs and proposed a single-IMF optimized feature extraction approach. Aiming to further enhance its performance, the optimized combination of dual-IMFs was selected, and a dual-IMF optimized feature extraction approach was also proposed. We conducted three experiments to demonstrate the effectiveness of CEEMDAN, Slopen, and the proposed approaches. The experimental and comparative results revealed both of the proposed single- and dual-IMF optimized feature extraction approaches based on Slopen and CEEMDAN to be more effective than the original ship signal-based and IMF-based feature extraction approaches.
Collapse
Affiliation(s)
- Yuxing Li
- School of Automation and Information Engineering, Xi’an University of Technology, Xi’an 710048, China
- Shaanxi Key Laboratory of Complex System Control and Intelligent Information Processing, Xi’an University of Technology, Xi’an 710048, China
| | - Bingzhao Tang
- School of Automation and Information Engineering, Xi’an University of Technology, Xi’an 710048, China
| | - Shangbin Jiao
- School of Automation and Information Engineering, Xi’an University of Technology, Xi’an 710048, China
- Shaanxi Key Laboratory of Complex System Control and Intelligent Information Processing, Xi’an University of Technology, Xi’an 710048, China
| |
Collapse
|
10
|
Xue L, Zeng X, Jin A. A Novel Deep-Learning Method with Channel Attention Mechanism for Underwater Target Recognition. SENSORS (BASEL, SWITZERLAND) 2022; 22:5492. [PMID: 35897996 PMCID: PMC9331384 DOI: 10.3390/s22155492] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 07/20/2022] [Accepted: 07/21/2022] [Indexed: 06/15/2023]
Abstract
The core of underwater acoustic recognition is to extract the spectral features of targets. The running speed and track of the targets usually result in a Doppler shift, which poses significant challenges for recognizing targets with different Doppler frequencies. This paper proposes deep learning with a channel attention mechanism approach for underwater acoustic recognition. It is based on three crucial designs. Feature structures can obtain high-dimensional underwater acoustic data. The feature extraction model is the most important. First, we develop a ResNet to extract the deep abstraction spectral features of the targets. Then, the channel attention mechanism is introduced in the camResNet to enhance the energy of stable spectral features of residual convolution. This is conducive to subtly represent the inherent characteristics of the targets. Moreover, a feature classification approach based on one-dimensional convolution is applied to recognize targets. We evaluate our approach on challenging data containing four kinds of underwater acoustic targets with different working conditions. Our experiments show that the proposed approach achieves the best recognition accuracy (98.2%) compared with the other approaches. Moreover, the proposed approach is better than the ResNet with a widely used channel attention mechanism for data with different working conditions.
Collapse
|