1
|
Rakhmatulin I, Dao MS, Nassibi A, Mandic D. Exploring Convolutional Neural Network Architectures for EEG Feature Extraction. SENSORS (BASEL, SWITZERLAND) 2024; 24:877. [PMID: 38339594 PMCID: PMC10856895 DOI: 10.3390/s24030877] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 01/12/2024] [Accepted: 01/20/2024] [Indexed: 02/12/2024]
Abstract
The main purpose of this paper is to provide information on how to create a convolutional neural network (CNN) for extracting features from EEG signals. Our task was to understand the primary aspects of creating and fine-tuning CNNs for various application scenarios. We considered the characteristics of EEG signals, coupled with an exploration of various signal processing and data preparation techniques. These techniques include noise reduction, filtering, encoding, decoding, and dimension reduction, among others. In addition, we conduct an in-depth analysis of well-known CNN architectures, categorizing them into four distinct groups: standard implementation, recurrent convolutional, decoder architecture, and combined architecture. This paper further offers a comprehensive evaluation of these architectures, covering accuracy metrics, hyperparameters, and an appendix that contains a table outlining the parameters of commonly used CNN architectures for feature extraction from EEG signals.
Collapse
Affiliation(s)
- Ildar Rakhmatulin
- Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK; (A.N.)
| | - Minh-Son Dao
- National Institute of Information and Communications Technology (NICT), Tokyo 184-0015, Japan
| | - Amir Nassibi
- Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK; (A.N.)
| | - Danilo Mandic
- Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK; (A.N.)
| |
Collapse
|
2
|
Esmaiel H, Xie D, Qasem ZAH, Sun H, Qi J, Wang J. Multi-Stage Feature Extraction and Classification for Ship-Radiated Noise. SENSORS (BASEL, SWITZERLAND) 2021; 22:112. [PMID: 35009653 PMCID: PMC8747422 DOI: 10.3390/s22010112] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 12/21/2021] [Accepted: 12/22/2021] [Indexed: 06/14/2023]
Abstract
Due to the complexity and unique features of the hydroacoustic channel, ship-radiated noise (SRN) detected using a passive sonar tends mostly to distort. SRN feature extraction has been proposed to improve the detected passive sonar signal. Unfortunately, the current methods used in SRN feature extraction have many shortcomings. Considering this, in this paper we propose a new multi-stage feature extraction approach to enhance the current SRN feature extractions based on enhanced variational mode decomposition (EVMD), weighted permutation entropy (WPE), local tangent space alignment (LTSA), and particle swarm optimization-based support vector machine (PSO-SVM). In the proposed method, first, we enhance the decomposition operation of the conventional VMD by decomposing the SRN signal into a finite group of intrinsic mode functions (IMFs) and then calculate the WPE of each IMF. Then, the high-dimensional features obtained are reduced to two-dimensional ones by using the LTSA method. Finally, the feature vectors are fed into the PSO-SVM multi-class classifier to realize the classification of different types of SRN sample. The simulation and experimental results demonstrate that the recognition rate of the proposed method overcomes the conventional SRN feature extraction methods, and it has a recognition rate of up to 96.6667%.
Collapse
Affiliation(s)
- Hamada Esmaiel
- Department of Information and Communication, School of Informatics, Xiamen University, Xiamen 316005, China; (H.E.); (Z.A.H.Q.)
- Electrical Engineering Department, Faculty of Engineering, Aswan University, Aswan 81542, Egypt
| | - Dongri Xie
- China Electronics Technology Avionics Co., Ltd., Chengdu 610100, China;
| | - Zeyad A. H. Qasem
- Department of Information and Communication, School of Informatics, Xiamen University, Xiamen 316005, China; (H.E.); (Z.A.H.Q.)
| | - Haixin Sun
- Department of Information and Communication, School of Informatics, Xiamen University, Xiamen 316005, China; (H.E.); (Z.A.H.Q.)
| | - Jie Qi
- School of Electronic Science and Engineering, Xiamen University, Xiamen 361005, China;
| | - Junfeng Wang
- Department of Information and Communication Engineering, School of Electrical and Electronic Engineering, Tianjin University of Technology, Tianjin 300383, China;
| |
Collapse
|
3
|
Xie Y, Yu J, Chen X, Ding Q, Wang E. Low-Element Image Restoration Based on an Out-of-Order Elimination Algorithm. ENTROPY 2019. [PMCID: PMC7514537 DOI: 10.3390/e21121192] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
To reduce the consumption of receiving devices, a number of devices at the receiving end undergo low-element treatment (the number of devices at the receiving end is less than that at the transmitting ends). The underdetermined blind-source separation system is a classic low-element model at the receiving end. Blind signal extraction in an underdetermined system remains an ill-posed problem, as it is difficult to extract all the source signals. To realize fewer devices at the receiving end without information loss, this paper proposes an image restoration method for underdetermined blind-source separation based on an out-of-order elimination algorithm. Firstly, a chaotic system is used to perform hidden transmission of source signals, where the source signals can hardly be observed and confidentiality is guaranteed. Secondly, empirical mode decomposition is used to decompose and complement the missing observed signals, and the fast independent component analysis (FastICA) algorithm is used to obtain part of the source signals. Finally, all the source signals are successfully separated using the out-of-order elimination algorithm and the FastICA algorithm. The results show that the performance of the underdetermined blind separation algorithm is related to the configuration of the transceiver antenna. When the signal is 3 × 4 antenna configuration, the algorithm in this paper is superior to the comparison algorithm in signal recovery, and its separation performance is better for a lower degree of missing array elements. The end result is that the algorithms discussed in this paper can effectively and completely extract all the source signals.
Collapse
Affiliation(s)
- Yaqin Xie
- Electronic Engineering College, Heilongjiang University, Harbin 150080, China; (Y.X.); (J.Y.); (Q.D.)
| | - Jiayin Yu
- Electronic Engineering College, Heilongjiang University, Harbin 150080, China; (Y.X.); (J.Y.); (Q.D.)
| | - Xinwu Chen
- Communications Research Center, Harbin Institute of Technology, Harbin 150001, China;
| | - Qun Ding
- Electronic Engineering College, Heilongjiang University, Harbin 150080, China; (Y.X.); (J.Y.); (Q.D.)
| | - Erfu Wang
- Electronic Engineering College, Heilongjiang University, Harbin 150080, China; (Y.X.); (J.Y.); (Q.D.)
- Correspondence:
| |
Collapse
|
4
|
A New Underwater Acoustic Signal Denoising Technique Based on CEEMDAN, Mutual Information, Permutation Entropy, and Wavelet Threshold Denoising. ENTROPY 2018; 20:e20080563. [PMID: 33265652 PMCID: PMC7513088 DOI: 10.3390/e20080563] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/01/2018] [Revised: 07/22/2018] [Accepted: 07/25/2018] [Indexed: 11/16/2022]
Abstract
Owing to the complexity of the ocean background noise, underwater acoustic signal denoising is one of the hotspot problems in the field of underwater acoustic signal processing. In this paper, we propose a new technique for underwater acoustic signal denoising based on complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN), mutual information (MI), permutation entropy (PE), and wavelet threshold denoising. CEEMDAN is an improved algorithm of empirical mode decomposition (EMD) and ensemble EMD (EEMD). First, CEEMDAN is employed to decompose noisy signals into many intrinsic mode functions (IMFs). IMFs can be divided into three parts: noise IMFs, noise-dominant IMFs, and real IMFs. Then, the noise IMFs can be identified on the basis of MIs of adjacent IMFs; the other two parts of IMFs can be distinguished based on the values of PE. Finally, noise IMFs were removed, and wavelet threshold denoising is applied to noise-dominant IMFs; we can obtain the final denoised signal by combining real IMFs and denoised noise-dominant IMFs. Simulation experiments were conducted by using simulated data, chaotic signals, and real underwater acoustic signals; the proposed denoising technique performs better than other existing denoising techniques, which is beneficial to the feature extraction of underwater acoustic signal.
Collapse
|
5
|
Arslan MT, Eraldemir SG, Yıldırım E. Subject-Dependent and Subject-Independent Classification of Mental Arithmetic and Silent Reading Tasks. ACTA ACUST UNITED AC 2017. [DOI: 10.29137/umagd.348871] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
6
|
Research on Ship-Radiated Noise Denoising Using Secondary Variational Mode Decomposition and Correlation Coefficient. SENSORS 2017; 18:s18010048. [PMID: 29278380 PMCID: PMC5795591 DOI: 10.3390/s18010048] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/27/2017] [Revised: 12/23/2017] [Accepted: 12/24/2017] [Indexed: 11/17/2022]
Abstract
As the sound signal of ships obtained by sensors contains other many significant characteristics of ships and called ship-radiated noise (SN), research into a denoising algorithm and its application has obtained great significance. Using the advantage of variational mode decomposition (VMD) combined with the correlation coefficient for denoising, a hybrid secondary denoising algorithm is proposed using secondary VMD combined with a correlation coefficient (CC). First, different kinds of simulation signals are decomposed into several bandwidth-limited intrinsic mode functions (IMFs) using VMD, where the decomposition number by VMD is equal to the number by empirical mode decomposition (EMD); then, the CCs between the IMFs and the simulation signal are calculated respectively. The noise IMFs are identified by the CC threshold and the rest of the IMFs are reconstructed in order to realize the first denoising process. Finally, secondary denoising of the simulation signal can be accomplished by repeating the above steps of decomposition, screening and reconstruction. The final denoising result is determined according to the CC threshold. The denoising effect is compared under the different signal-to-noise ratio and the time of decomposition by VMD. Experimental results show the validity of the proposed denoising algorithm using secondary VMD (2VMD) combined with CC compared to EMD denoising, ensemble EMD (EEMD) denoising, VMD denoising and cubic VMD (3VMD) denoising, as well as two denoising algorithms presented recently. The proposed denoising algorithm is applied to feature extraction and classification for SN signals, which can effectively improve the recognition rate of different kinds of ships.
Collapse
|
7
|
A Novel Feature Extraction Method for Ship-Radiated Noise Based on Variational Mode Decomposition and Multi-Scale Permutation Entropy. ENTROPY 2017. [DOI: 10.3390/e19070342] [Citation(s) in RCA: 48] [Impact Index Per Article: 6.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
In view of the problem that the features of ship-radiated noise are difficult to extract and inaccurate, a novel method based on variational mode decomposition (VMD), multi-scale permutation entropy (MPE) and a support vector machine (SVM) is proposed to extract the features of ship-radiated noise. In order to eliminate mode mixing and extract the complexity of the intrinsic mode function (IMF) accurately, VMD is employed to decompose the three types of ship-radiated noise instead of Empirical Mode Decomposition (EMD) and its extended methods. Considering the reason that the permutation entropy (PE) can quantify the complexity only in one scale, the MPE is used to extract features in different scales. In this study, three types of ship-radiated noise signals are decomposed into a set of band-limited IMFs by the VMD method, and the intensity of each IMF is calculated. Then, the IMFs with the highest energy are selected for the extraction of their MPE. By analyzing the separability of MPE at different scales, the optimal MPE of the IMF with the highest energy is regarded as the characteristic vector. Finally, the feature vectors are sent into the SVM classifier to classify and recognize different types of ships. The proposed method was applied in simulated signals and actual signals of ship-radiated noise. By comparing with the PE of the IMF with the highest energy by EMD, ensemble EMD (EEMD) and VMD, the results show that the proposed method can effectively extract the features of MPE and realize the classification and recognition for ships.
Collapse
|
8
|
Isableu B, Hlavackova P, Diot B, Vuillerme N. Regularity of Center of Pressure Trajectories in Expert Gymnasts during Bipedal Closed-Eyes Quiet Standing. Front Hum Neurosci 2017; 11:317. [PMID: 28676748 PMCID: PMC5476688 DOI: 10.3389/fnhum.2017.00317] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2016] [Accepted: 06/02/2017] [Indexed: 12/28/2022] Open
Abstract
We compared postural control of expert gymnasts (G) to that of non-gymnasts (NG) during bipedal closed-eyes quiet standing using conventional and nonlinear dynamical measures of center of foot pressure (COP) trajectories. Earlier findings based on COP classical variables showed that gymnasts exhibited a better control of postural balance but only in demanding stances. We examined whether the effect of expertise in Gymnastic can be uncovered in less demanding stances, from the analysis of the dynamic patterns of COP trajectories. Three dependent variables were computed to describe the subject's postural behavior: the variability of COP displacements (ACoP), the variability of the COP velocities (VCoP) and the sample entropy of COP (SEnCoP) to quantify COP regularity (i.e., predictability). Conventional analysis of COP trajectories showed that NG and G exhibited similar amount and control of postural sway, as indicated by similar ACoP and VCoP values observed in NG and G, respectively. These results suggest that the specialized balance training received by G may not transfer to less challenging balance conditions such as the bipedal eyes-closed stance condition used in the present experiment. Interestingly, nonlinear dynamical analysis of COP trajectories regarding COP regularity showed that G exhibited more irregular COP fluctuations relative to NG, as indicated by the higher SEnCoP values observed for the G than for the NG. The present results showed that a finer-grained analysis of the dynamic patterns of the COP displacements is required to uncover an effect of gymnastic expertise on postural control in nondemanding postural stance. The present findings shed light on the surplus value in the nonlinear dynamical analysis of COP trajectories to gain further insight into the mechanisms involved in the control of bipedal posture.
Collapse
Affiliation(s)
| | - Petra Hlavackova
- Équipe d'Accueil Autonomy, Gerontology, E-health, Imaging & Society, Université Grenoble-AlpesGrenoble, France.,Grenoble Alpes University HospitalGrenoble, France
| | - Bruno Diot
- Équipe d'Accueil Autonomy, Gerontology, E-health, Imaging & Society, Université Grenoble-AlpesGrenoble, France.,Informatique de SécuritéMontceau-les-Mines, France
| | - Nicolas Vuillerme
- Équipe d'Accueil Autonomy, Gerontology, E-health, Imaging & Society, Université Grenoble-AlpesGrenoble, France.,Institut Universitaire de FranceParis, France
| |
Collapse
|
9
|
Hansen C, Wei Q, Shieh JS, Fourcade P, Isableu B, Majed L. Sample Entropy, Univariate, and Multivariate Multi-Scale Entropy in Comparison with Classical Postural Sway Parameters in Young Healthy Adults. Front Hum Neurosci 2017; 11:206. [PMID: 28491029 PMCID: PMC5405138 DOI: 10.3389/fnhum.2017.00206] [Citation(s) in RCA: 42] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2016] [Accepted: 04/07/2017] [Indexed: 12/02/2022] Open
Abstract
The present study aimed to compare various entropy measures to assess the dynamics and complexity of center of pressure (COP) displacements. Perturbing balance tests are often used in healthy subjects to imitate either pathological conditions or to test the sensitivity of postural analysis techniques. Eleven healthy adult subjects were asked to stand in normal stance in three experimental conditions while the visuo-kinesthetic input was altered. COP displacement was recorded using a force plate. Three entropy measures [Sample Entropy (SE), Multi-Scale Entropy (MSE), and Multivariate Multi Scale Entropy (MMSE)] describing COP regularity at different scales were compared to traditional measures of COP variability. The analyses of the COP trajectories revealed that suppression of vision produced minor changes in COP displacement and in the COP characteristics. The comparison with the reference analysis showed that the entropy measures analysis techniques are more sensitive in the incremented time series compared to the classical parameters and entropy measures of original time series. Non-linear methods appear to be an additional valuable tool for analysis of the dynamics of posture especially when applied on incremental time series.
Collapse
Affiliation(s)
- Clint Hansen
- Research Department, Aspetar Qatar Orthopaedic and Sports MedicineDoha, Qatar
| | - Qin Wei
- School of Information Engineering, Wuhan University of TechnologyWuhan, China
| | - Jiann-Shing Shieh
- Department of Mechanical Engineering, Yuan Ze UniversityChung-Li, Taiwan
| | - Paul Fourcade
- URCIAMS - Motor Control and Perception Team, University Paris-SudOrsay, France
| | - Brice Isableu
- PSYCLE, Aix Marseille UniversityAix-en-Provence, France
| | - Lina Majed
- Sport Science Program, College of Arts and Science, Qatar UniversityDoha, Qatar
| |
Collapse
|
10
|
Feature Extraction of Ship-Radiated Noise Based on Permutation Entropy of the Intrinsic Mode Function with the Highest Energy. ENTROPY 2016. [DOI: 10.3390/e18110393] [Citation(s) in RCA: 42] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|