1
|
Arif M, Ur Rehman F, Sekanina L, Malik AS. A comprehensive survey of evolutionary algorithms and metaheuristics in brain EEG-based applications. J Neural Eng 2024; 21:051002. [PMID: 39321840 DOI: 10.1088/1741-2552/ad7f8e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Accepted: 09/25/2024] [Indexed: 09/27/2024]
Abstract
Electroencephalography (EEG) has emerged as a primary non-invasive and mobile modality for understanding the complex workings of the human brain, providing invaluable insights into cognitive processes, neurological disorders, and brain-computer interfaces. Nevertheless, the volume of EEG data, the presence of artifacts, the selection of optimal channels, and the need for feature extraction from EEG data present considerable challenges in achieving meaningful and distinguishing outcomes for machine learning algorithms utilized to process EEG data. Consequently, the demand for sophisticated optimization techniques has become imperative to overcome these hurdles effectively. Evolutionary algorithms (EAs) and other nature-inspired metaheuristics have been applied as powerful design and optimization tools in recent years, showcasing their significance in addressing various design and optimization problems relevant to brain EEG-based applications. This paper presents a comprehensive survey highlighting the importance of EAs and other metaheuristics in EEG-based applications. The survey is organized according to the main areas where EAs have been applied, namely artifact mitigation, channel selection, feature extraction, feature selection, and signal classification. Finally, the current challenges and future aspects of EAs in the context of EEG-based applications are discussed.
Collapse
Affiliation(s)
- Muhammad Arif
- Institute of Networked and Embedded Systems,University of Klagenfurt, 9020 Klagenfurt, Austria
- Ubiquitous Sensing Systems Lab, University of Klagenfurt-Silicon Austria Labs, 9020 Klagenfurt, Austria
| | - Faizan Ur Rehman
- Electrical Engineering Department, Karachi Institute of Economics and Technology, Karachi, Pakistan
| | - Lukas Sekanina
- Faculty of Information Technology, Brno University of Technology, Brno, Czech Republic
| | - Aamir Saeed Malik
- Faculty of Information Technology, Brno University of Technology, Brno, Czech Republic
| |
Collapse
|
2
|
Barnova K, Mikolasova M, Kahankova RV, Jaros R, Kawala-Sterniuk A, Snasel V, Mirjalili S, Pelc M, Martinek R. Implementation of artificial intelligence and machine learning-based methods in brain-computer interaction. Comput Biol Med 2023; 163:107135. [PMID: 37329623 DOI: 10.1016/j.compbiomed.2023.107135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2023] [Revised: 05/13/2023] [Accepted: 06/04/2023] [Indexed: 06/19/2023]
Abstract
Brain-computer interfaces are used for direct two-way communication between the human brain and the computer. Brain signals contain valuable information about the mental state and brain activity of the examined subject. However, due to their non-stationarity and susceptibility to various types of interference, their processing, analysis and interpretation are challenging. For these reasons, the research in the field of brain-computer interfaces is focused on the implementation of artificial intelligence, especially in five main areas: calibration, noise suppression, communication, mental condition estimation, and motor imagery. The use of algorithms based on artificial intelligence and machine learning has proven to be very promising in these application domains, especially due to their ability to predict and learn from previous experience. Therefore, their implementation within medical technologies can contribute to more accurate information about the mental state of subjects, alleviate the consequences of serious diseases or improve the quality of life of disabled patients.
Collapse
Affiliation(s)
- Katerina Barnova
- Department of Cybernetics and Biomedical Engineering, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Czechia.
| | - Martina Mikolasova
- Department of Cybernetics and Biomedical Engineering, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Czechia.
| | - Radana Vilimkova Kahankova
- Department of Cybernetics and Biomedical Engineering, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Czechia
| | - Rene Jaros
- Department of Cybernetics and Biomedical Engineering, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Czechia.
| | - Aleksandra Kawala-Sterniuk
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Poland.
| | - Vaclav Snasel
- Department of Computer Science, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Czechia.
| | - Seyedali Mirjalili
- Centre for Artificial Intelligence Research and Optimisation, Torrens University Australia, Australia.
| | - Mariusz Pelc
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Poland; School of Computing and Mathematical Sciences, University of Greenwich, London, UK.
| | - Radek Martinek
- Department of Cybernetics and Biomedical Engineering, Faculty of Electrical Engineering and Computer Science, VSB-Technical University of Ostrava, Czechia; Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Poland.
| |
Collapse
|
3
|
van Stigt M, Groenendijk E, Marquering H, Coutinho J, Potters W. High performance clean versus artifact dry electrode EEG data classification using Convolutional Neural Network transfer learning. Clin Neurophysiol Pract 2023; 8:88-91. [PMID: 37215683 PMCID: PMC10196906 DOI: 10.1016/j.cnp.2023.04.002] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Revised: 04/06/2023] [Accepted: 04/08/2023] [Indexed: 05/24/2023] Open
Abstract
Objective Convolutional Neural Networks (CNNs) are promising for artifact detection in electroencephalography (EEG) data, but require large amounts of data. Despite increasing use of dry electrodes for EEG data acquisition, dry electrode EEG datasets are sparse. We aim to develop an algorithm for clean versus artifact dry electrode EEG data classification using transfer learning. Methods Dry electrode EEG data were acquired in 13 subjects while physiological and technical artifacts were induced. Data were per 2-second segment labeled as clean or artifact and split in an 80% train and 20% test set. With the train set, we fine-tuned a pre-trained CNN for clean versus artifact wet electrode EEG data classification using 3-fold cross validation. The three fine-tuned CNNs were combined in one final clean versus artifact classification algorithm, in which the majority vote was used for classification. We calculated accuracy, F1-score, precision, and recall of the pre-trained CNN and fine-tuned algorithm when applied to unseen test data. Results The algorithm was trained on 0.40 million and tested on 0.17 million overlapping EEG segments. The pre-trained CNN had a test accuracy of 65.6%. The fine-tuned clean versus artifact classification algorithm had an improved test accuracy of 90.7%, F1-score of 90.2%, precision of 89.1% and recall of 91.2%. Conclusions Despite a relatively small dry electrode EEG dataset, transfer learning enabled development of a high performing CNN-based algorithm for clean versus artifact classification. Significance Development of CNNs for classification of dry electrode EEG data is challenging as dry electrode EEG datasets are sparse. Here, we show that transfer learning can be used to overcome this problem.
Collapse
Affiliation(s)
- M.N. van Stigt
- Amsterdam UMC location University of Amsterdam, Department of Clinical Neurophysiology, Meibergdreef 9, Amsterdam, the Netherlands
- Amsterdam UMC location University of Amsterdam, Department of Neurology, Meibergdreef 9, Amsterdam, the Netherlands
| | - E.A. Groenendijk
- Amsterdam UMC location University of Amsterdam, Department of Clinical Neurophysiology, Meibergdreef 9, Amsterdam, the Netherlands
- Amsterdam UMC location University of Amsterdam, Department of Neurology, Meibergdreef 9, Amsterdam, the Netherlands
| | - H.A. Marquering
- Amsterdam UMC location University of Amsterdam, Department of Biomedical Engineering and Physics, Meibergdreef 9, Amsterdam, the Netherlands
- Amsterdam UMC location University of Amsterdam, Department of Radiology and Nuclear Medicine, Meibergdreef 9, Amsterdam, the Netherlands
| | - J.M. Coutinho
- Amsterdam UMC location University of Amsterdam, Department of Neurology, Meibergdreef 9, Amsterdam, the Netherlands
| | - W.V. Potters
- Amsterdam UMC location University of Amsterdam, Department of Clinical Neurophysiology, Meibergdreef 9, Amsterdam, the Netherlands
- Amsterdam UMC location University of Amsterdam, Department of Neurology, Meibergdreef 9, Amsterdam, the Netherlands
| |
Collapse
|
4
|
Kaveh M, Mesgari MS. Application of Meta-Heuristic Algorithms for Training Neural Networks and Deep Learning Architectures: A Comprehensive Review. Neural Process Lett 2022; 55:1-104. [PMID: 36339645 PMCID: PMC9628382 DOI: 10.1007/s11063-022-11055-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/11/2022] [Indexed: 12/02/2022]
Abstract
The learning process and hyper-parameter optimization of artificial neural networks (ANNs) and deep learning (DL) architectures is considered one of the most challenging machine learning problems. Several past studies have used gradient-based back propagation methods to train DL architectures. However, gradient-based methods have major drawbacks such as stucking at local minimums in multi-objective cost functions, expensive execution time due to calculating gradient information with thousands of iterations and needing the cost functions to be continuous. Since training the ANNs and DLs is an NP-hard optimization problem, their structure and parameters optimization using the meta-heuristic (MH) algorithms has been considerably raised. MH algorithms can accurately formulate the optimal estimation of DL components (such as hyper-parameter, weights, number of layers, number of neurons, learning rate, etc.). This paper provides a comprehensive review of the optimization of ANNs and DLs using MH algorithms. In this paper, we have reviewed the latest developments in the use of MH algorithms in the DL and ANN methods, presented their disadvantages and advantages, and pointed out some research directions to fill the gaps between MHs and DL methods. Moreover, it has been explained that the evolutionary hybrid architecture still has limited applicability in the literature. Also, this paper classifies the latest MH algorithms in the literature to demonstrate their effectiveness in DL and ANN training for various applications. Most researchers tend to extend novel hybrid algorithms by combining MHs to optimize the hyper-parameters of DLs and ANNs. The development of hybrid MHs helps improving algorithms performance and capable of solving complex optimization problems. In general, the optimal performance of the MHs should be able to achieve a suitable trade-off between exploration and exploitation features. Hence, this paper tries to summarize various MH algorithms in terms of the convergence trend, exploration, exploitation, and the ability to avoid local minima. The integration of MH with DLs is expected to accelerate the training process in the coming few years. However, relevant publications in this way are still rare.
Collapse
Affiliation(s)
- Mehrdad Kaveh
- Department of Geodesy and Geomatics, K. N. Toosi University of Technology, Tehran, 19967-15433 Iran
| | - Mohammad Saadi Mesgari
- Department of Geodesy and Geomatics, K. N. Toosi University of Technology, Tehran, 19967-15433 Iran
| |
Collapse
|
5
|
Zangeneh Soroush M, Tahvilian P, Nasirpour MH, Maghooli K, Sadeghniiat-Haghighi K, Vahid Harandi S, Abdollahi Z, Ghazizadeh A, Jafarnia Dabanloo N. EEG artifact removal using sub-space decomposition, nonlinear dynamics, stationary wavelet transform and machine learning algorithms. Front Physiol 2022; 13:910368. [PMID: 36091378 PMCID: PMC9449652 DOI: 10.3389/fphys.2022.910368] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Accepted: 07/11/2022] [Indexed: 11/22/2022] Open
Abstract
Blind source separation (BSS) methods have received a great deal of attention in electroencephalogram (EEG) artifact elimination as they are routine and standard signal processing tools to remove artifacts and reserve desired neural information. On the other hand, a classifier should follow BSS methods to automatically identify artifactual sources and remove them in the following steps. In addition, removing all detected artifactual components leads to loss of information since some desired information related to neural activity leaks to these sources. So, an approach should be employed to detect and suppress the artifacts and reserve neural activity. This study introduces a novel method based on EEG and Poincare planes in the phase space to detect artifactual components estimated by second-order blind identification (SOBI). Artifacts are detected using a mixture of well-known conventional classifiers and were removed employing stationary wavelet transform (SWT) to reserve neural information. The proposed method is a combination of signal processing techniques and machine learning algorithms, including multi-layer perceptron (MLP), K-nearest neighbor (KNN), naïve Bayes, and support vector machine (SVM) which have significant results while applying our proposed method to different scenarios. Simulated, semi-simulated, and real EEG signals are employed to evaluate the proposed method, and several evaluation criteria are calculated. We achieved acceptable results, for example, 98% average accuracy and 97% average sensitivity in artifactual EEG component detection or about 2% as mean square error in EEG reconstruction after artifact removal. Results showed that the proposed method is effective and can be used in future studies as we have considered different real-world scenarios to evaluate it.
Collapse
Affiliation(s)
- Morteza Zangeneh Soroush
- Occupational Sleep Research Center, Baharloo Hospital, Tehran University of Medical Sciences, Tehran, Iran
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences, IPM, Tehran, Iran
- Bio-Intelligence Research Unit, Electrical Engineering Department, Sharif University of Technology, Tehran, Iran
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
- Engineering Research Center in Medicine and Biology, Science and Research Branch, Islamic Azad University, Tehran, Iran
- Department of Clinical Neuroscience, Mahdiyeh Clinic, Tehran, Iran
- *Correspondence: Morteza Zangeneh Soroush,
| | - Parisa Tahvilian
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
- Engineering Research Center in Medicine and Biology, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Mohammad Hossein Nasirpour
- Department of Medical Genetics, Institute of Medical Biotechnology, National Institute of Genetic Engineering and Biotechnology (NIGEB), Tehran, Iran
| | - Keivan Maghooli
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
- Engineering Research Center in Medicine and Biology, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Khosro Sadeghniiat-Haghighi
- Occupational Sleep Research Center, Baharloo Hospital, Tehran University of Medical Sciences, Tehran, Iran
- Sleep Breathing Disorders Research Center, Tehran University of Medical Sciences, Tehran, Iran
| | - Sepide Vahid Harandi
- Department of Psychology, Islamic Azad University, Najafabad Branch, Najafabad, Iran
| | - Zeinab Abdollahi
- Department of Electrical and Computer Engineering, Islamic Azad University, Qazvin Branch, Qazvin, Iran
| | - Ali Ghazizadeh
- School of Cognitive Sciences, Institute for Research in Fundamental Sciences, IPM, Tehran, Iran
- Bio-Intelligence Research Unit, Electrical Engineering Department, Sharif University of Technology, Tehran, Iran
| | - Nader Jafarnia Dabanloo
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
- Engineering Research Center in Medicine and Biology, Science and Research Branch, Islamic Azad University, Tehran, Iran
| |
Collapse
|
6
|
Muthu Ganesh V, Nithiyanantham J. Heuristic-based channel selection with enhanced deep learning for heart disease prediction under WBAN. Comput Methods Biomech Biomed Engin 2022; 25:1429-1448. [PMID: 35156487 DOI: 10.1080/10255842.2021.2013828] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
The main intention of this proposal is to design and develop a new heart disease prediction model via WBAN using three stages. The first stage is data aggregation, in which data is scheduled in Time Division Multiple Access manner based on priority level, and the data from the public benchmark datasets are collected representing WBAN. In the second stage, a channel selection is performed using a developed hybrid metaheuristic algorithm named Tunicate Swarm-Sail Fish Optimization (TS-SFO) Algorithm. The main intention of the suggested channel selection algorithm is to solve the multi-objective problem based on certain constraints like Reference Signal Received Quality, Signal to Noise Ratio and channel capacity. The third stage is the heart disease prediction stage, in which the feature extraction and prediction are performed. The data transmitted in the selected channel is used for the feature extraction phase, where the weighted entropy-based statistical feature extraction is developed and extracts the essential statistical features. Then, an enhanced Recurrent Neural Network (RNN) is proposed by tuning certain parameters using the proposed TS-SFO for predicting heart disease with the help of extracted statistical features. Test results show that the flexible design and subsequent tuning of RNN hyper-parameters can achieve a high prediction rate.
Collapse
Affiliation(s)
- V Muthu Ganesh
- Department of Electronics and Communication Engineering, K.L.N. College of Engineering, Pottapalayam, Tamil Nadu, India
| | - Janakiraman Nithiyanantham
- Professor, Department of Electronics and Communication Engineering, K.L.N. College of Engineering, Pottapalayam, Tamil Nadu, India
| |
Collapse
|