1
|
Zhang Y, Cai Y. Explorative Binary Gray Wolf Optimizer with Quadratic Interpolation for Feature Selection. Biomimetics (Basel) 2024; 9:648. [PMID: 39451854 PMCID: PMC11505495 DOI: 10.3390/biomimetics9100648] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2024] [Revised: 10/15/2024] [Accepted: 10/19/2024] [Indexed: 10/26/2024] Open
Abstract
The high dimensionality of large datasets can severely impact the data mining process. Therefore, feature selection becomes an essential preprocessing stage, aimed at reducing the dimensionality of the dataset by selecting the most informative features while improving classification accuracy. This paper proposes a novel binary Gray Wolf Optimization algorithm to address the feature selection problem in classification tasks. Firstly, the historical optimal position of the search agent helps explore more promising areas. Therefore, by linearly combining the best positions of the search agents, the algorithm's exploration capability is increased, thus enhancing its global development ability. Secondly, the novel quadratic interpolation technique, which integrates population diversity with local exploitation, helps improve both the diversity of the population and the convergence accuracy. Thirdly, chaotic perturbations (small random fluctuations) applied to the convergence factor during the exploration phase further help avoid premature convergence and promote exploration of the search space. Finally, a novel transfer function processes feature information differently at various stages, enabling the algorithm to search and optimize effectively in the binary space, thereby selecting the optimal feature subset. The proposed method employs a k-nearest neighbor classifier and evaluates performance through 10-fold cross-validation across 32 datasets. Experimental results, compared with other advanced algorithms, demonstrate the effectiveness of the proposed algorithm.
Collapse
|
2
|
Jiao R, Xue B, Zhang M. A Tri-Objective Method for Bi-Objective Feature Selection in Classification. EVOLUTIONARY COMPUTATION 2024; 32:217-248. [PMID: 37463437 DOI: 10.1162/evco_a_00339] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/10/2022] [Accepted: 06/29/2023] [Indexed: 07/20/2023]
Abstract
Minimizing the number of selected features and maximizing the classification performance are two main objectives in feature selection, which can be formulated as a bi-objective optimization problem. Due to the complex interactions between features, a solution (i.e., feature subset) with poor objective values does not mean that all the features it selects are useless, as some of them combined with other complementary features can greatly improve the classification performance. Thus, it is necessary to consider not only the performance of feature subsets in the objective space, but also their differences in the search space, to explore more promising feature combinations. To this end, this paper proposes a tri-objective method for bi-objective feature selection in classification, which solves a bi-objective feature selection problem as a tri-objective problem by considering the diversity (differences) between feature subsets in the search space as the third objective. The selection based on the converted tri-objective method can maintain a balance between minimizing the number of selected features, maximizing the classification performance, and exploring more promising feature subsets. Furthermore, a novel initialization strategy and an offspring reproduction operator are proposed to promote the diversity of feature subsets in the objective space and improve the search ability, respectively. The proposed algorithm is compared with five multiobjective-based feature selection methods, six typical feature selection methods, and two peer methods with diversity as a helper objective. Experimental results on 20 real-world classification datasets suggest that the proposed method outperforms the compared methods in most scenarios.
Collapse
Affiliation(s)
- Ruwang Jiao
- School of Engineering and Computer Science, Victoria University of Wellington, Wellington, 6140, New Zealand
| | - Bing Xue
- School of Engineering and Computer Science, Victoria University of Wellington, Wellington, 6140, New Zealand
| | - Mengjie Zhang
- School of Engineering and Computer Science, Victoria University of Wellington, Wellington, 6140, New Zealand
| |
Collapse
|
3
|
Li M, Cao R, Zhao Y, Li Y, Deng S. Population characteristic exploitation-based multi-orientation multi-objective gene selection for microarray data classification. Comput Biol Med 2024; 170:108089. [PMID: 38330824 DOI: 10.1016/j.compbiomed.2024.108089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2023] [Revised: 01/23/2024] [Accepted: 01/27/2024] [Indexed: 02/10/2024]
Abstract
Gene selection is a process of selecting discriminative genes from microarray data that helps to diagnose and classify cancer samples effectively. Swarm intelligence evolution-based gene selection algorithms can never circumvent the problem that the population is prone to local optima in the process of gene selection. To tackle this challenge, previous research has focused primarily on two aspects: mitigating premature convergence to local optima and escaping from local optima. In contrast to these strategies, this paper introduces a novel perspective by adopting reverse thinking, where the issue of local optima is seen as an opportunity rather than an obstacle. Building on this foundation, we propose MOMOGS-PCE, a novel gene selection approach that effectively exploits the advantageous characteristics of populations trapped in local optima to uncover global optimal solutions. Specifically, MOMOGS-PCE employs a novel population initialization strategy, which involves the initialization of multiple populations that explore diverse orientations to foster distinct population characteristics. The subsequent step involved the utilization of an enhanced NSGA-II algorithm to amplify the advantageous characteristics exhibited by the population. Finally, a novel exchange strategy is proposed to facilitate the transfer of characteristics between populations that have reached near maturity in evolution, thereby promoting further population evolution and enhancing the search for more optimal gene subsets. The experimental results demonstrated that MOMOGS-PCE exhibited significant advantages in comprehensive indicators compared with six competitive multi-objective gene selection algorithms. It is confirmed that the "reverse-thinking" approach not only avoids local optima but also leverages it to uncover superior gene subsets for cancer diagnosis.
Collapse
Affiliation(s)
- Min Li
- School of Information Engineering, Nanchang Institute of Technology, No. 289 Tianxiang Road, Nanchang, Jiangxi, PR China.
| | - Rutun Cao
- School of Information Engineering, Nanchang Institute of Technology, No. 289 Tianxiang Road, Nanchang, Jiangxi, PR China
| | - Yangfan Zhao
- School of Information Engineering, Nanchang Institute of Technology, No. 289 Tianxiang Road, Nanchang, Jiangxi, PR China
| | - Yulong Li
- School of Information Engineering, Nanchang Institute of Technology, No. 289 Tianxiang Road, Nanchang, Jiangxi, PR China
| | - Shaobo Deng
- School of Information Engineering, Nanchang Institute of Technology, No. 289 Tianxiang Road, Nanchang, Jiangxi, PR China
| |
Collapse
|
4
|
Sun S, Chen Y, Dong L. An optimization method for wireless sensor networks coverage based on genetic algorithm and reinforced whale algorithm. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2024; 21:2787-2812. [PMID: 38454707 DOI: 10.3934/mbe.2024124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/09/2024]
Abstract
In response to the problem of coverage redundancy and coverage holes caused by the random deployment of nodes in wireless sensor networks (WSN), a WSN coverage optimization method called GARWOA is proposed, which combines the genetic algorithm (GA) and reinforced whale optimization algorithm (RWOA) to balance global search and local development performance. First, the population is initialized using sine map and piecewise linear chaotic map (SPM) to distribute it more evenly in the search space. Secondly, a non-linear improvement is made to the linear control factor 'a' in the whale optimization algorithm (WOA) to enhance the efficiency of algorithm exploration and development. Finally, a Levy flight mechanism is introduced to improve the algorithm's tendency to fall into local optima and premature convergence phenomena. Simulation experiments indicate that among the 10 standard test functions, GARWOA outperforms other algorithms with better optimization ability. In three coverage experiments, the coverage ratio of GARWOA is 95.73, 98.15, and 99.34%, which is 3.27, 2.32 and 0.87% higher than mutant grey wolf optimizer (MuGWO), respectively.
Collapse
Affiliation(s)
- Shuming Sun
- School of Information and Electronic Engineering (Sussex Artificial Intelligence Institute), Zhejiang Gongshang University, Hangzhou 310018, China
| | - Yijun Chen
- School of Information and Electronic Engineering (Sussex Artificial Intelligence Institute), Zhejiang Gongshang University, Hangzhou 310018, China
| | - Ligang Dong
- School of Information and Electronic Engineering (Sussex Artificial Intelligence Institute), Zhejiang Gongshang University, Hangzhou 310018, China
| |
Collapse
|
5
|
Jiao R, Xue B, Zhang M. Benefiting From Single-Objective Feature Selection to Multiobjective Feature Selection: A Multiform Approach. IEEE TRANSACTIONS ON CYBERNETICS 2023; 53:7773-7786. [PMID: 36346857 DOI: 10.1109/tcyb.2022.3218345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Evolutionary multiobjective feature selection (FS) has gained increasing attention in recent years. However, it still faces some challenges, for example, the frequently appeared duplicated solutions in either the search space or the objective space lead to the diversity loss of the population, and the huge search space results in the low search efficiency of the algorithm. Minimizing the number of selected features and maximizing the classification performance are two major objectives in FS. Usually, the fitness function of a single-objective FS problem linearly aggregates these two objectives through a weighted sum method. Given a predefined direction (weight) vector, the single-objective FS task can explore the specified direction or area extensively. Different direction vectors result in different search directions in the objective space. Motivated by this, this article proposes a multiform framework, which solves a multiobjective FS task combined with its auxiliary single-objective FS tasks in a multitask environment. By setting different direction vectors, promising feature subsets from single-objective FS tasks can be utilized, to boost the evolutionary search of the multiobjective FS task. By comparing with five classical and state-of-the-art multiobjective evolutionary algorithms, as well as four well-performing FS algorithms, the effectiveness and efficiency of the proposed method are verified via extensive experiments on 18 classification datasets. Furthermore, the effectiveness of the proposed method is also investigated in a noisy environment.
Collapse
|
6
|
Guo X, Wang Y, Zhang H. An active learning Gaussian modeling based multi-objective evolutionary algorithm using population guided weight vector evolution strategy. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:19839-19857. [PMID: 38052626 DOI: 10.3934/mbe.2023878] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/07/2023]
Abstract
The inverse model based multi-objective evolutionary algorithm (IM-MOEA) generates offspring by establishing probabilistic models and sampling by the model, which is a new computing schema to replace crossover in MOEAs. In this paper, an active learning Gaussian modeling based multi-objective evolutionary algorithm using population guided weight vector evolution strategy (ALGM-MOEA) is proposed. To properly cope with multi-objective problems with different shapes of Pareto front (PF), a novel population guided weight vector evolution strategy is proposed to dynamically adjust search directions according to the distribution of generated PF. Moreover, in order to enhance the search efficiency and prediction accuracy, an active learning based training sample selection method is designed to build Gaussian process based inverse models, which chooses individuals with the maximum amount of information to effectively enhance the prediction accuracy of the inverse model. The experimental results demonstrate the competitiveness of the proposed ALGM-MOEA on benchmark problems with various shapes of Pareto front.
Collapse
Affiliation(s)
- Xiaofang Guo
- School of Sciences, Xi'an Technological University, Xi'an 710000, China
| | - Yuping Wang
- School of Sciences, Xi'an Technological University, Xi'an 710000, China
| | - Haonan Zhang
- School of Sciences, Xi'an Technological University, Xi'an 710000, China
| |
Collapse
|
7
|
AbdelAty AM, Yousri D, Chelloug S, Alduailij M, Abd Elaziz M. Fractional order adaptive hunter-prey optimizer for feature selection. ALEXANDRIA ENGINEERING JOURNAL 2023; 75:531-547. [DOI: 10.1016/j.aej.2023.05.092] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
8
|
Zhu J, Liu J, Chen Y, Xue X, Sun S. Binary Restructuring Particle Swarm Optimization and Its Application. Biomimetics (Basel) 2023; 8:266. [PMID: 37366861 DOI: 10.3390/biomimetics8020266] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 06/14/2023] [Accepted: 06/15/2023] [Indexed: 06/28/2023] Open
Abstract
Restructuring Particle Swarm Optimization (RPSO) algorithm has been developed as an intelligent approach based on the linear system theory of particle swarm optimization (PSO). It streamlines the flow of the PSO algorithm, specifically targeting continuous optimization problems. In order to adapt RPSO for solving discrete optimization problems, this paper proposes the binary Restructuring Particle Swarm Optimization (BRPSO) algorithm. Unlike other binary metaheuristic algorithms, BRPSO does not utilize the transfer function. The particle updating process in BRPSO relies solely on comparison results between values derived from the position updating formula and a random number. Additionally, a novel perturbation term is incorporated into the position updating formula of BRPSO. Notably, BRPSO requires fewer parameters and exhibits high exploration capability during the early stages. To evaluate the efficacy of BRPSO, comprehensive experiments are conducted by comparing it against four peer algorithms in the context of feature selection problems. The experimental results highlight the competitive nature of BRPSO in terms of both classification accuracy and the number of selected features.
Collapse
Affiliation(s)
- Jian Zhu
- School of Computer Science and Mathematics, Fujian University of Technology, Fuzhou 350118, China
- Fujian Provincial Key Laboratory of Big Data Mining and Applications, Fuzhou 350118, China
| | - Jianhua Liu
- School of Computer Science and Mathematics, Fujian University of Technology, Fuzhou 350118, China
- Fujian Provincial Key Laboratory of Big Data Mining and Applications, Fuzhou 350118, China
| | - Yuxiang Chen
- School of Computer Science and Mathematics, Fujian University of Technology, Fuzhou 350118, China
- Fujian Provincial Key Laboratory of Big Data Mining and Applications, Fuzhou 350118, China
| | - Xingsi Xue
- School of Computer Science and Mathematics, Fujian University of Technology, Fuzhou 350118, China
- Fujian Provincial Key Laboratory of Big Data Mining and Applications, Fuzhou 350118, China
| | - Shuihua Sun
- School of Computer Science and Mathematics, Fujian University of Technology, Fuzhou 350118, China
- Fujian Provincial Key Laboratory of Big Data Mining and Applications, Fuzhou 350118, China
| |
Collapse
|
9
|
Silva BC, Rebello CM, Rodrigues AE, Ribeiro AM, Ferreira AFP, Nogueira IBR. Metaheuristic Framework for Material Screening and Operating Optimization of Adsorption-Based Heat Pumps. ACS OMEGA 2023; 8:19874-19891. [PMID: 37305278 PMCID: PMC10249114 DOI: 10.1021/acsomega.3c01797] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Accepted: 05/15/2023] [Indexed: 06/13/2023]
Abstract
The current methods applied to material screening for adsorption-based heat pumps are based on a fixed set of temperatures or their independent variation, providing a limited, insufficient, and unpractical evaluation of different adsorbents. This work proposes a novel strategy for the simultaneous optimization and material screening in the design of adsorption heat pumps by implementing a meta-heuristic approach, particle swarm optimization (PSO). The proposed framework can effectively evaluate variable and broad operation temperature intervals to search for viable zones of operation for multiple adsorbents at once. The criteria for selecting the adequate material were the maximum performance and the minimum heat supply cost, which were considered the objective functions of the PSO algorithm. First, the performance was assessed individually, followed by a single-objective approximation of the multi-objective problem. Next, a multi-objective approach was also adopted. With the results generated during the optimization, it was possible to find which adsorbents and temperature sets were the most suitable according to the main objective of the operation. The Fisher-Snedecor test was applied to expand the results obtained during PSO application and a feasible operating region built around the optima, enabling the arrangement of close-to-optima data into practical design and control tools. This approach allowed for a fast and intuitive evaluation of multiple design and operation variables.
Collapse
Affiliation(s)
- Beatriz C. Silva
- LSRE-LCM—Laboratory
of Separation and Reaction Engineering—Laboratory of Catalysis
and Materials, Faculty of Engineering, University
of Porto, Rua Dr. Roberto
Frias, Porto 4200-465, Portugal
- ALiCE—Associate
Laboratory in Chemical Engineering, Faculty of Engineering, University of Porto, Rua Dr. Roberto Frias, Porto 4200-465, Portugal
| | - Carine Menezes Rebello
- Chemical
Engineering Department, Polytechnic School
Federal University of Bahia, Salvador 40210-630, Brazil
| | - Alírio E. Rodrigues
- LSRE-LCM—Laboratory
of Separation and Reaction Engineering—Laboratory of Catalysis
and Materials, Faculty of Engineering, University
of Porto, Rua Dr. Roberto
Frias, Porto 4200-465, Portugal
- ALiCE—Associate
Laboratory in Chemical Engineering, Faculty of Engineering, University of Porto, Rua Dr. Roberto Frias, Porto 4200-465, Portugal
| | - Ana M. Ribeiro
- LSRE-LCM—Laboratory
of Separation and Reaction Engineering—Laboratory of Catalysis
and Materials, Faculty of Engineering, University
of Porto, Rua Dr. Roberto
Frias, Porto 4200-465, Portugal
- ALiCE—Associate
Laboratory in Chemical Engineering, Faculty of Engineering, University of Porto, Rua Dr. Roberto Frias, Porto 4200-465, Portugal
| | - Alexandre F. P. Ferreira
- LSRE-LCM—Laboratory
of Separation and Reaction Engineering—Laboratory of Catalysis
and Materials, Faculty of Engineering, University
of Porto, Rua Dr. Roberto
Frias, Porto 4200-465, Portugal
- ALiCE—Associate
Laboratory in Chemical Engineering, Faculty of Engineering, University of Porto, Rua Dr. Roberto Frias, Porto 4200-465, Portugal
| | - Idelfonso B. R. Nogueira
- Chemical
Engineering Department, Norwegian University
of Science and Technology, Sem Sælandsvei 4, Kjemiblokk 5, Trondheim 7491, Norway
| |
Collapse
|
10
|
Zhuang Y, Huang Y, Liu W. Integrating Sensor Ontologies with Niching Multi-Objective Particle Swarm Optimization Algorithm. SENSORS (BASEL, SWITZERLAND) 2023; 23:5069. [PMID: 37299796 PMCID: PMC10255516 DOI: 10.3390/s23115069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 05/22/2023] [Accepted: 05/22/2023] [Indexed: 06/12/2023]
Abstract
Sensor ontology provides a standardized semantic representation for information sharing between sensor devices. However, due to the varied descriptions of sensor devices at the semantic level by designers in different fields, data exchange between sensor devices is hindered. Sensor ontology matching achieves data integration and sharing between sensors by establishing semantic relationships between sensor devices. Therefore, a niching multi-objective particle swarm optimization algorithm (NMOPSO) is proposed to effectively solve the sensor ontology matching problem. As the sensor ontology meta-matching problem is essentially a multi-modal optimization problem (MMOP), a niching strategy is introduced into MOPSO to enable the algorithm to find more global optimal solutions that meet the needs of different decision makers. In addition, a diversity-enhancing strategy and an opposition-based learning (OBL) strategy are introduced into the evolution process of NMOPSO to improve the quality of sensor ontology matching and ensure the solutions converge to the real Pareto fronts (PFs). The experimental results demonstrate the effectiveness of NMOPSO in comparison to MOPSO-based matching techniques and participants of the Ontology Alignment Evaluation Initiative (OAEI).
Collapse
Affiliation(s)
- Yucheng Zhuang
- Fujian Provincial Key Laboratory of Big Data Mining and Applications, Fujian University of Technology, No. 69 Xuefu South Road, Minhou, Fuzhou 350118, China;
| | - Yikun Huang
- Concord University College, Fujian Normal University, No. 68 Xuefu South Road, Minhou, Fuzhou 350117, China
| | - Wenyu Liu
- School of Computer Science and Mathematics, Fujian University of Technology, No. 69 Xuefu South Road, Minhou, Fuzhou 350118, China;
| |
Collapse
|
11
|
Chen F, Liu Y, Yang J, Yang M, Zhang Q, Liu J. Multi-objective particle swarm optimization with reverse multi-leaders. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2023; 20:11732-11762. [PMID: 37501418 DOI: 10.3934/mbe.2023522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
Despite being easy to implement and having fast convergence speed, balancing the convergence and diversity of multi-objective particle swarm optimization (MOPSO) needs to be further improved. A multi-objective particle swarm optimization with reverse multi-leaders (RMMOPSO) is proposed as a solution to the aforementioned issue. First, the convergence strategy of global ranking and the diversity strategy of mean angular distance are proposed, which are used to update the convergence archive and the diversity archive, respectively, to improve the convergence and diversity of solutions in the archives. Second, a reverse selection method is proposed to select two global leaders for the particles in the population. This is conducive to selecting appropriate learning samples for each particle and leading the particles to quickly fly to the true Pareto front. Third, an information fusion strategy is proposed to update the personal best, to improve convergence of the algorithm. At the same time, in order to achieve a better balance between convergence and diversity, a new particle velocity updating method is proposed. With this, two global leaders cooperate to guide the flight of particles in the population, which is conducive to promoting the exchange of social information. Finally, RMMOPSO is simulated with several state-of-the-art MOPSOs and multi-objective evolutionary algorithms (MOEAs) on 22 benchmark problems. The experimental results show that RMMOPSO has better comprehensive performance.
Collapse
Affiliation(s)
- Fei Chen
- School of Mathematics and Statistics, Guizhou University, Guiyang 550025, China
| | - Yanmin Liu
- School of Mathematics, Zunyi Normal College, Zunyi 563002, China
| | - Jie Yang
- School of Mathematics, Zunyi Normal College, Zunyi 563002, China
| | - Meilan Yang
- School of Mathematics and Statistics, Guizhou University, Guiyang 550025, China
| | - Qian Zhang
- School of Mathematics and Statistics, Guizhou University, Guiyang 550025, China
| | - Jun Liu
- School of Data Science and Information Engineering, Guizhou Minzu University, Guiyang 550025, China
| |
Collapse
|
12
|
Tong W, Liu D, Hu Z, Su Q. Hybridizing genetic algorithm with grey prediction evolution algorithm for solving unit commitment problem. APPL INTELL 2023. [DOI: 10.1007/s10489-023-04527-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/28/2023]
|
13
|
Hu Y, Lu M, Li X, Cai B. Differential evolution based on network structure for feature selection. Inf Sci (N Y) 2023. [DOI: 10.1016/j.ins.2023.03.144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/03/2023]
|
14
|
Cluster-Based Multiobjective Particle Swarm Optimization and Application for Chemical Plants. INT J INTELL SYST 2023. [DOI: 10.1155/2023/5275262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/06/2023]
Abstract
In multiobjective particle swarm optimization (MOPSO), the global-best particle is randomly selected for each population particle from a nondominated solution set. However, this Roulette wheel-based global particle selection is ineffective for convergence and diversity when the problem has numerous decision variables or a large number of global-best candidates. Thus, this study proposes the cluster-based MOPSO (CMOPSO). In CMOPSO, the similarities between particles are considered when selecting the global-best particle. The cluster for each particle is determined based on the Euclidean distance in the decision or objective space. The proposed approach is demonstrated by applying an operating condition optimization problem to the hydrogen production process. The target process is a representative chemical plant with a large search space and strong nonlinearity. Furthermore, the performance of CMOPSO is assessed by comparing it with that of MOPSO. The results indicate that CMOPSO considered in the decision space exhibits superior performance in terms of convergence and diversity.
Collapse
|
15
|
Liu XF, Zhang J, Wang J. Cooperative Particle Swarm Optimization With a Bilevel Resource Allocation Mechanism for Large-Scale Dynamic Optimization. IEEE TRANSACTIONS ON CYBERNETICS 2023; 53:1000-1011. [PMID: 35976831 DOI: 10.1109/tcyb.2022.3193888] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Although cooperative coevolutionary algorithms are developed for large-scale dynamic optimization via subspace decomposition, they still face difficulties in reacting to environmental changes, in the presence of multiple peaks in the fitness functions and unevenness of subproblems. The resource allocation mechanisms among subproblems in the existing algorithms rely mainly on the fitness improvements already made but not potential ones. On the one hand, there is a lack of sufficient computing resources to achieve potential fitness improvements for some hard subproblems. On the other hand, the existing algorithms waste computing resources aiming to find most of the local optima of problems. In this article, we propose a cooperative particle swarm optimization algorithm to address these issues by introducing a bilevel balanceable resource allocation mechanism. A search strategy in the lower level is introduced to select some promising solutions from an archive based on solution diversity and quality to identify new peaks in every subproblem. A resource allocation strategy in the upper level is introduced to balance the coevolution of multiple subproblems by referring to their historical improvements and more computing resources are allocated for solving the subproblems that perform poorly but are expected to make great fitness improvements. Experimental results demonstrate that the proposed algorithm is competitive with the state-of-the-art algorithms in terms of objective function values and response efficiency with respect to environmental changes.
Collapse
|
16
|
Agrawal S, Tiwari A, Yaduvanshi B, Rajak P. Feature subset selection using multimodal multiobjective differential evolution. Knowl Based Syst 2023. [DOI: 10.1016/j.knosys.2023.110361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/12/2023]
|
17
|
A joint multiobjective optimization of feature selection and classifier design for high-dimensional data classification. Inf Sci (N Y) 2023. [DOI: 10.1016/j.ins.2023.01.069] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
18
|
Li Y, Zhang Y, Hu W. Adaptive multi-objective particle swarm optimization based on virtual Pareto front. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.12.079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
|
19
|
Harmonic Detection Method Based on Particle Swarm Optimization and Simulated Annealing Algorithm of Electrohydraulic Servo System. JOURNAL OF ROBOTICS 2022. [DOI: 10.1155/2022/7483427] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Due to the comprehensive influence of many nonlinear coupling factors within a system, when the input signal provided by an electrohydraulic servo shaker is sinusoidal, it often leads to the existence of high-order harmonic components of the system, which makes the output servo signal parameters exist extremely serious. Therefore, the detection of harmonics of the electrohydraulic servo shaker has very important application significance. In this paper, by using simulated annealing (SA) based harmonic detection, a kernel function is introduced to study area influence-based particle swarm optimization (PSO). Using a super accurate and fast global convergence brought by the combination of hybrid particle swarm optimization algorithm and simulated annealing algorithm, it can quickly jump out of the trap of traditional local optimization algorithms and a more stable, high-precision, as well as fast global convergence optimal solution can be obtained. Through the detection and simulation of the amplitude and phase of the harmonics in the system, by comparing the PSO-SA detection with PSO detection, it is proved that the PSO-SA algorithm can well satisfy the accuracy of the detection system, which has advantages such as a fast convergence speed, a high search accuracy, etc.; meanwhile, it is simple and easy to implement.
Collapse
|
20
|
A federated feature selection algorithm based on particle swarm optimization under privacy protection. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.110122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
21
|
A microscopic computational model based on particle dynamics and evolutionary algorithm for the prediction of gas solubility in polymers. J Mol Liq 2022. [DOI: 10.1016/j.molliq.2022.120169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
22
|
Feature selection based on a hybrid simplified particle swarm optimization algorithm with maximum separation and minimum redundancy. INT J MACH LEARN CYB 2022. [DOI: 10.1007/s13042-022-01663-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
23
|
Lu Z, Chu Q. Feature selection using class-level regularized self-representation. APPL INTELL 2022. [DOI: 10.1007/s10489-022-04177-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
24
|
Feature Selection Based on Adaptive Particle Swarm Optimization with Leadership Learning. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:1825341. [PMID: 36072739 PMCID: PMC9441366 DOI: 10.1155/2022/1825341] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 08/07/2022] [Accepted: 08/09/2022] [Indexed: 12/02/2022]
Abstract
With the rapid development of the Internet of Things (IoT), the curse of dimensionality becomes increasingly common. Feature selection (FS) is to eliminate irrelevant and redundant features in the datasets. Particle swarm optimization (PSO) is an efficient metaheuristic algorithm that has been successfully applied to obtain the optimal feature subset with essential information in an acceptable time. However, it is easy to fall into the local optima when dealing with high-dimensional datasets due to constant parameter values and insufficient population diversity. In the paper, an FS method is proposed by utilizing adaptive PSO with leadership learning (APSOLL). An adaptive updating strategy for parameters is used to replace the constant parameters, and the leadership learning strategy is utilized to provide valid population diversity. Experimental results on 10 UCI datasets show that APSOLL has better exploration and exploitation capabilities through comparison with PSO, grey wolf optimizer (GWO), Harris hawks optimization (HHO), flower pollination algorithm (FPA), salp swarm algorithm (SSA), linear PSO (LPSO), and hybrid PSO and differential evolution (HPSO-DE). Moreover, less than 8% of features in the original datasets are selected on average, and the feature subsets are more effective in most cases compared to those generated by 6 traditional FS methods (analysis of variance (ANOVA), Chi-Squared (CHI2), Pearson, Spearman, Kendall, and Mutual Information (MI)).
Collapse
|
25
|
Xue Y, Cai X, Neri F. A multi-objective evolutionary algorithm with interval based initialization and self-adaptive crossover operator for large-scale feature selection in classification. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109420] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
|
26
|
Agarwalla P, Mukhopadhyay S. GENEmops: Supervised feature selection from high dimensional biomedical dataset. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.108963] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
27
|
An enhanced binary Rat Swarm Optimizer based on local-best concepts of PSO and collaborative crossover operators for feature selection. Comput Biol Med 2022; 147:105675. [PMID: 35687926 DOI: 10.1016/j.compbiomed.2022.105675] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Revised: 05/24/2022] [Accepted: 05/26/2022] [Indexed: 11/22/2022]
Abstract
In this paper, an enhanced binary version of the Rat Swarm Optimizer (RSO) is proposed to deal with Feature Selection (FS) problems. FS is an important data reduction step in data mining which finds the most representative features from the entire data. Many FS-based swarm intelligence algorithms have been used to tackle FS. However, the door is still open for further investigations since no FS method gives cutting-edge results for all cases. In this paper, a recent swarm intelligence metaheuristic method called RSO which is inspired by the social and hunting behavior of a group of rats is enhanced and explored for FS problems. The binary enhanced RSO is built based on three successive modifications: i) an S-shape transfer function is used to develop binary RSO algorithms; ii) the local search paradigm of particle swarm optimization is used with the iterative loop of RSO to boost its local exploitation; iii) three crossover mechanisms are used and controlled by a switch probability to improve the diversity. Based on these enhancements, three versions of RSO are produced, referred to as Binary RSO (BRSO), Binary Enhanced RSO (BERSO), and Binary Enhanced RSO with Crossover operators (BERSOC). To assess the performance of these versions, a benchmark of 24 datasets from various domains is used. The proposed methods are assessed concerning the fitness value, number of selected features, classification accuracy, specificity, sensitivity, and computational time. The best performance is achieved by BERSOC followed by BERSO and then BRSO. These proposed versions are comparatively assessed against 25 well-regarded metaheuristic methods and five filter-based approaches. The obtained results underline their superiority by producing new best results for some datasets.
Collapse
|
28
|
Wang Y, Li J, Chen C, Zhang J, Zhan Z. Scale adaptive fitness evaluation‐based particle swarm optimisation for hyperparameter and architecture optimisation in neural networks and deep learning. CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY 2022. [DOI: 10.1049/cit2.12106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022] Open
Affiliation(s)
- Ye‐Qun Wang
- School of Computer Science and Engineering South China University of Technology Guangzhou China
| | - Jian‐Yu Li
- School of Computer Science and Engineering South China University of Technology Guangzhou China
| | - Chun‐Hua Chen
- School of Software Engineering South China University of Technology Guangzhou China
| | - Jun Zhang
- Hanyang University Ansan South Korea
| | - Zhi‐Hui Zhan
- School of Computer Science and Engineering South China University of Technology Guangzhou China
| |
Collapse
|
29
|
New bag-of-feature for histopathology image classification using reinforced cat swarm algorithm and weighted Gaussian mixture modelling. COMPLEX INTELL SYST 2022. [DOI: 10.1007/s40747-022-00726-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
AbstractThe progress in digital histopathology for computer-aided diagnosis leads to advancement in automated histopathological image classification system. However, heterogeneity and complexity in structural background make it a challenging process. Therefore, this paper introduces robust and reliable new bag-of-feature framework. The optimal visual words are obtained by applying proposed reinforcement cat swarm optimization algorithm. Moreover, the frequency of occurrence of each visual words is depicted through histogram using new weighted Gaussian mixture modelling method. Reinforcement cat swarm optimization algorithm is evaluated on the IEEE CEC 2017 benchmark function problems and compared with other state-of-the-art algorithms. Moreover, statistical test analysis is done on acquired mean and the best fitness values from benchmark functions. The proposed classification model effectively identifies and classifies the different categories of histopathological images. Furthermore, the comparative experimental result analysis of proposed reinforcement cat swarm optimization-based bag-of-feature is performed on standard quality metrics measures. The observation states that reinforcement cat swarm optimization-based bag-of-feature outperforms the other methods and provides promising results.
Collapse
|
30
|
Menor-Flores M, Vega-Rodríguez MA. Decomposition-based multi-objective optimization approach for PPI network alignment. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.108527] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
31
|
Sun L, Si S, Zhao J, Xu J, Lin Y, Lv Z. Feature selection using binary monarch butterfly optimization. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03554-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
|
32
|
Bezdan T, Zivkovic M, Bacanin N, Chhabra A, Suresh M. Feature Selection by Hybrid Brain Storm Optimization Algorithm for COVID-19 Classification. J Comput Biol 2022; 29:515-529. [PMID: 35446145 DOI: 10.1089/cmb.2021.0256] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
A large number of features lead to very high-dimensional data. The feature selection method reduces the dimension of data, increases the performance of prediction, and reduces the computation time. Feature selection is the process of selecting the optimal set of input features from a given data set in order to reduce the noise in data and keep the relevant features. The optimal feature subset contains all useful and relevant features and excludes any irrelevant feature that allows machine learning models to understand better and differentiate efficiently the patterns in data sets. In this article, we propose a binary hybrid metaheuristic-based algorithm for selecting the optimal feature subset. Concretely, the brain storm optimization algorithm is hybridized by the firefly algorithm and adopted as a wrapper method for feature selection problems on classification data sets. The proposed algorithm is evaluated on 21 data sets and compared with 11 metaheuristic algorithms. In addition, the proposed method is adopted for the coronavirus disease data set. The obtained experimental results substantiate the robustness of the proposed hybrid algorithm. It efficiently reduces and selects the feature subset and at the same time results in higher classification accuracy than other methods in the literature.
Collapse
Affiliation(s)
- Timea Bezdan
- Department of Informatics and Computing, Singidunum University, Belgrade, Serbia
| | - Miodrag Zivkovic
- Department of Informatics and Computing, Singidunum University, Belgrade, Serbia
| | - Nebojsa Bacanin
- Department of Informatics and Computing, Singidunum University, Belgrade, Serbia
| | - Amit Chhabra
- Department of Computer Engineering and Technology, Guru Nanak Dev University, Amritsar, India
| | - Muthusamy Suresh
- Department of Electronics and Communication Engineering, Kongu Engineering College, Erode, India
| |
Collapse
|
33
|
Liu Y, Wang S, Song X, Yang J. Novel multiobjective particle swarm optimization based on ranking and cyclic distance strategy. INT J INTELL SYST 2022. [DOI: 10.1002/int.22885] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Yanmin Liu
- School of Mathematics Zunyi Normal University Zunyi China
| | - Shihua Wang
- School of Mathematics and Statistics Guizhou University Guiyang China
| | - Xi Song
- Department of Management Science and Engineering, College of Management Shenzhen University Shenzhen China
| | - Jie Yang
- School of Mathematics Zunyi Normal University Zunyi China
| |
Collapse
|
34
|
Selection of investment portfolios with social responsibility: a multiobjective model and a Tabu search method. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03169-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Abstract
AbstractIn this study, a model for the selection of investment portfolios is proposed with three objectives. In addition to the traditional objectives of maximizing profitability and minimizing risk, maximization of social responsibility is also considered. Moreover, with the purpose of controlling transaction costs, a limit is placed on the number of assets for selection. To the best of our knowledge, this specific model has not been considered in the literature to date. This model is difficult (NP-Hard), and therefore, only very small instances may be solved in an exact way. This paper proposes a method based on tabu search and multiobjective adaptive memory programming (MOAMP) strategies. With this method it is possible to obtain sets of nondominated solutions in short computational times. To check the performance of our method it is compared with adaptations of the nondominated sorting genetic algorithm (NSGA-II), strength Pareto evolutionary algorithm (SPEA-II) and multiobjective particle swarm optimization (MOPSO). The results of different computational experiments show that our tabu search-MOAMP method performed best. The quality of the sets of solutions that were obtained and the speed of execution mean that our tabu search-MOAMP can be used as a tool for financial assessment and analysis (including online services). This tool, as we can see in this work with some examples, can take into account the social concerns of many clients and their overall risk profile (very conservative, conservative, moderate, or fearless). This approach is also in line with current legal regulations that oblige financial advisors to take the client profile into account to provide greater protection and propose good financial advice.
Collapse
|
35
|
Hou Y, Hao G, Zhang Y, Gu F, Xu W. A multi-objective discrete particle swarm optimization method for particle routing in distributed particle filters. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2021.108068] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
36
|
Multimodal and multi-objective optimization algorithm based on two-stage search framework. APPL INTELL 2022. [DOI: 10.1007/s10489-021-02969-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
37
|
Zhao F, Bao H, Wang L, He X, Jonrinaldi. A hybrid cooperative differential evolution assisted by CMA-ES with local search mechanism. Neural Comput Appl 2022. [DOI: 10.1007/s00521-021-06849-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
38
|
Multi-objective feature selection based on quasi-oppositional based Jaya algorithm for microarray data. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2021.107804] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
39
|
Huang W, Zhang W. Multi-objective optimization based on an adaptive competitive swarm optimizer. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2021.11.031] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
40
|
Binary Horse herd optimization algorithm with crossover operators for feature selection. Comput Biol Med 2021; 141:105152. [PMID: 34952338 DOI: 10.1016/j.compbiomed.2021.105152] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Revised: 12/11/2021] [Accepted: 12/14/2021] [Indexed: 01/30/2023]
Abstract
This paper proposes a binary version of Horse herd Optimization Algorithm (HOA) to tackle Feature Selection (FS) problems. This algorithm mimics the conduct of a pack of horses when they are trying to survive. To build a Binary version of HOA, or referred to as BHOA, twofold of adjustments were made: i) Three transfer functions, namely S-shape, V-shape and U-shape, are utilized to transform the continues domain into a binary one. Four configurations of each transfer function are also well studied to yield four alternatives. ii) Three crossover operators: one-point, two-point and uniform are also suggested to ensure the efficiency of the proposed method for FS domain. The performance of the proposed fifteen BHOA versions is examined using 24 real-world FS datasets. A set of six metric measures was used to evaluate the outcome of the optimization methods: accuracy, number of features selected, fitness values, sensitivity, specificity and computational time. The best-formed version of the proposed versions is BHOA with S-shape and one-point crossover. The comparative evaluation was also accomplished against 21 state-of-the-art methods. The proposed method is able to find very competitive results where some of them are the best-recorded. Due to the viability of the proposed method, it can be further considered in other areas of machine learning.
Collapse
|
41
|
Self-Regulated Particle Swarm Multi-Task Optimization. SENSORS 2021; 21:s21227499. [PMID: 34833574 PMCID: PMC8624381 DOI: 10.3390/s21227499] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/09/2021] [Revised: 11/03/2021] [Accepted: 11/06/2021] [Indexed: 11/28/2022]
Abstract
Population based search techniques have been developed and applied to wide applications for their good performance, such as the optimization of the unmanned aerial vehicle (UAV) path planning problems. However, the search for optimal solutions for an optimization problem is usually expensive. For example, the UAV problem is a large-scale optimization problem with many constraints, which makes it hard to get exact solutions. Especially, it will be time-consuming when multiple UAV problems are waiting to be optimized at the same time. Evolutionary multi-task optimization (EMTO) studies the problem of utilizing the population-based characteristics of evolutionary computation techniques to optimize multiple optimization problems simultaneously, for the purpose of further improving the overall performance of resolving all these problems. EMTO has great potential in solving real-world problems more efficiently. Therefore, in this paper, we develop a novel EMTO algorithm using a classical PSO algorithm, in which the developed knowledge transfer strategy achieves knowledge transfer between task by synthesizing the transferred knowledges from a selected set of component tasks during the updating of the velocities of population. Two knowledge transfer strategies are developed along with two versions of the proposed algorithm. The proposed algorithm is compared with the multifactorial PSO algorithm, the SREMTO algorithm, the popular multifactorial evolutionary algorithm and a classical PSO algorithm on nine popular single-objective MTO problems and six five-task MTO problems, which demonstrates its superiority.
Collapse
|
42
|
Boosting Atomic Orbit Search Using Dynamic-Based Learning for Feature Selection. MATHEMATICS 2021. [DOI: 10.3390/math9212786] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
Feature selection (FS) is a well-known preprocess step in soft computing and machine learning algorithms. It plays a critical role in different real-world applications since it aims to determine the relevant features and remove other ones. This process (i.e., FS) reduces the time and space complexity of the learning technique used to handle the collected data. The feature selection methods based on metaheuristic (MH) techniques established their performance over all the conventional FS methods. So, in this paper, we presented a modified version of new MH techniques named Atomic Orbital Search (AOS) as FS technique. This is performed using the advances of dynamic opposite-based learning (DOL) strategy that is used to enhance the ability of AOS to explore the search domain. This is performed by increasing the diversity of the solutions during the searching process and updating the search domain. A set of eighteen datasets has been used to evaluate the efficiency of the developed FS approach, named AOSD, and the results of AOSD are compared with other MH methods. From the results, AOSD can reduce the number of features by preserving or increasing the classification accuracy better than other MH techniques.
Collapse
|
43
|
Jiang Z, Zhang Y, Wang J. A multi-surrogate-assisted dual-layer ensemble feature selection algorithm. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
44
|
Boosting Arithmetic Optimization Algorithm with Genetic Algorithm Operators for Feature Selection: Case Study on Cox Proportional Hazards Model. MATHEMATICS 2021. [DOI: 10.3390/math9182321] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Feature selection is a well-known prepossessing procedure, and it is considered a challenging problem in many domains, such as data mining, text mining, medicine, biology, public health, image processing, data clustering, and others. This paper proposes a novel feature selection method, called AOAGA, using an improved metaheuristic optimization method that combines the conventional Arithmetic Optimization Algorithm (AOA) with the Genetic Algorithm (GA) operators. The AOA is a recently proposed optimizer; it has been employed to solve several benchmark and engineering problems and has shown a promising performance. The main aim behind the modification of the AOA is to enhance its search strategies. The conventional version suffers from weaknesses, the local search strategy, and the trade-off between the search strategies. Therefore, the operators of the GA can overcome the shortcomings of the conventional AOA. The proposed AOAGA was evaluated with several well-known benchmark datasets, using several standard evaluation criteria, namely accuracy, number of selected features, and fitness function. Finally, the results were compared with the state-of-the-art techniques to prove the performance of the proposed AOAGA method. Moreover, to further assess the performance of the proposed AOAGA method, two real-world problems containing gene datasets were used. The findings of this paper illustrated that the proposed AOAGA method finds new best solutions for several test cases, and it got promising results compared to other comparative methods published in the literature.
Collapse
|
45
|
|
46
|
CMVHHO-DKMLC: A Chaotic Multi Verse Harris Hawks optimization (CMV-HHO) algorithm based deep kernel optimized machine learning classifier for medical diagnosis. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.103034] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
47
|
Panahi F, Ehteram M, Emami M. Suspended sediment load prediction based on soft computing models and Black Widow Optimization Algorithm using an enhanced gamma test. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2021; 28:48253-48273. [PMID: 33904136 DOI: 10.1007/s11356-021-14065-4] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/30/2020] [Accepted: 04/19/2021] [Indexed: 06/12/2023]
Abstract
The suspended sediment load (SSL) prediction is one of the most important issues in water engineering. In this article, the adaptive neuro-fuzzy interface system (ANFIS) and support vector machine (SVM) were used to estimate the SLL of two main tributaries of the Telar River placed in the north of Iran. The main Telar River had two main tributaries, namely, the Telar and the Kasilian. A new evolutionary algorithm, namely, the black widow optimization algorithm (BWOA), was used to enhance the precision of the ANFIS and SVM models for predicting daily SSL. The lagged rainfall, temperature, discharge, and SSL were used as the inputs to the models. The present study used a new hybrid Gamma test to determine the best input scenario. In the next step, the best input combination was determined based on the gamma value. In this research, the abilities of the ANFIS-BWOA and SVM-BWOA were benchmarked with the ANFIS-bat algorithm (BA), SVM-BA, SVM-particle swarm optimization (PSO), and ANFIS-PSO. The mean absolute error (MAE) of ANFIS-BWOA was 0.40%, 2.2%, and 2.5% lower than those of ANFIS-BA, ANFIS-PSO, and ANFIS models in the training level for Telar River. It was concluded that the ANFIS-BWOA had the highest value of R2 among other models in the Telar River. The MAE of the ANFIS-BWOA, SVM-BWOA, SVM-PSO, SVM-BA, and SVM models were 899.12 (Ton/day), 934.23 (Ton/day), 987.12 (Ton/day), 976.12, and 989.12 (Ton/day), respectively, in the testing level for the Kasilian River. An uncertainty analysis was used to investigate the effect of uncertainty of the inputs (first scenario) and the model parameters (the second scenario) on the accuracy of models. It was observed that the input uncertainty higher than the parameter uncertainty.
Collapse
Affiliation(s)
- Fatemeh Panahi
- Faculty of Natural Resources and Earth Sciences, University of Kashan, Kashan, Iran
| | - Mohammad Ehteram
- Department of Water Engineering and Hydraulic Structures, Faculty of Civil Engineering, Semnan University, Semnan, Iran.
| | - Mohammad Emami
- Department of Water Engineering and Hydraulic Structures, Faculty of Civil Engineering, Semnan University, Semnan, Iran
| |
Collapse
|
48
|
Dhal P, Azad C. A multi-objective feature selection method using Newton’s law based PSO with GWO. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107394] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
49
|
Diaz PM, Jiju MJE. A comparative analysis of meta-heuristic optimization algorithms for feature selection and feature weighting in neural networks. EVOLUTIONARY INTELLIGENCE 2021. [DOI: 10.1007/s12065-021-00634-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
50
|
Model‐based multi‐objective particle swarm production optimization for efficient injection/production planning to improve reservoir recovery. CAN J CHEM ENG 2021. [DOI: 10.1002/cjce.24158] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|