1
|
Kononova AV, Vermetten D, Caraffini F, Mitran MA, Zaharie D. The Importance of Being Constrained: Dealing with Infeasible Solutions in Differential Evolution and Beyond. EVOLUTIONARY COMPUTATION 2024; 32:3-48. [PMID: 37186673 DOI: 10.1162/evco_a_00333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 05/04/2023] [Indexed: 05/17/2023]
Abstract
We argue that results produced by a heuristic optimisation algorithm cannot be considered reproducible unless the algorithm fully specifies what should be done with solutions generated outside the domain, even in the case of simple bound constraints. Currently, in the field of heuristic optimisation, such specification is rarely mentioned or investigated due to the assumed triviality or insignificance of this question. Here, we demonstrate that, at least in algorithms based on Differential Evolution, this choice induces notably different behaviours in terms of performance, disruptiveness, and population diversity. This is shown theoretically (where possible) for standard Differential Evolution in the absence of selection pressure and experimentally for the standard and state-of-the-art Differential Evolution variants, on a special test function and the BBOB benchmarking suite, respectively. Moreover, we demonstrate that the importance of this choice quickly grows with problem dimensionality. Differential Evolution is not at all special in this regard-there is no reason to presume that other heuristic optimisers are not equally affected by the aforementioned algorithmic choice. Thus, we urge the heuristic optimisation community to formalise and adopt the idea of a new algorithmic component in heuristic optimisers, which we refer to as the strategy of dealing with infeasible solutions. This component needs to be consistently: (a) specified in algorithmic descriptions to guarantee reproducibility of results, (b) studied to better understand its impact on an algorithm's performance in a wider sense (i.e., convergence time, robustness, etc.), and (c) included in the (automatic) design of algorithms. All of these should be done even for problems with bound constraints.
Collapse
Affiliation(s)
| | | | - Fabio Caraffini
- Department of Computer Science, Swansea University, United Kingdom
| | - Madalina-A Mitran
- Department of Computer Science, West University of Timişoara, Romania
| | - Daniela Zaharie
- Department of Computer Science, West University of Timişoara, Romania
| |
Collapse
|
2
|
Transfer learning based evolutionary algorithm framework for multi-objective optimization problems. APPL INTELL 2023. [DOI: 10.1007/s10489-022-04444-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
|
3
|
Abdel-Nabi H, Ali MZ, Awajan A, Alazrai R, Daoud MI, Suganthan PN. An Iterative cyclic Tri-Strategy Hybrid Stochastic fractal with Adaptive Differential Algorithm for Global Numerical Optimization. Inf Sci (N Y) 2023. [DOI: 10.1016/j.ins.2023.01.065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
|
4
|
Multiple individual guided differential evolution with time varying and feedback information-based control parameters. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.110091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
5
|
Gupta S, Su R. An efficient differential evolution with fitness-based dynamic mutation strategy and control parameters. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.109280] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
6
|
Abed-alguni BH, Paul D, Hammad R. Improved Salp swarm algorithm for solving single-objective continuous optimization problems. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03269-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
|
7
|
Liu J, Wei J, Heidari AA, Kuang F, Zhang S, Gui W, Chen H, Pan Z. Chaotic simulated annealing multi-verse optimization enhanced kernel extreme learning machine for medical diagnosis. Comput Biol Med 2022; 144:105356. [PMID: 35299042 DOI: 10.1016/j.compbiomed.2022.105356] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Revised: 02/25/2022] [Accepted: 02/25/2022] [Indexed: 01/09/2023]
Abstract
Classification models such as Multi-Verse Optimization (MVO) play a vital role in disease diagnosis. To improve the efficiency and accuracy of MVO, in this paper, the defects of MVO are mitigated and the improved MVO is combined with kernel extreme learning machine (KELM) for effective disease diagnosis. Although MVO obtains some relatively good results on some problems of interest, it suffers from slow convergence speed and local optima entrapment for some many-sided basins, especially multi-modal problems with high dimensions. To solve these shortcomings, in this study, a new chaotic simulated annealing overhaul of MVO (CSAMVO) is proposed. Based on MVO, two approaches are adopted to offer a relatively stable and efficient convergence speed. Specifically, a chaotic intensification mechanism (CIP) is applied to the optimal universe evaluation stage to increase the depth of the universe search. After obtaining relatively satisfactory results, the simulated annealing algorithm (SA) is employed to reinforce the capability of MVO to avoid local optima. To evaluate its performance, the proposed CSAMVO approach was compared with a wide range of classical algorithms on thirty-nine benchmark functions. The results show that the improved MVO outperforms the other algorithms in terms of solution quality and convergence speed. Furthermore, based on CSAMVO, a hybrid KELM model termed CSAMVO-KELM is established for disease diagnosis. To evaluate its effectiveness, the new hybrid system was compared with a multitude of competitive classifiers on two disease diagnosis problems. The results demonstrate that the proposed CSAMVO-assisted classifier can find solutions with better learning potential and higher predictive performance.
Collapse
Affiliation(s)
- Jiacong Liu
- Department of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou, 325035, China.
| | - Jiahui Wei
- Department of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou, 325035, China.
| | - Ali Asghar Heidari
- School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran, Iran.
| | - Fangjun Kuang
- School of Information Engineering, Wenzhou Business College, Wenzhou, 325035, China.
| | - Siyang Zhang
- School of Information Engineering, Wenzhou Business College, Wenzhou, 325035, China.
| | - Wenyong Gui
- Department of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou, 325035, China.
| | - Huiling Chen
- Department of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou, 325035, China.
| | - Zhifang Pan
- The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, 325000, China.
| |
Collapse
|
8
|
TPDE: A tri-population differential evolution based on zonal-constraint stepped division mechanism and multiple adaptive guided mutation strategies. Inf Sci (N Y) 2021. [DOI: 10.1016/j.ins.2021.06.035] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
9
|
Zeng Z, Zhang M, Chen T, Hong Z. A new selection operator for differential evolution algorithm. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107150] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
|
10
|
Shaker Ardakani L, Surendar A, Thangavelu L, Mandal T. Silver nanoparticles (Ag NPs) as catalyst in chemical reactions. SYNTHETIC COMMUN 2021. [DOI: 10.1080/00397911.2021.1894450] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Affiliation(s)
| | - A. Surendar
- Department of Pharmacology, Saveetha Dental College and Hospital, Saveetha Institute of Medical and Technical Sciences, Saveetha University, Chennai, India
| | - Lakshmi Thangavelu
- Department of Pharmacology, Saveetha Dental College and Hospital, Saveetha Institute of Medical and Technical Sciences, Saveetha University, Chennai, India
| | - Tanmay Mandal
- Department of Chemistry, University of Delhi, Delhi, India
| |
Collapse
|
11
|
Song S, Wang P, Heidari AA, Wang M, Zhao X, Chen H, He W, Xu S. Dimension decided Harris hawks optimization with Gaussian mutation: Balance analysis and diversity patterns. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2020.106425] [Citation(s) in RCA: 59] [Impact Index Per Article: 19.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
|
12
|
Sun G, Li C, Deng L. An adaptive regeneration framework based on search space adjustment for differential evolution. Neural Comput Appl 2021. [DOI: 10.1007/s00521-021-05708-1] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
13
|
Ardakani LS, Arabmarkadeh A, Kazemi M. Multicomponent synthesis of highly functionalized piperidines. SYNTHETIC COMMUN 2020. [DOI: 10.1080/00397911.2020.1861301] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Affiliation(s)
| | - Arash Arabmarkadeh
- Biotechnology Group, Faculty of Chemical Engineering, Tarbiat Modares University, Tehran, Iran
| | - Mosstafa Kazemi
- Young Researchers and Elite Club, Ilam Branch, Islamic Azad University, Ilam, Iran
| |
Collapse
|
14
|
Affiliation(s)
- Xiaomin Li
- Ecology and Health Institute, Hangzhou Vocational & Technical College, Hangzhou, China
| |
Collapse
|
15
|
Multi-population following behavior-driven fruit fly optimization: A Markov chain convergence proof and comprehensive analysis. Knowl Based Syst 2020. [DOI: 10.1016/j.knosys.2020.106437] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
16
|
|
17
|
Special issue on decision making and uncertainty. Soft comput 2020. [DOI: 10.1007/s00500-020-04702-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
18
|
ZHANG D, SUN D. A model for art communication and development under the influence of social network. TRANSINFORMACAO 2020. [DOI: 10.1590/2318-0889202032e200047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Abstract Improving the value of art information and user behavior factors can boost the effect of art communication and development. This paper proposes a social network based on the s-seir (Single SEIR) art communication and development model, a new model developed based on the SEIR (Susceptible, Exposed, Infectious, Recovered) classical epidemic dynamics model. In addition, we present the concept and characteristics of art communication, summarize the rules of node classification and art information evolution, and design an interpretative s-seir model considering the value of art information and user behavior factors. The experimental results show that the model can clearly analyze the impact of art value and user behavior on the dissemination and development of art information, and has the advantages of high efficiency and accuracy.
Collapse
|