1
|
Gelvez-Almeida E, Barrientos RJ, Vilches-Ponce K, Mora M. Parallel ensemble of a randomization-based online sequential neural network for classification problems using a frequency criterion. Sci Rep 2024; 14:16104. [PMID: 38997323 PMCID: PMC11245530 DOI: 10.1038/s41598-024-66676-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2023] [Accepted: 07/03/2024] [Indexed: 07/14/2024] Open
Abstract
Randomization-based neural networks have gained wide acceptance in the scientific community owing to the simplicity of their algorithm and generalization capabilities. Random vector functional link (RVFL) networks and their variants are a class of randomization-based neural networks. RVFL networks have shown promising results in classification, regression, and clustering problems. For real-world applications, learning algorithms that can train with new samples over previous results are necessary because of to the constant generation of problems related to large-scale datasets. Various online sequential algorithms, commonly involving an initial learning phase followed by a sequential learning phase, have been proposed to address this issue. This paper presents a training algorithm based on multiple online sequential random vector functional link (OS-RVFL) networks for large-scale databases using a shared memory architecture. The training dataset is distributed among p OS-RVFL networks, which are trained in parallel using p threads. Subsequently, the test dataset samples are classified using each trained OS-RVFL network. Finally, a frequency criterion is applied to the results obtained from each OS-RVFL network to determine the final classification. Additionally, an equation was derived to reasonably predict the total training time of the proposed algorithm based on the learning time in the initial phase and the time scaling factor compared to the sequential learning phase. The results demonstrate a drastic reduction in training time because of data distribution and an improvement in accuracy because of the adoption of the frequency criterion.
Collapse
Affiliation(s)
- Elkin Gelvez-Almeida
- Doctorado en Modelamiento Matemático Aplicado, Universidad Católica del Maule, 3480112, Talca, Chile
- Facultad de Ciencias Básicas y Biomédicas, Universidad Simón Bolívar, San José de Cúcuta, 540006, Colombia
| | - Ricardo J Barrientos
- Laboratory of Technological Research in Pattern Recognition (LITRP), Facultad de Ciencias de la Ingeniería, Universidad Católica del Maule, 3480112, Talca, Chile.
- Departamento de Computación e Industrias, Facultad de Ciencias de la Ingeniería, Universidad Católica del Maule, 3480112, Talca, Chile.
| | - Karina Vilches-Ponce
- Laboratory of Technological Research in Pattern Recognition (LITRP), Facultad de Ciencias de la Ingeniería, Universidad Católica del Maule, 3480112, Talca, Chile
- Departamento de Computación e Industrias, Facultad de Ciencias de la Ingeniería, Universidad Católica del Maule, 3480112, Talca, Chile
| | - Marco Mora
- Laboratory of Technological Research in Pattern Recognition (LITRP), Facultad de Ciencias de la Ingeniería, Universidad Católica del Maule, 3480112, Talca, Chile
- Departamento de Computación e Industrias, Facultad de Ciencias de la Ingeniería, Universidad Católica del Maule, 3480112, Talca, Chile
| |
Collapse
|
2
|
Lu J, Fu H, Tang X, Liu Z, Huang J, Zou W, Chen H, Sun Y, Ning X, Li J. GOA-optimized deep learning for soybean yield estimation using multi-source remote sensing data. Sci Rep 2024; 14:7097. [PMID: 38528045 DOI: 10.1038/s41598-024-57278-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Accepted: 03/15/2024] [Indexed: 03/27/2024] Open
Abstract
Accurately estimating large-area crop yields, especially for soybeans, is essential for addressing global food security challenges. This study introduces a deep learning framework that focuses on precise county-level soybean yield estimation in the United States. It utilizes a wide range of multi-variable remote sensing data. The model used in this study is a state-of-the-art CNN-BiGRU model, which is enhanced by the GOA and a novel attention mechanism (GCBA). This model excels in handling intricate time series and diverse remote sensing datasets. Compared to five leading machine learning and deep learning models, our GCBA model demonstrates superior performance, particularly in the 2019 and 2020 evaluations, achieving remarkable R2, RMSE, MAE and MAPE values. This sets a new benchmark in yield estimation accuracy. Importantly, the study highlights the significance of integrating multi-source remote sensing data. It reveals that synthesizing information from various sensors and incorporating photosynthesis-related parameters significantly enhances yield estimation precision. These advancements not only provide transformative insights for precision agricultural management but also establish a solid scientific foundation for informed decision-making in global agricultural production and food security.
Collapse
Affiliation(s)
- Jian Lu
- Institute of Smart Agriculture, Jilin Agricultural University, Changchun, 130118, People's Republic of China
| | - Hongkun Fu
- College of Agriculture, Jilin Agricultural University, Changchun, 130118, People's Republic of China
| | - Xuhui Tang
- College of Information Technology, Jilin Agricultural University, Changchun, 130118, People's Republic of China
| | - Zhao Liu
- Northeast Institute of Geography and Agroecology, Chinese Academy of Sciences, Changchun, 130102, People's Republic of China
| | - Jujian Huang
- College of Surveying and Exploration, Jilin Jianzhu University, Changchun, 130119, People's Republic of China
| | - Wenlong Zou
- Northeast Institute of Geography and Agroecology, Chinese Academy of Sciences, Changchun, 130102, People's Republic of China
| | - Hui Chen
- Northeast Institute of Geography and Agroecology, Chinese Academy of Sciences, Changchun, 130102, People's Republic of China
| | - Yue Sun
- Northeast Institute of Geography and Agroecology, Chinese Academy of Sciences, Changchun, 130102, People's Republic of China
| | - Xiangyu Ning
- Northeast Institute of Geography and Agroecology, Chinese Academy of Sciences, Changchun, 130102, People's Republic of China
| | - Jian Li
- Institute of Smart Agriculture, Jilin Agricultural University, Changchun, 130118, People's Republic of China.
| |
Collapse
|
3
|
Peralez-González C, Pérez-Rodríguez J, Durán-Rosal AM. Boosting ridge for the extreme learning machine globally optimised for classification and regression problems. Sci Rep 2023; 13:11809. [PMID: 37479841 PMCID: PMC10362034 DOI: 10.1038/s41598-023-38948-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 07/18/2023] [Indexed: 07/23/2023] Open
Abstract
This paper explores the boosting ridge (BR) framework in the extreme learning machine (ELM) community and presents a novel model that trains the base learners as a global ensemble. In the context of Extreme Learning Machine single-hidden-layer networks, the nodes in the hidden layer are preconfigured before training, and the optimisation is performed on the weights in the output layer. The previous implementation of the BR ensemble with ELM (BRELM) as base learners fix the nodes in the hidden layer for all the ELMs. The ensemble learning method generates different output layer coefficients by reducing the residual error of the ensemble sequentially as more base learners are added to the ensemble. As in other ensemble methodologies, base learners are selected until fulfilling ensemble criteria such as size or performance. This paper proposes a global learning method in the BR framework, where base learners are not added step by step, but all are calculated in a single step looking for ensemble performance. This method considers (i) the configurations of the hidden layer are different for each base learner, (ii) the base learners are optimised all at once, not sequentially, thus avoiding saturation, and (iii) the ensemble methodology does not have the disadvantage of working with strong classifiers. Various regression and classification benchmark datasets have been selected to compare this method with the original BRELM implementation and other state-of-the-art algorithms. Particularly, 71 datasets for classification and 52 for regression, have been considered using different metrics and analysing different characteristics of the datasets, such as the size, the number of classes or the imbalanced nature of them. Statistical tests indicate the superiority of the proposed method in both regression and classification problems in all experimental scenarios.
Collapse
|
4
|
Ye Q, Wang Z, Zhao Y, Dai R, Wu F, Yu M. A clustering-based competitive particle swarm optimization with grid ranking for multi-objective optimization problems. Sci Rep 2023; 13:11754. [PMID: 37474702 PMCID: PMC10359354 DOI: 10.1038/s41598-023-38529-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Accepted: 07/10/2023] [Indexed: 07/22/2023] Open
Abstract
The goal of the multi-objective optimization algorithm is to quickly and accurately find a set of trade-off solutions. This paper develops a clustering-based competitive multi-objective particle swarm optimizer using the enhanced grid for solving multi-objective optimization problems, named EGC-CMOPSO. The enhanced grid mechanism involved in EGC-CMOPSO is designed to locate superior Pareto optimal solutions. Subsequently, a hierarchical-based clustering is established on the grid for improving the accuracy rate of the grid selection. Due to the adaptive division of clustering centers, EGC-CMOPSO is applicable for solving MOPs with various Pareto front (PF) shapes. Particularly, the inferior solutions are discarded and the leading particles are identified by the comprehensive ranking of particles in each cluster. Finally, the selected leading particles compete against each other, and the winner guides the update of the current particle. The proposed EGC-CMOPSO and the eight latest multi-objective optimization algorithms are performed on 21 test problems. The experimental results validate that the proposed EGC-CMOPSO is capable of handling multi-objective optimization problems (MOPs) and obtaining superior performance on both convergence and diversity.
Collapse
Affiliation(s)
- Qianlin Ye
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, 310023, China.
| | - Zheng Wang
- School of Computer and Computational Sciences, Hangzhou City University, Hangzhou, 310015, China.
| | - Yanwei Zhao
- School of Engineering, Hangzhou City University, Hangzhou, 310015, China
| | - Rui Dai
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, 310023, China
| | - Fei Wu
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, 310023, China
| | - Mengjiao Yu
- College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, 310023, China
| |
Collapse
|
5
|
Improved Fitness-Dependent Optimizer for Solving Economic Load Dispatch Problem. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:7055910. [PMID: 35860638 PMCID: PMC9293509 DOI: 10.1155/2022/7055910] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Revised: 05/01/2022] [Accepted: 05/18/2022] [Indexed: 11/17/2022]
Abstract
Economic load dispatch depicts a fundamental role in the operation of power systems, as it decreases the environmental load, minimizes the operating cost, and preserves energy resources. The optimal solution to economic load dispatch problems and various constraints can be obtained by evolving several evolutionary and swarm-based algorithms. The major drawback to swarm-based algorithms is premature convergence towards an optimal solution. Fitness-dependent optimizer is a novel optimization algorithm stimulated by the decision-making and reproductive process of bee swarming. Fitness-dependent optimizer (FDO) examines the search spaces based on the searching approach of particle swarm optimization. To calculate the pace, the fitness function is utilized to generate weights that direct the search agents in the phases of exploitation and exploration. In this research, the authors have used a fitness-dependent optimizer to solve the economic load dispatch problem by reducing fuel cost, emission allocation, and transmission loss. Moreover, the authors have enhanced a novel variant of the fitness-dependent optimizer, which incorporates novel population initialization techniques and dynamically employed sine maps to select the weight factor for the fitness-dependent optimizer. The enhanced population initialization approach incorporates a quasi-random Sabol sequence to generate the initial solution in the multidimensional search space. A standard 24-unit system is employed for experimental evaluation with different power demands. The empirical results obtained using the enhanced variant of the fitness-dependent optimizer demonstrate superior performance in terms of low transmission loss, low fuel cost, and low emission allocation compared to the conventional fitness-dependent optimizer. The experimental study obtained 7.94E−12, the lowest transmission loss using the enhanced fitness-dependent optimizer. Correspondingly, various standard estimations are used to prove the stability of the fitness-dependent optimizer in phases of exploitation and exploration.
Collapse
|
6
|
A Review of an Artificial Intelligence Framework for Identifying the Most Effective Palm Oil Prediction. ALGORITHMS 2022. [DOI: 10.3390/a15060218] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Machine Learning (ML) offers new precision technologies with intelligent algorithms and robust computation. This technology benefits various agricultural industries, such as the palm oil sector, which possesses one of the most sustainable industries worldwide. Hence, an in-depth analysis was conducted, which is derived from previous research on ML utilisation in the palm oil in-dustry. The study provided a brief overview of widely used features and prediction algorithms and critically analysed current the state of ML-based palm oil prediction. This analysis is extended to the ML application in the palm oil industry and a comparison of related studies. The analysis was predicated on thoroughly examining the advantages and disadvantages of ML-based palm oil prediction and the proper identification of current and future agricultural industry challenges. Potential solutions for palm oil prediction were added to this list. Artificial intelligence and ma-chine vision were used to develop intelligent systems, revolutionising the palm oil industry. Overall, this article provided a framework for future research in the palm oil agricultural industry by highlighting the importance of ML.
Collapse
|
7
|
Liu L, Wang M, Li G, Wang Q. Construction of Predictive Model for Type 2 Diabetic Retinopathy Based on Extreme Learning Machine. Diabetes Metab Syndr Obes 2022; 15:2607-2617. [PMID: 36046759 PMCID: PMC9420743 DOI: 10.2147/dmso.s374767] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Accepted: 08/18/2022] [Indexed: 12/02/2022] Open
Abstract
PURPOSE The common cause of blindness in people with type 2 diabetes (T2D) is diabetic retinopathy (DR). Early fundus examinations have been shown to prevent vision loss, but routine ophthalmic screenings for patients with diabetes present significant financial and material challenges to existing health-care systems. The purpose of this study is to build a DR prediction model based on the extreme learning machine (ELM) and to compare the performance with the DR prediction models based on support machine vector (SVM), K proximity (KNN), random forest (RF) and artificial neural network (ANN). METHODS From January 1, 2020 to November 31, 2021, data were collected from electronic inpatient medical records at Lu'an Hospital of Anhui Medical University in China. An extreme learning machine (ELM) algorithm was used to develop a prediction model based on demographic data and blood testing and urine test results. Several metrics were used to evaluate the model's performance: (1) classification accuracy (ACC), (2) sensitivity, (3) specificity, (4) Precision,(5) Negative predictive value (NPV), (6) Training time and (7) area under the receiver operating characteristic (ROC) curve (AUC). RESULTS In terms of ACC, Sensitivity, Specificity, Precision, NPV and AUC, DR prediction model based on SVM and ELM is better than DR prediction model based on ANN, KNN and RF. The prediction model for diabetic retinopathy based on elm is the best among them in terms of ACC, Precision, Specificity, Training time and AUC, with 84.45%, 83.93%, 93.16%,1.24s, and 88.34%, respectively. The DR prediction model based on SVM is the best in terms of sensitivity and NPV, which are, respectively, 70.82% and 85.60%. CONCLUSION According to the findings of this study, the model based on the extreme learning machine presents an outstanding performance in predicting diabetic retinopathy thus providing technological assistance for screening of diabetic retinopathy.
Collapse
Affiliation(s)
- Lei Liu
- Graduate School of Bengbu Medical College, Bengbu Medical College, Bengbu City, People’s Republic of China
| | - Mengmeng Wang
- Graduate School of Bengbu Medical College, Bengbu Medical College, Bengbu City, People’s Republic of China
| | - Guocheng Li
- School of Finance & Mathematics, West Anhui University, Lu’an City, People’s Republic of China
| | - Qi Wang
- Graduate School of Bengbu Medical College, Bengbu Medical College, Bengbu City, People’s Republic of China
- Department of Endocrinology, Lu’an Hospital of Anhui Medical University, Lu’an City, People’s Republic of China
- Correspondence: Qi Wang, Department of Endocrinology, Lu’an Hospital of Anhui Medical University, No. 21, Wanxi West Road, Lu’an City, People’s Republic of China, Tel +86-13966299858, Email
| |
Collapse
|