1
|
Hussain K, Mehmood K, Anees SA, Ding Z, Muhammad S, Badshah T, Shahzad F, Haidar I, Wahab A, Ali J, Ansari MJ, Salmen SH, Yujun S, Khan WR. Assessing forest fragmentation due to land use changes from 1992 to 2023: A spatio-temporal analysis using remote sensing data. Heliyon 2024; 10:e34710. [PMID: 39148982 PMCID: PMC11325051 DOI: 10.1016/j.heliyon.2024.e34710] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2024] [Revised: 07/12/2024] [Accepted: 07/15/2024] [Indexed: 08/17/2024] Open
Abstract
The increasing pressures of urban development and agricultural expansion have significant implications for land use and land cover (LULC) dynamics, particularly in ecologically sensitive regions like the Murree and Kotli Sattian tehsils of the Rawalpindi district in Pakistan. This study's primary objective is to assess spatial variations within each LULC category over three decades (1992-2023) using cross-tabulation in ArcGIS to identify changes in LULC and investigates into forest fragmentation analysis using the Landscape Fragmentation Tool (LFTv2.0) to classify forest into several classes such as patch, edge, perforated, small core, medium core, and large core. Utilizing remote sensing data from Landsat 5 and Landsat 9 satellites, the research focuses on the temporal dynamics in various land classes including Coniferous Forest (CF), Evergreen Forest (EF), Arable Land (AR), Buildup Area (BU), Barren Land (BA), Water (WA), and Grassland (GL). The Support Vector Machine (SVM) classifier and ArcGIS software were employed for image processing and classification, ensuring accuracy in categorizing different land types. Our results indicate a notable reduction in forested areas, with Coniferous Forest (CF) decreasing from 363.9 km2, constituting 45.0 % of the area in 1992, to 291.5 km2 (36.0 %) in 2023, representing a total decrease of 72.4 km2. Similarly, Evergreen Forests have also seen a significant reduction, from 177.9 km2 (22.0 %) in 1992 to 99.8 km2 (12.3 %) in 2023, a decrease of 78.1 km2. The study investigates into forest fragmentation analysis using the Landscape Fragmentation Tool (LFTv2.0), revealing an increase in fragmentation and a decrease in large core forests from 20.3 % of the total area in 1992 to 7.2 % in 2023. Additionally, the patch forest area increased from 2.4 % in 1992 to 5.9 % in 2023, indicating significant fragmentation. Transition matrices and a Sankey diagram illustrate the transitions between different LULC classes, providing a comprehensive view of the dynamics of land-use changes and their implications for ecosystem services. These findings highlight the critical need for robust conservation strategies and effective land management practices. The study contributes to the understanding of LULC dynamics and forest fragmentation in the Himalayan region of Pakistan, offering insights essential for future land management and policymaking in the face of rapid environmental changes.
Collapse
Affiliation(s)
- Khadim Hussain
- State Forestry and Grassland Administration Key Laboratory of Forest Resources and Environmental Management, Beijing Forestry University, Beijing, 100083, China
| | - Kaleem Mehmood
- Key Laboratory for Silviculture and Conservation of Ministry of Education, Beijing Forestry University, Beijing, 100083, China
- Institute of Forest Science, University of Swat, Main Campus Charbagh 19120, Swat, Pakistan
| | - Shoaib Ahmad Anees
- Department of Forestry, The University of Agriculture, Dera Ismail Khan, 29050, Pakistan
- Key Laboratory of Environment Change and Resources Use in Beibu Gulf, Ministry of Education, Nanning Normal University, Nanning, 530001, China
| | - Zhidan Ding
- State Forestry and Grassland Administration Key Laboratory of Forest Resources and Environmental Management, Beijing Forestry University, Beijing, 100083, China
| | - Sultan Muhammad
- Institute of Forest Science, University of Swat, Main Campus Charbagh 19120, Swat, Pakistan
- Department of Forestry and Wildlife, Faculty of Physical & Applied Sciences, University of Haripur, Pakistan
| | - Tariq Badshah
- State Forestry and Grassland Administration Key Laboratory of Forest Resources and Environmental Management, Beijing Forestry University, Beijing, 100083, China
| | - Fahad Shahzad
- Mapping and 3S Technology Center, Beijing Forestry University, Beijing, 100083, China
| | - Ijlal Haidar
- State Forestry and Grassland Administration Key Laboratory of Forest Resources and Environmental Management, Beijing Forestry University, Beijing, 100083, China
- Key Laboratory for Silviculture and Conservation of Ministry of Education, Beijing Forestry University, Beijing, 100083, China
| | - Abdul Wahab
- Department of Forestry and Range Management, Arid Agriculture University Rawalpindi, Pakistan
| | - Jamshid Ali
- Key Laboratory for Silviculture and Conservation of Ministry of Education, Beijing Forestry University, Beijing, 100083, China
| | - Mohammad Javed Ansari
- Department of Botany, Hindu College Moradabad (Mahatma Jyotiba Phule Rohilkhand University Bareilly), 244001, India
| | - Saleh H Salmen
- Department of Botany and Microbiology, College of Science, King Saud University, PO Box -2455, Riyadh, 11451, Saudi Arabia
| | - Sun Yujun
- State Forestry and Grassland Administration Key Laboratory of Forest Resources and Environmental Management, Beijing Forestry University, Beijing, 100083, China
| | - Waseem Razzaq Khan
- Department of Forestry Science and Biodiversity, Faculty of Forestry and Environment, Universiti Putra Malaysia UPM, Serdang, 43400, Selangor, Malaysia
- Advanced Master in Sustainable Blue Economy, National Institute of Oceanography and Applied Geophysics - OGS, University of Trieste, Trieste, 34127, Italy
- Institut Ekosains Borneo (IEB), Universiti Putra Malaysia Bintulu Campus, Sarawak, 97008, Malaysia
| |
Collapse
|
2
|
Talari P, N B, Kaur G, Alshahrani H, Al Reshan MS, Sulaiman A, Shaikh A. Hybrid feature selection and classification technique for early prediction and severity of diabetes type 2. PLoS One 2024; 19:e0292100. [PMID: 38236900 PMCID: PMC10796060 DOI: 10.1371/journal.pone.0292100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 09/12/2023] [Indexed: 01/22/2024] Open
Abstract
Diabetes prediction is an ongoing study topic in which medical specialists are attempting to forecast the condition with greater precision. Diabetes typically stays lethargic, and on the off chance that patients are determined to have another illness, like harm to the kidney vessels, issues with the retina of the eye, or a heart issue, it can cause metabolic problems and various complexities in the body. Various worldwide learning procedures, including casting a ballot, supporting, and sacking, have been applied in this review. The Engineered Minority Oversampling Procedure (Destroyed), along with the K-overlay cross-approval approach, was utilized to achieve class evening out and approve the discoveries. Pima Indian Diabetes (PID) dataset is accumulated from the UCI Machine Learning (UCI ML) store for this review, and this dataset was picked. A highlighted engineering technique was used to calculate the influence of lifestyle factors. A two-phase classification model has been developed to predict insulin resistance using the Sequential Minimal Optimisation (SMO) and SMOTE approaches together. The SMOTE technique is used to preprocess data in the model's first phase, while SMO classes are used in the second phase. All other categorization techniques were outperformed by bagging decision trees in terms of Misclassification Error rate, Accuracy, Specificity, Precision, Recall, F1 measures, and ROC curve. The model was created using a combined SMOTE and SMO strategy, which achieved 99.07% correction with 0.1 ms of runtime. The suggested system's result is to enhance the classifier's performance in spotting illness early.
Collapse
Affiliation(s)
- Praveen Talari
- Department of Computer Science and Engineering, Vignana Bharathi Institute of Technology, Hyderabad, India
| | - Bharathiraja N
- Chitkara University Institute of Engineering and Technology, Chitkara University Punjab, Rajpura, India
| | - Gaganpreet Kaur
- Chitkara University Institute of Engineering and Technology, Chitkara University Punjab, Rajpura, India
| | - Hani Alshahrani
- Department of Computer Science, College of Computer Science and Information Systems, Najran University, Najran, Saudi Arabia
| | - Mana Saleh Al Reshan
- Department of Information Systems, College of Computer Science and Information Systems, Najran University, Najran, Saudi Arabia
- Scientific and Engineering Research Centre, Najran University, Najran, Saudi Arabia
| | - Adel Sulaiman
- Department of Computer Science, College of Computer Science and Information Systems, Najran University, Najran, Saudi Arabia
| | - Asadullah Shaikh
- Department of Information Systems, College of Computer Science and Information Systems, Najran University, Najran, Saudi Arabia
| |
Collapse
|
3
|
Liu G, Guo Z, Liu W, Jiang F, Fu E. A feature selection method based on the Golden Jackal-Grey Wolf Hybrid Optimization Algorithm. PLoS One 2024; 19:e0295579. [PMID: 38165924 PMCID: PMC10760777 DOI: 10.1371/journal.pone.0295579] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2023] [Accepted: 11/20/2023] [Indexed: 01/04/2024] Open
Abstract
This paper proposes a feature selection method based on a hybrid optimization algorithm that combines the Golden Jackal Optimization (GJO) and Grey Wolf Optimizer (GWO). The primary objective of this method is to create an effective data dimensionality reduction technique for eliminating redundant, irrelevant, and noisy features within high-dimensional datasets. Drawing inspiration from the Chinese idiom "Chai Lang Hu Bao," hybrid algorithm mechanisms, and cooperative behaviors observed in natural animal populations, we amalgamate the GWO algorithm, the Lagrange interpolation method, and the GJO algorithm to propose the multi-strategy fusion GJO-GWO algorithm. In Case 1, the GJO-GWO algorithm addressed eight complex benchmark functions. In Case 2, GJO-GWO was utilized to tackle ten feature selection problems. Experimental results consistently demonstrate that under identical experimental conditions, whether solving complex benchmark functions or addressing feature selection problems, GJO-GWO exhibits smaller means, lower standard deviations, higher classification accuracy, and reduced execution times. These findings affirm the superior optimization performance, classification accuracy, and stability of the GJO-GWO algorithm.
Collapse
Affiliation(s)
- Guangwei Liu
- College of Mining, Liaoning Technical University, Fuxin, Liaoning, China
| | - Zhiqing Guo
- College of Mining, Liaoning Technical University, Fuxin, Liaoning, China
| | - Wei Liu
- College of Science, Liaoning Technical University, Fuxin, Liaoning, China
| | - Feng Jiang
- College of Science, Liaoning Technical University, Fuxin, Liaoning, China
| | - Ensan Fu
- College of Mining, Liaoning Technical University, Fuxin, Liaoning, China
| |
Collapse
|
4
|
Zhou G, Gao J, Zuo D, Li J, Li R. MSXFGP: combining improved sparrow search algorithm with XGBoost for enhanced genomic prediction. BMC Bioinformatics 2023; 24:384. [PMID: 37817077 PMCID: PMC10566073 DOI: 10.1186/s12859-023-05514-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Accepted: 10/02/2023] [Indexed: 10/12/2023] Open
Abstract
BACKGROUND With the significant reduction in the cost of high-throughput sequencing technology, genomic selection technology has been rapidly developed in the field of plant breeding. Although numerous genomic selection methods have been proposed by researchers, the existing genomic selection methods still face the problem of poor prediction accuracy in practical applications. RESULTS This paper proposes a genome prediction method MSXFGP based on a multi-strategy improved sparrow search algorithm (SSA) to optimize XGBoost parameters and feature selection. Firstly, logistic chaos mapping, elite learning, adaptive parameter adjustment, Levy flight, and an early stop strategy are incorporated into the SSA. This integration serves to enhance the global and local search capabilities of the algorithm, thereby improving its convergence accuracy and stability. Subsequently, the improved SSA is utilized to concurrently optimize XGBoost parameters and feature selection, leading to the establishment of a new genomic selection method, MSXFGP. Utilizing both the coefficient of determination R2 and the Pearson correlation coefficient as evaluation metrics, MSXFGP was evaluated against six existing genomic selection models across six datasets. The findings reveal that MSXFGP prediction accuracy is comparable or better than existing widely used genomic selection methods, and it exhibits better accuracy when R2 is utilized as an assessment metric. Additionally, this research provides a user-friendly Python utility designed to aid breeders in the effective application of this innovative method. MSXFGP is accessible at https://github.com/DIBreeding/MSXFGP . CONCLUSIONS The experimental results show that the prediction accuracy of MSXFGP is comparable or better than existing genome selection methods, providing a new approach for plant genome selection.
Collapse
Affiliation(s)
- Ganghui Zhou
- College of Computer and Information Engineering, Inner Mongolia Agricultural University, Erdos East Street No. 29, Hohhot, 010011, China
- Inner Mongolia Autonomous Region Key Laboratory of Big Data Research and Application for Agriculture and Animal Husbandry, Zhaowuda Road No. 306, Hohhot, 010018, China
| | - Jing Gao
- College of Computer and Information Engineering, Inner Mongolia Agricultural University, Erdos East Street No. 29, Hohhot, 010011, China.
- Inner Mongolia Autonomous Region Key Laboratory of Big Data Research and Application for Agriculture and Animal Husbandry, Zhaowuda Road No. 306, Hohhot, 010018, China.
- Inner Mongolia Autonomous Region Big Data Center, Chilechuan Street No. 1, Hohhot, 010091, China.
| | - Dongshi Zuo
- College of Computer and Information Engineering, Inner Mongolia Agricultural University, Erdos East Street No. 29, Hohhot, 010011, China
- Inner Mongolia Autonomous Region Key Laboratory of Big Data Research and Application for Agriculture and Animal Husbandry, Zhaowuda Road No. 306, Hohhot, 010018, China
| | - Jin Li
- College of Computer and Information Engineering, Inner Mongolia Agricultural University, Erdos East Street No. 29, Hohhot, 010011, China
- Inner Mongolia Autonomous Region Key Laboratory of Big Data Research and Application for Agriculture and Animal Husbandry, Zhaowuda Road No. 306, Hohhot, 010018, China
| | - Rui Li
- College of Computer and Information Engineering, Inner Mongolia Agricultural University, Erdos East Street No. 29, Hohhot, 010011, China
- Inner Mongolia Autonomous Region Key Laboratory of Big Data Research and Application for Agriculture and Animal Husbandry, Zhaowuda Road No. 306, Hohhot, 010018, China
| |
Collapse
|
5
|
Zhang K, Liu Y, Mei F, Sun G, Jin J. IBGJO: Improved Binary Golden Jackal Optimization with Chaotic Tent Map and Cosine Similarity for Feature Selection. ENTROPY (BASEL, SWITZERLAND) 2023; 25:1128. [PMID: 37628158 PMCID: PMC10453476 DOI: 10.3390/e25081128] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 07/23/2023] [Accepted: 07/26/2023] [Indexed: 08/27/2023]
Abstract
Feature selection is a crucial process in machine learning and data mining that identifies the most pertinent and valuable features in a dataset. It enhances the efficacy and precision of predictive models by efficiently reducing the number of features. This reduction improves classification accuracy, lessens the computational burden, and enhances overall performance. This study proposes the improved binary golden jackal optimization (IBGJO) algorithm, an extension of the conventional golden jackal optimization (GJO) algorithm. IBGJO serves as a search strategy for wrapper-based feature selection. It comprises three key factors: a population initialization process with a chaotic tent map (CTM) mechanism that enhances exploitation abilities and guarantees population diversity, an adaptive position update mechanism using cosine similarity to prevent premature convergence, and a binary mechanism well-suited for binary feature selection problems. We evaluated IBGJO on 28 classical datasets from the UC Irvine Machine Learning Repository. The results show that the CTM mechanism and the position update strategy based on cosine similarity proposed in IBGJO can significantly improve the Rate of convergence of the conventional GJO algorithm, and the accuracy is also significantly better than other algorithms. Additionally, we evaluate the effectiveness and performance of the enhanced factors. Our empirical results show that the proposed CTM mechanism and the position update strategy based on cosine similarity can help the conventional GJO algorithm converge faster.
Collapse
Affiliation(s)
- Kunpeng Zhang
- College of Computer Science and Technology, Jilin University, Changchun 130012, China; (K.Z.); (Y.L.); (J.J.)
| | - Yanheng Liu
- College of Computer Science and Technology, Jilin University, Changchun 130012, China; (K.Z.); (Y.L.); (J.J.)
- Key Laboratory of Symbol Computation and Knowledge Engineering of the Ministry of Education, Jilin University, Changchun 130012, China
| | - Fang Mei
- College of Computer Science and Technology, Jilin University, Changchun 130012, China; (K.Z.); (Y.L.); (J.J.)
- Key Laboratory of Symbol Computation and Knowledge Engineering of the Ministry of Education, Jilin University, Changchun 130012, China
| | - Geng Sun
- College of Computer Science and Technology, Jilin University, Changchun 130012, China; (K.Z.); (Y.L.); (J.J.)
- Key Laboratory of Symbol Computation and Knowledge Engineering of the Ministry of Education, Jilin University, Changchun 130012, China
| | - Jingyi Jin
- College of Computer Science and Technology, Jilin University, Changchun 130012, China; (K.Z.); (Y.L.); (J.J.)
| |
Collapse
|
6
|
Zhou T, Liu S, Lu H, Bai J, Zhi L, Shi Q. Nested multi-scale transform fusion model: The response evaluation of chemoradiotherapy for patients with lung tumors. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 232:107445. [PMID: 36878127 DOI: 10.1016/j.cmpb.2023.107445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 02/02/2023] [Accepted: 02/23/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND AND OBJECTIVE The response evaluation of chemoradiotherapy is an important method of precision treatment for patients with malignant lung tumors. In view of the existing evaluation criteria for chemoradiotherapy, it is difficult to synthesize the geometric and shape characteristics of lung tumors. In the present, the response evaluation of chemoradiotherapy is limited. Therefore, this paper constructs a response evaluation system of chemoradiotherapy based on PET/CT images. METHODS There are two parts in the system: a nested multi-scale fusion model and an attribute sets for the Response evaluation of chemoradiotherapy (AS-REC). In the first part, a new nested multi-scale transform method, i.e., latent low-rank representation (LATLRR) and non-subsampled contourlet transform (NSCT), is proposed. Then, the average gradient self-adaptive weighting is used for the low-frequency fusion rule, and the regional energy fusion rule is used for the high-frequency fusion rule. Further, the low-rank part fusion image is obtained by the inverse NSCT, and the fusion image is generated by adding the low-rank part fusion image and the significant part fusion image. In the second part, AS-REC is constructed to evaluate the growth direction of the tumor, the degree of tumor metabolic activity, and the tumor growth state. RESULTS the numerical results clearly show that the performance of our proposed method outperforms in comparison with several existing methods, among them, the value of Qabf increased by up to 69%. CONCLUSIONS Through the experiment of three reexamination patients, the effectiveness of the evaluation system of radiotherapy and chemotherapy are proved.
Collapse
Affiliation(s)
- Tao Zhou
- School of Computer Science and Engineering, North Minzu University, Yinchuan, Ningxia 750021, China; The Key Laboratory of Images and Graphics Intelligent Processing of State Ethnic Affairs Commission, North Minzu University, Yinchuan 750021, China.
| | - Shan Liu
- School of Computer Science and Engineering, North Minzu University, Yinchuan, Ningxia 750021, China; The Key Laboratory of Images and Graphics Intelligent Processing of State Ethnic Affairs Commission, North Minzu University, Yinchuan 750021, China
| | - Huiling Lu
- School of Science, Ningxia Medical University, Yinchuan, Ningxia 750004, China.
| | - Jing Bai
- School of Computer Science and Engineering, North Minzu University, Yinchuan, Ningxia 750021, China; The Key Laboratory of Images and Graphics Intelligent Processing of State Ethnic Affairs Commission, North Minzu University, Yinchuan 750021, China
| | - Lijia Zhi
- School of Computer Science and Engineering, North Minzu University, Yinchuan, Ningxia 750021, China; The Key Laboratory of Images and Graphics Intelligent Processing of State Ethnic Affairs Commission, North Minzu University, Yinchuan 750021, China
| | - Qiu Shi
- Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an 710119,China
| |
Collapse
|
7
|
Aram KY, Lam SS, Khasawneh MT. Cost-sensitive max-margin feature selection for SVM using alternated sorting method genetic algorithm. Knowl Based Syst 2023. [DOI: 10.1016/j.knosys.2023.110421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/07/2023]
|
8
|
Multi-objective evolving long-short term memory networks with attention for network intrusion detection. Appl Soft Comput 2023. [DOI: 10.1016/j.asoc.2023.110216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/19/2023]
|
9
|
He S, Xiao B, Wei H, Huang S, Chen T. SVM classifier of cervical histopathology images based on texture and morphological features. Technol Health Care 2023; 31:69-80. [PMID: 35754238 DOI: 10.3233/thc-220031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/25/2023]
Abstract
BACKGROUND Cervical histopathology image classification is a crucial indicator in cervical biopsy results. OBJECTIVE The objective of this study is to identify histopathology images of cervical cancer at an early stage by extracting texture and morphological features for the Support Vector Machine (SVM) classifier. METHODS We extract three different texture features and one morphological feature of cervical histopathology images: first-order histogram, K-means clustering, Gray Level Co-occurrence Matrix (GLCM) and nucleus feature. The original dataset used in our experiment is obtained from 20 patients diagnosed with cervical cancer, including 135 whole slide images (WSIs). Given an entire WSI, the patches on its tissue region are extracted randomly. RESULTS We finally obtain 3,000 patches, including 1,000 normal, 1,000 hysteromyoma and 1,000 cancer images. Among them, 80% of the entire data set is randomly selected as training set and the remaining 20% as test set. The accuracy of SVM classification using first-order histogram, K-means clustering, GLAM and nucleus feature for extracting features are respectively 87.4%, 90.6%, 91.6% and 93.5%. CONCLUSIONS The classification accuracy of the SVM combining the four features is 96.8%, and the proposed nucleus feature plays a key role in the SVM classification of cervical histopathology images.
Collapse
Affiliation(s)
- Siqi He
- Key Laboratory of Laser Life Science, Ministry of Education, College of Biophotonics, South China Normal University, Guangzhou, Guangdong, China
| | - Bo Xiao
- Key Laboratory of Laser Life Science, Ministry of Education, College of Biophotonics, South China Normal University, Guangzhou, Guangdong, China
| | - Huajiang Wei
- Key Laboratory of Laser Life Science, Ministry of Education, College of Biophotonics, South China Normal University, Guangzhou, Guangdong, China
| | - Shenjiao Huang
- GuangZhou Woman and Children's Medical Center, Guangzhou, Guangzhou, China
| | - Tongsheng Chen
- Key Laboratory of Laser Life Science, Ministry of Education, College of Biophotonics, South China Normal University, Guangzhou, Guangdong, China.,SCNU Qingyuan Institute of Science and Technology Innovation Co. Ltd., South China Normal University, Qingyuan, Guandong, China
| |
Collapse
|
10
|
Liu D, Duan X, Wang S, Cui X, Wu X, Niu Y, Shi J. A reliability estimation method based on signal feature extraction and artificial neural network supported Wiener process with random effects. Appl Soft Comput 2023. [DOI: 10.1016/j.asoc.2023.110044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
|
11
|
Zhang H, Han Y. A New Mixed-Gas-Detection Method Based on a Support Vector Machine Optimized by a Sparrow Search Algorithm. SENSORS (BASEL, SWITZERLAND) 2022; 22:8977. [PMID: 36433576 PMCID: PMC9698078 DOI: 10.3390/s22228977] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 11/15/2022] [Accepted: 11/17/2022] [Indexed: 06/16/2023]
Abstract
To solve the problem of the low recognition rate of mixed gases and consider the phenomenon of low prediction accuracy when traditional gas-concentration-prediction methods deal with nonlinear data, this paper proposes a mixed-gas identification and gas-concentration-prediction method based on a support vector machine (SVM) optimized by a sparrow search algorithm (SSA). Principal component analysis (PCA) is applied to perform data dimensionality reduction on the input data, and SSA is adopted to optimize the SVM hyperparameters to improve the recognition rate and gas-concentration-prediction accuracy of mixed gases. For the mixed-gas identification, the classification accuracy is significantly improved under the proposed SSA optimization SVM method (SSA-SVM), compared with random forest (RF), extreme-learning machine (ELM), and BP neural network methods. With respect to gas-concentration prediction, the maximum fitting degrees reached 99.34% for single gas-concentration prediction and 97.55% for mixed-gas-concentration prediction. The experimental results show that the SSA-SVM method had a high recognition rate and high concentration-prediction accuracy in gas-mixture detection.
Collapse
|
12
|
Cheng F, Chu F, Xu Y, Zhang L. A Steering-Matrix-Based Multiobjective Evolutionary Algorithm for High-Dimensional Feature Selection. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:9695-9708. [PMID: 33667171 DOI: 10.1109/tcyb.2021.3053944] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
In recent years, multiobjective evolutionary algorithms (MOEAs) have been demonstrated to show promising performance in feature selection (FS) tasks. However, designing an MOEA for high-dimensional FS is more challenging due to the curse of dimensionality. To address this problem, in this article, a steering-matrix-based multiobjective evolutionary algorithm, called SM-MOEA, is proposed. In SM-MOEA, a steering matrix is suggested and harnessed to guide the evolution of the population, which not only improves the search efficiency greatly but also obtains the feature subsets with high quality. Specifically, each element SM (i, j) in the steering matrix SM reflects the probability of the j th feature that is selected in the i th individual (feature subset), which is generated by considering the importance of both the feature j and the individual i . Based on the suggested steering matrix, two important operators referred to as dimensionality reduction and individual repairing operators are developed to effectively steer the population evolution in each generation. In addition, an effective initialization and update strategy for the steering matrix is also designed to further improve the performance of SM-MOEA. The experimental results on 12 high-dimensional datasets with the number of features ranging from 3000 to 13 000 demonstrate the superiority of the proposed algorithm over several state-of-the-art algorithms (including single-objective and MOEAs for high-dimensional FS) in terms of both the number and quality of the selected features.
Collapse
|
13
|
Akinola OO, Ezugwu AE, Agushaka JO, Zitar RA, Abualigah L. Multiclass feature selection with metaheuristic optimization algorithms: a review. Neural Comput Appl 2022; 34:19751-19790. [PMID: 36060097 PMCID: PMC9424068 DOI: 10.1007/s00521-022-07705-4] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Accepted: 08/02/2022] [Indexed: 11/24/2022]
Abstract
Selecting relevant feature subsets is vital in machine learning, and multiclass feature selection is harder to perform since most classifications are binary. The feature selection problem aims at reducing the feature set dimension while maintaining the performance model accuracy. Datasets can be classified using various methods. Nevertheless, metaheuristic algorithms attract substantial attention to solving different problems in optimization. For this reason, this paper presents a systematic survey of literature for solving multiclass feature selection problems utilizing metaheuristic algorithms that can assist classifiers selects optima or near optima features faster and more accurately. Metaheuristic algorithms have also been presented in four primary behavior-based categories, i.e., evolutionary-based, swarm-intelligence-based, physics-based, and human-based, even though some literature works presented more categorization. Further, lists of metaheuristic algorithms were introduced in the categories mentioned. In finding the solution to issues related to multiclass feature selection, only articles on metaheuristic algorithms used for multiclass feature selection problems from the year 2000 to 2022 were reviewed about their different categories and detailed descriptions. We considered some application areas for some of the metaheuristic algorithms applied for multiclass feature selection with their variations. Popular multiclass classifiers for feature selection were also examined. Moreover, we also presented the challenges of metaheuristic algorithms for feature selection, and we identified gaps for further research studies.
Collapse
Affiliation(s)
- Olatunji O. Akinola
- School of Mathematics, Statistics, and Computer Science, University of KwaZulu-Natal, King Edward Avenue, Pietermaritzburg Campus, Pietermaritzburg, 3201 KwaZulu-Natal South Africa
| | - Absalom E. Ezugwu
- School of Mathematics, Statistics, and Computer Science, University of KwaZulu-Natal, King Edward Avenue, Pietermaritzburg Campus, Pietermaritzburg, 3201 KwaZulu-Natal South Africa
| | - Jeffrey O. Agushaka
- School of Mathematics, Statistics, and Computer Science, University of KwaZulu-Natal, King Edward Avenue, Pietermaritzburg Campus, Pietermaritzburg, 3201 KwaZulu-Natal South Africa
| | - Raed Abu Zitar
- Sorbonne Center of Artificial Intelligence, Sorbonne University-Abu Dhabi, 38044 Abu Dhabi, United Arab Emirates
| | - Laith Abualigah
- Hourani Center for Applied Scientific Research, Al-Ahliyya Amman University, Amman, 19328 Jordan
- Faculty of Inforsmation Technology, Middle East University, Amman, 11831 Jordan
| |
Collapse
|
14
|
Dynamic forecasting of the Shanghai Stock Exchange index movement using multiple types of investor sentiment. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109132] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
15
|
Liu J, Zhou Z, Kong S, Ma Z. Application of random forest based on semi-automatic parameter adjustment for optimization of anti-breast cancer drugs. Front Oncol 2022; 12:956705. [PMID: 35936743 PMCID: PMC9353770 DOI: 10.3389/fonc.2022.956705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Accepted: 06/28/2022] [Indexed: 11/19/2022] Open
Abstract
The optimization of drug properties in the process of cancer drug development is very important to save research and development time and cost. In order to make the anti-breast cancer drug candidates with good biological activity, this paper collected 1974 compounds, firstly, the top 20 molecular descriptors that have the most influence on biological activity were screened by using XGBoost-based data feature selection; secondly, on this basis, take pIC50 values as feature data and use a variety of machine learning algorithms to compare, soas to select a most suitable algorithm to predict the IC50 and pIC50 values. It is preliminarily found that the effects of Random Forest, XGBoost and Gradient-enhanced algorithms are good and have little difference, and the Support vector machine is the worst. Then, using the Semi-automatic parameter adjustment method to adjust the parameters of Random Forest, XGBoost and Gradient-enhanced algorithms to find the optimal parameters. It is found that the Random Forest algorithm has high accuracy and excellent anti over fitting, and the algorithm is stable. Its prediction accuracy is 0.745. Finally, the accuracy of the results is verified by training the model with the preliminarily selected data, which provides an innovative solution for the optimization of the properties of anti- breast cancer drugs, and can provide better support for the early research and development of anti-breast cancer drugs.
Collapse
Affiliation(s)
- Jiajia Liu
- College of Science, North China University of Science and Technology, Tangshan, China
- Hebei Engineering Research Center for the Intelligentization of Iron Ore Optimization and Ironmaking Raw Materials Preparation Processes, North China University of Science and Technology, Tangshan, China
- The Key Laboratory of Engineering Computing in Tangshan City, North China University of Science and Technology, Tangshan, China
| | - Zhihui Zhou
- College of Science, North China University of Science and Technology, Tangshan, China
- The Key Laboratory of Engineering Computing in Tangshan City, North China University of Science and Technology, Tangshan, China
- Hebei Key Laboratory of Data Science and Application, North China University of Science and Technology, Tangshan, China
| | - Shanshan Kong
- College of Science, North China University of Science and Technology, Tangshan, China
- Hebei Engineering Research Center for the Intelligentization of Iron Ore Optimization and Ironmaking Raw Materials Preparation Processes, North China University of Science and Technology, Tangshan, China
- The Key Laboratory of Engineering Computing in Tangshan City, North China University of Science and Technology, Tangshan, China
- Hebei Key Laboratory of Data Science and Application, North China University of Science and Technology, Tangshan, China
- Tangshan Intelligent Industry and Image Processing Technology Innovation Center, North China University of Science and Technology, Tangshan, China
- *Correspondence: Shanshan Kong,
| | - Zezhong Ma
- College of Science, North China University of Science and Technology, Tangshan, China
- Hebei Engineering Research Center for the Intelligentization of Iron Ore Optimization and Ironmaking Raw Materials Preparation Processes, North China University of Science and Technology, Tangshan, China
- Tangshan Intelligent Industry and Image Processing Technology Innovation Center, North China University of Science and Technology, Tangshan, China
| |
Collapse
|
16
|
Abstract
AbstractCancer survival prediction is one of the three major tasks of cancer prognosis. To improve the accuracy of cancer survival prediction, in this paper, we propose a priori knowledge- and stability-based feature selection (PKSFS) method and develop a novel two-stage heterogeneous stacked ensemble learning model (BQAXR) to predict the survival status of cancer patients. Specifically, PKSFS first obtains the optimal feature subsets from the high-dimensional cancer datasets to guide the subsequent model construction. Then, BQAXR seeks to generate five high-quality heterogeneous learners, among which the shortcomings of the learners are overcome by using improved methods, and integrate them in two stages through the stacked generalization strategy based on optimal feature subsets. To verify the merits of PKSFS and BQAXR, this paper collected the real survival datasets of gastric cancer and skin cancer from the Surveillance, Epidemiology, and End Results (SEER) database of the National Cancer Institute, and conducted extensive numerical experiments from different perspectives based on these two datasets. The accuracy and AUC of the proposed method are 0.8209 and 0.8203 in the gastric cancer dataset, and 0.8336 and 0.8214 in the skin cancer dataset. The results show that PKSFS has marked advantages over popular feature selection methods in processing high-dimensional datasets. By taking full advantage of heterogeneous high-quality learners, BQAXR is not only superior to mainstream machine learning methods, but also outperforms improved machine learning methods, which indicates can effectively improve the accuracy of cancer survival prediction and provide a reference for doctors to make medical decisions.
Collapse
|
17
|
A Comparative Analysis of Swarm Intelligence and Evolutionary Algorithms for Feature Selection in SVM-Based Hyperspectral Image Classification. REMOTE SENSING 2022. [DOI: 10.3390/rs14133019] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
Feature selection (FS) is vital in hyperspectral image (HSI) classification, it is an NP-hard problem, and Swarm Intelligence and Evolutionary Algorithms (SIEAs) have been proved effective in solving it. However, the high dimensionality of HSIs still leads to the inefficient operation of SIEAs. In addition, many SIEAs exist, but few studies have conducted a comparative analysis of them for HSI FS. Thus, our study has two goals: (1) to propose a new filter–wrapper (F–W) framework that can improve the SIEAs’ performance; and (2) to apply ten SIEAs under the F–W framework (F–W–SIEAs) to optimize the support vector machine (SVM) and compare their performance concerning five aspects, namely the accuracy, the number of selected bands, the convergence rate, and the relative runtime. Based on three HSIs (i.e., Indian Pines, Salinas, and Kennedy Space Center (KSC)), we demonstrate how the proposed framework helps improve these SIEAs’ performances. The five aspects of the ten algorithms are different, but some have similar optimization capacities. On average, the F–W–Genetic Algorithm (F–W–GA) and F–W–Grey Wolf Optimizer (F–W–GWO) have the strongest optimization abilities, while the F–W–GWO requires the least runtime among the ten. The F–W–Marine Predators Algorithm (F–W–MPA) is second only to the two and slightly better than F–W–Differential Evolution (F–W–DE). The F–W–Ant Lion Optimizer (F–W–ALO), F–W–I-Ching Divination Evolutionary Algorithm (F–W–IDEA), and F–W–Whale Optimization Algorithm (F–W–WOA) have the middle optimization abilities, and F–W–IDEA takes the most runtime. Moreover, the F–W–SIEAs outperform other commonly used FS techniques in accuracy overall, especially in complex scenes.
Collapse
|
18
|
Kong PH, Chiang CH, Lin TC, Kuo SC, Li CF, Hsiung CA, Shiue YL, Chiou HY, Wu LC, Tsou HH. Discrimination of Methicillin-resistant Staphylococcus aureus by MALDI-TOF Mass Spectrometry with Machine Learning Techniques in Patients with Staphylococcus aureus Bacteremia. Pathogens 2022; 11:pathogens11050586. [PMID: 35631107 PMCID: PMC9143686 DOI: 10.3390/pathogens11050586] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Revised: 05/11/2022] [Accepted: 05/13/2022] [Indexed: 11/29/2022] Open
Abstract
Early administration of proper antibiotics is considered to improve the clinical outcomes of Staphylococcus aureus bacteremia (SAB), but routine clinical antimicrobial susceptibility testing takes an additional 24 h after species identification. Recent studies elucidated matrix-assisted laser desorption/ionization time-of-flight mass spectra to discriminate methicillin-resistant strains (MRSA) or even incorporated with machine learning (ML) techniques. However, no universally applicable mass peaks were revealed, which means that the discrimination model might need to be established or calibrated by local strains’ data. Here, a clinically feasible workflow was provided. We collected mass spectra from SAB patients over an 8-month duration and preprocessed by binning with reference peaks. Machine learning models were trained and tested by samples independently of the first six months and the following two months, respectively. The ML models were optimized by genetic algorithm (GA). The accuracy, sensitivity, specificity, and AUC of the independent testing of the best model, i.e., SVM, under the optimal parameters were 87%, 75%, 95%, and 87%, respectively. In summary, almost all resistant results were truly resistant, implying that physicians might escalate antibiotics for MRSA 24 h earlier. This report presents an attainable method for clinical laboratories to build an MRSA model and boost the performance using their local data.
Collapse
Affiliation(s)
- Po-Hsin Kong
- Institute of Biomedical Sciences, National Sun Yat-sen University, Kaohsiung 80424, Taiwan; (P.-H.K.); (Y.-L.S.)
- Center for Precision Medicine, Chi Mei Medical Center, Tainan 71004, Taiwan;
| | - Cheng-Hsiung Chiang
- Institute of Population Health Sciences, National Health Research Institutes, Zhunan, Miaoli 35053, Taiwan; (C.-H.C.); (C.A.H.); (H.-Y.C.)
| | - Ting-Chia Lin
- Center for Precision Medicine, Chi Mei Medical Center, Tainan 71004, Taiwan;
- Institute of Precision Medicine, National Sun Yat-sen University, Kaohsiung 80424, Taiwan
| | - Shu-Chen Kuo
- National Institute of Infectious Diseases and Vaccinology, National Health Research Institutes, Zhunan, Miaoli 35053, Taiwan;
| | - Chien-Feng Li
- Department of Medical Research, Chi Mei Medical Center, Tainan 71004, Taiwan;
| | - Chao A. Hsiung
- Institute of Population Health Sciences, National Health Research Institutes, Zhunan, Miaoli 35053, Taiwan; (C.-H.C.); (C.A.H.); (H.-Y.C.)
| | - Yow-Ling Shiue
- Institute of Biomedical Sciences, National Sun Yat-sen University, Kaohsiung 80424, Taiwan; (P.-H.K.); (Y.-L.S.)
- Institute of Precision Medicine, National Sun Yat-sen University, Kaohsiung 80424, Taiwan
| | - Hung-Yi Chiou
- Institute of Population Health Sciences, National Health Research Institutes, Zhunan, Miaoli 35053, Taiwan; (C.-H.C.); (C.A.H.); (H.-Y.C.)
- School of Public Health, College of Public Health, Taipei Medical University, Taipei 11031, Taiwan
- Master’s Program in Applied Epidemiology, College of Public Health, Taipei Medical University, Taipei 11031, Taiwan
| | - Li-Ching Wu
- Institute of Biomedical Sciences, National Sun Yat-sen University, Kaohsiung 80424, Taiwan; (P.-H.K.); (Y.-L.S.)
- Center for Precision Medicine, Chi Mei Medical Center, Tainan 71004, Taiwan;
- Correspondence: (L.-C.W.); (H.-H.T.)
| | - Hsiao-Hui Tsou
- Institute of Population Health Sciences, National Health Research Institutes, Zhunan, Miaoli 35053, Taiwan; (C.-H.C.); (C.A.H.); (H.-Y.C.)
- Graduate Institute of Biostatistics, College of Public Health, China Medical University, Taichung 40402, Taiwan
- Correspondence: (L.-C.W.); (H.-H.T.)
| |
Collapse
|
19
|
Zhou T, Dong Y, Lu H, Zheng X, Qiu S, Hou S. APU-Net: An Attention Mechanism Parallel U-Net for Lung Tumor Segmentation. BIOMED RESEARCH INTERNATIONAL 2022; 2022:5303651. [PMID: 35586818 PMCID: PMC9110197 DOI: 10.1155/2022/5303651] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Accepted: 04/09/2022] [Indexed: 11/30/2022]
Abstract
Lung cancer is one of the malignant tumors with high morbidity and mortality, and lung nodules are the early stages of lung cancer. The symptoms of pulmonary nodules are not obvious in the clinic, and the optimal treatment time is missed due to the missed diagnosis in the clinic. A parallel U-Net network called APU-Net is proposed. Firstly, two parallel U-Net networks are used to extract the features of different modalities. Among them, the subnetwork UNet_B extracts the CT image features, and the subnetwork UNet_A consists of two encoders to extract the PET/CT and PET image features. Secondly, multimodal feature extraction blocks are used to extract features for PET/CT and PET images in UNet_B network. Thirdly, a hybrid attention mechanism is added to the encoding paths of the UNet_A and UNet_B. Finally, a multiscale feature aggregation block is used for extracting feature maps of different scales of decoding path. On the lung tumor 18FDGPET/CT multimodal medical images dataset, experiments' results show that the DSC, Recall, VOE, and RVD coefficients of APU-Net are 96.86%, 97.53%, 3.18%, and 3.29%, respectively. APU-Net can improve the segmentation accuracy of the adhesion between the lesion of complex shape and the normal tissue. This has positive significance for computer-aided diagnosis.
Collapse
Affiliation(s)
- Tao Zhou
- School of Computer Science and Engineering, North Minzu University, Yinchuan, Ningxia 750021, China
- The Key Laboratory of Images and Graphics Intelligent Processing of State Ethnic Affairs Commission, North Minzu University, Yinchuan 750021, China
| | - YaLi Dong
- School of Computer Science and Engineering, North Minzu University, Yinchuan, Ningxia 750021, China
- The Key Laboratory of Images and Graphics Intelligent Processing of State Ethnic Affairs Commission, North Minzu University, Yinchuan 750021, China
| | - HuiLing Lu
- School of Science, Ningxia Medical University, Yinchuan, Ningxia 750004, China
| | - XiaoMin Zheng
- Research Institute for Reproductive Medicine and Genetic Diseases, Wuxi Maternity and Child Health Hospital, Jiangsu Wuxi, 214002, China
| | - Shi Qiu
- Key Laboratory of Spectral Imaging Technology CAS, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, Shanxi 710119, China
| | - SenBao Hou
- School of Computer Science and Engineering, North Minzu University, Yinchuan, Ningxia 750021, China
- The Key Laboratory of Images and Graphics Intelligent Processing of State Ethnic Affairs Commission, North Minzu University, Yinchuan 750021, China
| |
Collapse
|
20
|
Al-Solami HM, Alhebshi AMS, Abdo H, Mahmuod SR, Alwabli AS, Alkenani N. A bio-mathematical approach to control the Anopheles mosquito using sterile males technology. INT J BIOMATH 2022. [DOI: 10.1142/s1793524522500371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Initiative for this study is taken to solve the mathematical model which is base-forming with population dynamics of the Anopheles mosquito using an advanced computational intelligence scheme named as genetic algorithm (GA), artificial neural network (ANN). This ANN is a famous global search method, active set (AS) scheme known as a quick local refinement, i.e. ANN-GA-AS. An error-based fitness function is optimized which is made by using the sense of the differential system and boundary conditions for solving the Anopheles mosquito control model. The ability of the stochastic ANN-GA-AS approach to solve the population dynamics of the Anopheles mosquito is examined to check the exactness, efficiency, precision, and consistency of the scheme. The numerical outcomes of the Anopheles mosquito control model through the ANN-GA-AS approach are compared with the reference Adams numerical results to show the significance of the designed scheme. Moreover, statistical considerations using the “semi-interquartile range”, “Theil’s inequality coefficient”, and “mean absolute deviation” have been applied to validate the precision and accuracy of the obtained results.
Collapse
Affiliation(s)
- Habeeb M. Al-Solami
- Department of Biological Sciences, Faculty of Science, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Alawiah M. S. Alhebshi
- Department of Biological Sciences, Faculty of Science, King Abdulaziz University, Jeddah, Saudi Arabia
| | - H. Abdo
- Department of Mathematics, Computer Science Branch, Aswan University, Aswan, Egypt
| | - S. R. Mahmuod
- GRC Department, Applied College, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Afaf S. Alwabli
- Department of Biological Sciences, Science and Arts College, Rabigh Campus, King Abdulaziz University, Jeddah, Saudi Arabia
| | - Naser Alkenani
- Department of Biological Sciences, Faculty of Science, King Abdulaziz University, Jeddah, Saudi Arabia
| |
Collapse
|
21
|
Dense Convolutional Network and Its Application in Medical Image Analysis. BIOMED RESEARCH INTERNATIONAL 2022; 2022:2384830. [PMID: 35509707 PMCID: PMC9060995 DOI: 10.1155/2022/2384830] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 03/23/2022] [Indexed: 12/28/2022]
Abstract
Dense convolutional network (DenseNet) is a hot topic in deep learning research in recent years, which has good applications in medical image analysis. In this paper, DenseNet is summarized from the following aspects. First, the basic principle of DenseNet is introduced; second, the development of DenseNet is summarized and analyzed from five aspects: broaden DenseNet structure, lightweight DenseNet structure, dense unit, dense connection mode, and attention mechanism; finally, the application research of DenseNet in the field of medical image analysis is summarized from three aspects: pattern recognition, image segmentation, and object detection. The network structures of DenseNet are systematically summarized in this paper, which has certain positive significance for the research and development of DenseNet.
Collapse
|
22
|
Predicting streamflow in Peninsular Malaysia using support vector machine and deep learning algorithms. Sci Rep 2022; 12:3883. [PMID: 35273236 PMCID: PMC8913629 DOI: 10.1038/s41598-022-07693-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2021] [Accepted: 02/04/2022] [Indexed: 11/16/2022] Open
Abstract
Floods and droughts are environmental phenomena that occur in Peninsular Malaysia due to extreme values of streamflow (SF). Due to this, the study of SF prediction is highly significant for the purpose of municipal and environmental damage mitigation. In the present study, machine learning (ML) models based on the support vector machine (SVM), artificial neural network (ANN), and long short-term memory (LSTM), are tested and developed to predict SF for 11 different rivers throughout Peninsular Malaysia. SF data sets for the rivers were collected from the Malaysian Department of Irrigation and Drainage. The main objective of the present study is to propose a universal model that is most capable of predicting SFs for rivers within Peninsular Malaysia. Based on the findings, the ANN3 model which was developed using the ANN algorithm and input scenario 3 (inputs consisting of previous 3 days SF) is deduced as the best overall ML model for SF prediction as it outperformed all the other models in 4 out of 11 of the tested data sets; and obtained among the highest average RMs with a score of 3.27, hence indicating that the model is very adaptable and reliable in accurately predicting SF based on different data sets and river case studies. Therefore, the ANN3 model is proposed as a universal model for SF prediction within Peninsular Malaysia.
Collapse
|
23
|
Liu Q, Liu M, Wang F, Xiao W. A dynamic stochastic search algorithm for high-dimensional optimization problems and its application to feature selection. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.108517] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
|
24
|
Novel Improved Salp Swarm Algorithm: An Application for Feature Selection. SENSORS 2022; 22:s22051711. [PMID: 35270856 PMCID: PMC8914736 DOI: 10.3390/s22051711] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Revised: 02/05/2022] [Accepted: 02/16/2022] [Indexed: 02/01/2023]
Abstract
We live in a period when smart devices gather a large amount of data from a variety of sensors and it is often the case that decisions are taken based on them in a more or less autonomous manner. Still, many of the inputs do not prove to be essential in the decision-making process; hence, it is of utmost importance to find the means of eliminating the noise and concentrating on the most influential attributes. In this sense, we put forward a method based on the swarm intelligence paradigm for extracting the most important features from several datasets. The thematic of this paper is a novel implementation of an algorithm from the swarm intelligence branch of the machine learning domain for improving feature selection. The combination of machine learning with the metaheuristic approaches has recently created a new branch of artificial intelligence called learnheuristics. This approach benefits both from the capability of feature selection to find the solutions that most impact on accuracy and performance, as well as the well known characteristic of swarm intelligence algorithms to efficiently comb through a large search space of solutions. The latter is used as a wrapper method in feature selection and the improvements are significant. In this paper, a modified version of the salp swarm algorithm for feature selection is proposed. This solution is verified by 21 datasets with the classification model of K-nearest neighborhoods. Furthermore, the performance of the algorithm is compared to the best algorithms with the same test setup resulting in better number of features and classification accuracy for the proposed solution. Therefore, the proposed method tackles feature selection and demonstrates its success with many benchmark datasets.
Collapse
|
25
|
Wang J, Luo J. A fast parameter optimization approach based on the inter-cluster induced distance in the feature space for support vector machines. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.108519] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
26
|
An Advance Computing Numerical Heuristic of Nonlinear SIR Dengue Fever System Using the Morlet Wavelet Kernel. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2022:9981355. [PMID: 35140906 PMCID: PMC8820869 DOI: 10.1155/2022/9981355] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Accepted: 01/05/2022] [Indexed: 11/21/2022]
Abstract
This study is associated to solve the nonlinear SIR dengue fever system using a computational methodology by operating the neural networks based on the designed Morlet wavelet (MWNNs), global scheme as genetic algorithm (GA), and rapid local search scheme as interior-point algorithm (IPA), i.e., GA-IPA. The optimization of fitness function based on MWNNs is performed for solving the nonlinear SIR dengue fever system. This MWNNs-based fitness function is accessible using the differential system and initial conditions of the nonlinear SIR dengue fever system. The designed procedures based on the MWNN-GA-IPA are applied to solve the nonlinear SIR dengue fever system to check the exactness, precision, constancy, and efficiency. The achieved numerical form of the nonlinear SIR dengue fever system via MWNN-GA-IPA was compared with the Runge–Kutta numerical results that verify the significance of MWNN-GA-IPA. Moreover, statistical reflections through different measures for the nonlinear SIR dengue fever system endorse the precision and convergence of the computational MWNN-GA-IPA.
Collapse
|
27
|
Sabir Z, Ali MR, Sadat R. Gudermannian neural networks using the optimization procedures of genetic algorithm and active set approach for the three-species food chain nonlinear model. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING 2022; 14:8913-8922. [PMID: 35069921 PMCID: PMC8763432 DOI: 10.1007/s12652-021-03638-3] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/07/2021] [Accepted: 12/01/2021] [Indexed: 05/31/2023]
Abstract
The present study is to investigate the Gudermannian neural networks (GNNs) using the optimization procedures of genetic algorithm and active-set approach (GA-ASA) to solve the three-species food chain nonlinear model. The three-species food chain nonlinear model is dependent upon the prey populations, top-predator, and specialist predator. The design of an error-based fitness function is presented using the sense of the three-species food chain nonlinear model and its initial conditions. The numerical results of the model have been obtained by exploiting the GNN-GA-ASA. The obtained results through the GNN-GA-ASA have been compared with the Runge-Kutta method to substantiate the correctness of the designed approach. The reliability, efficacy and authenticity of the proposed GNN-GA-ASA are examined through different statistical measures based on single and multiple neurons for solving the three-species food chain nonlinear model.
Collapse
Affiliation(s)
- Zulqurnain Sabir
- Department of Mathematics and Statistics, Hazara University, Mansehra, Pakistan
| | - Mohamed R. Ali
- Faculty of Engineering and Technology, Future University, Cairo, Egypt
- Department of Basic Science, Faculty of Engineering at Benha, Benha University, Benha, 13512 Egypt
| | - R. Sadat
- Department of Physics and Engineering Mathematics, Faculty of Engineering, Zagazig University, Zagazig, Egypt
| |
Collapse
|
28
|
Tan G, Huang B, Cui Z, Dou H, Zheng S, Zhou T. A noise-immune reinforcement learning method for early diagnosis of neuropsychiatric systemic lupus erythematosus. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2022; 19:2219-2239. [PMID: 35240783 DOI: 10.3934/mbe.2022104] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The neuropsychiatric systemic lupus erythematosus (NPSLE), a severe disease that can damage the heart, liver, kidney, and other vital organs, often involves the central nervous system and even leads to death. Magnetic resonance spectroscopy (MRS) is a brain functional imaging technology that can detect the concentration of metabolites in organs and tissues non-invasively. However, the performance of early diagnosis of NPSLE through conventional MRS analysis is still unsatisfactory. In this paper, we propose a novel method based on genetic algorithm (GA) and multi-agent reinforcement learning (MARL) to improve the performance of the NPSLE diagnosis model. Firstly, the proton magnetic resonance spectroscopy (1H-MRS) data from 23 NPSLE patients and 16 age-matched healthy controls (HC) were standardized before training. Secondly, we adopt MARL by assigning an agent to each feature to select the optimal feature subset. Thirdly, the parameter of SVM is optimized by GA. Our experiment shows that the SVM classifier optimized by feature selection and parameter optimization achieves 94.9% accuracy, 91.3% sensitivity, 100% specificity and 0.87 cross-validation score, which is the best score compared with other state-of-the-art machine learning algorithms. Furthermore, our method is even better than other dimension reduction ones, such as SVM based on principal component analysis (PCA) and variational autoencoder (VAE). By analyzing the metabolites obtained by MRS, we believe that this method can provide a reliable classification result for doctors and can be effectively used for the early diagnosis of this disease.
Collapse
Affiliation(s)
- Guanru Tan
- Department of Computer Science, Shantou University, Shantou 515063, China
| | - Boyu Huang
- Department of Computer Science, Shantou University, Shantou 515063, China
| | - Zhihan Cui
- Department of Computer Science, Shantou University, Shantou 515063, China
| | - Haowen Dou
- Department of Computer Science, Shantou University, Shantou 515063, China
| | - Shiqiang Zheng
- Department of Computer Science, Shantou University, Shantou 515063, China
| | - Teng Zhou
- Department of Computer Science, Shantou University, Shantou 515063, China
- Key Laboratory of Intelligent Manufacturing Technology, Shantou University, Ministry of Education, Shantou 515063, China
| |
Collapse
|
29
|
A Novel Design of Morlet Wavelet to Solve the Dynamics of Nervous Stomach Nonlinear Model. INT J COMPUT INT SYS 2022. [DOI: 10.1007/s44196-021-00057-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
AbstractThe present study introduces a novel design of Morlet wavelet neural network (MWNN) models to solve a class of a nonlinear nervous stomach system represented with governing ODEs systems via three categories, tension, food and medicine, i.e., TFM model. The comprehensive detail of each category is designated together with the sleep factor, food rate, tension rate, medicine factor and death rate are also provided. The computational structure of MWNNs along with the global search ability of genetic algorithm (GA) and local search competence of active-set algorithms (ASAs), i.e., MWNN-GA-ASAs is applied to solve the TFM model. The optimization of an error function, for nonlinear TFM model and its related boundary conditions, is performed using the hybrid heuristics of GA-ASAs. The performance of the obtained outcomes through MWNN-GA-ASAs for solving the nonlinear TFM model is compared with the results of state of the article numerical computing paradigm via Adams methods to validate the precision of the MWNN-GA-ASAs. Moreover, statistical assessments studies for 50 independent trials with 10 neuron-based networks further authenticate the efficacy, reliability and consistent convergence of the proposed MWNN-GA-ASAs.
Collapse
|
30
|
Ji W, Liu D, Meng Y, Xue Y. A review of genetic-based evolutionary algorithms in SVM parameters optimization. EVOLUTIONARY INTELLIGENCE 2021. [DOI: 10.1007/s12065-020-00439-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
31
|
Abstract
In this work, three-dimensional nonlinear food chain system is numerically treated using the computational heuristic framework of artificial neural networks (ANNs) together with the proficiencies of global and local search approaches based on genetic algorithm (GA) and interior-point algorithm scheme (IPAS), i.e. ANN–GA–IPAS. The three-dimensional food chain system consists of prey populations, specialist predator and top-predator. The formulation of an objective function using the differential system of three-species food chain and its initial conditions is presented and the optimization is performed by using the hybrid computing efficiency of GA–IPAS. The achieved numerical solutions through ANN–GA–IPAS to solve the nonlinear three-species food chain system are compared with the Adams method to validate the exactness of the designed ANN–GA–IPAS. The comparison of the results is presented to authenticate the correctness of the designed ANN–GA–IPAS for solving the nonlinear three-species food chain system. Moreover, statistical representations for 40 independent trials and 30 variables validate the efficacy, constancy and reliability of ANN–GA–IPAS.
Collapse
Affiliation(s)
- Zulqurnain Sabir
- Department of Mathematics and Statistics, Hazara University, Mansehra, Pakistan
| |
Collapse
|
32
|
Sabir Z, Umar M, Raja MAZ, Baskonus HM, Gao W. Designing of Morlet wavelet as a neural network for a novel prevention category in the HIV system. INT J BIOMATH 2021. [DOI: 10.1142/s1793524522500127] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The aim of this work is to present a design of Morlet wavelet neural network (MWNN) for solving a novel prevention category (P) in the HIV system, known as HIPV mathematical model. The numerical performance of the novel HIPV mathematical model will be observed by exploiting the MWNN that works through the optimization procedures of global/local via “genetic algorithm (GA)” and local search “interior-point algorithm (IPA)”, i.e. MWNN-GA-IPA. An error function using the differential HIPV mathematical model and its initial conditions is presented and optimized by the MWNN-GA-IPA. The obtained results have been compared with the Adams method to check the competence of the MWNN-GA-IPA. For the reliability and stability of the scheme, the performance using different statistical operators has been performed based on the multiple independent trials to solve the novel HIPV mathematical model.
Collapse
Affiliation(s)
- Zulqurnain Sabir
- Department of Mathematics and Statistics, Hazara University, Mansehra, Pakistan
- Department of Mathematics and Science Education, Harran University, Sanliurfa, Turkey
| | - Muhammad Umar
- Department of Mathematics and Statistics, Hazara University, Mansehra, Pakistan
| | - Muhammad Asif Zahoor Raja
- Future Technology Research Center, National Yunlin University of Science and Technology, 123 University Road, Section 3, Douliou, Yunlin 64002, Taiwan, R.O.C
| | - Haci Mehmet Baskonus
- Department of Mathematics and Science Education, Harran University, Sanliurfa, Turkey
| | - Wei Gao
- School of Information Science and Technology, Yunnan Normal University, Yunnan, P. R. China
| |
Collapse
|
33
|
A Cutting Pattern Recognition Method for Shearers Based on ICEEMDAN and Improved Grey Wolf Optimizer Algorithm-Optimized SVM. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11199081] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
When the shearer is cutting, the sound signal generated by the cutting drum crushing coal and rock contains a wealth of cutting status information. In order to effectively process the shearer cutting sound signal and accurately identify the cutting mode, this paper proposed a shearer cutting sound signal recognition method based on an improved complete ensemble empirical mode decomposition with adaptive noise (ICCEMDAN) and an improved grey wolf optimizer (IGWO) algorithm-optimized support vector machine (SVM). First, the approach applied ICEEMDAN to process the cutting sound signal and obtained several intrinsic mode function (IMF) components. It used the correlation coefficient to select the characteristic component. Meanwhile, this paper calculated the composite multi-scale permutation entropy (CMPE) of the characteristic components as the eigenvalue. Then, the method introduced a differential evolution algorithm and nonlinear convergence factor to improve the GWO algorithm. It used the improved GWO algorithm to realize the adaptive selection of SVM parameters and established a cutting sound signal recognition model. According to the proportioning plan, the paper made several simulation coal walls for cutting experiments and collected cutting sound signals for cutting pattern recognition. The experimental results show that the method proposed in this paper can effectively process the cutting sound signal of the shearer, and the average accuracy of the cutting pattern recognition model reached 97.67%.
Collapse
|
34
|
Abinash MJ, Vasudevan V. Boundaries tuned support vector machine (BT-SVM) classifier for cancer prediction from gene selection. Comput Methods Biomech Biomed Engin 2021; 25:794-807. [PMID: 34585639 DOI: 10.1080/10255842.2021.1981300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
In recent days, the identified genes which are detecting cancer-causing diseases are plays a crucial part in the microarray data analysis. Huge volume of data required since the disease changed often. Conventional data mining techniques are lacking in space concern and time complexity. Based on big data the proposed work is executed. Using the ISPCA - Improved Supervised Principal Component Analysis, feature extraction is developed in this study. For gene expression, co-variance matrix is generated and through feature selection cancer classification is performed by IPSCA. Further feature selection process by boundaries tuned support vector machines (BT-SVM) classifier and modified particle swarm optimization with novel wrapper model algorithm are performed. The experimentation is carried out by utilizing different datasets like leukaemia, breast cancer dataset, brain cancer, colon, and lung carcinoma from the UCI repository. The proposed work is executed on six benchmark dataset for DNA microarray data in terms of accuracy, recall, and precision to evaluate the performance of the proposed work. For evaluating the proposed work effectiveness, it is compared with various traditional techniques and resulted in optimum accuracy, recall, precision and training time with and without feature selection effectively.
Collapse
Affiliation(s)
- M J Abinash
- Department of Computer Science, Sri Kaliswari College (Autonomous), Sivakasi, TamilNadu, India
| | - V Vasudevan
- Department of Information Technology, Kalasalingam Academy of Research and Education, Krishnankoil, Tamil Nadu, India
| |
Collapse
|
35
|
Soft Computing Paradigms to Find the Numerical Solutions of a Nonlinear Influenza Disease Model. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11188549] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
The aim of this work is to present the numerical results of the influenza disease nonlinear system using the feed forward artificial neural networks (ANNs) along with the optimization of the combination of global and local search schemes. The genetic algorithm (GA) and active-set method (ASM), i.e., GA-ASM, are implemented as global and local search schemes. The mathematical nonlinear influenza disease system is dependent of four classes, susceptible S(u), infected I(u), recovered R(u) and cross-immune individuals C(u). For the solutions of these classes based on influenza disease system, the design of an objective function is presented using these differential system equations and its corresponding initial conditions. The optimization of this objective function is using the hybrid computing combination of GA-ASM for solving all classes of the influenza disease nonlinear system. The obtained numerical results will be compared by the Adams numerical results to check the authenticity of the designed ANN-GA-ASM. In addition, the designed approach through statistical based operators shows the consistency and stability for solving the influenza disease nonlinear system.
Collapse
|
36
|
Shen J, Wu J, Xu M, Gan D, An B, Liu F. A Hybrid Method to Predict Postoperative Survival of Lung Cancer Using Improved SMOTE and Adaptive SVM. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:2213194. [PMID: 34545291 PMCID: PMC8449740 DOI: 10.1155/2021/2213194] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Revised: 06/09/2021] [Accepted: 08/21/2021] [Indexed: 11/18/2022]
Abstract
Predicting postoperative survival of lung cancer patients (LCPs) is an important problem of medical decision-making. However, the imbalanced distribution of patient survival in the dataset increases the difficulty of prediction. Although the synthetic minority oversampling technique (SMOTE) can be used to deal with imbalanced data, it cannot identify data noise. On the other hand, many studies use a support vector machine (SVM) combined with resampling technology to deal with imbalanced data. However, most studies require manual setting of SVM parameters, which makes it difficult to obtain the best performance. In this paper, a hybrid improved SMOTE and adaptive SVM method is proposed for imbalance data to predict the postoperative survival of LCPs. The proposed method is divided into two stages: in the first stage, the cross-validated committees filter (CVCF) is used to remove noise samples to improve the performance of SMOTE. In the second stage, we propose an adaptive SVM, which uses fuzzy self-tuning particle swarm optimization (FPSO) to optimize the parameters of SVM. Compared with other advanced algorithms, our proposed method obtains the best performance with 95.11% accuracy, 95.10% G-mean, 95.02% F1, and 95.10% area under the curve (AUC) for predicting postoperative survival of LCPs.
Collapse
Affiliation(s)
- Jiang Shen
- College of Management and Economics, Tianjin University, Tianjin 300072, China
| | - Jiachao Wu
- College of Management and Economics, Tianjin University, Tianjin 300072, China
| | - Man Xu
- Business School, Nankai University, Tianjin 300071, China
| | - Dan Gan
- School of Economics and Management, Hebei University of Technology, Tianjin 300071, China
| | - Bang An
- College of Management and Economics, Tianjin University, Tianjin 300072, China
| | - Fusheng Liu
- College of Management and Economics, Tianjin University, Tianjin 300072, China
| |
Collapse
|
37
|
Dudzik W, Nalepa J, Kawulok M. Evolving data-adaptive support vector machines for binary classification. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107221] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
38
|
Hybrid Artificial Intelligence HFS-RF-PSO Model for Construction Labor Productivity Prediction and Optimization. ALGORITHMS 2021. [DOI: 10.3390/a14070214] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
This paper presents a novel approach, using hybrid feature selection (HFS), machine learning (ML), and particle swarm optimization (PSO) to predict and optimize construction labor productivity (CLP). HFS selects factors that are most predictive of CLP to reduce the complexity of CLP data. Selected factors are used as inputs for four ML models for CLP prediction. The study results showed that random forest (RF) obtains better performance in mapping the relationship between CLP and selected factors affecting CLP, compared with the other three models. Finally, the integration of RF and PSO is developed to identify the maximum CLP value and the optimum value of each selected factor. This paper introduces a new hybrid model named HFS-RF-PSO that addresses the main limitation of existing CLP prediction studies, which is the lack of capacity to optimize CLP and its most predictive factors with respect to a construction company’s preferences, such as a targeted CLP. The major contribution of this paper is the development of the hybrid HFS-RF-PSO model as a novel approach for optimizing factors that influence CLP and identifying the maximum CLP value.
Collapse
|
39
|
Li AD, Xue B, Zhang M. Improved binary particle swarm optimization for feature selection with new initialization and search space reduction strategies. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107302] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
40
|
WR-SVM Model Based on the Margin Radius Approach for Solving the Minimum Enclosing Ball Problem in Support Vector Machine Classification. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11104657] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
The generalization error of conventional support vector machine (SVM) depends on the ratio of two factors; radius and margin. The traditional SVM aims to maximize margin but ignore minimization of radius, which decreases the overall performance of the SVM classifier. However, different approaches are developed to achieve a trade-off between the margin and radius. Still, the computational cost of all these approaches is high due to the requirements of matrix transformation. Furthermore, a conventional SVM tries to set the best hyperplane between classes, and due to some robust kernel tricks, an SVM is used in many non-linear and complex problems. The configuration of the best hyperplane between classes is not effective; therefore, it is required to bind a class within its limited area to enhance the performance of the SVM classifier. The area enclosed by a class is called its Minimum Enclosing Ball (MEB), and it is one of the emerging problems of SVM. Therefore, a robust solution is needed to improve the performance of the conventional SVM to overcome the highlighted issues. In this research study, a novel weighted radius SVM (WR-SVM) is proposed to determine the tighter bounds of MEB. The proposed solution uses a weighted mean to find tighter bounds of radius, due to which the size of MEB decreases. Experiments are conducted on nine different benchmark datasets and one synthetic dataset to demonstrate the effectiveness of our proposed model. The experimental results reveal that the proposed WR-SVM significantly performed well compared to the conventional SVM classifier. Furthermore, experimental results are compared with F-SVM and traditional SVM in terms of classification accuracy to demonstrate the significance of the proposed WR-SVM.
Collapse
|
41
|
Correlation between the structure and skin permeability of compounds. Sci Rep 2021; 11:10076. [PMID: 33980965 PMCID: PMC8115152 DOI: 10.1038/s41598-021-89587-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 04/28/2021] [Indexed: 12/02/2022] Open
Abstract
A three-descriptor quantitative structure–activity/toxicity relationship (QSAR/QSTR) model was developed for the skin permeability of a sufficiently large data set consisting of 274 compounds, by applying support vector machine (SVM) together with genetic algorithm. The optimal SVM model possesses the coefficient of determination R2 of 0.946 and root mean square (rms) error of 0.253 for the training set of 139 compounds; and a R2 of 0.872 and rms of 0.302 for the test set of 135 compounds. Compared with other models reported in the literature, our SVM model shows better statistical performance in a model that deals with more samples in the test set. Therefore, applying a SVM algorithm to develop a nonlinear QSAR model for skin permeability was achieved.
Collapse
|
42
|
18F-FDG-PET/CT Whole-Body Imaging Lung Tumor Diagnostic Model: An Ensemble E-ResNet-NRC with Divided Sample Space. BIOMED RESEARCH INTERNATIONAL 2021; 2021:8865237. [PMID: 33869635 PMCID: PMC8032520 DOI: 10.1155/2021/8865237] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/13/2020] [Revised: 11/03/2020] [Accepted: 02/25/2021] [Indexed: 11/17/2022]
Abstract
Under the background of 18F-FDG-PET/CT multimodal whole-body imaging for lung tumor diagnosis, for the problems of network degradation and high dimension features during convolutional neural network (CNN) training, beginning with the perspective of dividing sample space, an E-ResNet-NRC (ensemble ResNet nonnegative representation classifier) model is proposed in this paper. The model includes the following steps: (1) Parameters of a pretrained ResNet model are initialized using transfer learning. (2) Samples are divided into three different sample spaces (CT, PET, and PET/CT) based on the differences in multimodal medical images PET/CT, and ROI of the lesion was extracted. (3) The ResNet neural network was used to extract ROI features and obtain feature vectors. (4) Individual classifier ResNet-NRC was constructed with nonnegative representation NRC at a fully connected layer. (5) Ensemble classifier E-ResNet-NRC was constructed using the “relative majority voting method.” Finally, two network models, AlexNet and ResNet-50, and three classification algorithms, nearest neighbor classification algorithm (NNC), softmax, and nonnegative representation classification algorithm (NRC), were combined to compare with the E-ResNet-NRC model in this paper. The experimental results show that the overall classification performance of the Ensemble E-ResNet-NRC model is better than the individual ResNet-NRC, and specificity and sensitivity are more higher; the E-ResNet-NRC has better robustness and generalization ability.
Collapse
|
43
|
Xie H, Zhang L, Lim CP, Yu Y, Liu H. Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models. SENSORS 2021; 21:s21051816. [PMID: 33807806 PMCID: PMC7961412 DOI: 10.3390/s21051816] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/13/2021] [Revised: 02/19/2021] [Accepted: 02/22/2021] [Indexed: 11/16/2022]
Abstract
In this research, we propose two Particle Swarm Optimisation (PSO) variants to undertake feature selection tasks. The aim is to overcome two major shortcomings of the original PSO model, i.e., premature convergence and weak exploitation around the near optimal solutions. The first proposed PSO variant incorporates four key operations, including a modified PSO operation with rectified personal and global best signals, spiral search based local exploitation, Gaussian distribution-based swarm leader enhancement, and mirroring and mutation operations for worst solution improvement. The second proposed PSO model enhances the first one through four new strategies, i.e., an adaptive exemplar breeding mechanism incorporating multiple optimal signals, nonlinear function oriented search coefficients, exponential and scattering schemes for swarm leader, and worst solution enhancement, respectively. In comparison with a set of 15 classical and advanced search methods, the proposed models illustrate statistical superiority for discriminative feature selection for a total of 13 data sets.
Collapse
Affiliation(s)
- Hailun Xie
- Computational Intelligence Research Group, Department of Computer and Information Sciences, Faculty of Engineering and Environment, University of Northumbria, Newcastle upon Tyne NE1 8ST, UK;
| | - Li Zhang
- Computational Intelligence Research Group, Department of Computer and Information Sciences, Faculty of Engineering and Environment, University of Northumbria, Newcastle upon Tyne NE1 8ST, UK;
- Correspondence:
| | - Chee Peng Lim
- Institute for Intelligent Systems Research and Innovation, Deakin University, Waurn Ponds, VIC 3216, Australia;
| | - Yonghong Yu
- College of Tongda, Nanjing University of Posts and Telecommunications, Nanjing 210049, China;
| | - Han Liu
- College of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, China;
| |
Collapse
|
44
|
Albashish D, Hammouri AI, Braik M, Atwan J, Sahran S. Binary biogeography-based optimization based SVM-RFE for feature selection. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2020.107026] [Citation(s) in RCA: 40] [Impact Index Per Article: 13.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
|
45
|
Wang X, Wang S, Huang Z, Du Y. Condensing the solution of support vector machines via radius-margin bound. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2020.107071] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
46
|
A New Robust Adaptive Fusion Method for Double-Modality Medical Image PET/CT. BIOMED RESEARCH INTERNATIONAL 2021. [DOI: 10.1155/2021/8824395] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
A new robust adaptive fusion method for double-modality medical image PET/CT is proposed according to the Piella framework. The algorithm consists of the following three steps. Firstly, the registered PET and CT images are decomposed using the nonsubsampled contourlet transform (NSCT). Secondly, in order to highlight the lesions of the low-frequency image, low-frequency components are fused by pulse-coupled neural network (PCNN) that has a higher sensitivity to featured area with low intensities. With regard to high-frequency subbands, the Gauss random matrix is used for compression measurements, histogram distance between the every two corresponding subblocks of high coefficient is employed as match measure, and regional energy is used as activity measure. The fusion factor
is then calculated by using the match measure and the activity measure. The high-frequency measurement value is fused according to the fusion factor, and high-frequency fusion image is reconstructed by using the orthogonal matching pursuit algorithm of the high-frequency measurement after fusion. Thirdly, the final image is acquired through the NSCT inverse transformation of the low-frequency fusion image and the reconstructed high-frequency fusion image. To validate the proposed algorithm, four comparative experiments were performed: comparative experiment with other image fusion algorithms, comparison of different activity measures, different match measures, and PET/CT fusion results of lung cancer (20 groups). The experimental results showed that the proposed algorithm could better retain and show the lesion information, and is superior to other fusion algorithms based on both the subjective and objective evaluations.
Collapse
|
47
|
Ma Y, Liang X, Sheng G, Kwok JT, Wang M, Li G. Noniterative Sparse LS-SVM Based on Globally Representative Point Selection. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:788-798. [PMID: 32275614 DOI: 10.1109/tnnls.2020.2979466] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
A least squares support vector machine (LS-SVM) offers performance comparable to that of SVMs for classification and regression. The main limitation of LS-SVM is that it lacks sparsity compared with SVMs, making LS-SVM unsuitable for handling large-scale data due to computation and memory costs. To obtain sparse LS-SVM, several pruning methods based on an iterative strategy were recently proposed but did not consider the quantity constraint on the number of reserved support vectors, as widely used in real-life applications. In this article, a noniterative algorithm is proposed based on the selection of globally representative points (global-representation-based sparse least squares support vector machine, GRS-LSSVM) to improve the performance of sparse LS-SVM. For the first time, we present a model of sparse LS-SVM with a quantity constraint. In solving the optimal solution of the model, we find that using globally representative points to construct the reserved support vector set produces a better solution than other methods. We design an indicator based on point density and point dispersion to evaluate the global representation of points in feature space. Using the indicator, the top globally representative points are selected in one step from all points to construct the reserved support vector set of sparse LS-SVM. After obtaining the set, the decision hyperplane of sparse LS-SVM is directly computed using an algebraic formula. This algorithm only consumes O(N2) in computational complexity and O(N) in memory cost which makes it suitable for large-scale data sets. The experimental results show that the proposed algorithm has higher sparsity, greater stability, and lower computational complexity than the traditional iterative algorithms.
Collapse
|
48
|
Ray P, Reddy SS, Banerjee T. Various dimension reduction techniques for high dimensional data analysis: a review. Artif Intell Rev 2021. [DOI: 10.1007/s10462-020-09928-0] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
49
|
Bhagat SK, Tiyasha T, Awadh SM, Tung TM, Jawad AH, Yaseen ZM. Prediction of sediment heavy metal at the Australian Bays using newly developed hybrid artificial intelligence models. ENVIRONMENTAL POLLUTION (BARKING, ESSEX : 1987) 2021; 268:115663. [PMID: 33120144 DOI: 10.1016/j.envpol.2020.115663] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2020] [Revised: 09/05/2020] [Accepted: 09/14/2020] [Indexed: 05/25/2023]
Abstract
Hybrid artificial intelligence (AI) models are developed for sediment lead (Pb) prediction in two Bays (i.e., Bramble (BB) and Deception (DB)) stations, Australia. A feature selection (FS) algorithm called extreme gradient boosting (XGBoost) is proposed to abstract the correlated input parameters for the Pb prediction and validated against principal component of analysis (PCA), recursive feature elimination (RFE), and the genetic algorithm (GA). XGBoost model is applied using a grid search strategy (Grid-XGBoost) for predicting Pb and validated against the commonly used AI models, artificial neural network (ANN) and support vector machine (SVM). The input parameter selection approaches redimensioned the 21 parameters into 9-5 parameters without losing their learned information over the models' training phase. At the BB station, the mean absolute percentage error (MAPE) values (0.06, 0.32, 0.34, and 0.33) were achieved for the XGBoost-SVM, XGBoost-ANN, XGBoost-Grid-XGBoost, and Grid-XGBoost models, respectively. At the DB station, the lowest MAPE values, 0.25 and 0.24, were attained for the XGBoost-Grid-XGBoost and Grid-XGBoost models, respectively. Overall, the proposed hybrid AI models provided a reliable and robust computer aid technology for sediment Pb prediction that contribute to the best knowledge of environmental pollution monitoring and assessment.
Collapse
Affiliation(s)
- Suraj Kumar Bhagat
- Faculty of Civil Engineering, Ton Duc Thang University, Ho Chi Minh City, Viet Nam
| | - Tiyasha Tiyasha
- Faculty of Civil Engineering, Ton Duc Thang University, Ho Chi Minh City, Viet Nam
| | | | - Tran Minh Tung
- Faculty of Civil Engineering, Ton Duc Thang University, Ho Chi Minh City, Viet Nam
| | - Ali H Jawad
- Faculty of Applied Sciences, Universiti Teknologi MARA, 40450, Shah Alam, Selangor, Malaysia
| | - Zaher Mundher Yaseen
- Sustainable Developments in Civil Engineering Research Group, Faculty of Civil Engineering, Ton Duc Thang University, Ho Chi Minh City, Viet Nam.
| |
Collapse
|
50
|
NSCR-Based DenseNet for Lung Tumor Recognition Using Chest CT Image. BIOMED RESEARCH INTERNATIONAL 2020; 2020:6636321. [PMID: 33490248 PMCID: PMC7787714 DOI: 10.1155/2020/6636321] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/24/2020] [Revised: 11/15/2020] [Accepted: 12/04/2020] [Indexed: 01/10/2023]
Abstract
Nonnegative sparse representation has become a popular methodology in medical analysis and diagnosis in recent years. In order to resolve network degradation, higher dimensionality in feature extraction, data redundancy, and other issues faced when medical images parameters are trained using convolutional neural networks. Lung tumors in chest CT image based on nonnegative, sparse, and collaborative representation classification of DenseNet (DenseNet-NSCR) are proposed by this paper: firstly, initialization parameters of pretrained DenseNet model using transfer learning; secondly, training DenseNet using CT images to extract feature vectors for the full connectivity layer; thirdly, a nonnegative, sparse, and collaborative representation (NSCR) is used to represent the feature vector and solve the coding coefficient matrix; fourthly, the residual similarity is used for classification. The experimental results show that the DenseNet-NSCR classification is better than the other models, and the various evaluation indexes such as specificity and sensitivity are also high, and the method has better robustness and generalization ability through comparison experiment using AlexNet, GoogleNet, and DenseNet-201 models.
Collapse
|