Application of Meta-Heuristic Algorithms for Training Neural Networks and Deep Learning Architectures: A Comprehensive Review

Construction and optimization of vending machine decision support system based on improved C4.5 decision tree

The intensification of market competition makes refined operation management become the focus of attention of major manufacturers. As an important branch of artificial intelligence (AI), machine learning (ML) plays a key role in it, and has its application prospect in various systems. Based on this situation, this paper takes vending machines as the research object. On the one hand, the product classification model of vending machine is constructed based on decision tree algorithm. On the other hand, based on neural network (NN), the sales forecast model of vending machines is built. Finally, based on the above research, the theoretical framework of decision support system (DSS) for vending machines is constructed. The research shows that: (1) The accuracy of C4.5 algorithm can reach 87 % at the highest and 68 % at the lowest. The accuracy of the improved C4.5 algorithm can reach 87 % at the highest and 67 % at the lowest, with little difference between them. (2) The maximum running time of the improved C4.5 algorithm is about 5500 ms, and the minimum is close to 1 ms. In addition, the running time of all seven datasets is better than that of the unmodified algorithm. (3) When the back propagation neural network (BPNN) is used to forecast the sales of vending machines, the curve of the predicted data basically coincides with the curve of the actual data, which shows that its accuracy is high. This paper aims to build a convenient and secure DSS by taking vending machines as an example. In addition, this paper also uses reinforcement learning to optimize the research methods of this paper. It can further optimize the performance and efficiency of vending machines and provide better service experience for customers. Meanwhile, the use of reinforcement learning can make the whole system more intelligent and adaptive to better cope with the changing market environment.

Harnessing deep learning for population genetic inference

In population genetics, the emergence of large-scale genomic data for various species and populations has provided new opportunities to understand the evolutionary forces that drive genetic diversity using statistical inference. However, the era of population genomics presents new challenges in analysing the massive amounts of genomes and variants. Deep learning has demonstrated state-of-the-art performance for numerous applications involving large-scale data. Recently, deep learning approaches have gained popularity in population genetics; facilitated by the advent of massive genomic data sets, powerful computational hardware and complex deep learning architectures, they have been used to identify population structure, infer demographic history and investigate natural selection. Here, we introduce common deep learning architectures and provide comprehensive guidelines for implementing deep learning models for population genetic inference. We also discuss current challenges and future directions for applying deep learning in population genetics, focusing on efficiency, robustness and interpretability.

Lesion detection in women breast's dynamic contrast-enhanced magnetic resonance imaging using deep learning

Breast cancer is one of the most common cancers in women and the second foremost cause of cancer death in women after lung cancer. Recent technological advances in breast cancer treatment offer hope to millions of women in the world. Segmentation of the breast's Dynamic Contrast-Enhanced Magnetic Resonance Imaging (DCE-MRI) is one of the necessary tasks in the diagnosis and detection of breast cancer. Currently, a popular deep learning model, U-Net is extensively used in biomedical image segmentation. This article aims to advance the state of the art and conduct a more in-depth analysis with a focus on the use of various U-Net models in lesion detection in women's breast DCE-MRI. In this article, we perform an empirical study of the effectiveness and efficiency of U-Net and its derived deep learning models including ResUNet, Dense UNet, DUNet, Attention U-Net, UNet++, MultiResUNet, RAUNet, Inception U-Net and U-Net GAN for lesion detection in breast DCE-MRI. All the models are applied to the benchmarked 100 Sagittal T2-Weighted fat-suppressed DCE-MRI slices of 20 patients and their performance is compared. Also, a comparative study has been conducted with V-Net, W-Net, and DeepLabV3+. Non-parametric statistical test Wilcoxon Signed Rank Test is used to analyze the significance of the quantitative results. Furthermore, Multi-Criteria Decision Analysis (MCDA) is used to evaluate overall performance focused on accuracy, precision, sensitivity, F[Formula: see text]-score, specificity, Geometric-Mean, DSC, and false-positive rate. The RAUNet segmentation model achieved a high accuracy of 99.76%, sensitivity of 85.04%, precision of 90.21%, and Dice Similarity Coefficient (DSC) of 85.04% whereas ResNet achieved 99.62% accuracy, 62.26% sensitivity, 99.56% precision, and 72.86% DSC. ResUNet is found to be the most effective model based on MCDA. On the other hand, U-Net GAN takes the least computational time to perform the segmentation task. Both quantitative and qualitative results demonstrate that the ResNet model performs better than other models in segmenting the images and lesion detection, though computational time in achieving the objectives varies.

Hybrid Whale Archimedes Optimization-based MLPNN model for soil nutrient classification and pH prediction

Soil fertility and environmental factors play an important role in improving productivity and cropland quality in the agricultural sector. A new prediction and classification model for the potential of soil nutrients and hydrogen (pH) levels is proposed. The proposed model, Hybrid Whale Archimedes Optimization-based Multilayer Perceptron Neural Network (HWAO-MLPNN), is utilized for soil features classification of pH levels, and the soils are collected from the villages such as phosphorous (P), organic carbon (OC), boron (B), and potassium (K). The village-wise soil fertility prediction and classification model aims to improve soil health, reduce harmful fertilizer usage, enhance environmental quality, and achieve more profits. The proposed model combines the Multilayer Perceptron Neural Network (MLPNN) model and the Hybrid Whale Archimedes Optimization (HWAO) algorithm to enhance the classification performance on the validation data. The Marathwada dataset is selected to validate the soil nutrient prediction and classification model, and various measuring units such as cross-validation accuracy, Area Under Curve (AUC), accuracy, Mean Squared Error (MSE), G-mean, precision, specificity, and sensitivity are used for evaluation. The comparative study of this paper shows that the proposed HWAO-MLPNN achieved more classification accuracy of 98.1%, cross-validation accuracy of 98.3% for pH classification, and cross-validation accuracy of 97.9% for soil nutrient classification. The proposed model can be utilized to accurately classify soil nutrients and pH levels, which can have a significant impact on improving soil health, reducing harmful fertilizer usage, enhancing environmental quality, and ultimately increasing profitability in the agricultural sector.

A bio-inspired convolution neural network architecture for automatic breast cancer detection and classification using RNA-Seq gene expression data

Breast cancer is considered one of the significant health challenges and ranks among the most prevalent and dangerous cancer types affecting women globally. Early breast cancer detection and diagnosis are crucial for effective treatment and personalized therapy. Early detection and diagnosis can help patients and physicians discover new treatment options, provide a more suitable quality of life, and ensure increased survival rates. Breast cancer detection using gene expression involves many complexities, such as the issue of dimensionality and the complicatedness of the gene expression data. This paper proposes a bio-inspired CNN model for breast cancer detection using gene expression data downloaded from the cancer genome atlas (TCGA). The data contains 1208 clinical samples of 19,948 genes with 113 normal and 1095 cancerous samples. In the proposed model, Array-Array Intensity Correlation (AAIC) is used at the pre-processing stage for outlier removal, followed by a normalization process to avoid biases in the expression measures. Filtration is used for gene reduction using a threshold value of 0.25. Thereafter the pre-processed gene expression dataset was converted into images which were later converted to grayscale to meet the requirements of the model. The model also uses a hybrid model of CNN architecture with a metaheuristic algorithm, namely the Ebola Optimization Search Algorithm (EOSA), to enhance the detection of breast cancer. The traditional CNN and five hybrid algorithms were compared with the classification result of the proposed model. The competing hybrid algorithms include the Whale Optimization Algorithm (WOA-CNN), the Genetic Algorithm (GA-CNN), the Satin Bowerbird Optimization (SBO-CNN), the Life Choice-Based Optimization (LCBO-CNN), and the Multi-Verse Optimizer (MVO-CNN). The results show that the proposed model determined the classes with high-performance measurements with an accuracy of 98.3%, a precision of 99%, a recall of 99%, an f1-score of 99%, a kappa of 90.3%, a specificity of 92.8%, and a sensitivity of 98.9% for the cancerous class. The results suggest that the proposed method has the potential to be a reliable and precise approach to breast cancer detection, which is crucial for early diagnosis and personalized therapy.

A Comprehensive Review of Bio-Inspired Optimization Algorithms Including Applications in Microelectronics and Nanophotonics

The application of artificial intelligence in everyday life is becoming all-pervasive and unavoidable. Within that vast field, a special place belongs to biomimetic/bio-inspired algorithms for multiparameter optimization, which find their use in a large number of areas. Novel methods and advances are being published at an accelerated pace. Because of that, in spite of the fact that there are a lot of surveys and reviews in the field, they quickly become dated. Thus, it is of importance to keep pace with the current developments. In this review, we first consider a possible classification of bio-inspired multiparameter optimization methods because papers dedicated to that area are relatively scarce and often contradictory. We proceed by describing in some detail some more prominent approaches, as well as those most recently published. Finally, we consider the use of biomimetic algorithms in two related wide fields, namely microelectronics (including circuit design optimization) and nanophotonics (including inverse design of structures such as photonic crystals, nanoplasmonic configurations and metamaterials). We attempted to keep this broad survey self-contained so it can be of use not only to scholars in the related fields, but also to all those interested in the latest developments in this attractive area.

Ensemble Learning, Deep Learning-Based and Molecular Descriptor-Based Quantitative Structure-Activity Relationships

A deep learning-based quantitative structure-activity relationship analysis, namely the molecular image-based DeepSNAP-deep learning method, can successfully and automatically capture the spatial and temporal features in an image generated from a three-dimensional (3D) structure of a chemical compound. It allows building high-performance prediction models without extracting and selecting features because of its powerful feature discrimination capability. Deep learning (DL) is based on a neural network with multiple intermediate layers that makes it possible to solve highly complex problems and improve the prediction accuracy by increasing the number of hidden layers. However, DL models are too complex when it comes to understanding the derivation of predictions. Instead, molecular descriptor-based machine learning has clear features owing to the selection and analysis of features. However, molecular descriptor-based machine learning has some limitations in terms of prediction performance, calculation cost, feature selection, etc., while the DeepSNAP-deep learning method outperforms molecular descriptor-based machine learning due to the utilization of 3D structure information and the advanced computer processing power of DL.

Brain Tumor Classification Using Meta-Heuristic Optimized Convolutional Neural Networks

The field of medical image processing plays a significant role in brain tumor classification. The survival rate of patients can be increased by diagnosing the tumor at an early stage. Several automatic systems have been developed to perform the tumor recognition process. However, the existing systems could be more efficient in identifying the exact tumor region and hidden edge details with minimum computation complexity. The Harris Hawks optimized convolution network (HHOCNN) is used in this work to resolve these issues. The brain magnetic resonance (MR) images are pre-processed, and the noisy pixels are eliminated to minimize the false tumor recognition rate. Then, the candidate region process is applied to identify the tumor region. The candidate region method investigates the boundary regions with the help of the line segments concept, which reduces the loss of hidden edge details. Various features are extracted from the segmented region, which is classified by applying a convolutional neural network (CNN). The CNN computes the exact region of the tumor with fault tolerance. The proposed HHOCNN system was implemented using MATLAB, and performance was evaluated using pixel accuracy, error rate, accuracy, specificity, and sensitivity metrics. The nature-inspired Harris Hawks optimization algorithm minimizes the misclassification error rate and improves the overall tumor recognition accuracy to 98% achieved on the Kaggle dataset.

A Novel Multi-Objective Binary Chimp Optimization Algorithm for Optimal Feature Selection: Application of Deep-Learning-Based Approaches for SAR Image Classification

Removing redundant features and improving classifier performance necessitates the use of meta-heuristic and deep learning (DL) algorithms in feature selection and classification problems. With the maturity of DL tools, many data-driven polarimetric synthetic aperture radar (POLSAR) representation models have been suggested, most of which are based on deep convolutional neural networks (DCNNs). In this paper, we propose a hybrid approach of a new multi-objective binary chimp optimization algorithm (MOBChOA) and DCNN for optimal feature selection. We implemented the proposed method to classify POLSAR images from San Francisco, USA. To do so, we first performed the necessary preprocessing, including speckle reduction, radiometric calibration, and feature extraction. After that, we implemented the proposed MOBChOA for optimal feature selection. Finally, we trained the fully connected DCNN to classify the pixels into specific land-cover labels. We evaluated the performance of the proposed MOBChOA-DCNN in comparison with nine competitive methods. Our experimental results with the POLSAR image datasets show that the proposed architecture had a great performance for different important optimization parameters. The proposed MOBChOA-DCNN provided fewer features (27) and the highest overall accuracy. The overall accuracy values of MOBChOA-DCNN on the training and validation datasets were 96.89% and 96.13%, respectively, which were the best results. The overall accuracy of SVM was 89.30%, which was the worst result. The results of the proposed MOBChOA on two real-world benchmark problems were also better than the results with the other methods. Furthermore, it was shown that the MOBChOA-DCNN performed better than methods from previous studies.