G-Prop: Global optimization of multilayer perceptrons using GAs

Cost-Sensitive Metaheuristic Optimization-Based Neural Network with Ensemble Learning for Financial Distress Prediction

Financial distress prediction is crucial in the financial domain because of its implications for banks, businesses, and corporations. Serious financial losses may occur because of poor financial distress prediction. As a result, significant efforts have been made to develop prediction models that can assist decision-makers to anticipate events before they occur and avoid bankruptcy, thereby helping to improve the quality of such tasks. Because of the usual highly imbalanced distribution of data, financial distress prediction is a challenging task. Hence, a wide range of methods and algorithms have been developed over recent decades to address the classification of imbalanced datasets. Metaheuristic optimization-based artificial neural networks have shown exciting results in a variety of applications, as well as classification problems. However, less consideration has been paid to using a cost sensitivity fitness function in metaheuristic optimization-based artificial neural networks to solve the financial distress prediction problem. In this work, we propose ENS_PSONNcost and ENS_CSONNcost: metaheuristic optimization-based artificial neural networks that utilize a particle swarm optimizer and a competitive swarm optimizer and five cost sensitivity fitness functions as the base learners in a majority voting ensemble learning paradigm. Three extremely imbalanced datasets from Spanish, Taiwanese, and Polish companies were considered to avoid dataset bias. The results showed significant improvements in the g-mean (the geometric mean of sensitivity and specificity) metric and the F1 score (the harmonic mean of precision and sensitivity) while maintaining adequately high accuracy.

Artificial Neural Network Optimized with a Genetic Algorithm for Seasonal Groundwater Table Depth Prediction in Uttar Pradesh, India

Accurate information about groundwater level prediction is crucial for effective planning and management of groundwater resources. In the present study, the Artificial Neural Network (ANN), optimized with a Genetic Algorithm (GA-ANN), was employed for seasonal groundwater table depth (GWTD) prediction in the area between the Ganga and Hindon rivers located in Uttar Pradesh State, India. A total of 18 models for both seasons (nine for the pre-monsoon and nine for the post-monsoon) have been formulated by using groundwater recharge (GWR), groundwater discharge (GWD), and previous groundwater level data from a 21-year period (1994–2014). The hybrid GA-ANN models’ predictive ability was evaluated against the traditional GA models based on statistical indicators and visual inspection. The results appraisal indicates that the hybrid GA-ANN models outperformed the GA models for predicting the seasonal GWTD in the study region. Overall, the hybrid GA-ANN-8 model with an 8-9-1 structure (i.e., 8: inputs, 9: neurons in the hidden layer, and 1: output) was nominated optimal for predicting the GWTD during pre- and post-monsoon seasons. Additionally, it was noted that the maximum number of input variables in the hybrid GA-ANN approach improved the prediction accuracy. In conclusion, the proposed hybrid GA-ANN model’s findings could be readily transferable or implemented in other parts of the world, specifically those with similar geology and hydrogeology conditions for sustainable planning and groundwater resources management.

Use of machine learning methods for prediction of acute toxicity in organs at risk following prostate radiotherapy

PURPOSE

The goal of this study is to investigate the advantages of large scale optimization methods vs conventional classification techniques in predicting acute toxicity for urinary bladder and rectum due to prostate irradiation.

METHODS

Clinical and dosimetric data of 321 patients undergoing prostate conformal radiotherapy were recorded. Gastro-intestinal and genito-urinary acute toxicities were scored according to the Radiation Therapy Oncology Group/European Organization for Research and Treatment of Cancer (RTOG/EORTC) scale. Patients were classified in two categories to separate mild (Grade < 2) from severe toxicity levels (Grade > 2). Machine learning methods at different complexity were implemented to predict toxicity as a function of multiple variables. The first approach consisted of a large scale optimization method, based on genetic algorithms (GAs) and artificial neural networks (ANN). The second approach was a binary classifier based on support vector machines (SVM).

RESULTS

The ANN and SVM-based solutions showed comparable prediction accuracy, exhibiting an area under the receiver operating characteristic (ROC) curve of 0.7. Different sensitivity and specificity features were measured for the two approaches. The ANN algorithm showed enhanced sensitivity if combined with appropriate classification criteria.

CONCLUSIONS

The results demonstrate that high sensitivity in toxicity prediction can be achieved with optimized ANNs, that are put forward to represent a valuable support in medical decisions. Future studies will be focused on enlarging the available patient database to increase the reliability of toxicity prediction algorithms and to define optimal classification criteria.

Evolutionary Computation and Its Applications in Neural and Fuzzy Systems

Neural networks and fuzzy systems are two soft-computing paradigms for system modelling. Adapting a neural or fuzzy system requires to solve two optimization problems: structural optimization and parametric optimization. Structural optimization is a discrete optimization problem which is very hard to solve using conventional optimization techniques. Parametric optimization can be solved using conventional optimization techniques, but the solution may be easily trapped at a bad local optimum. Evolutionary computation is a general-purpose stochastic global optimization approach under the universally accepted neo-Darwinian paradigm, which is a combination of the classical Darwinian evolutionary theory, the selectionism of Weismann, and the genetics of Mendel. Evolutionary algorithms are a major approach to adaptation and optimization. In this paper, we first introduce evolutionary algorithms with emphasis on genetic algorithms and evolutionary strategies. Other evolutionary algorithms such as genetic programming, evolutionary programming, particle swarm optimization, immune algorithm, and ant colony optimization are also described. Some topics pertaining to evolutionary algorithms are also discussed, and a comparison between evolutionary algorithms and simulated annealing is made. Finally, the application of EAs to the learning of neural networks as well as to the structural and parametric adaptations of fuzzy systems is also detailed.

An Optimal Design Method for Artificial Neural Networks by Using the Design of Experiments

This paper presents a method to optimally design artificial neural networks with many design parameters using the Design of Experiment (DOE), whose features are efficient experiments using an orthogonal array and quantitative analysis by analysis of variance. Neural networks can approximate arbitrary nonlinear functions. The accuracy of a trained neural network at a certain number of learning cycles depends on both weights and biases and its structure and learning rate. Design methods such as trial-and-error, brute-force approaches, network construction, and pruning, cannot deal with many design parameters such as the number of elements in a layer and a learning rate. Our design method realizes efficient optimization using DOE, and obtains confidence of optimal design through statistical analysis even though trained neural networks very due to randomness in initial weights. We apply our design method three-layer and five-layer feedforward neural networks in a preliminary study and show that approximation accuracy of multilayer neural networks is increased by picking up many more parameters.

Computer-aided diagnosis of carotid atherosclerosis based on ultrasound image statistics, laws' texture and neural networks

Quantitative characterisation of carotid atherosclerosis and classification into symptomatic or asymptomatic is crucial in planning optimal treatment of atheromatous plaque. The computer-aided diagnosis (CAD) system described in this paper can analyse ultrasound (US) images of carotid artery and classify them into symptomatic or asymptomatic based on their echogenicity characteristics. The CAD system consists of three modules: a) the feature extraction module, where first-order statistical (FOS) features and Laws' texture energy can be estimated, b) the dimensionality reduction module, where the number of features can be reduced using analysis of variance (ANOVA), and c) the classifier module consisting of a neural network (NN) trained by a novel hybrid method based on genetic algorithms (GAs) along with the back propagation algorithm. The hybrid method is able to select the most robust features, to adjust automatically the NN architecture and to optimise the classification performance. The performance is measured by the accuracy, sensitivity, specificity and the area under the receiver-operating characteristic (ROC) curve. The CAD design and development is based on images from 54 symptomatic and 54 asymptomatic plaques. This study demonstrates the ability of a CAD system based on US image analysis and a hybrid trained NN to identify atheromatous plaques at high risk of stroke.

Combining neural network and genetic algorithm for prediction of lung sounds

Recognition of lung sounds is an important goal in pulmonary medicine. In this work, we present a study for neural networks-genetic algorithm approach intended to aid in lung sound classification. Lung sound was captured from the chest wall of The subjects with different pulmonary diseases and also from the healthy subjects. Sound intervals with duration of 15-20 s were sampled from subjects. From each interval, full breath cycles were selected. Of each selected breath cycle, a 256-point Fourier Power Spectrum Density (PSD) was calculated. Total of 129 data values calculated by the spectral analysis are selected by genetic algorithm and applied to neural network. Multilayer perceptron (MLP) neural network employing backpropagation training algorithm was used to predict the presence or absence of adventitious sounds (wheeze and crackle). We used genetic algorithms to search for optimal structure and training parameters of neural network for a better predicting of lung sounds. This application resulted in designing of optimum network structure and, hence reducing the processing load and time.

Biological engineering applications of feedforward neural networks designed and parameterized by genetic algorithms

Two neural network (NN) applications in the field of biological engineering are developed, designed and parameterized by an evolutionary method based on the evolutionary process of genetic algorithms. The developed systems are a fault detection NN model and a predictive modeling NN system. An indirect or 'weak specification' representation was used for the encoding of NN topologies and training parameters into genes of the genetic algorithm (GA). Some a priori knowledge of the demands in network topology for specific application cases is required by this approach, so that the infinite search space of the problem is limited to some reasonable degree. Both one-hidden-layer and two-hidden-layer network architectures were explored by the GA. Except for the network architecture, each gene of the GA also encoded the type of activation functions in both hidden and output nodes of the NN and the type of minimization algorithm that was used by the backpropagation algorithm for the training of the NN. Both models achieved satisfactory performance, while the GA system proved to be a powerful tool that can successfully replace the problematic trial-and-error approach that is usually used for these tasks.