A new optimized GA-RBF neural network algorithm

When confronting the complex problems, radial basis function (RBF) neural network has the advantages of adaptive and self-learning ability, but it is difficult to determine the number of hidden layer neurons, and the weights learning ability from hidden layer to the output layer is low; these deficiencies easily lead to decreasing learning ability and recognition precision. Aiming at this problem, we propose a new optimized RBF neural network algorithm based on genetic algorithm (GA-RBF algorithm), which uses genetic algorithm to optimize the weights and structure of RBF neural network; it chooses new ways of hybrid encoding and optimizing simultaneously. Using the binary encoding encodes the number of the hidden layer's neurons and using real encoding encodes the connection weights. Hidden layer neurons number and connection weights are optimized simultaneously in the new algorithm. However, the connection weights optimization is not complete; we need to use least mean square (LMS) algorithm for further leaning, and finally get a new algorithm model. Using two UCI standard data sets to test the new algorithm, the results show that the new algorithm improves the operating efficiency in dealing with complex problems and also improves the recognition precision, which proves that the new algorithm is valid.

Kernel learning at the first level of inference

Kernel learning methods, whether Bayesian or frequentist, typically involve multiple levels of inference, with the coefficients of the kernel expansion being determined at the first level and the kernel and regularisation parameters carefully tuned at the second level, a process known as model selection. Model selection for kernel machines is commonly performed via optimisation of a suitable model selection criterion, often based on cross-validation or theoretical performance bounds. However, if there are a large number of kernel parameters, as for instance in the case of automatic relevance determination (ARD), there is a substantial risk of over-fitting the model selection criterion, resulting in poor generalisation performance. In this paper we investigate the possibility of learning the kernel, for the Least-Squares Support Vector Machine (LS-SVM) classifier, at the first level of inference, i.e. parameter optimisation. The kernel parameters and the coefficients of the kernel expansion are jointly optimised at the first level of inference, minimising a training criterion with an additional regularisation term acting on the kernel parameters. The key advantage of this approach is that the values of only two regularisation parameters need be determined in model selection, substantially alleviating the problem of over-fitting the model selection criterion. The benefits of this approach are demonstrated using a suite of synthetic and real-world binary classification benchmark problems, where kernel learning at the first level of inference is shown to be statistically superior to the conventional approach, improves on our previous work (Cawley and Talbot, 2007) and is competitive with Multiple Kernel Learning approaches, but with reduced computational expense.

An efficient method for ectopic beats cancellation based on radial basis function

The analysis of the surface Electrocardiogram (ECG) is the most extended noninvasive technique in cardiological diagnosis. In order to properly use the ECG, we need to cancel out ectopic beats. These beats may occur in both normal subjects and patients with heart disease, and their presence represents an important source of error which must be handled before any other analysis. This paper presents a method for electrocardiogram ectopic beat cancellation based on Radial Basis Function Neural Network (RBFNN). A train-able neural network ensemble approach to develop customized electrocardiogram beat classifier in an effort to further improve the performance of ECG processing and to offer individualized health care is presented. Six types of beats including: Normal Beats (NB); Premature Ventricular Contractions (PVC); Left Bundle Branch Blocks (LBBB); Right Bundle Branch Blocks (RBBB); Paced Beats (PB) and Ectopic Beats (EB) are obtained from the MIT-BIH arrhythmia database. Four morphological features are extracted from each beat after the preprocessing of the selected records. Average Results for the RBFNN based method provided an ectopic beat reduction (EBR) of (mean ± std) EBR = 7, 23 ± 2.18 in contrast to traditional compared methods that, for the best case, yielded EBR = 4.05 ± 2.13. The results prove that RBFNN based methods are able to obtain a very accurate reduction of ectopic beats together with low distortion of the QRST complex.