A dynamic fuzzy neural filter for separation of discontinuous adventitious sounds from vesicular sounds

This paper presents a recurrent filter that performs real-time separation of discontinuous adventitious sounds from vesicular sounds. The filter uses two Dynamic Fuzzy Neural Networks, operating in parallel, to perform the task of separation of the lung sounds, obtained from patients with pulmonary pathology. Extensive experimental results, including fine/coarse crackles and squawks, are given, and a performance comparison with a series of other models is conducted, underlining the separation capabilities of the proposed filter and its improved performance with respect to its competing rivals.

A stable learning algorithm for block-diagonal recurrent neural networks: application to the analysis of lung sounds

A novel learning algorithm, the Recurrent Neural Network Constrained Optimization Method (RENNCOM) is suggested in this paper, for training block-diagonal recurrent neural networks. The training task is formulated as a constrained optimization problem, whose objective is twofold: (1) minimization of an error measure, leading to successful approximation of the input/output mapping and (2) optimization of an additional functional, the payoff function, which aims at ensuring network stability throughout the learning process. Having assured the network and training stability conditions, the payoff function is switched to an alternative form with the scope to accelerate learning. Simulation results on a benchmark identification problem demonstrate that, compared to other learning schemes with stabilizing attributes, the RENNCOM algorithm has enhanced qualities, including, improved speed of convergence, accuracy and robustness. The proposed algorithm is also applied to the problem of the analysis of lung sounds. Particularly, a filter based on block-diagonal recurrent neural networks is developed, trained with the RENNCOM method. Extensive experimental results are given and performance comparisons with a series of other models are conducted, underlining the effectiveness of the proposed filter.

A Recurrent Fuzzy Network for Fuzzy Temporal Sequence Processing and Gesture Recognition

A fuzzified Takagi-Sugeno-Kang (TSK)-type recurrent fuzzy network (FTRFN) for handling fuzzy temporal information is proposed in this paper. The FTRFN extends our previously proposed network, TRFN, to deal with fuzzy temporal signals represented by Gaussian or triangular fuzzy numbers. In the precondition part of FTRFN, matching degrees between input fuzzy variables and fuzzy antecedent sets is performed by similarity measure. In the TSK-type consequence, a linear combination of fuzzy variables is computed, where two sets of combination coefficients, one for the center and the other for the width of each fuzzy number, are used. Derivation of the linear combination results and final network output is based on left-right fuzzy number operation. There are no rules in FTRFN initially; they are constructed online by concurrent structure and parameter learning, where all free parameters in the precondition/consequence of FTRFN are all tunable. FTRFN can be applied on a variety of domains related to fuzzy temporal information processing. In this paper, it has been applied on one-dimensional and two-dimensional fuzzy temporal sequence prediction and CCD-based temporal gesture recognition. The performance of FTRFN is verified from these examples.

Prediction and Identification Using Wavelet-Based Recurrent Fuzzy Neural Networks

This paper presents a wavelet-based recurrent fuzzy neural network (WRFNN) for prediction and identification of nonlinear dynamic systems. The proposed WRFNN model combines the traditional Takagi-Sugeno-Kang (TSK) fuzzy model and the wavelet neural networks (WNN). This paper adopts the nonorthogonal and compactly supported functions as wavelet neural network bases. Temporal relations embedded in the network are caused by adding some feedback connections representing the memory units into the second layer of the feedforward wavelet-based fuzzy neural networks (WFNN). An online learning algorithm, which consists of structure learning and parameter learning, is also presented. The structure learning depends on the degree measure to obtain the number of fuzzy rules and wavelet functions. Meanwhile, the parameter learning is based on the gradient descent method for adjusting the shape of the membership function and the connection weights of WNN. Finally, computer simulations have demonstrated that the proposed WRFNN model requires fewer adjustable parameters and obtains a smaller rms error than other methods.

A Hybrid of Genetic Algorithm and Particle Swarm Optimization for Recurrent Network Design

An evolutionary recurrent network which automates the design of recurrent neural/fuzzy networks using a new evolutionary learning algorithm is proposed in this paper. This new evolutionary learning algorithm is based on a hybrid of genetic algorithm (GA) and particle swarm optimization (PSO), and is thus called HGAPSO. In HGAPSO, individuals in a new generation are created, not only by crossover and mutation operation as in GA, but also by PSO. The concept of elite strategy is adopted in HGAPSO, where the upper-half of the best-performing individuals in a population are regarded as elites. However, instead of being reproduced directly to the next generation, these elites are first enhanced. The group constituted by the elites is regarded as a swarm, and each elite corresponds to a particle within it. In this regard, the elites are enhanced by PSO, an operation which mimics the maturing phenomenon in nature. These enhanced elites constitute half of the population in the new generation, whereas the other half is generated by performing crossover and mutation operation on these enhanced elites. HGAPSO is applied to recurrent neural/fuzzy network design as follows. For recurrent neural network, a fully connected recurrent neural network is designed and applied to a temporal sequence production problem. For recurrent fuzzy network design, a Takagi-Sugeno-Kang-type recurrent fuzzy network is designed and applied to dynamic plant control. The performance of HGAPSO is compared to both GA and PSO in these recurrent networks design problems, demonstrating its superiority.