Fuzzy neural networks and neuro-fuzzy networks: A review the main techniques and applications used in the literature

Fully Scalable Fuzzy Neural Network for Data Processing

The primary objective of the research presented in this article is to introduce an artificial neural network that demands less computational power than a conventional deep neural network. The development of this ANN was achieved through the application of Ordered Fuzzy Numbers (OFNs). In the context of Industry 4.0, there are numerous applications where this solution could be utilized for data processing. It allows the deployment of Artificial Intelligence at the network edge on small devices, eliminating the need to transfer large amounts of data to a cloud server for analysis. Such networks will be easier to implement in small-scale solutions, like those for the Internet of Things, in the future. This paper presents test results where a real system was monitored, and anomalies were detected and predicted.

Review of speed estimation algorithms for three- phase induction motor

In the field of evolving industrial automation, there is a growing need for refined sensorless speed estimation techniques for induction drives to cater the demands of various applications. In this paper, the sensorless speed estimation algorithms for induction motor drives are investigated and reviewed detailly for real-time industrial usages. The main objective of this paper is to classify sensorless techniques by highlighting the characteristics, merits and drawbacks of each sensorless speed estimation techniques of induction motor drives. Different techniques like Rotor slot harmonics, Signal Injection, and Machine model based system have the benefits of sensorless motor drives involving lower costs, higher reliability, simpler hardware complication, improved noise immunity, and lesser maintenance requirement. As a result of the advancement of current industrial automation, more improved sensorless estimation techniques are required to meet application demand. The various speed estimation techniques are distinguished based on criteria of steady state error, dynamic behavior, low speed operation, parameter sensitivity, noise sensitivity, complexity and computation time. This comparison allows to opt the best sensorless speed estimation technique for induction motor drive to be implemented based on a specific application. The results of comparison highlight the characteristics of each technique.

Deep Neuro-Fuzzy System application trends, challenges, and future perspectives: a systematic survey

Deep neural networks (DNN) have remarkably progressed in applications involving large and complex datasets but have been criticized as a black-box. This downside has recently become a motivation for the research community to pursue the ideas of hybrid approaches, resulting in novel hybrid systems classified as deep neuro-fuzzy systems (DNFS). Studies regarding the implementation of DNFS have rapidly increased in the domains of computing, healthcare, transportation, and finance with high interpretability and reasonable accuracy. However, relatively few survey studies have been found in the literature to provide a comprehensive insight into this domain. Therefore, this study aims to perform a systematic review to evaluate the current progress, trends, arising issues, research gaps, challenges, and future scope related to DNFS studies. A study mapping process was prepared to guide a systematic search for publications related to DNFS published between 2015 and 2020 using five established scientific directories. As a result, a total of 105 studies were identified and critically analyzed to address research questions with the objectives: (i) to understand the concept of DNFS; (ii) to find out DNFS optimization methods; (iii) to visualize the intensity of work carried out in DNFS domain; and (iv) to highlight DNFS application subjects and domains. We believe that this study provides up-to-date guidance for future research in the DNFS domain, allowing for more effective advancement in techniques and processes. The analysis made in this review proves that DNFS-based research is actively growing with a substantial implementation and application scope in the future.

Autonomous learning for fuzzy systems: a review

As one of the three pillars in computational intelligence, fuzzy systems are a powerful mathematical tool widely used for modelling nonlinear problems with uncertainties. Fuzzy systems take the form of linguistic IF-THEN fuzzy rules that are easy to understand for human. In this sense, fuzzy inference mechanisms have been developed to mimic human reasoning and decision-making. From a data analytic perspective, fuzzy systems provide an effective solution to build precise predictive models from imprecise data with great transparency and interpretability, thus facilitating a wide range of real-world applications. This paper presents a systematic review of modern methods for autonomously learning fuzzy systems from data, with an emphasis on the structure and parameter learning schemes of mainstream evolving, evolutionary, reinforcement learning-based fuzzy systems. The main purpose of this paper is to introduce the underlying concepts, underpinning methodologies, as well as outstanding performances of the state-of-the-art methods. It serves as a one-stop guide for readers learning the representative methodologies and foundations of fuzzy systems or who desire to apply fuzzy-based autonomous learning in other scientific disciplines and applied fields.

Evolving fuzzy neural classifier that integrates uncertainty from human-expert feedback

Evolving fuzzy neural networks are models capable of solving complex problems in a wide variety of contexts. In general, the quality of the data evaluated by a model has a direct impact on the quality of the results. Some procedures can generate uncertainty during data collection, which can be identified by experts to choose more suitable forms of model training. This paper proposes the integration of expert input on labeling uncertainty into evolving fuzzy neural classifiers (EFNC) in an approach called EFNC-U. Uncertainty is considered in class label input provided by experts, who may not be entirely confident in their labeling or who may have limited experience with the application scenario for which the data is processed. Further, we aimed to create highly interpretable fuzzy classification rules to gain a better understanding of the process and thus to enable the user to elicit new knowledge from the model. To prove our technique, we performed binary pattern classification tests within two application scenarios, cyber invasion and fraud detection in auctions. By explicitly considering class label uncertainty in the update process of the EFNC-U, improved accuracy trend lines were achieved compared to fully (and blindly) updating the classifiers with uncertain data. Integration of (simulated) labeling uncertainty smaller than 20% led to similar accuracy trends as using the original streams (unaffected by uncertainty). This demonstrates the robustness of our approach up to this uncertainty level. Finally, interpretable rules were elicited for a particular application (auction fraud identification) with reduced (and thus readable) antecedent lengths and with certainty values in the consequent class labels. Additionally, an average expected uncertainty of the rules were elicited based on the uncertainty levels in those samples which formed the corresponding rules.

An Explainable Evolving Fuzzy Neural Network to Predict the k Barriers for Intrusion Detection Using a Wireless Sensor Network

Evolving fuzzy neural networks have the adaptive capacity to solve complex problems by interpreting them. This is due to the fact that this type of approach provides valuable insights that facilitate understanding the behavior of the problem being analyzed, because they can extract knowledge from a set of investigated data. Thus, this work proposes applying an evolving fuzzy neural network capable of solving data stream regression problems with considerable interpretability. The dataset is based on a necessary prediction of k barriers with wireless sensors to identify unauthorized persons entering a protected territory. Our method was empirically compared with state-of-the-art evolving methods, showing significantly lower RMSE values for separate test data sets and also lower accumulated mean absolute errors (MAEs) when evaluating the methods in a stream-based interleaved-predict-and-then-update procedure. In addition, the model could offer relevant information in terms of interpretable fuzzy rules, allowing an explainable evaluation of the regression problems contained in the data streams.

Modified generalized neo-fuzzy system with combined online fast learning in medical diagnostic task for situations of information deficit

In the paper, we propose the modified generalized neo-fuzzy system. It is designed to solve the pattern-image recognition task by working with data that are fed to the system in the image form. The neo-fuzzy system can work with small training datasets, where classes can overlap in a features space. The core of the system under consideration is a modification of multidimensional generalized neuro-fuzzy neuron with an additional softmax activation function in the output layer instead of the defuzzification layer and quartic-kernel functions as membership ones. The learning procedure of the system combined cross-entropy criterion optimization using a matrix version of the optimal by speed Kaczmarz-Widrow-Hoff algorithm with the additional filtering (smoothing) properties. In comparison to the well-known systems, the modified neo-fuzzy one provides both numerical and computational implementation simplicity. The computational experiments have proved the effectiveness of the modified generalized neo-fuzzy-neuron, including the situation with shot training datasets.

A Comprehensive Comparison of the Performance of Metaheuristic Algorithms in Neural Network Training for Nonlinear System Identification

Many problems in daily life exhibit nonlinear behavior. Therefore, it is important to solve nonlinear problems. These problems are complex and difficult due to their nonlinear nature. It is seen in the literature that different artificial intelligence techniques are used to solve these problems. One of the most important of these techniques is artificial neural networks. Obtaining successful results with an artificial neural network depends on its training process. In other words, it should be trained with a good training algorithm. Especially, metaheuristic algorithms are frequently used in artificial neural network training due to their advantages. In this study, for the first time, the performance of sixteen metaheuristic algorithms in artificial neural network training for the identification of nonlinear systems is analyzed. It is aimed to determine the most effective metaheuristic neural network training algorithms. The metaheuristic algorithms are examined in terms of solution quality and convergence speed. In the applications, six nonlinear systems are used. The mean-squared error (MSE) is utilized as the error metric. The best mean training error values obtained for six nonlinear systems were 3.5×10−4, 4.7×10−4, 5.6×10−5, 4.8×10−4, 5.2×10−4, and 2.4×10−3, respectively. In addition, the best mean test error values found for all systems were successful. When the results were examined, it was observed that biogeography-based optimization, moth–flame optimization, the artificial bee colony algorithm, teaching–learning-based optimization, and the multi-verse optimizer were generally more effective than other metaheuristic algorithms in the identification of nonlinear systems.

An Intelligent Site Selection Model for Hydrogen Refueling Stations Based on Fuzzy Comprehensive Evaluation and Artificial Neural Network—A Case Study of Shanghai

With the gradual popularization of hydrogen fuel cell vehicles (HFCVs), the construction and planning of hydrogen refueling stations (HRSs) are increasingly important. Taking operational HRSs in China’s coastal and major cities as examples, we consider the main factors affecting the site selection of HRSs in China from the three aspects of economy, technology and society to establish a site selection evaluation system for hydrogen refueling stations and determine the weight of each index through the analytic hierarchy process (AHP). Then, combined with fuzzy comprehensive evaluation (FCE) method and artificial neural network model (ANN), FCE method is used to evaluate HRS in operation in China’s coastal areas and major cities, and we used the resulting data obtained from the comprehensive evaluation as the training data to train the neural network. So, an intelligent site selection model for HRSs based on fuzzy comprehensive evaluation and artificial neural network model (FCE-ANN) is proposed. The planned HRSs in Shanghai are evaluated, and an optimal site selection of the HRS is obtained. The results show that the optimal HRSs site selected by the FCE-ANN model is consistent with the site selection obtained by the FCE method, and the accuracy of the FCE-ANN model is verified. The findings of this study may provide some guidelines for policy makers in planning the hydrogen refueling stations.

Bearing Fault Diagnosis Using Refined Composite Generalized Multiscale Dispersion Entropy-Based Skewness and Variance and Multiclass FCM-ANFIS

Bearing vibration signals typically have nonlinear components due to their interaction and coupling effects, friction, damping, and nonlinear stiffness. Bearing faults affect the signal complexity at various scales. Hence, measuring signal complexity at different scales is helpful to diagnosis of bearing faults. Numerous studies have investigated multiscale algorithms; nevertheless, multiscale algorithms using the first moment lose important complexity data. Accordingly, generalized multiscale algorithms have been recently introduced. The present research examined the use of refined composite generalized multiscale dispersion entropy (RCGMDispEn) based on the second moment (variance) and third moment (skewness) along with refined composite multiscale dispersion entropy (RCMDispEn) in bearing fault diagnosis. Moreover, multiclass FCM-ANFIS, which is a combination of adaptive network-based fuzzy inference systems (ANFIS), was developed to improve the efficiency of rotating machinery fault classification. According to the results, it is recommended that generalized multiscale algorithms based on variance and skewness be examined for diagnosis, along with multiscale algorithms, and be used to achieve an improvement in the results. The simultaneous usage of the multiscale algorithm and generalized multiscale algorithms improved the results in all three real datasets used in this study.

A preliminary study for selecting the appropriate AI-based forecasting model for hospital assets demand under disasters

Purpose

Hospitals recently search for more accurate forecasting systems, given the unpredictable demand and the increasing occurrence of disruptive incidents (mass casualty incidents, pandemics and natural disasters). Besides, the incorporation of automatic inventory and replenishment systems – that hospitals are undertaking – requires developed and accurate forecasting systems. Researchers propose different artificial intelligence (AI)-based forecasting models to predict hospital assets consumption (AC) for everyday activity case and prove that AI-based models generally outperform many forecasting models in this framework. The purpose of this paper is to identify the appropriate AI-based forecasting model(s) for predicting hospital AC under disruptive incidents to improve hospitals' response to disasters/pandemics situations.

Design/methodology/approach

The authors select the appropriate AI-based forecasting models according to the deduced criteria from hospitals' framework analysis under disruptive incidents. Artificial neural network (ANN), recurrent neural network (RNN), adaptive neuro-fuzzy inference system (ANFIS) and learning-FIS (FIS with learning algorithms) are generally compliant with the criteria among many AI-based forecasting methods. Therefore, the authors evaluate their accuracy to predict a university hospital AC under a burn mass casualty incident.

Findings

The ANFIS model is the most compliant with the extracted criteria (autonomous learning capability, fast response, real-time control and interpretability) and provides the best accuracy (the average accuracy is 98.46%) comparing to the other models.

Originality/value

This work contributes to developing accurate forecasting systems for hospitals under disruptive incidents to improve their response to disasters/pandemics situations.

An intelligent Bayesian hybrid approach to help autism diagnosis

This paper proposes a Bayesian hybrid approach based on neural networks and fuzzy systems to construct fuzzy rules to assist experts in detecting features and relations regarding the presence of autism in human beings. The model proposed in this paper works with a database generated through mobile devices that deals with diagnoses of autistic characteristics in human beings who answer a series of questions in a mobile application. The Bayesian model works with the construction of Gaussian fuzzy neurons in the first and logical neurons in the second layer of the model to form a fuzzy inference system connected to an artificial neural network that activates a robust output neuron. The new fuzzy neural network model was compared with traditional state-of-the-art machine learning models based on high-dimensional based on real-world data sets comprising the autism occurrence in children, adults, and adolescents. The results (97.73- Children/94.32-Adolescent/97.28-Adult) demonstrate the efficiency of our new method in determining children, adolescents, and adults with autistic traits (being among the top performers among all ML models tested), can generate knowledge about the dataset through fuzzy rules.

A review on type-2 fuzzy neural networks for system identification

In many engineering problems, the systems dynamics are uncertain, and then, the accurate dynamic modeling is required. Type-2 fuzzy neural networks (T2F-NNs) are extensively used in system identification problems, because of their strong estimation capability. In this paper, the application of T2F-NNs is reviewed and classified. First, an introduction to the principles of system identification, including how to extract data from a system, persistency of excitation, preprocessing of information and data, removal of outlier data, and sorting of data to learn the T2F-NNs, is presented. Then, various learning methods for structure and parameters of the T2F-NNs are reviewed and analyzed. A number of different T2F-NNs that have been used to system identification are reviewed, and their disadvantages and advantages are described. Also, their efficiency in different applications is reviewed. Finally, we will look at the horizon ahead in this issue and analyze its challenges.

Compact Fuzzy Systems Based on Boolean Relations

This document presents some considerations and procedures to design a compact fuzzy system based on Boolean relations. In the design process, a Boolean codification of two elements is extended to a Kleene’s of three elements to perform simplifications for obtaining a compact fuzzy system. The design methodology employed a set of considerations producing equivalent expressions when using Boole and Kleene algebras establishing cases where simplification can be carried out, thus obtaining compact forms. In addition, the development of two compact fuzzy systems based on Boolean relations is shown, presenting its application for the identification of a nonlinear plant and the control of a hydraulic system where it can be seen that compact structures describes satisfactory performance for both identification and control when using algorithms for optimizing the parameters of the compact fuzzy systems. Finally, the applications where compact fuzzy systems are based on Boolean relationships are discussed allowing the observation of other scenarios where these structures can be used.

Fast Probabilistic Neuro-Fuzzy System for Pattern Classification Task

The probabilistic neuro-fuzzy system to solve the image classification-recognition task is proposed. The considered system is a “hybrid” of Specht’s probabilistic neural network and the neuro-fuzzy system of Takagi-Sugeno-Kang. It is designed to solve tasks in case of overlapping classes. Also, it is supposed that the initial data that are fed on the input of the system can be represented in numerical, rank, and nominal (binary) scales. The tuning of the network is implemented with the modified procedure of lazy learning based on the concept “neurons at data points”. Such a learning approach allows substantially reducing the consumption of time and does not require large amounts of training dataset. The proposed system is easy in computational implementation and characterised by a high classification speed, as well as allows processing information both in batch and online mode.

Identification of Heart Sounds with an Interpretable Evolving Fuzzy Neural Network

Heart problems are responsible for the majority of deaths worldwide. The use of intelligent techniques to assist in the identification of existing patterns in these diseases can facilitate treatments and decision making in the field of medicine. This work aims to extract knowledge from a dataset based on heart noise behaviors in order to determine whether heart murmur predilection exists or not in the analyzed patients. A heart murmur can be pathological due to defects in the heart, so the use of an evolving hybrid technique can assist in detecting this comorbidity team, and at the same time, extract knowledge through fuzzy linguistic rules, facilitating the understanding of the nature of the evaluated data. Heart disease detection tests were performed to compare the proposed hybrid model's performance with state of the art for the subject. The results obtained (90.75% accuracy) prove that in addition to great assertiveness in detecting heart murmurs, the evolving hybrid model could be concomitant with the extraction of knowledge from data submitted to an intelligent approach.

Typhoon Quantitative Rainfall Prediction from Big Data Analytics by Using the Apache Hadoop Spark Parallel Computing Framework

Situated in the main tracks of typhoons in the Northwestern Pacific Ocean, Taiwan frequently encounters disasters from heavy rainfall during typhoons. Accurate and timely typhoon rainfall prediction is an imperative topic that must be addressed. The purpose of this study was to develop a Hadoop Spark distribute framework based on big-data technology, to accelerate the computation of typhoon rainfall prediction models. This study used deep neural networks (DNNs) and multiple linear regressions (MLRs) in machine learning, to establish rainfall prediction models and evaluate rainfall prediction accuracy. The Hadoop Spark distributed cluster-computing framework was the big-data technology used. The Hadoop Spark framework consisted of the Hadoop Distributed File System, MapReduce framework, and Spark, which was used as a new-generation technology to improve the efficiency of the distributed computing. The research area was Northern Taiwan, which contains four surface observation stations as the experimental sites. This study collected 271 typhoon events (from 1961 to 2017). The following results were obtained: (1) in machine-learning computation, prediction errors increased with prediction duration in the DNN and MLR models; and (2) the system of Hadoop Spark framework was faster than the standalone systems (single I7 central processing unit (CPU) and single E3 CPU). When complex computation is required in a model (e.g., DNN model parameter calibration), the big-data-based Hadoop Spark framework can be used to establish highly efficient computation environments. In summary, this study successfully used the big-data Hadoop Spark framework with machine learning, to develop rainfall prediction models with effectively improved computing efficiency. Therefore, the proposed system can solve problems regarding real-time typhoon rainfall prediction with high timeliness and accuracy.