51
|
Wu EQ, Zhou M, Hu D, Zhu L, Tang Z, Qiu XY, Deng PY, Zhu LM, Ren H. Self-Paced Dynamic Infinite Mixture Model for Fatigue Evaluation of Pilots' Brains. IEEE TRANSACTIONS ON CYBERNETICS 2022; 52:5623-5638. [PMID: 33284758 DOI: 10.1109/tcyb.2020.3033005] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Current brain cognitive models are insufficient in handling outliers and dynamics of electroencephalogram (EEG) signals. This article presents a novel self-paced dynamic infinite mixture model to infer the dynamics of EEG fatigue signals. The instantaneous spectrum features provided by ensemble wavelet transform and Hilbert transform are extracted to form four fatigue indicators. The covariance of log likelihood of the complete data is proposed to accurately identify similar components and dynamics of the developed mixture model. Compared with its seven peers, the proposed model shows better performance in automatically identifying a pilot's brain workload.
Collapse
|
52
|
An Improved Equilibrium Optimizer with a Decreasing Equilibrium Pool. Symmetry (Basel) 2022. [DOI: 10.3390/sym14061227] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023] Open
Abstract
Big Data is impacting and changing the way we live, and its core lies in the use of machine learning to extract valuable information from huge amounts of data. Optimization problems are a common problem in many steps of machine learning. In the face of complex optimization problems, evolutionary computation has shown advantages over traditional methods. Therefore, many researchers are working on improving the performance of algorithms for solving various optimization problems in machine learning. The equilibrium optimizer (EO) is a member of evolutionary computation and is inspired by the mass balance model in environmental engineering. Using particles and their concentrations as search agents, it simulates the process of finding equilibrium states for optimization. In this paper, we propose an improved equilibrium optimizer (IEO) based on a decreasing equilibrium pool. IEO provides more sources of information for particle updates and maintains a higher population diversity. It can discard some exploration in later stages to enhance exploitation, thus achieving a better search balance. The performance of IEO is verified using 29 benchmark functions from IEEE CEC2017, a dynamic economic dispatch problem, a spacecraft trajectory optimization problem, and an artificial neural network model training problem. In addition, the changes in population diversity and computational complexity brought by the proposed method are analyzed.
Collapse
|
53
|
A survey on dendritic neuron model: Mechanisms, algorithms and practical applications. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2021.08.153] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
54
|
Li T, Qiao C, Wang L, Chen J, Ren Y. An Algorithm for Precipitation Correction in Flood Season Based on Dendritic Neural Network. FRONTIERS IN PLANT SCIENCE 2022; 13:862558. [PMID: 35685003 PMCID: PMC9171397 DOI: 10.3389/fpls.2022.862558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/26/2022] [Accepted: 04/06/2022] [Indexed: 06/15/2023]
Abstract
In recent years, the National Climate Center has developed a dynamic downscaling prediction technology based on the Climate-Weather Research and Forecasting (CWRF) regional climate model and used it for summer precipitation prediction, but there are certain deviations, and it is difficult to predict more accurately. The CWRF model simulates the summer precipitation forecast data from 1996 to 2019 and uses a combination of dendrite net (DD) and artificial neural networks (ANNs) to conduct a comparative analysis of summer precipitation correction techniques. While summarizing the characteristics and current situation of summer precipitation in the whole country, the meteorological elements related to precipitation are analyzed. CWRF is used to simulate summer precipitation and actual observation precipitation data to establish a model to correct the precipitation. By comparing with the measured data of the ground station after quality control, the relevant evaluation index analysis is used to determine the best revised model. The results show that the correction effect based on the dendritic neural network algorithm is better than the CWRF historical return, in which, the anomaly correlation coefficient (ACC) and the temporal correlation coefficient (TCC) both increased by 0.1, the mean square error (MSE) dropped by about 26%, and the overall trend anomaly (Ps) test score was also improved, showing that the machine learning algorithms can correct the summer precipitation in the CWRF regional climate model to a certain extent and improve the accuracy of weather forecasts.
Collapse
Affiliation(s)
- Tao Li
- School of Artificial Intelligence, Nanjing University of Information Science and Technology, Nanjing, China
| | - Chenwei Qiao
- School of Artificial Intelligence, Nanjing University of Information Science and Technology, Nanjing, China
| | - Lina Wang
- School of Artificial Intelligence, Nanjing University of Information Science and Technology, Nanjing, China
| | - Jie Chen
- School of Electronics and Information Engineering, Nanjing University of Information Science and Technology, Nanjing, China
| | - Yongjun Ren
- School of Computer Software, Nanjing University of Information Science and Technology, Nanjing, China
| |
Collapse
|
55
|
Single Neuron for Solving XOR like Nonlinear Problems. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:9097868. [PMID: 35652062 PMCID: PMC9148856 DOI: 10.1155/2022/9097868] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2021] [Revised: 03/24/2022] [Accepted: 04/13/2022] [Indexed: 11/18/2022]
Abstract
XOR is a special nonlinear problem in artificial intelligence (AI) that resembles multiple real-world nonlinear data distributions. A multiplicative neuron model can solve these problems. However, the multiplicative model has the indigenous problem of backpropagation for densely distributed XOR problems and higher dimensional parity problems. To overcome this issue, we have proposed an enhanced translated multiplicative single neuron model. It can provide desired tessellation surface. We have considered an adaptable scaling factor associated with each input in our proposed model. It helps in achieving optimal scaling factor value for higher dimensional input. The efficacy of the proposed model has been tested by randomly increasing input dimensions for XOR-type data distribution. The proposed model has crisply classified even higher dimensional input in their respective class. Also, the computational complexity is the same as that of the previous multiplicative neuron model. It has shown more than an 80% reduction in absolute loss as compared to the previous neuron model in similar experimental conditions. Therefore, it can be considered as a generalized artificial model (single neuron) with the capability of solving XOR-like real problems.
Collapse
|
56
|
Research on SVR Water Quality Prediction Model Based on Improved Sparrow Search Algorithm. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:7327072. [PMID: 35528335 PMCID: PMC9071992 DOI: 10.1155/2022/7327072] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/19/2021] [Revised: 02/24/2022] [Accepted: 03/14/2022] [Indexed: 11/17/2022]
Abstract
Multiparameter water quality trend prediction technique is one of the important tools for water environment management and regulation. This study proposes a new water quality prediction model with better prediction performance, which is combined with improved sparrow search algorithm (ISSA) and support vector regression (SVR) machine. For the problems of low population diversity and easily falling into local optimum of sparrow search algorithm (SSA), ISSA is proposed to increase the initial population diversity by introducing Skew-Tent mapping and to help the algorithm jump out of local optimum by using the adaptive elimination mechanism. The optimal values of the penalty factor C and kernel function parameter g of the SVR model are selected using ISSA to make the model have better prediction accuracy and generalization performance. The performance of the ISSA-SVR water quality prediction model is compared with BP neural network, SVR model, and other hybrid models by conducting water quality prediction experiments with actual breeding-water quality data. The experimental results showed that the prediction accuracy of the ISSA-SVR model was significantly higher than that of other models, reaching 99.2%; the mean square deviation (MSE) was 0.013, which was 79.37% lower than that of the SVR model and 75% lower than that of SSA-SVR model, and the coefficient of determination (R2) was 0.98, which was 5.38% higher than that of the SVR model and 7.57% higher than that of the SSA-SVR model, indicating that the ISSA-SVR water quality prediction model has some engineering application value in the field of water body management.
Collapse
|
57
|
Dynamic and Static Features-Aware Recommendation with Graph Neural Networks. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:5484119. [PMID: 35498210 PMCID: PMC9050307 DOI: 10.1155/2022/5484119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/16/2022] [Revised: 03/27/2022] [Accepted: 03/28/2022] [Indexed: 11/21/2022]
Abstract
Recommender systems are designed to deal with structured and unstructured information and help the user effectively retrieve needed information from the vast number of web pages. Dynamic information of users has been proven useful for learning representations in the recommender system. In this paper, we construct a series of dynamic subgraphs that include the user and item interaction pairs and the temporal information. Then, the dynamic features and the long- and short-term information of users are integrated into the static recommendation model. The proposed model is called dynamic and static features-aware graph recommendation, which can model unstructured graph information and structured tabular data. Particularly, two elaborately designed modules are available: dynamic preference learning and dynamic sequence learning modules. The former uses all user-item interactions and the last dynamic subgraph to model the dynamic interaction preference of the user. The latter captures the dynamic features of users and items by tracking the preference changes of users over time. Extensive experiments on two publicly available datasets show that the proposed model outperforms several compelling state-of-the-art baselines.
Collapse
|
58
|
A novel in-depth analysis approach for domain-specific problems based on multidomain data. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2021.12.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
59
|
Guo ZH, Chen ZH, You ZH, Wang YB, Yi HC, Wang MN. A learning-based method to predict LncRNA-disease associations by combining CNN and ELM. BMC Bioinformatics 2022; 22:622. [PMID: 35317723 PMCID: PMC8941737 DOI: 10.1186/s12859-022-04611-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2021] [Accepted: 10/07/2021] [Indexed: 11/10/2022] Open
Abstract
Background lncRNAs play a critical role in numerous biological processes and life activities, especially diseases. Considering that traditional wet experiments for identifying uncovered lncRNA-disease associations is limited in terms of time consumption and labor cost. It is imperative to construct reliable and efficient computational models as addition for practice. Deep learning technologies have been proved to make impressive contributions in many areas, but the feasibility of it in bioinformatics has not been adequately verified. Results In this paper, a machine learning-based model called LDACE was proposed to predict potential lncRNA-disease associations by combining Extreme Learning Machine (ELM) and Convolutional Neural Network (CNN). Specifically, the representation vectors are constructed by integrating multiple types of biology information including functional similarity and semantic similarity. Then, CNN is applied to mine both local and global features. Finally, ELM is chosen to carry out the prediction task to detect the potential lncRNA-disease associations. The proposed method achieved remarkable Area Under Receiver Operating Characteristic Curve of 0.9086 in Leave-one-out cross-validation and 0.8994 in fivefold cross-validation, respectively. In addition, 2 kinds of case studies based on lung cancer and endometrial cancer indicate the robustness and efficiency of LDACE even in a real environment. Conclusions Substantial results demonstrated that the proposed model is expected to be an auxiliary tool to guide and assist biomedical research, and the close integration of deep learning and biology big data will provide life sciences with novel insights.
Collapse
Affiliation(s)
- Zhen-Hao Guo
- School of Electronics and Information Engineering, Tongji University, No. 4800 Cao'an Road, Shanghai, 201804, China
| | - Zhan-Heng Chen
- College of Computer Science and Engineering, Shenzhen University, Shenzhen, 518060, China.
| | - Zhu-Hong You
- School of Computer Science, Northwestern Polytechnical University, Xi'an, 710129, China
| | - Yan-Bin Wang
- College of Information Science and Engineering, Zaozhuang University, Zaozhuang, 277100, Shandong, China.
| | - Hai-Cheng Yi
- Xinjiang Technical Institute of Physics and Chemistry, Chinese Academy of Sciences, Urumqi, 830011, China.,University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Mei-Neng Wang
- School of Mathematics and Computer Science, Yichun University, Yichun, 336000, Jiangxi, China
| |
Collapse
|
60
|
|
61
|
Anomaly detection of industrial multi-sensor signals based on enhanced spatiotemporal features. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07101-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
62
|
Zuo K, Zuo H. A new fractional modified exponential curve model and its applications. COMMUN STAT-THEOR M 2022. [DOI: 10.1080/03610926.2022.2042026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Affiliation(s)
- Kai Zuo
- School of Mathematics, Chengdu Normal University, Chengdu, China
| | - Hang Zuo
- School of Mathematics, Chengdu Normal University, Chengdu, China
| |
Collapse
|
63
|
Luo X, Liu Z, Jin L, Zhou Y, Zhou M. Symmetric Nonnegative Matrix Factorization-Based Community Detection Models and Their Convergence Analysis. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:1203-1215. [PMID: 33513110 DOI: 10.1109/tnnls.2020.3041360] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Community detection is a popular yet thorny issue in social network analysis. A symmetric and nonnegative matrix factorization (SNMF) model based on a nonnegative multiplicative update (NMU) scheme is frequently adopted to address it. Current research mainly focuses on integrating additional information into it without considering the effects of a learning scheme. This study aims to implement highly accurate community detectors via the connections between an SNMF-based community detector's detection accuracy and an NMU scheme's scaling factor. The main idea is to adjust such scaling factor via a linear or nonlinear strategy, thereby innovatively implementing several scaling-factor-adjusted NMU schemes. They are applied to SNMF and graph-regularized SNMF models to achieve four novel SNMF-based community detectors. Theoretical studies indicate that with the proposed schemes and proper hyperparameter settings, each model can: 1) keep its loss function nonincreasing during its training process and 2) converge to a stationary point. Empirical studies on eight social networks show that they achieve significant accuracy gain in community detection over the state-of-the-art community detectors.
Collapse
|
64
|
Tan Z, Chen J, Kang Q, Zhou M, Abusorrah A, Sedraoui K. Dynamic Embedding Projection-Gated Convolutional Neural Networks for Text Classification. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:973-982. [PMID: 33417564 DOI: 10.1109/tnnls.2020.3036192] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Text classification is a fundamental and important area of natural language processing for assigning a text into at least one predefined tag or category according to its content. Most of the advanced systems are either too simple to get high accuracy or centered on using complex structures to capture the genuinely required category information, which requires long time to converge during their training stage. In order to address such challenging issues, we propose a dynamic embedding projection-gated convolutional neural network (DEP-CNN) for multi-class and multi-label text classification. Its dynamic embedding projection gate (DEPG) transforms and carries word information by using gating units and shortcut connections to control how much context information is incorporated into each specific position of a word-embedding matrix in a text. To our knowledge, we are the first to apply DEPG over a word-embedding matrix. The experimental results on four known benchmark datasets display that DEP-CNN outperforms its recent peers.
Collapse
|
65
|
Experimental Study on Support Vector Machine-Based Early Detection for Sensor Faults and Operator-Based Robust Fault Tolerant Control. MACHINES 2022. [DOI: 10.3390/machines10020123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
Considering sensor faults for a thermoelectric cooler actuated by Peltier devices, this work proposes an operator-based robust nonlinear fault tolerant controller (FTC) integrated with early fault detection using a support vector machine (SVM). Firstly, a physical model is formulated based on the law of heat transfer, and the estimated model is derived based on Volterra identification. Then, an operator-based robust nonlinear control system is employed to compensate for uncertainties and to eliminate the effects of coupling. Furthermore, FTC integrated with SVM-based early fault detection is designed to improve the safety performance in the case of sensor faults. The simulation results indicate that SVM-based fault detection can shorten the detection time in comparison to the conventional method without the SVM classier. The experiment results are utilized to verify the tracking performance of the proposed FTC method in the case study.
Collapse
|
66
|
Analytical Energy Model Parametrized by Workload, Clock Frequency and Number of Active Cores for Share-Memory High-Performance Computing Applications. ENERGIES 2022. [DOI: 10.3390/en15031213] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
Energy consumption is crucial in high-performance computing (HPC), especially to enable the next exascale generation. Hence, modern systems implement various hardware and software features for power management. Nonetheless, due to numerous different implementations, we can always push the limits of software to achieve the most efficient use of our hardware. To be energy efficient, the software relies on dynamic voltage and frequency scaling (DVFS), as well as dynamic power management (DPM). Yet, none have privileged information on the hardware architecture and application behavior, which may lead to energy-inefficient software operation. This study proposes analytical modeling for architecture and application behavior that can be used to estimate energy-optimal software configurations and provide knowledgeable hints to improve DVFS and DPM techniques for single-node HPC applications. Additionally, model parameters, such as the level of parallelism and dynamic power, provide insights into how the modeled application consumes energy, which can be helpful for energy-efficient software development and operation. This novel analytical model takes the number of active cores, the operating frequencies, and the input size as inputs to provide energy consumption estimation. We present the modeling of 13 parallel applications employed to determine energy-optimal configurations for several different input sizes. The results show that up to 70% of energy could be saved in the best scenario compared to the default Linux choice and 14% on average. We also compare the proposed model with standard machine-learning modeling concerning training overhead and accuracy. The results show that our approach generates about 10 times less energy overhead for the same level of accuracy.
Collapse
|
67
|
Ma L, Ma Y, Lin Q, Ji J, Coello CAC, Gong M. SNEGAN: Signed Network Embedding by Using Generative Adversarial Nets. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE 2022. [DOI: 10.1109/tetci.2020.3035937] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
68
|
A Task Allocation Strategy of the UAV Swarm Based on Multi-Discrete Wolf Pack Algorithm. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12031331] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
With the continuous development of artificial intelligence, swarm control and other technologies, the application of Unmanned Aerial Vehicles (UAVs) in the battlefield is more and more extensive, and the UAV swarm is increasingly playing a prominent role in the future of warfare. How tasks are assigned in the dynamic and complex battlefield environment is very important. This paper proposes a task assignment model and its objective function based on dynamic information convergence. In order to resolve this multidimensional function, the Wolf Pack Algorithm (WPA) is selected as the alternative optimization algorithm. This is because its functional optimization of high-dimensional complex problems is better than other intelligent algorithms, and the fact that it is more suitable for UAV swarm task allocation scenarios. Based on the traditional WPA algorithm, this paper proposes a Multi-discrete Wolf Pack Algorithm (MDWPA) to solve the UAV task assignment problem in a complex environment through the discretization of wandering, calling, sieging behavior, and new individual supplement. Through Orthogonal Experiment Design (OED) and analysis of variance, the results show that MDWPA performs with better accuracy, robustness, and convergence rate and can effectively solve the task assignment problem of UAVs in a complex dynamic environment.
Collapse
|
69
|
Cooperative particle swarm optimizer with depth first search strategy for global optimization of multimodal functions. APPL INTELL 2022. [DOI: 10.1007/s10489-021-03005-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
70
|
Zhao F, Hu X, Wang L, Zhao J, Tang J, Jonrinaldi. A reinforcement learning brain storm optimization algorithm (BSO) with learning mechanism. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2021.107645] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
71
|
|
72
|
Abstract
In recent years, the dendritic neural model has been widely employed in various fields because of its simple structure and inexpensive cost. Traditional numerical optimization is ineffective for the parameter optimization problem of the dendritic neural model; it is easy to fall into local in the optimization process, resulting in poor performance of the model. This paper proposes an intelligent dendritic neural model firstly, which uses the intelligent optimization algorithm to optimize the model instead of the traditional dendritic neural model with a backpropagation algorithm. The experiment compares the performance of ten representative intelligent optimization algorithms in six classification datasets. The optimal combination of user-defined parameters for the model evaluates by using Taguchi’s method, systemically. The results show that the performance of an intelligent dendritic neural model is significantly better than a traditional dendritic neural model. The intelligent dendritic neural model has small classification errors and high accuracy, which provides an effective approach for the application of dendritic neural model in engineering classification problems. In addition, among ten intelligent optimization algorithms, an evolutionary algorithm called biogeographic optimization algorithm has excellent performance, and can quickly obtain high-quality solutions and excellent convergence speed.
Collapse
|
73
|
Luo X, Wu H, Wang Z, Wang J, Meng D. A Novel Approach to Large-Scale Dynamically Weighted Directed Network Representation. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2021; PP:9756-9773. [PMID: 34898429 DOI: 10.1109/tpami.2021.3132503] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
A dynamically weighted directed network (DWDN) is frequently encountered in various big data-related applications like a terminal interaction pattern analysis system (TIPAS) concerned in this study. It consists of large-scale dynamic interactions among numerous nodes. As the involved nodes increase drastically, it becomes impossible to observe their full interactions at each time slot, making a resultant DWDN High Dimensional and Incomplete (HDI). An HDI DWDN, in spite of its incompleteness, contains rich knowledge regarding involved nodes various behavior patterns. To extract such knowledge from an HDI DWDN, this paper proposes a novel Alternating direction method of multipliers (ADMM)-based Nonnegative Latent-factorization of Tensors (ANLT) model. It adopts three-fold ideas: a) building a data density-oriented augmented Lagrangian function for efficiently handling an HDI tensors incompleteness and nonnegativity; b) splitting the optimization task in each iteration into an elaborately designed subtask series where each one is solved based on the previously solved ones following the ADMM principle to achieve fast convergence; and c) theoretically proving that its convergence is guaranteed with its efficient learning scheme. Experimental results on six DWDNs from real applications demonstrate that the proposed ANLT outperforms state-of-the-art models significantly in both computational efficiency and prediction accuracy.
Collapse
|
74
|
Yu J, You X, Liu S. A heterogeneous guided ant colony algorithm based on space explosion and long–short memory. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107991] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
75
|
Dendritic neuron model trained by information feedback-enhanced differential evolution algorithm for classification. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107536] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
76
|
An J, Liu F, Shen F, Zhao J, Li R, Gao K. IC neuron: An efficient unit to construct neural networks. Neural Netw 2021; 145:177-188. [PMID: 34763244 DOI: 10.1016/j.neunet.2021.10.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2020] [Revised: 05/19/2021] [Accepted: 10/04/2021] [Indexed: 11/24/2022]
Abstract
As a popular machine learning method, neural networks can be used to solve many complex tasks. Their strong generalization ability comes from the representation ability of the basic neuron models. The most popular neuron model is the McCulloch-Pitts (MP) neuron, which uses a simple transformation to process the input signal. A common trend is to use the MP neuron to design various neural networks. However, the optimization of the neuron structure is rarely considered. Inspired by the elastic collision model in physics, we propose a new neuron model that can represent more complex distributions. We term it the Inter-layer Collision (IC) neuron which divides the input space into multiple subspaces to represent different linear transformations. Through this operation, the IC neuron enhances the non-linear representation ability and emphasizes useful input features for a given task. We build the IC networks by integrating the IC neurons into the fully-connected, the convolutional, and the recurrent structures. The IC networks outperform the traditional neural networks in a wide range of tasks. Besides, we combine the IC neuron with deep learning models and show the superiority of the IC neuron. Our research proves that the IC neuron can be an effective basic unit to build network structures and make the network performance better.
Collapse
Affiliation(s)
- Junyi An
- State Key Laboratory for Novel Software Technology, Nanjing University, China; Department of Computer Science and Technology, Nanjing University, China.
| | - Fengshan Liu
- State Key Laboratory for Novel Software Technology, Nanjing University, China; Department of Computer Science and Technology, Nanjing University, China.
| | - Furao Shen
- State Key Laboratory for Novel Software Technology, Nanjing University, China; Department of Computer Science and Technology, Nanjing University, China.
| | - Jian Zhao
- School of Electronic Science and Engineering, Nanjing University, China.
| | - Ruotong Li
- State Key Laboratory for Novel Software Technology, Nanjing University, China; School of Artificial Intelligence, Nanjing University, China.
| | - Kepan Gao
- State Key Laboratory for Novel Software Technology, Nanjing University, China; Department of Computer Science and Technology, Nanjing University, China.
| |
Collapse
|
77
|
Wang W, Tian G, Zhang H, Xu K, Miao Z. Modeling and scheduling for remanufacturing systems with disassembly, reprocessing, and reassembly considering total energy consumption. ENVIRONMENTAL SCIENCE AND POLLUTION RESEARCH INTERNATIONAL 2021:10.1007/s11356-021-17292-x. [PMID: 34767174 DOI: 10.1007/s11356-021-17292-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2021] [Accepted: 10/27/2021] [Indexed: 06/13/2023]
Abstract
As one of the mainstream development directions of remanufacturing industry, remanufacturing system scheduling has become a hot research topic recently. This study regards a scheduling problem for remanufacturing systems where end-of-life (EOL) products are firstly disassembled into their constituent components, and next these components are reprocessed to like-new states. At last, the reprocessed components are reassembled into new remanufactured products. Among various system configurations, we investigate a scheduling problem for the one with parallel disassembly workstations, several parallel flow-shop-type reprocessing lines and parallel reassembly workstations for the objective of minimize total energy consumption. To address this problem, a mathematical model is established and an improved genetic algorithm (IMGA) is proposed to solve it due to the problem complexity. The proposed IMGA adopts a hybrid initialization method to improve the solution quality and diversity at the beginning. Crossover operation and mutation operation are specially designed subject to the characteristics of the optimization problem. Besides, an elite strategy is combined to gain a faster convergence speed. Numerical experiments are conducted and the results verify the effectiveness of the scheduling model and proposed algorithm. The work can assist production managers in better planning a scheduling scheme for remanufacturing systems.
Collapse
Affiliation(s)
- Wenjie Wang
- Key Laboratory of High Efficiency and Clean Mechanical Manufacture (Ministry of Education), National Demonstration Center for Experimental Mechanical Engineering Education School of Mechanical Engineering, Shandong University, Jinan, 250061, People's Republic of China
- State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin, 150001, People's Republic of China
| | - Guangdong Tian
- Key Laboratory of High Efficiency and Clean Mechanical Manufacture (Ministry of Education), National Demonstration Center for Experimental Mechanical Engineering Education School of Mechanical Engineering, Shandong University, Jinan, 250061, People's Republic of China.
- State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin, 150001, People's Republic of China.
| | - Honghao Zhang
- Key Laboratory of High Efficiency and Clean Mechanical Manufacture (Ministry of Education), National Demonstration Center for Experimental Mechanical Engineering Education School of Mechanical Engineering, Shandong University, Jinan, 250061, People's Republic of China
- State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin, 150001, People's Republic of China
| | - Kangkang Xu
- School of Electromechanical Engineering, Guangdong University of Technology, Guangzhou, 510006, People's Republic of China
| | - Zheng Miao
- Qinghai Huasheng Ferroalloy Smelting Co., Ltd., Xining, 810000, People's Republic of China
| |
Collapse
|
78
|
Liu Y, Qiu T, Wang J, Qi W. A Nighttime Vehicle Detection Method with Attentive GAN for Accurate Classification and Regression. ENTROPY 2021; 23:e23111490. [PMID: 34828188 PMCID: PMC8624689 DOI: 10.3390/e23111490] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/09/2021] [Revised: 11/08/2021] [Accepted: 11/08/2021] [Indexed: 11/16/2022]
Abstract
Vehicle detection plays a vital role in the design of Automatic Driving System (ADS), which has achieved remarkable improvements in recent years. However, vehicle detection in night scenes still has considerable challenges for the reason that the vehicle features are not obvious and are easily affected by complex road lighting or lights from vehicles. In this paper, a high-accuracy vehicle detection algorithm is proposed to detect vehicles in night scenes. Firstly, an improved Generative Adversarial Network (GAN), named Attentive GAN, is used to enhance the vehicle features of nighttime images. Then, with the purpose of achieving a higher detection accuracy, a multiple local regression is employed in the regression branch, which predicts multiple bounding box offsets. An improved Region of Interest (RoI) pooling method is used to get distinguishing features in a classification branch based on Faster Region-based Convolutional Neural Network (R-CNN). Cross entropy loss is introduced to improve the accuracy of classification branch. The proposed method is examined with the proposed dataset, which is composed of the selected nighttime images from BDD-100k dataset (Berkeley Diverse Driving Database, including 100,000 images). Compared with a series of state-of-the-art detectors, the experiments demonstrate that the proposed algorithm can effectively contribute to vehicle detection accuracy in nighttime.
Collapse
Affiliation(s)
- Yan Liu
- Correspondence: ; Tel.: +86-136-638-69878
| | | | | | | |
Collapse
|
79
|
Ji J, Tang Y, Ma L, Li J, Lin Q, Tang Z, Todo Y. Accuracy Versus Simplification in an Approximate Logic Neural Model. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:5194-5207. [PMID: 33156795 DOI: 10.1109/tnnls.2020.3027298] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
An approximate logic neural model (ALNM) is a novel single-neuron model with plastic dendritic morphology. During the training process, the model can eliminate unnecessary synapses and useless branches of dendrites. It will produce a specific dendritic structure for a particular task. The simplified structure of ALNM can be substituted by a logic circuit classifier (LCC) without losing any essential information. The LCC merely consists of the comparator and logic NOT, AND, and OR gates. Thus, it can be easily implemented in hardware. However, the architecture of ALNM affects the learning capacity, generalization capability, computing time and approximation of LCC. Thus, a Pareto-based multiobjective differential evolution (MODE) algorithm is proposed to simultaneously optimize ALNM's topology and weights. MODE can generate a concise and accurate LCC for every specific task from ALNM. To verify the effectiveness of MODE, extensive experiments are performed on eight benchmark classification problems. The statistical results demonstrate that MODE is superior to conventional learning methods, such as the backpropagation algorithm and single-objective evolutionary algorithms. In addition, compared against several commonly used classifiers, both ALNM and LCC are capable of obtaining promising and competitive classification performances on the benchmark problems. Besides, the experimental results also verify that the LCC obtains the faster classification speed than the other classifiers.
Collapse
|
80
|
Melek M, Melek N. Roza: a new and comprehensive metric for evaluating classification systems. Comput Methods Biomech Biomed Engin 2021; 25:1015-1027. [PMID: 34693834 DOI: 10.1080/10255842.2021.1995721] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Many metrics such as accuracy rate (ACC), area under curve (AUC), Jaccard index (JI), and Cohen's kappa coefficient are available to measure the success of the system in pattern recognition and machine/deep learning systems. However, the superiority of one system to one other cannot be determined based on the mentioned metrics. This is because such a system can be successful using one metric, but not the other ones. Moreover, such metrics are insufficient when the number of samples in the classes is unequal (imbalanced data). In this case, naturally, by using these metrics, a sensible comparison cannot be made between two given systems. In the present study, the comprehensive, fair, and accurate Roza (Roza means rose in Persian. When different permutations of the metrics used are superimposed in a polygon format, it looks like a flower, so we named it Roza.) metric is introduced for evaluating classification systems. This metric, which facilitates the comparison of systems, expresses the summary of many metrics with a single value. To verify the stability and validity of the metric and to conduct a comprehensive, fair, and accurate comparison between the systems, the Roza metric of the systems tested under the same conditions are calculated and comparisons are made. For this, systems tested with three different strategies on three different datasets are considered. The results show that the performance of the system can be summarized by a single value and the Roza metric can be used in all systems that include classification processes, as a powerful metric.
Collapse
Affiliation(s)
- Mesut Melek
- Department of Electronics and Automation, Gumushane University, Gumushane, Turkey
| | - Negin Melek
- Faculty of Engineering, Department of Electrical and Electronics Engineering, Avrasya University, Trabzon, Turkey
| |
Collapse
|
81
|
Yang J, Zhang Y, Wang Z, Todo Y, Lu B, Gao S. A Cooperative Coevolution Wingsuit Flying Search Algorithm with Spherical Evolution. INT J COMPUT INT SYS 2021. [DOI: 10.1007/s44196-021-00030-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
AbstractThe algorithm wingsuit flying search (WFS) mimics the procedure of landing the vehicle. The outstanding feature of WFS is parameterless and of rapid convergence. However, WFS also has its shortcomings, sometimes it will inevitably be trapped into local optima, thereby yield inferior solutions owing to its relatively weak exploration ability. Spherical evolution (SE) adopts a novel spherical search pattern that takes aim at splendid search ability. Cooperative coevolution is a useful parallel structure for reconciling algorithmic performance. Considering the complementary strengths of both algorithms, we herein propose a new hybrid algorithm that is comprised of SE and WFS using cooperative coevolution. During the search for optimal solutions in WFS, we replaced the original search matrix and introduced the spherical mechanism of SE, in parallel with coevolution to enhance the competitiveness of the population. The two distinct search dynamics were combined in a parallel and coevolutionary way, thereby getting a good search performance. The resultant hybrid algorithm, CCWFSSE, was tested on the CEC2017 benchmark set and 22 CEC 2011 real-world problems. The experimental data obtained can verify that CCWFSSE outperforms other algorithms in aspects of effectiveness and robustness.
Collapse
|
82
|
Pan Z, Wang Y, Yuan X, Yang C, Gui W. A classification-driven neuron-grouped SAE for feature representation and its application to fault classification in chemical processes. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107350] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
83
|
Dong LJ, Zhang HB, Shi Q, Lei Q, Du JX, Gao S. Learning and fusing multiple hidden substages for action quality assessment. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107388] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
|
84
|
A wireless sensor node deployment scheme based on embedded virtual force resampling particle swarm optimization algorithm. APPL INTELL 2021. [DOI: 10.1007/s10489-021-02745-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
85
|
Predicting personalized grouping and consumption: A collaborative evolution model. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.107248] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
86
|
A seasonal-trend decomposition-based dendritic neuron model for financial time series prediction. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107488] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
87
|
|
88
|
Wang G, Jia QS, Qiao J, Bi J, Zhou M. Deep Learning-Based Model Predictive Control for Continuous Stirred-Tank Reactor System. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:3643-3652. [PMID: 32903185 DOI: 10.1109/tnnls.2020.3015869] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
A continuous stirred-tank reactor (CSTR) system is widely applied in wastewater treatment processes. Its control is a challenging industrial-process-control problem due to great difficulty to achieve accurate system identification. This work proposes a deep learning-based model predictive control (DeepMPC) to model and control the CSTR system. The proposed DeepMPC consists of a growing deep belief network (GDBN) and an optimal controller. First, GDBN can automatically determine its size with transfer learning to achieve high performance in system identification, and it serves just as a predictive model of a controlled system. The model can accurately approximate the dynamics of the controlled system with a uniformly ultimately bounded error. Second, quadratic optimization is conducted to obtain an optimal controller. This work analyzes the convergence and stability of DeepMPC. Finally, the DeepMPC is used to model and control a second-order CSTR system. In the experiments, DeepMPC shows a better performance in modeling, tracking, and antidisturbance than the other state-of-the-art methods.
Collapse
|
89
|
Yu H, Wang T. A Method for Real-Time Fault Detection of Liquid Rocket Engine Based on Adaptive Genetic Algorithm Optimizing Back Propagation Neural Network. SENSORS 2021; 21:s21155026. [PMID: 34372263 PMCID: PMC8347358 DOI: 10.3390/s21155026] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Revised: 07/21/2021] [Accepted: 07/21/2021] [Indexed: 11/22/2022]
Abstract
A real-time fault diagnosis method utilizing an adaptive genetic algorithm to optimize a back propagation (BP) neural network is intended to achieve real-time fault detection of a liquid rocket engine (LRE). In this paper, the authors employ an adaptive genetic algorithm to optimize a BP neural network, produce real-time predictions regarding sensor data, compare the projected value to the actual data collected, and determine whether the engine is malfunctioning using a threshold judgment mechanism. The proposed fault detection method is simulated and verified using data from a certain type of liquid hydrogen and liquid oxygen rocket engine. The experiment results show that this method can effectively diagnose this liquid hydrogen and liquid oxygen rocket engine in real-time. The proposed method has higher system sensitivity and robustness compared with the results obtained from a single BP neural network model and a BP neural network model optimized by a traditional genetic algorithm (GA), and the method has engineering application value.
Collapse
|
90
|
Analysis of Human Behavior by Mining Textual Data: Current Research Topics and Analytical Techniques. Symmetry (Basel) 2021. [DOI: 10.3390/sym13071276] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
The goal of this study was to conduct a literature review of current approaches and techniques for identifying, understanding, and predicting human behaviors through mining a variety of sources of textual data with a focus on enabling classification of psychological behaviors regarding emotion, cognition, and social empathy. This review was performed using keyword searches in ISI Web of Science, Engineering Village Compendex, ProQuest Dissertations, and Google Scholar. Our findings show that, despite recent advancements in predicting human behaviors based on unstructured textual data, significant developments in data analytics systems for identification, determination of interrelationships, and prediction of human cognitive, emotional and social behaviors remain lacking.
Collapse
|
91
|
Jiang CS, Liang GQ. Modeling shear strength of medium- to ultra-high-strength concrete beams with stirrups using SVR and genetic algorithm. Soft comput 2021. [DOI: 10.1007/s00500-021-06027-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
92
|
Wang X, Kang Q, Zhou M, Pan L, Abusorrah A. Multiscale Drift Detection Test to Enable Fast Learning in Nonstationary Environments. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:3483-3495. [PMID: 32544055 DOI: 10.1109/tcyb.2020.2989213] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
A model can be easily influenced by unseen factors in nonstationary environments and fail to fit dynamic data distribution. In a classification scenario, this is known as a concept drift. For instance, the shopping preference of customers may change after they move from one city to another. Therefore, a shopping website or application should alter recommendations based on its poorer predictions of such user patterns. In this article, we propose a novel approach called the multiscale drift detection test (MDDT) that efficiently localizes abrupt drift points when feature values fluctuate, meaning that the current model needs immediate adaption. MDDT is based on a resampling scheme and a paired student t -test. It applies a detection procedure on two different scales. Initially, the detection is performed on a broad scale to check if recently gathered drift indicators remain stationary. If a drift is claimed, a narrow scale detection is performed to trace the refined change time. This multiscale structure reduces the massive time of constantly checking and filters noises in drift indicators. Experiments are performed to compare the proposed method with several algorithms via synthetic and real-world datasets. The results indicate that it outperforms others when abrupt shift datasets are handled, and achieves the highest recall score in localizing drift points.
Collapse
|
93
|
Neural network-crow search model for the prediction of functional properties of nano TiO 2 coated cotton composites. Sci Rep 2021; 11:13649. [PMID: 34211049 PMCID: PMC8249465 DOI: 10.1038/s41598-021-93108-9] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2021] [Accepted: 06/21/2021] [Indexed: 01/22/2023] Open
Abstract
This paper presents a new hybrid approach for the prediction of functional properties i.e., self-cleaning efficiency, antimicrobial efficiency and ultraviolet protection factor (UPF), of titanium dioxide nanoparticles (TiO2 NPs) coated cotton fabric. The proposed approach is based on feedforward artificial neural network (ANN) model called a multilayer perceptron (MLP), trained by an optimized algorithm known as crow search algorithm (CSA). ANN is an effective and widely used approach for the prediction of extremely complex problems. Various studies have been proposed to improve the weight training of ANN using metaheuristic algorithms. CSA is a latest and an effective metaheuristic method relies on the intelligent behavior of crows. CSA has been never proposed to improve the weight training of ANN. Therefore, CSA is adopted to optimize the initial weights and thresholds of the ANN model, in order to improve the training accuracy and prediction performance of functional properties of TiO2 NPs coated cotton composites. Furthermore, our proposed algorithm i.e., multilayer perceptron with crow search algorithm (MLP-CSA) was applied to map out the complex input–output conditions to predict the optimal results. The amount of chemicals and reaction time were selected as input variables and the amount of titanium dioxide coated on cotton, self-cleaning efficiency, antimicrobial efficiency and UPF were evaluated as output results. A sensitivity analysis was carried out to assess the performance of CSA in prediction process. MLP-CSA provided excellent result that were statistically significant and highly accurate as compared to standard MLP model and other metaheuristic algorithms used in the training of ANN reported in the literature.
Collapse
|
94
|
Wang G, Jia QS, Zhou M, Bi J, Qiao J, Abusorrah A. Artificial neural networks for water quality soft-sensing in wastewater treatment: a review. Artif Intell Rev 2021. [DOI: 10.1007/s10462-021-10038-8] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
95
|
Salatiello A, Hovaidi-Ardestani M, Giese MA. A Dynamical Generative Model of Social Interactions. Front Neurorobot 2021; 15:648527. [PMID: 34177508 PMCID: PMC8220068 DOI: 10.3389/fnbot.2021.648527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2020] [Accepted: 04/23/2021] [Indexed: 11/24/2022] Open
Abstract
The ability to make accurate social inferences makes humans able to navigate and act in their social environment effortlessly. Converging evidence shows that motion is one of the most informative cues in shaping the perception of social interactions. However, the scarcity of parameterized generative models for the generation of highly-controlled stimuli has slowed down both the identification of the most critical motion features and the understanding of the computational mechanisms underlying their extraction and processing from rich visual inputs. In this work, we introduce a novel generative model for the automatic generation of an arbitrarily large number of videos of socially interacting agents for comprehensive studies of social perception. The proposed framework, validated with three psychophysical experiments, allows generating as many as 15 distinct interaction classes. The model builds on classical dynamical system models of biological navigation and is able to generate visual stimuli that are parametrically controlled and representative of a heterogeneous set of social interaction classes. The proposed method represents thus an important tool for experiments aimed at unveiling the computational mechanisms mediating the perception of social interactions. The ability to generate highly-controlled stimuli makes the model valuable not only to conduct behavioral and neuroimaging studies, but also to develop and validate neural models of social inference, and machine vision systems for the automatic recognition of social interactions. In fact, contrasting human and model responses to a heterogeneous set of highly-controlled stimuli can help to identify critical computational steps in the processing of social interaction stimuli.
Collapse
Affiliation(s)
- Alessandro Salatiello
- Section for Computational Sensomotorics, Department of Cognitive Neurology, Centre for Integrative Neuroscience, Hertie Institute for Clinical Brain Research, University Clinic Tübingen, Tübingen, Germany
| | - Mohammad Hovaidi-Ardestani
- Section for Computational Sensomotorics, Department of Cognitive Neurology, Centre for Integrative Neuroscience, Hertie Institute for Clinical Brain Research, University Clinic Tübingen, Tübingen, Germany
| | - Martin A Giese
- Section for Computational Sensomotorics, Department of Cognitive Neurology, Centre for Integrative Neuroscience, Hertie Institute for Clinical Brain Research, University Clinic Tübingen, Tübingen, Germany
| |
Collapse
|
96
|
Pan W, Zhang L, Shen C. Data-driven time series prediction based on multiplicative neuron model artificial neuron network. Appl Soft Comput 2021. [DOI: 10.1016/j.asoc.2021.107179] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
97
|
Wang X, Chai Y, Li H, Wang W, Sun W. Graph Convolutional Network-based Model for Incident-related Congestion Prediction: A Case Study of Shanghai Expressways. ACM TRANSACTIONS ON MANAGEMENT INFORMATION SYSTEMS 2021. [DOI: 10.1145/3451356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
Traffic congestion has become a significant obstacle to the development of mega cities in China. Although local governments have used many resources in constructing road infrastructure, it is still insufficient for the increasing traffic demands. As a first step toward optimizing real-time traffic control, this study uses Shanghai Expressways as a case study to predict incident-related congestions. Our study proposes a graph convolutional network-based model to identify correlations in multi-dimensional sensor-detected data, while simultaneously taking into account environmental, spatiotemporal, and network features in predicting traffic conditions immediately after a traffic incident. The average accuracy, average AUC, and average F-1 score of the predictive model are 92.78%, 95.98%, and 88.78%, respectively, on small-scale ground-truth data. Furthermore, we improve the predictive model’s performance using semi-supervised learning by including more unlabeled data instances. As a result, the accuracy, AUC, and F-1 score of the model increase by 2.69%, 1.25%, and 4.72%, respectively. The findings of this article have important implications that can be used to improve the management and development of Expressways in Shanghai, as well as other metropolitan areas in China.
Collapse
Affiliation(s)
- Xi Wang
- School of Information, Central University of Finance and Economics, Beijing, P.R.China
| | - Yibo Chai
- School of Information, Central University of Finance and Economics, Beijing, P.R.China
| | - Hui Li
- School of Information, Central University of Finance and Economics, Beijing, P.R.China
| | - Wenbin Wang
- College of Business, Shanghai University of Finance and Economics, Shanghai, P.R.China
| | - Weishan Sun
- Shanghai Municipal Traffic Command Center, Shanghai, P.R.China
| |
Collapse
|
98
|
Zhang C, Ding S. A stochastic configuration network based on chaotic sparrow search algorithm. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.106924] [Citation(s) in RCA: 53] [Impact Index Per Article: 17.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
|
99
|
Soft-sensing of Wastewater Treatment Process via Deep Belief Network with Event-triggered Learning. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.12.108] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
100
|
Nonlinear Control System Design of an Underactuated Robot Based on Operator Theory and Isomorphism Scheme. AXIOMS 2021. [DOI: 10.3390/axioms10020062] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The number of actuators of an underactuated robot is less than its degree of freedom. In other words, underactuated robots can be designed with fewer actuators than fully actuated ones. Although an underactuated robot is more complex than a fully actuated robot, it has many advantages, such as energy, material, and space saving. Therefore, it has high research value in both control theory and practical applications. Swing-up is a mechanism with two links, which mimics a gymnast performing a horizontal bar movement. Over the past few decades, many sufficiently robust control techniques have been developed for a fully actuated robot but almost none of them can be directly applicable to an underactuated robot system. The reason is that such control techniques require certain assumptions that are valid only for fully actuated robot systems but not for underactuated ones. In this paper, a control system design method for underactuated robots based on operator theory and an isomorphism scheme is first proposed. Bezout identity is designed using isomorphism. The effectiveness of the design method is confirmed by simulation. The simulation results show that the performances, such as robust stability and response time, of an underactuated robot control system are improved.
Collapse
|