1
|
Feng W, Sun T. A dynamic attribute reduction algorithm based on relative neighborhood discernibility degree. Sci Rep 2024; 14:15637. [PMID: 38977714 PMCID: PMC11231213 DOI: 10.1038/s41598-024-66264-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2024] [Accepted: 07/01/2024] [Indexed: 07/10/2024] Open
Abstract
This paper addresses the current existence of attribute reduction algorithms for incomplete hybrid decision-making systems, including low attribute reduction efficiency, low classification accuracy and lack of consideration of unlabeled data types. To address these issues, this paper first redefines the weakly labeled relative neighborhood discernibility degree and develops a non-dynamic attribute reduction algorithm. In addition, this paper proposes an incremental update mechanism for weakly tagged relative neighborhood discernibility degree and introduces a new dynamic attribute reduction algorithm for increasing the set of objects based on it. Meanwhile, this paper also compares and analyses the improved algorithm proposed in this study with two existing attribute reduction algorithms using 8 data sets in the UCI database. The results show that the dynamic attribute reduction algorithm proposed in this paper achieves higher attribute reduction efficiency and classification accuracy, which further validates the effectiveness of the algorithm proposed in this paper.
Collapse
Affiliation(s)
- Weibing Feng
- College of Science, Xi'an University of Science and Technology, Xi'an, China
| | - Tiantian Sun
- College of Science, Xi'an University of Science and Technology, Xi'an, China.
| |
Collapse
|
2
|
Zhang Y, Nie B, Du J, Chen J, Du Y, Jin H, Zheng X, Chen X, Miao Z. Feature selection based on neighborhood rough sets and Gini index. PeerJ Comput Sci 2023; 9:e1711. [PMID: 38192483 PMCID: PMC10773927 DOI: 10.7717/peerj-cs.1711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 10/30/2023] [Indexed: 01/10/2024]
Abstract
Neighborhood rough set is considered an essential approach for dealing with incomplete data and inexact knowledge representation, and it has been widely applied in feature selection. The Gini index is an indicator used to evaluate the impurity of a dataset and is also commonly employed to measure the importance of features in feature selection. This article proposes a novel feature selection methodology based on these two concepts. In this methodology, we present the neighborhood Gini index and the neighborhood class Gini index and then extensively discuss their properties and relationships with attributes. Subsequently, two forward greedy feature selection algorithms are developed using these two metrics as a foundation. Finally, to comprehensively evaluate the performance of the algorithm proposed in this article, comparative experiments were conducted on 16 UCI datasets from various domains, including industry, food, medicine, and pharmacology, against four classical neighborhood rough set-based feature selection algorithms. The experimental results indicate that the proposed algorithm improves the average classification accuracy on the 16 datasets by over 6%, with improvements exceeding 10% in five. Furthermore, statistical tests reveal no significant differences between the proposed algorithm and the four classical neighborhood rough set-based feature selection algorithms. However, the proposed algorithm demonstrates high stability, eliminating most redundant or irrelevant features effectively while enhancing classification accuracy. In summary, the algorithm proposed in this article outperforms classical neighborhood rough set-based feature selection algorithms.
Collapse
Affiliation(s)
- Yuchao Zhang
- School of Computer Science, Jiangxi University of Chinese Medicine, NanChang, JiangXi, China
| | - Bin Nie
- School of Computer Science, Jiangxi University of Chinese Medicine, NanChang, JiangXi, China
| | - Jianqiang Du
- School of Computer Science, Jiangxi University of Chinese Medicine, NanChang, JiangXi, China
| | - Jiandong Chen
- School of Computer Science, Jiangxi University of Chinese Medicine, NanChang, JiangXi, China
| | - Yuwen Du
- School of Computer Science, Jiangxi University of Chinese Medicine, NanChang, JiangXi, China
| | - Haike Jin
- School of Computer Science, Jiangxi University of Chinese Medicine, NanChang, JiangXi, China
| | - Xuepeng Zheng
- School of Computer Science, Jiangxi University of Chinese Medicine, NanChang, JiangXi, China
| | - Xingxin Chen
- School of Computer Science, Jiangxi University of Chinese Medicine, NanChang, JiangXi, China
| | - Zhen Miao
- School of Computer Science, Jiangxi University of Chinese Medicine, NanChang, JiangXi, China
| |
Collapse
|
3
|
Luo C, Wang S, Li T, Chen H, Lv J, Yi Z. Large-Scale Meta-Heuristic Feature Selection Based on BPSO Assisted Rough Hypercuboid Approach. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:10889-10903. [PMID: 35552142 DOI: 10.1109/tnnls.2022.3171614] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
The selection of prominent features for building more compact and efficient models is an important data preprocessing task in the field of data mining. The rough hypercuboid approach is an emerging technique that can be applied to eliminate irrelevant and redundant features, especially for the inexactness problem in approximate numerical classification. By integrating the meta-heuristic-based evolutionary search technique, a novel global search method for numerical feature selection is proposed in this article based on the hybridization of the rough hypercuboid approach and binary particle swarm optimization (BPSO) algorithm, namely RH-BPSO. To further alleviate the issue of high computational cost when processing large-scale datasets, parallelization approaches for calculating the hybrid feature evaluation criteria are presented by decomposing and recombining hypercuboid equivalence partition matrix via horizontal data partitioning. A distributed meta-heuristic optimized rough hypercuboid feature selection (DiRH-BPSO) algorithm is thus developed and embedded in the Apache Spark cloud computing model. Extensive experimental results indicate that RH-BPSO is promising and can significantly outperform the other representative feature selection algorithms in terms of classification accuracy, the cardinality of the selected feature subset, and execution efficiency. Moreover, experiments on distributed-memory multicore clusters show that DiRH-BPSO is significantly faster than its sequential counterpart and is perfectly capable of completing large-scale feature selection tasks that fail on a single node due to memory constraints. Parallel scalability and extensibility analysis also demonstrate that DiRH-BPSO could scale out and extend well with the growth of computational nodes and the volume of data.
Collapse
|
4
|
Sun X, Zeng K. RST: Rough Set Transformer for Point Cloud Learning. SENSORS (BASEL, SWITZERLAND) 2023; 23:9042. [PMID: 38005431 PMCID: PMC10674457 DOI: 10.3390/s23229042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/26/2023] [Revised: 10/25/2023] [Accepted: 11/06/2023] [Indexed: 11/26/2023]
Abstract
Point cloud data generated by LiDAR sensors play a critical role in 3D sensing systems, with applications encompassing object classification, part segmentation, and point cloud recognition. Leveraging the global learning capacity of dot product attention, transformers have recently exhibited outstanding performance in point cloud learning tasks. Nevertheless, existing transformer models inadequately address the challenges posed by uncertainty features in point clouds, which can introduce errors in the dot product attention mechanism. In response to this, our study introduces a novel global guidance approach to tolerate uncertainty and provide a more reliable guidance. We redefine the granulation and lower-approximation operators based on neighborhood rough set theory. Furthermore, we introduce a rough set-based attention mechanism tailored for point cloud data and present the rough set transformer (RST) network. Our approach utilizes granulation concepts derived from token clusters, enabling us to explore relationships between concepts from an approximation perspective, rather than relying on specific dot product functions. Empirically, our work represents the pioneering fusion of rough set theory and transformer networks for point cloud learning. Our experimental results, including point cloud classification and segmentation tasks, demonstrate the superior performance of our method. Our method establishes concepts based on granulation generated from clusters of tokens. Subsequently, relationships between concepts can be explored from an approximation perspective, instead of relying on specific dot product or addition functions. Empirically, our work represents the pioneering fusion of rough set theory and transformer networks for point cloud learning. Our experimental results, including point cloud classification and segmentation tasks, demonstrate the superior performance of our method.
Collapse
Affiliation(s)
| | - Kai Zeng
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China;
| |
Collapse
|
5
|
An S, Zhao E, Wang C, Guo G, Zhao S, Li P. Relative Fuzzy Rough Approximations for Feature Selection and Classification. IEEE TRANSACTIONS ON CYBERNETICS 2023; 53:2200-2210. [PMID: 34587109 DOI: 10.1109/tcyb.2021.3112674] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Fuzzy rough set (FRS) theory is generally used to measure the uncertainty of data. However, this theory cannot work well when the class density of a data distribution differs greatly. In this work, a relative distance measure is first proposed to fit the mentioned data distribution. Based on the measure, a relative FRS model is introduced to remedy the mentioned imperfection of classical FRSs. Then, the positive region, negative region, and boundary region are defined to measure the uncertainty of data with the relative FRSs. Besides, a relative fuzzy dependency is defined to evaluate the importance of features to decision. With the proposed feature evaluation, we propose a feature selection algorithm and design a classifier based on the maximal positive region. The classification principle is that an unlabeled sample will be classified into the class corresponding to the maximal degree of the positive region. Experimental results show the relative fuzzy dependency is an effective and efficient measure for evaluating features, and the proposed feature selection algorithm presents better performance than some classical algorithms. Besides, it also shows the proposed classifier can achieve slightly better performance than the KNN classifier, which demonstrates that the maximal positive region-based classifier is effective and feasible.
Collapse
|
6
|
Zhong C, Li G, Meng Z, Li H, He W. A self-adaptive quantum equilibrium optimizer with artificial bee colony for feature selection. Comput Biol Med 2023; 153:106520. [PMID: 36608463 DOI: 10.1016/j.compbiomed.2022.106520] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 11/28/2022] [Accepted: 12/31/2022] [Indexed: 01/03/2023]
Abstract
Feature selection (FS) is a popular data pre-processing technique in machine learning to extract the optimal features to maintain or increase the classification accuracy of the dataset, which is a combinatorial optimization problem, requiring a powerful optimizer to obtain the optimum subset. The equilibrium optimizer (EO) is a recent physical-based metaheuristic algorithm with good performance for various optimization problems, but it may encounter premature or the local convergence in feature selection. This work presents a self-adaptive quantum EO with artificial bee colony for feature selection, named SQEOABC. In the proposed algorithm, the quantum theory and the self-adaptive mechanism are employed into the updating rule of EO to enhance convergence, and the updating mechanism from the artificial bee colony is also incorporated into EO to achieve appropriate FS solutions. In the experiments, 25 benchmark datasets from the UCI repository are investigated to verify SQEOABC, which is compared with several state-of-the-art metaheuristic algorithms and the variants of EO. The statistical results of fitness values and accuracy demonstrate that SQEOABC has better performance than the compared algorithms and the variants of EO. Finally, a real-world FS problem from COVID-19 illustrates the effectiveness and superiority of SQEOABC.
Collapse
Affiliation(s)
- Changting Zhong
- Department of Engineering Mechanics, State Key Laboratory of Structural Analyses for Industrial Equipment, Dalian University of Technology, Dalian, 116024, China; School of Civil Engineering and Architecture, Hainan University, Haikou 570228, China.
| | - Gang Li
- Department of Engineering Mechanics, State Key Laboratory of Structural Analyses for Industrial Equipment, Dalian University of Technology, Dalian, 116024, China; Ningbo Institute of Dalian University of Technology, Ningbo, 315000, China.
| | - Zeng Meng
- School of Civil Engineering, Hefei University of Technology, Hefei, 230009, China.
| | - Haijiang Li
- BIM for Smart Engineering Centre, Cardiff School of Engineering, Cardiff University, Queen's Buildings, Cardiff, CF24 3AA, Whales, UK.
| | - Wanxin He
- Department of Engineering Mechanics, State Key Laboratory of Structural Analyses for Industrial Equipment, Dalian University of Technology, Dalian, 116024, China.
| |
Collapse
|
7
|
Feature selection using Information Gain and decision information in neighborhood decision system. Appl Soft Comput 2023. [DOI: 10.1016/j.asoc.2023.110100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/12/2023]
|
8
|
Feature selection using relative dependency complement mutual information in fitting fuzzy rough set model. APPL INTELL 2023. [DOI: 10.1007/s10489-022-04445-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
|
9
|
Qu K, Xu J, Han Z, Xu S. Maximum relevance minimum redundancy-based feature selection using rough mutual information in adaptive neighborhood rough sets. APPL INTELL 2023. [DOI: 10.1007/s10489-022-04398-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
|
10
|
Yang T, Liang J, Pang Y, Xie P, Qian Y, Wang R. An efficient feature selection algorithm based on the description vector and hypergraph. Inf Sci (N Y) 2023. [DOI: 10.1016/j.ins.2023.01.046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/15/2023]
|
11
|
Multi-label feature selection based on label distribution and neighborhood rough set. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.11.096] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
12
|
Zhang H, Sun Q, Dong K. Information-theoretic partially labeled heterogeneous feature selection based on neighborhood rough sets. Int J Approx Reason 2022. [DOI: 10.1016/j.ijar.2022.12.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
|
13
|
Effective fuzzy joint mutual information feature selection based on uncertainty region for classification problem. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.109885] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
14
|
An S, Guo X, Wang C, Guo G, Dai J. A Soft Neighborhood Rough Set Model and Its Applications. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.12.074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
|
15
|
Semi-supervised feature selection for partially labeled mixed-type data based on multi-criteria measure approach. Int J Approx Reason 2022. [DOI: 10.1016/j.ijar.2022.11.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022]
|
16
|
Yang L, Qin K, Sang B, Fu C. A novel incremental attribute reduction by using quantitative dominance-based neighborhood self-information. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.110200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
|
17
|
Gao L, Cai M, Li Q. A Relative Granular Ratio-based Outlier Detection Method In Heterogeneous Data. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.11.154] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
18
|
Kou Y, Lin G, Qian Y, Liao S. A Novel Multi-label Feature Selection Method with Association Rules and Rough Set. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.12.070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
|
19
|
Vaguely quantified fuzzy dominance rough set and its incremental maintenance approximation approaches. Soft comput 2022. [DOI: 10.1007/s00500-022-07598-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
20
|
Li X, Luo C. Neighborhood rough cognitive networks. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109796] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
21
|
Jiang H, Hu BQ. On two new types of fuzzy rough sets via overlap functions and corresponding applications. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.11.058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
22
|
Wang Z, Chen H, Yuan Z, Yang X, Zhang P, Li T. Exploiting fuzzy rough mutual information for feature selection. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109769] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
23
|
Feature selection for label distribution learning using dual-similarity based neighborhood fuzzy entropy. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.10.054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
24
|
Ye J, Sun B, Zhan J, Chu X. Variable precision multi-granulation composite rough sets with multi-decision and their applications to medical diagnosis. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.10.037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
25
|
An improved decision tree algorithm based on variable precision neighborhood similarity. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.10.043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
26
|
Zhang D, Zhu P. Variable radius neighborhood rough sets and attribute reduction. Int J Approx Reason 2022. [DOI: 10.1016/j.ijar.2022.08.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
27
|
Chen J, Zhu P. A variable precision multigranulation rough set model and attribute reduction. Soft comput 2022. [DOI: 10.1007/s00500-022-07566-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
28
|
Xing Y, Kochunov P, van Erp TG, Ma T, Calhoun VD, Du Y. A novel neighborhood rough set-based feature selection method and its application to biomarker identification of schizophrenia. IEEE J Biomed Health Inform 2022; 27:215-226. [PMID: 36201411 PMCID: PMC10076451 DOI: 10.1109/jbhi.2022.3212479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Feature selection can disclose biomarkers of mental disorders that have unclear biological mechanisms. Although neighborhood rough set (NRS) has been applied to discover important sparse features, it has hardly ever been utilized in neuroimaging-based biomarker identification, probably due to the inadequate feature evaluation metric and incomplete information provided under a single-granularity. Here, we propose a new NRS-based feature selection method and successfully identify brain functional connectivity biomarkers of schizophrenia (SZ) using functional magnetic resonance imaging (fMRI) data. Specifically, we develop a new weighted metric based on NRS combined with information entropy to evaluate the capacity of features in distinguishing different groups. Inspired by multi-granularity information maximization theory, we further take advantage of the complementary information from different neighborhood sizes via a multi-granularity fusion to obtain the most discriminative and stable features. For validation, we compare our method with six popular feature selection methods using three public omics datasets as well as resting-state fMRI data of 393 SZ patients and 429 healthy controls. Results show that our method obtained higher classification accuracies on both omics data (100.0%, 88.6%, and 72.2% for three omics datasets, respectively) and fMRI data (93.9% for main dataset, and 76.3% and 83.8% for two independent datasets, respectively). Moreover, our findings reveal biologically meaningful substrates of SZ, notably involving the connectivity between the thalamus and superior temporal gyrus as well as between the postcentral gyrus and calcarine gyrus. Taken together, we propose a new NRS-based feature selection method that shows the potential of exploring effective and sparse neuroimaging-based biomarkers of mental disorders.
Collapse
Affiliation(s)
- Ying Xing
- School of Computer and Information Technology, Shanxi University, Taiyuan, China
| | - Peter Kochunov
- Maryland Psychiatric Research Center and Department of Psychiatry, University of Maryland, School of Medicine, Baltimore, MD, USA
| | - Theo G.M. van Erp
- Department of Psychiatry and Human Behavior, School of Medicine, University of California, Irvine, CA, USA
| | - Tianzhou Ma
- Department of Epidemiology and Biostatistics, University of Maryland, College Park, MD, USA
| | - Vince D. Calhoun
- Tri-Institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, Emory University, Atlanta, GA, USA
| | - Yuhui Du
- School of Computer and Information Technology, Shanxi University, Taiyuan, China
| |
Collapse
|
29
|
Ju H, Ding W, Shi Z, Huang J, Yang J, Yang X. Attribute reduction with personalized information granularity of nearest mutual neighbors. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.09.006] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
30
|
Li Z, Chen Y, Zhang G, Qu L, Xie N. Entropy measurement for a hybrid information system with images: an application in attribute reduction. Soft comput 2022. [DOI: 10.1007/s00500-022-07502-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
31
|
Peng X, Wang P, Xia S, Wang C, Pu C, Qian J. FNC: A fast neighborhood calculation framework. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.109394] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
|
32
|
|
33
|
Wen X, Li D, Zhang C, Zhai Y. A weighted ML-KNN based on discernibility of attributes to heterogeneous sample pairs. Inf Process Manag 2022. [DOI: 10.1016/j.ipm.2022.103053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
34
|
Zhang X, Fan Y, Yao Y, Yang J. Class-specific attribute reducts based on neighborhood rough sets. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2022. [DOI: 10.3233/jifs-213418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Attribute reduction based on rough sets is an effective approach of data learning in intelligent systems, and it has two basic types. Traditional classification-based attribute reducts mainly complete the classification task, while recent class-specific reducts directly realize the class-pattern recognition. Neighborhood rough sets have the covering-structure extension and data-diversity applicability, but their attribute reducts concern only the neighborhood classification-based reducts. This paper proposes class-specific attribute reducts based on neighborhood rough sets, so as to promote the optimal identification and robust processing of specific classes. At first, neighborhood class-specific reducts are defined, and their basic properties and heuristic algorithms are acquired by granulation monotonicity. Then, hierarchical relationships between the neighborhood classification-based and class-specific reducts are analyzed, and mutual derivation algorithms are designed. Finally, the theoretical constructions and mutual relationships are effectively verified by both decision table examples and data set experiments. The neighborhood class-specific reducts robustly extend the existing class-specific reducts, and they also provide a hierarchical mechanism for the neighborhood classification-based reducts, thus facilitating wide applications of class-pattern processing.
Collapse
Affiliation(s)
- Xianyong Zhang
- School of Mathematical Sciences, Sichuan Normal University, Chengdu, China
- Institute of Intelligent Information and Quantum Information, Sichuan Normal University, Chengdu, China
- Research Center of Sichuan Normal University, National-Local Joint Engineering Laboratory of System Credibility Automatic Verification, Chengdu, China
| | - Yunrui Fan
- School of Mathematical Sciences, Sichuan Normal University, Chengdu, China
- Institute of Intelligent Information and Quantum Information, Sichuan Normal University, Chengdu, China
| | - Yuesong Yao
- School of Mathematical Sciences, Sichuan Normal University, Chengdu, China
- Institute of Intelligent Information and Quantum Information, Sichuan Normal University, Chengdu, China
| | - Jilin Yang
- Institute of Intelligent Information and Quantum Information, Sichuan Normal University, Chengdu, China
- College of Computer Science, Sichuan Normal University, Chengdu, China
| |
Collapse
|
35
|
Multi-Label Attribute Reduction Based on Neighborhood Multi-Target Rough Sets. Symmetry (Basel) 2022. [DOI: 10.3390/sym14081652] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
The rough set model has two symmetry approximations called upper approximation and lower approximation, which correspond to a concept’s intension and extension, respectively. Multi-label learning enforces the rough set model, which wants to be applied considering the correlations among labels, while the target concept should not be limited to only one. This paper proposes a multi-target model considering label correlation (Neighborhood Multi-Target Rough Sets, NMTRS) and proposes an attribute reduction approach based on NMTRS. First, some definitions of NMTRS are introduced. Second, some properties of NMTRS are discussed. Third, some discussion about the attribute significance measure is given. Fourth, the attribute reduction approaches based on NMTRS are proposed. Finally, the efficiency and validity of the designed algorithms are verified by experiments. The experiments show that our algorithm shows considerable performance when compared to state-of-the-art approaches.
Collapse
|
36
|
Unsupervised attribute reduction: improving effectiveness and efficiency. INT J MACH LEARN CYB 2022. [DOI: 10.1007/s13042-022-01618-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
37
|
Liang P, Lei D, Chin K, Hu J. Feature selection based on robust fuzzy rough sets using kernel-based similarity and relative classification uncertainty measures. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.109795] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
38
|
Study on the detection of heavy metal lead (Pb) in mussels based on near-infrared spectroscopy technology and a REELM classifier. Microchem J 2022. [DOI: 10.1016/j.microc.2022.107394] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
|
39
|
Thuy NN, Wongthanavasu S. A Novel Feature Selection Method for High-Dimensional Mixed Decision Tables. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:3024-3037. [PMID: 33449885 DOI: 10.1109/tnnls.2020.3048080] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Attribute reduction, also called feature selection, is one of the most important issues of rough set theory, which is regarded as a vital preprocessing step in pattern recognition, machine learning, and data mining. Nowadays, high-dimensional mixed and incomplete data sets are very common in real-world applications. Certainly, the selection of a promising feature subset from such data sets is a very interesting, but challenging problem. Almost all of the existing methods generated a cover on the space of objects to determine important features. However, some tolerance classes in the cover are useless for the computational process. Thus, this article introduces a new concept of stripped neighborhood covers to reduce unnecessary tolerance classes from the original cover. Based on the proposed stripped neighborhood cover, we define a new reduct in mixed and incomplete decision tables, and then design an efficient heuristic algorithm to find this reduct. For each loop in the main loop of the proposed algorithm, we use an error measure to select an optimal feature and put it into the selected feature subset. Besides, to deal more efficiently with high-dimensional data sets, we also determine redundant features after each loop and remove them from the candidate feature subset. For the purpose of verifying the performance of the proposed algorithm, we carry out experiments on data sets downloaded from public data sources to compare with existing state-of-the-art algorithms. Experimental results showed that our algorithm outperforms compared algorithms, especially in classification accuracy.
Collapse
|
40
|
Uncertainty measurement for a gene space based on class-consistent technology: an application in gene selection. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03657-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
41
|
An Ensemble Framework to Forest Optimization Based Reduct Searching. Symmetry (Basel) 2022. [DOI: 10.3390/sym14061277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023] Open
Abstract
Essentially, the solution to an attribute reduction problem can be viewed as a reduct searching process. Currently, among various searching strategies, meta-heuristic searching has received extensive attention. As a new emerging meta-heuristic approach, the forest optimization algorithm (FOA) is introduced to the problem solving of attribute reduction in this study. To further improve the classification performance of selected attributes in reduct, an ensemble framework is also developed: firstly, multiple reducts are obtained by FOA and data perturbation, and the structure of those multiple reducts is symmetrical, which indicates that no order exists among those reducts; secondly, multiple reducts are used to execute voting classification over testing samples. Finally, comprehensive experiments on over 20 UCI datasets clearly validated the effectiveness of our framework: it is not only beneficial to output reducts with superior classification accuracies and classification stabilities but also suitable for data pre-processing with noise. This improvement work we have performed makes the FOA obtain better benefits in the data processing of life, health, medical and other fields.
Collapse
|
42
|
|
43
|
Feature selection using self-information uncertainty measures in neighborhood information systems. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03760-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
44
|
Yang C, Ge H, Xu Y. Incremental maintenance of three-way regions with variations of objects and values in hybrid incomplete decision systems. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03736-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
45
|
|
46
|
Song L, Liu X, Chen S, Liu S, Liu X, Muhammad K, Bhattacharyya S. A deep fuzzy model for diagnosis of COVID-19 from CT images. Appl Soft Comput 2022; 122:108883. [PMID: 35474916 PMCID: PMC9027534 DOI: 10.1016/j.asoc.2022.108883] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2021] [Revised: 03/31/2022] [Accepted: 04/13/2022] [Indexed: 01/26/2023]
Abstract
From early 2020, a novel coronavirus disease pneumonia has shown a global "pandemic" trend at an extremely fast speed. Due to the magnitude of its harm, it has become a major global public health event. In the face of dramatic increase in the number of patients with COVID-19, the need for quick diagnosis of suspected cases has become particularly critical. Therefore, this paper constructs a fuzzy classifier, which aims to detect infected subjects by observing and analyzing the CT images of suspected patients. Firstly, a deep learning algorithm is used to extract the low-level features of CT images in the COVID-CT dataset. Subsequently, we analyze the extracted feature information with attribute reduction algorithm to obtain features with high recognition. Then, some key features are selected as the input for the fuzzy diagnosis model to the training model. Finally, several images in the dataset are used as the test set to test the trained fuzzy classifier. The obtained accuracy rate is 94.2%, and the F1-score is 93.8%. Experimental results show that, compared with the deep learning diagnosis methods widely used in medical image analysis, the proposed fuzzy model improves the accuracy and efficiency of diagnosis, which consequently helps to curb the spread of COVID-19.
Collapse
Affiliation(s)
- Liping Song
- Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing, College of Information Science and Engineering, China
- Hunan Xiangjiang Artificial Intelligence Academy; Hunan Normal University, Changsha, 410000, China
| | - Xinyu Liu
- Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing, College of Information Science and Engineering, China
- Hunan Xiangjiang Artificial Intelligence Academy; Hunan Normal University, Changsha, 410000, China
| | - Shuqi Chen
- Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing, College of Information Science and Engineering, China
- Hunan Xiangjiang Artificial Intelligence Academy; Hunan Normal University, Changsha, 410000, China
| | - Shuai Liu
- Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing, College of Information Science and Engineering, China
- Hunan Xiangjiang Artificial Intelligence Academy; Hunan Normal University, Changsha, 410000, China
| | - Xiangbin Liu
- Hunan Provincial Key Laboratory of Intelligent Computing and Language Information Processing, College of Information Science and Engineering, China
- Hunan Xiangjiang Artificial Intelligence Academy; Hunan Normal University, Changsha, 410000, China
| | - Khan Muhammad
- Visual Analytics for Knowledge Laboratory (VIS2KNOW Lab), Department of Applied Artificial Intelligence, School of Convergence, College of Computing and Informatics, Sungkyunkwan University, Seoul 03063, Republic of Korea
| | | |
Collapse
|
47
|
Zhang Q, Qu L, Li Z. Attribute reduction based on D-S evidence theory in a hybrid information system. Int J Approx Reason 2022. [DOI: 10.1016/j.ijar.2022.06.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
48
|
Xiao J, Zhang Q, Ai Z, Wang G. A fast neighborhood classifier based on hash bucket with application to medical diagnosis. Int J Approx Reason 2022. [DOI: 10.1016/j.ijar.2022.05.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
49
|
Niu J, Chen D. Incremental calculation approaches for granular reduct in formal context with attribute updating. INT J MACH LEARN CYB 2022. [DOI: 10.1007/s13042-022-01561-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
50
|
Abd Elaziz M, Abu-Donia HM, Hosny RA, Hazae SL, Ibrahim RA. Improved evolutionary-based feature selection technique using extension of knowledge based on the rough approximations. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.01.026] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|