1
|
Liu J, Yang S, Zhang H, Sun Z, Du J. Online Multi-Label Streaming Feature Selection Based on Label Group Correlation and Feature Interaction. ENTROPY (BASEL, SWITZERLAND) 2023; 25:1071. [PMID: 37510018 PMCID: PMC10377943 DOI: 10.3390/e25071071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/10/2023] [Revised: 07/10/2023] [Accepted: 07/14/2023] [Indexed: 07/30/2023]
Abstract
Multi-label streaming feature selection has received widespread attention in recent years because the dynamic acquisition of features is more in line with the needs of practical application scenarios. Most previous methods either assume that the labels are independent of each other, or, although label correlation is explored, the relationship between related labels and features is difficult to understand or specify. In real applications, both situations may occur where the labels are correlated and the features may belong specifically to some labels. Moreover, these methods treat features individually without considering the interaction between features. Based on this, we present a novel online streaming feature selection method based on label group correlation and feature interaction (OSLGC). In our design, we first divide labels into multiple groups with the help of graph theory. Then, we integrate label weight and mutual information to accurately quantify the relationships between features under different label groups. Subsequently, a novel feature selection framework using sliding windows is designed, including online feature relevance analysis and online feature interaction analysis. Experiments on ten datasets show that the proposed method outperforms some mature MFS algorithms in terms of predictive performance, statistical analysis, stability analysis, and ablation experiments.
Collapse
Affiliation(s)
- Jinghua Liu
- Department of Computer Science and Technology, Huaqiao University, Xiamen 361021, China
- Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University, Xiamen 361021, China
- Fujian Key Laboratory of Big Data Intelligence and Security, Huaqiao University, Xiamen 361021, China
| | - Songwei Yang
- Department of Computer Science and Technology, Huaqiao University, Xiamen 361021, China
- Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University, Xiamen 361021, China
- Fujian Key Laboratory of Big Data Intelligence and Security, Huaqiao University, Xiamen 361021, China
| | - Hongbo Zhang
- Department of Computer Science and Technology, Huaqiao University, Xiamen 361021, China
- Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University, Xiamen 361021, China
- Fujian Key Laboratory of Big Data Intelligence and Security, Huaqiao University, Xiamen 361021, China
| | - Zhenzhen Sun
- Department of Computer Science and Technology, Huaqiao University, Xiamen 361021, China
- Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University, Xiamen 361021, China
- Fujian Key Laboratory of Big Data Intelligence and Security, Huaqiao University, Xiamen 361021, China
| | - Jixiang Du
- Department of Computer Science and Technology, Huaqiao University, Xiamen 361021, China
- Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University, Xiamen 361021, China
- Fujian Key Laboratory of Big Data Intelligence and Security, Huaqiao University, Xiamen 361021, China
| |
Collapse
|
2
|
Miao J, Wang Y, Cheng Y, Chen F. Parallel dual-channel multi-label feature selection. Soft comput 2023. [DOI: 10.1007/s00500-023-07916-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/27/2023]
|
3
|
Dai L, Zhang J, Du G, Li C, Wei R, Li S. Toward embedding-based multi-label feature selection with label and feature collaboration. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07924-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/31/2022]
|
4
|
Sparse multi-label feature selection via dynamic graph manifold regularization. INT J MACH LEARN CYB 2022. [DOI: 10.1007/s13042-022-01679-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/10/2022]
|
5
|
Robust multi-label feature selection with shared label enhancement. Knowl Inf Syst 2022. [DOI: 10.1007/s10115-022-01747-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
7
|
Hashemi A, Bagher Dowlatshahi M, Nezamabadi-pour H. An efficient Pareto-based feature selection algorithm for multi-label classification. Inf Sci (N Y) 2021. [DOI: 10.1016/j.ins.2021.09.052] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
|
8
|
Fan Y, Liu J, Wu S. Exploring instance correlations with local discriminant model for multi-label feature selection. APPL INTELL 2021. [DOI: 10.1007/s10489-021-02799-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|