1
|
Shan Y, Li S, Li F, Cui Y, Chen M. Dual-level clustering ensemble algorithm with three consensus strategies. Sci Rep 2023; 13:22617. [PMID: 38114636 PMCID: PMC10730624 DOI: 10.1038/s41598-023-49947-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Accepted: 12/13/2023] [Indexed: 12/21/2023] Open
Abstract
Clustering ensemble (CE), renowned for its robust and potent consensus capability, has garnered significant attention from scholars in recent years and has achieved numerous noteworthy breakthroughs. Nevertheless, three key issues persist: (1) the majority of CE selection strategies rely on preset parameters or empirical knowledge as a premise, lacking adaptive selectivity; (2) the construction of co-association matrix is excessively one-sided; (3) the CE method lacks a more macro perspective to reconcile the conflicts among different consensus results. To address these aforementioned problems, a dual-level clustering ensemble algorithm with three consensus strategies is proposed. Firstly, a backward clustering ensemble selection framework is devised, and its built-in selection strategy can adaptively eliminate redundant members. Then, at the base clustering consensus level, taking into account the interplay between actual spatial location information and the co-occurrence frequency, two modified relation matrices are reconstructed, resulting in the development of two consensus methods with different modes. Additionally, at the CE consensus level with a broader perspective, an adjustable Dempster-Shafer evidence theory is developed as the third consensus method in present algorithm to dynamically fuse multiple ensemble results. Experimental results demonstrate that compared to seven other state-of-the-art and typical CE algorithms, the proposed algorithm exhibits exceptional consensus ability and robustness.
Collapse
Affiliation(s)
- Yunxiao Shan
- School of Science, Harbin University of Science and Technology, Harbin, 150080, China
| | - Shu Li
- School of Science, Harbin University of Science and Technology, Harbin, 150080, China.
- Key Laboratory of Engineering Dielectric and Applications (Ministry of Education), School of Electrical and Electronic Engineering, Harbin University of Science and Technology, Harbin, 150080, China.
| | - Fuxiang Li
- School of Science, Harbin University of Science and Technology, Harbin, 150080, China.
| | - Yuxin Cui
- School of Science, Harbin University of Science and Technology, Harbin, 150080, China
| | - Minghua Chen
- Key Laboratory of Engineering Dielectric and Applications (Ministry of Education), School of Electrical and Electronic Engineering, Harbin University of Science and Technology, Harbin, 150080, China
| |
Collapse
|
2
|
Mohammed Alsumaidaee YA, Yaw CT, Koh SP, Tiong SK, Chen CP, Yusaf T, Abdalla AN, Ali K, Raj AA. Detection of Corona Faults in Switchgear by Using 1D-CNN, LSTM, and 1D-CNN-LSTM Methods. SENSORS (BASEL, SWITZERLAND) 2023; 23:3108. [PMID: 36991819 PMCID: PMC10059847 DOI: 10.3390/s23063108] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 02/28/2023] [Accepted: 03/01/2023] [Indexed: 06/19/2023]
Abstract
The damaging effects of corona faults have made them a major concern in metal-clad switchgear, requiring extreme caution during operation. Corona faults are also the primary cause of flashovers in medium-voltage metal-clad electrical equipment. The root cause of this issue is an electrical breakdown of the air due to electrical stress and poor air quality within the switchgear. Without proper preventative measures, a flashover can occur, resulting in serious harm to workers and equipment. As a result, detecting corona faults in switchgear and preventing electrical stress buildup in switches is critical. Recent years have seen the successful use of Deep Learning (DL) applications for corona and non-corona detection, owing to their autonomous feature learning capability. This paper systematically analyzes three deep learning techniques, namely 1D-CNN, LSTM, and 1D-CNN-LSTM hybrid models, to identify the most effective model for detecting corona faults. The hybrid 1D-CNN-LSTM model is deemed the best due to its high accuracy in both the time and frequency domains. This model analyzes the sound waves generated in switchgear to detect faults. The study examines model performance in both the time and frequency domains. In the time domain analysis (TDA), 1D-CNN achieved success rates of 98%, 98.4%, and 93.9%, while LSTM obtained success rates of 97.3%, 98.4%, and 92.4%. The most suitable model, the 1D-CNN-LSTM, achieved success rates of 99.3%, 98.4%, and 98.4% in differentiating corona and non-corona cases during training, validation, and testing. In the frequency domain analysis (FDA), 1D-CNN achieved success rates of 100%, 95.8%, and 95.8%, while LSTM obtained success rates of 100%, 100%, and 100%. The 1D-CNN-LSTM model achieved a 100%, 100%, and 100% success rate during training, validation, and testing. Hence, the developed algorithms achieved high performance in identifying corona faults in switchgear, particularly the 1D-CNN-LSTM model due to its accuracy in detecting corona faults in both the time and frequency domains.
Collapse
Affiliation(s)
- Yaseen Ahmed Mohammed Alsumaidaee
- College of Graduate Studies (COGS), Universiti Tenaga Nasional (The Energy University), Jalan Ikram-Uniten, Kajang 43000, Selangor, Malaysia
| | - Chong Tak Yaw
- Institute of Sustainable Energy, Universiti Tenaga Nasional (The Energy University), Jalan Ikram-Uniten, Kajang 43000, Selangor, Malaysia
| | - Siaw Paw Koh
- Institute of Sustainable Energy, Universiti Tenaga Nasional (The Energy University), Jalan Ikram-Uniten, Kajang 43000, Selangor, Malaysia
- Department Electrical and Electronics Engineering, Universiti Tenaga Nasional (The Energy University), Jalan Ikram-Uniten, Kajang 43000, Selangor, Malaysia
| | - Sieh Kiong Tiong
- Institute of Sustainable Energy, Universiti Tenaga Nasional (The Energy University), Jalan Ikram-Uniten, Kajang 43000, Selangor, Malaysia
- Department Electrical and Electronics Engineering, Universiti Tenaga Nasional (The Energy University), Jalan Ikram-Uniten, Kajang 43000, Selangor, Malaysia
| | - Chai Phing Chen
- Department Electrical and Electronics Engineering, Universiti Tenaga Nasional (The Energy University), Jalan Ikram-Uniten, Kajang 43000, Selangor, Malaysia
| | - Talal Yusaf
- School of Engineering and Technology, Central Queensland University, Brisbane, QLD 4009, Australia
| | - Ahmed N Abdalla
- Faculty of Electronic Information Engineering, Huaiyin Institute of Technology, Huai’an 223003, China
| | - Kharudin Ali
- Faculty of Electrical and Automation Engineering Technology, UC TATI, Teluk Kalong, Kemaman 24000, Terengganu, Malaysia
| | - Avinash Ashwin Raj
- Tenaga National Berhard Research Sdn. Bhd., No. 1, Kawasan Institusi Penyelidikan, Jln Ayer Hitam, Kajang 43000, Selangor, Malaysia
| |
Collapse
|
3
|
Zamora J, Sublime J. An Ensemble and Multi-View Clustering Method Based on Kolmogorov Complexity. ENTROPY (BASEL, SWITZERLAND) 2023; 25:e25020371. [PMID: 36832736 PMCID: PMC9955949 DOI: 10.3390/e25020371] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Revised: 02/07/2023] [Accepted: 02/14/2023] [Indexed: 06/01/2023]
Abstract
The ability to build more robust clustering from many clustering models with different solutions is relevant in scenarios with privacy-preserving constraints, where data features have a different nature or where these features are not available in a single computation unit. Additionally, with the booming number of multi-view data, but also of clustering algorithms capable of producing a wide variety of representations for the same objects, merging clustering partitions to achieve a single clustering result has become a complex problem with numerous applications. To tackle this problem, we propose a clustering fusion algorithm that takes existing clustering partitions acquired from multiple vector space models, sources, or views, and merges them into a single partition. Our merging method relies on an information theory model based on Kolmogorov complexity that was originally proposed for unsupervised multi-view learning. Our proposed algorithm features a stable merging process and shows competitive results over several real and artificial datasets in comparison with other state-of-the-art methods that have similar goals.
Collapse
Affiliation(s)
- Juan Zamora
- Instituto de Estadística, Pontificia Universidad Católica de Valparaíso, Avenida Brasil 2830, Valparaíso 2340025, Chile
| | - Jérémie Sublime
- ISEP—School of Digital Engineers, 92130 Issy-Les-Moulineaux, France
| |
Collapse
|
4
|
Yao X, Wang X, Wang SH, Zhang YD. A comprehensive survey on convolutional neural network in medical image analysis. MULTIMEDIA TOOLS AND APPLICATIONS 2022; 81:41361-41405. [DOI: 10.1007/s11042-020-09634-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2020] [Revised: 07/30/2020] [Accepted: 08/13/2020] [Indexed: 08/30/2023]
|
5
|
Mariño LM, de Carvalho FDA. Vector batch SOM algorithms for multi-view dissimilarity data. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.109994] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
6
|
A Belief Two-Level Weighted Clustering Method for Incomplete Pattern Based on Multiview Fusion. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:2895338. [PMID: 36507228 PMCID: PMC9729040 DOI: 10.1155/2022/2895338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 10/23/2022] [Accepted: 11/04/2022] [Indexed: 12/02/2022]
Abstract
Incomplete pattern clustering is a challenging task because the unknown attributes of the missing data introduce uncertain information that affects the accuracy of the results. In addition, the clustering method based on the single view ignores the complementary information from multiple views. Therefore, a new belief two-level weighted clustering method based on multiview fusion (BTC-MV) is proposed to deal with incomplete patterns. Initially, the BTC-MV method estimates the missing data by an attribute-level weighted imputation method with k-nearest neighbor (KNN) strategy based on multiple views. The unknown attributes are replaced by the average of the KNN. Then, the clustering method based on multiple views is proposed for a complete data set with estimations; the view weights represent the reliability of the evidence from different source spaces. The membership values from multiple views, which indicate the probability of the pattern belonging to different categories, reduce the risk of misclustering. Finally, a view-level weighted fusion strategy based on the belief function theory is proposed to integrate the membership values from different source spaces, which improves the accuracy of the clustering task. To validate the performance of the BTC-MV method, extensive experiments are conducted to compare with classical methods, such as MI-KM, MI-KMVC, KNNI-FCM, and KNNI-MFCM. Results on six UCI data sets show that the error rate of the BTC-MV method is lower than that of the other methods. Therefore, it can be concluded that the BTC-MV method has superior performance in dealing with incomplete patterns.
Collapse
|
7
|
Zhang GY, Huang D, Wang CD. Facilitated low-rank multi-view subspace clustering. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.110141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
|
8
|
Wei H, Chen L, Chen CP, Duan J, Han R, Guo L. Fuzzy clustering for multiview data by combining latent information. Appl Soft Comput 2022. [DOI: 10.1016/j.asoc.2022.109140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
9
|
|
10
|
Chao G, Sun S, Bi J. A Survey on Multi-View Clustering. IEEE TRANSACTIONS ON ARTIFICIAL INTELLIGENCE 2022; 2:146-168. [PMID: 35308425 DOI: 10.1109/tai.2021.3065894] [Citation(s) in RCA: 31] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
Clustering is a machine learning paradigm of dividing sample subjects into a number of groups such that subjects in the same groups are more similar to those in other groups. With advances in information acquisition technologies, samples can frequently be viewed from different angles or in different modalities, generating multi-view data. Multi-view clustering, that clusters subjects into subgroups using multi-view data, has attracted more and more attentions. Although MVC methods have been developed rapidly, there has not been enough survey to summarize and analyze the current progress. Therefore, we propose a novel taxonomy of the MVC approaches. Similar to other machine learning methods, we categorize them into generative and discriminative classes. In discriminative class, based on the way of view integration, we split it further into five groups: Common Eigenvector Matrix, Common Coefficient Matrix, Common Indicator Matrix, Direct Combination and Combination After Projection. Furthermore, we relate MVC to other topics: multi-view representation, ensemble clustering, multi-task clustering, multi-view supervised and semi-supervised learning. Several representative real-world applications are elaborated for practitioners. Some benchmark multi-view datasets are introduced and representative MVC algorithms from each group are empirically evaluated to analyze how they perform on benchmark datasets. To promote future development of MVC approaches, we point out several open problems that may require further investigation and thorough examination.
Collapse
Affiliation(s)
- Guoqing Chao
- School of Computer Science and Technology, Harbin Institute of Technology, Weihai 264209, PR China
| | - Shiliang Sun
- School of Computer Science and Technology, East China Normal University, Shanghai, Shanghai 200062 China
| | - Jinbo Bi
- Department of Computer Science, University of Connecticut, Storrs, CT 06269 USA
| |
Collapse
|
11
|
Prediction of Short-Term Stock Price Trend Based on Multiview RBF Neural Network. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:8495288. [PMID: 34876898 PMCID: PMC8645385 DOI: 10.1155/2021/8495288] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Revised: 11/11/2021] [Accepted: 11/18/2021] [Indexed: 11/18/2022]
Abstract
Stock price prediction is important in both financial and commercial domains, and using neural networks to forecast stock prices has been a topic of ongoing research and development. Traditional prediction models are often based on a single type of data and do not account for the interplay of many variables. This study covers a radial basis neural network modeling technique with multiview collaborative learning capabilities for incorporating the impacts of numerous elements into the prediction model. This research offers a multiview RBF neural network prediction model based on the classic RBF network by integrating a collaborative learning item with multiview learning capabilities (MV-RBF). MV-RBF can make full use of both the internal information provided by the correlation between each view and the distinct characteristics of each view to form independent sample information. By using two separate stock qualities as input feature information for trials, this study proves the viability of the multiview RBF neural network prediction model on a real data set.
Collapse
|
12
|
A multi-level consensus function clustering ensemble. Soft comput 2021. [DOI: 10.1007/s00500-021-06092-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
13
|
|
14
|
Hua L, Xue J, Xia K, Zhou L, Qian P, Jiang Y. An Automatic Magnetic Resonance Brain Image Segmentation Method Using a Multitask Weighted Fuzzy Clustering Algorithm. JOURNAL OF MEDICAL IMAGING AND HEALTH INFORMATICS 2021. [DOI: 10.1166/jmihi.2021.3705] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
In clinical assisted diagnosis, it is an important way to obtain information with the help of medical images. Qualitative and quantitative analysis of brain tissue has become a research hotspot for brain diseases. Therefore, image segmentation technology is an indispensable link in
medical image analysis. Due to the defects such as ambiguity, complexity, gray-scale unevenness, partial volume effect in magnetic resonance brain images, it is essential to improve the segmentation performance of classical algorithms in medical images. In this paper, multitasking and weighted
fuzzy clustering algorithm are combined as a new algorithm (MT-WFCM) for MRI brain image segmentation. The proposed MT-WFCM algorithm improve the clustering performance of all tasks through common information between different magnetic resonance brain images with correlation. Besides, the
difference between MT-WFCM and MT-FCM is that task weights are added to avoid negative effects between tasks in the segmentation process. According to five different comparative experiments, the MT-WFCM algorithm can mine the cooperative relationship among each task and the characteristics
of each task effectively. In magnetic resonance image (MRI) segmentation, multi-task weighted fuzzy c-means clustering method can make up for the shortcomings of single-task clustering algorithm, strengthen the relationship between tasks, and get more accurate segmentation results.
Collapse
Affiliation(s)
- Lei Hua
- School of Artificial Intelligence and Computer Science, Jiangnan University, 1800 Lihu Avenue, Wuxi, Jiangsu 214122, People’s Republic of China
| | - Jing Xue
- Department of Nephrology, The Affiliated Wuxi People’s Hospital of Nanjing Medical University, Wuxi, Jiangsu 214023, People’s Republic of China
| | - Kaijian Xia
- Changshu No. 1 People’s Hospital, Changshu, Jiangsu 215500, People’s Republic of China
| | - Leyuan Zhou
- Department of Radiotherapy, Affiliated Hospital, Jiangnan University, Wuxi, Jiangsu 214062, Peoples Republic of China
| | - Pengjiang Qian
- School of Artificial Intelligence and Computer Science, Jiangnan University, 1800 Lihu Avenue, Wuxi, Jiangsu 214122, People’s Republic of China
| | - Yizhang Jiang
- School of Artificial Intelligence and Computer Science, Jiangnan University, 1800 Lihu Avenue, Wuxi, Jiangsu 214122, People’s Republic of China
| |
Collapse
|
15
|
Hong X. Basketball Data Analysis Using Spark Framework and K-Means Algorithm. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:6393560. [PMID: 34531967 PMCID: PMC8440079 DOI: 10.1155/2021/6393560] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Revised: 07/05/2021] [Accepted: 07/20/2021] [Indexed: 11/23/2022]
Abstract
With the rapid development, different information relating to sports may now be recorded forms of useful big data through wearable and sensing technology. Big data technology has become a pressing challenge to tackle in the present basketball training, which improves the effect of baseball analysis. In this study, we propose the Spark framework based on in-memory computing for big data processing. First, we use a new swarm intelligence optimization cuckoo search algorithm because the algorithm has fewer parameters, powerful global search ability, and support of fast convergence. Second, we apply the traditional K-clustering algorithm to improve the final output using clustering means in Spark distributed environment. Last, we examine the aspects that could lead to high-pressure game circumstances to study professional athletes' defensive performance. Both recruiters and trainers may use our technique to better understand essential player's qualities and eventually, to assess and improve a team's performance. The experimental findings reveal that the suggested approach outperforms previous methods in terms of clustering performance and practical utility. It has the greatest influence on the shooting training impact when moving, yielding complimentary outcomes in the training effect.
Collapse
Affiliation(s)
- Xijun Hong
- College of Sports Science, Dali University, Dali 671003, Yunnan, China
| |
Collapse
|
16
|
Automatic determining optimal parameters in multi-kernel collaborative fuzzy clustering based on dimension constraint. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2021.02.062] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
17
|
Medical Image Fusion Based on Low-Level Features. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:8798003. [PMID: 34221107 PMCID: PMC8211524 DOI: 10.1155/2021/8798003] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/06/2021] [Revised: 05/28/2021] [Accepted: 06/01/2021] [Indexed: 11/18/2022]
Abstract
Medical image fusion is an important technique to address the limited depth of the optical lens for a completely informative focused image. It can well improve the accuracy of diagnosis and assessment of medical problems. However, the difficulty of many traditional fusion methods in preserving all the significant features of the source images compromises the clinical accuracy of medical problems. Thus, we propose a novel medical image fusion method with a low-level feature to deal with the problem. We decompose the source images into base layers and detail layers with local binary pattern operators for obtaining low-level features. The low-level features of the base and detail layers are applied to construct weight maps by using saliency detection. The weight map optimized by fast guided filtering guides the fusion of base and detail layers to maintain the spatial consistency between the source images and their corresponding layers. The recombination of the fused base and detail layers constructs the final fused image. The experimental results demonstrated that the proposed method achieved a state-of-the-art performance for multifocus images.
Collapse
|
18
|
Gawali MB, Gawali SS. Optimized skill knowledge transfer model using hybrid Chicken Swarm plus Deer Hunting Optimization for human to robot interaction. Knowl Based Syst 2021. [DOI: 10.1016/j.knosys.2021.106945] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
19
|
Wen W. Sleep Quality Detection Based on EEG Signals Using Transfer Support Vector Machine Algorithm. Front Neurosci 2021; 15:670745. [PMID: 33967687 PMCID: PMC8104363 DOI: 10.3389/fnins.2021.670745] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Accepted: 03/15/2021] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND In recent years, with the acceleration of life rhythm and increased pressure, the problem of sleep disorders has become more and more serious. It affects people's quality of life and reduces work efficiency, so the monitoring and evaluation of sleep quality is of great significance. Sleep staging has an important reference value in sleep quality assessment. This article starts with the study of sleep staging to detect and analyze sleep quality. For the purpose of sleep quality detection, this article proposes a sleep quality detection method based on electroencephalography (EEG) signals. MATERIALS AND METHODS This method first preprocesses the EEG signals and then uses the discrete wavelet transform (DWT) for feature extraction. Finally, the transfer support vector machine (TSVM) algorithm is used to classify the feature data. RESULTS The proposed algorithm was tested using 60 pieces of data from the National Sleep Research Resource Library of the United States, and sleep quality was evaluated using three indicators: sensitivity, specificity, and accuracy. Experimental results show that the classification performance of the TSVM classifier is significantly higher than those of other comparison algorithms. This further validated the effectiveness of the proposed sleep quality detection method.
Collapse
Affiliation(s)
- Wu Wen
- Chongqing Technology and Business Institute, Chongqing, China
| |
Collapse
|
20
|
Ouyang T, Pedrycz W, Reyes-Galaviz OF, Pizzi NJ. Granular Description of Data Structures: A Two-Phase Design. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:1902-1912. [PMID: 30605118 DOI: 10.1109/tcyb.2018.2887115] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
The study is concerned with a description of large numeric data with the aid of building a limited collection of representative information granules with the objective of capturing the structure of the original data. The proposed development scheme consists of two steps. First, a clustering algorithm characterized by high flexibility of coping with the diverse geometry of data structure and efficient computational overhead is invoked. At the second step, a clustering algorithm applied to the clusters already formed during the first phase, yielding a collection of numeric prototypes is involved and the numeric prototypes produced there are then generalized into their granular prototypes. The quality of granular prototypes is quantified while their build-up is supported by the mechanisms of granular computing such as the principle of justifiable granularity. In this paper, the clustering algorithms of DBSCAN and fuzzy C -means were used in successive phases of the processed approach. The experimental studies concerning synthetic data and publicly available data are covered and the performance of the developed approach is assessed along with a comparative analysis.
Collapse
|
21
|
Hua L, Gu Y, Gu X, Xue J, Ni T. A Novel Brain MRI Image Segmentation Method Using an Improved Multi-View Fuzzy c-Means Clustering Algorithm. Front Neurosci 2021; 15:662674. [PMID: 33841095 PMCID: PMC8029590 DOI: 10.3389/fnins.2021.662674] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Accepted: 02/22/2021] [Indexed: 12/18/2022] Open
Abstract
Background: The brain magnetic resonance imaging (MRI) image segmentation method mainly refers to the division of brain tissue, which can be divided into tissue parts such as white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). The segmentation results can provide a basis for medical image registration, 3D reconstruction, and visualization. Generally, MRI images have defects such as partial volume effects, uneven grayscale, and noise. Therefore, in practical applications, the segmentation of brain MRI images has difficulty obtaining high accuracy. Materials and Methods: The fuzzy clustering algorithm establishes the expression of the uncertainty of the sample category and can describe the ambiguity brought by the partial volume effect to the brain MRI image, so it is very suitable for brain MRI image segmentation (B-MRI-IS). The classic fuzzy c-means (FCM) algorithm is extremely sensitive to noise and offset fields. If the algorithm is used directly to segment the brain MRI image, the ideal segmentation result cannot be obtained. Accordingly, considering the defects of MRI medical images, this study uses an improved multiview FCM clustering algorithm (IMV-FCM) to improve the algorithm’s segmentation accuracy of brain images. IMV-FCM uses a view weight adaptive learning mechanism so that each view obtains the optimal weight according to its cluster contribution. The final division result is obtained through the view ensemble method. Under the view weight adaptive learning mechanism, the coordination between various views is more flexible, and each view can be adaptively learned to achieve better clustering effects. Results: The segmentation results of a large number of brain MRI images show that IMV-FCM has better segmentation performance and can accurately segment brain tissue. Compared with several related clustering algorithms, the IMV-FCM algorithm has better adaptability and better clustering performance.
Collapse
Affiliation(s)
- Lei Hua
- School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China
| | - Yi Gu
- School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China
| | - Xiaoqing Gu
- School of Computer and Artificial Intelligence, Changzhou University, Changzhou, China
| | - Jing Xue
- Department of Nephrology, The Affiliated Wuxi People's Hospital of Nanjing Medical University, Wuxi, China
| | - Tongguang Ni
- School of Computer and Artificial Intelligence, Changzhou University, Changzhou, China
| |
Collapse
|
22
|
Tao Y, Jiang Y, Xia K, Xue J, Zhou L, Qian P. Classification of EEG signals in epilepsy using a novel integrated TSK fuzzy system. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2021. [DOI: 10.3233/jifs-201673] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
The use of machine learning technology to recognize electrical signals of the brain is becoming increasingly popular. Compared with doctors’ manual judgment, machine learning methods are faster. However, only when its recognition accuracy reaches a high level can it be used in practice. Due to the difference in the data distributions of the training dataset and the test dataset and the lack of training samples, the classification accuracies of general machine learning algorithms are not satisfactory. In fact, among the many machine learning methods used to process epilepsy electroencephalogram (EEG) signals, most are black box methods; however, in medicine, methods with explanatory power are needed. In response to these three challenges, this paper proposes a novel technique based on domain adaptation learning, semi-supervised learning and a fuzzy system. In detail, we use domain adaptation learning to reduce deviation from the data distribution, semi-supervised learning to compensate for the lack of training samples, and the Takagi-Sugen-Kang (TSK) fuzzy system model to improve interpretability. Our experimental results show that the performance of the new method is better than those of most advanced epilepsy classification methods.
Collapse
Affiliation(s)
- Yuwen Tao
- School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, Jiangsu, People’s Republic of China
- Jiangsu Key Laboratory of Media Design and Software Technology, Wuxi, Jiangsu, People’s Republic of China
| | - Yizhang Jiang
- School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, Jiangsu, People’s Republic of China
- Jiangsu Key Laboratory of Media Design and Software Technology, Wuxi, Jiangsu, People’s Republic of China
| | - Kaijian Xia
- Changshu No. 1 People’s Hospital, Changshu, Jiangsu, People’s Republic of China
- Jiangsu Key Laboratory of Media Design and Software Technology, Wuxi, Jiangsu, People’s Republic of China
| | - Jing Xue
- Department of Nephrology, the Affiliated Wuxi People’s Hospital of Nanjing Medical University, Wuxi, Jiangsu, People’s Republic of China
| | - Leyuan Zhou
- Department of Radiotherapy, Affiliated Hospital, Jiangnan University, Wuxi, Jiangsu, People’s Republic of China
| | - Pengjiang Qian
- School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, Jiangsu, People’s Republic of China
- Jiangsu Key Laboratory of Media Design and Software Technology, Wuxi, Jiangsu, People’s Republic of China
| |
Collapse
|
23
|
Hu X, Wang G, Duan J. Mining Maximal Dynamic Spatial Colocation Patterns. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2021; 32:1026-1036. [PMID: 32310783 DOI: 10.1109/tnnls.2020.2979875] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
A spatial colocation pattern represents a subset of spatial features with instances that are prevalently located together in a geographic space. Although many algorithms for mining spatial colocation patterns have been proposed, the following problems still remain. these methods miss certain meaningful patterns (e.g., {Ganoderma_lucidumnew, maple_treedead} and {water_hyacinthnew(increase), algaedead(decrease)}) and obtain a wrong conclusion if the instances of two or more features increase/decrease (i.e., new/dead) in the same/approximate proportion, which has no effect on the prevalent patterns; and the efficiency of existing methods is low in mining prevalent spatial colocation patterns, because the number of prevalent spatial colocation patterns is quite large. Therefore, we first propose the concept of a dynamic spatial colocation pattern that can reflect the dynamic relationships among spatial features. Second, we mine a small number of prevalent maximal dynamic spatial colocation patterns that can derive all prevalent dynamic spatial colocation patterns, which can improve the efficiency of obtaining all prevalent dynamic spatial colocation patterns. Third, we propose an algorithm for mining prevalent maximal dynamic spatial colocation patterns and two pruning strategies. Finally, the effectiveness and efficiency of the proposed method and the pruning strategies are verified by extensive experiments over real/synthetic data sets.
Collapse
|
24
|
Xu G, Ren T, Chen Y, Che W. A One-Dimensional CNN-LSTM Model for Epileptic Seizure Recognition Using EEG Signal Analysis. Front Neurosci 2021; 14:578126. [PMID: 33390878 PMCID: PMC7772824 DOI: 10.3389/fnins.2020.578126] [Citation(s) in RCA: 44] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2020] [Accepted: 11/10/2020] [Indexed: 11/13/2022] Open
Abstract
Frequent epileptic seizures cause damage to the human brain, resulting in memory impairment, mental decline, and so on. Therefore, it is important to detect epileptic seizures and provide medical treatment in a timely manner. Currently, medical experts recognize epileptic seizure activity through the visual inspection of electroencephalographic (EEG) signal recordings of patients based on their experience, which takes much time and effort. In view of this, this paper proposes a one-dimensional convolutional neural network-long short-term memory (1D CNN-LSTM) model for automatic recognition of epileptic seizures through EEG signal analysis. Firstly, the raw EEG signal data are pre-processed and normalized. Then, a 1D convolutional neural network (CNN) is designed to effectively extract the features of the normalized EEG sequence data. In addition, the extracted features are then processed by the LSTM layers in order to further extract the temporal features. After that, the output features are fed into several fully connected layers for final epileptic seizure recognition. The performance of the proposed 1D CNN-LSTM model is verified on the public UCI epileptic seizure recognition data set. Experiments results show that the proposed method achieves high recognition accuracies of 99.39% and 82.00% on the binary and five-class epileptic seizure recognition tasks, respectively. Comparing results with traditional machine learning methods including k-nearest neighbors, support vector machines, and decision trees, other deep learning methods including standard deep neural network and CNN further verify the superiority of the proposed method.
Collapse
Affiliation(s)
- Gaowei Xu
- Department of Cardiology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, Shanghai, China
| | - Tianhe Ren
- School of Informatics, Xiamen University, Xiamen, China
| | - Yu Chen
- Department of Dermatology & STD, Nantong First People's Hospital, Nantong, China
| | - Wenliang Che
- Department of Cardiology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, Shanghai, China
| |
Collapse
|
25
|
Yu X, Kang C, Guttery DS, Kadry S, Chen Y, Zhang YD. ResNet-SCDA-50 for Breast Abnormality Classification. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2021; 18:94-102. [PMID: 32287004 DOI: 10.1109/tcbb.2020.2986544] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
(Aim) Breast cancer is the most common cancer in women and the second most common cancer worldwide. With the rapid advancement of deep learning, the early stages of breast cancer development can be accurately detected by radiologists with the help of artificial intelligence systems. (Method) Based on mammographic imaging, a mainstream clinical breast screening technique, we present a diagnostic system for accurate classification of breast abnormalities based on ResNet-50. To improve the proposed model, we created a new data augmentation framework called SCDA (Scaling and Contrast limited adaptive histogram equalization Data Augmentation). In its procedure, we first conduct the scaling operation to the original training set, followed by applying contrast limited adaptive histogram equalisation (CLAHE) to the scaled training set. By stacking the training set after SCDA with the original training set, we formed a new training set. The network trained by the augmented training set, was coined as ResNet-SCDA-50. Our system, which aims at a binary classification on mammographic images acquired from INbreast and MINI-MIAS, classifies masses, microcalcification as "abnormal", while normal regions are classified as "normal". (Results) We present the first attempt to use the image contrast enhancement method as the data augmentation method, resulting in an averaged 98.55 percent specificity and 92.83 percent sensitivity, which gives our best model an overall accuracy of 95.74 percent. (Conclusion) Our proposed method is effective in classifying breast abnormality.
Collapse
|
26
|
Zhang Y, Chen J, Tan JH, Chen Y, Chen Y, Li D, Yang L, Su J, Huang X, Che W. An Investigation of Deep Learning Models for EEG-Based Emotion Recognition. Front Neurosci 2020; 14:622759. [PMID: 33424547 PMCID: PMC7785875 DOI: 10.3389/fnins.2020.622759] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Accepted: 11/26/2020] [Indexed: 12/04/2022] Open
Abstract
Emotion is the human brain reacting to objective things. In real life, human emotions are complex and changeable, so research into emotion recognition is of great significance in real life applications. Recently, many deep learning and machine learning methods have been widely applied in emotion recognition based on EEG signals. However, the traditional machine learning method has a major disadvantage in that the feature extraction process is usually cumbersome, which relies heavily on human experts. Then, end-to-end deep learning methods emerged as an effective method to address this disadvantage with the help of raw signal features and time-frequency spectrums. Here, we investigated the application of several deep learning models to the research field of EEG-based emotion recognition, including deep neural networks (DNN), convolutional neural networks (CNN), long short-term memory (LSTM), and a hybrid model of CNN and LSTM (CNN-LSTM). The experiments were carried on the well-known DEAP dataset. Experimental results show that the CNN and CNN-LSTM models had high classification performance in EEG-based emotion recognition, and their accurate extraction rate of RAW data reached 90.12 and 94.17%, respectively. The performance of the DNN model was not as accurate as other models, but the training speed was fast. The LSTM model was not as stable as the CNN and CNN-LSTM models. Moreover, with the same number of parameters, the training speed of the LSTM was much slower and it was difficult to achieve convergence. Additional parameter comparison experiments with other models, including epoch, learning rate, and dropout probability, were also conducted in the paper. Comparison results prove that the DNN model converged to optimal with fewer epochs and a higher learning rate. In contrast, the CNN model needed more epochs to learn. As for dropout probability, reducing the parameters by ~50% each time was appropriate.
Collapse
Affiliation(s)
- Yaqing Zhang
- Department of Cardiology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, Shanghai, China.,Department of Software Engineering,School of Informatics Xiamen University (National Demonstative Software School), Xiamen, China
| | - Jinling Chen
- Department of Software Engineering,School of Informatics Xiamen University (National Demonstative Software School), Xiamen, China
| | - Jen Hong Tan
- Department of Computer and Software, Institute of System Science, National University of Singapore, Singapore, Singapore
| | - Yuxuan Chen
- Department of Software Engineering,School of Informatics Xiamen University (National Demonstative Software School), Xiamen, China
| | - Yunyi Chen
- Department of Software Engineering,School of Informatics Xiamen University (National Demonstative Software School), Xiamen, China
| | - Dihan Li
- Department of Software Engineering,School of Informatics Xiamen University (National Demonstative Software School), Xiamen, China
| | - Lei Yang
- Department of Software Engineering,School of Informatics Xiamen University (National Demonstative Software School), Xiamen, China
| | - Jian Su
- Nanjing University of Information Science and Technology, Nanjing, China
| | - Xin Huang
- School of Software, Jiangxi Normal University, Nanchang, China
| | - Wenliang Che
- Department of Cardiology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, Shanghai, China
| |
Collapse
|
27
|
Knowledge representation and reasoning with industrial application using interval-valued intuitionistic fuzzy Petri nets and extended TOPSIS. INT J MACH LEARN CYB 2020. [DOI: 10.1007/s13042-020-01216-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
28
|
Intelligent Rehabilitation Assistance Tools for Distal Radius Fracture: A Systematic Review Based on Literatures and Mobile Application Stores. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2020; 2020:7613569. [PMID: 33062041 PMCID: PMC7542482 DOI: 10.1155/2020/7613569] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/14/2020] [Revised: 09/06/2020] [Accepted: 09/11/2020] [Indexed: 11/18/2022]
Abstract
Objective To systematically analyze the existing intelligent rehabilitation mobile applications (APPs) related to distal radius fracture (DRF) and evaluate their features and characteristics, so as to help doctors and patients to make evidence-based choice for appropriate intelligent-assisted rehabilitation. Methods Literatures which in regard to the intelligent rehabilitation tools of DRF were systematic retrieved from the PubMed, the Cochrane library, Wan Fang, and VIP Data. The effective APPs were systematically screened out through the APP markets of iOS and Android mobile platform, and the functional characteristics of different APPs were evaluated and analyzed. Results A total of 8 literatures and 31 APPs were included, which were divided into four categories: intelligent intervention, angle measurement, intelligent monitoring, and auxiliary rehabilitation games. These APPs provide support for the patients' home rehabilitation guidance and training and make up for the high cost and space limitations of traditional rehabilitation methods. The intelligent intervention category has the largest download ratio in the APP market. Angle measurement tools help DRF patients to measure the joint angle autonomously to judge the degree of rehabilitation, which is the most concentrated type of literature research. Some of the APPs and tools have obtained good clinical verification. However, due to the restrictions of cost, geographic authority, and applicable population, a large number of APPs still lack effective evidence to support popularization. Conclusion Patients with DRF could draw support from different kinds of APPs in order to fulfill personal need and promote self-management. Intelligent rehabilitation APPs play a positive role in the rehabilitation of patients, but the acceptance of the utilization for intelligent rehabilitation APPs is relatively low, which might need follow-up research to address the conundrum.
Collapse
|
29
|
Wang Z, Parvin H, Qasem SN, Tuan BA, Pho KH. Cluster ensemble selection using balanced normalized mutual information. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2020. [DOI: 10.3233/jifs-191531] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
A bad partition in an ensemble will be removed by a cluster ensemble selection framework from the final ensemble. It is the main idea in cluster ensemble selection to remove these partitions (bad partitions) from the selected ensemble. But still, it is likely that one of them contains some reliable clusters. Therefore, it may be reasonable to apply the selection phase on cluster level. To do this, a cluster evaluation metric is needed. Some of these metrics have been recently introduced; each of them has its limitations. The weak points of each method have been addressed in the paper. Subsequently, a new metric for cluster assessment has been introduced. The new measure is named Balanced Normalized Mutual Information (BNMI) criterion. It balances the deficiency of the traditional NMI-based criteria. Additionally, an innovative cluster ensemble approach has been proposed. To create the consensus partition considering the elected clusters, a set of different aggregation-functions (called also consensus-functions) have been utilized: the ones which are based upon the co-association matrix (CAM), the ones which are based on hyper graph partitioning algorithms, and the ones which are based upon intermediate space. The experimental study indicates that the state-of-the-art cluster ensemble methods are outperformed by the proposed cluster ensemble approach.
Collapse
Affiliation(s)
- Zecong Wang
- School of Computer Science and Cyberspace Security, Hainan University, China
| | - Hamid Parvin
- Institute of Research and Development, Duy Tan University, Da Nang, Vietnam
- Faculty of Information Technology, Duy Tan University, Da Nang, Vietnam
- Department of Computer Science, Nourabad Mamasani Branch, Islamic Azad University, Mamasani, Iran
| | - Sultan Noman Qasem
- Computer Science Department, College of Computer and Information Sciences, AI Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh, Saudi Arabia
- Computer Science Department, Faculty of Applied Science, Taiz University, Taiz, Yemen
| | - Bui Anh Tuan
- Department of Mathematics Education, Teachers College, Can Tho University, Can Tho City, Vietnam
| | - Kim-Hung Pho
- Fractional Calculus, Optimization and Algebra Research Group, Faculty of Mathematics and Statistics, Ton Duc Thang University, Ho Chi Minh City, Vietnam
| |
Collapse
|
30
|
Mahmoudi MR, Akbarzadeh H, Parvin H, Nejatian S, Rezaie V, Alinejad-Rokny H. Consensus function based on cluster-wise two level clustering. Artif Intell Rev 2020. [DOI: 10.1007/s10462-020-09862-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
31
|
|
32
|
Shi Y, Yu Z, Chen CLP, You J, Wong HS, Wang Y, Zhang J. Transfer Clustering Ensemble Selection. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:2872-2885. [PMID: 30596592 DOI: 10.1109/tcyb.2018.2885585] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Clustering ensemble (CE) takes multiple clustering solutions into consideration in order to effectively improve the accuracy and robustness of the final result. To reduce redundancy as well as noise, a CE selection (CES) step is added to further enhance performance. Quality and diversity are two important metrics of CES. However, most of the CES strategies adopt heuristic selection methods or a threshold parameter setting to achieve tradeoff between quality and diversity. In this paper, we propose a transfer CES (TCES) algorithm which makes use of the relationship between quality and diversity in a source dataset, and transfers it into a target dataset based on three objective functions. Furthermore, a multiobjective self-evolutionary process is designed to optimize these three objective functions. Finally, we construct a transfer CE framework (TCE-TCES) based on TCES to obtain better clustering results. The experimental results on 12 transfer clustering tasks obtained from the 20newsgroups dataset show that TCE-TCES can find a better tradeoff between quality and diversity, as well as obtaining more desirable clustering results.
Collapse
|
33
|
Fast Enhanced Exemplar-Based Clustering for Incomplete EEG Signals. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2020; 2020:4147807. [PMID: 32454881 PMCID: PMC7231425 DOI: 10.1155/2020/4147807] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Accepted: 02/27/2020] [Indexed: 11/17/2022]
Abstract
The diagnosis and treatment of epilepsy is a significant direction for both machine learning and brain science. This paper newly proposes a fast enhanced exemplar-based clustering (FEEC) method for incomplete EEG signal. The algorithm first compresses the potential exemplar list and reduces the pairwise similarity matrix. By processing the most complete data in the first stage, FEEC then extends the few incomplete data into the exemplar list. A new compressed similarity matrix will be constructed and the scale of this matrix is greatly reduced. Finally, FEEC optimizes the new target function by the enhanced α-expansion move method. On the other hand, due to the pairwise relationship, FEEC also improves the generalization of this algorithm. In contrast to other exemplar-based models, the performance of the proposed clustering algorithm is comprehensively verified by the experiments on two datasets.
Collapse
|
34
|
Jiang Z, Bian Z, Wang S. Multi-view local linear KNN classification: theoretical and experimental studies on image classification. INT J MACH LEARN CYB 2020. [DOI: 10.1007/s13042-019-00992-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
35
|
Zhang GY, Zhou YR, He XY, Wang CD, Huang D. One-step Kernel Multi-view Subspace Clustering. Knowl Based Syst 2020. [DOI: 10.1016/j.knosys.2019.105126] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
36
|
Zhu D. Bibliometric analysis of patent infringement retrieval model based on self-organizing map neural network algorithm. LIBRARY HI TECH 2019. [DOI: 10.1108/lht-12-2018-0201] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Purpose
The purpose of this paper is to quickly retrieve the same or similar patents in a large patent database.
Design/methodology/approach
The research is carried out through the analysis of the issue of patent examination, the type of patent infringement search and theories related to patent infringement determination and text mining.
Findings
The results show that the model improves the speed of patent search. It can quickly, accurately and comprehensively retrieve the same or equivalent patents as the imported patent claims.
Research limitations/implications
The patent infringement detection mainly focuses on the measurement of patent similarity in the implementation method. It is not mature, and there is still much room for improvement in research.
Practical implications
The model improves the efficiency of patent infringement detection, increases the accuracy of detection and protects the interests of patent stakeholders.
Originality/value
This study has great significance for improving the efficiency of patent examiners.
Collapse
|
37
|
Diagnostic and Gradation Model of Osteoporosis Based on Improved Deep U-Net Network. J Med Syst 2019; 44:15. [PMID: 31811448 DOI: 10.1007/s10916-019-1502-3] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Accepted: 11/14/2019] [Indexed: 12/28/2022]
|
38
|
Zhang Y. Classification and Diagnosis of Thyroid Carcinoma Using Reinforcement Residual Network with Visual Attention Mechanisms in Ultrasound Images. J Med Syst 2019; 43:323. [PMID: 31612276 DOI: 10.1007/s10916-019-1448-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2019] [Accepted: 08/29/2019] [Indexed: 12/29/2022]
Abstract
How to differentiate thyroid cancer nodules from a large number of benign nodules is always a challenging subject for clinicians. This paper proposes a novel Sal-deel network model to achieve the classification and diagnosis of thyroid cancer, which can simulate visual attention mechanism. The Sal-deep network introduces saliency map as an additional information on the deep residual network, which selectively enhances the feature extracted from different regions according to the mask map. Sal-deep network can work effectively for the benchmark networks with different data sets and different structures, and it is a universal network model. Sal-deep network increases the complexity of the network, but improves the efficiency of the network. A large number of qualitative and quantitative experiments show that our improved network is superior to other existing deep models in terms of classification accuracy rate and Recall, which is suitable for clinical application.
Collapse
Affiliation(s)
- Yanming Zhang
- Zhejiang Provincial People's Hospital, People's Hospital of Hangzhou Medical College, Hangzhou, 310014, Zhejiang, China.
| |
Collapse
|
39
|
Segmentation and Diagnosis of Liver Carcinoma Based on Adaptive Scale-Kernel Fuzzy Clustering Model for CT Images. J Med Syst 2019; 43:322. [PMID: 31602537 DOI: 10.1007/s10916-019-1459-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2019] [Accepted: 09/11/2019] [Indexed: 01/17/2023]
Abstract
Medical image analysis plays an important role in computer-aided liver-carcinoma diagnosis. Aiming at the existing image fuzzy clustering segmentation being not suitable to segment CT image with non-uniform background, a fast robust kernel space fuzzy clustering segmentation algorithm is proposed. Firstly, the sample in euclidean space is mapped into the high dimensional feature space through the kernel function. Then the linear weighted filtering image is obtained by combining the current pixel with its neighborhood pixels through the space information in CT image. Finally, the two-dimensional histogram between the clustered pixel and its neighborhood mean is introduced into the robust kernel space image fuzzy clustering, and the iterative expression of the fast robust fuzzy clustering in kernel space is obtained by using Lagrange multiplier method. The experimental results on four databases show that our proposed method can segment liver tumors from abdominal CT volumes effectively and automatically, and the comprehensive segmentation performance of the proposed method is superior to that of several existing methods.
Collapse
|
40
|
Nonnegative matrix tri-factorization with user similarity for clustering in point-of-interest. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2019.07.040] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
41
|
Context Attention Heterogeneous Network Embedding. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2019; 2019:8106073. [PMID: 31531010 PMCID: PMC6721026 DOI: 10.1155/2019/8106073] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/09/2019] [Revised: 07/11/2019] [Accepted: 07/17/2019] [Indexed: 11/17/2022]
Abstract
Network embedding (NE), which maps nodes into a low-dimensional latent Euclidean space to represent effective features of each node in the network, has obtained considerable attention in recent years. Many popular NE methods, such as DeepWalk, Node2vec, and LINE, are capable of handling homogeneous networks. However, nodes are always fully accompanied by heterogeneous information (e.g., text descriptions, node properties, and hashtags) in the real-world network, which remains a great challenge to jointly project the topological structure and different types of information into the fixed-dimensional embedding space due to heterogeneity. Besides, in the unweighted network, how to quantify the strength of edges (tightness of connections between nodes) accurately is also a difficulty faced by existing methods. To bridge the gap, in this paper, we propose CAHNE (context attention heterogeneous network embedding), a novel network embedding method, to accurately determine the learning result. Specifically, we propose the concept of node importance to measure the strength of edges, which can better preserve the context relations of a node in unweighted networks. Moreover, text information is a widely ubiquitous feature in real-world networks, e.g., online social networks and citation networks. On account of the sophisticated interactions between the network structure and text features of nodes, CAHNE learns context embeddings for nodes by introducing the context node sequence, and the attention mechanism is also integrated into our model to better reflect the impact of context nodes on the current node. To corroborate the efficacy of CAHNE, we apply our method and various baseline methods on several real-world datasets. The experimental results show that CAHNE achieves higher quality compared to a number of state-of-the-art network embedding methods on the tasks of network reconstruction, link prediction, node classification, and visualization.
Collapse
|
42
|
Wang J, Zu H, Guo H, Bi R, Cheng Y, Tamura S. Patient-specific probabilistic atlas combining modified distance regularized level set for automatic liver segmentation in CT. Comput Assist Surg (Abingdon) 2019; 24:20-26. [PMID: 31401890 DOI: 10.1080/24699322.2019.1649076] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022] Open
Abstract
Liver segmentation from CT is regarded as a prerequisite for computer-assisted clinical applications. However, automatic liver segmentation technology still faces challenges due to the variable shapes and low contrast. In this paper, a patient-specific probabilistic atlas (PA)-based method combing modified distance regularized level set for liver segmentation is proposed. Firstly, the similarities between training atlases and testing patient image are calculated, resulting in a series of weighted atlas, which are used to generate the patient-specific PA. Then, a most likely liver region (MLLR) can be determined based on the patient-specific PA. Finally, the refinement is performed by the modified distance regularized level set model, which takes advantage of both edge and region information as balloon force. We evaluated our proposed scheme based on 35 public datasets, and experimental result shows that the proposed method can be deployed for robust and precise liver segmentation, to replace the tedious and time-consuming manual method.
Collapse
Affiliation(s)
- Jinke Wang
- Department of Software Engineering, Harbin University of Science and Technology , Rongcheng , China.,Center for Advanced Medical Engineering and Informatics, Osaka University , Suita , Japan
| | - Hongliang Zu
- School of Computer Science and Technology, Harbin University of Science and Technology , Harbin , China
| | - Haoyan Guo
- School of Computer Science and Technology, Harbin Institute of Technology , Harbin , China
| | - Rongrong Bi
- Department of Software Engineering, Harbin University of Science and Technology , Rongcheng , China
| | - Yuanzhi Cheng
- School of Computer Science and Technology, Harbin Institute of Technology , Harbin , China
| | - Shinichi Tamura
- Center for Advanced Medical Engineering and Informatics, Osaka University , Suita , Japan
| |
Collapse
|
43
|
Wang J, Wang Q, Zhang H, Chen J, Wang S, Shen D. Sparse Multiview Task-Centralized Ensemble Learning for ASD Diagnosis Based on Age- and Sex-Related Functional Connectivity Patterns. IEEE TRANSACTIONS ON CYBERNETICS 2019; 49:3141-3154. [PMID: 29994137 PMCID: PMC6411442 DOI: 10.1109/tcyb.2018.2839693] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
Autism spectrum disorder (ASD) is an age- and sex-related neurodevelopmental disorder that alters the brain's functional connectivity (FC). The changes caused by ASD are associated with different age- and sex-related patterns in neuroimaging data. However, most contemporary computer-assisted ASD diagnosis methods ignore the aforementioned age-/sex-related patterns. In this paper, we propose a novel sparse multiview task-centralized (Sparse-MVTC) ensemble classification method for image-based ASD diagnosis. Specifically, with the age and sex information of each subject, we formulate the classification as a multitask learning problem, where each task corresponds to learning upon a specific age/sex group. We also extract multiview features per subject to better reveal the FC changes. Then, in Sparse-MVTC learning, we select a certain central task and treat the rest as auxiliary tasks. By considering both task-task and view-view relationships between the central task and each auxiliary task, we can learn better upon the entire dataset. Finally, by selecting the central task, in turn, we are able to derive multiple classifiers for each task/group. An ensemble strategy is further adopted, such that the final diagnosis can be integrated for each subject. Our comprehensive experiments on the ABIDE database demonstrate that our proposed Sparse-MVTC ensemble learning can significantly outperform the state-of-the-art classification methods for ASD diagnosis.
Collapse
Affiliation(s)
- Jun Wang
- Department of Radiology and BRIC, School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA, also with the School of Digital Media, Jiangnan University, Wuxi 214122, China, and also with the Jiangsu Key Laboratory of Media Design and Software Technology, Jiangnan University, Wuxi 214122, China ()
| | - Qian Wang
- Institute for Medical Imaging Technology, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai 200030, China ()
| | - Han Zhang
- Department of Radiology and BRIC, School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA ()
| | - Jiawei Chen
- Department of Radiology and BRIC, School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA ()
| | - Shitong Wang
- School of Digital Media, Jiangnan University, Wuxi 214122, China, and also with the Jiangsu Key Laboratory of Media Design and Software Technology, Jiangnan University, Wuxi 214122, China ()
| | - Dinggang Shen
- Department of Radiology and BRIC, School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA, and also with the Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, South Korea ()
| |
Collapse
|
44
|
Zhai J, Li H. An Improved Full Convolutional Network Combined with Conditional Random Fields for Brain MR Image Segmentation Algorithm and its 3D Visualization Analysis. J Med Syst 2019; 43:292. [PMID: 31338693 DOI: 10.1007/s10916-019-1424-0] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2019] [Accepted: 07/14/2019] [Indexed: 01/27/2023]
Abstract
Existing brain region segmentation algorithms based on deep convolutional neural networks (CNN) are inefficient for object boundary segmentation. In order to enhance the segmentation accuracy of brain tissue, this paper proposed an object region segmentation algorithm that combines pixel-level information and semantic information. Firstly, we extract semantic information by CNN with the attention module and get the coarse segmentation results through a specific pixel-level classifier. Then, we exploit conditional random fields to model the relationship between the underlying pixels so as to get local features. Finally, the semantic information and the local pixel-level information are respectively used as the unary potential and the binary potential of the Gibbs distribution, and the combination of both can obtain the fine region segmentation algorithm based on the fusion of pixel-level information and the semantic information. A large number of qualitative and quantitative test results show that our proposed algorithm has higher precision than the existing state-of-the-art deep feature models, which can better solve the problem of rough edge segmentation and produce good 3D visualization effect.
Collapse
Affiliation(s)
- Jiemin Zhai
- Department of Neurology, Xi'an XD Group Hospital, Xi'an, 710077, Shaanxi, China.
| | - Huiqi Li
- Department of Neurology, Xi'an XD Group Hospital, Xi'an, 710077, Shaanxi, China
| |
Collapse
|
45
|
Jiang Z, Zhou J, Zhang Y, Wang S. A novel multi-view SVM based on consistent hidden density distributions between views for face recognition. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2019. [DOI: 10.3233/jifs-181048] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Zhibin Jiang
- School of Digital Media, Jiangnan University, Wuxi, Jiangsu, P.R. China
| | - Jie Zhou
- School of Digital Media, Jiangnan University, Wuxi, Jiangsu, P.R. China
| | - Yuanpeng Zhang
- School of Digital Media, Jiangnan University, Wuxi, Jiangsu, P.R. China
- School of Medical Informatics, Nantong University, Nantong, Jiangsu, P.R. China
| | - Shitong Wang
- School of Digital Media, Jiangnan University, Wuxi, Jiangsu, P.R. China
| |
Collapse
|
46
|
A differential privacy protecting K-means clustering algorithm based on contour coefficients. PLoS One 2018; 13:e0206832. [PMID: 30462662 PMCID: PMC6248925 DOI: 10.1371/journal.pone.0206832] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2018] [Accepted: 10/13/2018] [Indexed: 12/01/2022] Open
Abstract
This paper, based on differential privacy protecting K-means clustering algorithm, realizes privacy protection by adding data-disturbing Laplace noise to cluster center point. In order to solve the problem of Laplace noise randomness which causes the center point to deviate, especially when poor availability of clustering results appears because of small privacy budget parameters, an improved differential privacy protecting K-means clustering algorithm was raised in this paper. The improved algorithm uses the contour coefficients to quantitatively evaluate the clustering effect of each iteration and add different noise to different clusters. In order to be adapted to the huge number of data, this paper provides an algorithm design in MapReduce Framework. Experimental finding shows that the new algorithm improves the availability of the algorithm clustering results under the condition of ensuring individual privacy without significantly increasing its operating time.
Collapse
|
47
|
Zhong W, Tan D, Peng X, Tang Y, He W. Fuzzy high-order hybrid clustering algorithm for swarm intelligence sets. Neurocomputing 2018. [DOI: 10.1016/j.neucom.2018.03.019] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
48
|
Ren X, Bedini T. A fuzzy clustering algorithm for Internet customer group behavior data. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2018. [DOI: 10.3233/jifs-169744] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Xinglong Ren
- College of Science, Huazhong Agricultural University, Wuhan, Hubei, China
| | - T.H. Bedini
- School of Economics, Yonsei University, Seoul, South Korea
| |
Collapse
|
49
|
Liu AA, Xu N, Nie WZ, Su YT, Zhang YD. Multi-Domain & Multi-Task Learning for Human Action Recognition. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2018; 28:853-867. [PMID: 30281454 DOI: 10.1109/tip.2018.2872879] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Domain-invariant (view-invariant & modalityinvariant) feature representation is essential for human action recognition. Moreover, given a discriminative visual representation, it is critical to discover the latent correlations among multiple actions in order to facilitate action modeling. To address these problems, we propose a multi-domain & multi-task learning (MDMTL) method to (1) extract domain-invariant information for multi-view and multi-modal action representation and (2) explore the relatedness among multiple action categories. Specifically, we present a sparse transfer learning-based method to co-embed multi-domain (multi-view & multi-modality) data into a single common space for discriminative feature learning. Additionally, visual feature learning is incorporated into the multitask learning framework, with the Frobenius-norm regularization term and the sparse constraint term, for joint task modeling and task relatedness-induced feature learning. To the best of our knowledge, MDMTL is the first supervised framework to jointly realize domain-invariant feature learning and task modeling for multi-domain action recognition. Experiments conducted on the INRIA Xmas Motion Acquisition Sequences (IXMAS) dataset, the MSR Daily Activity 3D (DailyActivity3D) dataset, and the Multi-modal & Multi-view & Interactive (M2I) dataset, which is the most recent and largest multi-view and multi-model action recognition dataset, demonstrate the superiority of MDMTL over the state-of-the-art approaches.
Collapse
|
50
|
Feng DD, Fulham M. Multi-view collaborative segmentation for prostate MRI images. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2018; 2017:3529-3532. [PMID: 29060659 DOI: 10.1109/embc.2017.8037618] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Prostate delineation from MRI images is a prolonged challenging issue partially due to appearance variations across patients and disease progression. To address these challenges, our proposed collaborative method takes into account the computed multiple label-relevance maps as multiple views for learning the optimal boundary delineation. In our method, we firstly extracted multiple label-relevance maps to represent the affinities between each unlabeled pixel to the pre-defined labels to avoid the selection of handcrafted features. Then these maps were incorporated in a collaborative clustering to learn the adaptive weights for an optimal segmentation which overcomes the seeds selection sensitivity problems. The segmentation results were evaluated over 22 prostate MRI patient studies with respect to dice similarity coefficient (DSC), absolute relative volume difference (ARVD) and average symmetric surface distance (ASSD) (mm). The results and t-Test demonstrated that the proposed method improved the segmentation accuracy and robustness and the improvement was statistically significant.
Collapse
|