1
|
Xin R, Zhang F, Zheng J, Zhang Y, Yu C, Feng X. SDBA: Score Domain-Based Attention for DNA N4-Methylcytosine Site Prediction from Multiperspectives. J Chem Inf Model 2024; 64:2839-2853. [PMID: 37646411 DOI: 10.1021/acs.jcim.3c00688] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
In tasks related to DNA sequence classification, choosing the appropriate encoding methods is challenging. Some of the methods encode sequences based on prior knowledge that limits the ability of the model to obtain multiperspective information from the sequences. We introduced a new trainable ensemble method based on the attention mechanism SDBA, which stands for Score Domain-Based Attention. Unlike other methods, we fed the task-independent encoding results into the models and dynamically ensembled features from different perspectives using the SDBA mechanism. This approach allows the model to acquire and weight sequence features voluntarily. SDBA is conceptually general and empirically powerful. It has achieved new state-of-the-art results on the benchmark data sets associated with DNA N4-methylcytosine site prediction.
Collapse
Affiliation(s)
- Ruihao Xin
- College of Information and Control Engineering, Jilin Institute of Chemical Technology, Jilin 130000, P.R. China
- College of Computer Science and Technology, and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, P.R. China
| | - Fan Zhang
- College of Information and Control Engineering, Jilin Institute of Chemical Technology, Jilin 130000, P.R. China
| | - Jiaxin Zheng
- College of Computer Science and Technology, and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, P.R. China
| | - Yangyi Zhang
- University of Melbourne Centre for Cancer Research, Victorian Comprehensive Cancer Centre, University of Melbourne, Parkville, Victoria 3050, Australia
| | - Cuinan Yu
- College of Computer Science and Technology, and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, P.R. China
| | - Xin Feng
- School of Science, Jilin Institute of Chemical Technology, Jilin 130000, P.R. China
- State Key Laboratory of Inorganic Synthesis and Preparative Chemistry, College of Chemistry, Jilin University, Changchun 130012, P.R. China
| |
Collapse
|
2
|
Philip MM, Welch A, McKiddie F, Nath M. A systematic review and meta-analysis of predictive and prognostic models for outcome prediction using positron emission tomography radiomics in head and neck squamous cell carcinoma patients. Cancer Med 2023; 12:16181-16194. [PMID: 37353996 PMCID: PMC10469753 DOI: 10.1002/cam4.6278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Revised: 06/07/2023] [Accepted: 06/11/2023] [Indexed: 06/25/2023] Open
Abstract
BACKGROUND Positron emission tomography (PET) images of head and neck squamous cell carcinoma (HNSCC) patients can assess the functional and biochemical processes at cellular levels. Therefore, PET radiomics-based prediction and prognostic models have the potentials to understand tumour heterogeneity and assist clinicians with diagnosis, prognosis and management of the disease. We conducted a systematic review of published modelling information to evaluate the usefulness of PET radiomics in the prediction and prognosis of HNSCC patients. METHODS We searched bibliographic databases (MEDLINE, Embase, Web of Science) from 2010 to 2021 and considered 31 studies with pre-defined inclusion criteria. We followed the CHARMS checklist for data extraction and performed quality assessment using the PROBAST tool. We conducted a meta-analysis to estimate the accuracy of the prediction and prognostic models using the diagnostic odds ratio (DOR) and average C-statistic, respectively. RESULTS Manual segmentation method followed by 40% of the maximum standardised uptake value (SUVmax ) thresholding is a commonly used approach. The area under the receiver operating curves of externally validated prediction models ranged between 0.60-0.87, 0.65-0.86 and 0.62-0.75 for overall survival, distant metastasis and recurrence, respectively. Most studies highlighted an overall high risk of bias (outcome definition, statistical methodologies and external validation of models) and high unclear concern in terms of applicability. The meta-analysis showed the estimated pooled DOR of 6.75 (95% CI: 4.45, 10.23) for prediction models and the C-statistic of 0.71 (95% CI: 0.67, 0.74) for prognostic models. CONCLUSIONS Both prediction and prognostic models using clinical variables and PET radiomics demonstrated reliable accuracy for detecting adverse outcomes in HNSCC, suggesting the prospect of PET radiomics in clinical settings for diagnosis, prognosis and management of HNSCC patients. Future studies of prediction and prognostic models should emphasise the quality of reporting, external model validation, generalisability to real clinical scenarios and enhanced reproducibility of results.
Collapse
Affiliation(s)
| | - Andy Welch
- Institute of Education in Healthcare and Medical Sciences, University of AberdeenAberdeenUK
| | | | - Mintu Nath
- Institute of Applied Health Sciences, University of AberdeenAberdeenUK
| |
Collapse
|
3
|
Zoo: Selecting Transcriptomic and Methylomic Biomarkers by Ensembling Animal-Inspired Swarm Intelligence Feature Selection Algorithms. Genes (Basel) 2021; 12:genes12111814. [PMID: 34828418 PMCID: PMC8621246 DOI: 10.3390/genes12111814] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Revised: 11/12/2021] [Accepted: 11/15/2021] [Indexed: 02/03/2023] Open
Abstract
Biological omics data such as transcriptomes and methylomes have the inherent “large p small n” paradigm, i.e., the number of features is much larger than that of the samples. A feature selection (FS) algorithm selects a subset of the transcriptomic or methylomic biomarkers in order to build a better prediction model. The hidden patterns in the FS solution space make it challenging to achieve a feature subset with satisfying prediction performances. Swarm intelligence (SI) algorithms mimic the target searching behaviors of various animals and have demonstrated promising capabilities in selecting features with good machine learning performances. Our study revealed that different SI-based feature selection algorithms contributed complementary searching capabilities in the FS solution space, and their collaboration generated a better feature subset than the individual SI feature selection algorithms. Nine SI-based feature selection algorithms were integrated to vote for the selected features, which were further refined by the dynamic recursive feature elimination framework. In most cases, the proposed Zoo algorithm outperformed the existing feature selection algorithms on transcriptomics and methylomics datasets.
Collapse
|
4
|
Females and Males Show Differences in Early-Stage Transcriptomic Biomarkers of Lung Adenocarcinoma and Lung Squamous Cell Carcinoma. Diagnostics (Basel) 2021; 11:diagnostics11020347. [PMID: 33669819 PMCID: PMC7922551 DOI: 10.3390/diagnostics11020347] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Revised: 02/15/2021] [Accepted: 02/17/2021] [Indexed: 12/25/2022] Open
Abstract
The incidence and mortality rates of lung cancers are different between females and males. Therefore, sex information should be an important part of how to train and optimize a diagnostic model. However, most of the existing studies do not fully utilize this information. This study carried out a comparative investigation between sex-specific models and sex-independent models. Three feature selection algorithms and five classifiers were utilized to evaluate the contribution of the sex information to the detection of early-stage lung cancers. Both lung adenocarcinoma (LUAD) and lung squamous cell carcinoma (LUSC) showed that the sex-specific models outperformed the sex-independent detection of early-stage lung cancers. The Venn plots suggested that females and males shared only a few transcriptomic biomarkers of early-stage lung cancers. Our experimental data suggested that sex information should be included in optimizing disease diagnosis models.
Collapse
|
5
|
Kaur B, Goyal B, Daniel E. A survey on Machine learning based Medical Assistive systems in Current Oncological Sciences. Curr Med Imaging 2021; 18:445-459. [PMID: 33596810 DOI: 10.2174/1573405617666210217154446] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2020] [Revised: 12/04/2020] [Accepted: 01/15/2021] [Indexed: 11/22/2022]
Abstract
BACKGROUND Cancer is one of the life threatening disease which is affecting a large number of population worldwide. The cancer cells multiply inside the body without showing much symptoms on the surface of the skin thereby making it difficult to predict and detect at the onset of disease. Many organizations are working towards automating the process of cancer detection with minimal false detection rates. INTRODUCTION The machine learning algorithms serve to be a promising alternative to support health care practitioners to rule out the disease and predict the growth with various imaging and statistical analysis tools. The medical practitioners are utilizing the output of these algorithms to diagnose and design the course of treatment. These algorithms are capable of finding out the risk level of the patient and can reduce the mortality rate concerning to cancer disease. METHOD This article presents the existing state of art techniques for identifying cancer affecting human organs based on machine learning models. The supported set of imaging operations are also elaborated for each type of Cancer. CONCLUSION The CAD tools are the aid for the diagnostic radiologists for preliminary investigations and detecting the nature of tumor cells.
Collapse
Affiliation(s)
| | | | - Ebenezer Daniel
- City of Hope, National Medical Centre, California. United States
| |
Collapse
|
6
|
Han Y, Huang L, Zhou F. A dynamic recursive feature elimination framework (dRFE) to further refine a set of OMIC biomarkers. Bioinformatics 2021; 37:2183-2189. [PMID: 33515240 DOI: 10.1093/bioinformatics/btab055] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Revised: 12/23/2020] [Accepted: 01/25/2021] [Indexed: 11/14/2022] Open
Abstract
MOTIVATION A feature selection algorithm may select the subset of features with the best associations with the class labels. The recursive feature elimination (RFE) is a heuristic feature screening framework and has been widely used to select the biological OMIC biomarkers. This study proposed a dynamic recursive feature elimination (dRFE) framework with more flexible feature elimination operations. The proposed dRFE was comprehensively compared with 11 existing feature selection algorithms and five classifiers on the eight difficult transcriptome datasets from a previous study, the ten newly collected transcriptome datasets and the five methylome datasets. RESULTS The experimental data suggested that the regular RFE framework did not perform well, and dRFE outperformed the existing feature selection algorithms in most cases. The dRFE-detected features achieved Acc=1.0000 for the two methylome datasets GSE53045 and GSE66695. The best prediction accuracies of the dRFE-detected features were 0.9259, 0.9424, and 0.8601 for the other three methylome datasets GSE74845, GSE103186, and GSE80970, respectively. Four transcriptome datasets received Acc=1.0000 using the dRFE-detected features, and the prediction accuracies for the other six newly collected transcriptome datasets were between 0.6301 and 0.9917. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Yuanyuan Han
- College of Computer Science and Technology, and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China, 130012
| | - Lan Huang
- College of Computer Science and Technology, and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China, 130012
| | - Fengfeng Zhou
- College of Computer Science and Technology, and Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China, 130012
| |
Collapse
|
7
|
Zhang Y, Chen C, Duan M, Liu S, Huang L, Zhou F. BioDog, biomarker detection for improving identification power of breast cancer histologic grade in methylomics. Epigenomics 2019; 11:1717-1732. [PMID: 31625763 DOI: 10.2217/epi-2019-0230] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
Aim: Breast cancer histologic grade (HG) is a well-established prognostic factor. This study aimed to select methylomic biomarkers to predict breast cancer HGs. Materials & methods: The proposed algorithm BioDog firstly used correlation bias reduction strategy to eliminate redundant features. Then incremental feature selection was applied to find the features with a high HG prediction accuracy. The sequential backward feature elimination strategy was employed to further refine the biomarkers. A comparison with existing algorithms were conducted. The HG-specific somatic mutations were investigated. Results & conclusions: BioDog achieved accuracy 0.9973 using 92 methylomic biomarkers for predicting breast cancer HGs. Many of these biomarkers were within the genes and lncRNAs associated with the HG development in breast cancer or other cancer types.
Collapse
Affiliation(s)
- Yexian Zhang
- College of Computer Science & Technology, & Key Laboratory of Symbolic Computation & Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin 130012, PR China
| | - Chaorong Chen
- College of Software, Jilin University, Changchun, Jilin 130012, PR China
| | - Meiyu Duan
- College of Computer Science & Technology, & Key Laboratory of Symbolic Computation & Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin 130012, PR China
| | - Shuai Liu
- College of Computer Science & Technology, & Key Laboratory of Symbolic Computation & Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin 130012, PR China
| | - Lan Huang
- College of Computer Science & Technology, & Key Laboratory of Symbolic Computation & Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin 130012, PR China
| | - Fengfeng Zhou
- College of Computer Science & Technology, & Key Laboratory of Symbolic Computation & Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin 130012, PR China
| |
Collapse
|
8
|
Chen Z, Pang M, Zhao Z, Li S, Miao R, Zhang Y, Feng X, Feng X, Zhang Y, Duan M, Huang L, Zhou F. Feature selection may improve deep neural networks for the bioinformatics problems. Bioinformatics 2019; 36:1542-1552. [DOI: 10.1093/bioinformatics/btz763] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2019] [Revised: 09/03/2019] [Accepted: 10/02/2019] [Indexed: 12/22/2022] Open
Abstract
Abstract
Motivation
Deep neural network (DNN) algorithms were utilized in predicting various biomedical phenotypes recently, and demonstrated very good prediction performances without selecting features. This study proposed a hypothesis that the DNN models may be further improved by feature selection algorithms.
Results
A comprehensive comparative study was carried out by evaluating 11 feature selection algorithms on three conventional DNN algorithms, i.e. convolution neural network (CNN), deep belief network (DBN) and recurrent neural network (RNN), and three recent DNNs, i.e. MobilenetV2, ShufflenetV2 and Squeezenet. Five binary classification methylomic datasets were chosen to calculate the prediction performances of CNN/DBN/RNN models using feature selected by the 11 feature selection algorithms. Seventeen binary classification transcriptome and two multi-class transcriptome datasets were also utilized to evaluate how the hypothesis may generalize to different data types. The experimental data supported our hypothesis that feature selection algorithms may improve DNN models, and the DBN models using features selected by SVM-RFE usually achieved the best prediction accuracies on the five methylomic datasets.
Availability and implementation
All the algorithms were implemented and tested under the programming environment Python version 3.6.6.
Supplementary information
Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Zheng Chen
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Meng Pang
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Zixin Zhao
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Shuainan Li
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Rui Miao
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Yifan Zhang
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Xiaoyue Feng
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Xin Feng
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Yexian Zhang
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Meiyu Duan
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Lan Huang
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Fengfeng Zhou
- BioKnow Health Informatics Lab, College of Computer Science and Technology
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| |
Collapse
|