An empirical study of ensemble-based semi-supervised learning approaches for imbalanced splice site datasets

A Supervised Ensemble Approach for Sensitive microRNA Target Prediction

MicroRNAs, a class of small non-coding RNAs, regulate important biological functions via post-transcriptional regulation of messenger RNAs (mRNAs). Despite rapid development in miRNA research, precise experimental methods to determine miRNA target interactions are still lacking. This motivated us to explore the in silico target interaction features and incorporate them in predictive modeling. We propose a systematic approach towards developing a sensitive miRNA target prediction model to explore the interplay of target recognition features. In the first step, we have employed a supervised ensemble under-sampling approach to address the problem of imbalance in the training dataset due to a larger number of negative instances. Various feature selection techniques were evaluated to obtain the optimal feature subset that best recognizes the true miRNA-mRNA targets. In the second step, we have built our optimal model, miRTPred, a novel blending ensemble-based approach that combines the predictions of the best performing traditional and classical ensemble models, through a weighted voting classifier, achieving a sensitivity of 87 percent and F1-score of 0.88 for 3'UTR region of the mRNA transcript. miRTPred outperforms popular machine learning (ML) and non-ML approaches to target prediction algorithms. miRTPred is freely available at http://bicresources.jcbose.ac.in/zhumur/mirtpred.

Multiobjective Semisupervised Classifier Ensemble

Classification of high-dimensional data with very limited labels is a challenging task in the field of data mining and machine learning. In this paper, we propose the multiobjective semisupervised classifier ensemble (MOSSCE) approach to address this challenge. Specifically, a multiobjective subspace selection process (MOSSP) in MOSSCE is first designed to generate the optimal combination of feature subspaces. Three objective functions are then proposed for MOSSP, which include the relevance of features, the redundancy between features, and the data reconstruction error. Then, MOSSCE generates an auxiliary training set based on the sample confidence to improve the performance of the classifier ensemble. Finally, the training set, combined with the auxiliary training set, is used to select the optimal combination of basic classifiers in the ensemble, train the classifier ensemble, and generate the final result. In addition, diversity analysis of the ensemble learning process is applied, and a set of nonparametric statistical tests is adopted for the comparison of semisupervised classification approaches on multiple datasets. The experiments on 12 gene expression datasets and two large image datasets show that MOSSCE has a better performance than other state-of-the-art semisupervised classifiers on high-dimensional data.

Progressive Semisupervised Learning of Multiple Classifiers

Semisupervised learning methods are often adopted to handle datasets with very small number of labeled samples. However, conventional semisupervised ensemble learning approaches have two limitations: 1) most of them cannot obtain satisfactory results on high dimensional datasets with limited labels and 2) they usually do not consider how to use an optimization process to enlarge the training set. In this paper, we propose the progressive semisupervised ensemble learning approach (PSEMISEL) to address the above limitations and handle datasets with very small number of labeled samples. When compared with traditional semisupervised ensemble learning approaches, PSEMISEL is characterized by two properties: 1) it adopts the random subspace technique to investigate the structure of the dataset in the subspaces and 2) a progressive training set generation process and a self evolutionary sample selection process are proposed to enlarge the training set. We also use a set of nonparametric tests to compare different semisupervised ensemble learning methods over multiple datasets. The experimental results on 18 real-world datasets from the University of California, Irvine machine learning repository show that PSEMISEL works well on most of the real-world datasets, and outperforms other state-of-the-art approaches on 10 out of 18 datasets.

An inference method from multi-layered structure of biomedical data

Background

Biological system is a multi-layered structure of omics with genome, epigenome, transcriptome, metabolome, proteome, etc., and can be further stretched to clinical/medical layers such as diseasome, drugs, and symptoms. One advantage of omics is that we can figure out an unknown component or its trait by inferring from known omics components. The component can be inferred by the ones in the same level of omics or the ones in different levels.

Methods

To implement the inference process, an algorithm that can be applied to the multi-layered complex system is required. In this study, we develop a semi-supervised learning algorithm that can be applied to the multi-layered complex system. In order to verify the validity of the inference, it was applied to the prediction problem of disease co-occurrence with a two-layered network composed of symptom-layer and disease-layer.

Results

The symptom-disease layered network obtained a fairly high value of AUC, 0.74, which is regarded as noticeable improvement when comparing 0.59 AUC of single-layered disease network. If further stretched to whole layered structure of omics, the proposed method is expected to produce more promising results.

Conclusion

This research has novelty in that it is a new integrative algorithm that incorporates the vertical structure of omics data, on contrary to other existing methods that integrate the data in parallel fashion. The results can provide enhanced guideline for disease co-occurrence prediction, thereby serve as a valuable tool for inference process of multi-layered biological system.