1
|
Wang Y, Flowers CR, Li Z, Huang X. CondiS web app: imputation of censored lifetimes for machine learning-based survival analysis. Bioinformatics 2022; 38:4252-4254. [PMID: 35801895 PMCID: PMC9438949 DOI: 10.1093/bioinformatics/btac461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 05/27/2022] [Accepted: 07/07/2022] [Indexed: 12/24/2022] Open
Abstract
SUMMARY In the era of big data, machine learning techniques are widely applied to every area in biomedical research including survival analysis. It is well recognized that censoring, which is a common missing issue in survival time data, hampers the direct usage of these machine learning techniques. Here, we present CondiS, a web toolkit with graphical user interface to help impute the survival times for censored observations and predict the survival times for future enrolled patients. CondiS imputes a censored survival time based on its distribution conditional on its observed part. When covariates are available, CondiS-X incorporates this information to further increase the imputation accuracy. Users can also upload data of newly enrolled patients and predict their survival times. As the first web-app tool with an imputation function for censored lifetime data, CondiS web can facilitate conducting survival analysis with machine learning approaches. AVAILABILITY AND IMPLEMENTATION CondiS is an open-source application implemented with Shiny in R, available free at: https://biostatistics.mdanderson.org/shinyapps/CondiS/. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Yizhuo Wang
- Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Christopher R Flowers
- Department of Lymphoma/Myeloma, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Ziyi Li
- To whom correspondence should be addressed. or
| | | |
Collapse
|
2
|
CondiS: A conditional survival distribution-based method for censored data imputation overcoming the hurdle in machine learning-based survival analysis. J Biomed Inform 2022; 131:104117. [PMID: 35690348 PMCID: PMC10099458 DOI: 10.1016/j.jbi.2022.104117] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2022] [Revised: 04/24/2022] [Accepted: 06/05/2022] [Indexed: 01/18/2023]
Abstract
Data analyses by machine learning (ML) algorithms are gaining popularity in biomedical research. When time-to-event data are of interest, censoring is common and needs to be properly addressed. Most ML methods cannot conveniently and appropriately take the censoring information into consideration, potentially leading to inaccurate or biased results. We aim to develop a general-purpose method for imputing censored survival data, facilitating downstream ML analysis. In this study, we propose a novel method of imputing the survival times for censored observations. The proposal is based on their conditional survival distributions (CondiS) derived from Kaplan-Meier estimators. CondiS can replace censored observations with their best approximations from the statistical model, allowing for direct application of ML methods. When covariates are available, we extend CondiS by incorporating the covariate information through ML modeling (CondiS-X), which further improves the accuracy of the imputed survival time. Compared with existing methods with similar purposes, the proposed methods achieved smaller prediction errors and higher concordance with the underlying true survival times in extensive simulation studies. We also demonstrated the usage and advantages of the proposed methods through two real-world cancer datasets. The major advantage of CondiS is that it allows for the direct application of standard ML techniques for analysis once the censored survival times are imputed. We present a user-friendly R package to implement our method, which is a useful tool for ML-based biomedical research in this era of big data.
Collapse
|
3
|
Wang L, Chen P, Chen S, Sun M. A novel approach to fully representing the diversity in conditional dependencies for learning Bayesian network classifier. INTELL DATA ANAL 2021. [DOI: 10.3233/ida-194959] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Bayesian network classifiers (BNCs) have proved their effectiveness and efficiency in the supervised learning framework. Numerous variations of conditional independence assumption have been proposed to address the issue of NP-hard structure learning of BNC. However, researchers focus on identifying conditional dependence rather than conditional independence, and information-theoretic criteria cannot identify the diversity in conditional (in)dependencies for different instances. In this paper, the maximum correlation criterion and minimum dependence criterion are introduced to sort attributes and identify conditional independencies, respectively. The heuristic search strategy is applied to find possible global solution for achieving the trade-off between significant dependency relationships and independence assumption. Our extensive experimental evaluation on widely used benchmark data sets reveals that the proposed algorithm achieves competitive classification performance compared to state-of-the-art single model learners (e.g., TAN, KDB, KNN and SVM) and ensemble learners (e.g., ATAN and AODE).
Collapse
Affiliation(s)
- Limin Wang
- College of Computer Science and Technology, Jilin University, Changchun, Jilin, China
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Peng Chen
- College of Computer Science and Technology, Jilin University, Changchun, Jilin, China
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| | - Shenglei Chen
- School of Economics, Nanjing Audit University, Nanjing, Jiangsu, China
| | - Minghui Sun
- College of Computer Science and Technology, Jilin University, Changchun, Jilin, China
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun, Jilin, China
| |
Collapse
|
4
|
Salman I. Learning the Structure of the Tree and Tree Augmented Naive Bayesian from Incomplete and Imbalanced Data. 2020 21ST INTERNATIONAL ARAB CONFERENCE ON INFORMATION TECHNOLOGY (ACIT) 2020. [DOI: 10.1109/acit50332.2020.9300091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/30/2023]
|
5
|
|
6
|
Tajik F, Wang M, Zhang X, Han J. Evaluation of the impact of body mass index on venous thromboembolism risk factors. PLoS One 2020; 15:e0235007. [PMID: 32645000 PMCID: PMC7347165 DOI: 10.1371/journal.pone.0235007] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2020] [Accepted: 06/06/2020] [Indexed: 12/23/2022] Open
Abstract
In this paper, we investigate the interaction impacts of body mass index (BMI) on the other important risk factors for venous thromboembolism (VTE), using deep venous thrombosis (DVT) patient data from the International Warfarin Pharmacogenetics Consortium (IWPC). We apply eight machine learning techniques, including naive Bayes classifier (NB), support vector machine (SVM), elastic net regression (ENET), logistic regression (LR), lasso regression (LAR), multivariate adaptive regression splines (MARS), boosted regression tree (BRT) and random forest model (RF). The RF method is selected as the best model for classification. Out of 33 features considered in this study, we identify 12 variables as relatively important risk factors for VTE. Finally, we examine the interaction impacts of BMI on these important VTE risk factors. We conclude that the impacts of risk factors on VTE incidence are varying across different BMI groups, and the variations are different for different risk factors. Therefore the interaction impacts of BMI on the other risk factors have to be taken into account in order to better understand the incidence of VTE.
Collapse
Affiliation(s)
- Fatemeh Tajik
- School of Economics and Management, Dalian University of Technology, Dalian, China
| | - Mingzheng Wang
- School of Management, Zhejiang University, Hangzhou, China
- * E-mail:
| | - Xiaohui Zhang
- Business School, University of Exeter, Exeter, England, United Kingdom
| | - Jie Han
- The First Affiliated Hospital, Zhejiang University, Hangzhou, China
| |
Collapse
|
7
|
Abd-Elsalam SM, Ezz MM, Gamalel-Din S, Esmat G, Salama A, ElHefnawi M. Early diagnosis of esophageal varices using Boosted-Naïve Bayes Tree: A multicenter cross-sectional study on chronic hepatitis C patients. INFORMATICS IN MEDICINE UNLOCKED 2020. [DOI: 10.1016/j.imu.2020.100421] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022] Open
|
8
|
Zhang Y, Wang L, Duan Z, Sun M. Structure Learning of Bayesian Network Based on Adaptive Thresholding. ENTROPY 2019; 21:e21070665. [PMID: 33267379 PMCID: PMC7515162 DOI: 10.3390/e21070665] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/01/2019] [Revised: 07/02/2019] [Accepted: 07/05/2019] [Indexed: 11/16/2022]
Abstract
Direct dependencies and conditional dependencies in restricted Bayesian network classifiers (BNCs) are two basic kinds of dependencies. Traditional approaches, such as filter and wrapper, have proved to be beneficial to identify non-significant dependencies one by one, whereas the high computational overheads make them inefficient especially for those BNCs with high structural complexity. Study of the distributions of information-theoretic measures provides a feasible approach to identifying non-significant dependencies in batch that may help increase the structure reliability and avoid overfitting. In this paper, we investigate two extensions to the k-dependence Bayesian classifier, MI-based feature selection, and CMI-based dependence selection. These two techniques apply a novel adaptive thresholding method to filter out redundancy and can work jointly. Experimental results on 30 datasets from the UCI machine learning repository demonstrate that adaptive thresholds can help distinguish between dependencies and independencies and the proposed algorithm achieves competitive classification performance compared to several state-of-the-art BNCs in terms of 0–1 loss, root mean squared error, bias, and variance.
Collapse
Affiliation(s)
- Yang Zhang
- College of Computer Science and Technology, Jilin University, Changchun 130012, China
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China
| | - Limin Wang
- College of Computer Science and Technology, Jilin University, Changchun 130012, China
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China
| | - Zhiyi Duan
- College of Computer Science and Technology, Jilin University, Changchun 130012, China
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China
| | - Minghui Sun
- College of Computer Science and Technology, Jilin University, Changchun 130012, China
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, Jilin University, Changchun 130012, China
- Correspondence:
| |
Collapse
|
9
|
Leguey I, Bielza C, Larrañaga P. Circular Bayesian classifiers using wrapped Cauchy distributions. DATA KNOWL ENG 2019. [DOI: 10.1016/j.datak.2019.05.005] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
10
|
Accuracy Enhanced Lung Cancer Prognosis for Improving Patient Survivability Using Proposed Gaussian Classifier System. J Med Syst 2019; 43:201. [DOI: 10.1007/s10916-019-1297-2] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2019] [Accepted: 04/16/2019] [Indexed: 10/26/2022]
|
11
|
Choe EK, Rhee H, Lee S, Shin E, Oh SW, Lee JE, Choi SH. Metabolic Syndrome Prediction Using Machine Learning Models with Genetic and Clinical Information from a Nonobese Healthy Population. Genomics Inform 2018; 16:e31. [PMID: 30602092 PMCID: PMC6440667 DOI: 10.5808/gi.2018.16.4.e31] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2018] [Accepted: 12/03/2018] [Indexed: 02/06/2023] Open
Abstract
The prevalence of metabolic syndrome (MS) in the nonobese population is not low. However, the identification and risk mitigation of MS are not easy in this population. We aimed to develop an MS prediction model using genetic and clinical factors of nonobese Koreans through machine learning methods. A prediction model for MS was designed for a nonobese population using clinical and genetic polymorphism information with five machine learning algorithms, including naïve Bayes classification (NB). The analysis was performed in two stages (training and test sets). Model A was designed with only clinical information (age, sex, body mass index, smoking status, alcohol consumption status, and exercise status), and for model B, genetic information (for 10 polymorphisms) was added to model A. Of the 7,502 nonobese participants, 647 (8.6%) had MS. In the test set analysis, for the maximum sensitivity criterion, NB showed the highest sensitivity: 0.38 for model A and 0.42 for model B. The specificity of NB was 0.79 for model A and 0.80 for model B. In a comparison of the performances of models A and B by NB, model B (area under the receiver operating characteristic curve [AUC] = 0.69, clinical and genetic information input) showed better performance than model A (AUC = 0.65, clinical information only input). We designed a prediction model for MS in a nonobese population using clinical and genetic information. With this model, we might convince nonobese MS individuals to undergo health checks and adopt behaviors associated with a preventive lifestyle.
Collapse
Affiliation(s)
- Eun Kyung Choe
- Department of Surgery, Seoul National University Hospital, Healthcare System Gangnam Center, Seoul 06236, Korea
| | | | | | | | - Seung-Won Oh
- Department of Family Medicine, Seoul National University Hospital, Healthcare System Gangnam Center, Seoul 06236, Korea
| | | | - Seung Ho Choi
- Department of Internal Medicine, Seoul National University Hospital, Healthcare System Gangnam Center, Seoul 06236, Korea
| |
Collapse
|
12
|
Lou H, Wang L, Duan D, Yang C, Mammadov M. RDE: A novel approach to improve the classification performance and expressivity of KDB. PLoS One 2018; 13:e0199822. [PMID: 30036402 PMCID: PMC6056076 DOI: 10.1371/journal.pone.0199822] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2017] [Accepted: 06/14/2018] [Indexed: 11/18/2022] Open
Abstract
Bayesian network classifiers (BNCs) have demonstrated competitive classification performance in a variety of real-world applications. A highly scalable BNC with high expressivity is extremely desirable. This paper proposes Redundant Dependence Elimination (RDE) for improving the classification performance and expressivity of k-dependence Bayesian classifier (KDB). To demonstrate the unique characteristics of each case, RDE identifies redundant conditional dependencies and then substitute/remove them. The learned personalized k-dependence Bayesian Classifier (PKDB) can achieve high-confidence conditional probabilities, and graphically interpret the dependency relationships between attributes. Two thyroid cancer datasets and four other cancer datasets from the UCI machine learning repository are selected for our experimental study. The experimental results prove the effectiveness of the proposed algorithm in terms of zero-one loss, bias, variance and AUC.
Collapse
Affiliation(s)
- Hua Lou
- Changzhou College of Information Technology, ChangZhou, China
- * E-mail:
| | - LiMin Wang
- College of Computer Science and Technology, Jilin University, ChangChun, China
| | - DingBo Duan
- Changzhou College of Information Technology, ChangZhou, China
| | - Cheng Yang
- Changzhou College of Information Technology, ChangZhou, China
| | - Musa Mammadov
- Faculty of Science and Technology, Federation University, Ballarat, Australia
| |
Collapse
|
13
|
Attallah O, Karthikesalingam A, Holt PJ, Thompson MM, Sayers R, Bown MJ, Choke EC, Ma X. Using multiple classifiers for predicting the risk of endovascular aortic aneurysm repair re-intervention through hybrid feature selection. Proc Inst Mech Eng H 2017; 231:1048-1063. [PMID: 28925817 DOI: 10.1177/0954411917731592] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Feature selection is essential in medical area; however, its process becomes complicated with the presence of censoring which is the unique character of survival analysis. Most survival feature selection methods are based on Cox's proportional hazard model, though machine learning classifiers are preferred. They are less employed in survival analysis due to censoring which prevents them from directly being used to survival data. Among the few work that employed machine learning classifiers, partial logistic artificial neural network with auto-relevance determination is a well-known method that deals with censoring and perform feature selection for survival data. However, it depends on data replication to handle censoring which leads to unbalanced and biased prediction results especially in highly censored data. Other methods cannot deal with high censoring. Therefore, in this article, a new hybrid feature selection method is proposed which presents a solution to high level censoring. It combines support vector machine, neural network, and K-nearest neighbor classifiers using simple majority voting and a new weighted majority voting method based on survival metric to construct a multiple classifier system. The new hybrid feature selection process uses multiple classifier system as a wrapper method and merges it with iterated feature ranking filter method to further reduce features. Two endovascular aortic repair datasets containing 91% censored patients collected from two centers were used to construct a multicenter study to evaluate the performance of the proposed approach. The results showed the proposed technique outperformed individual classifiers and variable selection methods based on Cox's model such as Akaike and Bayesian information criterions and least absolute shrinkage and selector operator in p values of the log-rank test, sensitivity, and concordance index. This indicates that the proposed classifier is more powerful in correctly predicting the risk of re-intervention enabling doctor in selecting patients' future follow-up plan.
Collapse
Affiliation(s)
- Omneya Attallah
- 1 Department of Electronics and Communications, College of Engineering and Technology, Arab Academy for Science and Technology, Alexandria, Egypt.,2 School of Engineering and Applied Science, Aston University, Birmingham, UK
| | - Alan Karthikesalingam
- 3 St George's Vascular Institute, St George's University Hospitals NHS Foundation Trust, London, UK
| | - Peter Je Holt
- 3 St George's Vascular Institute, St George's University Hospitals NHS Foundation Trust, London, UK
| | - Matthew M Thompson
- 3 St George's Vascular Institute, St George's University Hospitals NHS Foundation Trust, London, UK
| | - Rob Sayers
- 4 NIHR Leicester Cardiovascular Biomedical Research Unit and Department of Cardiovascular Sciences, University of Leicester, Leicester, UK
| | - Matthew J Bown
- 4 NIHR Leicester Cardiovascular Biomedical Research Unit and Department of Cardiovascular Sciences, University of Leicester, Leicester, UK
| | - Eddie C Choke
- 4 NIHR Leicester Cardiovascular Biomedical Research Unit and Department of Cardiovascular Sciences, University of Leicester, Leicester, UK
| | - Xianghong Ma
- 2 School of Engineering and Applied Science, Aston University, Birmingham, UK
| |
Collapse
|
14
|
Attallah O, Karthikesalingam A, Holt PJE, Thompson MM, Sayers R, Bown MJ, Choke EC, Ma X. Feature selection through validation and un-censoring of endovascular repair survival data for predicting the risk of re-intervention. BMC Med Inform Decis Mak 2017; 17:115. [PMID: 28774329 PMCID: PMC5543447 DOI: 10.1186/s12911-017-0508-3] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2016] [Accepted: 07/24/2017] [Indexed: 12/25/2022] Open
Abstract
Background Feature selection (FS) process is essential in the medical area as it reduces the effort and time needed for physicians to measure unnecessary features. Choosing useful variables is a difficult task with the presence of censoring which is the unique characteristic in survival analysis. Most survival FS methods depend on Cox’s proportional hazard model; however, machine learning techniques (MLT) are preferred but not commonly used due to censoring. Techniques that have been proposed to adopt MLT to perform FS with survival data cannot be used with the high level of censoring. The researcher’s previous publications proposed a technique to deal with the high level of censoring. It also used existing FS techniques to reduce dataset dimension. However, in this paper a new FS technique was proposed and combined with feature transformation and the proposed uncensoring approaches to select a reduced set of features and produce a stable predictive model. Methods In this paper, a FS technique based on artificial neural network (ANN) MLT is proposed to deal with highly censored Endovascular Aortic Repair (EVAR). Survival data EVAR datasets were collected during 2004 to 2010 from two vascular centers in order to produce a final stable model. They contain almost 91% of censored patients. The proposed approach used a wrapper FS method with ANN to select a reduced subset of features that predict the risk of EVAR re-intervention after 5 years to patients from two different centers located in the United Kingdom, to allow it to be potentially applied to cross-centers predictions. The proposed model is compared with the two popular FS techniques; Akaike and Bayesian information criteria (AIC, BIC) that are used with Cox’s model. Results The final model outperforms other methods in distinguishing the high and low risk groups; as they both have concordance index and estimated AUC better than the Cox’s model based on AIC, BIC, Lasso, and SCAD approaches. These models have p-values lower than 0.05, meaning that patients with different risk groups can be separated significantly and those who would need re-intervention can be correctly predicted. Conclusion The proposed approach will save time and effort made by physicians to collect unnecessary variables. The final reduced model was able to predict the long-term risk of aortic complications after EVAR. This predictive model can help clinicians decide patients’ future observation plan. Electronic supplementary material The online version of this article (doi:10.1186/s12911-017-0508-3) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Omneya Attallah
- School of Engineering and Applied Science, Aston University, B4 7ET, Birmingham, UK.,Department of Electronics and Communications, College of Engineering and Technology, Arab Academy for Science and Technology, Alexandria, Egypt
| | | | | | | | - Rob Sayers
- St George's Vascular Institute, St George's University Hospitals NHS Foundation Trust, Blackshaw Road, London, SW17 0QT, UK
| | - Matthew J Bown
- Vascular Surgery Group, University of Leicester, Leicester, UK
| | - Eddie C Choke
- Vascular Surgery Group, Robert Kilpatrick Clinical Sciences Building, Leicester Royal Infirmary, University of Leicester, Leicester, LE2 7LX, UK
| | - Xianghong Ma
- School of Engineering and Applied Science, Aston University, B4 7ET, Birmingham, UK.
| |
Collapse
|
15
|
Janghorbani A, Moradi MH. Fuzzy Evidential Network and Its Application as Medical Prognosis and Diagnosis Models. J Biomed Inform 2017; 72:96-107. [PMID: 28690054 DOI: 10.1016/j.jbi.2017.07.004] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2017] [Revised: 05/17/2017] [Accepted: 07/05/2017] [Indexed: 10/19/2022]
Abstract
Uncertainty is one of the important facts of the medical knowledge. Medical prognosis and diagnosis, as the essential parts of medical knowledge, is affected by different aspects of uncertainty, which must be managed. In the previous studies, different theories such as Bayesian probability theory, evidence theory, and fuzzy set theory have been developed to represent and manage different aspects of uncertainty. Recently, hybrid frameworks are suggested to deal with various types of uncertainty in a single framework. Evidential networks are general frameworks for dealing explicitly with total and partial ignorance and offer powerful combination rule of contradictory evidence. In this framework, the fuzziness of linguistic variables is neglected while these variables commonly appear in the medical domain knowledge and different sources of medical information. In addition, the evidential network parameters are determined based on the experts' knowledge and no data-driven algorithm is provided to learn these parameters. In this study, a novel hybrid framework called fuzzy evidential network was suggested to manage the imprecision and epistemic uncertainty of medical prognosis and diagnosis. Also, a data-driven algorithm based on the fuzzy set theory and the fuzzy maximum likelihood is provided to learn the network parameters from clinical databases. The performance of the proposed framework as various prognosis and diagnosis models, compared with well-known machine learning algorithms and the results showed its superiority. Also, an evidential method is suggested to handle the missing values and its results were compared with KNN imputation method.
Collapse
Affiliation(s)
- Amin Janghorbani
- Department of Biomedical Engineering, Amirkabir University of Technology, Tehran, Iran
| | | |
Collapse
|
16
|
Ma X, Cheng Y, Hao S. Multi-stage classification method oriented to aerial image based on low-rank recovery and multi-feature fusion sparse representation. APPLIED OPTICS 2016; 55:10038-10044. [PMID: 27958408 DOI: 10.1364/ao.55.010038] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Automatic classification of terrain surfaces from an aerial image is essential for an autonomous unmanned aerial vehicle (UAV) landing at an unprepared site by using vision. Diverse terrain surfaces may show similar spectral properties due to the illumination and noise that easily cause poor classification performance. To address this issue, a multi-stage classification algorithm based on low-rank recovery and multi-feature fusion sparse representation is proposed. First, color moments and Gabor texture feature are extracted from training data and stacked as column vectors of a dictionary. Then we perform low-rank matrix recovery for the dictionary by using augmented Lagrange multipliers and construct a multi-stage terrain classifier. Experimental results on an aerial map database that we prepared verify the classification accuracy and robustness of the proposed method.
Collapse
|
17
|
Vock DM, Wolfson J, Bandyopadhyay S, Adomavicius G, Johnson PE, Vazquez-Benitez G, O'Connor PJ. Adapting machine learning techniques to censored time-to-event health record data: A general-purpose approach using inverse probability of censoring weighting. J Biomed Inform 2016; 61:119-31. [PMID: 26992568 DOI: 10.1016/j.jbi.2016.03.009] [Citation(s) in RCA: 61] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2015] [Revised: 03/06/2016] [Accepted: 03/07/2016] [Indexed: 11/16/2022]
Abstract
Models for predicting the probability of experiencing various health outcomes or adverse events over a certain time frame (e.g., having a heart attack in the next 5years) based on individual patient characteristics are important tools for managing patient care. Electronic health data (EHD) are appealing sources of training data because they provide access to large amounts of rich individual-level data from present-day patient populations. However, because EHD are derived by extracting information from administrative and clinical databases, some fraction of subjects will not be under observation for the entire time frame over which one wants to make predictions; this loss to follow-up is often due to disenrollment from the health system. For subjects without complete follow-up, whether or not they experienced the adverse event is unknown, and in statistical terms the event time is said to be right-censored. Most machine learning approaches to the problem have been relatively ad hoc; for example, common approaches for handling observations in which the event status is unknown include (1) discarding those observations, (2) treating them as non-events, (3) splitting those observations into two observations: one where the event occurs and one where the event does not. In this paper, we present a general-purpose approach to account for right-censored outcomes using inverse probability of censoring weighting (IPCW). We illustrate how IPCW can easily be incorporated into a number of existing machine learning algorithms used to mine big health care data including Bayesian networks, k-nearest neighbors, decision trees, and generalized additive models. We then show that our approach leads to better calibrated predictions than the three ad hoc approaches when applied to predicting the 5-year risk of experiencing a cardiovascular adverse event, using EHD from a large U.S. Midwestern healthcare system.
Collapse
Affiliation(s)
- David M Vock
- Division of Biostatistics, School of Public Health, University of Minnesota, 420 Delaware Street S.E., MMC 303, Minneapolis, MN 55455, United States.
| | - Julian Wolfson
- Division of Biostatistics, School of Public Health, University of Minnesota, 420 Delaware Street S.E., MMC 303, Minneapolis, MN 55455, United States.
| | - Sunayan Bandyopadhyay
- Department of Computer Science and Engineering, College of Science and Engineering, 200 Union Street, University of Minnesota, Minneapolis, MN 55455, United States.
| | - Gediminas Adomavicius
- Department of Information and Decision Sciences, Carlson School of Management, University of Minnesota, 321 19th Avenue South, Minneapolis, MN 55455, United States.
| | - Paul E Johnson
- Department of Information and Decision Sciences, Carlson School of Management, University of Minnesota, 321 19th Avenue South, Minneapolis, MN 55455, United States.
| | - Gabriela Vazquez-Benitez
- HealthPartners Institute for Education and Research, Mailstop 23301A, P.O. Box 1524, Minneapolis, MN 55440, United States.
| | - Patrick J O'Connor
- HealthPartners Institute for Education and Research, Mailstop 23301A, P.O. Box 1524, Minneapolis, MN 55440, United States.
| |
Collapse
|
18
|
Wolfson J, Bandyopadhyay S, Elidrisi M, Vazquez-Benitez G, Vock DM, Musgrove D, Adomavicius G, Johnson PE, O'Connor PJ. A Naive Bayes machine learning approach to risk prediction using censored, time-to-event data. Stat Med 2015; 34:2941-57. [PMID: 25980520 PMCID: PMC4523419 DOI: 10.1002/sim.6526] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2013] [Revised: 03/24/2015] [Accepted: 04/19/2015] [Indexed: 01/08/2023]
Abstract
Predicting an individual's risk of experiencing a future clinical outcome is a statistical task with important consequences for both practicing clinicians and public health experts. Modern observational databases such as electronic health records provide an alternative to the longitudinal cohort studies traditionally used to construct risk models, bringing with them both opportunities and challenges. Large sample sizes and detailed covariate histories enable the use of sophisticated machine learning techniques to uncover complex associations and interactions, but observational databases are often 'messy', with high levels of missing data and incomplete patient follow-up. In this paper, we propose an adaptation of the well-known Naive Bayes machine learning approach to time-to-event outcomes subject to censoring. We compare the predictive performance of our method with the Cox proportional hazards model which is commonly used for risk prediction in healthcare populations, and illustrate its application to prediction of cardiovascular risk using an electronic health record dataset from a large Midwest integrated healthcare system.
Collapse
Affiliation(s)
- Julian Wolfson
- Division of Biostatistics, University of Minnesota, Minneapolis, MN, U.S.A
| | - Sunayan Bandyopadhyay
- Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN, U.S.A
| | - Mohamed Elidrisi
- Department of Computer Science and Engineering, University of Minnesota, Minneapolis, MN, U.S.A
| | | | - David M Vock
- Division of Biostatistics, University of Minnesota, Minneapolis, MN, U.S.A
| | - Donald Musgrove
- Division of Biostatistics, University of Minnesota, Minneapolis, MN, U.S.A
| | - Gediminas Adomavicius
- Department of Information and Decision Sciences, Carlson School of Management, University of Minnesota, Minneapolis, MN, U.S.A
| | - Paul E Johnson
- Department of Information and Decision Sciences, Carlson School of Management, University of Minnesota, Minneapolis, MN, U.S.A
| | - Patrick J O'Connor
- HealthPartners Institute for Education and Research, Minneapolis, MN, U.S.A
| |
Collapse
|
19
|
Bandyopadhyay S, Wolfson J, Vock DM, Vazquez-Benitez G, Adomavicius G, Elidrisi M, Johnson PE, O’Connor PJ. Data mining for censored time-to-event data: a Bayesian network model for predicting cardiovascular risk from electronic health record data. Data Min Knowl Discov 2014. [DOI: 10.1007/s10618-014-0386-6] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
20
|
Walker ML, Holt KE, Anderson GP, Teo SM, Sly PD, Holt PG, Inouye M. Elucidation of pathways driving asthma pathogenesis: development of a systems-level analytic strategy. Front Immunol 2014; 5:447. [PMID: 25295037 PMCID: PMC4172064 DOI: 10.3389/fimmu.2014.00447] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2014] [Accepted: 09/01/2014] [Indexed: 01/16/2023] Open
Abstract
Asthma is a genetically complex, chronic lung disease defined clinically as episodic airflow limitation and breathlessness that is at least partially reversible, either spontaneously or in response to therapy. Whereas asthma was rare in the late 1800s and early 1900s, the marked increase in its incidence and prevalence since the 1960s points to substantial gene × environment interactions occurring over a period of years, but these interactions are very poorly understood (1-6). It is widely believed that the majority of asthma begins during childhood and manifests first as intermittent wheeze. However, wheeze is also very common in infancy and only a subset of wheezy children progress to persistent asthma for reasons that are largely obscure. Here, we review the current literature regarding causal pathways leading to early asthma development and chronicity. Given the complex interactions of many risk factors over time eventually leading to apparently multiple asthma phenotypes, we suggest that deeply phenotyped cohort studies combined with sophisticated network models will be required to derive the next generation of biological and clinical insights in asthma pathogenesis.
Collapse
Affiliation(s)
- Michael L. Walker
- Medical Systems Biology, Department of Pathology, The University of Melbourne, Parkville, VIC, Australia
| | - Kathryn E. Holt
- Department of Biochemistry and Molecular Biology, Bio21 Molecular Science and Biotechnology Institute, The University of Melbourne, Melbourne, VIC, Australia
- Telethon Kids Institute, The University of Western Australia, West Perth, WA, Australia
| | - Gary P. Anderson
- Department of Pharmacology and Therapeutics, Lung Health Research Centre, The University of Melbourne, Melbourne, VIC, Australia
| | - Shu Mei Teo
- Medical Systems Biology, Department of Pathology, The University of Melbourne, Parkville, VIC, Australia
- Department of Biochemistry and Molecular Biology, Bio21 Molecular Science and Biotechnology Institute, The University of Melbourne, Melbourne, VIC, Australia
| | - Peter D. Sly
- Queensland Children’s Medical Research Institute, The University of Queensland, Brisbane, QLD, Australia
| | - Patrick G. Holt
- Telethon Kids Institute, The University of Western Australia, West Perth, WA, Australia
- Queensland Children’s Medical Research Institute, The University of Queensland, Brisbane, QLD, Australia
| | - Michael Inouye
- Medical Systems Biology, Department of Pathology, The University of Melbourne, Parkville, VIC, Australia
- Telethon Kids Institute, The University of Western Australia, West Perth, WA, Australia
- Medical Systems Biology, Department of Microbiology and Immunology, The University of Melbourne, Parkville, VIC, Australia
| |
Collapse
|
21
|
Attallah O, Ma X. Bayesian neural network approach for determining the risk of re-intervention after endovascular aortic aneurysm repair. Proc Inst Mech Eng H 2014; 228:857-66. [PMID: 25212212 DOI: 10.1177/0954411914549980] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
This article proposes a Bayesian neural network approach to determine the risk of re-intervention after endovascular aortic aneurysm repair surgery. The target of proposed technique is to determine which patients have high chance to re-intervention (high-risk patients) and which are not (low-risk patients) after 5 years of the surgery. Two censored datasets relating to the clinical conditions of aortic aneurysms have been collected from two different vascular centers in the United Kingdom. A Bayesian network was first employed to solve the censoring issue in the datasets. Then, a back propagation neural network model was built using the uncensored data of the first center to predict re-intervention on the second center and classify the patients into high-risk and low-risk groups. Kaplan-Meier curves were plotted for each group of patients separately to show whether there is a significant difference between the two risk groups. Finally, the logrank test was applied to determine whether the neural network model was capable of predicting and distinguishing between the two risk groups. The results show that the Bayesian network used for uncensoring the data has improved the performance of the neural networks that were built for the two centers separately. More importantly, the neural network that was trained with uncensored data of the first center was able to predict and discriminate between groups of low risk and high risk of re-intervention after 5 years of endovascular aortic aneurysm surgery at center 2 (p = 0.0037 in the logrank test).
Collapse
Affiliation(s)
- Omneya Attallah
- Department of Electronics and Communications Engineering, Arab Academy for Science, Technology & Maritime Transport, Alexandria, Egypt School of Engineering and Applied Science, Aston University, Birmingham, UK
| | - Xianghong Ma
- School of Engineering and Applied Science, Aston University, Birmingham, UK
| |
Collapse
|
22
|
Assawamakin A, Prueksaaroon S, Kulawonganunchai S, Shaw PJ, Varavithya V, Ruangrajitpakorn T, Tongsima S. Biomarker selection and classification of "-omics" data using a two-step bayes classification framework. BIOMED RESEARCH INTERNATIONAL 2013; 2013:148014. [PMID: 24106694 PMCID: PMC3784073 DOI: 10.1155/2013/148014] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/22/2013] [Revised: 07/04/2013] [Accepted: 08/06/2013] [Indexed: 11/18/2022]
Abstract
Identification of suitable biomarkers for accurate prediction of phenotypic outcomes is a goal for personalized medicine. However, current machine learning approaches are either too complex or perform poorly. Here, a novel two-step machine-learning framework is presented to address this need. First, a Naïve Bayes estimator is used to rank features from which the top-ranked will most likely contain the most informative features for prediction of the underlying biological classes. The top-ranked features are then used in a Hidden Naïve Bayes classifier to construct a classification prediction model from these filtered attributes. In order to obtain the minimum set of the most informative biomarkers, the bottom-ranked features are successively removed from the Naïve Bayes-filtered feature list one at a time, and the classification accuracy of the Hidden Naïve Bayes classifier is checked for each pruned feature set. The performance of the proposed two-step Bayes classification framework was tested on different types of -omics datasets including gene expression microarray, single nucleotide polymorphism microarray (SNParray), and surface-enhanced laser desorption/ionization time-of-flight (SELDI-TOF) proteomic data. The proposed two-step Bayes classification framework was equal to and, in some cases, outperformed other classification methods in terms of prediction accuracy, minimum number of classification markers, and computational time.
Collapse
Affiliation(s)
- Anunchai Assawamakin
- Department of Pharmacology, Faculty of Pharmacy, Mahidol University, 447 Sri-Ayuthaya Road, Rajathevi, Bangkok 10400, Thailand
| | - Supakit Prueksaaroon
- Department of Electrical and Computer Engineering, Faculty of Engineering, Thammasat University, 99 Phahonyothin Road, Khlong Nueng, Khlong Luang, Pathum Thani 12120, Thailand
| | - Supasak Kulawonganunchai
- National Center for Genetic Engineering and Biotechnology, 113 Thailand Science Park, Phahonyothin Road, Khlong Nueng, Khlong Luang, Pathum Thani 12120, Thailand
| | - Philip James Shaw
- National Center for Genetic Engineering and Biotechnology, 113 Thailand Science Park, Phahonyothin Road, Khlong Nueng, Khlong Luang, Pathum Thani 12120, Thailand
| | - Vara Varavithya
- Department of Electrical and Computer Engineering, King Mongkut University of Technology North Bangkok, 1518 Piboonsongkarm Road, Bangkok 10800, Thailand
| | - Taneth Ruangrajitpakorn
- Language and Semantic Technology Laboratory, National Electronic and Computer Technology Center, 112 Thailand Science Park, Phahonyothin Road, Khlong Nueng, Khlong Luang, Pathum Thani 12120, Thailand
| | - Sissades Tongsima
- National Center for Genetic Engineering and Biotechnology, 113 Thailand Science Park, Phahonyothin Road, Khlong Nueng, Khlong Luang, Pathum Thani 12120, Thailand
| |
Collapse
|
23
|
Morales DA, Vives-Gilabert Y, Gómez-Ansón B, Bengoetxea E, Larrañaga P, Bielza C, Pagonabarraga J, Kulisevsky J, Corcuera-Solano I, Delfino M. Predicting dementia development in Parkinson's disease using Bayesian network classifiers. Psychiatry Res 2013; 213:92-8. [PMID: 23149030 DOI: 10.1016/j.pscychresns.2012.06.001] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/19/2011] [Revised: 06/02/2012] [Accepted: 06/07/2012] [Indexed: 12/18/2022]
Abstract
Parkinson's disease (PD) has broadly been associated with mild cognitive impairment (PDMCI) and dementia (PDD). Researchers have studied surrogate, neuroanatomic biomarkers provided by magnetic resonance imaging (MRI) that may help in the early diagnosis of this condition. In this article, four classification models (naïve Bayes, multivariate filter-based naïve Bayes, filter selective naïve Bayes and support vector machines, SVM) have been applied to evaluate their capacity to discriminate between cognitively intact patients with Parkinson's disease (PDCI), PDMCI and PDD. For this purpose, the MRI studies of 45 subjects (16 PDCI, 15 PDMCI and 14 PDD) were acquired and post-processed with Freesurfer, obtaining 112 variables (volumes of subcortical structures and thickness of cortical parcels) per subject. A multivariate filter-based naïve Bayes model was found to be the best classifier, having the highest cross-validated sensitivity, specificity and accuracy. Additionally, the most relevant variables related to dementia in PD, as predicted by our classifiers, were cerebral white matter, and volumes of the lateral ventricles and hippocampi.
Collapse
Affiliation(s)
- Dinora A Morales
- Computational Intelligence Group, Universidad Politécnica de Madrid, Campus de Montegancedo, 28660 Boadilla del Monte, Madrid 28660, Spain.
| | | | | | | | | | | | | | | | | | | |
Collapse
|
24
|
VIDAURRE DIEGO, BIELZA CONCHA, LARRAÑAGA PEDRO. AN L1-REGULARIZED NAÏVE BAYES-INSPIRED CLASSIFIER FOR DISCARDING REDUNDANT AND IRRELEVANT PREDICTORS. INT J ARTIF INTELL T 2013. [DOI: 10.1142/s021821301350019x] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
The naïve Bayes model is a simple but often satisfactory supervised classification method. The original naïve Bayes scheme, does, however, have a serious weakness, namely, the harmful effect of redundant predictors. In this paper, we study how to apply a regularization technique to learn a computationally efficient classifier that is inspired by naïve Bayes. The proposed formulation, combined with an L1-penalty, is capable of discarding harmful, redundant predictors. A modification of the LARS algorithm is devised to solve this problem. We tackle both real-valued and discrete predictors, assuring that our method is applicable to a wide range of data. In the experimental section, we empirically study the effect of redundant and irrelevant predictors. We also test the method on a high dimensional data set from the neuroscience field, where there are many more predictors than data cases. Finally, we run the method on a real data set than combines categorical with numeric predictors. Our approach is compared with several naïve Bayes variants and other classification algorithms (SVM and kNN), and is shown to be competitive.
Collapse
Affiliation(s)
- DIEGO VIDAURRE
- Computational Intelligence Group, Universidad Politécnica de Madrid, Spain
| | - CONCHA BIELZA
- Computational Intelligence Group, Universidad Politécnica de Madrid, Spain
| | - PEDRO LARRAÑAGA
- Computational Intelligence Group, Universidad Politécnica de Madrid, Spain
| |
Collapse
|
25
|
Mao Z, Cai W, Shao X. Selecting significant genes by randomization test for cancer classification using gene expression data. J Biomed Inform 2013; 46:594-601. [DOI: 10.1016/j.jbi.2013.03.009] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2012] [Revised: 01/30/2013] [Accepted: 03/28/2013] [Indexed: 12/30/2022]
|
26
|
García-Torres M, Armañanzas R, Bielza C, Larrañaga P. Comparison of metaheuristic strategies for peakbin selection in proteomic mass spectrometry data. Inf Sci (N Y) 2013. [DOI: 10.1016/j.ins.2010.12.013] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
27
|
Yajuan Wang, Simon M, Bonde P, Harris BU, Teuteberg JJ, Kormos RL, Antaki JF. Prognosis of Right Ventricular Failure in Patients With Left Ventricular Assist Device Based on Decision Tree With SMOTE. ACTA ACUST UNITED AC 2012; 16:383-90. [DOI: 10.1109/titb.2012.2187458] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
28
|
Aussem A, de Morais SR, Corbex M. Analysis of nasopharyngeal carcinoma risk factors with Bayesian networks. Artif Intell Med 2012; 54:53-62. [DOI: 10.1016/j.artmed.2011.09.002] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2009] [Revised: 09/01/2011] [Accepted: 09/04/2011] [Indexed: 10/15/2022]
|
29
|
Modeling Paradigms for Medical Diagnostic Decision Support: A Survey and Future Directions. J Med Syst 2011; 36:3029-49. [PMID: 21964969 DOI: 10.1007/s10916-011-9780-4] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2011] [Accepted: 09/12/2011] [Indexed: 10/17/2022]
|
30
|
|
31
|
Geenen P, van der Gaag L, Loeffen W, Elbers A. Constructing naive Bayesian classifiers for veterinary medicine: A case study in the clinical diagnosis of classical swine fever. Res Vet Sci 2011; 91:64-70. [DOI: 10.1016/j.rvsc.2010.08.006] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2007] [Revised: 08/01/2010] [Accepted: 08/04/2010] [Indexed: 10/19/2022]
|
32
|
Matwin S, Kouznetsov A, Inkpen D, Frunza O, O'Blenis P. A new algorithm for reducing the workload of experts in performing systematic reviews. J Am Med Inform Assoc 2010; 17:446-53. [PMID: 20595313 DOI: 10.1136/jamia.2010.004325] [Citation(s) in RCA: 45] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
OBJECTIVE To determine whether a factorized version of the complement naïve Bayes (FCNB) classifier can reduce the time spent by experts reviewing journal articles for inclusion in systematic reviews of drug class efficacy for disease treatment. DESIGN The proposed classifier was evaluated on a test collection built from 15 systematic drug class reviews used in previous work. The FCNB classifier was constructed to classify each article as containing high-quality, drug class-specific evidence or not. Weight engineering (WE) techniques were added to reduce underestimation for Medical Subject Headings (MeSH)-based and Publication Type (PubType)-based features. Cross-validation experiments were performed to evaluate the classifier's parameters and performance. MEASUREMENTS Work saved over sampling (WSS) at no less than a 95% recall was used as the main measure of performance. RESULTS The minimum workload reduction for a systematic review for one topic, achieved with a FCNB/WE classifier, was 8.5%; the maximum was 62.2% and the average over the 15 topics was 33.5%. This is 15.0% higher than the average workload reduction obtained using a voting perceptron-based automated citation classification system. CONCLUSION The FCNB/WE classifier is simple, easy to implement, and produces significantly better results in reducing the workload than previously achieved. The results support it being a useful algorithm for machine-learning-based automation of systematic reviews of drug class efficacy for disease treatment.
Collapse
Affiliation(s)
- Stan Matwin
- School of Information Technology and Engineering, University of Ottawa, Ottawa, Ontario, Canada
| | | | | | | | | |
Collapse
|
33
|
|
34
|
Štajduhar I, Dalbelo-Bašić B, Bogunović N. Impact of censoring on learning Bayesian networks in survival modelling. Artif Intell Med 2009; 47:199-217. [DOI: 10.1016/j.artmed.2009.08.001] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2008] [Revised: 01/12/2009] [Accepted: 08/28/2009] [Indexed: 02/06/2023]
|
35
|
Steeneveld W, van der Gaag L, Barkema H, Hogeveen H. Providing probability distributions for the causal pathogen of clinical mastitis using naive Bayesian networks. J Dairy Sci 2009; 92:2598-609. [DOI: 10.3168/jds.2008-1694] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
36
|
Paul TK, Iba H. Prediction of cancer class with majority voting genetic programming classifier using gene expression data. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2009; 6:353-367. [PMID: 19407358 DOI: 10.1109/tcbb.2007.70245] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
In order to get a better understanding of different types of cancers and to find the possible biomarkers for diseases, recently, many researchers are analyzing the gene expression data using various machine learning techniques. However, due to a very small number of training samples compared to the huge number of genes and class imbalance, most of these methods suffer from overfitting. In this paper, we present a majority voting genetic programming classifier (MVGPC) for the classification of microarray data. Instead of a single rule or a single set of rules, we evolve multiple rules with genetic programming (GP) and then apply those rules to test samples to determine their labels with majority voting technique. By performing experiments on four different public cancer data sets, including multiclass data sets, we have found that the test accuracies of MVGPC are better than those of other methods, including AdaBoost with GP. Moreover, some of the more frequently occurring genes in the classification rules are known to be associated with the types of cancers being studied in this paper.
Collapse
Affiliation(s)
- Topon Kumar Paul
- System Engineering Laboratory, Corporate Research & Development Center, Toshiba Corporation, Kawasaki-shi, Kanagawa, Japan.
| | | |
Collapse
|
37
|
Morales DA, Bengoetxea E, Larrañaga P. Selection of human embryos for transfer by Bayesian classifiers. Comput Biol Med 2008; 38:1177-86. [DOI: 10.1016/j.compbiomed.2008.09.002] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2007] [Revised: 06/28/2008] [Accepted: 09/12/2008] [Indexed: 11/17/2022]
|
38
|
Armañanzas R, Inza I, Larrañaga P. Detecting reliable gene interactions by a hierarchy of Bayesian network classifiers. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2008; 91:110-121. [PMID: 18433926 DOI: 10.1016/j.cmpb.2008.02.010] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/05/2007] [Revised: 02/08/2008] [Accepted: 02/28/2008] [Indexed: 05/26/2023]
Abstract
The main purpose of a gene interaction network is to map the relationships of the genes that are out of sight when a genomic study is tackled. DNA microarrays allow the measure of gene expression of thousands of genes at the same time. These data constitute the numeric seed for the induction of the gene networks. In this paper, we propose a new approach to build gene networks by means of Bayesian classifiers, variable selection and bootstrap resampling. The interactions induced by the Bayesian classifiers are based both on the expression levels and on the phenotype information of the supervised variable. Feature selection and bootstrap resampling add reliability and robustness to the overall process removing the false positive findings. The consensus among all the induced models produces a hierarchy of dependences and, thus, of variables. Biologists can define the depth level of the model hierarchy so the set of interactions and genes involved can vary from a sparse to a dense set. Experimental results show how these networks perform well on classification tasks. The biological validation matches previous biological findings and opens new hypothesis for future studies.
Collapse
Affiliation(s)
- Rubén Armañanzas
- Department of Computer Science and Artificial Intelligence, University of the Basque Country, Paseo Manuel Lardizabal 1, 20018 Donostia-San Sebastián, Gipuzkoa, Spain.
| | | | | |
Collapse
|
39
|
Varpa K, Iltanen K, Juhola M. Machine learning method for knowledge discovery experimented with otoneurological data. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2008; 91:154-164. [PMID: 18524411 DOI: 10.1016/j.cmpb.2008.03.003] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/23/2007] [Revised: 03/17/2008] [Accepted: 03/18/2008] [Indexed: 05/26/2023]
Abstract
We have been interested in developing an otoneurological decision support system that supports diagnostics of vertigo diseases. In this study, we concentrate on testing its inference mechanism and knowledge discovery method. Knowledge is presented as patterns of classes. Each pattern includes attributes with weight and fitness values concerning the class. With the knowledge discovery method it is possible to form fitness values from data. Knowledge formation is based on frequency distributions of attributes. Knowledge formed by the knowledge discovery method is tested with two vertigo data sets and compared to experts' knowledge. The experts' and machine learnt knowledge are also combined in various ways in order to examine effects of weights on classification accuracy. The classification accuracy of knowledge discovery method is compared to 1- and 5-nearest neighbour method and Naive-Bayes classifier. The results showed that knowledge bases combining machine learnt knowledge with the experts' knowledge yielded the best classification accuracies. Further, attribute weighting had an important effect on the classification capability of the system. When considering different diseases in the used data sets, the performance of the knowledge discovery method and the inference method is comparable to other methods employed in this study.
Collapse
Affiliation(s)
- Kirsi Varpa
- Department of Computer Sciences, FI-33014 University of Tampere, Tampere, Finland.
| | | | | |
Collapse
|
40
|
Abstract
Research in psychology has reported that, among the variety of possibilities for assessment methodologies, summary evaluation offers a particularly adequate context for inferring text comprehension and topic understanding. However, grades obtained in this methodology are hard to quantify objectively. Therefore, we carried out an empirical study to analyze the decisions underlying human summary-grading behavior. The task consisted of expert evaluation of summaries produced in critically relevant contexts of summarization development, and the resulting data were modeled by means of Bayesian networks using an application called Elvira, which allows for graphically observing the predictive power (if any) of the resultant variables. Thus, in this article, we analyzed summary-evaluation decision making in a computational framework.
Collapse
|
41
|
Morales DA, Bengoetxea E, Larrañaga P, García M, Franco Y, Fresnada M, Merino M. Bayesian classification for the selection of in vitro human embryos using morphological and clinical data. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2008; 90:104-116. [PMID: 18190996 DOI: 10.1016/j.cmpb.2007.11.018] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2007] [Revised: 11/27/2007] [Accepted: 11/28/2007] [Indexed: 05/25/2023]
Abstract
In vitro fertilization (IVF) is a medically assisted reproduction technique that enables infertile couples to achieve successful pregnancy. Given the uncertainty of the treatment, we propose an intelligent decision support system based on supervised classification by Bayesian classifiers to aid to the selection of the most promising embryos that will form the batch to be transferred to the woman's uterus. The aim of the supervised classification system is to improve overall success rate of each IVF treatment in which a batch of embryos is transferred each time, where the success is achieved when implantation (i.e. pregnancy) is obtained. Due to ethical reasons, different legislative restrictions apply in every country on this technique. In Spain, legislation allows a maximum of three embryos to form each transfer batch. As a result, clinicians prefer to select the embryos by non-invasive embryo examination based on simple methods and observation focused on morphology and dynamics of embryo development after fertilization. This paper proposes the application of Bayesian classifiers to this embryo selection problem in order to provide a decision support system that allows a more accurate selection than with the actual procedures which fully rely on the expertise and experience of embryologists. For this, we propose to take into consideration a reduced subset of feature variables related to embryo morphology and clinical data of patients, and from this data to induce Bayesian classification models. Results obtained applying a filter technique to choose the subset of variables, and the performance of Bayesian classifiers using them, are presented.
Collapse
Affiliation(s)
- Dinora Araceli Morales
- Department of Computer Science and Artificial Intelligence, University of the Basque Country, Paseo Manuel Lardizabal 1, E-20018 Donostia-San Sebastián, Spain.
| | | | | | | | | | | | | |
Collapse
|
42
|
|