1
|
Wang N, Massam H, Gao X, Briollais L. THE SCALABLE BIRTH-DEATH MCMC ALGORITHM FOR MIXED GRAPHICAL MODEL LEARNING WITH APPLICATION TO GENOMIC DATA INTEGRATION. Ann Appl Stat 2023; 17:1958-1983. [PMID: 37830084 PMCID: PMC10569451 DOI: 10.1214/22-aoas1701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2023]
Abstract
Recent advances in biological research have seen the emergence of high-throughput technologies with numerous applications that allow the study of biological mechanisms at an unprecedented depth and scale. A large amount of genomic data is now distributed through consortia like The Cancer Genome Atlas (TCGA), where specific types of biological information on specific type of tissue or cell are available. In cancer research, the challenge is now to perform integrative analyses of high-dimensional multi-omic data with the goal to better understand genomic processes that correlate with cancer outcomes, e.g. elucidate gene networks that discriminate a specific cancer subgroups (cancer sub-typing) or discovering gene networks that overlap across different cancer types (pan-cancer studies). In this paper, we propose a novel mixed graphical model approach to analyze multi-omic data of different types (continuous, discrete and count) and perform model selection by extending the Birth-Death MCMC (BDMCMC) algorithm initially proposed by Stephens (2000) and later developed by Mohammadi and Wit (2015). We compare the performance of our method to the LASSO method and the standard BDMCMC method using simulations and find that our method is superior in terms of both computational efficiency and the accuracy of the model selection results. Finally, an application to the TCGA breast cancer data shows that integrating genomic information at different levels (mutation and expression data) leads to better subtyping of breast cancers.
Collapse
Affiliation(s)
- Nanwei Wang
- Department of Mathematics and Statistics, University of New Brunswick, Toronto, Canada
| | - Hélène Massam
- Department of Mathematics and Statistics, York University, Toronto, Canada
| | - Xin Gao
- Department of Mathematics and Statistics, York University, Toronto, Canada
| | - Laurent Briollais
- Department of Mathematics and Statistics, University of New Brunswick, Toronto, Canada
- Lunenfeld-Tanenbaum Research Institute of Sinai Health System and Dalla Lana School of Public Health (Biostatistics), University of Toronto, Toronto, Canada
| |
Collapse
|
2
|
Yang X, Wang Y, Wang R, Li J. Ensemble Feature Selection With Block-Regularized m × 2 Cross-Validation. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:6628-6641. [PMID: 34851832 DOI: 10.1109/tnnls.2021.3128173] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Ensemble feature selection (EFS) has attracted significant interest in the literature due to its great potential in reducing the discovery rate of noise features and stabilizing the feature selection results. In view of the superior performance of block-regularized m × 2 cross-validation on generalization performance and algorithm comparison, a novel EFS technology based on block-regularized m × 2 cross-validation is proposed in this study. Contrary to the traditional ensemble learning with a binomial distribution, the distribution of feature selection frequency in the proposed technique is approximated by a beta distribution more accurately. Furthermore, theoretical analysis of the proposed technique shows that it yields a higher selection probability for important features, lower selected risk for noise features, more true positives, and fewer false positives. Finally, the above conclusions are verified by the simulated and real data experiments.
Collapse
|
3
|
Rivera AJ, Muñoz JC, Pérez-Goody MD, de San Pedro BS, Charte F, Elizondo D, Rodríguez C, Abolafia ML, Perea A, Del Jesus MJ. XAIRE: An ensemble-based methodology for determining the relative importance of variables in regression tasks. Application to a hospital emergency department. Artif Intell Med 2023; 137:102494. [PMID: 36868688 DOI: 10.1016/j.artmed.2023.102494] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Revised: 01/13/2023] [Accepted: 01/18/2023] [Indexed: 01/21/2023]
Abstract
Nowadays it is increasingly important in many applications to understand how different factors influence a variable of interest in a predictive modeling process. This task becomes particularly important in the context of Explainable Artificial Intelligence. Knowing the relative impact of each variable on the output allows us to acquire more information about the problem and about the output provided by a model. This paper proposes a new methodology, XAIRE, that determines the relative importance of input variables in a prediction environment, considering multiple prediction models in order to increase generality and avoid bias inherent in a particular learning algorithm. Concretely, we present an ensemble-based methodology that promotes the aggregation of results from several prediction methods to obtain a relative importance ranking. Also, statistical tests are considered in the methodology in order to reveal significant differences between the relative importance of the predictor variables. As a case study, XAIRE is applied to the arrival of patients in a Hospital Emergency Department, which has resulted in one of the largest sets of different predictor variables in the literature. Results show the extracted knowledge related to the relative importance of the predictors involved in the case study.
Collapse
Affiliation(s)
- A J Rivera
- Computer Science Department, University of Jaén, Spain.
| | - J Cobo Muñoz
- Emergency Department, University Hospital of Jaén, Spain.
| | | | | | - F Charte
- Computer Science Department, University of Jaén, Spain.
| | - D Elizondo
- Department of Computer Science and Informatics, De Montfort University, UK.
| | - C Rodríguez
- Emergency Department, University Hospital of Jaén, Spain.
| | - M L Abolafia
- Emergency Department, University Hospital of Jaén, Spain.
| | - A Perea
- Emergency Department, University Hospital of Jaén, Spain.
| | - M J Del Jesus
- Computer Science Department, University of Jaén, Spain.
| |
Collapse
|
4
|
Chen Z, Liao J, Xu W, Yang Y. Multifold Cross-Validation Model Averaging for Generalized Additive Partial Linear Models. J Comput Graph Stat 2023. [DOI: 10.1080/10618600.2023.2174127] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Affiliation(s)
- Ze Chen
- Center for Applied Statistics and School of Statistics, Renmin University of China, Beijing 100872, China
| | - Jun Liao
- Center for Applied Statistics and School of Statistics, Renmin University of China, Beijing 100872, China
| | - Wangli Xu
- Center for Applied Statistics and School of Statistics, Renmin University of China, Beijing 100872, China
| | - Yuhong Yang
- School of Statistics, University of Minnesota, Minneapolis, MN 55455, United States
| |
Collapse
|
5
|
Zhan Z, Li Y, Yang Y, Lin C. Model averaging for semiparametric varying coefficient quantile regression models. ANN I STAT MATH 2022. [DOI: 10.1007/s10463-022-00857-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
|
6
|
Visualization and assessment of model selection uncertainty. Comput Stat Data Anal 2022. [DOI: 10.1016/j.csda.2022.107598] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
7
|
Hoang TT, Ichinose K, Morimoto S, Furukawa K, Le LH, Kawakami A. Measurement of anti-suprabasin antibodies, multiple cytokines and chemokines as potential predictive biomarkers for neuropsychiatric systemic lupus erythematosus. Clin Immunol 2022; 237:108980. [DOI: 10.1016/j.clim.2022.108980] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Revised: 03/08/2022] [Accepted: 03/09/2022] [Indexed: 11/28/2022]
|
8
|
The One Standard Error Rule for Model Selection: Does It Work? STATS 2021. [DOI: 10.3390/stats4040051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Previous research provided a lot of discussion on the selection of regularization parameters when it comes to the application of regularization methods for high-dimensional regression. The popular “One Standard Error Rule” (1se rule) used with cross validation (CV) is to select the most parsimonious model whose prediction error is not much worse than the minimum CV error. This paper examines the validity of the 1se rule from a theoretical angle and also studies its estimation accuracy and performances in applications of regression estimation and variable selection, particularly for Lasso in a regression framework. Our theoretical result shows that when a regression procedure produces the regression estimator converging relatively fast to the true regression function, the standard error estimation formula in the 1se rule is justified asymptotically. The numerical results show the following: 1. the 1se rule in general does not necessarily provide a good estimation for the intended standard deviation of the cross validation error. The estimation bias can be 50–100% upwards or downwards in various situations; 2. the results tend to support that 1se rule usually outperforms the regular CV in sparse variable selection and alleviates the over-selection tendency of Lasso; 3. in regression estimation or prediction, the 1se rule often performs worse. In addition, comparisons are made over two real data sets: Boston Housing Prices (large sample size n, small/moderate number of variables p) and Bardet–Biedl data (large p, small n). Data guided simulations are done to provide insight on the relative performances of the 1se rule and the regular CV.
Collapse
|
9
|
Fan Y, Sun J. Subsampling from features in large regression to find “winning features”. Stat Anal Data Min 2021. [DOI: 10.1002/sam.11499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Yiying Fan
- Department of Mathematics and Statistics Cleveland State University Cleveland Ohio USA
| | - Jiayang Sun
- Department of Statistics George Mason University Fairfax Virginia USA
| |
Collapse
|
10
|
Slanzi D, Mameli V, Brown PJ. A comparative study on high-dimensional bayesian regression with binary predictors. COMMUN STAT-SIMUL C 2021. [DOI: 10.1080/03610918.2021.1894337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- Debora Slanzi
- Department of Management, Ca’ Foscari University of Venice, Venice, Italy
- European Centre for Living Technology, Venice, Italy
| | - Valentina Mameli
- Department of Economics and Statistics, University of Udine, Udine, Italy
| | - Philip J. Brown
- School of Mathematics, Statistics and Actuarial Science, University of Kent, Canterbury, United Kingdom
| |
Collapse
|
11
|
|
12
|
Affiliation(s)
- Jing Lei
- Department of Statistics and Data Science, Carnegie Mellon University, Pittsburgh, PA
| |
Collapse
|