51
|
Mbah C, De Neve J, Thas O. High-dimensional prediction of binary outcomes in the presence of between-study heterogeneity. Stat Methods Med Res 2018; 28:2848-2867. [PMID: 30051767 DOI: 10.1177/0962280218787544] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Many prediction methods have been proposed in the literature, but most of them ignore heterogeneity between populations. Either only data from a single study or population is available for model building and evaluation, or when data from multiple studies make up the training dataset, studies are pooled before model building. As a result, prediction models might perform less than expected when applied to new subjects from new study populations. We propose a linear method for building prediction models with high-dimensional data from multiple studies. Our method explicitly addresses between-population variability and tends to select predictors that are predictive in most of the study populations. We employ empirical Bayes estimators and hence avoid selection bias during the variable selection process. Simulation results demonstrate that the new method works better than other linear prediction methods that ignore the between-study variability. Our method is developed for classification into two groups.
Collapse
Affiliation(s)
- Chamberlain Mbah
- 1 Department of Radiotherapy and Experimental Cancer Research, Ghent University, Ghent, Belgium
| | - Jan De Neve
- 2 Department of Data Analysis, Faculty of Psychology and Educational Sciences, Ghent University, Ghent, Belgium
| | - Olivier Thas
- 3 Center for Statistics, Hasselt University, Diepenbeek, Belgium.,4 National Institute for Applied Statistics Research Australia, University of Wollongong, New South Wales, Australia
| |
Collapse
|
52
|
Shen C. Interval estimation of a population mean using existing knowledge or data on effect sizes. Stat Methods Med Res 2018; 28:1703-1715. [DOI: 10.1177/0962280218773537] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Bayes or empirical Bayes methods to improve inferential accuracy for a population mean has been widely adopted in medical research. As the joint prior distribution of both the mean and variance parameters can be difficult to specify or estimate, most of these methods have relied on certain level of simplifications of the joint prior, which could lead to difficulty in the interpretation of the posterior distribution or compromised inferential accuracy. We propose a framework of interval estimation using existing knowledge or data on the effect size to address this difficulty. Our method has two unique characteristics. First, the interpretation of the interval bears the spirit of both Frequentist and Bayesian thinking. For this reason, it will be called FB interval. Second, we define a new quantity, the hybrid effect size, which is a key quantity that mediates the construction of the FB interval when the population variance is unknown. A simulation study and a real data example are presented to evaluate and illustrate our method.
Collapse
Affiliation(s)
- Changyu Shen
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
53
|
Fuentes C, Casella G, Wells MT. Confidence intervals for the means of the selected populations. Electron J Stat 2018. [DOI: 10.1214/17-ejs1374] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
54
|
Madrid-Padilla OH, Polson NG, Scott J. A deconvolution path for mixtures. Electron J Stat 2018. [DOI: 10.1214/18-ejs1430] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
55
|
So HC, Sham PC. Exploring the predictive power of polygenic scores derived from genome-wide association studies: a study of 10 complex traits. Bioinformatics 2017; 33:886-892. [PMID: 28065900 DOI: 10.1093/bioinformatics/btw745] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2016] [Accepted: 11/21/2016] [Indexed: 12/30/2022] Open
Abstract
Motivation It is hoped that advances in our knowledge in disease genomics will contribute to personalized medicine such as individualized preventive strategies or early diagnoses of diseases. With the growth of genome-wide association studies (GWAS) in the past decade, how far have we reached this goal? In this study we explored the predictive ability of polygenic risk scores (PRSs) derived from GWAS for a range of complex disease and traits. Results We first proposed a new approach to evaluate predictive performances of PRS at arbitrary P -value thresholds. The method was based on corrected estimates of effect sizes, accounting for possible false positives and selection bias. This approach requires no distributional assumptions and only requires summary statistics as input. The validity of the approach was verified in simulations. We explored the predictive power of PRS for ten complex traits, including type 2 diabetes (DM), coronary artery disease (CAD), triglycerides, high- and low-density lipoprotein, total cholesterol, schizophrenia (SCZ), bipolar disorder (BD), major depressive disorder and anxiety disorders. We found that the predictive ability of PRS for CAD and DM were modest (best AUC = 0.608 and 0.607) while for lipid traits the prediction R-squared ranged from 16.1 to 29.8%. For psychiatric disorders, the predictive power for SCZ was estimated to be the highest (best AUC 0.820), followed by BD. Predictive performance of other psychiatric disorders ranged from 0.543 to 0.585. Psychiatric traits tend to have more gradual rise in AUC when significance thresholds increase and achieve the best predictive power at higher P -values than cardiometabolic traits. Contact hcso@cuhk.edu.hk ; pcsham@hku.hk. Supplementary information Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Hon-Cheong So
- School of Biomedical Sciences, Chinese University of Hong Kong, Shatin, Hong Kong.,KIZ-CUHK Joint Laboratory of Bioresources and Molecular Research of Common Diseases, Kunming Zoology Institute of Zoology and Chinese University of Hong Kong, Hong Kong
| | - Pak C Sham
- Department of Psychiatry, University of Hong Kong, PokFuLam, Hong Kong.,Centre for Genomic Sciences, University of Hong Kong, PokFuLam, Hong Kong.,State Key Laboratory for Cognitive and Brain Sciences, University of Hong Kong, PokFuLam, Hong Kong.,Centre for Reproduction, Development and Growth, University of Hong Kong, PokFuLam, Hong Kong
| |
Collapse
|
56
|
Pan JC, Huang Y, Hwang JG. Estimation of selected parameters. Comput Stat Data Anal 2017. [DOI: 10.1016/j.csda.2016.11.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
57
|
Reid S, Taylor J, Tibshirani R. Post-selection point and interval estimation of signal sizes in Gaussian samples. CAN J STAT 2017. [DOI: 10.1002/cjs.11320] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Stephen Reid
- Department of Statistics; 390 Serra Mall, Stanford University; Stanford, CA 94305 U.S.A
| | - Jonathan Taylor
- Department of Statistics; 390 Serra Mall, Stanford University; Stanford, CA 94305 U.S.A
| | - Robert Tibshirani
- Department of Statistics; 390 Serra Mall, Stanford University; Stanford, CA 94305 U.S.A
- Department of Health Research and Policy; 150 Governor's Lane, HRP Redwood Building, Stanford University School of Medicine; Stanford, CA 94305 U.S.A
| |
Collapse
|
58
|
Bhadra A, Datta J, Polson NG, Willard B. Default Bayesian analysis with global-local shrinkage priors. Biometrika 2016. [DOI: 10.1093/biomet/asw041] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
|
59
|
Lu J, Deng A. Demystifying the bias from selective inference: A revisit to Dawid’s treatment selection problem. Stat Probab Lett 2016. [DOI: 10.1016/j.spl.2016.06.007] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
60
|
|
61
|
Zou W, Ouyang H. Using local multiplicity to improve effect estimation from a hypothesis-generating pharmacogenetics study. THE PHARMACOGENOMICS JOURNAL 2016; 16:107-112. [PMID: 25802090 DOI: 10.1038/tpj.2015.19] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/18/2014] [Revised: 12/29/2014] [Accepted: 01/28/2015] [Indexed: 06/04/2023]
Abstract
We propose a multiple estimation adjustment (MEA) method to correct effect overestimation due to selection bias from a hypothesis-generating study (HGS) in pharmacogenetics. MEA uses a hierarchical Bayesian approach to model individual effect estimates from maximal likelihood estimation (MLE) in a region jointly and shrinks them toward the regional effect. Unlike many methods that model a fixed selection scheme, MEA capitalizes on local multiplicity independent of selection. We compared mean square errors (MSEs) in simulated HGSs from naive MLE, MEA and a conditional likelihood adjustment (CLA) method that model threshold selection bias. We observed that MEA effectively reduced MSE from MLE on null effects with or without selection, and had a clear advantage over CLA on extreme MLE estimates from null effects under lenient threshold selection in small samples, which are common among 'top' associations from a pharmacogenetics HGS.
Collapse
Affiliation(s)
- W Zou
- Biostatistics, Genentech, Inc., 1 DNA Way, South San Francisco, CA, USA
| | - H Ouyang
- Global Statistical Sciences (GSS) - Oncology, Lilly Corporate Center, Eli Lilly and Company, Indianapolis, IN, USA
| |
Collapse
|
62
|
Bogdan M, van den Berg E, Sabatti C, Su W, Candès EJ. SLOPE-ADAPTIVE VARIABLE SELECTION VIA CONVEX OPTIMIZATION. Ann Appl Stat 2015; 9:1103-1140. [PMID: 26709357 DOI: 10.1214/15-aoas842] [Citation(s) in RCA: 76] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
We introduce a new estimator for the vector of coefficients β in the linear model y = Xβ + z, where X has dimensions n × p with p possibly larger than n. SLOPE, short for Sorted L-One Penalized Estimation, is the solution to [Formula: see text]where λ1 ≥ λ2 ≥ … ≥ λ p ≥ 0 and [Formula: see text] are the decreasing absolute values of the entries of b. This is a convex program and we demonstrate a solution algorithm whose computational complexity is roughly comparable to that of classical ℓ1 procedures such as the Lasso. Here, the regularizer is a sorted ℓ1 norm, which penalizes the regression coefficients according to their rank: the higher the rank-that is, stronger the signal-the larger the penalty. This is similar to the Benjamini and Hochberg [J. Roy. Statist. Soc. Ser. B57 (1995) 289-300] procedure (BH) which compares more significant p-values with more stringent thresholds. One notable choice of the sequence {λ i } is given by the BH critical values [Formula: see text], where q ∈ (0, 1) and z(α) is the quantile of a standard normal distribution. SLOPE aims to provide finite sample guarantees on the selected model; of special interest is the false discovery rate (FDR), defined as the expected proportion of irrelevant regressors among all selected predictors. Under orthogonal designs, SLOPE with λBH provably controls FDR at level q. Moreover, it also appears to have appreciable inferential properties under more general designs X while having substantial power, as demonstrated in a series of experiments running on both simulated and real data.
Collapse
Affiliation(s)
- Małgorzata Bogdan
- Department of Mathematics, Wrocław University of Technology, 50-370 Wrocław, Poland
| | - Ewout van den Berg
- Human Language Technologies, IBM T.J. Watson Research Center, Yorktown Heights, New York 10598, USA
| | - Chiara Sabatti
- Department of Health Research and Policy, Division of Biostatistics, Stanford University, HRP Redwood Building, Stanford, California 94305, USA
| | - Weijie Su
- Department of Statistics, Stanford University, 90 Serra Mall, Sequoia Hall, Stanford, California 94305, USA
| | - Emmanuel J Candès
- Department of Statistics, Stanford University, 390 Serra Mall, Sequoia Hall, Stanford, California 94305, USA
| |
Collapse
|
63
|
Abstract
In the absence of relevant prior experience, popular Bayesian estimation techniques usually begin with some form of "uninformative" prior distribution intended to have minimal inferential influence. Bayes rule will still produce nice-looking estimates and credible intervals, but these lack the logical force attached to experience-based priors and require further justification. This paper concerns the frequentist assessment of Bayes estimates. A simple formula is shown to give the frequentist standard deviation of a Bayesian point estimate. The same simulations required for the point estimate also produce the standard deviation. Exponential family models make the calculations particularly simple, and bring in a connection to the parametric bootstrap.
Collapse
|
64
|
Shen C, Li X, Jeong J. Estimation of treatment effect in a subpopulation: An empirical Bayes approach. J Biopharm Stat 2015; 26:507-18. [PMID: 26010422 DOI: 10.1080/10543406.2015.1052480] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
It is well recognized that the benefit of a medical intervention may not be distributed evenly in the target population due to patient heterogeneity, and conclusions based on conventional randomized clinical trials may not apply to every person. Given the increasing cost of randomized trials and difficulties in recruiting patients, there is a strong need to develop analytical approaches to estimate treatment effect in subpopulations. In particular, due to limited sample size for subpopulations and the need for multiple comparisons, standard analysis tends to yield wide confidence intervals of the treatment effect that are often noninformative. We propose an empirical Bayes approach to combine both information embedded in a target subpopulation and information from other subjects to construct confidence intervals of the treatment effect. The method is appealing in its simplicity and tangibility in characterizing the uncertainty about the true treatment effect. Simulation studies and a real data analysis are presented.
Collapse
Affiliation(s)
- Changyu Shen
- a Department of Biostatistics , School of Medicine, Fairbanks School of Public Health, Indiana University , Indianapolis , Indiana , USA
| | - Xiaochun Li
- a Department of Biostatistics , School of Medicine, Fairbanks School of Public Health, Indiana University , Indianapolis , Indiana , USA
| | - Jaesik Jeong
- b Department of Statistics , Chonnam National University , Gwangju , Korea
| |
Collapse
|
65
|
Affiliation(s)
- Jiaying Gu
- Department of Economics; University of Illinois; Urbana IL 61801 US
| | - Roger Koenker
- Department of Economics; University of Illinois; Urbana IL 61801 US
| |
Collapse
|
66
|
Koenker R, Mizera I. Convex Optimization, Shape Constraints, Compound Decisions, and Empirical Bayes Rules. J Am Stat Assoc 2014. [DOI: 10.1080/01621459.2013.869224] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
67
|
Abstract
Empirical Bayes methods use the data from parallel experiments, for instance observations Xk ~ 𝒩 (Θ k , 1) for k = 1, 2, …, N, to estimate the conditional distributions Θ k |Xk . There are two main estimation strategies: modeling on the θ space, called "g-modeling" here, and modeling on the×space, called "f-modeling." The two approaches are de- scribed and compared. A series of computational formulas are developed to assess their frequentist accuracy. Several examples, both contrived and genuine, show the strengths and limitations of the two strategies.
Collapse
|
68
|
Goeman JJ, Solari A. Multiple hypothesis testing in genomics. Stat Med 2014; 33:1946-78. [DOI: 10.1002/sim.6082] [Citation(s) in RCA: 208] [Impact Index Per Article: 20.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2012] [Revised: 12/09/2013] [Accepted: 12/10/2013] [Indexed: 11/06/2022]
Affiliation(s)
- Jelle J. Goeman
- Biostatistics, Department for Health Evidence; Radboud University Medical Center; Nijmegen The Netherlands
- Department of Medical Statistics and Bioinformatics; Leiden University Medical Center; Leiden The Netherlands
| | - Aldo Solari
- Department of Statistics; University of Milano-Bicocca; Milan Italy
| |
Collapse
|
69
|
Hwang JTG, Zhao Z. Empirical Bayes Confidence Intervals for Selected Parameters in High-Dimensional Data. J Am Stat Assoc 2013. [DOI: 10.1080/01621459.2013.771102] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
70
|
Polson NG, Scott JG. Data augmentation for non-Gaussian regression models using variance-mean mixtures. Biometrika 2013. [DOI: 10.1093/biomet/ass081] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
|
71
|
Ferguson JP, Cho JH, Yang C, Zhao H. Empirical Bayes correction for the Winner's Curse in genetic association studies. Genet Epidemiol 2012; 37:60-8. [PMID: 23012258 DOI: 10.1002/gepi.21683] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2012] [Revised: 08/14/2012] [Accepted: 08/17/2012] [Indexed: 01/03/2023]
Abstract
We consider an Empirical Bayes method to correct for the Winner's Curse phenomenon in genome-wide association studies. Our method utilizes the collective distribution of all odds ratios (ORs) to determine the appropriate correction for a particular single-nucleotide polymorphism (SNP). We can show that this approach is squared error optimal provided that this collective distribution is accurately estimated in its tails. To improve the performance when correcting the OR estimates for the most highly associated SNPs, we develop a second estimator that adaptively combines the Empirical Bayes estimator with a previously considered Conditional Likelihood estimator. The applications of these methods to both simulated and real data suggest improved performance in reducing selection bias.
Collapse
Affiliation(s)
- John P Ferguson
- Section of Digestive Diseases, Yale School of Medicine, New Haven, Connecticut 06511, USA.
| | | | | | | |
Collapse
|