1
|
Beyene KM, Chen DG, Kifle YG. A novel nonparametric time-dependent precision-recall curve estimator for right-censored survival data. Biom J 2024; 66:e2300135. [PMID: 38637327 DOI: 10.1002/bimj.202300135] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2023] [Revised: 10/04/2023] [Accepted: 12/27/2023] [Indexed: 04/20/2024]
Abstract
In order to assess prognostic risk for individuals in precision health research, risk prediction models are increasingly used, in which statistical models are used to estimate the risk of future outcomes based on clinical and nonclinical characteristics. The predictive accuracy of a risk score must be assessed before it can be used in routine clinical decision making, where the receiver operator characteristic curves, precision-recall curves, and their corresponding area under the curves are commonly used metrics to evaluate the discriminatory ability of a continuous risk score. Among these the precision-recall curves have been shown to be more informative when dealing with unbalanced biomarker distribution between classes, which is common in rare event, even though except one, all existing methods are proposed for classic uncensored data. This paper is therefore to propose a novel nonparametric estimation approach for the time-dependent precision-recall curve and its associated area under the curve for right-censored data. A simulation is conducted to show the better finite sample property of the proposed estimator over the existing method and a real-world data from primary biliary cirrhosis trial is used to demonstrate the practical applicability of the proposed estimator.
Collapse
Affiliation(s)
- Kassu Mehari Beyene
- College of Health Solutions, Arizona State University, Phoenix, Arizona, USA
| | - Ding-Geng Chen
- College of Health Solutions, Arizona State University, Phoenix, Arizona, USA
- Department of Statistics, University of Pretoria, Pretoria, South Africa
| | - Yehenew Getachew Kifle
- Department of Mathematics and Statistics, University of Maryland Baltimore County, Baltimore, Maryland, USA
| |
Collapse
|
2
|
Beyene KM, Chen DG. Time-dependent receiver operating characteristic curve estimator for correlated right-censored time-to-event data. Stat Methods Med Res 2024; 33:162-181. [PMID: 38130110 DOI: 10.1177/09622802231220496] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2023]
Abstract
In clinical trials, evaluating the accuracy of risk scores (markers) derived from prognostic models for prediction of survival outcomes is of major concern. The time-dependent receiver operating characteristic curve and the corresponding area under the receiver operating characteristic curve are appealing measures to evaluate the predictive accuracy. Several estimation methods have been proposed in the context of classical right-censored data which assumes the event time of individuals are independent. In many applications, however, this may not hold true if, for example, individuals belong to clusters or experience recurrent events. Estimates may be biased if this correlated nature is not taken into account. This paper is then aimed to fill this knowledge gap to introduce a time-dependent receiver operating characteristic curve and the corresponding area under the receiver operating characteristic curve estimation method for right-censored data that take the correlated nature into account. In the proposed method, the unknown status of censored subjects is imputed using conditional survival functions given the marker and frailty of the subjects. An extensive simulation study is conducted to evaluate and demonstrate the finite sample performance of the proposed method. Finally, the proposed method is illustrated using two real-world examples of lung cancer and kidney disease.
Collapse
Affiliation(s)
| | - Ding-Geng Chen
- Arizona State University, College of Health Solutions, AZ, USA
- Department of Statistics, University of Pretoria, Pretoria, South Africa
| |
Collapse
|
3
|
Cheng W, Li X. A semi-parametric approach for time-dependent ROC curves with nonignorable missing biomarker. J Biopharm Stat 2023; 33:555-574. [PMID: 36852969 DOI: 10.1080/10543406.2023.2170394] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Accepted: 12/30/2022] [Indexed: 03/01/2023]
Abstract
The main purpose of this paper is to survey the statistical inference for covariate-specific time-dependent receiver operating characteristic (ROC) curves with nonignorable missing continuous biomarker values. To construct time-dependent ROC curves, we consider a joint model which assumes that the failure time depends on the continuous biomarker and the covariates through a Cox proportional hazards model and that the continuous biomarker depends on the covariates through a semiparametric location model. Assuming a purely parametric model on the propensity score, we utilize instrumental variables to deal with the identifiable issue and estimate the unknown parameters of the propensity score by a simple and efficient method. In addition, when the propensity score is estimated, we develop HT and AIPW approaches to estimate our interested quantities. In the presence of nonignorable missing biomarker, our AIPW estimators of the interested quantities are still doubly robust when the true propensity score is a special parametric logistic model. At last, simulation studies are conducted to assess the performance of our proposed approaches, and a real data analysis is also carried out to illustrate its application.
Collapse
Affiliation(s)
- Weili Cheng
- School of Mathematics and Statistics, North China University of Water Resources and Electric Power, Zhengzhou, China
| | - Xiaorui Li
- School of Mathematics and Statistics, North China University of Water Resources and Electric Power, Zhengzhou, China
| |
Collapse
|
4
|
Zou H, Zeng D, Xiao L, Luo S. BAYESIAN INFERENCE AND DYNAMIC PREDICTION FOR MULTIVARIATE LONGITUDINAL AND SURVIVAL DATA. Ann Appl Stat 2023; 17:2574-2595. [PMID: 37719893 PMCID: PMC10500582 DOI: 10.1214/23-aoas1733] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/19/2023]
Abstract
Alzheimer's disease (AD) is a complex neurological disorder impairing multiple domains such as cognition and daily functions. To better understand the disease and its progression, many AD research studies collect multiple longitudinal outcomes that are strongly predictive of the onset of AD dementia. We propose a joint model based on a multivariate functional mixed model framework (referred to as MFMM-JM) that simultaneously models the multiple longitudinal outcomes and the time to dementia onset. We develop six functional forms to fully investigate the complex association between longitudinal outcomes and dementia onset. Moreover, we use the Bayesian methods for statistical inference and develop a dynamic prediction framework that provides accurate personalized predictions of disease progressions based on new subject-specific data. We apply the proposed MFMM-JM to two large ongoing AD studies: the Alzheimer's Disease Neuroimaging Initiative (ADNI) and National Alzheimer's Coordinating Center (NACC), and identify the functional forms with the best predictive performance. our method is also validated by extensive simulation studies with five settings.
Collapse
Affiliation(s)
- Haotian Zou
- Department of Biostatistics, University of North Carolina at Chapel Hill
| | - Donglin Zeng
- Department of Biostatistics, University of North Carolina at Chapel Hill
| | - Luo Xiao
- Department of Statistics, North Carolina State University
| | - Sheng Luo
- Department of Biostatistics and Bioinformatics, Duke University
| |
Collapse
|
5
|
Li W, Li L, Astor BC. A comparison of two approaches to dynamic prediction: Joint modeling and landmark modeling. Stat Med 2023; 42:2101-2115. [PMID: 36938960 DOI: 10.1002/sim.9713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2022] [Revised: 02/18/2023] [Accepted: 03/07/2023] [Indexed: 03/21/2023]
Abstract
Joint modeling and landmark modeling are two mainstream approaches to dynamic prediction in longitudinal studies, that is, the prediction of a clinical event using longitudinally measured predictor variables available up to the time of prediction. It is an important research question to the methodological research field and also to practical users to understand which approach can produce more accurate prediction. There were few previous studies on this topic, and the majority of results seemed to favor joint modeling. However, these studies were conducted in scenarios where the data were simulated from the joint models, partly due to the widely recognized methodological difficulty on whether there exists a general joint distribution of longitudinal and survival data so that the landmark models, which consists of infinitely many working regression models for survival, hold simultaneously. As a result, the landmark models always worked under misspecification, which caused difficulty in interpreting the comparison. In this paper, we solve this problem by using a novel algorithm to generate longitudinal and survival data that satisfies the working assumptions of the landmark models. This innovation makes it possible for a "fair" comparison of joint modeling and landmark modeling in terms of model specification. Our simulation results demonstrate that the relative performance of these two modeling approaches depends on the data settings and one does not always dominate the other in terms of prediction accuracy. These findings stress the importance of methodological development for both approaches. The related methodology is illustrated with a kidney transplantation dataset.
Collapse
Affiliation(s)
- Wenhao Li
- Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, Texas
| | - Liang Li
- Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, Texas
| | - Brad C Astor
- Departments of Medicine and Population Health Sciences, University of Wisconsin, Madison, Wisconsin
| |
Collapse
|
6
|
Zhang Q, Huang MJ, Wang HY, Wu Y, Chen YZ. A novel prognostic nomogram for adult acute lymphoblastic leukemia: a comprehensive analysis of 321 patients. Ann Hematol 2023:10.1007/s00277-023-05267-6. [PMID: 37173535 DOI: 10.1007/s00277-023-05267-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Accepted: 05/06/2023] [Indexed: 05/15/2023]
Abstract
The cure rate of acute lymphoblastic leukemia (ALL) in adolescents and adults remains poor. This study aimed to establish a prognostic model for ≥14-year-old patients with ALL to guide treatment decisions. We retrospectively analyzed the data of 321 ALL patients between January 2017 and June 2020. Patients were randomly (2:1 ratio) divided into either the training or validation set. A nomogram was used to construct a prognostic model. Multivariate Cox analysis of the training set showed that age > 50 years, white blood cell count > 28.52×109/L, and MLL rearrangement were independent risk factors for overall survival (OS), while platelet count >37×109/L was an independent protective factor. The nomogram was established according to these independent prognostic factors in the training set, where patients were grouped into two categories: low-risk (≤13.15) and high-risk (>13.15). The survival analysis, for either total patients or sub-group patients, showed that both OS and progression-free survival (PFS) of low-risk patients was significantly better than that of high-risk patients. Moreover, treatment analysis showed that both OS and progression-free survival (PFS) of ALL with stem cell transplantation (SCT) were significantly better than that of ALL without SCT. Further stratified analysis showed that in low-risk patients, the OS and PFS of patients with SCT were significantly better than those of patients without SCT. In contrast, in high-risk patients, compared with non-SCT patients, receiving SCT can only significantly prolong the PFS, but it does not benefit the OS. We established a simple and effective prognostic model for ≥ 14-year-old patients with ALL that can provide accurate risk stratification and determine the clinical strategy.
Collapse
Affiliation(s)
- Qian Zhang
- Fujian Institute of Hematology, Fujian Medical University Union Hospital, Fuzhou, China
- Fujian Provincial Key Laboratory on Hematology, Fujian Medical University Union Hospital, Fuzhou, China
| | - Mei-Juan Huang
- Fujian Institute of Hematology, Fujian Medical University Union Hospital, Fuzhou, China
- Fujian Provincial Key Laboratory on Hematology, Fujian Medical University Union Hospital, Fuzhou, China
| | - Han-Yu Wang
- Department of Cardiac Surgery, Union Hospital, Fujian Medical University, Fuzhou, Fujian, China
| | - Yong Wu
- Fujian Institute of Hematology, Fujian Medical University Union Hospital, Fuzhou, China.
- Fujian Provincial Key Laboratory on Hematology, Fujian Medical University Union Hospital, Fuzhou, China.
| | - Yuan-Zhong Chen
- Fujian Institute of Hematology, Fujian Medical University Union Hospital, Fuzhou, China.
- Fujian Provincial Key Laboratory on Hematology, Fujian Medical University Union Hospital, Fuzhou, China.
| |
Collapse
|
7
|
Zou H, Xiao L, Zeng D, Luo S. Multivariate functional mixed model with MRI data: An application to Alzheimer's disease. Stat Med 2023; 42:1492-1511. [PMID: 36805635 PMCID: PMC10133011 DOI: 10.1002/sim.9683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2022] [Revised: 11/09/2022] [Accepted: 01/26/2023] [Indexed: 02/22/2023]
Abstract
Alzheimer's Disease (AD) is the leading cause of dementia and impairment in various domains. Recent AD studies, (ie, Alzheimer's Disease Neuroimaging Initiative (ADNI) study), collect multimodal data, including longitudinal neurological assessments and magnetic resonance imaging (MRI) data, to better study the disease progression. Adopting early interventions is essential to slow AD progression for subjects with mild cognitive impairment (MCI). It is of particular interest to develop an AD predictive model that leverages multimodal data and provides accurate personalized predictions. In this article, we propose a multivariate functional mixed model with MRI data (MFMM-MRI) that simultaneously models longitudinal neurological assessments, baseline MRI data, and the survival outcome (ie, dementia onset) for subjects with MCI at baseline. Two functional forms (the random-effects model and instantaneous model) linking the longitudinal and survival process are investigated. We use Markov Chain Monte Carlo (MCMC) method based on No-U-Turn Sampling (NUTS) algorithm to obtain posterior samples. We develop a dynamic prediction framework that provides accurate personalized predictions of longitudinal trajectories and survival probability. We apply MFMM-MRI to the ADNI study and identify significant associations among longitudinal outcomes, MRI data, and the risk of dementia onset. The instantaneous model with voxels from the whole brain has the best prediction performance among all candidate models. The simulation study supports the validity of the estimation and dynamic prediction method.
Collapse
Affiliation(s)
- Haotian Zou
- Department of Biostatistics, University of North Carolina, Chapel Hill, North Carolina, United States
| | - Luo Xiao
- Department of Statistics, North Carolina State University, North Carolina, United States
| | - Donglin Zeng
- Department of Biostatistics, University of North Carolina, Chapel Hill, North Carolina, United States
| | - Sheng Luo
- Department of Biostatistics and Bioinformatics, Duke University, North Carolina, United States
| | | |
Collapse
|
8
|
Hu JF, Song X, Zhong K, Zhao XK, Zhou FY, Xu RH, Li JL, Wang XZ, Li XM, Wang PP, Lei LL, Wei MX, Wang R, Fan ZM, Han XN, Chen Y, Li LY, Ji JJ, Yang YZ, Li B, Yang MM, Yang HJ, Chang FB, Ren JL, Zhou SL, Wang LD. Increases prognostic value of clinical-pathological nomogram in patients with esophageal squamous cell carcinoma. Front Oncol 2023; 13:997776. [PMID: 36865805 PMCID: PMC9973522 DOI: 10.3389/fonc.2023.997776] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Accepted: 01/04/2023] [Indexed: 02/16/2023] Open
Abstract
Background This study was intended to construct a brand new prognostic nomogram after combine clinical and pathological characteristics to increases prognostic value in patients with esophageal squamous cell carcinoma. Methods A total of 1,634 patients were included. Subsequently, the tumor tissues of all patients were prepared into tissue microarrays. AIPATHWELL software was employed to explore tissue microarrays and calculate the tumor-stroma ratio. X-tile was adopted to find the optimal cut-off value. Univariate and multivariate Cox analyses were used to screen out remarkable characteristics for constructing the nomogram in the total populations. A novel prognostic nomogram with clinical and pathological characteristics was constructed on the basis of the training cohort (n=1,144). What's more performance was validated in the validation cohort (n=490). Clinical-pathological nomogram were assessed by concordance index, time-dependent receiver operating characteristic, calibration curve and decision curve analysis. Results The patients can divide into two groups with cut-off value of 69.78 for the tumor-stroma ratio. It is noteworthy that the survival difference was noticeable (P<0.001). A clinical-pathological nomogram was constructed by combining clinical and pathological characteristics to predict the overall survival. In comparison with TNM stage, the concordance index and time-dependent receiver operating characteristic of the clinical-pathological nomogram showed better predictive value (P<0.001). High quality of calibration plots in overall survival was noticed. As demonstrated by the decision curve analysis, the nomogram has better value than the TNM stage. Conclusions As evidently revealed by the research findings, tumor-stroma ratio is an independent prognostic factor in patients with esophageal squamous cell carcinoma. The clinical-pathological nomogram has an incremental value compared TNM stage in predicting overall survival.
Collapse
Affiliation(s)
- Jing Feng Hu
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Xin Song
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Kan Zhong
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Xue Ke Zhao
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Fu You Zhou
- Department of Thoracic Surgery, Anyang Tumor Hospital, Anyang, Henan, China
| | - Rui Hua Xu
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Ji Lin Li
- Department of Pathology, Linzhou Esophageal Cancer Hospital, Linzhou, Henan, China
| | - Xian Zeng Wang
- Department of Thoracic Surgery, Linzhou People’s Hospital, Linzhou, Henan, China
| | - Xue Min Li
- Department of Pathology, Hebei Provincial Cixian People’s Hospital, Cixian, Hebei, China
| | - Pan Pan Wang
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Ling Ling Lei
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Meng Xia Wei
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Ran Wang
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Zong Min Fan
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Xue Na Han
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Yao Chen
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Liu Yu Li
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Jia Jia Ji
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Yuan Ze Yang
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Bei Li
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Miao Miao Yang
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China
| | - Hai Jun Yang
- Department of Thoracic Surgery, Anyang Tumor Hospital, Anyang, Henan, China
| | - Fu Bao Chang
- Department of Surgery, Central Hospital of Linzhou City, Linzhou, Henan, China
| | - Jing Li Ren
- Department of Pathology, The Second Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Sheng Li Zhou
- Department of Pathology, Henan Provincial People’s Hospital, People’s Hospital of Zhengzhou University, People’s Hospital of Henan University, Zhengzhou, Henan, China
| | - Li Dong Wang
- State Key Laboratory of Esophageal Cancer Prevention & Treatment of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,Henan Key Laboratory for Esophageal Cancer Research of The First Affiliated Hospital, Zhengzhou University, Zhengzhou, Henan, China,*Correspondence: Li Dong Wang,
| |
Collapse
|
9
|
Yao Y, Li L, Astor B, Yang W, Greene T. Predicting the risk of a clinical event using longitudinal data: the generalized landmark analysis. BMC Med Res Methodol 2023; 23:5. [PMID: 36611147 PMCID: PMC9824910 DOI: 10.1186/s12874-022-01828-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Accepted: 12/22/2022] [Indexed: 01/09/2023] Open
Abstract
BACKGROUND In the development of prediction models for a clinical event, it is common to use the static prediction modeling (SPM), a regression model that relates baseline predictors to the time to event. In many situations, the data used in training and validation are from longitudinal studies, where predictor variables are time-varying and measured at clinical visits. But these data are not used in SPM. The landmark analysis (LA), previously proposed for dynamic prediction with longitudinal data, has interpretational difficulty when the baseline is not a risk-changing clinical milestone, as is often the case in observational studies of chronic disease without intervention. METHODS This paper studies the generalized landmark analysis (GLA), a statistical framework to develop prediction models for longitudinal data. The GLA includes the LA as a special case, and generalizes it to situations where the baseline is not a risk-changing clinical milestone with a more useful interpretation. Unlike the LA, the landmark variable does not have to be time since baseline in the GLA, but can be any time-varying prognostic variable. The GLA can also be viewed as a longitudinal generalization of localized prediction, which has been studied in the context of low-dimensional cross-sectional data. We studied the GLA using data from the Chronic Renal Insufficiency Cohort (CRIC) Study and the Wisconsin Allograft Replacement Database (WisARD) and compared the prediction performance of SPM and GLA. RESULTS In various validation populations from longitudinal data, the GLA generally had similarly or better predictive performance than SPM, with notable improvement being seen when the validation population deviated from the baseline population. The GLA also demonstrated similar or better predictive performance than LA, due to its more general model specification. CONCLUSIONS GLA is a generalization of the LA such that the landmark variable does not have to be the time since baseline. It has better interpretation when the baseline is not a risk-changing clinical milestone. The GLA is more adaptive to the validation population than SPM and is more flexible than LA, which may help produce more accurate prediction.
Collapse
Affiliation(s)
- Yi Yao
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, US
| | - Liang Li
- Department of Biostatistics, University of Texas MD Anderson Cancer Center, Houston, TX, US
| | - Brad Astor
- School of Medicine and Public Health, University of Wisconsin-Madison, Madison, WI, US
| | - Wei Yang
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, US
| | - Tom Greene
- School of Medicine, University of Utah, Madison, UT, US
| |
Collapse
|
10
|
Pfeiffer RM, Chen Y, Gail MH, Ankerst DP. Accommodating population differences when validating risk prediction models. Stat Med 2022; 41:4756-4780. [PMID: 36224712 PMCID: PMC10510530 DOI: 10.1002/sim.9447] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2021] [Revised: 01/19/2022] [Accepted: 05/11/2022] [Indexed: 11/11/2022]
Abstract
Validation of risk prediction models in independent data provides a more rigorous assessment of model performance than internal assessment, for example, done by cross-validation in the data used for model development. However, several differences between the populations that gave rise to the training and the validation data can lead to seemingly poor performance of a risk model. In this paper we formalize the notions of "similarity" or "relatedness" of the training and validation data, and define reproducibility and transportability. We address the impact of different distributions of model predictors and differences in verifying the disease status or outcome on measures of calibration, accuracy and discrimination of a model. When individual level information from both the training and validation data sets is available, we propose and study weighted versions of the validation metrics that adjust for differences in the risk factor distributions and in outcome verification between the training and validation data to provide a more comprehensive assessment of model performance. We provide conditions on the risk model and the populations that gave rise to the training and validation data that ensure a model's reproducibility or transportability, and show how to check these conditions using weighted and unweighted performance measures. We illustrate the method by developing and validating a model that predicts the risk of developing prostate cancer using data from two large prostate cancer screening trials.
Collapse
Affiliation(s)
| | - Yiyao Chen
- Technical University of Munich, Garching, Germany
| | | | | |
Collapse
|
11
|
Wang S, Li Z, Lan L, Zhao J, Zheng WJ, Li L. GPU accelerated estimation of a shared random effect joint model for dynamic prediction. Comput Stat Data Anal 2022. [DOI: 10.1016/j.csda.2022.107528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
12
|
Liu Y, Zheng R, Liu Y, Yang L, Li T, Li Y, Jiang Z, Liu Y, Wang C, Wang S. An easy-to-use nomogram predicting overall survival of adult acute lymphoblastic leukemia. Front Oncol 2022; 12:977119. [PMID: 36226057 PMCID: PMC9549528 DOI: 10.3389/fonc.2022.977119] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2022] [Accepted: 08/29/2022] [Indexed: 12/02/2022] Open
Abstract
Adult acute lymphoblastic leukemia (ALL) is heterogeneous both biologically and clinically. The outcomes of ALL have been improved with the application of children-like regimens and novel agents including immune therapy in young adults. The refractory to therapy and relapse of ALL have occurred in most adult cases. Factors affecting the prognosis of ALL include age and white blood cell (WBC) count at diagnosis. The clinical implications of genetic biomarkers, including chromosome translocation and gene mutation, have been explored in ALL. The interactions of these factors on the prediction of prognosis have not been evaluated in adult ALL. A prognostic model based on clinical and genetic abnormalities is necessary for clinical practice in the management of adult ALL. The newly diagnosed adult ALL patients were divided into the training and the validation cohort at 7:3 ratio. Factors associated with overall survival (OS) were assessed by univariate/multivariate Cox regression analyses and a signature score was assigned to each independent factor. A nomogram based on the signature score was developed and validated. The receiver operating characteristic (ROC) curve, calibration curve, and decision curve analysis (DCA) were used to assess the performance of the nomogram model. This study included a total of 229 newly diagnosed ALL patients. Five independent variables including age, WBC, bone marrow (BM) blasts, MLL rearrangement, and ICT gene mutations (carried any positive mutation of IKZF1, CREBBP and TP53) were identified as independent adverse factors for OS evaluated by the univariate, Kaplan-Meier survival and multivariate Cox regression analyses. A prognostic nomogram was built based on these factors. The areas under the ROC curve and calibration curve showed good accuracy between the predicted and observed values. The DCA curve showed that the performance of our model was superior to current risk factors. A nomogram was developed and validated based on the clinical and laboratory factors in newly diagnosed ALL patients. This model is effective to predict the overall survival of adult ALL. It is a simple and easy-to-use model that could efficiently predict the prognosis of adult ALL and is useful for decision making of treatment.
Collapse
Affiliation(s)
- Yu Liu
- Department of Hematology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
| | - Ruyue Zheng
- Department of Hematology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
| | - Yajun Liu
- Department of Orthopaedics, Rhode Island Hospital, Warren Alpert Medical School, Brown University, Providence, RI, United States
| | - Lu Yang
- Department of Hematology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
| | - Tao Li
- Department of Hematology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
| | - Yafei Li
- Department of Hematology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
| | - Zhongxing Jiang
- Department of Hematology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
| | - Yanfang Liu
- Department of Hematology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
| | - Chong Wang
- Department of Hematology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
| | - Shujuan Wang
- Department of Hematology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, China
- *Correspondence: Shujuan Wang,
| |
Collapse
|
13
|
Li J, Wu Z, Wang S, Li C, Zhuang X, He Y, Xu J, Su M, Wang Y, Ma W, Fan D, Yue T. A necroptosis-related prognostic model for predicting prognosis, immune landscape, and drug sensitivity in hepatocellular carcinoma based on single-cell sequencing analysis and weighted co-expression network. Front Genet 2022; 13:984297. [PMID: 36212155 PMCID: PMC9533069 DOI: 10.3389/fgene.2022.984297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Accepted: 09/01/2022] [Indexed: 12/24/2022] Open
Abstract
Background: Hepatocellular carcinoma (HCC) is a highly lethal cancer and is the second leading cause of cancer-related deaths worldwide. Unlike apoptosis, necroptosis (NCPS) triggers an immune response by releasing damage-related molecular factors. However, the clinical prognostic features of necroptosis-associated genes in HCC are still not fully explored.Methods: We analyzed the single-cell datasets GSE125449 and GSE151530 from the GEO database and performed weighted co-expression network analysis on the TCGA data to identify the necroptosis genes. A prognostic model was built using COX and Lasso regression. In addition, we performed an analysis of survival, immunity microenvironment, and mutation. Furthermore, the hub genes and pathways associated with HCC were localized within the single-cell atlas.Results: Patients with HCC in the TCGA and ICGC cohorts were classified using a necroptosis-related model with significant differences in survival times between high- and low-NCPS groups (p < 0.05). High-NCPS patients expressed more immune checkpoint-related genes, suggesting immunotherapy and some chemotherapies might prove beneficial to them. In addition, a single-cell sequencing approach was conducted to investigate the expression of hub genes and associated signaling pathways in different cell types.Conclusion: Through the analysis of single-cell and bulk multi-omics sequencing data, we constructed a prognostic model related to necroptosis and explored the relationship between high- and low-NCPS groups and immune cell infiltration in HCC. This provides a new reference for further understanding the role of necroptosis in HCC.
Collapse
Affiliation(s)
- Jingjing Li
- Department of Anesthesiology, Jincheng People’s Hospital, Jincheng, Shanxi, China
- Department of Anesthesiology, The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Zhi Wu
- Department of General Surgery, Jincheng People’s Hospital, Jincheng, Shanxi, China
| | - Shuchen Wang
- Department of Anesthesiology, The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Chan Li
- The Fifth Clinical Medical School, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Xuhui Zhuang
- Department of Anesthesiology, The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Yuewen He
- Department of Anesthesiology, The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Jianmei Xu
- The Fifth Clinical Medical School, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Meiyi Su
- Department of Rehabilitation, GuangDong Second Traditional Chinese Medicine Hospital, Guangzhou, China
| | - Yong Wang
- Department of Anesthesiology, The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Wuhua Ma
- Department of Anesthesiology, The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Dehui Fan
- The Fifth Clinical Medical School, Guangzhou University of Chinese Medicine, Guangzhou, China
- Department of Rehabilitation, GuangDong Second Traditional Chinese Medicine Hospital, Guangzhou, China
| | - Ting Yue
- Department of Oncology Rehabilitation, Jincheng People’s Hospital, Jincheng, Shanxi, China
- *Correspondence: Ting Yue,
| |
Collapse
|
14
|
Yue T, Li J, Liang M, Yang J, Ou Z, Wang S, Ma W, Fan D. Identification of the KCNQ1OT1/ miR-378a-3p/ RBMS1 Axis as a Novel Prognostic Biomarker Associated With Immune Cell Infiltration in Gastric Cancer. Front Genet 2022; 13:928754. [PMID: 35910231 PMCID: PMC9330051 DOI: 10.3389/fgene.2022.928754] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 06/23/2022] [Indexed: 11/13/2022] Open
Abstract
Background: Gastric cancer (GC) is the second leading cause of cancer-related mortality and the fifth most common cancer worldwide. However, the underlying mechanisms of competitive endogenous RNAs (ceRNAs) in GC are unclear. This study aimed to construct a ceRNA regulation network in correlation with prognosis and explore a prognostic model associated with GC. Methods: In this study, 1,040 cases of GC were obtained from TCGA and GEO datasets. To identify potential prognostic signature associated with GC, Cox regression analysis and the least absolute shrinkage and selection operator (LASSO) regression were employed. The prognostic value of the signature was validated in the GEO84437 training set, GEO84437 test set, GEO15459 set, and TCGA-STAD. Based on the public databases, TargetScan and starBase, an mRNA-miRNA-lncRNA regulatory network was constructed, and hub genes were identified using the CytoHubba plugin. Furthermore, the clinical outcomes, immune cell infiltration, genetic variants, methylation, and somatic copy number alteration (sCNA) associated with the ceRNA network were derived using bioinformatics methods. Results: A total of 234 prognostic genes were identified. GO and GSEA revealed that the biological pathways and modules related to immune response and fibroblasts were considerably enriched in GC. A nomogram was generated to provide accurate prognostic outcomes and individualized risk estimates, which were validated in the training, test dataset, and two independent validation datasets. Thereafter, an mRNA-miRNA-lncRNA regulatory network containing 4 mRNAs, 22 miRNAs, 201 lncRNAs was constructed. The KCNQ1OT1/hsa-miR-378a-3p/RBMS1 ceRNA network associated with the prognosis was obtained by hub gene analysis and correlation analysis. Importantly, we found that the KCNQ1OT1/miR-378a-3p/RBMS1 axis may play a vital role in the diagnosis and prognosis of GC patients based on Cox regression analyses. Furthermore, our findings demonstrated that mutations and sCNA of the KCNQ1OT1/miR-378a-3p/RBMS1 axis were associated with increased immune infiltration, while the abnormal upregulation of the axis was primarily a result of hypomethylation. Conclusion: Our findings suggest that the KCNQ1OT1/miR-378a-3p/RBMS1 axis may be a potential prognostic biomarker and therapeutic target for GC. Moreover, such findings provide insights into the molecular mechanisms of GC pathogenesis.
Collapse
Affiliation(s)
- Ting Yue
- The Fifth Clinical Medical School, Guangzhou University of Chinese Medicine, Guangzhou, China
- Department of Oncology Rehabilitation, Jincheng People’s Hospital, Jincheng, China
| | - Jingjing Li
- Department of Anesthesiology, The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
- Department of Anesthesiology, Jincheng People’s Hospital, Jincheng, China
| | - Manguang Liang
- The Fifth Clinical Medical School, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Jiaman Yang
- The Fifth Clinical Medical School, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Zhiwen Ou
- The Fifth Clinical Medical School, Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Shuchen Wang
- Department of Anesthesiology, The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
| | - Wuhua Ma
- Department of Anesthesiology, The First Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, China
- *Correspondence: Wuhua Ma, ; Dehui Fan,
| | - Dehui Fan
- The Fifth Clinical Medical School, Guangzhou University of Chinese Medicine, Guangzhou, China
- Department of Rehabilitation, GuangDong Second Traditional Chinese Medicine Hospital, Guangzhou, China
- *Correspondence: Wuhua Ma, ; Dehui Fan,
| |
Collapse
|
15
|
Luo C, Wang S, Shan W, Liao W, Zhang S, Wang Y, Xin Q, Yang T, Hu S, Xie W, Xu N, Zhang Y. A Whole Exon Screening-Based Score Model Predicts Prognosis and Immune Checkpoint Inhibitor Therapy Effects in Low-Grade Glioma. Front Immunol 2022; 13:909189. [PMID: 35769464 PMCID: PMC9234137 DOI: 10.3389/fimmu.2022.909189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2022] [Accepted: 05/16/2022] [Indexed: 11/23/2022] Open
Abstract
Objective This study aims to identify prognostic factors for low-grade glioma (LGG) via different machine learning methods in the whole genome and to predict patient prognoses based on these factors. We verified the results through in vitro experiments to further screen new potential therapeutic targets. Method A total of 940 glioma patients from The Cancer Genome Atlas (TCGA) and The Chinese Glioma Genome Atlas (CGGA) were included in this study. Two different feature extraction algorithms – LASSO and Random Forest (RF) – were used to jointly screen genes significantly related to the prognosis of patients. The risk signature was constructed based on these screening genes, and the K-M curve and ROC curve evaluated it. Furthermore, we discussed the differences between the high- and low-risk groups distinguished by the signature in detail, including differential gene expression (DEG), single-nucleotide polymorphism (SNP), copy number variation (CNV), immune infiltration, and immune checkpoint. Finally, we identified the function of a novel molecule, METTL7B, which was highly correlated with PD-L1 expression on tumor cell, as verified by in vitro experiments. Results We constructed an accurate prediction model based on seven genes (AUC at 1, 3, 5 years= 0.91, 0.85, 0.74). Further analysis showed that extracellular matrix remodeling and cytokine and chemokine release were activated in the high-risk group. The proportion of multiple immune cell infiltration was upregulated, especially macrophages, accompanied by the high expression of most immune checkpoints. According to the in vitro experiment, we preliminarily speculate that METTL7B affects the stability of PD-L1 mRNA by participating in the modification of m6A. Conclusion The seven gene signatures we constructed can predict the prognosis of patients and identify the potential benefits of immune checkpoint inhibitors (ICI) therapy for LGG. More importantly, METTL7B, one of the risk genes, is a crucial molecule that regulates PD-L1 and could be used as a new potential therapeutic target.
Collapse
Affiliation(s)
- Cheng Luo
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Department of Biomedical Engineering, Tsinghua University, Beijing, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
| | - Songmao Wang
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- School of Life Sciences, Tsinghua University, Beijing, China
| | - Wenjie Shan
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Open Faculty for Innovation, Education, Science, Technology and Art, Tsinghua Shenzhen International Graduate School, Shenzhen, China
| | - Weijie Liao
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
| | - Shikuan Zhang
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- School of Life Sciences, Tsinghua University, Beijing, China
| | - Yanzhi Wang
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- School of Life Sciences, Tsinghua University, Beijing, China
| | - Qilei Xin
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Department of Chemical Engineering, Tsinghua University, Beijing, China
| | - Tingpeng Yang
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Department of Chemical Engineering, Tsinghua University, Beijing, China
| | - Shaoliang Hu
- Research and Development Department, Shenzhen Combined Biotech Co., Ltd, Shenzhen, China
| | - Weidong Xie
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Open Faculty for Innovation, Education, Science, Technology and Art, Tsinghua Shenzhen International Graduate School, Shenzhen, China
| | - Naihan Xu
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Open Faculty for Innovation, Education, Science, Technology and Art, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- *Correspondence: Naihan Xu, ; Yaou Zhang,
| | - Yaou Zhang
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- Open Faculty for Innovation, Education, Science, Technology and Art, Tsinghua Shenzhen International Graduate School, Shenzhen, China
- *Correspondence: Naihan Xu, ; Yaou Zhang,
| |
Collapse
|
16
|
Modelling time-varying covariates effect on survival via functional data analysis: application to the MRC BO06 trial in osteosarcoma. STAT METHOD APPL-GER 2022. [DOI: 10.1007/s10260-022-00647-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
AbstractTime-varying covariates are of great interest in clinical research since they represent dynamic patterns which reflect disease progression. In cancer studies biomarkers values change as functions of time and chemotherapy treatment is modified by delaying a course or reducing the dose intensity, according to patient’s toxicity levels. In this work, a Functional covariate Cox Model (FunCM) to study the association between time-varying processes and a time-to-event outcome is proposed. FunCM first exploits functional data analysis techniques to represent time-varying processes in terms of functional data. Then, information related to the evolution of the functions over time is incorporated into functional regression models for survival data through functional principal component analysis. FunCM is compared to a standard time-varying covariate Cox model, commonly used despite its limiting assumptions that covariate values are constant in time and measured without errors. Data from MRC BO06/EORTC 80931 randomised controlled trial for treatment of osteosarcoma are analysed. Time-varying covariates related to alkaline phosphatase levels, white blood cell counts and chemotherapy dose during treatment are investigated. The proposed method allows to detect differences between patients with different biomarkers and treatment evolutions, and to include this information in the survival model. These aspects are seldom addressed in the literature and could provide new insights into the clinical research.
Collapse
|
17
|
Geraili Z, Hajian-Tilaki K, Bayani M, Hosseini SR, Khafri S, Ebrahimpour S, Javanian M, Babazadeh A, Shokri M. Prognostic accuracy of inflammatory markers in predicting risk of ICU admission for COVID-19: application of time-dependent receiver operating characteristic curves. J Int Med Res 2022; 50:3000605221102217. [PMID: 35701893 PMCID: PMC9208048 DOI: 10.1177/03000605221102217] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
Objective Intensive care unit (ICU) admission occurs at different times during hospitalization among patients with COVID-19. We aimed to evaluate the time-dependent receive operating characteristic (ROC) curve and area under the ROC curve, AUC(t), and accuracy of baseline levels of inflammatory markers C-reactive protein (CRP) and neutrophil-to-lymphocyte ratio (NLR) in predicting time to an ICU admission event in patients with severe COVID-19 infection. Methods In this observational study, we evaluated 724 patients with confirmed severe COVID-19 referred to Ayatollah Rohani Hospital, affiliated with Babol University of Medical Sciences, Iran. Results The AUC(t) of CRP and NLR reached 0.741 (95% confidence interval [CI]: 0.661–0.820) and 0.690 (95% CI: 0.607–0.772), respectively, in the first 3 days after hospital admission. The optimal cutoff values of CRP and NLR for stratification of ICU admission outcomes in patients with severe COVID-19 were 78 mg/L and 5.13, respectively. The risk of ICU admission was significantly greater for patients with these cutoff values (CRP hazard ratio = 2.98; 95% CI: 1.58–5.62; NLR hazard ratio = 2.90; 95% CI: 1.45–5.77). Conclusions Using time-dependent ROC curves, CRP and NLR values at hospital admission were important predictors of ICU admission. This approach is more efficient than using standard ROC curves.
Collapse
Affiliation(s)
- Zahra Geraili
- Social Determinants of Health Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran
| | - Karimollah Hajian-Tilaki
- Social Determinants of Health Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran.,Department of Biostatistics and Epidemiology, School of Public Health, Babol University of Medical Sciences, Babol, Iran
| | - Masomeh Bayani
- Infectious Diseases and Tropical Medicine Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran
| | - Seyed Reza Hosseini
- Social Determinants of Health Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran
| | - Soraya Khafri
- Department of Biostatistics and Epidemiology, School of Public Health, Babol University of Medical Sciences, Babol, Iran
| | - Soheil Ebrahimpour
- Infectious Diseases and Tropical Medicine Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran
| | - Mostafa Javanian
- Infectious Diseases and Tropical Medicine Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran
| | - Arefeh Babazadeh
- Infectious Diseases and Tropical Medicine Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran
| | - Mehran Shokri
- Infectious Diseases and Tropical Medicine Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran
| |
Collapse
|
18
|
Beyene KM, El Ghouch A. Time-dependent ROC curve estimation for interval-censored data. Biom J 2022; 64:1056-1074. [PMID: 35523738 DOI: 10.1002/bimj.202000382] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2020] [Revised: 10/20/2021] [Accepted: 11/07/2021] [Indexed: 11/10/2022]
Abstract
The receiver-operating characteristic (ROC) curve is the most popular graphical method for evaluating the classification accuracy of a diagnostic marker. In time-to-event studies, the subject's event status is time-dependent, and hence, time-dependent extensions of ROC curve have been proposed. However, in practice, the calculation of this curve is not straightforward due to the presence of censoring that may be of different types. Existing methods focus on the more standard and simple case of right-censoring and neglect the general case of mixed interval-censored data that may involve left-, right-, and interval-censored observations. In this context, we propose and study a new time-dependent ROC curve estimator. We also consider some summary measures (area under the ROC curve and Youden index) traditionally associated with ROC as well as the Youden-based cutoff estimation method. The proposed method uses available data very efficiently. To this end, the unknown status (positive or negative) of censored subjects are estimated from the data via the estimation of the conditional survival function given the marker. For that, we investigate both model-based and nonparametric approaches. We also provide variance estimates and confidence intervals using Bootstrap. A simulation study is conducted to investigate the finite sample behavior of the proposed methods and to compare their performance with a competitor. Globally, we observed better finite sample performances for the proposed estimators. Finally, we illustrate the methods using two data sets one from a hypobaric decompression sickness study and the other from an oral health study. The proposed methods are implemented in the R package cenROC.
Collapse
Affiliation(s)
- Kassu Mehari Beyene
- ISBA, UCLouvain, Louvain la Neuve, Belgium.,Department of Statistics, College of Natural Sciences, Wollo University, Dessie, Ethiopia
| | | |
Collapse
|
19
|
Zhang DY, Ku JW, Zhao XK, Zhang HY, Song X, Wu HF, Fan ZM, Xu RH, You D, Wang R, Zhou RX, Wang LD. Increased prognostic value of clinical–reproductive model in Chinese female patients with esophageal squamous cell carcinoma. World J Gastroenterol 2022; 28:1347-1361. [PMID: 35645543 PMCID: PMC9099181 DOI: 10.3748/wjg.v28.i13.1347] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Revised: 01/21/2022] [Accepted: 02/27/2022] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND In China, it has been well recognized that some female patients with esophageal squamous cell carcinoma (ESCC) have different overall survival (OS) time, even with the same tumor-node-metastasis (TNM) stage, challenging the prognostic value of the TNM system alone. An effective predictive model is needed to accurately evaluate the prognosis of female ESCC patients.
AIM To construct a novel prognostic model with clinical and reproductive data for Chinese female patients with ESCC, and to assess the incremental prognostic value of the full model compared with the clinical model and TNM stage.
METHODS A new prognostic nomogram incorporating clinical and reproductive features was constructed based on univariatie and Cox proportional hazards survival analysis from a training cohort (n = 175). The results were recognized using the internal (n = 111) and independent external (n = 85) validation cohorts. The capability of the clinical–reproductive model was evaluated by Harrell’s concordance index (C-index), Kaplan–Meier curve, time-dependent receiver operating characteristic (ROC), calibration curve and decision curve analysis. The correlations between estrogen response and immune-related pathways and some gene markers of immune cells were analyzed using the TIMER 2.0 database.
RESULTS A clinical–reproductive model including incidence area, age, tumor differentiation, lymph node metastasis (N) stage, estrogen receptor alpha (ESR1) and beta (ESR2) expression, menopausal age, and pregnancy number was constructed to predict OS in female ESCC patients. Compared to the clinical model and TNM stage, the time-dependent ROC and C-index of the clinical–reproductive model showed a good discriminative ability for predicting 1-, 3-, and 5-years OS in the primary training, internal and external validation sets. Based on the optimal cut-off value of total prognostic scores, patients were classified into high- and low-risk groups with significantly different OS. The estrogen response was significantly associated with p53 and apoptosis pathways in esophageal cancer.
CONCLUSION The clinical–reproductive prognostic nomogram has an incremental prognostic value compared with the clinical model and TNM stage in predicting OS in Chinese female ESCC patients.
Collapse
Affiliation(s)
- Dong-Yun Zhang
- State Key Laboratory of Esophageal Cancer Prevention & Treatment and Henan Key Laboratory for Esophageal Cancer Research of the First Affiliated Hospital, Zhengzhou University, Zhengzhou 450052, Henan Province, China
- Department of Pathology, Nanyang Medical College, Nanyang 473061, Henan Province, China
| | - Jian-Wei Ku
- Department of Endoscopy, The Third Affiliated Hospital, Nanyang Medical College, Nanyang 473061, Henan Province, China
| | - Xue-Ke Zhao
- State Key Laboratory of Esophageal Cancer Prevention & Treatment and Henan Key Laboratory for Esophageal Cancer Research of the First Affiliated Hospital, Zhengzhou University, Zhengzhou 450052, Henan Province, China
| | - Hai-Yan Zhang
- Department of Pathology, The First Affiliated Hospital, Nanyang Medical College, Nanyang 473061, Henan Province, China
| | - Xin Song
- State Key Laboratory of Esophageal Cancer Prevention & Treatment and Henan Key Laboratory for Esophageal Cancer Research of the First Affiliated Hospital, Zhengzhou University, Zhengzhou 450052, Henan Province, China
| | - Hong-Fang Wu
- Department of Pathology, Nanyang Medical College, Nanyang 473061, Henan Province, China
| | - Zong-Min Fan
- State Key Laboratory of Esophageal Cancer Prevention & Treatment and Henan Key Laboratory for Esophageal Cancer Research of the First Affiliated Hospital, Zhengzhou University, Zhengzhou 450052, Henan Province, China
| | - Rui-Hua Xu
- State Key Laboratory of Esophageal Cancer Prevention & Treatment and Henan Key Laboratory for Esophageal Cancer Research of the First Affiliated Hospital, Zhengzhou University, Zhengzhou 450052, Henan Province, China
| | - Duo You
- State Key Laboratory of Esophageal Cancer Prevention & Treatment and Henan Key Laboratory for Esophageal Cancer Research of the First Affiliated Hospital, Zhengzhou University, Zhengzhou 450052, Henan Province, China
- Department of Medical Oncology, Affiliated Cancer Hospital of Zhengzhou University, Henan Cancer Hospital, Zhengzhou 450052, Henan Province, China
| | - Ran Wang
- State Key Laboratory of Esophageal Cancer Prevention & Treatment and Henan Key Laboratory for Esophageal Cancer Research of the First Affiliated Hospital, Zhengzhou University, Zhengzhou 450052, Henan Province, China
| | - Ruo-Xi Zhou
- Department of Biology, University of Richmond, Richmond, VA 23173, United States
| | - Li-Dong Wang
- State Key Laboratory of Esophageal Cancer Prevention & Treatment and Henan Key Laboratory for Esophageal Cancer Research of the First Affiliated Hospital, Zhengzhou University, Zhengzhou 450052, Henan Province, China
| |
Collapse
|
20
|
Lin J, Luo S. Deep learning for the dynamic prediction of multivariate longitudinal and survival data. Stat Med 2022; 41:2894-2907. [PMID: 35347750 DOI: 10.1002/sim.9392] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2021] [Revised: 02/18/2022] [Accepted: 03/08/2022] [Indexed: 11/10/2022]
Abstract
The joint model for longitudinal and survival data improves time-to-event predictions by including longitudinal outcome variables in addition to baseline covariates. However, in practice, joint models may be limited by parametric assumptions in both the longitudinal and survival submodels. In addition, computational difficulties arise when considering multiple longitudinal outcomes due to the large number of random effects to be integrated out in the full likelihood. In this article, we discuss several recent machine learning methods for incorporating multivariate longitudinal data for time-to-event prediction. The presented methods use functional data analysis or convolutional neural networks to model the longitudinal data, both of which scale well to multiple longitudinal outcomes. In addition, we propose a novel architecture based on the transformer neural network, named TransformerJM, which jointly models longitudinal and time-to-event data. The prognostic abilities of each model are assessed and compared through both simulation and real data analysis on Alzheimer's disease datasets. Specifically, the models were evaluated based on their ability to dynamically update predictions as new longitudinal data becomes available. We showed that TransformerJM improves upon the predictive performance of existing methods across different scenarios.
Collapse
Affiliation(s)
- Jeffrey Lin
- Department of Biostatistics and Data Science, The University of Texas Health Science Center at Houston, Houston, Texas, USA
| | - Sheng Luo
- Department of Biostatistics and Bioinformatics, Duke University Medical Center, Durham, North Carolina, USA
| |
Collapse
|
21
|
Clonal and subclonal TP53 molecular impairment is associated with prognosis and progression in multiple myeloma. Blood Cancer J 2022; 12:15. [PMID: 35082295 PMCID: PMC8791929 DOI: 10.1038/s41408-022-00610-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2021] [Revised: 09/14/2021] [Accepted: 11/11/2021] [Indexed: 02/06/2023] Open
Abstract
Aberrations on TP53, either as deletions of chromosome 17p (del17p) or mutations, are associated with poor outcome in multiple myeloma (MM), but conventional detection methods currently in use underestimate their incidence, hindering an optimal risk assessment and prognostication of MM patients. We have investigated the altered status of TP53 gene by SNPs array and sequencing techniques in a homogenous cohort of 143 newly diagnosed MM patients, evaluated both at diagnosis and at first relapse: single-hit on TP53 gene, either deletion or mutation, detected both at clonal and sub-clonal level, had a minor effect on outcomes. Conversely, the coexistence of both TP53 deletion and mutation, which defined the so-called double-hit patients, was associated with the worst clinical outcome (PFS: HR 3.34 [95% CI: 1.37–8.12] p = 0.008; OS: HR 3.47 [95% CI: 1.18–10.24] p = 0.02). Moreover, the analysis of longitudinal samples pointed out that TP53 allelic status might increase during the disease course. Notably, the acquisition of TP53 alterations at relapse dramatically worsened the clinical course of patients. Overall, our analyses showed these techniques to be highly sensitive to identify TP53 aberrations at sub-clonal level, emphasizing the poor prognosis associated with double-hit MM patients.
Collapse
|
22
|
Zou H, Li K, Zeng D, Luo S. Bayesian inference and dynamic prediction of multivariate joint model with functional data: An application to Alzheimer's disease. Stat Med 2021; 40:6855-6872. [PMID: 34649301 PMCID: PMC8671252 DOI: 10.1002/sim.9214] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2020] [Revised: 08/03/2021] [Accepted: 09/20/2021] [Indexed: 01/01/2023]
Abstract
Alzheimer's disease (AD) is a severe neurodegenerative disorder impairing multiple domains, for example, cognition and behavior. Assessing the risk of AD progression and initiating timely interventions at early stages are critical to improve the quality of life for AD patients. Due to the heterogeneous nature and complex mechanisms of AD, one single longitudinal outcome is insufficient to assess AD severity and disease progression. Therefore, AD studies collect multiple longitudinal outcomes, including cognitive and behavioral measurements, as well as structural brain images such as magnetic resonance imaging (MRI). How to utilize the multivariate longitudinal outcomes and MRI data to make efficient statistical inference and prediction is an open question. In this article, we propose a multivariate joint model with functional data (MJM-FD) framework that relates multiple correlated longitudinal outcomes to a survival outcome, and use the scalar-on-function regression method to include voxel-based whole-brain MRI data as functional predictors in both longitudinal and survival models. We adopt a Bayesian paradigm to make statistical inference and develop a dynamic prediction framework to predict an individual's future longitudinal outcomes and risk of a survival event. We validate the MJM-FD framework through extensive simulation studies and apply it to the motivating Alzheimer's Disease Neuroimaging Initiative (ADNI) study.
Collapse
Affiliation(s)
- Haotian Zou
- Gillings School of Global Public Health, Department of Biostatistics, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Kan Li
- Merck Research Lab, Merck & Co, North Wales, Pennsylvania
| | - Donglin Zeng
- Department of Biostatistics, Gillings School of Global Public Health, CB#7420, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Sheng Luo
- Corresponding author: Sheng Luo, Department of Biostatistics and Informatics, Duke University, 2424 Erwin Rd, Durham, NC 27705, USA ()
| | | |
Collapse
|
23
|
Abstract
Machine learning (ML)-based prediction is considered an important technique for improving decision making during the planning process. Modern ML models are used for prediction, prioritization, and decision making. Multiple ML algorithms are used to improve decision-making at different aspects after forecasting. This study focuses on the future prediction of the effectiveness of the COVID-19 vaccine effectiveness which has been presented as a light in the dark. People bear several reservations, including concerns about the efficacy of the COVID-19 vaccine. Under these presumptions, the COVID-19 vaccine would either lower the risk of developing the malady after injection, or the vaccine would impose side effects, affecting their existing health condition. In this regard, people have publicly expressed their concerns regarding the vaccine. This study intends to estimate what perception the masses will establish about the role of the COVID-19 vaccine in the future. Specifically, this study exhibits people’s predilection toward the COVID-19 vaccine and its results based on the reviews. Five models, e.g., random forest (RF), a support vector machine (SVM), decision tree (DT), K-nearest neighbor (KNN), and an artificial neural network (ANN), were used for forecasting the overall predilection toward the COVID-19 vaccine. A voting classifier was used at the end of this study to determine the accuracy of all the classifiers. The results prove that the SVM produces the best forecasting results and that artificial neural networks (ANNs) produce the worst prediction toward the individual aptitude to be vaccinated by the COVID-19 vaccine. When using the voting classifier, the proposed system provided an overall accuracy of 89.9% for the random dataset and 45.7% for the date-wise dataset. Thus, the results show that the studied prediction technique is a promising and encouraging procedure for studying the future trends of the COVID-19 vaccine.
Collapse
|
24
|
Luo C, Wang S, Liao W, Zhang S, Xu N, Xie W, Zhang Y. Upregulation of the APOBEC3 Family Is Associated with a Poor Prognosis and Influences Treatment Response to Raf Inhibitors in Low Grade Glioma. Int J Mol Sci 2021; 22:10390. [PMID: 34638749 PMCID: PMC8508917 DOI: 10.3390/ijms221910390] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Revised: 09/23/2021] [Accepted: 09/25/2021] [Indexed: 12/29/2022] Open
Abstract
Apolipoprotein B mRNA-editing enzyme catalytic polypeptide-like 3 (APOBEC3) has been identified as a group of enzymes that catalyze cytosine deamination in single-stranded (ss) DNA to form uracil, causing somatic mutations in some cancers. We analyzed the APOBEC3 family in 33 TCGA cancer types and the results indicated that APOBEC3s are upregulated in multiple cancers and strongly correlate with prognosis, particularly in low grade glioma (LGG). Then we constructed a prognostic model based on family expression in LGG where the APOBEC3 family signature is an accurate predictive model (AUC of 0.85). Gene mutation, copy number variation (CNV), and a differential gene expression (DEG) analysis were performed in different risk groups, and the weighted gene co-expression network analysis (WGCNA) was employed to clarify the role of various members in LGG; CIBERSORT algorithm was deployed to evaluate the landscape of LGG immune infiltration. We found that upregulation of the APOBEC3 family expression can strengthen Ras/MAPK signaling pathway, promote tumor progression, and ultimately reduce the treatment benefits of Raf inhibitors. Moreover, the APOBEC3 family was shown to enhance the immune response mediated by myeloid cells and interferon gamma, as well as PD-L1 and PD-L2 expression, implying that they have immunotherapy potential. Therefore, the APOBEC3 signature enables an efficient assessment of LGG patient survival outcomes and expansion of clinical benefits by selecting appropriate individualized treatment strategies.
Collapse
Affiliation(s)
- Cheng Luo
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China; (C.L.); (S.W.); (W.L.); (S.Z.); (N.X.); (W.X.)
- Department of Biomedical Engineering, Tsinghua University, Beijing 100084, China
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China
| | - Songmao Wang
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China; (C.L.); (S.W.); (W.L.); (S.Z.); (N.X.); (W.X.)
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China
- School of Life Sciences, Tsinghua University, Beijing 100084, China
| | - Weijie Liao
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China; (C.L.); (S.W.); (W.L.); (S.Z.); (N.X.); (W.X.)
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China
| | - Shikuan Zhang
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China; (C.L.); (S.W.); (W.L.); (S.Z.); (N.X.); (W.X.)
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China
- School of Life Sciences, Tsinghua University, Beijing 100084, China
| | - Naihan Xu
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China; (C.L.); (S.W.); (W.L.); (S.Z.); (N.X.); (W.X.)
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China
- Open FIESTA Center, Tsinghua University, Shenzhen 518055, China
| | - Weidong Xie
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China; (C.L.); (S.W.); (W.L.); (S.Z.); (N.X.); (W.X.)
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China
- Open FIESTA Center, Tsinghua University, Shenzhen 518055, China
| | - Yaou Zhang
- China State Key Laboratory of Chemical Oncogenomics, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China; (C.L.); (S.W.); (W.L.); (S.Z.); (N.X.); (W.X.)
- Key Lab in Healthy Science and Technology of Shenzhen, Tsinghua Shenzhen International Graduate School, Shenzhen 518055, China
- Open FIESTA Center, Tsinghua University, Shenzhen 518055, China
| |
Collapse
|
25
|
Shen F, Li L. Backward joint model and dynamic prediction of survival with multivariate longitudinal data. Stat Med 2021; 40:4395-4409. [PMID: 34018218 DOI: 10.1002/sim.9037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2020] [Revised: 04/21/2021] [Accepted: 05/01/2021] [Indexed: 11/05/2022]
Abstract
An important approach to dynamic prediction of time-to-event outcomes using longitudinal data is based on modeling the joint distribution of longitudinal and time-to-event data. The widely used joint model for this purpose is the shared random effect model. Presumably, adding more longitudinal predictors improves the predictive accuracy. However, the shared random effect model can be computationally difficult or prohibitive when a large number of longitudinal variables are used. In this paper, we study an alternative way of modeling the joint distribution of longitudinal and time-to-event data. Under this formulation, the log-likelihood involves no more than one-dimensional integration, regardless of the number of longitudinal variables in the model. Therefore, this model is particularly suitable in dynamic prediction problems with large number of longitudinal predictors. The model fitting can be implemented with tractable and stable computation by using a combination of pseudo maximum likelihood estimation, Expectation-Maximization algorithm, and convex optimization. We evaluate the proposed methodology and its predictive accuracy with varying number of longitudinal variables using simulations and data from a primary biliary cirrhosis study.
Collapse
Affiliation(s)
- Fan Shen
- Department of Biostatistics and Data Science, The University of Texas School of Public Health, Dallas, Texas, USA.,Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Liang Li
- Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| |
Collapse
|
26
|
Louro J, Román M, Posso M, Vázquez I, Saladié F, Rodriguez-Arana A, Quintana MJ, Domingo L, Baré M, Marcos-Gragera R, Vernet-Tomas M, Sala M, Castells X. Developing and validating an individualized breast cancer risk prediction model for women attending breast cancer screening. PLoS One 2021; 16:e0248930. [PMID: 33755692 PMCID: PMC7987139 DOI: 10.1371/journal.pone.0248930] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Accepted: 03/08/2021] [Indexed: 12/18/2022] Open
Abstract
BACKGROUND Several studies have proposed personalized strategies based on women's individual breast cancer risk to improve the effectiveness of breast cancer screening. We designed and internally validated an individualized risk prediction model for women eligible for mammography screening. METHODS Retrospective cohort study of 121,969 women aged 50 to 69 years, screened at the long-standing population-based screening program in Spain between 1995 and 2015 and followed up until 2017. We used partly conditional Cox proportional hazards regression to estimate the adjusted hazard ratios (aHR) and individual risks for age, family history of breast cancer, previous benign breast disease, and previous mammographic features. We internally validated our model with the expected-to-observed ratio and the area under the receiver operating characteristic curve. RESULTS During a mean follow-up of 7.5 years, 2,058 women were diagnosed with breast cancer. All three risk factors were strongly associated with breast cancer risk, with the highest risk being found among women with family history of breast cancer (aHR: 1.67), a proliferative benign breast disease (aHR: 3.02) and previous calcifications (aHR: 2.52). The model was well calibrated overall (expected-to-observed ratio ranging from 0.99 at 2 years to 1.02 at 20 years) but slightly overestimated the risk in women with proliferative benign breast disease. The area under the receiver operating characteristic curve ranged from 58.7% to 64.7%, depending of the time horizon selected. CONCLUSIONS We developed a risk prediction model to estimate the short- and long-term risk of breast cancer in women eligible for mammography screening using information routinely reported at screening participation. The model could help to guiding individualized screening strategies aimed at improving the risk-benefit balance of mammography screening programs.
Collapse
Affiliation(s)
- Javier Louro
- IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain
- Research Network on Health Services in Chronic Diseases (REDISSEC), Barcelona, Spain
- Servei d’Epidemiologia i Avaluació, Hospital del Mar, Barcelona, Spain
- European Higher Education Area (EHEA) Doctoral Programme in Methodology of Biomedical Research and Public Health in Department of Pediatrics, Obstetrics and Gynecology, Preventive Medicine and Public Health, Universitat Autónoma de Barcelona (UAB), Bellaterra, Barcelona, Spain
| | - Marta Román
- IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain
- Research Network on Health Services in Chronic Diseases (REDISSEC), Barcelona, Spain
- Servei d’Epidemiologia i Avaluació, Hospital del Mar, Barcelona, Spain
- * E-mail:
| | - Margarita Posso
- IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain
- Research Network on Health Services in Chronic Diseases (REDISSEC), Barcelona, Spain
- Servei d’Epidemiologia i Avaluació, Hospital del Mar, Barcelona, Spain
| | | | - Francina Saladié
- Cancer Epidemiology and Prevention Service, Hospital Universitari Sant Joan de Reus, Institut d’Investigació Sanitària Pere Virgili, Universitat Rovira i Virgili, Reus, Spain
| | | | - M. Jesús Quintana
- Department of Clinical Epidemiology and Public Health, University Hospital de la Santa Creu i Sant Pau, IIB Sant Pau, Barcelona, Barcelona, Spain
- CIBER of Epidemiology and Public Health (CIBERESP), Barcelona, Spain
| | - Laia Domingo
- IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain
- Research Network on Health Services in Chronic Diseases (REDISSEC), Barcelona, Spain
- Servei d’Epidemiologia i Avaluació, Hospital del Mar, Barcelona, Spain
| | - Marisa Baré
- Research Network on Health Services in Chronic Diseases (REDISSEC), Barcelona, Spain
- Clinical Epidemiology and Cancer Screening, Parc Taulí University Hospital, Sabadell, Spain
| | - Rafael Marcos-Gragera
- CIBER of Epidemiology and Public Health (CIBERESP), Barcelona, Spain
- Department of Health, Epidemiology Unit and Girona Cancer Registry, Oncology Coordination Plan, Autonomous Government of Catalonia, Catalan Institute of Oncology, Girona, Spain
| | | | - Maria Sala
- IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain
- Research Network on Health Services in Chronic Diseases (REDISSEC), Barcelona, Spain
- Servei d’Epidemiologia i Avaluació, Hospital del Mar, Barcelona, Spain
| | - Xavier Castells
- IMIM (Hospital del Mar Medical Research Institute), Barcelona, Spain
- Research Network on Health Services in Chronic Diseases (REDISSEC), Barcelona, Spain
- Servei d’Epidemiologia i Avaluació, Hospital del Mar, Barcelona, Spain
| | | |
Collapse
|
27
|
Shin YE, Gail MH, Pfeiffer RM. Assessing risk model calibration with missing covariates. Biostatistics 2021; 23:875-890. [PMID: 33616159 DOI: 10.1093/biostatistics/kxaa060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2020] [Revised: 12/07/2020] [Accepted: 12/11/2020] [Indexed: 11/12/2022] Open
Abstract
When validating a risk model in an independent cohort, some predictors may be missing for some subjects. Missingness can be unplanned or by design, as in case-cohort or nested case-control studies, in which some covariates are measured only in subsampled subjects. Weighting methods and imputation are used to handle missing data. We propose methods to increase the efficiency of weighting to assess calibration of a risk model (i.e. bias in model predictions), which is quantified by the ratio of the number of observed events, $\mathcal{O}$, to expected events, $\mathcal{E}$, computed from the model. We adjust known inverse probability weights by incorporating auxiliary information available for all cohort members. We use survey calibration that requires the weighted sum of the auxiliary statistics in the complete data subset to equal their sum in the full cohort. We show that a pseudo-risk estimate that approximates the actual risk value but uses only variables available for the entire cohort is an excellent auxiliary statistic to estimate $\mathcal{E}$. We derive analytic variance formulas for $\mathcal{O}/\mathcal{E}$ with adjusted weights. In simulations, weight adjustment with pseudo-risk was much more efficient than inverse probability weighting and yielded consistent estimates even when the pseudo-risk was a poor approximation. Multiple imputation was often efficient but yielded biased estimates when the imputation model was misspecified. Using these methods, we assessed calibration of an absolute risk model for second primary thyroid cancer in an independent cohort.
Collapse
Affiliation(s)
- Yei Eun Shin
- Biostatistics Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, 9609 Medical Center Drive, Rockville, MD 20850, USA
| | - Mitchell H Gail
- Biostatistics Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, 9609 Medical Center Drive, Rockville, MD 20850, USA
| | - Ruth M Pfeiffer
- Biostatistics Branch, Division of Cancer Epidemiology and Genetics, National Cancer Institute, 9609 Medical Center Drive, Rockville, MD 20850, USA
| |
Collapse
|
28
|
Beyene KM, El Ghouch A. Smoothed time-dependent receiver operating characteristic curve for right censored survival data. Stat Med 2020; 39:3373-3396. [PMID: 32687225 DOI: 10.1002/sim.8671] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2019] [Revised: 03/30/2020] [Accepted: 06/05/2020] [Indexed: 11/08/2022]
Abstract
The prediction reliability is of primary concern in many clinical studies when the objective is to develop new predictive models or improve existing risk scores. In fact, before using a model in any clinical decision making, it is very important to check its ability to discriminate between subjects who are at risk of, for example, developing certain disease in a near future from those who will not. To that end, the time-dependent receiver operating characteristic (ROC) curve is the most commonly used method in practice. Several approaches have been proposed in the literature to estimate the ROC nonparametrically in the context of survival data. But, except one recent approach, all the existing methods provide a nonsmooth ROC estimator whereas, by definition, the ROC curve is smooth. In this article we propose and study a new nonparametric smooth ROC estimator based on a weighted kernel smoother. More precisely, our approach relies on a well-known kernel method used to estimate cumulative distribution functions of random variables with bounded supports. We derived some asymptotic properties for the proposed estimator. As bandwidth is the main parameter to be set, we present and study different methods to appropriately select one. A simulation study is conducted, under different scenarios, to prove the consistency of the proposed method and to compare its finite sample performance with a competitor. The results show that the proposed method performs better and appear to be quite robust to bandwidth choice. As for inference purposes, our results also reveal the good performances of a proposed nonparametric bootstrap procedure. Furthermore, we illustrate the method using a real data example.
Collapse
Affiliation(s)
- Kassu Mehari Beyene
- Institute of Statistics, Biostatistics and Actuarial Sciences, Catholic University of Louvain, Louvain la Neuve, Belgium
| | - Anouar El Ghouch
- Institute of Statistics, Biostatistics and Actuarial Sciences, Catholic University of Louvain, Louvain la Neuve, Belgium
| |
Collapse
|
29
|
Zhu Y, Huang X, Li L. Dynamic prediction of time to a clinical event with sparse and irregularly measured longitudinal biomarkers. Biom J 2020; 62:1371-1393. [PMID: 32196728 PMCID: PMC7502505 DOI: 10.1002/bimj.201900112] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2019] [Revised: 12/13/2019] [Accepted: 12/18/2019] [Indexed: 12/21/2022]
Abstract
In clinical research and practice, landmark models are commonly used to predict the risk of an adverse future event, using patients' longitudinal biomarker data as predictors. However, these data are often observable only at intermittent visits, making their measurement times irregularly spaced and unsynchronized across different subjects. This poses challenges to conducting dynamic prediction at any post-baseline time. A simple solution is the last-value-carry-forward method, but this may result in bias for the risk model estimation and prediction. Another option is to jointly model the longitudinal and survival processes with a shared random effects model. However, when dealing with multiple biomarkers, this approach often results in high-dimensional integrals without a closed-form solution, and thus the computational burden limits its software development and practical use. In this article, we propose to process the longitudinal data by functional principal component analysis techniques, and then use the processed information as predictors in a class of flexible linear transformation models to predict the distribution of residual time-to-event occurrence. The measurement schemes for multiple biomarkers are allowed to be different within subject and across subjects. Dynamic prediction can be performed in a real-time fashion. The advantages of our proposed method are demonstrated by simulation studies. We apply our approach to the African American Study of Kidney Disease and Hypertension, predicting patients' risk of kidney failure or death by using four important longitudinal biomarkers for renal functions.
Collapse
Affiliation(s)
- Yayuan Zhu
- The Department of Epidemiology and Biostatistics, University of Western Ontario, London, ON, Canada
| | - Xuelin Huang
- The Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| | - Liang Li
- The Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, TX, United States
| |
Collapse
|
30
|
Amico M, Van Keilegom I, Han B. Assessing cure status prediction from survival data using receiver operating characteristic curves. Biometrika 2020. [DOI: 10.1093/biomet/asaa080] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Summary
Survival analysis relies on the hypothesis that, if the follow-up is long enough, the event of interest will eventually be observed for all observations. This assumption, however, is often not realistic. The survival data then contain a cure fraction. A common approach to modelling and analysing this type of data consists in using cure models. Two types of information can therefore be obtained: the survival at a given time and the cure status, both possibly modelled as a function of the covariates. The cure status is often of interest to medical practitioners, and one is usually interested in predicting it based on markers. Receiver operating characteristic, Roc, curves are one way to evaluate the predicted performance; however, the classical Roc curve method is not appropriate since the cure status is partially unobserved due to the presence of censoring in survival data. We propose a Roc curve estimator that aims to evaluate the cured/noncured status classification performance from cure survival data. This estimator, which handles the presence of censoring, decomposes sensitivity and specificity by means of the definition of conditional probability, and estimates these two quantities by means of weighted empirical distribution functions. The mixture cure model is used to calculate the weights. Based on simulations, we demonstrate good performance of the proposed method, and compare it with the classical Roc curve nonparametric estimator that would be obtained if the cure status was fully observed. We also compare our proposed method with the Roc curves of Heagerty et al. (2000) for classical survival analysis. Finally, we illustrate the methodology on a breast cancer dataset.
Collapse
Affiliation(s)
- M Amico
- Research Centre for Operations Research and Statistics, KU Leuven, Naamsestaat 69, 3000 Leuven, Belgium
| | - I Van Keilegom
- Research Centre for Operations Research and Statistics, KU Leuven, Naamsestaat 69, 3000 Leuven, Belgium
| | - B Han
- Research Centre for Operations Research and Statistics, KU Leuven, Naamsestaat 69, 3000 Leuven, Belgium
| |
Collapse
|
31
|
Díaz-Coto S, Martínez-Camblor P, Pérez-Fernández S. smoothROCtime: an R package for time-dependent ROC curve estimation. Comput Stat 2020. [DOI: 10.1007/s00180-020-00955-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|
32
|
Díaz-Coto S, Corral-Blanco NO, Martínez-Camblor P. Two-stage receiver operating-characteristic curve estimator for cohort studies. Int J Biostat 2020; 17:117-137. [PMID: 32862149 DOI: 10.1515/ijb-2019-0097] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2019] [Accepted: 05/25/2020] [Indexed: 12/22/2022]
Abstract
The receiver operating-characteristic (ROC) curve is a graphical statistical tool routinely used for studying the classification accuracy in both, diagnostic and prognosis problems. Given the different nature of these situations, ROC curve estimation has been separately considered for binary (diagnostic) and time-to-event (prognosis) outcomes, even for data coming from the same study design. In this work, the authors propose a two-stage ROC curve estimator which allows to link both contexts through a general prediction model (first-stage) and the empirical cumulative estimator of the distribution function (second-stage) of the considered test (marker) on the total population. The so-called two-stage Mixed-Subject (sMS) approach proves its behavior on both, large-samples (theoretically) and finite-samples (via Monte Carlo simulations). Besides, a useful asymptotic distribution for the concomitant area under the curve is also computed. Results show the ability of the proposed estimator to fit non-standard situations by considering flexible predictive models. Two real-world examples, one with binary and one with time-dependent outcomes, help us to a better understanding of the proposed methodology on usual practical circumstances. The R code used for the practical implementation of the proposed methodology and its documentation is provided as supplementary material.
Collapse
Affiliation(s)
| | | | - Pablo Martínez-Camblor
- Biomedical Data Science Department, Geisel school of Medicine at Dartmouth, Hanover, NH, USA
| |
Collapse
|
33
|
Liu Z, Cao Y, Diao W, Cheng Y, Jia Z, Peng X. Radiomics-based prediction of survival in patients with head and neck squamous cell carcinoma based on pre- and post-treatment 18F-PET/CT. Aging (Albany NY) 2020; 12:14593-14619. [PMID: 32674074 PMCID: PMC7425452 DOI: 10.18632/aging.103508] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Accepted: 06/04/2020] [Indexed: 02/05/2023]
Abstract
BACKGROUND 18-fluorodeoxyglucose positron emission tomography/computed tomography (18F-PET/CT) has been widely applied for the imaging of head and neck squamous cell carcinoma (HNSCC). This study examined whether pre- and post-treatment 18F-PET/CT features can help predict the survival of HNSCC patients. RESULTS Three radiomics features were identified as prognostic factors. Radiomics score calculated from these features significantly predicted overall survival (OS) and disease-free disease (DFS). The clinicopathological characteristics combined with pre- or post-treatment nomograms showed better ROC curves and decision curves than the nomogram based only on clinicopathological characteristics. CONCLUSIONS Combining clinicopathological characteristics with radiomics features of pre-treatment PET/CT or post-treatment PET/CT assessment of primary tumor sites as positive or negative may substantially improve prediction of OS and DFS of HNSCC patients. METHODS 171 patients who received pre-treatment 18F-PET/CT scans and 154 patients who received post-treatment 18F-PET/CT scans with HNSCC in the Cancer Imaging Achieve (TCIA) were included. Nomograms that combined clinicopathological features with either pre-treatment PET/CT radiomics features or post-treatment assessment of primary tumor sites were constructed using data from 154 HNSCC patients. Receiver operating characteristic (ROC) curves and decision curves were used to compare the predictions of these models with those of a model incorporating only clinicopathological features.
Collapse
Affiliation(s)
- Zheran Liu
- Department of Biotherapy, Cancer Center, West China Hospital of Sichuan University, Chengdu 610041, China
| | - Yuan Cao
- Department of Nuclear Medicine, West China Hospital of Sichuan University, Chengdu 610041, China
| | - Wei Diao
- Department of Nuclear Medicine, West China Hospital of Sichuan University, Chengdu 610041, China
| | - Yue Cheng
- Department of Radiology, West China Hospital of Sichuan University, Chengdu 610041, China
| | - Zhiyun Jia
- Department of Nuclear Medicine, West China Hospital of Sichuan University, Chengdu 610041, China
| | - Xingchen Peng
- Department of Biotherapy, Cancer Center, West China Hospital of Sichuan University, Chengdu 610041, China
| |
Collapse
|
34
|
Díaz-Coto S, Martínez-Camblor P, Corral-Blanco NO. Cumulative/dynamic ROC curve estimation under interval censorship. J STAT COMPUT SIM 2020. [DOI: 10.1080/00949655.2020.1736071] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Affiliation(s)
- Susana Díaz-Coto
- Department of Statistics, University of Oviedo, Oviedo, Asturias, Spain
| | | | | |
Collapse
|
35
|
Heyard R, Timsit J, Held L. Validation of discrete time-to-event prediction models in the presence of competing risks. Biom J 2020; 62:643-657. [PMID: 31368172 PMCID: PMC7217187 DOI: 10.1002/bimj.201800293] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2018] [Revised: 06/21/2019] [Accepted: 06/28/2019] [Indexed: 11/06/2022]
Abstract
Clinical prediction models play a key role in risk stratification, therapy assignment and many other fields of medical decision making. Before they can enter clinical practice, their usefulness has to be demonstrated using systematic validation. Methods to assess their predictive performance have been proposed for continuous, binary, and time-to-event outcomes, but the literature on validation methods for discrete time-to-event models with competing risks is sparse. The present paper tries to fill this gap and proposes new methodology to quantify discrimination, calibration, and prediction error (PE) for discrete time-to-event outcomes in the presence of competing risks. In our case study, the goal was to predict the risk of ventilator-associated pneumonia (VAP) attributed to Pseudomonas aeruginosa in intensive care units (ICUs). Competing events are extubation, death, and VAP due to other bacteria. The aim of this application is to validate complex prediction models developed in previous work on more recently available validation data.
Collapse
Affiliation(s)
- Rachel Heyard
- Department of Biostatistics at the EpidemiologyBiostatistics and Prevention InstituteUniversity of ZurichHirschengrabenSwitzerland
| | | | - Leonhard Held
- Department of Biostatistics at the EpidemiologyBiostatistics and Prevention InstituteUniversity of ZurichHirschengrabenSwitzerland
| | | |
Collapse
|
36
|
Blangero Y, Rabilloud M, Laurent-Puig P, Le Malicot K, Lepage C, Ecochard R, Taieb J, Subtil F. The area between ROC curves, a non-parametric method to evaluate a biomarker for patient treatment selection. Biom J 2020; 62:1476-1493. [PMID: 32346912 DOI: 10.1002/bimj.201900171] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2019] [Revised: 09/26/2019] [Accepted: 01/10/2020] [Indexed: 12/19/2022]
Abstract
Treatment selection markers are generally sought for when the benefit of an innovative treatment in comparison with a reference treatment is considered, and this benefit is suspected to vary according to the characteristics of the patients. Classically, such quantitative markers are detected through testing a marker-by-treatment interaction in a parametric regression model. Most alternative methods rely on modeling the risk of event occurrence in each treatment arm or the benefit of the innovative treatment over the marker values, but with assumptions that may be difficult to verify. Herein, a simple non-parametric approach is proposed to detect and assess the general capacity of a quantitative marker for treatment selection when no overall difference in efficacy could be demonstrated between two treatments in a clinical trial. This graphical method relies on the area between treatment-arm-specific receiver operating characteristic curves (ABC), which reflects the treatment selection capacity of the marker. A simulation study assessed the inference properties of the ABC estimator and compared them with other parametric and non-parametric indicators. The simulations showed that the estimate of the ABC had low bias, power comparable to parametric indicators, and that its confidence interval had a good coverage probability (better than the other non-parametric indicator in some cases). Thus, the ABC is a good alternative to parametric indicators. The ABC method was applied to data of the PETACC-8 trial that investigated FOLFOX4 versus FOLFOX4 + cetuximab in stage III colon adenocarcinoma. It enabled the detection of a treatment selection marker: the DDR2 gene.
Collapse
Affiliation(s)
- Yoann Blangero
- Service de Biostatistique, Pôle Santé Publique, Hospices Civils de Lyon, Lyon, France.,Université de Lyon, Université Lyon 1, CNRS, Laboratoire de Biométrie et Biologie Evolutive UMR 5558, Villeurbanne, France
| | - Muriel Rabilloud
- Service de Biostatistique, Pôle Santé Publique, Hospices Civils de Lyon, Lyon, France.,Université de Lyon, Université Lyon 1, CNRS, Laboratoire de Biométrie et Biologie Evolutive UMR 5558, Villeurbanne, France
| | - Pierre Laurent-Puig
- Université Paris Descartes, Sorbonne Paris Cité, Paris, France.,Service de génétique, Hôpital Européen Georges Pompidou, Paris, France.,INSERM UMR-S 1147, Paris, France
| | | | - Côme Lepage
- Fédération Francophone de Cancérologie Digestive, Dijon, France.,Hépato-gastroentérologie et cancérologie digestive, Centre hospitalier universitaire Dijon Bourgogne, Dijon, France.,INSERM U 866, Dijon, France
| | - René Ecochard
- Service de Biostatistique, Pôle Santé Publique, Hospices Civils de Lyon, Lyon, France.,Université de Lyon, Université Lyon 1, CNRS, Laboratoire de Biométrie et Biologie Evolutive UMR 5558, Villeurbanne, France
| | - Julien Taieb
- Université Paris Descartes, Sorbonne Paris Cité, Paris, France.,Chirurgie digestive générale et cancérologique, Hôpital Européen Georges Pompidou, Paris, France
| | - Fabien Subtil
- Service de Biostatistique, Pôle Santé Publique, Hospices Civils de Lyon, Lyon, France.,Université de Lyon, Université Lyon 1, CNRS, Laboratoire de Biométrie et Biologie Evolutive UMR 5558, Villeurbanne, France
| |
Collapse
|
37
|
|
38
|
Beyene KM, El Ghouch A, Oulhaj A. On the validity of time-dependent AUC estimation in the presence of cure fraction. Biom J 2019; 61:1430-1447. [PMID: 31310019 DOI: 10.1002/bimj.201800376] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2018] [Revised: 04/16/2019] [Accepted: 06/04/2019] [Indexed: 11/09/2022]
Abstract
During the last decades, several approaches have been proposed to estimate the time-dependent area under the receiver operating characteristic curve (AUC) of risk tools derived from survival data. The validity of these estimators relies on some regularity assumptions among which a survival function being proper. In practice, this assumption is not always satisfied because a fraction of the population may not be susceptible to experience the event of interest even for long follow-up. Studying the sensitivity of the proposed estimators to the violation of this assumption is of substantial interest. In this paper, we investigate the performance of a nonparametric simple estimator, developed for classical survival data, in the case when the population exhibits a cure fraction. Motivated from the current practice of deriving risk tools in oncology and cardiovascular disease prevention, we also assess the loss, in terms of predictive performance, when deriving risk tools from survival models that do not acknowledge the presence of cure. The simulation results show that the investigated method is valid even under the presence of cure. They also show that risk tools derived from survival models that ignore the presence of cure have smaller AUC compared to those derived from survival models that acknowledge the presence of cure. This was also attested with a real data analysis from a breast cancer study.
Collapse
Affiliation(s)
- Kassu M Beyene
- Institute of Statistics, Biostatistics and Actuarial Sciences, Catholic University of Louvain, Louvain la Neuve, Belgium
| | - Anouar El Ghouch
- Institute of Statistics, Biostatistics and Actuarial Sciences, Catholic University of Louvain, Louvain la Neuve, Belgium
| | - Abderrahim Oulhaj
- Institute of Public Health, College of Medicine and Health Sciences, UAE University, Al-Ain, United Arab Emirates
| |
Collapse
|
39
|
Shouval R, Labopin M, Gorin NC, Bomze D, Houhou M, Blaise D, Zuckerman T, Baerlocher GM, Capria S, Forcade E, Huynh A, Saccardi R, Martino M, Schaap M, Wu D, Mohty M, Nagler A. Individualized prediction of leukemia‐free survival after autologous stem cell transplantation in acute myeloid leukemia. Cancer 2019; 125:3566-3573. [DOI: 10.1002/cncr.32344] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2019] [Revised: 05/22/2019] [Accepted: 05/23/2019] [Indexed: 12/16/2022]
Affiliation(s)
- Roni Shouval
- Hematology and Bone Marrow Transplantation Division Chaim Sheba Medical Center at Tel HaShomer Ramat‐Gan Israel
- Sackler School of Medicine Tel Aviv University Tel Aviv Israel
- Dr. Pinchas Bornstein Talpiot Medical Leadership Program Chaim Sheba Medical Center at Tel HaShomer Ramat‐Gan Israel
| | - Myriam Labopin
- Department of Hematology and Cell Therapy Saint‐Antoine Hospital Paris France
- Acute Leukemia Working Party of the European Society for Blood and Marrow Transplantation Saint‐Antoine Hospital Paris France
| | - Norbert C. Gorin
- Department of Hematology and Cell Therapy Saint‐Antoine Hospital Paris France
- Acute Leukemia Working Party of the European Society for Blood and Marrow Transplantation Saint‐Antoine Hospital Paris France
| | - David Bomze
- Hematology and Bone Marrow Transplantation Division Chaim Sheba Medical Center at Tel HaShomer Ramat‐Gan Israel
- Sackler School of Medicine Tel Aviv University Tel Aviv Israel
| | - Mohamed Houhou
- Acute Leukemia Working Party of the European Society for Blood and Marrow Transplantation Saint‐Antoine Hospital Paris France
| | - Didier Blaise
- Transplantation and Cell Therapy Program Marseille Cancer Research Center, Paoli Calmettes Institute Marseille France
| | | | - Gabriela M. Baerlocher
- Department of Hematology, Inselspital Bern University Hospital, University of Bern Switzerland
| | | | - Edouard Forcade
- Service Hématologie Clinique et Thérapie CellulaireCentre Hospitalier Universitaire de Bordeaux Hôpital Haut‐Leveque Pessac France
| | - Anne Huynh
- Department of HematologyInstitut Universitaire du Cancer Toulouse Oncopole Toulouse France
| | - Riccardo Saccardi
- Department of Cellular Therapies and Transfusion MedicineCareggi University Hospital Firenze Italy
| | - Massimo Martino
- Stem Cell Transplant Unit, Hemato‐Oncology Department Grande Ospedale Metropolitano Bianchi Melacrino Morelli Reggio Calabria Italy
| | - Michel Schaap
- Department of HematologyRadboud University Medical Centre Nijmegen the Netherlands
| | - Depei Wu
- First Affiliated Hospital of Soochow University Suzhou China
| | - Mohamad Mohty
- Department of Hematology and Cell Therapy Saint‐Antoine Hospital Paris France
- Acute Leukemia Working Party of the European Society for Blood and Marrow Transplantation Saint‐Antoine Hospital Paris France
| | - Arnon Nagler
- Hematology and Bone Marrow Transplantation Division Chaim Sheba Medical Center at Tel HaShomer Ramat‐Gan Israel
- Sackler School of Medicine Tel Aviv University Tel Aviv Israel
- Acute Leukemia Working Party of the European Society for Blood and Marrow Transplantation Saint‐Antoine Hospital Paris France
| |
Collapse
|
40
|
Zhu Y, Li L, Huang X. Landmark Linear Transformation Model for Dynamic Prediction with Application to a Longitudinal Cohort Study of Chronic Disease. J R Stat Soc Ser C Appl Stat 2019; 68:771-791. [PMID: 31467454 PMCID: PMC6715145 DOI: 10.1111/rssc.12334] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Dynamic prediction of the risk of a clinical event using longitudinally measured biomarkers or other prognostic information is important in clinical practice. We propose a new class of landmark survival models. The model takes the form of a linear transformation model, but allows all the model parameters to vary with the landmark time. This model includes many published landmark prediction models as special cases. We propose a unified local linear estimation framework to estimate time-varying model parameters. Simulation studies are conducted to evaluate the finite sample performance of the proposed method. We apply the methodology to a dataset from the African American Study of Kidney Disease and Hypertension and predict individual patient's risk of an adverse clinical event.
Collapse
Affiliation(s)
- Yayuan Zhu
- University of Western Ontario, London, Canada
| | - Liang Li
- University of Texas MD Anderson Cancer Center, Houston, USA
| | - Xuelin Huang
- University of Texas MD Anderson Cancer Center, Houston, USA
| |
Collapse
|
41
|
Wang M, Chen C, Jemielita T, Anderson J, Li XN, Hu C, Kang SP, Ibrahim N, Ebbinghaus S. Are tumor size changes predictive of survival for checkpoint blockade based immunotherapy in metastatic melanoma? J Immunother Cancer 2019; 7:39. [PMID: 30736858 PMCID: PMC6368769 DOI: 10.1186/s40425-019-0513-4] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2018] [Accepted: 01/16/2019] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND In oncology clinical development, objective response rate, disease control rate and early tumor size changes are commonly used as efficacy metrics for early decision-making. However, for immunotherapy trials, it is unclear whether these early efficacy metrics are still predictive of long-term clinical benefit such as overall survival. The goal of this paper is to identify appropriate early efficacy metrics predictive of overall survival for immunotherapy trials. METHODS Based on several checkpoint blockade based immunotherapy studies in metastatic melanoma, we evaluated the predictive value of early tumor size changes and RECIST-based efficacy metrics at various time points on overall survival. The cut-off values for tumor size changes to predict survival were explored via tree based recursive partitioning and validated by external data. Sensitivity analyses were performed for the cut-offs. RESULTS The continuous tumor size change metric and RECIST-based trichotomized response metric at different landmark time points were found to be statistically significantly associated with overall survival. The predictive values were higher at Week 12 and 18 than those at Week 24. The percentage of tumor size changes appeared to have comparable or lower predictive values than the RECIST-based trichotomized metric, and a cut-off of approximately 10% tumor reduction appeared to be reasonable for predicting survival. CONCLUSIONS An approximate 10% tumor reduction may be a reasonable cut-off for early decision-making while the RECIST-based efficacy metric remains the primary tool. Early landmark analysis is especially useful for decision making when accrual is fast. Composite response rate (utilizing different weights for PR/CR and SD) may be worth further investigation. TRIAL REGISTRATION Clinical trials gov, NCT01295827 , Registered February 15, 2011; NCT01704287 , Registered October 11, 2012; NCT01866319 , Registered May 31, 2013.
Collapse
Affiliation(s)
- Meihua Wang
- Merck & Co., Inc., Kenilworth, NJ, USA.
- BARDS Early Development Statistics - Early Oncology, 351 North Sumneytown Pike, North Wales, 19454, USA.
| | - Cong Chen
- Merck & Co., Inc., Kenilworth, NJ, USA
| | | | | | | | - Chen Hu
- Sidney Kimmel Comprehensive Cancer Center at Johns Hopkins, Baltimore, MD, USA
| | | | | | | |
Collapse
|
42
|
Li K, Luo S. Bayesian Functional Joint Models for Multivariate Longitudinal and Time-to-Event Data. Comput Stat Data Anal 2018; 129:14-29. [PMID: 30559575 DOI: 10.1016/j.csda.2018.07.015] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
A multivariate functional joint model framework is proposed which enables the repeatedly measured functional outcomes, scalar outcomes, and survival process to be modeled simultaneously while accounting for association among the multiple (functional and scalar) longitudinal and survival processes. This data structure is increasingly common across medical studies of neurodegenerative diseases and is exemplified by the motivating Alzheimer's Disease Neuroimaging Initiative (ADNI) study, in which serial brain imaging, clinical and neuropsychological assessments are collected to measure the progression of Alzheimer's disease (AD). The proposed functional joint model consists of a longitudinal function-on-scalar submodel, a regular longitudinal submodel, and a survival submodel which allows time-dependent functional and scalar covariates. A Bayesian approach is adopted for parameter estimation and a dynamic prediction framework is introduced for predicting the subjects' future health outcomes and risk of AD conversion. The proposed model is evaluated by a simulation study and is applied to the motivating ADNI study.
Collapse
Affiliation(s)
- Kan Li
- Merck Research Lab, Merck & Co, 351 North Sumneytown Pike, North Wales, PA 19454, USA
| | - Sheng Luo
- Department of Biostatistics and Bioinformatics, Duke University Medical Center, 2400 Pratt St, 7040 North Pavilion, Durham, NC 27705, USA
| |
Collapse
|
43
|
Prognostic assessment of repeatedly measured time-dependent biomarkers, with application to dilated cardiomyopathy. STAT METHOD APPL-GER 2017. [DOI: 10.1007/s10260-017-0410-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
44
|
Wang J, Luo S, Li L. DYNAMIC PREDICTION FOR MULTIPLE REPEATED MEASURES AND EVENT TIME DATA: AN APPLICATION TO PARKINSON'S DISEASE. Ann Appl Stat 2017; 11:1787-1809. [PMID: 29081873 DOI: 10.1214/17-aoas1059] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
In many clinical trials studying neurodegenerative diseases such as Parkinson's disease (PD), multiple longitudinal outcomes are collected to fully explore the multidimensional impairment caused by this disease. If the outcomes deteriorate rapidly, patients may reach a level of functional disability sufficient to initiate levodopa therapy for ameliorating disease symptoms. An accurate prediction of the time to functional disability is helpful for clinicians to monitor patients' disease progression and make informative medical decisions. In this article, we first propose a joint model that consists of a semiparametric multilevel latent trait model (MLLTM) for the multiple longitudinal outcomes, and a survival model for event time. The two submodels are linked together by an underlying latent variable. We develop a Bayesian approach for parameter estimation and a dynamic prediction framework for predicting target patients' future outcome trajectories and risk of a survival event, based on their multivariate longitudinal measurements. Our proposed model is evaluated by simulation studies and is applied to the DATATOP study, a motivating clinical trial assessing the effect of deprenyl among patients with early PD.
Collapse
Affiliation(s)
- Jue Wang
- University of Texas Health Science Center at Houston
| | - Sheng Luo
- University of Texas Health Science Center at Houston
| | - Liang Li
- University of Texas MD Anderson Cancer Center
| |
Collapse
|
45
|
Li K, Luo S. Dynamic predictions in Bayesian functional joint models for longitudinal and time-to-event data: An application to Alzheimer's disease. Stat Methods Med Res 2017; 28:327-342. [PMID: 28750578 DOI: 10.1177/0962280217722177] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023]
Abstract
In the study of Alzheimer's disease, researchers often collect repeated measurements of clinical variables, event history, and functional data. If the health measurements deteriorate rapidly, patients may reach a level of cognitive impairment and are diagnosed as having dementia. An accurate prediction of the time to dementia based on the information collected is helpful for physicians to monitor patients' disease progression and to make early informed medical decisions. In this article, we first propose a functional joint model to account for functional predictors in both longitudinal and survival submodels in the joint modeling framework. We then develop a Bayesian approach for parameter estimation and a dynamic prediction framework for predicting the subjects' future outcome trajectories and risk of dementia, based on their scalar and functional measurements. The proposed Bayesian functional joint model provides a flexible framework to incorporate many features both in joint modeling of longitudinal and survival data and in functional data analysis. Our proposed model is evaluated by a simulation study and is applied to the motivating Alzheimer's Disease Neuroimaging Initiative study.
Collapse
Affiliation(s)
- Kan Li
- Department of Biostatistics, The University of Texas Health Science Center at Houston, Houston, USA
| | - Sheng Luo
- Department of Biostatistics, The University of Texas Health Science Center at Houston, Houston, USA
| |
Collapse
|