1
|
Young KJ, Bantis LE. Estimation and inference on the partial volume under the receiver operating characteristic surface. Stat Methods Med Res 2024:9622802241267356. [PMID: 39118330 DOI: 10.1177/09622802241267356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/10/2024]
Abstract
measures of biomarker accuracy that employ the receiver operating characteristic surface have been proposed for biomarkers that classify patients into one of three groups: healthy, benign, or aggressive disease. The volume under the receiver operating characteristic surface summarizes the overall discriminatory ability of a biomarker in such configurations, but includes cutoffs associated with clinically irrelevant true classification rates. Due to the lethal nature of pancreatic cancer, cutoffs associated with a low true classification rate for identifying patients with pancreatic cancer may be undesirable and not appropriate for use in a clinical setting. In this project, we study the properties of a more focused criterion, the partial volume under the receiver operating characteristic surface, that summarizes the diagnostic accuracy of a marker in the three-class setting for regions restricted to only those of clinical interest. We propose methods for estimation and inference on the partial volume under the receiver operating characteristic surface under parametric and non-parametric frameworks and apply these methods to the evaluation of potential biomarkers for the diagnosis of pancreatic cancer.
Collapse
Affiliation(s)
- Kate J Young
- Department of Biostatistics and Data Science, University of Kansas Medical Center, Kansas City, KS, USA
| | - Leonidas E Bantis
- Department of Biostatistics and Data Science, University of Kansas Medical Center, Kansas City, KS, USA
| |
Collapse
|
2
|
Mosier BR, Bantis LE. Combining multiple biomarkers linearly to minimize the Euclidean distance of the closest point on the receiver operating characteristic surface to the perfection corner in trichotomous settings. Stat Methods Med Res 2024; 33:647-668. [PMID: 38445348 PMCID: PMC11234871 DOI: 10.1177/09622802241233768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/07/2024]
Abstract
The performance of individual biomarkers in discriminating between two groups, typically the healthy and the diseased, may be limited. Thus, there is interest in developing statistical methodologies for biomarker combinations with the aim of improving upon the individual discriminatory performance. There is extensive literature referring to biomarker combinations under the two-class setting. However, the corresponding literature under a three-class setting is limited. In our study, we provide parametric and nonparametric methods that allow investigators to optimally combine biomarkers that seek to discriminate between three classes by minimizing the Euclidean distance from the receiver operating characteristic surface to the perfection corner. Using this Euclidean distance as the objective function allows for estimation of the optimal combination coefficients along with the optimal cutoff values for the combined score. An advantage of the proposed methods is that they can accommodate biomarker data from all three groups simultaneously, as opposed to a pairwise analysis such as the one implied by the three-class Youden index. We illustrate that the derived true classification rates exhibit narrower confidence intervals than those derived from the Youden-based approach under a parametric, flexible parametric, and nonparametric kernel-based framework. We evaluate our approaches through extensive simulations and apply them to real data sets that refer to liver cancer patients.
Collapse
Affiliation(s)
- Brian R Mosier
- University of Kansas Medical Center, Kansas City, KS, USA
- EMB Statistical Solutions, LLC KS, USA
| | | |
Collapse
|
3
|
Wang J, Yin J, Tian L. Evaluating joint confidence region of hypervolume under ROC manifold and generalized Youden index. Stat Med 2024; 43:869-889. [PMID: 38115806 DOI: 10.1002/sim.9998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 10/25/2023] [Accepted: 12/05/2023] [Indexed: 12/21/2023]
Abstract
In biomarker evaluation/diagnostic studies, the hypervolume under the receiver operating characteristic manifold (HUM K $$ {\mathrm{HUM}}_K $$ ) and the generalized Youden index (J K $$ {J}_K $$ ) are the most popular measures for assessing classification accuracy under multiple classes. WhileHUM K $$ {\mathrm{HUM}}_K $$ is frequently used to evaluate the overall accuracy,J K $$ {J}_K $$ provides direct measure of accuracy at the optimal cut-points. Simultaneous evaluation ofHUM K $$ {\mathrm{HUM}}_K $$ andJ K $$ {J}_K $$ provides a comprehensive picture about the classification accuracy of the biomarker/diagnostic test under consideration. This article studies both parametric and non-parametric approaches for estimating the confidence region ofHUM K $$ {\mathrm{HUM}}_K $$ andJ K $$ {J}_K $$ for a single biomarker. The performances of the proposed methods are investigated by an extensive simulation study and are applied to a real data set from the Alzheimer's Disease Neuroimaging Initiative.
Collapse
Affiliation(s)
- Jia Wang
- Department of Biostatistics, University at Buffalo, Buffalo, New York, USA
| | - Jingjing Yin
- Department of Biostatistics, Epidemiology and Environmental Health Sciences, Jiann-Ping Hsu College Public Health, Georgia Southern University, Statesboro, Georgia, USA
| | - Lili Tian
- Department of Biostatistics, University at Buffalo, Buffalo, New York, USA
| |
Collapse
|
4
|
Nan N, Tian L. A new accuracy metric under three classes when subclasses are involved and its confidence interval estimation. Stat Med 2023; 42:5207-5228. [PMID: 37779490 DOI: 10.1002/sim.9908] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 07/26/2023] [Accepted: 09/04/2023] [Indexed: 10/03/2023]
Abstract
"Compound multi-class classification" refers to the setting where three or more main classes are involved and at least one of the main classes have multiple subclasses. A common practice in evaluating biomarker performance under "compound multi-class classification" is "subclasses pooling." In this article, we first explore the downsides of accuracy metrics based on pooled data. Then we propose a new accuracy measure proper for "compound multi-class classification" with three ordinal main classes, namely "volume under compoundR O C $$ ROC $$ surface (V U S C $$ VU{S}_C $$ )." The proposedV U S C $$ VU{S}_C $$ evaluates the accuracy of a biomarker appropriately by identifying main classes without requiring specification of an ordering for marker values of subclasses within each main class. For confidence interval estimation ofV U S C $$ VU{S}_C $$ , both parametric and nonparametric methods are studied, and simulation studies are carried out to assess coverage probabilities. A subset of Alzheimer's Disease Neuroimaging Initiative study dataset is analyzed.
Collapse
Affiliation(s)
- Nan Nan
- Department of Biostatistics, University at Buffalo, Buffalo, New York, USA
| | - Lili Tian
- Department of Biostatistics, University at Buffalo, Buffalo, New York, USA
| |
Collapse
|
5
|
MacAskill MR, Pitcher TL, Melzer TR, Myall DJ, Horne KL, Shoorangiz R, Almuqbel MM, Livingston L, Grenfell S, Pascoe MJ, Marshall ET, Marsh S, Perry SE, Meissner WG, Theys C, Le Heron CJ, Keenan RJ, Dalrymple-Alford JC, Anderson TJ. The New Zealand Parkinson’s progression programme. J R Soc N Z 2022. [DOI: 10.1080/03036758.2022.2111448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
Affiliation(s)
- Michael R. MacAskill
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
| | - Toni L. Pitcher
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
| | - Tracy R. Melzer
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
- School of Psychology, Speech and Hearing, University of Canterbury, Christchurch, New Zealand
| | - Daniel J. Myall
- New Zealand Brain Research Institute, Christchurch, New Zealand
| | | | - Reza Shoorangiz
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
- Department of Electrical and Computer Engineering, University of Canterbury, Christchurch, New Zealand
| | - Mustafa M. Almuqbel
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Pacific Radiology, Christchurch, New Zealand
| | - Leslie Livingston
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
| | - Sophie Grenfell
- New Zealand Brain Research Institute, Christchurch, New Zealand
| | - Maddie J. Pascoe
- New Zealand Brain Research Institute, Christchurch, New Zealand
- School of Physical Education, Sport and Exercise Sciences, University of Otago, Dunedin, New Zealand
| | - Ethan T. Marshall
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
| | - Steven Marsh
- Department of Medical Physics, University of Canterbury, Christchurch, New Zealand
| | - Sarah E. Perry
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
| | - Wassilios G. Meissner
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
- Institute of Neurodegenerative Diseases (IMN), University of Bordeaux, Bordeaux, France
| | - Catherine Theys
- New Zealand Brain Research Institute, Christchurch, New Zealand
- School of Psychology, Speech and Hearing, University of Canterbury, Christchurch, New Zealand
| | - Campbell J. Le Heron
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
- School of Psychology, Speech and Hearing, University of Canterbury, Christchurch, New Zealand
- Department of Neurology, Canterbury District Health Board, Christchurch, New Zealand
| | - Ross J. Keenan
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Pacific Radiology, Christchurch, New Zealand
| | - John C. Dalrymple-Alford
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
- School of Psychology, Speech and Hearing, University of Canterbury, Christchurch, New Zealand
| | - Tim J. Anderson
- New Zealand Brain Research Institute, Christchurch, New Zealand
- Department of Medicine, University of Otago, Christchurch, New Zealand
- Department of Neurology, Canterbury District Health Board, Christchurch, New Zealand
| |
Collapse
|
6
|
Shi P, Bantis LE. Construction of joint confidence spaces for the optimal true class fraction triplet in the ROC space using alternative biomarker cutoffs. Biom J 2022; 64:1023-1039. [PMID: 35561036 DOI: 10.1002/bimj.202100132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Revised: 02/22/2022] [Accepted: 03/20/2022] [Indexed: 11/06/2022]
Abstract
Hepatocellular carcinoma (HCC) is the most common primary cancer of the liver. Finding new biomarkers for its early detection is of high clinical importance. As with many other diseases, cancer has a progressive nature. In cancer biomarker studies, it is often the case that the true disease status of the recruited individuals exhibits more than two classes. The receiver operating characteristic (ROC) surface is a well-known statistical tool for assessing the biomarkers' discriminatory ability in trichotomous settings. The volume under the ROC surface (VUS) is an overall measure of the discriminatory ability of a marker. In practice, clinicians are often in need of cutoffs for decision-making purposes. A popular approach for computing such cutoffs is the Youden index and its recent three-class generalization. A drawback of such a method is that it treats the data in a pairwise fashion rather than consider all the data simultaneously. The use of the minimized Euclidean distance from the perfection corner to the ROC surface (also known as closest to perfection method) is an alternative to the Youden index that may be preferable in some settings. When such a method is employed, there is a need for inferences around the resulting true class rates/fractions that correspond to the optimal operating point. In this paper, we provide an inferential framework for the derivation of marginal confidence intervals (CIs) and joint confidence spaces (CSs) around the corresponding true class fractions, when dealing with trichotomous settings. We explore parametric and nonparametric approaches for the construction of such CIs and CSs. We evaluate our approaches through extensive simulations and apply them to a real data set that refers to HCC patients.
Collapse
Affiliation(s)
- Peng Shi
- Department of Biostatistics & Data Science, The University of Kansas Medical Center, Kansas City, KS, USA
| | - Leonidas E Bantis
- Department of Biostatistics & Data Science, The University of Kansas Medical Center, Kansas City, KS, USA
| |
Collapse
|
7
|
Swint-Kruse L, Martin TA, Page BM, Wu T, Gerhart PM, Dougherty LL, Tang Q, Parente DJ, Mosier BR, Bantis LE, Fenton AW. Rheostat functional outcomes occur when substitutions are introduced at nonconserved positions that diverge with speciation. Protein Sci 2021; 30:1833-1853. [PMID: 34076313 DOI: 10.1002/pro.4136] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Revised: 05/25/2021] [Accepted: 05/28/2021] [Indexed: 12/14/2022]
Abstract
When amino acids vary during evolution, the outcome can be functionally neutral or biologically-important. We previously found that substituting a subset of nonconserved positions, "rheostat" positions, can have surprising effects on protein function. Since changes at rheostat positions can facilitate functional evolution or cause disease, more examples are needed to understand their unique biophysical characteristics. Here, we explored whether "phylogenetic" patterns of change in multiple sequence alignments (such as positions with subfamily specific conservation) predict the locations of functional rheostat positions. To that end, we experimentally tested eight phylogenetic positions in human liver pyruvate kinase (hLPYK), using 10-15 substitutions per position and biochemical assays that yielded five functional parameters. Five positions were strongly rheostatic and three were non-neutral. To test the corollary that positions with low phylogenetic scores were not rheostat positions, we combined these phylogenetic positions with previously-identified hLPYK rheostat, "toggle" (most substitution abolished function), and "neutral" (all substitutions were like wild-type) positions. Despite representing 428 variants, this set of 33 positions was poorly statistically powered. Thus, we turned to the in vivo phenotypic dataset for E. coli lactose repressor protein (LacI), which comprised 12-13 substitutions at 329 positions and could be used to identify rheostat, toggle, and neutral positions. Combined hLPYK and LacI results show that positions with strong phylogenetic patterns of change are more likely to exhibit rheostat substitution outcomes than neutral or toggle outcomes. Furthermore, phylogenetic patterns were more successful at identifying rheostat positions than were co-evolutionary or eigenvector centrality measures of evolutionary change.
Collapse
Affiliation(s)
- Liskin Swint-Kruse
- Department of Biochemistry and Molecular Biology, The University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Tyler A Martin
- Department of Biochemistry and Molecular Biology, The University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Braelyn M Page
- Department of Biochemistry and Molecular Biology, The University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Tiffany Wu
- Department of Biochemistry and Molecular Biology, The University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Paige M Gerhart
- Department of Biochemistry and Molecular Biology, The University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Larissa L Dougherty
- Department of Biochemistry and Molecular Biology, The University of Kansas Medical Center, Kansas City, Kansas, USA.,Department of Biochemistry and Cell Biology, Geisel School of Medicine at Dartmouth College, Hanover, New Hampshire, USA
| | - Qingling Tang
- Department of Biochemistry and Molecular Biology, The University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Daniel J Parente
- Department of Family Medicine and Community Health, The University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Brian R Mosier
- Department of Biostatistics and Data Science, The University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Leonidas E Bantis
- Department of Biostatistics and Data Science, The University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Aron W Fenton
- Department of Biochemistry and Molecular Biology, The University of Kansas Medical Center, Kansas City, Kansas, USA
| |
Collapse
|
8
|
Mosier BR, Bantis LE. Estimation and construction of confidence intervals for biomarker cutoff-points under the shortest Euclidean distance from the ROC surface to the perfection corner. Stat Med 2021; 40:4522-4539. [PMID: 34080733 DOI: 10.1002/sim.9077] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2020] [Revised: 04/10/2021] [Accepted: 05/12/2021] [Indexed: 11/08/2022]
Abstract
Pancreatic ductal adenocarcinoma (PDAC) is an aggressive type of cancer with a 5-year survival rate of less than 5%. As in many other diseases, its diagnosis might involve progressive stages. It is common that in biomarker studies referring to PDAC, recruitment involves three groups: healthy individuals, patients that suffer from chronic pancreatitis, and PDAC patients. Early detection and accurate classification of the state of the disease are crucial for patients' successful treatment. ROC analysis is the most popular way to evaluate the performance of a biomarker and the Youden index is commonly employed for cutoff derivation. The so-called generalized Youden index has a drawback in the three-class case of not accommodating the full data set when estimating the optimal cutoffs. In this article, we explore the use of the Euclidean distance of the ROC to the perfection corner for the derivation of cutoffs in trichotomous settings. We construct an inferential framework that involves both parametric and nonparametric techniques. Our methods can accommodate the full information of a given data set and thus provide more accurate estimates in terms of the decision-making cutoffs compared with a Youden-based strategy. We evaluate our approaches through extensive simulations and illustrate them on a PDAC biomarker study.
Collapse
Affiliation(s)
- Brian R Mosier
- Department of Biostatistics & Data Science, The University of Kansas Medical Center, Kansas City, Kansas, USA
| | - Leonidas E Bantis
- Department of Biostatistics & Data Science, The University of Kansas Medical Center, Kansas City, Kansas, USA
| |
Collapse
|
9
|
Noll S, Furrer R, Reiser B, Nakas CT. Inference in receiver operating characteristic surface analysis via a trinormal model‐based testing approach. Stat (Int Stat Inst) 2020. [DOI: 10.1002/sta4.249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Samuel Noll
- Department of MathematicsUniversity of Zurich Zurich Switzerland
| | - Reinhard Furrer
- Department of MathematicsUniversity of Zurich Zurich Switzerland
- Department of Computational ScienceUniversity of Zurich Zurich Switzerland
| | | | - Christos T. Nakas
- Department of Agriculture, Crop Production and Rural EnvironmentUniversity of Thessaly Volos 38446 Greece
- Department of Clinical ChemistryInselspital, Bern University Hospital, University of Bern Bern Switzerland
| |
Collapse
|
10
|
Inácio de Carvalho V, Carvalho M, Branscum A. Bayesian bootstrap inference for the receiver operating characteristic surface. Stat (Int Stat Inst) 2018. [DOI: 10.1002/sta4.211] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Affiliation(s)
| | | | - Adam Branscum
- College of Public Health and Human Sciences Oregon State University Corvallis Oregon
| |
Collapse
|
11
|
Bantis LE, Nakas CT, Reiser B. Construction of confidence intervals for the maximum of the Youden index and the corresponding cutoff point of a continuous biomarker. Biom J 2018; 61:138-156. [DOI: 10.1002/bimj.201700107] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2017] [Revised: 07/20/2018] [Accepted: 07/24/2018] [Indexed: 11/06/2022]
Affiliation(s)
- Leonidas E. Bantis
- Department of Biostatistics; University of Kansas Medical Center; Kansas City Kansas USA
| | - Christos T. Nakas
- Laboratory of Biometry, School of Agriculture; University of Thessaly; Nea Ionia Magnesia Greece
- University Institute of Clinical Chemistry, Inselspital, Bern University Hospital, University of Bern; Bern Switzerland
| | | |
Collapse
|
12
|
Bantis LE, Feng Z. Comparison of two correlated ROC surfaces at a given pair of true classification rates. Stat Med 2018; 37:4022-4035. [DOI: 10.1002/sim.7894] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2017] [Revised: 01/04/2018] [Accepted: 03/08/2018] [Indexed: 11/12/2022]
Affiliation(s)
- Leonidas E. Bantis
- Department of Biostatistics; The University of Texas MD Anderson Cancer Center; Houston Texas 77030
| | - Ziding Feng
- Department of Biostatistics; The University of Texas MD Anderson Cancer Center; Houston Texas 77030
| |
Collapse
|
13
|
Xiong C, Luo J, Chen L, Gao F, Liu J, Wang G, Bateman R, Morris JC. Estimating diagnostic accuracy for clustered ordinal diagnostic groups in the three-class case-Application to the early diagnosis of Alzheimer disease. Stat Methods Med Res 2018; 27:701-714. [PMID: 29182052 PMCID: PMC5841923 DOI: 10.1177/0962280217742539] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Many medical diagnostic studies involve three ordinal diagnostic populations in which the diagnostic accuracy can be summarized by the volume or partial volume under the receiver operating characteristic surface for a diagnostic marker. When the diagnostic populations are clustered, e.g. by families, we propose to model the diagnostic marker by a general linear mixed model that takes into account of the correlation on the diagnostic marker from members of the same clusters. This model then facilitates the maximum likelihood estimation and statistical inferences of the diagnostic accuracy for the diagnostic marker. This approach naturally allows the incorporation of covariates as well as missing data when some clusters do not have subjects on all diagnostic groups in the estimation of, and the subsequent inferences on the diagnostic accuracy. We further study the performance of the proposed methods in a large simulation study with clustered data. Finally, we apply the proposed methodology to the data of several biomarkers collected by the Dominantly Inherited Alzheimer Network, an international family-clustered registry to study autosomal dominant Alzheimer disease which is a rare form of Alzheimer disease caused by mutations in any of the three genes including the amyloid precursor protein, presenilin 1 and presenilin 2. We estimate the accuracy of several cerebrospinal fluid and neuroimaging biomarkers in differentiating three diagnostic and genetic populations: normal non-mutation carriers, asymptomatic mutation carriers, and symptomatic mutation carriers.
Collapse
Affiliation(s)
- Chengjie Xiong
- Division of Biostatistics, Washington University in St. Louis, St. Louis, MO, U.S.A
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, U.S.A
| | - Jingqin Luo
- Division of Public health, Department of Surgery, Washington University in St. Louis, St. Louis, MO, U.S.A
- Biostatistics Core, Siteman Cancer Center, Washington University in St. Louis, St. Louis, MO, U.S.A
| | - Ling Chen
- Division of Biostatistics, Washington University in St. Louis, St. Louis, MO, U.S.A
| | - Feng Gao
- Division of Public health, Department of Surgery, Washington University in St. Louis, St. Louis, MO, U.S.A
- Biostatistics Core, Siteman Cancer Center, Washington University in St. Louis, St. Louis, MO, U.S.A
| | - Jingxia Liu
- Division of Public health, Department of Surgery, Washington University in St. Louis, St. Louis, MO, U.S.A
- Biostatistics Core, Siteman Cancer Center, Washington University in St. Louis, St. Louis, MO, U.S.A
| | - Guoqiao Wang
- Division of Biostatistics, Washington University in St. Louis, St. Louis, MO, U.S.A
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, U.S.A
| | - Randall Bateman
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, U.S.A
| | - John C. Morris
- Department of Neurology, Washington University in St. Louis, St. Louis, MO, U.S.A
- Departments of Pathology and Immunology, Washington University in St. Louis, St. Louis, MO, U.S.A
| |
Collapse
|
14
|
Carvalho VID, Branscum AJ. Bayesian nonparametric inference for the three-class Youden index and its associated optimal cutoff points. Stat Methods Med Res 2017; 27:689-700. [PMID: 29241400 DOI: 10.1177/0962280217742538] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The three-class Youden index serves both as a measure of medical test accuracy and a criterion to choose the optimal pair of cutoff values for classifying subjects into three ordinal disease categories (e.g. no disease, mild disease, advanced disease). We present a Bayesian nonparametric approach for estimating the three-class Youden index and its corresponding optimal cutoff values based on Dirichlet process mixtures, which are robust models that can handle intricate features of distributions for complex data. Results from a simulation study are presented and an application to data from the Trail Making Test to assess cognitive impairment in Parkinson's disease patients is detailed.
Collapse
Affiliation(s)
| | - Adam J Branscum
- 2 College of Public Health and Human Sciences, Oregon State University, Corvallis, OR, USA
| |
Collapse
|
15
|
Yin J, Nakas CT, Tian L, Reiser B. Confidence intervals for differences between volumes under receiver operating characteristic surfaces (VUS) and generalized Youden indices (GYIs). Stat Methods Med Res 2017; 27:675-688. [PMID: 29233075 DOI: 10.1177/0962280217740787] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
This article explores both existing and new methods for the construction of confidence intervals for differences of indices of diagnostic accuracy of competing pairs of biomarkers in three-class classification problems and fills the methodological gaps for both parametric and non-parametric approaches in the receiver operating characteristic surface framework. The most widely used such indices are the volume under the receiver operating characteristic surface and the generalized Youden index. We describe implementation of all methods and offer insight regarding the appropriateness of their use through a large simulation study with different distributional and sample size scenarios. Methods are illustrated using data from the Alzheimer's Disease Neuroimaging Initiative study, where assessment of cognitive function naturally results in a three-class classification setting.
Collapse
Affiliation(s)
- Jingjing Yin
- 1 Department of Biostatistics, Jiann-Ping Hsu College of Public Health, Georgia Southern University, Statesboro, GA, USA
| | - Christos T Nakas
- 2 Laboratory of Biometry, School of Agriculture, University of Thessaly, Volos, Greece.,3 University Institute of Clinical Chemistry, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Lili Tian
- 4 Department of Biostatistics, University at Buffalo, Buffalo, NY, USA
| | - Benjamin Reiser
- 5 Department of Statistics, University of Haifa, Haifa, Israel
| |
Collapse
|