Kampfrath T, Levinson SS. Brief critical review: Statistical assessment of biomarker performance.
Clin Chim Acta 2013;
419:102-7. [PMID:
23428592 DOI:
10.1016/j.cca.2013.02.006]
[Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2012] [Revised: 01/29/2013] [Accepted: 02/03/2013] [Indexed: 11/25/2022]
Abstract
INTRODUCTION
Articles have suggested that C-statistics associated with receiver operator characteristic (ROC) curves are insufficiently sensitive compared to odds/risk ratios (OR/RR) defined by p-values. Some suggest reclassification techniques are more appropriate.
METHODS
We review the concepts of p-values, OR/RR, and ROC curves. We construct a ROC curve, demonstrate parametric and nonparametric curves, and analyze a comparison of ROC curves.
RESULTS
Using these illustrations, we show that the ROC curve is not simply a C-statistic but a continuum of sensitivity/specificity pairs over decision levels. We demonstrate that p-values provide little useful information about discrimination and that OR/RR is a limited expression of a sensitivity/specificity plot. We illustrate that low prevalence produces low positive predictive values, reclassification techniques are subject to the same rules of prevalence as other analysis, and that modifying the analysis can decrease the p-value comparing C-statistics without altering the sensitivity/specificity plot.
CONCLUSIONS
ROC curves provide both visual and statistical information to support entry into large-scale trials, determining decision levels and the use of testing in the absence of such trials. If the sensitivity/specificity plot shows little improvement at appropriate decision point(s), statistically significant-improvement in other "novel" statistical indices should be suspect.
Collapse