Comparison of three-dimensional ROC surfaces for clustered and correlated markers, with a proteomics application

Statistical inference for decision curve analysis, with applications to cataract diagnosis

Statistical learning methods are widely used in medical literature for the purpose of diagnosis or prediction. Conventional accuracy assessment via sensitivity, specificity, and ROC curves does not fully account for clinical utility of a specific model. Decision curve analysis (DCA) becomes a novel complement as it incorporates a clinical judgment of the relative value of benefits (treating a true positive case) and harms (treating a false positive case) associated with prediction models. The preference of a patient or a policy-maker is formulated statistically as the underlying threshold probability, above which the patient would choose to be treated. Net benefit is then calculated for possible threshold probability, which places benefits and harms on the same scale. We consider the inference problems for DCA in this paper. Interval estimation procedure and inference methodology are provided after we derive the relevant asymptotic properties. Our formulation can accommodate the classification problems with multiple categories. We carry out numerical studies to assess the performance of the proposed methods. An eye disease dataset is analyzed to illustrate our proposals.

Weighted volume under the three-way receiver operating characteristic surface

It is often necessary to differentiate subjects from multiple categories using medical tests. We may then adopt statistical measures to characterize the performance of these tests. The three-way ROC analysis has been proposed to evaluate the diagnostic accuracy of medical tests with three categories, reflecting the correct classification probabilities across all possible decision thresholds. The geometry of the ROC surface is carefully studied, leading to numerical summary measures such as the volume under the surface. This paper generalizes the global volume under the surface of three-way ROC analysis to the weighted volume under the surface (WVUS) by introducing a weight function emphasizing particular regions of correct classification probabilities. This generalization practically allows researchers to calculate the diagnostic accuracy for a medical or clinical biomarker while satisfactorily high probabilities of correct classification for one or two classes are conditionally ensured. We provide the asymptotic properties of the proposed nonparametric and parametric estimators of WVUS, which could easily lend support to statistical inferences. Some simulations have been conducted to assess the proposed estimators and also to demonstrate the necessity of WVUS. A real data analysis about liver cancer illustrates our methodology.