A note on modeling placement values in the analysis of receiver operating characteristic curves

Estimation of multiple ordered ROC curves using placement values

In many diagnostic accuracy studies, a priori orders may be available on multiple receiver operating characteristic curves. For example, being closer to delivery, fetal ultrasound measures in the third trimester should be no less accurate than those in the second trimester in predicting small-for-gestational-age births. Such an a priori order should be incorporated in estimating receiver operating characteristic curves and associated summary accuracy statistics, as it can potentially improve statistical efficiency of these estimates. Early work in the literature has mainly taken an indirect approach to this task and has induced the desired a priori order through modeling test score distributions. We instead propose a new strategy that incorporates the order directly through the modeling of receiver operating characteristic curves. We achieve this by exploiting the link between placement value (the relative position of a diseased test score in the healthy score distribution), the cumulative distribution function of placement value, and receiver operating characteristic curve, and by building stochastically ordered random variables through mixture distributions. We take a Bayesian semiparametric approach in using Dirichlet process mixture models so that the placement values can be flexibly modeled. We conduct extensive simulation studies to examine the performance of the proposed methodology and apply the new framework to data from obstetrics and women's health studies.

Discriminatory Capacity of Prenatal Ultrasound Measures for Large-for-Gestational-Age Birth: A Bayesian Approach to ROC Analysis Using Placement Values

Predicting large fetuses at birth is of great interest to obstetricians. Using an NICHD Scandinavian Study that collected longitudinal ultrasound examination data during pregnancy, we estimate diagnostic accuracy parameters of estimated fetal weight (EFW) at various times during pregnancy in predicting large-for-gestational-age. We adopt a placement value based Bayesian regression model with random effects to estimate ROC curves. The use of placement values allows us to model covariate effects directly on the ROC curves and the adoption of a Bayesian approach accommodates the a priori constraint that an ROC curve of EFW near delivery should dominate another further away. The proposed methodology is shown to perform better than some alternative approaches in simulations and its application to the Scandinavian Study data suggests that diagnostic accuracy of EFW can improve about 65% from week 17 to 37 of gestation.