Asymptotic properties of maximum likelihood estimators with sample size recalculation

Discussion on "Adaptive enrichment designs with a continuous biomarker" by Nigel Stallard

We congratulate Dr. Nigel Stallard on his stimulating paper on adaptive enrichment designs with a continuous biomarker. Dr. Stallard details a framework for a large and interesting class of enrichment procedures. His work has motivated us to offer some thoughts in response. Dr. Stallard's strategy is to use the maximum of a test statistic over a set of possible threshold values to define the enriched population to be sampled in a second stage. This reminds us of procedures for identifying a change point, a biomarker value beyond which the effect of treatment is increased. For simplicity we focus our comments on Dr. Stallard's Rule 1 for selecting the second-stage sampling threshold. Using this rule, we present the likelihood ratio approach for adaptive testing and compare it to Dr. Stallard's approach for a few scenarios.

Most Powerful Test Sequences with Early Stopping Options

We extended the application of uniformly most powerful tests to sequential tests with different stage-specific sample sizes and critical regions. In the one parameter exponential family, likelihood ratio sequential tests are shown to be uniformly most powerful for any predetermined α-spending function and stage-specific sample sizes. To obtain this result, the probability measure of a group sequential design is constructed with support for all possible outcome events, as is useful for designing an experiment prior to having data. This construction identifies impossible events that are not part of the support. The overall probability distribution is dissected into components determined by the stopping stage. These components are the sub-densities of interim test statistics first described by Armitage, McPherson and Rowe (1969) that are commonly used to create stopping boundaries given an α-spending function and a set of interim analysis times. Likelihood expressions conditional on reaching a stage are given to connect pieces of the probability anatomy together. The reduction of support caused by the adoption of an early stopping rule induces sequential truncation (not nesting) in the probability distributions of possible events. Multiple testing induces mixtures on the adapted support. Even asymptotic distributions of inferential statistics that are typically normal, are not. Rather they are derived from mixtures of truncated multivariate normal distributions.