Assessment of the performance of the Ames MPF™ assay: A multicenter collaborative study with six coded chemicals

The Ames MPF™ is a miniaturized, microplate fluctuation format of the Ames test. It is a standardized, commercially available product which can be used to assess mutagenicity in Salmonella and E. coli strains in 384-well plates using a color change-based readout. Several peer-reviewed comparisons of the Ames MPF™ to the Ames test in Petri dishes confirmed its suitability to evaluate the mutagenic potential of a variety of test items. An international multicenter study involving seven laboratories tested six coded chemicals with this assay using five bacterial strains, as recommended by the OECD test guideline 471. The data generated by the participating laboratories was in excellent agreement (93%), and the similarity of their dose response curves, as analyzed with sophisticated statistical approaches further confirmed the suitability of the Ames MPF™ assay as an alternative to the Ames test on agar plates, but with advantages with respect to significantly reduced amount of test substance and S9 requirements, speed, hands-on time and, potentially automation.

Testing for qualitative heterogeneity: An application to composite endpoints in survival analysis

Composite endpoints are frequently used in clinical outcome trials to provide more endpoints, thereby increasing statistical power. A key requirement for a composite endpoint to be meaningful is the absence of the so-called qualitative heterogeneity to ensure a valid overall interpretation of any treatment effect identified. Qualitative heterogeneity occurs when individual components of a composite endpoint exhibit differences in the direction of a treatment effect. In this paper, we develop a general statistical method to test for qualitative heterogeneity, that is to test whether a given set of parameters share the same sign. This method is based on the intersection-union principle and, provided that the sample size is large, is valid whatever the model used for parameters estimation. We propose two versions of our testing procedure, one based on a random sampling from a Gaussian distribution and another version based on bootstrapping. Our work covers both the case of completely observed data and the case where some observations are censored which is an important issue in many clinical trials. We evaluated the size and power of our proposed tests by carrying out some extensive Monte Carlo simulations in the case of multivariate time to event data. The simulations were designed under a variety of conditions on dimensionality, censoring rate, sample size and correlation structure. Our testing procedure showed very good performances in terms of statistical power and type I error. The proposed test was applied to a data set from a single-center, randomized, double-blind controlled trial in the area of Alzheimer's disease.

A nested group sequential framework for regional evaluation in global drug development program

The primary objective of a multiregional clinical trial (MRCT) is to assess the efficacy of all participating regions and evaluate the probability of applying the overall results to a specific region. The consistency assessment of the target region with the overall results is the most common way of evaluating the efficacy in a specific region. Recently, Huang et al. (2012) proposed an additional trial in the target region to an MRCT to evaluate the efficacy in the target ethnic (TE) population under the framework of simultaneous global drug development program (SGDDP). However, the operating characteristics of this statistical framework were not well considered. Therefore, a nested group sequential program for regional efficacy evaluation is proposed in this paper. It is an extension of Huang's SGDDP framework and allows interim analysis after MRCT and in the course of local clinical trial (LCT) phase. It is able to well control the family-wise type I error in the program level and enhances the flexibility of the program. In LCT sample size estimation, we introduce virtual trial, which is transformed from the original program by using discounting factor, and an iteration method is employed to calculate the sample size and stopping boundaries of interim analyses. The proposed sample size estimation method is validated in the simulations and the effect of varied weight, effect size of TE population, and design setting is explored. Examples with normal end point, binary end point, and survival end point are shown to illustrate the application of the proposed nested group sequential program.

Subgroup analyses in confirmatory clinical trials: time to be specific about their purposes

Background

It is well recognized that treatment effects may not be homogeneous across the study population. Subgroup analyses constitute a fundamental step in the assessment of evidence from confirmatory (Phase III) clinical trials, where conclusions for the overall study population might not hold. Subgroup analyses can have different and distinct purposes, requiring specific design and analysis solutions. It is relevant to evaluate methodological developments in subgroup analyses against these purposes to guide health care professionals and regulators as well as to identify gaps in current methodology.

Methods

We defined four purposes for subgroup analyses: (1) Investigate the consistency of treatment effects across subgroups of clinical importance, (2) Explore the treatment effect across different subgroups within an overall non-significant trial, (3) Evaluate safety profiles limited to one or a few subgroup(s), (4) Establish efficacy in the targeted subgroup when included in a confirmatory testing strategy of a single trial. We reviewed the methodology in line with this “purpose-based” framework. The review covered papers published between January 2005 and April 2015 and aimed to classify them in none, one or more of the aforementioned purposes.

Results

In total 1857 potentially eligible papers were identified. Forty-eight papers were selected and 20 additional relevant papers were identified from their references, leading to 68 papers in total. Nineteen were dedicated to purpose 1, 16 to purpose 4, one to purpose 2 and none to purpose 3. Seven papers were dedicated to more than one purpose, the 25 remaining could not be classified unambiguously. Purposes of the methods were often not specifically indicated, methods for subgroup analysis for safety purposes were almost absent and a multitude of diverse methods were developed for purpose (1).

Conclusions

It is important that researchers developing methodology for subgroup analysis explicitly clarify the objectives of their methods in terms that can be understood from a patient’s, health care provider’s and/or regulator’s perspective. A clear operational definition for consistency of treatment effects across subgroups is lacking, but is needed to improve the usability of subgroup analyses in this setting. Finally, methods to particularly explore benefit-risk systematically across subgroups need more research.

Electronic supplementary material

The online version of this article (doi:10.1186/s12874-016-0122-6) contains supplementary material, which is available to authorized users.

Detecting qualitative interactions in clinical trials with binary responses

This study considers the detection of treatment-by-subset interactions in a stratified, randomised clinical trial with a binary-response variable. The focus lies on the detection of qualitative interactions. In addition, the presented method is useful more generally, as it can assess the inconsistency of the treatment effects among strata by using an a priori-defined inconsistency margin. The methodology presented is based on the construction of ratios of treatment effects. In addition to multiplicity-adjusted p-values, simultaneous confidence intervals are recommended to use in detecting the source and the amount of a potential qualitative interaction. The proposed method is demonstrated on a multi-regional trial using the open-source statistical software R.