Interdisciplinary Safety Evaluation and Quantitative Safety Monitoring: Introduction to a Series of Papers

A Novel Method for Deriving Adverse Event Prevalence in Randomized Controlled Trials: Potential for Improved Understanding of Benefit-Risk Ratio and Application to Drug Labels

INTRODUCTION

Adverse event (AE) data in randomized controlled trials (RCTs) allow quantification of a drug's safety risk relative to placebo and comparison across medications. The standard US label for Food and Drug Administration-approved drugs typically lists AEs by MedDRA Preferred Term that occur at ≥ 2% in drug and with greater incidence than in placebo. We suggest that the drug label can be more informative for both patients and physicians if it includes, in addition to AE incidence (percent of subjects who reported the AE out of the total subjects in treatment), the absolute prevalence (percent of subject-days spent with an AE out of the total subject-days spent in treatment) and expected duration (days required for AE incidence to be reduced by half). We also propose a new method to analyze AEs in RCTs using drug-placebo difference in AE prevalence to improve safety signal detection.

METHODS

AE data from six RCTs in schizophrenia were analyzed (five RCTs of the dopamine D2 receptor-based antipsychotic lurasidone and one RCT of the novel trace amine-associated receptor 1 [TAAR1] agonist ulotaront). We determined incidence, absolute prevalence, and expected duration of AEs for lurasidone and ulotaront vs respective placebo. We also calculated areas under the curve of drug-placebo difference in AE prevalence and mean percent contribution of each AE to this difference.

RESULTS

A number of AEs with the same incidence had different absolute prevalence and expected duration. When accounting for these two parameters, AEs that did not appear in the 2% incidence tables of the drug label turned out to contribute substantially to drug tolerability. The percent contribution of a drug-related AE to the overall side effect burden increased the drug-placebo difference in AE prevalence, whereas the percent contribution of a placebo-related AE decreased such difference, revealing a continuum of risk between drug and placebo. AE prevalence curves for drug were generally greater than those for placebo. Ulotaront exhibited a small drug-placebo difference in AE prevalence curves due to a relatively low incidence and short duration of AEs in the ulotaront treatment arm as well as the emergence of disease-related AEs in the placebo arm.

CONCLUSION

Reporting AE absolute prevalence and expected duration for each RCT and incorporating them in the drug label is possible, is clinically relevant, and allows standardized comparison of medications. Our new metric, the drug-placebo difference in AE prevalence, facilitates signal detection in RCTs. We piloted this metric in RCTs of several neuropsychiatric indications and drugs, offering a new way to compare AE burden and tolerability among treatments using existing clinical trial information.

Statistical methods for the analysis of adverse event data in randomised controlled trials: a scoping review and taxonomy

BACKGROUND

Statistical methods for the analysis of harm outcomes in randomised controlled trials (RCTs) are rarely used, and there is a reliance on simple approaches to display information such as in frequency tables. We aimed to identify whether any statistical methods had been specifically developed to analyse prespecified secondary harm outcomes and non-specific emerging adverse events (AEs).

METHODS

A scoping review was undertaken to identify articles that proposed original methods or the original application of existing methods for the analysis of AEs that aimed to detect potential adverse drug reactions (ADRs) in phase II-IV parallel controlled group trials. Methods where harm outcomes were the (co)-primary outcome were excluded. Information was extracted on methodological characteristics such as: whether the method required the event to be prespecified or could be used to screen emerging events; and whether it was applied to individual events or the overall AE profile. Each statistical method was appraised and a taxonomy was developed for classification.

RESULTS

Forty-four eligible articles proposing 73 individual methods were included. A taxonomy was developed and articles were categorised as: visual summary methods (8 articles proposing 20 methods); hypothesis testing methods (11 articles proposing 16 methods); estimation methods (15 articles proposing 24 methods); or methods that provide decision-making probabilities (10 articles proposing 13 methods). Methods were further classified according to whether they required a prespecified event (9 articles proposing 12 methods), or could be applied to emerging events (35 articles proposing 61 methods); and if they were (group) sequential methods (10 articles proposing 12 methods) or methods to perform final/one analyses (34 articles proposing 61 methods).

CONCLUSIONS

This review highlighted that a broad range of methods exist for AE analysis. Immediate implementation of some of these could lead to improved inference for AE data in RCTs. For example, a well-designed graphic can be an effective means to communicate complex AE data and methods appropriate for counts, time-to-event data and that avoid dichotomising continuous outcomes can improve efficiencies in analysis. Previous research has shown that adoption of such methods in the scientific press is limited and that strategies to support change are needed.

TRIAL REGISTRATION

PROSPERO registration: https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=97442.