Calibrating Real-World Evidence Studies Against Randomized Trials: Treatment Effectiveness of Infliximab in Crohn's Disease

Pragmatic Trial Design to Compare Real-world Effectiveness of Different Treatments for Inflammatory Bowel Diseases: The PRACTICE-IBD European Consensus

BACKGROUND AND AIMS

Pragmatic studies designed to test interventions in everyday clinical settings can successfully complement the evidence from registration and explanatory clinical trials. The European consensus project PRACTICE-IBD was developed to identify essential criteria and address key methodological issues needed to design valid, comparative, pragmatic studies in inflammatory bowel diseases [BDs].

METHODS

Statements were issued by a panel of 11 European experts in IBD management and trial methodology, on four main topics: [I] study design; [II] eligibility, recruitment and organisation, flexibility; [III] outcomes; [IV] analysis. The consensus process followed a modified Delphi approach, involving two rounds of assessment and rating of the level of agreement [1 to 9; cut-off ≥7 for approval] with the statements by 18 additional European experts in IBD.

RESULTS

At the first voting round, 25 out of the 26 statements reached a mean score ≥7. Following the discussion that preceded the second round of voting, it was decided to eliminate two statements and to split one into two. At the second voting round, 25 final statements were approved: seven for study design; six for eligibility, recruitment and organisation, flexibility; eight for outcomes; and four for analysis.

CONCLUSIONS

Pragmatic, randomised, clinical trials can address important questions in IBD clinical practice, and may provide complementary, high-level evidence, as long as they follow a methodologically rigorous approach. These 25 statements intend to offer practical guidance in the design of high-quality, pragmatic, clinical trials that can aid decision making in choosing a management strategy for IBDs.

Infliximab: a single-centre, prospective, observational evaluation of TDM data in patients with IBD

OBJECTIVES

Therapeutic drug monitoring of infliximab (IFX) is important to optimise treatment of inflammatory bowel disease (IBD). A recent IBD consensus statement recommends targeting trough serum concentrations of >3 μg/mL, higher than our local recommendation of >1 μg/mL. We therefore investigated the relationship between IFX trough concentrations and C reactive protein (CRP), faecal calprotectin (FCP), clinical outcomes and anti-IFX antibody (AB) development as well as the influence of concomitant thiopurine treatment.

METHODS

Observational data, prospectively collected in a cohort of adult patients with IBD newly initiated on IFX at a single centre.

RESULTS

IFX concentrations >3 μg/mL were associated with a greater reduction in CRP (% change from baseline) and lower FCP; mean (SD) 47 (33.8) % vs 102.3 (136.9) % and 233.9 (505.1) μg/g vs 416.3 (613.5) μg/g, respectively. Lower IFX concentrations were observed in patients who developed AB than those who did not, mean (range) 6.2 (1.1-10) μg/mL vs 0.9 (0.4-4.9) μg/mL, respectively, and also in patients who stopped/switched therapy compared with those who continued, 2.4 (2.9) μg/mL vs 6.5 (2.8) μg/mL; p=0.0002. Patients taking a concomitant thiopurine were found to have higher IFX concentrations; mean (range) 6.4 (0.7-10) μg/mL vs 3.9 (0.4-10) μg/mL.

CONCLUSIONS

IFX concentrations are correlated with biomarkers, clinical response and AB development in patients with IBD. Concomitant thiopurine therapy appears to be associated with higher IFX concentrations and reduced likelihood of AB development.

Use of Structured Template and Reporting Tool for Real-World Evidence for Critical Appraisal of the Quality of Reporting of Real-World Evidence Studies: A Systematic Review

OBJECTIVES

Real-world evidence (RWE) studies are increasingly being used to support healthcare decisions. Various frameworks, tools, and checklists exist for ensuring quality of real-world data, designing robust studies, and assessing potential for bias. In January 2021, Structured Template and Reporting Tool for RWE (STaRT-RWE) was released to further reduce ambiguity, assumptions, and misinterpretation while planning, implementing, and reporting RWE studies of the safety and effectiveness of treatments. The objective of this study was to identify gaps in the reporting quality of published RWE studies by using this template for critical appraisal.

METHODS

Two reviewers conducted a keyword search on PubMed for free-full-text research articles using real-world data, RWE design, and safety with or without effectiveness outcomes of a medicinal product or intervention in humans of any age or gender, published in English between January 13, 2021, and January 13, 2022. Assessment of risk of bias was done using Assessment of Real-World Observational Studies critical appraisal tool. Deficiencies in methods and findings as per STaRT-RWE template were reported as frequencies.

RESULTS

A total of 54 of 2374 retrieved studies were included in the review. Based on the STaRT-RWE template, the studies inadequately reported empirically defined covariates, power and sample size calculation, attrition, sensitivity analyses, index date (day 0) defining criterion, predefined covariates, outcome, metadata about data source and software, objective, inclusion and exclusion criteria, analysis specifications, and follow-up.

CONCLUSIONS

The use of STaRT-RWE template along with its tables, design diagram, and library of published studies has a potential of improving robustness of RWE studies.

Decreased risk of treatment failure with vedolizumab and thiopurines combined compared with vedolizumab monotherapy in Crohn's disease

OBJECTIVE

While infliximab combined to thiopurines is more effective than infliximab monotherapy in patients with Crohn's disease (CD) and UC, the impact of adding thiopurines to vedolizumab remains controversial. We emulated two target trials comparing the effectiveness of combination therapy versus vedolizumab monotherapy in CD and UC.

DESIGN

Based on two US and the French nationwide healthcare databases, patients with CD and UC who initiated vedolizumab were identified. The study methodology, including confounding adjustment and outcome definitions, were previously validated in successful emulations of the SONIC and SUCCESS trials. Risk ratios for treatment failure based on hospitalisation or surgery related to disease activity, treatment switch, or prolonged corticosteroids use, were estimated after 1:1 propensity score (PS) matching.

RESULTS

Among a total of 10 299 vedolizumab users, 804 CD and 1088 UC pairs of combination therapy versus vedolizumab monotherapy users were PS matched. Treatment failure occurred at week 26 in 236 (29.3%) and 376 (34.3%) patients with CD and at week 16 in 236 (21.7%) and 263 (24.2%) patients with UC initiating combination therapy and vedolizumab monotherapy, respectively. The risk of treatment failure was decreased with combination therapy compared with vedolizumab monotherapy in CD (RR 0.85, 95% CI: 0.74 to 0.98) and to a lesser extent in UC (RR 0.90, 95% CI: 0.77 to 1.05). Findings were consistent across databases.

CONCLUSION

Using validated methodologies, combination therapy with vedolizumab and thiopurines was associated with lower treatment failure compared with vedolizumab monotherapy in CD but not UC across the USA and France.

Large-Scale Postmarketing Surveillance of Biological Drugs for Immune-Mediated Inflammatory Diseases Through an Italian Distributed Multi-Database Healthcare Network: The VALORE Project

BACKGROUND

Biological drugs have improved the management of immune-mediated inflammatory diseases (IMIDs) despite being associated with important safety issues such as immunogenicity, infections, and malignancies in real-world settings.

OBJECTIVE

The aim of this study was to explore the potential of a large Italian multi-database distributed network for use in the postmarketing surveillance of biological drugs, including biosimilars, in patients with IMID.

METHODS

A retrospective cohort study was conducted using 13 Italian regional claims databases during 2010-2019. A tailor-made R-based tool developed for distributed analysis of claims data using a study-specific common data model was customized for this study. We measured the yearly prevalence of biological drug users and the frequency of switches between originator and biosimilars for infliximab, etanercept, and adalimumab separately and stratified them by calendar year and region. We then calculated the cumulative number of users and person-years (PYs) of exposure to individual biological drugs approved for IMIDs. For a number of safety outcomes (e.g., severe acute respiratory syndrome coronavirus 2 [SARS-COV-2] infection), we conducted a sample power calculation to estimate the PYs of exposure required to investigate their association with individual biological drugs approved for IMIDs, considering different strengths of association.

RESULTS

From a total underlying population of almost 50 million inhabitants from 13 Italian regions, we identified 143,602 (0.3%) biological drug users, with a cumulative exposure of 507,745 PYs during the entire follow-up. The mean age ± standard deviation of biological drug users was 49.3 ± 16.3, with a female-to-male ratio of 1.2. The age-adjusted yearly prevalence of biological drug users increased threefold from 0.7 per 1000 in 2010 to 2.1 per 1000 in 2019. Overall, we identified 40,996 users of biosimilars of tumor necrosis factor (TNF)-α inhibitors (i.e., etanercept, adalimumab, and infliximab) in the years 2015-2019. Of these, 46% (N = 18,845) switched at any time between originator and biosimilars or vice versa. To investigate a moderate association (incidence rate ratio 2) between biological drugs approved for IMIDs and safety events of interest, such as optic neuritis (lowest background incidence rate 10.4/100,000 PYs) or severe infection (highest background incidence rate 4312/100,000 PYs), a total of 43,311 PYs and 104 PYs of exposure to individual biological drugs, respectively, would be required. As such, using this network, of 15 individual biological drugs approved for IMIDs, the association with those adverse events could be investigated for four (27%) and 14 (93%), respectively.

CONCLUSION

The VALORE project multi-database network has access to data on more than 140,000 biological drug users (and > 0.5 million PYs) from 13 Italian regions during the years 2010-2019, which will be further expanded with the inclusion of data from other regions and more recent calendar years. Overall, the cumulated amount of person-time of exposure to biological drugs approved for IMIDs provides enough statistical power to investigate weak/moderate associations of almost all individual compounds and the most relevant safety outcomes. Moreover, this network may offer the opportunity to investigate the interchangeability of originator and biosimilars of several TNFα inhibitors in different therapeutic areas in real-world settings.