Real-World Evidence: Bridging Gaps in Evidence to Guide Payer Decisions

Evaluating Comprehensibility of 157 Patient-Reported Outcome Measures (PROMs) in the Nationwide Dutch Outcome-Based Healthcare Program: More Attention for Comprehensibility of PROMs is Needed

INTRODUCTION

Patient-reported outcomes measures (PROMs) are increasingly prevalent in healthcare and used for shared decision-making and healthcare quality evaluation. However, the extent to which patients with varying health literacy levels can complete PROMs is often overlooked. This may lead to biased aggregated data and patients being excluded from studies or other PROM collection initiatives. This cross-sectional study evaluates the comprehensibility of 157 well-known and widely used PROM scales using a comprehensibility checklist.

METHODS

Pairs of two independent raters scored 157 PROM scales designed for adults included in the 35 sets of outcome information developed as part of the Dutch Outcome-Based Healthcare Program. The PROM scales were scored on the eight comprehensibility domains of the Pharos Checklist for Questionnaires in Healthcare (PCQH). Interrater agreement of domain ratings was assessed using Intraclass Correlation Coefficients or Cohen's kappa. Subsequently, final ratings were established through discussion and used to evaluate the domain-specific comprehensibility rating for each PROM scale.

RESULTS

Comprehensibility of a large number of PROM scales (n = 157), which cover a wide range of diseases and conditions across Dutch medical specialist care, was assessed. While most PROM scales were written at an accessible language level, with minimal use of medical terms, instruction clarity, number of questions, and response options emerged as significant issues, affecting a substantial proportion of PROM scales. Interrater agreement was high for most domains of the PCQH.

CONCLUSION

This study highlights the need for greater attention to the comprehensibility of PROMs to ensure their accessibility to all patients, including those with low health literacy. The PCQH can be a valuable tool in PROM development in addition to qualitative methods and in selection processes enabling comparison of comprehensibility between PROMs. However, the PCQH needs further development and validation for these purposes. Enhancing the comprehensibility of PROMs is essential for their effective incorporation in healthcare evaluation and decision-making processes.

Cross-sectional analysis of use of real-world data in single technology appraisals of oncological medicine by the National Institute for Health and Care Excellence in 2011-2021

OBJECTIVES

This study aims to identify how real-world data (RWD) have been used in single technology appraisals (STAs) of cancer drugs by the National Institute for Health and Care Excellence (NICE).

DESIGN

Cross-sectional study of NICE technology appraisals of cancer drugs for which guidance was issued between January 2011 and December 2021 (n=229). The appraisals were reviewed following a published protocol to extract the data about the use of RWD. The use of RWD was analysed by reviewing the specific ways in which RWD were used and by identifying different patterns of use.

PRIMARY OUTCOME MEASURE

The number of appraisals where RWD are used in the economic modelling.

RESULTS

Most appraisals used RWD in their economic models. The parametric use of RWD was commonly made in the economic models (76% of the included appraisals), whereas non-parametric use was less common (41%). Despite widespread use of RWD, there was no dominant pattern of use. Three sources of RWD (registries, administrative data, chart reviews) were found across the three important parts of the economic model (choice of comparators, overall survival and volume of treatment).

CONCLUSIONS

NICE has had a long-standing interest in the use of RWD in STAs. A systematic review of oncology appraisals suggests that RWD have been widely used in diverse parts of the economic models. Between 2011 and 2021, parametric use was more commonly found in economic models than non-parametric use. Nonetheless, there was no clear pattern in the way these data were used. As each appraisal involves a different decision problem and the ability of RWD to provide the information required for the economic modelling varies, appraisals will continue to differ with respect to their use of RWD.

Completion of adjuvant S-1 chemotherapy after surgical resection for biliary tract cancer: A single center experience

BACKGROUNDS

A recent randomized control trial (JCOG1202; ASCOT trial) demonstrated the efficacy of adjuvant S-1 chemotherapy (ASC) for biliary tract cancer (BTC) after surgical resection; however, the significance of the completion of ASC in the real-world setting remains unknown.

METHODS

Data of consecutive patients who underwent surgical resection for biliary tract cancer (BTC) from 2011 to 2021 were retrospectively reviewed. Of these, patients who underwent ASC were enrolled in this study. Patients were divided into two groups according to whether ASC was completed: the completion group and the non-completion group. Clinicopathological features and survival outcomes were assessed.

RESULTS

Of the 223 patients with BTC who underwent surgical resection, 75 patients who underwent ASC were included for analysis. Among them, 48 (64.0 %) completed the intended ASC course, while 27 cases (36.0 %) discontinued the treatment. The most common reason for the discontinuation was adverse event (n = 16, 59.3 %), followed by disease recurrence (n = 9, 33.3 %). Patients in the completion group showed significantly better overall survival (OS) (p < 0.001) and recurrence-free survival (RFS) (p < 0.001) compared to the non-completion group. Further, after excluding the patients in the non-completion group who discontinued ASC due to disease recurrence, the significance of ASC completion was retained for both OS and RFS.

CONCLUSION

The completion of ASC was associated with improved prognosis in patients with BTC after surgical resection. The achievement of ASC should be the goal after surgical resection, while further study may be warranted regarding the resistance of ASC.

Use of Healthcare Claims Data to Generate Real-World Evidence on Patients With Drug-Resistant Epilepsy: Practical Considerations for Research

Objectives: Regulatory bodies, health technology assessment agencies, payers, physicians, and other decision-makers increasingly recognize the importance of real-world evidence (RWE) to provide important and relevant insights on treatment patterns, burden/cost of illness, product safety, and long-term and comparative effectiveness. However, RWE generation requires a careful approach to ensure rigorous analysis and interpretation. There are limited examples of comprehensive methodology for the generation of RWE on patients who have undergone neuromodulation for drug-resistant epilepsy (DRE). This is likely due, at least in part, to the many challenges inherent in using real-world data to define DRE, neuromodulation (including type implanted), and related outcomes of interest. We sought to provide recommendations to enable generation of robust RWE that can increase knowledge of "real-world" patients with DRE and help inform the difficult decisions regarding treatment choices and reimbursement for this particularly vulnerable population. Methods: We drew upon our collective decades of experience in RWE generation and relevant disciplines (epidemiology, health economics, and biostatistics) to describe challenges inherent to this therapeutic area and to provide potential solutions thereto within healthcare claims databases. Several examples were provided from our experiences in DRE to further illustrate our recommendations for generation of robust RWE in this therapeutic area. Results: Our recommendations focus on considerations for the selection of an appropriate data source, development of a study timeline, exposure allotment (specifically, neuromodulation implantation for patients with DRE), and ascertainment of relevant outcomes. Conclusions: The need for RWE to inform healthcare decisions has never been greater and continues to grow in importance to regulators, payers, physicians, and other key stakeholders. However, as real-world data sources used to generate RWE are typically generated for reasons other than research, rigorous methodology is required to minimize bias and fully unlock their value.

The nonadherence and risk factors of eradication failure by sequential therapy as first-line anti-Helicobacter pylori treatment in real-world clinical practice

BACKGROUND

The eradication rates of sequential therapy are high in clinical trials; however, the adherence for follow-up or the patient population in a real-world setting might be different from those in trails. This study investigates the effectiveness of sequential therapy in a real-world setting and the factors that lead to treatment failure.

MATERIALS AND METHODS

In this retrospective study, patients receiving sequential therapy as a first-line anti-Helicobacter pylori (H. pylori) treatment in a real-world setting were reviewed. The age adjusted Charlson Comorbidity Index (age-CCI) and baseline variety of medications were reviewed to determine factors correlated with nonadherence for post-treatment testing and H. pylori eradication failure.

RESULTS

A total of 1053 patients were reviewed. A total of 579 patients receiving sequential therapy were included in the analyses. Among them, 462 received post-treatment testing and were placed into the follow-up group. Thus, the post-treatment testing rate was 79.8%. Stroke was an independent factor of nonadherence for post-treatment testing. In the follow-up group, the eradication failure rate was 8.2%. Female sex (odds ratio [OR] 2.41 [95% CI 1.16-5.03], p = 0.02) and age-CCI ≥2 (OR 3.16 [1.05-9.48], p = 0.04) were independent factors of H. pylori eradication failure. The eradication failure rates were 14.4%, 7.8%, 7.1%, and 3.1% for the females with age-CCI ≥2, females with age-CCI <2, males with age-CCI ≥2, and males with age-CCI <2 subgroups, respectively (p = 0.027).

CONCLUSIONS

In a real-world setting, the adherence rate of post-treatment testing for sequential therapy as a first-line anti-H. pylori treatment was found to be suboptimal. Female sex and age-CCI ≥2 were independent factors of eradication failure.

Recent advancement in integrating artificial intelligence and information technology with real-world data for clinical decision-making in China: A scoping review

OBJECTIVE

Striking innovations and advancements have been achieved with the use of artificial intelligence and healthcare information technology being integrated into clinical real-world data. The current scoping review aimed to provide an overview of the current status of artificial intelligence-/information technology-based clinical decision support tools in China.

METHODS

PubMed/MEDLINE, Embase, China National Knowledge Internet, and Wanfang data were searched for both English and Chinese literature. The gray literature search was conducted for commercially available tools. Original studies that focused on clinical decision support tools driven by artificial intelligence or information technology in China and were published between 2010 and February 2022 were included. Information extracted from each article was further synthesized by themes based on three types of clinical decision-making.

RESULTS

A total of 37 peer-reviewed publications and 13 commercially available tools were included in the final analysis. Among them, 32.0% were developed for disease diagnosis, 54.0% for risk prediction and classification, and 14.0% for disease management. Chronic diseases were the most popular therapeutic areas of exploration, with particular emphasis on cardiovascular and cerebrovascular diseases. Single-center electronic medical records were the mainstream data sources leveraged to inform clinical decision-making, with internal validation being predominately used for model evaluation.

CONCLUSIONS

To effectively promote the extensive use of real-world data and drive a paradigm shift in clinical decision-making in China, multidisciplinary collaboration of key stakeholders is urgently needed.

DAPA-HF applicability: the point of view of a cardiology setting

Randomised clinical trials, observational studies, and meta-analyses have shown that sodium-glucose cotransporter 2 inhibitors (SGLT2-i) reduce the risk of hospitalisation for heart failure (HF), chronic kidney disease (CKD) progression, and mortality in patients with HF, irrespective of the presence of type 2 diabetes mellitus. However, real-world epidemiology may differ from clinical trial populations, thereby limiting generalisability and delaying the introduction of novel treatments in clinical practice.The aim of the present study was to assess the prevalence of DAPA-HF (Dapagliflozin and Prevention of Adverse Outcomes in Heart Failure) inclusion criteria in a population of HF with reduced ejection fraction (HFrEF) patients enrolled in the Italian Network on Heart Failure (IN-HF) registry.Overall, 3415 IN-HF patients matched the 4744 patients in DAPA-HF, overlapping for most baseline characteristics (e.g. similar average ejection fraction), with a slightly lower prevalence of type 2 diabetes and of HF ischaemic aetiology and a higher percentage of NYHA class II patients. The theoretical eligibility to DAPA-HF in a cardiology setting resulted to be 73%.The availability of an easily accessible database from a large nationwide prospective registry allows to provide insights to clinicians and policy makers on the applicability of the DAPA HF findings to a contemporary population of HFrEF patients followed by cardiologists. It is reasonable to assume that the results of this analysis can be applicable to the entire SGLT2-ir class of drugs.

Lorlatinib Effectiveness and Quality-of-Life in Patients with ALK-Positive NSCLC Who Had Failed Second-Generation ALK Inhibitors: Canadian Real-World Experience

Lorlatinib is the only targeted therapy approved in Canada to treat patients with anaplastic lymphoma kinase (ALK)-positive non-small cell lung cancer (NSCLC) whose tumor has progressed despite treatment with second-generation ALK tyrosine kinase inhibitor (TKI), a patient population with high unmet need and lack of publicly reimbursed targeted treatments in Canada. We prospectively examined the real-world effectiveness and impact of lorlatinib on quality-of-life in 59 lorlatinib-treated patients, characterized as: median age of 62.0 years; 47.5% were female; 32.2% had central nervous system metastases; 50.8% had 2+ prior ALK TKI lines; and alectinib was the most common ALK TKI (72.9%) administered before lorlatinib, including 44.1% who received first-line alectinib. With a median follow-up of 15.3 months (IQR: 6.2-19.2), median time-to-treatment discontinuation of lorlatinib was 15.3 months (95% CI: 7.9-not reached), with 54.2% (95% CI: 40.8-65.9%) of patients without treatment discontinuation at 12 months. At baseline, the mean health utility score (HUS) was 0.744 (SD: 0.200). At 3 months, patients receiving lorlatinib demonstrated a 0.069 (95% CI: 0.020-0.118; p = 0.007) average HUS increase over baseline; HUS was maintained at 6 and 12 months. Thus, patients with ALK-positive NSCLC post second-generation ALK TKI remained on lorlatinib for a meaningful duration of time while their quality-of-life was preserved.

Generating fit-for-purpose real-world evidence in Asia: How far are we from closing the gaps?

Evidence generated by randomized controlled trials (RCTs) does not often represent the patient journey and clinical outcomes in the real world due to limited external validity or generalizability. Studies based on real-world data are intended to generalize results to the broader population; however, if the influence of external factors or confounders is not effectively managed, the cause-and-effect relationship and internal validity may be challenged, resulting in flawed results. The collection of quality real-world evidence (RWE) is crucial in Asia as there is often an underrepresentation of Asian populations in RCTs. In addition, few countries in Asia are catching up with the Western world in issuing practical foundational principles and guidance for conducting and adopting evidence for regulatory and reimbursement decisions. However, privacy and data protection laws are generally lagging behind technological developments in electronic medical records. While leveraging RWE in clinical and regulatory decision-making holds excellent potential, collective efforts across industry, governments, and research institutions are required for generating standardized practices and building capabilities for developing fit-for-purpose RWE in Asia.

Improvement in patient-reported outcomes and work productivity following 3-year ustekinumab or tumour necrosis factor inhibitor treatment in patients with psoriatic arthritis: results from the PsABio real-world study

BACKGROUND

To evaluate the real-world effect of the IL-12/23 inhibitor ustekinumab or of a tumour necrosis factor inhibitor (TNFi) on patient-reported outcomes (PRO) and their association with effectiveness endpoints in psoriatic arthritis (PsA) patients over 3 years.

METHODS

In PsABio (NCT02627768), a prospective, observational study, patients with PsA that were prescribed first- to third-line ustekinumab or a TNFi, and remained on that drug for 3 years, were analysed for change in baseline in PROs (EuroQol-5 dimensions health state VAS [EQ-5D VAS], 12-item Psoriatic Arthritis Impact of Disease questionnaire [PsAID-12; range 0-10], Work Productivity and Activity Impairment for Psoriatic Arthritis questionnaire [WPAI; results expressed as a percentage for each domain]), and the association between PROs and WPAI with effectiveness endpoints, clinical disease activity index for psoriatic arthritis (cDAPSA), low disease activity (LDA)/remission, minimal disease activity (MDA) and very low disease activity (VLDA).

RESULTS

In 437 patients (mean age 49.1 years, 47.8% female), at 3 years, ustekinumab and TNFi treatment led to comparable improvements in EQ-5D VAS; mean change from baseline (95% confidence intervals [CI]) was 11.0 (6.5; 15.4) and 18.9 (14.0; 23.9), respectively. Both groups improved PsAID-12 after 3 years; mean change from baseline (95% CI) was -2.9 (-3.2; -2.5) and -3.5 (-3.9; -3.2), respectively. At baseline, due to their PsA, TNFi-treated patients had lower work productivity compared to ustekinumab-treated patients; mean productivity reduction (95% CI) was 58.8 [52.4; 65.2] and 43.3 [35.6; 51.1]. Over 3 years, TNFi-treated patients had a greater improvement in work productivity compared to ustekinumab-treated patients, ultimately leaving work productivity to be comparable between groups; mean improvement (95% CI) was 44.5% (38.4; 50.6) and 24.9% (15.8; 34.0), respectively. A similar trend was observed in activity impairment. Patients in both treatment groups who achieved effectiveness endpoints, cDAPSA LDA/remission, MDA, and VLDA had greater improvement in PROs and WPAI than patients who did not achieve these endpoints.

CONCLUSIONS

At 3 years, improvements in PROs following ustekinumab or TNFi treatment were generally comparable; however, TNFi-treated patients achieved a greater improvement in work productivity, although this group started from a lower baseline. Achievement of effectiveness endpoints, independent of treatment group, also improved PROs.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT02627768. Registered on 11 December 2015.

Development of a standard set of PROs and generic PROMs for Dutch medical specialist care : Recommendations from the Outcome-Based Healthcare Program Working Group Generic PROMs

PURPOSE

The added value of measuring patient-reported outcomes (PROs) for delivering patient-centered care and assessment of healthcare quality is increasingly evident. However, healthcare system wide data collection initiatives are hampered by the proliferation of patient-reported outcome measures (PROMs) and conflicting data collection standards. As part of a national initiative of the Dutch Ministry of Health, Welfare and Sport we developed a consensus-based standard set of generic PROs and PROMs to be implemented across Dutch medical specialist care.

METHODS

A working group of mandated representatives of umbrella organizations involved in Dutch medical specialist care, together with PROM experts and patient organizations worked through a structured, consensus-driven co-creation process. This included literature reviews, online expert and working group meetings, and feedback from national patient- and umbrella organizations. The 'PROM-cycle' methodology was used to select feasible, valid, and reliable PROMs to obtain domain scores for each of the PROs included in the set.

RESULTS

Eight PROs across different domains of health were ultimately endorsed: symptoms (pain & fatigue), functioning (physical, social/participation, mental [anxiety & depression]), and overarching (quality of life & perceived overall health). A limited number of generic PROMs was endorsed. PROMIS short forms were selected as the preferred instruments for all PROs. Several recommendations were formulated to facilitate healthcare system level adoption and implementation of the standard set.

CONCLUSIONS

We developed a consensus-based standard set of Generic PROMs and a set of recommendations to facilitate healthcare system wide implementation across Dutch medical specialist care.

Exploring uncertainty and use of real-world data in the National Institute for Health and Care Excellence single technology appraisals of targeted cancer therapy

OBJECTIVES

Dealing with uncertainty is one of the critical topics in health technology assessment. The greater decision uncertainty in appraisals, the less clear the clinical- and cost-effectiveness of the health technology. Although the development of targeted cancer therapies (TCTs) has improved patient health care, additional complexity has been introduced in drug appraisals due to targeting more specific populations. Real-world data (RWD) are expected to provide helpful information to fill the evidence gaps in appraisals. This study compared appraisals of TCTs with those of non-targeted cancer therapies (non-TCTs) regarding sources of uncertainty and reviewed how RWD have been used to supplement the information in these appraisals.

METHODS

This study reviews single technology appraisals (STAs) of oncology medicines performed by the National Institute for Health and Care Excellence (NICE) over 11 years up to December 2021. Three key sources of uncertainty were identified for comparison (generalisability of clinical trials, availability of direct treatment comparison, maturity of survival data in clinical trials). To measure the intensity of use of RWD in appraisals, three components were identified (overall survival, volume of treatment, and choice of comparators).

RESULTS

TCTs received more recommendations for provision through the Cancer Drugs Fund (27.7, 23.6% for non-TCT), whereas similar proportions were recommended for routine commissioning. With respect to sources of uncertainty, the external validity of clinical trials was greater in TCT appraisals (p = 0.026), whereas mature survival data were available in fewer TCT appraisals (p = 0.027). Both groups showed similar patterns of use of RWD. There was no clear evidence that RWD have been used more intensively in appraisals of TCT.

CONCLUSIONS

Some differences in uncertainty were found between TCT and non-TCT appraisals. The appraisal of TCT is generally challenging, but these challenges are neither new nor distinctive. The same sources of uncertainty were often found in the non-TCT appraisals. The uncertainty when appraising TCT stems from insufficient data rather than the characteristics of the drugs. Although RWD might be expected to play a more active role in appraisals of TCT, the use of RWD has generally been limited.

Natural History and Real‐World Data in Rare Diseases: Applications, Limitations, and Future Perspectives

Rare diseases represent a highly heterogeneous group of disorders with high phenotypic and genotypic diversity within individual conditions. Due to the small numbers of people affected, there are unique challenges in understanding rare diseases and drug development for these conditions, including patient identification and recruitment, trial design, and costs. Natural history data and real-world data (RWD) play significant roles in defining and characterizing disease progression, final patient populations, novel biomarkers, genetic relationships, and treatment effects. This review provides an introduction to rare diseases, natural history data, RWD, and real-world evidence, the respective sources and applications of these data in several rare diseases. Considerations for data quality and limitations when using natural history and RWD are also elaborated. Opportunities are highlighted for cross-sector collaboration, standardized and high-quality data collection using new technologies, and more comprehensive evidence generation using quantitative approaches such as disease progression modeling, artificial intelligence, and machine learning. Advanced statistical approaches to integrate natural history data and RWD to further disease understanding and guide more efficient clinical study design and data analysis in drug development in rare diseases are also discussed.

Post-marketing safety of immunomodulatory drugs in multiple myeloma: A pharmacovigilance investigation based on the FDA adverse event reporting system

Objective: In recent years, the emergence of immunomodulatory drugs (IMiDs) has significantly improved clinical outcomes in patients with multiple myeloma (MM); however, serious adverse events (AEs) have hindered their safe clinical application. This study aimed to characterize the safety profiles and differences in IMiDs through a disproportionality analysis using the U.S. Food and Drug Administration Adverse Event Reporting System (FAERS), a post-marketing surveillance database. Methods: This study filtered reports of thalidomide, lenalidomide, and pomalidomide as primary suspect drugs in FAERS files from January 2013 to December 2021. AEs in the reports were retrieved according to the preferred terms (PTs) of the Medical Dictionary for Regulatory Activities. Furthermore, we detected safety signals using the reporting odds ratio (ROR), proportional reporting ratio (PRR), and Bayesian belief propagation neural network (BCPNN). When all three algorithms showed an association between the target drug and the AE, a positive signal was generated. Results: We extracted 9,968 thalidomide, 231,926 lenalidomide, and 55,066 pomalidomide AE reports. AEs were more common in male patients and in those >44 years old. Important safety signals were detected based on the system organ classes (SOC), including thalidomide (cardiac disorders: ROR, 2.87; PRR, 2.79; IC 1.22), lenalidomide (gastrointestinal disorders: ROR, 2.38; PRR, 2.27; IC 0.75), and pomalidomide (respiratory, thoracic, and mediastinal disorders: ROR, 2.14; PRR, 2.09; IC 0.85). Within the PT level, we identified novel risk signals: the thalidomide-induced second primary malignancy (SPM) signal was significant; lenalidomide reduced the success rate of hematopoietic stem cell collection; and three IMiDs may cause human chorionic gonadotropin increase, but this needs to be proven by clinical data. Pneumonia, sepsis, and renal failure are common risk factors for death due to IMiDs. Compared with thalidomide and lenalidomide, pomalidomide has a lower risk of venous thromboembolism (VTE) and is beneficial to patients with renal insufficiency. Conclusion: Mining data from FAERS resulted in novel AE signals, including adenocarcinoma of colon, harvest failure of blood stem cells, and increased levels of human chorionic gonadotropin. Further investigation is required to verify the significance of these signals. Moreover, IMiDs showed differences in safety reports, which should be emphasized by clinicians.

Medication Use and Clinical Outcomes by the Dutch Institute for Clinical Auditing Medicines Program: Quantitative Analysis

BACKGROUND

The Dutch Institute for Clinical Auditing (DICA) Medicines Program was set up in September 2018 to evaluate expensive medicine use in daily practice in terms of real-world effectiveness using only existing data sources.

OBJECTIVE

The aim of this study is to describe the potential of the addition of declaration data to quality registries to provide participating centers with benchmark information about the use of medicines and outcomes among patients.

METHODS

A total of 3 national population-based registries were linked to clinical and financial data from the hospital pharmacy, the Dutch diagnosis treatment combinations information system including in-hospital activities, and survival data from health care insurers. The first results of the real-world data (RWD) linkage are presented using descriptive statistics to assess patient, tumor, and treatment characteristics. Time-to-next-treatment (TTNT) and overall survival (OS) were estimated using the Kaplan-Meier method.

RESULTS

A total of 21 Dutch hospitals participated in the DICA Medicines Program, which included 7412 patients with colorectal cancer, 1981 patients with metastasized colon cancer, 3860 patients with lung cancer, 1253 patients with metastasized breast cancer, and 7564 patients with rheumatic disease. The data were used for hospital benchmarking to gain insights into medication use in specific patient populations, treatment information, clinical outcomes, and costs. Detailed treatment information (duration and treatment steps) led to insights into differences between hospitals in daily clinical practices. Furthermore, exploratory analyses on clinical outcomes (TTNT and OS) were possible.

CONCLUSIONS

The DICA Medicines Program shows that it is possible to gather and link RWD about medicines to 4 disease-specific population-based registries. Since these RWD became available with minimal registration burden and effort for hospitals, this method can be explored in other population-based registries to evaluate real-world efficacy.

Real-world studies: bridging the gap between trial-assessed efficacy and routine care

Even though randomized controlled clinical trials (RCTs) have been accepted as the gold standard for official assessment of novel interventions, there is a substantial gap between the efficacy observed in RCTs and the impact on clinical practice and in terms of patient benefit. While real-world studies (RWS) are emerging to confer valuable complementing evidence in this regard and beyond, the evolving role of RWS is yet to be agreed. This article delineates an updated profile of RWS covering effectiveness verification, rare adverse effects discovery, indication repurposing, to name a few. RWS tends not only to improve the efficiency of clinical investigations for regulatory approval, but also optimizes the whole-life cycle evaluation of biomedical/pharmaceutical products.

NeuroBlu, an electronic health record (EHR) trusted research environment (TRE) to support mental healthcare analytics with real-world data

PURPOSE

NeuroBlu is a real-world data (RWD) repository that contains deidentified electronic health record (EHR) data from US mental healthcare providers operating the MindLinc EHR system. NeuroBlu enables users to perform statistical analysis through a secure web-based interface. Structured data are available for sociodemographic characteristics, mental health service contacts, hospital admissions, International Classification of Diseases ICD-9/ICD-10 diagnosis, prescribed medications, family history of mental disorders, Clinical Global Impression-Severity and Improvement (CGI-S/CGI-I) and Global Assessment of Functioning (GAF). To further enhance the data set, natural language processing (NLP) tools have been applied to obtain mental state examination (MSE) and social/environmental data. This paper describes the development and implementation of NeuroBlu, the procedures to safeguard data integrity and security and how the data set supports the generation of real-world evidence (RWE) in mental health.

PARTICIPANTS

As of 31 July 2021, 562 940 individuals (48.9% men) were present in the data set with a mean age of 33.4 years (SD: 18.4 years). The most frequently recorded diagnoses were substance use disorders (1 52 790 patients), major depressive disorder (1 29 120 patients) and anxiety disorders (1 03 923 patients). The median duration of follow-up was 7 months (IQR: 1.3 to 24.4 months).

FINDINGS TO DATE

The data set has supported epidemiological studies demonstrating increased risk of psychiatric hospitalisation and reduced antidepressant treatment effectiveness among people with comorbid substance use disorders. It has also been used to develop data visualisation tools to support clinical decision-making, evaluate comparative effectiveness of medications, derive models to predict treatment response and develop NLP applications to obtain clinical information from unstructured EHR data.

FUTURE PLANS

The NeuroBlu data set will be further analysed to better understand factors related to poor clinical outcome, treatment responsiveness and the development of predictive analytic tools that may be incorporated into the source EHR system to support real-time clinical decision-making in the delivery of mental healthcare services.

Adherence to and persistence with antidiabetic medications and associations with clinical and economic outcomes in people with type 2 diabetes mellitus: A systematic literature review

We designed a systematic literature review to identify available evidence on adherence to and persistence with antidiabetic medication in people with type 2 diabetes (T2D). Electronic screening and congress searches identified real-world noninterventional studies (published between 2010 and October 2020) reporting estimates of adherence to and persistence with antidiabetic medication in adults with T2D, and associations with glycaemic control, microvascular and/or macrovascular complications, hospitalizations and healthcare costs. Ninety-two relevant studies were identified, the majority of which were retrospective and reported US data. The proportions of patients considered adherent (median [range] 51.2% [9.4%-84.3%]) or persistent (median [range] 47.7% [16.9%-94.0%]) varied widely across studies. Multiple studies reported an association between greater adherence/persistence and greater reductions in glycated haemoglobin levels. Better adherence/persistence was associated with fewer microvascular and/or macrovascular outcomes, although there was little consistency across studies in terms of which outcomes were improved. More adherent and more persistent patients were typically less likely to be hospitalized or to have emergency department visits/admissions and spent fewer days in hospital annually than less adherent/persistent patients. Greater adherence and persistence were generally associated with lower hospitalization costs, higher pharmacy costs and lower or budget-neutral total healthcare costs compared with lower adherence/persistence. In conclusion, better adherence and persistence in people with T2D is associated with lower rates of microvascular and/or macrovascular outcomes and inpatient hospitalization, and lower or budget-neutral total healthcare expenditure. Education and treatment strategies to address suboptimal adherence and persistence are needed to improve clinical and economic outcomes.

Assessing Payers' Preferences for Real-World Evidence in the United States: A Discrete Choice Experiment

OBJECTIVES

To rank the US payers' preferences for attributes of real-world evidence (RWE) studies in the context of chronic disease and to quantify trade-offs among them.

METHODS

We conducted a discrete choice experiment in which 180 employees from payer organizations were tasked to choose between 2 RWE studies assuming they were assessing evidence to inform formulary decisions for chronic disease treatment. Each RWE study was characterized by 7 attributes with 3 levels each: very informative, moderately informative, and not measured. We used a D-optimal main-effects design. Survey data were fitted to a conditional logit model to obtain a relative measure of the ranking of importance for each attribute.

RESULTS

Clinical outcomes were the most preferred attribute. It was 4.68 times as important as productivity outcomes-the least preferred attribute. It was followed by health-related quality of life (2.78), methodologic rigor (2.09), resource utilization (1.71), and external validity (1.56).

CONCLUSIONS

This study provides a quantification of the value payers place on key RWE attributes. Across attributes, payers have higher preferences for clinical and health-related quality of life outcomes than the other attributes. Between attributes' levels, payers prefer high levels of information in clinical outcomes and methodologic rigor but are indifferent in other attributes. Our results bridge the gap between the information that payers seek and the attributes that RWE studies prioritize and effectively guide future research design.

Preventive effect of rebamipide on NSAID-induced lower gastrointestinal tract injury using FAERS and JADER

Non-steroidal anti-inflammatory drugs (NSAIDs) are widely used for their antipyretic, analgesic, and anti-inflammatory properties. However, various aspects of NSAID-induced lower gastrointestinal tract injury remain unclear, and effective prophylaxis has not been established. Based on its pharmacological effect and clinical trials, rebamipide may prevent lower gastrointestinal tract injury, although this evidence is limited by the small scale of trials. The present study used the FDA Adverse Event Reporting System (FAERS) and the Japanese Adverse Event Reporting Database (JADER) to assess the efficacy of rebamipide in combination with loxoprofen and diclofenac in preventing NSAID-induced lower gastrointestinal tract injury. The calculated reporting odds ratio and 95% confidence interval (CI) for rebamipide in combination with loxoprofen and diclofenac were 1.15 (95% CI 0.88–1.51) and 1.28 (95% CI 0.82–2.01) for FAERS, and 0.50 (95% CI 0.35–0.71) and 0.43 (95% CI 0.27–0.67) for JADER, respectively. No signal was detected when combining drugs. These results suggest a prophylactic effect of rebamipide on NSAID-induced lower gastrointestinal tract injury.

Protocol for data extraction: how real-world data have been used in the National Institute for Health and Care Excellence appraisals of cancer therapy

INTRODUCTION

Due to the limitations of relying on randomised controlled trials, the potential benefits of real-world data (RWD) in enriching evidence for health technology assessment (HTA) are highlighted. Despite increased interest in RWD, there is limited systematic research investigating how RWD have been used in HTA. The main purpose of this protocol is to extract relevant data from National Institute for Health and Care Excellence (NICE) appraisals in a transparent and reproducible manner in order to determine how NICE has incorporated a broader range of evidence in the appraisal of oncology medicines.

METHODS AND ANALYSIS

The appraisals issued between January 2011 and May 2021 are included following inclusion criteria. The data extraction tool newly developed for this research includes the critical components of economic evaluation. The information is extracted from identified appraisals in accordance with extraction rules. The data extraction tool will be validated by a second researcher independently. The extracted data will be analysed quantitatively to investigate to what extent RWD have been used in appraisals. This is the first protocol to enable data to be extracted comprehensively and systematically in order to review the use of RWD.

ETHICS AND DISSEMINATION

This study is approved by the Ethics Committee of the London School of Hygiene and Tropical Medicine on 14 November 2019 (17315). Results will be published in peer-reviewed journals.

The value of real world evidence: The case of medical cannabis

Randomised controlled trials (RCTs) have long been considered the gold standard of medical evidence. In relation to cannabis based medicinal products (CBMPs), this focus on RCTs has led to very restrictive guidelines in the UK, which are limiting patient access. There is general agreement that RCT evidence in relation to CBPMs is insufficient at present. As well as commercial reasons, a major problem is that RCTs do not lend themselves well to the study of whole plant medicines. One solution to this challenge is the use of real world evidence (RWE) with patient reported outcomes (PROs) to widen the evidence base. Such data increasingly highlights the positive impact medical cannabis can have on patients' lives. This paper outlines the value of this approach which involves the study of interventions and patients longitudinally under medical care. In relation to CBMPs, RWE has a broad range of advantages. These include the study of larger groups of patients, the use of a broader range and ratio of components of CBMPs, and the inclusion of more and rarer medical conditions. Importantly, and in contrast to RCTs, patients with significant comorbidities-and from a wider demographic profile-can also be studied, so providing higher ecological validity and increasing patient numbers, whilst offering significant cost savings. We conclude by outlining 12 key recommendations of the value of RWE in relation to medical cannabis. We hope that this paper will help policymakers and prescribers understand the importance of RWE in relation to medical cannabis and help them develop approaches to overcome the current situation which is detrimental to patients.

Assessment of Alectinib vs Ceritinib in ALK-Positive Non-Small Cell Lung Cancer in Phase 2 Trials and in Real-world Data

IMPORTANCE

Quantitative assessment of bias from unmeasured confounding and missing data can help evaluate uncertainty in findings from indirect comparisons using real-world data (RWD).

OBJECTIVE

To compare the effectiveness of alectinib vs ceritinib in terms of overall survival (OS) in patients with ALK-positive, crizotinib-refractory, non-small cell lung cancer (NSCLC) and to assess the sensitivity of these findings to unmeasured confounding and missing data assumptions.

DESIGN, SETTING, AND PARTICIPANTS

This comparative effectiveness research study compared patients from 2 phase 2 alectinib trials and real-world patients. Patients were monitored from June 2013 to March 2020. Comparisons of interest were between alectinib trial data vs ceritinib RWD and alectinib RWD vs ceritinib RWD. RWD treatment groups were selected from nationally representative cancer data from US cancer clinics, the majority from community centers. Participants were ALK-positive patients aged 18 years or older with advanced NSCLC, prior exposure to crizotinib, and Eastern Cooperative Oncology Group Performance Status (PS) of 0 to 2. Data analysis was performed from October 2020 to March 2021.

EXPOSURES

Initiation of alectinib or ceritinib therapy.

MAIN OUTCOMES AND MEASURES

The main outcome was OS.

RESULTS

In total, there were 355 patients: 183 (85 men [46.4%]) in the alectinib trial, 91 (43 men [47.3%]) in the ceritinib RWD group, and 81 (38 men [46.9%]) in the alectinib RWD group. Patients in the alectinib trial were younger (mean [SD] age, 52.53 [11.18] vs 57.97 [11.71] years), more heavily pretreated (mean [SD] number of prior therapy lines, 1.95 [0.72] vs 1.47 [0.81]), and had more favorable baseline ECOG PS (ECOG PS of 0 or 1, 165 patients [90.2%] vs 37 patients [77.1%]) than those in the ceritinib RWD group. The alectinib RWD group (mean [SD] age, 58.69 [11.26] years) had more patients with favorable ECOG PS (ECOG PS of 0 or 1, 49 patients [92.4%] vs 37 patients [77.1%]) and more White patients (56 patients [72.7%] vs 53 patients [62.4%]) compared with the ceritinib group. Compared with ceritinib RWD, alectinib-exposed patients had significantly longer OS in alectinib trials (adjusted hazard ratio [HR], 0.59; 95% CI, 0.44-0.75; P < .001) and alectinib RWD (HR, 0.46; 95% CI, 0.29-0.63; P < .001) after adjustment for baseline confounders. For the worst-case HR estimate of 0.59, residual confounding by a hypothetical confounder associated with mortality and treatment by a risk ratio greater than 2.24 was required to reverse the findings. Conclusions were robust to plausible deviations from random missingness for missing ECOG PS and underrecorded comorbidities and central nervous system metastases in RWD.

CONCLUSIONS AND RELEVANCE

Alectinib exposure was associated with longer OS compared with ceritinib in patients with ALK-positive NSCLC, and only substantial levels of bias examined reversed the findings. These findings suggest that quantitative bias analysis can be a useful tool to address uncertainty of findings for decision-makers considering RWD.

Real-World Treatment Patterns and Overall Survival of Patients with Metastatic Castration-Resistant Prostate Cancer in the US Prior to PARP Inhibitors

Introduction

Therapeutic options for metastatic castration-resistant prostate cancer (mCRPC) patients are continuously advancing. We described mCRPC treatment patterns in the US from 2013 to 2019.

Methods

Patients with a confirmed mCRPC diagnosis and adenocarcinoma histology were included in the US Flatiron Health Electronic Health Record-derived de-identified database. Treatment patterns [including treatment per lines of therapies (LOTs), LOT sequences, and time on treatment] and overall survival (OS) have been described in mCRPC settings.

Results

Of 5213 patients (mean age: 72.6 years), 4374 (83.9%) were treated with ≥ 1 LOT post-mCRPC diagnosis (among those with ≥ 1 LOT, 55.3%, 29.5%, 14.7%, and 6.7% had ≥ 2, 3, 4, and 5 LOTs, respectively). In first line (1L), the main treatment class was next-generation hormonal agents (NHA; 62.5% of patients with ≥ 1 LOT), while the shortest and longest time on 1L were observed for chemotherapy (median 2.8 months) and NHA (median 5.1 months), respectively. The most common LOT sequences were NHA → NHA (29.4% of patients with ≥ 2 LOTs) and NHA → NHA → chemotherapy (16.7% of patients with ≥ 3 LOTs). In Kaplan–Meier analyses, the median OS was 19.4, 14.6, and 11.1 months post-1L, 2L, and 3L start, respectively. Patients who moved rapidly through LOTs had an increased risk of death.

Conclusions

NHA were widely used as 1L therapy in mCRPC patients from 2013 to 2019, but time on 1L NHA treatment was on average < 6 months. While NHA → NHA was the most observed 1L → 2L LOT sequence, a plethora of other LOT sequences were observed. OS was poor, highlighting an unmet need for life-prolonging treatments.

Supplementary Information

The online version contains supplementary material available at 10.1007/s12325-021-01823-6.

Clinical Effectiveness and Safety of Once-Weekly GLP-1 Receptor Agonist Dulaglutide as Add-On to Metformin or Metformin Plus Insulin Secretagogues in Obesity and Type 2 Diabetes

AIMS AND METHODS

The aim of this monocentric retrospective observational study was to evaluate the 18-month safety and effectiveness of GLP-1 receptor agonist (GLP-1 RA) dulaglutide (DU) 1.5 mg/once weekly as an add-on to metformin (MET) or MET plus conventional insulin secretagogues in a study cohort with excess body weight and type 2 diabetes (T2D). Comparative efficacy versus liraglutide (LIRA) 1.2-1.8 mg/once daily in a study sample naïve to GLP-1 RAs, frequency matching for age, gender, T2D duration, degree of glycemic impairment, cardiovascular comorbidities, and medications, was addressed as a secondary aim. Clinical and biochemical data for efficacy outcomes and information on drug discontinuation due to adverse events (AEs) were collected from digital records.

RESULTS

Initial analysis included 126 overweight and obese T2D patients (48.4% females). Out of these, 13 discontinued DU due to moderate-severe gastrointestinal AEs after a mean follow-up of 6 (4 standard deviations (SD)) months, while 65 completed 18 months of continuous therapy. At 6 months, there was a significant mean HbA1c reduction of -0.85% (1.17 SD) with respect to baseline values (p < 0.001), which remained stable during 18 months follow-up. These results were accompanied by a moderate weight loss sustained over time, with a mean reduction of -2.0% (4.3 SD) at 6 months and -1.3% (4.8 SD) at 18 months (p = 0.091). At univariate analysis, a negative correlation between baseline body mass index (BMI) and risk of drug discontinuation due to gastrointestinal AEs was observed. The protective effect of obesity against drug discontinuation was confirmed by logistic regression analysis. Neither gender, nor age, nor T2D duration, nor concomitant conventional insulin secretagogue use, nor switching to DU from other GLP-1 RAs influenced its long-term effectiveness. However, higher baseline HbA1c values emerged as predictors of clinically relevant efficacy outcomes, either in terms of HbA1c reduction ≥ 0.5% or body weight loss ≥ 5%. The efficacy outcomes were corroborated by head-to-head comparison with LIRA, a GLP-1 RA with durable beneficial effects on glycemic control and body weight in real-world experiences. With the advantage of once-weekly administration, at 18-month follow-up, a significantly larger fraction of patients on DU therapy reached glycemic targets (HbA1c ≤ 7.0%) when compared to those on LIRA: from 14.8% at baseline (both groups) to 64.8% with DU and 42.6% with LIRA (p = 0.033).

CONCLUSIONS

Although limited by a retrospective design and lack of constant up-titration for LIRA to the highest dose, these findings indicate that the beneficial responses to DU on a background of MET or MET plus insulin secretagogues are durable, especially in the presence of obesity and greater HbA1c impairment.