When Can We Trust Real-World Data To Evaluate New Medical Treatments?

Real-World Research on Retinal Diseases Using Health Claims Database: A Narrative Review

Real-world data (RWD) has emerged as a crucial component in understanding and improving patient outcomes across various medical conditions, including retinal diseases. Health claims databases, generated from healthcare reimbursement claims, offer a comprehensive source of RWD, providing insights into patient outcomes, healthcare utilization, and treatment effectiveness. However, the use of these databases for research also presents unique challenges. This narrative review explores the role of real-world research on retinal diseases using health claims databases, highlighting their advantages, limitations, and potential contributions to advancing our understanding and management of the diseases. The review examines the applications of health claims databases in retinal disease research, including epidemiological studies, comparative effectiveness and safety analyses, economic burden assessments, and evaluations of patient outcomes and quality of care. Previous findings demonstrate the value of these databases in generating prevalence and incidence estimates, identifying risk factors and predictors, evaluating treatment effectiveness and safety, and understanding healthcare utilization patterns and costs associated with retinal diseases. Despite their strengths, health claims databases face challenges related to data limitations, biases, privacy concerns, and methodological issues. Accordingly, the review also explores future directions and opportunities, including advancements in data collection and analysis, integration with electronic health records, collaborative research networks and consortia, and the evolving regulatory landscape. These developments are expected to enhance the utility of health claims databases for retinal disease research, resulting in more comprehensive and impactful findings across diverse retinal disorders and robust real-world insights from a large population.

Evaluating cardiac lead safety using observational, real-world data: EP PASSION proof-of-concept study

BACKGROUND

Traditional post-approval study (PAS) designs have been accepted by regulatory authorities to fulfill postmarketing requirements for cardiac leads, but they have several limitations.

OBJECTIVE

We conducted a proof-of-concept study of alternative methods that use real-world data (RWD) to evaluate lead safety in large populations of patients.

METHODS

Abbott patient device databases were linked with Medicare Fee-For-Service (FFS) claims to identify lead complications in patients implanted with Abbott Optisure lead. A 1:1 comparison between the PAS method and RWD method of detecting mechanical lead-related complication events was conducted in 444 PAS participants who were enrolled in Medicare FFS. Agreement between methods was evaluated by McNemar test and Cohen κ. Survival free from complications at 3 years was compared between the PAS and RWD cohorts with an equivalence acceptance criterion of ±2.5%.

RESULTS

There were 1171 PAS patients and 5804 Medicare FFS patients who received an Optisure lead between August 27, 2014, and June 14, 2016. Patients were observed through December 31, 2018. Complete agreement was found between PAS-reported and claims-detected complications (McNemar P value = 1; Cohen κ = 1). Survival free from complications at 3 years by the RWD method was 98.4% (95% confidence limit, 98.0%-98.7%), which was within the acceptable range of the PAS 98.4% (95% confidence limit, 97.6%-99.0%).

CONCLUSION

These results show a close agreement between RWD-detected and PAS-reported lead complication rates, which highlights the potential benefits of RWD-based methods to enhance the generation of clinical evidence for lead safety.

Suitability of the Current Health Technology Assessment of Innovative Artificial Intelligence-Based Medical Devices: Scoping Literature Review

BACKGROUND

Artificial intelligence (AI)-based medical devices have garnered attention due to their ability to revolutionize medicine. Their health technology assessment framework is lacking.

OBJECTIVE

This study aims to analyze the suitability of each health technology assessment (HTA) domain for the assessment of AI-based medical devices.

METHODS

We conducted a scoping literature review following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology. We searched databases (PubMed, Embase, and Cochrane Library), gray literature, and HTA agency websites.

RESULTS

A total of 10.1% (78/775) of the references were included. Data quality and integration are vital aspects to consider when describing and assessing the technical characteristics of AI-based medical devices during an HTA process. When it comes to implementing specialized HTA for AI-based medical devices, several practical challenges and potential barriers could be highlighted and should be taken into account (AI technological evolution timeline, data requirements, complexity and transparency, clinical validation and safety requirements, regulatory and ethical considerations, and economic evaluation).

CONCLUSIONS

The adaptation of the HTA process through a methodological framework for AI-based medical devices enhances the comparability of results across different evaluations and jurisdictions. By defining the necessary expertise, the framework supports the development of a skilled workforce capable of conducting robust and reliable HTAs of AI-based medical devices. A comprehensive adapted HTA framework for AI-based medical devices can provide valuable insights into the effectiveness, cost-effectiveness, and societal impact of AI-based medical devices, guiding their responsible implementation and maximizing their benefits for patients and health care systems.

Tactical Considerations for Designing Real-World Studies: Fit-for-Purpose Designs That Bridge Research and Practice

Real-world evidence (RWE) is being used to provide information on diverse groups of patients who may be highly impacted by disease but are not typically studied in traditional randomized clinical trials (RCT) and to obtain insights from everyday care settings and real-world adherence to inform clinical practice. RWE is derived from so-called real-world data (RWD), ie, information generated by clinicians in the course of everyday patient care, and is sometimes coupled with systematic input from patients in the form of patient-reported outcomes or from wearable biosensors. Studies using RWD are conducted to evaluate how well medical interventions, services, and diagnostics perform under conditions of real-world use, and may include long-term follow-up. Here, we describe the main types of studies used to generate RWE and offer pointers for clinicians interested in study design and execution. Our tactical guidance addresses (1) opportunistic study designs, (2) considerations about representativeness of study participants, (3) expectations for transparency about data provenance, handling and quality assessments, and (4) considerations for strengthening studies using record linkage and/or randomization in pragmatic clinical trials. We also discuss likely sources of bias and suggest mitigation strategies. We see a future where clinical records - patient-generated data and other RWD - are brought together and harnessed by robust study design with efficient data capture and strong data curation. Traditional RCT will remain the mainstay of drug development, but RWE will play a growing role in clinical, regulatory, and payer decision-making. The most meaningful RWE will come from collaboration with astute clinicians with deep practice experience and questioning minds working closely with patients and researchers experienced in the development of RWE.

Current status of real-world big data research in the cardiovascular field in Japan

Real-world data (RWD) are observational data obtained by collecting, structuring, and accumulating patient information among the medical big data. RWD are derived from a variety of patient medical care and health information outside of conventional research data, and include electronic health records, claims data, registry data of disease, drug and device, health check-up data, and more recently, patient information data from wearable devices. They are currently being utilized in various forms for optimal medical care and real-world evidence (RWE) is constructed through a process of hypothesis generation and verification based on the RWD research. Together with classic clinical research and pragmatic trials, RWE shapes the learning healthcare system and contributes to the improvement of medical care. In the cardiovascular medical care of the current super-aged society, the need for a variety of RWE and the research is increasing, since the guidelines established over time and the medical care based on it cannot necessarily be the best in accordance with the current medical situation. In this review, we focus on the RWD and RWE studies in the cardiovascular medical field and outlines their current status in Japan. Furthermore, we discuss the potential for extending the studies and issues related to the use of medical big data and RWD.

Licensing of Orphan Medicinal Products—Use of Real-World Data and Other External Data on Efficacy Aspects in Marketing Authorization Applications Concluded at the European Medicines Agency Between 2019 and 2021

Background: Reference to so-called real-world data is more often made in marketing authorization applications for medicines intended to diagnose, prevent or treat rare diseases compared to more common diseases. We provide granularity on the type and aim of any external data on efficacy aspects from both real-world data sources and external trial data as discussed in regulatory submissions of orphan designated medicinal products in the EU. By quantifying the contribution of external data according to various regulatory characteristics, we aimed at identifying specific opportunities for external data in the field of orphan conditions.

Methods: Information on external data in regulatory documents covering 72 orphan designations was extracted. Our sample comprised public assessment reports for approved, refused, or withdrawn applications concluded from 2019–2021 at the European Medicines Agency. Products with an active orphan designation at the time of submission were scrutinized regarding the role of external data on efficacy aspects in the context of marketing authorization applications, or on the criterion of “significant benefit” for the confirmation of the orphan designation at the time of licensing. The reports allowed a broad distinction between clinical development, regulatory decision making, and intended post-approval data collection. We defined three categories of external data, administrative data, structured clinical data, and external trial data (from clinical trials not sponsored by the applicant), and noted whether external data concerned the therapeutic context of the disease or the product under review.

Results: While reference to external data with respect to efficacy aspects was included in 63% of the approved medicinal products in the field of rare diseases, 37% of marketing authorization applications were exclusively based on the dedicated clinical development plan for the product under review. Purely administrative data did not play any role in our sample of reports, but clinical data collected in a structured manner (from routine care or clinical research) were often used to inform on the trial design. Two additional recurrent themes for the use of external data were the contextualization of results, especially to confirm the orphan designation at the time of licensing, and reassurance of a large difference in treatment effect size or consistency of effects observed in clinical trials and practice. External data on the product under review were restricted to either active substances already belonging to the standard of care even before authorization or to compassionate use schemes. Furthermore, external data were considered pivotal for marketing authorization only exceptionally and only for active substances already in use within the specific therapeutic indication. Applications for the rarest conditions and those without authorized treatment alternatives were especially prominent with respect to the use of external data from real-world data sources both in the pre- and post-approval setting.

Conclusion: Specific opportunities for external data in the setting of marketing authorizations in the field of rare diseases were identified. Ongoing initiatives of fostering systematic data collection are promising steps for a more efficient medicinal product development in the field of rare diseases.

Demonstrating Benefit-Risk Profiles of Novel Therapeutic Strategies in Kidney Transplantation: Opportunities and Challenges of Real-World Evidence

While great progress has been made in transplantation medicine, long-term graft failure and serious side effects still pose a challenge in kidney transplantation. Effective and safe long-term treatments are needed. Therefore, evidence of the lasting benefit-risk of novel therapies is required. Demonstrating superiority of novel therapies is unlikely via conventional randomized controlled trials, as long-term follow-up in large sample sizes pose statistical and operational challenges. Furthermore, endpoints generally accepted in short-term clinical trials need to be translated to real-world (RW) care settings, enabling robust assessments of novel treatments. Hence, there is an evidence gap that calls for innovative clinical trial designs, with RW evidence (RWE) providing an opportunity to facilitate longitudinal transplant research with timely translation to clinical practice. Nonetheless, the current RWE landscape shows considerable heterogeneity, with few registries capturing detailed data to support the establishment of new endpoints. The main recommendations by leading scientists in the field are increased collaboration between registries for data harmonization and leveraging the development of technology innovations for data sharing under high privacy standards. This will aid the development of clinically meaningful endpoints and data models, enabling future long-term research and ultimately establish optimal long-term outcomes for transplant patients.

Clinical Evidence Generation During a Pandemic: Lessons Learned for Sustaining Progress

Because of significant adaptations forced by the COVID-19 pandemic, resultant changes within health care delivery and clinical research introduced the potential for evaluation of novel evidence generation approaches in oncology. On July 26 and 27, 2021, the National Academies of Science, Engineering, and Medicine, National Cancer Policy Forum hosted a virtual workshop entitled “Cancer Care and Cancer Research in the Context of the COVID-19 Pandemic: A Workshop on Lessons Learned.” This workshop examined changes in cancer care and cancer research that occurred in response to the COVID-19 pandemic and considered lessons learned from that experience. The goal was to identify what changes could improve the delivery of high-quality cancer care and the conduct of cancer clinical trials in the postpandemic era, with an emphasis on health equity. How can we sustain the valuable lessons learned that might accelerate progress and enhance clinical evidence generation for patients and clinicians? In this overview, we discuss ways in which the COVID-19 experience has catalyzed research efficiencies as well as fostered a broader array of trial design and research methods that may facilitate improved cancer drug development during the pandemic and beyond.

Electronic Health Record Network Research in Infectious Diseases

With the marked increases in electronic health record (EHR) use for providing clinical care, there have been parallel efforts to leverage EHR data for research. EHR repositories offer the promise of vast amounts of clinical data not easily captured with traditional research methods and facilitate clinical epidemiology and comparative effectiveness research, including analyses to identify patients at higher risk for complications or who are better candidates for treatment. These types of studies have been relatively slow to penetrate the field of infectious diseases, but the need for rapid turnaround during the COVID-19 global pandemic has accelerated the uptake. This review discusses the rationale for her network projects, opportunities and challenges that such networks present, and some prior studies within the field of infectious diseases.