External validity of randomised controlled trials: "to whom do the results of this trial apply?"

Generate Analysis-Ready Data for Real-world Evidence: Tutorial for Harnessing Electronic Health Records With Advanced Informatic Technologies

Although randomized controlled trials (RCTs) are the gold standard for establishing the efficacy and safety of a medical treatment, real-world evidence (RWE) generated from real-world data has been vital in postapproval monitoring and is being promoted for the regulatory process of experimental therapies. An emerging source of real-world data is electronic health records (EHRs), which contain detailed information on patient care in both structured (eg, diagnosis codes) and unstructured (eg, clinical notes and images) forms. Despite the granularity of the data available in EHRs, the critical variables required to reliably assess the relationship between a treatment and clinical outcome are challenging to extract. To address this fundamental challenge and accelerate the reliable use of EHRs for RWE, we introduce an integrated data curation and modeling pipeline consisting of 4 modules that leverage recent advances in natural language processing, computational phenotyping, and causal modeling techniques with noisy data. Module 1 consists of techniques for data harmonization. We use natural language processing to recognize clinical variables from RCT design documents and map the extracted variables to EHR features with description matching and knowledge networks. Module 2 then develops techniques for cohort construction using advanced phenotyping algorithms to both identify patients with diseases of interest and define the treatment arms. Module 3 introduces methods for variable curation, including a list of existing tools to extract baseline variables from different sources (eg, codified, free text, and medical imaging) and end points of various types (eg, death, binary, temporal, and numerical). Finally, module 4 presents validation and robust modeling methods, and we propose a strategy to create gold-standard labels for EHR variables of interest to validate data curation quality and perform subsequent causal modeling for RWE. In addition to the workflow proposed in our pipeline, we also develop a reporting guideline for RWE that covers the necessary information to facilitate transparent reporting and reproducibility of results. Moreover, our pipeline is highly data driven, enhancing study data with a rich variety of publicly available information and knowledge sources. We also showcase our pipeline and provide guidance on the deployment of relevant tools by revisiting the emulation of the Clinical Outcomes of Surgical Therapy Study Group Trial on laparoscopy-assisted colectomy versus open colectomy in patients with early-stage colon cancer. We also draw on existing literature on EHR emulation of RCTs together with our own studies with the Mass General Brigham EHR.

Antidepressive Effectiveness of Amisulpride, Aripiprazole, and Olanzapine in Patients With Schizophrenia Spectrum Disorders: A Secondary Outcome Analysis of a Pragmatic, Randomized Trial (BeSt InTro)

BACKGROUND

Depressive symptoms are frequent in schizophrenia and associated with a poorer outcome. Currently, the optimal treatment for depressive symptoms in schizophrenia remains undetermined. Amisulpride, aripiprazole, and olanzapine all have antidepressive pharmacodynamic properties, ranging from serotonergic affinities to limbic dopaminergic selectivity. Consequently, in a 12-month pragmatic, randomized clinical trial, we aimed to investigate differences in antidepressive effectiveness among amisulpride, aripiprazole, and olanzapine as a secondary outcome, measured by change in the Calgary Depression Scale for Schizophrenia sum score in patients within the schizophrenia spectrum.

METHODS

Psychotic patients within the schizophrenia spectrum were included, and effectiveness was analyzed with latent growth curve modeling.

RESULTS

Of the 144 patients, 51 (35%) were women, the mean age was 31.7 (SD 12.7), and 39% were antipsychotic naive. At inclusion, 68 (47%) participants had a Calgary Depression Scale for Schizophrenia sum score >6, indicating severe depressive symptoms. Across the 12-month follow-up, there was a depressive symptom reduction in all medication groups, but no statistically significant differences between the study drugs. Separate analyses of the subcohort with elevated depressive symptoms at inclusion also failed to find differences in depressive symptom reduction between study drugs. The reduction in depressive symptoms mainly occurred within 6 weeks after randomization.

CONCLUSIONS

There was a reduction in depressive symptoms under treatment with amisulpride, aripiprazole, and olanzapine in acutely psychotic patients with schizophrenia spectrum disorder, but no differences between the drugs.

Evaluation of a Structured Screening Assessment to Detect Isolated Rapid Eye Movement Sleep Behavior Disorder

BACKGROUND

Isolated rapid eye movement (REM) sleep behavior disorder (iRBD) cohorts have provided insights into the earliest neurodegenerative processes in α-synucleinopathies. Even though polysomnography (PSG) remains the gold standard for diagnosis, an accurate questionnaire-based algorithm to identify eligible subjects could facilitate efficient recruitment in research.

OBJECTIVE

This study aimed to optimize the identification of subjects with iRBD from the general population.

METHODS

Between June 2020 and July 2021, we placed newspaper advertisements, including the single-question screen for RBD (RBD1Q). Participants' evaluations included a structured telephone screening consisting of the RBD screening questionnaire (RBDSQ) and additional sleep-related questionnaires. We examined anamnestic information predicting PSG-proven iRBD using logistic regressions and receiver operating characteristic curves.

RESULTS

Five hundred forty-three participants answered the advertisements, and 185 subjects fulfilling inclusion and exclusion criteria were screened. Of these, 124 received PSG after expert selection, and 78 (62.9%) were diagnosed with iRBD. Selected items of the RBDSQ, the Pittsburgh Sleep Quality Index, the STOP-Bang questionnaire, and age predicted iRBD with high accuracy in a multiple logistic regression model (area under the curve >80%). When comparing the algorithm to the sleep expert decision, 77 instead of 124 polysomnographies (62.1%) would have been carried out, and 63 (80.8%) iRBD patients would have been identified; 32 of 46 (69.6%) unnecessary PSG examinations could have been avoided.

CONCLUSIONS

Our proposed algorithm displayed high diagnostic accuracy for PSG-proven iRBD cost-effectively and may be a convenient tool for research and clinical settings. External validation sets are warranted to prove reliability. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Specific recommendations to improve the design and conduct of clinical trials

There are many reasons why the majority of clinical trials fail or have limited applicability to patient care. These include restrictive entry criteria, short duration studies, unrecognized adverse drug effects, and reporting of therapy assignment preferential to actual use. Frequently, experimental animal models are used sparingly and do not accurately simulate human disease. We suggest two approaches to improve the conduct, increase the success, and applicability of clinical trials. Studies can apply dosing of the investigational therapeutics and outcomes, determined from animal models that more closely simulate human disease. More extensive identification of known and potential risk factors and confounding issues, gleaned from recently organized "big data," should be utilized to create models for trials. The risk factors in each model are then accounted for and managed during each study.

The Incidence and Severity of Patient-Reported Side Effects of Chemotherapy in Routine Clinical Care: A Prospective Observational Study

INTRODUCTION

Understanding patients' self-reported chemotherapy side effects is significant because it affects patients' quality of life (QOL) and compliance with treatment. Our current knowledge of chemotherapy side effects comes from available literature, whose external validity is questionable. Moreover, there are very few studies available in the literature that focus on various cancers and their associated side effects.

METHODS

A single-center, prospective observational study was conducted at a tertiary care center from July 2019 to July 2021. After deriving the sample size, we interviewed 76 consecutive study patients with gastric, periampullary, colorectal, and breast cancer for six months after chemotherapy initiation with a structured patient-reported outcome tool adapted in English and Tamil to record the side effects like diarrhea, vomiting, chest pain, constipation, dyspnea, fatigue, mucositis, and rash. The grading of symptoms was done according to the Common Terminology Criteria for Adverse Events version 5.0. The frequency and prevalence of side effects were calculated as the number of patients who reported the side effect of any grade at least once during the follow-up period. The incidence rate of side effects was calculated in terms of person-time. The association between each side effect and cancer type was calculated using the chi-square test and Fisher's exact test as appropriate.

RESULTS

Of the 77 patients in the study, 51.9% were male, 63.6% were between 40 and 60 years of age, 45.5% had stage-3 disease, and 44.2% received neoadjuvant treatment. During the six-month follow-up period, 97.4% of patients experienced at least one side effect. Fatigue was the most common side effect (87%), followed by loss of appetite (71.4%) and diarrhea (49.4%). Approximately 66.7% of patients experienced six or more side effects. There was a statistically significant difference in the frequency of side effects between cancer types. However, age, socioeconomic status, BMI, comorbidity, chemo-intent, and stage of disease did not affect the frequency of side effects.

CONCLUSIONS

This study highlights the need to integrate patient-reported side effects into routine clinical practice. Identifying these side effects, even if they are mild in intensity, and managing them in a timely manner may improve the patient's emotional state, QOL, and compliance with chemotherapy.

The standards of reporting trials in pets (PetSORT): Explanation and elaboration

Well-designed randomized controlled trials (RCTs) provide the best evidence of the primary research designs for evaluating the effectiveness of interventions. However, if RCTs are incompletely reported, the methodological rigor with which they were conducted cannot be reliably evaluated and it may not be possible to replicate the intervention. Missing information also may limit the reader's ability to evaluate the external validity of a trial. Reporting guidelines are available for clinical trials in human healthcare (CONSORT), livestock populations (REFLECT), and preclinical experimental research involving animals (ARRIVE 2.0). The PetSORT guidelines complement these existing guidelines, providing recommendations for reporting controlled trials in pet dogs and cats. The rationale and scientific background are explained for each of the 25 items in the PetSORT reporting recommendations checklist, with examples from well-reported trials.

Burden of Illness beyond Mortality and Heart Failure Hospitalizations in Patients Newly Diagnosed with Heart Failure in Spain According to Ejection Fraction

OBJECTIVE

The objective of this study was to describe the rates of adverse clinical outcomes, including all-cause mortality, heart failure (HF) hospitalization, myocardial infarction, and stroke, in patients newly diagnosed with HF to provide a comprehensive picture of HF burden.

METHODS

This was a retrospective and observational study, using the BIG-PAC database in Spain. Adults, newly diagnosed with HF between January 2013 and September 2019 with ≥1 HF-free year of enrolment prior to HF diagnosis, were included.

RESULTS

A total of 19,961 patients were newly diagnosed with HF (43.5% with reduced ejection fraction (EF), 26.3% with preserved EF, 5.1% with mildly reduced EF, and 25.1% with unknown EF). The mean age was 69.7 ± 19.0 years; 53.8% were men; and 41.0% and 41.5% of patients were in the New York Heart Association functional classes II and III, respectively. The baseline HF treatments included beta-blockers (70.1%), renin-angiotensin system inhibitors (56.3%), mineralocorticoid receptor antagonists (11.8%), and SGLT2 inhibitors (8.9%). The post-index incidence rates of all-cause mortality, HF hospitalization, and both combined were 102.2 (95% CI 99.9-104.5), 123.1 (95% CI 120.5-125.7), and 182 (95% CI 178.9-185.1) per 1000 person-years, respectively. The rates of myocardial infarction and stroke were lower (26.2 [95% CI 25.1-27.4] and 19.8 [95% CI 18.8-20.8] per 1000 person-years, respectively).

CONCLUSIONS

In Spain, patients newly diagnosed with HF have a high risk of clinical outcomes. Specifically, the rates of all-cause mortality and HF hospitalization are high and substantially greater than the rates of myocardial infarction and stroke. Given the burden of adverse outcomes, these should be considered targets in the comprehensive management of HF. There is much room for improving the proportion of patients receiving disease-modifying therapies.

Strengthening implementation guidelines for HIV service delivery: Considerations for future evidence generation and synthesis

Ingrid Eshun-Wilson and colleagues summarize gaps in primary HIV implementation research methods and reporting, and propose areas for future methodological development.

Intensive insulin therapy in sepsis patients: Better data enables better intervention

In clinics, sepsis is a critical disease that often develops into shock and multiple organ dysfunction, leading to a serious threat of death. Patients with sepsis are often accompanied by stress hyperglycemia which is an independent risk factor for poor prognosis in sepsis. Thus, the treatment for stress hyperglycemia has attracted more and more attention, among which intensive insulin therapy is widely concerned. However, the benefits and harms of intensive insulin therapy for sepsis patients remain controversial. What the existing literature discusses mostly are the clinical benefit and hypoglycemia risk of intensive insulin therapy, but there is no conclusion on the target range of blood glucose control, the applicable patients, the timing of treatment initiation, and how to avoid the risk. In this study, we have analyzed and summarized the existing literature, hoping to determine the adverse and clinical benefit of intensive insulin therapy in sepsis. And we attempt to assemble better evidence to propose a better recommendation on hyperglycemia intervention for sepsis patients.

Adherence to CONSORT Guidelines and Reporting of the Determinants of External Validity in Clinical Oncology Randomized Controlled Trials: A Review of Trials Published in Four Major Journals between 2013 and 2015

Our primary objective was to determine the proportion of trials that report the number of patients assessed for eligibility before randomization. We performed the systematic retrieval and analysis of all phase II, III, and IV RCTs published between 2013 and 2015 in four high-impact-factor journals in the field of clinical oncology. Among 456 RCTs reviewed, 236 trials (51.8%) reported the number of patients assessed for eligibility. Among the 236 trials that reported the entire enrollment process, the reasons for patient exclusion could be found in 184 trials (78%). A flow diagram was presented in 452 trials (99.1%), and 98 trials (21.5%) included a discussion on generalizability. Reporting the parameters of external validity in medical oncology RCTs is challenging. Improving adherence to the 2010 CONSORT guidelines concerning the enrollment process could help clinicians and health policymakers establish to whom trial results apply.

Unit information prior for incorporating real-world evidence into randomized controlled trials

Randomized controlled trials (RCTs) have been widely recognized as the gold standard to infer the treatment effect in clinical research. Recently, there has been growing interest in enhancing and complementing the result in an RCT by integrating real-world evidence from observational studies. The unit information prior (UIP) is a newly proposed technique that can effectively borrow information from multiple historical datasets. We extend this generic approach to synthesize the non-randomized evidence into a current RCT. Not only does the UIP only require summary statistics published from observational studies for ease of implementation, but it also has clear interpretations and can alleviate the potential bias in the real-world evidence via weighting schemes. Extensive numerical experiments show that the UIP can improve the statistical efficiency in estimating the treatment effect for various types of outcome variables. The practical potential of our UIP approach is further illustrated with a real trial of hydroxychloroquine for treating COVID-19 patients.

Dissemination and implementation research for oral and craniofacial health: Background, a review of literature and future directions

Oral conditions are highly prevalent globally and have profound consequence on individuals and communities. Clinical (e.g. dental treatments, behavioural counselling) and non-clinical (e.g. community-based programming, water fluoridation, oral health policy) evidence-based interventions have been identified, recommended and applied at the clinic, community and policy levels. Still, the burden of oral conditions persists, with inequitable distribution across populations. A major driver of this lack of progress is poor translation of research findings, which results in an evidence-to-practice gap. Dissemination and implementation science (DIS) has emerged to address this gap. A relatively new field, application of DIS represents an important avenue for achieving good dental, oral and craniofacial health for all. The goal of this introductory article is to provide a brief background on DIS relevant to researchers in dentistry and oral health. The problem of knowledge translation, basic concepts and terminology in DIS, and approaches to doing dissemination and implementation research-including implementation strategies, key outcomes, and implementation theories, models and frameworks-are discussed. Additionally, the article reviews literature applying DIS to dentistry and oral health. Results of published studies and their implications for the field are presented. Drawing on the literature review and contemporary thinking in DIS, current gaps, opportunities and future directions are discussed. Resources for understanding and applying DIS are provided throughout. This article serves as a primer on DIS for dental and oral health researchers of all types working across a range of contexts; it also serves as a call to action for increased application of DIS to address the burden of oral conditions globally.

Characteristics of drug safety alerts issued by the Spanish Medicines Agency

Objectives: To describe the characteristics of safety alerts issued by the Spanish Medicines Agency (AEMPS) and the Spanish Pharmacovigilance System over a 7-year period and the regulatory actions they generated. Methods: A retrospective analysis was carried out of drug safety alerts published on the AEMPS website from 1 January 2013 to 31 December 2019. Alerts that were not drug-related or were addressed to patients rather than healthcare professionals were excluded. Results: During the study period, 126 safety alerts were issued, 12 of which were excluded because they were not related to drugs or were addressed to patients and 22 others were excluded as they were duplications of previous alerts. The remaining 92 alerts reported 147 adverse drug reactions (ADRs) involving 84 drugs. The most frequent source of information triggering a safety alert was spontaneous reporting (32.6%). Four alerts (4.3%) specifically addressed health issues related to children. ADRs were considered serious in 85.9% of the alerts. The most frequent ADRs were hepatitis (seven alerts) and congenital malformations (five alerts), and the most frequent drug classes were antineoplastic and immunomodulating agents (23%). Regarding the drugs involved, 22 (26.2%) were "under additional monitoring." Regulatory actions induced changes in the Summary of Product Characteristics in 44.6% of alerts, and in eight cases (8.7%), the alert led to withdrawal from the market of medicines with an unfavorable benefit/risk ratio. Conclusion: This study provides an overview of drug safety alerts issued by the Spanish Medicines Agency over a 7-year period and highlights the contribution of spontaneous reporting of ADRs and the need to assess safety throughout the lifecycle of medicines.

Machine learning enabled subgroup analysis with real-world data to inform clinical trial eligibility criteria design

Overly restrictive eligibility criteria for clinical trials may limit the generalizability of the trial results to their target real-world patient populations. We developed a novel machine learning approach using large collections of real-world data (RWD) to better inform clinical trial eligibility criteria design. We extracted patients' clinical events from electronic health records (EHRs), which include demographics, diagnoses, and drugs, and assumed certain compositions of these clinical events within an individual's EHRs can determine the subphenotypes-homogeneous clusters of patients, where patients within each subgroup share similar clinical characteristics. We introduced an outcome-guided probabilistic model to identify those subphenotypes, such that the patients within the same subgroup not only share similar clinical characteristics but also at similar risk levels of encountering severe adverse events (SAEs). We evaluated our algorithm on two previously conducted clinical trials with EHRs from the OneFlorida+ Clinical Research Consortium. Our model can clearly identify the patient subgroups who are more likely to suffer or not suffer from SAEs as subphenotypes in a transparent and interpretable way. Our approach identified a set of clinical topics and derived novel patient representations based on them. Each clinical topic represents a certain clinical event composition pattern learned from the patient EHRs. Tested on both trials, patient subgroup (#SAE=0) and patient subgroup (#SAE>0) can be well-separated by k-means clustering using the inferred topics. The inferred topics characterized as likely to align with the patient subgroup (#SAE>0) revealed meaningful combinations of clinical features and can provide data-driven recommendations for refining the exclusion criteria of clinical trials. The proposed supervised topic modeling approach can infer the clinical topics from the subphenotypes with or without SAEs. The potential rules for describing the patient subgroups with SAEs can be further derived to inform the design of clinical trial eligibility criteria.

Bleeding Risk in Elderly Patients with Venous Thromboembolism Who Would Have Been Excluded from Anticoagulation Trials

Older patients with venous thromboembolism (VTE) are underrepresented in clinical anticoagulation trials. We examined to which extent elderly patients with VTE would be excluded from such trials and compared the bleeding risk between hypothetically excluded and enrolled patients. We studied 991 patients aged ≥65 years with acute VTE in a prospective multicenter cohort. We identified 12 landmark VTE oral anticoagulation trials from the eighth and updated ninth American College of Chest Physician Guidelines. For each trial, we abstracted the exclusion criteria and calculated the proportion of our study patients who would have been excluded from trial participation. We examined the association between five common exclusion criteria (hemodynamic instability, high bleeding risk, comorbidity, co-medication, and invasive treatments) and major bleeding (MB) within 36 months using competing risk regression, adjusting for age, sex, and periods of anticoagulation. A median of 31% (range: 20-52%) of our patients would have been excluded from participation in the landmark trials. Hemodynamic instability (sub-hazard ratio [SHR]: 2.2, 95% CI: 1.1-4.7), comorbidity (SHR: 1.5, 95% CI: 1.1-2.2), and co-medication (SHR: 1.5, 95% CI: 1.0-2.3) were associated with MB. Compared to eligible patients, those with ≥2 exclusion criteria had a twofold (SHR: 2.16, 95% CI: 1.38-3.39) increased risk of MB. Overall, about one-third of older patients would not be eligible for participation in guideline-defining VTE anticoagulation trials. The bleeding risk increases significantly with the number of exclusion criteria present. Thus, results from such trials may not be generalizable to older, multimorbid, and co-medicated patients.

Differences Among Clinical Trials and Registries on Surgical and Percutaneous Coronary Interventions

BACKGROUND

A need exists for systematic evaluation of the differences in baseline characteristics and early outcomes between patients enrolled in randomized controlled trials (RCTs) and clinical practice for coronary artery bypass grafting (CABG) and percutaneous coronary intervention (PCI).

METHODS

Systematic searches were conducted to identify RCTs comparing CABG vs PCI and CABG or PCI registries. Sixteen predefined baseline characteristics and 30-day mortality were extracted from the included studies. Pooled proportion and mean with 95% CI were calculated for binary and continuous outcomes, respectively, by using the random effects model.

RESULTS

Fourteen RCTs and 10 registries including more than 2 million patients were included. Registry patients who underwent CABG had a higher prevalence of hypertension, smoking, reduced left ventricular ejection fraction, and prior myocardial infarction, but a lower prevalence of single-vessel disease when compared with CABG-treated patients included in RCTs. Regarding PCI, hypertension, hyperlipidemia, left main coronary artery disease, triple-vessel coronary disease, and NYHA functional class <IV were significantly more prevalent among patients in RCTs, whereas age, reduced left ventricular ejection fraction, and smoking were more represented among PCI registry patients. Thirty-day mortality was higher in registries for both PCI-treated and CABG-treated patients.

CONCLUSIONS

There were significant differences in baseline characteristics and 30-day mortality between patients enrolled in RCTs comparing CABG vs PCI and CABG and PCI registries. However, results were mixed, and the discrepancy was less than seen in other fields.

Effectiveness of different treatments for odontogenic keratocyst: a network meta-analysis

Odontogenic keratocysts (OKC) are benign but aggressive lesions. As there is a lack of well randomized clinical studies assessing the effectiveness of the different treatment options for OKC, a network meta-analysis (NMA) was performed to identify the best treatment option with the lowest recurrence rate. An electronic search was performed following the PRISMA guidelines to identify all clinical studies comparing treatment options against enucleation alone. The outcome variable was recurrence. The predictor variables were treatments. The eight included treatments were: enucleation with peripheral ostectomy/curettage (E + PO/curettage); enucleation with cryotherapy (E + CRYO); enucleation with/without PO followed by modified Carnoy's solution (E ± PO+MCS); enucleation with PO and with topical 5-fluorouracil (E + PO+5FU); enucleation with/without PO followed by original Carnoy's solution (E ± PO+CS); marsupialization alone (MARS); marsupialization followed by secondary enucleation with/without PO (MARS+2°E ± PO); and resection. The odds ratio was used to estimate the recurrence rate. A frequentist NMA was performed using Stata software. A total of 2989 patients in 40 studies were included. Both direct pairwise meta-analysis and NMA showed that E + 5FU+PO was significantly superior to E ± PO+MCS. However, no statistically significant difference was found between E ± PO+CS vs E + 5FU+PO, E ± PO+MCS, and resection, respectively (all very low quality evidence). The three most effective treatments in reducing the recurrence rate were E + PO+ 5FU (98.1%; very low quality evidence), resection (83.5%; very low quality evidence), and E ± PO+CS (63.8%; moderate quality evidence). The findings from this study suggest that CS remains the most effective fixative agent after enucleation and PO until proven otherwise. Additionally, 5FU appears to be an effective method with promising results that needs further research. Finally, the efficacy of MCS remains controversial; further in vivo and in vitro studies are required to determine new protocols. As this NMA included retrospective studies, the results should be interpreted with great caution (level of evidence: type III).

Comparing pregnancy rates following ovarian stimulation with follitropin-Δ to follitropin -α in routine IVF: A retrospective analysis

STUDY OBJECTIVES

Follitropin-Δ, a new recombinant follicle stimulation hormone, uses a fixed daily dose producing a predictable ovarian response while using less gonadotropins compared to follitropin-α. We report clinical outcomes comparing each in the routine IVF setting and further compare qualified to disqualified subjects based on previous randomized controlled trial (RCT) inclusion criteria.

STUDY DESIGN

Retrospective analysis of all cycles performed by a single provider between January 2020 to January 2021. All IVF cycles without patient inclusion-exclusion criteria were considered for the analysis. Clinical outcomes in two groups (follitropin-Δ vs follitropin-α ± 75 IU human menopausal gonadotropin (hMG) in expected poor responders) were compared. In addition, comparisons were made between qualified versus disqualified subgroups.

RESULTS

No differences in baseline demographics, number of MII oocytes, fertilization/MII oocyte, percent of good quality embryos were noted. Compared to those using follitropin-α, follitropin-Δ resulted in lower daily (170 vs 211 IU/d, p = 0.002) and total Gn used (1739 vs 2194 IU, p = 0.003). Optimal range response (8-14 oocytes) (22/44 [50 %] vs 78/203 [38.6 %]; p = 0.10) and fresh (fCP) and cumulative clinical pregnancy (cCP) rates per transfer (29.5 % vs 24.1 % and 35 % vs 25.1 %, p = 0.08) were similar between groups. Based on previous RCTs, those who would have qualified compared to those who would have disqualified, patients using follitropin-Δ were just as likely to have an optimal oocyte response (qualified: 48 % vs disqualified: 57.1 %) and resulted in similar cCP (41.4 % vs 25 %, p-0.23).

CONCLUSIONS

While follitropin-Δ requires less daily and total dosing compared to follitropin-α, optimal range of retrieved oocytes and clinical outcomes appear to be comparable. Using RCT inclusion criteria, similar findings were noted in those who would have qualified compared to disqualified patients.

External applicability of the Effect of ticagrelor on Health Outcomes in diabEtes Mellitus patients Intervention Study (THEMIS) trial: An analysis of patients with diabetes and coronary artery disease in the REduction of Atherothrombosis for Continued Health (REACH) registry

AIMS

THEMIS is a double-blind, randomized trial of 19,220 patients with diabetes mellitus and stable coronary artery disease (CAD) comparing ticagrelor to placebo, in addition to aspirin. The present study aimed to describe the proportion of patients eligible and reasons for ineligibility for THEMIS within a population of patients with diabetes and CAD included in the Reduction of Atherothrombosis for Continued Health (REACH) registry.

METHODS AND RESULTS

The THEMIS eligibility criteria were applied to REACH patients. THEMIS included patients ≥50 years with type 2 diabetes and stable CAD as determined by either a history of previous percutaneous coronary intervention, coronary artery bypass grafting, or documentation of angiographic stenosis of ≥50% of at least one coronary artery. Patients with prior myocardial infarction or stroke were excluded. In REACH, 10,156 patients had stable CAD and diabetes. Of these, 6515 (64.1%) patients had at least one exclusion criteria. From the remaining population, 784 patients did not meet inclusion criteria (7.7%) mainly due to absence of aspirin treatment (7.2%), yielding a 'THEMIS-eligible population' of 2857 patients (28.1% of patients with diabetes and stable CAD). The main reasons for exclusion were a history of myocardial infarction (53.1%), use of oral anticoagulation (14.5%), or history of stroke (12.9%). Among the 4208 patients with diabetes and a previous PCI, 1196 patients (28.4%) were eligible for inclusion in the THEMIS-PCI substudy.

CONCLUSIONS

In a population of patients with diabetes and stable coronary artery disease, a sizeable proportion appear to be 'THEMIS eligible.'

CLINICAL TRIAL REGISTRATION

http://www.

CLINICALTRIALS

gov identifier: NCT01991795.

Comparing stroke rehabilitation inpatients and clinical trials eligibility criteria: A secondary chart review analysis revealing that most patients could have been excluded from rehabilitation trials based on comorbidity status

Background

The generalizability of treatments examined in rehabilitation randomized controls trials (RCTs) partly depend on the similarity between trial subjects and a stroke rehabilitation inpatient population. The aim of this study was to determine the proportion of stroke rehabilitation inpatients that would have been eligible or ineligible to participate in published stroke RCTs.

Methods

This was a secondary analysis of chart review data collected as part of an independent quality improvement initiative. Data pertaining to the characteristics of stroke rehabilitation inpatients (e.g. age, cognitive impairment, previous stroke, comorbidities) were extracted from the medical charts of patients consecutively admitted to an inpatient stroke rehabilitation unit at a large urban rehabilitation hospital in Canada. Using the exclusion criteria categories of stroke RCTs identified from a systematic scoping review of 428 RCTs, we identified how many stroke rehabilitation inpatients would have been eligible or ineligible to participate in stroke RCTs based on their age, cognitive impairment, previous stroke and presence of comorbidities.

Results

In total, 110 stroke rehabilitation inpatients were included. Twenty-four percent of patients were 80 years of age or older, 84.5% had queries or concerns regarding patient cognitive abilities, 28.0% had a previous stroke, and 31.8% had a severe stroke. Stroke rehabilitation inpatients had six comorbidities on average. Based on these factors, most stroke rehabilitation inpatients could have been excluded from stroke RCTs, with cognitive impairment the most common RCT exclusion criteria.

Conclusions

Changes to the design of RCTs would support the development of clinical practice guidelines that reflect stroke rehabilitation inpatient characteristics, enhancing equity, diversity, and inclusion within samples and the generalizability of results.

Lipid-Lowering Trials Are Not Representative of Patients Managed in Clinical Practice: A Systematic Review and Meta-Analysis of Exclusion Criteria

Background Randomized clinical trials (RCTs) might not be representative of the real-world population because of unreasonable exclusion criteria. We sought to determine which groups of patients are excluded from RCTs that included lipid-lowering therapy. Methods and Results We retrieved all trials from the Cholesterol Treatment Trialists Collaboration and systematically searched for large (≥1000 participants) lipid-lowering therapy RCTs, defined as statins, ezetimibe, and PCSK9 inhibitors. We predefined groups: older adults (>70 or >75 years), women, non-Whites, chronic kidney failure, heart failure, immunosuppression, cancer, dementia, treated thyroid disease, chronic obstructive pulmonary disease, mental illness, atrial fibrillation, multimorbidity (≥2 chronic diseases), and polypharmacy. We counted the number of RCTs excluding patients of the predefined groups and meta-analyzed the prevalence of included patients to obtain pooled estimates with a random-effects model. We included 42 RCTs (298 605 patients). Eighty-one percent of trials excluded patients with severe and 76% those with moderate kidney failure. Seventy-one percent of trials excluded groups of women, 64% excluded patients with moderate to severe heart failure, 64% those with immunosuppressant conditions, 48% those with cancer, 29% those with dementia, and 29% of trials excluded older adults. The pooled prevalence for patients >70 years of age was 25% (95% CI, 0%-49%), 11% (3%-18%) for >75 years of age, and 51% (38%-63%) for multimorbidity. Conclusions The majority of lipid-lowering therapy trials excluded patients with common diseases, such as moderate-to-severe kidney disease or heart failure or with immunosuppression. Underrepresenting certain populations, including women and older adults, might lead to limited transportability of study results and uncertainty on possible side-effects and efficacy in these groups. Future trials should promote diversity in the recruitment strategies and improve equity in cardiovascular research. Registration URL: ClinicalTrials.gov; Unique Identifier: CRD42021253909.

Intervention effect estimates in randomised controlled trials conducted in primary care versus secondary or tertiary care settings: a meta-epidemiological study

BACKGROUND

Many clinical practice guidelines are based on randomised controlled trials conducted in secondary or tertiary care setting and general practitioners frequently question their relevance for primary care patients. Our aim was to compare the intervention effect estimates between primary care setting randomised controlled trials (PC-RCTs) and secondary or tertiary care setting randomised controlled trials (ST-RCTs).

METHODS

Meta-epidemiological study of meta-analyses (MAs) of a binary outcome including at least one PC-RCT and one ST-RCT. PC-RCTs were defined as trials recruiting patients in general practices, primary care practices, family practices, community centers or community pharmacies. ST-RCTs were defined as trials recruiting in hospitals, including hospitalized patients, hospital outpatients and patients from emergency departments. For each MA, we estimated a ratio of odds ratio (ROR) by using random-effects meta-regression, with an ROR less than 1 indicating lower estimates of the intervention effect in PC-RCTs than ST-RCTs. Finally, we estimated a combined ROR across MAs by using a random-effects meta-analysis. We performed subgroup analyses considering the type of outcomes (objective vs subjective), type of experimental intervention (pharmacological vs non-pharmacological), and control group (active vs inactive) as well as analyses adjusted on items of the Cochrane Risk of Bias tool.

RESULTS

Among 1765 screened reviews, 76 MAs with 230 PC-RCTs and 384 ST-RCTs were selected. The main medical fields were pneumology (13.2%) and psychiatry or addictology (38.2%). Intervention effect estimates did not significantly differ between PC-RCTs and ST-RCTs (ROR = 0.97, 95% confidence interval 0.88 to 1.08), with moderate heterogeneity across MAs (I² = 45%). Subgroup and adjusted analyses led to consistent results.

CONCLUSION

We did not observe any significant difference in intervention effect estimates between PC-RCTs and ST-RCTs. Nevertheless, most of the medical fields in this meta-epidemiological study were not representative of the pathologies encountered in primary care. Further studies with pathologies more frequently encountered in primary care are needed.

Evaluation of external validity of the OVHIPEC-1 trial in a real-world population

OBJECTIVE

The OVHIPEC-1 trial (Phase III randomised clinical trial for stage III ovarian carcinoma randomising between interval cytoreductive surgery with or without hyperthermic intraperitoneal chemotherapy) showed improved survival when interval cytoreductive surgery (CRS) was combined with hyperthermic intraperitoneal chemotherapy in patients with stage III epithelial ovarian cancer (EOC). The authors compared the control arm of the trial with a real-world population treated in the Netherlands during the same period to explore generalizability of the trial results.

METHODS

For this nationwide comparative cohort study, all patients with EOC undergoing interval CRS between 2007 and 2016 were identified from the Netherlands Cancer Registry if they fulfilled the eligibility criteria of OVHIPEC-1 (n = 1376). Patient and treatment characteristics, and overall survival (OS) were compared between trial and real-world populations.

RESULTS

Age, comorbidity, BRCA status, histologic subtype, and residual disease were similar in trial and real-world patients. Trial patients had a better performance status, higher socioeconomic status, and underwent bowel surgery more often. In a real-world setting, patients more often received more than six cycles. The difference in OS between the trial and the real-world populations was not statistically significant (unadjusted hazard ratio, 1.09 [95% confidence interval, 0.87-1.37]; P = 0.44).

CONCLUSION

Despite differences in patient characteristics, OS of patients treated in the control arm of OVHIPEC-1 was similar to patients treated outside the trial. The trial population accurately represents real-world patients with stage III EOC undergoing interval CRS in terms of outcome.

Exploring uncertainty and use of real-world data in the National Institute for Health and Care Excellence single technology appraisals of targeted cancer therapy

OBJECTIVES

Dealing with uncertainty is one of the critical topics in health technology assessment. The greater decision uncertainty in appraisals, the less clear the clinical- and cost-effectiveness of the health technology. Although the development of targeted cancer therapies (TCTs) has improved patient health care, additional complexity has been introduced in drug appraisals due to targeting more specific populations. Real-world data (RWD) are expected to provide helpful information to fill the evidence gaps in appraisals. This study compared appraisals of TCTs with those of non-targeted cancer therapies (non-TCTs) regarding sources of uncertainty and reviewed how RWD have been used to supplement the information in these appraisals.

METHODS

This study reviews single technology appraisals (STAs) of oncology medicines performed by the National Institute for Health and Care Excellence (NICE) over 11 years up to December 2021. Three key sources of uncertainty were identified for comparison (generalisability of clinical trials, availability of direct treatment comparison, maturity of survival data in clinical trials). To measure the intensity of use of RWD in appraisals, three components were identified (overall survival, volume of treatment, and choice of comparators).

RESULTS

TCTs received more recommendations for provision through the Cancer Drugs Fund (27.7, 23.6% for non-TCT), whereas similar proportions were recommended for routine commissioning. With respect to sources of uncertainty, the external validity of clinical trials was greater in TCT appraisals (p = 0.026), whereas mature survival data were available in fewer TCT appraisals (p = 0.027). Both groups showed similar patterns of use of RWD. There was no clear evidence that RWD have been used more intensively in appraisals of TCT.

CONCLUSIONS

Some differences in uncertainty were found between TCT and non-TCT appraisals. The appraisal of TCT is generally challenging, but these challenges are neither new nor distinctive. The same sources of uncertainty were often found in the non-TCT appraisals. The uncertainty when appraising TCT stems from insufficient data rather than the characteristics of the drugs. Although RWD might be expected to play a more active role in appraisals of TCT, the use of RWD has generally been limited.

Transfer learning of individualized treatment rules from experimental to real-world data

Individualized treatment effect lies at the heart of precision medicine. Interpretable individualized treatment rules (ITRs) are desirable for clinicians or policymakers due to their intuitive appeal and transparency. The gold-standard approach to estimating the ITRs is randomized experiments, where subjects are randomized to different treatment groups and the confounding bias is minimized to the extent possible. However, experimental studies are limited in external validity because of their selection restrictions, and therefore the underlying study population is not representative of the target real-world population. Conventional learning methods of optimal interpretable ITRs for a target population based only on experimental data are biased. On the other hand, real-world data (RWD) are becoming popular and provide a representative sample of the target population. To learn the generalizable optimal interpretable ITRs, we propose an integrative transfer learning method based on weighting schemes to calibrate the covariate distribution of the experiment to that of the RWD. Theoretically, we establish the risk consistency for the proposed ITR estimator. Empirically, we evaluate the finite-sample performance of the transfer learner through simulations and apply it to a real data application of a job training program.

Eligibility criteria in clinical trials for cervical dystonia

INTRODUCTION

Cervical dystonia (CD) is the most common form of adult-onset focal dystonia. Because of a heterogeneous clinical presentation, the diagnosis rests on clinical opinion. During the last decades, several clinical trials have tested safety and efficacy of medical and surgical treatments for CD. We analyzed all the published CD trials and reviewed the strategies adopted for patient enrollment.

METHODS

The review included clinical trials in patients with CD published in PubMed. Studies were excluded if reviews, meta-analyses, post-hoc analyses on pooled data, or if not reporting a treatment for CD.

RESULTS

A total of 174 articles were identified; 134 studies met inclusion criteria. Diagnosis of CD varied among studies and in most cases was based on clinical judgement, using different descriptors such as "cervical dystonia" (37 studies), "idiopathic or isolated CD" (35), "primary CD" (13), and "torticollis" (40). Clinical judgement was supported by a phenomenological description of dystonia in four studies, and by a specific diagnostic strategy in other four. Finally, one study adopted general diagnostic criteria for dystonia. Inclusion and exclusion criteria proved heterogeneous across trials and were defined only in 108 studies, mainly considering age or the phenomenological pattern of muscle involvement.

CONCLUSION

The review showed lack of consolidated diagnostic criteria and non-uniformity of eligibility criteria for CD across clinical trials. There is need to move beyond clinical judgement as diagnostic criterion for selecting participants. New trials assessing specific CD patient subgroups or comparing medical and surgical procedures will need grounds that are more consistent.

Effectiveness of medical rehabilitation in persons with back pain - lessons learned from a German cohort study

PURPOSE

Evidence for health-related effects of German medical rehabilitation programs for back pain is inconclusive. This cohort study aimed to examine the effectiveness of medical rehabilitation in residents with back pain (German Clinical Trial Register: DRKS00011554).

MATERIAL AND METHODS

A sample of 45 000 people aged 45-59 years was randomly drawn from two pension agencies. We used propensity score matching to compare persons with back pain who completed a medical rehabilitation program with similar untreated subjects. Questionnaire data were assessed in 2017 and 2019, and linked with administrative data. The primary outcome was pain disability.

RESULTS

In total, 6610 persons with back pain were considered for matching and we finally compared 200 persons treated in a medical rehabilitation program with 200 untreated subjects. Pain disability was reported more favorable in the control group without medical rehabilitation compared to the intervention group (difference = 4.2; 95% CI -0.8-9.2), as well as other secondary outcomes.

CONCLUSIONS

At first glance, the findings suggest that medical rehabilitation was ineffective in improving health, pain and work ability among employed persons with back pain, but we found plausible explanations indicating that the estimated effects in favor of the untreated subjects are methodologically induced.IMPLICATIONS FOR REHABILITATIONPropensity score matching can be used to assess the effects of multimodal interventions in persons with back pain in routine care.Inappropriate recruitment of controls may underestimate treatment effects.When using observational data and propensity score matching to analyze the effectiveness of medical rehabilitation, baseline survey should be conducted directly before the start of rehabilitation to identify comparable controls.

External Validity of Randomised Controlled Trials on Carotid Revascularisation: Trial Populations May Not Always Reflect Patients in Clinical Practice

OBJECTIVE

The external validity of randomised controlled trials (RCTs) and their transferability to clinical practice is under investigated. This study aimed to analyse the exclusion criteria of recent carotid RCTs comparing carotid endarterectomy (CEA) and carotid artery stenting, and to assess the eligibility of consecutive clinical practice cohorts to those RCTs.

METHODS

An analysis of the clinical and anatomical exclusion criteria of RCTs for asymptomatic (SPACE-2, ACST-2, CREST-1, and CREST-2) and symptomatic carotid stenosis (SPACE-1, CREST-1, ICSS, and EVA-3S) was performed. Two hundred consecutive asymptomatic and 200 consecutive symptomatic patients, treated by CEA, or transfemoral or transcarotid artery stenting at a tertiary referral university centre were assessed for their potential eligibility for each corresponding RCT. RCT patient data were pooled and differences from the clinical practice cohort analysed. Statistics were descriptive and comparative using Fisher's exact and t tests.

RESULTS

The number of clinical and anatomical exclusion criteria differed widely between RCTs. Potential eligibility rates of the clinical practice cohort for RCTs with regard to asymptomatic carotid stenosis were 80.5% (ACST-2), 79.5% (SPACE-2), 47% (CREST-1), and 20% (CREST-2). For RCTs on symptomatic carotid stenosis the eligibility rates were 89% (ICSS), 86.5% (EVA-3S), 64% (SPACE-1), and 39% (CREST-1). Both clinical practice cohorts were older by about three years and patients were more often male vs. the RCTs. Furthermore, a history of smoking (asymptomatic patients), hypertension (symptomatic patients), and atrial fibrillation was diagnosed more often, whereas hypercholesterolaemia and coronary heart disease (asymptomatic patients) were less prevalent. More clinical practice patients were on antiplatelets, anticoagulants, and lipid lowering drugs. Symptomatic clinical practice patients presented more often with retinal ischaemia and less often with minor hemispheric strokes than patients in the RCTs.

CONCLUSION

The external validity of contemporary carotid RCTs varies considerably. Patients in routine clinical practice differ from RCT populations with respect to age, comorbidities, and medication. These data are of interest for clinicians and guideline authors and may be relevant for the design of future comparative trials.

Effectiveness and Safety of Tofacitinib for Ulcerative Colitis: Systematic Review and Meta-analysis

BACKGROUND

The objective of our systematic review and meta-analysis was to evaluate the effectiveness and safety of tofacitinib in the treatment of moderate-severe ulcerative colitis (UC).

METHODS

We searched Medline, Embase, Web of Science, and Cochrane Central to identify articles and abstracts reporting efficacy or safety data on tofacitinib use in UC. Primary outcome assessed was remission. Secondary outcomes included clinical response, steroid free remission, and adverse events (AEs).

RESULTS

A total of 26 studies were included. The rates of remission were 29.81% [95% confidence interval (CI): 22.37%-37.25%, I2 : 90%] at week 8, 32.27% (95% CI: 27.67%-36.88%, I2 : 42%) at 6 months and 38.03% (95% CI: 33.59%-42.48%, I2 : 0%) at 1-year. Clinical response rates were 59.41% (95% CI: 55.03%-63.94%, I2 : 61%) at week 8, 48.99% (95% CI: 36.92%-61.06%, I2 : 91%) at 6 months and 50.87% (95% CI: 42.16%-59.58%, I2 : 67%) at 1-year. Odds ratio of clinical response at week 8 in biologic naive versus biologic experienced patients was 1.59 (95% CI: 0.54-4.63). Pooled incidence rate for serious infections, major adverse cardiovascular events, and nonmelanotic squamous cell malignancies across all doses was 4.41 per 100-patient years (PYs) (95% CI: 2.32-8.38 per 100-PY, I2 : 78%), 0.91 per 100-PY (95% CI: 0.43-1.93 per 100-PY, I2 : 37%) and 0.91 per 100-PY (95% CI: 0.61-1.34 per 100-PY, I2 : 0%), respectively. Higher dose was associated with an increased frequency of AEs.

CONCLUSIONS

While the overall efficacy and safety of tofacitinib in moderate-severe UC is consistent with clinical trial data, the dose dependent increase in AEs highlights the significance of early dose de-escalation. Rate of clinical response after tofacitinb induction was similar in biologic naive and biologic experienced patients.

DEcrease STress through RESilience training for Students (DESTRESS) Study: Protocol for a randomized controlled trial nested in a longitudinal observational cohort study

INTRODUCTION

Chronic stress and burnout are highly prevalent among academically trained healthcare professionals, negatively affecting their well-being and capacity to engage in their work. Resilience to stress develops early in one's career path, hence offering resilience training to university students in these professions is one approach to fostering well-being and mental health. The aim of this study is to assess whether offering mindfulness-based resilience training to university students in healthcare professions reduces their perceived chronic stress.

METHODS AND ANALYSIS

The study has a hybrid design combining a longitudinal observational cohort with a nested randomized controlled trial (RCT) with sequential multiple assignment and multistage adaptive interventions while taking participants' preferences into account. All students in healthcare related programmes at the Erasmus University Rotterdam are invited to participate. Within the observational cohort, students with a score of 14 or higher on the Perceived Stress Scale (PSS) are invited to take part in the RCT (n = 706). Eligible participants are randomized to control or active intervention in a ratio of 1:6. Those randomized to the control group and non-randomized participants in the cohort receive passive web-based psychoeducation about chronic stress and burnout through referral to specific websites. Participants randomized to the intervention group receive one of 8 active mindfulness-based interventions. They select a rank order of 4 preferred interventions and are randomized across these with equal probability. Non-response to the intervention is followed by sequential randomized assignment to another intervention, for a total maximum of 3 sequential interventions. All participants receive questionnaires at baseline, before and after each 8-week intervention period, and at 1- and 2-year follow-up. The primary outcome is perceived chronic stress measured with the PSS. Secondary outcomes include mental well-being, burnout, quality of life, healthcare utilization, drug use, bodyweight, mental and physical stress-related symptoms, resilience, and study progress.

ETHICS AND REGISTRATION

Approval from the Medical Ethics Review Committee was obtained under protocol number MEC-2018-1645. The trial is registered in the Netherlands National Trial Register by registration number NL7623, 22/03/2019, https://www.trialregister.nl/.

Antihypertensive Deprescribing in Older Adults: a Practical Guide

PURPOSE OF REVIEW

To summarise evidence on both appropriate and inappropriate antihypertensive drug withdrawal.

RECENT FINDINGS

Deprescribing should be attempted in the following steps: (1) identify patients with several comorbidities and significant functional decline, i.e. people at higher risk for negative outcomes related to polypharmacy and lower blood pressure; (2) check blood pressure; (3) identify candidate drugs for deprescribing; (4) withdraw medications at 4-week intervals; (5) monitor blood pressure and check for adverse events. Although evidence is accumulating regarding short-term outcomes of antihypertensive deprescribing, long-term effects remain unclear. The limited evidence for antihypertensive deprescribing means that it should not be routinely attempted, unless in response to specific adverse events or following discussions between physicians and patients about the uncertain benefits and harms of the treatment.

PERSPECTIVES

Clinical controlled trials are needed to examine the long-term effects of deprescribing in older subjects, especially in those with comorbidities, and significant functional decline.

Chemotherapy-Induced Toxicities and Their Associations with Clinical and Non-Clinical Factors among Breast Cancer Patients in Vietnam

Understanding the burden and factors related to chemotherapy-induced toxicity is important in treatment planning for breast cancer patients. We conducted a prospective study among 396 newly diagnosed and chemotherapy-treated breast cancer patients recruited in two major cancer hospitals in northern Vietnam. Toxicities were captured through medical chart reviews and patient self-reports and graded using NCI CTCAE classification. Associations for sociodemographic and clinical factors with chemotherapy-induced toxicities during first-line chemotherapy were evaluated via multivariable logistic regression. Severe (i.e., grade ≥ 3) hematological (38.6%), and gastrointestinal (12.9%) toxicities were common. A pre-existing nephrological condition was significantly associated with the risk of severe hematological toxicity with adjusted odds ratios (OR) and 95% confidence intervals (CIs) of 2.30 (1.32-4.01). Patients living in rural areas had a lower risk of severe hematological toxicity (OR = 0.48; 95% CI, 0.30-0.77). Patients diagnosed with stage II and stage III-IV had a lower risk of severe gastrointestinal toxicity with ORs and 95% CIs of 0.26 (0.12-0.59) and 0.47 (0.20-1.10), respectively. Triple-negative/basal-like subtype was associated with a higher risk of severe hematological (OR = 3.15; 95% CI, 1.56-6.34) and gastrointestinal toxicities (OR = 3.60; 95% CI, 1.45-8.95) comparing to hormone receptor (HR)-positive HER2-negative subtype. Further research investigating underlying mechanisms would facilitate the development and delivery of personalized treatment and care plans.

Effect of a Run-In Period on Estimated Treatment Effects in Cardiovascular Randomized Clinical Trials: A Meta-Analytic Review

Background A run-in period may increase adherence to intervention and reduce loss to follow-up. Whether use of a run-in period affects the magnitude of treatment effects is unknown. Methods and Results We conducted a meta-analysis comparing treatment effects from 11 systematic reviews of cardiovascular prevention trials using a run-in period with matched trials not using a run-in period. We matched run-in with non-run-in trials by population, intervention, control, and outcome. We calculated a ratio of relative risks (RRRs) using a random-effects meta-analysis. Our primary outcome was a composite of cardiovascular events, and the primary analysis was a matched comparison of clinical trials using a run-in period versus without a run-in period. We identified 66 run-in trials and 111 non-run-in trials (n=668 901). On meta-analysis there was no statistically significant difference in the magnitude of treatment effect between run-in trials (relative risk [RR], 0.83 [95% CI, 0.80-0.87]) compared with non-run-in trials (RR, 0.88 [95% CI, 0.84-0.91]; RRR, 0.95 [95% CI, 0.90-1.01]). There was no significant difference in the RRR for secondary outcomes of all-cause mortality (RRR, 0.97 [95% CI, 0.91-1.03]) or medication discontinuation because of adverse events (RRR, 1.05 [95% CI, 0.85-1.21]). Post hoc exploratory univariate meta-regression showed that on average a run-in period is associated with a statistically significant difference in treatment effect (RRR, 0.94 [95% CI, 0.90-0.99]) for cardiovascular composite outcome, but this was not statistically significant on multivariable meta-regression analysis (RRR, 0.95 [95% CI, 0.90-1.0]). Conclusions The use of a run-in period was not associated with a difference in the magnitude of treatment effect among cardiovascular prevention trials.

The multimorbidity collaborative medication review and decision making (MyComrade) study: a pilot cluster randomised trial in two healthcare systems

BACKGROUND

While international guidelines recommend medication reviews as part of the management of multimorbidity, evidence on how to implement reviews in practice in primary care is lacking. The MyComrade (MultimorbiditY Collaborative Medication Review And Decision Making) intervention is an evidence-based, theoretically informed novel intervention which aims to support the conduct of medication reviews for patients with multimorbidity in primary care.

AIM

The pilot study aimed to assess the feasibility of a definitive trial of the MyComrade intervention across two healthcare systems (Republic of Ireland (ROI) and Northern Ireland (NI)).

DESIGN

A pilot cluster-randomised controlled trial was conducted (clustered at general practice level), using specific progression criteria and a process evaluation framework.

SETTING

General practices in the ROI and NI.

PARTICIPANTS

Eligible practices were those in defined geographical areas who had GP's and Practice Based Pharmacists (PBP's) (in NI) willing to conduct medication reviews. Eligible patients were those aged 18 years and over, with multi morbidity and on ten or more medications.

INTERVENTION

The MyComrade intervention is an evidence-based, theoretically informed novel intervention which aims to support the conduct of medication reviews for patients with multimorbidity in primary care, using a planned collaborative approach guided by an agreed checklist, within a specified timeframe.

OUTCOME MEASURES

Feasibility outcomes, using pre-determined progression criteria, assessed practice and patient recruitment and retention and intervention acceptability and fidelity. Anonymised patient-related quantitative data, from practice medical records and patient questionnaires were collected at baseline, 4 and 8 months, to inform potential outcome measures for a definitive trial. These included (i) practice outcomes-completion of medication reviews; (ii) patient outcomes-treatment burden and quality of life; (iii) prescribing outcomes-number and changes of prescribed medications and incidents of potentially inappropriate prescribing; and (iv) economic cost analysis. The framework Decision-making after Pilot and feasibility Trials (ADePT) in conjunction with a priori progression criteria and process evaluation was used to guide the collection and analysis of quantitative and qualitative data.

RESULTS

The recruitment of practices (n = 15) and patients (n = 121, mean age 73 years and 51% female), representing 94% and 38% of a priori targets respectively, was more complex and took longer than anticipated; impacted by the global COVID-19 pandemic. Retention rates of 100% of practices and 85% of patients were achieved. Both practice staff and patients found the intervention acceptable and reported strong fidelity to the My Comrade intervention components. Some practice staff highlighted concerns such as poor communication of the reviews to patients, dissatisfaction regarding incentivisation and in ROI the sustainability of two GPs collaboratively conducting the medication reviews. Assessing outcomes from the collected data was found feasible and appropriate for a definitive trial. Two progression criteria met the 'Go' criterion (practice and patient retention), two met the 'Amend' criterion (practice recruitment and intervention implementation) and one indicated a 'Stop - unless changes possible' (patient recruitment).

CONCLUSION

The MyComrade intervention was found to be feasible to conduct within two different healthcare systems. Recruitment of participants requires significant time and effort given the nature of this population and the pairing of GP and pharmacist may be more sustainable to implement in routine practice.

TRIAL REGISTRATION

Registry: ISRCTN, ISRCTN80017020 ; date of confirmation 4/11/2019; retrospectively registered.

Comparison of Characteristics and Outcomes of Veterans With Stable Ischemic Heart Disease Enrolled in the COURAGE Trial Versus the Veterans Affairs Clinical Assessment, Reporting, and Tracking Program

Randomized clinical trials have not demonstrated a survival benefit with percutaneous coronary intervention in stable ischemic heart disease (SIHD). We evaluated the generalizability of the COURAGE (Clinical Outcomes Utilizing Revascularization and Aggressive Drug Evaluation) trial findings to the broader population of veterans with SIHD. Veterans who underwent coronary angiography between 2005 and 2013 for SIHD were identified from the Veterans Affairs Clinical Assessment, Reporting and Tracking Program (VA CART). Patient-level comparisons were made between patients from VA CART who met the eligibility criteria for COURAGE and veterans enrolled in COURAGE between 1999 and 2004. All-cause mortality over long-term follow-up was assessed using Cox proportional hazards models. COURAGE-eligible patients from VA CART (n = 59,758) were older, had a higher body mass index, a greater prevalence of co-morbidities, but fewer diseased vessels on index coronary angiography, and were less likely to be on optimal medical therapy at baseline and on 1-year follow-up compared with VA COURAGE participants (n = 968). Patients from VA CART (median follow-up 6.5 years) had higher all-cause mortality (adjusted hazard ratio [aHR] 1.98 [1.61 to 2.43]) than participants from VA COURAGE (median follow-up: 4.6 years). Risks of mortality were greater in the 56.4% patients from CART who were medically managed (aHR 1.94 [1.49 to 2.53]) and in the 43.6% who underwent percutaneous coronary intervention (aHR 1.99 [1.45 to 2.74]), compared with their respective VA COURAGE arms. In conclusion, in this noncontemporaneous patient-level analysis, veterans in the randomized COURAGE trial had more favorable outcomes than the population of veterans with SIHD at large.

A Systematic Review of Sex-Specific Reporting in Heart Failure Clinical Trials: Trial Flow and Results

Background

Females are historically underenrolled in heart failure (HF) randomized controlled trials (RCTs) relative to disease prevalence. Sex differences in trial flow, including withdrawals and losses to follow up, may further limit the generalizability of results.

Objectives

This study aimed to assess the frequency of sex-specific reporting of trial flow, treatment efficacy, and adverse events in HF RCTs.

Methods

We systematically searched MEDLINE, Embase, and CINAHL for HF RCTs published between 2000 and 2020 in journals with an impact factor ≥10. We assessed whether trial flow, treatment effect, and adverse events were disaggregated by sex. We used multivariable regression to assess associations between trial characteristics and sex subgroup analysis. We analyzed temporal trends in sex-specific reporting.

Results

We included 224 RCTs with 228,801 total participants (28.2% female). No RCT reported sex-disaggregated screening, consent, or withdrawal rates; and 2 (0.9%) reported sex-disaggregated losses to follow-up. Seventy-five RCTs (33.4%) presented sex subgroup analysis, and 63 (28.3%) reported sex-treatment interaction. No RCT reported sex-specific adverse events. Large trial size (odds ratio: 13.16, 95% CI: 5.67-30.52; P < 0.001) and device/procedure interventions (odds ratio: 5.13, 95% CI: 1.55-16.95; P < 0.007) were independently associated with sex subgroup analysis. Over the study period, there was an increase in sex subgroup analysis (P < 0.001) and testing for sex-treatment interaction (P < 0.001).

Conclusions

HF RCTs rarely reported sex differences in trial flow or adverse events and uncommonly performed sex subgroup analysis. Improved sex-disaggregated reporting could highlight the causes and extent of sex differences in trial participation and facilitate appropriate inferences about treatment effect.

COVID-19 Vaccines against Omicron Variant: Real-World Data on Effectiveness

The efficacy of vaccines against coronavirus disease 2019 (COVID-19) has now been well established in phase III clinical trials. However, clinical studies based on real-world data remain critical to assess vaccines effectiveness (VE), especially in specific populations and against variants of concern (VOC). This review presents the principles and methods of VE studies and the main available results on VE of COVID-19 vaccines at the time of Omicron circulation. References for this narrative review were identified through searches of PubMed database up to 13 September 2022. The results of phase III clinical trials have been globally confirmed by VE in real-life studies, including in the elderly. Emergence of VOC Omicron emphasized the importance of booster doses to maintain a high level of protection against severe forms. There are still numerous challenges regarding booster(s) and duration of immunity, particularly in specific subpopulations, and regarding the need for adapted vaccines.

Outcomes of Patients with Metastatic Colorectal Cancer Treated with Trifluridine/Tipiracil beyond the Second Line: A Multicenter Retrospective Study from Saudi Arabia

BACKGROUND

The outcome of patients with refractory metastatic colorectal cancer (mCRC) treated with trifluridine/tipiracil (FTD/TPI) beyond the second-line has not been studied in Saudi Arabia. Therefore, this multicenter retrospective analysis was conducted to evaluate the efficacy of FTD/TPI.

METHODS

This multicenter retrospective analysis included five centers in Saudi Arabia. FTD/TPI was administered to all the patients beyond the oxaliplatin- and irinotecan-based chemotherapy regimens. The electronic medical records were reviewed, and progression-free survival (PFS) and overall survival (OS) were determined.

RESULTS

The study included 100 patients with a mean age of 55.4 ± 11.8 years. The overall response to FTD/TPI was 4%. The median PFS was 4 months (95% confidence interval (CI) 3.487-4.513), and the median OS was 11 months (95% CI, 9.226-12.771). In a Cox regression analysis of the independent predictors for PFS, advanced stage of the disease (P = 0.037; HR, 2.614; and CI, 1.102-7.524), presence of lymph node metastasis (P = 0.018; HR, 3.664; and 95% CI, 1.187-8.650), and >2 metastatic sites (P = 0.020; HR, 1.723; and 95% CI, 1.089-2.727) were independent factors predicting disease progression. The Cox regression analysis confirmed that age ≥ 55 years (P = 0.046; HR, 1.667; and 95%, 1.097-3.100), advanced disease stage (P = 0.044; HR, 1.283; and 95% CI, 1.035-2.940), prior use of adjuvant chemotherapy (P = 0.037; HR, 0.892; and 95% CI, 0.481-0.994), liver metastasis (P = 0.025; HR, 2.015; and 95% CI, 1.091-3.720), >2 metastatic sites (P = 0.038; HR, 1.248; and 95% CI, 1.036-1.846), development of neutropenia after receiving first cycle of FTD/TPI (P = 0.042; HR, 1.505; and 95% CI, 1.064-2.167), and increased number of FTD/TPI cycles (P = 0.002; HR, 0.769; and 95% CI, 0.664-0.891) were independent variables for OS.

CONCLUSION

Treatment with FTD/TPI is feasible and effective in daily clinical practice in Saudi Arabian patients. The risk of progression increased with advanced disease stage, lymph node metastasis, bone metastasis, and metastasis to >2 sites. Age ≥ 55 years, advanced disease stage, liver metastasis, metastasis to >2 sites, neutropenia after the first cycle of FTD/TPI, and increased number of FTD/TPI cycles were independent factors predicting mortality.

The Association of Readmission Reduction Activities with Primary Care Practice Readmission Rates

BACKGROUND

A great deal of research has focused on how hospitals influence readmission rates. While hospitals play a vital role in reducing readmissions, a significant portion of the work also falls to primary care practices. Despite this critical role of primary care, little empirical evidence has shown what primary care characteristics or activities are associated with reductions in hospital admissions.

OBJECTIVE

To examine the relationship between practices' readmission reduction activities and their readmission rates.

DESIGN, SETTING, AND PARTICIPANTS

A retrospective study of 1,788 practices who responded to the National Survey of Healthcare Organizations and Systems (fielded 2017-2018) and 415,663 hospital admissions for Medicare beneficiaries attributed to those practices from 2016 100% Medicare claims data. We constructed mixed-effects logistic regression models to estimate practice-level readmission rates and a linear regression model to evaluate the association between practices' readmission rates with their number of readmission reduction activities.

INTERVENTIONS

Standardized composite score, ranging from 0 to 1, representing the number of a practice's readmission reduction capabilities. The composite score was composed of 12 unique capabilities identified in the literature as being significantly associated with lower readmission rates (e.g., presence of care manager, medication reconciliation, shared-decision making, etc.).

MAIN OUTCOMES AND MEASURES

Practices' readmission rates for attributed Medicare beneficiaries.

KEY RESULTS

Routinely engaging in more readmission reduction activities was significantly associated (P < .05) with lower readmission rates. On average, practices experienced a 0.05 percentage point decrease in readmission rates for each additional activity. Average risk-standardized readmission rates for practices performing 10 or more of the 12 activities in our composite measure were a full percentage point lower than risk-standardized readmission rates for practices engaging in none of the activities.

CONCLUSIONS

Primary care practices that engaged in more readmission reduction activities had lower readmission rates. These findings add to the growing body of evidence suggesting that engaging in multiple activities, rather than any single activity, is associated with decreased readmissions.

Association of Intraventricular Fibrinolysis With Clinical Outcomes in Intracerebral Hemorrhage: An Individual Participant Data Meta-Analysis

BACKGROUND

In patients with intracerebral hemorrhage (ICH), the presence of intraventricular hemorrhage constitutes a promising therapeutic target. Intraventricular fibrinolysis (IVF) reduces mortality, yet impact on functional disability remains unclear. Thus, we aimed to determine the influence of IVF on functional outcomes.

METHODS

This individual participant data meta-analysis pooled 1501 patients from 2 randomized trials and 7 observational studies enrolled during 2004 to 2015. We compared IVF versus standard of care (including placebo) in patients treated with external ventricular drainage due to acute hydrocephalus caused by ICH with intraventricular hemorrhage. The primary outcome was functional disability evaluated by the modified Rankin Scale (mRS; range: 0-6, lower scores indicating less disability) at 6 months, dichotomized into mRS score: 0 to 3 versus mRS: 4 to 6. Secondary outcomes included ordinal-shift analysis, all-cause mortality, and intracranial adverse events. Confounding and bias were adjusted by random effects and doubly robust models to calculate odds ratios and absolute treatment effects (ATE).

RESULTS

Comparing treatment of 596 with IVF to 905 with standard of care resulted in an ATE to achieve the primary outcome of 9.3% (95% CI, 4.4-14.1). IVF treatment showed a significant shift towards improved outcome across the entire range of mRS estimates, common odds ratio, 1.75 (95% CI, 1.39-2.17), reduced mortality, odds ratio, 0.47 (95% CI, 0.35-0.64), without increased adverse events, absolute difference, 1.0% (95% CI, -2.7 to 4.8). Exploratory analyses provided that early IVF treatment (≤48 hours) after symptom onset was associated with an ATE, 15.2% (95% CI, 8.6-21.8) to achieve the primary outcome.

CONCLUSIONS

As compared to standard of care, the administration of IVF in patients with acute hydrocephalus caused by intracerebral and intraventricular hemorrhage was significantly associated with improved functional outcome at 6 months. The treatment effect was linked to an early time window <48 hours, specifying a target population for future trials.

Assessment of the external validity of the National Comprehensive Cancer Network (NCCN) guidelines for pancreatic ductal adenocarcinoma in a population of older patients aged 70 years and older

INTRODUCTION

Pancreatic ductal adenocarcinoma (PDAC) mainly occurs in older adults. Since randomized clinical trials (RCTs) provide the highest-quality evidence incorporated in NCCN recommendations, the underrepresentation of older patients in RCTs challenges guidelines' external validity and limits the solidity of evidence in this specific population.

MATERIALS AND METHODS

The study aimed to investigate external validity of NCCN guidelines for PDCA and the impact of reference studies eligibility on overall survival (OS) in a real-world older population. We retrieved RCTs supporting NCCN recommendations for management of PDAC and identified ten topics. We matched a cohort of 707 PDAC patients aged ≥70 years from the Moffitt Cancer Center database with eligibility criteria of 96 reference RCTs to check the proportion of patients eligible for at least two RCTs. Eligibility >60% was rated full validity, 30%-60% partial validity and < 30% limited validity. We also performed log-rank test to assessed whether "eligibility" status affects OS, stratifying by age (70-74; 75-79; ≥80).

RESULTS AND DISCUSSION

We found full validity for neoadjuvant (57/73 patients; 69.86%), locally advanced (28/39; 71.79%) and second line (88/110; 80%) treatment, while lowest validity was found for adjuvant chemotherapy (37/86; 43%). Eligible status was correlated with a significant OS benefit for adjuvant chemoradiation (p = 0.002) in all-comers and for first-line polychemotherapy in patients aged ≥80 (p = 0.01). Our analysis supports the limitation of guidelines' external validity in older patients, and hints at possible correlations with survival, although no definitive conclusions can be drawn at this stage. Renewing RCT design with broader eligibility criteria might help increase inclusion of older and thus strengthen the evidence.