A comparison of observational studies and randomized, controlled trials

Systematic reviews and meta-analyses in neurosurgery part I: interpreting and critically appraising as a guide for clinical practice

Neurosurgeons are inundated with the Herculean task to keep abreast with the rapid pace at which clinical research is proliferating. Systematic reviews and meta-analyses (SRMAs) have consequently surged in popularity because when executed properly, they constitute the highest level of evidence, and may save busy neurosurgeons many hours of combing the literature. Well-executed SRMAs may prove instructive for clinical practice, but poorly conducted reviews sow confusion and may potentially cause harm. Unfortunately, many SRMAs within neurosurgery are relatively lackluster in methodological rigor. When neurosurgeons apply the results of an SRMA to patient care, they should start by evaluating the extent to which the employed methods have likely protected against misleading results. The present article aims to educate the reader about how to interpret an SRMA, to assess the potential relevance of its results in the special context of the neurosurgical patient population.

Impact of neoadjuvant chemotherapy on short-term outcomes after simple and complex minimally invasive minor hepatectomy for colorectal liver metastases: A propensity-score matched and coarsened exact matched study

BACKGROUND

In the last three decades, minimally invasive liver resection has been replacing conventional open approach in liver surgery. More recently, developments in neoadjuvant chemotherapy have led to increased multidisciplinary management of colorectal liver metastases with both medical and surgical treatment modalities. However, the impact of neoadjuvant chemotherapy on the surgical outcomes of minimally invasive liver resections remains poorly understood.

METHODS

A multicenter, international, database of 4998 minimally invasive minor hepatectomy for colorectal liver metastases was used to compare surgical outcomes in patients who received neoadjuvant chemotherapy with surgery alone. To correct for baseline imbalance, propensity score matching, coarsened exact matching and inverse probability treatment weighting were performed.

RESULTS

2546 patients met the inclusion criteria. After propensity score matching there were 759 patients in both groups and 383 patients in both groups after coarsened exact matching. Baseline characteristics were equal after both matching strategies. Neoadjuvant chemotherapy was not associated with statistically significant worse surgical outcomes of minimally invasive minor hepatectomy.

CONCLUSION

Neoadjuvant chemotherapy had no statistically significant impact on short-term surgical outcomes after simple and complex minimally invasive minor hepatectomy for colorectal liver metastases.

Use and reporting of inverse-probability-of-treatment weighting for multicategory treatments in medical research: a systematic review

OBJECTIVES

Causal inference methods for observational data represent an alternative to randomised controlled trials when they are not feasible or when real-world evidence is sought. Inverse-probability-of-treatment weighting (IPTW) is one of the most popular approaches to account for confounding in observational studies. In medical research, IPTW is mainly applied to estimate the causal effect of a binary treatment, even when the treatment has in fact multiple categories, despite the availability of IPTW estimators for multiple treatment categories. This raises questions about the appropriateness of the use of IPTW in this context. Therefore, we conducted a systematic review of medical publications reporting the use of IPTW in the presence of a multi-category treatment. Our objectives were to investigate the frequency of use and the implementation of these methods in practice, and to assess the quality of their reporting.

STUDY DESIGN AND SETTING

Using Pubmed, Embase and Web of Science, we screened 5660 articles and retained 106 articles in the final analysis that were from 17 different medical areas. This systematic review is registered on PROSPERO (CRD42022352669).

RESULTS

The number of treatment groups varied between 3 and 9, with a large majority of articles (90 [84.9%]) including 3 or 4 groups. The most commonly used method for estimating the weights was multinomial regression (51 [48.1%]) and generalized boosted models (48 [45.3%]). The covariates of the weight model were reported in 91 articles (85.9 %). Twenty-six articles (24.5 %) did not discuss the balance of covariates after weighting, and only 16 articles (15.1 %) referred to the assumptions needed to obtain correct inferences.

CONCLUSION

The results of this systematic review illustrate that medical publications scarcely use IPTW methods for more than two treatment categories. Among the publications that did, the quality of reporting was suboptimal, in particular in regard to the assumptions and model building. IPTW for multi-category treatments could be applied more broadly in medical research, and the application of the proposed guidelines in this context will help researchers to report their results and to ensure reproducibility of their research.

Effectiveness of web-based guided self-help cognitive behavioral therapy-enhanced for binge-eating disorder: An implementation study

INTRODUCTION

Web-based guided self-help cognitive behavioral therapy-enhanced (CBT-E) is a 12-weeks, 12-sessions, digitalized version of part II of the self-help book Overcoming Binge Eating. This intervention is effective when offered under controlled circumstances in a randomized-controlled-trial. It is unknown how patients with binge-eating disorder (BED) respond to this intervention when offered in real-world clinical-settings. The aim of this study is to examine post-intervention effectiveness of guided self-help CBT-E for BED in real-world settings.

METHOD

The present study used a cohort-design examining the effectiveness of web-based guided self-help CBT-E according to an intention-to-treat (ITT) analysis. BED patients (n = 278) were assessed pre- and post-intervention. The primary outcome was reduction in binge-eating episodes. Other outcomes were full-recovery (EDE-Q score <2.77 and abstinence from binge-eating episodes), impaired psychosocial functioning, defined as secondary impairment, and general psychopathology post-intervention.

RESULTS

The number of binge-eating episodes reduced by an average of 16 binge-eating episodes per 4 weeks pre-intervention to five binge-eating episodes during the last 4 weeks of treatment. Abstinence from binge eating was reported by 30%, and 28% reported full recovery. Effect sizes (Cohen's d) were large (d ≥ 1.0) for all outcome measures. There were no differences in outcomes between the ITT and the completers sample.

DISCUSSION

Guided self-help CBT-E is associated with significant improvements. The effects of guided self-help CBT-E offered in a real-world-setting are comparable to self-help CBT-E offered in a randomized-controlled-trial. However, it should be noted that comparisons with randomized-controlled-trials requires caution. Longer-term follow-up data are necessary to measure persistence of treatment benefits.

PUBLIC SIGNIFICANCE

Offering CBT-E as a web-based guided self-help intervention has several benefits for patients with BED. Guided self-help CBT-E is associated with significant improvements on the short term when offered in real-world clinical settings.

Evidence-Based Medicine and Observational Studies

Evidence-based medicine drives medical decision-making in the modern era, which has historically favored randomized control trials. Despite their notoriety, randomized control trials have multiple disadvantages when applied to spinal surgery. Observational studies are popular in spinal surgery literature and are seen in various forms, such as retrospective studies and prospective cohort studies. For researchers, learners, and practicing spine surgeons, this paper describes options for study design when applied to spinal surgery.

Natural Experiments as a Study Method in Spinal Trauma Surgery: A Systematic Review

STUDY DESIGN

Systematic review.

OBJECTIVES

To determine if the natural experiment design is a useful research methodology concept in spinal trauma care, and to determine if this methodology can be a viable alternative when randomized controlled trials are either infeasible or unethical.

METHODS

A Medline, Embase and Cochrane database search was performed between 2004 and 2023 for studies comparing different treatment modalities of spinal trauma. All observational studies with a natural experiment design comparing different treatment modalities of spinal trauma were included. Data extraction and quality assessment with the MINORS criteria was performed.

RESULTS

Four studies with a natural experiment design regarding patients with traumatic spinal fractures were included. All studies were retrospective, one study collected follow-up data prospectively. Three studies compared different operative treatment modalities, whereas one study compared different antibiotic treatment strategies. Two studies compared preferred treatment modalities between expertise centers, one study between departments (neuro- and orthopedic surgery) and one amongst surgeons. For the included retrospective studies, MINORS scores (maximum score 18) were high ranging from 12-17 and with a mean (SD) of 14.6 (1.63).

CONCLUSIONS

Since 2004 only four studies using a natural experiment design have been conducted in spinal trauma. In the included studies, comparability of patient groups was high emphasizing the potential of natural experiments in spinal trauma research. Natural experiments design should be considered more frequently in future research in spinal trauma as they may help to address difficult clinical problems when RCT's are infeasible or unethical.

Exercise Training Improves Brachial Artery Endothelial Function, but Does Not Alter Inflammatory Biomarkers in Patients with Peripheral Artery Disease: a Systematic Review and Meta-analysis

The study aimed to systematically review the effects of exercise training (EX) on brachial artery flow-mediated dilation (FMD) and inflammatory biomarkers in patients with peripheral artery disease (PAD). Five electronic databases were searched: (i) patients with PAD aged ≥ 18; (ii) structured EX ≥ 2 weeks; (iii) measured brachial artery FMD; and (iv) measured blood inflammatory biomarkers. Eighteen studies met the inclusion criteria. EX increased FMD but had no effect on C-reactive protein, interleukin-6, and tumor necrosis factor-α. Subgroups with moderate intensity had a greater increase in FMD than subgroups with vigorous intensity. There was no difference in effect on FMD and three inflammatory biomarkers between subgroups training for ≤ 12 weeks and > 12 weeks of EX, < 50 min and ≥ 50 min of session duration, and < 150 min and ≥ 150 min of weekly volume, respectively. These results suggest that EX-induced improvement in vascular function can be independent of the improvement of systemic inflammation.

Effect of topical vancomycin powder on surgical site infection prevention in major orthopaedic surgery: a systematic review and meta-analysis of randomized controlled trials with trial sequential analysis

BACKGROUND

Evidence has been mixed regarding the effect of topical vancomycin (VCM) powder in reducing surgical site infection (SSI).

AIM

To clarify the effect of topical VCM powder for the prevention of SSI in major orthopaedic surgeries.

METHODS

The MEDLINE, Embase, CENTRAL, ICTRP, and ClinicalTrials.gov databases were searched from their inception to September 25th, 2023. Randomized controlled trials comparing topical VCM powder and controls for the prevention of SSI in major orthopaedic surgeries were included. Two reviewers independently screened the title and abstract and extracted relevant data, followed by the assessment of the risk of bias and the certainty of the evidence. Main outcome measures were overall SSI, reoperation, and adverse events. Summary results were obtained using random-effects meta-analysis. Trial sequential analysis (TSA) was performed.

FINDINGS

Eight randomized controlled trials yielded data on 4307 participants. VCM powder showed no difference in reducing overall SSI. The cumulative number of patients did not exceed the required information size of 19,233 in our TSA, and the Z-curves did not cross the trial sequential monitoring or futility boundary, suggesting an inconclusive result of the meta-analysis. No difference was found for reoperation. Among SSIs, VCM powder showed a statistically significant difference in reducing Gram-positive cocci SSI. However, the certainty of this evidence was very low.

CONCLUSION

This systematic review and meta-analysis suggests inconclusive results regarding the effect of VCM powder in reducing SSI in major orthopaedic surgeries. Further trials using rigorous methodologies are required to elucidate the effect of this intervention.

Immune Checkpoint Inhibitors and Cardiotoxicity: A Comparative Meta-Analysis of Observational Studies and Randomized Controlled Trials

BACKGROUND

Immune checkpoint inhibitors (ICIs) have uncommon associations with cardiotoxicity, yet these cardiotoxic effects are associated with high mortality. An accurate assessment of risk for cardiotoxicity is essential for clinical decision-making, but data from randomized controlled trials often differ from real-world observational studies.

METHODS AND RESULTS

A systematic search of PubMed, Embase, Cochrane Library, and Scopus was performed, including phase II and III randomized controlled trials (RCTs) and observational studies (OSs) reporting myocarditis or pericardial disease, myocardial infarction, or stroke with an immunotherapy. Odds ratios (ORs) were used to pool results between ICIs and other cancer therapy in RCTs and OSs. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses guideline was followed. In total, 54 RCTs (N=38 264) and 24 OSs (N=12 561 455) were included. In RCTs, ICI use resulted in higher risk of myocarditis (OR, 3.55 [95% CI, 2.10-5.98]), pericardial disease (OR, 2.73 [95% CI, 1.57-4.77]), and myocardial infarction (OR, 1.83 [95% CI, 1.03-3.25]), compared with non-ICI (placebo or chemotherapy). In OSs, ICI use was not associated with myocarditis, pericardial disease, or myocardial infarction compared with controls; however, combination ICIs demonstrated higher risk of myocarditis compared with single ICI use (OR, 3.07 [95% CI, 1.28-7.39]). Stroke risk was not increased with use of ICIs in RCTs.

CONCLUSIONS

We demonstrated increased risk of ICI myocarditis, pericardial disease, and myocardial infarction in RCTs but not OSs. Results of this study suggest there are differences between ICI cardiotoxicity risk, possibly suggesting differences in diagnoses and management, in clinical trials versus the OSs.

Invited Commentary: Combining Information to Answer Epidemiologic Questions About a Target Population

Epidemiologists are attempting to address research questions of increasing complexity by developing novel methods for combining information from diverse sources. Cole et al. (Am J Epidemiol. 2023;192(3)467-474) provide 2 examples of the process of combining information to draw inferences about a population proportion. In this commentary, we consider combining information to learn about a target population as an epidemiologic activity and distinguish it from more conventional meta-analyses. We examine possible rationales for combining information and discuss broad methodological considerations, with an emphasis on study design, assumptions, and sources of uncertainty.

A systematic review of neurological airway respiratory cardiovascular other-surgical severity (NARCO-SS) score as a pediatric perioperative scoring system

OBJECTIVE

To systematically identify and synthesize the available evidence of the neurological airway respiratory cardiovascular other-surgical severity (NARCO-SS) score as compared to other pediatric specific perioperative scoring systems.

DESIGN

This systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Review and Meta-analysis (PRISMA) statement. All studies in all languages comparing NARCO-SS with pediatric perioperative scoring systems against outcomes were included. Records were screened and data were extracted by three independent reviewers into standardized pilot-tested extraction templates.

DATA SOURCES

Electronic searches were performed in MEDLINE, Embase, Scopus, and CINAHL (from inception to February 2023).

REVIEW METHODS

The references were uploaded to a validated software for systematic reviews (Rayyan) and screened against the inclusion criteria. Full text of included studies were reviewed and the available data were tabulated. We conducted Risk of Bias analysis on the included studies using the Prediction model Risk Of Bias ASsessment Tool (PROBAST).

RESULTS

A meta-analysis could not be performed due to differences in outcome definitions across the included studies. Correlations between NARCO-SS scores, ASA-PS scores and the predefined outcomes of each study were presented as a narrative synthesis. The included studies were determined to have a high risk of bias using the PROBAST.

CONCLUSIONS

This review has identified a need for high-quality studies assessing NARCO-SS before recommendations for clinical practice can be made. Addressing its limitations and enhancing the NARCO-SS through targeted refinements of its individual descriptive categories could potentially lead to improvement in its overall predictive accuracy and facilitate wider adoption into clinical practice.

Digital mental health interventions as stand-alone vs. augmented treatment as usual

BACKGROUND

Smartphone-based digital mental health interventions (DMHI) have been described as a purported solution to meet growing healthcare demands and lack of providers, but studies often don't account for whether patients are concurrently in another treatment modality.

METHODS

This preregistered quasi-experimental intent-to-treat study with 354 patients enrolled in a therapist-supported DMHI examined the treatment effectiveness of the Meru Health Program (MHP) as a stand-alone treatment as compared to the MHP in combination with any other form of treatment, including (1) in-person therapy, (2) psychotropic medication use, and (3) in-person therapy and psychotropic medication use.

RESULTS

Patients with higher baseline depressive and anxiety symptoms were more likely to self-select into multiple forms of treatment, an effect driven by patients in the MHP as adjunctive treatment to in-person therapy and psychotropic medication. Patients in combined treatments had significantly higher depressive and anxiety symptoms across treatment, but all treatment groups had similar decreasing depressive and anxiety symptom trajectories. Exploratory analyses revealed differential treatment outcomes across treatment combinations. Patients in the MHP in combination with another treatment had higher rates of major depressive episodes, psychiatric hospitalization, and attempted death by suicide at baseline.

CONCLUSIONS

Patients with higher depressive and anxiety symptoms tend to self-select into using DMHI in addition to more traditional types of treatment, rather than as a stand-alone intervention, and have more severe clinical characteristics. The use the MHP alone was associated with improvement at a similar rate to those with higher baseline symptoms who are in traditional treatments and use MHP adjunctively.

Is cost of surgery and hospital length of stay increased for sickle cell disease patients undergoing total joint replacement surgeries? Systematic review and multivariate meta-analysis

Background

Sickle cell disease (SCD) patients undergo major joint replacement surgeries with significant improvement in quality of life. Previous literature have tried to explore differences in hospital charges and length of stay between patients with and without SCD. The aim of this meta-analysis is to find out if both outcomes are increased for patients with SCD patients compared to those without SCD.

Methods

Literature search was conducted and studies that compared hospital charges and length of stay between patients with and without sickle cell disease following major arthroplasties were retrieved. A multivariate meta-analysis was conducted using Random-Effect model with the Restricted Maximum Likelihood (REML) using the Metafor Package in R and Rstudio.

Results

Four observational studies were found eligible for the study. The estimated average mean difference based on the random effect model for hospital charges was 7548.50 (95 % CI: 3779.65 to 11317.65) and for length of stay was 2.28 (95 % CI: 1.32 to 3.24) while the prediction interval for the true mean difference for both outcomes were -1810.56 to 16907.56 and -0.01 to 4.57 respectively.

Conclusion

This present study showed that hospital charges and length of stay are increased for patients with SCD compared to patients without.

Covariate Balancing Methods for Randomized Controlled Trials Are Not Adversarially Robust

The first step toward investigating the effectiveness of a treatment via a randomized trial is to split the population into control and treatment groups then compare the average response of the treatment group receiving the treatment to the control group receiving the placebo. To ensure that the difference between the two groups is caused only by the treatment, it is crucial that the control and the treatment groups have similar statistics. Indeed, the validity and reliability of a trial are determined by the similarity of two groups' statistics. Covariate balancing methods increase the similarity between the distributions of the two groups' covariates. However, often in practice, there are not enough samples to accurately estimate the groups' covariate distributions. In this article, we empirically show that covariate balancing with the standardized means difference (SMD) covariate balancing measure, as well as Pocock and Simon's sequential treatment assignment method, are susceptible to worst case treatment assignments. Worst case treatment assignments are those admitted by the covariate balance measure, but result in highest possible ATE estimation errors. We developed an adversarial attack to find adversarial treatment assignment for any given trial. Then, we provide an index to measure how close the given trial is to the worst case. To this end, we provide an optimization-based algorithm, namely adversarial treatment assignment in treatment effect trials (ATASTREET), to find the adversarial treatment assignments.

Dark Data in Real-World Evidence: Challenges, Implications, and the Imperative of Data Literacy in Medical Research

Randomized controlled trials (RCTs) and real-world evidence (RWE) studies are crucial and complementary in generating clinical evidence. RCTs provide controlled settings to validate the clinical effect of specific drugs or medical devices, while RWE integrates extrinsic factors, encompassing external influences affecting real-world scenarios, thus challenging RCT results in practical applications. In this study, we explore the impact of extrinsic factors on RWE outcomes, focusing on "dark data," which refers to data collected but not used or excluded from the analyses. Dark data can arise in many ways during research process, from selecting study samples to data collection and analysis. However, even unused or unanalyzed dark data hold potential insights, providing a comprehensive view of clinical contexts. Extrinsic factors lead to divergent RWE outcomes that could differ from RCTs beyond statistical correction's scope. Two main types of dark data exist: "known-unknown" and "unknown-unknown." The distinction between these dark data types highlights RWE's complexity. The transformation of unknown into known depends on data literacy-powerful utilization capabilities that can be interpreted based on medical expertise. Shifting the focus to excluded subjects or unused data in real-world contexts reveals unexplored potential. Understanding the significance of dark data is vital in reflecting the complexity of clinical settings. Connecting RCTs and RWEs requires medical data literacy, enabling clinicians to decipher meaningful insights. In the big data and artificial intelligence era, medical staff must navigate data complexities while promoting the core role of medicine. Prepared clinicians will lead this transformative journey, ensuring data value shapes the medical landscape.

Design differences and variation in results between randomised trials and non-randomised emulations: meta-analysis of RCT-DUPLICATE data

Objective

To explore how design emulation and population differences relate to variation in results between randomised controlled trials (RCT) and non-randomised real world evidence (RWE) studies, based on the RCT-DUPLICATE initiative (Randomised, Controlled Trials Duplicated Using Prospective Longitudinal Insurance Claims: Applying Techniques of Epidemiology).

Design

Meta-analysis of RCT-DUPLICATE data.

Data sources

Trials included in RCT-DUPLICATE, a demonstration project that emulated 32 randomised controlled trials using three real world data sources: Optum Clinformatics Data Mart, 2004-19; IBM MarketScan, 2003-17; and subsets of Medicare parts A, B, and D, 2009-17.

Eligibility criteria for selecting studies

Trials where the primary analysis resulted in a hazard ratio; 29 RCT-RWE study pairs from RCT-DUPLICATE.

Results

Differences and variation in effect sizes between the results from randomised controlled trials and real world evidence studies were investigated. Most of the heterogeneity in effect estimates between the RCT-RWE study pairs in this sample could be explained by three emulation differences in the meta-regression model: treatment started in hospital (which does not appear in health insurance claims data), discontinuation of some baseline treatments at randomisation (which would have been an unusual care decision in clinical practice), and delayed onset of drug effects (which would be under-reported in real world clinical practice because of the relatively short persistence of the treatment). Adding the three emulation differences to the meta-regression reduced heterogeneity from 1.9 to almost 1 (absence of heterogeneity).

Conclusions

This analysis suggests that a substantial proportion of the observed variation between results from randomised controlled trials and real world evidence studies can be attributed to differences in design emulation.

Mechanical circulatory support for cardiogenic shock: a network meta-analysis of randomized controlled trials and propensity score-matched studies

PURPOSE

Cardiogenic shock is associated with high mortality. In refractory shock, it is unclear if mechanical circulatory support (MCS) devices improve survival. We conducted a network meta-analysis to determine which MCS devices confers greatest benefit.

METHODS

We searched MEDLINE, Embase, and Scopus databases through 27 August 2023 for relevant randomized controlled trials (RCTs) and propensity score-matched studies (PSMs). We conducted frequentist network meta-analysis, investigating mortality (either 30 days or in-hospital) as the primary outcome. We assessed risk of bias (Cochrane risk of bias 2.0 tool/Newcastle-Ottawa Scale) and as sensitivity analysis reconstructed survival data from published survival curves for a one-stage unadjusted individual patient data (IPD) meta-analysis using a stratified Cox model.

RESULTS

We included 38 studies (48,749 patients), mostly reporting on patients with Society for Cardiovascular Angiography and Intervention shock stages C-E cardiogenic shock. Compared with no MCS, extracorporeal membrane oxygenation with intra-aortic balloon pump (ECMO-IABP; network odds ratio [OR]: 0.54, 95% confidence interval (CI): 0.33-0.86, moderate certainty) was associated with lower mortality. There were no differences in mortality between ECMO, IABP, microaxial ventricular assist device (mVAD), ECMO-mVAD, centrifugal VAD, or mVAD-IABP and no MCS (all very low certainty). Our one-stage IPD survival meta-analysis based on the stratified Cox model found only ECMO-IABP was associated with lower mortality (hazard ratio, HR, 0.55, 95% CI 0.46-0.66).

CONCLUSION

In patients with cardiogenic shock, ECMO-IABP may reduce mortality, while other MCS devices did not reduce mortality. However, this must be interpreted within the context of inter-study heterogeneity and limited certainty of evidence.

Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials: a meta-epidemiological study

BACKGROUND

Researchers and decision-makers often use evidence from randomised controlled trials (RCTs) to determine the efficacy or effectiveness of a treatment or intervention. Studies with observational designs are often used to measure the effectiveness of an intervention in 'real world' scenarios. Numerous study designs and their modifications (including both randomised and observational designs) are used for comparative effectiveness research in an attempt to give an unbiased estimate of whether one treatment is more effective or safer than another for a particular population. An up-to-date systematic analysis is needed to identify differences in effect estimates from RCTs and observational studies. This updated review summarises the results of methodological reviews that compared the effect estimates of observational studies with RCTs from evidence syntheses that addressed the same health research question.

OBJECTIVES

To assess and compare synthesised effect estimates by study type, contrasting RCTs with observational studies. To explore factors that might explain differences in synthesised effect estimates from RCTs versus observational studies (e.g. heterogeneity, type of observational study design, type of intervention, and use of propensity score adjustment). To identify gaps in the existing research comparing effect estimates across different study types.

SEARCH METHODS

We searched MEDLINE, the Cochrane Database of Systematic Reviews, Web of Science databases, and Epistemonikos to May 2022. We checked references, conducted citation searches, and contacted review authors to identify additional reviews.

SELECTION CRITERIA

We included systematic methodological reviews that compared quantitative effect estimates measuring the efficacy or effectiveness of interventions tested in RCTs versus in observational studies. The included reviews compared RCTs to observational studies (including retrospective and prospective cohort, case-control and cross-sectional designs). Reviews were not eligible if they compared RCTs with studies that had used some form of concurrent allocation.

DATA COLLECTION AND ANALYSIS

Using results from observational studies as the reference group, we examined the relative summary effect estimates (risk ratios (RRs), odds ratios (ORs), hazard ratios (HRs), mean differences (MDs), and standardised mean differences (SMDs)) to evaluate whether there was a relatively larger or smaller effect in the ratio of odds ratios (ROR) or ratio of risk ratios (RRR), ratio of hazard ratios (RHR), and difference in (standardised) mean differences (D(S)MD). If an included review did not provide an estimate comparing results from RCTs with observational studies, we generated one by pooling the estimates for observational studies and RCTs, respectively. Across all reviews, we synthesised these ratios to produce a pooled ratio of ratios comparing effect estimates from RCTs with those from observational studies. In overviews of reviews, we estimated the ROR or RRR for each overview using observational studies as the reference category. We appraised the risk of bias in the included reviews (using nine criteria in total). To receive an overall low risk of bias rating, an included review needed: explicit criteria for study selection, a complete sample of studies, and to have controlled for study methodological differences and study heterogeneity. We assessed reviews/overviews not meeting these four criteria as having an overall high risk of bias. We assessed the certainty of the evidence, consisting of multiple evidence syntheses, with the GRADE approach.

MAIN RESULTS

We included 39 systematic reviews and eight overviews of reviews, for a total of 47. Thirty-four of these contributed data to our primary analysis. Based on the available data, we found that the reviews/overviews included 2869 RCTs involving 3,882,115 participants, and 3924 observational studies with 19,499,970 participants. We rated 11 reviews/overviews as having an overall low risk of bias, and 36 as having an unclear or high risk of bias. Our main concerns with the included reviews/overviews were that some did not assess the quality of their included studies, and some failed to account appropriately for differences between study designs - for example, they conducted aggregate analyses of all observational studies rather than separate analyses of cohort and case-control studies. When pooling RORs and RRRs, the ratio of ratios indicated no difference or a very small difference between the effect estimates from RCTs versus from observational studies (ratio of ratios 1.08, 95% confidence interval (CI) 1.01 to 1.15). We rated the certainty of the evidence as low. Twenty-three of 34 reviews reported effect estimates of RCTs and observational studies that were on average in agreement. In a number of subgroup analyses, small differences in the effect estimates were detected: - pharmaceutical interventions only (ratio of ratios 1.12, 95% CI 1.04 to 1.21); - RCTs and observational studies with substantial or high heterogeneity; that is, I2 ≥ 50% (ratio of ratios 1.11, 95% CI 1.04 to 1.18); - no use (ratio of ratios 1.07, 95% CI 1.03 to 1.11) or unclear use (ratio of ratios 1.13, 95% CI 1.03 to 1.25) of propensity score adjustment in observational studies; and - observational studies without further specification of the study design (ratio of ratios 1.06, 95% CI 0.96 to 1.18). We detected no clear difference in other subgroup analyses.

AUTHORS' CONCLUSIONS

We found no difference or a very small difference between effect estimates from RCTs and observational studies. These findings are largely consistent with findings from recently published research. Factors other than study design need to be considered when exploring reasons for a lack of agreement between results of RCTs and observational studies, such as differences in the population, intervention, comparator, and outcomes investigated in the respective studies. Our results underscore that it is important for review authors to consider not only study design, but the level of heterogeneity in meta-analyses of RCTs or observational studies. A better understanding is needed of how these factors might yield estimates reflective of true effectiveness.

Local Tumour Control Following Microwave Ablation: Protocol for the Prospective Observational CIEMAR Study

PURPOSE

Microwave ablation (MWA) is a treatment modality for colorectal liver metastases (CRLM). While potentially curative, more information is needed on factors that contribute to long-term local tumour control. The prospective multicentre observational study CIRSE Emprint Microwave Ablation Registry aims to prospectively collect real-world technical data and clinical outcomes on patients treated with MWA in CRLM.

METHODS

Eligible patients are adults with up to 9 local treatment naïve CRLM of ≤ 3 cm completely treatable with either MWA alone or MWA with resection and/or radiotherapy within 8 weeks. Data are collected, at baseline, every 3 months until 12 months, and thereafter every 6 months until the end of the study. The primary outcome measure is local tumour control. Secondary outcome measures are overall survival, (hepatic-) disease-free survival, time-to-progression untreatable by ablation, systemic therapy vacation, safety, and quality of life. Covariates related to the primary outcome measure will be assessed using a stratified log-rank test and an univariable Cox proportional hazard regression. A sample size of 500 patients with 750 lesions produces a two-sided 95% confidence interval with a precision equal to 0.057.

RESULTS

Between September 2019 and December 2022, 500 patients have been enrolled with at least 976 treated tumours.

CONCLUSION

The prospective observational CIEMAR study will provide valuable insights into the real-world use of MWA, helping in the future patient selection and clarifying factors that may contribute to long-term local tumour control.

TRIAL REGISTRATION

NCT03775980.

High-Dose vs. Standard-Dose Influenza Vaccine and Cardiopulmonary Hospitalization or Mortality: Emulating the INVESTED Trial Using Insurance Claims Data

The INVESTED trial did not show benefits of high-dose (HD) vaccine vs. standard-dose (SD) for a primary composite outcome of cardiopulmonary hospitalization or all-cause mortality (hazard ratio (HR) = 1.05, 95% confidence interval (CI) = 0.96-1.15) and its components (all-cause mortality HR = 1.01, 95% CI = 0.84-1.21, cardiopulmonary hospitalization HR = 1.05, 95% CI = 0.96-1.16) during three influenza seasons (2016-2019) among participants with recent myocardial infarction or hospitalization for heart failure (HHF). We emulated INVESTED using Medicare claims data to assess whether the real-world evidence (RWE) study reached similar conclusions. We identified 1:1 propensity score (PS)-matched trial-eligible Medicare beneficiaries aged > 65 years and with prior HHF who received an HD or SD vaccine for the 2016-2019 seasons. We also re-analyzed the INVESTED trial data restricting to participants > 65 years with prior HHF to align eligibility criteria more closely with the RWE study. We compared HRs from the trial and RWE study for the main outcomes. Among 53,393 pairs of PS-matched Medicare beneficiaries, the HD vaccine group showed lower risk of the primary composite outcome (HR = 0.96, 95% CI = 0.95-0.98) and all-cause mortality (HR = 0.93, 95% CI = 0.91-0.95), and similar risk of cardiopulmonary hospitalization (HR = 0.98, 95% CI = 0.96-1.00), compared with SD. The RWE and trial results were closely concordant after the trial population was limited to participants > 65 years with prior HHF: trial-based results for the primary composite outcome (HR = 1.02, 95% CI = 0.89-1.17), all-cause mortality (HR = 0.92, 95% CI = 0.72-1.16), and cardiopulmonary hospitalization (HR = 1.02, 95% CI = 0.88-1.18). Although similar to the main trial results, the RWE was closer to the results from trial participants with aligned eligibility criteria. This study affirms the importance of considering different distributions of baseline patient characteristics when comparing trial findings to RWE.

A longitudinal transition imputation model for categorical data applied to a large registry dataset

Imputation of longitudinal categorical covariates with several waves and many predictors is cumbersome in terms of implausible transitions, colinearity, and overfitting. We designed a simulation study with data obtained from a general practitioners' morbidity registry in Belgium for three waves, with smoking as the longitudinal covariate of interest. We set varying proportions of data on smoking to missing completely at random and missing not at random with proportions of missingness equal to 10%, 30%, 50%, and 70%. This study proposed a 3-stage approach that allows flexibility when imputing time-dependent categorical covariates. First, multiple imputation using fully conditional specification or multiple imputation for the predictor variables was deployed using the wide format such that previous and future information of the same patient was utilized. Second, a joint Markov transition model for initial, forward, backward, and intermittent probabilities was developed for each imputed dataset. Finally, this transition model was used for imputation. We compared the performance of this methodology with an analyses of the complete data and with listwise deletion in terms of bias and root mean square error. Next, we applied this methodology in a clinical case for years 2017 to 2021, where we estimated the effect of several covariates on the pneumococcal vaccination. This methodological framework ensures that the plausibility of transitions is preserved, overfitting and colinearity issues are resolved, and confounders can be utilized. Finally, a companion R package was developed to enable the replication and easy application of this methodology.

Risk of prostate cancer death after radical radiotherapy with neoadjuvant and adjuvant therapy with bicalutamide or gonadotropin-releasing hormone agonists

BACKGROUND

Oncological outcome after radical radiotherapy (RRT) combined with neoadjuvant and adjuvant androgen suppression therapy (AST) may differ according to type of AST. The aim of this nationwide register-based study was to investigate risk of prostate cancer (Pca) death after different neoadjuvant and adjuvant ASTs; (i) bicalutamide, (ii) gonadotropin-releasing hormone agonists (GnRH) or (iii) combined bicalutamide and GnRH (CAB), together with RRT.

MATERIALS AND METHODS

Data for 6882 men diagnosed with high-risk Pca between 2007 and 2020 and treated with primary RRT was retrieved from Prostate Cancer data Base Sweden (PCBaSe) 5.0. Time to Pca death according to type of neoadjuvant and adjuvant AST was assessed by use of Kaplan-Meier plots and Cox proportional hazard models adjusted for putative confounders.

RESULTS

Data were stratified by RRT type since the effect of AST in risk of Pca death differed according to type of RRT. Compared with the reference RRT combined with neoadjuvant CAB/adjuvant GnRH, risk of Pca death for men treated with CAB/bicalutamide and conventionally fractionated external beam radiotherapy (CF-EBRT) was hazard ratio (HR) 0.73 (95% CI: 0.50-1.04), hypofractionated EBRT (HF-EBRT), HR 1.35 (95% CI: 0.65-2.81) and EBRT with high dose rate brachytherapy (EBRT-HDRBT), HR 0.85 (95% CI: 0.37-1.95). Risk of Pca death for men treated with bicalutamide/bicalutamide and: (i) CF-EBRT was HR 2.35 (95% CI: 1.42-3.90), (ii) HF-EBRT, HR 0.70 (95% CI: 0.26-1.85), (iii) HF-EBRT, HR 4.07 (95% CI: 1.88-8.77) vs the reference.

CONCLUSION

In this observational study, risk of Pca death between men receiving different combinations of AST varied according to RRT type. No difference was found in risk of Pca death for men treated with bicalutamide or GnRH as adjuvant therapy to RRT following neoadjuvant CAB. Risk of Pca death was increased for men with monotherapy neo-/adjuvant bicalutamide in combination with CF-EBRT or EBRT-HDRBT.

High protein provision of more than 1.2 g/kg improves muscle mass preservation and mortality in ICU patients: A systematic review and meta-analyses

BACKGROUND

ICU patients lose muscle mass rapidly and maintenance of muscle mass may contribute to improved survival rates and quality of life. Protein provision may be beneficial for preservation of muscle mass and other clinical outcomes, including survival. Current protein recommendations are expert-based and range from 1.2 to 2.0 g/kg. Thus, we performed a systematic review and meta-analysis on protein provision and all clinically relevant outcomes recorded in the available literature.

METHODS

We conducted a systematic review and meta-analyses, including studies of all designs except case control and case studies, with patients aged ≥18 years with an ICU stay of ≥2 days and a mean protein provision group of ≥1.2 g/kg as compared to <1.2 g/kg with a difference of ≥0.2 g/kg between protein provision groups. All clinically relevant outcomes were studied. Meta-analyses were performed for all clinically relevant outcomes that were recorded in ≥3 included studies.

RESULTS

A total of 29 studies published between 2012 and 2022 were included. Outcomes reported in the included studies were ICU, hospital, 28-day, 30-day, 42-day, 60-day, 90-day and 6-month mortality, ICU and hospital length of stay, duration of mechanical ventilation, vomiting, diarrhea, gastric residual volume, pneumonia, overall infections, nitrogen balance, changes in muscle mass, destination at hospital discharge, physical performance and psychological status. Meta-analyses showed differences between groups in favour of high protein provision for 60-day mortality, nitrogen balance and changes in muscle mass.

CONCLUSION

High protein provision of more than 1.2 g/kg in critically ill patients seemed to improve nitrogen balance and changes in muscle mass on the short-term and likely 60-day mortality. Data on long-term effects on quality of life are urgently needed.

The role of randomized controlled trials, registries, observational databases in evaluating new interventions

Approaches to comparing safety and efficacy of interventions include analyzing data from randomized controlled trials (RCTs), registries and observational databases (ODBs). RCTs are regarded as the gold standard but data from such trials are sometimes unavailable because a disease is uncommon, because the intervention is uncommon, because of structural limitations or because randomization cannot be done for practical or (seemingly) ethical reasons. There are many examples of an unproved intervention being so widely-believed to be effective that clinical trialists and potential subjects decline randomization. Often, when a RCT is finally done the intervention is proved ineffective or even harmful. These situations are termed medical reversals and are not uncommon [1,2]. There is also the dilemma of when seemingly similar RCTs report discordant conclisions Data from high-quality registries, especially ODBs can be used when data from RCTs are unavailable but also have limitations. Biases and confounding co-variates may be unknown, difficult or impossible to identify and/or difficult to adjust for adequately. However, ODBs sometimes have large numbers of diverse subjects and often give answers more useful to clinicians than RCTs. Side-by-side comparisons suggest analyses from high-quality ODBs often give similar conclusions from high quality RCTs. Meta-analyses combining data from RCTs, registries and ODBs are sometimes appropriate. We suggest increased use of registries and ODBs to compare efficacy of interventions.

Design, implementation, and inferential issues associated with clinical trials that rely on data in electronic medical records: a narrative review

Real world evidence is now accepted by authorities charged with assessing the benefits and harms of new therapies. Clinical trials based on real world evidence are much less expensive than randomized clinical trials that do not rely on "real world evidence" such as contained in electronic health records (EHR). Consequently, we can expect an increase in the number of reports of these types of trials, which we identify here as 'EHR-sourced trials.' 'In this selected literature review, we discuss the various designs and the ethical issues they raise. EHR-sourced trials have the potential to improve/increase common data elements and other aspects of the EHR and related systems. Caution is advised, however, in drawing causal inferences about the relationships among EHR variables. Nevertheless, we anticipate that EHR-CTs will play a central role in answering research and regulatory questions.

The Journey of Data Within a Global Data Sharing Initiative: A Federated 3-Layer Data Analysis Pipeline to Scale Up Multiple Sclerosis Research

BACKGROUND

Investigating low-prevalence diseases such as multiple sclerosis is challenging because of the rather small number of individuals affected by this disease and the scattering of real-world data across numerous data sources. These obstacles impair data integration, standardization, and analysis, which negatively impact the generation of significant meaningful clinical evidence.

OBJECTIVE

This study aims to present a comprehensive, research question-agnostic, multistakeholder-driven end-to-end data analysis pipeline that accommodates 3 prevalent data-sharing streams: individual data sharing, core data set sharing, and federated model sharing.

METHODS

A demand-driven methodology is employed for standardization, followed by 3 streams of data acquisition, a data quality enhancement process, a data integration procedure, and a concluding analysis stage to fulfill real-world data-sharing requirements. This pipeline's effectiveness was demonstrated through its successful implementation in the COVID-19 and multiple sclerosis global data sharing initiative.

RESULTS

The global data sharing initiative yielded multiple scientific publications and provided extensive worldwide guidance for the community with multiple sclerosis. The pipeline facilitated gathering pertinent data from various sources, accommodating distinct sharing streams and assimilating them into a unified data set for subsequent statistical analysis or secure data examination. This pipeline contributed to the assembly of the largest data set of people with multiple sclerosis infected with COVID-19.

CONCLUSIONS

The proposed data analysis pipeline exemplifies the potential of global stakeholder collaboration and underlines the significance of evidence-based decision-making. It serves as a paradigm for how data sharing initiatives can propel advancements in health care, emphasizing its adaptability and capacity to address diverse research inquiries.

Artificial intelligence-based language learning: illuminating the impact on speaking skills and self-regulation in Chinese EFL context

Introduction

This study investigated the effectiveness of artificial intelligence-based instruction in improving second language (L2) speaking skills and speaking self-regulation in a natural setting. The research was conducted with 93 Chinese English as a foreign language (EFL) students, randomly assigned to either an experimental group receiving AI-based instruction or a control group receiving traditional instruction.

Methods

The AI-based instruction leveraged the Duolingo application, incorporating natural language processing technology, interactive exercises, personalized feedback, and speech recognition technology. Pre- and post-tests were conducted to assess L2 speaking skills and self-regulation abilities.

Results

The results of the study demonstrated that the experimental group, which received AI-based instruction, exhibited significantly greater improvement in L2 speaking skills compared to the control group. Moreover, participants in the experimental group reported higher levels of self-regulation.

Discussion

These findings suggest that AI-based instruction effectively enhances L2 speaking skills and fosters self-regulatory processes among language learners, highlighting the potential of AI technology to optimize language learning experiences and promote learners' autonomy and metacognitive strategies in the speaking domain. However, further research is needed to explore the long-term effects and specific mechanisms underlying these observed improvements.

Investigating the influence of long-axial versus short-axial field of view PET/CT on stage migration in lymphoma and non-small cell lung cancer

OBJECTIVES

The objective of this study was to evaluate the influence of a long-axial field-of-view (LAFOV) on stage migration using a large single-centre retrospective cohort in lymphoma and non-small cell lung cancer (NSCLC).

METHODS

A retrospective study is performed for patients undergoing PET/computed tomography (CT) on either a short-axial field-of-view (SAFOV) or LAFOV PET/CT system for the staging of known or suspected NSCLC or for therapeutic response in lymphoma. The primary endpoint was the Deauville therapy response score for patients with lymphoma for the two systems. Secondary endpoints were the American Joint Committee on Cancer stage for NSCLC, the frequency of cN3 and cM1 findings, the probability for a positive nodal staging (cN1-3) for NSCLC and the diagnostic accuracy for nodal staging in NSCLC.

RESULTS

One thousand two hundred eighteen records were screened and 597 patients were included for analysis ( N  = 367 for lymphoma and N  = 291 for NSCLC). For lymphoma, no significant differences were found in the proportion of patients with complete metabolic response versus non-complete metabolic response Deauville response scores ( P  = 0.66). For NSCLC no significant differences were observed between the two scanners for the frequency of cN3 and cM1 findings, for positive nodal staging, neither the sensitivity nor the specificity.

CONCLUSIONS

In this study use of a LAFOV system was neither associated with upstaging in lymphoma nor NSCLC compared to a digital SAFOV system. Diagnostic accuracy was comparable between the two systems in NSCLC despite shorter acquisition times for LAFOV.

Anakinra authorized to treat severe coronavirus disease 2019; Sepsis breakthrough or time to reflect?

Introduction

The European Medicines Agency (EMA) and the United States Food and Drug Administration (FDA) announced conditions for using recombinant human interleukin-1 receptor antagonist (rhIL-1ra) to treat hospitalized patients with Coronavirus disease 2019 (COVID-19) and risk for progression. These decisions followed publication of the suPAR-guided Anakinra treatment for Validation of the risk and early Management OF seveRE respiratory failure by COVID-19 (SAVE- MORE) phase 3 clinical trial that yielded positive results.

Methods

We conducted a literature review and theoretical analysis of IL-1 blockade as a therapy to treat COVID-19. Using a stepwise analysis, we assessed clinical applicability of the SAVE-MORE results and evaluated conceptual support for interleukin-1 suppression as a suitable approach to COVID-19 treatment. This therapeutic approach was then examined as an example of inflammation-suppressing measures used to treat sepsis.

Results

Anakinra use as a COVID-19 therapy seems to rely on a view of pathogenesis that incorrectly reflects human disease. Since COVID-19 is an example of sepsis, COVID-19 benefit due to anti-inflammatory therapy contradicts an extensive history of unsuccessful clinical study. Repurposing rhIL-1ra to treat COVID-19 appears to exemplify a cycle followed by inflammation-suppressing sepsis treatments. A landscape of treatment failures is interrupted by a successful clinical trial. However, subsequent confirmatory study fails to replicate the positive data.

Discussion

We suggest further experimentation is not a promising pathway to discover game-changing sepsis therapies. A different kind of approach may be necessary.

Extracorporeal cardiopulmonary resuscitation versus conventional cardiopulmonary resuscitation in adults with cardiac arrest: a comparative meta-analysis and trial sequential analysis

BACKGROUND

Although outcomes of patients after cardiac arrest remain poor, studies have suggested that extracorporeal cardiopulmonary resuscitation (ECPR) might improve survival and neurological outcomes. We aimed to investigate any potential benefits of using ECPR over conventional cardiopulmonary resuscitation (CCPR) in patients with out-of-hospital cardiac arrest (OHCA) and in-hospital cardiac arrest (IHCA).

METHODS

In this systematic review and meta-analysis, we searched MEDLINE via PubMed, Embase, and Scopus from Jan 1, 2000, to April 1, 2023, for randomised controlled trials and propensity-score matched studies. We included studies comparing ECPR with CCPR in adults (aged ≥18 years) with OHCA and IHCA. We extracted data from published reports using a prespecified data extraction form. We did random-effects (Mantel-Haenszel) meta-analyses and rated the certainty of evidence using the Grading of Recommendations, Assessments, Developments, and Evaluations (GRADE) approach. We rated the risk of bias of randomised controlled trials using the Cochrane risk-of-bias 2.0 tool, and that of observational studies using the Newcastle-Ottawa Scale. The primary outcome was in-hospital mortality. Secondary outcomes included complications during extracorporeal membrane oxygenation, short-term (from hospital discharge to 30 days after cardiac arrest) and long-term (≥90 days after cardiac arrest) survival with favourable neurological outcomes (defined as cerebral performance category scores 1 or 2), and survival at 30 days, 3 months, 6 months, and 1 year after cardiac arrest. We also did trial sequential analyses to evaluate the required information sizes in the meta-analyses to detect clinically relevant reductions in mortality.

FINDINGS

We included 11 studies (4595 patients receiving ECPR and 4597 patients receiving CCPR) in the meta-analysis. ECPR was associated with a significant reduction in overall in-hospital mortality (OR 0·67, 95% CI 0·51-0·87; p=0·0034; high certainty), without evidence of publication bias (pegger=0·19); the trial sequential analysis was concordant with the meta-analysis. When considering IHCA only, in-hospital mortality was lower in patients receiving ECPR than in those receiving CCPR (0·42, 0·25-0·70; p=0·0009), whereas when considering OHCA only, no differences were found (0·76, 0·54-1·07; p=0·12). Centre volume (ie, the number of ECPR runs done per year in each centre) was associated with reductions in odds of mortality (regression coefficient per doubling of centre volume -0·17, 95% CI -0·32 to -0·017; p=0·030). ECPR was also associated with an increased rate of short-term (OR 1·65, 95% CI 1·02-2·68; p=0·042; moderate certainty) and long-term (2·04, 1·41-2·94; p=0·0001; high certainty) survival with favourable neurological outcomes. Additionally, patients receiving ECPR had increased survival at 30-day (OR 1·45, 95% CI 1·08-1·96; p=0·015), 3-month (3·98, 1·12-14·16; p=0·033), 6-month (1·87, 1·36-2·57; p=0·0001), and 1-year (1·72, 1·52-1·95; p<0·0001) follow-ups.

INTERPRETATION

Compared with CCPR, ECPR reduced in-hospital mortality and improved long-term neurological outcomes and post-arrest survival, particularly in patients with IHCA. These findings suggest that ECPR could be considered for eligible patients with IHCA, although further research into patients with OHCA is warranted.

FUNDING

None.

The impact of theatre on social competencies: a meta-analytic evaluation

BACKGROUND

There has been agrowing interest in using artistic interventions as a method of developing interpersonal competence. This paper presents a meta-analysis evaluating the impact of theatre interventions on social competencies.

METHODS

Twenty-one primary studies totaling 4064 participants were included, presenting evidence available since 1983. Included studies were assessed in terms of quality, heterogeneity, and publication bias.

RESULTS

Our findings indicated that active theatre participation significantly improved participants' empathic abilities, social communication, tolerance, and social interactions, with the largest pooled effect size for social communication (0.698) and the smallest for tolerance (0.156). Our findings did not corroborate the impact of theatre on self-concept.

CONCLUSIONS

This paper shows that theatre interventions have a positive impact on social competencies. The paper makes a methodological contribution by showing that randomized and non-randomized studies yielded comparably valid results.

Causal Paradigm Between Common Comorbidities of Cardiovascular and Metabolism-Related Diseases in Elderly: Evidence from Cross-Sectional and Mendelian Randomization Studies

Background

Comorbidity is a common problem among elderly people, significantly damaging individuals' health and healthcare systems. However, observational studies may be susceptible to residual confounding factors and bias. The present study aimed to assess the causal effect of common chronic disease comorbidity using the Mendelian randomization (MR) approach.

Methods

Data for the present study were obtained from a community survey conducted between 2018 and 2020 in four counties in Ganzhou City, southern China. A cross-sectional survey was conducted using a multi-stage stratified random sampling method. A total of 1756 valid questionnaires were collected to analyze common chronic disease comorbidities. Genetic variants associated with hypertension, diabetes, stroke, and hyperlipidemia-related factors were selected as instrumental variables for univariate and multivariate MR analyses.

Results

The self-reported prevalence of chronic disease in the older adult population in Southern China was 68.1%, with hypertension (46.1%), diabetes (10.5%), and hyperlipidemia (8.5%) being the three most common conditions. The prevalence of chronic disease comorbidity was 20.7% among the 12 chronic diseases studied. Hypertension was identified as a predictor of diabetes (OR [95% CI]: 1.114 [1.049, 1.184], p < 0.001), and diabetes mellitus was equally identified as a risk factor for hypertension (OR [95% CI]: 1.118 [1.069, 1.187], p < 0.001). Furthermore, high triglyceride levels were identified as a risk factor for hypertension (OR [95% CI]: 1.262 [1.129, 1.411], p < 0.001). In contrast to intracranial hemorrhages, hypertension had a significant impact on ischemic stroke (OR [95% CI]: 1.299 [1.161, 1.454], p < 0.001).

Conclusion

The causal association between multiple cardiovascular and metabolism-related diseases is mediated by hypertension, with a bidirectional cause-and-effect relationship between hypertension and diabetes. Hypertension is a risk factor for ischemic stroke, and the hyperlipidemia-related factor triglycerides (TG) influence hypertension. Therefore, prioritizing hypertension prevention and control in the elderly is critical for effective chronic disease management.

How to enrich team research in healthcare by considering five theoretical perspectives

The aim of this paper is to inspire team research to apply diverse and unconventional perspectives to study team dynamics and performance in healthcare settings. To illustrate that using multiple perspectives can yield valuable insights, we examine a segment of a team interaction during a heart-surgery, using five distinct interdisciplinary perspectives known from small group research: the psychodynamic, functional, conflict-power-status, temporal, and social identity perspectives. We briefly describe each theoretical perspective, discuss its application to study healthcare teams, and present possible research questions for the segment at hand using the respective perspective. We also highlight the benefits and challenges associated with employing these diverse approaches and explore how they can be integrated to analyze team processes in health care. Finally, we offer our own insights and opinions on the integration of these approaches, as well as the types of data required to conduct such analyses. We also point to further research avenues and highlight the benefits associated with employing these diverse approaches. Finally, we offer our own insights and opinions on the integration of these approaches, as well as the types of data required to conduct such analyses.

DESIGN DIFFERENCES EXPLAIN VARIATION IN RESULTS BETWEEN RANDOMIZED TRIALS AND THEIR NON-RANDOMIZED EMULATIONS

Objectives

While randomized controlled trials (RCTs) are considered a standard for evidence on the efficacy of medical treatments, non-randomized real-world evidence (RWE) studies using data from health insurance claims or electronic health records can provide important complementary evidence. The use of RWE to inform decision-making has been questioned because of concerns regarding confounding in non-randomized studies and the use of secondary data. RCT-DUPLICATE was a demonstration project that emulated the design of 32 RCTs with non-randomized RWE studies. We sought to explore how emulation differences relate to variation in results between the RCT-RWE study pairs.

Methods

We include all RCT-RWE study pairs from RCT-DUPLICATE where the measure of effect was a hazard ratio and use exploratory meta-regression methods to explain differences and variation in the effect sizes between the results from the RCT and the RWE study. The considered explanatory variables are related to design and population differences.

Results

Most of the observed variation in effect estimates between RCT-RWE study pairs in this sample could be explained by three emulation differences in the meta-regression model: (i) in-hospital start of treatment (not observed in claims data), (ii) discontinuation of certain baseline therapies at randomization (not part of clinical practice), (iii) delayed onset of drug effects (missed by short medication persistence in clinical practice).

Conclusions

This analysis suggests that a substantial proportion of the observed variation between results from RCTs and RWE studies can be attributed to design emulation differences. (238 words).

Impact of neoadjuvant chemotherapy on the difficulty and outcomes of laparoscopic and robotic major liver resections for colorectal liver metastases: A propensity-score and coarsened exact-matched controlled study

BACKGROUND

Minimal invasive liver resections are a safe alternative to open surgery. Different scoring systems considering different risks factors have been developed to predict the risks associated with these procedures, especially challenging major liver resections (MLR). However, the impact of neoadjuvant chemotherapy (NAT) on the difficulty of minimally invasive MLRs remains poorly investigated.

METHODS

Patients who underwent laparoscopic and robotic MLRs for colorectal liver metastases (CRLM) performed across 57 centers between January 2005 to December 2021 were included in this analysis. Patients who did or did not receive NAT were matched based on 1:1 coarsened exact and 1:2 propensity-score matching. Pre- and post-matching comparisons were performed.

RESULTS

In total, the data of 5189 patients were reviewed. Of these, 1411 procedures were performed for CRLM, and 1061 cases met the inclusion criteria. After excluding 27 cases with missing data on NAT, 1034 patients (NAT: n = 641; non-NAT: n = 393) were included. Before matching, baseline characteristics were vastly different. Before matching, the morbidity rate was significantly higher in the NAT-group (33.2% vs. 27.2%, p-value = 0.043). No significant differences were seen in perioperative outcomes after the coarsened exact matching. After the propensity-score matching, statistically significant higher blood loss (mean, 300 (SD 128-596) vs. 250 (SD 100-400) ml, p-value = 0.047) but shorter hospital stay (mean, 6 [4-8] vs. 6 [5-9] days, p-value = 0.043) were found in the NAT-group.

CONCLUSION

The current study demonstrated that NAT had minimal impact on the difficulty and outcomes of minimally-invasive MLR for CRLM.

Mobile Dressing Trolleys Improve Satisfaction and Logistics on Pediatric Surgery Wards

BACKGROUND

Evidence-based data on the effect of dressing trolleys on children's postoperative recovery are not available. The aim of this study was to evaluate a specific pediatric surgical dressing trolley on patient and caregiver satisfaction, as well as temporal and logistical aspects of the dressing change procedures.

METHODS

In a prospective observational non-randomized study, a total of 100 dressing changes were observed before (group 1) and after (group 2) the introduction of a pediatric surgical dressing trolley and the satisfaction, time and logistical factors were recorded on site.

RESULTS

The median preparation time, the duration of the dressing change and the total time decreased significantly from group 1 to group 2 by 1:11 min (p < 0.001); 1:56 min (p = 0.05) and 5:09 min (p = 0.001), respectively. The patient's room was left significantly less often in group 2 to retrieve missing bandages. The median satisfaction of the medical staff increased by 12% in group 2 (p < 0.001). The satisfaction of the parents increased by 2.5% in group 2 (p = 0.042), and that of the nursing staff increased by 9.25% in group 2 (p = 0.015).

CONCLUSIONS

Our results demonstrate the positive effects of a dressing trolley for pediatric surgical dressing changes by minimizing postoperative handling and manipulation of the child. It improves time and logistical factors as well as the satisfaction of those involved, which may lead to a faster recovery.

Application of Instrumental Variable Analysis in Pediatric End-of-Life Research: A Case Study

Instrumental variable analysis (IVA) has been widely used in many fields, including health care, to determine the comparative effectiveness of a treatment, intervention, or policy. However, its application in pediatric end-of-life care research has been limited. This article provides a brief overview of IVA and its assumptions. It illustrates the use of IVA by investigating the comparative effectiveness of concurrent versus standard hospice care for reducing 1-day hospice enrollments. Concurrent hospice care is a relatively recent type of care enabled by the Affordable Care Act in 2010 for children enrolled in the Medicaid program and allows for receiving life-prolonging medical treatment concurrently with hospice care. The IVA was conducted using observational data from 18,152 pediatric patients enrolled in hospice between 2011 and 2013. The results indicated that enrollment in concurrent hospice care reduced 1-day enrollment by 19.3%.

Commercializing Personal Health Information: A Critical Qualitative Content Analysis of Documents Describing Proprietary Primary Care Databases in Canada

BACKGROUND

Commercial data brokers have amassed large collections of primary care patient data in proprietary databases. Our study objective was to critically analyze how entities involved in the collection and use of these records construct the value of these proprietary databases. We also discuss the implications of the collection and use of these databases.

METHODS

We conducted a critical qualitative content analysis using publicly available documents describing the creation and use of proprietary databases containing Canadian primary care patient data. We identified relevant commercial data brokers, as well as entities involved in collecting data or in using data from these databases. We sampled documents associated with these entities that described any aspect of the collection, processing, and use of the proprietary databases. We extracted data from each document using a structured data tool. We conducted an interpretive thematic content analysis by inductively coding documents and the extracted data.

RESULTS

We analyzed 25 documents produced between 2013 and 2021. These documents were largely directed at the pharmaceutical industry, as well as shareholders, academics, and governments. The documents constructed the value of the proprietary databases by describing extensive, intimate, detailed patient-level data holdings. They provided examples of how the databases could be used by pharmaceutical companies for regulatory approval, marketing and understanding physician behaviour. The documents constructed the value of these data more broadly by claiming to improve health for patients, while also addressing risks to privacy. Some documents referred to the trade-offs between patient privacy and data utility, which suggests these considerations may be in tension.

CONCLUSION

Documents in our analysis positioned the proprietary databases as socially legitimate and valuable, particularly to pharmaceutical companies. The databases, however, may pose risks to patient privacy and contribute to problematic drug promotion. Solutions include expanding public data repositories with appropriate governance and external regulatory oversight.

Complications of Intravenous Tenecteplase Versus Alteplase for the Treatment of Acute Ischemic Stroke: A Systematic Review and Meta-Analysis

BACKGROUND

Prior systematic reviews have compared the efficacy of intravenous tenecteplase and alteplase in acute ischemic stroke, assigning their relative complications as a secondary objective. The objective of the present study is to determine whether the risk of treatment complications differs between patients treated with either agent.

METHODS

We performed a systematic review including interventional studies and prospective and retrospective, observational studies enrolling adult patients treated with intravenous tenecteplase for ischemic stroke (both comparative and noncomparative with alteplase). We searched MEDLINE, Embase, the Cochrane Library, Web of Science, and the www.

CLINICALTRIALS

gov registry from inception through June 3, 2022. The primary outcome was symptomatic intracranial hemorrhage, and secondary outcomes included any intracranial hemorrhage, angioedema, gastrointestinal hemorrhage, other extracranial hemorrhage, and mortality. We performed random effects meta-analyses where appropriate. Evidence was synthesized as relative risks, comparing risks in patients exposed to tenecteplase versus alteplase and absolute risks in patients treated with tenecteplase.

RESULTS

Of 2226 records identified, 25 full-text articles (reporting 26 studies of 7913 patients) were included. Sixteen studies included alteplase as a comparator, and 10 were noncomparative. The relative risk of symptomatic intracranial hemorrhage in patients treated with tenecteplase compared with alteplase in the 16 comparative studies was 0.89 ([95% CI, 0.65-1.23]; I2=0%). Among patients treated with low dose (<0.2 mg/kg; 4 studies), medium dose (0.2-0.39 mg/kg; 13 studies), and high dose (≥0.4 mg/kg; 3 studies) tenecteplase, the RRs of symptomatic intracranial hemorrhage were 0.78 ([95% CI, 0.22-2.82]; I2=0%), 0.77 ([95% CI, 0.53-1.14]; I2=0%), and 2.31 ([95% CI, 0.69-7.75]; I2=40%), respectively. The pooled risk of symptomatic intracranial hemorrhage in tenecteplase-treated patients, including comparative and noncomparative studies, was 0.99% ([95% CI, 0%-3.49%]; I2=0%, 7 studies), 1.69% ([95% CI, 1.14%-2.32%]; I2=1%, 23 studies), and 4.19% ([95% CI, 1.92%-7.11%]; I2=52%, 5 studies) within the low-, medium-, and high-dose groups. The risks of any intracranial hemorrhage, mortality, and other studied outcomes were comparable between the 2 agents.

CONCLUSIONS

Across medium- and low-dose tiers, the risks of complications were generally comparable between those treated with tenecteplase versus alteplase for acute ischemic stroke.

Strength of association between comorbidities and asthma: a meta-analysis

BACKGROUND

The strength of association between comorbidities and asthma has never been ranked in relation to the prevalence of the comorbidity in the nonasthma population. We investigated the strength of association between comorbidities and asthma.

METHODS

A comprehensive literature search was performed for observational studies reporting data on comorbidities in asthma and nonasthma populations. A pairwise meta-analysis was performed and the strength of association calculated by anchoring odds ratios and 95% confidence intervals with the rate of comorbidities in nonasthma populations via Cohen's d method. Cohen's d=0.2, 0.5 and 0.8 were cut-off values for small, medium and large effect sizes, respectively; very large effect size resulted for Cohen's d >0.8. The review was registered in the PROSPERO database; identifier number CRD42022295657.

RESULTS

Data from 5 493 776 subjects were analysed. Allergic rhinitis (OR 4.24, 95% CI 3.82-4.71), allergic conjunctivitis (OR 2.63, 95% CI 2.22-3.11), bronchiectasis (OR 4.89, 95% CI 4.48-5.34), hypertensive cardiomyopathy (OR 4.24, 95% CI 2.06-8.90) and nasal congestion (OR 3.30, 95% CI 2.96-3.67) were strongly associated with asthma (Cohen's d >0.5 and ≤0.8); COPD (OR 6.23, 95% CI 4.43-8.77) and other chronic respiratory diseases (OR 12.85, 95% CI 10.14-16.29) were very strongly associated with asthma (Cohen's d >0.8). Stronger associations were detected between comorbidities and severe asthma. No bias resulted according to funnel plots and Egger's test.

CONCLUSION

This meta-analysis supports the relevance of individualised strategies for disease management that look beyond asthma. A multidimensional approach should be used to assess whether poor symptom control is related to uncontrolled asthma or to uncontrolled underlying comorbidities.

Is it feasible and ethical to randomize patients between surgery and non-surgical treatments for gastrointestinal cancers?

Background

In several settings in the treatment of gastrointestinal cancers, it is unclear if the addition of surgery to a multimodal treatment strategy, or in some circumstances its omission, lead to a better outcome for patients. In such situations of clinical equipoise, high-quality evidence from randomised-controlled trials is needed to decide which treatment approach is preferable.

Objective

In this article, we outline the importance of randomised trials comparing surgery with non-surgical therapies for specific scenarios in the treatment of gastrointestinal cancers. We explain the difficulties and solutions of designing these trials and recruiting patients in this context.

Methods

We performed a selective review based on a not systematic literature search in core databases, supplemented by browsing health information journals and citation searching. Only articles in English were selected. Based on this search, we discuss the results and methodological characteristics of several trials which randomised patients with gastrointestinal cancers between surgery and non-surgical treatments, highlighting their differences, advantages, and limitations.

Results and conclusions

Innovative and effective cancer treatment requires randomised trials, also comparing surgery and non-surgical treatments for defined scenarios in the treatment of gastrointestinal malignancies. Nevertheless, potential obstacles to designing and carrying out these trials must be recognised ahead of time to avoid problems before or during the trial.

Association between progression-free survival and overall survival in women receiving first-line treatment for metastatic breast cancer: evidence from the ESME real-world database

BACKGROUND

Overall survival (OS) is the gold standard endpoint to assess treatment efficacy in cancer clinical trials. In metastatic breast cancer (mBC), progression-free survival (PFS) is commonly used as an intermediate endpoint. Evidence remains scarce regarding the degree of association between PFS and OS. Our study aimed to describe the individual-level association between real-world PFS (rwPFS) and OS according to first-line treatment in female patients with mBC managed in real-world setting for each BC subtype (defined by status for both hormone-receptor [HR] expression and HER2 protein expression/gene amplification).

METHODS

We extracted data from the ESME mBC database (NCT03275311) which gathers deidentified data from consecutive patients managed in 18 French Comprehensive Cancer Centers. Adult women diagnosed with mBC between 2008 and 2017 were included. Endpoints (PFS, OS) were described using the Kaplan-Meier method. Individual-level associations between rwPFS and OS were estimated using the Spearman's correlation coefficient. Analyses were conducted by tumor subtype.

RESULTS

20,033 women were eligible. Median age was 60.0 years. Median follow-up duration was 62.3 months. Median rwPFS ranged from 6.0 months (95% CI 5.8-6.2) for HR-/HER2 - subtype to 13.3 months (36% CI 12.7-14.3) for HR + /HER2 + subtype. Correlation coefficients were highly variable across subtypes and first-line (L1) treatments. Among patients with HR - /HER2 - mBC, correlation coefficients ranged from 0.73 to 0.81, suggesting a strong rwPFS/OS association. For HR + /HER2 + mBC patients, the individual-level associations were weak to strong with coefficients ranging from 0.33 to 0.43 for monotherapy and from 0.67 to 0.78 for combined therapies.

CONCLUSIONS

Our study provides comprehensive information on individual-level association between rwPFS and OS for L1 treatments in mBC women managed in real-life practice. Our results could be used as a basis for future research dedicated to surrogate endpoint candidates.

The Importance of Pragmatic Study Design to the Scholarly Influence of Surgical Hip Fracture Randomized Controlled Trials

BACKGROUND

Surgical randomized controlled trials (RCTs) have potential drawbacks, leading some to question their role in filling the information gap in orthopaedic surgery. Pragmatism in study design was introduced to increase the clinical applicability of study results. The purpose of this study was to examine how pragmatism affects the scholarly influence of surgical RCTs.

METHODS

A search for surgical hip fracture-related RCTs published between 1995 and 2015 was done. Journal impact factor, citation number, research question, significance and type of outcome, number of centers involved, and the Pragmatic-Explanatory Continuum Indicator Summary-2 level of pragmatism score were recorded for each study. Scholarly influence was estimated by a study's inclusion into orthopaedic literature or guidelines or through the study's average yearly citation rate.

RESULTS

One hundred sixty RCTs were included in the final analysis. A multivariate logistic regression identified large study sample size as the only predictor of an RCT being used in clinical guidance texts. Large sample size and multicenter RCTs were predictors of high yearly citation rates. The level of pragmatism in study design did not predict scholarly influence.

CONCLUSIONS

Pragmatic design is not independently associated with increased scholarly influence; however, large study sample size was the most important study characteristic affecting scholarly influence.

From real-world electronic health record data to real-world results using artificial intelligence

With the worldwide digitalisation of medical records, electronic health records (EHRs) have become an increasingly important source of real-world data (RWD). RWD can complement traditional study designs because it captures almost the complete variety of patients, leading to more generalisable results. For rheumatology, these data are particularly interesting as our diseases are uncommon and often take years to develop. In this review, we discuss the following concepts related to the use of EHR for research and considerations for translation into clinical care: EHR data contain a broad collection of healthcare data covering the multitude of real-life patients and the healthcare processes related to their care. Machine learning (ML) is a powerful method that allows us to leverage a large amount of heterogeneous clinical data for clinical algorithms, but requires extensive training, testing, and validation. Patterns discovered in EHR data using ML are applicable to real life settings, however, are also prone to capturing the local EHR structure and limiting generalisability outside the EHR(s) from which they were developed. Population studies on EHR necessitates knowledge on the factors influencing the data available in the EHR to circumvent biases, for example, access to medical care, insurance status. In summary, EHR data represent a rapidly growing and key resource for real-world studies. However, transforming RWD EHR data for research and for real-world evidence using ML requires knowledge of the EHR system and their differences from existing observational data to ensure that studies incorporate rigorous methods that acknowledge or address factors such as access to care, noise in the data, missingness and indication bias.

Can Observational Analyses of Routinely Collected Data Emulate Randomized Trials? Design and Feasibility of the Observational Patient Evidence for Regulatory Approval Science and Understanding Disease Project

OBJECTIVES

The Observational Patient Evidence for Regulatory Approval Science and Understanding Disease (OPERAND) project examines whether real-world data (RWD) can be used to inform regulatory decision making.

METHODS

OPERAND evaluates whether observational analyses using RWD to emulate index trials can produce effect estimates similar to those of the trials and examines the impact of relaxing the eligibility criteria of the observational analyses to obtain samples that more closely match the real-world populations receiving the treatments. In OPERAND, 2 research teams independently attempt to emulate the ROCKET Atrial Fibrillation and LEAD-2 trials using OptumLabs data. This article describes the design of the project, summarizes the approaches of the 2 research teams, and presents feasibility results for 2 emulations using new-user designs.

RESULTS

There were differences in the teams' conceptualizations of the emulation, design decisions for cohort identification, and resulting RWD cohorts. These differences occurred even though both teams were guided by the same index trials and had access to the same source of RWD.

CONCLUSIONS

Reasonable alternative design and analysis approaches may be taken to answer the same research question, even when attempting to emulate the same index trial. Researcher decision making is an understudied and potentially important source of variability across RWD analyses.

Exposure to Commonly Used Drugs and the Risk of Gastric Cancer: An Umbrella Review of Meta-Analyses

Recently, attention has been paid to some medications and gastric cancer (GC) risk. This review aimed to evaluate associations between commonly used drugs and GC risk and to grade evidence from published systematic reviews and meta-analyses. This umbrella review was registered in PROSPERO (CRD42022320276). The systematic reviews and meta-analyses of observational studies were retrieved by searching Embase, PubMed, and Web of Science. The evidence strength of commonly used drugs and GC risk was categorized into four grades: weak, suggestive, highly suggestive, and strong. Of 19 associations between commonly used drugs and GC risk and its subtypes, none was supported by convincing or highly suggestive evidence. The risk of GC related to non-steroidal anti-inflammatory drugs (NSAIDs), non-aspirin NSAIDs, and acid-suppressive drugs, as well as the risk of non-cardia GC related to NSAIDs and aspirin, was supported by suggestive evidence. The results showed that a reduced GC risk was associated with two drug types (NSAIDs and non-aspirin NSAIDs), and an increased GC risk was associated with acid-suppressing drugs at the suggestive evidence level. Moreover, NSAIDs and aspirin reduced non-cardia GC risk as supported by suggestive evidence. However, the evidence supporting statins or metformin in reducing GC risk was weak, and thus future studies are required to clarify these associations.

Brachytherapy and osteoradionecrosis in patients with base of tongue cancer

BACKGROUND

Base of tongue cancer incidence and patient survival is increasing why treatment sequelae becomes exceedingly important. Osteoradionecrosis (ORN) is a late adverse effect of radiotherapy and brachytherapy (BT) could be a risk factor. Brachytherapy is used in three out of six health care regions in Sweden.

AIMS

Investigate if patients treated in regions using BT show an increased risk for ORN and whether brachytherapy has any impact on overall survival.

MATERIAL AND METHODS

We used data from the Swedish Head and Neck Cancer Register between 2008-2014. Due to the nonrandomized nature of the study and possible selection bias we compared the risk for ORN in brachy vs non-brachy regions.

RESULTS

Fifty out of 505 patients (9.9%) developed ORN; eight of these were treated in nonbrachy regions (16%), while 42 (84%) were treated in brachy regions. Neither age, sex, TNM-classification/stage, p16, smoking, neck dissection, or chemotherapy differed between ORN and no-ORN patients. The risk for ORN was significantly higher for patients treated in brachy regions compared to non-brachy regions (HR = 2,63, p = .012), whereas overall survival did not differ (HR = 0.95, p = .782).

CONCLUSIONS AND SIGNIFICANCE

Brachytherapy ought to be used cautiously for selected patients or within prospective randomized studies.