A fast bootstrap algorithm for causal inference with large data

Estimating causal effects from large experimental and observational data has become increasingly prevalent in both industry and research. The bootstrap is an intuitive and powerful technique used to construct standard errors and confidence intervals of estimators. Its application however can be prohibitively demanding in settings involving large data. In addition, modern causal inference estimators based on machine learning and optimization techniques exacerbate the computational burden of the bootstrap. The bag of little bootstraps has been proposed in non-causal settings for large data but has not yet been applied to evaluate the properties of estimators of causal effects. In this article, we introduce a new bootstrap algorithm called causal bag of little bootstraps for causal inference with large data. The new algorithm significantly improves the computational efficiency of the traditional bootstrap while providing consistent estimates and desirable confidence interval coverage. We describe its properties, provide practical considerations, and evaluate the performance of the proposed algorithm in terms of bias, coverage of the true 95% confidence intervals, and computational time in a simulation study. We apply it in the evaluation of the effect of hormone therapy on the average time to coronary heart disease using a large observational data set from the Women's Health Initiative.

Relationship between C-reactive protein level and periodontitis and systemic diseases

BACKGROUND

Periodontitis affects systemic disease risk, although the relationship thereof in the context of different C-reactive protein (CRP) levels is not clear. This study investigated the association of periodontitis with systemic diseases according to high-sensitivity CRP (hs-CRP) level and sought to identify the risk of systemic diseases in patients with periodontitis.

METHODS

We used data from the seventh (2016-2018) Korea National Health and Nutrition Examination Survey. In a total of 16,489 subjects, the hs-CRP group was classified into the hs-CRP low-risk group and the hs-CRP high-risk group. Propensity score matching (PSM) is used for 1:1 matching of confounding variables (e.g., age, gender, income, and education) between hs-CRP low-risk and hs-CRP at-risk groups to analyze the final 5316 subjects. The association between general characteristics and prevalence of systemic diseases was analyzed using descriptive statistics and the chi-squared test. The associations between hs-CRP level and systemic and periodontitis were analyzed using logistic regression analyses.

RESULTS

Within the hs-CRP group, the presence of periodontitis was associated with a significantly increased prevalence of hypertension, diabetes mellitus, and stroke. In the hs-CRP risk group, periodontitis significantly increased the risk of hypertension and diabetes mellitus by 2.1 and 2.4 times, respectively.

CONCLUSIONS

The presence of periodontitis significantly increases the prevalence of systemic diseases and more so in individuals with higher hs-CRP levels. This indicates the significance of maintaining oral health in reducing the risk of systemic diseases.

The Association of Prescribed Opioids and Incident Cardiovascular Disease

Opioid prescribing remains common despite known overdose-related harms. Less is known about links to nonoverdose morbidity. We determined the association between prescribed opioid receipt with incident cardiovascular disease (CVD) using data from the Veterans Aging Cohort Study, a national prospective cohort of Veterans with/without Human Immunodeficiency Virus (HIV) receiving Veterans Health Administration care. Selected participants had no/minimal prior exposure to prescription opioids, no opioid use disorder, and no severe illness 1 year after the study start date (baseline period). We ascertained prescription opioid exposure over 3 years after the baseline period using outpatient pharmacy fill/refill data. Incident CVD ascertainment began at the end of the prescribed opioid exposure ascertainment period until the first incident CVD event, death, or September 30, 2015. We used adjusted Cox proportional hazards regression models with matching weights using propensity scores for opioid receipt to estimate CVD risk. Among 49,077 patients, 30% received opioids; the median age was 49 years, 97% were male, 49% were Black, and 47% were currently smoking. Prevalence of hypertension, diabetes, current smoking, alcohol and cocaine use disorder, and depression was higher in patients receiving opioids versus those not but were well-balanced by matching weights. Unadjusted CVD incidence rates per 1,000-person-years were higher among those receiving opioids versus those not: 17.4 (95% confidence interval [CI], 16.5-18.3) versus 14.7 (95% CI, 14.2-15.3). In adjusted analyses, those receiving opioids versus those not had an increased hazard of incident CVD (adjusted hazard ratio 1.16 [95% CI, 1.08-1.24]). Prescribed opioids were associated with increased CVD incidence, making opioids a potential modifiable CVD risk factor. PERSPECTIVE: In a propensity score weighted analysis of Veterans Administration data, prescribed opioids compared to no opioids were associated with an increased hazard of incident CVD. Higher opioid doses compared with lower doses were associated with increased hazard of incident CVD. Opioids are a potentially modifiable CVD risk factor.

Treatment Modalities and Outcomes in Brainstem Cavernous Malformations: A Large Multicenter Observational Cohort Study

BACKGROUND

Symptomatic brainstem cavernous malformations (BSCMs) pose a high risk of morbidity and mortality due to recurrent hemorrhage, warranting aggressive management. However, few studies have compared the effectiveness of different treatment modalities for BSCMs. We aimed to assess the association of treatment modalities with recurrent hemorrhage and neurological outcomes in patients with BSCM.

METHODS

We conducted a retrospective cohort study using an observational registry database covering population of southwest and southeast China. Adult patients with BSCM were included and followed up between March 1, 2011, to March 31, 2023. We compared outcomes between microsurgery and stereotactic radiosurgery (SRS) in propensity score-matched case pairs, incorporating demographic, medical history, and lesion characteristics. The outcomes studied included recurrent hemorrhage and poor prognosis (defined as a Glasgow Outcome Scale score, <4). Absolute rate differences and hazard ratios (HRs) with 95% CIs were calculated using Cox models.

RESULTS

Among 736 diagnosed patients with BSCM, 96 (48 matched pairs) were included after exclusions and propensity score matching (mean age, 43.1 [SD, 12.1] years; 50% women). During the median 5-year follow-up, no significant differences in recurrent hemorrhage (4.2% [microsurgery] versus 14.6% [SRS], HR, 3.90 [95% CI, 0.46-32.65]; P=0.21) and poor prognosis (12.5% [microsurgery] versus 8.3% [SRS], HR, 0.29 [95% CI, 0.08-1.08]; P=0.07) were observed between microsurgery and SRS recipients. Furthermore, either microsurgery or SRS correlated with fewer recurrent hemorrhage (HR, 0.09 [95% CI, 0.02-0.39]; P=0.001; HR, 0.21 [95% CI, 0.07-0.69]; P=0.01) compared with conservative treatment.

CONCLUSIONS

In this study, both microsurgery and SRS were safe and effective for BSCM, demonstrated comparable outcomes in recurrent hemorrhage and poor prognosis. However, interpretation should be cautious due to the potential for residual confounding.

REGISTRATION

URL: https://www.chictr.org.cn/; Unique identifier: ChiCTR2300070907.

Association of remaining tooth number with postoperative respiratory complications in heart valve surgery patients

OBJECTIVES

This study examined the association between the number of remaining teeth and the incidence of postoperative respiratory complications in patients undergoing heart valve surgery.

METHODS

We retrospectively enrolled 157 patients who underwent heart valve surgery between April 2010 and March 2019. Data on patient characteristics including systemic and oral conditions were extracted and postoperative respiratory complications were set as outcomes. Patients were divided into two groups according to the number of remaining teeth (≥20, <20). After adjusting for confounding factors with propensity scoring, logistic regression analysis was performed to examine the association of remaining teeth number with the incidence of postoperative respiratory complications. In addition, subgroup analysis was performed by stratifying the data into quintiles based on the propensity score.

RESULTS

Univariate analysis showed significant differences between the two groups in factors, including age, past cardiac surgery experience, New York Heart Association functional classification class IV, denture use, tooth extraction before surgery, occlusal support, and periodontitis. Logistic regression analysis showed that patients with <20 remaining teeth had a significantly higher incidence of postoperative respiratory complications than those with ≥20 remaining teeth, with an odds ratio of 29.800 (p = 0.004). Subgroup analysis showed that the odds ratio for the patients with <20 remaining teeth was 9.000 (p = 0.038).

CONCLUSIONS

The results suggest that heart valve surgery patients shall get attention on oral disease prevention by dental care practitioners to maintain a sufficient number of teeth for the prevention of postoperative respiratory complications.

Postoperative long‑term outcomes of acute normovolemic hemodilution in pancreatic cancer: A propensity score matching analysis

Acute normovolemic hemodilution (ANH) is a useful intraoperative blood conservation technique. However, the impact on long-term outcomes in pancreatic ductal adenocarcinoma (PDAC) remains unclear. The present study investigated the impact of ANH on long-term outcomes in patients with PDAC undergoing radical surgery. Data from 155 resectable PDAC cases were collected. Patients were categorized according to whether or not they had received intraoperative allogeneic blood transfusion (ABT) or ANH. Postoperative complications, recurrence-free survival (RFS) and disease-specific survival (DSS), before and after propensity score matching (PSM), were compared among patients who did and did not receive ANH. A total of 44 patients (28.4%) were included in the ANH group and 30 patients (19.4%) were included in the ABT group; 81 (52.3%) patients, comprising the standard management (STD) group, received neither ANH nor ABT. The ABT group had the worst prognosis among them. Before PSM, ANH was significantly associated with decreased RFS (P=0.043) and DSS (P=0.029) compared with the STD group before applying Bonferroni correction; however, no significant difference was observed after applying Bonferroni correction. Cox regression analysis identified ANH as an independent prognostic factor for RFS [relative risk (RR), 1.696; P=0.019] and DSS (RR, 1.876; P=0.009). After PSM, the ANH group exhibited less favorable RFS [median survival time (MST), 12.1 vs. 18.1 months; P=0.097] and DSS (MST, 32.1 vs. 50.5 months; P=0.097) compared with the STD group; however, these differences were not statistically significant. In conclusion, while ANH was not as harmful as ABT, it exhibited potentially more negative effects on long-term postoperative outcomes in PDAC than STD.

Tocolysis after preterm prelabor rupture of membranes and 5-year outcomes: a population-based cohort study

BACKGROUND

The administration of tocolytics after preterm prelabor rupture of membranes remains a controversial practice. In theory, reducing uterine contractility should delay delivery and allow for optimal antenatal management, thereby reducing the risks for prematurity and adverse consequences over the life course. However, tocolysis may be associated with neonatal death or long-term adverse neurodevelopmental outcomes, mainly related to prolonged fetal exposure to intrauterine infection or inflammation. In a previous study, we showed that tocolysis administration was not associated with short-term benefits. There are currently no data available to evaluate the impact of tocolysis on neurodevelopmental outcomes in school-aged children born prematurely in this clinical setting.

OBJECTIVE

This study aimed to investigate whether tocolysis administered after preterm prelabor rupture of membranes is associated with neurodevelopmental outcomes at 5.5 years of age.

STUDY DESIGN

We used data from a prospective, population-based cohort study of preterm births recruited in 2011 (referred to as the EPIPAGE-2 study) and for whom the results of a comprehensive medical and neurodevelopmental assessment of the infant at age 5.5 years were available. We included pregnant individuals with preterm prelabor rupture of membranes at 24 to 32 weeks' gestation in singleton pregnancies with a live fetus at the time of rupture, birth at 24 to 34 weeks' gestation, and participation of the infant in an assessment at 5.5 years of age. Exposure was the administration of any tocolytic treatment after preterm prelabor rupture of membranes. The main outcome was survival without moderate to severe neurodevelopmental disabilities at 5.5 years of age. Secondary outcomes included survival without any neurodevelopmental disabilities, cerebral palsy, full-scale intelligence quotient, developmental coordination disorders, and behavioral difficulties. A propensity-score analysis was used to minimize the indication bias in the estimation of the treatment effect on outcomes.

RESULTS

Overall, 596 of 803 pregnant individuals (73.4%) received tocolytics after preterm prelabor rupture of membranes. At the 5.5-year follow-up, 82.7% and 82.5% of the children in the tocolysis and no tocolysis groups, respectively, were alive without moderate to severe neurodevelopmental disabilities; 52.7% and 51.1%, respectively, were alive without any neurodevelopmental disabilities. After applying multiple imputations and inverse probability of treatment weighting, we found no association between the exposure to tocolytics and survival without moderate to severe neurodevelopmental disabilities (odds ratio, 0.93; 95% confidence interval, 0.55-1.60), survival without any neurodevelopmental disabilities (odds ratio, 1.02; 95% confidence interval, 0.65-1.61), or any of the other outcomes.

CONCLUSION

There was no difference in the neurodevelopmental outcomes at age 5.5 years among children with and without antenatal exposure to tocolysis after preterm prelabor rupture of membranes. To date, the health benefits of tocolytics remain unproven, both in the short- and long-term.

Complications after peripherally inserted central catheter versus central venous catheter implantation in intensive care unit: propensity score analysis using a nationwide database

BACKGROUND

It remains unclear whether peripherally inserted central catheters (PICCs) are superior to central venous catheters (CVCs); therefore, we compared post-implantation complications between CVC and PICC groups.

RESEARCH DESIGN AND METHODS

Patients who received CVCs or PICCs between April 2010 and March 2018 were identified from the Diagnosis Procedure Combination database, a national inpatient database in Japan. The outcomes of interest included catheter infection, pulmonary embolism, deep vein thrombosis, and phlebitis. Propensity score overlap weighting was used to balance patient backgrounds. Outcomes were compared using logistic regression analyses.

RESULTS

We identified 164,185 eligible patients, including 161,605 (98.4%) and 2,580 (1.6%) in the CVC and PICC groups, respectively. The PICC group was more likely to have overall complications (odds ratio [OR], 1.70; 95% confidence interval [CI], 1.32-2.19), pulmonary embolism (OR, 2.32; 95% CI, 1.38-3.89), deep vein thrombosis (OR, 1.86; 95% CI, 1.16-2.99), and phlebitis (OR, 1.72; 95% CI, 1.27-2.32) than the CVC group. There was no significant intergroup difference in catheter infection (OR, 1.09; 95% CI, 0.39-3.04).

CONCLUSIONS

Patients with PICCs had a significantly greater incidence of complications than did those with CVCs. Further research is necessary to explore the factors contributing to these complications.

Assessing Covariate Balance with Small Sample Sizes

Propensity score adjustment addresses confounding by balancing covariates in subject treatment groups through matching, stratification, inverse probability weighting, etc. Diagnostics ensure that the adjustment has been effective. A common technique is to check whether the standardized mean difference for each relevant covariate is less than a threshold like 0.1. For small sample sizes, the probability of falsely rejecting the validity of a study because of chance imbalance when no underlying balance exists approaches 1. We propose an alternative diagnostic that checks whether the standardized mean difference statistically significantly exceeds the threshold. Through simulation and real-world data, we find that this diagnostic achieves a better trade-off of type 1 error rate and power than standard nominal threshold tests and not testing for sample sizes from 250 to 4000 and for 20 to 100,000 covariates. In network studies, meta-analysis of effect estimates must be accompanied by meta-analysis of the diagnostics or else systematic confounding may overwhelm the estimated effect. Our procedure for statistically testing balance at both the database level and the meta-analysis level achieves the best balance of type-1 error rate and power. Our procedure supports the review of large numbers of covariates, enabling more rigorous diagnostics.

Propensity Score-Matched Analysis of Perioperative Outcomes of Supine versus Prone Percutaneous Nephrolithotomy

Objective: To compare the perioperative outcomes of supine and prone percutaneous nephrolithotomy (PCNL). Methods: A retrospective search of a tertiary medical center database yielded 517 patients who underwent supine (n = 91) or prone (n = 426) PCNL between September 2015 and July 2020. Data on demographics, baseline clinical parameters, and stone burden were included as predictors in a logistic regression model, generating a set of propensity scores. Seventy patients after supine PCNL were propensity score-matched 1:1 with patients after prone PCNL and compared for operative time, perioperative complications, system complexity, and stone-free rate. Results: We found that the operative time was significantly shorter in the supine PCNL group than in the prone PCNL group (85.5 ± 25.2 min vs. 96.4 ± 25.8 min, respectively; p = 0.012). The majority of both groups had low-grade (I-II) complexity systems (85.6% and 88.6%, respectively), with no significant difference among all grade groups (p = 0.749). There were no significant differences between the supine and prone PCNL groups in terms of the overall perioperative complication rate (8.6% vs. 4.3%, respectively; p = 0.301) or stone-free rate (74.3 vs. 65.7%, respectively; p = 0.356), while the rate of blood transfusion was significantly higher in the supine group (p = 0.023). Conclusions: In our study, we used propensity score matching to compare patients who underwent PCNL in the supine or prone position, adjusting for selection bias. Supine PCNL was associated with a shorter operative time but a higher blood transfusion rate, with no differences in the overall complication and stone-free rates.

The performance of marginal structural models for estimating risk differences and relative risks using weighted univariate generalized linear models

We used Monte Carlo simulations to compare the performance of marginal structural models (MSMs) based on weighted univariate generalized linear models (GLMs) to estimate risk differences and relative risks for binary outcomes in observational studies. We considered four different sets of weights based on the propensity score: inverse probability of treatment weights with the average treatment effect as the target estimand, weights for estimating the average treatment effect in the treated, matching weights and overlap weights. We considered sample sizes ranging from 500 to 10,000 and allowed the prevalence of treatment to range from 0.1 to 0.9. We examined both the robust variance estimator when using generalized estimating equations with an independent working correlation matrix and a bootstrap variance estimator for estimating the standard error of the risk difference and the log-relative risk. The performance of these methods was compared with that of direct weighting. Both the direct weighting approach and MSMs based on weighted univariate GLMs resulted in the identical estimates of risk differences and relative risks. When sample sizes were small to moderate, the use of an MSM with a bootstrap variance estimator tended to result in the most accurate estimates of standard errors. When sample sizes were large, the direct weighting approach and an MSM with a bootstrap variance estimator tended to produce estimates of standard error with similar accuracy. When using a MSM to estimate risk differences and relative risks, in general it is preferable to use a bootstrap variance estimator than the robust variance estimator. We illustrate the application of the different methods for estimating risks differences and relative risks using an observational study on the effect on mortality of discharge prescribing of a beta-blocker in patients hospitalized with acute myocardial infarction.

Real-World Outcomes for the Fifth-Generation Balloon Expandable Transcatheter Heart Valve in the United States

BACKGROUND

The fifth-generation SAPIEN 3 Ultra Resilia valve (S3UR) incorporates several design changes as compared with its predecessors, the SAPIEN 3 (S3) and SAPIEN 3 Ultra (S3U) valves, including bovine leaflets treated with a novel process intended to reduce structural valve deterioration via calcification, as well as a taller external skirt on the 29-mm valve size to reduce paravalvular leak (PVL). The clinical performance of S3UR compared with S3 and S3U in a large patient population has not been previously reported.

OBJECTIVES

The aim of this study was to compare S3UR to S3/S3U for procedural, in-hospital, and 30-day clinical and echocardiographic outcomes after transcatheter aortic valve replacement (TAVR).

METHODS

Patients enrolled in the STS/ACC TVT (Society of Thoracic Surgeons/American College of Cardiology Transcatheter Valve Therapy) Registry between January 1, 2021, and June 30, 2023, who underwent TAVR with S3UR or S3U/S3 valve platforms were propensity-matched and evaluated for procedural, in-hospital, and 30-day clinical and echocardiographic outcomes.

RESULTS

10,314 S3UR patients were propensity matched with 10,314 patients among 150,539 S3U/S3 patients. At 30 days, there were no statistically significant differences in death, stroke, or bleeding, but a numerically higher hospital readmission rate in the S3UR cohort (8.5% vs 7.7%; P = 0.04). At discharge, S3UR patients exhibited significantly lower mean gradients (9.2 ± 4.6 mm Hg vs 12.0 ± 5.7 mm Hg; P < 0.0001) and larger aortic valve area (2.1 ± 0.7 cm2 vs 1.9 ± 0.6 cm2; P < 0.0001) than patients treated with S3/S3U. The 29-mm valve size exhibited significant reduction in mild PVL (5.3% vs 9.4%; P < 0.0001).

CONCLUSIONS

S3UR TAVR is associated with lower mean gradients and lower rates of PVL than earlier generations of balloon expandable transcatheter heart valve platforms.

Evaluating the comparability of osteoporosis treatments using propensity score and negative control outcome methods in UK and Denmark electronic health record databases

Evidence on the comparative effectiveness of osteoporosis treatments is heterogeneous. This may be attributed to different populations and clinical practice, but also to differing methodologies ensuring comparability of treatment groups before treatment effect estimation and the amount of residual confounding by indication. This study assessed the comparability of denosumab vs oral bisphosphonate (OBP) groups using propensity score (PS) methods and negative control outcome (NCO) analysis. A total of 280 288 women aged ≥50 years initiating denosumab or OBP in 2011-2018 were included from the UK Clinical Practice Research Datalink (CPRD) and the Danish National Registries (DNR). Balance of observed covariates was assessed using absolute standardised mean difference (ASMD) before and after PS weighting, matching, and stratification, with ASMD >0.1 indicating imbalance. Residual confounding was assessed using NCOs with ≥100 events. Hazard ratio (HR) and 95% confidence interval (CI) between treatment and NCO was estimated using Cox models. Presence of residual confounding was evaluated with two approaches1: >5% of NCOs with 95% CI excluding 1,2 >5% of NCOs with an upper CI <0.75 or lower CI >1.3. The number of imbalanced covariates before adjustment (CPRD 22/87; DNR 18/83) decreased, with 2-11% imbalance remaining after weighting, matching or stratification. Using approach 1, residual confounding was present for all PS methods in both databases (≥8% of NCOs), except for stratification in DNR (3.8%). Using approach 2, residual confounding was present in CPRD with PS matching (5.3%) and stratification (6.4%), but not with weighting (4.3%). Within DNR, no NCOs had HR estimates with upper or lower CI limits beyond the specified bounds indicating residual confounding for any PS method. Achievement of covariate balance and determination of residual bias were dependent upon several factors including the population under study, PS method, prevalence of NCO, and the threshold indicating residual confounding.

Factors affecting the long-term prognosis of patients in the AYA generation with epithelial ovarian cancer: A multicenter propensity score matching analysis

OBJECTIVE

Ovarian carcinoma (OvCa) is more common in the elderly, but also affects the adolescent and young adult (AYA) generation, which refers to those aged 15-39 years. Although the characteristics of OvCa may differ between AYAs and non-AYAs, limited information is currently available on differences in prognostic factors. Therefore, we herein investigated prognostic factors for and the prognosis of OvCa in AYAs. We also examined the prognostic impact of fertility-sparing surgery in a subgroup analysis.

METHODS

We retrospectively collected data on 4897 patients with OvCa from the databases of multiple institutions and ultimately included 1161 patients with epithelial ovarian cancer (EOC). We performed a survival analysis to compare AYAs and non-AYAs with backgrounds that conformed to those of AYAs using the propensity score (PS) matching method. A Cox regression analysis was also conducted to evaluate each predictor of recurrence-free survival (RFS) and overall survival (OS) in the original population. As a subgroup analysis, a multivariate analysis stratified by the AYA and non-AYA generations was performed.

RESULTS

In total, 119 AYA patients were included in this study. After PS adjustments, no significant differences were observed in RFS or OS between AYAs and non-AYAs. Prognostic factors differed between AYAs and non-AYAs, particularly in histology and cytology. A multivariate analysis stratified by the AYA and non-AYA generations described that uterine-preserving surgery (UPS) did not have a significant impact on the prognosis of AYAs or non-AYAs. In cases with recurrence, no significant differences were observed in RFS and recurrent sites in the two groups.

CONCLUSION

Characteristic prognostic factors for EOC in AYAs were identified. The present results indicate the limited prognostic impact of UPS for EOC in AYAs.

Effect of high-frequency repetitive transcranial magnetic stimulation on cognitive impairment in WD patients based on inverse probability weighting of propensity scores

Background

Hepatolenticular degeneration [Wilson disease (WD)] is an autosomal recessive metabolic disease characterized by copper metabolism disorder. Cognitive impairment is a key neuropsychiatric symptom of WD. At present, there is no effective treatment for WD-related cognitive impairment.

Methods

In this study, high-frequency repetitive transcranial magnetic stimulation (rTMS) was used to treat WD-related cognitive impairment, and inverse probability weighting of propensity scores was used to correct for confounding factors. The Mini-Mental State Examination (MMSE), Montreal Cognitive Assessment (MoCA), Auditory Verbal Learning Test (AVLT), Boston Naming Test (BNT), Clock Drawing Test (CDT) and Trail Making Test (TMT) were used to evaluate overall cognition and specific cognitive domains.

Results

The MMSE, MoCA and CDT scores after treatment were significantly different from those before treatment (MMSE: before adjustment: OR = 1.404, 95% CI: 1.271-1.537; after adjustment: OR = 1.381, 95% CI: 1.265-1.497, p < 0.001; MoCA: before adjustment: OR = 1.306, 95% CI: 1.122-1.490; after adjustment: OR = 1.286, 95% CI: 1.104; AVLT: OR = 1.161, 95% CI: 1.074-1.248; after adjustment: OR = 1.145, 95% CI: 1.068-1.222, p < 0.05; CDT: OR = 1.524, 95% CI: 1.303-1.745; after adjustment: OR = 1.518, 95% CI: 1.294-1.742, p < 0.001). The BNT and TMT scores after adjustment were not significantly different from those before adjustment (BNT: before adjustment: OR = 1.048, 95% CI: 0.877-1.219; after adjustment: OR = 1.026, 95% CI: 0.863-1.189, p > 0.05; TMT: before adjustment: OR = 0.816, 95% CI: 1.122-1.490; after adjustment: OR = 0.791, 95% CI: 0.406-1.176, p > 0.05).

Conclusion

High-frequency rTMS can effectively improve cognitive impairment, especially memory and visuospatial ability, in WD patients. The incidence of side effects is low, and the safety is good.

Dynamic borrowing of historical controls adjusting for covariates in vaccine efficacy clinical trials

Traditional vaccine efficacy trials usually use fixed designs and often require large sample sizes. Recruiting a large number of subjects can make the trial expensive, long, and difficult to conduct. A possible approach to reduce the sample size and speed up the development is to use historical controls. In this paper, we extend the robust mixture prior (RMP) approach (a well established approach for Bayesian dynamic borrowing of historical controls) to adjust for covariates. The adjustment is done using classical methods from causal inference: inverse probability of treatment weighting, G-computation and double-robust estimation. We evaluate these covariate-adjusted RMP approaches using a comprehensive simulation study and demonstrate their use by performing a retrospective analysis of a prophylactic human papillomavirus vaccine efficacy trial. Adjusting for covariates reduces the drift between current and historical controls, with a beneficial effect on bias, control of type I error and power.

Associations between regular physical exercise and physical, emotional, and cognitive health of older adults in China: an 8-year longitudinal study with propensity score matching

Background

The importance of healthy aging is growing in China as it has the largest number of older adults in the world and is one of the fastest-aging countries. This study aimed to examine the predictive value of regular physical exercise in relation to the physical, emotional, and cognitive health among samples of adults aged ≥60 years in China during an 8-year period.

Methods

A total of 10,691 older adults were extracted from two waves of national data from the China Family Panel Studies in 2010 and 2018. To minimize the impact of selection bias on the findings, a longitudinal propensity score matching (LPSM) method was used to examine the relationships between regular physical exercise and emotional health (depression), between regular physical exercise and physical health (instrumental activities of daily living), and between regular physical exercise and cognitive health (cognitive ability) of older adults. After LPSM, 856 older adults were included in the study. In the regular physical exercise group, the average age of participants at baseline year was 65.67 years, with an average age of 65.90 years for 238 men and 65.45 years for 190 women, and in the non-physical exercise group, their average age at baseline year was 65.70 years, with an average age of 65.45 years for 253 men and 65.98 years for 175 women.

Results

LPSM indicated that regular physical exercise has been found to be effective in improving physical function and reducing depressive symptoms in old adults, even after controlling for background differences. However, the sensitivity analysis suggests that the positive association between regular physical exercise and cognitive function may not be sufficiently valid.

Conclusion

The findings of this study indicate that engaging in long-term structured and repetitive physical exercise can have a significant positive effect on reducing depressive symptoms and improving the physical function of older adults. As a result, incorporating regular physical exercise into the lifestyle of older adults is recognized as an effective strategy for promoting healthy aging and reducing the strain on public health resources.

Adaptively leverage multiple real-world data sources for treatment effect estimation based on similarity

The incorporation of real-world data (RWD) into medical product development and evaluation has exhibited consistent growth. However, there is no universally adopted method of how much information to borrow from external data. This paper proposes a study design methodology called Tree-based Monte Carlo (TMC) that dynamically integrates patients from various RWD sources to calculate the treatment effect based on the similarity between clinical trial and RWD. Initially, a propensity score is developed to gauge the resemblance between clinical trial data and each real-world dataset. Utilizing this similarity metric, we construct a hierarchical clustering tree that delineates varying degrees of similarity between each RWD source and the clinical trial data. Ultimately, a Gaussian process methodology is employed across this hierarchical clustering framework to synthesize the projected treatment effects of the external group. Simulation result shows that our clustering tree could successfully identify similarity. Data sources exhibiting greater similarity with clinical trial are accorded higher weights in treatment estimation process, while less congruent sources receive comparatively lower emphasis. Compared with another Bayesian method, meta-analytic predictive prior (MAP), our proposed method's estimator is closer to the true value and has smaller bias.

The relationship between household food insecurity and overweight or obesity among children and adults in Canada: a population-based, propensity score weighting analysis

Household food insecurity is independently associated with adverse health outcomes among Canadians, but its association with overweight and obesity is poorly understood partly because of limited attention to confounding. This study assessed the relationship between food insecurity status and overweight/obesity in Canada. Cross-sectional data for individuals aged 2-64 years were drawn from the 2004 and 2015 Canadian Community Health Survey-Nutrition. Overweight/obesity was defined using body mass index calculated with measured height and weight. Food insecurity status was assessed with the 18-item Household Food Security Survey Module. The relationship was examined among preschool children (n = 2007), girls (n = 5512), boys (n = 5507), women (n = 8317), and men (n = 7279) using propensity score weighted logistic regressions to control for confounding. Relative to their food-secure counterparts, girls in moderately food-insecure households (39.7% vs. 28.5%), boys in severely food-insecure households (54.4% vs. 35.0%), and women in moderately and severely food-insecure households (58.9% and 73.1% vs. 50.7%) had higher overweight/obesity prevalence; men in moderately food-insecure households had a lower prevalence (48.9% vs. 66.3%). With propensity score weighting, no association existed between food insecurity and overweight/obesity among preschool children, girls, boys, or men. For women, moderate (adjusted odds ratio (AOR): 1.61; 95% confidence interval (95%CI): 1.06-2.47) and severe (AOR: 2.33; 95%CI: 1.22-4.44) food insecurity was positively associated with overweight/obesity; the association was strongest for severe food insecurity and obesity (AOR: 3.38; 95%CI: 1.60-7.16). Additional research is needed to better understand the nature of the relationship among women. Problems of food insecurity and overweight/obesity among Canadian children and men should not be conflated in public health interventions.

Pre-Existing Left Bundle Branch Block and Clinical Outcomes After Transcatheter Aortic Valve Replacement

Background

Few reports on pre-existing left bundle branch block (LBBB) in patients undergoing transcatheter aortic valve replacement (TAVR) are currently available. Further, no present studies compare patients with new onset LBBB with those with pre-existing LBBB.

Objectives

This study aimed to investigate the association between pre-existing or new onset LBBB and clinical outcomes after TAVR.

Methods

Using data from the Japanese multicenter registry, 5,996 patients who underwent TAVR between October 2013 and December 2019 were included. Patients were classified into 3 groups: no LBBB, pre-existing LBBB, and new onset LBBB. The 2-year clinical outcomes were compared between 3 groups using Cox proportional hazards models and propensity score analysis to adjust the differences in baseline characteristics.

Results

Of 5,996 patients who underwent TAVR, 280 (4.6%) had pre-existing LBBB, while 1,658 (27.6%) experienced new onset LBBB. Compared with the no LBBB group, multivariable Cox regression analysis showed that pre-existing LBBB was associated not only with a higher 2-year all-cause (adjusted HR: 1.39; 95% CI: 1.06-1.82; P = 0.015) and cardiovascular (adjusted HR: 1.60; 95% CI: 1.04-2.48; P = 0.031) mortality, but also with higher all-cause (adjusted HR: 1.43, 95% CI: 1.07-1.91; P = 0.016) and cardiovascular (adjusted HR: 1.81, 95% CI:1.12-2.93; P = 0.014) mortality than the new onset LBBB group. Heart failure was the most common cause of cardiovascular death, with more heart failure deaths in the pre-existing LBBB group.

Conclusions

Pre-existing LBBB was independently associated with poor clinical outcomes, reflecting an increased risk of cardiovascular mortality after TAVR. Patients with pre-existing LBBB should be carefully monitored.

Comparing Perioperative Complications of Off-Clamp versus On-Clamp Partial Nephrectomy for Renal Cancer Using a Novel Energy Balancing Weights Method

Partial nephrectomy (PN) is the primary surgical method for renal tumor treatment, typically involving clamping the renal artery during tumor removal, leading to warm ischemia and potential renal function impairment. Off-clamp approaches have been explored to mitigate organ damage, yet few results have emerged about the possible effects on hemoglobin loss. Most evidence comes from retrospective studies using propensity score matching, known to be sensitive to PS model misspecification. The energy balancing weights (EBW) method offers an alternative method to address bias by focusing on balancing all the characteristics of covariate distribution. We aimed to compare on- vs. off-clamp techniques in PN using EB-weighted retrospective patient data. Out of 333 consecutive PNs (275/58 on/off-clamp ratio), the EBW method achieved balanced variables, notably tumor anatomy and staging. No significant differences were observed in the operative endpoints between on- and off-clamp techniques, although off-clamp PNs showed slight reductions in hemoglobin loss and renal function decline, albeit with slightly higher perioperative blood loss. Our findings support previous evidence, indicating comparable surgical outcomes between standard and off-clamp procedures, with the EBW method proving effective in balancing baseline variables in observational studies comparing interventions.

Comparative efficacy of ofatumumab versus oral therapies for relapsing multiple sclerosis patients using propensity score analyses and simulated treatment comparisons

Background

Evidence from network meta-analyses (NMAs) and real-world propensity score (PS) analyses suggest monoclonal antibodies (mAbs) offer a therapeutic advantage over currently available oral therapies and, therefore, warrant consideration as a distinct group of high-efficacy disease-modifying therapies (DMTs) for patients with relapsing multiple sclerosis (RMS). This is counter to the current perception of these therapies by some stakeholders, including payers.

Objectives

A multifaceted indirect treatment comparison (ITC) approach was undertaken to clarify the relative efficacy of mAbs and oral therapies.

Design

Two ITC methods that use individual patient data (IPD) to adjust for between-trial differences, PS analyses and simulated treatment comparisons (STCs), were used to compare the mAb ofatumumab versus the oral therapies cladribine, fingolimod, and ozanimod.

Data sources and methods

As IPD were available for trials of ofatumumab and fingolimod, PS analyses were conducted. Given summary-level data were available for cladribine, fingolimod, and ozanimod trials, STCs were conducted between ofatumumab and each of these oral therapies. Three efficacy outcomes were compared: annualized relapse rate (ARR), 3-month confirmed disability progression (3mCDP), and 6-month CDP (6mCDP).

Results

The PS analyses demonstrated ofatumumab was statistically superior to fingolimod for ARR and time to 3mCDP but not time to 6mCDP. In STCs, ofatumumab was statistically superior in reducing ARR and decreasing the proportion of patients with 3mCDP compared with cladribine, fingolimod, and ozanimod and in decreasing the proportion with 6mCP compared with fingolimod and ozanimod. These findings were largely consistent with recently published NMAs that identified mAb therapies as the most efficacious DMTs for RMS.

Conclusion

Complementary ITC methods showed ofatumumab was superior to cladribine, fingolimod, and ozanimod in lowering relapse rates and delaying disability progression among patients with RMS. Our study supports the therapeutic superiority of mAbs over currently available oral DMTs for RMS and the delineation of mAbs as high-efficacy therapies.

Predicting postinterventional rupture of intracranial aneurysms using arteriography-derived radiomic features after pipeline embolization

Background and purpose

Postinterventional rupture of intracranial aneurysms (IAs) remains a severe complication after flow diverter treatment. However, potential hemodynamic mechanisms underlying independent predictors for postinterventional rupture of IAs remain unclear. In this study, we employed arteriography-derived radiomic features to predict this complication.

Methods

We included 64 patients who underwent pipeline flow diversion for intracranial aneurysms, distinguishing between 16 patients who experienced postinterventional rupture and 48 who did not. We performed propensity score matching based on clinical and morphological factors to match these patients with 48 patients with postinterventional unruptured IAs at a 1:3 ratio. Postinterventional digital subtraction angiography were used to create five arteriography-derived perfusion parameter maps and then radiomics features were obtained from each map. Informative features were selected through the least absolute shrinkage and selection operator method with five-fold cross-validation. Subsequently, radiomics scores were formulated to predict the occurrence of postinterventional IA ruptures. Prediction performance was evaluated with the training and test datasets using area under the curve (AUC) and confusion matrix-derived metrics.

Results

Overall, 1,459 radiomics features were obtained, and six were selected. The resulting radiomics scores had high efficacy in distinguishing the postinterventional rupture group. The AUC and Youden index were 0.912 (95% confidence interval: 0.767-1.000) and 0.847 for the training dataset, respectively, and 0.938 (95% confidence interval, 0.806-1.000) and 0.800 for the testing dataset, respectively.

Conclusion

Radiomics scores generated using arteriography-derived radiomic features effectively predicted postinterventional IA ruptures and may aid in differentiating IAs at high risk of postinterventional rupture.

Propensity score-incorporated adaptive design approaches when incorporating real-world data

The propensity score-integrated composite likelihood (PSCL) method is one method that can be utilized to design and analyze an application when real-world data (RWD) are leveraged to augment a prospectively designed clinical study. In the PSCL, strata are formed based on propensity scores (PS) such that similar subjects in terms of the baseline covariates from both the current study and RWD sources are placed in the same stratum, and then composite likelihood method is applied to down-weight the information from the RWD. While PSCL was originally proposed for a fixed design, it can be extended to be applied under an adaptive design framework with the purpose to either potentially claim an early success or to re-estimate the sample size. In this paper, a general strategy is proposed due to the feature of PSCL. For the possibility of claiming early success, Fisher's combination test is utilized. When the purpose is to re-estimate the sample size, the proposed procedure is based on the test proposed by Cui, Hung, and Wang. The implementation of these two procedures is demonstrated via an example.

The Effect of CenteringPregnancy Group Antenatal Care on Maternal, Birth, and Neonatal Outcomes Among Low-Risk Women in the Netherlands: A Stepped-Wedge Cluster Randomized Trial

INTRODUCTION

This study was carried out to assess the effects of participating in CenteringPregnancy (CP) on maternal, birth, and neonatal outcomes among low-risk pregnant women in the Netherlands.

METHODS

A total of 2124 pregnant women in primary care were included in the study. Data were derived from the Dutch national database, Perined, complemented with data from questionnaires completed by pregnant women. A stepwise-wedge design was employed; multilevel intention-to-treat analyses and propensity score matching were the main analytic approaches. Propensity score matching resulted in sample sizes of 305 nulliparous women in both the individual care (IC) and the matched control group (control-IC) and 267 in the CP and control-CP groups. For multiparous women, 354 matches were found for IC and control-IC groups and 152 for CP and control-CP groups. Main outcome measures were maternal, birth, and neonatal outcomes.

RESULTS

Compared with the control-CP group receiving standard antenatal care, nulliparous women participating in CP had a lower risk of maternal hypertensive disorders (odds ratio [OR], 0.53; 95% CI, 0.30-0.93) and for the composite adverse maternal outcome (OR, 0.52; 95% CI, 0.33-0.82). Breastfeeding initiation rates were higher amongst nulliparous (OR, 2.23; 95% CI, 134-3.69) and multiparous women (OR, 1.62; 95% CI, 1.00-2.62) participating in CP compared with women in the control-CP group.

CONCLUSION

Nulliparous women in CP were at lower risk of developing hypertensive disorders during pregnancy and, consequently, at lower risk of having adverse maternal outcomes. The results confirmed our hypothesis that both nulliparous and multiparous women who participated in CP would have higher breastfeeding rates compared with women receiving standard antenatal care.

Proton Pump Inhibitors and Cyclin-Dependent Kinase 4/6 Inhibitors in Patients With Breast Cancer

BACKGROUND

Proton pump inhibitors (PPIs) reduce the bioavailability of several anticancer drugs. The impact of PPIs co-administered with cyclin-dependent kinase 4 and 6 inhibitors is controversial. We aimed to clarify whether the concomitant use of PPIs impacts palbociclib and abemaciclib effectiveness in breast cancer treatment.

PATIENTS AND METHODS

This multicenter, retrospective, observational study, conducted across 4 medical institutions in Japan, consecutively included patients with endocrine-resistant metastatic breast cancer, receiving palbociclib or abemaciclib between December 2017 and August 2022. Propensity score-matched analyses were performed. Treatment efficacy and safety with and without PPIs were compared. Progression-free survival and overall survival were estimated using the Kaplan-Meier method and compared using a log-rank test. A Cox proportional hazards model was used to estimate the hazard ratio.

RESULTS

The study included 240 patients. After 1:1 matching, 112 patients were treated with and without PPIs. The median progression-free survival period was 1.2 years in the PPI group and 1.3 years in the non-PPI group (hazard ratio, 1.19; 95% CI, 0.70-2.02). The median overall survival period was 3.6 years in the PPI group, whereas it was not reached in the non-PPI group (hazard ratio, 1.23; 95% CI, 0.61-2.47). Consistent results were obtained for subgroups receiving palbociclib (n = 177) and abemaciclib (n = 63) without propensity score matching. Adverse event incidence and severity were similar in both groups.

CONCLUSION

The effectiveness of cyclin-dependent kinase 4/6 inhibitors is unlikely to be affected by concomitant PPI use. Future prospective pharmacokinetic studies are warranted.

Characterizing Imbalance in the Tails of the Propensity Score Distribution

Understanding characteristics of patients with propensity scores in the tails of the propensity score (PS) distribution has relevance for inverse-probability-of-treatment-weighted and PS-based estimation in observational studies. Here we outline a method for identifying variables most responsible for extreme propensity scores. The approach is illustrated in 3 scenarios: 1) a plasmode simulation of adult patients in the National Ambulatory Medical Care Survey (2011-2015) and 2) timing of dexamethasone initiation and 3) timing of remdesivir initiation in patients hospitalized for coronavirus disease 2019 from February 2020 through January 2021. PS models were fitted using relevant baseline covariates, and tails of the PS distribution were defined using asymmetric first and 99th percentiles. After fitting of the PS model in each original data set, values of each key covariate were permuted and model-agnostic variable importance measures were examined. Visualization and variable importance techniques were helpful in identifying variables most responsible for extreme propensity scores and may help identify individual characteristics that might make patients inappropriate for inclusion in a study (e.g., off-label use). Subsetting or restricting the study sample based on variables identified using this approach may help investigators avoid the need for trimming or overlap weights in studies.

Visualizing the target estimand in comparative effectiveness studies with multiple treatments

Aim: Comparative effectiveness research using real-world data often involves pairwise propensity score matching to adjust for confounding bias. We show that corresponding treatment effect estimates may have limited external validity, and propose two visualization tools to clarify the target estimand. Materials & methods: We conduct a simulation study to demonstrate, with bivariate ellipses and joy plots, that differences in covariate distributions across treatment groups may affect the external validity of treatment effect estimates. We showcase how these visualization tools can facilitate the interpretation of target estimands in a case study comparing the effectiveness of teriflunomide (TERI), dimethyl fumarate (DMF) and natalizumab (NAT) on manual dexterity in patients with multiple sclerosis. Results: In the simulation study, estimates of the treatment effect greatly differed depending on the target population. For example, when comparing treatment B with C, the estimated treatment effect (and respective standard error) varied from -0.27 (0.03) to -0.37 (0.04) in the type of patients initially receiving treatment B and C, respectively. Visualization of the matched samples revealed that covariate distributions vary for each comparison and cannot be used to target one common treatment effect for the three treatment comparisons. In the case study, the bivariate distribution of age and disease duration varied across the population of patients receiving TERI, DMF or NAT. Although results suggest that DMF and NAT improve manual dexterity at 1 year compared with TERI, the effectiveness of DMF versus NAT differs depending on which target estimand is used. Conclusion: Visualization tools may help to clarify the target population in comparative effectiveness studies and resolve ambiguity about the interpretation of estimated treatment effects.

Associations between morphological parameters and ruptured anterior communicating artery aneurysm: A propensity score-matched, single center, case-control study

BACKGROUND

To identify an association between morphological parameters and the rupture risk of anterior communicating artery (ACoA) aneurysms using propensity score matching (PSM).

METHODS

Data for 109 patients with ACoA aneurysms treated from January 2018 to October 2021 were reviewed; 94 patients were enrolled. The geometrical parameters of the ACoA aneurysms were measured and calculated using three-dimensional reconstructed digital subtraction angiography images. The aneurysms' morphological parameters were analyzed using a propensity score for six factors (age, sex, excess alcohol intake, smoking, hypertension, diabetes mellitus). Univariate logistic regression was used to analyze the relationship between the aneurysms' morphological parameters and rupture risk.

RESULTS

Twenty-five patients each with or without ruptured aneurysms were selected. After matching, no statistically significant differences were seen between the groups in their baseline characteristics. Aneurysm neck size (p = 0.038) was higher in the unruptured group than that in the ruptured group, and the dome-to-neck ratio (D/N; p = 0.009) and aspect ratio (AR; p = 0.003) were higher in the ruptured group than those in the unruptured group. Univariable logistic regression analysis demonstrated that ACoA aneurysm rupture was associated with AR (odds ratio: 8.047; 95% confidence interval: 1.569-41.213; p = 0.012) and D/N (odds ratio: 4.253; 95% confidence interval: 1.228-14.731; p = 0.022). The areas under the receiver operating characteristic curves for AR and D/N were 0.746 and 0.715, respectively.

CONCLUSIONS

After PSM, ACoA aneurysms with higher AR and D/N, and smaller neck size were more likely to rupture. AR may be a much more important predictor of aneurysm rupture than other predictors.

Induction of labor and risk of postpartum hemorrhage in women with vaginal delivery: A propensity score analysis

OBJECTIVE

To explore the association between induction of labor (IOL) and postpartum hemorrhage (PPH) after vaginal delivery.

METHODS

We included women from the merged database of three randomized prospective trials (TRACOR, CYTOCINON, and TRAAP) that measured postpartum blood loss precisely, with standardized methods. IOL was considered overall and according to its method. The association between IOL and PPH was tested by multivariate logistic regression modeling, adjusted for confounders, and by propensity score matching. The role of potential intermediate factors, i.e. estimated quantity of oxytocin administered during labor and operative vaginal delivery, was assessed with structural equation modeling.

RESULTS

Labor was induced for 1809 of the 9209 (19.6%) women. IOL was associated with a significantly higher risk of PPH of 500 mL or more (adjusted odds ratio 1.56, 95% confidence interval 1.42-1.70) and PPH of 1000 mL or more (adjusted odds ratio 1.51, 95% confidence interval 1.16-1.96). The risk of PPH increased similarly regardless of the method of induction. The results were similar after propensity score matching (odds ratio for PPH ≥500 mL 1.57, 95% confidence interval 1.33-1.87, odds ratio for PPH ≥1000 mL 1.57, 95% confidence interval 1.06-2.07). Structural equation modeling showed that 34% of this association was mediated by the quantity of oxytocin administered during labor and 1.3% by women who underwent operative vaginal delivery.

CONCLUSION

Among women with vaginal delivery, the risk of PPH is higher in those with IOL, regardless of its method, and after accounting for indication bias. The quantity of oxytocin administered during labor may explain one third of this association.

Impact of urinary diversion type on urethral recurrence following radical cystectomy for bladder cancer: propensity score matched and weighted analyses of retrospective cohort

BACKGROUND

The absence of randomized controlled trials and the presence of inherent selection bias in existing studies have led to ongoing uncertainty regarding the impact of urinary diversion (UD) type (orthotopic UD or nonorthotopic UD) on urethral recurrence (UR) following radical cystectomy (RC) for bladder cancer. This study aimed to assess the impact of the UD types on UR after RC and to identify predictive factors associated with UR.

MATERIALS AND METHODS

This retrospective analysis encompassed 612 male patients who underwent RC for urothelial carcinoma of the bladder. Among them, 341 patients received nonorthotopic UD [ileal conduit (IC) or ureterocutaneostomy (UC)], whereas 271 received orthotopic neobladder (NB) between January 2012 and October 2022. To mitigate potential biases, we employed 1:1 propensity score matching (PSM) and stabilized inverse probability treatment weighting (IPTW). Kaplan-Meier analysis and log-rank tests were employed to assess UR-free survival between the IC/UC and NB groups, while multivariable Cox regression analysis was conducted to determine predictive factors for UR.

RESULTS

Among the 612 patients included, 33 (5.4%) experienced UR. PSM yielded matched cohort comprising 412 patients, evenly distributed with 206 patients in each group (IC/UC and NB). Clinicopathological data demonstrated similarity between the two groups. Patients who underwent NB exhibited significantly superior UR-free survival in both PSM (log-rank P =0.033) and IPTW cohorts (log-rank P =0.009). NB reconstruction (vs. IC/UC) emerged as a substantial protective factor against UR [hazard ratio (HR) 0.283; 95% CI: 0.088-0.916; P =0.035], whereas prostatic urethral involvement was identified as a significant risk factor (HR 5.328; 95% CI: 1.298-21.868; P =0.020) in the PSM cohort. Additionally, in the IPTW cohort, NB reconstruction (vs. IC/UC) maintained its significance as a protective factor against UR (HR 0.336; 95% CI: 0.131-0.858; P =0.023) along with neoadjuvant chemotherapy (HR 0.335; 95% CI: 0.116-0.969; P =0.044), whereas prostatic urethral involvement remained a significant risk factor (HR 3.752; 95% CI: 1.484-9.488; P =0.005).

CONCLUSIONS

Even after mitigating selection bias, NB reconstruction holds a protective effect against UR in male patients undergoing RC for bladder cancer.

Estimating Surveillance Bias in Child Maltreatment Reporting During Home Visiting Program Involvement

It is unclear if surveillance bias (increased reports to Child Protective Services [CPS] related to program involvement) has a substantial impact on evaluation of home visiting (HV) prevention programs. We estimated surveillance bias using data from Connecticut's HV program, birth certificates, CPS, and hospitals. Using propensity score matching, we identified 15,870 families similar to 4015 HV families. The difference-in-differences approach was used to estimate surveillance bias as the change in investigated reports from the last 6 months of program involvement to the next 6 months. The median age of the children at program exit was 1.2 years (range: 60 days, 5 years). We estimated that 25.6% of investigated reports in the HV group resulted from surveillance bias. We reviewed CPS reports of 194 home-visited families to determine if a home visitor made the report and found that 10% were directly from home visitors. Program evaluations should account for surveillance bias.

Effect of Abdominal Aortic Calcification on Recurrence Following Initial Hepatectomy for Colorectal Liver Metastases

BACKGROUND/AIM

The aim of the study was to analyze the association between abdominal aortic calcification (AAC) and patient prognosis following resection of colorectal liver metastases (CRLM). AAC potentially reflects intrahepatic immunity and is involved in tumor development and progression. However, the clinical effects of AAC on colorectal cancer (CRC) prognosis after curative-intent liver resection for CRLM remain unclear.

PATIENTS AND METHODS

We evaluated the effect of AAC on the clinical prognosis and metastatic patterns in 99 patients who underwent hepatectomy for CRLM between 2010 and 2019.

RESULTS

The high-AAC group had significantly worse overall survival (OS) and remnant liver recurrence rate (RR) after propensity score matching to adjust for differences in baseline characteristics of patients and tumors. In multivariate Cox regression analyses, high AAC volume was an independent risk factor for poor OS and liver RR, but not poor lung RR. The expression of tumor necrosis factor-related apoptosis-inducing ligand, known as an anti-tumor marker, in liver natural killer (NK) cells was lower in the high-AAC group than in the low-AAC group.

CONCLUSION

High AAC volume showed a strong relationship with remnant liver RR after curative resection of CRLM. High AAC volume may be responsible for the suppression of anti-tumor activity of liver NK cells, which results in an increased risk of liver recurrence and poor prognosis.

Statistical inference for time-to-event data in non-randomized cohorts with selective attrition

In multi-season clinical trials with a randomize-once strategy, patients enrolled from previous seasons who stay alive and remain in the study will be treated according to the initial randomization in subsequent seasons. To address the potentially selective attrition from earlier seasons for the non-randomized cohorts, we develop an inverse probability of treatment weighting method using season-specific propensity scores to produce unbiased estimates of survival functions or hazard ratios. Bootstrap variance estimators are used to account for the randomness in the estimated weights and the potential correlations in repeated events within each patient from season to season. Simulation studies show that the weighting procedure and bootstrap variance estimator provide unbiased estimates and valid inferences in Kaplan-Meier estimates and Cox proportional hazard models. Finally, data from the INVESTED trial are analyzed to illustrate the proposed method.

High-dimensional generalized median adaptive lasso with application to omics data

Recently, there has been a growing interest in variable selection for causal inference within the context of high-dimensional data. However, when the outcome exhibits a skewed distribution, ensuring the accuracy of variable selection and causal effect estimation might be challenging. Here, we introduce the generalized median adaptive lasso (GMAL) for covariate selection to achieve an accurate estimation of causal effect even when the outcome follows skewed distributions. A distinctive feature of our proposed method is that we utilize a linear median regression model for constructing penalty weights, thereby maintaining the accuracy of variable selection and causal effect estimation even when the outcome presents extremely skewed distributions. Simulation results showed that our proposed method performs comparably to existing methods in variable selection when the outcome follows a symmetric distribution. Besides, the proposed method exhibited obvious superiority over the existing methods when the outcome follows a skewed distribution. Meanwhile, our proposed method consistently outperformed the existing methods in causal estimation, as indicated by smaller root-mean-square error. We also utilized the GMAL method on a deoxyribonucleic acid methylation dataset from the Alzheimer's disease (AD) neuroimaging initiative database to investigate the association between cerebrospinal fluid tau protein levels and the severity of AD.

Efficiency and safety of hepatic arterial infusion chemotherapy (HAIC) combined with anti-PD1 therapy versus HAIC monotherapy for advanced hepatocellular carcinoma: A multicenter propensity score matching analysis

PURPOSE

To investigate the clinical efficacy and safety of combination therapy of hepatic arterial infusion chemotherapy (HAIC) and anti-programmed cell death protein-1 (PD-1) therapy in the treatment of advanced hepatocellular carcinoma (HCC).

METHODS

In this retrospective clinical research, from March 2018 to December 2019, 1158 HCC patients categorized as BCLC stage C were reviewed for eligibility. We utilized propensity score matching (PSM) to mitigate initial disparities between the groups. The evaluation of the best tumor response was conducted in accordance with mRECIST 1.1 criteria. The difference in survival outcomes including overall survival (OS), progression-free survival (PFS), and objective response rate (ORR) between groups were compared.

RESULTS

Following the eligibility review, 453 patients underwent a combined treatment of HAIC with PD1 inhibitors (HAIC-PD1 group), while 221 patients received HAIC monotherapy (HAIC group) met the inclusion criteria and were finally enrolled in this study. In the entire cohort, the HAIC-PD1 group exhibited significantly prolonged overall survival (median overall survival: 40.4 months vs. 9.7 months, p < 0.001) and progression-free survival (median progression-free survival: 22.1 months vs. 5.8 months, p < 0.001). By propensity score, patients were matched according to baseline differences, resulting in all 442 patients in group HAIC-PD1 (n = 221) and group HAIC (n = 221). After PSM adjustment, as well, the survival of the HAIC-PD1 group was still distinctly longer than the HAIC group (median overall survival time, 40.4 months vs 9.7 months, p < 0.001; median progression-free survival, 22.1 months vs 5.7 months, p < 0.001). Univariate and multivariable analysis demonstrated that AFP level, metastasis, and therapeutic schedule were independent predictive factors for overall survival.

CONCLUSION

The combination therapy of HAIC and PD1 inhibitors successfully extended OS to advanced HCC patients and could be a better choice than HAIC monotherapy.

Association between periodontal disease and malignant soft tissue sarcomas

OBJECTIVE

Malignant soft tissue sarcoma (MSTS) is a rare disease, but is seen in patients undergoing orthopedic surgery. Although the association of periodontal disease with various cancers occurring in the oral cavity, gastrointestinal tract, lungs, and prostate, has been reported, the association between periodontal disease and MSTS remains unclear. This study investigated the association between periodontal disease and MSTS in patients undergoing orthopedic surgery.

SUBJECTS AND METHODS

One hundred fifteen patients who underwent orthopedic surgery between 2017 and 2021 were retrospectively enrolled (mean age = 66.8 ± 10.7 years). The patient background was adjusted by the propensity score (PS). Subsequently, the association of periodontal disease with MSTS was analyzed using PS inverse probability of treatment weighting (IPTW). Periodontal status was determined by evaluating the periodontal inflamed surface area, which was calculated by measuring the periodontal probing pocket depth and detecting bleeding on probing.

RESULTS

Multivariate logistic regression analysis after adjustment by the PS showed that severe periodontitis was significantly associated with MSTS (odds ratio 2.81, p = 0.04). Furthermore, IPTW showed that severe periodontitis was significantly associated with MSTS (odds ratio 3.21, p = 0.01).

CONCLUSION

The results indicate an association between periodontal inflammation and MSTS.

Thiazide Diuretics and Risk of Colorectal Cancer: A Population-Based Cohort Study

Evidence from clinical trials and observational studies on the association between thiazide diuretics and colorectal cancer risk is conflicting. We aimed to determine whether thiazide diuretics are associated with an increased colorectal cancer risk compared with dihydropyridine calcium channel blockers (dCCBs). A population-based, new-user cohort was assembled using the UK Clinical Practice Research Datalink. Between 1990-2018, we compared thiazide diuretic initiators with dCCB initiators and estimated hazard ratios (HR) with 95% confidence intervals (CIs) of colorectal cancer using Cox proportional hazard models. Models were weighted using standardized morbidity ratio weights generated from calendar time-specific propensity scores. The cohort included 377,760 thiazide diuretic initiators and 364,300 dCCB initiators, generating 3,619,883 person-years of follow-up. Compared with dCCBs, thiazide diuretics were not associated with colorectal cancer (weighted HR = 0.97, 95% CI: 0.90, 1.04). Secondary analyses yielded similar results, although an increased risk was observed among patients with inflammatory bowel disease (weighted HR = 2.45, 95% CI: 1.13, 5.35) and potentially polyps (weighted HR = 1.46, 95% CI: 0.93, 2.30). Compared with dCCBs, thiazide diuretics were not associated with an overall increased colorectal cancer risk. While these findings provide some reassurance, research is needed to corroborate the elevated risks observed among patients with inflammatory bowel disease and history of polyps.

The Impact of Using Donor Sperm After ICSI Failure in Severe Oligozoospermia on Male Mental Health and Erectile Function

Objective

To analyze the mental health and erectile function status of men using sperm donor during pregnancy after ICSI failure in severe oligoasthenospermia and to provide reference for clinical implementation of more targeted psychological intervention and nursing for this group.

Methods

A total of 410 sterile men who received assisted pregnancy treatment in our hospital from December 2020 to December 2022 and met the inclusion and exclusion criteria were collected as the study subjects. Among them, 68 patients with severe oligoasthenospermia who used donor assisted pregnancy after ICSI failure were used as the study group. Sixty-eight patients with severe oligoasthenospermia who continued to receive ICSI assisted pregnancy were matched by propensity score 1:1 as control group. General data questionnaire, self-rating Anxiety Scale (SAS), self-rating Depression Scale (SDS), Chinese version of perceived Stress Scale (CPSS) and International Erectile Function Index Rating Scale (IIEF-5) were used to conduct a cross-sectional investigation to compare the mental health and erectile function status of the two groups.

Results

There were statistical differences in age and occupational status between the two groups before PSM (P < 0.05), but there was no statistical significance in social demographic data between the two groups after matching (P > 0.05). The incidence of anxiety, depression, stress and erectile dysfunction (ED) in the study group was higher than that in the control group, and there were statistical differences between the two groups (P < 0.05).

Conclusion

The use of donor sperm to assist pregnancy has a great impact on the mental health and erectile function of infertile men. Medical personnel should pay attention to the mental health and erectile function of these men, and formulate targeted measures to help these patients actively cope with infertility, so as to improve the life and marriage quality of this group and improve their mental health status.

Novel biomarkers based on dual-energy computed tomography for risk stratification of very early distant metastasis in colorectal cancer after surgery

Background

Very early distant metastasis (VEDM) for patients with colorectal cancer (CRC) following surgery suggests failure of local treatment strategy and few biomarkers are available for its effective risk stratification. This study aimed to explore the potential of quantitative dual-energy computed tomography (DECT) spectral parameters and build models to predict VEDM.

Methods

Consecutive patients suspected of having CRC and with a clinical indication for enhanced CT from April 2021 to July 2022 at a single institution were prospectively enrolled to undertake spectral CT scanning. The spectral features were extracted by two reviewers and intraclass correlation coefficient (ICC) was used for interobserver agreement evaluation. A total of 16 spectral parameters, including unenhanced effective atomic number, triphasic iodine concentrations (ICs)/normalized ICs (NICs)-A/V/E/1/NIC-A/V/E/spectral curve slopes (λ-A/V/E), two arterial enhancement fractions (AEFs), and venous enhancement fraction (VEF), were determined for analysis. Patients with and without VEDM after surgery were matched using propensity score matching (PSM). The diagnostic performance was assessed using the area under the curve (AUC). Models of multiple modalities were generated.

Results

In total, 222 patients were included (141 males, age range, 32-83 years) and 13 patients developed VEDM. Interobserver agreement ranged from good to excellent (ICC, 0.773-0.964). A total of three spectral parameters (VEF, λ-V, and 1/NIC-V) exhibited significant discriminatory ability (P<0.05) in predicting VEDM, with AUCs of 0.822 [95% confidence interval (CI): 0.667-0.926], 0.738 (95% CI: 0.573-0.866), and 0.713 (95% CI: 0.546-0.846) and optimal cutoff points of 67.16%, 2.46, and 2.44, respectively. The performance of these spectral parameters was validated in the entire cohort; the combined spectral model showed comparable efficiency to the combined clinical model [AUC, 0.771 (95% CI: 0.622-0.919) vs. 0.779 (95% CI: 0.663-0.894), P>0.05]; the clinical-spectral model achieved further improved AUC of 0.887 (95% CI: 0.812-0.962), which was significantly higher than the combined clinical model (P=0.015), yet not superior to the combined spectral model (P=0.078).

Conclusions

Novel spectral parameters showed potential in predicting VEDM in CRC following surgery in this preliminary study, which were closely related with spectral perfusion in the venous phase. However, further studies with larger samples are warranted.

Use of clinical classifications software to address ICD coding transition in large healthcare databases analyzed via high-dimensional propensity scores

PURPOSE

The EUPAS26595 study characterized the rate of acute renal failure (ARF) in patients exposed to levetiracetam versus other antiepileptic drugs using healthcare claims data and a high-dimensional propensity score (hd-PS) for confounding adjustment. The data contained several coding systems by design and an update in International Classification of Diseases (ICD) coding dictionary. Such coding heterogeneity can affect the performance of hd-PS, and manually coding harmonization is not feasible. Our objective was to explore the impact of code aggregation via Clinical Classifications Software (CCS) on the analysis of a large claims-based database using hd-PS.

METHODS

Patients with epilepsy, who were new-users of an antiepileptic drug, were identified from the IBM® MarketScan® Research Databases. We used CCS categories to harmonize coding and compared the results with other alternatives. Incidence rate ratios (IRRs) were computed using modified Poisson regression model with a robust variance estimator.

RESULTS

For January 2008-October 2015 (before ICD update), 34 833 eligible patients initiated levetiracetam and 52 649 initiated a comparator drug; IRR (95% CI) for ARF for the hd-PS analysis was 1.34 (0.72-2.50) without CCS categories and 1.30 (0.71-2.39) with CCS categories. For January 2008-December 2017 (including ICD coding change), 45 672 eligible patients initiated levetiracetam and 64 664 initiated a comparator drug; IRR (95% CI) for the hd-PS analysis was 1.34 (0.78-2.29) without CCS categories and 1.37 (0.80-2.34) with CCS categories.

CONCLUSIONS

Using single-level CCS categories to overcome differences in coding provides consistent results and can be used in studies that use large claims data and hd-PS for adjustment.

Impact of the matching algorithm on the treatment effect estimate: A neutral comparison study

Propensity score matching is increasingly being used in the medical literature. Choice of matching algorithms, reporting quality, and estimands are oftentimes not discussed. We evaluated the impact of propensity score matching algorithms, based on a recent clinical dataset, with three commonly used outcomes. The resulting estimands for different strengths of treatment effects were compared in a neutral comparison study and based on a thoroughly designed simulation study. Different algorithms yielded different levels of balance after matching. Along with full matching and genetic matching with replacement, good balance was achieved with nearest neighbor matching with caliper but thereby more than one fifth of the treated units were discarded. Average marginal treatment effect estimates were least biased with genetic or nearest neighbor matching, both with replacement and full matching. Double adjustment yielded conditional treatment effects that were closer to the true values, throughout. The choice of the matching algorithm had an impact on covariate balance after matching as well as treatment effect estimates. In comparison, genetic matching with replacement yielded better covariate balance than all other matching algorithms. A literature review in the British Medical Journal including its subjournals revealed frequent use of propensity score matching; however, the use of different matching algorithms before treatment effect estimation was only reported in one out of 21 studies. Propensity score matching is a methodology for causal treatment effect estimation from observational data; however, the methodological difficulties and low reporting quality in applied medical research need to be addressed.

Stratified analysis in comparative effectiveness studies that emulate randomized trials

PURPOSE

For observational cohort studies that employ matching by propensity scores (PS), preliminary stratification by consequential predictors of outcome better emulates stratified randomization and potentially reduces variance and bias through relaxed dependence on modeling assumptions. We assessed the impact of pre-stratification in two real-life examples. For both, prior evidence from placebo-controlled randomized clinical trials (RCTs) suggested small or no risk reduction, but observational analysis suggested protection, presumably the result of confounding bias.

STUDY DESIGN AND SETTING

The study populations consisted of Medicare beneficiaries (2014-18) with type 2 diabetes initiating either (i) empagliflozin versus dipeptidyl peptidase-4 inhibitors (DPP-4i) or (ii) empagliflozin versus glucagon-like peptide-1 receptor agonists (GLP-1RA). The outcome was myocardial infarction or stroke. We estimated hazard ratios (HR) and rate differences (RD) after controlling for 143 pre-exposure covariates via 1:1 PS matching after (1) PS estimation in the total cohort (total-cohort PS-matching) and (2) PS estimation separately by baseline cardiovascular disease (stratified PS matching).

RESULTS

Stratified PS matching resulted in HRs that exceeded those from total-cohort PS-matching by 13% and 9%, respectively, for the comparisons of empagliflozin to DPP-4i and GLP-1RA. Against both comparators, HRs and RDs after stratified PS matching were closer to the null, with slightly higher variances (2%-3%) than those after total-cohort PS matching.

CONCLUSION

Stratified PS matching produced effect estimates closer to the expected trial findings than total-cohort PS matching. The price paid in increased variance was minimal.

Why Are We Weighting? Understanding the Estimates From Propensity Score Weighting and Matching Methods

BACKGROUND

Propensity score methods are used in observational studies to compensate for the lack of random allocation by balancing measured baseline characteristics between treated and untreated patients. We sought to explain the treatment effect estimates derived from different propensity score methods.

METHODS

We performed a retrospective analysis of long-term mortality after single internal mammary artery versus bilateral internal mammary artery (BIMA) conduit in 47 984 index isolated coronary artery bypass grafting procedures from 1992 to 2014 in the Northern New England Cardiovascular Disease Study Group registry using multivariable Cox regression, 1:1 propensity score matching, inverse probability weighting (IPW) among the treated, and IPW among the overall population treatment estimates.

RESULTS

The mean duration of follow-up was 13.2 (interquartile range, 7.4-17.7) years. In multivariable Cox regression, the adjusted hazard ratio for mortality was 0.83 (95% CI, 0.75-0.92) in patients receiving BIMA compared with a single internal mammary artery. The 1:1 propensity matched (hazard ratio, 0.79 [95% CI, 0.69-0.91]) and IPW among the treated (hazard ratio, 0.83 [95% CI, 0.75-0.92]) estimates showed a protective treatment effect of BIMA use on mortality. However, the IPW estimate of treatment effect for the overall population showed an increased risk of mortality after BIMA that was not statistically significant (hazard ratio, 1.08 [95% CI, 0.94-1.24]).

CONCLUSIONS

While the multivariable Cox regression, 1:1 propensity matching, and IPW treatment effect in the treated estimates demonstrate that BIMA was associated with a statistically significantly decreased risk of mortality, the IPW treatment effect in the average study population showed an increased risk of mortality associated with BIMA that was not statistically significant. This is attributed to the different populations (weighted to look like the overall study population versus treated group) represented by the 2 IPW approaches. Determining how the study population is balanced is a large driver of the treatment effect. Ultimately, the treatment effect estimate desired should drive the choice of the propensity score method.

randomized controlled trial

BACKGROUND

Randomized controlled trials have demonstrated that Songling Xuemaikang capsule (SXC) is effective in blood pressure (BP) lowering for essential hypertension. However, the effectiveness of SXC in real-world clinical practice remains unknown. We aimed to investigate whether the BP-lowering effectiveness of SXC in the real-world practice setting is comparable to the efficacy of the intervention in a randomized controlled trial.

METHODS

We included 1325 patients treated with SXC monotherapy from a real-world registry and 300 from the SXC-BP trial. A propensity score matching (PSM) approach was used to select participants from the two cohorts. The primary outcome was a change in the office of BP from baseline to 8 weeks.

RESULTS

After PSM, there were 552 patients for the comparative analysis. Clinically meaningful BP reductions were observed both in the real world and in the RCT cohorts after 8-week SXC treatment. The 8-week systolic/diastolic BP was 129.50/81.33 mm Hg vs. 134.97/84.14 mm Hg in the real-world population and the RCT population, respectively. The changes in systolic BP (15.82 ± 10.71 vs. 10.48 ± 10.24; P < .001), and diastolic BP (10.01 ± 7.73 vs. 7.75 ± 8.14; P = .001) from baseline to 8 weeks were significantly greater in the real-world population.

CONCLUSION

The current comparison demonstrated that SXC monotherapy is at least as effective in real-world settings as within the randomized controlled trial for BP lowering in patients with grade 1 hypertension.

Practical Utility of a Clinical Pathway for Older Patients with Aspiration Pneumonia: A Single-Center Retrospective Observational Study

Introduction: Clinical pathways (CPWs) are patient management tools based on a standardized treatment plan aimed at improving quality of care. This study aimed to investigate whether CPW-guided treatment has a favorable impact on the outcomes of hospitalized older patients with aspiration pneumonia. Method: This retrospective study included patients with aspiration pneumonia, aged ≥ 65 years, and hospitalized at a community hospital in Japan. CPW implementation was arbitrarily determined by the attending physician upon admission. Outcomes were compared according to with or without the CPW (CPW-group and non-CPW groups). Propensity score (PS)-based analyses were used to control for confounding factors. Logistic regression analyses were conducted to evaluate the impact of CPW on the clinical course and outcomes. Results: Of 596 included patients, 167 (28%) received the CPW-guided treatment. The mortality rate was 16.4%. In multivariable model, CPW implementation did not increase the risk for total and 30-day mortality, and resulted in shorter antibiotic therapy duration (≤9 days) (PS matching (PSM): odds ratio (OR) 0.50, p = 0.001; inverse provability of treatment weighting (IPTW): OR 0.48, p < 0.001) and length of hospital stay (≤21 days) (PSM: OR 0.67, p = 0.05; IPTW: OR 0.66, p = 0.03). Conclusions: This study support CPW utility in this population.

Scalable kernel balancing weights in a nationwide observational study of hospital profit status and heart attack outcomes

Weighting is a general and often-used method for statistical adjustment. Weighting has two objectives: first, to balance covariate distributions, and second, to ensure that the weights have minimal dispersion and thus produce a more stable estimator. A recent, increasingly common approach directly optimizes the weights toward these two objectives. However, this approach has not yet been feasible in large-scale datasets when investigators wish to flexibly balance general basis functions in an extended feature space. To address this practical problem, we describe a scalable and flexible approach to weighting that integrates a basis expansion in a reproducing kernel Hilbert space with state-of-the-art convex optimization techniques. Specifically, we use the rank-restricted Nyström method to efficiently compute a kernel basis for balancing in nearly linear time and space, and then use the specialized first-order alternating direction method of multipliers to rapidly find the optimal weights. In an extensive simulation study, we provide new insights into the performance of weighting estimators in large datasets, showing that the proposed approach substantially outperforms others in terms of accuracy and speed. Finally, we use this weighting approach to conduct a national study of the relationship between hospital profit status and heart attack outcomes in a comprehensive dataset of 1.27 million patients. We find that for-profit hospitals use interventional cardiology to treat heart attacks at similar rates as other hospitals but have higher mortality and readmission rates.

An evolutionary algorithm for the direct optimization of covariate balance between nonrandomized populations

Matching reduces confounding bias in comparing the outcomes of nonrandomized patient populations by removing systematic differences between them. Under very basic assumptions, propensity score (PS) matching can be shown to eliminate bias entirely in estimating the average treatment effect on the treated. In practice, misspecification of the PS model leads to deviations from theory and matching quality is ultimately judged by the observed post-matching balance in baseline covariates. Since covariate balance is the ultimate arbiter of successful matching, we argue for an approach to matching in which the success criterion is explicitly specified and describe an evolutionary algorithm to directly optimize an arbitrary metric of covariate balance. We demonstrate the performance of the proposed method using a simulated dataset of 275,000 patients and 10 matching covariates. We further apply the method to match 250 patients from a recently completed clinical trial to a pool of more than 160,000 patients identified from electronic health records on 101 covariates. In all cases, we find that the proposed method outperforms PS matching as measured by the specified balance criterion. We additionally find that the evolutionary approach can perform comparably to another popular direct optimization technique based on linear integer programming, while having the additional advantage of supporting arbitrary balance metrics. We demonstrate how the chosen balance metric impacts the statistical properties of the resulting matched populations, emphasizing the potential impact of using nonlinear balance functions in constructing an external control arm. We release our implementation of the considered algorithms in Python.