Bias in Before-After Studies: Narrative Overview for Anesthesiologists

Cardiopulmonary Bypass Blood Flow Rates and Major Adverse Kidney Events in Cardiac Surgery: A Propensity Score-adjusted Before-After Study

OBJECTIVES

Cardiac surgery associated-acute kidney injury is a common and serious postoperative complication of cardiac surgery, which is associated with increased postoperative morbidity and mortality. This study aimed to explore the association between cardiopulmonary bypass (CPB) blood flow rate (BFR), and major adverse kidney events (MAKEs) at day 30.

DESIGN

Retrospective single-center before-after observational study. Patients were divided in 2 groups according to CPB flow rates: a first group with an institutional protocol targeting a CPB-BFR of >2.2 L/min/m² (low CPB-BFR group), and a second group with a modified institutional protocol targeting a CPB-BFR of >2.4 L/min/m² (high CPB-BFR group). The primary outcome was MAKE at 30 days, defined as the composite of death, renal replacement therapy or persistent renal dysfunction.

SETTING

The data were collected from clinical routines in university hospital.

PARTICIPANTS

Adult patients who underwent elective and urgent cardiac surgery without severe chronic renal failure, for whom CPB duration was ≥90 minutes.

INTERVENTIONS

We included 533 patients (low CPB-BFR group, n = 270; high CPB-BFR group, n = 263).

MEASUREMENTS AND MAIN RESULTS

A significant decrease in MAKE at 30 days was observed in the high CPB-BFR group (3% v 8%; odds ratio [OR], 0.779; 95% confidence interval [CI], 0.661-0.919; p < 0.001) mainly mediated by a lower 30-day mortality in the high CPB-BFR group (1% v 5%; OR, 0.697; 95% CI, 0.595-0.817; p = 0.001), as was renal replacement therapy (1% v 4%; OR, 0.739; 95% CI, 0.604-0.904; p = 0.016).

CONCLUSIONS

In patients undergoing cardiac surgery, increased CPB-BFR was associated with a decrease in MAKE at 30 days including mortality and renal replacement therapy.

Effect of a non-reactive absorbent with or without environmentally oriented electronic feedback on anesthesia provider's fresh gas flow rates: A greening initiative

STUDY OBJECTIVE

To examine the effects of a non-reactive carbon dioxide absorbent (AMSORB® Plus) versus a traditional carbon dioxide absorbent (Medisorb™) on the FGF used by anesthesia providers and an electronic educational feedback intervention using Carestation™ Insights (GE HealthCare) on provider-specific change in FGF.

DESIGN

Prospective, single-center cohort study set in a greening initiative.

SETTING

Operating room.

PARTICIPANTS

157 anesthesia providers (i.e., anesthesiology trainees, certified registered nurse anesthetists, and solo anesthesiologists).

INTERVENTIONS

Intervention #1 was the introduction of AMSORB® Plus into 8 Aisys CS2, Carestation™ Insights-enabled anesthesia machines (GE HealthCare) at the study site. At the end of week 6, anesthesia providers were educated and given an environmentally oriented electronic feedback strategy for the next 12 weeks of the study (Intervention #2) using Carestation™ Insights data.

MEASUREMENTS

The dual primary outcomes were the difference in average daily FGF during maintenance anesthesia between machines assigned to AMSORB® Plus versus Medisorb™ and the provider-specific change in average fresh gas flows after 12 weeks of feedback and education compared to the historical data.

MAIN RESULTS

Over the 18-week period, there were 1577 inhaled anesthetics performed in the 8 operating rooms (528 for intervention 1, 1049 for intervention 2). There were 1001 provider days using Aisys CS2 machines and 7452 provider days of historical data from the preceding year. Overall, AMSORB® Plus was not associated with significantly less FGF (mean - 80 ml/min, 97.5% confidence interval - 206 to 46, P = .15). The environmentally oriented electronic feedback intervention was not associated with a significant decrease in provider-specific mean FGF (-112 ml/min, 97.5% confidence interval - 244 to 21, P = .059).

CONCLUSIONS

This study showed that introducing a non-reactive absorbent did not significantly alter FGF. Using environmentally oriented electronic feedback relying on data analytics did not result in significantly reduced provider-specific FGF.

Impact of Bedside Laparotomy Simulation and Microlearning on Trauma Nurse Role Clarity, Knowledge, and Confidence

BACKGROUND

The care of patients undergoing low-volume, high-risk emergency procedures such as bedside laparotomy (BSL) remains a challenge for surgical trauma critical care nurses.

OBJECTIVES

This study evaluates simulation and microlearning on trauma nurse role ambiguity, knowledge, and confidence in caring for patients during emergency BSL.

METHODS

The study is a single-center, prospective pretest-posttest design conducted from September to November 2022 at a Level I trauma center in the Mid-Atlantic United States using simulation and microlearning to evaluate role clarity, knowledge, and confidence among surgical trauma intensive care unit (STICU) nurses. Participants, nurses from a voluntary convenience sample within a STICU, attended a simulation and received three weekly microlearning modules. Instruments measuring role ambiguity, knowledge, and confidence were administered before the simulation, after, and again at 30 days.

RESULTS

From the pretest to the initial posttest, the median (interquartile range [IQR]) Role Ambiguity scores increased by 1.0 (1.13) (p < .001), and at the 30-day posttest, improved by 1.33 (1.5) (p < .001). The median (IQR) knowledge scores at initial posttest improved by 4.0 (2.0) (p < .001) and at the 30-day posttest improved by 3.0 (1.75) (p< .001). The median (IQR) confidence scores at initial posttest increased by 0.08 (0.33) (p = .009) and at the 30-day posttest improved by 0.33 (0.54) (p = .01).

CONCLUSIONS

We found that simulation and microlearning improved trauma nurse role clarity, knowledge, and confidence in caring for patients undergoing emergency BSL.

Modafinil Therapy and Mental Status Following Aneurysmal Subarachnoid Hemorrhage: Comprehensive Stroke Center Analysis

BACKGROUND

Disorders of consciousness impair early recovery after aneurysmal subarachnoid hemorrhage (aSAH). Modafinil, a wakefulness-promoting agent, is efficacious for treating fatigue in stroke survivors, but data pertaining to its use in the acute setting are scarce. This study sought to assess the effects of modafinil use on mental status after aSAH.

METHODS

Modafinil timing and dosage, neurological examination, intubation status, and physical and occupational therapy participation were documented. Repeated-measures paired tests were used for a before-after analysis of modafinil recipients. Propensity score matching (1:1 nearest neighbor) for modafinil and no-modafinil cohorts was used to compare outcomes.

RESULTS

Modafinil (100-200 mg/day) was administered to 21% (88/422) of aSAH patients for a median (IQR) duration of 10.5 (4-16) days and initiated 14 (7-17) days after aSAH. Improvement in mentation (alertness, orientation, or Glasgow Coma Scale score) was documented in 87.5% (77/88) of modafinil recipients within 72 hours and 86.4% (76/88) at discharge. Of 37 intubated patients, 10 (27%) were extubated within 72 hours after modafinil initiation. Physical and occupational therapy teams noted increased alertness or participation in 47 of 56 modafinil patients (83.9%). After propensity score matching for baseline covariates, the modafinil cohort had a greater mean (SD) change in Glasgow Coma Scale score than the no-modafinil cohort at discharge (2.2 [4.0] vs. -0.2 [6.32], P = 0.003).

CONCLUSIONS

A temporal relationship with improvement in mental status was noted for most patients administered modafinil after aSAH. These findings, a favorable adverse-effect profile, and implications for goals-of-care decisions favor a low threshold for modafinil initiation in aSAH patients in the acute-care setting.

Evaluation of a Novel Mechanical Venous Thromboembolism Compression Device in Trauma Patients: A Pilot Study

BACKGROUND

Venous thromboembolism (VTE) is the fourth most common preventable hospital-acquired complication for hospitalized trauma patients. Mechanical prophylaxis, using sequential compression or intermittent pneumatic compression (IPC) devices, is recommended alongside pharmacologic prophylaxis for VTE prevention. However, compliance with device use is a barrier that reduces the effectiveness of mechanical prophylaxis.

OBJECTIVE

This study aimed to determine whether using the Movement and Compressions (MAC) system compared with an IPC device impacts compliance with mechanical VTE prophylaxis in trauma patients.

METHODS

This study used a before-and-after design with historical control at a Level II trauma center with a convenience sample of adult trauma patients admitted to the intensive care unit or acute care floor for at least 24 h. We trialed the MAC device for 2 weeks in November and December 2022 with prospective data collection. Data collection for the historical control group occurred retrospectively using patients from a point-in-time audit of IPC device compliance from August and September of 2022.

RESULTS

A total of 51 patients met inclusion criteria, with 34 patients in the IPC group and 17 patients in the MAC group. The mean (SD) prophylaxis time was 17.2 h per day (4.0) in the MAC group and 7.5 h per day (8.8) in the IPC group, which was statistically significant (p < .001).

CONCLUSION

Our findings suggest that the MAC device can improve compliance with mechanical prophylaxis.

A Quality Improvement Initiative to Reduce Adverse Effects of Transitions of Anesthesia Care on Postoperative Outcomes: A Retrospective Cohort Study

BACKGROUND

An intraoperative transfer of care from one anesthesia provider to another, or handover, may result in information loss and contribute to adverse patient outcomes. In 2019 the authors undertook a quality improvement effort to increase the use of a structured intraoperative handover tool incorporated in the electronic medical record. The authors hypothesized that intraoperative handovers of anesthesia care would be associated with adverse patient outcomes, and that increased use of a structured tool would attenuate this effect.

METHODS

This study included adult patients undergoing noncardiac surgery of at least 1 h duration performed during the period 2016 to 2021. Cases with a handover were identified if either there was a change of attending anesthesiologist or change of nurse anesthetist or resident for more than 35 min. The primary outcome was the occurrence of a composite of postoperative mortality and major postoperative morbidity. The effect of the intervention was analyzed by examining the quarterly change in odds ratio for the primary outcome for cases with and without a handover.

RESULTS

A total of 121,077 cases, 40.4% of which had a handover, were included. After weighting, the composite outcome was statistically associated with handovers (3,517 of 48,986 [7.2%] in handover cases vs. 4,470 of 72,091 [6.2%] in nonhandover cases; odds ratio, 1.08; 95% CI, 1.04 to 1.12). Time series analysis showed a marked increase in usage of the structured tool after the initial intervention. The odds ratio for the composite outcome showed a significant decrease over time after the initial intervention (t = -3.97; P < 0.001), with the slope of the odds ratio versus time curve decreasing from 0.002 (95% CI, 0.001 to 0.004; P = 0.018) to -0.011 (95% CI, -0.01 to -0.018; P < 0.001).

CONCLUSIONS

Intraoperative handovers are significantly associated with adverse outcomes even after controlling for multiple confounding variables. Use of a structured handover tool during anesthesia care may attenuate the adverse effect.

EDITOR’S PERSPECTIVE

Effectiveness of educational programs in hearing health: a systematic review and meta-analysis

OBJECTIVE

To evaluate the effectiveness of hearing health education programs aimed at preventing noise-induced hearing loss (NIHL), of recreational and occupational origin, by means of a systematic review and meta-analysis.

DESIGN

The search strategy was carried out in on five electronic databases, as well as referrals from experts. The risk of bias was judged, and the random effects meta-analysis was performed. The certainty of the evidence was assessed.

STUDY SAMPLE

Effectiveness studies that used educational intervention in hearing health and prevention of NIHL were included.

RESULTS

42 studies were included. The Dangerous Decibels program was the only one that could be quantitatively analysed and showed improvement in the post-intervention period of up to one week [SMD = 0.60; CI95% = 0.38-0.82; I2 = 92.5%) and after eight weeks [SMD = 0.45; CI95% = 0.26-0.63; I2 = 81.6%) compared to the baseline. The certainty of evidence was judged as very low.

CONCLUSIONS

The Dangerous Decibels program is effective after eight weeks of intervention. The other programs cannot be quantified. They still present uncertainty about their effectiveness. The level of certainty is still low for this assessment.

Innovative designs for trials informing the care of cardiac surgical patients: Part II

PURPOSE OF REVIEW

This review examines advances in clinical trial methodologies relevant to cardiac anesthesia. It focuses on innovative approaches, including factorial randomization, composite outcomes, and cluster randomized trials, which enhance the efficiency, practical relevance, and generalizability of trial outcomes.

RECENT FINDINGS

Factorial randomization is becoming popular because the approach allows investigators to simultaneously evaluate two or more interventions. Furthermore, factorial designs can evaluate interactions among treatments which is highly relevant information that cannot be obtained from separate trials. Composite outcomes are also increasingly utilized, combining multiple individual outcomes into a single measure, which increases statistical power and can better represent relevant physiology. Designing valid composites requires careful consideration of component outcome severity and incidence. Cluster randomized trials, including stepped wedge and multiple crossover designs, address the challenges of group-level effects and shared environments.

SUMMARY

The evolution of clinical trial designs is marked by a shift towards methodologies that enhance efficiency and provide more nuanced insights into treatment effects. These include factorial designs for simultaneous intervention assessment, composite outcomes for comprehensive physiological representation, and cluster trials for group-level effect analysis. Such advancements are shaping the future of clinical research, making it more relevant, efficient, and broadly applicable.

A Multi-method Exploratory Evaluation of a Service Designed to Improve Medication Safety for Patients with Monitored Dosage Systems Following Hospital Discharge

BACKGROUND AND OBJECTIVE

Medication safety problems are common post-hospital discharge, and an important global healthcare improvement target. The Transfers of Care Around Medicines (TCAM) service was launched by a National Health Service Trust in the North-West of England, initially focusing on patients with new or existing Monitored Dosage Systems (MDS). The TCAM service is designed to enable the prompt transfer of medication information, with referrals made by hospitals at discharge to a named community pharmacy. This study aimed to explore the utilisation and impact of the TCAM service on medication safety.

METHODS

The evaluation included a descriptive analysis of 3033 anonymised patient referrals to 71 community pharmacies over a 1-year period alongside an assessment of the impact of the TCAM service on unintentional medication discrepancies and adverse drug events using a retrospective before-and-after study design. Impact data were collected across 18 general practices by 16 trained clinical pharmacists.

RESULTS

Most patient referrals (70%, 2126/3033) were marked as 'completed' by community pharmacies, with 15% of completed referrals delayed beyond 30 days. Screening of 411 patient records by clinical pharmacists yielded no statistically significant difference in unintentional medication discrepancies or adverse drug event rates following TCAM implementation using a multivariable regression analysis (unintentional medication discrepancies adjusted odds ratio = 0.79 [95% confidence interval 0.44-1.44, p = 0.46]; and adverse drug events adjusted odds ratio = 1.19 [95% confidence interval 0.57-2.45, p = 0.63]), although there remained considerable uncertainty.

CONCLUSIONS

The TCAM service facilitated a number of community pharmacy services offered to patients with monitored dosage systems; but the impact of the intervention on unintentional medication discrepancies and adverse drug event rates post-hospital discharge for this patient group was uncertain. The results of this exploratory study can inform the ongoing implementation of the TCAM service at hospital discharge and highlight the need to understand service implementation in different contexts, which may influence its impact on medication safety.

Analgesic Effect of Buprenorphine for Chronic Noncancer Pain: A Systematic Review and Meta-analysis of Randomized Controlled Trials

BACKGROUND

Buprenorphine is a partial agonist at the µ-opioid receptor and an antagonist at the delta and kappa opioid receptors. It has high affinity and low intrinsic activity at the µ-opioid receptor. Buprenorphine demonstrates no ceiling effect for clinical analgesia, but demonstrates this for respiratory depression and euphoria. It may provide effective analgesia while producing less adverse effects, making it a promising opioid analgesic. A systematic review and meta-analysis were performed to examine the analgesic efficacy of buprenorphine for patients with chronic noncancer pain.

METHODS

PubMed, MEDLNE, Embase, and the Cochrane Library were searched up to January 2022. Randomized controlled trials were included if they compared buprenorphine versus placebo or active analgesic in patients with chronic noncancer pain, where pain score was an outcome. Nonrandomized controlled trials, observational studies, qualitative studies, case reports, and commentaries were excluded. Two investigators independently performed the literature search, study selection, and data collection. A random-effects model was used. The primary outcome was the effect of buprenorphine on pain intensity in patients with chronic noncancer pain based on standardized mean difference (SMD) in pain score. Quality of evidence was assessed using the Grade of Recommendations Assessment, Development, and Evaluation (GRADE) approach.

RESULTS

Two separate literature searches were conducted for patients with and without opioid use disorder (OUD). Only one study met the search criteria for those with OUD. Fourteen randomized controlled trials were included for those without OUD. Buprenorphine was associated with reduced pain score (SMD = -0.368, P < .001, I 2 = 89.37%) compared to placebo or active analgesic. Subgroup meta-analyses showed statistically significant differences in favor of buprenorphine versus placebo (SMD = -0.404, P < .001), for chronic low back pain (SMD = -0.383, P < .001), when administered via the transdermal route (SMD = -0.572, P = .001), via the buccal route (SMD = -0.453, P < .001), with length of follow-up lasting <12 weeks (SMD = -0.848, P < .05), and length of follow-up lasting 12 weeks or more (SMD = -0.415, P < .001). There was no significant difference when compared to active analgesic (SMD = 0.045, P > .05). Quality of evidence was low to moderate.

CONCLUSIONS

Buprenorphine was associated with a statistically significant and small reduction in pain intensity compared to placebo. Both the transdermal and buccal routes provided pain relief. There was more evidence supporting its use for chronic low back pain.

Association of a sepsis initiative on broad spectrum antibiotic use and outcomes in an ED population: A retrospective cohort study

INTRODUCTION

Sepsis identification and treatment is a priority for emergency department (ED) providers and payors alike. However, aggressive metrics aimed at improving sepsis care could have unintended consequences for patients who do not have sepsis.

METHODS

All ED patient visits for a one month period before and after a quality initiative to increase early antibiotic use in septic patients were included. Overall broad spectrum (BS) antibiotic use, admission rates, and mortality were compared in the 2 time periods. A more detailed chart review was performed on those who received BS antibiotics in the before and after cohorts. Patient were excluded for pregnancy, age < 18, COVID-19 infection, hospice patients, left ED against medical advice, and if antibiotics were given for prophylaxis. In BS antibiotic treated patients, we sought to determine mortality, rates of subsequent multidrug resistant (MDR) or Clostridium Difficile (CDiff) infections and rates of non-infected patients receiving BS antibiotics.

RESULTS

There were 7967 and 7407 ED visits in the pre- and post-implementation periods, respectively. Of those, BS antibiotics were administered in a total of 3.9% pre-implementation and 6.2% post-implementation (p ≤ 0.00001). Admission was more common in the post-implementation period, but overall mortality was unchanged (0.9% pre-implementation and 0.8% post-implementation, p = 0.41). After exclusions, 654 patients treated with BS antibiotics were included in the secondary analyses. Baseline characteristics were similar between the pre-implementation and post-implementation cohorts. There was no difference in the rate of CDiff infection or the proportion of patients receiving BS antibiotics who were not infected, but there was an increase in the post-implementation period in MDR infections after ED BS antibiotics, 0.72% vs. 0.35% of the entire ED cohorts, p = 0.0009.

CONCLUSIONS

We found that a QI sepsis initiative was associated with an increase in the proportion of patients who received BS antibiotics in the ED, and a small absolute increase in associated subsequent MDR infections, with no apparent effect on mortality in all ED patients or the subset treated with BS antibiotics. Further research is needed to assess the impact on all patients affected by aggressive sepsis protocols and initiatives, rather than only those with sepsis.

Prevalence of signs and symptoms related to temporomandibular disorders and orofacial pain in patients indicated for orthognathic surgery: a meta-analysis

OBJECTIVE

To evaluate the prevalence of signs and symptoms related to temporomandibular disorders (TMD) and orofacial pain in patients with indication for orthognathic surgery.

METHODS

The search was carried out in seven electronic databases and gray literature. Studies that evaluated the frequency of signs and symptoms related to TMD and orofacial pain were included. The risk of bias was assessed using the Joanna Briggs Critical Appraisal tool. A meta-analysis of proportions with a random effect model was performed and the GRADE tool judged the certainty of evidence.

RESULTS

After searching the databases, 1859 references were retrieved, 18 of which were selected for synthesis. The prevalence of individuals with at least one TMD symptom was 51% [CI95% = 44-58%], and 44% of the subjects had temporomandibular joint click/crepitus [CI95% = 37-52%]. Additionally, 28% exhibited symptoms related to muscle disorders [CI95% = 22-35%], 34% had disc displacement with or without reduction [CI95% = 25-44%], and 24% had inflammatory joint disorders [CI95% = 13-36%]. The prevalence of headache was 26% [CI95% = 8-51%]. The certainty of evidence was considered very low.

CONCLUSION

Approximately 1 in 2 patients with dentofacial deformity presents some sign and symptom related to TMD. Myofascial pain and headache may be present in approximately a quarter of patients with dentofacial deformity.

CLINICAL RELEVANCE

A multidisciplinary treatment is necessary for these patients, involving a professional with expertise in the management of TMD.

A mixed-methods study measuring the effectiveness of a menstrual health intervention on menstrual health knowledge, perceptions and practices among young women in Zimbabwe

OBJECTIVES

While integral to women's physical and mental well-being, achieving good menstrual health (MH) remains a challenge for many women. This study investigated the effectiveness of a comprehensive MH intervention on menstrual knowledge, perceptions and practices among women aged 16-24 years in Harare, Zimbabwe.

DESIGN

A mixed-methods prospective cohort study with pre-post evaluation of an MH intervention.

SETTING

Two intervention clusters in Harare, Zimbabwe.

PARTICIPANTS

Overall, 303 female participants were recruited, of whom 189 (62.4%) were seen at midline (median follow-up 7.0; IQR 5.8-7.7 months) and 184 (60.7%) were seen at endline (median follow-up 12.4; IQR 11.9-13.8 months). Cohort follow-up was greatly affected by COVID-19 pandemic and associated restrictions.

INTERVENTION

The MH intervention provided MH education and support, analgesics, and a choice of menstrual products in a community-based setting to improve MH outcomes among young women in Zimbabwe.

PRIMARY AND SECONDARY OUTCOMES

Effectiveness of a comprehensive MH intervention on improving MH knowledge, perceptions, and practices among young women over time. Quantitative questionnaire data were collected at baseline, midline, and endline. At endline, thematic analysis of four focus group discussions was used to further explore participants' menstrual product use and experiences of the intervention.

RESULTS

At midline, more participants had correct/positive responses for MH knowledge (adjusted OR (aOR)=12.14; 95% CI: 6.8 to 21.8), perceptions (aOR=2.85; 95% CI: 1.6 to 5.1) and practices for reusable pads (aOR=4.68; 95% CI: 2.3 to 9.6) than at baseline. Results were similar comparing endline with baseline for all MH outcomes. Qualitative findings showed that sociocultural norms, stigma and taboos around menstruation, and environmental factors such as limited access to water, sanitation and hygiene facilities affected the effect of the intervention on MH outcomes.

CONCLUSIONS

The intervention improved MH knowledge, perceptions and practices among young women in Zimbabwe, and the comprehensive nature of the intervention was key to this. MH interventions should address interpersonal, environmental and societal factors.

TRIAL REGISTRATION NUMBER

NCT03719521.

Determining the impact of ex-vivo lung perfusion on hospital costs for lung transplantation: A retrospective cohort study

INTRODUCTION

Ex-vivo lung perfusion (EVLP) has improved organ utilization for lung transplantation, but it is not yet known whether the benefits of this technology offset its additional costs. We compared the institutional costs of lung transplantation before vs after EVLP was available to identify predictors of costs and determine the health-economic impact of EVLP.

METHODS

We performed a retrospective, before-after, propensity-score weighted cohort study of patients wait-listed for lung transplant at University Health Network (UHN) in Ontario, Canada, between January 2005 and December 2019 using institutional administrative data. We compared costs, in 2019 Canadian Dollars ($), between patients referred for transplant before EVLP was available (Pre-EVLP) to after (Modern EVLP). Cumulative costs were estimated using a novel application of multistate survival models. Predictors of costs were identified using weighted log-gamma generalized linear regression.

RESULTS

A total of 1,199 patients met inclusion criteria (352 Pre-EVLP; 847 Modern EVLP). Mean total costs for the transplant hospitalization were $111,878 ($94,123-$130,767) in the Pre-EVLP era and $110,969 ($87,714-$136,000) in the Modern EVLP era. Cumulative five-year costs since referral were $278,777 ($82,575-$298,135) in the Pre-EVLP era and $293,680 ($252,832-$317,599) in the Modern EVLP era. We observed faster progression to transplantation when EVLP was available. EVLP availability was not a predictor of waitlist (cost ratio [CR] 1.04 [0.81-1.37]; p = 0.354) or transplant costs (CR 1.02 [0.80-1.29]; p = 0.425) but was associated with lower costs during posttransplant years 1&2 (CR 0.75 [0.58-1.06]; p = 0.05) and posttransplant years 3+ (CR 0.43 [0.26-0.74]; p = 0.001).

CONCLUSIONS

At our center, EVLP availability was associated with faster progression to transplantation at no significant marginal cost.

Trial of antibiotic restraint in presumed pneumonia: A Surgical Infection Society multicenter pilot

BACKGROUND

Pneumonia is the most common intensive care unit-acquired infection in the trauma and emergency general surgery population. Despite guidelines urging rapid antibiotic use, data supporting immediate antibiotic initiation in cases of suspected infection are limited. Our hypothesis was that a protocol of specimen-initiated antibiotic initiation would have similar compliance and outcomes to an immediate initiation protocol.

METHODS

We devised a pragmatic cluster-randomized crossover pilot trial. Four surgical and trauma intensive care units were randomized to either an immediate initiation or specimen-initiated antibiotic protocol for intubated patients with suspected pneumonia and bronchoscopically obtained cultures who did not require vasopressors. In the immediate initiation arm, antibiotics were started immediately after the culture regardless of patient status. In the specimen-initiated arm, antibiotics were delayed until objective Gram stain or culture results suggested infection. Each site participated in both arms after a washout period and crossover. Outcomes were protocol compliance, all-cause 30-day mortality, and ventilator-free alive days at 30 days. Standard statistical techniques were applied.

RESULTS

A total of 186 patients had 244 total cultures, of which only the first was analyzed. Ninety-three patients (50%) were enrolled in each arm, and 94.6% were trauma patients (84.4% blunt trauma). The median age was 50.5 years, and 21% of the cohort was female. There were no differences in demographics, comorbidities, sequential organ failure assessment, Acute Physiology and Chronic Health Evaluation II, or Injury Severity Scores. Antibiotics were started significantly later in the specimen-initiated arm (0 vs. 9.3 hours; p < 0.0001) with 19.4% avoiding antibiotics completely for that episode. There were no differences in the rate of protocol adherence, 30-day mortality, or ventilator-free alive days at 30 days.

CONCLUSION

In this cluster-randomized crossover trial, we found similar compliance rates between immediate and specimen-initiated antibiotic strategies. Specimen-initiated antibiotic protocol in patients with a suspected hospital-acquired pneumonia did not result in worse clinical outcomes compared with immediate initiation.

LEVEL OF EVIDENCE

Therapeutic/Care Management; Level II.

A Novel Orderset Driven Emergency Department Atrial Fibrillation Algorithm to Increase Discharge and Risk-appropriate Anticoagulation

INTRODUCTION

Patients with atrial fibrillation (AF) are frequently admitted from the emergency department (ED), and when discharged, are not reliably prescribed indicated anticoagulation. We report the impact of a novel computerized ED AF pathway orderset on discharge rate and risk-appropriate anticoagulation in patients with primary AF.

METHODS

The orderset included options for rate and rhythm control of primary AF, structured risk assessment for thrombotic complications, recommendations for anticoagulation as appropriate, and follow up with an electrophysiologist. All patients discharged from the ED in whom the AF orderset was utilized over an 18-month period comprised the primary study population. The primary outcome was the rate of appropriate anticoagulation or not according to confirmed CHADS-VASC and HASBLED scores. Additionally, the percentage of primary AF patients discharged directly from the ED was compared in the 18-month periods before and after introduction of the orderset.

RESULTS

A total of 56 patients, average age 57.8 years and average initial heart rate 126 beats/minute, were included in the primary analysis. All 56 (100%; 95% confidence interval, 94-100) received guideline-concordant anticoagulation. The discharge rates in the pre- and postorderset implementation periods were 29% and 41%, respectively (95% confidence interval for 12% difference, 5-18).

CONCLUSIONS

Our novel AF pathway orderset was associated with 100% guideline-concordant anticoagulation in patients discharged from the ED. Availability of the orderset was associated with a significant increase in the proportion of ED AF patients discharged.

Ultrasound-guided radiofrequency Ablation for SI joint pain:An observational study

Objective

An ultrasound (US) guided RFA technique for the SIJ, utilizing bipolar RF cannula placements along the lateral sacral crest (LSC), has been proposed in anatomical studies. This study evaluated changes in pain intensity, function and quality of life following this technique.

Methods

Patients achieving ≥50% pain relief on two blocks (one FL- and one US-guided) were included. US-guided SIJ RFA was performed with sequential bipolar lesions using two multitined RF cannulae placed along the LSC. The Pain, Disability, Quality of Life Questionnaire-Spine (PDQQ-S), which includes an 11-point (0-10) numeric rating scale (NRS) for pain intensity, was completed pre-RFA, and 2, 6, 9, 12 and 16 months post-RFA. Outcomes at 2 months post-RFA were compared between US-guided and FL-guided SIJ RFA in participants with previous FL-guided SIJ RFA.

Results

31 patients were included. Statistically significant decreases in pain intensity were observed up to 9 months after US-guided SIJ RFA (Baseline NRS: mean ​= ​6.8 SD ​= ​1.6, 95%CI [6.169, 7.347]; 9 month: mean ​= ​4.8, SD ​= ​2.6, 95%CI [3.891, 5.786]; p ​= ​0.0005), and up to 12 months for PDQQ-S. A clinically significant ≥2 point reduction in pain intensity on the NRS was seen in 48.4% of participants at 9 months. 11 participants had previous FL-guided SIJ RFA; no statistically significant differences were found in pain intensity or PDQQ-S scores between US- and FL-guided SIJ RFA 2-months post-RFA.

Conclusions

Preliminary results suggest that SIJ RFA could be performed using US guidance. Further study is required to establish effectiveness.

A Standardized Emergency Department Order Set Decreases Admission Rates and In-Patient Length of Stay for Adults Patients with Sickle Cell Disease

INTRODUCTION

Pain associated with sickle cell disease (SCD) causes severe complications and frequent presentation to the emergency department (ED). Patients with SCD frequently report inadequate pain treatment in the ED, resulting in hospital admission. A retrospective analysis was conducted to assess a quality improvement project to standardize ED care for patients presenting with pain associated with SCD.

METHODS

A 3-year prospective quality improvement initiative was performed. Our multidisciplinary team of providers implemented an ED order set in 2019 to improve care and provide adequate analgesia management. Our primary outcome was the overall hospital admission rate for patients after the intervention. Secondary outcome measures included ED disposition, rate of return to the ED within 72 hours, ED pain scores at admission and discharge, ED treatment time, in-patient length of stay, non-opioid medication use, and opioid medication use.

RESULTS

There was an overall 67% reduction in the hospital admission rate after implementation of the order set (P = 0.005) and a significant decrease in the percentage admission rate month over month (P = 0.047). Time to the first non-opioid analgesic decreased by 71 minutes (P > 0.001), and there was no change in time to the first opioid medication. The rate of return to the ED within 72 hours remained unchanged (7.0% vs 7.1%) (P = 0.93), and the ED elopement rate remained unchanged (1.3% vs 1.85%) (P = 0.93). After the implementation, there were significant increases in the prescribing of orally administered acetaminophen (7%), celecoxib (1.2%), and tizanidine (12.5%) and intravenous ketamine (30.5%) and ketorolac (27%). ED pain scores at discharge were unchanged for both hospital-admitted (7.12 vs 7.08) (P = 0.93) and non-admitted (5.51 vs 6.11) (P = 0.27) patients. The resulting potential cost reduction was determined to be $193,440 during the 12-month observation period, with the mean cost per visit decreasing by $792.

CONCLUSIONS

Use of a standardized and multimodal ED order set reduced hospital admission rates and the timeliness of analgesia without negatively impacting patients' pain.

Evaluation of a menstrual hygiene intervention in urban and rural schools in Bangladesh: a pilot study

Girls' menstrual experiences impact their social and educational participation, physical and psychological health. We conducted a pilot study to assess the acceptability and feasibility of a multi-component intervention intended to support menstruating girls; improve menstrual care knowledge, practices, and comfort; and increase school attendance.We conducted a pre/post evaluation of a 6-month pilot intervention in four schools (2 urban, 2 rural) in Dhaka, Bangladesh. We selected 527 schoolgirls (grades 5 to 10; aged 10 to 17 years) for a baseline survey and 528 girls at endline. The intervention included: 1) Menstrual Hygiene Management (MHM) packs- reusable cloth pads, underwear, carry bags and menstrual cycle tracking calendars, 2) education curriculum- pictorial flipcharts, puberty related-booklets, and teachers' training to deliver puberty and MHM sessions, 3) maintenance- improvements to school sanitation, provision of disposable pads in the school office, provision of chute disposal systems for disposable pads, and gender committees to promote a gender-friendly school environment and maintenance of intervention facilities. We estimated intervention uptake and intervention effect by calculating prevalence differences and 95% confidence intervals using fixed-effects logistic regression.The intervention uptake was more than 85% for most indicators; 100% reported receiving puberty education, 85% received MHM packs, and 92% received booklets. Reusable cloth pads uptake was 34% by endline compared with 0% at baseline. Knowledge about menstrual physiology and knowledge of recommended menstrual management practices significantly improved from baseline to endline. Reported improvements included more frequent changing of menstrual materials (4.2 times/day at endline vs. 3.4 times/day at baseline), increased use of recommended disposal methods (prevalence difference (PD): 8%; 95% Confidence Interval: 1, 14), and fewer staining incidents (PD: - 12%; 95% CI: - 22, - 1). More girls reported being satisfied with their menstrual materials (59% at endline vs. 46% at baseline, p < 0.005) and thought school facilities were adequate for menstrual management at endline compared to baseline (54% vs. 8%, p < 0.001). At endline, 64% girls disagreed/strongly disagreed that they felt anxious at school due to menstruation, compared to 33% at baseline (p < 0.001). Sixty-five percent girls disagreed/strongly disagreed about feeling distracted or trouble concentrating in class at endline, compared to 41% at baseline (p < 0.001). Self-reported absences decreased slightly (PD: - 8%; 95% CI: - 14, - 2).Uptake of cloth pads, improved maintenance and disposal of menstrual materials, and reduced anxiety at school suggest acceptability and feasibility of the intervention aiming to create a supportive school environment.

Interventions in hypertension: systematic review and meta-analysis of natural and quasi-experiments

BACKGROUND

Hypertension is an urgent public health problem. Consistent summary from natural and quasi-experiments employed to evaluate interventions that aim at preventing or controlling hypertension is lacking in the current literature. This study aims to summarize the evidence from natural and quasi-experiments that evaluated interventions used to prevent or control hypertension.

METHODS

We searched PubMed, Embase and Web of Science for natural and quasi-experiments evaluating interventions used to prevent hypertension, improve blood pressure control or reduce blood pressure levels from January 2008 to November 2018. Descriptions of studies and interventions were systematically summarized, and a meta-analysis was conducted.

RESULTS

Thirty studies were identified, and all used quasi-experimental designs including a difference-in-difference, a pre-post with a control group or a propensity score matching design. Education and counseling on lifestyle modifications such as promoting physical activity (PA), promoting a healthy diet and smoking cessation consultations could help prevent hypertension in healthy people. The use of computerized clinical practice guidelines by general practitioners, education and management of hypertension, the screening for cardiovascular disease (CVD) goals and referral could help improve hypertension control in patients with hypertension. The educating and counseling on PA and diet, the monitoring of patients' metabolic factors and chronic diseases, the combination of education on lifestyles with management of hypertension, the screening for economic risk factors, medical needs, and CVD risk factors and referral all could help reduce blood pressure. In the meta-analysis, the largest reduction in blood pressure was seen for interventions which combined education, counseling and management strategies: weighted mean difference in systolic blood pressure was - 5.34 mmHg (95% confidence interval [CI], - 7.35 to - 3.33) and in diastolic blood pressure was - 3.23 mmHg (95% CI, - 5.51 to - 0.96).

CONCLUSIONS

Interventions that used education and counseling strategies; those that used management strategies; those that used combined education, counseling and management strategies and those that used screening and referral strategies were beneficial in preventing, controlling hypertension and reducing blood pressure levels. The combination of education, counseling and management strategies appeared to be the most beneficial intervention to reduce blood pressure levels.

Evaluation Methods Applied to Digital Health Interventions: What Is Being Used beyond Randomised Controlled Trials?-A Scoping Review

Despite the potential of digital health interventions (DHIs), evaluations of their effectiveness face challenges. DHIs are complex interventions and currently established evaluation methods, e.g., the randomised controlled trial (RCT), are limited in their application. This study aimed at identifying alternatives to RCTs as potentially more appropriate evaluation approaches. A scoping review was conducted to provide an overview of existing evaluation methods of DHIs beyond the RCT. Cochrane Central Register of Controlled Trials, MEDLINE, Web of Science, and EMBASE were screened in May 2021 to identify relevant publications, while using defined inclusion and exclusion criteria. Eight studies were extracted for a synthesis comprising four alternative evaluation designs. Factorial designs were mostly used to evaluate DHIs followed by stepped-wedge designs, sequential multiple assignment randomised trials (SMARTs), and micro randomised trials (MRTs). Some of these methods allow for the adaptation of interventions (e.g., SMART or MRT) and the evaluation of specific components of interventions (e.g., factorial designs). Thus, they are appropriate for addressing some specific needs in the evaluation of DHIs. However, it remains unsolved how to establish these alternative evaluation designs in research practice and how to deal with the limitations of the designs.

Effect of post-ICU follow-up by a rapid response team after congenital heart surgery

Patients with congenital heart disease who have a variety of cardiac/extracardiac problems are at high risk for deterioration. This study aimed to determine the effectiveness of post-intensive care unit (ICU) follow-up by a rapid response team (RRT) after congenital heart surgery. This before-and-after study was conducted at an urban regional tertiary hospital. We enrolled 572 consecutive patients who underwent congenital heart surgery and were transferred alive from the paediatric ICU (PICU) between April 2015 and March 2020. Post-ICU follow-up for 48 h was started in April 2018. The primary and secondary endpoints were unplanned ICU readmission and clinical outcomes at ICU readmission, respectively. Overall, 346 and 226 patients were analysed pre- and post-intervention, respectively. Patient demographics were similar between groups, but in the post-intervention group, patients tended to have had more complicated surgery. Unplanned ICU readmission rates within 30 days were similar between groups. Regarding the demographics and outcomes at ICU readmission, patients in the post-intervention group had lower predicted mortality rates (1.7% vs 5.3%, P = 0.001), required less ventilator days (median, 0.5 days [interquartile range (IQR) 0–1] vs median, 3 days [IQR 0.5–4], P = 0.02), and had a shorter ICU stay (median, 3 days [IQR 2–4] vs median, 6 days [IQR 3–9], P = 0.03), but there was no significant between-group difference in ICU mortality. Post-ICU follow-up by a RRT after congenital heart surgery did not decrease unplanned ICU readmission but improved several outcomes at ICU readmission.

A Within-Subject Before-After Study of the Impact of Antidepressants on Hemoglobin A1c and Low-Density Lipoprotein Levels in Type 2 Diabetes

PURPOSE/BACKGROUND

Data on the effect of treatment with antidepressant drugs on metabolic control in diabetes are sparse. In this controlled within-subject before-after study, the impact of initiation and discontinuation of antidepressant treatment on hemoglobin A1c (HbA1c) and low-density lipoprotein (LDL) levels in type 2 diabetes was estimated.

METHODS/PROCEDURES

All individuals with newly developed type 2 diabetes (first HbA1c ≥ 6.5%) between 2000 and 2016 in Northern and Central Denmark were identified using register-based health care data. Among these, we identified individuals initiating and discontinuing antidepressant treatment. Using a within-subject before-after design, we examined HbA1c and LDL in the 16 months leading up to and the 16 months after antidepressant treatment initiation or discontinuation, respectively. For comparison, we ran similar time trend analyses in a reference population of age- and sex-matched type 2 diabetes individuals not receiving antidepressant treatment.

FINDINGS/RESULTS

Mean HbA1c decreased after initiation of antidepressant treatment (-0.16%; 95% confidence interval [CI], -0.18 to -0.13%). In the reference population, no material change in HbA1c over time (-0.03%; 95% CI, -0.04 to -0.01%) was seen. Mean LDL decreased not only in antidepressant initiators (-0.17 mmol/L; 95% CI, -0.19 to -0.15 mmol/L) but also in the reference population (-0.15 mmol/L; 95% CI, -0.16 to -0.13 mmol/L). Among antidepressant discontinuers, there was also a decrease in HbA1c (-0.32%; 95% CI, -0.37 to -0.28%), with no change in the reference population (-0.02%; 95% CI, -0.04 to 0.00%). Decreases in LDL were found both in antidepressant discontinuers (-0.09 mmol/L; 95% CI, -0.14 to -0.04 mmol/L) and in the reference population (-0.16 mmol/L0; 95% CI, -0.18 to -0.13 mmol/L).

IMPLICATIONS/CONCLUSIONS

Antidepressant treatment in type 2 diabetes may have a beneficial effect on glycemic control, as the decrease in HbA1c after discontinuation of antidepressants likely reflects remission of depression. Conversely, antidepressant treatment does not seem to affect LDL levels.

Cost of lost work hours associated with the COVID-19 pandemic-United States, March 2020 through February 2021

INTRODUCTION

Of the 22.8 million coronavirus disease 2019 (COVID-19) cases recorded in the United States as of March 21, 2021 with age information, three-fourths were in the workingage group, indicating the potentially high economic impact of the pandemic. This study estimates the cost of lost work hours associated with the COVID-19 pandemic between March 2020 through February 2021.

METHOD

I used a before-and-after analysis of data from the 2017-2021 Current Population Survey to estimate the costs of lost work hours due to economic, workers' own health, and other reasons, from the COVID-19 pandemic.

RESULTS

Across March 2020 through February 2021 (a year since the start of the pandemic in the United States), the estimated cost of lost work hours associated with the COVID-19 pandemic among US full-time workers was $138 billion (95% confidence interval [CI]: $73.4 billion-$202.46 billion). Shares of the costs attributed to economic, workers' own health, and other reasons were 33.7%, 13.7%, and 52.6%, respectively.

CONCLUSION

The $138 billion cost of lost work hours associated with the COVID-19 pandemic during March 2020 through February 2021 highlights the economic consequences of the pandemic, as well as indicating the potential benefit of public health and safety interventions used to mitigate COVID-19 spread.

Utility of solar-powered oxygen delivery in a resource-constrained setting

BACKGROUND

Pneumonia is a leading cause of childhood mortality globally. Children with severe pneumonia associated with hypoxaemia require oxygen (O₂) therapy, which is scarce across resource-constrained countries. Solar-powered oxygen (SPO2) is a novel technology developed for delivering therapeutic O₂ in resource-constrained environments.

RESEARCH QUESTION

Is the introduction of SPO2 associated with a reduction in mortality, relative to the existing practice?

STUDY DESIGN

This was a pragmatic, quasi-experimental study comparing mortality amongst children < 5 years of age with hypoxaemic respiratory illness before and after the installation of SPO2 in two resource-constrained hospitals.

METHODS

Participants were children < 5 years old admitted with acute hypoxaemic respiratory illness. The intervention was SPO2, installed at two resource-constrained hospitals. The primary outcome was 30-day mortality. Secondary outcomes included in-hospital mortality (time to death), length of hospital stay among survivors, duration of O₂ therapy (time to wean O₂), and O₂ delivery system failure(s).

RESULTS

Mortality amongst children admitted with acute hypoxaemic respiratory illness decreased from 30/50 (60%) pre-SPO2 to 15/50 (30%) post-SPO2 (relative risk reduction 50%, 95%CI 19 - 69, p = 0.0049). The post-SPO2 period was consistently associated with decreased mortality in statistical models adjusting for potential confounding factors. Likewise, survival curves pre- and post- SPO2 differed significantly (hazard ratio 0.39, 95% CI 0.20 - 0.74, p = 0.0043). A reduction in the frequency of O₂ delivery interruptions due to fuel shortages and multiple patients needing the concentrator at once was observed, explaining the mortality reduction.

INTERPRETATION

Solar-powered oxygen installation was associated with decreased mortality in resource-constrained settings.

Impact of a Clinical Intervention to Decrease Opioid Prescribing in a Postcesarean Delivery

A quality assurance study was completed following the implementation of a standardized opioid prescribing and education protocol post cesarean delivery. The primary goal was to determine the need for a policy on postpartum opioid prescribing practices and whether the protocol worked. There was a decrease in the number of tablets provided post intervention and no statistically significant maternal or neonatal readmissions for suspected opioid toxicity or pain control. Combination prescribing of Tylenol 3 and/or tramadol and another opioid occurred in both groups. Our results show a need for concise guidelines regarding opioid prescribing following cesarean delivery.

Acceptability and Potential Effectiveness of eHealth Tools for Training Primary Health Workers From Nigeria at Scale: Mixed Methods, Uncontrolled Before-and-After Study

BACKGROUND

The in-service training of frontline health workers (FHWs) in primary health care facilities plays an important role in improving the standard of health care delivery. However, it is often expensive and requires FHWs to leave their posts in rural areas to attend courses in urban centers. This study reports the implementation of a digital health tool for providing video training (VTR) on maternal, newborn, and child health (MNCH) care to provide in-service training at scale without interrupting health services. The VTR intervention was supported by satellite communications technology and existing 3G mobile networks.

OBJECTIVE

This study aims to determine the feasibility and acceptability of these digital health tools and their potential effectiveness in improving clinical knowledge, attitudes, and practices related to MNCH care.

METHODS

A mixed methods design, including an uncontrolled pre- and postquantitative evaluation, was adopted. From October 2017 to May 2018, a VTR mobile intervention was delivered to FHWs in 3 states of Nigeria. We examined changes in workers' knowledge and confidence in delivering MNCH services through a pre- and posttest survey. Stakeholders' experiences with the intervention were explored through semistructured interviews that drew on the technology acceptance model to frame contextual factors that shaped the intervention's acceptability and usability in the work environment.

RESULTS

In total, 328 FHWs completed both pre- and posttests. FHWs achieved a mean pretest score of 51% (95% CI 48%-54%) and mean posttest score of 69% (95% CI 66%-72%), reflecting, after adjusting for key covariates, a mean increase between the pre- and posttest of 17 percentage points (95% CI 15-19; P<.001). Variation was identified in pre- and posttest scores by the sex and location of participants alongside topic-specific areas where scores were lowest. Stakeholder interviews suggested a wide acceptance of VTR Mobile (delivered via digital technology) as an important tool for enhancing the quality of training, reinforcing knowledge, and improving health outcomes.

CONCLUSIONS

This study found that VTR supported through a digital technology approach is a feasible and acceptable approach for supporting improvements in clinical knowledge, attitudes, and reported practices in MNCH. The determinants of technology acceptance included ease of use, perceived usefulness, access to technology and training contents, and the cost-effectiveness of VTR, whereas barriers to the adoption of VTR were poor electricity supply, poor internet connection, and FHWs' workload. The evaluation also identified the mechanisms of the impact of delivering VTR Mobile at scale on the micro (individual), meso (organizational), and macro (policy) levels of the health system. Future research is required to explore the translation of this digital health approach for the VTR of FHWs and its impact across low-resource settings to ameliorate the financial and time costs of training and support high-quality MNCH care delivery.

TRIAL REGISTRATION

ISRCTN Registry 32105372; https://www.isrctn.com/ISRCTN32105372.

Improving accuracy of American Society of Anesthesiologists Physical Status using audit and feedback and artificial intelligence: a time-series analysis

BACKGROUND

While the American Society of Anesthesiologists (ASA) Physical Status (PS) is used to adjust for greater mortality risk with higher ASA PS classification, inaccurate classification can lead to an inaccurate comparison of institutions.

OBJECTIVE

The purpose of this study was to assess the effect of audit and feedback with a rule-based artificial intelligence algorithm on the accuracy of ASA PS classification.

METHODS

We reviewed 78 121 anesthetic records from 1 January 2017 to 19 February 2020. The first intervention entailed audit and feedback emphasizing accurately documenting ASA PS classification using body mass index (BMI), while the second intervention consisted of implementing a rule-based artificial intelligence algorithm. If a patient with a BMI ≥40 kg/m2 had a documented ASA PS classification of 1 or 2, the provider was alerted to change the ASA PS classification to 3 or above. The primary outcome was the overall proportion of patients with inaccurate ASA PS classification based on BMI per month. Secondary outcomes included the proportion of patients with a BMI ≥40 or a BMI 30-39.9 who had inaccurate ASA PS classification and the proportion of patients documented as having ASA 3-5. Data were analyzed using interrupted time-series analysis.

RESULTS

For the primary outcome, the slope for ASA PS classification inaccurately incorporating BMI was unchanging before the first intervention (parameter coefficient 0.002, 95% CI -0.034 to 0.038; P = 0.911). Following the first intervention, there was an immediate level change (parameter coefficient -0.821, 95% CI -1.236 to -0.0406; P < 0.001) without significant change in slope (parameter coefficient -0.048, 95% CI -0.100 to 0.004; P = 0.067). The post-intervention slope was negative (parameter coefficient -0.046, 95% CI -0.083 to -0.009; P = 0.017). Following the second intervention, there was no level change (parameter coefficient 0.203, 95% CI -0.380 to 0.463; P = 0.839) and no significant change in slope (parameter coefficient 0.013, 95% CI -0.043 to 0.043; P = 0.641). The post-intervention slope was not significant (parameter coefficient -0.034, 95% CI -0.078 to 0.010; P = 0.121). The proportion of patients whose ASA PS classification inaccurately incorporated BMI at the first and final timepoint of the study was 2.6% and 0.8%, respectively.

CONCLUSIONS

Our quality improvement efforts successfully modified clinician behavior to accurately incorporate BMI into the ASA PS classification. By combining audit and feedback methodology with a rule-based artificial intelligence algorithm, we created a process that resulted in immediate and sustained effects. Improving ASA PS classification accuracy is important because it affects quality metrics, research design, resource allocation and workflow processes.

Variability in physical function for patients living with breast cancer during a 12-week exercise program

PURPOSE

To describe the variability during weekly performance on physical function tests during a 12-week individualized exercise program for patients with breast cancer and to test if the expected improvements in physical function surpass the minimally clinically important difference (MCID), after accounting for week-to-week variance.

METHODS

Twenty-five participants, 19 years and older living with breast cancer within 2 years of their initial diagnosis, were recruited. Some participants were undergoing active treatment, while others completed their treatment. The intervention was an individualized exercise session twice a week, for 1 h each session, for a total of 12 weeks. Main outcomes tested included the 6-min walk test and chair stand test.

RESULTS

A significant average improvement was observed in the 6MWT (p < .01) and the chair stand test (p < .001) following the intervention. Individual confidence intervals were wide across all testing measures with only 28% and 8% of participants meeting or surpassing the MCID for the 6MWT and chair stand test, respectively.

CONCLUSION

Despite a significant improvement in physical function during the program, the majority of patients did not reach the MCID, which could be due to large variability resulting from treatment-related side effects or measurement error.

Comparison of three intraoperative analgesic strategies in laparoscopic bariatric surgery: a retrospective study of immediate postoperative outcomes

Introduction and objectives

Multimodal Analgesia (MMA) has shown promising results in postoperative outcomes across a broad spectrum of surgeries, including bariatric surgery. We compared the analgesic effect immediately after Laparoscopic Bariatric Surgery (LBS) of the combined effect of MMA and methadone against two techniques that were based mainly on the use of high-potency medium-acting opioids.

Methods

Two hundred seventy-one patients were retrospectively reviewed. The primary outcome was postoperative pain score > 3/10 measured by the Verbal Numeric Scale (VNS) during the Postanesthetic Care Unit (PACU) stay. The three protocols of intraoperative analgesia were: (P1) sufentanil at anesthetic induction followed by remifentanil infusion; (P2) sufentanil at induction followed by dexmedetomidine infusion; and (P3) remifentanil at induction followed by MMA including dexmedetomidine, magnesium, lidocaine, and methadone. Only P1 and P2 patients received morphine toward the end of surgery. Poisson regression was used to adjust confounding factors and calculate Prevalence Ratio (PR).

Results

Postoperative VNS > 3 was recorded in 135 (49.81%) patients, of which 93 (68.89%) were subjected to P1, 25 (18.56%) to P2, and 17 (12.59%) to P3. In the final adjusted model, both anesthetic techniques (P3) (PR = 0.10; 95% CI [0.03–0.28]), and (P2) (PR = 0.42%; 95% CI [0.20–0.90]) were associated with lower occurrence of VNS > 3, whereas age range 20–29 was associated to higher occurrence of VNS > 3 (PR = 3.21; 95% CI [1.22–8.44]) in PACU. Postoperative Nausea and Vomiting (PONV) was distributed as follows: (P1) 20.3%, (P2) 31.25% and (P3) 6.77%; (P3 < P1, P2; p < 0.05). Intraoperative hypotension occurred more often in P3 (39%) compared to P2 (20.31%) and P1 (17.46%) (p < 0.05).

Conclusion

MMA + methadone was associated with higher incidence of intraoperative hypotension and lower incidence of moderate/severe pain in PACU after LBS.

Individualized Vancomycin Dosing with Therapeutic Drug Monitoring and Pharmacokinetic Consultation Service: A Large-Scale Retrospective Observational Study

Background

To date, outcome data with a large sample size and data regarding the clinical outcomes of pharmacokinetic-guided (PK) dosing of vancomycin are limited.

Aim

We evaluated the pharmacokinetic and clinical outcomes of a PK-guided dosing advisory program, pharmacokinetic consultation service (PKCS), in vancomycin treatment.

Methods

We investigated vancomycin therapeutic drug monitoring (TDM) and PKCS use through a retrospective review of patients who had serum vancomycin trough concentration data from October 2017 to November 2018. Among these patients, we selected non-critically ill adult patients satisfying our selection criteria to evaluate the effect of PKCS. Target trough attainment rate, time to target attainment, vancomycin-induced nephrotoxicity (VIN), vancomycin treatment failure rate, and duration of vancomycin therapy were compared between patients whose dosing was adjusted according to PKCS (PKCS group), and those whose dose was adjusted at the discretion of the attending physician (non-PKCS group).

Results

A total of 280 patients met the selection criteria for the VIN analysis (PKCS, n=134; non-PKCS, n=146). The incidence of VIN was similar between the two groups (PKCS, n=5; non-PKCS, n=5); however, the target attainment rate was higher in the PKCS group (75% vs 60%, P = 0.012). The time to target attainment was similar between the two groups. Further exclusions yielded 112 patients for the clinical outcome evaluation (PKCS, n=51; non-PKCS, n=61). The treatment failure rate was similar, and the duration of vancomycin therapy was longer in the PKCS group (12 vs 8 days, P = 0.008).

Conclusion

In non-critically ill patients, an increase in target trough achieved by PKCS did not lead to decreased vancomycin treatment failures, shorter vancomycin treatment, or decreased nephrotoxicity in vancomycin treatment. Considering the excessive amount of effort currently put into vancomycin dosing and monitoring, more selective criteria for individualized pharmacokinetic-guided dosing needs to be applied.

Association between a complex community intervention and quality of health extension workers' performance to correctly classify common childhood illnesses in four regions of Ethiopia

Background

Due to low care utilization, a complex intervention was done for two years to optimize the Ethiopian Health Extension Program. Improved quality of the integrated community case management services was an intermediate outcome of this intervention through community education and mobilization, capacity building of health workers, and strengthening of district ownership and accountability of sick child services. We evaluated the association between the intervention and the health extension workers’ ability to correctly classify common childhood illnesses in four regions of Ethiopia.

Methods

Baseline and endline assessments were done in 2016 and 2018 in intervention and comparison areas in four regions of Ethiopia. Ill children aged 2 to 59 months were mobilized to visit health posts for an assessment that was followed by re-examination. We analyzed sensitivity, specificity, and difference-in-difference of correct classification with multilevel mixed logistic regression in intervention and comparison areas at baseline and endline.

Results

Health extensions workers’ consultations with ill children were observed in intervention (n = 710) and comparison areas (n = 615). At baseline, re-examination of the children showed that in intervention areas, health extension workers’ sensitivity for fever or malaria was 54%, 68% for respiratory infections, 90% for diarrheal diseases, and 34% for malnutrition. At endline, it was 40% for fever or malaria, 49% for respiratory infections, 85% for diarrheal diseases, and 48% for malnutrition. Specificity was higher (89–100%) for all childhood illnesses. Difference-in-differences was 6% for correct classification of fever or malaria [aOR = 1.45 95% CI: 0.81–2.60], 4% for respiratory tract infection [aOR = 1.49 95% CI: 0.81–2.74], and 5% for diarrheal diseases [aOR = 1.74 95% CI: 0.77–3.92].

Conclusion

This study revealed that the Optimization of Health Extension Program intervention, which included training, supportive supervision, and performance reviews of health extension workers, was not associated with an improved classification of childhood illnesses by these Ethiopian primary health care workers.

Trial registration

ISRCTN12040912, http://www.isrctn.com/ISRCTN12040912.

The Effect of the No Pain Labor & Delivery-Global Health Initiative on Cesarean Delivery and Neonatal Outcomes in China: An Interrupted Time-Series Analysis

BACKGROUND

The proportion of live births by cesarean delivery (CD) in China is significant, with some, particularly rural, provinces reporting up to 62.5%. The No Pain Labor & Delivery-Global Health Initiative (NPLD-GHI) was established to improve obstetric and neonatal outcomes in China, including through a reduction of CD through educational efforts. The purpose of this study was to determine whether a reduction in CD at a rural Chinese hospital occurred after NPLD-GHI. We hypothesized that a reduction in CD trend would be observed.

METHODS

The NPLD-GHI program visited the Weixian Renmin Hospital, Hebei Province, China, from June 15 to 21, 2014. The educational intervention included problem-based learning, bedside teaching, simulation drill training, and multidisciplinary debriefings. An interrupted time-series analysis using segmented logistic regression models was performed on data collected between June 1, 2013 and May 31, 2015 to assess whether the level and/or trend over time in the proportion of CD births would decline after the program intervention. The primary outcome was monthly proportion of CD births. Secondary outcomes included neonatal intensive care unit (NICU) admissions and extended NICU length of stay, neonatal antibiotic and intubation use, and labor epidural analgesia use.

RESULTS

Following NPLD-GHI, there was a level decrease in CD with an estimated odds ratio (95% confidence interval [CI]) of 0.87 (0.78-0.98), P = .017, with odds (95% CI) of monthly CD reduction an estimated 3% (1-5; P < .001), more in the post- versus preintervention periods. For labor epidural analgesia, there was a level increase (estimated odds ratio [95% CI] of 1.76 [1.48-2.09]; P < .001) and a slope decrease (estimated odds ratio [95% CI] of 0.94 [0.92-0.97]; P < .001). NICU admissions did not have a level change (estimated odds ratio [95% CI] of 0.99 [0.87-1.12]; P = .835), but the odds (95% CI) of monthly reduction in NICU admission was estimated 9% (7-11; P < .001), greater in post- versus preintervention. Neonatal intubation level and slope changes were not statistically significant. For neonatal antibiotic administration, while the level change was not statistically significant, there was a decrease in the slope with an odds (95% CI) of monthly reduction estimated 6% (3-9; P < .001), greater post- versus preintervention.

CONCLUSIONS

In a large, rural Chinese hospital, live births by CD were lower following NPLD-GHI and associated with increased use of labor epidural analgesia. We also found decreasing NICU admissions. International-based educational programs can significantly alter practices associated with maternal and neonatal outcomes.

["Alternative study designs" for the evaluation of digital health applications - a real alternative?]

INTRODUCTION

After the Digital Healthcare Act (Digitale-Versorgung-Gesetz, DVG) reformed digital health applications' (Digitale Gesundheitsanwendungen, DiGAs) access to German Statutory Health Insurance (SHI) reimbursement, the discussion concerning necessary evidence requirements has intensified. In the past, different "alternative study designs" have been proposed to replace randomized controlled trials (RCTs) in the DiGA efficacy and benefit assessments. The present paper examines the suitability of these alternative designs for informing SHI reimbursement decisions.

METHODS

The four alternative study designs primarily discussed in the context of DiGA - "Continuous Evaluation of Evolving Behavioral Intervention Technologies" (CEEBIT), "Multiphase Optimization Strategy" (MOST), "Sequential Multiple Assignment Randomized Trial" (SMART) and "Micro-Randomized Trial" (MRT) - are characterized and compared on the basis of relevant primary and secondary sources. Subsequently, their suitability for effectiveness and benefit evaluation in the context of SHI reimbursement decisions is discussed.

RESULTS

None of the study designs examined aims primarily at conclusively demonstrating efficacy and benefit. Three of the four designs (MOST, SMART, MRT) focus on the development and optimization of interventions. In order to reduce resource requirements, the approaches presented sometimes deviate considerably from the methodological approach in traditional RCTs. This is especially true for their applied statistical error tolerance and their underlying randomization logic. Three of the four concepts (MOST, SMART, MRT) therefore still require RCTs after the development phase in order to demonstrate the effectiveness and benefit of the optimized intervention.

DISCUSSION

The methodological differences of the alternative study designs compared to classical RCTs are accompanied by serious potentials for bias and uncertainties with regard to the identified intervention effects. These may be acceptable in the context of intervention development, but do not appear to be appropriate for use in collective SHI reimbursement decisions.

CONCLUSION

The alternative study designs presented cannot be regarded as a suitable RCT alternative for efficacy and benefit assessments. A pragmatic study design, which continues to meet high methodological standards, and better utilization of real-world data could, in the future, contribute to a compromise between the justified claims to sufficient certainty of results on the one hand and appropriate procedural effort on the other.

Design, methods, and reporting of impact studies of cardiovascular clinical prediction rules are suboptimal: a systematic review

OBJECTIVES

To evaluate design, methods, and reporting of impact studies of cardiovascular clinical prediction rules (CPRs).

STUDY DESIGN AND SETTING

We conducted a systematic review. Impact studies of cardiovascular CPRs were identified by forward citation and electronic database searches. We categorized the design of impact studies as appropriate for randomized and nonrandomized experiments, excluding uncontrolled before-after study. For impact studies with appropriate study design, we assessed the quality of methods and reporting. We compared the quality of methods and reporting between impact and matched control studies.

RESULTS

We found 110 impact studies of cardiovascular CPRs. Of these, 65 (59.1%) used inappropriate designs. Of 45 impact studies with appropriate design, 31 (68.9%) had substantial risk of bias. Mean number of reporting domains that impact studies with appropriate study design adhered to was 10.2 of 21 domains (95% confidence interval, 9.3 and 11.1). The quality of methods and reporting was not clearly different between impact and matched control studies.

CONCLUSION

We found most impact studies either used inappropriate study design, had substantial risk of bias, or poorly complied with reporting guidelines. This appears to be a common feature of complex interventions. Users of CPRs should critically evaluate evidence showing the effectiveness of CPRs.

Management decisions on unruptured intracranial aneurysms before and after implementation of the PHASES score

BACKGROUND

In management decisions on saccular unruptured intracranial aneurysms (UIAs) the risk of rupture is an important factor. The PHASES score, introduced in 2014, provides absolute 5-year risks of rupture based on six easily retrievable patient and aneurysm characteristics. We assessed whether management decisions on UIAs changed after implementation of the PHASES score.

PATIENT AND METHODS

We included all patients with UIAs who were referred to two Dutch tertiary referral centers for aneurysm care in the Netherlands (University Medical Center Utrecht (UMCU) and Leiden University Medical Center (LUMC)) between 2011 and 2017. Analyses were done on an aneurysm level. We calculated the overall proportion of UIAs with a decision to treat before and after PHASES implementation and studied the influence of age and center on post-implementation management changes.

RESULTS

We included 623 patients with 803 UIAs. The proportion of UIAs with a decision to treat was 123/360 (34.2%) before and 117/443 (26.4%) after PHASES implementation (absolute risk difference: -7.8%; 95% CI: -14.1 to -1.4). The decision to treat was made at a higher median PHASES score after implementation (7 points (IQR 5;10) pre- versus 8 points (IQR 5;10) post-implementation; p = 0.14). The reduced proportion with a treatment decision after implementation was most pronounced in patients <50 years (-22.3%; 95% CI: -39.2 to -3.4) and was restricted to treatment decisions made at the UMCU (-10.6%; 95% CI: -18.5 to -2.5).

DISCUSSION AND CONCLUSIONS

Management of UIAs changed following implementation of the PHASES score, but the impact of PHASES implementation on treatment decisions differed across age subgroups and centers.

Real-world results of the implementation of preoperative anaemia clinic with intravenous iron therapy for treating iron-deficiency anaemia: a propensity-matched case-control study

Background

Preoperative anaemia is associated with blood transfusion and longer hospital length of stay. Preoperative iron deficiency anaemia (IDA) can be treated with oral or intravenous (IV) iron. IV iron can raise haemoglobin faster compared with oral iron. However, its ability to reduce blood transfusion and length of stay in clinical trials is inconclusive. This study aims to compare blood transfusion and hospital length of stay between anemic patients who received preoperative IV iron versus standard care, after implementation of a protocol in 2017 to screen patients for preoperative IDA, and its treatment with IV iron.

Methods

Retrospective before-after cohort study comparing 89 patients who received IV iron preoperatively in 2017, with historic patients who received oral iron therapy (selected by propensity score matching (PSM) from historic cohort of 7,542 patients who underwent surgery in 2016). Propensity score was calculated using ASA status, age, gender, surgical discipline, surgical risk and preoperative haemoglobin concentration. Both 1:1 and 1:2 matching were performed as sensitivity analysis.

Results

After PSM, there was no statistically significant difference in distribution of preoperative clinical variables. There was no significant difference in proportion of cases requiring transfusion nor a difference in average units transfused per patient. IV iron cohort stayed in hospital on average 8.0 days compared to non-IV iron cohort 14.1–15.1 days (P=0.006, P=0.013 respectively). Average time from IV iron therapy to surgery was 10.5 days.

Conclusions

Preoperative IV iron therapy for patients with IDA undergoing elective surgery may not reduce perioperative blood transfusion, but this could be due to the short time between therapy and surgery. Implementation of IV iron therapy may reduce hospital length of stay compared to standard care for anemic patients, although this may be enhanced by concomitant improvement in perioperative care.

The impact of a stewardship program on antibiotic administration in community-acquired pneumonia: Results from an observational before-after study

BACKGROUND

A majority of patients with community-acquired pneumonia (CAP) receive antibiotics. According to the evidence, 5-7 days of treatment should be sufficient for most patients. Many, however, are treated longer than recommended. We have previously conducted a quality improvement study to ensure guideline-conform treatment for CAP. However, the impact of the interventions on antibiotic use has not been investigated.

OBJECTIVE

To estimate the impact of an eight-month stewardship program on antibiotic use.

METHODS

We conducted a before-after study comparing a four-month baseline period with data from a corresponding follow-up period. We performed univariable and multivariable logistic regression to compare odds for ≤7 days of total antibiotic treatment, ≤3 days of intravenous treatment and the proportion of correct empiric antibiotics. As sensitivity analysis, we repeated the univariable logistic regression on a propensity score-matched cohort by using the same variables we used for adjustments in the multivariable analysis. We also performed subgroup analyses for patients stable ≤72 h of admission.

RESULTS

In total, 771 patients were included. Compared to preintervention, the unadjusted odds ratio (OR) for ≤7 days of total antibiotic treatment were 1.84 (95% CI 1.34-2.54) for the whole population and 2.08 (1.41-3.10) for the stable patients. The OR for ≤3 days of intravenous antibiotics were 1.16 (0.87-1.54) and 1.38 (0.87-2.22), respectively. The OR for correct empiric antibiotics were 1.96 (1.45-2.68) and 1.82 (1.23-2.69). Comparable results regarding all outcomes were derived from the other analyses.

CONCLUSION

The program resulted in a significantly lower overall antibiotic exposure and a higher proportion of patients treated with the recommended antibiotics without a the reduction of exposure to intravenous antibiotics significantly.

[Reduction of reconciliation errors in chronic pediatric patients through an educational strategy]

BACKGROUND

Medication reconciliation errors, also known as unintentional discrepancies, are frequent during admission, especially in chronic patients, and have an impact on safety. Educational interventions can be a reduction strategy.

MATERIAL AND METHODS

Quasi-experimental study, before-after design. Participants were chronic patients admitted into hospitalization services. Medication reconciliation was conducted at admission. The intervention consisted of a training to each prescribing physician with study contents and printed educational material. To study the association between intervention and change of frequency of unintentional discrepancies was made a logistic regression model, adjusting for selected variables.

RESULTS

A sample of 54 patients was studied in each stage. In the first stage it was observed that 42.6% of patients had at least one unintentional discrepancy. After intervention the proportion of patients with at least one unintentional discrepancy decreased to 24.1% (p = 0.041). In both stages, omission was the main category of unintentional discrepancy. The significant reduction after the intervention is maintained by controlling for variables such as emergency admission and pre-admission service.

CONCLUSIONS

Incidence of unintentional discrepancies in admission is high in chronic hospitalized patients and can be reduced through an educative strategy.

Neostigmine Versus Sugammadex for Reversal of Neuromuscular Blockade and Effects on Reintubation for Respiratory Failure or Newly Initiated Noninvasive Ventilation: An Interrupted Time Series Design

BACKGROUND

Pulmonary complications related to residual neuromuscular blockade lead to morbidity and mortality. Using an interrupted time series design, we tested whether proportions of reintubation for respiratory failure or new noninvasive ventilation were changed after a system-wide transition of the standard reversal agent from neostigmine to sugammadex.

METHODS

Adult patients undergoing a procedure with general anesthesia that included pharmacologic reversal of neuromuscular blockade and admission ≥1 night were eligible. Groups were determined by date of surgery: August 15, 2015 to May 10, 2016 (presugammadex), and August 15, 2016 to May 11, 2017 (postsugammadex). The period from May 11, 2016 to August 14, 2016 marked the institutional transition (washout/wash-in) from neostigmine to sugammadex. The primary outcome was defined as a composite of reintubation for respiratory failure or new noninvasive ventilation. Event proportions were parsed into 10-day intervals in each cohort, and trend lines were fitted. Segmented logistic regression models appropriate for an interrupted time series design and adjusting for potential confounders were utilized to evaluate the immediate effect of the implementation of sugammadex and on the difference between preintervention and postintervention slopes of the outcomes. Models containing all parameters (full) and only significant parameters (parsimonious) were fitted and are reported.

RESULTS

Of 13,031 screened patients, 7316 patients were included. The composite respiratory outcome occurred in 6.1% of the presugammadex group and 4.2% of the postsugammadex group. Adjusted odds ratio (OR) and 95% confidence intervals (CIs) for the composite respiratory outcome were 0.795 (95% CI, 0.523-1.208) for the immediate effect of intervention, 0.986 (95% CI, 0.959-1.013) for the difference between preintervention and postintervention slopes in the full model, and 0.667 (95% CI, 0.536-0.830) for the immediate effect of the intervention in the parsimonious model.

CONCLUSIONS

The system-wide transition of the standard pharmacologic reversal agent from neostigmine to sugammadex was associated with a reduction in the odds of the composite respiratory outcome. This observation is supported by nonsignificant within-group time trends and a significant reduction in intercept/level from presugammadex to postsugammadex in a parsimonious logistic regression model adjusting for covariates.

Personalised dosing of vancomycin: A prospective and retrospective comparative quasi-experimental study

AIMS

The 2019 update to the US consensus guideline for vancomycin therapeutic monitoring advocates using Bayesian-guided personalised dosing to maximise efficacy and minimise toxicity of vancomycin. We conducted an observational cohort study of the implementation of bed-side Bayesian-guided vancomycin dosing in vascular surgery patients.

METHODS

Over a 9-month prospective study period, vascular surgery patients were dosed vancomycin using Bayesian-guided dosing decision tool (DoseMeRx) and compared retrospectively with a control group admitted to the same ward in the 14 months prior to the study and dosed using a standard algorithmic approach. Primary endpoints were proportion of patients achieving mean area under the curve in 24 hours (AUC₂₄ ) in the acceptable range 350-450 mg/L• h and percentage time in acceptable range (%TTR). Secondary endpoints focused on clinical outcomes including incidence of acute kidney injury.

RESULTS

A significantly higher proportion of DoseMeRx patients achieved mean AUC₂₄ values in the acceptable range compared to the control group; 71/104 (68.3%) vs 58/139 (41.7%), P < .005. The median %TTR was also greater in DoseMeRx patients compared to the control group (57.1 vs 30.0%, P < .00001). Patients in the DoseMeRx group missed an average of 0.23 doses per course compared to 1.04 doses in the control group (P < .00001). No difference was observed in secondary (clinical) outcomes between the 2 groups.

CONCLUSION

Bedside Bayesian-guided personalised dosing of vancomycin increases the proportion of patients achieving target AUC₂₄ and the %TTR.

Systematic Review of Economic Evaluations of Services Provided by Community Pharmacists

BACKGROUND

Community pharmacists' scope of practice has been evolving from a traditional dispensing role to providing patient-centered services. Given the constraints in healthcare budget and a need for efficient use of finite resources, decision makers may require convincing evidence of value to recommend these services for public funding. Several economic evaluations have aimed to demonstrate the value of services provided by community pharmacists.

OBJECTIVE

The objective of this study was to systematically review the reporting and methodological quality of full economic evaluations of services provided by community pharmacists.

METHODS

A literature search was conducted in the bibliographic databases MEDLINE, EMBASE, and the NHS Economic Evaluations Database since their inception to February 2019. Two independent reviewers performed title, abstract, full text screening, and data abstraction and assessed the quality of reporting and methodological approaches using the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) and Quality of Health Economic Studies (QHES) checklists.

RESULTS

Twenty full economic evaluations were included in the review. Most of these studies were conducted in the UK (40%), followed by the USA (35%), Canada (10%), the Netherlands (5%), Thailand (5%), and Australia (5%). The efficacy or effectiveness data were drawn from individual level or cluster randomized trials, or observational studies. About half of these studies (45%) adopted the perspective of the public healthcare system. Four studies used decision analytic modeling. We identified issues in these studies with selection of study population, efficacy or effectiveness data, time horizon, outcomes measured, measurement or resources used and cost estimation, analytical approaches, and handling of uncertainty with study parameters. The quality of reporting and methodological considerations was variable across these studies, with none of the studies adequately fulfilling all 24 items of CHEERS or 16 questions of QHES checklists.

CONCLUSIONS

Our findings suggest there are various issues related to the quality of conduct and reporting of economic evaluations of services provided by community pharmacists. Interpretation of these studies should be treated with caution to facilitate decision making in the local context. In an era of scarce resources and demand for evidence-informed decision making, there may be a need for guidance on methodological approaches to assess the value of these services.