Why most published meta-analysis findings are false

Appendectomy versus antibiotic treatment for acute appendicitis

BACKGROUND

Acute appendicitis is one of the most common emergency general surgical conditions worldwide. Uncomplicated/simple appendicitis can be treated with appendectomy or antibiotics. Some studies have suggested possible benefits with antibiotics with reduced complications, length of hospital stay, and the number of days off work. However, surgery may improve success of treatment as antibiotic treatment is associated with recurrence and future need for surgery.

OBJECTIVES

To assess the effects of antibiotic treatment for uncomplicated/simple acute appendicitis compared with appendectomy for resolution of symptoms and complications.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase, and two trial registers (World Health Organization International Clinical Trials Registry Platform and ClinicalTrials.gov) on 19 July 2022. We also searched for unpublished studies in conference proceedings together with reference checking and citation search. There were no restrictions on date, publication status, or language of publication.

SELECTION CRITERIA

We included parallel-group randomised controlled trials (RCTs) only. We included studies where most participants were adults with uncomplicated/simple appendicitis. Interventions included antibiotics (by any route) compared with appendectomy (open or laparoscopic).

DATA COLLECTION AND ANALYSIS

We used standard methodology expected by Cochrane. We used GRADE to assess the certainty of evidence for each outcome. Primary outcomes included mortality and success of treatment, and secondary outcomes included number of participants requiring appendectomy in the antibiotic group, complications, pain, length of hospital stay, sick leave, malignancy in the antibiotic group, negative appendectomy rate, and quality of life. Success of treatment definitions were heterogeneous although mainly based on resolution of symptoms rather than incorporation of long-term recurrence or need for surgery in the antibiotic group.

MAIN RESULTS

We included 13 studies in the review covering 1675 participants randomised to antibiotics and 1683 participants randomised to appendectomy. One study was unpublished. All were conducted in secondary care and two studies received pharmaceutical funding. All studies used broad-spectrum antibiotic regimens expected to cover gastrointestinal bacteria. Most studies used predominantly laparoscopic surgery, but some included mainly open procedures. Six studies included adults and children. Almost all studies aimed to exclude participants with complicated appendicitis prior to randomisation, although one study included 12% with perforation. The diagnostic technique was clinical assessment and imaging in most studies. Only one study limited inclusion by sex (male only). Follow-up ranged from hospital admission only to seven years. Certainty of evidence was mainly affected by risk of bias (due to lack of blinding and loss to follow-up) and imprecision. Primary outcomes It is uncertain whether there was any difference in mortality due to the very low-certainty evidence (Peto odds ratio (OR) 0.51, 95% confidence interval (CI) 0.05 to 4.95; 1 study, 492 participants). There may be 76 more people per 1000 having unsuccessful treatment in the antibiotic group compared with surgery, which did not reach our predefined level for clinical significance (risk ratio (RR) 0.91, 95% CI 0.87 to 0.96; I2 = 69%; 7 studies, 2471 participants; low-certainty evidence). Secondary outcomes At one year, 30.7% (95% CI 24.0 to 37.8; I2 = 80%; 9 studies, 1396 participants) of participants in the antibiotic group required appendectomy or, alternatively, more than two-thirds of antibiotic-treated participants avoided surgery in the first year, but the evidence is very uncertain. Regarding complications, it is uncertain whether there is any difference in episodes of Clostridium difficile diarrhoea due to very low-certainty evidence (Peto OR 0.97, 95% CI 0.24 to 3.89; 1 study, 1332 participants). There may be a clinically significant reduction in wound infections with antibiotics (RR 0.25, 95% CI 0.09 to 0.68; I2 = 16%; 9 studies, 2606 participants; low-certainty evidence). It is uncertain whether antibiotics affect the incidence of intra-abdominal abscess or collection (RR 1.58, 95% CI 0.61 to 4.07; I2 = 19%; 6 studies, 1831 participants), or reoperation (Peto OR 0.13, 95% CI 0.01 to 2.16; 1 study, 492 participants) due to very low-certainty evidence, mainly due to rare events causing imprecision and risk of bias. It is uncertain if antibiotics prolonged length of hospital stay by half a day due to the very low-certainty evidence (MD 0.54, 95% CI 0.06 to 1.01; I2 = 97%; 11 studies, 3192 participants). The incidence of malignancy was 0.3% (95% CI 0 to 1.5; 5 studies, 403 participants) in the antibiotic group although follow-up was variable. Antibiotics probably increased the number of negative appendectomies at surgery (RR 3.16, 95% CI 1.54 to 6.49; I2 = 17%; 5 studies, 707 participants; moderate-certainty evidence).

AUTHORS' CONCLUSIONS

Antibiotics may be associated with higher rates of unsuccessful treatment for 76 per 1000 people, although differences may not be clinically significant. It is uncertain if antibiotics increase length of hospital stay by half a day. Antibiotics may reduce wound infections. A third of the participants initially treated with antibiotics required subsequent appendectomy or two-thirds avoided surgery within one year, but the evidence is very uncertain. There were too few data from the included studies to comment on major complications.

Plyometric Jump Training Exercise Optimization for Maximizing Human Performance: A Systematic Scoping Review and Identification of Gaps in the Existing Literature

BACKGROUND

Plyometric jump training (PJT) encompasses a range of different exercises that may offer advantages over other training methods to improve human physical capabilities (HPC). However, no systematic scoping review has analyzed either the role of the type of PJT exercise as an independent prescription variable or the gaps in the literature regarding PJT exercises to maximize HPC.

OBJECTIVE

This systematic scoping review aims to summarize the published scientific literature and its gaps related to HPC adaptations (e.g., jumping) to PJT, focusing on the role of the type of PJT exercise as an independent prescription variable.

METHODS

Computerized literature searches were conducted in the PubMed, Web of Science, and SCOPUS electronic databases. Design (PICOS) framework: (P) Healthy participants of any age, sex, fitness level, or sports background; (I) Chronic interventions exclusively using any form of PJT exercise type (e.g., vertical, unilateral). Multimodal interventions (e.g., PJT + heavy load resistance training) will be considered only if studies included two experimental groups under the same multimodal intervention, with the only difference between groups being the type of PJT exercise. (C) Comparators include PJT exercises with different modes (e.g., vertical vs. horizontal; vertical vs. horizontal combined with vertical); (O) Considered outcomes (but not limited to): physiological, biomechanical, biochemical, psychological, performance-related outcomes/adaptations, or data on injury risk (from prevention-focused studies); (S) Single- or multi-arm, randomized (parallel, crossover, cluster, other) or non-randomized.

RESULTS

Through database searching, 10,546 records were initially identified, and 69 studies (154 study groups) were included in the qualitative synthesis. The DJ (counter, bounce, weighted, and modified) was the most studied type of jump, included in 43 study groups, followed by the CMJ (standard CMJ or modified) in 19 study groups, and the SJ (standard SJ or modified) in 17 study groups. Strength and vertical jump were the most analyzed HPC outcomes in 38 and 54 studies, respectively. The effects of vertical PJT versus horizontal PJT on different HPC were compared in 21 studies. The effects of bounce DJ versus counter DJ (or DJ from different box heights) on different HPC were compared in 26 studies.

CONCLUSIONS

Although 69 studies analyzed the effects of PJT exercise type on different HPC, several gaps were identified in the literature. Indeed, the potential effect of the PJT exercise type on a considerable number of HPC outcomes (e.g., aerobic capacity, flexibility, asymmetries) are virtually unexplored. Future studies are needed, including greater number of participants, particularly in groups of females, senior athletes, and youths according to maturity. Moreover, long-term (e.g., >12 weeks) PJT interventions are needed.

Programming Plyometric-Jump Training in Soccer: A Review

The aim of this review was to describe and summarize the scientific literature on programming parameters related to jump or plyometric training in male and female soccer players of different ages and fitness levels. A literature search was conducted in the electronic databases PubMed, Web of Science and Scopus using keywords related to the main topic of this study (e.g., “ballistic” and “plyometric”). According to the PICOS framework, the population for the review was restricted to soccer players, involved in jump or plyometric training. Among 7556 identified studies, 90 were eligible for inclusion. Only 12 studies were found for females. Most studies (n = 52) were conducted with youth male players. Moreover, only 35 studies determined the effectiveness of a given jump training programming factor. Based on the limited available research, it seems that a dose of 7 weeks (1−2 sessions per week), with ~80 jumps (specific of combined types) per session, using near-maximal or maximal intensity, with adequate recovery between repetitions (<15 s), sets (≥30 s) and sessions (≥24−48 h), using progressive overload and taper strategies, using appropriate surfaces (e.g., grass), and applied in a well-rested state, when combined with other training methods, would increase the outcome of effective and safe plyometric-jump training interventions aimed at improving soccer players physical fitness. In conclusion, jump training is an effective and easy-to-administer training approach for youth, adult, male and female soccer players. However, optimal programming for plyometric-jump training in soccer is yet to be determined in future research.

GO-E-MON: A New Online Platform for Decentralized Cognitive Science

Advances in web technology and the widespread use of smartphones and PCs have proven that it is possible to optimize various services using personal data, such as location information and search history. While considerations of personal privacy and legal aspects lead to situations where data are monopolized by individual services and companies, a replication crisis has been pointed out for the data of laboratory experiments, which is challenging to solve given the difficulty of data distribution. To ensure distribution of experimental data while guaranteeing security, an online experiment platform can be a game changer. Current online experiment platforms have not yet considered improving data distribution, and it is currently difficult to use the data obtained from one experiment for other purposes. In addition, various devices such as activity meters and consumer-grade electroencephalography meters are emerging, and if a platform that collects data from such devices and tasks online is to be realized, the platform will hold a large amount of sensitive data, making it even more important to ensure security. We propose GO-E-MON, a service that combines an online experimental environment with a distributed personal data store (PDS), and explain how GO-E-MON can realize the reuse of experimental data with the subject’s consent by connecting to a distributed PDS. We report the results of the experiment in a groupwork lecture for university students to verify whether this method works. By building an online experiment environment integrated with a distributed PDS, we present the possibility of integrating multiple experiments performed by different experimenters—with the consent of individual subjects—while solving the security issues.

Need for more evidence in the prevention and management of perinatal asphyxia and neonatal encephalopathy in low and middle-income countries: A call for action

Although low- and middle-income countries (LMICs) shoulder 90 % of the neonatal encephalopathy (NE) burden, there is very little evidence base for prevention or management of this condition in these settings. A variety of antenatal factors including socio-economic deprivation, undernutrition and sub optimal antenatal and intrapartum care increase the risk of NE, although little is known about the underlying mechanisms. Implementing interventions based on the evidence from high-income countries to LMICs, may cause more harm than benefit as shown by the increased mortality and lack of neuroprotection with cooling therapy in the hypothermia for moderate or severe NE in low and middle-income countries (HELIX) trial. Pooled data from pilot trials suggest that erythropoietin monotherapy reduces death and disability in LMICs, but this needs further evaluation in clinical trials. Careful attention to supportive care, including avoiding hyperoxia, hypocarbia, hypoglycemia, and hyperthermia, are likely to improve outcomes until specific neuroprotective or neurorestorative therapies available.

A local platform for user-friendly FAIR data management and reproducible analytics

Collaborative research is common practice in modern life sciences. For most projects several researchers from multiple universities collaborate on a specific topic. Frequently, these research projects produce a wealth of data that requires central and secure storage, which should also allow for easy sharing among project participants. Only under best circumstances, this comes with minimal technical overhead for the researchers. Moreover, the need for data to be analyzed in a reproducible way often poses a challenge for researchers without a data science background and thus represents an overly time-consuming process. Here, we report on the integration of CyVerse Austria (CAT), a new cyberinfrastructure for a local community of life science researchers and provide two examples how it can be used to facilitate FAIR data management and reproducible analytics for teaching and research. In particular, we describe in detail how CAT can be used (i) as a teaching platform with a defined software environment and data management/sharing possibilities, and (ii) to build a data analysis pipeline using the Docker technology tailored to the needs and interests of the researcher.

Pre-emptive and preventive NSAIDs for postoperative pain in adults undergoing all types of surgery

BACKGROUND

Postoperative pain is a common consequence of surgery and can have many negative perioperative effects. It has been suggested that the administration of analgesia before a painful stimulus may improve pain control. We defined pre-emptive nonsteroidal anti-inflammatories (NSAIDs) as those given before surgery but not continued afterwards and preventive NSAIDs as those given before surgery and continued afterwards. These were compared to a control group given the NSAIDs after surgery instead of before surgery.

OBJECTIVES

To assess the efficacy of preventive and pre-emptive NSAIDs for reducing postoperative pain in adults undergoing all types of surgery.

SEARCH METHODS

We searched the following electronic databases: CENTRAL, MEDLINE, Embase, AMED and CINAHL (up to June 2020). In addition, we searched for unpublished studies in three clinical trial databases, conference proceedings, grey literature databases, and reference lists of retrieved articles. We did not apply any restrictions on language or date of publication.

SELECTION CRITERIA

We included parallel-group randomized controlled trials (RCTs) only. We included adult participants undergoing any type of surgery. We defined pre-emptive NSAIDs as those given before surgery but not continued afterwards and preventive NSAIDs as those given before surgery and continued afterwards. These were compared to a control group given the NSAIDs after surgery instead of before surgery. We included studies that gave the medication by any route but not given on the skin.

DATA COLLECTION AND ANALYSIS

We used the standard methods expected by Cochrane, as well as a novel publication bias test developed by our research group. We used GRADE to assess the certainty of the evidence for each outcome. Outcomes included acute postoperative pain (minimal clinically important difference (MCID): 1.5 on a 0-10 scale), adverse events of NSAIDs, nausea and vomiting, 24-hour morphine consumption (MCID: 10 mg reduction), time to analgesic request (MCID: one hour), pruritus, sedation, patient satisfaction, chronic pain and time to first bowel movement (MCID: 12 hours).

MAIN RESULTS

We included 71 RCTs. Seven studies are awaiting classification. We included 45 studies that evaluated pre-emptive NSAIDs and 26 studies that evaluated preventive NSAIDs. We considered only four studies to be at low risk of bias for most domains. The operations and NSAIDs used varied, although most studies were conducted in abdominal, orthopaedic and dental surgery. Most studies were conducted in secondary care and in low-risk participants. Common exclusions were participants on analgesic medications prior to surgery and those with chronic pain. Pre-emptive NSAIDs compared to post-incision NSAIDs For pre-emptive NSAIDs, there is probably a decrease in early acute postoperative pain (MD -0.69, 95% CI -0.97 to -0.41; studies = 36; participants = 2032; I2 = 96%; moderate-certainty evidence). None of the included studies that reported on acute postoperative pain reported adverse events as an outcome. There may be little or no difference between the groups in short-term (RR 1.00, 95% CI 0.34 to 2.94; studies = 2; participants = 100; I2 = 0%; low-certainty evidence) or long-term nausea and vomiting (RR 0.85, 95% CI 0.52 to 1.38; studies = 5; participants = 228; I2 = 29%; low-certainty evidence). There may be a reduction in late acute postoperative pain (MD -0.22, 95% CI -0.44 to 0.00; studies = 28; participants = 1645; I2 = 97%; low-certainty evidence). There may be a reduction in 24-hour morphine consumption with pre-emptive NSAIDs (MD -5.62 mg, 95% CI -9.00 mg to -2.24 mg; studies = 16; participants = 854; I2 = 99%; low-certainty evidence) and an increase in the time to analgesic request (MD 17.04 minutes, 95% CI 3.77 minutes to 30.31 minutes; studies = 18; participants = 975; I2 = 95%; low-certainty evidence). There may be little or no difference in opioid adverse events such as pruritus (RR 0.40, 95% CI 0.09 to 1.76; studies = 4; participants = 254; I2 = 0%; low-certainty evidence) or sedation (RR 0.51, 95% CI 0.16 to 1.68; studies = 4; participants = 281; I2 = 0%; low-certainty evidence), although the number of included studies for these outcomes was small. No study reported patient satisfaction, chronic pain or time to first bowel movement for pre-emptive NSAIDs. Preventive NSAIDs compared to post-incision NSAIDs For preventive NSAIDs, there may be little or no difference in early acute postoperative pain (MD -0.14, 95% CI -0.39 to 0.12; studies = 18; participants = 1140; I2 = 75%; low-certainty evidence). One study reported adverse events from NSAIDs (reoperation for bleeding) although the events were low which did not allow any meaningful conclusions to be drawn (RR 1.95; 95% CI 0.18 to 20.68). There may be little or no difference in rates of short-term (RR 1.26, 95% CI 0.49 to 3.30; studies = 1; participants = 76; low-certainty evidence) or long-term (RR 0.85, 95% CI 0.52 to 1.38; studies = 5; participants = 456; I2 = 29%; low-certainty evidence) nausea and vomiting. There may be a reduction in late acute postoperative pain (MD -0.33, 95% CI -0.59 to -0.07; studies = 21; participants = 1441; I2 = 81%; low-certainty evidence). There is probably a reduction in 24-hour morphine consumption (MD -1.93 mg, 95% CI -3.55 mg to -0.32 mg; studies = 16; participants = 1323; I2 = 49%; moderate-certainty evidence). It is uncertain if there is any difference in time to analgesic request (MD 8.51 minutes, 95% CI -31.24 minutes to 48.27 minutes; studies = 8; participants = 410; I2 = 98%; very low-certainty evidence). As with pre-emptive NSAIDs, there may be little or no difference in other opioid adverse events such as pruritus (RR 0.56, 95% CI 0.09 to 3.35; studies = 3; participants = 211; I2 = 0%; low-certainty evidence) and sedation (RR 0.84, 95% CI 0.44 to 1.63; studies = 5; participants = 497; I2 = 0%; low-certainty evidence). There is probably little or no difference in patient satisfaction (MD -0.42; 95% CI -1.09 to 0.25; studies = 1; participants = 72; moderate-certainty evidence). No study reported on chronic pain. There is probably little or no difference in time to first bowel movement (MD 0.00; 95% CI -15.99 to 15.99; studies = 1; participants = 76; moderate-certainty evidence).

AUTHORS' CONCLUSIONS

There was some evidence that pre-emptive and preventive NSAIDs reduce both pain and morphine consumption, although this was not universal for all pain and morphine consumption outcomes. Any differences found were not clinically significant, although we cannot exclude this in more painful operations. Moreover, without any evidence of reductions in opioid adverse effects, the clinical significance of these results is questionable although few studies reported these outcomes. Only one study reported clinically significant adverse events from NSAIDs administered before surgery and, therefore, we have very few data to assess the safety of either pre-emptive or preventive NSAIDs. Therefore, future research should aim to adhere to the highest methodology and be adequately powered to assess serious adverse events of NSAIDs and reductions in opioid adverse events.

Methodologies for systematic reviews with meta-analysis of randomised clinical trials in pain, anaesthesia, and perioperative medicine

Systematic reviews and meta-analyses (SRMAs) are increasing in popularity, but should they be used to inform clinical decision-making in anaesthesia? We present evidence that the certainty of evidence from SRMAs in anaesthesia (and in general) may be unacceptably low because of risks of bias exaggerating treatment effects, unexplained heterogeneity reducing certainty in estimates, random errors, and widespread prevalence of publication bias. We also present the latest methodological advances to help improve the certainty of evidence from SRMAs. The target audience includes both review authors and practising clinicians to help with SRMA appraisal. Issues discussed include minimising risks of bias from included trials, trial sequential analysis to reduce random error, updated methods for presenting effect estimates, and novel publication bias tests for commonly used outcome measures. These methods can help to reduce spurious conclusions on clinical significance, explain statistical heterogeneity, and reduce false positives when evaluating small-study effects. By reducing concerns in these domains of Grading of Recommendations, Assessment, Development and Evaluation, it should help improve the certainty of evidence from SRMAs used for decision-making in anaesthesia, pain, and perioperative medicine.

Prophylactic antibiotics for penetrating abdominal trauma: duration of use and antibiotic choice

BACKGROUND

Penetrating abdominal trauma (PAT) is a common type of trauma leading to admission to hospital, which often progresses to septic complications. Antibiotics are commonly administered as prophylaxis prior to laparotomy for PAT. However, an earlier Cochrane Review intending to compare antibiotics with placebo identified no relevant randomised controlled trials (RCTs). Despite this, many RCTs have been carried out that compare different agents and durations of antibiotic therapy. To date, no systematic review of these trials has been performed.

OBJECTIVES

To assess the effects of antibiotics in penetrating abdominal trauma, with respect to the type of agent administered and the duration of therapy.

SEARCH METHODS

We searched the following electronic databases for relevant randomised controlled trials, from database inception to 23 July 2019; Cochrane Injuries Group's Specialised Register, CENTRAL, MEDLINE Ovid, MEDLINE Ovid In-Process & Other Non-Indexed Citations, MEDLINE Ovid Daily and Ovid OLDMEDLINE, Embase Classic + Embase Ovid, ISI Web of Science (SCI-EXPANDED, SSCI, CPCI-S & CPSI-SSH), and two clinical trials registers. We also searched reference lists from included studies. We applied no restrictions on language or date of publication.

SELECTION CRITERIA

We included RCTs only. We included studies involving participants of all ages, which were conducted in secondary care hospitals only. We included studies of participants who had an isolated penetrating abdominal wound that breached the peritoneum, who were not already taking antibiotics.

DATA COLLECTION AND ANALYSIS

Two study authors independently extracted data and assessed risk of bias. We used standard Cochrane methods. We aggregated study results using a random-effects model. We also conducted trial sequential analysis (TSA) to help reduce type I and II errors in our analyses.

MAIN RESULTS

We included 29 RCTs, involving a total of 4458 participants. We deemed 23 trials to be at high risk of bias in at least one domain. We are uncertain of the effect of a long course of antibiotic prophylaxis (> 24 hours) compared to a short course (≤ 24 hours) on abdominal surgical site infection (RR 1.00, 95% CI 0.81 to 1.23; I² = 0%; 7 studies, 1261 participants; very low-quality evidence), mortality (Peto OR 1.67, 95% CI 0.73 to 3.82; I² = 8%; 7 studies, 1261 participants; very low-quality evidence), or intra-abdominal infection (RR 1.23, 95% CI 0.84 to 1.80; I² = 0%; 6 studies, 111 participants; very-low quality evidence). Based on very low-quality evidence from fifteen studies, involving 2020 participants, which compared different drug regimens with activity against three classes of gastrointestinal flora (gram positive, gram negative, anaerobic), we are uncertain whether there is a benefit of one regimen over another. TSA showed the majority of comparisons did not cross the alpha adjusted boundary for benefit or harm, or reached the required information size, indicating that further studies are required for these analyses. However, in the three analyses which crossed the boundary for futility, further studies are unlikely to show benefit or harm.

AUTHORS' CONCLUSIONS

Very low-quality evidence means that we are uncertain about the effect of either the duration of antibiotic prophylaxis, or the superiority of one drug regimen over another for penetrating abdominal trauma on abdominal surgical site infection rates, mortality, or intra-abdominal infections. Future RCTs should be adequately powered, test currently used antibiotics, known to be effective against gut flora, use methodology to minimise the risk of bias, and adequately report the level of peritoneal contamination encountered at laparotomy.