No role for quality scores in systematic reviews of diagnostic accuracy studies

Intra- and inter-rater reliability of movement and palpation tests in patients with neck pain: A systematic review

Neck pain is common and often becomes chronic. Various clinical tests of the cervical spine are used to direct and evaluate treatment. This systematic review aimed to identify studies examining the intra- and/or interrater reliability of tests used in clinical examination of patients with neck pain. A database search up to April 2016 was conducted in PubMed, CINAHL, and AMED. The Quality Appraisal of Reliability Studies Checklist (QAREL) was used to assess risk of bias. Eleven studies were included, comprising tests of active and passive movement and pain evaluating participants with ongoing neck pain. One study was assessed with a low risk of bias, three with medium risk, while the rest were assessed with high risk of bias. The results showed differing reliabilities for the included tests ranging from poor to almost perfect. In conclusion, active movement and pain for pain or mobility overall presented acceptable to very good reliability (Kappa >0.40); while passive intervertebral tests had lower Kappa values, suggesting poor reliability. It may be a coincidence that the studies indicating very good reliability tended to be of higher quality (low to moderate risk of bias), while studies finding poor reliability tended to be of lower quality (high risk of bias). Regardless, the current recommendation from this review would suggest the clinical use of tests with acceptable reliability and avoiding the use of tests that have been shown to not be reliable. Finally, it is critical that all future reliability studies are of higher quality with low risk of bias.

A proposed framework for developing quality assessment tools

BACKGROUND

Assessment of the quality of included studies is an essential component of any systematic review. A formal quality assessment is facilitated by using a structured tool. There are currently no guidelines available for researchers wanting to develop a new quality assessment tool.

METHODS

This paper provides a framework for developing quality assessment tools based on our experiences of developing a variety of quality assessment tools for studies of differing designs over the last 14 years. We have also drawn on experience from the work of the EQUATOR Network in producing guidance for developing reporting guidelines.

RESULTS

We do not recommend a single 'best' approach. Instead, we provide a general framework with suggestions as to how the different stages can be approached. Our proposed framework is based around three key stages: initial steps, tool development and dissemination.

CONCLUSIONS

We recommend that anyone who would like to develop a new quality assessment tool follow the stages outlined in this paper. We hope that our proposed framework will increase the number of tools developed using robust methods.

"Assessing the methodological quality of systematic reviews in radiation oncology: A systematic review"

OBJECTIVE

The objective of our study was to evaluate the methodological quality of systematic reviews and meta-analyses in Radiation Oncology.

METHODS

A systematic literature search was conducted for all eligible systematic reviews and meta-analyses in Radiation Oncology from 1966 to 2015. Methodological characteristics were abstracted from all works that satisfied the inclusion criteria and quality was assessed using the critical appraisal tool, AMSTAR. Regression analyses were performed to determine factors associated with a higher score of quality.

RESULTS

Following exclusion based on a priori criteria, 410 studies (157 systematic reviews and 253 meta-analyses) satisfied the inclusion criteria. Meta-analyses were found to be of fair to good quality while systematic reviews were found to be of less than fair quality. Factors associated with higher scores of quality in the multivariable analysis were including primary studies consisting of randomized control trials, performing a meta-analysis, and applying a recommended guideline related to establishing a systematic review protocol and/or reporting.

CONCLUSIONS

Systematic reviews and meta-analyses may introduce a high risk of bias if applied to inform decision-making based on AMSTAR. We recommend that decision-makers in Radiation Oncology scrutinize the methodological quality of systematic reviews and meta-analyses prior to assessing their utility to inform evidence-based medicine and researchers adhere to methodological standards outlined in validated guidelines when embarking on a systematic review.

The characteristics of national health initiatives promoting earlier cancer diagnosis among adult populations: a systematic review protocol

INTRODUCTION

The increasing burden of cancer morbidity and mortality has led to the development of national health initiatives to promote earlier cancer diagnosis and improve cancer survival. This protocol describes a systematic review aiming to identify the evidence about such initiatives among the adult population. We will describe their components, stakeholders and target populations, and summarise their outcomes.

METHODS AND ANALYSIS

We will search databases and websites for peer-reviewed publications and grey literature on national health initiatives in high-income countries as defined by the World Bank. Quantitative, qualitative and mixed-methods studies will be included and assessed for their methodological quality. Study selection, quality assessment and data extraction will be carried out independently by two reviewers. Narrative synthesis will be used to analyse the findings.

ETHICS AND DISSEMINATION

This systematic review analyses secondary data and ethical approval is not required. Review findings will be helpful to researchers, policy makers, governments and other key stakeholders developing similar initiatives and assessing cancer outcomes. The results will be submitted to a peer-reviewed journal in order to reach a diverse group of healthcare professionals, researchers and policy makers. This systematic review protocol is registered at PROSPERO (CRD42016047233).

The Anatomic Centers of the Femoral and Tibial Insertions of the Anterior Cruciate Ligament: A Systematic Review of Imaging and Cadaveric Studies Reporting Normal Center Locations

BACKGROUND

The anterior cruciate ligament (ACL) is regularly reconstructed if knee joint function is impaired. Anatomic graft tunnel placement, often assessed with varying measurement methods, in the femur and tibia is considered important for an optimal clinical outcome. A consensus on the exact location of the femoral and tibial footprint centers is lacking.

PURPOSE

To systematically review the literature regarding anatomic centers of the femoral and tibial ACL footprints and assess the mean, median, and percentiles of normal centers.

STUDY DESIGN

Systematic review.

METHODS

A systematic literature search was performed in the PubMed/Medline database in November 2015. Search terms were the following: "ACL" and "insertion anatomy" or "anatomic footprint" or "radiographic landmarks" or "quadrant methods" or "tunnel placement" or "cadaveric femoral" or "cadaveric tibial." English-language articles that reported the location of the ACL footprint according to the Bernard and Hertel grid in the femur and the Stäubli and Rauschning method in the tibia were included. Weighted means, weighted medians, and weighted 5th and 95th percentiles were calculated.

RESULTS

The initial search yielded 1393 articles. After applying the inclusion and exclusion criteria, 16 studies with measurements on cadaveric specimens or a healthy population were reviewed. The weighted mean of the femoral insertion center based on measurements in 218 knees was 29% in the deep-shallow (DS) direction and 35% in the high-low (HL) direction. The weighted median was 26% for DS and 34% for HL. The weighted 5th and 95th percentiles for DS were 24% and 37%, respectively, and for HL were 28% and 43%, respectively. The weighted mean of the tibial insertion center in the anterior-posterior direction based on measurements in 300 knees was 42%, and the weighted median was 44%; the 5th and 95th percentiles were 39% and 46%, respectively.

CONCLUSION

Our results show slight differences between the weighted means and medians in the femoral and tibial insertion centers. We recommend the use of the 5th and 95th percentiles when considering postoperative placement to be "in or out of the anatomic range."

Clinical Utility of Fecal Calprotectin Monitoring in Asymptomatic Patients with Inflammatory Bowel Disease: A Systematic Review and Practical Guide

BACKGROUND

In asymptomatic patients with inflammatory bowel disease (IBD), "monitoring" involves repeated testing aimed at early recognition of disease exacerbation. We aimed to determine the usefulness of repeated fecal calprotectin (FC) measurements to predict IBD relapses by a systematic literature review.

METHODS

An electronic search was performed in Medline, Embase, and Cochrane from inception to April 2016. Inclusion criteria were prospective studies that followed patients with IBD in remission at baseline and had at least 2 consecutive FC measurements with a test interval of 2 weeks to 6 months. Methodological assessment was based on the second Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) checklist.

RESULTS

A total of 1719 articles were identified; 193 were retrieved for full text review. Six studies met eligibility for inclusion. The time interval between FC tests varied between 1 and 3 months. Asymptomatic patients with IBD who had repeated FC measurements above the study's cutoff level had a 53% to 83% probability of developing disease relapse within the next 2 to 3 months. Patients with repeated normal FC values had a 67% to 94% probability to remain in remission in the next 2 to 3 months. The ideal FC cutoff for monitoring could not be identified because of the limited number studies meeting inclusion criteria and heterogeneity between selected studies.

CONCLUSIONS

Two consecutively elevated FC values are highly associated with disease relapse, indicating a consideration to proactively optimize IBD therapy plans. More prospective data are necessary to assess whether FC monitoring improves health outcomes.

Clinical classification in low back pain: best-evidence diagnostic rules based on systematic reviews

Background

Clinical examination findings are used in primary care to give an initial diagnosis to patients with low back pain and related leg symptoms. The purpose of this study was to develop best evidence Clinical Diagnostic Rules (CDR] for the identification of the most common patho-anatomical disorders in the lumbar spine; i.e. intervertebral discs, sacroiliac joints, facet joints, bone, muscles, nerve roots, muscles, peripheral nerve tissue, and central nervous system sensitization.

Methods

A sensitive electronic search strategy using MEDLINE, EMBASE and CINAHL databases was combined with hand searching and citation tracking to identify eligible studies. Criteria for inclusion were: persons with low back pain with or without related leg symptoms, history or physical examination findings suitable for use in primary care, comparison with acceptable reference standards, and statistical reporting permitting calculation of diagnostic value. Quality assessments were made independently by two reviewers using the Quality Assessment of Diagnostic Accuracy Studies tool. Clinical examination findings that were investigated by at least two studies were included and results that met our predefined threshold of positive likelihood ratio ≥ 2 or negative likelihood ratio ≤ 0.5 were considered for the CDR.

Results

Sixty-four studies satisfied our eligible criteria. We were able to construct promising CDRs for symptomatic intervertebral disc, sacroiliac joint, spondylolisthesis, disc herniation with nerve root involvement, and spinal stenosis. Single clinical test appear not to be as useful as clusters of tests that are more closely in line with clinical decision making.

Conclusions

This is the first comprehensive systematic review of diagnostic accuracy studies that evaluate clinical examination findings for their ability to identify the most common patho-anatomical disorders in the lumbar spine. In some diagnostic categories we have sufficient evidence to recommend a CDR. In others, we have only preliminary evidence that needs testing in future studies. Most findings were tested in secondary or tertiary care. Thus, the accuracy of the findings in a primary care setting has yet to be confirmed.

Electronic supplementary material

The online version of this article (doi:10.1186/s12891-017-1549-6) contains supplementary material, which is available to authorized users.

A meta-analysis: The diagnostic values of long non-coding RNA as a biomarker for gastric cancer

Long non-coding RNAs (lncRNAs) have been identified as novel biomarkers for the diagnosis, staging and prognosis for gastric cancer. However, various studies have reported a series of significances based on different diagnostic values. Therefore, the current study performed a systematic review and meta-analysis to evaluate the diagnostic accuracy of lncRNAs for gastric cancer, and to discuss lncRNA types and sources of heterogeneity. The Cochrane Central Register of Controlled Trials, MEDLINE, PubMed, EMBASE, the Chinese Biomedical Literature Database, the China Academic Journals Full-text Database and the Chinese Scientific Journals Database were systematically searched for potential studies. Studies were included if they were associated with lncRNAs, gastric cancer and reported diagnostic outcomes. Analysis of diagnostic values was used to summarize the overall test performance of lncRNAs. Ten studies were included in this meta-analysis. The ranges of the diagnostic value of lncRNAs for gastric cancer were as follows: Sensitivity was 0.45–0.83, and pooled sensitivity was 0.63; specificity was 0.60–0.93, and pooled specificity was 0.75; positive likelihood ratio was 1.80–6.92, and pooled positive likelihood ratio was 2.51; negative likelihood ratio was 0.23–0.67, and pooled negative likelihood ratio was 0.50; diagnostic odds ratio was 3.33–13.75, and pooled diagnostic odds ratio was 5.47. An overall area under the curve value of the summary receiver operating characteristic curve was 0.7550. LncRNAs did not have a high accuracy for identifying gastric cancer at present, but may be a useful screening tool for diagnosing gastric cancer due to their correlation with gastric cancer biological features. LncRNAs are potential biomarkers for gastric cancer if the screening strategy is altered, or they are combined with other biomarkers to diagnose gastric cancer.

Meta-analyses of the sensitivity and specificity of ante-mortem and post-mortem diagnostic tests for bovine tuberculosis in the UK and Ireland

Bovine Tuberculosis (bTB) in cattle is a global health problem and eradication of the disease requires accurate estimates of diagnostic test performance to optimize their efficiency. The objective of this study was, through statistical meta-analyses, to obtain estimates of sensitivity (Se) and specificity (Sp), for 14 different ante-mortem and post-mortem diagnostic tests for bTB in cattle. Using data from a systematic review of the scientific literature (published 1934-2009) diagnostic Se and Sp were estimated using Bayesian logistic regression models adjusting for confounding factors. Random effect terms were used to account for unexplained heterogeneity. Parameters in the models were implemented using Markov Chain Monte Carlo (MCMC), and posterior distributions for the diagnostic parameters with adjustment for covariates (confounding factors) were obtained using the inverse logit function. Estimates for Se and/or Sp of the tuberculin skin tests and the IFN-γ blood test were compared with estimates published 2010-2015. Median Se for the single intradermal comparative cervical tuberculin skin (SICCT) test (standard interpretation) was 0.50 and Bayesian credible intervals (CrI) were wide (95% CrI 0.26, 0.78). Median Sp for the SICCT test was 1.00 (95% CrI 0.99, 1.00). Estimates for the IFN-γ blood test Bovine Purified Protein Derivative (PPD)-Avian PPD and Early Secreted Antigen target 6 and Culture Filtrate Protein 10 (ESAT-6/CFP10) ESAT6/CFP10 were 0.67 (95% CrI 0.49, 0.82) and 0.78 (95% CrI 0.60, 0.90) respectively for Se, and 0.98 (95% CrI 0.96, 0.99) and 0.99 (95% CrI 0.99, 1.00) for Sp. The study provides an overview of the accuracy of a range of contemporary diagnostic tests for bTB in cattle. Better understanding of diagnostic test performance is essential for the design of effective control strategies and their evaluation.

Physical examination tests of the shoulder: a systematic review and meta-analysis of diagnostic test performance

BACKGROUND

Physical examination tests of the shoulder (PETS) are clinical examination maneuvers designed to aid the assessment of shoulder complaints. Despite more than 180 PETS described in the literature, evidence of their validity and usefulness in diagnosing the shoulder is questioned.

METHODS

This meta-analysis aims to use diagnostic odds ratio (DOR) to evaluate how much PETS shift overall probability and to rank the test performance of single PETS in order to aid the clinician's choice of which tests to use. This study adheres to the principles outlined in the Cochrane guidelines and the PRISMA statement. A fixed effect model was used to assess the overall diagnostic validity of PETS by pooling DOR for different PETS with similar biomechanical rationale when possible. Single PETS were assessed and ranked by DOR. Clinical performance was assessed by sensitivity, specificity, accuracy and likelihood ratio.

RESULTS

Six thousand nine-hundred abstracts and 202 full-text articles were assessed for eligibility; 20 articles were eligible and data from 11 articles could be included in the meta-analysis. All PETS for SLAP (superior labral anterior posterior) lesions pooled gave a DOR of 1.38 [1.13, 1.69]. The Supraspinatus test for any full thickness rotator cuff tear obtained the highest DOR of 9.24 (sensitivity was 0.74, specificity 0.77). Compression-Rotation test obtained the highest DOR (6.36) among single PETS for SLAP lesions (sensitivity 0.43, specificity 0.89) and Hawkins test obtained the highest DOR (2.86) for impingement syndrome (sensitivity 0.58, specificity 0.67). No single PETS showed superior clinical test performance.

CONCLUSIONS

The clinical performance of single PETS is limited. However, when the different PETS for SLAP lesions were pooled, we found a statistical significant change in post-test probability indicating an overall statistical validity. We suggest that clinicians choose their PETS among those with the highest pooled DOR and to assess validity to their own specific clinical settings, review the inclusion criteria of the included primary studies. We further propose that future studies on the validity of PETS use randomized research designs rather than the accuracy design relying less on well-established gold standard reference tests and efficient treatment options.

The bronchodilator response in preschool children: A systematic review

BACKGROUND

The bronchodilator response (BDR) is frequently used to support diagnostic and therapeutic decision-making for children who wheeze. However, there is little evidence-based guidance describing the role of BDR testing in preschool children and it is unclear whether published cut-off values, which are derived from adult data, can be applied to this population.

METHODS

We searched MEDLINE, EMBASE, Web of Science, and Cochrane databases (inception-September 2015) for studies reporting response to a bronchodilator in healthy preschool children, response following placebo inhalation, and the diagnostic efficacy of BDR compared with a clinical diagnosis of asthma/recurrent wheezing.

FINDINGS

We included 14 studies. Thirteen studies provided BDR data from healthy preschool children. Two studies reported response to placebo in preschool children with asthma/recurrent wheezing. Twelve studies compared BDR measurements from preschool children with asthma/recurrent wheeze to those from healthy children and seven of these studies reported diagnostic efficacy. Significant differences between the BDR measured in healthy preschool children compared with that in children with asthma/recurrent wheeze were demonstrated in some, but not all studies. Techniques such as interrupter resistance, oscillometry, and plethysmography were more consistently successfully completed than spirometry. Between study heterogeneity precluded determination of an optimum technique.

INTERPRETATION

There is little evidence to suggest spirometry-based BDR can be used in the clinical assessment of preschool children who wheeze. Further evaluation of simple alternative techniques is required. Future studies should recruit children in whom airways disease is suspected and should evaluate the ability of BDR testing to predict treatment response. Pediatr Pulmonol. 2016;51:1242-1250. © 2016 Wiley Periodicals, Inc.

Combination of the non-invasive tests for the diagnosis of endometriosis

BACKGROUND

About 10% of women of reproductive age suffer from endometriosis, a costly chronic disease causing pelvic pain and subfertility. Laparoscopy is the gold standard diagnostic test for endometriosis, but is expensive and carries surgical risks. Currently, there are no non-invasive tests available in clinical practice to accurately diagnose endometriosis. This review assessed the diagnostic accuracy of combinations of different non-invasive testing modalities for endometriosis and provided a summary of all the reviews in the non-invasive tests for endometriosis series.

OBJECTIVES

To estimate the diagnostic accuracy of any combination of non-invasive tests for the diagnosis of pelvic endometriosis (peritoneal and/or ovarian or deep infiltrating) compared to surgical diagnosis as a reference standard. The combined tests were evaluated as replacement tests for diagnostic surgery and triage tests to assist decision-making to undertake diagnostic surgery for endometriosis.

SEARCH METHODS

We did not restrict the searches to particular study designs, language or publication dates. We searched CENTRAL to July 2015, MEDLINE and EMBASE to May 2015, as well as the following databases to April 2015: CINAHL, PsycINFO, Web of Science, LILACS, OAIster, TRIP, ClinicalTrials.gov, DARE and PubMed.

SELECTION CRITERIA

We considered published, peer-reviewed, randomised controlled or cross-sectional studies of any size, including prospectively collected samples from any population of women of reproductive age suspected of having one or more of the following target conditions: ovarian, peritoneal or deep infiltrating endometriosis (DIE). We included studies comparing the diagnostic test accuracy of a combination of several testing modalities with the findings of surgical visualisation of endometriotic lesions.

DATA COLLECTION AND ANALYSIS

Three review authors independently collected and performed a quality assessment of the data from each study by using the QUADAS-2 tool. For each test, the data were classified as positive or negative for the surgical detection of endometriosis and sensitivity and specificity estimates were calculated. The bivariate model was planned to obtain pooled estimates of sensitivity and specificity whenever sufficient data were available. The predetermined criteria for a clinically useful test to replace diagnostic surgery were a sensitivity of 0.94 and a specificity of 0.79 to detect endometriosis. We set the criteria for triage tests at a sensitivity of 0.95 and above and a specificity of 0.50 and above, which 'rules out' the diagnosis with high accuracy if there is a negative test result (SnOUT test), or a sensitivity of 0.50 and above and a specificity of 0.95 and above, which 'rules in' the diagnosis with high accuracy if there is a positive result (SpIN test).

MAIN RESULTS

Eleven eligible studies included 1339 participants. All the studies were of poor methodological quality. Seven studies evaluated pelvic endometriosis, one study considered DIE and/or ovarian endometrioma, two studies differentiated endometrioma from other ovarian cysts and one study addressed mapping DIE at specific anatomical sites. Fifteen different diagnostic combinations were assessed, including blood, urinary or endometrial biomarkers, transvaginal ultrasound (TVUS) and clinical history or examination. We did not pool estimates of sensitivity and specificity, as each study analysed independent combinations of the non-invasive tests.Tests that met the criteria for a replacement test were: a combination of serum IL-6 (cut-off >15.4 pg/ml) and endometrial PGP 9.5 for pelvic endometriosis (sensitivity 1.00 (95% confidence interval (CI) 0.91 to 1.00), specificity 0.93 (95% CI, 0.80, 0.98) and the combination of vaginal examination and transvaginal ultrasound (TVUS) for rectal endometriosis (sensitivity 0.96 (95% CI 0.86 to 0.99), specificity 0.98 (95% CI 0.94 to 1.00)). Tests that met the criteria for SpIN triage tests for pelvic endometriosis were: 1. a multiplication of urine vitamin-D-binding protein (VDBP) and serum CA-125 (cut-off >2755) (sensitivity 0.74 (95% CI 0.60 to 0.84), specificity 0.97 (95% CI 0.86 to 1.00)) and 2. a combination of history (length of menses), serum CA-125 (cut-off >35 U/ml) and endometrial leukocytes (sensitivity 0.61 (95% CI 0.54 to 0.69), specificity 0.95 (95% CI 0.91 to 0.98)). For endometrioma, the following combinations qualified as SpIN test: 1. TVUS and either serum CA-125 (cut-off ≥25 U/ml) or CA 19.9 (cut-off ≥12 U/ml) (sensitivity 0.79 (95% CI 0.64 to 0.91), specificity 0.97 (95% CI 0.91 to 1.00)); 2. TVUS and serum CA 19.9 (cut-off ≥12 U/ml) (sensitivity 0.54 (95% CI 0.37 to 0.70), specificity 0.97 (95% CI 0.91 to 1.0)); 3-4. TVUS and serum CA-125 (cut-off ≥20 U/ml or cut-off ≥25 U/ml) (sensitivity 0.69 (95% CI 0.49 to 0.85), specificity 0.96 (95% CI 0.88 to 0.99)); 5. TVUS and serum CA-125 (cut-off ≥35 U/ml) (sensitivity 0.52 (95% CI 0.33 to 0.71), specificity 0.97 (95% CI 0.90 to 1.00)). A combination of vaginal examination and TVUS reached the threshold for a SpIN test for obliterated pouch of Douglas (sensitivity 0.87 (95% CI 0.69 to 0.96), specificity 0.98 (95% CI 0.95 to 1.00)), vaginal wall endometriosis (sensitivity 0.82 (95% CI 0.60 to 0.95), specificity 0.99 (95% CI 0.97 to 1.0)) and rectovaginal septum endometriosis (sensitivity 0.88 (95% CI 0.47 to 1.00), specificity 0.99 (95% CI 0.96 to 1.00)).All the tests were evaluated in individual studies and displayed wide CIs. Due to the heterogeneity and high risk of bias of the included studies, the clinical utility of the studied combination diagnostic tests for endometriosis remains unclear.

AUTHORS' CONCLUSIONS

None of the biomarkers evaluated in this review could be evaluated in a meaningful way and there was insufficient or poor-quality evidence. Laparoscopy remains the gold standard for the diagnosis of endometriosis and using any non-invasive tests should only be undertaken in a research setting.

Blood biomarkers for the non-invasive diagnosis of endometriosis

BACKGROUND

About 10% of reproductive-aged women suffer from endometriosis, a costly chronic disease causing pelvic pain and subfertility. Laparoscopy is the gold standard diagnostic test for endometriosis, but is expensive and carries surgical risks. Currently, there are no non-invasive or minimally invasive tests available in clinical practice to accurately diagnose endometriosis. Although other reviews have assessed the ability of blood tests to diagnose endometriosis, this is the first review to use Cochrane methods, providing an update on the rapidly expanding literature in this field.

OBJECTIVES

To evaluate blood biomarkers as replacement tests for diagnostic surgery and as triage tests to inform decisions on surgery for endometriosis. Specific objectives include:1. To provide summary estimates of the diagnostic accuracy of blood biomarkers for the diagnosis of peritoneal, ovarian and deep infiltrating pelvic endometriosis, compared to surgical diagnosis as a reference standard.2. To assess the diagnostic utility of biomarkers that could differentiate ovarian endometrioma from other ovarian masses.

SEARCH METHODS

We did not restrict the searches to particular study designs, language or publication dates. We searched CENTRAL to July 2015, MEDLINE and EMBASE to May 2015, as well as these databases to 20 April 2015: CINAHL, PsycINFO, Web of Science, LILACS, OAIster, TRIP, ClinicalTrials.gov, DARE and PubMed.

SELECTION CRITERIA

We considered published, peer-reviewed, randomised controlled or cross-sectional studies of any size, including prospectively collected samples from any population of reproductive-aged women suspected of having one or more of the following target conditions: ovarian, peritoneal or deep infiltrating endometriosis (DIE). We included studies comparing the diagnostic test accuracy of one or more blood biomarkers with the findings of surgical visualisation of endometriotic lesions.

DATA COLLECTION AND ANALYSIS

Two authors independently collected and performed a quality assessment of data from each study. For each diagnostic test, we classified the data as positive or negative for the surgical detection of endometriosis, and we calculated sensitivity and specificity estimates. We used the bivariate model to obtain pooled estimates of sensitivity and specificity whenever sufficient datasets were available. The predetermined criteria for a clinically useful blood test to replace diagnostic surgery were a sensitivity of 0.94 and a specificity of 0.79 to detect endometriosis. We set the criteria for triage tests at a sensitivity of ≥ 0.95 and a specificity of ≥ 0.50, which 'rules out' the diagnosis with high accuracy if there is a negative test result (SnOUT test), or a sensitivity of ≥ 0.50 and a specificity of ≥ 0.95, which 'rules in' the diagnosis with high accuracy if there is a positive result (SpIN test).

MAIN RESULTS

We included 141 studies that involved 15,141 participants and evaluated 122 blood biomarkers. All the studies were of poor methodological quality. Studies evaluated the blood biomarkers either in a specific phase of the menstrual cycle or irrespective of the cycle phase, and they tested for them in serum, plasma or whole blood. Included women were a selected population with a high frequency of endometriosis (10% to 85%), in which surgery was indicated for endometriosis, infertility work-up or ovarian mass. Seventy studies evaluated the diagnostic performance of 47 blood biomarkers for endometriosis (44 single-marker tests and 30 combined tests of two to six blood biomarkers). These were angiogenesis/growth factors, apoptosis markers, cell adhesion molecules, high-throughput markers, hormonal markers, immune system/inflammatory markers, oxidative stress markers, microRNAs, tumour markers and other proteins. Most of these biomarkers were assessed in small individual studies, often using different cut-off thresholds, and we could only perform meta-analyses on the data sets for anti-endometrial antibodies, interleukin-6 (IL-6), cancer antigen-19.9 (CA-19.9) and CA-125. Diagnostic estimates varied significantly between studies for each of these biomarkers, and CA-125 was the only marker with sufficient data to reliably assess sources of heterogeneity.The mean sensitivities and specificities of anti-endometrial antibodies (4 studies, 759 women) were 0.81 (95% confidence interval (CI) 0.76 to 0.87) and 0.75 (95% CI 0.46 to 1.00). For IL-6, with a cut-off value of > 1.90 to 2.00 pg/ml (3 studies, 309 women), sensitivity was 0.63 (95% CI 0.52 to 0.75) and specificity was 0.69 (95% CI 0.57 to 0.82). For CA-19.9, with a cut-off value of > 37.0 IU/ml (3 studies, 330 women), sensitivity was 0.36 (95% CI 0.26 to 0.45) and specificity was 0.87 (95% CI 0.75 to 0.99).Studies assessed CA-125 at different thresholds, demonstrating the following mean sensitivities and specificities: for cut-off > 10.0 to 14.7 U/ml: 0.70 (95% CI 0.63 to 0.77) and 0.64 (95% CI 0.47 to 0.82); for cut-off > 16.0 to 17.6 U/ml: 0.56 (95% CI 0.24, 0.88) and 0.91 (95% CI 0.75, 1.00); for cut-off > 20.0 U/ml: 0.67 (95% CI 0.50 to 0.85) and 0.69 (95% CI 0.58 to 0.80); for cut-off > 25.0 to 26.0 U/ml: 0.73 (95% CI 0.67 to 0.79) and 0.70 (95% CI 0.63 to 0.77); for cut-off > 30.0 to 33.0 U/ml: 0.62 (95% CI 0.45 to 0.79) and 0.76 (95% CI 0.53 to 1.00); and for cut-off > 35.0 to 36.0 U/ml: 0.40 (95% CI 0.32 to 0.49) and 0.91 (95% CI 0.88 to 0.94).We could not statistically evaluate other biomarkers meaningfully, including biomarkers that were assessed for their ability to differentiate endometrioma from other benign ovarian cysts.Eighty-two studies evaluated 97 biomarkers that did not differentiate women with endometriosis from disease-free controls. Of these, 22 biomarkers demonstrated conflicting results, with some studies showing differential expression and others no evidence of a difference between the endometriosis and control groups.

AUTHORS' CONCLUSIONS

Of the biomarkers that were subjected to meta-analysis, none consistently met the criteria for a replacement or triage diagnostic test. A subset of blood biomarkers could prove useful either for detecting pelvic endometriosis or for differentiating ovarian endometrioma from other benign ovarian masses, but there was insufficient evidence to draw meaningful conclusions. Overall, none of the biomarkers displayed enough accuracy to be used clinically outside a research setting. We also identified blood biomarkers that demonstrated no diagnostic value in endometriosis and recommend focusing research resources on evaluating other more clinically useful biomarkers.

Endometrial biomarkers for the non-invasive diagnosis of endometriosis

BACKGROUND

About 10% of reproductive-aged women suffer from endometriosis, which is a costly, chronic disease that causes pelvic pain and subfertility. Laparoscopy is the gold standard diagnostic test for endometriosis, but it is expensive and carries surgical risks. Currently, there are no non-invasive tests available in clinical practice that accurately diagnose endometriosis. This is the first diagnostic test accuracy review of endometrial biomarkers for endometriosis that utilises Cochrane methodologies, providing an update on the rapidly expanding literature in this field.

OBJECTIVES

To determine the diagnostic accuracy of the endometrial biomarkers for pelvic endometriosis, using a surgical diagnosis as the reference standard. We evaluated the tests as replacement tests for diagnostic surgery and as triage tests to inform decisions to undertake surgery for endometriosis.

SEARCH METHODS

We did not restrict the searches to particular study designs, language or publication dates. To identify trials, we searched the following databases: CENTRAL (2015, July), MEDLINE (inception to May 2015), EMBASE (inception to May 2015), CINAHL (inception to April 2015), PsycINFO (inception to April 2015), Web of Science (inception to April 2015), LILACS (inception to April 2015), OAIster (inception to April 2015), TRIP (inception to April 2015) and ClinicalTrials.gov (inception to April 2015). We searched DARE and PubMed databases up to April 2015 to identify reviews and guidelines as sources of references to potentially relevant studies. We also performed searches for papers recently published and not yet indexed in the major databases. The search strategies incorporated words in the title, abstract, text words across the record and the medical subject headings (MeSH).

SELECTION CRITERIA

We considered published peer-reviewed, randomised controlled or cross-sectional studies of any size that included prospectively collected samples from any population of reproductive-aged women suspected of having one or more of the following target conditions: ovarian, peritoneal or deep infiltrating endometriosis (DIE).

DATA COLLECTION AND ANALYSIS

Two authors independently extracted data from each study and performed a quality assessment. For each endometrial diagnostic test, we classified the data as positive or negative for the surgical detection of endometriosis and calculated the estimates of sensitivity and specificity. We considered two or more tests evaluated in the same cohort as separate data sets. We used the bivariate model to obtain pooled estimates of sensitivity and specificity whenever sufficient data were available. The predetermined criteria for a clinically useful test to replace diagnostic surgery was one with a sensitivity of 94% and a specificity of 79%. The criteria for triage tests were set at sensitivity at or above 95% and specificity at or above 50%, which in case of negative results rules out the diagnosis (SnOUT test) or sensitivity at or above 50% with specificity at or above 95%, which in case of positive result rules in the diagnosis (SpIN test).

MAIN RESULTS

We included 54 studies involving 2729 participants, most of which were of poor methodological quality. The studies evaluated endometrial biomarkers either in specific phases of the menstrual cycle or outside of it, and the studies tested the biomarkers either in menstrual fluid, in whole endometrial tissue or in separate endometrial components. Twenty-seven studies evaluated the diagnostic performance of 22 endometrial biomarkers for endometriosis. These were angiogenesis and growth factors (PROK-1), cell-adhesion molecules (integrins α3β1, α4β1, β1 and α6), DNA-repair molecules (hTERT), endometrial and mitochondrial proteome, hormonal markers (CYP19, 17βHSD2, ER-α, ER-β), inflammatory markers (IL-1R2), myogenic markers (caldesmon, CALD-1), neural markers (PGP 9.5, VIP, CGRP, SP, NPY, NF) and tumour markers (CA-125). Most of these biomarkers were assessed in single studies, whilst only data for PGP 9.5 and CYP19 were available for meta-analysis. These two biomarkers demonstrated significant diversity for the diagnostic estimates between the studies; however, the data were too limited to reliably determine the sources of heterogeneity. The mean sensitivities and specificities of PGP 9.5 (7 studies, 361 women) were 0.96 (95% confidence interval (CI) 0.91 to 1.00) and 0.86 (95% CI 0.70 to 1.00), after excluding one outlier study, and for CYP19 (8 studies, 444 women), they were were 0.77 (95% CI 0.70 to 0.85) and 0.74 (95% CI 0.65 to 84), respectively. We could not statistically evaluate other biomarkers in a meaningful way. An additional 31 studies evaluated 77 biomarkers that showed no evidence of differences in expression levels between the groups of women with and without endometriosis.

AUTHORS' CONCLUSIONS

We could not statistically evaluate most of the biomarkers assessed in this review in a meaningful way. In view of the low quality of most of the included studies, the findings of this review should be interpreted with caution. Although PGP 9.5 met the criteria for a replacement test, it demonstrated considerable inter study heterogeneity in diagnostic estimates, the source of which could not be determined. Several endometrial biomarkers, such as endometrial proteome, 17βHSD2, IL-1R2, caldesmon and other neural markers (VIP, CGRP, SP, NPY and combination of VIP, PGP 9.5 and SP) showed promising evidence of diagnostic accuracy, but there was insufficient or poor quality evidence for any clinical recommendations. Laparoscopy remains the gold standard for the diagnosis of endometriosis, and using any non-invasive tests should only be undertaken in a research setting. We have also identified a number of biomarkers that demonstrated no diagnostic value for endometriosis. We recommend that researchers direct future studies towards biomarkers with high diagnostic potential in good quality diagnostic studies.

Predicting neurologic outcome after targeted temperature management for cardiac arrest: systematic review and meta-analysis

OBJECTIVES

Targeted temperature management improves survival and neurologic outcomes for adult out-of-hospital cardiac arrest survivors but may alter the accuracy of tests for predicting neurologic outcome after cardiac arrest.

DATA SOURCES

We systematically searched Medline, Embase, CINAHL, and CENTRAL from database inception to September 2012.

STUDY SELECTION

Citations were screened for studies that examined diagnostic tests to predict poor neurologic outcome or death following targeted temperature management in adult cardiac arrest survivors.

DATA EXTRACTION

Data on study outcomes and quality were abstracted in duplicate. We constructed contingency tables for each diagnostic test and calculated sensitivity, specificity, and positive and negative likelihood ratios.

DATA SYNTHESIS

Of 2,737 citations, 20 studies (n = 1,845) met inclusion criteria. Meta-analysis showed that three tests accurately predicted poor neurologic outcome with low false-positive rates: bilateral absence of pupillary reflexes more than 24 hours after a return of spontaneous circulation (false-positive rate, 0.02; 95% CI, 0.01-0.06; summary positive likelihood ratio, 10.45; 95% CI, 3.37-32.43), bilateral absence of corneal reflexes more than 24 hours (false-positive rate, 0.04; 95% CI, 0.01-0.09; positive likelihood ratio, 6.8; 95% CI, 2.52-18.38), and bilateral absence of somatosensory-evoked potentials between days 1 and 7 (false-positive rate, 0.03; 95% CI, 0.01-0.07; positive likelihood ratio, 12.79; 95% CI, 5.35-30.62). False-positive rates were higher for a Glasgow Coma Scale motor score showing extensor posturing or worse (false-positive rate, 0.09; 95% CI, 0.06-0.13; positive likelihood ratio, 7.11; 95% CI, 5.01-10.08), unfavorable electroencephalogram patterns (false-positive rate, 0.07; 95% CI, 0.04-0.12; positive likelihood ratio, 8.85; 95% CI, 4.87-16.08), myoclonic status epilepticus (false-positive rate, 0.05; 95% CI, 0.02-0.11; positive likelihood ratio, 5.58; 95% CI, 2.56-12.16), and elevated neuron-specific enolase (false-positive rate, 0.12; 95% CI, 0.06-0.23; positive likelihood ratio, 4.14; 95% CI, 1.82-9.42). The specificity of available tests improved when these were performed beyond 72 hours. Data on neuroimaging, biomarkers, or combination testing were limited and inconclusive.

CONCLUSION

Simple bedside tests and somatosensory-evoked potentials predict poor neurologic outcome for survivors of cardiac arrest treated with targeted temperature management, and specificity improves when performed beyond 72 hours. Clinicians should use caution with these predictors as they carry the inherent risk of becoming self-fulfilling.

Metabolomics of biomarker discovery in ovarian cancer: a systematic review of the current literature

INTRODUCTION

Metabolomics is the emerging member of "omics" sciences advancing the understanding, diagnosis and treatment of many cancers, including ovarian cancer (OC).

OBJECTIVES

To systematically identify the metabolomic abnormalities in OC detection, and the dominant metabolic pathways associated with the observed alterations.

METHODS

An electronic literature search was performed, up to and including January 15th 2016, for studies evaluating the metabolomic profile of patients with OC compared to controls. QUADOMICS tool was used to assess the quality of the twenty-three studies included in this systematic review.

RESULTS

Biological samples utilized for metabolomic analysis include: serum/plasma (n = 13), urine (n = 4), cyst fluid (n = 3), tissue (n = 2) and ascitic fluid (n = 1). Metabolites related to cellular respiration, carbohydrate, lipid, protein and nucleotide metabolism were significantly altered in OC. Increased levels of tricarboxylic acid cycle intermediates and altered metabolites of the glycolytic pathway pointed to perturbations in cellular respiration. Alterations in lipid metabolism included enhanced fatty acid oxidation, abnormal levels of glycerolipids, sphingolipids and free fatty acids with common elevations of palmitate, oleate, and myristate. Increased levels of glutamine, glycine, cysteine and threonine were commonly reported while enhanced degradations of tryptophan, histidine and phenylalanine were found. N-acetylaspartate, a brain amino acid, was found elevated in primary and metastatic OC tissue and ovarian cyst fluid. Further, elevated levels of ketone bodies including 3-hydroxybutyrate were commonly reported. Increased levels of nucleotide metabolites and tocopherols were consistent through out the studies.

CONCLUSION

Metabolomics presents significant new opportunities for diagnostic biomarker development, elucidating previously unknown mechanisms of OC pathogenesis.

Typical rise and fall of troponin in (peri-procedural) myocardial infarction: A systematic review

AIM: To identify the typical shape of the rise and fall curve of troponin (Tn) following the different types of myocardial infarction (MI).

METHODS: We conducted a systematic search in PubMed and Embase including all studies which focused on the kinetics of Tn in MI type 1, type 4 and type 5. Tn levels were standardized using the 99^th percentile, a pooled mean with 95%CI was calculated from the weighted means for each time point until 72 h.

RESULTS: A total of 34 of the 2528 studies identified in the systematic search were included. The maximum peak level of the Tn was seen after 6 h after successful reperfusion of an acute MI, after 12 h for type 1 MI and after 72 h for type 5 MI. In type 1 MI there were additional smaller peaks at 1 h and at 24 h. After successful reperfusion of an acute MI there was a second peak at 24 h. There was not enough data available to analyze the Tn release after MI associated with percutaneous coronary intervention (type 4).

CONCLUSION: The typical rise and fall of Tn is different for type 1 MI, successful reperfusion of an acute MI and type 5 MI, with different timing of the peak levels and different slopes of the fall phase.

Longitudinal Photogrammetric Analysis of Soft Tissue Facial Changes: A Systematic Review of the Literature and a Summary of Recommendations

Human faces are under a constant state of change throughout the entirety of one's lifetime. Photogrammetry has been advocated for use in large epidemiological studies investigating facial characteristics. This study aimed to review existing longitudinal photogrammetric studies in terms of the measurements selected and the observed facial changes overtime. A comprehensive literature search was performed in 4 databases, PubMed, ISI Web of Science, EMBASE, and Scopus, which was supplemented by hand search. No limitations were set as to the language, dates, or status of publication. The records were assessed for the eligibility and rated for the risk of bias by 2 independent reviewers. Data regarding study characteristics, measurements selected and the outcomes reported, were extracted for analysis. An initial search identified 5127 studies. After 2 rounds of study screening, 6 eligible studies informed this review. The risk of bias of the studies ranged from 41.7% to 80.8%. Only 1 study performed sample size calculation, and only 17% of the studies had a sample size of over 30 subjects. Confidence interval was reported by none of the studies. The facial features assessed varied among the studies, and some studies focused on only specific regions of the face. Photogrammetry has been used by a limited number of studies in the analysis of longitudinal soft tissue facial changes. Moreover, these studies are heterogeneous with respect to their levels of risk of bias and the facial features assessed. Recommendations are provided to improve the qualities of future photogrammetric studies.

Ultrasonography for diagnosis of alcoholic cirrhosis in people with alcoholic liver disease

BACKGROUND

Heavy alcohol consumption causes alcoholic liver disease and is a causal factor of many types of liver injuries and concomitant diseases. It is a true systemic disease that may damage the digestive tract, the nervous system, the heart and vascular system, the bone and skeletal muscle system, and the endocrine and immune system, and can lead to cancer. Liver damage in turn, can present as multiple alcoholic liver diseases, including fatty liver, steatohepatitis, fibrosis, alcoholic cirrhosis, and hepatocellular carcinoma, with presence or absence of hepatitis B or C virus infection. There are three scarring types (fibrosis) that are most commonly found in alcoholic liver disease: centrilobular scarring, pericellular fibrosis, and periportal fibrosis. When liver fibrosis progresses, alcoholic cirrhosis occurs. Hepatocellular carcinoma occurs in 5% to 15% of people with alcoholic cirrhosis, but people in whom hepatocellular carcinoma has developed are often co-infected with hepatitis B or C virus.Abstinence from alcohol may help people with alcoholic disease in improving their prognosis of survival at any stage of their disease; however, the more advanced the stage, the higher the risk of complications, co-morbidities, and mortality, and lesser the effect of abstinence. Being abstinent one month after diagnosis of early cirrhosis will improve the chance of a seven-year life expectancy by 1.6 times. Liver transplantation is the only radical method that may change the prognosis of a person with alcoholic liver disease; however, besides the difficulties of finding a suitable liver transplant organ, there are many other factors that may influence a person's survival.Ultrasound is an inexpensive method that has been used for years in clinical practice to diagnose alcoholic cirrhosis. Ultrasound parameters for assessing cirrhosis in people with alcoholic liver disease encompass among others liver size, bluntness of the liver edge, coarseness of the liver parenchyma, nodularity of the liver surface, size of the lymph nodes around the hepatic artery, irregularity and narrowness of the inferior vena cava, portal vein velocity, and spleen size.Diagnosis of cirrhosis by ultrasound, especially in people who are asymptomatic, may have its advantages for the prognosis, motivation, and treatment of these people to decrease their alcohol consumption or become abstinent.Timely diagnosis of alcoholic cirrhosis in people with alcoholic liver disease is the cornerstone for evaluation of prognosis or choosing treatment strategies.

OBJECTIVES

To determine the diagnostic accuracy of ultrasonography for detecting the presence or absence of cirrhosis in people with alcoholic liver disease compared with liver biopsy as reference standard.To determine the diagnostic accuracy of any of the ultrasonography tests, B-mode or echo-colour Doppler ultrasonography, used singly or combined, or plus ultrasonography signs, or a combination of these, for detecting hepatic cirrhosis in people with alcoholic liver disease compared with liver biopsy as a reference standard, irrespective of sequence.

SEARCH METHODS

We performed searches in The Cochrane Hepato-Biliary Group Controlled Trials Register, The Cochrane Hepato-Biliary Group Diagnostic Test Accuracy Studies Register, The Cochrane Library (Wiley), MEDLINE (OvidSP), EMBASE (OvidSP), and the Science Citation Index Expanded to 8 January 2015. We applied no language limitations.We screened study references of the retrieved studies to identify other potentially relevant studies for inclusion in the review and read abstract and poster publications.

SELECTION CRITERIA

Three review authors independently identified studies for possible inclusion in the review. We excluded references not fulfilling the inclusion criteria of the review protocol. We sent e-mails to study authors.The included studies had to evaluate ultrasound in the diagnosis of hepatic cirrhosis using only liver biopsy as the reference standard.The maximum time interval of investigation with liver biopsy and ultrasonography should not have exceeded six months. In addition, ultrasonography could have been performed before or after liver biopsy.

DATA COLLECTION AND ANALYSIS

We followed the Cochrane Handbook for Systematic Reviews of Diagnostic Test Accuracy.

MAIN RESULTS

The review included two studies that provided numerical data regarding alcoholic cirrhosis in 205 men and women with alcoholic liver disease. Although there were no applicability concerns in terms of participant selection, index text, and reference standard, we judged the two studies at high risk of bias. Participants in both studies had undergone both liver biopsy and ultrasonography investigations. The studies shared only a few comparable clinical signs and symptoms (index tests).We decided to not perform a meta-analysis due to the high risk of bias and the high degree of heterogeneity of the included studies.

AUTHORS' CONCLUSIONS

As the accuracy of ultrasonography in the two included studies was not informative enough, we could not recommend the use of ultrasonography as a diagnostic tool for liver cirrhosis in people with alcoholic liver disease. In order to be able to answer the review questions, we need diagnostic ultrasonography prospective studies of adequate sample size, enrolling only participants with alcoholic liver disease.The design and report of the studies should follow the Standards for Reporting of Diagnostic Accuracy. The sonographic features, with validated cut-offs, which may help identify clinical signs used for diagnosis of fibrosis in alcoholic liver disease, should be carefully selected to achieve maximum diagnostic accuracy on ultrasonography.

Monothermal Caloric Screening Test Accuracy

Objective

To minimize discomfort, time, and costs, vestibular laboratories may perform monothermal caloric irrigations and discontinue testing if responses are symmetric. This systematic review aimed to determine the diagnostic accuracy of the monothermal caloric screening test (MCST) for unilateral vestibular dysfunction compared with bithermal caloric testing (BCT).

Data Sources

Ovid-MEDLINE, EMBASE, Scopus, Cochrane CENTRAL, and manual bibliographic searches.

Review Methods

Inclusion criteria specified concurrent MCST and BCT performance and reporting of test measures (monothermal caloric asymmetry, unilateral weakness). The primary outcomes were between-measure correlation, sensitivity, and specificity. Meta-analysis was performed with hierarchical bivariate and univariate random-effects models. Heterogeneity was assessed with the I2 statistic.

Results

Fifteen studies (n = 5572 participants) met inclusion criteria. Thresholds varied between studies. Asymmetries calculated by MCST and BCT were strongly correlated, but a subgroup analysis showed no correlation for those with mild unilateral weakness. The sensitivity and specificity of the MCST ranged from 0.54 to 1.00 and 0.25 to 0.96, respectively. Predictably, higher sensitivity resulted from lower cutoff points for the MCST, higher thresholds for the BCT, and additional test positivity criteria. Warm irrigations yielded higher sensitivity than cool. Studies excluding participants with severe unilateral weakness yielded lower sensitivity estimates. After pooling by threshold, temperature, and risk of bias, most performance estimates remained substantially heterogeneous ( I2 > 60%).

Conclusion

Accuracy of the MCST is lacking precisely where it is needed most—at the border of normal and abnormal vestibular function. To guide clinical practice, research should include analysis of subgroups with varying levels of function and employ standardized testing parameters.

Imaging modalities for the non-invasive diagnosis of endometriosis

BACKGROUND

About 10% of women of reproductive age suffer from endometriosis. Endometriosis is a costly chronic disease that causes pelvic pain and subfertility. Laparoscopy, the gold standard diagnostic test for endometriosis, is expensive and carries surgical risks. Currently, no non-invasive tests that can be used to accurately diagnose endometriosis are available in clinical practice. This is the first review of diagnostic test accuracy of imaging tests for endometriosis that uses Cochrane methods to provide an update on the rapidly expanding literature in this field.

OBJECTIVES

• To provide estimates of the diagnostic accuracy of imaging modalities for the diagnosis of pelvic endometriosis, ovarian endometriosis and deeply infiltrating endometriosis (DIE) versus surgical diagnosis as a reference standard.• To describe performance of imaging tests for mapping of deep endometriotic lesions in the pelvis at specific anatomical sites.Imaging tests were evaluated as replacement tests for diagnostic surgery and as triage tests that would assist decision making regarding diagnostic surgery for endometriosis.

SEARCH METHODS

We searched the following databases to 20 April 2015: MEDLINE, CENTRAL, EMBASE, CINAHL, PsycINFO, Web of Science, LILACS, OAIster, TRIP, ClinicalTrials.gov, MEDION, DARE, and PubMed. Searches were not restricted to a particular study design or language nor to specific publication dates. The search strategy incorporated words in the title, abstracts, text words across the record and medical subject headings (MeSH).

SELECTION CRITERIA

We considered published peer-reviewed cross-sectional studies and randomised controlled trials of any size that included prospectively recruited women of reproductive age suspected of having one or more of the following target conditions: endometrioma, pelvic endometriosis, DIE or endometriotic lesions at specific intrapelvic anatomical locations. We included studies that compared the diagnostic test accuracy of one or more imaging modalities versus findings of surgical visualisation of endometriotic lesions.

DATA COLLECTION AND ANALYSIS

Two review authors independently collected and performed a quality assessment of data from each study. For each imaging test, data were classified as positive or negative for surgical detection of endometriosis, and sensitivity and specificity estimates were calculated. If two or more tests were evaluated in the same cohort, each was considered as a separate data set. We used the bivariate model to obtain pooled estimates of sensitivity and specificity when sufficient data sets were available. Predetermined criteria for a clinically useful imaging test to replace diagnostic surgery included sensitivity ≥ 94% and specificity ≥ 79%. Criteria for triage tests were set at sensitivity ≥ 95% and specificity ≥ 50%, ruling out the diagnosis with a negative result (SnNout test - if sensitivity is high, a negative test rules out pathology) or at sensitivity ≥ 50% with specificity ≥ 95%, ruling in the diagnosis with a positive result (SpPin test - if specificity is high, a positive test rules in pathology).

MAIN RESULTS

We included 49 studies involving 4807 women: 13 studies evaluated pelvic endometriosis, 10 endometriomas and 15 DIE, and 33 studies addressed endometriosis at specific anatomical sites. Most studies were of poor methodological quality. The most studied modalities were transvaginal ultrasound (TVUS) and magnetic resonance imaging (MRI), with outcome measures commonly demonstrating diversity in diagnostic estimates; however, sources of heterogeneity could not be reliably determined. No imaging test met the criteria for a replacement or triage test for detecting pelvic endometriosis, albeit TVUS approached the criteria for a SpPin triage test. For endometrioma, TVUS (eight studies, 765 participants; sensitivity 0.93 (95% confidence interval (CI) 0.87, 0.99), specificity 0.96 (95% CI 0.92, 0.99)) qualified as a SpPin triage test and approached the criteria for a replacement and SnNout triage test, whereas MRI (three studies, 179 participants; sensitivity 0.95 (95% CI 0.90, 1.00), specificity 0.91 (95% CI 0.86, 0.97)) met the criteria for a replacement and SnNout triage test and approached the criteria for a SpPin test. For DIE, TVUS (nine studies, 12 data sets, 934 participants; sensitivity 0.79 (95% CI 0.69, 0.89) and specificity 0.94 (95% CI 0.88, 1.00)) approached the criteria for a SpPin triage test, and MRI (six studies, seven data sets, 266 participants; sensitivity 0.94 (95% CI 0.90, 0.97), specificity 0.77 (95% CI 0.44, 1.00)) approached the criteria for a replacement and SnNout triage test. Other imaging tests assessed in small individual studies could not be statistically evaluated.TVUS met the criteria for a SpPin triage test in mapping DIE to uterosacral ligaments, rectovaginal septum, vaginal wall, pouch of Douglas (POD) and rectosigmoid. MRI met the criteria for a SpPin triage test for POD and vaginal and rectosigmoid endometriosis. Transrectal ultrasonography (TRUS) might qualify as a SpPin triage test for rectosigmoid involvement but could not be adequately assessed for other anatomical sites because heterogeneous data were scant. Multi-detector computerised tomography enema (MDCT-e) displayed the highest diagnostic performance for rectosigmoid and other bowel endometriosis and met the criteria for both SpPin and SnNout triage tests, but studies were too few to provide meaningful results.Diagnostic accuracies were higher for TVUS with bowel preparation (TVUS-BP) and rectal water contrast (RWC-TVS) and for 3.0TMRI than for conventional methods, although the paucity of studies precluded statistical evaluation.

AUTHORS' CONCLUSIONS

None of the evaluated imaging modalities were able to detect overall pelvic endometriosis with enough accuracy that they would be suggested to replace surgery. Specifically for endometrioma, TVUS qualified as a SpPin triage test. MRI displayed sufficient accuracy to suggest utility as a replacement test, but the data were too scant to permit meaningful conclusions. TVUS could be used clinically to identify additional anatomical sites of DIE compared with MRI, thus facilitating preoperative planning. Rectosigmoid endometriosis was the only site that could be accurately mapped by using TVUS, TRUS, MRI or MDCT-e. Studies evaluating recent advances in imaging modalities such as TVUS-BP, RWC-TVS, 3.0TMRI and MDCT-e were observed to have high diagnostic accuracies but were too few to allow prudent evaluation of their diagnostic role. In view of the low quality of most of the included studies, the findings of this review should be interpreted with caution. Future well-designed diagnostic studies undertaken to compare imaging tests for diagnostic test accuracy and costs are recommended.

Meta-analysis of drain amylase content on postoperative day 1 as a predictor of pancreatic fistula following pancreatic resection

Background

Drain amylase content in the days immediately after major pancreatic resection has been investigated previously as a predictor of postoperative pancreatic fistula (POPF). Its accuracy, however, has not been determined conclusively. The purpose of this study was to evaluate the accuracy of drain amylase content on the first day after major pancreatic resection in predicting the occurrence of POPF.

Methods

A literature search of the MEDLINE, Embase and Scopus® databases to 13 May 2015 was performed to identify studies evaluating the accuracy of drain amylase values on day 1 after surgery in predicting the occurrence of POPF. The area under the hierarchical summary receiver operating characteristic (ROC) curve (AUChSROC) was calculated as an index of accuracy, and pooled estimates of accuracy indices (sensitivity and specificity) were calculated at different cut-off levels. Subgroup and meta-regression analyses were performed to test the robustness of the results.

Results

Thirteen studies involving 4416 patients were included. The AUChSROC was 0·89 (95 per cent c.i. 0·86 to 0·92) for clinically significant POPF and 0·88 (0·85 to 0·90) for POPF of any grade. Pooled estimates of sensitivity and specificity were calculated for the different cut-offs: 90–100 units/l (0·96 and 0·54 respectively), 350 units/l (0·91 and 0·84) and 5000 units/l (0·59 and 0·91). Accuracy was independent of the type of operation, type of anastomosis performed and octreotide administration.

Conclusion

Evaluation of drain amylase content on the first day after surgery is highly accurate in predicting POPF following major pancreatic resection. It may allow early drain removal and institution of an enhanced recovery pathway.

Cervical phosphorylated insulin-like growth factor binding protein-1 test for the prediction of preterm birth: a systematic review and metaanalysis

OBJECTIVE

To assess the accuracy of the cervical phosphorylated insulin-like growth factor binding protein-1 (phIGFBP-1) test to predict preterm birth in women with and without symptoms of preterm labor through the use of formal methods for systematic reviews and metaanalytic techniques.

DATA SOURCES

PubMed, Embase, Cinahl, Lilacs, and Medion (all from inception to June 30, 2015), reference lists, conference proceedings, and Google scholar.

STUDY ELIGIBILITY CRITERIA

Cohort or cross-sectional studies that reported on the predictive accuracy of the cervical phIGFBP-1 test for preterm birth.

STUDY APPRAISAL AND SYNTHESIS METHODS

Two reviewers independently selected studies, assessed the risk of bias, and extracted the data. Summary receiver-operating characteristic curves, pooled sensitivities and specificities, and summary likelihood ratios were generated.

RESULTS

Forty-three studies met the inclusion criteria, of which 15 provided data on asymptomatic women (n = 6583) and 34 on women with an episode of preterm labor (n = 3620). Among asymptomatic women, the predictive accuracy of the cervical phIGFBP-1 test for preterm birth at <37, <34, and <32 weeks of gestation was minimal, with pooled sensitivities and specificities and summary positive and negative likelihood ratios ranging from 14% to 47%, 76% to 93%, 1.5 to 4.4, and 0.6 to 1.0, respectively. Among women with an episode of preterm labor, the test had a low predictive performance for delivery within 7 and 14 days of testing, and preterm birth at <34 and <37 weeks of gestation with pooled sensitivities and specificities and summary positive and negative likelihood ratios that varied between 60% and 68%, 77% and 81%, 2.7 and 3.5, and 0.4 and 0.5, respectively. A negative test result in women with an episode of preterm labor had a low to moderate accuracy to identify women who are not at risk for delivering within the next 48 hours (summary negative likelihood ratio of 0.28 in all women and 0.23 in women with singleton gestations).

CONCLUSION

Cervical phIGFBP-1 has the potential utility to identify patients with an episode of preterm labor who will not deliver within 48 hours. However, its overall predictive ability for the identification of symptomatic and asymptomatic women at risk for preterm birth is limited.

Pitfalls of Systematic Reviews and Meta-Analyses in Imaging Research

Systematic reviews of imaging research represent a tool to better understand test accuracy or the efficacy of interventions. Like any type of research, appropriate methods must be applied to optimize quality. The purpose of this review is to outline common pitfalls in performing systematic reviews of imaging research, with a focus on challenges particular to performing reviews of diagnostic accuracy studies. The following challenges are highlighted: posing relevant review questions, conducting comprehensive literature searches, assessing for bias in included studies, testing for heterogeneity and publication bias, pooling results across studies, and forming appropriate conclusions. By guiding authors on how to overcome these, the hope is that published reviews in imaging research will be of higher quality and have a positive impact on clinical practice. In addition, the review aims to educate readers of reviews so they become aware of crucial elements of systematic reviews that could bias review results.

Galactomannan detection for invasive aspergillosis in immunocompromised patients

BACKGROUND

Invasive aspergillosis is the most common life-threatening opportunistic invasive mycosis in immunocompromised patients. A test for invasive aspergillosis should neither be too invasive nor too great a burden for the already weakened patient. The serum galactomannan enzyme-linked immunosorbent assay (ELISA) seems to have the potential to meet both requirements.

OBJECTIVES

To obtain summary estimates of the diagnostic accuracy of galactomannan detection in serum for the diagnosis of invasive aspergillosis.

SEARCH METHODS

We searched MEDLINE, EMBASE and Web of Science with both MeSH terms and text words for both aspergillosis and the sandwich ELISA. We checked the reference lists of included studies and review articles for additional studies. We conducted the searches in February 2014.

SELECTION CRITERIA

We included cross-sectional studies, case-control designs and consecutive series of patients assessing the diagnostic accuracy of galactomannan detection for the diagnosis of invasive aspergillosis in patients with neutropenia or patients whose neutrophils are functionally compromised. The reference standard was composed of the criteria given by the European Organization for Research and Treatment of Cancer (EORTC) and the Mycoses Study Group (MSG).

DATA COLLECTION AND ANALYSIS

Two review authors independently assessed quality and extracted data. We carried out meta-analysis using the bivariate method. We investigated sources of heterogeneity by adding potential sources of heterogeneity to the model as covariates.

MAIN RESULTS

We included 54 studies in the review (50 in the meta-analyses), containing 5660 patients, of whom 586 had proven or probable invasive aspergillosis. When using an optical density index (ODI) of 0.5 as a cut-off value, the sensitivity of the test was 82% (73% to 90%) and the specificity was 81% (72% to 90%). At a cut-off value of 1.0 ODI, the sensitivity was 72% (65% to 80%) and the specificity was 88% (84% to 92%). At a cut-off value of 1.5 ODI, the sensitivity was 61% (47% to 75%) and the specificity was 93% (89% to 97%). None of the potential sources of heterogeneity had a statistically significant effect on either sensitivity or specificity.

AUTHORS' CONCLUSIONS

If we used the test at a cut-off value of 0.5 ODI in a population of 100 patients with a disease prevalence of 9% (overall median prevalence), two patients who have invasive aspergillosis would be missed (sensitivity 82%, 18% false negatives), and 17 patients would be treated unnecessarily or referred unnecessarily for further testing (specificity 81%, 19% false negatives). If we used the test at a cut-off value of 1.5 in the same population, that would mean that four invasive aspergillosis patients would be missed (sensitivity 61%, 39% false negatives), and six patients would be treated or referred for further testing unnecessarily (specificity 93%, 7% false negatives). These numbers should, however, be interpreted with caution because the results were very heterogeneous.

Urinary biomarkers for the non-invasive diagnosis of endometriosis

BACKGROUND

About 10% of reproductive-aged women suffer from endometriosis which is a costly chronic disease that causes pelvic pain and subfertility. Laparoscopy is the 'gold standard' diagnostic test for endometriosis, but it is expensive and carries surgical risks. Currently, there are no simple non-invasive or minimally-invasive tests available in clinical practice that accurately diagnoses endometriosis.

OBJECTIVES

1. To provide summary estimates of the diagnostic accuracy of urinary biomarkers for the diagnosis of pelvic endometriosis compared to surgical diagnosis as a reference standard.2. To assess the diagnostic utility of biomarkers that could differentiate ovarian endometrioma from other ovarian masses.Urinary biomarkers were evaluated as replacement tests for surgical diagnosis and as triage tests to inform decisions to undertake surgery for endometriosis.

SEARCH METHODS

The searches were not restricted to particular study design, language or publication dates. We searched the following databases to 20 April - 31 July 2015: CENTRAL, MEDLINE, EMBASE, CINAHL, PsycINFO, Web of Science, LILACS, OAIster, TRIP and ClinicalTrials.gov (trial register). MEDION, DARE, and PubMed were also searched to identify reviews and guidelines as reference sources of potentially relevant studies. Recently published papers not yet indexed in the major databases were also sought. The search strategy incorporated words in the title, abstract, text words across the record and the medical subject headings (MeSH) and was modified for each database.

SELECTION CRITERIA

Published peer-reviewed, randomised controlled or cross-sectional studies of any size were considered, which included prospectively collected samples from any population of reproductive-aged women suspected of having one or more of the following target conditions: ovarian, peritoneal or deep infiltrating endometriosis (DIE). We included studies comparing the diagnostic test accuracy of one or more urinary biomarkers with surgical visualisation of endometriotic lesions.

DATA COLLECTION AND ANALYSIS

Two authors independently collected and performed a quality assessment of the data from each study. For each diagnostic test, the data were classified as positive or negative for the surgical detection of endometriosis and sensitivity and specificity estimates were calculated. If two or more tests were evaluated in the same cohort, each was considered as a separate data set. The bivariate model was used to obtain pooled estimates of sensitivity and specificity whenever sufficient data sets were available. The predetermined criteria for a clinically useful urine test to replace diagnostic surgery was one with a sensitivity of 94% and a specificity of 79% to detect endometriosis. The criteria for triage tests were set at sensitivity of equal or greater than 95% and specificity of equal or greater than 50%, which in case of negative result rules out the diagnosis (SnOUT test) or sensitivity of equal or greater than 50% with specificity of equal or greater than 95%, which in case of positive result rules the diagnosis in (SpIN test).

MAIN RESULTS

We included eight studies involving 646 participants, most of which were of poor methodological quality. The urinary biomarkers were evaluated either in a specific phase of menstrual cycle or irrespective of the cycle phase. Five studies evaluated the diagnostic performance of four urinary biomarkers for endometriosis, including three biomarkers distinguishing women with and without endometriosis (enolase 1 (NNE); vitamin D binding protein (VDBP); and urinary peptide profiling); and one biomarker (cytokeratin 19 (CK 19)) showing no significant difference between the two groups. All of these biomarkers were assessed in small individual studies and could not be statistically evaluated in a meaningful way. None of the biomarkers met the criteria for a replacement test or a triage test. Three studies evaluated three biomarkers that did not differentiate women with endometriosis from disease-free controls.

AUTHORS' CONCLUSIONS

There was insufficient evidence to recommend any urinary biomarker for use as a replacement or triage test in clinical practice for the diagnosis of endometriosis. Several urinary biomarkers may have diagnostic potential, but require further evaluation before being introduced into routine clinical practice. Laparoscopy remains the gold standard for the diagnosis of endometriosis, and diagnosis of endometriosis using urinary biomarkers should only be undertaken in a research setting.

Predictive accuracy of changes in transvaginal sonographic cervical length over time for preterm birth: a systematic review and metaanalysis

OBJECTIVE

To determine the accuracy of changes in transvaginal sonographic cervical length over time in predicting preterm birth in women with singleton and twin gestations.

DATA SOURCES

PubMed, Embase, Cinahl, Lilacs, and Medion (all from inception to June 30, 2015), bibliographies, Google scholar, and conference proceedings. Cohort or cross-sectional studies reporting on the predictive accuracy for preterm birth of changes in cervical length over time.

STUDY APPRAISAL AND SYNTHESIS METHODS

Two reviewers independently selected studies, assessed the risk of bias, and extracted the data. Summary receiver-operating characteristic curves, pooled sensitivities and specificities, and summary likelihood ratios were generated.

RESULTS

Fourteen studies met the inclusion criteria, of which 7 provided data on singleton gestations (3374 women) and 8 on twin gestations (1024 women). Among women with singleton gestations, the shortening of cervical length over time had a low predictive accuracy for preterm birth at <37 and <35 weeks of gestation with pooled sensitivities and specificities, and summary positive and negative likelihood ratios ranging from 49% to 74%, 44% to 85%, 1.3 to 4.1, and 0.3 to 0.7, respectively. In women with twin gestations, the shortening of cervical length over time had a low to moderate predictive accuracy for preterm birth at <34, <32, <30, and <28 weeks of gestation with pooled sensitivities and specificities, and summary positive and negative likelihood ratios ranging from 47% to 73%, 84% to 89%, 3.8 to 5.3, and 0.3 to 0.6, respectively. There were no statistically significant differences between the predictive accuracies for preterm birth of cervical length shortening over time and the single initial and/or final cervical length measurement in 8 of 11 studies that provided data for making these comparisons. In the largest and highest-quality study, a single measurement of cervical length obtained at 24 or 28 weeks of gestation was significantly more predictive of preterm birth than any decrease in cervical length between these gestational ages.

CONCLUSIONS

Change in transvaginal sonographic cervical length over time is not a clinically useful test to predict preterm birth in women with singleton or twin gestations. A single cervical length measurement obtained between 18 and 24 weeks of gestation appears to be a better test to predict preterm birth than changes in cervical length over time.

Diagnostic accuracy of (18)F amyloid PET tracers for the diagnosis of Alzheimer's disease: a systematic review and meta-analysis

Imaging or tissue biomarker evidence has been introduced into the core diagnostic pathway for Alzheimer’s disease (AD). PET using ¹⁸F-labelled beta-amyloid PET tracers has shown promise for the early diagnosis of AD. However, most studies included only small numbers of participants and no consensus has been reached as to which radiotracer has the highest diagnostic accuracy. First, we performed a systematic review of the literature published between 1990 and 2014 for studies exploring the diagnostic accuracy of florbetaben, florbetapir and flutemetamol in AD. The included studies were analysed using the QUADAS assessment of methodological quality. A meta-analysis of the sensitivity and specificity reported within each study was performed. Pooled values were calculated for each radiotracer and for visual or quantitative analysis by population included. The systematic review identified nine studies eligible for inclusion. There were limited variations in the methods between studies reporting the same radiotracer. The meta-analysis results showed that pooled sensitivity and specificity values were in general high for all tracers. This was confirmed by calculating likelihood ratios. A patient with a positive ratio is much more likely to have AD than a patient with a negative ratio, and vice versa. However, specificity was higher when only patients with AD were compared with healthy controls. This systematic review and meta-analysis found no marked differences in the diagnostic accuracy of the three beta-amyloid radiotracers. All tracers perform better when used to discriminate between patients with AD and healthy controls. The sensitivity and specificity for quantitative and visual analysis are comparable to those of other imaging or biomarker techniques used to diagnose AD. Further research is required to identify the combination of tests that provides the highest sensitivity and specificity, and to identify the most suitable position for the tracer in the clinical pathway.

Diagnostic Value of the Combination of Golgi Protein 73 and Alpha-Fetoprotein in Hepatocellular Carcinoma: A Meta-Analysis

Conflicting results have been widely reported on the use of Golgi protein 73 (GP73) as a serum biomarker for diagnosing hepatocellular carcinoma (HCC). This study evaluated the accuracy of GP73, alpha-fetoprotein (AFP), and GP73 + AFP for diagnosing HCC. The meta-analysis was performed on 11 studies that were selected by means of a comprehensive systematic literature review. Summary diagnostic accuracy, meta-regression analysis for heterogeneity and publication bias, and other statistical analyses were performed using Meta-Disc (version 1.4) and Stata (version 12.0). Pooled sensitivity, specificity, and diagnostic odds ratio were 0.77 (95% CI: 0.75–0.79), 0.91 (95% CI: 0.90–0.92), and 12.49 (95% CI: 4.91–31.79) for GP73; 0.62 (95% CI: 0.60–0.64), 0.84 (95% CI: 0.83–0.85), and 11.61 (95% CI: 8.02–16.81) for AFP; and 0.87 (95% CI: 0.85–0.89), 0.85 (95% CI: 0.84–0.86), and 30.63 (95% CI: 18.10–51.84) for GP73 + AFP. The area under the curve values were 0.86, 0.84, and 0.91 for GP73, AFP, and GP73 + AFP, respectively. These results indicate that for HCC diagnosis, the accuracy of GP73 was higher than that of AFP, and that GP73 + AFP exhibited significantly higher diagnostic accuracy than did GP73 or AFP alone.

Polymerase chain reaction blood tests for the diagnosis of invasive aspergillosis in immunocompromised people

BACKGROUND

Invasive aspergillosis (IA) is the most common life-threatening opportunistic invasive mould infection in immunocompromised people. Early diagnosis of IA and prompt administration of appropriate antifungal treatment are critical to the survival of people with IA. Antifungal drugs can be given as prophylaxis or empirical therapy, instigated on the basis of a diagnostic strategy (the pre-emptive approach) or for treating established disease. Consequently there is an urgent need for research into both new diagnostic tools and drug treatment strategies. Newer methods such as polymerase chain reaction (PCR) to detect fungal nucleic acids are increasingly being investigated.

OBJECTIVES

To provide an overall summary of the diagnostic accuracy of PCR-based tests on blood specimens for the diagnosis of IA in immunocompromised people.

SEARCH METHODS

We searched MEDLINE (1946 to June 2015) and EMBASE (1980 to June 2015). We also searched LILACS, DARE, Health Technology Assessment, Web of Science and Scopus to June 2015. We checked the reference lists of all the studies identified by the above methods and contacted relevant authors and researchers in the field.

SELECTION CRITERIA

We included studies that: i) compared the results of blood PCR tests with the reference standard published by the European Organisation for Research and Treatment of Cancer/Mycoses Study Group (EORTC/MSG); ii) reported data on false-positive, true-positive, false-negative and true-negative results of the diagnostic tests under investigation separately; and iii) evaluated the test(s) prospectively in cohorts of people from a relevant clinical population, defined as a group of individuals at high risk for invasive aspergillosis. Case-control studies were excluded from the analysis.

DATA COLLECTION AND ANALYSIS

Authors independently assessed quality and extracted data. For PCR assays, we evaluated the requirement for either one or two consecutive samples to be positive for diagnostic accuracy. We investigated heterogeneity by subgroup analyses. We plotted estimates of sensitivity and specificity from each study in receiver operating characteristics (ROC) space and constructed forest plots for visual examination of variation in test accuracy. We performed meta-analyses using the bivariate model to produce summary estimates of sensitivity and specificity.

MAIN RESULTS

Eighteen primary studies, corresponding to 19 cohorts and 22 data sets, published between 2000 and 2013 were included in the meta-analyses, with a median prevalence of IA (proven or probable) of 12.0% (range 2.5 to 30.8 %). The majority of people had received chemotherapy for a haematological malignancy or had undergone a hematopoietic stem cell transplant. Several PCR techniques were used among the included studies. The sensitivity and specificity of PCR for the diagnosis of IA varied according to the interpretative criteria used to define a test as positive. The mean sensitivity and specificity were 80.5% (95% CI; 73.0 to 86.3) and 78.5% (67.8 to 86.4) for a single positive test result, and 58.0% (36.5 to 76.8) and 96.2% (89.6 to 98.6) for two consecutive positive test results.

AUTHORS' CONCLUSIONS

PCR shows moderate diagnostic accuracy when used as screening tests for IA in high-risk patient groups. Importantly the sensitivity of the test confers a high negative predictive value (NPV) such that a negative test allows the diagnosis to be excluded. Consecutive positives show good specificity in diagnosis of IA and could be used to trigger radiological and other investigations or for pre-emptive therapy in the absence of specific radiological signs when the clinical suspicion of infection is high. When a single PCR positive test is used as diagnostic criterion for IA in a population of 100 people with a disease prevalence of 13.0% (overall mean prevalence), three people with IA would be missed (sensitivity 80.5%, 19.5% false negatives), and 19 people would be unnecessarily treated or referred for further tests (specificity of 78.5%, 21.5% false positives). If we use the two positive test requirement in a population with the same disease prevalence, it would mean that six IA people would be missed (sensitivity 58.0%, 42.1% false negatives) and three people would be unnecessarily treated or referred for further tests (specificity of 96.2%, 3.8% false positives). Galactomannan and PCR have good NPV for excluding disease but the low prevalence of disease limits the ability to rule in a diagnosis. The biomarkers are detecting different aspects of disease and the combination of both together is likely to be more useful.

Early Pregnancy Biomarkers in Pre-Eclampsia: A Systematic Review and Meta-Analysis

Pre-eclampsia (PE) complicates 2%–8% of all pregnancies and is an important cause of perinatal morbidity and mortality worldwide. In order to reduce these complications and to develop possible treatment modalities, it is important to identify women at risk of developing PE. The use of biomarkers in early pregnancy would allow appropriate stratification into high and low risk pregnancies for the purpose of defining surveillance in pregnancy and to administer interventions. We used formal methods for a systematic review and meta-analyses to assess the accuracy of all biomarkers that have been evaluated so far during the first and early second trimester of pregnancy to predict PE. We found low predictive values using individual biomarkers which included a disintegrin and metalloprotease 12 (ADAM-12), inhibin-A, pregnancy associated plasma protein A (PAPP-A), placental growth factor (PlGF) and placental protein 13 (PP-13). The pooled sensitivity of all single biomarkers was 0.40 (95% CI 0.39–0.41) at a false positive rate of 10%. The area under the Summary of Receiver Operating Characteristics Curve (SROC) was 0.786 (SE 0.02). When a combination model was used, the predictive value improved to an area under the SROC of 0.893 (SE 0.03). In conclusion, although there are multiple potential biomarkers for PE their efficacy has been inconsistent and comparisons are difficult because of heterogeneity between different studies. Therefore, there is an urgent need for high quality, large-scale multicentre research in biomarkers for PE so that the best predictive marker(s) can be identified in order to improve the management of women destined to develop PE.

Polymerase chain reaction blood tests for the diagnosis of invasive aspergillosis in immunocompromised people

BACKGROUND

Invasive aspergillosis (IA) is the most common life-threatening opportunistic invasive mould infection in immunocompromised people. Early diagnosis of IA and prompt administration of appropriate antifungal treatment are critical to the survival of people with IA. Antifungal drugs can be given as prophylaxis or empirical therapy, instigated on the basis of a diagnostic strategy (the pre-emptive approach) or for treating established disease. Consequently there is an urgent need for research into both new diagnostic tools and drug treatment strategies. Newer methods such as polymerase chain reaction (PCR) to detect fungal nucleic acids are increasingly being investigated.

OBJECTIVES

To provide an overall summary of the diagnostic accuracy of PCR-based tests on blood specimens for the diagnosis of IA in immunocompromised people.

SEARCH METHODS

We searched MEDLINE (1946 to June 2015) and EMBASE (1980 to June 2015). We also searched LILACS, DARE, Health Technology Assessment, Web of Science and Scopus to June 2015. We checked the reference lists of all the studies identified by the above methods and contacted relevant authors and researchers in the field.

SELECTION CRITERIA

We included studies that: i) compared the results of blood PCR tests with the reference standard published by the European Organisation for Research and Treatment of Cancer/Mycoses Study Group (EORTC/MSG); ii) reported data on false-positive, true-positive, false-negative and true-negative results of the diagnostic tests under investigation separately; and iii) evaluated the test(s) prospectively in cohorts of people from a relevant clinical population, defined as a group of individuals at high risk for invasive aspergillosis. Case-control studies were excluded from the analysis.

DATA COLLECTION AND ANALYSIS

Authors independently assessed quality and extracted data. For PCR assays, we evaluated the requirement for either one or two consecutive samples to be positive for diagnostic accuracy. We investigated heterogeneity by subgroup analyses. We plotted estimates of sensitivity and specificity from each study in receiver operating characteristics (ROC) space and constructed forest plots for visual examination of variation in test accuracy. We performed meta-analyses using the bivariate model to produce summary estimates of sensitivity and specificity.

MAIN RESULTS

Eighteen primary studies, corresponding to 19 cohorts and 22 data sets, published between 2000 and 2013 were included in the meta-analyses, with a median prevalence of IA (proven or probable) of 12.0% (range 2.5 to 30.8 %). The majority of people had received chemotherapy for a haematological malignancy or had undergone a hematopoietic stem cell transplant. Several PCR techniques were used among the included studies. The sensitivity and specificity of PCR for the diagnosis of IA varied according to the interpretative criteria used to define a test as positive. The mean sensitivity and specificity were 80.5% (95% CI; 73.0 to 86.3) and 78.5% (67.8 to 86.4) for a single positive test result, and 58.0% (36.5 to 76.8) and 96.2% (89.6 to 98.6) for two consecutive positive test results.

AUTHORS' CONCLUSIONS

PCR shows moderate diagnostic accuracy when used as screening tests for IA in high-risk patient groups. Importantly the sensitivity of the test confers a high negative predictive value (NPV) such that a negative test allows the diagnosis to be excluded. Consecutive positives show good specificity in diagnosis of IA and could be used to trigger radiological and other investigations or for pre-emptive therapy in the absence of specific radiological signs when the clinical suspicion of infection is high. When a single PCR positive test is used as diagnostic criterion for IA in a population of 100 people with a disease prevalence of 13.0% (overall mean prevalence), three people with IA would be missed (sensitivity 80.5%, 19.5% false negatives), and 19 people would be unnecessarily treated or referred for further tests (specificity of 78.5%, 21.5% false negatives). If we use the two positive test requirement in a population with the same disease prevalence, it would mean that six IA people would be missed (sensitivity 58.0%, 42.1% false negatives) and three people would be unnecessarily treated or referred for further tests (specificity of 96.2%, 3.8% false negatives). Galactamannan and PCR have good NPV for excluding disease but the low prevalence of disease limits the ability to rule in a diagnosis. The biomarkers are detecting different aspects of disease and the combination of both together is likely to be more useful.

OBSERVER RATING VERSUS THREE-DIMENSIONAL MOTION ANALYSIS OF LOWER EXTREMITY KINEMATICS DURING FUNCTIONAL SCREENING TESTS: A SYSTEMATIC REVIEW

BACKGROUND

Functional assessments are conducted in both clinical and athletic settings in an attempt to identify those individuals who exhibit movement patterns that may increase their risk of non-contact injury. In place of highly sophisticated three-dimensional motion analysis, functional testing can be completed through observation.

HYPOTHESIS/PURPOSE

To evaluate the validity of movement observation assessments by summarizing the results of articles comparing human observation in real-time or video play-back and three-dimensional motion analysis of lower extremity kinematics during functional screening tests.

STUDY DESIGN

Systematic review.

METHODS

A computerized systematic search was conducted through Medline, SPORTSdiscus, Scopus, Cinhal, and Cochrane health databases between February and April of 2014. Validity studies comparing human observation (real-time or video play-back) to three-dimensional motion analysis of functional tasks were selected. Only studies comprising uninjured, healthy subjects conducting lower extremity functional assessments were appropriate for review. Eligible observers were certified health practitioners or qualified members of sports and athletic training teams that conduct athlete screening. The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) was used to appraise the literature. Results are presented in terms of functional tasks.

RESULTS

Six studies met the inclusion criteria. Across these studies, two-legged squats, single-leg squats, drop-jumps, and running and cutting manoeuvres were the functional tasks analysed. When compared to three-dimensional motion analysis, observer ratings of lower extremity kinematics, such as knee position in relation to the foot, demonstrated mixed results. Single-leg squats achieved target sensitivity values (≥ 80%) but not specificity values (≥ 50%>%). Drop-jump task agreement ranged from poor (< 50%) to excellent (> 80%). Two-legged squats achieved 88% sensitivity and 85% specificity. Mean underestimations as large as 198 (peak knee flexion) were found in the results of those assessing running and side-step cutting manoeuvres. Variables such as the speed of movement, the methods of rating, the profiles of participants and the experience levels of observers may have influenced the outcomes of functional testing.

LIMITATIONS

The small number of studies used limits generalizability. Furthermore, this review used two dimensional video-playback for the majority of observations. If the movements had been rated in real-time three dimensional video, the results may have been different.

CONCLUSIONS

Slower, speed controlled movements using dichotomous ratings reach target sensitivity and demonstrate higher overall levels of agreement. As a result, their utilization in functional screening is advocated.

LEVEL OF EVIDENCE

1A.

Evaluating radiographers' diagnostic accuracy in screen-reading mammograms: what constitutes a quality study?

Introduction

The aim of this study was to first evaluate the quality of studies investigating the diagnostic accuracy of radiographers as mammogram screen-readers and then to develop an adapted tool for determining the quality of screen-reading studies.

Methods

A literature search was used to identify relevant studies and a quality evaluation tool constructed by combining the criteria for quality of Whiting, Rutjes, Dinnes et al. and Brealey and Westwood. This constructed tool was then applied to the studies and subsequently adapted specifically for use in evaluating quality in studies investigating diagnostic accuracy of screen-readers.

Results

Eleven studies were identified and the constructed tool applied to evaluate quality. This evaluation resulted in the identification of quality issues with the studies such as potential for bias, applicability of results, study conduct, reporting of the study and observer characteristics. An assessment of the applicability and relevance of the tool for this area of research resulted in adaptations to the criteria and the development of a tool specifically for evaluating diagnostic accuracy in screen-reading.

Conclusions

This tool, with further refinement and rigorous validation can make a significant contribution to promoting well-designed studies in this important area of research and practice.

ROBIS: A new tool to assess risk of bias in systematic reviews was developed

Objective

To develop ROBIS, a new tool for assessing the risk of bias in systematic reviews (rather than in primary studies).

Study Design and Setting

We used four-stage approach to develop ROBIS: define the scope, review the evidence base, hold a face-to-face meeting, and refine the tool through piloting.

Results

ROBIS is currently aimed at four broad categories of reviews mainly within health care settings: interventions, diagnosis, prognosis, and etiology. The target audience of ROBIS is primarily guideline developers, authors of overviews of systematic reviews (“reviews of reviews”), and review authors who might want to assess or avoid risk of bias in their reviews. The tool is completed in three phases: (1) assess relevance (optional), (2) identify concerns with the review process, and (3) judge risk of bias. Phase 2 covers four domains through which bias may be introduced into a systematic review: study eligibility criteria; identification and selection of studies; data collection and study appraisal; and synthesis and findings. Phase 3 assesses the overall risk of bias in the interpretation of review findings and whether this considered limitations identified in any of the phase 2 domains. Signaling questions are included to help judge concerns with the review process (phase 2) and the overall risk of bias in the review (phase 3); these questions flag aspects of review design related to the potential for bias and aim to help assessors judge risk of bias in the review process, results, and conclusions.

Conclusions

ROBIS is the first rigorously developed tool designed specifically to assess the risk of bias in systematic reviews.

Is visual evaluation of aneurysm coiling a reliable study end point? Systematic review and meta-analysis

BACKGROUND AND PURPOSE

Angiographic occlusion as a surrogate marker of satisfactory aneurysm treatment is commonly used in clinical trials although some pitfalls have to be considered. To investigate the inter-rater reliability of visual rating of aneurysm occlusion as study end point, we performed a systematic review and meta-analysis.

METHODS

Electronic databases (MEDLINE, EMBASE, PubMed, and the Cochrane Library) were searched up to June 2014. Assessment of risk for bias was based on the Quality Appraisal Tool for Studies of Diagnostic Reliability and the Guidelines for Reporting Reliability and Agreement studies. Inter-rater reliability estimates were pooled across studies using meta-analysis, and the influence of several factors (eg, imaging methods, grading scales, and occlusion rate) was tested with meta-regression.

RESULTS

From 1193 titles, 644 abstracts and 87 full-text versions were reviewed. Twenty-six articles met the inclusion criteria and provided 77 reliability estimates. Twenty-one different rating scales were used, and statistical analysis varied. Mean inter-rater agreement of the pooled studies was substantial (κ=0.65; 95% confidence interval, 0.60-0.69). Reliability varied significantly as a function of imaging methods, grading scales, occlusion rates, and their interaction. Observer agreement substantially increased with increasing occlusion rate in digital subtraction angiography but not in MR angiography. Reliability was higher in studies using 2- or 3-value grading scales than in studies with 4-value grading scales.

CONCLUSIONS

There is significant heterogeneity between studies evaluating the reliability of visual evaluation of aneurysm coiling. On the basis of our analysis, we found that the combination of magnetic resonance angiography, 3-value grading scale, and 2 trained raters seems most promising for usage as surrogate study end points.

An introduction to systematic reviews in animal health, animal welfare, and food safety

In this paper, we provide an introduction to systematic reviews and discuss the process for conducting systematic reviews in animal health, animal welfare, and food safety. The research synthesis need that can be addressed by a systematic review is discussed. The use of systematic reviews to address questions about intervention effects, etiology, diagnostic tests evaluation and disease burden are discussed. The steps included in a systematic review are described.

Insertion torque recordings for the diagnosis of contact between orthodontic mini-implants and dental roots: protocol for a systematic review

BACKGROUND

Hitting a dental root during the insertion of orthodontic mini-implants (OMIs) is a common adverse effect of this intervention. This condition can permanently damage these structures and can cause implant instability. Increased torque levels (index test) recorded during the insertion of OMIs may provide a more accurate and immediate diagnosis of implant-root contact (target condition) than radiographic imaging (reference standard). An accurate index test could reduce or eliminate X-ray exposure. These issues, the common use of OMIs, the high prevalence of the target condition, and because most OMIs are placed between roots warrant a systematic review. We will assess 1) the diagnostic accuracy and the adverse effects of the index test, 2) whether OMIs with root contact have higher insertion torque values than those without, and 3) whether intermediate torque values have clinical diagnostic utility.

METHODS

The Preferred Reporting Items for Systematic review and Meta-Analysis Protocols (PRISMA-P) 2015 statement was used as a the guideline for reporting this protocol. Inserting implants deliberately into dental roots of human participants would not be approved by ethical review boards and adverse effects of interventions are generally underreported. We will therefore apply broad spectrum eligibility criteria, which will include clinical, animal and cadaver models. Not including these models could slow down knowledge translation. Both randomized and non-randomized research studies will be included. Comparisons of interest and subgroups are pre-specified. We will conduct searches in MEDLINE and more than 40 other electronic databases. We will search the grey literature and reference lists and hand-search ten journals. All methodological procedures will be conducted by three reviewers. Study selection, data extraction and analyses, and protocols for contacting authors and resolving conflicts between reviewers are described. Designed specific risk of bias tools will be tailored to the research question. Different research models will be analysed separately. Parameters for exploring statistical heterogeneity and conducting meta-analyses are pre-specified. The quality of evidence for outcomes will be assessed through the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach.

DISCUSSION

The findings of this systematic review will be useful for patients, clinicians, researchers, guideline developers, policymakers, and surgical companies.

Golgi protein 73 as a biomarker for hepatocellular carcinoma: A diagnostic meta-analysis

Hepatocellular carcinoma (HCC) is the most common primary malignancy of the liver and the third leading cause of cancer-related mortality worldwide. Conflicting results have been reported regarding the use of serum Golgi protein 73 (GP73) as a promising serum marker for the diagnosis of HCC; therefore, the aim of the present study was to provide a systematic review of the diagnostic performance of GP73 for HCC. Following a systematic review of the relevant studies, a number of indices associated with the accuracy of the diagnostic performance of GP73, including the sensitivity and specificity, were pooled using Meta Disc 1.4 software. Data were presented as forest plots, and summary receiver operating characteristic (SROC) curve analysis was used to summarize the overall test performance. Eleven studies were included in this meta-analysis. The summary estimates for serum GP73 in diagnosing HCC were as follows: Sensitivity, 77% [95% confidence interval (CI), 75–79%]; specificity, 91% (95% CI, 90–92%); positive likelihood ratio, 4.34 (95% CI, 2.19–8.59); negative likelihood ratio, 0.30 (95% CI, 0.26–0.36) and diagnostic odds ratio, 15.78 (95% CI, 6.95–35.83). The area under the SROC curve was 0.8638, and the Q index was 0.7944. Significant heterogeneity was found. This meta-analysis indicates a moderate diagnostic value of GP73 in HCC; however, further studies with rigorous design, large sample size and multiregional cooperation are required.