Case-control and two-gate designs in diagnostic accuracy studies

Measurement accuracy: Enabling human rights for Fijian students with speech difficulties

PURPOSE

The Universal Declaration of Human Rights enshrines the rights to communication and education and measuring access to these rights for children with disabilities is fundamental. The UNICEF/Washington Group Child Functioning Module (CFM) is being promoted to measure progress against the Sustainable Development Goals for children with disabilities. This cross-sectional diagnostic accuracy study in Fiji compares parent and teacher CFM responses to the Intelligibility in Context Scale for 463 primary-aged students with and without speech difficulties.

METHOD

Receiver operating characteristic curves were constructed to analyse CFM accuracy and determine optimal cut-off points; inter-rater reliability between teachers and parents was calculated.

RESULT

Parent responses to the CFM speech questions achieved an area under the curve of 0.98, indicating "excellent" diagnostic accuracy. Teachers achieved 0.92 ("very good"). The Youden Index identified the optimal cut-off as "some difficulty".

CONCLUSION

The CFM appears effective when used by parents or teachers for distinguishing between children with and without speech difficulties. While identified as the optimal cut-off statistically, the "some difficulty" category identifies too many children without speech difficulties to be simplistically applied to funding eligibility. The CFM should be used as a screening tool, followed by further assessment to confirm eligibility.

Predictors for independent external validation of cardiovascular risk clinical prediction rules: Cox proportional hazards regression analyses

BACKGROUND

Clinical prediction rules (CPRs) should be externally validated by independent researchers. Although there are many cardiovascular CPRs, most have not been externally validated. It is not known why some CPRs are externally validated by independent researchers and others are not.

METHODS

We analyzed cardiovascular risk CPRs included in a systematic review. Independent external validations were identified by forward citation searches of derivation studies. Time between the publication of a cardiovascular CPR and the first independent external validation was calculated. We assessed Kaplan-Meier estimates of the probability to have an independent external validation. Using univariable Cox regression, we explored whether characteristics of derivation (design, location, sample size, number of predictors, presentation format, validation in derivation), reporting (participants, predictors, outcomes, performance measure, information for risk calculation), and publication (journal impact factor) are associated with time to the first independent external validation.

RESULTS

Of 125 cardiovascular risk CPRs, 29 had an independent external validation. The median follow-up was 118 months (95% CI, 99-130). The 25th percentile of event time was 122 months (95% CI, 91-299). Cardiovascular risk CPRs from the USA were 4.15 times (95% CI, 1.89-9.13) more likely to have an independent external validation. Increasing the sample size of derivation by ten times was associated with a 2.32-fold (95% CI, 1.37-3.91) increase in the probability of having an independent external validation. CPRs presented with an internal validation tend to get an independent external validation sooner (HR = 1.73, 95% CI, 0.77-3.93). CPRs reporting all the information necessary for calculating individual risk were 2.65 (95% CI, 1.01-6.96) times more likely to have an independent external validation. Publishing a cardiovascular risk CPR in a journal that has one unit higher impact factor was associated with a 6% (95% CI, 3-9) higher likelihood of an independent external validation.

CONCLUSIONS

The probability for cardiovascular risk CPRs to get an independent external validation was low even many years after their derivations. Authors of new cardiovascular risk CPRs should consider using adequate sample size, conducting an internal validation, and reporting all the information needed for risk calculation as these features were associated with an independent external validation.

A systematic review of test accuracy studies evaluating molecular micro-satellite instability testing for the detection of individuals with lynch syndrome

BACKGROUND

A systematic review was conducted to assess the diagnostic test accuracy of polymerase chain reaction (PCR)-based microsatellite instability (MSI) testing for identifying Lynch syndrome in patients with colorectal cancer (CRC). Unlike previous reviews, this was based on assessing MSI testing against best practice for the reference standard, and included CRC populations that were unselected, age-limited or high-risk for Lynch syndrome.

METHODS

Single- and two-gate diagnostic test accuracy studies, or similar, were identified, assessed for inclusion, data extracted and quality appraised by two reviewers according to a pre-specified protocol. Sensitivity of MSI testing was estimated for all included studies. Specificity, likelihood ratios and predictive values were estimated for studies that were not based on high-risk samples. Narrative synthesis was conducted.

RESULTS

Nine study samples were included. When MSI-Low results were considered to be negative, sensitivity estimates ranged from 67% (95% CI 47, 83) to 100% (95% CI 94, 100). Three studies contributed to estimates of both sensitivity and specificity, with specificity ranging from 61% (95% CI 57, 65), to 93% (95% CI 89, 95). Good sensitivity was achieved at the expense of specificity. When MSI-L was considered to be positive (effectively lowering the threshold for a positive index test result) sensitivity increased and specificity decreased. Between-study heterogeneity in both the MSI and reference standard testing, combined with the low number of studies contributing to both sensitivity and specificity estimates, precluded pooling by meta-analysis.

CONCLUSIONS

MSI testing is an effective screening test for Lynch syndrome. However, there is significant uncertainty surrounding what balance of sensitivity and specificity will be achieved in clinical practice and how this relates to specific characteristics of the test (such as the panel of markers used or the thresholds used to denote a positive test).

Systematic Review and Meta-Analysis of Diagnostic Accuracy of Serum Refractometry and Brix Refractometry for the Diagnosis of Inadequate Transfer of Passive Immunity in Calves

BACKGROUND

Transfer of passive immunity in calves can be assessed by direct measurement of immunoglobulin G (IgG) by methods such as radial immunodiffusion (RID) or turbidimetric immunoassay (TIA). IgG can also be measured indirectly by methods such as serum refractometry (REF) or Brix refractometry (BRIX).

OBJECTIVES

To determine the accuracy of REF and BRIX for assessment of inadequate transfer of passive immunity (ITPI) in calves.

DESIGN

Systematic review and meta-analysis of diagnostic accuracy studies.

METHODS

Databases (PubMed and CAB Abstract, Searchable Proceedings of Animal Science) and Google Scholar were searched for relevant studies. Studies were eligible if the accuracy (sensitivity and specificity) of REF or BRIX was determined using direct measurement of IgG by RID or turbidimetry as the reference standard. The study population included calves <14 days old that were fed with natural colostrum (colostrum replacement products were excluded). Quality assessment was performed by the QUADAS-2 tool. Hierarchical models were used for meta-analysis.

RESULTS

From 1,291 references identified, 13 studies of 3,788 calves were included. Of these, 11 studies evaluated REF and 5 studies evaluated BRIX. The median (range) prevalence of ITPI (defined as calves with IgG <10 g/L by RID or TIA) was 21% (1.3-56%). Risk of bias and applicability concerns were generally low or unclear. For REF, summary estimates were obtained for 2 different cutoffs: 5.2 g/dL (6 studies) and 5.5 g/dL (5 studies). For the 5.2 g/dL cutoff, the summary sensitivity (95% CI) and specificity (95% CI) were 76.1% (63.8-85.2%) and 89.3% (82.3-93.7%), and 88.2% (80.2-93.3%) and 77.9% (74.5-81.0%) for the 5.5 g/dL cutoff. Due to the low number of studies using the same cutoffs, summary estimates could not be obtained for BRIX.

CONCLUSIONS AND CLINICAL IMPORTANCE

Despite their widespread use on dairy farms, evidence about the optimal strategy for using refractometry, including the optimal cutoff, are sparse (especially for BRIX). When using REF to rule out ITPI in herds, the 5.5 g/dL cutoff may be used whereas for ruling in ITPI, the 5.2 g/dL cutoff may be used.

Microfluidic device for novel breast cancer screening by blood test using miRNA beacon probe

Breast cancer is identified as the highest cause of death in women suffering from cancer. Early diagnosis is the key to increase the survival of breast cancer victims. Molecular diagnosis using biomarkers have advanced much in the recent years. The cost involved in such diagnosis is not affordable for most of the population. The concept being investigated here is to realize a simple diagnosis system for screening cancer by way of a blood test utilizing a miRNA based biomarker with a complementary molecular beacon probe. A microfluidic platform was designed and attached with a fluorescence reader, which is portable and cost effective. Experiments were performed with 51 blood samples of which 30 were healthy and 21 were positive for breast cancer, collected against institutional human ethical clearance, IHEC 16/180-7-9-2016. miRNA 21 was chosen as the biomarker because it is overexpressed 4-fold in the serum of breast cancer patients. This work involved design of an experiment to prove the concept of miRNA over expression followed by detection of miRNA 21 using the microfluidic platform attached with a fluorescence reader and validation of the results using quantitative Real Time Polymerase Chain Reaction (qRT-PCR). The results obtained from the microfluidic device concurred with qRT-PCR results. The device is suitable for point-of-care application in a mass-screening programme. The study also has revealed that the stage of the cancer could be indicated by this test, which will be further useful for deciding a therapeutic regime.

Validating the UNICEF/Washington Group Child Functioning Module for Fijian schools to identify seeing, hearing and walking difficulties

PURPOSE

This study investigated the seeing, hearing and walking questions of the UNICEF/Washington Group Child Functioning Module and the inter-rater reliability between teachers and parents as proxy respondents.

METHODS

Cross-sectional diagnostic accuracy study, two-gate design with representative sampling, comparing Module responses to reference standard assessments for 472 primary aged students in Fiji. Receiver operating characteristic curves were constructed to determine the area under the curve and optimal cut-off points.

RESULTS

Areas under the curves ranged from 0.823 to 0.889 indicating "good" diagnostic accuracy. Inter-rater reliability between parent and teacher responses was "good" to "excellent". The optimal cut-off determined by the Youden Index was "some difficulty" however a wide spread of impairment levels were found in this category with most children either having none or substantial impairments.

CONCLUSIONS

The diagnostic accuracy of the Module seeing, hearing and walking questions appears acceptable with either parents or teachers as proxy respondents. For education systems, use of the cut-off "some difficulty" with accompanying clinical assessment may be important to capture children who require services and learning supports and avoid potentially misleading categorization. Given the high proportion of the sample from special schools research is required to further test the Module in mainstream schools. Implications for rehabilitation Identification of children who are at risk of disability in Fiji is important to enable planning, monitoring and evaluating access to quality inclusive education. The UNICEF/Washington Group Child Functioning Module appears to be a practical and effective tool that can be used by teachers to identify children at risk of disability. Children identified on the UNICEF/Washington Group Child Functioning Module as having "some difficulty" or higher levels of difficulty in relation to vision, hearing or walking should be referred for further assessment and services. Rehabilitation services in Fiji need to prepare for greater numbers of referrals as the Ministry of Education increasingly rolls out the inclusive education policy, which includes identification by schools of children at risk of disability.

Decision making about healthcare-related tests and diagnostic test strategies. Paper 2: a review of methodological and practical challenges

OBJECTIVES

In this first of a series of five articles, we provide an overview of how and why healthcare-related tests and diagnostic strategies are currently applied. We also describe how our findings can be integrated with existing frameworks for making decisions that guide the use of healthcare-related tests and diagnostic strategies.

STUDY DESIGN AND SETTING

We searched MEDLINE, references of identified articles, chapters in relevant textbooks, and identified articles citing classic literature on this topic.

RESULTS

We provide updated frameworks for the potential roles and applications of tests with suggested definitions and practical examples. We also discuss study designs that are commonly used to assess tests' performance and the effects of tests on people's health. These designs include diagnostic randomized controlled trials and retrospective validation. We describe the utility of these and other currently suggested designs, which questions they can answer and which ones they cannot. In addition, we summarize the challenges unique to decision-making resulting from the use of tests.

CONCLUSION

This overview highlights current challenges in the application of tests in decision-making in healthcare, provides clarifications, and informs the proposed solutions.

Diagnostic accuracy of refractometer and Brix refractometer to assess failure of passive transfer in calves: protocol for a systematic review and meta-analysis

Calves are highly dependent of colostrum (and antibody) intake because they are born agammaglobulinemic. The transfer of passive immunity in calves can be assessed directly by dosing immunoglobulin G (IgG) or by refractometry or Brix refractometry. The latter are easier to perform routinely in the field. This paper presents a protocol for a systematic review meta-analysis to assess the diagnostic accuracy of refractometry or Brix refractometry versus dosage of IgG as a reference standard test. With this review protocol we aim to be able to report refractometer and Brix refractometer accuracy in terms of sensitivity and specificity as well as to quantify the impact of any study characteristic on test accuracy.

Accuracy of isolated-check visual evoked potential technique for diagnosing primary open-angle glaucoma

PURPOSE

The aim of this study was to determine the diagnostic accuracy, sensitivity and specificity of isolated-check visual evoked potentials (icVEP) in primary open-angle glaucoma (POAG).

METHODS

Ninety POAG patients and sixty-six healthy controls were recruited consecutively. All subjects underwent icVEP and visual field testing. Swept icVEP response functions were obtained by increasing contrast in six stimulus steps, recording the electroencephalogram synchronized to the stimulus display's frame rate and calculating the corresponding signal-to-noise ratio (SNR) of the response at the fundamental frequency to evaluate visual function. Depth of modulation of the check luminance was increased as follows: 2, 4, 8, 14, 22 and 32%, about an equal level of standing contrast, so that the pattern appeared and disappeared at a frequency of 10.0 Hz. SNR above 0.85 was deemed to be significant at the 0.1 level and SNR above 1 significant at the 0.05 level.

RESULTS

The results show that SNR is contrast dependent. It significantly rose as contrast increased. The areas under receiver-operating-characteristic curves (AUCs) indicating classification accuracy for all POAG cases in comparison with normal subjects were 0.790 (sensitivity 91.1%, specificity 69.7%) with the cutoff SNR of 0.85, and 0.706 (sensitivity 95.6%, specificity 51.5%) with the cutoff SNR of 1. The AUC of early glaucoma cases (EG) in comparison with normal subjects was 0.801 (sensitivity 93.3%, specificity 69.7%) with the cutoff SNR of 0.85, and 0.717 (sensitivity 97.8%, specificity 51.5%) with the cutoff SNR of 1.

CONCLUSION

icVEP has good diagnostic accuracy (high sensitivity and moderate specificity) in distinguishing early POAG patients from healthy subjects. It might be a promising device to use in conjunction with complementary functional and structural measures for early POAG detection.

A directly comparative two-gate case-control diagnostic accuracy study of the pure tone screen and HearCheck screener tests for identifying hearing impairment in school children

OBJECTIVES

This study directly compared the accuracy of two audiometry-based tests for screening school children for hearing impairment: the currently used test, pure tone screen and a device newly applied to children, HearCheck Screener.

DESIGN

Two-gate case-control diagnostic test accuracy study.

SETTING AND PARTICIPANTS

Hearing impaired children ('intended cases') aged 4-6 years were recruited between February 2013 and August 2014 from collaborating audiology services. Children with no previously identified impairment ('intended controls') were recruited from Foundation and Year 1 of schools between February 2013 and June 2014 in central England. The reference standard was pure tone audiometry. Tests were administered at Nottingham Hearing Biomedical Research Unit or, for some intended cases only, in the participant's home.

MAIN OUTCOME MEASURES

Sensitivity and specificity of the pure tone screen and HearCheck tests based on pure tone audiometry result as reference standard.

RESULTS

315 children (630 ears) were recruited; 75 from audiology services and 240 from schools. Full test and reference standard data were obtained for 600 ears; 155 ears were classified as truly impaired and 445 as truly hearing based on the pure tone audiometry assessment. Sensitivity was estimated to be 94.2% (95% CI 89.0% to 97.0%) for pure tone screen and 89.0% (95% CI 82.9% to 93.1%) for HearCheck (difference=5.2% favouring pure tone screen; 95% CI 0.2% to 10.1%; p=0.02). Estimates for specificity were 82.2% (95% CI 77.7% to 86.0%) for pure tone screen and 86.5% (95% CI 82.5% to 89.8%) for HearCheck (difference=4.3% favouring HearCheck; 95% CI0.4% to 8.2%; p=0.02).

CONCLUSION

Pure tone screen was better than HearCheck with respect to sensitivity but inferior with respect to specificity. As avoiding missed cases is arguably of greater importance for school entry screening, pure tone screen is probably preferable in this context.

STUDY REGISTRATION NUMBER

Current controlled trials: ISRCTN61668996.

Distribution of antiphospholipid antibodies in a large population-based German cohort

BACKGROUND

Antiphospholipid syndrome (APS) is the most common acquired thrombophilia. Diagnosis is based on clinical criteria and the presence of antiphospholipid antibodies (aPLs) above the 99th percentile of a reference group. Data on the distribution of aPL in the population are limited. The distribution of aPL including diagnostic cutoffs should be determined in a population-based cohort.

METHODS

The Gutenberg Health Study (GHS) is a population-based cohort aged 35-74 years. We determined the presence of antibodies against cardiolipin (aCL, IgG, and IgM), β2-glycoprotein I (anti-β2GPI, IgG, and IgM), and domain 1 of β2-glycoprotein I (anti-domain 1, IgG) in a sample of 4979 participants.

RESULTS

aPL titers were similar in the whole sample and in an apparently healthy subgroup of 1049 individuals. There was a strong age-dependent increase of both aCL and anti-β2GPI IgM, while aPL IgG titers were stable or tended to decrease with age. A relevant decrease was observed for aCL IgG in women and anti-domain 1 IgG in both sexes. There was no association of aPL titers with a history of venous thromboembolism (VTE).

CONCLUSIONS

Our data show that for IgM aPL, age-dependent reference ranges should be used. In fact, the controversy regarding the clinical utility of IgM aPL might be related to the use of inappropriate reference ranges among other causes. In our population, aPLs were not associated with a history of VTE.

What are the critical elements of sideline screening that can be used to establish the diagnosis of concussion? A systematic review

BACKGROUND

Sideline detection is the first and most significant step in recognising a potential concussion and removing an athlete from harm. This systematic review aims to evaluate the critical elements aiding sideline recognition of potential concussions including screening tools, technologies and integrated assessment protocols.

DATA SOURCES

Bibliographic databases, grey literature repositories and relevant websites were searched from 1 January 2000 to 30 September 2016. A total of 3562 articles were identified.

STUDY SELECTION

Original research studies evaluating a sideline tool, technology or protocol for sports-related concussion were eligible, of which 27 studies were included.

DATA EXTRACTION

A standardised form was used to record information. The QUADAS-2 and Newcastle-Ottawa tools were used to rate risk of bias. Strength of evidence was assessed using the Grades of Recommendation, Assessment, Development and Evaluation Working Group system.

DATA SYNTHESIS

Studies assessing symptoms, the King-Devick test and multimodal assessments reported high sensitivity and specificity. Evaluations of balance and cognitive tests described lower sensitivity but higher specificity. However, these studies were at high risk of bias and the overall strength of evidence examining sideline screening tools was very low. A strong body of evidence demonstrated that head impact sensors did not provide useful sideline concussion information. Low-strength evidence suggested a multimodal, multitime-based concussion evaluation process incorporating video review was important in the recognition of significant head impact events and delayed onset concussion.

CONCLUSION

In the absence of definitive evidence confirming the diagnostic accuracy of sideline screening tests, consensus-derived multimodal assessment tools, such as the Sports Concussion Assessment Tool, are recommended. Sideline video review may improve recognition and removal from play of athletes who have sustained significant head impact events. Current evidence does not support the use of impact sensor systems for real-time concussion identification.

Diagnostic accuracy of imaging devices in glaucoma: A meta-analysis

Imaging devices such as the Heidelberg retinal tomograph-3 (HRT3), scanning laser polarimetry (GDx), and optical coherence tomography (OCT) play an important role in glaucoma diagnosis. A systematic search for evidence-based data was performed for prospective studies evaluating the diagnostic accuracy of HRT3, GDx, and OCT. The diagnostic odds ratio (DOR) was calculated. To compare the accuracy among instruments and parameters, a meta-analysis considering the hierarchical summary receiver-operating characteristic model was performed. The risk of bias was assessed using quality assessment of diagnostic accuracy studies, version 2. Studies in the context of screening programs were used for qualitative analysis. Eighty-six articles were included. The DOR values were 29.5 for OCT, 18.6 for GDx, and 13.9 for HRT. The heterogeneity analysis demonstrated statistically a significant influence of degree of damage and ethnicity. Studies analyzing patients with earlier glaucoma showed poorer results. The risk of bias was high for patient selection. Screening studies showed lower sensitivity values and similar specificity values when compared with those included in the meta-analysis. The classification capabilities of GDx, HRT, and OCT were high and similar across the 3 instruments. The highest estimated DOR was obtained with OCT. Diagnostic accuracy could be overestimated in studies including prediagnosed groups of subjects.

Screening for Atrial Fibrillation using Economical and accurate TechnologY (SAFETY)-a pilot study

INTRODUCTION

Atrial fibrillation (AF) is a cause of stroke and a marker of atherosclerosis and of all patients with stroke, around 17% have AF. The screening and treatment of AF could prevent about 12% of all strokes. Several relatively low-cost devices with good accuracy now exist which can detect AF including WatchBP and AliveCor. However, they can only measure the ECG or pulse over short time periods. Inexpensive devices such as heart rate monitors, which are widely available, can measure heart rate for prolonged periods and may have potential in screening for AF. This study aims to determine the accuracy of AliveCor and WatchBP along with a bespoke algorithm using a heart rate monitor belt (Polar H7) and a wearable RR interval recorder (Firstbeat Bodyguard 2) for detecting AF during a single screening visit in primary care patients.

METHODS/ANALYSIS

A multicentre case-control diagnostic study comparing the four different devices for the detection of AF with a reference standard consisting of a 12-lead ECG in GP surgeries across Hampshire, UK. We aim to recruit 92 participants with AF and 329 without AF aged 65 years and over. We will ask participants to rate comfort and overall impression for each device. We will collect qualitative data from participants capturing their experience of using wearable devices in order to evaluate acceptability. We will collect data from GPs to determine their views on AF screening.

ETHICS AND DISSEMINATION

This protocol was approved by the London-City & East Research Ethics Committee in June 2016. The findings of the trial will be disseminated through peer-reviewed journals, national and international conference presentations and the Atrial Fibrillation Association, UK.

TRIAL REGISTRATION NUMBER

ISRCTN17495003, Pre-results.

Dermoscopy in General Dermatology: A Practical Overview

Over the last few years, dermoscopy has been shown to be a useful tool in assisting the noninvasive diagnosis of various general dermatological disorders. In this article, we sought to provide an up-to-date practical overview on the use of dermoscopy in general dermatology by analysing the dermoscopic differential diagnosis of relatively common dermatological disorders grouped according to their clinical presentation, i.e. dermatoses presenting with erythematous-desquamative patches/plaques (plaque psoriasis, eczematous dermatitis, pityriasis rosea, mycosis fungoides and subacute cutaneous lupus erythematosus), papulosquamous/papulokeratotic dermatoses (lichen planus, pityriasis rosea, papulosquamous sarcoidosis, guttate psoriasis, pityriasis lichenoides chronica, classical pityriasis rubra pilaris, porokeratosis, lymphomatoid papulosis, papulosquamous chronic GVHD, parakeratosis variegata, Grover disease, Darier disease and BRAF-inhibitor-induced acantholytic dyskeratosis), facial inflammatory skin diseases (rosacea, seborrheic dermatitis, discoid lupus erythematosus, sarcoidosis, cutaneous leishmaniasis, lupus vulgaris, granuloma faciale and demodicidosis), acquired keratodermas (chronic hand eczema, palmar psoriasis, keratoderma due to mycosis fungoides, keratoderma resulting from pityriasis rubra pilaris, tinea manuum, palmar lichen planus and aquagenic palmar keratoderma), sclero-atrophic dermatoses (necrobiosis lipoidica, morphea and cutaneous lichen sclerosus), hypopigmented macular diseases (extragenital guttate lichen sclerosus, achromic pityriasis versicolor, guttate vitiligo, idiopathic guttate hypomelanosis, progressive macular hypomelanosis and postinflammatory hypopigmentations), hyperpigmented maculopapular diseases (pityriasis versicolor, lichen planus pigmentosus, Gougerot-Carteaud syndrome, Dowling-Degos disease, erythema ab igne, macular amyloidosis, lichen amyloidosus, friction melanosis, terra firma-forme dermatosis, urticaria pigmentosa and telangiectasia macularis eruptiva perstans), itchy papulonodular dermatoses (hypertrophic lichen planus, prurigo nodularis, nodular scabies and acquired perforating dermatosis), erythrodermas (due to psoriasis, atopic dermatitis, mycosis fungoides, pityriasis rubra pilaris and scabies), noninfectious balanitis (Zoon's plasma cell balanitis, psoriatic balanitis, seborrheic dermatitis and non-specific balanitis) and erythroplasia of Queyrat, inflammatory cicatricial alopecias (scalp discoid lupus erythematosus, lichen planopilaris, frontal fibrosing alopecia and folliculitis decalvans), nonscarring alopecias (alopecia areata, trichotillomania, androgenetic alopecia and telogen effluvium) and scaling disorders of the scalp (tinea capitis, scalp psoriasis, seborrheic dermatitis and pityriasis amiantacea).

STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration

Diagnostic accuracy studies are, like other clinical studies, at risk of bias due to shortcomings in design and conduct, and the results of a diagnostic accuracy study may not apply to other patient groups and settings. Readers of study reports need to be informed about study design and conduct, in sufficient detail to judge the trustworthiness and applicability of the study findings. The STARD statement (Standards for Reporting of Diagnostic Accuracy Studies) was developed to improve the completeness and transparency of reports of diagnostic accuracy studies. STARD contains a list of essential items that can be used as a checklist, by authors, reviewers and other readers, to ensure that a report of a diagnostic accuracy study contains the necessary information. STARD was recently updated. All updated STARD materials, including the checklist, are available at http://www.equator-network.org/reporting-guidelines/stard Here, we present the STARD 2015 explanation and elaboration document. Through commented examples of appropriate reporting, we clarify the rationale for each of the 30 items on the STARD 2015 checklist, and describe what is expected from authors in developing sufficiently informative study reports.

Diagnostic accuracy of radiographs for detecting supraglottitis: a systematic review and meta-analysis

Aim

To assess the diagnostic performance of lateral radiograph of the neck for supraglottitis in adults and children.

Methods

Electronic database searches (including PubMed, EMBASE, CINAHL, Web of Science, and WHO International Clinical Trials Registry Platform) were carried out through July 2014. Citations of included studies and recent narrative reviews were searched. Studies that compared lateral radiograph of the neck with a reference standard of direct/indirect laryngoscopy were included. Two reviewers independently assessed the methodological quality of included studies by Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2).

Results

Of 2,088 potentially relevant citations, two single-gate (cohort) studies and six two-gate (case-control) studies were identified. These included studies of design are at the moderate or high risk of bias in QUADAS-2. The pooled sensitivity from bivariate random-effects regression was 92.9% (95% confidence interval [CI], 88.5-95.9%) and the pooled specificity was 89.2% (95% CI, 85.9-91.9%), but the diagnostic value would be overestimated because of selection bias in the six two-gate studies. The sensitivity and specificity of the single-gate studies were 100.0% (95% CI, 92.2-100.0%) and 30.6% (95% CI, 15.5-35.6%) in children and 81.0% (95% CI, 78.2-93.2%) and 85.7% specificity (95% CI, 78.2-93.2%) in adults.

Conclusion

This study determines that there are insufficient studies of lateral neck radiograph for detecting supraglottitis. Lateral radiograph of the neck seems to have moderate accuracy for detecting supraglottitis. Further approximately unbiased studies are needed to obtain more valid and reliable estimates of test accuracy.

Diagnostic accuracy of the Berlin questionnaire, STOP-BANG, STOP, and Epworth sleepiness scale in detecting obstructive sleep apnea: A bivariate meta-analysis

Obstructive sleep apnea (OSA) is a highly prevalent sleep disorder; however, it remains underdiagnosed and undertreated. Although screening tools such as the Berlin questionnaire (BQ), STOP-BANG questionnaire (SBQ), STOP questionnaire (STOP), and Epworth sleepiness scale (ESS) are widely used for OSA, the findings regarding their diagnostic accuracy are controversial. Therefore, this meta-analysis investigated and compared the summary sensitivity, specificity, and diagnostic odds ratio (DOR) among the BQ, SBQ, STOP, and ESS according to the severity of OSA. Electronic databases, namely the Embase, PubMed, PsycINFO, ProQuest dissertations and theses A&I databases, and China knowledge resource integrated database, were searched from their inception to July 15, 2016. We included studies examining the sensitivity and specificity of the BQ, SBQ, STOP, and ESS against the apnea-hypopnea index (AHI) or respiratory disturbance index (RDI). The revised quality assessment of diagnostic accuracy studies was used to evaluate the methodological quality of studies. A random-effects bivariate model was used to estimate the summary sensitivity, specificity, and DOR of the tools. We identified 108 studies including a total of 47 989 participants. The summary estimates were calculated for the BQ, SBQ, STOP, and ESS in detecting mild (AHI/RDI ≥ 5 events/h), moderate (AHI/RDI ≥ 15 events/h), and severe OSA (AHI/RDI ≥ 30 events/h). The performance levels of the BQ, SBQ, STOP, and ESS in detecting OSA of various severity levels are outlined as follows: for mild OSA, the pooled sensitivity levels were 76%, 88%, 87%, and 54%; pooled specificity levels were 59%, 42%, 42%, and 65%; and pooled DORs were 4.30, 5.13, 4.85, and 2.18, respectively. For moderate OSA, the pooled sensitivity levels were 77%, 90%, 89%, and 47%; pooled specificity levels were 44%, 36%, 32%, and 621%; and pooled DORs were 2.68, 5.05, 3.71, and 1.45, respectively. For severe OSA, the pooled sensitivity levels were 84%, 93%, 90%, and 58%; pooled specificity levels were 38%, 35%, 28%, and 60%; and pooled DORs were 3.10, 6.51, 3.37, and 2.10, respectively. Therefore, for mild, moderate, and severe OSA, the pooled sensitivity and DOR of the SBQ were significantly higher than those of other screening tools (P < .05); however, the specificity of the SBQ was lower than that of the ESS (P < .05). Moreover, age, sex, body mass index, study sample size, study populations, presence of comorbidities, PSG or portable monitoring performance, and risk of bias in the domains of the index test and reference standard were significant moderators of sensitivity and specificity (P < .05). Compared with the BQ, STOP, and ESS, the SBQ is a more accurate tool for detecting mild, moderate, and severe OSA. Sleep specialists should use the SBQ to conduct patient interviews for the early diagnosis of OSA in clinical settings, particularly in resource-poor countries and sleep clinics where PSG is unavailable.

Specific Challenges in Conducting and Reporting Studies on the Diagnostic Accuracy of Ultrasonography in Bovine Medicine

Ultrasonography is used by bovine practitioners more for reproductive issues than as a diagnostic test for medical and surgical diseases. This article reviews the specific challenges and standards concerning reporting of studies on diagnostic accuracy of ultrasound in cattle for nonreproductive issues. Specific biases and applicability concerns in studies reporting ultrasonography as a diagnostic test are also reviewed. Better understanding of these challenges will help the practitioner to interpret and apply (or not) diagnostic accuracy study results depending on the field context. Examples of application of sensitivity and specificity results in a clinical context are given using the Bayes theorem.

Diagnostic value of serum squamous cell carcinoma antigen for hepatocellular carcinoma: a systematic review and meta-analysis

The aim of this study was to ascertain the diagnostic value of serum squamous cell carcinoma antigen (SCCA) and SCCA-IgM for hepatocellular carcinoma (HCC). After a comprehensive search of PubMed and Web of Science databases, we identified eligible studies on the diagnostic value serum SCCAs for HCC. The quality of the eligible studies was assessed using the revised Quality Assessment for Studies of Diagnostic Accuracy (QUADAS-2) tool. The overall diagnostic value of SCCAs for HCC was pooled using a bivariate model. Twelve studies were included in this systematic review and meta-analysis. The pooled sensitivities for SCCA and SCCA-IgM were 0.61 (95% confidence interval [CI], 0.37-0.81) and 0.70 (95% CI, 0.55-0.82), respectively. The corresponding specificities were 0.80 (95% CI, 0.52-0.94) and 0.62 (95% CI, 0.51-0.72), respectively. The areas under summary receiver operating characteristic (sROC) curves for SCCA and SCCA-IgM were 0.76 (95% CI, 0.72-0.80) and 0.70 (95% CI, 0.66-0.74), respectively. Major design deficiencies of the included studies were two-gate design and partial verification bias. Therefore, we concluded that both serum SCCA and SCCA-IgM have a fair diagnostic value for HCC.

Diagnostic Value of Methylated Septin9 for Colorectal Cancer Screening: A Meta-Analysis

Background

Septin9 is a member of GTP-binding protein family, and is used as a predictive diagnostic index. However, it has not been widely adopted due to inconsistent results reported in the literature. The present study was performed to determine the diagnostic accuracy of methylated Septin9 (mSEPT9) for colorectal cancer (CRC) and to evaluate its utility in CRC screening.

Material/Methods

After reviewing relevant studies, accuracy measures (pooled sensitivity and specificity, positive/negative likelihood ratio [PLR/NLR], and diagnostic odds ratio [DOR]) were calculated for mSEPT9 in the diagnosis of CRC. Overall test performance was summarized using summary receiver operating characteristic curve analysis. Potential between-study heterogeneity was explored by use of a meta-regression model. We divided included studies into Epi proColon test and non-Epi proColon test subgroups. We compared the effects of mSEPT9 and fecal occult blood test (FOBT) for CRC screening.

Results

A total of 9870 subjects in 14 studies were recruited. Pooled sensitivity and specificity, PLR, NLR, DOR, and corresponding 95% confidence intervals (CI) of mSEPT9 for CRC diagnosis were 0.66 (95% CI: 0.64–0.69), 0.91 (95% CI: 0.90–0.91), 5.59 (95% CI: 4.03–7.74), 0.37 (95% CI: 0.29–0.48), and 16.79 (95% CI: 10.54–26.76), respectively. The area under the summary ROC curve (AUC) was 0.8563. The AUCs in the Epi proColon test and non-Epi proColon test for CRC diagnosis were 0.8709 and 0.7968, respectively. In head-to-head comparison, AUC of mSEPT9 and FOBT for CRC diagnosis were 0.7857 and 0.6571, respectively.

Conclusions

The present study demonstrates that mSEPT9 can be a good diagnostic biomarker complementary to FOBT as a screening tool for CRC.

Objective Measures of Prenatal Alcohol Exposure: A Systematic Review

CONTEXT

Objective measurement of prenatal alcohol exposure (PAE) is essential for identifying children at risk for adverse outcomes, including fetal alcohol spectrum disorders. Biomarkers have been advocated for use in universal screening programs, but their validity has not been comprehensively evaluated.

OBJECTIVE

To systematically review the validity of objective measures of PAE.

DATA SOURCES

Thirteen electronic databases and supplementary sources were searched for studies published between January 1990 and October 2015.

STUDY SELECTION

Eligible studies were those that evaluated the diagnostic accuracy of objective measures of PAE.

DATA EXTRACTION

Three reviewers independently verified study inclusion, quality assessments, and extracted data.

RESULTS

Twelve studies met inclusion criteria. Test performance varied widely across studies of maternal blood (4 studies; sensitivity 0%-100%, specificity 79%-100%), maternal hair (2 studies; sensitivity 19%-87%, specificity 56%-86%) maternal urine (2 studies; sensitivity 5%-15%, specificity 97%-100%), and biomarker test batteries (3 studies; sensitivity 22%-50%, specificity 56%-97%). Tests of the total concentration of 4 fatty acid ethyl esters (in meconium: 2 studies; in placenta: 1 study) demonstrated high sensitivity (82%-100%); however, specificity was variable (13%-98%).

LIMITATIONS

Risk of bias was high due to self-report reference standards and selective outcome reporting.

CONCLUSIONS

Current evidence is insufficient to support the use of objective measures of prenatal alcohol exposure in practice. Biomarkers in meconium and placenta tissue may be the most promising candidates for further large-scale population-based research.

Does the Reporting Quality of Diagnostic Test Accuracy Studies, as Defined by STARD 2015, Affect Citation?

Objective

To determine the rate with which diagnostic test accuracy studies that are published in a general radiology journal adhere to the Standards for Reporting of Diagnostic Accuracy Studies (STARD) 2015, and to explore the relationship between adherence rate and citation rate while avoiding confounding by journal factors.

Materials and Methods

All eligible diagnostic test accuracy studies that were published in the Korean Journal of Radiology in 2011–2015 were identified. Five reviewers assessed each article for yes/no compliance with 27 of the 30 STARD 2015 checklist items (items 28, 29, and 30 were excluded). The total STARD score (number of fulfilled STARD items) was calculated. The score of the 15 STARD items that related directly to the Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 was also calculated. The number of times each article was cited (as indicated by the Web of Science) after publication until March 2016 and the article exposure time (time in months between publication and March 2016) were extracted.

Results

Sixty-three articles were analyzed. The mean (range) total and QUADAS-2-related STARD scores were 20.0 (14.5–25) and 11.4 (7–15), respectively. The mean citation number was 4 (0–21). Citation number did not associate significantly with either STARD score after accounting for exposure time (total score: correlation coefficient = 0.154, p = 0.232; QUADAS-2-related score: correlation coefficient = 0.143, p = 0.266).

Conclusion

The degree of adherence to STARD 2015 was moderate for this journal, indicating that there is room for improvement. When adjusted for exposure time, the degree of adherence did not affect the citation rate.

Diagnostic accuracy of refractometry for assessing bovine colostrum quality: A systematic review and meta-analysis

Provision of good quality colostrum [i.e., immunoglobulin G (IgG) concentration ≥50g/L] is the first step toward ensuring proper passive transfer of immunity for young calves. Precise quantification of colostrum IgG levels cannot be easily performed on the farm. Assessment of the refractive index using a Brix scale with a refractometer has been described as being highly correlated with IgG concentration in colostrum. The aim of this study was to perform a systematic review of the diagnostic accuracy of Brix refractometry to diagnose good quality colostrum. From 101 references initially obtain ed, 11 were included in the systematic review meta-analysis representing 4,251 colostrum samples. The prevalence of good colostrum samples with IgG ≥50g/L varied from 67.3 to 92.3% (median 77.9%). Specific estimates of accuracy [sensitivity (Se) and specificity (Sp)] were obtained for different reported cut-points using a hierarchical summary receiver operating characteristic curve model. For the cut-point of 22% (n=8 studies), Se=80.2% (95% CI: 71.1-87.0%) and Sp=82.6% (71.4-90.0%). Decreasing the cut-point to 18% increased Se [96.1% (91.8-98.2%)] and decreased Sp [54.5% (26.9-79.6%)]. Modeling the effect of these Brix accuracy estimates using a stochastic simulation and Bayes theorem showed that a positive result with the 22% Brix cut-point can be used to diagnose good quality colostrum (posttest probability of a good colostrum: 94.3% (90.7-96.9%). The posttest probability of good colostrum with a Brix value <18% was only 22.7% (12.3-39.2%). Based on this study, the 2 cut-points could be alternatively used to select good quality colostrum (sample with Brix ≥22%) or to discard poor quality colostrum (sample with Brix <18%). When sample results are between these 2 values, colostrum supplementation should be considered.

D-dimer test for excluding the diagnosis of pulmonary embolism

BACKGROUND

Pulmonary embolism (PE) can occur when a thrombus (blood clot) travels through the veins and lodges in the arteries of the lungs, producing an obstruction. People who are thought to be at risk include those with cancer, people who have had a recent surgical procedure or have experienced long periods of immobilisation and women who are pregnant. The clinical presentation can vary, but unexplained respiratory symptoms such as difficulty breathing, chest pain and an increased respiratory rate are common.D-dimers are fragments of protein released into the circulation when a blood clot breaks down as a result of normal body processes or with use of prescribed fibrinolytic medication. The D-dimer test is a laboratory assay currently used to rule out the presence of high D-dimer plasma levels and, by association, venous thromboembolism (VTE). D-dimer tests are rapid, simple and inexpensive and can prevent the high costs associated with expensive diagnostic tests.

OBJECTIVES

To investigate the ability of the D-dimer test to rule out a diagnosis of acute PE in patients treated in hospital outpatient and accident and emergency (A&E) settings who have had a pre-test probability (PTP) of PE determined according to a clinical prediction rule (CPR), by estimating the accuracy of the test according to estimates of sensitivity and specificity. The review focuses on those patients who are not already established on anticoagulation at the time of study recruitment.

SEARCH METHODS

We searched 13 databases from conception until December 2013. We cross-checked the reference lists of relevant studies.

SELECTION CRITERIA

Two review authors independently applied exclusion criteria to full papers and resolved disagreements by discussion.We included cross-sectional studies of D-dimer in which ventilation/perfusion (V/Q) scintigraphy, computerised tomography pulmonary angiography (CTPA), selective pulmonary angiography and magnetic resonance pulmonary angiography (MRPA) were used as the reference standard.•

PARTICIPANTS

Adults who were managed in hospital outpatient and A&E settings and were suspected of acute PE were eligible for inclusion in the review if they had received a pre-test probability score based on a CPR.•

INDEX TESTS

quantitative, semi quantitative and qualitative D-dimer tests.• Target condition: acute symptomatic PE.• Reference standards: We included studies that used pulmonary angiography, V/Q scintigraphy, CTPA and MRPA as reference standard tests.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted data and assessed quality using Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2). We resolved disagreements by discussion. Review authors extracted patient-level data when available to populate 2 × 2 contingency tables (true-positives (TPs), true-negatives (TNs), false-positives (FPs) and false-negatives (FNs)).

MAIN RESULTS

We included four studies in the review (n = 1585 patients). None of the studies were at high risk of bias in any of the QUADAS-2 domains, but some uncertainty surrounded the validity of studies in some domains for which the risk of bias was uncertain. D-dimer assays demonstrated high sensitivity in all four studies, but with high levels of false-positive results, especially among those over the age of 65 years. Estimates of sensitivity ranged from 80% to 100%, and estimates of specificity from 23% to 63%.

AUTHORS' CONCLUSIONS

A negative D-dimer test is valuable in ruling out PE in patients who present to the A&E setting with a low PTP. Evidence from one study suggests that this test may have less utility in older populations, but no empirical evidence was available to support an increase in the diagnostic threshold of interpretation of D-dimer results for those over the age of 65 years.

Discriminative ability of reflex receptive fields to distinguish patients with acute and chronic low back pain

Low back pain has a life time prevalence of 70% to 85%. Approximately 10% to 20% of all patients experience recurrent episodes or develop chronic low back pain. Sociodemographic, clinical, and psychological characteristics explain the transition from acute to chronic low back pain only to a limited extent. Altered central pain processing may be a contributing mechanism. The measurement of reflex receptive fields (RRF) is a novel method to assess altered central pain processing. The RRF area denotes the area of the foot sole from which spinal nociceptive reflexes can be elicited. It was shown to be enlarged in patients with acute and chronic low back pain compared with pain-free individuals. The aim of the study was to explore the discriminative ability of the RRF to distinguish patients with acute and chronic low back pain with the hypothesis that enlarged RRF are associated with chronic low back pain. We included 214 patients with either acute or chronic low back pain and compared RRF between groups in both univariable and multivariable analyses adjusted for different sociodemographic and clinical characteristics possibly associated with the transition to chronic pain. We found a mean difference between patients with acute and chronic low back pain of -0.01 (95% confidence interval [CI], -0.06 to 0.04) in the crude, -0.02 (95% CI, -0.08 to 0.04) in the age and sex adjusted, and -0.02 (95% CI, -0.09 to 0.05) in the fully adjusted model. Our results suggest that the enlargement of RRF area may not be associated with the transition from acute to chronic low back pain.

A meta-analysis of diagnostic accuracy of three screening tools for insomnia

BACKGROUND

Insomnia is a highly prevalent health complaint in the modern societies; however, insomnia remains under-diagnosed and under-treated. Although screening tools, including the Insomnia Severity Index (ISI), Athens Insomnia Scale (AIS), and Pittsburg Sleep Quality Index (PSQI), are widely used for assessing the risk of insomnia, the diagnostic properties have yet to be summarized in a systematic manner.

OBJECTIVES

To estimate and to compare the diagnostic accuracy of the ISI, AIS, and PSQI for insomnia screening.

DATA SOURCES

We systematically searched EMBASE, PubMed, PsycINFO, CINAHL and Chinese Electronic Periodic Services for data from their inception to May 20, 2015.

DATA SELECTION

Original articles that had assessed the sensitivity and specificity of the ISI, AIS, or PSQI against a reference standard in adult participants (age>18) were included.

RESULTS

A total of 19 studies comprising 4693 participants were included. The pooled sensitivity for the ISI, AIS, and PSQI was 88% (95% confidence interval [CI]=0.79 to 0.93), 91% (0.87 to 0.93), and 94% (0.86 to 0.98), respectively. The pooled specificity was 85% (0.68 to 0.94), 87% (0.68 to 0.95), and 76% (0.64 to 0.85); and the pooled DORs was 41.93 (8.77 to 200.33), 67.7 (23.4 to 196.1), and 53 (15.5 to 186.2), respectively. The summary estimates did not differ significantly among the ISI, AIS and PSQI (all P>0.05).

CONCLUSIONS

The current evidence indicates that the ISI, AIS, and PSQI yield comparable diagnostic properties for insomnia screening.

Combination of the non-invasive tests for the diagnosis of endometriosis

BACKGROUND

About 10% of women of reproductive age suffer from endometriosis, a costly chronic disease causing pelvic pain and subfertility. Laparoscopy is the gold standard diagnostic test for endometriosis, but is expensive and carries surgical risks. Currently, there are no non-invasive tests available in clinical practice to accurately diagnose endometriosis. This review assessed the diagnostic accuracy of combinations of different non-invasive testing modalities for endometriosis and provided a summary of all the reviews in the non-invasive tests for endometriosis series.

OBJECTIVES

To estimate the diagnostic accuracy of any combination of non-invasive tests for the diagnosis of pelvic endometriosis (peritoneal and/or ovarian or deep infiltrating) compared to surgical diagnosis as a reference standard. The combined tests were evaluated as replacement tests for diagnostic surgery and triage tests to assist decision-making to undertake diagnostic surgery for endometriosis.

SEARCH METHODS

We did not restrict the searches to particular study designs, language or publication dates. We searched CENTRAL to July 2015, MEDLINE and EMBASE to May 2015, as well as the following databases to April 2015: CINAHL, PsycINFO, Web of Science, LILACS, OAIster, TRIP, ClinicalTrials.gov, DARE and PubMed.

SELECTION CRITERIA

We considered published, peer-reviewed, randomised controlled or cross-sectional studies of any size, including prospectively collected samples from any population of women of reproductive age suspected of having one or more of the following target conditions: ovarian, peritoneal or deep infiltrating endometriosis (DIE). We included studies comparing the diagnostic test accuracy of a combination of several testing modalities with the findings of surgical visualisation of endometriotic lesions.

DATA COLLECTION AND ANALYSIS

Three review authors independently collected and performed a quality assessment of the data from each study by using the QUADAS-2 tool. For each test, the data were classified as positive or negative for the surgical detection of endometriosis and sensitivity and specificity estimates were calculated. The bivariate model was planned to obtain pooled estimates of sensitivity and specificity whenever sufficient data were available. The predetermined criteria for a clinically useful test to replace diagnostic surgery were a sensitivity of 0.94 and a specificity of 0.79 to detect endometriosis. We set the criteria for triage tests at a sensitivity of 0.95 and above and a specificity of 0.50 and above, which 'rules out' the diagnosis with high accuracy if there is a negative test result (SnOUT test), or a sensitivity of 0.50 and above and a specificity of 0.95 and above, which 'rules in' the diagnosis with high accuracy if there is a positive result (SpIN test).

MAIN RESULTS

Eleven eligible studies included 1339 participants. All the studies were of poor methodological quality. Seven studies evaluated pelvic endometriosis, one study considered DIE and/or ovarian endometrioma, two studies differentiated endometrioma from other ovarian cysts and one study addressed mapping DIE at specific anatomical sites. Fifteen different diagnostic combinations were assessed, including blood, urinary or endometrial biomarkers, transvaginal ultrasound (TVUS) and clinical history or examination. We did not pool estimates of sensitivity and specificity, as each study analysed independent combinations of the non-invasive tests.Tests that met the criteria for a replacement test were: a combination of serum IL-6 (cut-off >15.4 pg/ml) and endometrial PGP 9.5 for pelvic endometriosis (sensitivity 1.00 (95% confidence interval (CI) 0.91 to 1.00), specificity 0.93 (95% CI, 0.80, 0.98) and the combination of vaginal examination and transvaginal ultrasound (TVUS) for rectal endometriosis (sensitivity 0.96 (95% CI 0.86 to 0.99), specificity 0.98 (95% CI 0.94 to 1.00)). Tests that met the criteria for SpIN triage tests for pelvic endometriosis were: 1. a multiplication of urine vitamin-D-binding protein (VDBP) and serum CA-125 (cut-off >2755) (sensitivity 0.74 (95% CI 0.60 to 0.84), specificity 0.97 (95% CI 0.86 to 1.00)) and 2. a combination of history (length of menses), serum CA-125 (cut-off >35 U/ml) and endometrial leukocytes (sensitivity 0.61 (95% CI 0.54 to 0.69), specificity 0.95 (95% CI 0.91 to 0.98)). For endometrioma, the following combinations qualified as SpIN test: 1. TVUS and either serum CA-125 (cut-off ≥25 U/ml) or CA 19.9 (cut-off ≥12 U/ml) (sensitivity 0.79 (95% CI 0.64 to 0.91), specificity 0.97 (95% CI 0.91 to 1.00)); 2. TVUS and serum CA 19.9 (cut-off ≥12 U/ml) (sensitivity 0.54 (95% CI 0.37 to 0.70), specificity 0.97 (95% CI 0.91 to 1.0)); 3-4. TVUS and serum CA-125 (cut-off ≥20 U/ml or cut-off ≥25 U/ml) (sensitivity 0.69 (95% CI 0.49 to 0.85), specificity 0.96 (95% CI 0.88 to 0.99)); 5. TVUS and serum CA-125 (cut-off ≥35 U/ml) (sensitivity 0.52 (95% CI 0.33 to 0.71), specificity 0.97 (95% CI 0.90 to 1.00)). A combination of vaginal examination and TVUS reached the threshold for a SpIN test for obliterated pouch of Douglas (sensitivity 0.87 (95% CI 0.69 to 0.96), specificity 0.98 (95% CI 0.95 to 1.00)), vaginal wall endometriosis (sensitivity 0.82 (95% CI 0.60 to 0.95), specificity 0.99 (95% CI 0.97 to 1.0)) and rectovaginal septum endometriosis (sensitivity 0.88 (95% CI 0.47 to 1.00), specificity 0.99 (95% CI 0.96 to 1.00)).All the tests were evaluated in individual studies and displayed wide CIs. Due to the heterogeneity and high risk of bias of the included studies, the clinical utility of the studied combination diagnostic tests for endometriosis remains unclear.

AUTHORS' CONCLUSIONS

None of the biomarkers evaluated in this review could be evaluated in a meaningful way and there was insufficient or poor-quality evidence. Laparoscopy remains the gold standard for the diagnosis of endometriosis and using any non-invasive tests should only be undertaken in a research setting.

Systematic Review of the Diagnostic Accuracy of Haptoglobin, Serum Amyloid A, and Fibrinogen versus Clinical Reference Standards for the Diagnosis of Bovine Respiratory Disease

BACKGROUND

Bovine respiratory disease (BRD) is a worldwide animal health concern especially in feedlot, dairy, and veal calves. One of the greatest challenges is the absence of a gold standard for achieving an accurate antemortem diagnosis. Various blood markers, including the acute-phase proteins (AAP), have been proposed as potential valuable tools for BRD diagnosis.

OBJECTIVES

To perform a systematic review of the literature to assess the accuracy of selected APP (haptoglobin [Hp], serum amyloid A [SAA], and fibrinogen [Fb]) as diagnostic tools for cattle with naturally occurring BRD when compared with clinical reference standards of diagnosis.

METHODS

This review was performed with eligible studies selected from CAB Abstract and MEDLINE from 1946 to 2015, as well as the "gray literature." Methodological quality of included studies was assessed using the QUADAS-2 tool developed for diagnostic accuracy studies. The accuracy parameters sensitivity (Se) and specificity (Sp) were obtained from the articles or through contact with the authors when not directly reported.

RESULTS

A total of 314 studies were identified, from them, 23 met inclusion criteria as diagnostic studies for naturally occurring BRD. Quality of studies showed high risk of bias for case selection (70% of articles) and unclear risk of bias for index test (65%), reference standard (74%), and flow and timing (61%). There were high concerns regarding applicability for case selection (61% of studies) and reference standards used for defining BRD (48%). The concerns regarding index test application were low (83% of the studies). Only 4-8 studies could be included in the meta-analysis for each APP. No pooled estimates or pooled accuracy measurements were performed due to the low number of studies and multiple differences between studies, including reference standard definitions.

CONCLUSIONS AND CLINICAL IMPORTANCE

On the basis of these findings, it is not possible to make conclusions regarding the accuracy of APP for BRD diagnosis. The reporting of accuracy of APP for BRD detection is inconsistent among studies. Recommendations to improve capability for future meta-analyses in this area include reporting studies on diagnostic tests following the Standard for the Reporting of Diagnostic Accuracy Studies (STARD), as well as trying to standardize BRD definition across future studies.

Incremental Value (Bayesian Framework) of Thoracic Ultrasonography over Thoracic Auscultation for Diagnosis of Bronchopneumonia in Preweaned Dairy Calves

Background

Thoracic ultrasonography (TUS) is a specific and relatively sensitive method to diagnose bronchopneumonia (BP) in dairy calves. Unfortunately, as it requires specific training and equipment, veterinarians typically base their diagnosis on thoracic auscultation (AUSC), which is rapid and easy to perform.

Hypothesis/Objectives

We hypothesized that the use of TUS, in addition to AUSC, can significantly increase accuracy of BP diagnosis. Therefore, the objectives were to (i) determine the incremental value of TUS over AUSC for diagnosis of BP in preweaned dairy calves and (ii) assess diagnostic accuracy of AUSC.

Animals

Two hundred and nine dairy calves (<1 month of age) were enrolled in this cross‐sectional study.

Methods

Prospective cross‐sectional study. All calves from a veal calves unit were examined (independent operators) using the Wisconsin Calf Respiratory Scoring Criteria (CRSC), AUSC, and TUS. A Bayesian latent class approach was used to estimate the incremental value of AUSC over TUS (integrated discrimination improvement [IDI]) and the diagnostic accuracy of AUSC.

Results

Abnormal CRSC, AUSC, and TUS were recorded in 3.3, 53.1, and 23.9% of calves, respectively. AUSC was sensitive (72.9%; 95% Bayesian credible interval [BCI]: 50.1–96.4%), but not specific (53.3%; 95% BCI: 43.3–64.0%) to diagnose BP. Compared to AUSC, TUS was more specific (92.9%; 95% BCI: 86.5–97.1%), but had similar sensitivity (76.5%; 95% BCI: 60.2–88.8%). The incremental value of TUS over AUSC was high (IDI = 43.7%; 5% BCI: 22.0–63.0%) significantly improving proportions of sick and healthy calves appropriately classified.

Conclusions and Clinical Importance

The use of TUS over AUSC significantly improved accuracy of BP diagnosis in dairy calves.

The value of antibody-coated bacteria in tracheal aspirates for the diagnosis of ventilator-associated pneumonia: a case-control study

Objective:

Ventilator-associated pneumonia (VAP) is the leading type of hospital-acquired infection in ICU patients. The diagnosis of VAP is challenging, mostly due to limitations of the diagnostic methods available. The aim of this study was to determine whether antibody-coated bacteria (ACB) evaluation can improve the specificity of endotracheal aspirate (EA) culture in VAP diagnosis.

Methods:

We conducted a diagnostic case-control study, enrolling 45 patients undergoing mechanical ventilation. Samples of EA were obtained from patients with and without VAP (cases and controls, respectively), and we assessed the number of bacteria coated with FITC-conjugated monoclonal antibodies (IgA, IgM, or IgG) or an FITC-conjugated polyvalent antibody. Using immunofluorescence microscopy, we determined the proportion of ACB among a fixed number of 80 bacteria.

Results:

The median proportions of ACB were significantly higher among the cases (n = 22) than among the controls (n = 23)-IgA (60.6% vs. 22.5%), IgM (42.5% vs. 12.5%), IgG (50.6% vs. 17.5%), and polyvalent (75.6% vs. 33.8%)-p < 0.001 for all. The accuracy of the best cut-off points for VAP diagnosis regarding monoclonal and polyvalent ACBs was greater than 95.0% and 93.3%, respectively.

Conclusions:

The numbers of ACB in EA samples were higher among cases than among controls. Our findings indicate that evaluating ACB in EA is a promising tool to improve the specificity of VAP diagnosis. The technique could be cost-effective and therefore useful in low-resource settings, with the advantages of minimizing false-positive results and avoiding overtreatment.

Meta-epidemiologic study showed frequent time trends in summary estimates from meta-analyses of diagnostic accuracy studies

OBJECTIVES

To evaluate changes over time in summary estimates from meta-analyses of diagnostic accuracy studies.

STUDY DESIGN AND SETTING

We included 48 meta-analyses from 35 MEDLINE-indexed systematic reviews published between September 2011 and January 2012 (743 diagnostic accuracy studies; 344,015 participants). Within each meta-analysis, we ranked studies by publication date. We applied random-effects cumulative meta-analysis to follow how summary estimates of sensitivity and specificity evolved over time. Time trends were assessed by fitting a weighted linear regression model of the summary accuracy estimate against rank of publication.

RESULTS

The median of the 48 slopes was -0.02 (-0.08 to 0.03) for sensitivity and -0.01 (-0.03 to 0.03) for specificity. Twelve of 96 (12.5%) time trends in sensitivity or specificity were statistically significant. We found a significant time trend in at least one accuracy measure for 11 of the 48 (23%) meta-analyses.

CONCLUSION

Time trends in summary estimates are relatively frequent in meta-analyses of diagnostic accuracy studies. Results from early meta-analyses of diagnostic accuracy studies should be considered with caution.

Blood biomarkers for the non-invasive diagnosis of endometriosis

BACKGROUND

About 10% of reproductive-aged women suffer from endometriosis, a costly chronic disease causing pelvic pain and subfertility. Laparoscopy is the gold standard diagnostic test for endometriosis, but is expensive and carries surgical risks. Currently, there are no non-invasive or minimally invasive tests available in clinical practice to accurately diagnose endometriosis. Although other reviews have assessed the ability of blood tests to diagnose endometriosis, this is the first review to use Cochrane methods, providing an update on the rapidly expanding literature in this field.

OBJECTIVES

To evaluate blood biomarkers as replacement tests for diagnostic surgery and as triage tests to inform decisions on surgery for endometriosis. Specific objectives include:1. To provide summary estimates of the diagnostic accuracy of blood biomarkers for the diagnosis of peritoneal, ovarian and deep infiltrating pelvic endometriosis, compared to surgical diagnosis as a reference standard.2. To assess the diagnostic utility of biomarkers that could differentiate ovarian endometrioma from other ovarian masses.

SEARCH METHODS

We did not restrict the searches to particular study designs, language or publication dates. We searched CENTRAL to July 2015, MEDLINE and EMBASE to May 2015, as well as these databases to 20 April 2015: CINAHL, PsycINFO, Web of Science, LILACS, OAIster, TRIP, ClinicalTrials.gov, DARE and PubMed.

SELECTION CRITERIA

We considered published, peer-reviewed, randomised controlled or cross-sectional studies of any size, including prospectively collected samples from any population of reproductive-aged women suspected of having one or more of the following target conditions: ovarian, peritoneal or deep infiltrating endometriosis (DIE). We included studies comparing the diagnostic test accuracy of one or more blood biomarkers with the findings of surgical visualisation of endometriotic lesions.

DATA COLLECTION AND ANALYSIS

Two authors independently collected and performed a quality assessment of data from each study. For each diagnostic test, we classified the data as positive or negative for the surgical detection of endometriosis, and we calculated sensitivity and specificity estimates. We used the bivariate model to obtain pooled estimates of sensitivity and specificity whenever sufficient datasets were available. The predetermined criteria for a clinically useful blood test to replace diagnostic surgery were a sensitivity of 0.94 and a specificity of 0.79 to detect endometriosis. We set the criteria for triage tests at a sensitivity of ≥ 0.95 and a specificity of ≥ 0.50, which 'rules out' the diagnosis with high accuracy if there is a negative test result (SnOUT test), or a sensitivity of ≥ 0.50 and a specificity of ≥ 0.95, which 'rules in' the diagnosis with high accuracy if there is a positive result (SpIN test).

MAIN RESULTS

We included 141 studies that involved 15,141 participants and evaluated 122 blood biomarkers. All the studies were of poor methodological quality. Studies evaluated the blood biomarkers either in a specific phase of the menstrual cycle or irrespective of the cycle phase, and they tested for them in serum, plasma or whole blood. Included women were a selected population with a high frequency of endometriosis (10% to 85%), in which surgery was indicated for endometriosis, infertility work-up or ovarian mass. Seventy studies evaluated the diagnostic performance of 47 blood biomarkers for endometriosis (44 single-marker tests and 30 combined tests of two to six blood biomarkers). These were angiogenesis/growth factors, apoptosis markers, cell adhesion molecules, high-throughput markers, hormonal markers, immune system/inflammatory markers, oxidative stress markers, microRNAs, tumour markers and other proteins. Most of these biomarkers were assessed in small individual studies, often using different cut-off thresholds, and we could only perform meta-analyses on the data sets for anti-endometrial antibodies, interleukin-6 (IL-6), cancer antigen-19.9 (CA-19.9) and CA-125. Diagnostic estimates varied significantly between studies for each of these biomarkers, and CA-125 was the only marker with sufficient data to reliably assess sources of heterogeneity.The mean sensitivities and specificities of anti-endometrial antibodies (4 studies, 759 women) were 0.81 (95% confidence interval (CI) 0.76 to 0.87) and 0.75 (95% CI 0.46 to 1.00). For IL-6, with a cut-off value of > 1.90 to 2.00 pg/ml (3 studies, 309 women), sensitivity was 0.63 (95% CI 0.52 to 0.75) and specificity was 0.69 (95% CI 0.57 to 0.82). For CA-19.9, with a cut-off value of > 37.0 IU/ml (3 studies, 330 women), sensitivity was 0.36 (95% CI 0.26 to 0.45) and specificity was 0.87 (95% CI 0.75 to 0.99).Studies assessed CA-125 at different thresholds, demonstrating the following mean sensitivities and specificities: for cut-off > 10.0 to 14.7 U/ml: 0.70 (95% CI 0.63 to 0.77) and 0.64 (95% CI 0.47 to 0.82); for cut-off > 16.0 to 17.6 U/ml: 0.56 (95% CI 0.24, 0.88) and 0.91 (95% CI 0.75, 1.00); for cut-off > 20.0 U/ml: 0.67 (95% CI 0.50 to 0.85) and 0.69 (95% CI 0.58 to 0.80); for cut-off > 25.0 to 26.0 U/ml: 0.73 (95% CI 0.67 to 0.79) and 0.70 (95% CI 0.63 to 0.77); for cut-off > 30.0 to 33.0 U/ml: 0.62 (95% CI 0.45 to 0.79) and 0.76 (95% CI 0.53 to 1.00); and for cut-off > 35.0 to 36.0 U/ml: 0.40 (95% CI 0.32 to 0.49) and 0.91 (95% CI 0.88 to 0.94).We could not statistically evaluate other biomarkers meaningfully, including biomarkers that were assessed for their ability to differentiate endometrioma from other benign ovarian cysts.Eighty-two studies evaluated 97 biomarkers that did not differentiate women with endometriosis from disease-free controls. Of these, 22 biomarkers demonstrated conflicting results, with some studies showing differential expression and others no evidence of a difference between the endometriosis and control groups.

AUTHORS' CONCLUSIONS

Of the biomarkers that were subjected to meta-analysis, none consistently met the criteria for a replacement or triage diagnostic test. A subset of blood biomarkers could prove useful either for detecting pelvic endometriosis or for differentiating ovarian endometrioma from other benign ovarian masses, but there was insufficient evidence to draw meaningful conclusions. Overall, none of the biomarkers displayed enough accuracy to be used clinically outside a research setting. We also identified blood biomarkers that demonstrated no diagnostic value in endometriosis and recommend focusing research resources on evaluating other more clinically useful biomarkers.

Endometrial biomarkers for the non-invasive diagnosis of endometriosis

BACKGROUND

About 10% of reproductive-aged women suffer from endometriosis, which is a costly, chronic disease that causes pelvic pain and subfertility. Laparoscopy is the gold standard diagnostic test for endometriosis, but it is expensive and carries surgical risks. Currently, there are no non-invasive tests available in clinical practice that accurately diagnose endometriosis. This is the first diagnostic test accuracy review of endometrial biomarkers for endometriosis that utilises Cochrane methodologies, providing an update on the rapidly expanding literature in this field.

OBJECTIVES

To determine the diagnostic accuracy of the endometrial biomarkers for pelvic endometriosis, using a surgical diagnosis as the reference standard. We evaluated the tests as replacement tests for diagnostic surgery and as triage tests to inform decisions to undertake surgery for endometriosis.

SEARCH METHODS

We did not restrict the searches to particular study designs, language or publication dates. To identify trials, we searched the following databases: CENTRAL (2015, July), MEDLINE (inception to May 2015), EMBASE (inception to May 2015), CINAHL (inception to April 2015), PsycINFO (inception to April 2015), Web of Science (inception to April 2015), LILACS (inception to April 2015), OAIster (inception to April 2015), TRIP (inception to April 2015) and ClinicalTrials.gov (inception to April 2015). We searched DARE and PubMed databases up to April 2015 to identify reviews and guidelines as sources of references to potentially relevant studies. We also performed searches for papers recently published and not yet indexed in the major databases. The search strategies incorporated words in the title, abstract, text words across the record and the medical subject headings (MeSH).

SELECTION CRITERIA

We considered published peer-reviewed, randomised controlled or cross-sectional studies of any size that included prospectively collected samples from any population of reproductive-aged women suspected of having one or more of the following target conditions: ovarian, peritoneal or deep infiltrating endometriosis (DIE).

DATA COLLECTION AND ANALYSIS

Two authors independently extracted data from each study and performed a quality assessment. For each endometrial diagnostic test, we classified the data as positive or negative for the surgical detection of endometriosis and calculated the estimates of sensitivity and specificity. We considered two or more tests evaluated in the same cohort as separate data sets. We used the bivariate model to obtain pooled estimates of sensitivity and specificity whenever sufficient data were available. The predetermined criteria for a clinically useful test to replace diagnostic surgery was one with a sensitivity of 94% and a specificity of 79%. The criteria for triage tests were set at sensitivity at or above 95% and specificity at or above 50%, which in case of negative results rules out the diagnosis (SnOUT test) or sensitivity at or above 50% with specificity at or above 95%, which in case of positive result rules in the diagnosis (SpIN test).

MAIN RESULTS

We included 54 studies involving 2729 participants, most of which were of poor methodological quality. The studies evaluated endometrial biomarkers either in specific phases of the menstrual cycle or outside of it, and the studies tested the biomarkers either in menstrual fluid, in whole endometrial tissue or in separate endometrial components. Twenty-seven studies evaluated the diagnostic performance of 22 endometrial biomarkers for endometriosis. These were angiogenesis and growth factors (PROK-1), cell-adhesion molecules (integrins α3β1, α4β1, β1 and α6), DNA-repair molecules (hTERT), endometrial and mitochondrial proteome, hormonal markers (CYP19, 17βHSD2, ER-α, ER-β), inflammatory markers (IL-1R2), myogenic markers (caldesmon, CALD-1), neural markers (PGP 9.5, VIP, CGRP, SP, NPY, NF) and tumour markers (CA-125). Most of these biomarkers were assessed in single studies, whilst only data for PGP 9.5 and CYP19 were available for meta-analysis. These two biomarkers demonstrated significant diversity for the diagnostic estimates between the studies; however, the data were too limited to reliably determine the sources of heterogeneity. The mean sensitivities and specificities of PGP 9.5 (7 studies, 361 women) were 0.96 (95% confidence interval (CI) 0.91 to 1.00) and 0.86 (95% CI 0.70 to 1.00), after excluding one outlier study, and for CYP19 (8 studies, 444 women), they were were 0.77 (95% CI 0.70 to 0.85) and 0.74 (95% CI 0.65 to 84), respectively. We could not statistically evaluate other biomarkers in a meaningful way. An additional 31 studies evaluated 77 biomarkers that showed no evidence of differences in expression levels between the groups of women with and without endometriosis.

AUTHORS' CONCLUSIONS

We could not statistically evaluate most of the biomarkers assessed in this review in a meaningful way. In view of the low quality of most of the included studies, the findings of this review should be interpreted with caution. Although PGP 9.5 met the criteria for a replacement test, it demonstrated considerable inter study heterogeneity in diagnostic estimates, the source of which could not be determined. Several endometrial biomarkers, such as endometrial proteome, 17βHSD2, IL-1R2, caldesmon and other neural markers (VIP, CGRP, SP, NPY and combination of VIP, PGP 9.5 and SP) showed promising evidence of diagnostic accuracy, but there was insufficient or poor quality evidence for any clinical recommendations. Laparoscopy remains the gold standard for the diagnosis of endometriosis, and using any non-invasive tests should only be undertaken in a research setting. We have also identified a number of biomarkers that demonstrated no diagnostic value for endometriosis. We recommend that researchers direct future studies towards biomarkers with high diagnostic potential in good quality diagnostic studies.

Biomarker Case-Detection and Prediction with Potential for Functional Psychosis Screening: Development and Validation of a Model Related to Biochemistry, Sensory Neural Timing and End Organ Performance

The Mental Health Biomarker Project aimed to discover case-predictive biomarkers for functional psychosis. In a retrospective, cross-sectional study, candidate marker results from 67 highly characterized symptomatic participants were compared with results from 67 gender- and age-matched controls. Urine samples were analyzed for catecholamines, their metabolites, and hydroxylpyrolline-2-one, an oxidative stress marker. Blood samples were analyzed for vitamin and trace element cofactors of enzymes in catecholamine synthesis and metabolism pathways. Cognitive, auditory, and visual processing measures were assessed using a simple 45-min, office-based procedure. Receiver operating curve (ROC) and odds ratio analysis discovered biomarkers for deficits in folate, vitamin D and B6 and elevations in free copper to zinc ratio, catecholamines and the oxidative stress marker. Deficits were discovered in peripheral visual and auditory end-organ function, intracerebral auditory and visual processing speed and dichotic listening performance. Fifteen ROC biomarker variables were divided into five functional domains. Through a repeated ROC process, individual ROC variables, followed by domains and finally the overall 15 set model, were dichotomously scored and tallied for abnormal results upon which it was found that ≥3 out of 5 abnormal domains achieved an area under the ROC curve of 0.952 with a sensitivity of 84% and a specificity of 90%. Six additional middle ear biomarkers in a 21 biomarker set increased sensitivity to 94%. Fivefold cross-validation yielded a mean sensitivity of 85% for the 15 biomarker set. Non-parametric regression analysis confirmed that ≥3 out of 5 abnormally scored domains predicted >50% risk of caseness while 4 abnormally scored domains predicted 88% risk of caseness; 100% diagnostic certainty was reached when all 5 domains were abnormally scored. These findings require validation in prospective cohorts and other mental illness states. They have potential for case-detection, -screening, -monitoring, and -targeted personalized management. The findings unmask unmet needs within the functional psychosis condition and suggest new biological understandings of psychosis phenomenology.

Reporting Weaknesses in Conference Abstracts of Diagnostic Accuracy Studies in Ophthalmology

IMPORTANCE

Conference abstracts present information that helps clinicians and researchers to decide whether to attend a presentation. They also provide a source of unpublished research that could potentially be included in systematic reviews. We systematically assessed whether conference abstracts of studies that evaluated the accuracy of a diagnostic test were sufficiently informative.

OBSERVATIONS

We identified all abstracts describing work presented at the 2010 Annual Meeting of the Association for Research in Vision and Ophthalmology. Abstracts were eligible if they included a measure of diagnostic accuracy, such as sensitivity, specificity, or likelihood ratios. Two independent reviewers evaluated each abstract using a list of 21 items, selected from published guidance for adequate reporting. A total of 126 of 6310 abstracts presented were eligible. Only a minority reported inclusion criteria (5%), clinical setting (24%), patient sampling (10%), reference standard (48%), whether test readers were masked (7%), 2 × 2 tables (16%), and confidence intervals around accuracy estimates (16%). The mean number of items reported was 8.9 of 21 (SD, 2.1; range, 4-17).

CONCLUSIONS AND RELEVANCE

Crucial information about study methods and results is often missing in abstracts of diagnostic studies presented at the Association for Research in Vision and Ophthalmology Annual Meeting, making it difficult to assess risk for bias and applicability to specific clinical settings.

The diagnostic accuracy of serological tests for Lyme borreliosis in Europe: a systematic review and meta-analysis

Background

Interpretation of serological assays in Lyme borreliosis requires an understanding of the clinical indications and the limitations of the currently available tests. We therefore systematically reviewed the accuracy of serological tests for the diagnosis of Lyme borreliosis in Europe.

Methods

We searched EMBASE en MEDLINE and contacted experts. Studies evaluating the diagnostic accuracy of serological assays for Lyme borreliosis in Europe were eligible. Study selection and data-extraction were done by two authors independently. We assessed study quality using the QUADAS-2 checklist. We used a hierarchical summary ROC meta-regression method for the meta-analyses. Potential sources of heterogeneity were test-type, commercial or in-house, Ig-type, antigen type and study quality. These were added as covariates to the model, to assess their effect on test accuracy.

Results

Seventy-eight studies evaluating an Enzyme-Linked ImmunoSorbent assay (ELISA) or an immunoblot assay against a reference standard of clinical criteria were included. None of the studies had low risk of bias for all QUADAS-2 domains. Sensitivity was highly heterogeneous, with summary estimates: erythema migrans 50 % (95 % CI 40 % to 61 %); neuroborreliosis 77 % (95 % CI 67 % to 85 %); acrodermatitis chronica atrophicans 97 % (95 % CI 94 % to 99 %); unspecified Lyme borreliosis 73 % (95 % CI 53 % to 87 %). Specificity was around 95 % in studies with healthy controls, but around 80 % in cross-sectional studies. Two-tiered algorithms or antibody indices did not outperform single test approaches.

Conclusions

The observed heterogeneity and risk of bias complicate the extrapolation of our results to clinical practice. The usefulness of the serological tests for Lyme disease depends on the pre-test probability and subsequent predictive values in the setting where the tests are being used. Future diagnostic accuracy studies should be prospectively planned cross-sectional studies, done in settings where the test will be used in practice.

The diagnostic accuracy of the hand-held Raman spectrometer for the identification of anti-malarial drugs

Background

There is a need for accurate and field-applicable instruments for the evaluation of the quality of anti-malarial drugs. The aim of this study was to determine the diagnostic accuracy of the NanoRam^®, a handheld Raman spectrometer (RS), to identify anti-malarial drugs.

Methods

In total, 289 anti-malarial drugs collected in a randomized field survey in Gabon were evaluated. The samples were compared with authentic products as supplied by the official manufacturer. To determine the sensitivity and specificity of the handheld NanoRam^® spectrometer in the identification of anti-malarial drugs, a two-gate reversed-flow design was applied. The standards for reporting of diagnostic accuracy studies (STARD) were followed. The index test was the handheld RS. The reference test standards were thin layer chromatography and high performance liquid chromatography with ultraviolet photo diode array detection.

Results

The sensitivity [95 % confidence interval (95 % CI)] and specificity of the RS to correctly identify an anti-malarial drug were 100 % (95 % CI 94.9–100 %) and 96 % (95 % CI 92.3–99.0 %), respectively. The RS could not differentiate between different batches of the same product or different manufacturers of the same product. Intra-observer agreement for 289 samples was 100 %. The average time to conduct the RS was 15 s per sample compared to 45 min per sample for TLC.

Conclusion

The handheld RS holds promise as an easy-to-use, quick and field-applicable instrument for the evaluation of quality of anti-malarial drugs, potentially empowering pharmacists, drug inspectors and medical regulatory authorities.

Trial registration NTR4341 (Dutch Trial Registry)

Electronic supplementary material

The online version of this article (doi:10.1186/s12936-016-1212-y) contains supplementary material, which is available to authorized users.