Systematic reviews of diagnostic test accuracy

CT-Defined Coronary Artery Calcification as a Prognostic Marker for Overall Survival in Lung Cancer: A Systematic Review and Meta-analysis

RATIONALE AND OBJECTIVES

Coronary artery calcification (CAC) can be quantified by computed tomography (CT). It is an important predictive and prognostic imaging marker for cardiovascular disease. The prognostic role for CAC in oncological patients is provided in preliminary studies, especially in lung cancer patients. The aim of the present study was to establish the effect of CAC score on overall survival (OS) in lung cancer patients based on the published literature MATERIALS AND METHODS: Literature databases were screened for papers analyzing the association between CAC and overall survival in lung cancer patients up to June 2024. The primary endpoint of the present systematic review was the OS. Overall, seven studies were suitable for the analysis and were included.

RESULTS

The included studies comprised 2292 patients undergoing curative treatment. The pooled hazard ratio for the association between CAC score and OS was HR= 1.42 (95% CI=(1.19; 1.69), p < 0.0001) in the univariable analysis and HR= 1.56 (95% CI=(1.25; 1.94), p < 0.0001) in the multivariable analysis. The pooled odds ratio for the association between CAC score and major cardiovascular events was OR= 1.97 (95% CI=(1.24; 3.13)], p = 0.004.

CONCLUSION

CT-defined CAC has a meaningful impact on overall survival and prediction of major cardiovascular events in lung cancer patients undergoing curative treatment. The sole presence of CAC on staging CT should be reported as an important prognostic marker in these patients.

Adherence to mask-wearing and its impact on the incidence and deaths of viral respiratory infectious diseases: a systematic review, meta-analysis and modelling study

BACKGROUND

This study systematically analysed global and regional adherence to mask-wearing and its impact on the incidence and deaths of viral respiratory infectious diseases (VRIDs).

METHODS

Relevant studies were sourced from PubMed, Web of Science, Embase and Scopus. We included observational studies with available raw data on mask-wearing adherence (rates of acceptability of mask-wearing, mask-wearing in public settings and correct mask-wearing) during VRID pandemics/epidemics. The COVID-19-related incidence and deaths were sourced from Global Burden of Diseases 2021. The quality of each study was assessed using the Agency for Healthcare Research and Quality Scale. Pooled rates and effects of mask-wearing were calculated using random effects models and generalised linear models.

RESULTS

We included 448 studies from 70 countries/regions. During the VRID pandemics/epidemics, global pooled rates for the acceptability of mask-wearing, mask-wearing in public settings and correct mask-wearing were 65.27% (95% CI 60.34% to 70.05%), 74.67% (95% CI 69.17% to 79.8%) and 63.63% (95% CI 59.28% to 67.87%), respectively. In individuals with chronic diseases/elderly/pregnant women, the rates of acceptability (42.54%) and correct mask-wearing (60.56%) were both low. Among the general population, the rates of mask-wearing in public settings (68.2%) and correct mask-wearing (57.45%) were the lowest. During the COVID-19 pandemic, countries with a requirement for mask-wearing exhibited a higher rate in public settings (76.10% vs 58.32%), especially in regions with more stringent containment and health measures (β=0.86, p=0.008). The mask-wearing in public settings has been found to significantly reduce the COVID-19 incidence (β=-265.26, p=0.004), COVID-19 deaths (β=-2.04, p<0.001) and other COVID-19 pandemic-related deaths (β=-0.83, p<0.001).

CONCLUSION

During the VRID pandemics/epidemics, adherence to mask-wearing was relatively low. Implementing policies requiring mask-wearing during the pandemic could enhance the mask-wearing rate, potentially leading to a significant reduction in VRID-related incidence and deaths.

TRIAL REGISTRATION NUMBER

CRD42024496464.

Procalcitonin and presepsin for detecting bacterial infection and spontaneous bacterial peritonitis in cirrhosis: A systematic review and meta-analysis

BACKGROUND

Diagnosing bacterial infections (BI) in patients with cirrhosis can be challenging because of unclear symptoms, low diagnostic accuracy, and lengthy culture testing times. Various biomarkers have been studied, including serum procalcitonin (PCT) and presepsin. However, the diagnostic performance of these markers remains unclear, requiring further informative studies to ascertain their diagnostic value.

AIM

To evaluate the pooled diagnostic performance of PCT and presepsin in detecting BI among patients with cirrhosis.

METHODS

We performed a systematic search of the MEDLINE, EMBASE, and Scopus databases for studies that evaluated the diagnostic role of PCT and presepsin from inception to June 2024. Sensitivity and specificity values were pooled using a random effects model. BI was diagnosed based on clinical manifestations, physical examination, laboratory data, and radiological findings.

RESULTS

Of the 6639 articles retrieved, 28 met the inclusion criteria and included 4287 patients with 1789 cases of BI (41.7%). The bivariate pooled sensitivity and specificity estimates of PCT for BI diagnosis were 0.73 [95% confidence interval (CI): 0.64-0.81] and 0.83 (95%CI: 0.79-0.87), respectively. The diagnostic odds ratio (DOR) of PCT was 17.21 (95%CI: 9.57-30.95). Presepsin showed a pooled sensitivity of 0.75 (95%CI: 0.60-0.86), specificity of 0.80 (95%CI: 0.68-0.88), and DOR of 12.33 (95%CI: 5.10-29.83) for diagnosing BI. The pooled sensitivity and specificity of PCT for diagnosing spontaneous bacterial peritonitis (SBP) were 0.76 (95%CI: 0.67-0.84) and 0.87 (95%CI: 0.78-0.92), respectively. The positive likelihood ratio of PCT was 5.57 (95%CI: 3.34-9.29), which was sufficiently indicative of SBP. The DOR of PCT was 29.50 (95%CI: 12.30-70.80).

CONCLUSION

PCT and presepsin have high sensitivity and specificity for detecting BI in patients with cirrhosis. Furthermore, PCT has good diagnostic value as a rule-in test for SBP diagnosis.

Prognostic accuracy of point-of-care ultrasound in patients with pulseless electrical activity: a systematic review and meta-analysis

BACKGROUND

The prognosis for pulseless electrical activity (PEA) is typically poor; however, patients with cardiac activity observed on point-of-care ultrasound (POCUS) tend to have better outcomes compared to those without. This systematic review and meta-analysis were conducted to assess the prognostic accuracy of cardiac activity detected by POCUS in predicting resuscitation outcomes in patients experiencing PEA.

METHODS

A comprehensive literature search was conducted in PubMed, Embase, and the Cochrane Central Register of Controlled Trials to identify relevant studies. The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio, and the area under the summary receiver operating characteristic curve (SROC) were calculated using the bivariate model.

RESULTS

Eighteen studies comprising 1202 patients were included in the meta-analysis. Cardiac activity observed on POCUS demonstrated a pooled sensitivity of 0.86 (95% CI 0.67-0.95) and specificity of 0.64 (95% CI 0.51-0.75) for predicting return of spontaneous circulation, a pooled sensitivity of 0.89 (95% CI 0.80-0.94) and specificity of 0.73 (95% CI 0.63-0.81) for survival to admission (SHA), and a pooled sensitivity of 0.79 (95% CI 0.58-0.91) and specificity of 0.58 (95% CI 0.47-0.68) for survival to discharge. The highest area under the SROC, 0.89 (95% CI 0.86-0.92), was observed for SHA.

CONCLUSIONS

Our study suggests that POCUS may serve as a vital component of a multimodal approach for early termination of resuscitation.

Prevalence and prognostic role of thoracic lymphadenopathy in Covid-19

PURPOSE

 The prevalent coronavirus disease 2019 (COVID-19) pandemic has spread throughout the world and is considered a serious threat to global health. The prognostic role of thoracic lymphadenopathy in COVID-19 is unclear. The aim of the present meta-analysis was to analyze the prognostic role of thoracic lymphadenopathy for the prediction of 30-day mortality in patients with COVID-19.

MATERIALS AND METHODS

 The MEDLINE library, Cochrane, and SCOPUS databases were screened for associations between CT-defined features and mortality in COVID-19 patients up to June 2021. In total, 21 studies were included in the present analysis. The quality of the included studies was assessed by the Newcastle-Ottawa Scale. The meta-analysis was performed using RevMan 5.3. Heterogeneity was calculated by means of the inconsistency index I2. DerSimonian and Laird random-effect models with inverse variance weights were performed without any further correction.

RESULTS

 The included studies comprised 4621 patients. The prevalence of thoracic lymphadenopathy varied between 1 % and 73.4 %. The pooled prevalence was 16.7 %, 95 % CI = (15.6 %; 17.8 %). The hospital mortality was higher in patients with thoracic lymphadenopathy (34.7 %) than in patients without (20.0 %). The pooled odds ratio for the influence of thoracic lymphadenopathy on mortality was 2.13 (95 % CI = [1.80-2.52], p < 0.001).

CONCLUSION

 The prevalence of thoracic lymphadenopathy in COVID-19 is 16.7 %. The presence of thoracic lymphadenopathy is associated with an approximately twofold increase in the risk for hospital mortality in COVID-19.

KEY POINTS

  · The prevalence of lymphadenopathy in COVID-19 is 16.7 %.. · Patients with lymphadenopathy in COVID-19 have a higher risk of mortality during hospitalization.. · Lymphadenopathy nearly doubles mortality and plays an important prognostic role..

CITATION FORMAT

· Bucher AM, Sieren M, Meinel F et al. Prevalence and prognostic role of thoracic lymphadenopathy in Covid-19. Rofo 2025; 197: 163 - 171.

PET scan for the detection of histological transformation of follicular lymphoma: A systematic review of diagnostic performance

The strength of evidence supporting use of PET in the evaluation of suspected histological transformation (HT) of follicular lymphoma (FL) is unknown. We conducted a systematic review of studies reporting the diagnostic performance of ≥1 PET parameters for the detection of HT in patients with known FL. We searched PubMed for any study reporting ≥1 diagnostic performance metrics. Risk of bias was evaluated with the QUADAS2 tool. We included 7 studies encompassing 152 patients with a biopsy showing FL (or indolent non-Hodgkin lymphoma) and 111 with a biopsy confirming HT. Study designs and study populations differed substantially. PET methods were poorly reported and 18F-FDG dose was highly variable. Most studies were judged to be at high risk of bias in the patient and index test domains of QUADAS2. The diagnostic performance of 5 PET parameters were reported in at least one study but only SUVmax (n = 7) was reported in >2. Median SUVmax ranged from 9.2 to 10.9 in FL/iNHL and from 13.7 to 24.4 in HT. While SUVmax was consistently higher in the HT group, there was considerable overlap between the two groups and significant variability between studies. Area under the ROC curve for SUVmax to distinguish between FL/iNHL and HT ranged from 0.68 to 0.97. Sensitivity and specificity of the proposed cutoffs also varied widely (sensitivity ∼0.6 to 1, specificity ∼0.4 to 1). In conclusion, few studies - mostly small and potentially biased - have addressed this question. Although SUVmax is generally higher in HT than in FL, the diagnostic performance and optimal cutoffs remain unclear. Proposed SUVmax cutoffs should not be used to determine whether a patient has HT or to decide whether a biopsy should be obtained. For now, we encourage physicians to evaluate results of their own practice to devise a prudent workup of suspected.

Identifying clusters of raters with a common notion of diagnosing erosive tooth wear: a step towards improving the accuracy of diagnostic procedures

BACKGROUND

Heterogeneous results are to be expected when multiple raters diagnose whether the dentine of a tooth with erosive tooth wear (ETW) is exposed or not. Identification of notions (fundamental concepts and understanding) about the diagnostic problem shared by groups of raters can be helpful to develop guidelines and to optimize teaching and calibration procedures. We aim to illustrate how clusters of raters with a common notion can be identified and how first insights about the notions can be obtained.

METHODS

This investigation is based on a former study in which 49 tooth surfaces affected by ETW were rated visually by 61 raters (23 scientists, 18 university dentists, 20 dental students) in terms of dentine exposed or not. The true status was determined histologically. Gender, age, professional experience, and specialization of the raters were documented. An algorithm was used to search for clusters of raters with high agreement in their ratings suggesting a common notion. The clusters identified were examined with respect to various aspects.

RESULTS

Four clusters of raters with high agreement could be found. The ratings of the raters in the cluster with the lowest diagnostic accuracy showed the highest correlation with the degree of tissue loss and the background tooth color, whereas the correlation with tissue loss was least in the cluster with highest diagnostic accuracy. The 15 raters of the latter cluster covered both students and dentists with or without specialization in erosion/cariology and/or long experience. This suggests that similar conceptual understanding of ETW can exist independent of professional experience.

CONCLUSIONS

The described methodology is useful to identify clusters of raters with a common notion about a specific diagnostic problem. The cluster-specific notions can be further examined based on existing study data or by group-based interviews of the raters of a cluster. This methodology allows investigators to learn more about useful or useless cues in diagnostic decision-making. This information can facilitate development or enhancement of guidelines on diagnostic decision-making.

Diagnostic accuracy of the faecal immunochemical test and volatile organic compound analysis in detecting colorectal polyps: meta-analysis

BACKGROUND

For the early detection of colorectal cancer, it is important to identify the premalignant lesions to prevent cancer development. Non-invasive testing methods such as the faecal immunochemical test are well established for the screening and triage of patients with suspected colorectal cancer but are not routinely used for polyps. Additionally, the role of volatile organic compounds has been tested for cancer detection. The aim of this review was to determine the diagnostic accuracy of the faecal immunochemical test and volatile organic compounds in detecting colorectal polyps.

METHODS

Original articles with diagnostic test accuracy measures for both the faecal immunochemical test and volatile organic compounds for advanced adenomas were included. Four databases including Medical Literature Analysis and Retrieval System Online (MEDLINE), Cumulative Index to Nursing and Allied Health Literature (CINAHL), Embase, and Web of Science were searched. The quality assessment tool for diagnostic accuracy study was used to assess the risk of bias and applicability. Meta-analysis was performed using RStudio® and the combined faecal immunochemical test-volatile organic compounds sensitivity and specificity were computed.

RESULTS

Twenty-two faecal immunochemical tests and 12 volatile organic compound-related articles were included in the systematic review whilst 18 faecal immunochemical tests and eight volatile organic compound-related studies qualified for the meta-analysis. The estimated pooled sensitivity and specificity of the faecal immunochemical test to diagnose advanced adenoma(s) were 36% (95% c.i. 30 to 41) and 89% (95% c.i. 86 to 91) respectively, with an area under the curve of 0.65, whilst volatile organic compounds pooled sensitivity and specificity was 83% (95% c.i. 70 to 91) and 76% (95% c.i. 60 to 87) respectively, with an area under the curve of 0.84. The combined faecal immunochemical test-volatile organic compounds increased the sensitivity to 89% with a specificity of 67%.

CONCLUSION

Faecal immunochemical testing has a higher specificity but poor sensitivity for detecting advanced adenomas, while volatile organic compound analysis is more sensitive. The combination of both tests enhances the detection rate of advanced adenomas.

Machine Learning and Deep Learning for Diagnosis of Lumbar Spinal Stenosis: Systematic Review and Meta-Analysis

BACKGROUND

Lumbar spinal stenosis (LSS) is a major cause of pain and disability in older individuals worldwide. Although increasing studies of traditional machine learning (TML) and deep learning (DL) were conducted in the field of diagnosing LSS and gained prominent results, the performance of these models has not been analyzed systematically.

OBJECTIVE

This systematic review and meta-analysis aimed to pool the results and evaluate the heterogeneity of the current studies in using TML or DL models to diagnose LSS, thereby providing more comprehensive information for further clinical application.

METHODS

This review was performed under the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines using articles extracted from PubMed, Embase databases, and Cochrane Library databases. Studies that evaluated DL or TML algorithms assessment value on diagnosing LSS were included, while those with duplicated or unavailable data were excluded. Quality Assessment of Diagnostic Accuracy Studies 2 was used to estimate the risk of bias in each study. The MIDAS module and the METAPROP module of Stata (StataCorp) were used for data synthesis and statistical analyses.

RESULTS

A total of 12 studies with 15,044 patients reported the assessment value of TML or DL models for diagnosing LSS. The risk of bias assessment yielded 4 studies with high risk of bias, 3 with unclear risk of bias, and 5 with completely low risk of bias. The pooled sensitivity and specificity were 0.84 (95% CI: 0.82-0.86; I2=99.06%) and 0.87 (95% CI 0.84-0.90; I2=98.7%), respectively. The diagnostic odds ratio was 36 (95% CI 26-49), the positive likelihood ratio (LR+) was 6.6 (95% CI 5.1-8.4), and the negative likelihood ratio (LR-) was 0.18 (95% CI 0.16-0.21). The summary receiver operating characteristic curves, the area under the curve of TML or DL models for diagnosing LSS of 0.92 (95% CI 0.89-0.94), indicating a high diagnostic value.

CONCLUSIONS

This systematic review and meta-analysis emphasize that despite the generally satisfactory diagnostic performance of artificial intelligence systems in the experimental stage for the diagnosis of LSS, none of them is reliable and practical enough to apply in real clinical practice. Further efforts, including optimization of model balance, widely accepted objective reference standards, multimodal strategy, large dataset for training and testing, external validation, and sufficient and scientific report, should be made to bridge the distance between current TML or DL models and real-life clinical applications in future studies.

TRIAL REGISTRATION

PROSPERO CRD42024566535; https://tinyurl.com/msx59x8k.

Diagnostic value of neutrophil-to-lymphocyte ratio and albumin-to-globulin ratio for periprosthetic joint infections: a systematic review and meta-analysis

Purpose

Periprosthetic joint infection (PJI) is a serious complication after joint arthroplasty, resulting in high morbidity and mortality. The neutrophil-to-lymphocyte ratio (NLR) and albumin-to-globulin ratio (AGR) are novel diagnostic markers for PJI; however, their diagnostic value remains inconsistent.

Methods

This meta-analysis was conducted using the PubMed, Embase, and MEDLINE databases to determine the diagnostic accuracy of NLR and AGR for PJI in the knee or hip. Data extraction and quality assessment were independently completed by two reviewers. The pooled sensitivity and specificity, diagnostic odds ratio (DOR), summary receiver operating characteristic curve (sROC), and area under the sROC curve (AUC) were assessed using the univariate meta-analysis framework.

Results

Nineteen eligible studies were included in the quantitative analysis. The pooled sensitivity and specificity of NLR for the diagnosis of PJI were 0.73 (95% CI: 0.68-0.77) and 0.72 (95% CI: 0.66-0.77), respectively. Its pooled DOR was 6.89 (95% CI: 5.03-9.43), and AUC was 0.79 (95% CI: 0.75-0.82). The pooled sensitivity and specificity of AGR for the diagnosis of PJI were 0.80 (95% CI: 0.70-0.88) and 0.83 (95% CI: 0.79-0.87), respectively. Its DOR was 17.69 (95% CI: 10.76-29.07), and AUC was 0.88 (95% CI: 0.85-0.91).

Conclusion

NLR and AGR can be individually used as reliable serum biomarkers for the detection of PJI. Future research is warranted to determine the diagnostic value of these markers in combination with C-reactive protein levels and erythrocyte sedimentation rates to improve diagnostic accuracy for PJI in clinical practice.

Diagnostic Accuracy of Mycobacterium tuberculosis Antigen-Based Skin Tests (TBSTs) for Tuberculosis Infection Compared with TST and IGRA: A Network Meta-Analysis

The aim of this study was to evaluate the diagnostic accuracy of the IGRA, TST, and TBST by combining diagnostic test accuracy (DTA) analysis and network meta-analysis (NMA) to increase the reliability and accuracy of diagnostic methods and promote the eradication of TB. An electronic search of the PubMed, Embase, and Cochrane databases was conducted, from the date of establishment to September 30, 2024. Data were synthesized with frequentist random-effects network meta-analyses, a single-group rate meta-analysis algorithm, and a bivariate mixed-effects logistic regression model. Summarized receiver operating characteristic curves and Fagan nomograms were used to assess diagnostic accuracy and clinical utility. Deeks' funnel plots and the Quality Assessment of Diagnostic Accuracy Studies 2 tools were used to assess publication bias and risk of bias. Sources of heterogeneity were investigated using subgroup analyses. Forty-nine studies were identified. The diagnostic performance of the three diagnostic methods for TB infection is summarized as follows: the pooled sensitivity was 77.9% (95% confidence interval [CI], 0.69-0.856), and the pooled specificity was 80.3% (95% CI, 0.75-0.86). The sensitivity and specificity of the IGRA were 82.1% (95% CI, 0.78-0.86) and 81.1% (95% CI, 0.75-0.86), respectively, both higher than the TST. However, the TBST exhibited the highest specificity, at 98.5% (95% CI, 0.96-1.00), with a sensitivity of 78.7% (95% CI, 0.68-0.88), which was between that of the IGRA and TST. Subgroup analysis found that population categories and reference standards, among other factors, may be attributed to heterogeneity. In addition, the TST and IGRA add-on TBST can significantly improve diagnostic accuracy. In our study, the IGRA showed higher sensitivity, whereas the TBST showed higher specificity. Interestingly, under certain conditions, TST add-on TBST and IGRA add-on TBST showed better accuracy than TST and IGRA alone and could provide more effective guidance for clinical practice (PROSPERO CRD42023420136).

Value of dynamic computed tomography myocardial perfusion in CAD: a systematic review and meta-analysis

AIMS

Dynamic stress computed tomography (CT) perfusion is a non-invasive method for quantifying myocardial ischaemia by assessing myocardial blood flow (MBF). In this meta-analysis, we evaluated the diagnostic accuracy of dynamic CT perfusion for the detection of significant coronary artery disease (CAD) across various CT scanners, obese patients, and its prognostic value.

METHODS AND RESULTS

We systematically searched PubMed, Embase, Web of Science, and Cochrane library for published studies evaluating the accuracy of CT myocardial perfusion in diagnosing functional significant ischaemia by invasive fractional flow reserve. The diagnostic performance of dynamic CT perfusion in detecting ischaemia was evaluated using a summary receiver operating characteristic (sROC) curve. A total of 23 studies underwent meta-analysis. In myocardial region without ischaemia, MBF was measured at 1.39 mL/min/g [95% confidence interval (CI) 1.25-1.54], while in region with ischaemia, it was 0.92 mL/min/g (95% CI 0.83-1.01) (P < 0.001). On the patient-based analysis, the area under the sROC curve of CT-MBF was 0.92, with a sensitivity of 0.82 and specificity of 0.86. Differences in CT type (dual source vs. single source), and body mass index did not significantly affect the diagnostic performance. The pooled hazard ratio of dynamic CT perfusion for predicting adverse events was 4.98 (95% CI 2.08-11.93, P ≤ 0.001, I2 = 61%, P for heterogeneity = 0.07).

CONCLUSION

Dynamic CT perfusion has high diagnostic performance in the quantitative assessment of ischaemia and detection of functional myocardial ischaemia as defined by invasive FFR and may be useful in risk stratification of CAD patients.

Machine learning for prognostic prediction in coronary artery disease with SPECT data: a systematic review and meta-analysis

BACKGROUND

Single-photon emission computed tomography (SPECT) analysis relies on qualitative visual assessment or semi-quantitative measures like total perfusion deficit that play a critical role in the non-invasive diagnosis of coronary artery disease by assessing regional blood flow abnormalities. Recently, machine learning (ML) -based analysis of SPECT images for coronary artery disease diagnosis has shown promise, with its utility in predicting long-term patient outcomes (prognosis) remaining an active area of investigation. In this review, we comprehensively examine the current landscape of ML-based analysis of SPECT imaging with an emphasis on prognostication of coronary artery disease.

MAIN BODY

Our systematic search yielded twelve retrospective studies, investigating SPECT-based ML models for prognostic prediction in coronary artery disease patients, with a total sample size of 73,023 individuals. Several of these studies demonstrate the superior prognostic capabilities of ML models over traditional logistic regression (LR) models and total perfusion deficit, especially when incorporating demographic data alongside SPECT imaging. Meta-analysis of 6 studies revealed promising performance of the included ML models, with sensitivity and specificity exceeding 65% for major adverse cardiovascular events and all-cause mortality. Notably, the integration of demographic information with SPECT imaging in ML frameworks shows statistically significant improvements in prognostic performance.

CONCLUSION

Our review suggests that ML models either independently or in combination with demographic data enhance prognostic prediction in coronary artery disease.

Diagnostic Accuracy of CT for the Detection of Hepatic Steatosis: A Systematic Review and Meta-Analysis

Background CT plays an important role in the opportunistic identification of hepatic steatosis. CT performance for steatosis detection has been inconsistent across various studies, and no clear guidelines on optimum thresholds have been established. Purpose To conduct a systematic review and meta-analysis to assess CT diagnostic accuracy in hepatic steatosis detection and to determine reliable cutoffs for the commonly mentioned measures in the literature. Materials and Methods A systematic search of the PubMed, Embase, and Scopus databases (English-language studies published from September 1977 to January 2024) was performed. Studies evaluating the diagnostic accuracy of noncontrast CT (NCCT), contrast-enhanced (CECT), and dual-energy CT (DECT) for hepatic steatosis detection were included. Reference standards included biopsy, MRI proton density fat fraction (PDFF), or NCCT. In several CECT and DECT studies, NCCT was used as the reference standard, necessitating subgroup analysis. Statistical analysis included a random-effects meta-analysis, assessment of heterogeneity with use of the I2 statistic, and meta-regression to explore potential sources of heterogeneity. When available, mean liver attenuation, liver-spleen attenuation difference, liver to spleen attenuation ratio, and the DECT-derived fat fraction for hepatic steatosis diagnosis were assessed. Results Forty-two studies (14 186 participants) were included. NCCT had a sensitivity and specificity of 72% and 88%, respectively, for steatosis (>5% fat at biopsy) detection and 82% and 94% for at least moderate steatosis (over 20%-33% fat at biopsy) detection. CECT had a sensitivity and specificity of 66% and 90% for steatosis detection and 68% and 93% for at least moderate steatosis detection. DECT had a sensitivity and specificity of 85% and 88% for steatosis detection. In the subgroup analysis, the sensitivity and specificity for detecting steatosis were 80% and 99% for CECT and 84% and 93% for DECT. There was heterogeneity among studies focusing on CECT and DECT. Liver attenuation less than 40-45 HU, liver-spleen attenuation difference less than -5 to 0 HU, and liver to spleen attenuation ratio less than 0.9-1 achieved high specificity for detection of at least moderate steatosis. Conclusion NCCT showed high performance for detection of at least moderate steatosis. © RSNA, 2024 Supplemental material is available for this article.

Diagnostic accuracy of magnetic resonance diffusion tensor imaging in distinguishing pseudoprogression from glioma recurrence: a systematic review and meta-analysis

PURPOSE

To evaluate the diagnostic accuracy of diffusion tensor imaging (DTI)-derived metrics mean diffusivity (MD) and fractional anisotropy (FA) in differentiating glioma recurrence from pseudoprogression.

METHODS

The Cochrane Library, Scopus, PubMed, and the Web of Science were systematically searched. Study selection and data extraction were done by two investigators independently. The quality assessment of diagnostic accuracy studies was applied to evaluate the quality of the included studies. Combined sensitivity (SEN) and specificity (SPE) and the area under the summary receiver operating characteristic curve (SROC) with the 95% confidence interval (CI) were calculated.

RESULTS

Seven high-quality studies involving 246 patients were included. Quantitative synthesis of studies showed that the pooled SEN and SPE for MD were 0.81 (95% CI 0.70-0.88) and 0.82 (95% CI 0.70-0.90), respectively, and the value of the area under the SROC curve was 0.88 (95% CI 0.85-0.91). The pooled SEN and SPE for FA were 0.74 (95% CI 0.65-0.82) and 0.79 (95% CI 0.66-0.88), respectively, and the value of the area under the SROC curve was 0.84 (95% CI 0.80-0.87).

CONCLUSIONS

This meta-analysis showed that both MD and FA have a high diagnostic accuracy in differentiating glioma recurrence from pseudoprogression.

REGISTRATION

PROSPERO protocol: CRD42024501146.

Olecranon bone age assessment in puberty using a lateral elbow radiograph and a deep-learning model

OBJECTIVES

To improve pubertal bone age (BA) evaluation by developing a precise and practical elbow BA classification using the olecranon, and a deep-learning AI model.

MATERIALS AND METHODS

Lateral elbow radiographs taken for BA evaluation in children under 18 years were collected from January 2020 to June 2022, retrospectively. A novel classification and the olecranon BA were established based on the morphological changes in the olecranon ossification process during puberty. The olecranon BA was compared with other elbow and hand BA methods, using intraclass correlation coefficients (ICCs), and a deep-learning AI model was developed.

RESULTS

A total of 3508 lateral elbow radiographs (mean age 9.8 ± 1.8 years) were collected. The olecranon BA showed the highest applicability (100%) and interobserver agreement (ICC 0.993) among elbow BA methods. It showed excellent reliability with Sauvegrain (0.967 in girls, 0.969 in boys) and Dimeglio (0.978 in girls, 0.978 in boys) elbow BA methods, as well as Korean standard (KS) hand BA in boys (0.917), and good reliability with KS in girls (0.896) and Greulich-Pyle (GP)/Tanner-Whitehouse (TW)3 (0.835 in girls, 0.895 in boys) hand BA methods. The AI model for olecranon BA showed an accuracy of 0.96 and a specificity of 0.98 with EfficientDet-b4. External validation showed an accuracy of 0.86 and a specificity of 0.91.

CONCLUSION

The olecranon BA evaluation for puberty, requiring only a lateral elbow radiograph, showed the highest applicability and interobserver agreement, and excellent reliability with other BA evaluation methods, along with a high performance of the AI model.

CLINICAL RELEVANCE STATEMENT

This AI model uses a single lateral elbow radiograph to determine bone age for puberty from the olecranon ossification center and can improve pubertal bone age assessment with the highest applicability and excellent reliability compared to previous methods.

KEY POINTS

Elbow bone age is valuable for pubertal bone age assessment, but conventional methods have limitations. Olecranon bone age and its AI model showed high performances for pubertal bone age assessment. Olecranon bone age system is practical and accurate while requiring only a single lateral elbow radiograph.

Diagnostic performance of transvaginal sonography vs. magnetic resonance imaging for rectovaginal septum deep infiltrating endometriosis: a head-to-head comparative meta-analysis

AIM

We aimed to compare the diagnostic performance of transvaginal sonography (TVS) versus magnetic resonance imaging (MRI) in identifying deep infiltrating endometriosis (DIE) in the rectovaginal septum (RVS) of affected patients.

MATERIALS AND METHODS

An extensive search was conducted in the PubMed, Embase databases to identify available publications up to November 2023. Studies evaluating the diagnostic perfor-mance of TVS and MRI for DIE in patients with rectovaginal septum involvement were all included. Sensitivity and specificity analyses employed the DerSi-monian and Laird method, complemented by the Freeman-Tukey double arc-sine trans-formation. Additionally, the study quality was rigorously evaluated using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) method.

RESULTS

The meta-analysis encompassed 8 articles with a total of 721 patients. It revealed that the overall sensitivity of TVS was 0.51 (95% CI: 0.31-0.72), contrasted with 0.74 (95% CI: 0.66-0.82) for MRI. This finding suggests a higher sensitivity of MRI compared to TVS (P=0.04). Conversely, the overall specificity was 0.97 (95%CI: 0.94-1.00) for TVS and 0.93 (95% CI: 0.84-0.99) for MRI, indicating a comparable level of specificity between the two modalities (P=0.22).

CONCLUSION

Our meta-analysis reveals that MRI exhibits higher sensitivity and comparable specificity to TVS in patients with DIE of the RVS. However, the limited number of articles included may affect the evidence of these results. Therefore, further d number of articles included may affect the evidence of these results. Therefore, further research with larger sample sizes and prospective designs is essential to validate these findings.

An exemplary reanalysis of coronary computed tomography angiography diagnostic meta-analyses shows insufficient data sharing and incorrect sensitivity and specificity estimates

OBJECTIVES

To systematically evaluate the reproducibility of primary data and, the reproducibility and correctness of pooled sensitivity and specificity estimates reported in a sample of diagnostic meta-analyses.

STUDY DESIGN AND SETTING

We conducted an exemplary systematic review of diagnostic meta-analyses comparing coronary computed tomography angiography to invasive coronary angiography in patients with suspected coronary artery disease. The objectives were to assess 1) the reproducibility of contingency tables, 2) the reproducibility of pooled sensitivity and specificity, and 3) differences to reported results when applying a recommended bivariate binomial model for pooling sensitivity and specificity. Therefore, we reproduced the contingency tables and recalculated sensitivity and specificity by utilizing both the pooling method of each meta-analysis and a bivariate binomial model. We used linear trends to assess the improvement of these objectives over time.

RESULTS

We identified 38 diagnostic meta-analyses, each including on average 19 primary studies (range: 3 to 89 studies; total: 715-including duplicates) with an average of approximately 1800 patients per meta-analysis (range: 118 to 7516 patients). For 31 meta-analyses (82%, 95% CI: 65%, 91%), the contingency tables were reproducible; however, only 15 published them. Using the pooling method of each meta-analysis, we obtained comparable recalculated sensitivities/specificities for 28 meta-analyses (74% [57%, 86%]). Only 11 meta-analyses pooled sensitivity/specificity using a bivariate binomial model (29% [16%, 46%]). When all meta-analyses were pooled with this model, published sensitivities/specificities were confirmed for 19 of 38 meta-analyses (50% [34%, 66%]). There was only marginal improvement in data availability and application of recommended pooling methods over time.

CONCLUSION

Data sharing should become standard practice along with the use of appropriate pooling methods. Journal publication requirements may play a key role in enhancing the quality of scientific reporting and methodological standards which may lead to more reliable and consistent outcomes. The ability to reproduce sensitivity and specificity estimates in diagnostic imaging meta-analyses is dependent on the availability of contingency tables and the explicit reporting of pooling methods and software used.

Protocol for conducting a systematic review on diagnostic accuracy in clinical research

In the landscape of modern medicine, the ability to accurately diagnose various clinical conditions is paramount. As new diagnostic tools continue to emerge, their accuracy must be rigorously assessed before clinical implementation. This paper introduces a systematic review protocol tailored for diagnostic accuracy studies, drawing inspiration from a review on dysphagia screening in post-stroke patients. The protocol, designed with precision and transparency at its core, facilitates a thorough synthesis of evidence, employing tools such as the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) and the Standards for Reporting of Diagnostic Accuracy Studies (STARD) checklist for robust evaluation. The protocol emphasizes registration with the PROSPERO database and adherence to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The systematic search approach encompasses a comprehensive exploration of databases and precise keyword combinations. Distinctive inclusion and exclusion criteria, coupled with a dual-reviewer methodology, ensure the selection of high-quality studies. This framework has the potential to serve as a benchmark for systematic reviews in diagnostic accuracy, highlighting the importance of standardization, transparency, and adaptability in clinical research. This approach paves the way for a research methodology that delves deeper into diagnostic tools across various clinical scenarios, promoting evidence-based advancements in patient care.

Diagnostic Accuracy of Transthoracic Echocardiography for Acute Type A Aortic Syndrome: A Systematic Review and Meta-Analysis

BACKGROUND

Transthoracic echocardiography (TTE) is currently recognized as the potential first-line imaging test for patients with suspected acute type A aortic syndrome (AAAS). Direct TTE sign for detecting AAAS is positive if there is an intimal flap separating two aortic lumens or aortic wall thickening seen in the ascending aorta. Indirect TTE sign indicates high-risk features of AAAS, such as aortic root dilatation, pericardial effusion, and aortic regurgitation. Our aim is to summarize the existing clinical evidence regarding the diagnostic accuracy of TTE and to evaluate its potential role in the management of patients with suspected AAAS.

METHODS

We included prospective or retrospective diagnostic cohort studies, written in any language, that specifically focused on using TTE to diagnose AAAS from databases such as PubMed, EMBASE, MEDLINE, and the Cochrane Library. The pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio [1], and hierarchical summary receiver-operating characteristic (HSROC) curve were calculated for TTE in diagnosing AAAS. We applied Quality Assessment of Diagnostic Accuracy (QUADAS-2) tool and Grading of Recommendations, Assessment, Development and Evaluation (GRADE) quality assessment criteria.

RESULTS

Ten studies (2886 patients) were included in the meta-analysis. The pooled sensitivity and specificity of direct TTE signs were 58% (95% CI, 38-76%) and 94% (95% CI, 89-97%). For any TTE signs, the pooled sensitivity and specificity were 91% (95% CI, 85-94%) and 74% (95% CI, 61-84%). The diagnostic accuracy of direct TTE signs was significantly higher than that of any TTE signs, as measured by the area under the HSROC curve [0.95 (95% CI, 0.92-0.96) vs. 0.87 (95% CI, 0.84-0.90)] in four studies.

CONCLUSIONS

Our study suggests that TTE could serve as the initial imaging test for patients with suspected AAAS. Given its high specificity, the presence of direct TTE signs may indicate AAAS, whereas the absence of any TTE signs, combined with low clinical suspicion, could suggest a lower likelihood of AAAS.

The development and validation of a milk feeding behavior alert from automated feeder data to classify calves at risk for a diarrhea bout: A diagnostic accuracy study

The objective of this diagnostic accuracy study was to develop and validate an alert to identify calves at risk for a diarrhea bout using milk feeding behavior data (behavior) from automated milk feeders (AMF). We enrolled Holstein calves (n = 259) as a convenience sample size from 2 facilities that were health scored daily preweaning and offered either 10 or 15 L/d of milk replacer. For alert development, 132 calves were enrolled and the ability of milk intake, drinking speed, and rewarded visits collected from AMF to identify calves at risk for diarrhea was tested. Alerts that had high diagnostic accuracy in the alert development phase were validated using a holdout validation strategy of 127 different calves from the same facilities (all offered 15 L/d) for -3 to 1 d relative to diarrhea diagnosis. We enrolled calves that were either healthy or had a first diarrheal bout (loose feces ≥2 d or watery feces ≥1 d). Relative change and rolling dividends for each milk feeding behavior were calculated for each calf from the previous 2 d. Logistic regression models and receiver operator curves (ROC) were used to assess the diagnostic ability for relative change and rolling dividends behavior relative to alert d) to classify calves at risk for a diarrhea bout from -2 to 0 d relative to diagnosis. To maximize sensitivity (Se), alert thresholds were based on ROC optimal classification cutoff. Diagnostic accuracy was met when the alert had a moderate area under the ROC curve (≥0.70), high accuracy (Acc; ≥0.80), high Se (≥0.80), and very high precision (Pre; ≥0.85). For alert development, deviations in rolling dividend milk intake with drinking speed had the best performance (10 L/d: ROC area under the curve [AUC] = 0.79, threshold ≤0.70; 15 L/d: ROC AUC = 0.82, threshold ≤0.60). Our diagnostic criteria were only met in calves offered 15 L/d (10 L/d: Se 75%, Acc 72%, Pre 92%, specificity [Sp] 55% vs. 15 L/d: Se 91%, Acc 91%, Pre 89%, Sp 73%). For holdout validation, rolling dividend milk intake with drinking speed met diagnostic criteria for one facility (threshold ≤0.60, Se 86%, Acc 82%, Pre 94%, Sp 50%). However, no milk feeding behavior alerts met diagnostic criteria for the second facility due to poor Se (relative change milk intake -0.36 threshold, Se 71%, Acc 70%, and Pre 97%). We suggest that changes in milk feeding behavior may indicate diarrhea bouts in dairy calves. Future research should validate this alert in commercial settings; furthermore, software updates, support, and new analytics might be required for on-farm application to implement these types of alerts.

DiTA: helping you search for evidence of diagnostic test accuracy in physical therapy

BACKGROUND

Physical therapists use diagnostic tests in a variety of settings. Choosing the best diagnostic test to apply in a particular situation can be difficult. The choice of diagnostic test should be informed, at least in part, by evidence of test accuracy. Finding evidence of diagnostic test accuracy has, until recently, been challenging. Ideally, there would exist a database that comprehensively indexes evidence on diagnostic tests relevant to physical therapy practice, is free to access, and is easy to use.

OBJECTIVE

This Masterclass will describe the DiTA (Diagnostic Test Accuracy) database (dita.org.au) including its development and search interface, and provide advice on how to search and retrieve records.

DISCUSSION

DiTA indexes more than 2400 primary studies and systematic reviews of diagnostic test accuracy relevant to physical therapy practice. Users can search DiTA using text fields and dropdown lists to find evidence of diagnostic test accuracy. The database is freely accessible on the internet. Since its launch, DiTA has been accessed from almost every country in the world, the largest number of searches having been conducted from Brazil.

Clinical Utility of Computed Tomography-Derived Myocardial Extracellular Volume Fraction: A Systematic Review and Meta-Analysis

BACKGROUND

Computed tomography (CT)-derived extracellular volume fraction (ECV) is a noninvasive method to quantify myocardial fibrosis. Although studies suggest CT is a suitable measure of ECV, clinical use remains limited.

OBJECTIVES

A meta-analysis was performed to determine the clinical value of CT-derived ECV in cardiovascular diseases.

METHODS

Electronic database searches of PubMed, Web of Science Core Collection, Cochrane advanced search, and EMBASE were performed. The most pivotal analysis entailed the comparison of ECV ascertained through CT-ECV among the control, aortic stenosis, and cardiac amyloidosis cohorts. The diagnostic test accuracy for detecting cardiac amyloidosis was assessed using summary receiver-operating characteristics curve.

RESULTS

Pooled CT-derived ECV values were 28.5% (95% CI: 27.3%-29.7%) in the control, 31.9% (95% CI: 30.2%-33.8%) in the aortic stenosis, and 48.9% (95% CI: 44.5%-53.3%) in the cardiac amyloidosis group. ECV was significantly elevated in aortic stenosis (P = 0.002) (vs controls) but further elevated in cardiac amyloidosis (P < 0.001) (vs aortic stenosis). CT-derived ECV had a high diagnostic accuracy for cardiac amyloidosis, with sensitivity of 92.8% (95% CI: 86.7%-96.2%), specificity of 84.8% (95% CI: 68.6%-93.4%), and area under the summary receiver-operating characteristic curve of 0.94 (95% CI: 0.88-1.00).

CONCLUSIONS

This study is the first comprehensive systematic review and meta-analysis of CT-derived ECV evaluation in cardiac disease. The high diagnostic accuracy of CT-ECV suggests the usefulness of CT-ECV in the diagnosis of cardiac amyloidosis in preoperative CT planning for transcatheter aortic valve replacement.

Statistical inference for diagnostic test accuracy studies with multiple comparisons

Diagnostic accuracy studies assess the sensitivity and specificity of a new index test in relation to an established comparator or the reference standard. The development and selection of the index test are usually assumed to be conducted prior to the accuracy study. In practice, this is often violated, for instance, if the choice of the (apparently) best biomarker, model or cutpoint is based on the same data that is used later for validation purposes. In this work, we investigate several multiple comparison procedures which provide family-wise error rate control for the emerging multiple testing problem. Due to the nature of the co-primary hypothesis problem, conventional approaches for multiplicity adjustment are too conservative for the specific problem and thus need to be adapted. In an extensive simulation study, five multiple comparison procedures are compared with regard to statistical error rates in least-favourable and realistic scenarios. This covers parametric and non-parametric methods and one Bayesian approach. All methods have been implemented in the new open-source R package cases which allows us to reproduce all simulation results. Based on our numerical results, we conclude that the parametric approaches (maxT and Bonferroni) are easy to apply but can have inflated type I error rates for small sample sizes. The two investigated Bootstrap procedures, in particular the so-called pairs Bootstrap, allow for a family-wise error rate control in finite samples and in addition have a competitive statistical power.

Interpretation of Complete Tumor Response on MRI Following Chemoradiotherapy of Rectal Cancer: Inter-Reader Agreement and Associated Factors in Multi-Center Clinical Practice

OBJECTIVE

To measure inter-reader agreement and identify associated factors in interpreting complete response (CR) on magnetic resonance imaging (MRI) following chemoradiotherapy (CRT) for rectal cancer.

MATERIALS AND METHODS

This retrospective study involved 10 readers from seven hospitals with experience of 80-10210 cases, and 149 patients who underwent surgery after CRT for rectal cancer. Using MRI-based tumor regression grading (mrTRG) and methods employed in daily practice, the readers independently assessed mrTRG, CR on T2-weighted images (T2WI) denoted as mrCRT2W, and CR on all images including diffusion-weighted images (DWI) denoted as mrCRoverall. The readers described their interpretation patterns and how they utilized DWI. Inter-reader agreement was measured using multi-rater kappa, and associated factors were analyzed using multivariable regression. Correlation between sensitivity and specificity of each reader was analyzed using Spearman coefficient.

RESULTS

The mrCRT2W and mrCRoverall rates varied widely among the readers, ranging 18.8%-40.3% and 18.1%-34.9%, respectively. Nine readers used DWI as a supplement sequence, which modified interpretations on T2WI in 2.7% of cases (36/1341 [149 patients × 9 readers]) and mostly (33/36) changed mrCRT2W to non-mrCRoverall. The kappa values for mrTRG, mrCRT2W, and mrCRoverall were 0.56 (95% confidence interval: 0.49, 0.62), 0.55 (0.52, 0.57), and 0.54 (0.51, 0.57), respectively. No use of rectal gel, larger initial tumor size, and higher initial cT stage exhibited significant association with a higher inter-reader agreement for assessing mrCRoverall (P ≤ 0.042). Strong negative correlations were observed between the sensitivity and specificity of individual readers (coefficient, -0.718 to -0.963; P ≤ 0.019).

CONCLUSION

Inter-reader agreement was moderate for assessing CR on post-CRT MRI. Readers' varying standards on MRI interpretation (i.e., threshold effect), along with the use of rectal gel, initial tumor size, and initial cT stage, were significant factors associated with inter-reader agreement.

Relationship Between Subjective Questionnaires and Videofluoroscopy of Dysphagia Evaluation: A Systematic Review and Meta-Analysis

BACKGROUND

Early detection of dysphagia is important for preventing aspiration pneumonia. Although videofluoroscopy is currently the primary diagnostic tool for dysphagia, access to this tool may be limited because of radiation exposure risk, high cost, and other factors.

PURPOSE

In this study, a meta-analysis was used to determine the strength of the correlation between dysphagia detection outcomes obtained using subjective questionnaires and videofluoroscopy.

METHODS

The PubMed and Embase databases were searched for original articles up to December 2022. Studies published in English that used cross-sectional designs to assess the correlation between subjective questionnaires and videofluoroscopy were considered eligible for inclusion. The search terms used included "dysphagia," "questionnaire," and "videofluoroscopy." Two reviewers critically appraised and extracted the correlation coefficient r values. In addition, a random-effects meta-analysis was conducted. The Q statistic was used to assess the heterogeneity among the included studies. Publication bias was checked using the funnel plot and Egger's tests. Multilevel analysis was used to determine sensitivity to consider within-study correlations. In addition, subgroup analyses were conducted based on type of questionnaire, head and neck cancer, and English-speaking regions.

RESULTS

The meta-analysis included five studies and 856 patients using the Eating Assessment Tool-10 and one study and 27 patients using the Sydney Swallow Questionnaire. The results of the random-effects meta-analysis showed a moderate relationship between the subjective questionnaires and videofluoroscopy ( r = .35, 95% CI [0.20, 0.48]). Similar results were also obtained using multilevel analysis ( r = .34, 95% CI [0.25, 0.42]). No publication bias was found for any of the studies ( p = .88). In the subgroup analyses, a moderate relationship between Eating Assessment Tool-10 and videofluoroscopy ( r = .31, 95% CI [0.19, 0.42]) and an ultrahigh relationship between Sydney Swallow Questionnaire and video-fluoroscopy ( r = .74, 95% CI [0.50, 0.87]) were found. Furthermore, moderate associations were observed within each head and neck cancer and English-speaking regions subgroup. However, no significant differences were found between these two subgroups.

CONCLUSIONS

These results indicate the subjective questionnaires considered in this study share a moderate relationship with videofluoroscopy. Subjective questionnaires may be used as an auxiliary tool by nurses and homecare givers for the early assessment of dysphagia risk in patients.

Deep learning or radiomics based on CT for predicting the response of gastric cancer to neoadjuvant chemotherapy: a meta-analysis and systematic review

Background

Artificial intelligence (AI) models, clinical models (CM), and the integrated model (IM) are utilized to evaluate the response to neoadjuvant chemotherapy (NACT) in patients diagnosed with gastric cancer.

Objective

The objective is to identify the diagnostic test of the AI model and to compare the accuracy of AI, CM, and IM through a comprehensive summary of head-to-head comparative studies.

Methods

PubMed, Web of Science, Cochrane Library, and Embase were systematically searched until September 5, 2023, to compile English language studies without regional restrictions. The quality of the included studies was evaluated using the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) criteria. Forest plots were utilized to illustrate the findings of diagnostic accuracy, while Hierarchical Summary Receiver Operating Characteristic curves were generated to estimate sensitivity (SEN) and specificity (SPE). Meta-regression was applied to analyze heterogeneity across the studies. To assess the presence of publication bias, Deeks' funnel plot and an asymmetry test were employed.

Results

A total of 9 studies, comprising 3313 patients, were included for the AI model, with 7 head-to-head comparative studies involving 2699 patients. Across the 9 studies, the pooled SEN for the AI model was 0.75 (95% confidence interval (CI): 0.66, 0.82), and SPE was 0.77 (95% CI: 0.69, 0.84). Meta-regression was conducted, revealing that the cut-off value, approach to predicting response, and gold standard might be sources of heterogeneity. In the head-to-head comparative studies, the pooled SEN for AI was 0.77 (95% CI: 0.69, 0.84) with SPE at 0.79 (95% CI: 0.70, 0.85). For CM, the pooled SEN was 0.67 (95% CI: 0.57, 0.77) with SPE at 0.59 (95% CI: 0.54, 0.64), while for IM, the pooled SEN was 0.83 (95% CI: 0.79, 0.86) with SPE at 0.69 (95% CI: 0.56, 0.79). Notably, there was no statistical difference, except that IM exhibited higher SEN than AI, while maintaining a similar level of SPE in pairwise comparisons. In the Receiver Operating Characteristic analysis subgroup, the CT-based Deep Learning (DL) subgroup, and the National Comprehensive Cancer Network (NCCN) guideline subgroup, the AI model exhibited higher SEN but lower SPE compared to the IM. Conversely, in the training cohort subgroup and the internal validation cohort subgroup, the AI model demonstrated lower SEN but higher SPE than the IM. The subgroup analysis underscored that factors such as the number of cohorts, cohort type, cut-off value, approach to predicting response, and choice of gold standard could impact the reliability and robustness of the results.

Conclusion

AI has demonstrated its viability as a tool for predicting the response of GC patients to NACT Furthermore, CT-based DL model in AI was sensitive to extract tumor features and predict the response. The results of subgroup analysis also supported the above conclusions. Large-scale rigorously designed diagnostic accuracy studies and head-to-head comparative studies are anticipated.

Systematic review registration

PROSPERO, CRD42022377030.

Diagnostic accuracy of procalcitonin in adult non-neutropenic cancer patients with suspected infection: a systematic review and meta-analysis

BACKGROUND

Procalcitonin (PCT) has garnered attention as a potential diagnostic biomarker for infection in cancer patients. We performed a systematic review and meta-analysis to evaluate the diagnostic accuracy of procalcitonin (PCT) and to compare it with C-reactive protein (CRP) in adult non-neutropenic cancer patients with suspected infection.

METHODS

A systematic literature search was performed in MEDLINE, EMBASE, and Cochrane Central Register of Controlled Trials to identify all relevant diagnostic accuracy studies. Original articles reporting the diagnostic accuracy of PCT for infection detection in adult patients with solid or hematological malignancies were included. The pooled sensitivity, specificity, positive likelihood ratio, negative likelihood ratio, diagnostic odds ratio, area under the hierarchical summary receiver operator characteristic (HSROC) curve, and corresponding 95% confidence interval (CI) were calculated.

RESULTS

Seven studies were included in the meta-analysis. The pooled sensitivity and specificity of PCT were 60% (95% CI [45-74%]) and 78% (95% CI [69-86%]). The diagnostic odds ratio was estimated at 5.47 (95% CI [2.86-10.46]). Three studies compared the diagnostic accuracies of PCT and CRP. The pooled sensitivity and specificity values for PCT were 57% (95% CI [26-83%]) and 75% (95% CI [68-82%]), and those for CRP were 67% (95% CI [35-88%]) and 73% (95% CI [69-77%]). The pooled sensitivity and specificity of PCT and CRP did not differ significantly (p = 0.61 and p = 0.63). The diagnostic accuracy of PCT was similar to that of CRP as measured by the area under the HSROC curve (0.73, CI = 0.61-0.91 vs. 0.74, CI = 0.61-0.95, p = 0.93).

CONCLUSION

While elevated PCT levels can be indicative of potential infection, they should not be solely relied upon to exclude infection. We recommend not using the PCT test in isolation; Instead, it should be carefully interpreted in the context of clinical findings.

Fat tissue quantity, waist circumference or waist-to-hip ratio in patients with chronic kidney disease: A systematic review and meta-analysis

The BMI predicts mortality and cardiovascular disease (CVD) in the general population, while in patients with end-stage chronic kidney disease (CKD) a high BMI is associated with improved survival, a phenomenon referred to as the "obesity paradox". While BMI is easy to determine and helps to categorize patients, it does not differentiate between fat tissue, lean tissue and bone mass. As the BMI may be altered in CKD, e.g. by muscle wasting, we determined in this meta-analysis (i) the association of mortality with fat tissue quantity in CKD and (ii) the association of mortality with abdominal obesity (as measured by waist circumference (WC) or waist-to-hip ratio (WHR)) in CKD. We systematically reviewed databases for prospective or retrospective cohort studies. In eleven studies with 23,523 patients the association between mortality and high fat tissue quantity in CKD was calculated. The pooled hazard ratio (HR) for this association in the CKD group in the dialysis group 0.91 (CI 0.84- 0.98, p = 0.01) which is comparable to the HR for the association with BMI. The HR in patients without dialysis was 0.7 (95% CI 0.53- 0.93, p = 0.01), suggesting a better risk prediction of high fat tissue content with mortality as compared to higher BMI with mortality in patients with CKD without dialysis. Importantly, both BMI and fat tissue quantity in CKD are described by the "obesity paradox": the higher the fat tissue content or BMI, the lower the mortality risk. In thirteen studies with 55,175 patients the association between mortality and high WC or WHR in CKD (with or without dialysis) was calculated. We observed, that the HR in the WHR group was 1.31 (CI 1.08-1.58, p = 0.007), whereas the overall hazard ratio of both groups was 1.09 (CI 1.01-1.18, p = 0.03), indicating that a higher abdominal obesity as measured by WHR is associated with higher mortality in CKD. Our analysis suggests gender-specific differences, which need larger study numbers for validation. This meta-analysis confirms the obesity paradox in CKD using fat tissue quantity as measure and further shows that using abdominal obesity measurements in the routine in obese CKD patients might allow better risk assessment than using BMI or fat tissue quantity. Comparable to the overall population, here, the higher the WHR, the higher the mortality risk.

Performance of adenosine deaminase in synovial fluid for the diagnosis of tuberculous arthritis: A systematic review and meta-analysis

OBJECTIVES

Adenosine deaminase (ADA) activity has shown good performance in diagnosing pleural, peritoneal, and meningeal tuberculosis. This meta-analysis aimed to evaluate the performance of measuring ADA activity in synovial fluid for the early diagnosis of joint tuberculosis.

METHODS

We searched published information in MEDLINE, Embase, Cochrane Library, Web of Science, and MedRxiv databases, as well as unpublished information in the American College of Rheumatology and European League Against Rheumatism for conference abstracts (2012-2021). We also scanned the reference lists of articles. Two reviewers independently applied the criteria for selection, assessed quality, and extracted data (PROSPERO number CRD42021284472).

RESULTS

Seven independent studies (N=305 subjects) that compared ADA activity in synovial fluid with a composite reference diagnostic method for tuberculosis were included. Overall, the risk of bias was judged low. Studies were classified as high quality (n=3; 148 subjects) and low quality (n=4; 157 subjects). Pooled sensitivity and specificity of ADA activity was 94% (95% confidence interval [CI], 0.89-98; I2=23%) and 88% (95% CI, 83-92; I2=83%), respectively. The random-effects model for pooled diagnostic Odds ratio was 67.1 (95%CI, 20.3-222.2; I2=30%). The receiver operating characteristic curve area was 0.96 (95% CI, 0.92-0.99). Meta-regression did not identify the quality of the study, country of publication, or the type of assay as a source of heterogeneity.

CONCLUSIONS

Measuring ADA activity in synovial fluid demonstrates good performance for the early diagnosis of joint tuberculosis.

A guide to conducting systematic reviews of clinical laboratory tests

Clinical laboratory professionals have an instrumental role in supporting clinical decision making with the optimal use of laboratory testing for screening, risk stratification, diagnostic, prognostic, treatment selection and monitoring of different states of health and disease. Delivering evidence-based laboratory medicine relies on review of available data and literature. The information derived, supports many national policies to improve patient care through clinical practice guidelines or best practice recommendations. The quality, validity and bias of this literature is variable. Hence, there is a need to collate similar studies and data and analyse them critically. Systematic review, thus, becomes the most important source of evidence. A systematic review, unlike a scoping or narrative review, involves a thorough understanding of the procedure involved and a stepwise methodology. There are nuances that need some consideration for laboratory medicine systematic reviews. The purpose of this article is to describe the process of performing a systematic review in the field of laboratory medicine, describing the available methodologies, tools and software packages that can be used to facilitate this process.

Diagnostic Test Accuracy of artificial intelligence-assisted detection of acute coronary syndrome: A systematic review and meta-analysis

BACKGROUND

Artificial intelligence (AI) has potential uses in healthcare including the detection of health conditions and prediction of health outcomes. Past systematic reviews had reviewed the accuracy of artificial neural networks (ANN) on Electrocardiogram (ECG) readings but that of other AI models on other Acute Coronary Syndrome (ACS) detection tools remains unclear.

METHODS

Nine electronic databases were searched from 2012 to 31 August 2022 including grey literature search and hand searching of references of included articles. Risk of bias was assessed by two independent reviewers using the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2). Test characteristics namely true positives, false positives, true negatives, and false negatives were extracted from all included articles into a 2x2 table. Study-specific estimates of sensitivity and specificity were pooled using hierarchical summary receiver operating characteristic (HSROC) model and displayed using a forest plot and HSROC curve.

RESULTS

66 studies were included in the review. A total of 518,931 patients were included whose mean ages varied from 32.62 to 70 years old. In 66 studies, the sensitivity and specificity of AI-based detection for ACS screening ranged from 64 % to 100 % and 65 %-100 %, respectively. The overall quality of evidence was low due to the inclusion of case-control studies.

CONCLUSION

Results of the study inform the potential of using AI-assisted ACS detection for accurate diagnosis and prompt treatment for ACS. Adherence to the Standards for Reporting of Diagnostic Accuracy (STARD) guideline and having more cohort studies for future Diagnostic Test Accuracy (DTA) studies are necessary to improve the quality of evidence of AI-based detection of ACS.

Diagnostic performance of diffusion-weighted imaging and intravoxel incoherent motion for renal lesions: a meta-analysis

AIM

To compare the diagnostic performance of diffusion-weighted imaging (DWI) and intravoxel incoherent motion (IVIM) parameters, specifically true diffusion coefficient (D), pseudo diffusion coefficient (D∗), and perfusion fraction (f) for quantitatively differentiating benign and malignant renal lesions.

MATERIALS AND METHODS

A comprehensive search was conducted in the EMBASE and PubMed databases before September 2022 to identify studies in English investigating the diagnostic accuracy of DWI and IVIM in renal lesions. The quality of the included studies was assessed using the QUADAS-2 tool. Pooled sensitivity, specificity, and area under the curve (AUC) values were estimated for each parameter.

RESULTS

A total of 19 studies involving 1,860 renal lesions (1,160 malignant and 700 benign), met the inclusion criteria. Among these studies, 15 assessed the apparent diffusion coefficient (ADC), four assessed IVIM, and three evaluated both ADC and IVIM. The pooled sensitivity, specificity, and AUC for ADC were 0.84 (95% confidence interval [Cl], 0.79-0.88), 0.82 (95% Cl, 0.72-0.89), and 0.89 (95% Cl, 0.86-0.92), respectively. The IVIM parameter with the highest diagnostic accuracy was D, with a pooled sensitivity, specificity, and AUC of 0.89 (95% Cl, 0.74-0.96), 0.96 (95% Cl, 0.85-0.99), and 0.98 (95% Cl, 0.96-0.99), respectively. The pooled sensitivity, specificity and AUC for f were 0.67 (95% Cl, 0.55-0.77), 0.81 (95% Cl, 0.30-0.98), and 0.73 (95% Cl, 0.69-0.77), respectively. The pooled sensitivity, specificity, and AUC for D∗ were 0.87 (95% Cl, 0.81-0.91), 0.59 (95% Cl, 0.48-0.70), and 0.82 (95% Cl, 0.78-0.85), respectively.

CONCLUSION

This meta-analysis indicated that both IVIM and DWI had moderate to high diagnostic accuracy for differentiating benign and malignant renal lesions. Among the IVIM parameter, D exhibited the highest diagnostic accuracy, demonstrating higher sensitivity and specificity than ADC, D∗, and f.

Confusion Assessment Method for the Intensive Care Unit (CAM-ICU) for the diagnosis of delirium in adults in critical care settings

BACKGROUND

Delirium is an underdiagnosed clinical syndrome typified by an acute alteration of mental state. It is an important problem in critical care and intensive care units (ICU) due to its high prevalence and its association with adverse outcomes. Delirium is a very distressing condition for patients, with a huge impact on their well-being. Diagnosis of delirium in the critical care setting is challenging. This is especially true for patients who are mechanically ventilated and are therefore unable to engage in a verbal interview. The Confusion Assessment Method for the Intensive Care Unit (CAM-ICU) is a tool specifically designed to assess for delirium in the context of ICU patients, including those on mechanical ventilation. CAM-ICU can be administered by non-specialists to give a dichotomous delirium present/absent result.

OBJECTIVES

To determine the diagnostic accuracy of the CAM-ICU for the diagnosis of delirium in adult patients in critical care units.

SEARCH METHODS

We searched MEDLINE (Ovid SP, 1946 to 8 July 2022), Embase (Ovid SP, 1982 to 8 July 2022), Web of Science Core Collection (ISI Web of Knowledge, 1945 to 8 July 2022), PsycINFO (Ovid SP, 1806 to 8 July 2022), and LILACS (BIREME, 1982 to 8 July 2022). We checked the reference lists of included studies and other resources for additional potentially relevant studies. We also searched the Health Technology Assessment database, the Cochrane Library, Aggressive Research Intelligence Facility database, WHO ICTRP, ClinicalTrials.gov, and websites of scientific associations to access any annual meetings and abstracts of conference proceedings in the field.

SELECTION CRITERIA

We included diagnostic studies enrolling adult ICU patients assessed using the CAM-ICU tool, regardless of language or publication status and reporting sufficient data on delirium diagnosis for the construction of 2 x 2 tables. Eligible studies evaluated the diagnostic performance of the CAM-ICU versus a clinical reference standard based on any iteration of the Diagnostic and Statistical Manual of Mental Disorders (DSM) criteria applied by a clinical expert.

DATA COLLECTION AND ANALYSIS

Two review authors independently selected and collated study data. We assessed the methodological quality of studies using the QUADAS-2 tool. We used two univariate fixed-effect or random-effects models to determine summary estimates of sensitivity and specificity. We performed sensitivity analyses that excluded studies considered to be at high risk of bias and high concerns in applicability, due mainly to the target population included (e.g. patients with traumatic brain injury). We also investigated potential sources of heterogeneity, assessing the effect of reference standard diagnosis and proportion of patients ventilated.

MAIN RESULTS

We included 25 studies (2817 participants). The mean age of participants ranged from 48 to 69 years; 15 of the studies included critical care units admitting mixed populations (e.g. medical, trauma, surgery patients). The percentage of patients receiving mechanical ventilation ranged from 11.8% to 100%. The prevalence of delirium in the studies included ranged from 12.5% to 83.9%. Presence of delirium was determined by the application of DSM-IV criteria in 13 out of 25 included studies. We assessed 13 studies as at low risk of bias and low applicability concerns for all QUADAS-2 domains. The most common issue of concern was flow and timing of the tests, followed by patient selection. Overall, we estimated a pooled sensitivity of 0.78 (95% confidence interval (CI) 0.72 to 0.83) and a pooled specificity of 0.95 (95% CI 0.92 to 0.97). Sensitivity analysis restricted to studies at low risk of bias and without any applicability concerns (n = 13 studies) gave similar summary accuracy indices (sensitivity 0.80 (95% CI 0.72 to 0.86), specificity 0.95 (95% CI 0.93 to 0.97)). Subgroup analyses based on diagnostic assessment found summary estimates of sensitivity and specificity for studies using DSM-IV of 0.79 (95% CI 0.72 to 0.85) and 0.94 (95% CI 0.90 to 0.96). For studies that used DSM-5 criteria, summary estimates of sensitivity and specificity were 0.75 (95% CI 0.67 to 0.82) and 0.98 (95% CI 0.95 to 0.99). DSM criteria had no significant effect on sensitivity (P = 0.421), but the specificity for detection of delirium was higher when DSM-5 criteria were used (P = 0.024). The relative specificity comparing DSM-5 versus DSM-IV criteria was 1.05 (95% CI 1.02 to 1.08). Summary estimates of sensitivity and specificity for studies recruiting < 100% of patients with mechanical ventilation were 0.81 (95% CI 0.75 to 0.85) and 0.95 (95% CI 0.91 to 0.98). For studies that exclusively recruited patients with mechanical ventilation, summary estimates of sensitivity and specificity were 0.91 (95% CI 0.76 to 0.97) and 0.98 (95% CI 0.92 to 0.99). Although there was a suggestion of differential performance of CAM-ICU in ventilated patients, the differences were not significant in sensitivity (P = 0.316) or in specificity (P = 0.493).

AUTHORS' CONCLUSIONS

The CAM-ICU tool may have a role in the early identification of delirium, in adult patients hospitalized in intensive care units, including those on mechanical ventilation, when non-specialized, properly trained clinical personnel apply the CAM-ICU. The test is most useful for exclusion of delirium. The test may miss a proportion of patients with incident delirium, therefore in situations where detection of all delirium cases is desirable, it may be best to repeat the test or combine CAM-ICU with another assessment. Future studies should compare different screening tests proposed for bedside assessment of delirium, as this approach will reveal which tool yields superior accuracy. In addition, future studies should consider and report the flow and timing of the tests and clearly report key characteristics related to patient selection. Finally, future research should focus on the impact of CAM-ICU screening on patient outcomes.

Diagnostic accuracy of dual-energy CT for bone marrow edema in patients with acute knee injury: a systematic review and meta-analysis

BACKGROUND

Knee injuries are prevalent, and early diagnosis is crucial for guiding clinical therapy. MRI is the diagnostic gold standard for bone marrow edema (BME) in patients with acute knee injuries, yet there are still limitations. Dual-energy CT, a possible viable replacement, is being explored (DECT).

METHODS

We systematically retrieved studies from EMBASE, Scopus, PUBMED, and the Cochrane Library and collected gray literatures. In accordance with the PRISMA-DTA standards, a systematic review was conducted between the study's initiation and July 31, 2021, utilizing an MRI reference standard and at least 10 adult patients with acute knee injuries to evaluate the diagnostic effectiveness of DECT for diagnosing BME. Two reviewers collected the study's details independently. For the meta-analysis, a bivariate mixed-effects regression model was utilized, and subgroup analysis was employed to determine the sources of variability.

RESULTS

The research included nine studies that examined 290 individuals between the ages of 23 and 53 with acute knee injuries who had DECT and MRI. Overall, the sensitivity, specificity, and AUC of the BME were 85% (95% confidence interval [CI]: 77-90%), 96% (95% CI: 93-97%), and 0.97 (95% CI: 0.95-0.98), respectively. To account for the assumed diversity of research, there were no statistically significant differences between the comparison groups in terms of specificity and sensitivity.

CONCLUSION

DECT is a viable alternative to MRI for individuals with acute knee injuries when MRI is inappropriate or unavailable.

Society of Critical Care Medicine and the Infectious Diseases Society of America Guidelines for Evaluating New Fever in Adult Patients in the ICU

RATIONALE

Fever is frequently an early indicator of infection and often requires rigorous diagnostic evaluation.

OBJECTIVES

This is an update of the 2008 Infectious Diseases Society of America and Society (IDSA) and Society of Critical Care Medicine (SCCM) guideline for the evaluation of new-onset fever in adult ICU patients without severe immunocompromise, now using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) methodology.

PANEL DESIGN

The SCCM and IDSA convened a taskforce to update the 2008 version of the guideline for the evaluation of new fever in critically ill adult patients, which included expert clinicians as well as methodologists from the Guidelines in Intensive Care, Development and Evaluation Group. The guidelines committee consisted of 12 experts in critical care, infectious diseases, clinical microbiology, organ transplantation, public health, clinical research, and health policy and administration. All task force members followed all conflict-of-interest procedures as documented in the American College of Critical Care Medicine/SCCM Standard Operating Procedures Manual and the IDSA. There was no industry input or funding to produce this guideline.

METHODS

We conducted a systematic review for each population, intervention, comparison, and outcomes question to identify the best available evidence, statistically summarized the evidence, and then assessed the quality of evidence using the GRADE approach. We used the evidence-to-decision framework to formulate recommendations as strong or weak or as best-practice statements.

RESULTS

The panel issued 12 recommendations and 9 best practice statements. The panel recommended using central temperature monitoring methods, including thermistors for pulmonary artery catheters, bladder catheters, or esophageal balloon thermistors when these devices are in place or accurate temperature measurements are critical for diagnosis and management. For patients without these devices in place, oral or rectal temperatures over other temperature measurement methods that are less reliable such as axillary or tympanic membrane temperatures, noninvasive temporal artery thermometers, or chemical dot thermometers were recommended. Imaging studies including ultrasonography were recommended in addition to microbiological evaluation using rapid diagnostic testing strategies. Biomarkers were recommended to assist in guiding the discontinuation of antimicrobial therapy. All recommendations issued were weak based on the quality of data.

CONCLUSIONS

The guidelines panel was able to formulate several recommendations for the evaluation of new fever in a critically ill adult patient, acknowledging that most recommendations were based on weak evidence. This highlights the need for the rapid advancement of research in all aspects of this issue-including better noninvasive methods to measure core body temperature, the use of diagnostic imaging, advances in microbiology including molecular testing, and the use of biomarkers.

Accuracy of package inserts of SARS-CoV-2 rapid antigen tests: a secondary analysis of manufacturer versus systematic review data

BACKGROUND

Rapid antigen tests (RATs) were crucial during the COVID-19 pandemic. Information provided by the test manufacturer in product package inserts, also known as instructions for use (IFUs), is often the only data available to clinicians, public health professionals, and individuals on the diagnostic accuracy of these tests. We aimed to assess whether manufacturer IFU accuracy data aligned with evidence from independent research.

METHODS

We searched company websites for package inserts for RATs that were included in the July 2022 update of the Cochrane meta-analysis of SARS-CoV-2 RATs, which served as a benchmark for research evidence. We fitted bivariate hierarchical models to obtain absolute differences in sensitivity and specificity between IFU and Cochrane Review estimates for each test, as well as overall combined differences.

FINDINGS

We found 22 (100%) of 22 IFUs of the RATs included in the Cochrane Review. IFUs for 12 (55%) of 22 RATs reported statistically significantly higher sensitivity estimates than the Cochrane Review, and none reported lower estimates. The mean difference between IFU and Cochrane Review sensitivity estimates across tests was 12·0% (95% CI 7·5-16·6). IFUs in three (14%) of 22 diagnostic tests had significantly higher specificity estimates than the Cochrane Review and two (9%) of 22 had lower estimates. The mean difference between IFU and Cochrane Review specificity estimates across tests was 0·3% (95% CI 0·1-0·5). If 100 people with SARS-CoV-2 infection were tested with each of the tests in this study, on average 12 fewer people would be correctly diagnosed than is suggested by the package inserts.

INTERPRETATION

Health professionals and the public should be aware that package inserts for SARS-CoV-2 RATs might provide an overly optimistic picture of the sensitivity of a test. Regulatory bodies should strengthen their requirements for the reporting of diagnostic accuracy data in package inserts and policy makers should demand independent validation data for decision making.

FUNDING

None.

Diagnostic efficiency of the FilmArray blood culture identification (BCID) panel: a systematic review and meta-analysis

Introduction. The FilmArray blood culture identification panel (BCID) panel is a multiplex PCR assay with high sensitivity and specificity to identify the most common pathogens in bloodstream infections (BSIs).Hypothesis. We hypothesize that the BCID panel has good diagnostic performance for BSIs and can be popularized in clinical application.Aim: To provide summarized evidence for the diagnostic accuracy of the BCID panel for the identification of positive blood cultures.Methodology. We searched the MEDLINE, EMBASE and Cochrane databases through March 2021 and assessed the efficacy of the diagnostic test of the BCID panel. We performed a meta-analysis and calculated the summary sensitivity and specificity of the BCID panel. Systematic review protocols were registered in the International Prospective Register of Systematic Reviews (PROSPERO) (registration number CRD42021239176).Results. A total of 16 full-text articles were eligible for analysis. The overall sensitivities of the BCID panel on Gram-positive bacteria, Gram-negative bacteria and fungi were 97 % (95 % CI, 0.96-0.98), 100 % (95 % CI, 0.98-01.00) and 99 % (95 % CI, 0.87-1.00), respectively. The pooled diagnostic specificities were 99 % (95 % CI, 0.97-1.00), 100 % (95 % CI, 1.00-1.00) and 100 % (95 % CI, 1.00-1.00) for Gram-positive bacteria, Gram-negative bacteria and fungi, respectively.Conclusions. The BCID panel has high rule-in value for the early detection of BSI patients. The BCID panel can still provide valuable information for ruling out bacteremia or fungemia in populations with low pretest probability.

Accuracy of placental growth factor alone or in combination with soluble fms-like tyrosine kinase-1 or maternal factors in detecting preeclampsia in asymptomatic women in the second and third trimesters: a systematic review and meta-analysis

OBJECTIVE

This study aimed to: (1) identify all relevant studies reporting on the diagnostic accuracy of maternal circulating placental growth factor) alone or as a ratio with soluble fms-like tyrosine kinase-1), and of placental growth factor-based models (placental growth factor combined with maternal factors±other biomarkers) in the second or third trimester to predict subsequent development of preeclampsia in asymptomatic women; (2) estimate a hierarchical summary receiver-operating characteristic curve for studies reporting on the same test but different thresholds, gestational ages, and populations; and (3) select the best method to screen for preeclampsia in asymptomatic women during the second and third trimester of pregnancy by comparing the diagnostic accuracy of each method.

DATA SOURCES

A systematic search was performed through MEDLINE, Embase, CENTRAL, ClinicalTrials.gov, and the World Health Organization International Clinical Trials Registry Platform databases from January 1, 1985 to April 15, 2021.

STUDY ELIGIBILITY CRITERIA

Studies including asymptomatic singleton pregnant women at >18 weeks' gestation with risk of developing preeclampsia were evaluated. We included only cohort or cross-sectional test accuracy studies reporting on preeclampsia outcome, allowing tabulation of 2×2 tables, with follow-up available for >85%, and evaluating performance of placental growth factor alone, soluble fms-like tyrosine kinase-1- placental growth factor ratio, or placental growth factor-based models. The study protocol was registered on the International Prospective Register Of Systematic Reviews (CRD 42020162460).

METHODS

Because of considerable intra- and interstudy heterogeneity, we computed the hierarchical summary receiver-operating characteristic plots and derived diagnostic odds ratios, β, θi, and Λ for each method to compare performances. The quality of the included studies was evaluated by the QUADAS-2 tool.

RESULTS

The search identified 2028 citations, from which we selected 474 studies for detailed assessment of the full texts. Finally, 100 published studies met the eligibility criteria for qualitative and 32 for quantitative syntheses. Twenty-three studies reported on performance of placental growth factor testing for the prediction of preeclampsia in the second trimester, including 16 (with 27 entries) that reported on placental growth factor test alone, 9 (with 19 entries) that reported on the soluble fms-like tyrosine kinase-1-placental growth factor ratio, and 6 (16 entries) that reported on placental growth factor-based models. Fourteen studies reported on performance of placental growth factor testing for the prediction of preeclampsia in the third trimester, including 10 (with 18 entries) that reported on placental growth factor test alone, 8 (with 12 entries) that reported on soluble fms-like tyrosine kinase-1-placental growth factor ratio, and 7 (with 12 entries) that reported on placental growth factor-based models. For the second trimester, Placental growth factor-based models achieved the highest diagnostic odds ratio for the prediction of early preeclampsia in the total population compared with placental growth factor alone and soluble fms-like tyrosine kinase-1-placental growth factor ratio (placental growth factor-based models, 63.20; 95% confidence interval, 37.62-106.16 vs soluble fms-like tyrosine kinase-1-placental growth factor ratio, 6.96; 95% confidence interval, 1.76-27.61 vs placental growth factor alone, 5.62; 95% confidence interval, 3.04-10.38); placental growth factor-based models had higher diagnostic odds ratio than placental growth factor alone for the identification of any-onset preeclampsia in the unselected population (28.45; 95% confidence interval, 13.52-59.85 vs 7.09; 95% confidence interval, 3.74-13.41). For the third trimester, Placental growth factor-based models achieved prediction for any-onset preeclampsia that was significantly better than that of placental growth factor alone but similar to that of soluble fms-like tyrosine kinase-1-placental growth factor ratio (placental growth factor-based models, 27.12; 95% confidence interval, 21.67-33.94 vs placental growth factor alone, 10.31; 95% confidence interval, 7.41-14.35 vs soluble fms-like tyrosine kinase-1-placental growth factor ratio, 14.94; 95% confidence interval, 9.42-23.70).

CONCLUSION

Placental growth factor with maternal factors ± other biomarkers determined in the second trimester achieved the best predictive performance for early preeclampsia in the total population. However, in the third trimester, placental growth factor-based models had predictive performance for any-onset preeclampsia that was better than that of placental growth factor alone but similar to that of soluble fms-like tyrosine kinase-1-placental growth factor ratio. Through this meta-analysis, we have identified a large number of very heterogeneous studies. Therefore, there is an urgent need to develop standardized research using the same models that combine serum placental growth factor with maternal factors ± other biomarkers to accurately predict preeclampsia. Identification of patients at risk might be beneficial for intensive monitoring and timing delivery.

Low skeletal muscle mass predicts treatment response in oncology: a meta-analysis

OBJECTIVES

Low skeletal muscle mass (LSMM) predicts relevant clinical outcomes in oncologic patients. The purpose of this study was to perform a meta-analysis of data regarding associations between LSMM and treatment response (TR) in oncology.

METHODS

MEDLINE, Cochrane, and SCOPUS databases were screened for relationships between LSMM and TR in oncologic patients up to November 2022. Overall, 35 studies met the inclusion criteria. The meta-analysis was performed using RevMan 5.4 software.

RESULTS

The collected 35 studies comprised 3858 patients. In 1682 patients (43.6%), LSMM was diagnosed. In the overall sample, LSMM predicted a negatively objective response rate (ORR), OR = 0.70, 95% CI = (0.54-0.91), p = 0.007, and disease control rate (DCR), OR = 0.69, 95% CI = (0.50-0.95), p = 0.02. In the curative setting, LSMM predicted a negatively ORR, OR = 0.24, 95% CI = (0.12-0.50), p = 0.0001, but not DCR, OR = 0.60, 95% CI = (0.31-1.18), p = 0.14. In palliative treatment with conventional chemotherapies, LSMM did not predict ORR: OR = 0.94, 95% CI (0.57-1.55), p = 0.81, and DCR: OR = 1.13, 95% CI (0.38-3.40), p = 0.82. In palliative treatment with tyrosine kinase inhibitors (TKI), LSMM did not predict TR: ORR, OR = 0.74, 95% CI (0.44-1.26), p = 0.27, and DCR, OR = 1.04, 95% CI (0.53-2.05), p = 0.90. In palliative immunotherapy, LSMM tended to predict ORR, OR = 0.74, 95% CI = (0.54-1.01), p = 0.06, and predicted DCR, OR = 0.53, 95% CI = (0.37-0.76), p = 0.0006.

CONCLUSION

LSMM is a risk factor for poor TR in curative chemotherapy in the adjuvant and/or neoadjuvant setting. LSMM is a risk factor for treatment failure in treatment with immunotherapy. Finally, LSMM does not influence TR in palliative treatment with conventional chemotherapy and/or TKIs.

KEY POINTS

• Low skeletal muscle mass (LSMM) predicts treatment response (TR) to chemotherapy in the adjuvant and/or neoadjuvant setting. • LSMM predicts TR in immunotherapy. • LSMM does not influence TR in palliative chemotherapy.

Meta-analysis of the diagnostic and clinical utility of exome and genome sequencing in pediatric and adult patients with rare diseases across diverse populations

PURPOSE

This meta-analysis aims to compare the diagnostic and clinical utility of exome sequencing (ES) vs genome sequencing (GS) in pediatric and adult patients with rare diseases across diverse populations.

METHODS

A meta-analysis was conducted to identify studies from 2011 to 2021.

RESULTS

One hundred sixty-one studies across 31 countries/regions were eligible, featuring 50,417 probands of diverse populations. Diagnostic rates of ES (0.38, 95% CI 0.36-0.40) and GS (0.34, 95% CI 0.30-0.38) were similar (P = .1). Within-cohort comparison illustrated 1.2-times odds of diagnosis by GS over ES (95% CI 0.79-1.83, P = .38). GS studies discovered a higher range of novel genes than ES studies; yet, the rate of variant of unknown significance did not differ (P = .78). Among high-quality studies, clinical utility of GS (0.77, 95% CI 0.64-0.90) was higher than that of ES (0.44, 95% CI 0.30-0.58) (P < .01).

CONCLUSION

This meta-analysis provides an important update to demonstrate the similar diagnostic rates between ES and GS and the higher clinical utility of GS over ES. With the newly published recommendations for clinical interpretation of variants found in noncoding regions of the genome and the trend of decreasing variant of unknown significance and GS cost, it is expected that GS will be more widely used in clinical settings.

Kenward-Roger-type corrections for inference methods of network meta-analysis and meta-regression

Network meta-analysis has been an essential methodology of systematic reviews for comparative effectiveness research. The restricted maximum likelihood (REML) method is one of the current standard inference methods for multivariate, contrast-based meta-analysis models, but recent studies have revealed the resultant confidence intervals of average treatment effect parameters in random-effects models can seriously underestimate statistical errors; that is, the actual coverage probability of a true parameter cannot retain the nominal level (e.g., 95%). In this article, we provided improved inference methods for the network meta-analysis and meta-regression models using higher-order asymptotic approximations based on the approach of Kenward and Roger (Biometrics 1997;53:983-997). We provided two corrected covariance matrix estimators for the REML estimator and improved approximations for its sample distribution using a t-distribution with adequate degrees of freedom. All of the proposed procedures can be implemented using only simple matrix calculations. In simulation studies under various settings, the REML-based Wald-type confidence intervals seriously underestimated the statistical errors, especially in cases of small numbers of trials meta-analyzed. By contrast, the proposed Kenward-Roger-type inference methods consistently showed accurate coverage properties under all the settings considered in our experiments. We also illustrated the effectiveness of the proposed methods through applications to two real network meta-analysis datasets.

Drain fluid biomarkers for the diagnosis of clinically relevant postoperative pancreatic fistula: a diagnostic accuracy systematic review and meta-analysis

BACKGROUND

Pancreatectomy is the only curative treatment available for pancreatic cancer and a necessity for patients with challenging pancreatic pathology. To optimize outcomes, postsurgical complications such as clinically relevant postoperative pancreatic fistula (CR-POPF) should be minimized. Central to this is the ability to predict and diagnose CR-POPF, potentially through drain fluid biomarkers. This study aimed to assess the utility of drain fluid biomarkers for predicting CR-POPF by conducting a diagnostic test accuracy systematic review and meta-analysis.

METHODS

Five databases were searched for relevant and original papers published from January 2000 to December 2021, with citation chaining capturing additional studies. The QUADAS-2 tool was used to assess the risk of bias and concerns regarding applicability of the selected studies.

RESULTS

Seventy-eight papers were included in the meta-analysis, encompassing six drain biomarkers and 30 758 patients with a CR-POPF prevalence of 17.42%. The pooled sensitivity and specificity for 15 cut-offs were determined. Potential triage tests (negative predictive value >90%) were identified for the ruling out of CR-POPF and included postoperative day 1 (POD1) drain amylase in pancreatoduodenectomy (PD) patients (300 U/l) and in mixed surgical cohorts (2500 U/l), POD3 drain amylase in PD patients (1000-1010 U/l) and drain lipase in mixed surgery groups (180 U/l). Notably, drain POD3 lipase had a higher sensitivity than POD3 amylase, while POD3 amylase had a higher specificity than POD1.

CONCLUSIONS

The current findings using the pooled cut-offs will offer options for clinicians seeking to identify patients for quicker recovery. Improving the reporting of future diagnostic test studies will further clarify the diagnostic utility of drain fluid biomarkers, facilitating their inclusion in multivariable risk-stratification models and the improvement of pancreatectomy outcomes.

Do external urine collection devices reduce contamination in urine samples for women with symptoms of urinary tract infection? A systematic review

INTRODUCTION

To evaluate the impact of external urine collection devices (UCD) on contamination of urine samples in women with symptoms of urinary tract infection.

METHODS

This review was conducted according to the Systematic Reviews of Diagnostic Test Accuracy guidelines (PROSPERO CRD42021241758). PubMed was searched for paired sample studies and controlled trials. Studies comparing UCDs with non-invasive urine collection procedures were considered.

RESULTS

Only two studies were found. Neither of the two studies found any difference regarding contamination between specimens collected with the UCDs compared and non-invasive techniques. In the largest study, including 1264 symptomatic women, 18.8% of those allocated to UCDs failed to collect urine samples successfully.

CONCLUSIONS

More studies involving women with symptoms of urinary tract infection are needed to produce more robust data on the impact of these devices on urine contamination rates.

Sarcopenia is an Independent Prognostic Factor in Patients With Pancreatic Cancer - a Meta-analysis

RATIONALE AND OBJECTIVES

Sarcopenia is defined as skeletal muscle loss and can be assessed by cross-sectional imaging. Our aim was to establish the effect of sarcopenia on relevant outcomes in patients with pancreatic ductal adenocarcinoma (PDAC) in curative and palliative settings based on a large patient sample.

MATERIALS AND METHODS

MEDLINE library, EMBASE and SCOPUS databases were screened for the associations between sarcopenia and mortality in patients with PDAC up to March 2022. The primary endpoint of the systematic review was the hazard ratio of Sarcopenia on survival. 22 studies were included into the present analysis.

RESULTS

The included 22 studies comprised 3958 patients. The prevalence of sarcopenia was 38.7%. Sarcopenia was associated with a higher prevalence in the palliative setting (OR 53.23, CI 39.00-67.45, p<0.001) compared to the curative setting (OR 36.73, CI 27.81-45.65, p<0.001). Sarcopenia was associated with worse OS in the univariable (HR 1.79, CI 1.41-2.28, p<0.001) and multivariable analysis (HR 1.62, CI 1.27-2.07, p<0.001) in the curative setting. For the palliative setting the pooled hazards ratio showed that sarcopenia was associated with overall survival (HR 1.56, CI 1.21-2.02, p<0.001) as well as in multivariable analysis (HR 1.77, CI 1.39-2.26, p<0.001). Sarcopenia was not associated with a higher rate of post-operative complications in univariable analysis (OR 1.10, CI 0.70-1.72, p = 0.69).

CONCLUSION

Sarcopenia occurs in 38.7% of patients with pancreatic cancer, significantly more in the palliative setting. Sarcopenia is associated with overall survival in both settings. The assessment of sarcopenia is therefore relevant for personalized oncology. Sarcopenia is not associated with postoperative complications.

Diagnostic Accuracy and Measurement Properties of Instruments Screening for Psychological Distress in Healthcare Workers-A Systematic Review

BACKGROUND

Instruments with sufficient diagnostic accuracy are better able to detect healthcare workers (HCWs) who are at risk of psychological distress. The objective of this review is to examine the diagnostic accuracy and measurement properties of psychological distress instruments in HCWs.

METHODS

We searched in Embase, Medline and PsycINFO from 2000 to February 2021. We included studies if they reported on the diagnostic accuracy of an instrument. To assess the methodological quality of the studies with regard to diagnostic accuracy, we used the Quality Assessment of Diagnostic Accuracy Studies and, for the measurement properties, the Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN).

RESULTS

Seventeen studies reporting on eight instruments were included. Overall, the methodological quality assessing the diagnostic accuracy and measurement properties was low, specifically for items addressing the domain 'index test'. The items addressing 'reference standard', 'time and flow' and 'patient selection' were mostly unclear. The criterion validity of the single-item burnout, the Burnout-Thriving Index, and the Physician Well-Being Index (PWBI) was sufficient, with area under the curve ranging from 0.75 to 0.92 and sensitivity 71-84%, respectively.

CONCLUSION

Our findings indicate that it is questionable whether screening for HCWs at risk of psychological distress can be performed sufficiently with the included instruments due to the low numbers of studies per instrument and the low methodological quality.

How to Critically Appraise and Interpret Systematic Reviews and Meta-Analyses of Diagnostic Accuracy: A User Guide

Systematic reviews of diagnostic accuracy studies can provide the best available evidence to inform decisions regarding the use of a diagnostic test. In this guide, the authors provide a practical approach for clinicians to appraise diagnostic accuracy systematic reviews and apply their results to patient care. The first step is to identify an appropriate systematic review with a research question matching the clinical scenario. The user should evaluate the rigor of the review methods to evaluate its credibility (Did the review use clearly defined eligibility criteria, a comprehensive search strategy, structured data collection, risk of bias and applicability appraisal, and appropriate meta-analysis methods?). If the review is credible, the next step is to decide whether the diagnostic performance is adequate for clinical use (Do sensitivity and specificity estimates exceed the threshold that makes them useful in clinical practice? Are these estimates sufficiently precise? Is variability in the estimates of diagnostic accuracy across studies explained?). Diagnostic accuracy systematic reviews that are judged to be credible and provide diagnostic accuracy estimates with sufficient certainty and relevance are the most useful to inform patient care. This review discusses comparative, noncomparative, and emerging approaches to systematic reviews of diagnostic accuracy using a clinical scenario and examples based on recent publications.

Diagnostic accuracy of transthoracic echocardiography for the identification of proximal aortic dissection: a systematic review and meta-analysis

This systematic review and meta-analysis evaluated the performance of transthoracic echocardiography (TTE) for diagnosis of proximal aortic dissections based on the identification of specific sonographic features. A systematic literature search of major databases was conducted on human studies investigating the diagnostic accuracy of TTE for proximal aortic dissection. The study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement. The quality of studies was evaluated using Quality Assessment of Diagnostic Accuracy Studies 2 tool. Data were gathered for the following sonographic findings: intimal flap, tear, or intramural hematoma; enlargement of aortic root or widening of aortic walls; aortic valve regurgitation; or pericardial effusion. Sensitivity, specificity, diagnostic odds ratio, number needed to diagnose values, and likelihood ratios were determined. Fourteen studies were included in our final analysis. More than half of the included studies demonstrated low risk of bias. The identification of intimal flap, tear, or intramural hematoma was shown to have an exceptional ability as a diagnostic tool to rule in proximal aortic dissections. TTE should be considered during the initial evaluation of patients presenting to the emergency department with suspected proximal aortic dissection. Positive sonographic findings on TTE may aid in rapid assessment, coordination of care, and treatment of individuals awaiting advanced imaging.

Mental Health Disorders Due to Disaster Exposure: A Systematic Review and Meta-Analysis

Natural disasters are complex, global issues that affect people individually, families, and communities, upsetting their emotional wellbeing. This research aims to comprehend the connections between disasters and their effects on mental health. We conducted a systemic review and meta-analysis on the effect of disasters on mental health disorders using defined search terms across three major databases. The search technique adhered to the PECO framework. The study locations were dispersed across Asia, Europe, and America. An electronic search was established in the Cochrane Central Register of Controlled Trials in the Cochrane Library, PubMed, and Medline databases. A random-effects meta-analysis was carried out. The I2 statistic was used to explore heterogeneity. In the random-effects analysis, Tau-squared, τ2, or Tau2 evaluates the effects seen between the study variances. Publication bias was examined. The outcomes of the included studies on mental health issues (n = 48,170) brought on by catastrophic disasters were pooled using a random-effects meta-analysis. The three main mental health illnesses attributed to the disaster catastrophe in most studies were generalized anxiety disorder (GAD), depression, substance use, adjustment disorder, and post-traumatic stress disorder (PTSD). Storms, including cyclones and snowstorms, had an impact on 5,151 individuals. 38,456 people were harmed by flooding, and 4,563 people were affected by the earthquake. The included studies showed prevalence rates for mental health disorders ranging from 5.8% to 87.6%. The prevalence rates were between 2.2% and 84% for anxiety, 3.23% and 52.70% for depression, and 2.6% and 52% for PTSD, respectively. The point effect estimates of studies included the flood, storm/cyclone, and earthquake were 0.07 (95% confidence interval [CI]: 0.02-0.12), 0.18 (95% CI: 0.03-0.32), and 0.15 (95% CI: 0.03-0.27), respectively, which revealed a statistically significant positive effect (p-value: < 0.05) with a narrow 95% CI indicating more precise population estimates. However, the pooled effect estimates were not of a large effect size of 0.129 (95% CI: 0.05-0.20). This study found a link between disaster and poorer outcomes for mental health. The risk of psychological morbidity and fatalities increased with relocation and disruption of essential services. Flooding was the most frequent calamity. The "medium human development countries" were found to have the highest prevalence rate of mental health disorders in our meta-analysis. The "very high human development" and "high human development" nations, however, also had a higher prevalence rate of mental health disorders following catastrophic events. This study could aid in the creation of thorough strategies for the mitigation and avoidance of mental health problems during natural disasters. Increased community resilience, improved access to healthcare services, and a suitable mitigation strategy can all help to improve the situation of the disaster's vulnerable population.

The association between inflammatory markers in blood and cerebrospinal fluid: a systematic review and meta-analysis

BACKGROUND

Neuroinflammatory processes have been hypothesized to play a role in the pathogenesis of psychiatric and neurological diseases. Studies on this topic often rely on analysis of inflammatory biomarkers in peripheral blood. Unfortunately, the extent to which these peripheral markers reflect inflammatory processes in the central nervous system (CNS) is unclear.

METHODS

We performed a systematic review and found 29 studies examining the association between inflammatory marker levels in blood and cerebrospinal (CSF) samples. We performed a random effects meta-analysis of 21 studies (pooled n = 1679 paired samples) that reported the correlation of inflammatory markers in paired blood-CSF samples.

RESULTS

A qualitative review revealed moderate to high quality of included studies with the majority of studies reporting no significant correlation of inflammatory markers between paired blood-CSF. Meta-analyses revealed a significant low pooled correlation between peripheral and CSF biomarkers (r = 0.21). Meta-analyses of individual cytokines revealed a significant pooled correlation for IL-6 (r = 0.26) and TNFα (r = 0.3) after excluding outlier studies, but not for other cytokines. Sensitivity analyses showed that correlations were highest among participants with a median age above 50 (r = 0.46) and among autoimmune disorder patients (r = 0.35).

CONCLUSION

This systematic review and meta-analysis revealed poor correlation between peripheral and central inflammatory markers in paired blood-CSF samples, with increased correlations in certain study populations. Based on the current findings, peripheral inflammatory markers are a poor reflection of the neuroinflammatory profile.