Preferred reporting items for journal and conference abstracts of systematic reviews and meta-analyses of diagnostic test accuracy studies (PRISMA-DTA for Abstracts): checklist, explanation, and elaboration

Percentage of Pancreatic Cysts on MRI With a Pancreatic Carcinoma: Systematic Review and Meta-Analysis

BACKGROUND

Pancreatic cystic lesions (PCLs) are frequent on MRI and are thought to be associated with pancreatic adenocarcinoma (PDAC) necessitating long-term surveillance based on older studies suffering from selection bias.

PURPOSE

To establish the percentage of patients with PCLs on MRI with a present or future PDAC.

STUDY TYPE

Systematic review, meta-analysis.

POPULATION

Adults with PCLs on MRI and a present or future diagnosis of PDAC were eligible. MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, and Scopus were searched to April 2022 (PROSPERO:CRD42022320502). Studies limited to PCLs not requiring surveillance, <100 patients, or those with a history/genetic risk of PDAC were excluded.

FIELD STRENGTH/SEQUENCE

≥1.5 T with ≥1 T2-weighted sequence.

ASSESSMENT

Two investigators extracted data, with discrepancies resolved by a third. QUADAS-2 assessed bias. PDAC was diagnosed using a composite reference standard.

STATISTICAL TESTS

A meta-analysis of proportions was performed at the patient-level with 95% confidence intervals (95% CI).

RESULTS

Eight studies with 1289 patients contributed to the percentage of patients with a present diagnosis of PDAC, and 10 studies with 3422 patients to the percentage with a future diagnosis. Of patients with PCLs on MRI, 14.8% (95% CI 2.4-34.9) had a PDAC at initial MRI, which decreased to 6.0% (2.2-11.3) for studies at low risk of bias. For patients without PDAC on initial MRI, 2.0% (1.1-3.2) developed PDAC during surveillance, similar for low risk of bias studies at 1.9% (0.7-3.6), with no clear trend of increased PDAC for longer surveillance durations. For patients without worrisome features or high-risk stigmata, 0.9% (0.1-2.2) developed PDAC during surveillance. Of 10, eight studies had a median surveillance ≥3 years (range 3-157 months). Sources of bias included retrospectively limiting PCLs to those with histopathology and inconsistent surveillance protocols.

DATA CONCLUSION

A low percentage of patients with PCLs on MRI develop PDAC while on surveillance. The first MRI revealing a PCL should be scrutinized for PDAC.

LEVEL OF EVIDENCE

3 TECHNICAL EFFICACY: Stage 2.

Deep Learning for Pneumothorax Detection on Chest Radiograph: A Diagnostic Test Accuracy Systematic Review and Meta Analysis

BACKGROUND

Pneumothorax is a common acute presentation in healthcare settings. A chest radiograph (CXR) is often necessary to make the diagnosis, and minimizing the time between presentation and diagnosis is critical to deliver optimal treatment. Deep learning (DL) algorithms have been developed to rapidly identify pathologic findings on various imaging modalities.

PURPOSE

The purpose of this systematic review and meta-analysis was to evaluate the overall performance of studies utilizing DL algorithms to detect pneumothorax on CXR.

METHODS

A study protocol was created and registered a priori (PROSPERO CRD42023391375). The search strategy included studies published up until January 10, 2023. Inclusion criteria were studies that used adult patients, utilized computer-aided detection of pneumothorax on CXR, dataset was evaluated by a qualified physician, and sufficient data was present to create a 2 × 2 contingency table. Risk of bias was assessed using the QUADAS-2 tool. Bivariate random effects meta-analyses and meta-regression modeling were performed.

RESULTS

Twenty-three studies were selected, including 34 011 patients and 34 075 CXRs. The pooled sensitivity and specificity were 87% (95% confidence interval, 81%, 92%) and 95% (95% confidence interval, 92%, 97%), respectively. The study design, use of an institutional/public data set and risk of bias had no significant effect on the sensitivity and specificity of pneumothorax detection.

CONCLUSIONS

The relatively high sensitivity and specificity of pneumothorax detection by deep-learning showcases the vast potential for implementation in clinical settings to both augment the workflow of radiologists and assist in more rapid diagnoses and subsequent patient treatment.

Best Practice for MRI Diagnostic Accuracy Research With Lessons and Examples from the LI-RADS Individual Participant Data Group

Medical imaging diagnostic test accuracy research is strengthened by adhering to best practices for study design, data collection, data documentation, and study reporting. In this review, key elements of such research are discussed, and specific recommendations provided for optimizing diagnostic accuracy study execution to improve uniformity, minimize common sources of bias and avoid potential pitfalls. Examples are provided regarding study methodology and data collection practices based on insights gained by the liver imaging reporting and data system (LI-RADS) individual participant data group, who have evaluated raw data from numerous MRI diagnostic accuracy studies for risk of bias and data integrity. The goal of this review is to outline strategies for investigators to improve research practices, and to help reviewers and readers better contextualize a study's findings while understanding its limitations. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 3.

Evidence Construction of Chuankezhi Injection Against Chronic Obstructive Pulmonary Disease: A Systematic Review and Network Pharmacology

Objective

Chronic obstructive pulmonary disease (COPD) is a chronic respiratory disease with high prevalence, morbidity, and mortality. Chuankezhi (CKZ) injection, a Chinese patent medicine, has been commonly used for treating COPD. This study evaluated the clinical efficacy of CKZ injections in COPD patients and explored potential underlying mechanisms by integrating meta-analysis and network pharmacology.

Research Methods

Randomized controlled trials (RCTs) were search in database by Web of Science, Cochrane Library and PubMed as of November 2022 for literature collection, and the Review Manager 5.4 was used to analyze the data. Through the network pharmacology method, the chemical components and their targets, as well as the disease targets were further analyzed.

Results

A total of 15 RCTs including 1212 patients were included. The results of meta-analysis showed that CKZ injection can significantly improve the clinical effective rate (RR = 1.25, 95% CI: 1.14 to 1.36), and the clinical advantage was that it can significantly reduced acute exacerbation rate (RR = 0.29, 95% CI: 0.12 to 0.70) and COPD assessment test (CAT) scores (MD =-4.62, 95% CI:-8.966 to-0.28). A total of 31 chemical compounds and 178 potential targets for CKZ injection were obtained from the online databases. Molecular docking revealed that most key components and targets could form stable structure.

Conclusion

This systematic review with meta-analysis and network pharmacology demonstrates that CKZ could effectively improve the clinical efficacy and safety in the treatment of COPD. Such efficacy may be related to an anti-inflammatory effect and immunoregulation of CKZ via multiple components, multiple targets and multiple pathways.

Role and knowledge of nurses in the management of non-communicable diseases in Africa: A scoping review

BACKGROUND

31.4 million people in low- and middle-income countries die from chronic diseases annually, particularly in Africa. To address this, strategies such as task-shifting from doctors to nurses have been proposed and have been endorsed by the World Health Organization as a potential solution; however, no comprehensive review exists describing the extent of nurse-led chronic disease management in Africa.

AIMS

This study aimed to provide a thorough description of the current roles of nurses in managing chronic diseases in Africa, identify their levels of knowledge, the challenges, and gaps they encounter in this endeavor.

METHODS

We performed a scoping review following the key points of the Cochrane Handbook, and two researchers independently realized each step. Searches were conducted using five databases: MEDLINE, PyscINFO, CINAHL, Web of Science, and Embase, between October 2021 and April 2023. A descriptive analysis of the included studies was conducted, and the quality of the studies was assessed using the Downs and Black Scale.

RESULTS

Our scoping review included 111 studies from 20 African countries, with South Africa, Nigeria, and Ghana being the most represented. Findings from the included studies revealed varying levels of knowledge. Nurses were found to be actively involved in managing common chronic diseases from diagnosis to treatment. Facilitating factors included comprehensive training, close supervision by physicians, utilization of decision trees, and mentorship. However, several barriers were identified, such as a shortage of nurses, lack of essential materials, and inadequate initial training.

CONCLUSION

There is significant potential for nurses to enhance the screening, diagnosis, and treatment of chronic diseases in Africa. Achieving this requires a combination of rigorous training and effective supervision, supported by robust policies. To address varying levels of knowledge, tailored training programs should be devised. Further research is warranted to establish the effectiveness of nurse-led interventions on population health outcomes.

LI-RADS CT and MRI Ancillary Feature Association with Hepatocellular Carcinoma and Malignancy: An Individual Participant Data Meta-Analysis

Background The independent contribution of each Liver Imaging Reporting and Data System (LI-RADS) CT or MRI ancillary feature (AF) has not been established. Purpose To evaluate the association of LI-RADS AFs with hepatocellular carcinoma (HCC) and malignancy while adjusting for LI-RADS major features through an individual participant data (IPD) meta-analysis. Materials and Methods Medline, Embase, Cochrane Central Register of Controlled Trials, and Scopus were searched from January 2014 to January 2022 for studies evaluating the diagnostic accuracy of CT and MRI for HCC using LI-RADS version 2014, 2017, or 2018. Using a one-step approach, IPD across studies were pooled. Adjusted odds ratios (ORs) and 95% CIs were derived from multivariable logistic regression models of each AF combined with major features except threshold growth (excluded because of infrequent reporting). Liver observation clustering was addressed at the study and participant levels through random intercepts. Risk of bias was assessed using a composite reference standard and Quality Assessment of Diagnostic Accuracy Studies 2. Results Twenty studies comprising 3091 observations (2456 adult participants; mean age, 59 years ± 11 [SD]; 1849 [75.3%] men) were included. In total, 89% (eight of nine) of AFs favoring malignancy were associated with malignancy and/or HCC, 80% (four of five) of AFs favoring HCC were associated with HCC, and 57% (four of seven) of AFs favoring benignity were negatively associated with HCC and/or malignancy. Nonenhancing capsule (OR = 3.50 [95% CI: 1.53, 8.01]) had the strongest association with HCC. Diffusion restriction (OR = 14.45 [95% CI: 9.82, 21.27]) and mild-moderate T2 hyperintensity (OR = 10.18 [95% CI: 7.17, 14.44]) had the strongest association with malignancy. The strongest negative associations with HCC were parallels blood pool enhancement (OR = 0.07 [95% CI: 0.01, 0.49]) and marked T2 hyperintensity (OR = 0.18 [95% CI: 0.07, 0.45]). Seventeen studies (85%) had a high risk of bias. Conclusion Most LI-RADS AFs were independently associated with HCC, malignancy, or benignity as intended when adjusting for major features. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Crivellaro in this issue.

The PRISMATIC project: protocol for a research programme on novel methods to improve reporting and peer review of systematic reviews of health evidence

BACKGROUND

Incomplete reporting about what systematic reviewers did and what they found prevents users of the report from being able to fully interpret the findings and understand the limitations of the underlying evidence. Reporting guidelines such as the PRISMA statement and its extensions are designed to improve reporting. However, there are important inconsistencies across the various PRISMA reporting guidelines, which causes confusion and misinterpretation. Coupled with this, users might need to consult multiple guidelines to gain a full understanding of the guidance. Furthermore, the current passive strategy of implementing PRISMA has not fully brought about needed improvements in the completeness of systematic review reporting.

METHODS

The PRISMATIC ('PRISMA, Technology, and Implementation to enhance reporting Completeness') project aims to use novel methods to enable more efficient and effective translation of PRISMA reporting guidelines into practice. We will establish a working group who will develop a unified PRISMA statement that harmonises content across the main PRISMA guideline and several of its extensions. We will then develop a web application that generates a reporting template and checklist customised to the characteristics and methods of a systematic review ('PRISMA-Web app') and conduct a randomised trial to evaluate its impact on authors' reporting. We will also develop a web application that helps peer reviewers appraise systematic review manuscripts ('PRISMA-Peer app') and conduct a diagnostic accuracy study to evaluate its impact on peer reviewers' detection of incomplete reporting.

DISCUSSION

We anticipate the novel guidance and web-based apps developed throughout the project will substantively enhance the completeness of reporting of systematic reviews of health evidence, ultimately benefiting users who rely on systematic reviews to inform health care decision-making.

A systematic review and meta-analysis of transthoracic echocardiogram vs. cardiac magnetic resonance imaging for the detection of left ventricular thrombus

Transthoracic echocardiography (TTE) is the most commonly used imaging modality to diagnose left ventricular thrombus (LVT), however, cardiac magnetic resonance (CMR) remains the gold standard investigation. A comparison of the diagnostic performance between two modalities is needed to inform guidelines on a diagnostic approach towards LVT. We performed a systematic review and meta-analysis to investigate the diagnostic performance of three methods of TTE (non-contrast, contrast, and apical wall motion scoring) for the detection of LVT compared to CMR as a reference test. Studies comprising 2113 patients investigated for LVT using both TTE and CMR were included in the meta-analysis. For non-contrast TTE, pooled sensitivity and specificity were 47% [95% confidence interval (CI): 32-62%], and 98% (95% CI: 96-99%), respectively. In contrast, TTE pooled sensitivity and specificity values were 58% (95% CI: 46-69%), and 98% (95% CI: 96-99%), respectively. Apical wall motion scoring on non-contrast TTE yielded a sensitivity of 100% [95% CI: 93-100%] and a specificity of 54% (95% CI: 42-65%). The area under the curve (AUC) values from our summary receiver operating characteristic curve (SROC) for non-contrast and contrast TTE were 0.87 and 0.86 respectively, with apical wall motion studies having the highest AUC of 0.93. Despite high specificity, routine contrast and non-contrast TTE are likely to miss a significant number of LVT, making it a suboptimal screening tool. The addition of apical wall motion scoring provides a promising method to reliably identify patients requiring further investigations for LVT, whilst excluding others from unnecessary testing.

Systematic Review for Risks of Pressure Injury and Prediction Models Using Machine Learning Algorithms

Pressure injuries are increasing worldwide, and there has been no significant improvement in preventing them. This study is aimed at reviewing and evaluating the studies related to the prediction model to identify the risks of pressure injuries in adult hospitalized patients using machine learning algorithms. In addition, it provides evidence that the prediction models identified the risks of pressure injuries earlier. The systematic review has been utilized to review the articles that discussed constructing a prediction model of pressure injuries using machine learning in hospitalized adult patients. The search was conducted in the databases Cumulative Index to Nursing and Allied Health Literature (CINAHIL), PubMed, Science Direct, the Institute of Electrical and Electronics Engineers (IEEE), Cochrane, and Google Scholar. The inclusion criteria included studies constructing a prediction model for adult hospitalized patients. Twenty-seven articles were included in the study. The defects in the current method of identifying risks of pressure injury led health scientists and nursing leaders to look for a new methodology that helps identify all risk factors and predict pressure injury earlier, before the skin changes or harms the patients. The paper critically analyzes the current prediction models and guides future directions and motivations.

Reporting quality of abstracts and inconsistencies with full text articles in pediatric orthopedic publications

BACKGROUND

Abstracts should provide a brief yet comprehensive reporting of all components of a manuscript. Inaccurate reporting may mislead readers and impact citation practices. It was our goal to investigate the reporting quality of abstracts of interventional observational studies in three major pediatric orthopedic journals and to analyze any reporting inconsistencies between those abstracts and their corresponding full-text articles.

METHODS

We selected a sample of 55 abstracts and their full-text articles published between 2018 and 2022. Included articles were primary therapeutic research investigating the results of treatments or interventions. Abstracts were scrutinized for reporting quality and inconsistencies with their full-text versions with a 22-itemized checklist. The reporting quality of titles was assessed by a 3-items categorical scale.

RESULTS

In 48 (87%) of articles there were abstract reporting inaccuracies related to patient demographics. The study's follow-up and complications were not reported in 21 (38%) of abstracts each. Most common inconsistencies between the abstracts and full-text articles were related to reporting of inclusion or exclusion criteria in 39 (71%) and study correlations in 27 (49%) of articles. Reporting quality of the titles was insufficient in 33 (60%) of articles.

CONCLUSIONS

In our study we found low reporting quality of abstracts and noticeable inconsistencies with full-text articles, especially regarding inclusion or exclusion criteria and study correlations. While the current sample is likely not representative of overall pediatric orthopedic literature, we recommend that authors, reviewers, and editors ensure abstracts are reported accurately, ideally following the appropriate reporting guidelines, and that they double check that there are no inconsistencies between abstracts and full text articles. To capture essential study information, journals should also consider increasing abstract word limits.

Which clinical features best predict occult scaphoid fractures? A systematic review of diagnostic test accuracy studies

BACKGROUND

Plain radiographs cannot identify all scaphoid fractures; thus ED patients with a clinical suspicion of scaphoid injury often undergo immobilisation despite normal imaging. This study determined (1) the prevalence of scaphoid fracture among patients with a clinical suspicion of scaphoid injury with normal radiographs and (2) whether clinical features can identify patients that do not require immobilisation and further imaging.

METHODS

This systematic review of diagnostic test accuracy studies included all study designs that evaluated predictors of scaphoid fracture among patients with normal initial radiographs. Quality assessment was undertaken using the Quality Assessment of Diagnostic Accuracy Studies 2 tool. Meta-analyses included all studies.

RESULTS

Eight studies reported data on 1685 wrist injuries. The prevalence of scaphoid fracture despite normal radiographs was 9.0%. Most studies were at overall low risk of bias but two were at unclear risk; all eight were at low risk for applicability concerns. The most accurate clinical predictors of occult scaphoid fracture were pain when the examiner moved the wrist from a pronated to a supinated position against resistance (sensitivity 100%, specificity 97.9%, LR+ 45.0, 95% CI 6.5 to 312.5), supination strength <10% of contralateral side (sensitivity 84.6%, specificity 76.9%, LR+ 3.7, 95% CI 2.2 to 6.1), pain on ulnar deviation (sensitivity 55.2%, specificity 76.4%, LR+ 2.3, 95% CI 1.8 to 3.0) and pronation strength <10% of contralateral side (sensitivity 69.2%, specificity 64.6%, LR+ 2.0, 95% CI 1.2 to 3.2). Absence of anatomical snuffbox tenderness significantly reduced the likelihood of an occult scaphoid fracture (sensitivity 92.1%, specificity 48.4%, LR- 0.2, 95% CI 0.0 to 0.7).

CONCLUSION

No single feature satisfactorily excludes an occult scaphoid fracture. Further work should explore whether a combination of clinical features, possibly in conjunction with injury characteristics (such as mechanism) and a normal initial radiograph might exclude fracture. Pain on supination against resistance would benefit from external validation.

TRIAL REGISTRATION NUMBER

CRD42021290224.

Cerebral near-infrared spectroscopy monitoring to predict periventricular-intraventricular haemorrhage and neurodevelopmental outcomes in preterm infants: a protocol for a systematic review and meta-analysis

INTRODUCTION

Periventricular-intraventricular haemorrhage (PV-IVH) is one of the major cause of mortality and long-term neurodevelopmental sequela in preterm infants born at less than 32 weeks of gestation. Near-infrared spectroscopy (NIRS) monitoring can detect brain tissue oxygen saturation changes before the occurrence of PV-IVH in the early postnatal period. However, the time window for NIRS monitoring, the absolute value or change value of brain tissue oxygen saturation, and the accuracy of NIRS in predicting PV-IVH and its neurodevelopmental outcomes has not been systematically reviewed. In this review, we will investigate the diagnostic accuracy (sensitivity, specificity and accuracy) of NIRS in predicting PV-IVH, its severity and outcomes.

METHODS AND ANALYSIS

Literature will be searched in the PubMed, EMBASE, Web of Science and Cochrane Library databases without limitation of region or time of publication. All published literature without language restrictions, including randomised/quasicontrolled trials and observational studies, will be considered. Studies providing index test values (the absolute value or change value of oxygen saturation using NIRS) will be included. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses of Diagnostic Test Accuracy Studies (DTA) process will be followed for writing. The risk of bias will be assessed according to the Quality Assessment of Diagnostic Accuracy Studies-2 tool. The outcomes will be the diagnostic accuracy (sensitivity, specificity and accuracy) of NIRS in predicting PV-IVH, long-term neurodevelopmental outcomes and infant mortality. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) tool will be used to evaluate the quality of the evidence.

ETHICS AND DISSEMINATION

In this systematic review, data will be collected from published articles for collation and analysis, without a separate ethical review.

PROSPERO REGISTRATION NUMBER

CRD42022316080.

Circulating microRNAs as diagnostic biomarkers for melanoma: a systematic review and meta-analysis

BACKGROUND

Recent studies have shown that circulating microRNAs (miRNAs) can be used as diagnostic biomarkers for melanoma. This study aimed to evaluate the diagnostic value of circulating miRNAs for melanoma.

METHODS

A comprehensive literature search was conducted and the quality of the included literature was evaluated using QUADAS-2 (Quality Assessment for diagnostic accuracy studies), and the diagnostic accuracy was assessed by pooled sensitivity, specificity, positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR), and area under the curve (AUC). We used Deeks' funnel plot to evaluate publication bias.

RESULTS

The meta-analysis included 10 articles covering 16 studies, and the results showed that circulating miRNAs provide high diagnostic accuracy for melanoma. The overall pooled sensitivity was 0.87 (95% CI: 0.82-0.91), specificity was 0.81 (95% CI: 0.77-0.85), PLR was 4.6 (95% CI: 3.7-5.8), NLR was 0.16 (95% CI: 0.11-0.23), DOR was 29 (95% CI: 18-49), and AUC was 0.90 (95% CI: 0.87-0.92), respectively. Subgroup analysis showed better diagnostic value in miRNA clusters, European population, plasma miRNAs, and upregulated miRNAs compared to other subgroups.

CONCLUSIONS

The results indicated that circulating microRNAs can be used as a non-invasive biomarker for the diagnosis of melanoma.

How to Critically Appraise and Interpret Systematic Reviews and Meta-Analyses of Diagnostic Accuracy: A User Guide

Systematic reviews of diagnostic accuracy studies can provide the best available evidence to inform decisions regarding the use of a diagnostic test. In this guide, the authors provide a practical approach for clinicians to appraise diagnostic accuracy systematic reviews and apply their results to patient care. The first step is to identify an appropriate systematic review with a research question matching the clinical scenario. The user should evaluate the rigor of the review methods to evaluate its credibility (Did the review use clearly defined eligibility criteria, a comprehensive search strategy, structured data collection, risk of bias and applicability appraisal, and appropriate meta-analysis methods?). If the review is credible, the next step is to decide whether the diagnostic performance is adequate for clinical use (Do sensitivity and specificity estimates exceed the threshold that makes them useful in clinical practice? Are these estimates sufficiently precise? Is variability in the estimates of diagnostic accuracy across studies explained?). Diagnostic accuracy systematic reviews that are judged to be credible and provide diagnostic accuracy estimates with sufficient certainty and relevance are the most useful to inform patient care. This review discusses comparative, noncomparative, and emerging approaches to systematic reviews of diagnostic accuracy using a clinical scenario and examples based on recent publications.

Diagnostic Accuracy of MRI for Solid Renal Masses: A Systematic Review and Meta-analysis

BACKGROUND

Biparametric (bp)-MRI and multiparametric (mp)-MRI may improve the diagnostic accuracy of renal mass histology.

PURPOSE

To evaluate the available evidence on the diagnostic accuracy of bp-MRI and mp-MRI for solid renal masses in differentiating malignant from benign, aggressive from indolent, and clear cell renal cell carcinoma (ccRCC) from other histology.

STUDY TYPE

Systematic review.

POPULATION

MEDLINE, EMBASE, and CENTRAL up to January 11, 2022 were searched.

FIELD STRENGTH/SEQUENCE

1.5 or 3 Tesla.

ASSESSMENT

Eligible studies evaluated the accuracy of MRI (with at least two sequences: T2, T1, dynamic contrast and diffusion-weighted imaging) for diagnosis of solid renal masses in adult patients, using histology as reference standard. Risk of bias and applicability were assessed using QUADAS-2.

STATISTICAL TESTS

Meta-analysis using a bivariate logitnormal random effects model.

RESULTS

We included 10 studies (1239 masses from approximately 1200 patients). The risk of bias was high in three studies, unclear in five studies and low in two studies. The diagnostic accuracy of malignant (vs. benign) masses was assessed in five studies (64% [179/281] malignant). The summary estimate of sensitivity was 95% (95% confidence interval [CI]: 77%-99%), and specificity was 63% (95% CI: 46%-77%). No study assessed aggressive (vs. indolent) masses. The diagnostic accuracy of ccRCC (vs. other subtypes) was evaluated in six studies (47% [455/971] ccRCC): the summary estimate of sensitivity was 85% (95% CI: 77%-90%) and specificity was 77% (95% CI: 73%-81%).

DATA CONCLUSION

Our study reveals deficits in the available evidence on MRI for diagnosis of renal mass histology. The number of studies was limited, at unclear/high risk of bias, with heterogeneous definitions of solid masses, imaging techniques, diagnostic criteria, and outcome measures.

EVIDENCE LEVEL

3 TECHNICAL EFFICACY: Stage 2.

Measuring quality of reporting in systematic reviews of diagnostic test accuracy studies in medical imaging: comparison of PRISMA-DTA and PRISMA

OBJECTIVES

To compare the reporting quality measured by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses of Diagnostic Test Accuracy studies (PRISMA-DTA) vs the original PRISMA checklist for systematic reviews of diagnostic test accuracy studies in imaging and survey the use of PRISMA-DTA by researchers and endorsement by journals.

METHODS

Systematic reviews of DTA studies published in 2020 and 2021 in Quartile 1 and Quartile 3 medical imaging journals (defined by Journal Citation Reports) were identified through PubMed. The reporting of each systematic review was assessed using PRISMA-DTA, PRISMA-2009 and PRISMA-2020. The item scores and overall score were compared among the three checklists. We also examined checklist adoption by the included systematic reviews and surveyed checklist endorsement from author instructions of included journals.

RESULTS

A total of 173 systematic reviews from 66 journals were included. The use of PRISMA-DTA, compared with PRISMA-2009 and PRISMA-2020, identified more issues in the reporting of title (proportion of systematic reviews with proper reporting, 27.2% vs 98.8% vs 98.8%), abstract (39.3% vs 97.1% vs 64.7%), eligibility criteria (67.6% vs 94.2% vs 94.2%), search (28.9% vs 72.3% vs 28.9%), definitions for data extraction (14.5% vs 91.9% vs 91.9%), diagnostic accuracy measures (38.2% vs 93.6% vs 93.6%), synthesis of results (28.9% vs 89.6% vs 73.4%) and results of individual studies (40.5% vs 80.3% vs 80.3%). The overall median reporting score measured by PRISMA-DTA (72.0% (interquartile range (IQR), 66.7-77.8%)) was lower than that measured by PRISMA-2009 (88.9% (IQR, 84.0-92.6%)) and similar to that measured by PRISMA-2020 (74.1% (IQR, 66.7-77.8%)). Additionally, PRISMA-DTA was used by only 43 (24.9%) systematic reviews and endorsed by two (3.0%) journals. These trends remained consistent for reviews published in journals with diverse scientific impact.

CONCLUSIONS

The use of PRISMA-DTA may identify more reporting inadequacies compared with the original PRISMA checklists when assessing diagnostic test accuracy systematic reviews, especially in critical sections such as title, abstract and methods. However, this tool is not commonly used by researchers and is inadequately endorsed by imaging journals. Our findings suggest a strong need to use PRISMA-DTA for reporting of diagnostic test accuracy systematic reviews by authors and its endorsement by journals. © 2022 International Society of Ultrasound in Obstetrics and Gynecology.

Completeness of Reporting of Systematic Reviews and Meta-Analysis of Diagnostic Test Accuracy (DTA) of Radiological Articles Based on the PRISMA-DTA Reporting Guideline

RATIONALE AND OBJECTIVES

This study evaluated the completeness of systematic reviews and meta-analyses in radiology using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Diagnostic Test Accuracy (PRISMA-DTA) and PRISMA-DTA for Abstracts guidelines between articles published before and those published after the issuance of the guideline and identify areas that have been poorly reported.

MATERIALS AND METHODS

PubMed were searched for systematic reviews on DTA with or without meta-analyses published in general radiology journals between January 1, 2016 and December 31, 2020. The identified articles were assessed for completeness of reporting according to the PRISMA-DTA. Subgroup analyses were performed for association of completeness of reporting with multiple cofactors.

RESULTS

The search identified 183 reviews from 12 journals. The mean numbers (standard deviation) of reported PRISMA-DTA and PRISMA-DTA for Abstracts items in the full texts and abstracts were 18.45 (2.02) and 5.66 (1.28), respectively. Subgroup analysis showed that compared to the corresponding reference groups, a higher mean number of reported PRISMA-DTA items was associated with publication during July 2018-December 2020 [(17.82 (2.01) vs 18.89 (1.91); p = 0.034), citation of the PRISMA-DTA [17.62 (1.86) vs 20.27 (2.02); p < 0.001], and inclusion of supplementary materials [17.64 (2) vs 19.09 (1.8); p < 0.001] on multiple-linear regression analysis.

CONCLUSION

Completeness of reporting with respect to the PRISMA-DTA and PRISMA-DTA for Abstracts has improved modestly since the publication of the PRISMA-DTA guideline; however, increasing awareness of the specific weakness provides the chance for completeness improvement.

Prognostic factors and outcomes of surgical intervention for patients with spinal metastases secondary to lung cancer: an update systematic review and meta analysis

PURPOSE

Lung cancer is one of the most common malignant tumors. Most patients develop spinal metastases during the course of cancer and suffer skeletal-related events. Currently, no consensus has been reached on the prognostic factors in patients undergoing surgeries. This study aimed to answer two questions: (1) what are the effects of surgical intervention, and (2) what are the factors associated with postoperative survival.

METHODS

Searches were performed on electronic databases including PubMed, Ovid/MEDLINE, Cochrane, and Scopus for articles published before February of 2022, involving the survival factors of patients with spinal metastasis. Multiple data items were considered, such as baseline demographics, surgical details, clinical outcome, and prognostic factors. The analysis was performed in Review Manager (RevMan) 5.5. The prognostic factors of survival were analyzed with univariate and multivariate cox regression analysis.

RESULTS

Finally, 14 studies with 813 patients were identified. Their 6, 12, and 24 months survival rates ranged from 18 to 58%, 18 to 22.4%, and 0 to 58.5%, respectively. The pooled hazard ratio of preoperative ambulatory status and the number of involved vertebrae demonstrated statistical significance, while no significant prognostic effect on the overall survival was found for targeted therapy, visceral metastases, chemotherapy, radiotherapy, or postoperative ambulatory status.

CONCLUSION

Overall, surgical intervention could achieve significant pain relief and neurological function improvements. For patients receiving surgery for spinal metastasis from lung cancer, preoperative ambulatory status and the number of involved vertebrae were significant prognostic factors associated with their survival.

Increasing Consumption of Antibiotics during the COVID-19 Pandemic: Implications for Patient Health and Emerging Anti-Microbial Resistance

The emergence of COVID-19 infection led to the indiscriminate use of antimicrobials without knowing their efficacy in treating the disease. The gratuitous use of antibiotics for COVID-19 treatment raises concerns about the emergence of antimicrobial resistance (AMR). In this systematic review, we performed a thorough systematic search using Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines of scientific databases (Scopus, Web of Science, and PubMed) to identify studies where antibiotics were prescribed to treat COVID-19 (December 2019 to December 2021). Of 970 identified studies, 130 were included in our analyses. Almost 78% of COVID-19 patients have been prescribed an antibiotic. Cephalosporins were the most prescribed (30.1% of patients) antibiotics, followed by azithromycin (26% of patients). Antibiotics were prescribed for COVID-19 patients regardless of reported severity; the overall rate of antibiotic use was similar when comparing patients with a severe or critical illness (77.4%) and patients with mild or moderate illness (76.8%). Secondary infections were mentioned in only 11 studies. We conclude that concerns related to COVID-19 and the lack of treatment strategy led to the overuse of antibiotics without proper clinical rationale. Based on our findings, we propose that antimicrobial stewardship should be retained as a priority while treating viral pandemics.

O-RADS MRI: A Systematic Review and Meta-Analysis of Diagnostic Performance and Category-wise Malignancy Rates

Background US-indeterminate adnexal lesions remain an important indication for gynecologic surgery. MRI can serve as a problem-solving tool through the use of the Ovarian-Adnexal Imaging Reporting and Data System (O-RADS) MRI lexicon, which is based on the ADNEX MR scoring system. Purpose To perform a systematic review and meta-analysis of the diagnostic performance of pelvic MRI interpreted using the ADNEX or O-RADS MRI stratification systems to characterize US-indeterminate adnexal lesions and of the category-wise malignancy rates. Materials and Methods A systematic literature search from May 2013 (publication of the ADNEX MR score) to September 2022 was performed. Studies reporting the use of pelvic MRI interpreted with the ADNEX or O-RADS MRI systems to characterize US-indeterminate adnexal lesions, with pathologic examination and/or follow-up as the reference standard, were included. Summary estimates of diagnostic performance were obtained with the bivariate random-effects model, while category-wise summary malignancy rates of O-RADS MRI 2, 3, 4, and 5 lesions were obtained with a random-effects model. Effects of covariates on heterogeneity and diagnostic performance were investigated through meta-regression. Results Thirteen study parts from 12 studies (3731 women, 4520 adnexal lesions) met the inclusion criteria. Diagnostic performance meta-analysis for 4012 lesions found a 92% summary sensitivity (95% CI: 88, 95) and a 91% summary specificity (95% CI: 89, 93). The meta-analysis of malignancy rates for 3641 lesions showed summary malignancy rates of 0.1% (95% CI: 0, 1) among O-RADS MRI 2 lesions, 6% (95% CI: 3, 9) among O-RADS MRI 3 lesions, 60% (95% CI: 52, 67) among O-RADS MRI 4 lesions, and 96% (95% CI: 92, 99) among O-RADS MRI 5 lesions. Conclusion Pelvic MRI interpreted with the Ovarian-Adnexal Reporting and Data System (O-RADS) MRI lexicon had high diagnostic performance for the characterization of US-indeterminate adnexal lesions. Summary estimates of malignancy rates in the O-RADS MRI 4 and O-RADS MRI 5 categories were higher than predicted ones. © RSNA, 2022 Supplemental material is available for this article. See also the editorial by Lee and Kang in this issue.

Diagnostic accuracy of rapid point-of-care tests for diagnosis of current SARS-CoV-2 infections in children: a systematic review and meta-analysis

OBJECTIVE

To systematically assess the diagnostic accuracy of rapid point-of-care tests for diagnosis of current SARS-CoV-2 infections in children under real-life conditions.

DESIGN

Systematic review and meta-analysis.

DATA SOURCES

MEDLINE, Embase, Cochrane Database for Systematic Reviews, INAHTA HTA database, preprint servers (via Europe PMC), ClinicalTrials.gov, WHO ICTRP from 1 January 2020 to 7 May 2021; NICE Evidence Search, NICE Guidance, FIND Website from 1 January 2020 to 24 May 2021.

REVIEW METHODS

Diagnostic cross-sectional or cohort studies were eligible for inclusion if they had paediatric study participants and compared rapid point-of care tests for diagnosing current SARS-CoV-2 infections with reverse transcription polymerase chain reaction (RT-PCR) as the reference standard. The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool was used to assess the risk of bias and the applicability of the included studies. Bivariate meta-analyses with random effects were performed. Variability was assessed by subgroup analyses.

RESULTS

17 studies with a total of 6355 paediatric study participants were included. All studies compared antigen tests against RT-PCR. Overall, studies evaluated eight antigen tests from six different brands. Only one study was at low risk of bias. The pooled overall diagnostic sensitivity and specificity in paediatric populations was 64.2% (95% CI 57.4% to 70.5%) and 99.1% (95% CI 98.2% to 99.5%), respectively. In symptomatic children, the pooled diagnostic sensitivity was 71.8% (95% CI 63.6% to 78.8%) and the pooled diagnostic specificity was 98.7% (95% CI 96.6% to 99.5%). The pooled diagnostic sensitivity in asymptomatic children was 56.2% (95% CI 47.6% to 64.4%) and the pooled diagnostic specificity was 98.6% (95% CI 97.3% to 99.3%).

CONCLUSIONS

The performance of current antigen tests in paediatric populations under real-life conditions varies broadly. Relevant data were only identified for very few antigen tests on the market, and the risk of bias was mostly unclear due to poor reporting. Additionally, the most common uses of these tests in children (eg, self-testing in schools or parents testing their toddlers before kindergarten) have not been addressed in clinical performance studies yet. The observed low diagnostic sensitivity may impact the planned purpose of the broad implementation of testing programmes.

PROSPERO REGISTRATION NUMBER

CRD42021236313.

Digital Help for Substance Users (SU): A Systematic Review

The estimated number of Substance Users (SU) globally has currently reached a very high number and is still increasing. This aspect necessitates appropriate interventions for prevention and specific treatments. The literature shows that digital treatments can be useful in the context of health services and substance abuse. This systematic review focuses mainly on research on the effectiveness of digital treatments for SU. Data sources included studies found on PsycINFO, PubMed, SCOPUS, and WebOfScience (WOS) database searches. The following keywords were used: TITLE (digital OR computer OR software OR tablet OR app OR videogame OR seriousgame OR virtualreality) AND ABSTRACT((mental AND health) AND (addiction OR dependence OR substance OR drug)). We focused on peer-reviewed articles published from 2010 through 2021 using PRISMA guidelines. A total of 18 studies met the inclusion criteria (i.e., type of intervention, efficacy in terms of misuse of substances and scored outcomes from questionnaire or toxicology tests, study methodology). The studies included investigations of specific digital treatments for SU of various kinds of drugs. The interventions were administered using personal computers, smartphones, or, in a few cases, tablets. Most of the interventions focused on the cognitive behavior therapy (CBT) model and/or on the use strategies, tips, or feedback. A minority provided information or training programs. The current review shows that digital treatments and interventions are effective in reducing the frequency of use, augmenting abstinence, or reducing the gravity of dependence for most of the studies at post-treatment. However, due to the heterogeneity of the variables (i.e., substance type, digital tool used, and treatment administered), there was a reduced generalizability of the results. This review highlights the need to continue the research in this field, and above all, to create effective digital protocols.

A comprehensive search string informed by an operational definition of complementary, alternative, and integrative medicine for systematic bibliographic database search strategies

BACKGROUND

Determining which therapies fall under the umbrella of complementary, alternative, and/or integrative medicine (CAIM) is difficult for several reasons. An operational definition is dynamic, and changes depending on both historical time period and geographical location, with many countries integrating or considering their traditional system(s) of medicine as conventional care. We have previously reported the first operational definition of CAIM informed by a systematic search. In the present study, we have developed a comprehensive search string informed by an operational definition of CAIM for systematic bibliographic database search strategies.

METHODS

We developed a single search string for the most common bibliographic databases, including those searchable on the OVID platform (e.g., MEDLINE, EMBASE, PsycINFO, AMED), the EBSCO platform (e.g., ERIC, CINAHL), Scopus, and Web of Science, using the finalised operational definition of CAIM's 604 therapies. We searched the Therapeutic Research Center's "Natural Medicines" database for all 604 therapies, and each item's scientific name and/or synonym was included as a keyword or phrase in the search string.

RESULTS

This developed search string provides a standardised list of CAIM terms (i.e., keywords and phrases) that may be searched on bibliographic databases including those found on the OVID platform (e.g., MEDLINE, EMBASE, PsycINFO, AMED), the EBSCO platform (e.g., ERIC, CINAHL), Scopus, and Web of Science.

CONCLUSION

Researchers can select relevant terms for their CAIM study and insert the keywords/phrases into these databases to receive all accessible data. This search technique can simply be copied and pasted into the search bar of each database to identify research by keywords, which is the most inclusive, or by words in the article title, which is more selective. Given its versatility across multiple commonly used academic platforms/databases, it is expected that this search string will be of great value to those conducting research on CAIM topics involving systematic search strategies.

Virtual Reality (VR) Technology for Treatment of Mental Health Problems during COVID-19: A Systematic Review

There was a surge in psychological distress and emotional burnout during the COVID-19 pandemic. Virtual reality (VR) is helpful as a psychological intervention whilst maintaining physical or social distancing. The present systematic review assessed the role of VR as a psychological intervention tool for mental health problems during the COVID-19 pandemic. We conducted a systematic review that followed the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines. This study used the search-related terms: (Virtual reality OR simulated-3D-environment OR VR) AND (covid! or corona!) AND (mental* OR psychologic* OR well* OR health*) AND (intervention) on six databases, i.e., MEDLINE, PsycINFO, Ovid Medline, EMBASE, ACM digital library, and Cochrane Central Register of Controlled Trials (CENTRAL) from the inception date until 23 June 2021. We finally included four studies in the systematic review out of the 379 references imported for screening. These studies reveal that VR is beneficial as a psychological tool for intervention in individuals with mental health problems. Immersed in the telepresence, interacting in a 3-D format compared to a 2-D layout, having a sense of enjoyment and engagement, activating an affective-motivational state, “escaping” to a virtual from the real world are pivotal faucets of VR as a psychological tool for intervention.

Operational definition of complementary, alternative, and integrative medicine derived from a systematic search

BACKGROUND

Identifying what therapies constitute complementary, alternative, and/or integrative medicine (CAIM) is complex for a multitude of reasons. An operational definition is dynamic, and changes based on both historical time period and geographical location whereby many jurisdictions may integrate or consider their traditional system(s) of medicine as conventional care. To date, only one operational definition of "complementary and alternative medicine" has been proposed, by Cochrane researchers in 2011. This definition is not only over a decade old but also did not use systematic methods to compile the therapies. Furthermore, it did not capture the concept "integrative medicine", which is an increasingly popular aspect of the use of complementary therapies in practice. An updated operational definition reflective of CAIM is warranted given the rapidly increasing body of CAIM research literature published each year.

METHODS

Four peer-reviewed or otherwise quality-assessed information resource types were used to inform the development of the operational definition: peer-reviewed articles resulting from searches across seven academic databases (MEDLINE, EMBASE, AMED, PsycINFO, CINAHL, Scopus and Web of Science); the "aims and scope" webpages of peer-reviewed CAIM journals; CAIM entries found in online encyclopedias, and highly-ranked websites identified through searches of CAIM-related terms on HONcode. Screening of eligible resources, and data extraction of CAIM therapies across them, were each conducted independently and in duplicate. CAIM therapies across eligible sources were deduplicated.

RESULTS

A total of 101 eligible resources were identified: peer-reviewed articles (n = 19), journal "aims and scope" webpages (n = 22), encyclopedia entries (n = 11), and HONcode-searched websites (n = 49). Six hundred four unique CAIM terms were included in this operational definition.

CONCLUSIONS

This updated operational definition is the first to be informed by systematic methods, and could support the harmonization of CAIM-related research through the provision of a standard of classification, as well as support improved collaboration between different research groups.

Reporting completeness in abstracts of systematic reviews of diagnostic test accuracy studies in cardiovascular diseases is suboptimal

OBJECTIVE

Journal abstracts are crucial for the identification and initial assessment of content of studies. We evaluated whether authors in the field of cardiovascular diseases (CVDs) reported Diagnostic Test Accuracy Systematic Reviews (DTA SRs) abstracts adequately, as defined by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)-DTA guidelines.

METHODS

SRs of DTA studies in CVDs published in general and specialized medical journals were identified in a MEDLINE search between 2010-2020. Adherence to 12 PRISMA-DTA for abstracts items was assessed independently by two reviewers and compared by journal's type. Moreover, the association of reporting completeness with different characteristics was investigated.

RESULTS

We included 72 abstracts. Studies published in general medical journals had higher mean reporting score than those in specialized journals (6.2 vs 5.3 out of 12 items; mean difference: 0.88; 95% confidence interval: 0.21, 1.55). PRISMA-DTA adherence was higher in journals that adopted this guideline and in articles with structured abstracts. However, number of participants analysed, funding and registration were the least-reported items in the identified abstracts.

CONCLUSION

The reporting of abstracts of DTA reports in CVDs is suboptimal according to PRISMA-DTA guidelines. Abstract reporting could be improved with the use of higher word count limits and the adoption of PRISMA-DTA guidelines especially in specialized journals.

CT/MRI and CEUS LI-RADS Major Features Association with Hepatocellular Carcinoma: Individual Patient Data Meta-Analysis

Background The Liver Imaging Reporting and Data System (LI-RADS) assigns a risk category for hepatocellular carcinoma (HCC) to imaging observations. Establishing the contributions of major features can inform the diagnostic algorithm. Purpose To perform a systematic review and individual patient data meta-analysis to establish the probability of HCC for each LI-RADS major feature using CT/MRI and contrast-enhanced US (CEUS) LI-RADS in patients at high risk for HCC. Materials and Methods Multiple databases (MEDLINE, Embase, Cochrane Central Register of Controlled Trials, and Scopus) were searched for studies from January 2014 to September 2019 that evaluated the accuracy of CT, MRI, and CEUS for HCC detection using LI-RADS (CT/MRI LI-RADS, versions 2014, 2017, and 2018; CEUS LI-RADS, versions 2016 and 2017). Data were centralized. Clustering was addressed at the study and patient levels using mixed models. Adjusted odds ratios (ORs) with 95% CIs were determined for each major feature using multivariable stepwise logistic regression. Risk of bias was assessed using Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) (PROSPERO protocol: CRD42020164486). Results A total of 32 studies were included, with 1170 CT observations, 3341 MRI observations, and 853 CEUS observations. At multivariable analysis of CT/MRI LI-RADS, all major features were associated with HCC, except threshold growth (OR, 1.6; 95% CI: 0.7, 3.6; P = .07). Nonperipheral washout (OR, 13.2; 95% CI: 9.0, 19.2; P = .01) and nonrim arterial phase hyperenhancement (APHE) (OR, 10.3; 95% CI: 6.7, 15.6; P = .01) had stronger associations with HCC than enhancing capsule (OR, 2.4; 95% CI: 1.7, 3.5; P = .03). On CEUS images, APHE (OR, 7.3; 95% CI: 4.6, 11.5; P = .01), late and mild washout (OR, 4.1; 95% CI: 2.6, 6.6; P = .01), and size of at least 20 mm (OR, 1.6; 95% CI: 1.04, 2.5; P = .04) were associated with HCC. Twenty-five studies (78%) had high risk of bias due to reporting ambiguity or study design flaws. Conclusion Most Liver Imaging Reporting and Data System major features had different independent associations with hepatocellular carcinoma; for CT/MRI, arterial phase hyperenhancement and washout had the strongest associations, whereas threshold growth had no association. © RSNA, 2021 Online supplemental material is available for this article.