Updating standards for reporting diagnostic accuracy: the development of STARD 2015

Diagnostic accuracy and radiological validation of intracerebral hemorrhage diagnosis in the Swedish Stroke Register (Riksstroke)

BACKGROUND AND PURPOSE

National quality registries for stroke care operate under the assumption that the included patients are correctly diagnosed. We aimed to validate the clinical diagnosis of spontaneous intracerebral hemorrhage (ICH) in Riksstroke (RS) by evaluating radiological data from a large, unselected ICH population.

METHODS

We conducted a retrospective, multicenter study including all ICH patients registered in RS between 2016 and 2020 residing in Skåne County in Sweden (1.41 million inhabitants). Radiological data from first imaging were evaluated for the presence of spontaneous ICH. Other types of bleeds were registered if a spontaneous ICH was not identified on imaging. The radiological evaluation was independently performed by one radiology fellow and one senior neuroradiologist.

RESULTS

Between 2016 and 2020, 1784 ICH cases were registered in RS, of which 1655 (92.8%) had a radiological diagnosis consistent with spontaneous ICH. In the 129 (7.2%) remaining cases, the radiological diagnosis was instead traumatic bleed (n = 80), subarachnoid hemorrhage (n = 15), brain tumor bleed (n = 14), ischemic lesion with hemorrhagic transformation (n = 14), ischemic lesion (n = 3), or no bleed at all (n = 3). There was a higher degree of incorrect coding in the older age groups.

CONCLUSION

At radiological evaluation, 92.8% of ICH diagnoses in RS were consistent with spontaneous ICH, yielding a high rate of agreement that strengthens the validity of the diagnostic accuracy in the register, justifying the use of high coverage quality register data for epidemiological purposes. The most common coding error was traumatic bleeds that were classified as spontaneous ICH.

Diagnostic value of neurofilaments in differentiating motor neuron disease from multifocal motor neuropathy

OBJECTIVE

To evaluate the performance of serum neurofilament light chain (NfL) and cerebrospinal fluid (CSF) phosphorylated neurofilament heavy chain (pNfH) as diagnostic biomarkers for the differentiation between motor neuron disease (MND) and multifocal motor neuropathy (MMN).

METHODS

This retrospective, monocentric study included 16 patients with MMN and 34 incident patients with MND. A subgroup of lower motor neuron (MN) dominant MND patients (n = 24) was analyzed separately. Serum NfL was measured using Ella automated immunoassay, and CSF pNfH was measured using enzyme-linked immunosorbent assay. Area under the curve (AUC), optimal cutoff values (Youden's index), and correlations with demographic characteristics were calculated.

RESULTS

Neurofilament concentrations were significantly higher in MND compared to MMN (p < 0.001), and serum NfL and CSF pNfH correlated strongly with each other (Spearman's rho 0.68, p < 0.001). Serum NfL (AUC 0.946, sensitivity and specificity 94%) and CSF pNfH (AUC 0.937, sensitivity 90.0%, specificity 100%) performed excellent in differentiating MND from MMN. Optimal cutoff values were ≥ 44.15 pg/mL (serum NfL) and ≥ 715.5 pg/mL (CSF pNfH), respectively. Similar results were found when restricting the MND cohort to lower MN dominant patients. Only one MMN patient had serum NfL above the cutoff. Two MND patients presented with neurofilament concentrations below the cutoffs, both featuring a slowly progressive disease.

CONCLUSION

Neurofilaments are valuable supportive biomarkers for the differentiation between MND and MMN. Serum NfL and CSF pNfH perform similarly well and elevated neurofilaments in case of diagnostic uncertainty underpin MND diagnosis.

Prediction of anemia in real-time using a smartphone camera processing conjunctival images

Anemia is defined as a low hemoglobin (Hb) concentration and is highly prevalent worldwide. We report on the performance of a smartphone application (app) that records images in RAW format of the palpebral conjunctivae and estimates Hb concentration by relying upon computation of the tissue surface high hue ratio. Images of bilateral conjunctivae were obtained prospectively from a convenience sample of 435 Emergency Department patients using a dedicated smartphone. A previous computer-based and validated derivation data set associating estimated conjunctival Hb (HBc) and the actual laboratory-determined Hb (HBl) was used in deriving Hb estimations using a self-contained mobile app. Accuracy of HBc was 75.4% (95% CI 71.3, 79.4%) for all categories of anemia, and Bland-Altman plot analysis showed a bias of 0.10 and limits of agreement (LOA) of (-4.73, 4.93 g/dL). Analysis of HBc estimation accuracy around different anemia thresholds showed that AUC was maximized at transfusion thresholds of 7 and 9 g/dL which showed AUC values of 0.92 and 0.90 respectively. We found that the app is sufficiently accurate for detecting severe anemia and shows promise as a population-sourced screening platform or as a non-invasive point-of-care anemia classifier.

The LEADING Guideline: Reporting Standards for Expert Panel, Best-Estimate Diagnosis, and Longitudinal Expert All Data (LEAD) Studies

Accurate assessments of symptoms and diagnoses are essential for health research and clinical practice but face many challenges. The absence of a single error-free measure is currently addressed by assessment methods involving experts reviewing several sources of information to achieve a more accurate or best-estimate assessment. Three bodies of work spanning medicine, psychiatry, and psychology propose similar assessment methods: The Expert Panel, the Best-Estimate Diagnosis, and the Longitudinal Expert All Data (LEAD). However, the quality of such best-estimate assessments is typically very difficult to evaluate due to poor reporting of the assessment methods and when it is reported, the reporting quality varies substantially. Here we tackle this gap by developing reporting guidelines for such studies, using a four-stage approach: 1) drafting reporting standards accompanied by rationales and empirical evidence, which were further developed with a patient organization for depression, 2) incorporating expert feedback through a two-round Delphi procedure, 3) refining the guideline based on an expert consensus meeting, and 4) testing the guideline by i) having two researchers test it and ii) using it to examine the extent previously published articles report the standards. The last step also demonstrates the need for the guideline: 18 to 58% (Mean = 33%) of the standards were not reported across fifteen randomly selected studies. The LEADING guideline comprises 20 reporting standards related to four groups: The Longitudinal design; the Appropriate data; the Evaluation - experts, materials, and procedures; and the Validity group. We hope that the LEADING guideline will be useful in assisting researchers in planning, reporting, and evaluating research aiming to achieve best-estimate assessments.

Assessment of Advanced Diagnostic Bronchoscopy Outcomes for Peripheral Lung Lesions: A Delphi Consensus Definition of Diagnostic Yield and Recommendations for Patient-centered Study Designs. An Official American Thoracic Society/American College of Chest Physicians Research Statement

Background: Advanced diagnostic bronchoscopy targeting the lung periphery has developed at an accelerated pace over the last two decades, whereas evidence to support introduction of innovative technologies has been variable and deficient. A major gap relates to variable reporting of diagnostic yield, in addition to limited comparative studies. Objectives: To develop a research framework to standardize the evaluation of advanced diagnostic bronchoscopy techniques for peripheral lung lesions. Specifically, we aimed for consensus on a robust definition of diagnostic yield, and we propose potential study designs at various stages of technology development. Methods: Panel members were selected for their diverse expertise. Workgroup meetings were conducted in virtual or hybrid format. The cochairs subsequently developed summary statements, with voting proceeding according to a modified Delphi process. The statement was cosponsored by the American Thoracic Society and the American College of Chest Physicians. Results: Consensus was reached on 15 statements on the definition of diagnostic outcomes and study designs. A strict definition of diagnostic yield should be used, and studies should be reported according to the STARD (Standards for Reporting Diagnostic Accuracy Studies) guidelines. Clinical or radiographic follow-up may be incorporated into the reference standard definition but should not be used to calculate diagnostic yield from the procedural encounter. Methodologically robust comparative studies, with incorporation of patient-reported outcomes, are needed to adequately assess and validate minimally invasive diagnostic technologies targeting the lung periphery. Conclusions: This American Thoracic Society/American College of Chest Physicians statement aims to provide a research framework that allows greater standardization of device validation efforts through clearly defined diagnostic outcomes and robust study designs. High-quality studies, both industry and publicly funded, can support subsequent health economic analyses and guide implementation decisions in various healthcare settings.

Performance of the 0/2-hour high-sensitivity cardiac troponin T diagnostic protocol in a multisite United States cohort

BACKGROUND

The diagnostic performance of the high-sensitivity troponin T (hs-cTnT) 0/2-h algorithm is unclear among U.S. emergency department (ED) patients with acute chest pain.

METHODS

A preplanned subgroup analysis of the STOP-CP cohort study was conducted. Participants with 0- and 2-h hs-cTnT measures prospectively enrolled at eight U.S. EDs from January 2017 to September 2018 were stratified into rule-out, observation, and rule-in zones using the hs-cTnT 0/2-h algorithm alone and combined with the history, electrocardiogram, age, and risk factor (HEAR) score. The primary outcome was adjudicated 30-day cardiac death or myocardial infarction (CDMI). The sensitivity and negative predictive value (NPV) of the 0/2-h rule-out zone and specificity and positive predictive value (PPV) of the rule-in zone for 30-day CDMI were calculated.

RESULTS

Of the 1307 patients accrued, 53.6% (700/1307) were male and 58.6% (762/1307) were White, with a mean ± SD age of 57.5 ± 12.7 years. At 30 days, CDMI occurred in 12.9% (168/1307) of participants. The 0/2-h algorithm ruled out 61.4% (802/1307) of patients. Among rule-out patients, 1.9% (15/802) experienced 30-day CDMI, resulting in a sensitivity of 91.1% (95% confidence interval [CI] 85.7%-94.9%) and NPV of 98.1% (95% CI 96.9%-98.9%). The 0/2-h algorithm ruled in 12.4% (162/1307) patients of whom 61.7% (100/162) experienced 30-day CDMI. The rule-in zone specificity was 94.6% (95% CI 93.1%-95.8%) and PPV was 61.7% (95% CI 53.8%-69.2%) for 30-day CDMI. The 0/2-h algorithm combined with HEAR score ruled out 30.7% (401/1307) of patients with a sensitivity and NPV for 30-day CDMI of 98.2% (95% CI 94.9%-99.6%) and 99.3% (95% CI 97.8%-99.8%), respectively.

CONCLUSIONS

The hs-cTnT 0/2-h algorithm ruled out most patients. With NPV of <99% for 30-day CDMI, the hs-cTnT 0/2-h algorithm, many emergency physicians may not consider it safe to use for U.S. ED patients. When combined with a low-risk HEAR score, NPV was >99% for 30-day CDMI at the cost of reduced efficacy.

A Decade of Efforts to Add Value to Child Health Research Practices

OBJECTIVE

To identify practices that add value to improve the design, conduct, and reporting of child health research and reduce research waste.

STUDY DESIGN

In order to categorize the contributions of members of Standards for Research (StaR) in Child Health network, we developed a novel Child Health Improving Research Practices (CHIRP) framework comprised of 5 domains meant to counteract avoidable child health research waste and improve quality: 1) address research questions relevant to children, their families, clinicians, and researchers; 2) apply appropriate research design, conduct and analysis; 3) ensure efficient research oversight and regulation; 4) Provide accessible research protocols and reports; and 5) develop unbiased and usable research reports, including 17 responsible research practice recommendations. All child health research relevant publications by the 48 original StaR standards' authors over the last decade were identified, and main topic areas were categorized using this framework.

RESULTS

A total of 247 publications were included in the final sample: 100 publications (41%) in domain 1 (3 recommendations), 77 publications (31%) in domain 2 (3), 35 publications (14%) in domain 3 (4), 20 publications (8%) in domain 4 (4), and 15 publications (6%) in domain 5 (3). We identified readily implementable "responsible" research practices to counter child health research waste and improve quality, especially in the areas of patients and families' engagement throughout the research process, developing Core Outcome Sets, and addressing ethics and regulatory oversight issues.

CONCLUSION

While most of the practices are readily implementable, increased awareness of methodological issues and wider guideline uptake is needed to improve child health research. The CHIRP Framework can be used to guide responsible research practices that add value to child health research.

Sex and race differences in the performance of the European Society of Cardiology 0/1-h algorithm with high-sensitivity troponin T

The diagnostic performance of the high-sensitivity troponin T (hs-cTnT) European Society of Cardiology (ESC) 0/1-h algorithm in sex and race subgroups of US Emergency Department (ED) patients is unclear. A pre-planned subgroup analysis of the STOP-CP cohort study was conducted. Participants with 0- and 1-h hs-cTnT measures from eight US EDs (1/2017 to 9/2018) were stratified into rule-out, observation, and rule-in zones using the hs-cTnT ESC 0/1 algorithm. The primary outcome was adjudicated 30-day cardiac death or MI. The proportion with the primary outcome in each zone was compared between subgroups with Fisher's exact tests. The negative predictive value (NPV) of the ESC 0/1 rule-out zone for 30-day CDMI was calculated and compared between subgroups using Fisher's exact tests. Of the 1422 patients enrolled, 54.2% (770/1422) were male and 58.1% (826/1422) white with a mean age of 57.6 ± 12.8 years. At 30 days, cardiac death or myocardial infarction (MI) occurred in 12.9% (183/1422) of participants. Among patients stratified to the rule-out zone, 30-day cardiac death or MI occurred in 1.1% (5/436) of women versus 2.1% (8/436) of men (p = .40) and 1.2% (4/331) of non-white patients versus 1.8% (9/490) of white patients (p = .58). The NPV for 30-day cardiac death or MI was similar among women versus men (98.9% [95% confidence interval, CI: 97.3-99.6] vs. 97.9% [95% CI: 95.9-99.1]; p = .40) and among white versus non-white patients (98.8% [95% CI: 96.9-99.7] vs. 98.2% [95% CI: 96.5-99.2]; p = .39). NPVs <99% in each subgroup suggest the hs-cTnT ESC 0/1-h algorithm may not be safe for use in US EDs. Trial Registration: High-Sensitivity Cardiac Troponin T to Optimize Chest Pain Risk Stratification (STOP-CP; ClinicalTrials.gov: NCT02984436; https://clinicaltrials.gov/ct2/show/NCT02984436).

Guidelines for reporting pediatric and child health clinical trial protocols and reports: study protocol for SPIRIT-Children and CONSORT-Children

BACKGROUND

Despite the critical importance of clinical trials to provide evidence about the effects of intervention for children and youth, a paucity of published high-quality pediatric clinical trials persists. Sub-optimal reporting of key trial elements necessary to critically appraise and synthesize findings is prevalent. To harmonize and provide guidance for reporting in pediatric controlled clinical trial protocols and reports, reporting guideline extensions to the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) and Consolidated Standards of Reporting Trials (CONSORT) guidelines specific to pediatrics are being developed: SPIRIT-Children (SPIRIT-C) and CONSORT-Children (CONSORT-C).

METHODS

The development of SPIRIT-C/CONSORT-C will be informed by the Enhancing the Quality and Transparency of Health Research Quality (EQUATOR) method for reporting guideline development in the following stages: (1) generation of a preliminary list of candidate items, informed by (a) items developed during initial development efforts and child relevant items from recent published SPIRIT and CONSORT extensions; (b) two systematic reviews and environmental scan of the literature; (c) workshops with young people; (2) an international Delphi study, where a wide range of panelists will vote on the inclusion or exclusion of candidate items on a nine-point Likert scale; (3) a consensus meeting to discuss items that have not reached consensus in the Delphi study and to "lock" the checklist items; (4) pilot testing of items and definitions to ensure that they are understandable, useful, and applicable; and (5) a final project meeting to discuss each item in the context of pilot test results. Key partners, including young people (ages 12-24 years) and family caregivers (e.g., parents) with lived experiences with pediatric clinical trials, and individuals with expertise and involvement in pediatric trials will be involved throughout the project. SPIRIT-C/CONSORT-C will be disseminated through publications, academic conferences, and endorsement by pediatric journals and relevant research networks and organizations.

DISCUSSION

SPIRIT/CONSORT-C may serve as resources to facilitate comprehensive reporting needed to understand pediatric clinical trial protocols and reports, which may improve transparency within pediatric clinical trials and reduce research waste.

TRIAL REGISTRATION

The development of these reporting guidelines is registered with the EQUATOR Network: SPIRIT-Children ( https://www.equator-network.org/library/reporting-guidelines-under-development/reporting-guidelines-under-development-for-clinical-trials-protocols/#35 ) and CONSORT-Children ( https://www.equator-network.org/library/reporting-guidelines-under-development/reporting-guidelines-under-development-for-clinical-trials/#CHILD ).

Effect of volume of instillate on the diagnostic utility of bronchoalveolar lavage galactomannan in patients with suspected chronic pulmonary aspergillosis-A pilot study

BACKGROUND

Bronchoalveolar lavage (BAL) galactomannan (GM) is commonly used to diagnose Aspergillus-related lung diseases. However, unlike serum GM, which is measured in undiluted blood, BAL-GM is estimated using variable aliquots and cumulative volume of instillates during bronchoscopy.

OBJECTIVE

Since different studies have reported varying diagnostic accuracy and cut-offs for BAL-GM in CPA, we hypothesized that the total volume of instillate and 'order/label' of aliquots significantly affects the BAL-GM values, which was evaluated as part of this study.

PATIENTS & METHODS

We obtained 250 BAL samples from 50 patients (five from each) with suspected chronic pulmonary aspergillosis. BAL fluid was collected after instilling sequential volumes of 40 mL of normal saline each for the first four labels and a fifth label was prepared by mixing 1 mL from each of the previous labels. The GM level of each label was measured by PLATELIA™ ASPERGILLUS Ag enzyme immunoassay. This study measured the discordance, level of agreement, diagnostic characteristics (sensitivity, specificity and AUROC) and best cut-offs for BAL-GM in the different aliquots of lavage fluid.

RESULTS

The study population, classified into CPA (28%) and non-CPA (72%) groups, based on ERS/ESCMID criteria (excluding BAL-GM) were not different with respect to clinico-radiological characteristics. The discordance of BAL-GM positivity (using a cut-off of >1) between the serial labels for the same patient ranged between 10% and 22%, while the discordance between classification using BAL-GM positivity (using a cut-off of ≥1) and clinic-radio-microbiological classification ranged between 18% and 30%. The level of agreement for serial labels was at best fair (<0.6 for all except one 'label'). The AUROC for the serial samples ranged between 0.595 and 0.702, with the '40 mL and the 'mix' samples performing the best. The best BAL-GM cut-off also showed significant variation between serial labels of varying dilutions (Range:1.01 - 4.26).

INTERPRETATION

This study highlights the variation in BAL-GM measured and the 'positivity' between different 'labels' of aliquots of BAL, with the first aliquot and the mixed sample showing the best performances for diagnosis of CPA. Future studies should attempt to 'standardise' the instilled volume for BAL-GM estimation to standardise the diagnostic yield.

'Immune-inflammatory markers & clinical characteristics for outcomes in hospitalized SARS-CoV-2 infected patients of Pakistan: a retrospective analysis'

OBJECTIVE

Accumulating evidence suggests the role of immune-inflammatory markers in early risk stratification and prognostication of COVID-19 patients. We aimed to evaluate their association with severity and the development of diagnostic scores with optimal thresholds in critical patients.

SETTING AND PARTICIPANTS

This retrospective case study includes hospitalized COVID-19 patients from March 2019 to March, 2022, in the developing area teaching hospital in Pakistan. Polymerase chain reaction (PCR) positive patients, n = 467 were investigated for clinical outcomes, comorbidities and disease prognosis. The plasma levels of Interleukin-6 (IL-6), Lactate dehydrogenase (LDH), C-reactive protein (CRP), Procalcitonin (PCT), ferritin and Complete blood count markers were measured.

RESULTS

Majority were males (58.8%) and patients with comorbidities had more severe disease. Hypertension and diabetes mellitus were the commonest comorbidities. Shortness of breath, myalgia and cough were the main symptoms. The hematological markers NLR, as well as the plasma levels of immune-inflammatory variables, IL-6, LDH, Procalcitonin, Erythrocyte sedimentation rate, Ferritin were markedly raised in severe and critical patients (p < 0.0001 for these markers). ROC analysis supports IL-6 as the most accurate marker with high prognostic relevance with proposed cut-off threshold (43 pg/ml), determining >90% of patients in terms of COVID-19 severity (AUC = 0.93, 91.7%, se; 90.3%sp). Furthermore, positive correlation with all other markers including NLR with cut-off = 2.99 (AUC = 0.87, se = 89.8%, sp = 88.4%), CRP with cut-offs at 42.9 mg/l, (AUC = 0.883, se = 89.3% and sp = 78.6%), LDH cut-off at 267μg/L, evidenced in >80% patients (AUC = 0.834 se = 84% and sp = 80%). Additionally, ESR and ferritin have the corresponding AUC 0.81 and 0.813 with cut-off at 55 mm/hr and 370, respectively.

CONCLUSION

Investigating the immune-inflammatory markers can assist physicians in providing prompt treatment and ICU admission in terms of COVID-19 severity. As a result, which may reduce the overall mortality of COVID-19 patients.

Development and Replication of Objective Measurements of Social Visual Engagement to Aid in Early Diagnosis and Assessment of Autism

Importance

Autism spectrum disorder is a common and early-emerging neurodevelopmental condition. While 80% of parents report having had concerns for their child's development before age 2 years, many children are not diagnosed until ages 4 to 5 years or later.

Objective

To develop an objective performance-based tool to aid in early diagnosis and assessment of autism in children younger than 3 years.

Design, Setting, and Participants

In 2 prospective, consecutively enrolled, broad-spectrum, double-blind studies, we developed an objective eye-tracking-based index test for children aged 16 to 30 months, compared its performance with best-practice reference standard diagnosis of autism (discovery study), and then replicated findings in an independent sample (replication study). Discovery and replication studies were conducted in specialty centers for autism diagnosis and treatment. Reference standard diagnoses were made using best-practice standardized protocols by specialists blind to eye-tracking results. Eye-tracking tests were administered by staff blind to clinical results. Children were enrolled from April 27, 2013, until September 26, 2017. Data were analyzed from March 28, 2018, to January 3, 2019.

Main Outcomes and Measures

Prespecified primary end points were the sensitivity and specificity of the eye-tracking-based index test compared with the reference standard. Prespecified secondary end points measured convergent validity between eye-tracking-based indices and reference standard assessments of social disability, verbal ability, and nonverbal ability.

Results

Data were collected from 1089 children: 719 children (mean [SD] age, 22.4 [3.6] months) in the discovery study, and 370 children (mean [SD] age, 25.4 [6.0] months) in the replication study. In discovery, 224 (31.2%) were female and 495 (68.8%) male; in replication, 120 (32.4%) were female and 250 (67.6%) male. Based on reference standard expert clinical diagnosis, there were 386 participants (53.7%) with nonautism diagnoses and 333 (46.3%) with autism diagnoses in discovery, and 184 participants (49.7%) with nonautism diagnoses and 186 (50.3%) with autism diagnoses in replication. In the discovery study, the area under the receiver operating characteristic curve was 0.90 (95% CI, 0.88-0.92), sensitivity was 81.9% (95% CI, 77.3%-85.7%), and specificity was 89.9% (95% CI, 86.4%-92.5%). In the replication study, the area under the receiver operating characteristic curve was 0.89 (95% CI, 0.86-0.93), sensitivity was 80.6% (95% CI, 74.1%-85.7%), and specificity was 82.3% (95% CI, 76.1%-87.2%). Eye-tracking test results correlated with expert clinical assessments of children's individual levels of ability, explaining 68.6% (95% CI, 58.3%-78.6%), 63.4% (95% CI, 47.9%-79.2%), and 49.0% (95% CI, 33.8%-65.4%) of variance in reference standard assessments of social disability, verbal ability, and nonverbal cognitive ability, respectively.

Conclusions and Relevance

In two diagnostic studies of children younger than 3 years, objective eye-tracking-based measurements of social visual engagement quantified diagnostic status as well as individual levels of social disability, verbal ability, and nonverbal ability in autism. These findings suggest that objective measurements of social visual engagement can be used to aid in autism diagnosis and assessment.

Artificial intelligence in endoscopic ultrasonography: risk stratification of gastric gastrointestinal stromal tumors

Background

Previous studies have identified useful endoscopic ultrasonography (EUS) features to predict the malignant potential of gastrointestinal stromal tumors (GISTs). However, the results of the studies were not consistent. Artificial intelligence (AI) has shown promising results in medicine.

Objectives

We aimed to build a risk stratification EUS-AI model to predict the malignancy potential of GISTs.

Design

This was a retrospective study with external validation.

Methods

We developed two models using EUS images from two hospitals to predict the GIST risk category. Model 1 was the four-category risk EUS-AI model, and Model 2 was the two-category risk EUS-AI model. The diagnostic performance of the models was validated with external cohorts.

Results

A total of 1320 images (880 were very low-risk, 269 were low-risk, 68 were intermediate-risk, and 103 were high-risk) were finally chosen for building the models and test sets, and a total of 656 images (211 were very low-risk, 266 were low-risk, 88 were intermediate-risk, and 91 were high-risk) were chosen for external validation. The overall accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) for the four-category risk EUS-AI model in the external validation sets by tumor were 74.50%, 55.00%, 79.05%, 53.49%, and 81.63%, respectively. The accuracy, sensitivity, specificity, PPV, and NPV for the two-category risk EUS-AI model for the prediction of very low-risk GISTs in the external validation sets by tumor were 86.25%, 94.44%, 79.55%, 79.07%, and 94.59%, respectively.

Conclusion

We developed a EUS-AI model for the risk stratification of GISTs with promising results, which may complement current clinical practice in the management of GISTs.

Registration

The study has been registered in the Chinese Clinical Trial Registry (No. ChiCTR2100051191).

Transcranial doppler in the non-invasive estimation of intracranial pressure in traumatic brain injury compared to other non-invasive methods in lower-middle income countries: Systematic review and meta-analysis

BACKGROUND

The prediction of raised Intracranial Pressure (ICP) with accuracy in Traumatic Brain Injury (TBI) patients is a clinically important decision and therapeutic tool. This study aimed to evaluate the existing methods used for non-invasive ICP monitoring in TBI patients in LMICs.

METHODS

Systematic searches of PubMed, Google Scholar, and ScienceDirect were performed from database inception to November 2021. Studies reporting the prediction of raised ICP in TBI patients by non-invasive means in LMICs were included. Pooled estimates of sensitivity, specificity, positive likelihood ratios, and negative likelihood ratios with 95 %CI were calculated for each index test consisting of the fifteen studies, using the MEDDECIDE module 0.0.2 for meta-analysis of diagnostic test accuracy, reliability, and decision studies in JAMOVI 2.2.5.

RESULTS

A total of 1032 studies were identified, of which, 15 included 3316 patients with male predominance (n = 2458, 74.13%). Patients' ages range from 15 to 96 years with 40-80 (n = 1205, 36.34%), the most represented population. The ICP measured by Transcranial Doppler (TCD) had a sensitivity of 92.3%, and a specificity of 70%. The positive predictive value was 66.67%, with a negative predictive value of 93.33%. Furthermore, the positive Likelihood Ratio (+LR) was 3.69; 2<+LR < 5 and the negative Likelihood Ratio (-LR) 0.103; 0.1 < -LR < 0.2. We carried out a "Medical Decision", "Plots", "Fagan Normogram" and the ROC curve to find the perfect discrimination point of all the five tests used for the non-invasive measurement of ICP in the TBI patients in LMICs.

CONCLUSION

The TCD had shown high performance in its sensitivity and specificity, placing it on top of the other four different tests used in LMICs for the management of patients with TBI.

Evaluation of electronic measurement of capillary refill for Sepsis screening at ED triage

OBJECTIVE

To evaluate the association between capillary refill time (CRT) measured by a medical device and sepsis among patients presenting to the Emergency Department (ED).

METHODS

This prospective observational study enrolled adult and pediatric patients during ED triage when sepsis was considered a potential diagnosis by the triage nurse. Patients were enrolled at an academic medical center between December 2020 and June 2022. CRT was measured by a research assistant using an investigational medical device. The outcomes included sepsis and septic shock defined using sep-3 criteria, septic shock defined as IV antibiotics and a vasopressor requirement, ICU admission, and hospital mortality. Other measures included patient demographics and vital signs at ED triage. We evaluated univariate associations between CRT and sepsis outcomes.

RESULTS

We enrolled 563 patients in the study, 48 met Sep-3 criteria, 5 met Sep-3 shock criteria, and 11 met prior septic shock criteria (IV antibiotics and vasopressors to maintain mean arterial pressure of 65). Sixteen patients were admitted to the ICU. The mean age was 49.1 years, and 51% of the cohort was female. The device measured CRT was significantly associated with the diagnosis of sepsis by sep-3 criteria (OR 1.23, 95% CI 1.06-1-43), septic shock by sep-3 criteria (OR 1.57, 95% CI 1.02-2.40), and septic shock defined as receipt of IV antibiotics and a vasopressor requirement (OR 1.37, 95% CI 1.03-1.82). Patients with CRT >3.5 s measured by the DCR device had an odds ratio of 4.67 (95%CI 1.31-16.1) of septic shock (prior definition), and an odds ratio of 3.97 (95% CI 1.99-7.92) of ICU admission, supporting the potential for the 3.5-s cutoff of the DCR measurement.

CONCLUSIONS

CRT measured by a medical device at ED triage was associated with the diagnosis of sepsis. Objective CRT measurement using a medical device may be a relatively simple way to improve sepsis diagnosis during ED triage.

Novel pan-lineage VP1 specific degenerate primers for precise genetic characterization of serotype O foot and mouth disease virus circulating in India

Analysis of the VP1 gene sequence of the foot and mouth disease virus (FMDV) is critical to understanding viral evolution and disease epidemiology. A standard set of primers have been used for the detection and sequence analysis of the VP1 gene of FMDV directly from suspected clinical samples with limited success. The study validated VP1-specific degenerate primer-based reverse transcription polymerase chain reaction (RT-PCR) for the qualitative detection and sequencing of serotype O FMDV lineages circulating in India. The novel degenerate primer-based RT-PCR amplifying the VP1 gene can circumvent the genetic heterogeneity observed in viruses after cell culture adaptation and facilitate precise viral gene sequence analysis from clinical samples.

Impact of Albumin Assays in the Diagnosis of Malnutrition in Hemodialysis Patients: A Cohort Study

OBJECTIVE

In hemodialysis (HD) patients, malnutrition should be diagnosed by several assessment tools including a plasma albumin concentration of less than 3.8 g/dL or 3.5 g/dL using bromocresol green or immunonephelometry (IN), respectively. However, albumin measurement is not yet standardized and two alternative methods are also commonly used in laboratories: bromocresol purple (BCP) and immunoturbidimetry (IT). This study aimed to revisit the hypoalbuminemia thresholds for BCP and IT, in HD patients.

METHODS

Plasma albumin was measured by the four analytical methods during the monthly HD nutritional assessment of 103 prospectively included patients.

RESULTS

Significant differences in albumin levels were observed in HD patients depending on the method used. Using BCP or IT with the cut-off at 3.5 g/dL (determined for the general population) we obtained 33% and 9.7% of false hypoalbuminemia in comparison to IN (mean bias of -0.4 g/dL and -0.065 g/dL, respectively). The best hypoalbuminemia threshold for BCP was 3.05 g/dL and 3.4 g/dL for IT. Twenty percent of HD patients were classified as malnourished when albumin was determined by IN. Similar rates were obtained using the new hypoalbuminemia cut-offs for BCP (18.5%) and IT (19.5%).

CONCLUSION

To avoid nutritional misclassification of HD patients, we should adjust hypoalbuminemia thresholds when BCP or IT methods are used in laboratories.

Clinical impact of whole-genome sequencing in patients with early-onset dementia

BACKGROUND

In the clinical setting, identification of the genetic cause in patients with early-onset dementia (EOD) is challenging due to multiple types of genetic tests required to arrive at a diagnosis. Whole-genome sequencing (WGS) has the potential to serve as a single diagnostic platform, due to its superior ability to detect common, rare and structural genetic variation.

METHODS

WGS analysis was performed in 50 patients with EOD. Point mutations, small insertions/deletions, as well as structural variants (SVs) and short tandem repeats (STRs), were analysed. An Alzheimer's disease (AD)-related polygenic risk score (PRS) was calculated in patients with AD.

RESULTS

Clinical genetic diagnosis was achieved in 7 of 50 (14%) of the patients, with a further 8 patients (16%) found to have established risk factors which may have contributed to their EOD. Two pathogenic variants were identified through SV analysis. No expanded STRs were found in this study cohort, but a blinded analysis with a positive control identified a C9orf72 expansion accurately. Approximately 37% (7 of 19) of patients with AD had a PRS equivalent to >90th percentile risk.

DISCUSSION

WGS acts as a single genetic test to identify different types of clinically relevant genetic variations in patients with EOD. WGS, if used as a first-line clinical diagnostic test, has the potential to increase the diagnostic yield and reduce time to diagnosis for EOD.

Systematic review: investigating the added diagnostic value of gadolinium contrast agents for osteomyelitis in the appendicular skeleton

OBJECTIVE

Osteomyelitis is an infection of the bone marrow. MRI with gadolinium-based contrast is frequently performed for cases of suspected osteomyelitis. The objective of this systematic review is to examine the diagnostic accuracy of contrast-enhanced vs non-contrast-enhanced MRI for osteomyelitis in the appendicular skeleton.

MATERIALS AND METHODS

We conducted a systematic review of MRI in the diagnosis of osteomyelitis by searching MEDLINE and EMBASE from January 2000 to March 2020. There were 21 studies that met the inclusion criteria for the systematic review for a total of 1095 patients. Analytic methods were based on Preferred Reporting Items for Systematic Reviews and Meta-Analyses. Evidence was evaluated using the STARD criteria for evaluation of completeness and transparency of reporting.

RESULTS

For diagnosing osteomyelitis in the appendicular skeleton, MRI with gadolinium-based contrast has 89% sensitivity (95% CI, 86-92%), 79% specificity (95% CI, 75-83%), and 90% overall diagnostic accuracy ([SE] = 0.03). For diagnosing osteomyelitis in the appendicular skeleton, MRI without gadolinium-based contrast has a 92% sensitivity (95% CI, 87-96%), 89% specificity (95% CI, 84-93%), and 96% overall diagnostic accuracy ([SE] = 0.03). The median score of included studies was 85% utilizing the STARD criteria with excellent interobserver agreement of 83.4%. Limitations included small sample size of studies, with retrospective designs.

CONCLUSION

No evidence was found to suggest an added diagnostic value of gadolinium contrast for the diagnosis of osteomyelitis in the appendicular skeleton. For routine cases of suspected non-spinal osteomyelitis, non-contrast MRI of the area of interest is the next most appropriate study after radiographs.

Neurological Pupil Index for the Early Prediction of Outcome in Severe Acute Brain Injury Patients

In this study, we examined the early value of automated quantitative pupillary examination, using the Neurological Pupil index (NPi), to predict the long-term outcome of acute brain injured (ABI) patients. We performed a single-centre retrospective study (October 2016−March 2019) in ABI patients who underwent NPi measurement during the first 3 days following brain insult. We examined the performance of NPi—alone or in combination with other baseline demographic (age) and radiologic (CT midline shift) predictors—to prognosticate unfavourable 6-month outcome (Glasgow Outcome Scale 1−3). A total of 145 severely brain-injured subjects (65 traumatic brain injury, TBI; 80 non-TBI) were studied. At each time point tested, NPi <3 was highly predictive of unfavourable outcome, with highest specificity (100% (90−100)) at day 3 (sensitivity 24% (15−35), negative predictive value 36% (34−39)). The addition of NPi, from day 1 following ABI to age and cerebral CT scan, provided the best prognostic performance (AUROC curve 0.85 vs. 0.78 without NPi, p = 0.008; DeLong test) for 6-month neurological outcome prediction. NPi, assessed at the early post-injury phase, has a superior ability to predict unfavourable long-term neurological outcomes in severely brain-injured patients. The added prognostic value of NPi was most significant when complemented with baseline demographic and radiologic information.

Performance of the 2016 diagnostic criteria for fibromyalgia in a tertiary care pain rehabilitation setting: a diagnostic accuracy study

OBJECTIVES

With the International Classification of Diseases 11th revision (classifying fibromyalgia as a primary pain disorder) soon to be implemented, the importance of pain physicians being able to identify patients with fibromyalgia is emphasized. The diagnostic criteria proposed in 2016 are based on self-reported pain distribution and symptom severity. The study aimed to evaluate the diagnostic accuracy of the 2016 diagnostic criteria for fibromyalgia applied in a population of patients with high impact chronic pain referred for pain rehabilitation.

METHODS

The study was performed as a diagnostic accuracy study at two Danish interdisciplinary pain rehabilitation centers, including 215 participants. All participants were evaluated clinically to identify patients with fibromyalgia. The diagnosis was based on expert opinion, but the minimum requirements were: (1) pain in all four body quadrants and axially for at least three months and (2) minimum 8 of 18 positive tender points. Participants filled in the fibromyalgia survey questionnaire, the patient version of the 2016 diagnostic criteria. Sensitivity, specificity, likelihood ratios, and positive and negative post-test probabilities were calculated using a clinical diagnosis of fibromyalgia as the reference standard.

RESULTS

Based on clinical diagnosis 45% of the participants were diagnosed with fibromyalgia; of these, only 19% had been diagnosed previously. The 2016 diagnostic criteria demonstrated a sensitivity of 88.5%, a specificity of 81.5%, a positive likelihood ratio of 4.79, a negative likelihood ratio of 0.14, a positive post-test probability of 79.4%, and a negative post-test probability of 10.2%.

CONCLUSIONS

Fibromyalgia was severely under-diagnosed among patients with high impact chronic pain referred to tertiary care in two pain rehabilitation centers in Denmark. The 2016 diagnostic criteria showed sufficient discriminatory properties suggesting that the fibromyalgia survey questionnaire can be used as a screening tool assisting the identification of fibromyalgia in this patient population.

Comparing shoulder maneuvers to magnetic resonance imaging and arthroscopic findings in patients with supraspinatus tears

BACKGROUND

Shoulder maneuvers and magnetic resonance imaging (MRI) are performed to diagnose supraspinatus tendon tears regardless of arthroscopy exam. Although there are many studies on this subject, there is a lack of studies comparing the sensitivity (Se) and specificity (Sp) of shoulder maneuvers and MRI to arthroscopic findings (intact, partial, or full thickness supraspinatus tendon tear).

AIM

To compare the diagnostic values of shoulder maneuvers with MRI for supraspinatus tendon tears in patients undergoing shoulder arthroscopy.

METHODS

A total of 199 consecutive patients from four orthopedic centers met the eligibility criteria of shoulder pain persisting for at least four weeks. They were prospectively enrolled in this study from April 2017 to April 2019. Seven clinical tests (full can, empty can, drop arm, Hawkins’, painful arc, Neer’s sign and resisted external rotation) and MRI were performed, and all were compared with surgical findings. Full can, empty can and resisted external rotation tests were interpreted as positive in the case of pain and/or weakness. We assessed the Se, Sp, accuracy, positive predictive value (PPV) and negative predictive value (NPV), positive and negative likelihood ratio and diagnostic odds ratio for overall, partial and full-thickness supraspinatus tears.

RESULTS

MRI had the highest Se for overall (0.97), partial (0.91) and full-thickness (0.99) tears; moreover, MRI had the highest NPV: 0.90, 0.88 and 0.98 for overall, partial and full-thickness tears, respectively. For overall supraspinatus tears, the Se and PPV were: Painful arc (Se = 0.85/PPV = 0.91), empty can (pain) (Se = 0.80/PPV = 0.89), full can (pain) (Se = 0.78/PPV = 0.90), resisted external rotation (pain) (Se = 0.48/PPV = 0.87), drop arm (Se = 0.19/PPV = 0.97), Neer’s sign (Se = 0.78/PPV = 0.93) and Hawkins’ (Se = 0.80/PPV = 0.88). MRI had the highest PPV (0.99). The Hawkin’s test had the highest false positive rate in patients with intact tendons (0.36). The Sp of the empty can and full can (both tests positive for pain and weakness), drop arm and MRI were: 0.93, 0.91, 0.98 and 0.96, respectively. For partial and full-thickness tears, the empty can test (positive for pain and weakness) had a Sp of 0.93, and the drop arm and MRI had the same Sp (0.98).

CONCLUSION

Physical examination demonstrated good diagnostic value, the drop arm test had a Sp as good as MRI for supraspinatus tears; however, MRI was more accurate in ruling out tears. The Hawkins’ test had high false-positive findings in patients with intact tendons.

Diagnostic accuracy of a SARS-CoV-2 rapid test and optimal time for seropositivity according to the onset of symptoms

Point-of-care serological tests for SARS-CoV-2 have been used for COVID-19 diagnosis. However, their accuracy over time regarding the onset of symptoms is not fully understood. We aimed to assess the accuracy of a point-of-care lateral flow immunoassay (LFI). Subjects, aged over 18 years, presenting clinical symptoms suggestive of acute SARS-CoV-2 infection were tested once by both nasopharyngeal and oropharyngeal RT-PCR and LFI. The accuracy of LFI was assessed in periodic intervals of three days in relation to the onset of symptoms. The optimal cut-off point was defined as the number of days required to achieve the best sensitivity and specificity. This cut-off point was also used to compare LFI accuracy according to participants’ status: outpatient or hospitalized. In total, 959 patients were included, 379 (39.52%) tested positive for SARS-CoV-2 with RT-PCR, and 272 (28.36%) tested positive with LFI. LFI best performance was achieved after 10 days of the onset of symptoms, with sensitivity and specificity of 84.9% (95%CI: 79.8-89.1) and 94.4% (95%CI: 91.0-96.8), respectively. Although the specificity was similar (94.6% vs. 88.9%, p = 0.051), the sensitivity was higher in hospitalized patients than in outpatients (91.7% vs. 82.1%, p = 0.032) after 10 days of the onset of symptoms. Best sensitivity of point-of-care LFI was found 10 days after the onset of symptoms which may limit its use in acute care. Specificity remained high regardless of the number of days since the onset of symptoms.

Lung ultrasound in a tertiary intensive care unit population: a diagnostic accuracy study

BACKGROUND

Evidence from previous studies comparing lung ultrasound to thoracic computed tomography (CT) in intensive care unit (ICU) patients is limited due to multiple methodologic weaknesses. While addressing methodologic weaknesses of previous studies, the primary aim of this study is to investigate the diagnostic accuracy of lung ultrasound in a tertiary ICU population.

METHODS

This is a single-center, prospective diagnostic accuracy study conducted at a tertiary ICU in the Netherlands. Critically ill patients undergoing thoracic CT for any clinical indication were included. Patients were excluded if time between the index and reference test was over eight hours. Index test and reference test consisted of 6-zone lung ultrasound and thoracic CT, respectively. Hemithoraces were classified by the index and reference test as follows: consolidation, interstitial syndrome, pneumothorax and pleural effusion. Sensitivity, specificity, positive and negative likelihood ratio were estimated.

RESULTS

In total, 87 patients were included of which eight exceeded the time limit and were subsequently excluded. In total, there were 147 respiratory conditions in 79 patients. The estimated sensitivity and specificity to detect consolidation were 0.76 (95%CI: 0.68 to 0.82) and 0.92 (0.87 to 0.96), respectively. For interstitial syndrome they were 0.60 (95%CI: 0.48 to 0.71) and 0.69 (95%CI: 0.58 to 0.79). For pneumothorax they were 0.59 (95%CI: 0.33 to 0.82) and 0.97 (95%CI: 0.93 to 0.99). For pleural effusion they were 0.85 (95%CI: 0.77 to 0.91) and 0.77 (95%CI: 0.62 to 0.88).

CONCLUSIONS

In conclusion, lung ultrasound is an adequate diagnostic modality in a tertiary ICU population to detect consolidations, interstitial syndrome, pneumothorax and pleural effusion. Moreover, one should be careful not to interpret lung ultrasound results in deterministic fashion as multiple respiratory conditions can be present in one patient. Trial registration This study was retrospectively registered at Netherlands Trial Register on March 17, 2021, with registration number NL9344.

Performance verification of the Abbott SARS-CoV-2 test for qualitative detection of IgG in Cali, Colombia

BACKGROUND

Adequate testing is critically important for control of the SARS-CoV-2 pandemic. Antibody testing is an option for case management and epidemiologic studies, with high specificity and variable sensitivity. However, characteristics of local populations may affect performance of these tests. For this reason, the National Institute of Health (INS) and regulatory agencies in Colombia require verification of diagnostic accuracy of tests introduced to the Colombian market.

METHODS

We conducted a validation study of the Abbott SARS-CoV-2 test for qualitative detection of IgG using the Abbott Architect i2000SR. Participants and retrospective samples were included from patients with suspected SARS-CoV-2 infection, age ≥18 years, and ≥8 days elapsed since initiation of symptoms. Pre-pandemic plasma samples (taken before October 2019) were used as controls. We estimated the sensitivity, specificity and agreement (kappa) of the Abbott IgG test compared to the gold standard (RT-PCR).

RESULTS

The overall sensitivity was 83.1% (95% CI: 75.4-100). Sensitivity among patients with ≥14 days since the start of symptoms was 85.7%, reaching 88% in samples collected from patients with COVID-19 symptoms onset >60 days. Specificity was 100% and the kappa index of agreement was 0.804 (95% CI: 0.642-0.965).

CONCLUSIONS

Our findings show high sensitivity and specificity of the Abbott IgG test in a Colombian population, which meet the criteria set by the Colombian INS to aid in the diagnosis of COVID-19. Data from our patient groups also suggest that IgG response is detectable in a high proportion of individuals (88.1%) during the first two months following onset of symptoms.

Diagnostic performance and clinical implications of rapid SARS-CoV-2 antigen testing in Mexico using real-world nationwide COVID-19 registry data

BACKGROUND

SARS-CoV-2 testing capacity is important to monitor epidemic dynamics and as a mitigation strategy. Given difficulties of large-scale quantitative reverse transcription polymerase chain reaction (qRT-PCR) implementation, rapid antigen tests (Rapid Ag-T) have been proposed as alternatives in settings like Mexico. Here, we evaluated diagnostic performance of Rapid Ag-T for SARS-CoV-2 infection and its associated clinical implications compared to qRT-PCR testing in Mexico.

METHODS

We analyzed data from the COVID-19 registry of the Mexican General Directorate of Epidemiology up to April 30th, 2021 (n = 6,632,938) and cases with both qRT-PCR and Rapid Ag-T (n = 216,388). We evaluated diagnostic performance using accuracy measures and assessed time-dependent changes in the Area Under the Receiver Operating Characteristic curve (AUROC). We also explored test discordances as predictors of hospitalization, intubation, severe COVID-19 and mortality.

RESULTS

Rapid Ag-T is primarily used in Mexico City. Rapid Ag-T have low sensitivity 37.6% (95%CI 36.6-38.7), high specificity 95.5% (95%CI 95.1-95.8) and acceptable positive 86.1% (95%CI 85.0-86.6) and negative predictive values 67.2% (95%CI 66.2-69.2). Rapid Ag-T has optimal diagnostic performance up to days 3 after symptom onset, and its performance is modified by testing location, comorbidity, and age. qRT-PCR (-) / Rapid Ag-T (+) cases had higher risk of adverse COVID-19 outcomes (HR 1.54 95% CI 1.41-1.68) and were older, qRT-PCR (+)/ Rapid Ag-T(-) cases had slightly higher risk or adverse outcomes and ≥7 days from symptom onset (HR 1.53 95% CI 1.48-1.59). Cases detected with rapid Ag-T were younger, without comorbidities, and milder COVID-19 course.

CONCLUSIONS

Rapid Ag-T could be used as an alternative to qRT-PCR for large scale SARS-CoV-2 testing in Mexico. Interpretation of Rapid Ag-T results should be done with caution to minimize the risk associated with false negative results.

Hematological and biochemical parameters as diagnostic and prognostic markers in SARS-COV-2 infected patients of Pakistan: a retrospective comparative analysis

Objectives: This study was conducted to investigate alteration in blood parameters and their association with the presence, severity, and mortality of COVID-19 patients as the data on hematological abnormalities associated with the Pakistani COVID-19 patients is limited.Methodology: A double-centered, hospital-based comparative retrospective case study was conducted, to include all the admitted patients (n = 317) having COVID-19 Polymerase chain reaction (PCR) positive. The control group (n = 157) tested negative for COVID-19.Results: Of 317 admitted cases, the majority were males n = 198 (62.5%). Associated comorbidities, lower lymphocytes, platelets, and higher White blood cells, neutrophil, neutrophil-to-lymphocyte ratio (NLR) and platelet-to-lymphocyte ratio (PLR) were found in COVID-19 cases as compared to healthy controls (p < 0.001 for all). The biochemical parameters of cases including Ferritin, D-Dimer, CRP, IL-6, LDH, ALT, AST, and APTT also showed a statistically significant difference compared with standard values (p < 0.001 for all). However, their comparison with a severity level of the severe and non-severe groups showed significance for WBCs, neutrophils, NLR (p < 0.001 for all), and PLR (p = 0.06) only. Receiver operating characteristic curve analysis showed that NLR had the highest area under curve (0.84) followed by 1/lymphocyte (0.82), neutrophils (0.74), PLR (0.67),1/platelets (0.68) and WBC's (0.65). Comparison of cases and controls with recommended cut-off values derived from sensitivity and 1-specificity was also done (p < 0.001).Conclusion: Monitoring all the hematological and biochemical parameters including novel hemograms NLR, PLR can aid clinicians to identify potentially severe cases at early stages and initiate effective management in time which may reduce the overall mortality of COVID-19 patients.

Supraspinatus tears: predictability of magnetic resonance imaging findings based on clinical examination

BACKGROUND

The shoulder physical examination is frequently performed to diagnose rotator cuff tears in clinical practice; however, there is insufficient evidence on which physical tests are efficient for shoulder impingements in primary care settings. The purposes of this study were (1) to analyze the accuracy of 8 clinical tests to diagnose supraspinatus tendon lesions and investigate whether the combination of these tests can improve the diagnostic values; (2) to assess which are the best positivity criteria for shoulder maneuvers-pain and/or weakness; and (3) to investigate the ability of these tests to distinguish between partial- and full-thickness tears.

METHODS

A total of 733 consecutive patients were prospectively evaluated by 4 shoulder surgeons in this multicenter diagnostic study from May 2017 to December 2018, and 8 clinical tests (empty-can, full-can test, drop arm, painful arc, Neer sign, Hawkins test, Patte test, and resisted external rotation) were compared with magnetic resonance imaging performed by blinded radiologists. We assessed the sensitivity, specificity, accuracy, positive and negative predictive values, and diagnostic odds ratio (DOR) for all tests.

RESULTS

For overall supraspinatus tears, the empty-can test showed the highest sensitivity (0.81), the Patte test (positive for pain and weakness) and the drop-arm test showed the highest specificity (0.99 and 0.98, respectively), and the best combination was the Neer sign and the drop-arm test (DOR, 12.92). The positivity criteria for pain associated with weakness showed the highest performance, with DORs of 16.94 for the Patte test and 10.45 for the empty-can test. The Patte test and resisted external rotation, positive for pain and weakness, showed the highest ability to distinguish between full- and partial-thickness tears (DOR, 5.69 and 5.35, respectively). The shoulder maneuvers showed low negative predictive values; the highest value (0.58) was found with the empty-can test.

CONCLUSIONS

(1) The clinical tests demonstrated excellent diagnostic values; the empty-can test had the highest sensitivity, whereas the drop-arm test and the Patte test had the highest specificity; and the best combination for detecting supraspinatus tears was the Neer sign and the drop-arm test. On the other hand, the physical examination findings showed limited values to rule out tears. (2) The best positivity criterion for shoulder maneuvers was pain associated with weakness. (3) The Patte test and resisted external rotation showed the highest ability to distinguish between full- and partial-thickness tears.

Impact of implementation of the national institute for health and clinical excellence (NICE) head injury guideline in a tertiary care center emergency department: A pre and post-intervention study

INTRODUCTION

Head injury, a common presentation to the emergency department (ED), is a substantial problem in developing countries like Nepal. The current national institute for health and clinical excellence (NICE) guideline revised in January 2014 focuses on effective clinical assessment and early management of head injuries according to their severity in all age groups. This study assessed the impact of implementing this guideline on the proportions of computed tomography (CT) head scans, guideline adherence, and confidence level of the attending physicians.

METHODS

We consecutively recruited 139 traumatic head injury (THI) patients in this prospective pre-post interventional study conducted in the ED of a tertiary care center. We implemented the NICE guideline into routine practice using multimodal intervention through physicians' education sessions, information sheets and guideline-dissemination. The pre and post-implementation CT head scan rates were compared. The post-implementation guideline adherence was assessed. Online Google form-questionnaires including 12 validated case scenarios were distributed to the attending physicians at the end of both phases to assess their confidence levels.

RESULTS

The implementation resulted in a statistically significant decrease in the proportion of CT head scan rates from 92.0% to 70.0% (p-value = 0.005). Following educational interventions, improved guideline adherence of 20.3 percentage points (p-value = 0.001) was observed. Nine ED attending physicians were enrolled in the study who showed statistically significant improvement in their confidence level following the intervention. The NICE guideline showed a sensitivity and specificity of 93.6% and 76.4% with 82.6% accuracy compared to that of clinical judgment (100%, 34.6%, and 58.1% respectively) in detecting intracranial lesions.

CONCLUSION

The implementation was successful in satisfying the aim of the NICE guideline by decreasing the proportion of CT head scans, improving guideline adherence and increasing the confidence of the attending physicians.

Updating guidance for reporting systematic reviews: development of the PRISMA 2020 statement

OBJECTIVES

To describe the processes used to update the PRISMA 2009 statement for reporting systematic reviews, present results of a survey conducted to inform the update, summarize decisions made at the PRISMA update meeting, and describe and justify changes made to the guideline.

METHODS

We reviewed 60 documents with reporting guidance for systematic reviews to generate suggested modifications to the PRISMA 2009 statement. We invited 220 systematic review methodologists and journal editors to complete a survey about the suggested modifications. The results of these projects were discussed at a 21-member in-person meeting. Following the meeting, we drafted the PRISMA 2020 statement and refined it based on feedback from co-authors and a convenience sample of 15 systematic reviewers.

RESULTS

The review of 60 documents revealed that all topics addressed by the PRISMA 2009 statement could be modified. Of the 110 survey respondents, more than 66% recommended keeping six of the original checklist items as they were and modifying 15 of them using wording suggested by us. Attendees at the in-person meeting supported the revised wording for several items but suggested rewording for most to enhance clarity, and further refinements were made over six drafts of the guideline.

CONCLUSIONS

The PRISMA 2020 statement consists of updated reporting guidance for systematic reviews. We hope that providing this detailed description of the development process will enhance the acceptance and uptake of the guideline and assist those developing and updating future reporting guidelines.

Validation of the International Classification of Disease 10th Revision Codes for Kidney Transplant Rejection and Failure

BACKGROUND

Clinical research requires that diagnostic codes captured from routinely collected health administrative data accurately identify individuals with a disease.

OBJECTIVE

In this study, we validated the International Classification of Disease 10th Revision (ICD-10) definition for kidney transplant rejection (T86.100) and for kidney transplant failure (T86.101).

DESIGN

Retrospective cohort study.

SETTING

A large, regional transplantation center in Ontario, Canada.

PATIENTS

All adult kidney transplant recipients from 2002 to 2018.

MEASUREMENTS

Chart review was undertaken to identify the first occurrence of biopsy-confirmed rejection and graft loss for all participants. For each observation, we determined the first date a single ICD-10 code T86.100 or T86.101 was recorded as a hospital encounter discharge diagnosis.

METHODS

Using chart review as the gold standard, we determined the sensitivity, specificity, and positive predictive value (PPV) for the ICD-10 codes T86.100 and T86.101.

RESULTS

Our study population comprised of 1,258 kidney transplant recipients. The prevalence of rejection and death-censored graft loss were 15.6 and 9.1%, respectively. For the ICD-10 rejection code (T86.100), sensitivity was 72.9% (95% confidence interval [CI], 66.6-79.2), specificity 97.5% (96.5-98.4), and PPV 83.8% (78.3-89.4). For the ICD-10 graft loss code (T86.101), sensitivity was 21.2% (95% CI, 13.2-29.3), specificity 86.3% (84.3-88.3), and PPV 11.7% (7.0-16.4).

LIMITATIONS

Single-center study which may limit generalizability of our findings.

CONCLUSIONS

A single ICD-10 code for kidney transplant rejection (T86.100) was present in 84% of true kidney transplant rejections and is an accurate way of identifying kidney transplant recipients with rejection using administrative health data. The ICD-10 code for graft failure (T86.101) performed poorly and should not be used for administrative health research.

The Diagnostic Accuracy of Critical Care Pain Observation Tool (CPOT) in ICU Patients: A Systematic Review and Meta-Analysis

BACKGROUND

The critical care pain observation tool (CPOT) has been widely used to assess pain in ICU patients, and its validity and reliability have been tested in various contexts.

OBJECTIVE

To determine the diagnostic accuracy of the CPOT in critically ill patients, a systematic review of diagnostic studies was performed.

METHODS

A database search (PubMed, Medline, CINAHL, ProQuest, EMBASE, Cochrane Library, CNKI, Wanfang, COVIP, CBM) was conducted, as was the manual identification of eligible papers from citations. Eligible studies were published between 2006 and February 2020. Quality appraisal of the studies was carried out with the QUADAS-2 checklist, and data extraction was performed in alignment with STARD 2015. Open Meta Analyst was used for the statistical analysis.

RESULTS

In total, 25 articles involving 1920 subjects with 3493 experimental results were included. Most of the studies were of fair quality. A high degree of heterogeneity (I² = 57.2%, P < 0.001) was discovered. The Youden index values were 1.56 and 1.55 when the CPOT threshold was set at two and three, respectively. The diagnostic performance of the CPOT was affected by the reference standard. The CPOT had a higher diagnostic odds ratio of 11.52 (95% CI: 7.42-17.87) during nociceptive procedures compared with 9.14 (95% CI: 5.38-15.53) at rest or during non-nociceptive procedures.

CONCLUSION

CPOT has moderate diagnostic parameters with a threshold of two or three, suggesting that it is a fair but not excellent tool. More research on the validity of the CPOT in specific subgroups is needed to broaden its applicability in critical care.

Testing COVID-19 tests faces methodological challenges

In battling the COVID-19 pandemic, testing is essential. The detection of viral RNA allows the identification of infected persons, whereas the detection of antibodies may reveal a response to a previous infection. Tests for coronavirus should be rigorously evaluated in terms of their analytical and clinical performance. This poses not only logistic challenges, but also methodological ones. Some of these are generic for the diagnostic accuracy paradigm, whereas others are more specific for tests for viruses. Problematic for evaluations of the clinical performance of tests for viral RNA is the absence of an independent reference standard. Many studies lack rigor in terms of the recruitment of study participants. Study reports are often insufficiently informative, which makes it difficult to assess the applicability of study findings. Attempts to summarize the performance of these tests in terms of a single estimate of the clinical sensitivity fail to do justice to the identifiable sources of the large heterogeneity in mechanisms for generating false negative results.

Confidence at 100%: Characteristics of Likelihood Ratio Confidence Intervals in the Emergency Medicine Diagnostics Literature

OBJECTIVE

We hypothesized that "perfect" 100% sample sensitivity or specificity (PSSS) is common in the emergency medicine (EM) literature. When results yield PSSS, calculating the likelihood ratio (LR) 95% confidence interval (CI) has been challenging. Consequently, we also hypothesized that studies with PSSS would be less likely to report the LR and associated CI, and those that did would use imperfect methods.

METHODS

We searched PubMed or Scopus for all articles reporting diagnostic test results in the 20 top EM journals from 2011 to 2016 and randomly sampled 124 articles. Trained researchers coded the articles as having PSSS or not ("controls"). We separately sampled 100 articles with PSSS and compared them to 100 controls in terms of their reporting of diagnostic tests and associated CIs.

RESULTS

Of the 124 articles, 19.4% (95% CI = 13% to 27.6%) feature a diagnostic test with PSSS. The LR is reported significantly less often in PSSS studies versus control studies: 18 of 100 articles (18% [95% CI = 11.3% to 27.2%]) versus 34 of 100 articles (34% [95% CI = 25% to 44.2%]), with an odds ratio (OR) of 0.43 (95% CI = 0.21 to 0.86). The LR 95% CI is also reported less often in PSSS versus control studies: five of 100 articles (5% [95% CI = 1.9% to 11.8%]) versus 27 of 100 articles (27% [95% CI = 18.8% to 37%]), with an OR of 0.11 (95% CI = 0.02 to 0.44). Five articles with perfect sample sensitivity reported their negative LR CI. The bootstrap method resulted in CIs that were 42.7% smaller on average (range = 16.6% to 63.6%).

CONCLUSION

This analysis provides systematic evidence of diagnostic test reporting in the EM literature. Sample sensitivity or specificity of 100% is common. LRs and their associated 95% CIs are infrequently reported, particularly for PSSS samples. When the LR CI is reported in this scenario, it is overly wide. Improved reporting and methods can enhance the utility and confidence in diagnostic tests in EM.

Early kinetics of cardiac troponin in suspected acute myocardial infarction

INTRODUCTION AND OBJECTIVES

Release kinetics of high-sensitivity cardiac troponin (hs-cTn) T and I in patients with acute myocardial infarction (AMI) are incompletely understood. We aimed to assess whether hs-cTnT/I release in early AMI is near linear.

METHODS

In a prospective diagnostic multicenter study the acute release of hs-cTnT and hs-cTnI within 1 and 2hours from presentation to the emergency department was quantified using 3 hs-cTnT/I assays in patients with suspected AMI. The primary endpoint was correlation between hs-cTn changes from presentation to 1 hour vs changes from presentation to 2hours, among all AMI patients and different prespecified subgroups. The final diagnosis was adjudicated by 2 independent cardiologists, based on serial hs-cTnT from the serial study blood samples and additional locally measured hs-cTn values.

RESULTS

Among 2437 patients with complete hs-cTnT data, AMI was the adjudicated diagnosis in 376 patients (15%). For hs-cTnT, the correlation coefficient between 0- to 1-hour change and 0- to 2 hour change was 0.931 (95%CI, 0.916-0.944), P <.001. Similar findings were obtained with hs-cTnI (Architect) with correlation coefficients between 0- to 1-hour change and 0- to 2 hour change of 0.969 and hs-cTnI (Centaur) of 0.934 (P <.001 for both). Findings were consistent among type 1 and type 2 AMI and in the subgroup of patients presenting very early after chest pain onset.

CONCLUSIONS

Patients presenting with early AMI showed a near linear release of hs-cTnT and hs-cTnI. This near linearity provides the pathophysiological basis for rapid diagnostic algorithms using 0- to 1-hour changes as surrogates for 0- to 2 hour or 0- to 3 hour changes. Registered at ClinicalTrials.gov (Identifier: NCT00470587).

Searching practices and inclusion of unpublished studies in systematic reviews of diagnostic accuracy

Introduction

Many diagnostic accuracy studies are never reported in full in a peer‐reviewed journal. Searching for unpublished studies may avoid bias due to selective publication, enrich the power of systematic reviews, and thereby help to reduce research waste. We assessed searching practices among recent systematic reviews of diagnostic accuracy.

Methods

We extracted data from 100 non‐Cochrane systematic reviews of diagnostic accuracy indexed in MEDLINE and published between October 2017 and January 2018 and from all 100 Cochrane systematic reviews of diagnostic accuracy published by December 2018, irrespective of whether meta‐analysis had been performed.

Results

Non‐Cochrane and Cochrane reviews searched a median of 4 (IQR 3‐5) and 6 (IQR 5‐9) databases, respectively; most often MEDLINE/PubMed (n = 100 and n = 100) and EMBASE (n = 81 and n = 100). Additional efforts to identify studies beyond searching bibliographic databases were performed in 76 and 98 reviews, most often through screening reference lists (n = 71 and n = 96), review/guideline articles (n = 18 and n = 52), or citing articles (n = 3 and n = 42). Specific sources of unpublished studies were searched in 22 and 68 reviews, for example, conference proceedings (n = 4 and n = 18), databases only containing conference abstracts (n = 2 and n = 33), or trial registries (n = 12 and n = 39). At least one unpublished study was included in 17 and 23 reviews. Overall, 39 of 2082 studies (1.9%) included in non‐Cochrane reviews were unpublished, and 64 of 2780 studies (2.3%) in Cochrane reviews, most often conference abstracts (97/103).

Conclusion

Searching practices vary considerably across systematic reviews of diagnostic accuracy. Unpublished studies are a minimal fraction of the evidence included in recent reviews.

Loop mediated isothermal amplification assay for detection of Trichomonas vaginalis in vaginal swabs among symptomatic women from North India

Trichomonas vaginalis is one of the most common curable sexually transmitted pathogens infecting both men and women worldwide. Unlike traditional methods such as microscopy and culture, nucleic acid amplification tests rapidly detect this agent, assisting in treatment. Conventional polymerase chain reaction (PCR), the loop-mediated isothermal amplification (LAMP), and the Xpert TV assay were evaluated using 28 microscopy positive T. vaginalis samples and 125 microscopy negative samples from symptomatic females of reproductive age. The sensitivity of all tests was 100% and the specificity was 100%, 100%, and 99·2% for PCR, Xpert TV, and LAMP, respectively. The inter-rater reliability was excellent for PCR: Xpert TV (kappa-coefficient = 1) and good for LAMP assay: Xpert TV/PCR (kappa-coefficient = 0·98) and conventional PCR: LAMP (kappa-coefficient = 0·98). The study highlights the importance of PCR for screening T. vaginalis in women, particularly in laboratories where the Xpert-TV assay is not available or not affordable. The LAMP assay showed a lower positive predictive value which merits further evaluation. SIGNIFICANCE AND IMPACT OF THE STUDY: Trichomonas vaginalis is a common sexually transmitted pathogen associated with considerable morbidity and risk of complications. Due to the limitations of traditional diagnostic modalities, three molecular assays were compared: conventional polymerase chain reaction (PCR), Xpert TV assay, and loop mediated isothermal amplification (LAMP) assay for detecting T. vaginalis in symptomatic females. All tests had a sensitivity of 100% and the inter-rater reliability was excellent for PCR: Xpert TV, and good for LAMP assay: Xpert TV/PCR. The translational impact of this study lies in the possible use of conventional PCR and LAMP in laboratories where the Xpert TV assay is not available or not affordable.

A newly noninvasive model for prediction of non-alcoholic fatty liver disease: utility of serum prolactin levels

BACKGROUNDS

To investigate the value of prolactin (PRL) in diagnosing non-alcoholic fatty liver disease (NAFLD).

METHODS

Metabolic parameters and serum PRL levels were measured in 452 males and 421 females, who were randomized to the estimation or the validation group as a 1:1 ratio. Hepatic steatosis was diagnosed via abdominal ultrasound. Variables that significantly associated with NAFLD in univariate analysis were included in multiple logistic regression. We used the receiver operator characteristic (ROC) curves to test the model performance. Besides, 147 patients underwent metabolic and liver biopsy were analyzed to validate the diagnostic value of this model.

RESULTS

Body mass index, alanine aminotransferase, prolactin, high density lipoprotein cholesterol and HbA1c were included into models. In males, the area under ROC curve (AUC) was 0.86 (95%CI: 0.82-0.91) for the validation group. With two cut-off points (- 0.79 and 1.71), the sensitivity and specificity for predicting NALFD was 95.2 and 91.1% in the validation group, respectively. In females, the AUC was 0.82 (95%CI: 0.76-0.88) for the validation group. With two cut-off points (- 0.68 and 2.16), the sensitivity and specificity for predicting NALFD was 97.1 and 91.4% in the validation group, respectively. In subjects with liver pathology, the AUC was higher than that of fatty liver index. A positive correlation between the scores of the model and the severities of NAFLD was observed. Importantly, we demonstrated a potential value of this model in predicting nonalcoholic steatohepatitis.

CONCLUSION

We established a mathematic model that can conveniently and effectively diagnose the existence and severities of NAFLD.

Detection of incident breast and colorectal cancer cases from an administrative healthcare database in Catalonia, Spain

OBJECTIVE

To validate the Catalan minimum basic data set (MBDS) of hospital discharges as an information source for detecting incident breast (BC) and colorectal cancer (CRC), against the Hospital del Mar Cancer Registry (RTHMar) in Barcelona (Spain) as the gold standard.

METHODS

Using ASEDAT software (Analysis, Selection and Extraction of Tumour Data), we identified Catalan public hospital discharge abstracts in patients with a first-time diagnosis of BC and CRC in the years 2005, 2008, and 2011, aggregated by unique patient identifiers and sorted by date. Once merged with the RTHMar database and anonymized, tumour-specific algorithms were validated to extract data on incident cases, tumour stage, surgical treatment, and date of incidence.

RESULTS

MBDS had a respective sensitivity and positive predictive value (PPV) of 78.0% (564/723) and 90.5% (564/623) for BC case detection; and 83.9% (387/461) and 94.9% (387/408) for CRC case detection. The staging algorithms overestimated the proportion of local-stage cases and underestimated the regional-stage cases in both cancers. When loco-regional stage and surgery were combined, sensitivity and PPV reached 98.3% and 99.8%, respectively, for BC and 96.4% and 98.4% for CRC. The differences between dates of incidence between RTHMar and MBDS were greater for BC cases without initial surgery, whereas they were generally smaller and homogeneous for CRC cases.

CONCLUSIONS

The MBDS is a valid and efficient instrument to improve the completeness of a hospital-based cancer registry (HBCR), particularly in BC and CRC, which require hospitalization and are predominantly surgical.

Validation of an automated cell counter to determine leukocyte differential counts in neonatal Holstein calves

Recent advances in the understanding of risk factors and biomarkers in calves entering rearing facilities show promise for identifying high-risk calves on arrival at veal and dairy beef operations. Rapid automated leukocyte differential cell counts may be a good addition for augmenting or refining calf risk identification on-farm. The objective of this study was to validate an automated leukocyte cell counter, the QScout BLD test (Advanced Animal Diagnostics, Morrisville, NC), for its ability to determine leukocyte differential cell counts in neonatal Holstein calves. From June to July 2018, blood samples collected in EDTA anticoagulant from 235 calves upon arrival at an independent veal research facility in Ontario, Canada, were evaluated using the QScout BLD test and manually by microscopy. We compared these leukocyte differential counts using Lin's concordance correlation coefficient (ρ) and found very good agreement between tests for neutrophil counts (ρ = 0.83); fair agreement for lymphocyte counts (ρ = 0.32); fair agreement for the ratio of neutrophils to lymphocytes (ρ = 0.36); slight agreement for monocyte counts (ρ = 0.14); and slight agreement for eosinophil counts (ρ = 0.20). We further examined test results to determine if they differed in their classification of samples as being above, within, or below reported 95% reference intervals for neonatal Holstein calves. Classification between tests resulted in very good agreement for neutrophils and lymphocytes, with only 4.2% and 5.8% disagreement in classification, respectively. We observed moderate agreement for monocytes, with 23.3% classified differently, and poor agreement for eosinophils, with 70.3% classified differently. Further study is required to determine the role of leukocyte profiling in the risk assessment of calves arriving at calf-rearing facilities.

Completeness of Reporting of Systematic Reviews of Diagnostic Test Accuracy Based on the PRISMA-DTA Reporting Guideline

BACKGROUND

We evaluated the completeness of reporting of diagnostic test accuracy (DTA) systematic reviews using the recently developed Preferred Reporting Items for Systematic Reviews and MetaAnalyses (PRISMA)-DTA guidelines.

METHODS

MEDLINE® was searched for DTA systematic reviews published October 2017 to January 2018. The search time span was modulated to reach the desired sample size of 100 systematic reviews. Reporting on a per-item basis using PRISMA-DTA was evaluated.

RESULTS

One hundred reviews were included. Mean reported items were 18.6 of 26 (71%; SD = 1.9) for PRISMA-DTA and 5.5 of 11 (50%; SD = 1.2) for PRISMA-DTA for abstracts. Items in the results were frequently reported. Items related to protocol registration, characteristics of included studies, results synthesis, and definitions used in data extraction were infrequently reported. Infrequently reported items from PRISMA-DTA for abstracts included funding information, strengths and limitations, characteristics of included studies, and assessment of applicability. Reporting completeness was higher in higher impact factor journals (18.9 vs 18.1 items; P = 0.04), studies that cited PRISMA (18.9 vs 17.7 items; P = 0.003), or used supplementary material (19.1 vs 18.0 items; P = 0.004). Variability in reporting was associated with author country (P = 0.04) but not journal (P = 0.6), abstract word count limitations (P = 0.9), PRISMA adoption (P = 0.2), structured abstracts (P = 0.2), study design (P = 0.8), subspecialty area (P = 0.09), or index test (P = 0.5). Abstracts with a higher word count were more informative (R = 0.4; P &lt; 0.001). No association with word counts was observed for full-text reports (R = −0.03; P = 0.06).

CONCLUSIONS

Recently published reports of DTA systematic reviews are not fully informative when evaluated against the PRISMA-DTA guidelines. These results should guide knowledge translation strategies, including journal level (e.g., PRISMA-DTA adoption, increased abstract word count, and use of supplementary material) and author level (PRISMA-DTA citation awareness) strategies.

Research Integrity and Peer Review-past highlights and future directions

In May 2016, we launched Research Integrity and Peer Review, an international, open access journal with fully open peer review (reviewers are identified on their reports and named reports are published alongside the article) to provide a home for research on research and publication ethics, research reporting, and research on peer review. As the journal enters its third year, we reflect on recent events and highlights for the journal and explore how the journal is faring in terms of gender and diversity in peer review. We also share the particular interests of our Editors-in-Chief regarding models of peer review, reporting quality, common research integrity issues that arise during the publishing process, and how people interact with the published literature. We continue to encourage further research into peer review, research and publication ethics and research reporting, as we believe that all new initiatives should be evidence-based. We also remain open to constructive discussions of the developments in the field that offer new solutions.