STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies

The [99mTc]Tc-HMPAO-labelled white blood cell SPECT/CT as a novel criterion for infective endocarditis diagnosis

AIMS

Infective endocarditis (IE) poses a significant clinical challenge, necessitating nuanced diagnostic tools for early and accurate detection. The diagnostic role of the hybrid technique of single-photon emission tomography-computed tomography with technetium-99 m-hexamethylpropyleneamine oxime-labelled leukocytes ([99mTc]Tc-HMPAO-SPECT/CT) has evolved in recent years. This single-center study assessed whether the recent inclusion in the 2023 European Society of Cardiology modified diagnostic criteria of IE (2023 ESC) of infectious lesions detected with [99mTc]Tc-HMPAO-SPECT/CT affects their diagnostic performance.

METHODS AND RESULTS

Between 2015 and 2019, we enrolled 205 consecutive adults with suspected IE. All participants underwent [99mTc]Tc-HMPAO-SPECT/CT scans (370-740 MBq). Scans were deemed positive in the presence of intracardiac abnormal tracer uptake and/or within the cardiac implantable electronic device. Patients were prospectively followed-up for 12 ± 10 months. Local device infection (LDI) or IE was diagnosed in 75 (36.6 %) patients, while 72 (35.1 %) [99mTc]Tc-HMPAO-SPECT/CT results returned positive. Moreover, extracardiac infectious foci were detected in 25 % of [99mTc]Tc-HMPAO-SPECT/CT scans. The inclusion of both intracardiac and extracardiac lesions detected with [99mTc]Tc-HMPAO-SPECT/CT yields significantly higher sensitivity (p = 0.003) and negative predictive value (NPV) (p = 0.009).

CONCLUSION

The inclusion of [99mTc]Tc-HMPAO-SPECT/CT into the IE diagnostic work-up improves the appropriate classification of patients. For patients with IE, the extended inclusion of lesions detected with [99mTc]Tc-HMPAO-SPECT/CT in the ESC 2023 diagnostic criteria significantly improves sensitivity and NPV while reducing potential IE misdiagnoses. This pioneering imaging modality is poised to become an integral component of clinical practice, promising to advance IE diagnosis and management.

Disorientation as a delirium feature in non-intubated patients: development and evaluation of diagnostic accuracy of the 'Confusion Assessment Method for Intermediate Care Unit' (CAM-IMC) - a prospective cohort study

BACKGROUND

Disorientation is an early indicator of developing postoperative delirium (POD), which is associated with increased mortality and cognitive decline. The well-established "Confusion-Assessment-Method-for-Intensive-Care-Unit" (CAM-ICU) for diagnosing POD in intubated patients cannot make use of the feature 'disorientation', as this requires verbal communication. Other tools such as the 4AT test for disorientation but are not established in ICU settings. We therefore combined test-variables of the CAM-ICU (level of consciousness, fluctuating mental status and inattention) with verbal testing for disorientation to develop and enhance diagnostic accuracy of the "Confusion Assessment Method for Intermediate Care Unit" (CAM-IMC). In the present study we describe the development and the evaluation of the diagnostic accuracy of the CAM-IMC.

METHODS

We conducted a prospective cohort-study to develop and evaluate the diagnostic accuracy of the CAM-IMC and disorientation for diagnosing POD in non-intubated patients undergoing elective cardiac surgery. All patients were eligible during data collection period. Exclusion criteria were preexisting brain-organic disease, age < 50 years, preoperative intubation, and insufficient language skills. Patients were assessed for POD using the CAM-IMC as the index-test by two independent examiners over three postoperative days. Reference-testing was conducted by experienced reference-raters. The primary outcome was the diagnostic test-performance.

RESULTS

Among 178 eligible patients, 624 paired observations were completed with 155 patients. Of these, 9% experienced POD. Sensitivity and specificity were 0.96 (CI-95%: 0.87-1.00) and 0.94 (CI-95%: 0.92-0.96), respectively. Area-Under-the-Receiver-Operating-Characteristic-Curve (AUROC; equivalent to c-statistic) for CAM-IMC with a cut-off at three points was 0.95 (CI-95%: 0.93-0.98). The interrater reliability was 0.80 (CI-95%: 0.69-0.91).

CONCLUSION

The CAM-IMC demonstrates excellent test performance for diagnosing POD in non-intubated patients by combining features of the CAM-ICU with 'disorientation'. Given an aging community with an increasing delirium risk, the CAM-IMC provides a highly structured assessment tool for POD. It enables early and accurate detection of delirium, which is critical for timely intervention and improved patient outcomes. The CAM-IMC appears to be a useful tool to be implemented in units for not-intubated patients and seems to be the perfect match where the CAM-ICU is already in use for monitoring POD.

TRIAL REGISTRATION

DRKS00026980 (German registry of clinical studies).

Biomarkers in paediatric bacterial meningitis: a systematic review and meta-analysis of diagnostic test accuracy

BACKGROUND

Biomarkers for paediatric bacterial meningitis are essential for an accurate diagnosis.

OBJECTIVES

To perform a systematic review of diagnostic accuracy on cerebrospinal fluid (CSF) and blood biomarkers for paediatric bacterial meningitis.

DATA SOURCES

Databases Medline, Excerpta Medica Database, Scopus, and Web of Science were used.

STUDY ELIGIBILITY CRITERIA

Eligible studies were those on novel diagnostic CSF and blood biomarkers from which data on biomarker concentration or diagnostic accuracy could be abstracted.

PARTICIPANTS

Paediatric patients (0-18 years) suspected of a central nervous system (CNS) infection.

ASSESSMENT OF RISK OF BIAS

The Quality Assessment tool for Diagnostic Accuracy Studies (QUADAS)-2 tool was used to assess risk of bias.

METHODS OF DATA SYNTHESIS

The difference in biomarker concentrations were assessed by calculating standardized and weighted mean differences. A random-effects meta-analysis model was used. Hierarchical summary receiver-operating characteristic curves were constructed.

RESULTS

We identified 3435 studies, of which 112 articles on 113 individual biomarkers (CSF n = 90 and blood n = 23) were included. In CSF, C-reactive protein (CRP), Interleukin (IL)-6, Tumor necrosis factor (TNF)-α, and Interleukin (IL)-8 showed the largest mean differences between bacterial meningitis and viral meningitis and IL-6, TNF-α, and IL-8 between bacterial meningitis and no CNS infection/inflammation. CSF CRP and ferritin showed excellent discrimination for bacterial versus viral meningitis (summary area under the curve [sAUC] 0.94; 95% CI, 0.92-0.97, sAUC 0.94; 95% CI, 0.90-1.0). CSF IL-6 and procalcitonin showed excellent discrimination for bacterial versus nonbacterial meningitis and versus no CNS infection/inflammation (sAUC IL-6: 0.98; 95% CI, 0.96-1.00, sAUC procalcitonin: 0.96; 95% CI, 0.94-0.99). Procalcitonin in blood showed good discrimination (AUC, 0.89; 95% CI, 0.68-1.00).

DISCUSSION

We identified several CSF biomarkers with high diagnostic accuracy for the diagnosis of bacterial meningitis, including IL-6, procalcitonin, CRP, and ferritin. None of the blood biomarkers exhibited excellent discrimination for paediatric bacterial meningitis. Validation of these biomarkers in prospective, well-designed studies of diagnostic accuracy performed in children with suspected meningitis is needed.

Diagnostic ability of confocal scanning ophthalmoscope for the detection of concurrent retinal disease in eyes with asteroid hyalosis

PURPOSE

To compare the diagnostic capacity of a color fundus camera (CFC), ultra-wide-field bicolor confocal scanning laser ophthalmoscope (BC-cSLO; OPTOS), and true-color confocal scanning ophthalmoscope (TC-cSO; EIDON) in detecting coexisting retinal diseases in eyes with asteroid hyalosis (AH).

METHODS

The medical records of consecutive patients with AH who were referred to a tertiary hospital for subsequent assessment by a vitreoretinal specialist were retrospectively reviewed. Fundus images obtained simultaneously using CFC, BC-cSLO, and TC-cSO were classified into four grades based on their obscuration by asteroid bodies. The proportion of Grade 1 images (minimal obscuration group) was assessed for each imaging modality. The diagnostic and screening abilities for concurrent retinal diseases were compared in terms of the accuracy and sensitivity of each device.

RESULTS

Among the 100 eyes with AH, 76 had coexisting retinal diseases, such as diabetic retinopathy (DR), retinal vascular occlusion, age-related macular degeneration, epiretinal membrane, and retinitis pigmentosa. TC-cSO had the highest ratio of Grade 1 images (94%, P<0.001), followed by CFC (67%) and BC-cSLO (63%). CFC and BC-cSLO exhibited a 5.3-fold higher rate of significant obscuration than TC-cSO (P<0.001, 95% confidence intervals = 2.4~11.6 folds). TC-cSO demonstrated the highest accuracy and sensitivity (95% and 81%, respectively) compared with CFC (89% and 43%, respectively) and BC-cSLO (89% and 39%, respectively) for all retinal diseases. BC-cSLO showed the best performance for DR diagnosis.

CONCLUSIONS

TC-cSO images showed minimal obscuration and a superior ability for diagnosing retinal diseases accompanied by AH over other imaging devices. TC-cSO can be a valuable alternative screening tool for detecting retinal diseases when AH impedes fundus imaging.

Multicenter External Validation of the Accuracy of Computed Tomography Criteria for Detecting Thoracolumbar Posterior Ligamentous Complex Injury

BACKGROUND AND OBJECTIVE

Recent studies have proposed computed tomography (CT) criteria for posterior ligamentous complex (PLC) injury: disrupted if ≥2 CT findings, indeterminate if single finding, and intact if 0 CT findings. The study aims to validate the CT criteria for PLC injury externally.

METHODS

Three level 1 trauma centers enrolled 614 consecutive patients with acute thoracolumbar fractures (T1-L5) who received CT and MRI. Three reviewers from each center assessed CT for facet joint malalignment, horizontal laminar fracture, spinous process fracture, and interspinous widening and MRI for disrupted PLC, defined as black stripe discontinuity. The primary outcome is the diagnostic accuracy of CT criteria (0, 1, ≥2 findings) in detecting disrupted PLC on MRI using all CT readings. A subgroup analysis was performed for each participating center and reviewer. The inter-reader agreement on PLC status on MRI and CT criteria was assessed using Fleiss Kappa (k).

RESULTS

The positive predictive value for PLC injury was 0 findings 3%, single positive CT 43%, and ≥2 CT findings in 94%. The accuracy measures were consistent across various centers and reviewers. The area under the curve for ≥1 CT finding in detecting PLC injury ranged from 90% to 97%, indicating excellent discrimination for all centers. The inter-reader k on PLC status by MRI and overall CT findings was substantial (k > 0.60).

CONCLUSION

This study externally validates the previously proposed CT criteria for PLC injury. A total of ≥2 positive CT findings or 0 CT findings can be used as criteria for a disrupted PLC (B-type injury) or intact PLC (A-type injuries), respectively, without added MRI. A single CT finding implies indeterminate PLC status and the need for further MRI assessment. The CT criteria will potentially guide MRI indications and treatment decisions for neurologically intact thoracolumbar burst fractures.

How I Write Manuscripts for Peer-Reviewed Medical Journals

Writing manuscripts is an integral part of the research journey. Despite the availability of various guidelines to inform study reporting and manuscript preparation requirements by peer-reviewed medical journals, developing manuscripts that effectively communicate study findings or new knowledge requires a range of communication skills that evolve with successes and failures. In this manuscript, I feature some personal learnings and acquired habits in manuscript development and publication planning from my 15-year experience as a scholar, including insights on authorship matters, journal selection, manuscript type choices, medical writing of various data-driven and non-data-driven manuscript types, and handling revisions.

Sensitivity and specificity of microscopic and molecular techniques for the diagnosis of taeniasis

BACKGROUND AND OBJECTIVES

The diagnostic challenges associated with T. solium continue to hamper control efforts of the world's most significant foodborne parasite and leading cause of epilepsy in low and middle-income countries. This study aimed to validate two conventional PCRs for taeniasis and estimate the diagnostic performance of microscopic and molecular tools.

METHODS

Formalin and ethanol-fixed samples were tested by formalin-ethyl acetate concentration technique (FECT), Malachite smear, McMaster2 method, rrnS PCR and cox1 PCR. Initial validation of PCR methods was completed on 45 microscopy positive individuals. After validation, the performance of microscopic methods and the rrnS were estimated using samples from 1,156 individuals in Laos. Bayesian latent class models (BLCMs) and a composite reference standard were used to estimate diagnostic sensitivity and specificity.

RESULTS

On preliminary validation, the rrnS was able to detect 27/45 (60.00 %) infections whereas the cox1 detected 21/45 (46.67 %). As a result, the cox1 was excluded from further performance analysis. Microscopy methods and the rrnS were highly specific with estimates above 99.02 % regardless of analytical method. The rrnS was the most sensitive test by informed BCLM (91.45 %, CrI: 73.41-99.52 %) followed by the FECT (71.20 %, CrI: 50.53-85.48 %), McMaster2 (51.31 %, CrI: 32.00-71.29 %) and Malachite smear (32.23 %, CrI: 15.40-54.47 %).

DISCUSSION

The inability to validate the cox1 PCR suggests that it may not be suitable in its current form for routine characterisation of Taenia spp.. The rrnS presents a suitable alternative, however, it requires its products to be sequenced. Given the low prevalence of taeniasis in most populations, microscopy screening followed by rrnS PCR and sequencing confirmation should be a feasible approach that may be integrated with existing soil-transmitted helminth surveys that often use FECT for microscopic diagnosis.

Ancillary immunohistochemistry testing for loss of p16 in melanoma: A systematic review and meta-analysis of diagnostic accuracy studies

BACKGROUND

Ancillary immunohistochemistry testing for p16 loss has been proposed as a diagnostic tool for melanoma, but its accuracy remains uncertain.

METHODS

A systematic review and meta-analysis were conducted on 26 studies involving 979 melanomas and 974 nevi.

RESULTS

Through bivariate analysis of data across all cut-off values, the sensitivity and specificity were calculated to be 0.55 (95% confidence interval [CI]: 0.38, 0.70) and 0.85 (95% CI: 0.70, 0.94), respectively. Summary estimates of diagnostic accuracy fell below recommended thresholds for effective tests, but subgroup analysis suggested that p16 loss could aid in diagnosing ambiguous lesions as melanoma in certain scenarios. However, the presence of p16 expression in these contexts does not definitively rule out melanoma. The findings were limited by underpowered exploratory study designs at risk for bias in patient selection and test interpretation.

CONCLUSIONS

While the use of p16 immunohistochemistry for detecting melanoma is not universally reliable, it may serve as a confirmatory test in differential diagnoses involving common, congenital, acral, Spitz, and deep penetrating nevi. Nevertheless, further studies are needed to validate its utility. Until then, the application of p16 immunohistochemistry in melanoma diagnosis should be regarded as experimental.

Diagnostic performance of artificial intelligence-aided caries detection on bitewing radiographs: a systematic review and meta-analysis

The accuracy of artificial intelligence-aided (AI) caries diagnosis can vary considerably depending on numerous factors. This review aimed to assess the diagnostic accuracy of AI models for caries detection and classification on bitewing radiographs. Publications after 2010 were screened in five databases. A customized risk of bias (RoB) assessment tool was developed and applied to the 14 articles that met the inclusion criteria out of 935 references. Dataset sizes ranged from 112 to 3686 radiographs. While 86 % of the studies reported a model with an accuracy of ≥80 %, most exhibited unclear or high risk of bias. Three studies compared the model's diagnostic performance to dentists, in which the models consistently showed higher average sensitivity. Five studies were included in a bivariate diagnostic random-effects meta-analysis for overall caries detection. The diagnostic odds ratio was 55.8 (95 % CI= 28.8 - 108.3), and the summary sensitivity and specificity were 0.87 (0.76 - 0.94) and 0.89 (0.75 - 0.960), respectively. Independent meta-analyses for dentin and enamel caries detection were conducted and showed sensitivities of 0.84 (0.80 - 0.87) and 0.71 (0.66 - 0.75), respectively. Despite the promising diagnostic performance of AI models, the lack of high-quality, adequately reported, and externally validated studies highlight current challenges and future research needs.

Enhancing orthopaedic surgery research: developing manuscripts using systematic checklists

BACKGROUND AND CHALLENGES

Writing and publishing research is important in the fields of orthopaedic surgery, and medicine in general. In recent years, the number of orthopaedic publications has significantly increased, highlighting the value of possessing the ability to write and publish a paper. However, publishing research is not an easy task, especially if English is not a native language. Non-native English speakers have been reported to experience barriers to writing and publishing research in English, the dominant language of scientific publication. This affects not only individual researchers, but also the scientific community in general. To improve reporting in scientific manuscripts, many peer-reviewed guidelines have been published for a variety of study designs and study types. These guidelines are made available through the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network and have associated checklists that guide authors in the synthesis of their research manuscript.

PURPOSE

Whether you are a non-native English speaker or a novice research writer, these checklists can ameliorate the process of building your manuscript. The purpose of this paper is to empower orthopaedic researchers, and researchers in general, through an easy-to-follow framework for writing a research manuscript using available checklists and general research knowledge.

Diagnostic Accuracy of Lung and Abdominal Ultrasound for Tuberculosis in a German Multicenter Cohort of Patients With Presumed Tuberculosis Disease

Background

There is limited evidence on point-of-care ultrasound for tuberculosis (TB), but studies suggest high sensitivity, especially for lung ultrasound (LUS). However, insufficient data are available on specificity of the examination and its generalizability to a broader patient population.

Aims

Our study aimed to establish accuracy for lung, chest, and abdominal ultrasound, individually and in combination, for TB diagnosis.

Methods

We conducted a prospective diagnostic accuracy study among consecutive adult out- and inpatients with probable TB in three German referral hospitals. We applied a comprehensive standardized ultrasound protocol. TB diagnosis was established by a microbiological reference standard including polymerase chain reaction and culture.

Results

A total of 102 participants originating from 30 different countries were enrolled. HIV prevalence was 7/99 (7%) and 73/102 (72%) had confirmed TB. TB was limited to the lungs in 15/34 (44%) of refugees and 27/39 (69%) in nonrefugees. Focused assessment with sonography for HIV-associated tuberculosis had a sensitivity of 40% (95% confidence interval [CI], 30-52) and specificity of 55% (95% CI, 38-72). Additional findings, such as small subpleural consolidations on LUS had a high sensitivity (88%; 95% CI, 78-93), but a low specificity (17%; 95% CI, 8-35). Larger consolidations in the lung apices had a sensitivity of 19% (95% CI, 12-30) and a specificity of 97% (95% CI, 83-100).

Conclusions

Our study establishes the first data on LUS performance against a comprehensive reference standard. Overall, our data suggest that ultrasound does not meet the requirements for triage but previously described and novel ultrasound targets in combination could aid in the clinical decision making.Registry: DRKS00026636.

Accurate and affordable detection of rifampicin and isoniazid resistance in Tuberculosis sputum specimens by multiplex PCR-multiple probes melting analysis

BACKGROUND

Escalating cases of multidrug-resistant tuberculosis (MDR-TB) pose a major challenge to global TB control efforts, necessitating innovative diagnostics to empower decentralized detection of gene mutations associated with resistance to rifampicin (RIF) and isoniazid (INH) in Mycobacterium tuberculosis (M. tuberculosis) in resource-constrained settings.

METHODS

Combining multiplex fluorescent PCR and Multiple Probes Melting Analysis, we identified mutations in the rpoB, katG, ahpC and inhA genes from sputum specimens. We first constructed a reference plasmid library comprising 40 prevalent mutations in the target genes' resistance determining regions and promoters, serving as positive controls. Our assay utilizes a four-tube asymmetric PCR method with specifically designed molecular beacon probes, enabling simultaneous detection of all 40 mutations. We evaluated the assay's effectiveness using DNA isolated from 50 clinically confirmed M. tuberculosis sputum specimens, comparing our results with those obtained from Sanger sequencing and retrospective validation involving bacteriological culture and phenotypic drug susceptibility testing (pDST). We also included the commercial Xpert MTB/RIF assay for accuracy comparison.

RESULTS

Our data demonstrated remarkable sensitivity in detecting resistance to RIF and INH, achieving values of 93.33% and 95.24%, respectively, with a specificity of 100%. The concordance between our assay and pDST was 98.00%. Furthermore, the accuracy of our assay was comparable to both Sanger sequencing and the Xpert assay. Importantly, our assay boasts a 4.2-h turnaround time and costs only $10 per test, making it an optimal choice for peripheral healthcare settings.

CONCLUSION

These findings highlight our assay's potential as a promising tool for rapidly, accurately, and affordably detecting MDR-TB.

Computed tomography-based fully automated artificial intelligence model to predict extrapancreatic perineural invasion in pancreatic ductal adenocarcinoma

BACKGROUND

Extrapancreatic perineural invasion (EPNI) increases the risk of postoperative recurrence in pancreatic ductal adenocarcinoma (PDAC). This study aimed to develop and validate a computed tomography (CT)-based, fully automated preoperative artificial intelligence (AI) model to predict EPNI in patients with PDAC.

METHODS

The authors retrospectively enrolled 1065 patients from two Shanghai hospitals between June 2014 and April 2023. Patients were split into training (n=497), internal validation (n=212), internal test (n=180), and external test (n=176) sets. The AI model used perivascular space and tumor contact for EPNI detection. The authors evaluated the AI model's performance based on its discrimination. Kaplan-Meier curves, log-rank tests, and Cox regression were used for survival analysis.

RESULTS

The AI model demonstrated superior diagnostic performance for EPNI with 1-pixel expansion. The area under the curve in the training, validation, internal test, and external test sets were 0.87, 0.88, 0.82, and 0.83, respectively. The log-rank test revealed a significantly longer survival in the AI-predicted EPNI-negative group than the AI-predicted EPNI-positive group in the training, validation, and internal test sets (P<0.05). Moreover, the AI model exhibited exceptional prognostic stratification in early PDAC and improved assessment of neoadjuvant therapy's effectiveness.

CONCLUSION

The AI model presents a robust modality for EPNI diagnosis, risk stratification, and neoadjuvant treatment guidance in PDAC, and can be applied to guide personalized precision therapy.

A foundation for evaluating the surgical artificial intelligence literature

With increasing growth in applications of artificial intelligence (AI) in surgery, it has become essential for surgeons to gain a foundation of knowledge to critically appraise the scientific literature, commercial claims regarding products, and regulatory and legal frameworks that govern the development and use of AI. This guide offers surgeons a framework with which to evaluate manuscripts that incorporate the use of AI. It provides a glossary of common terms, an overview of prerequisite knowledge to maximize understanding of methodology, and recommendations on how to carefully consider each element of a manuscript to assess the quality of the data on which an algorithm was trained, the appropriateness of the methodological approach, the potential for reproducibility of the experiment, and the applicability to surgical practice, including considerations on generalizability and scalability.

A Novel Polarized Light Microscope for the Examination of Birefringent Crystals in Synovial Fluid

Background

The gold standard for crystal arthritis diagnosis relies on the identification of either monosodium urate (MSU) or calcium pyrophosphate (CPP) crystals in synovial fluid. With the goal of enhanced crystal detection, we adapted a standard compensated polarized light microscope (CPLM) with a polarized digital camera and multi-focal depth imaging capabilities to create digital images from synovial fluid mounted on microscope slides. Using this single-shot computational polarized light microscopy (SCPLM) method, we compared rates of crystal detection and raters' preference for image.

Methods

Microscope slides from patients with either CPP, MSU, or no crystals in synovial fluid were acquired using CPLM and SCPLM methodologies. Detection rate, sensitivity, and specificity were evaluated by presenting expert crystal raters with (randomly sorted) CPLM and SCPLM digital images, from FOV above clinical samples. For each FOV and each method, each rater was asked to identify crystal suspects and their level of certainty for each crystal suspect and crystal type (MSU vs. CPP).

Results

For the 283 crystal suspects evaluated, SCPLM resulted in higher crystal detection rates than did CPLM, for both CPP (51%. vs. 28%) and MSU (78% vs. 46%) crystals. Similarly, sensitivity was greater for SCPLM for CPP (0.63 vs. 0.35) and MSU (0.88 vs. 0.52) without giving up much specificity resulting in higher AUC.

Conclusions

Subjective and objective measures of greater detection and higher certainty were observed for SCPLM over CPLM, particularly for CPP crystals. The digital data associated with these images can ultimately be incorporated into an automated crystal detection system that provides a quantitative report on crystal count, size, and morphology.

Subarachnoid haemorrhage in the emergency department (SHED): a prospective, observational, multicentre cohort study

BACKGROUND

People presenting to the ED with acute severe headache often undergo investigation to exclude subarachnoid haemorrhage (SAH). International guidelines propose that brain imaging within 6 hours of headache onset can exclude SAH, in isolation. The safety of this approach is debated. We sought to externally validate this strategy and evaluate the test characteristics of CT-brain beyond 6 hours.

METHODS

A prospective, multicentre, observational cohort study of consecutive adult patients with non-traumatic acute headache presenting to the ED within a UK National Health Service setting. Investigation, diagnosis and management of SAH were all performed within routine practice. All participants were followed up for 28 days using medical records and direct contact as necessary. Uncertain diagnoses were independently adjudicated.

RESULTS

Between March 2020 and February 2023, 3663 eligible patients were enrolled from 88 EDs (mean age 45.8 (SD 16.6), 64.1% female). 3268 patients (89.2%) underwent CT-brain imaging. There were 237 cases of confirmed SAH, a prevalence of 6.5%. CT within 6 hours of headache onset (n=772) had a sensitivity of 97% (95% CI 92.5% to 99.2%) for the diagnosis of SAH and a negative predictive value of 99.6% (95% CI 98.9% to 99.9%). The post-test probability after a negative CT within 6 hours was 0.5% (95% CI 0.2% to 1.3%). The negative likelihood ratio was 0.03 (95% CI 0.01 to 0.08). CT within 24 hours of headache onset (n=2008) had a sensitivity of 94.6% (95% CI 91.0% to 97.0%). Post-test probability for SAH was consistently less than 1%. For aneurysmal SAH, post-test probability was 0.1% (95% CI 0.0% to 0.4%) if the CT was performed within 24 hours of headache onset.

CONCLUSION

Our data suggest a very low likelihood of SAH after a negative CT-brain scan performed early after headache onset. These results can inform shared decision-making on the risks and benefits of further investigation to exclude SAH in ED patients with acute headache.

Higher isokinetic quadriceps peak force is associated with a patient-acceptable symptom-state 1 and 3 years after ACL reconstruction

PURPOSE

The main purpose was to determine cut-off values for absolute (QNm/kg) and relative (QLSI) isokinetic knee extensor (KE) strength for achieving a patient-acceptable symptom state (PASS) in the Knee injury and Osteoarthritis Outcome Score (KOOS) subscales and for different age groups to determine the association between QNm/kg and QLSI and PASS, at 1 and 3 years after an anterior cruciate ligament reconstruction (ACLR).

METHODS

PASS was defined as reaching cut-off values for all KOOS subscales. Data from follow-ups were extracted from a rehabilitation registry. Male and female patients were divided into two age groups based on their age at primary ACLR: 16-24 years and 25-65 years. Odds Ratios between the QNm/kg and QLSI cut-off values and achieving PASS were calculated. Receiver Operating Characteristic curves were constructed to determine the individual predictive capacity for achieving PASS of QNm/kg and of QLSI using the area under the curve (AUC).

RESULTS

Results from 755 and 145 patients (females = 51% and 52%; preinjury Tegner Activity level ≥6 = 82% and 74%) were used in the 1- and 3-year follow-up analyses. Reaching the cut-off values for the QNm/kg, ranging between ≥2.1 and ≥2.7, entailed between 2.09 and 5.12 times the odds of achieving PASS, across all groups at the 1-year follow-up. At the 3-year follow-up, the cut-off values of ≥3.4 and ≥2.6QNm/kg were associated with patients achieving PASS with acceptable accuracy (AUC = 0.700-0.780) in 16-41 year-old males and females.

CONCLUSION

At 1 year after ACLR, patients of both sexes and age groups reaching cut-off values for absolute KE strength had two to five times the odds, that were clinically relevant, to achieve PASS. Acceptable discriminative capacity was found for the absolute KE strength among male and female patients 16-24 years old, at 3 years after ACLR.

LEVEL OF EVIDENCE

Level III.

Several methods for assessing research waste in reviews with a systematic search: a scoping review

Background

Research waste is present in all study designs and can have significant consequences for science, including reducing the reliability of research findings and contributing to the inefficient use of resources. Estimates suggest that as much as 85% of all biomedical research is wasted. However, it is uncertain how avoidable research waste is assessed in specific types of study designs and what methods could be used to examine different aspects of research waste. We aimed to investigate which methods, systematic reviews, scoping reviews, and overviews of reviews discussing research waste, have used to assess avoidable research waste.

Materials and Methods

We published a protocol in the Open Science Framework prospectively (https://osf.io/2fbp4). We searched PubMed and Embase with a 30-year limit (January 1993-August 2023). The concept examined was how research waste and related synonyms (e.g., unnecessary, redundant, duplicate, etc.) were assessed in reviews with a systematic search: systematic, scoping, or overviews of reviews. We extracted data on the method used in the review to examine for research waste and for which study design this method was applied.

Results

The search identified 4,285 records of which 93 reviews with systematic searches were included. The reviews examined a median of 90 (range 10-6,781) studies, where the study designs most commonly included were randomized controlled trials (48%) and systematic reviews (33%). In the last ten years, the number of reports assessing research waste has increased. More than 50% of examined reviews reported evaluating methodological research waste among included studies, typically using tools such as one of Cochrane Risk of Bias tools (n = 8) for randomized controlled trials or AMSTAR 1 or 2 (n = 12) for systematic reviews. One fourth of reviews assessed reporting guideline adherence to e.g., CONSORT (n = 4) for randomized controlled trials or PRISMA (n = 6) for systematic reviews.

Conclusion

Reviews with systematic searches focus on methodological quality and reporting guideline adherence when examining research waste. However, this scoping review revealed that a wide range of tools are used, which may pose difficulties in comparing examinations and performing meta-research. This review aids researchers in selecting methodologies and contributes to the ongoing discourse on optimizing research efficiency.

Performance of Aldosterone-to-renin Ratio Before Washout of Antihypertensive Drugs in Screening of Primary Aldosteronism

OBJECTIVE

The aim of this study is to evaluate performance of aldosterone-to-renin ratio (ARR) before washout of antihypertensive drugs as a screening test for primary aldosteronism (PA).

METHODS

This retrospective analysis included consecutive patients screening for secondary hypertension during a period from January 2017 to May 2022 at the authors' institute. For inclusion in the final analysis, ARR had to be available prior to as well as after discontinuation of antihypertensives. Patients with ARR ≥2.4(ng/dL)/(μIU/mL) after washout proceeded to confirmatory tests. Diagnosis of PA was established based on a positive result of the confirmatory test. The diagnostic accuracy of ARR prior to the washout in predicting PA is shown as sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).

RESULTS

The analysis included a total of 1306 patients [median age of 50.2 (41.0-59.0) years, 64.0% male]. Confirmatory tests showed PA in 215(16.5%) patients and essential hypertension (EH) in the remaining 1091(83.5%) patients. In comparison to the second screening test, the first screening test (before washout of antihypertensives) yielded lower plasma aldosterone and higher renin and consequently lower ARR in both the PA and EH groups. At a cutoff of .7(ng/dL)/(μIU/mL), ARR before washout had 96.3% sensitivity, 61.2% specificity, .33 PPV, and .99 NPV. At a lower cutoff of .5(ng/dL)/(μIU/mL), the sensitivity, specificity, PPV, and NPV were 97.7%, 52.0%, .29, and .99, respectively.

CONCLUSION

ARR prior to washout of antihypertensives is a sensitive screening test for PA. Washout of antihypertensives could be omitted and further investigation for PA is not warranted if ARR is ≤ .7(ng/dL)/(μIU/mL) before washout.

Revisiting Diagnostic Criteria for Bilateral Vestibulopathy: A New Comprehensive Instrumental Model

Background: Bilateral vestibulopathy (BVP) is a disabling condition characterized by a deficit in vestibular function on both sides. Current diagnostic criteria consider instrumental data only from horizontal canals, excluding vertical canals and otolithic function, with the possibility of not including some variants of BVP. This study aims to evaluate vestibular functions in people with chronic vestibular syndrome through a comprehensive battery of tests. Methods: This diagnostic accuracy study included patients who met criteria for probable BVP. The index test included a thorough evaluation of the vestibular system, using the video Head Impulse Test (vHIT) to measure the gain of the angular vestibulo-ocular reflex (aVOR) in all six semicircular canals and the cervical and ocular vestibular-evoked myogenic potentials (VEMPs) to assess otolith function. The diagnostic criteria established by the Barany Society were considered the standard reference, including only the horizontal vHIT as an instrumental assessment. Results: 78 patients (41 male, age 61.40 ± 12.99) were enrolled. The Barany criteria showed a low ability to rule out BPV (sensitivity = 46%). The median Dizziness Handicap Inventory (DHI) varied from 66 to 69 among the models studied, and a significant difference in DHI scores between positive and negative tests was observed for the Barany criteria and the six-canals vHIT model. Conclusions: Our findings highlight the potential to transform BPV diagnostic criteria. The identification of new bilateral vestibular dysfunction variants through improved diagnostic tools calls for revising current criteria, with promising implications for patient care and understanding of etiological and prognostic aspects.

Serum human epididymis Protein-4 outperforms conventional biomarkers in the early detection of non-small cell lung cancer

We employed a three-step approach to evaluate serum immunoassay-based biomarkers for detecting non-small cell lung cancer (NSCLC). In the first step, we performed a systematic review and meta-analysis and implemented the Laboratory Medicine Best Practices (LMBP) method to identify potential biomarkers. From potential biomarkers, Carcinoembryonic antigen (CEA), cytokeratin 19-fragments (Cyfra 21-1), and human epididymis protein-4 (HE4) were categorized as LMBP "recommend." In the second step, we conducted matched-case-control validation on these recommended biomarkers and SAA, identified as the most accurate in the first step. In the third step, a re-meta-analysis was performed by integrating our experimental results and considering covariates. The final results revealed that HE4 emerged as the most reliable biomarker, offering balanced sensitivity and specificity, with accuracy unaffected by tumor stage, making it suitable for early diagnosis. Our findings support the inclusion of HE4 in clinical guidelines for NSCLC diagnosis, alongside well-established biomarkers such as Cyfra 21-1 and CEA.

Electroencephalography based delirium screening in acute supratentorial stroke

BACKGROUND

Up to 25% of patients suffering from an acute stroke are diagnosed with delirium during the hospital stay, with older age increasing the risk. Generalized slowing in the electroencephalogram (EEG) supports the diagnosis of delirium. We examined the potential of single-channel EEG (DeltaScan®) as an easy-to-use device on intensive care units for detecting delirium. Our aim was to investigate characteristics of bihemispheric EEG recordings and single-channel EEG in patients suffering from strokes with and without delirium and to analyze the diagnostic accuracy of EEG-based diagnoses.

METHODS

Within the first five days after stroke onset, patients received single-channel EEG DeltaScan® and a routine 21-channel EEG. The DeltaScan® analyzes right sided fronto-parietal EEG using a proprietary algorithm focusing on polymorphic delta activity (PDA). In routine EEG the power spectral density (PSD) in predefined frequency bands was analyzed based on 2-minute eyes-closed resting state segments. EEG-analyses were conducted in MNE (v1.3.1) in Python (3.10) and RStudio (v4.2.1).

RESULTS

In 9 of 53 patients (52-90 years) delirium was diagnosed according to DSM-V criteria. Sensitivity of DeltaScan® was 44% (95% CI = 15.3-77.3%), while specificity was 71% (95% CI = 57-83%). We found patients with right hemispheric stroke having a higher probability to be false positive in DeltaScan® (p = 0.01). The 21-channel EEG based power analysis revealed significant differences in frontal delta and theta power between patients with and without delirium (p < 0.05).

CONCLUSIONS

When EEG is used in clinical practice to support a delirium diagnosis in stroke patients, bihemispheric recordings are likely preferable over unilateral recordings. Slowing in the delta- or theta-frequency spectrum over the site of stroke may lead to false-positive results in single channel EEG based delirium scoring.

A Phase 2 Sensitivity and Selectivity Study of High-Dose 5-Aminolevulinic Acid in Adult Patients Undergoing Resection of a Newly Diagnosed or Recurrent Glioblastoma

BACKGROUND AND OBJECTIVES

The utility of oral 5-aminolevulinic acid (5-ALA)/protoporphyrin fluorescence for the resection of high-grade gliomas is well documented, but the problem of false-negative observations remains. This study compares high-grade glioma visualization with low/standard dose 5-ALA (<30 mg/kg) to high-dose 5-ALA (>40 mg/kg) to see if by using this higher dose, it is possible to reduce the rate of false-negative observations without increasing the rate of false-positive (FP) observations and therefore increase the sensitivity.

METHODS

This is a prospective study of consecutive patients with radiological evidence of presumed high-grade glioma. We reviewed the data from patients who received preoperative low/standard doses and patients who received a preoperative high dose of 5-ALA. Adverse events, dose to observation time, intensity of tumor fluorescence, and results of biopsies in areas of tumor and tumor bed under deep blue light were recorded.

RESULTS

A total of 22 patients with high-grade glioma received a dose >40 mg/kg (high-dose) and 9 patients received <30 mg/kg (low/standard dose). There were no serious adverse events related to 5-ALA in any subject. There was a very high sensitivity and specificity of 5-ALA for the presence of tumor in both groups. There were no FP observations (fluorescence with no tumor) in either group. The specificity and the positive predictive value were 100% in both groups. The sensitivity and the negative predictive value were 53.3% and 30.0% in the low/standard dose group and 59.5% and 31.8% in the high-dose group, respectively.

CONCLUSION

High-dose oral 5-aminolevulinic/protoporphyrin fluorescence is a safe and effective aid to the intraoperative detection of high-grade gliomas with high sensitivity and specificity. False-negative observations with a high dose do not seem to be less than that with a low/standard dose. The rate of FP observations with both groups remains very low.

The Accuracy and Capability of Artificial Intelligence Solutions in Health Care Examinations and Certificates: Systematic Review and Meta-Analysis

BACKGROUND

Large language models (LLMs) have dominated public interest due to their apparent capability to accurately replicate learned knowledge in narrative text. However, there is a lack of clarity about the accuracy and capability standards of LLMs in health care examinations.

OBJECTIVE

We conducted a systematic review of LLM accuracy, as tested under health care examination conditions, as compared to known human performance standards.

METHODS

We quantified the accuracy of LLMs in responding to health care examination questions and evaluated the consistency and quality of study reporting. The search included all papers up until September 10, 2023, with all LLMs published in English journals that report clear LLM accuracy standards. The exclusion criteria were as follows: the assessment was not a health care exam, there was no LLM, there was no evaluation of comparable success accuracy, and the literature was not original research.The literature search included the following Medical Subject Headings (MeSH) terms used in all possible combinations: "artificial intelligence," "ChatGPT," "GPT," "LLM," "large language model," "machine learning," "neural network," "Generative Pre-trained Transformer," "Generative Transformer," "Generative Language Model," "Generative Model," "medical exam," "healthcare exam," and "clinical exam." Sensitivity, accuracy, and precision data were extracted, including relevant CIs.

RESULTS

The search identified 1673 relevant citations. After removing duplicate results, 1268 (75.8%) papers were screened for titles and abstracts, and 32 (2.5%) studies were included for full-text review. Our meta-analysis suggested that LLMs are able to perform with an overall medical examination accuracy of 0.61 (CI 0.58-0.64) and a United States Medical Licensing Examination (USMLE) accuracy of 0.51 (CI 0.46-0.56), while Chat Generative Pretrained Transformer (ChatGPT) can perform with an overall medical examination accuracy of 0.64 (CI 0.6-0.67).

CONCLUSIONS

LLMs offer promise to remediate health care demand and staffing challenges by providing accurate and efficient context-specific information to critical decision makers. For policy and deployment decisions about LLMs to advance health care, we proposed a new framework called RUBRICC (Regulatory, Usability, Bias, Reliability [Evidence and Safety], Interoperability, Cost, and Codesign-Patient and Public Involvement and Engagement [PPIE]). This presents a valuable opportunity to direct the clinical commissioning of new LLM capabilities into health services, while respecting patient safety considerations.

TRIAL REGISTRATION

OSF Registries osf.io/xqzkw; https://osf.io/xqzkw.

Data-Driven Cutoff Selection for the Patient Health Questionnaire-9 Depression Screening Tool

Importance

Test accuracy studies often use small datasets to simultaneously select an optimal cutoff score that maximizes test accuracy and generate accuracy estimates.

Objective

To evaluate the degree to which using data-driven methods to simultaneously select an optimal Patient Health Questionnaire-9 (PHQ-9) cutoff score and estimate accuracy yields (1) optimal cutoff scores that differ from the population-level optimal cutoff score and (2) biased accuracy estimates.

Design, Setting, and Participants

This study used cross-sectional data from an existing individual participant data meta-analysis (IPDMA) database on PHQ-9 screening accuracy to represent a hypothetical population. Studies in the IPDMA database compared participant PHQ-9 scores with a major depression classification. From the IPDMA population, 1000 studies of 100, 200, 500, and 1000 participants each were resampled.

Main Outcomes and Measures

For the full IPDMA population and each simulated study, an optimal cutoff score was selected by maximizing the Youden index. Accuracy estimates for optimal cutoff scores in simulated studies were compared with accuracy in the full population.

Results

The IPDMA database included 100 primary studies with 44 503 participants (4541 [10%] cases of major depression). The population-level optimal cutoff score was 8 or higher. Optimal cutoff scores in simulated studies ranged from 2 or higher to 21 or higher in samples of 100 participants and 5 or higher to 11 or higher in samples of 1000 participants. The percentage of simulated studies that identified the true optimal cutoff score of 8 or higher was 17% for samples of 100 participants and 33% for samples of 1000 participants. Compared with estimates for a cutoff score of 8 or higher in the population, sensitivity was overestimated by 6.4 (95% CI, 5.7-7.1) percentage points in samples of 100 participants, 4.9 (95% CI, 4.3-5.5) percentage points in samples of 200 participants, 2.2 (95% CI, 1.8-2.6) percentage points in samples of 500 participants, and 1.8 (95% CI, 1.5-2.1) percentage points in samples of 1000 participants. Specificity was within 1 percentage point across sample sizes.

Conclusions and Relevance

This study of cross-sectional data found that optimal cutoff scores and accuracy estimates differed substantially from population values when data-driven methods were used to simultaneously identify an optimal cutoff score and estimate accuracy. Users of diagnostic accuracy evidence should evaluate studies of accuracy with caution and ensure that cutoff score recommendations are based on adequately powered research or well-conducted meta-analyses.

Prediction of humeral shaft fracture healing using the Radiographic Union Score for HUmeral Fractures (RUSHU)

Aims

Though most humeral shaft fractures heal nonoperatively, up to one-third may lead to nonunion with inferior outcomes. The Radiographic Union Score for HUmeral Fractures (RUSHU) was created to identify high-risk patients for nonunion. Our study evaluated the RUSHU's prognostic performance at six and 12 weeks in discriminating nonunion within a significantly larger cohort than before.

Methods

Our study included 226 nonoperatively treated humeral shaft fractures. We evaluated the interobserver reliability and intraobserver reproducibility of RUSHU scoring using intraclass correlation coefficients (ICCs). Additionally, we determined the optimal cut-off thresholds for predicting nonunion using the receiver operating characteristic (ROC) method.

Results

The RUSHU demonstrated good interobserver reliability with an ICC of 0.78 (95% CI 0.72 to 0.83) at six weeks and 0.77 (95% CI 0.71 to 0.82) at 12 weeks. Intraobserver reproducibility was good or excellent for all analyses. Area under the curve in the ROC analysis was 0.83 (95% CI 0.77 to 0.88) at six weeks and 0.89 (95% CI 0.84 to 0.93) at 12 weeks, indicating excellent discrimination. The optimal cut-off values for predicting nonunion were ≤ eight points at six weeks and ≤ nine points at 12 weeks, providing the best specificity-sensitivity trade-off.

Conclusion

The RUSHU proves to be a reliable and reproducible radiological scoring system that aids in identifying patients at risk of nonunion at both six and 12 weeks post-injury during non-surgical treatment of humeral shaft fractures. The statistically optimal cut-off values for predicting nonunion are ≤ eight at six weeks and ≤ nine points at 12 weeks post-injury.

Assessment of Treatment Response in Known Crohn's Disease-A Prospective Blinded Study Comparing the Diagnostic Accuracy of Intestinal Ultrasound, Magnetic Resonance Enterocolonography, Panenteric Capsule Endoscopy, and Fecal Calprotectin

BACKGROUND

Minimally invasive modalities may replace ileocolonoscopy (IC) in the follow-up of Crohn's disease (CD). The aim of this study was to evaluate intestinal ultrasound (IUS), magnetic resonance enterocolonography (MREC), panenteric capsule endoscopy (PCE), and fecal calprotectin (FC) for determining response to medical treatment in patients with ileocolonic CD.

METHODS

This prospective, blinded, multicenter study included patients with endoscopically active CD. Patients were scheduled for IC, MREC, IUS, PCE, and FC before and 12 weeks after treatment with corticosteroids or biological therapy. A ≥50% reduction of the Simple Endoscopic Score for Crohn's Disease (SES-CD) with IC defined treatment response.

RESULTS

Fifty patients completed the pre- and posttreatment evaluation with IC, and endoscopic response was achieved in 25 (50.0%). PCE was omitted in 12 (24.0%) patients because of stricturing CD. All activity scores decreased in patients achieving endoscopic response: The Simple Ultrasound Score for Crohn's Disease 2.2 vs 6.1 (P < .001), Magnetic Resonance Index of Activity 29.0 vs 37.1 (P = .05), SES-CD with PCE 3.1 vs 12.8 (P < .001), and FC 115.3 vs 1339.9 mg/kg (P < .001). The sensitivity and specificity of IUS, MREC, PCE, and FC were 80.0% (95% CI, 56.3-94.3)/77.8% (95% CI, 52.4-93.6), 65.2% (95% CI, 42.7-83.6)/87.0% (95% CI, 66.4-97.2), 87.5% (95% CI, 61.7-98.4)/86.7% (95% CI, 59.5-98.3), and 90.0% (95% CI, 68.3-98.8)/86.4% (95% CI, 65.1-97.1), respectively.

CONCLUSIONS

IUS and FC are equally effective for determining treatment response in patients with active CD. PCE is limited by the occurrence of strictures in this group of patients.

The Diagnostic Accuracy of EXTEM and HEPTEM Clotting Times Versus Standard Laboratory Tests in Cardiac Surgical Patients With and Without Normal FIBTEM Values

OBJECTIVES

There is extensive evidence to support the use of FIBTEM to identify hypofibrinogenemia during cardiac surgery, but less to support the use of EXTEM and INTEM clotting times (CTs) to identify other plasmatic coagulation factor deficiencies. The aim of the current study was to assess the diagnostic accuracy of EXTEM, INTEM, and HEPTEM CTs, using laboratory international normalized ratio (INR) and activated partial thromboplastin time (aPTT) as reference standards.

DESIGN

This was a retrospective diagnostic accuracy study.

SETTING

The work took place at a tertiary referral hospital.

PARTICIPANTS

A total of 176 cardiac surgical patients were enrolled.

INTERVENTIONS

INR, aPTT, ROTEM EXTEM, INTEM, and HEPTEM were measured post-heparin reversal after cardiopulmonary bypass.

MEASUREMENTS AND MAIN RESULTS

Sensitivity, specificity, and positive (PPVs) and negative predictive values (NPVs) for EXTEM CT >80 seconds and HEPTEM CT >280 seconds to detect INR ≥2.0, and INTEM CT >205 seconds to detect aPTT ≥38.5 seconds were calculated for all patients and the subset with normal FIBTEM A5 (>6 mm). The prevalence of INR ≥2.0 was 13%. EXTEM CT >80 seconds had a sensitivity of 1.00, specificity of 0.25, PPV of 0.17, and NPV of 1.00. HEPTEM CT >280 seconds had a sensitivity of 0.91, specificity of 0.38, PPV of 0.18, and NPV of 0.97. INTEM CT >205 seconds had a sensitivity of 0.97, specificity of 0.11, PPV of 0.57, and NPV of 0.75 for aPTT ≥38.5 seconds. These values were similar for the subset of patients with normal FIBTEM A5.

CONCLUSIONS

EXTEM CT >80 seconds and HEPTEM CT >280 seconds have high sensitivities and NPVs for INR >2.0, which would effectively "rule out" INR >2.0 as a cause for excessive bleeding. However, the low specificities and PPVs indicate they would be less effective in ruling it in. INTEM CT >205 seconds had low PPV and NPV in identifying aPTT >38.5 seconds.

Accuracy of immunological tests on serum and urine for diagnosis of Taenia solium neurocysticercosis: A systematic review

BACKGROUND

Taenia solium neurocysticercosis is a zoonotic neglected tropical disease, for which adequate diagnostic management is paramount, especially in patients with active cysts for whom improved and timely management could prove beneficial. Immunodiagnosis can potentially partially mitigate the necessity for neuroimaging, shortening the diagnostic -and treatment- pathway. An up-to-date review of immunological test performance is however lacking.

METHODOLOGY/PRINCIPAL FINDINGS

Searches were performed in PubMed, EMBASE, Web of Science, and Scopus (up to January 2024), with included records fitting the review scope, i.e. accuracy evaluation of an antibody-/or antigen-detecting immunological test, using serum or urine of humans confirmed via reference standard (i.e. neuroimaging or surgery/biopsy). Record data was assessed, with classification of descriptive data on cyst localization and stage according to a developed confidence scale, and with selection of tests evaluated on a sufficiently high sample size. A QUADAS-2 risk of bias assessment was performed. After screening, 169 records were included for data collection, with 53 records-corresponding to 123 tests- selected for analysis. Absence of data and large data heterogeneity complicated result interpretation. The lentil lectin-bound glycoprotein enzyme-linked immunoelectrotranfser blot seems to fulfill high accuracy standards regarding detection of parenchymal active multiple cysts; also antigen-detecting tests on serum and urine performed well, additionally in detection of extraparenchymal neurocysticercosis. A novel multi-antigen print immunoassay is highly promising, with sensitivity for detection of extraparenchymal and parenchymal active single and multiple cysts of 100.0%, and specificity of 98.5%. Point-of-care tests showed promising results, however require further evaluation in targeted resource-poor settings.

CONCLUSIONS/SIGNIFICANCE

The review highlights the importance of transparent and unambiguous data reporting. With promising immunological tests in development, the challenge before usage in targeted settings will be to perform large-scale evaluations whilst holding into account both optimized test performance and ease of use. Accessibility to validated tests and feasibility of implementation should also be considered.

Core outcomes measures in dental computer vision studies (DentalCOMS)

OBJECTIVES

To improve reporting and comparability as well as to reduce bias in dental computer vision studies, we aimed to develop a Core Outcome Measures Set (COMS) for this field. The COMS was derived consensus based as part of the WHO/ITU/WIPO Global Initiative AI for Health (WHO/ITU/WIPO AI4H).

METHODS

We first assessed existing guidance documents of diagnostic accuracy studies and conducted interviews with experts in the field. The resulting list of outcome measures was mapped against computer vision modeling tasks, clinical fields and reporting levels. The resulting systematization focused on providing relevant outcome measures whilst retaining details for meta-research and technical replication, displaying recommendations towards (1) levels of reporting for different clinical fields and tasks, and (2) outcome measures. The COMS was consented using a 2-staged e-Delphi, with 26 participants from various IADR groups, the WHO/ITU/WIPO AI4H, ADEA and AAOMFR.

RESULTS

We assigned agreed levels of reporting to different computer vision tasks. We agreed that human expert assessment and diagnostic accuracy considerations are the only feasible method to achieve clinically meaningful evaluation levels. Studies should at least report on eight core outcome measures: confusion matrix, accuracy, sensitivity, specificity, precision, F-1 score, area-under-the-receiver-operating-characteristic-curve, and area-under-the-precision-recall-curve.

CONCLUSION

Dental researchers should aim to report computer vision studies along the outlined COMS. Reviewers and editors may consider the defined COMS when assessing studies, and authors are recommended to justify when not employing the COMS.

CLINICAL SIGNIFICANCE

Comparing and synthesizing dental computer vision studies is hampered by the variety of reported outcome measures. Adherence to the defined COMS is expected to increase comparability across studies, enable synthesis, and reduce selective reporting.

Role of inflammatory markers in the assessment of meningitis in adult patients with fever and headache

BACKGROUND

Meningitis, especially of bacterial origin, is a medical emergency that must be diagnosed promptly. However, due to the associated risks of complications of lumbar puncture, it is crucial to identify individuals who truly need it. The aim of this study was to assess the diagnostic role of inflammatory markers in distinguishing among patients without meningitis, those with aseptic meningitis, and those with bacterial meningitis.

METHODS

This was a retrospective, diagnostic study at an acute care hospital, involving adult patients who presented to either ambulatory care or the emergency department with fever and headache, but without altered mental status or neurological deficits. Inflammatory markers (C-reactive protein [CRP], mean platelet volume, neutrophil-lymphocyte ratio, and red cell distribution width) were assessed as index tests. An expert panel classified patients into three groups: no meningitis, aseptic meningitis, and bacterial meningitis using predefined criteria.

RESULTS

Of the 80 patients, 52 had no meningitis, 27 had aseptic meningitis, and 1 had bacterial meningitis. Of the inflammatory markers investigated, only CRP showed potential usefulness in differentiating these three diagnostic groups, with median values of 5.6 (interquartile range [IQR] 2.1, 11.3) mg/dL in those without meningitis, 0.2 (IQR 0.1, 1.2) mg/dL in those with aseptic meningitis, and notably elevated at 21.7 mg/dL in the patient with bacterial meningitis.

CONCLUSION

In adult patients presenting with fever and headache in an emergency setting, CRP was the only marker that demonstrated potential diagnostic utility in distinguishing among those with no meningitis, aseptic meningitis, and bacterial meningitis.

Real-world performance of a single-use, analyser-free, molecular point-of-care test for COVID-19 used in the emergency department: Results of a prospective trial (ED-POC)

BACKGROUND

A novel single-use, analyser-free, molecular point-of-care test for SARS-CoV-2 (Veros COVID-19 test, Sherlock Biosciences) could reduce time to results and improve patient care and flow in the emergency department (ED), but its performance in this setting is unknown.

METHODS

Adults aged ≥18 years presenting to Southampton General Hospital (UK) with suspected COVID-19 were tested with the Veros COVID-19 test in addition to standard of care near-patient PCR. Measures of diagnostic accuracy were calculated for the Veros COVID-19 test stratified by Ct value. Discrepant results underwent viral culture.

FINDINGS

Between Jan 16 and May 2, 2023, 400 patients were enrolled with a median (IQR) age of 60 (34-77) and 141 (35·3%) were SARS-CoV-2 positive by PCR. The Veros test gave valid results on the first test in 384 (96·0%), and sensitivity and specificity were 127/141 (90·1%, 95%CI 83·9-94·5) and 258/259 (99·6%, 95%CI 97·9-100) overall. For those with high or moderate viral load (Ct ≤30), sensitivity was 125/129 (96·9%, 95%CI 92·3-99·2). One (7·1%) of 14 PCR positive/Veros test negative samples was culture positive. Median (IQR) time from sample collection to result was 19 (18-20) mins with the Veros test versus 73 (59-92) mins with PCR (p < 0·0001).

INTERPRETATION

The Veros COVID-19 test generated results in near real-time, around 1 h sooner than rapid, near-patient, analyser-based PCR, and accuracy was excellent for samples with moderate and high viral loads. The Veros test represents a step-change in molecular diagnostics for infection and could significantly reduce time to results and improve patient management in EDs and other settings.

Guidelines for Contributors to AJOT

The American Journal of Occupational Therapy (AJOT) is the official journal of the American Occupational Therapy Association (AOTA). The primary mission of AJOT is to publish peer-reviewed research examining the effectiveness and efficacy of occupational therapy practice so that occupational therapy professionals can make informed, evidence-based decisions about best practice. In addition, the journal aims to publish (1) research documenting the reliability and validity of occupational therapy instruments; (2) studies demonstrating a relationship between occupational engagement and the facilitation of community participation and health; and (3) articles that provide a forum for scholars to debate professional issues that affect education, practice, and research. This Guidelines for Contributors to AJOT is also available at the American Journal of Occupational Therapy manuscript submission website, ScholarOne (go to https://mc04.manuscriptcentral.com/ajot and click "Instructions & Forms" in the upper right). These guidelines are published annually in a supplement to the journal; any changes implemented in the interim are published to the Author Guidelines page on the AJOT website (go to https://research.aota.org/ajot/pages/authorguidelines).

Changes in vessel density patterns assessed with OCTA in patients with diabetic macular edema treated with anti-VEGF therapy

AIMS

To determine the presence of sectoral changes in vessel density (VD) patterns induced by vascular endothelial growth factor inhibitors (anti-VEGF) in patients with diabetic macular edema (DME) using optical coherence tomography angiography (OCTA).

METHODS

Prospective, interventional study. A total of 43 patients (63 eyes) were initially enrolled in the study. We performed swept source (SS) OCT and sectorial OCTA measurement to determine parafoveal VD at baseline and after six months of anti-VEGF treatment. In the locations with statistically significant differences in VD between baseline and month 6, we performed univariate and multivariate analyses to determine which, if any, of the baseline variables were associated with the observed changes.

RESULTS

A total of 34 patients (48 eyes) were included in the final analysis. Mean VD decreased from baseline to month 6 (from 45.2 (± 3.5) to 44.6 (± 3.2) % in the SCP and from 50 (± 3.3) to 49 (± 3.9) % in the DCP). The only significant changes in VD were observed in the nasal sector of the deep capillary plexus, with a decrease of 2.9% (p = 0.001). On univariate and multivariate analyses, the only variable significantly associated with changes in VD in the nasal sector after 6 months of treatment was baseline VD in the same sector.

CONCLUSIONS

Anti-VEGF therapy has a small impact on VD values over time. These variations observed after treatment seems to be related to changes over areas of vascular anomalies and displaced vessels adjacent to cystic areas, with no significant changes over ischemic areas. No correlation was observed between this trend and other clinical baseline features.

Accuracy of CAD4TB (Computer-Aided Detection for Tuberculosis) on paediatric chest radiographs

BACKGROUND

Computer-aided detection (CAD) systems hold promise for improving tuberculosis (TB) detection on digital chest radiographs. However, data on their performance in exclusively paediatric populations are scarce.

METHODS

We conducted a retrospective diagnostic accuracy study evaluating the performance of CAD4TBv7 (Computer-Aided Detection for Tuberculosis version 7) using digital chest radiographs from well-characterised cohorts of Gambian children aged <15 years with presumed pulmonary TB. The children were consecutively recruited between 2012 and 2022. We measured CAD4TBv7 performance against a microbiological reference standard (MRS) of confirmed TB, and also performed Bayesian latent class analysis (LCA) to address the inherent limitations of the MRS in children. Diagnostic performance was assessed using the area under the receiver operating characteristic curve (AUROC) and point estimates of sensitivity and specificity.

RESULTS

A total of 724 children were included in the analysis, with confirmed TB in 58 (8%), unconfirmed TB in 145 (20%) and unlikely TB in 521 (72%). Using the MRS, CAD4TBv7 showed an AUROC of 0.70 (95% CI 0.60-0.79), and demonstrated sensitivity and specificity of 19.0% (95% CI 11-31%) and 99.0% (95% CI 98.0-100.0%), respectively. Applying Bayesian LCA with the assumption of conditional independence between tests, sensitivity and specificity estimates for CAD4TBv7 were 42.7% (95% CrI 29.2-57.5%) and 97.9% (95% CrI 96.6-98.8%), respectively. When allowing for conditional dependence between culture and Xpert assay, CAD4TBv7 demonstrated a sensitivity of 50.3% (95% CrI 32.9-70.0%) and specificity of 98.0% (95% CrI 96.7-98.9%).

CONCLUSION

Although CAD4TBv7 demonstrated high specificity, its suboptimal sensitivity underscores the crucial need for optimisation of CAD4TBv7 for detecting TB in children.

The European Organisation of External Quality Assurance Providers in Laboratory Medicine (EQALM) Statement: guidelines for publishing about interlaboratory comparison studies (PubILC)

Data and results from interlaboratory comparison (ILC) studies, external quality assessment (EQA) and proficiency testing (PT) activities are important and valuable contributions both to the further development of all disciplines of medical laboratory diagnostics, and to the evaluation and comparison of in vitro diagnostic assays. So far, however, there are no recommendations as to which essential items should be addressed in publications on interlaboratory comparisons. The European Organization of External Quality Assurance Providers in Laboratory Medicine (EQALM) recognized the need for such recommendations, and these were developed by a group of experts. The result of this endeavor is the EQALM Statement on items recommended to be addressed in publications on interlaboratory comparison activities (PubILC), in conjunction with a user-friendly checklist. Once adopted by authors and journals, the EQALM Statement will ensure essential information and/or study-related facts are included within publications on EQA/PT activities.

Acute and Long-Term Management of Blunt Cerebrovascular Injury at a Quaternary Referral Level 1 Trauma Center: The Memphis Experience and Comparison of a New Scoring System

BACKGROUND AND OBJECTIVES

The management of blunt cerebrovascular injuries (BCVIs) remains an important topic within trauma and neurosurgery today. There remains a lack of consensus within the literature and significant variation across institutions. The purpose of this study was to evaluate management of BCVI at a large, tertiary referral trauma center.

METHODS

Institutional Review Board approval was obtained to conduct a retrospective review of patients with BCVI at our Level 1 Trauma Center. Computed tomography angiography was used to identify BCVI for each patient. Patient information was collected, and statistical analysis was performed. With the included risk factors for ischemic complications, a novel scoring system based on ischemic risk, the "Memphis Score," was developed and evaluated to grade BCVI.

RESULTS

Two hundred seventeen patients with BCVI from July 2020 to August 2022 were identified. The most common mechanism of injury was motor vehicle collision (141, 65.0%). Vertebral arteries were the most common vessel injured (136, 51.1%) with most injuries occurring at a high cervical location (101, 38.0%). Denver Grade 1 injuries (89, 33.5%) and a Memphis Score of 1 were most frequent (172, 64.6%), and initial anticoagulation with heparin drip was initiated 56.7% of the time (123). Endovascular treatment was required in 24 patients (11.1%) and was usually performed in the first 48 hours (15, 62.5%). While Denver Grade ( P = .019) and Memphis Score ( P < .00001) were significantly higher in those patients undergoing endovascular treatment, only the Memphis Score demonstrated a significant difference between those patients who had stroke or worsening on follow-up imaging and those who did not ( P = .0009).

CONCLUSION

Although BCVI management has improved since early investigative efforts, institutions must evaluate and share their data to help clarify outcomes. The novel "Memphis Score" presents a standardized framework to communicate ischemic risk and guide management of BCVI.

Evaluation and application of American College of Radiology Thyroid Imaging Reporting and Data System for improved malignancy detection in paediatric thyroid nodules

OBJECTIVE

The American College of Radiology Thyroid Imaging Reporting and Data System (TI-RADS) is a widely used method for the management of adult thyroid nodules. However, its use in paediatric patients is controversial because adult fine needle aspiration biopsy (FNAB) recommendations may lead to delayed diagnoses of cancer in children. The objectives of this study were to evaluate the performance of TI-RADS in paediatric thyroid nodules and to tailor FNAB recommendations for children.

METHODS

Consecutive surgically resected paediatric thyroid nodules from two tertiary care centres between 2003 and 2021 were reviewed. Ultrasounds were blindly scored by radiologists according to TI-RADS. Management recommendations based on TI-RADS were evaluated. Various modelling methodologies were used to determine the optimal cutoff for FNAB in children.

RESULTS

Of the 96 patients, 79 (82%) were female and the median age at surgery was 16.1 years. Fifty (52%) nodules were malignant on surgical pathology. The area under the receiver operating characteristic curve of TI-RADS for predicting malignancy was 0.78. Adult TI-RADS recommendations would have resulted in 4% of cancerous nodules being lost to follow-up. Modifications to TI-RADS (FNAB of all TR3 nodules ≥1.5 cm, FNAB of TR4 and TR5 nodules ≥0.5 cm, surveillance of nodules ≥1 cm, consider surgery for nodules >4 cm) reduced this missed malignancy rate to 0%.

CONCLUSIONS

TI-RADS can risk-stratify paediatric thyroid nodules. However, the system requires modifications to reduce the missed malignancy rate in paediatric thyroid nodules. Our data suggest that lower size thresholds for FNAB are warranted in children.

Deep learning-based automatic pipeline system for predicting lateral cervical lymph node metastasis in patients with papillary thyroid carcinoma using computed tomography: A multi-center study

Objective

The assessment of lateral lymph node metastasis (LLNM) in patients with papillary thyroid carcinoma (PTC) holds great significance. This study aims to develop and evaluate a deep learning-based automatic pipeline system (DLAPS) for diagnosing LLNM in PTC using computed tomography (CT).

Methods

A total of 1,266 lateral lymph nodes (LLNs) from 519 PTC patients who underwent CT examinations from January 2019 to November 2022 were included and divided into training and validation set, internal test set, pooled external test set, and prospective test set. The DLAPS consists of an auto-segmentation network based on RefineNet model and a classification network based on ensemble model (ResNet, Xception, and DenseNet). The performance of the DLAPS was compared with that of manually segmented DL models, the clinical model, and Node Reporting and Data System (Node-RADS). The improvement of radiologists' diagnostic performance under the DLAPS-assisted strategy was explored. In addition, bulk RNA-sequencing was conducted based on 12 LLNs to reveal the underlying biological basis of the DLAPS.

Results

The DLAPS yielded good performance with area under the receiver operating characteristic curve (AUC) of 0.872, 0.910, and 0.822 in the internal, pooled external, and prospective test sets, respectively. The DLAPS significantly outperformed clinical models (AUC 0.731, P<0.001) and Node-RADS (AUC 0.602, P<0.001) in the internal test set. Moreover, the performance of the DLAPS was comparable to that of the manually segmented deep learning (DL) model with AUCs ranging 0.814-0.901 in three test sets. Furthermore, the DLAPS-assisted strategy improved the performance of radiologists and enhanced inter-observer consistency. In clinical situations, the rate of unnecessary LLN dissection decreased from 33.33% to 7.32%. Furthermore, the DLAPS was associated with the cell-cell conjunction in the microenvironment.

Conclusions

Using CT images from PTC patients, the DLAPS could effectively segment and classify LLNs non-invasively, and this system had a good generalization ability and clinical applicability.

Reliability and accuracy of Artificial intelligence-based software for cephalometric diagnosis. A diagnostic study

BACKGROUND

Artificial intelligence (AI) is revolutionizing cephalometric diagnosis in orthodontics, streamlining the patient assessments. This study aimed to assess the reliability, accuracy, and time consumption of artificial intelligence (AI)-based software compared to a conventional digital cephalometric analysis method on 2D lateral cephalogram.

METHODS

408 lateral cephalometries were analysed using three methods: manual landmark localization, automatic localization, and semi-automatic localization with AI-based software. On each lateral cephalogram, 15 variables were selected, including skeletal, dental, and soft tissue measurements. The difference between the two AI-based software options (automatic and semi-automatic) was compared with the conventional digital technique. The time required to produce a complete cephalometric tracing was evaluated for each method using Student's t-test.

RESULTS

Statistically significant differences in the accuracy of landmark positioning were detected among the three different techniques (p < 0,01). However, it is noteworthy that almost all of these differences were not clinically significant. There was a small difference in accuracy between the semi-automatic AI-based option and conventional digital techniques. Regarding the time used for each technique, the automatic version was the fastest, followed by the semi-automatic option and the conventional digital technique. (p < 0,000).

CONCLUSIONS

The study showed a statistical difference in accuracy between the conventional digital technique and two AI-based software alternatives, but these differences were not clinically significant except for specific measurements. The semi-automatic option was more accurate than the automatic one and faster than conventional tracing. Further research is needed to confirm AI's accuracy in cephalometric tracing.

PD-L1 protein expression in breast cancer

AIMS

The immune checkpoint marker, Programmed cell death-ligand 1 (PD-L1), is expressed by both cancer epithelial cells and tumour-infiltrating immune cells (TICs) thus constituting a potential target for immunotherapy. This is of particular interest in triple negative breast cancer. In this study, we assessed the prognostic value of PD-L1 expression in tumour epithelial cells and TICs in a series of patients with breast cancer with long-term follow-up, and associations between PD-L1 expression and histopathological type and grade, proliferation and molecular subtype.

METHODS

Using immunohistochemistry for PD-L1 in tissue microarrays, we assessed PD-L1 expression in 821 tumours. Expression of PD-L1 was assessed separately in the epithelial and stromal compartments and classified as <1%, ≥1% to <10% or ≥10% positive staining cells. We correlated PD-L1 expression in tumour epithelial cells and TICs with tumour characteristics using Pearson's χ2 test, and prognosis by cumulative incidence of death from breast cancer and Cox regression analyses.

RESULTS

We found membranous staining in ≥1% of tumour epithelial cells in 53/821 cases (6.5%). Of these, 21 (2.6%) were ≥10%. Among TICs, staining (≥1%) was seen in 144/821 cases (17.6%). Of these, 62 were ≥10% (7.6%). PD-L1 was associated with high histopathological grade and proliferation, and the medullary and metaplastic patterns. In TICs, PD-L1 ≥1% found in 22/34 (34.4%) human epidermal growth factor receptor 2 type and 29/58 (50%) basal phenotype. An independent association between PD-L1 expression and prognosis was not observed.

CONCLUSIONS

PD-L1 is expressed more frequently in TICs than tumour epithelial cells. Expression in TICs is associated with aggressive tumour characteristics and non-luminal tumours but not with prognosis.

Challenges in Teledermoscopy Diagnostic Outcome Studies: Scoping Review of Heterogeneous Study Characteristics

BACKGROUND

Teledermoscopy has demonstrated benefits such as decreased costs and enhanced access to dermatology care for skin cancer detection. However, the heterogeneity among teledermoscopy studies hinders the systematic reviews' synopsis of diagnostic outcomes, impeding trust and adoption in general practice and limiting overall health care benefits.

OBJECTIVE

This study aims to improve understanding and standardization of teledermoscopy diagnostic studies, by identifying and categorizing study characteristics contributing to heterogeneity. Subsequently, the variability and consistency of these characteristics were assessed.

METHODS

A review of systematic reviews regarding the diagnostic outcomes of teledermoscopy was performed to discern reported study characteristics contributing to heterogeneity. These characteristics were thematically grouped into 3 domains (population, index test, and reference standard), forming a data extraction framework. A scoping review on teledermoscopy diagnostic outcomes studies was performed, guided by the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) checklist. Data pertaining to study characteristics from included studies were extracted and analyzed through descriptive content analysis. Systematic reviews' reference lists validated the scoping review query.

RESULTS

The literature search yielded 4 systematic reviews, revealing 15 heterogeneous studies across the population, index test, and reference standard domains. The scoping review identified 49 studies, with 27 overlapping with the systematic reviews. Population characteristics varied, with one-third (16/49, 33%) of studies reporting fewer than 100 samples; most studies (41/49, 84%) reported on the type of lesion, and most (20/49, 41%) teledermoscopy consultations took place in secondary care. One-fifth (11/49, 22%) did not describe inclusion or exclusion criteria, or the criteria varied highly. Index test characteristics showed differences in clinical expertise, profession, and training in dermatoscopic photography, and 59% (29/49) did not report on 1 or more index test characteristics. Image quality and clinical information reporting likewise varied. Reference standard characteristics involved teledermatologists' assessment, but 16 studies did not report teledermatologists' experience levels. Most studies (26/49, 53%) used histopathology as a gold standard.

CONCLUSIONS

The heterogeneity in the population, index tests, and reference standard domains across teledermoscopy diagnostic outcome studies underscores the need for standardized reporting. This hinders the synopsis of teledermoscopy diagnostic outcomes in systematic reviews and limits the integration of research results into practice. Adopting a (tailored) STARD (Standards for Reporting Diagnostic Accuracy Studies) checklist for teledermoscopy diagnostic outcome studies is recommended to enhance the consistency and comparability of outcomes. We suggest performing a Delphi study to gather consensus on the tailored STARD guideline.

Comparison of the sensitivity and specificity of commercial anti-dengue virus IgG tests to identify persons eligible for dengue vaccination

The Advisory Committee on Immunization Practices (ACIP) recommended that dengue pre-vaccination screening tests for Dengvaxia administration have at least 98% specificity and 75% sensitivity. This study evaluates the performance of commercial anti-DENV IgG tests to identify tests that could be used for pre-vaccination screening. First, for seven tests, we evaluated sensitivity and specificity in early convalescent dengue virus (DENV) infection, using 44 samples collected 7-30 days after symptom onset and confirmed by RT-PCR. Next, for the five best-performing tests and two additional tests (with and without an external test reader) that became available later, we evaluated performance to detect past dengue infection among a panel of 44 specimens collected in 2018-2019 from healthy 9- to 16-year-old children from Puerto Rico. Finally, a full-scale evaluation was done with the four best-performing tests using 400 specimens from the same population. We used virus focus reduction neutralization test and an in-house DENV IgG ELISA as reference standards. Of seven tests, five showed ≥75% sensitivity in detecting anti-DENV IgG in early convalescent specimens with low cross-reactivity to the Zika virus. For the detection of previous DENV infections, the tests with the highest performance were the Euroimmun NS1 IgG ELISA (sensitivity 84.5%, specificity 97.1%) and CTK Dengue IgG rapid test R0065C with the test reader (sensitivity 76.2% specificity 98.1%). There are IgG tests available that can be used to accurately classify individuals with previous DENV infection as eligible for dengue vaccination to support safe vaccine implementation.

IMPORTANCE

The Advisory Committee on Immunization Practices (ACIP) has set forth recommendations that dengue pre-vaccination screening tests must exhibit at least 98% specificity and 75% sensitivity. Our research rigorously assesses the performance of various commercial tests against these benchmarks using well-characterized specimens from Puerto Rico. The findings from our study are particularly relevant given FDA approval and ACIP recommendation of Sanofi Pasteur's Dengvaxia vaccine, highlighting the need for accurate pre-vaccination screening tools.

External Validation of the Recalibrated HEART Score for Evaluation of Possible Acute Coronary Syndrome

A single high-sensitivity troponin-T (hs-TnT) measurement may be sufficient to risk-stratify emergency department (ED) patients with possible acute coronary syndrome (ACS) using the recalibrated History, Electrocardiogram, Age, Risk Factors, Troponin (rHEART) score. We sought to validate this approach in a multiethnic population of United States patients and investigate gender-specific differences in performance. We conducted a secondary analysis of a prospective cohort study of adult ED patients with possible ACS at a single, urban, academic hospital. We investigated the diagnostic performance of rHEART for the incidence of type-1 acute myocardial infarction (AMI) and other major adverse cardiac events (MACE) at 30 days, using both single (19 ng/L) and gender-specific (14 ng/L for women, 22 ng/L for men) 99th percentile hs-TnT thresholds. The 821 patients included were 54% women, 57% Hispanic, and 26% Black. Overall, 4.6% of patients had MACE, including 2.4% with AMI. Single-threshold rHEART ≤3 had a sensitivity of 94.4% (95% confidence interval 81% to 99%) and negative predictive values of 99.3% (98% to 100%) for MACE; gender-specific thresholds performed nearly identically. Sensitivity and negative predictive values for AMI were 90.0% (67% to 98%) and 99.3% (97% to 100%). Excluding patients presenting <3 hours from symptom onset improved sensitivity for MACE and AMI to 97.0% (84% to 100%) and 94.1% (71% to 100%). Logistic regression demonstrated odds of MACE increased with higher rHEART scores at a similar rate for men and women. In conclusion, a single initial hs-TnT and rHEART score can be used to risk-stratify male and female ED patients with possible ACS, especially when drawn >3 hours after symptom onset.

Human Papillomaviruses 16 and 18 E6 Oncoprotein Detection Test in Primary Oropharyngeal Carcinomas and Metastatic Lymph Nodes: A Cross-Sectional Study

PURPOSE

Accuracy in the diagnosis of HPV-associated oropharyngeal carcinoma (OPSCC) of a rapid, low-cost lateral flow immunochromatographic assay for detecting E6 oncoprotein of HPV-16 and HPV-18 was previously evaluated in a small pilot study. This cross-sectional study aimed to assess on a large case series the sensitivity and specificity of E6 oncoprotein as a diagnostic marker for HPV-associated carcinogenesis in OPSCC.

METHODS

137 consecutive patients with histologically confirmed OPSCC were enrolled in two hospitals in Northeast Italy. HPV status was determined by PCR for HPV DNA and p16INK4a immunohistochemistry on primary tumor biopsies. An OPSCC was defined as HPV-associated when double positive for high-risk HPV-DNA and p16INK4a overexpression in primary lesion. Cytological samples from primary tumors and metastatic lymph nodes were obtained and tested for HPV16/18 E6 oncoproteins using the lateral flow immunochromatographic assay, which requires between 90 and 120 min to provide a result. Diagnostic performances were calculated as percentage with confidence intervals (CI).

RESULTS

Of the 137 OPSCC cases, 68 (49.6%) were HPV-associated, testing positive for both high-risk HPV-DNA and p16INK4a, with HPV16 predominating (82.4%). An average waiting time of 22 days was observed to obtain the results of p16INK4a and HPV-DNA after primary lesions biopsy. In patients with HPV16/18-associated OPSCC, the HPV16/18 E6 oncoprotein was detected in 59 out of 60 cytological samples from the primary lesion (sensitivity: 98.3%; 95% CI: 91.1-100%) and in 45 out of 51 cytological samples from lymph node metastases (sensitivity: 88.2%; 95% CI: 76.1-95.6%). The E6 oncoprotein assay showed a specificity of 100% in both primary tumors and lymph node metastases.

CONCLUSION

The low-cost lateral flow immunochromatographic assay for detecting HPV16/18 E6 oncoproteins confirmed high accuracy for identifying HPV-associated OPSCC, particularly in primary tumors, suggesting its potential as a valuable diagnostic tool in clinical practice. Its rapid diagnostic capability could significantly accelerate the process of treatment decision-making, enhancing the timely management of patients.

Psychometric Evaluation of Women's Knowledge of Healthcare Rights and Perception of Resource Scarcity during Maternity

Background/Objectives: Resources to cope with maternity and women's participation are essential modulators of maternal well-being. Therefore, it is relevant that the psychosocial factors of woman be monitored during maternity to promote adequate healthcare. This study involved the design and the validation of two new tools that identify women's knowledge of healthcare rights (MatCODE) and perception of resource scarcity (MatER) during pregnancy, labor and early postpartum; Methods: The content validity was carried out using the Aiken's V coefficient and the content validity index (CVI-i) based on five experts. In addition, for the face validity, the pilot cohort was considered the INFLESZ scale. Finally, the questionnaires were applied to 185 women, which allowed to assess the construct validation by factorial and Rasch analysis. The divergent validity was also studied with validated psychological questionnaires; Results: MatCODE and MatER questionnaires received CVI-i and Aiken's V > 0.80 values, and the INFLESZ demonstrated acceptable semantic understanding. The analysis confirms the unidimensionality of the questionnaires, with fit values for MatCODE of RMSEA = 0.113 [0.105; 0.122] and for MatER of RMSEA = 0.067 [0.063; 0.072]. The divergent validity showed significant and consistent correlations with the constructs assessed. For MatCODE, ω = 0.95 and α = 0.94, and for MatER, ω = 0.79 and α = 0.78; Conclusions: MatCODE and MatER are useful new tools for monitoring maternal healthcare, with adequate psychometric characteristics in the Spanish context.

Caries Detection and Classification in Photographs Using an Artificial Intelligence-Based Model-An External Validation Study

OBJECTIVE

This ex vivo diagnostic study aimed to externally validate a freely accessible AI-based model for caries detection, classification, localisation and segmentation using an independent image dataset. It was hypothesised that there would be no difference in diagnostic performance compared to previously published internal validation data.

METHODS

For the independent dataset, 718 dental images representing different stages of carious (n = 535) and noncarious teeth (n = 183) were retrieved from the internet. All photographs were evaluated by the dental team (reference standard) and the AI-based model (test method). Diagnostic performance was statistically determined using cross-tabulations to calculate accuracy (ACC), sensitivity (SE), specificity (SP) and area under the curve (AUC).

RESULTS

An overall ACC of 92.0% was achieved for caries detection, with an ACC of 85.5-95.6%, SE of 42.9-93.3%, SP of 82.1-99.4% and AUC of 0.702-0.909 for the classification of caries. Furthermore, 97.0% of the cases were accurately localised. Fully and partially correct segmentation was achieved in 52.9% and 44.1% of the cases, respectively.

CONCLUSIONS

The validated AI-based model showed promising diagnostic performance in detecting and classifying caries using an independent image dataset. Future studies are needed to investigate the validity, reliability and practicability of AI-based models using dental photographs from different image sources and/or patient groups.

Laboratory-based molecular test alternatives to RT-PCR for the diagnosis of SARS-CoV-2 infection

BACKGROUND

Diagnosing people with a SARS-CoV-2 infection played a critical role in managing the COVID-19 pandemic and remains a priority for the transition to long-term management of COVID-19. Initial shortages of extraction and reverse transcription polymerase chain reaction (RT-PCR) reagents impaired the desired upscaling of testing in many countries, which led to the search for alternatives to RNA extraction/purification and RT-PCR testing. Reference standard methods for diagnosing the presence of SARS-CoV-2 infection rely primarily on real-time reverse transcription-polymerase chain reaction (RT-PCR). Alternatives to RT-PCR could, if sufficiently accurate, have a positive impact by expanding the range of diagnostic tools available for the timely identification of people infected by SARS-CoV-2, access to testing and the use of resources.

OBJECTIVES

To assess the diagnostic accuracy of alternative (to RT-PCR assays) laboratory-based molecular tests for diagnosing SARS-CoV-2 infection.

SEARCH METHODS

We searched the COVID-19 Open Access Project living evidence database from the University of Bern until 30 September 2020 and the WHO COVID-19 Research Database until 31 October 2022. We did not apply language restrictions.

SELECTION CRITERIA

We included studies of people with suspected or known SARS-CoV-2 infection, or where tests were used to screen for infection, and studies evaluating commercially developed laboratory-based molecular tests for the diagnosis of SARS-CoV-2 infection considered as alternatives to RT-PCR testing. We also included all reference standards to define the presence or absence of SARS-CoV-2, including RT-PCR tests and established clinical diagnostic criteria.

DATA COLLECTION AND ANALYSIS

Two authors independently screened studies and resolved disagreements by discussing them with a third author. Two authors independently extracted data and assessed the risk of bias and applicability of the studies using the QUADAS-2 tool. We presented sensitivity and specificity, with 95% confidence intervals (CIs), for each test using paired forest plots and summarised results using average sensitivity and specificity using a bivariate random-effects meta-analysis. We illustrated the findings per index test category and assay brand compared to the WHO's acceptable sensitivity and specificity threshold for diagnosing SARS-CoV-2 infection using nucleic acid tests.

MAIN RESULTS

We included data from 64 studies reporting 94 cohorts of participants and 105 index test evaluations, with 74,753 samples and 7517 confirmed SARS-CoV-2 cases. We did not identify any published or preprint reports of accuracy for a considerable number of commercially produced NAAT assays. Most cohorts were judged at unclear or high risk of bias in more than three QUADAS-2 domains. Around half of the cohorts were considered at high risk of selection bias because of recruitment based on COVID status. Three quarters of 94 cohorts were at high risk of bias in the reference standard domain because of reliance on a single RT-PCR result to determine the absence of SARS-CoV-2 infection or were at unclear risk of bias due to a lack of clarity about the time interval between the index test assessment and the reference standard, the number of missing results, or the absence of a participant flow diagram. For index tests categories with four or more evaluations and when summary estimations were possible, we found that: a) For RT-PCR assays designed to omit/adapt RNA extraction/purification, the average sensitivity was 95.1% (95% CI 91.1% to 97.3%), and the average specificity was 99.7% (95% CI 98.5% to 99.9%; based on 27 evaluations, 2834 samples and 1178 SARS-CoV-2 cases); b) For RT-LAMP assays, the average sensitivity was 88.4% (95% CI 83.1% to 92.2%), and the average specificity was 99.7% (95% CI 98.7% to 99.9%; 24 evaluations, 29,496 samples and 2255 SARS-CoV-2 cases); c) for TMA assays, the average sensitivity was 97.6% (95% CI 95.2% to 98.8%), and the average specificity was 99.4% (95% CI 94.9% to 99.9%; 14 evaluations, 2196 samples and 942 SARS-CoV-2 cases); d) for digital PCR assays, the average sensitivity was 98.5% (95% CI 95.2% to 99.5%), and the average specificity was 91.4% (95% CI 60.4% to 98.7%; five evaluations, 703 samples and 354 SARS-CoV-2 cases); e) for RT-LAMP assays omitting/adapting RNA extraction, the average sensitivity was 73.1% (95% CI 58.4% to 84%), and the average specificity was 100% (95% CI 98% to 100%; 24 evaluations, 14,342 samples and 1502 SARS-CoV-2 cases). Only two index test categories fulfil the WHO-acceptable sensitivity and specificity requirements for SARS-CoV-2 nucleic acid tests: RT-PCR assays designed to omit/adapt RNA extraction/purification and TMA assays. In addition, WHO-acceptable performance criteria were met for two assays out of 35 when tests were used according to manufacturer instructions. At 5% prevalence using a cohort of 1000 people suspected of SARS-CoV-2 infection, the positive predictive value of RT-PCR assays omitting/adapting RNA extraction/purification will be 94%, with three in 51 positive results being false positives, and around two missed cases. For TMA assays, the positive predictive value of RT-PCR assays will be 89%, with 6 in 55 positive results being false positives, and around one missed case.

AUTHORS' CONCLUSIONS

Alternative laboratory-based molecular tests aim to enhance testing capacity in different ways, such as reducing the time, steps and resources needed to obtain valid results. Several index test technologies with these potential advantages have not been evaluated or have been assessed by only a few studies of limited methodological quality, so the performance of these kits was undetermined. Only two index test categories with enough evaluations for meta-analysis fulfil the WHO set of acceptable accuracy standards for SARS-CoV-2 nucleic acid tests: RT-PCR assays designed to omit/adapt RNA extraction/purification and TMA assays. These assays might prove to be suitable alternatives to RT-PCR for identifying people infected by SARS-CoV-2, especially when the alternative would be not having access to testing. However, these findings need to be interpreted and used with caution because of several limitations in the evidence, including reliance on retrospective samples without information about the symptom status of participants and the timing of assessment. No extrapolation of found accuracy data for these two alternatives to any test brands using the same techniques can be made as, for both groups, one test brand with high accuracy was overrepresented with 21/26 and 12/14 included studies, respectively. Although we used a comprehensive search and had broad eligibility criteria to include a wide range of tests that could be alternatives to RT-PCR methods, further research is needed to assess the performance of alternative COVID-19 tests and their role in pandemic management.

The diagnostic performance of neck ultrasound in follow-up of advanced stage differentiated thyroid cancer

BACKGROUND

Differentiated thyroid cancer (DTC) requires long-term follow-up due to the risk of delayed recurrence. Follow-up surveillance involves serial neck ultrasound (US) and thyroglobulin (Tg); however, the optimal frequency and diagnostic performance of neck US outside of specialized thyroid cancer centres in higher risk patients is not well defined. We sought to evaluate the diagnostic performance of US and serial Tg in advanced stage DTC.

METHODS

We retrospectively reviewed our thyroid cancer database for patients with stage III and IV DTC from 2006 to 2018, total thyroidectomy, and at least 2 years follow-up to assess recurrence rates. Those with hemi-thyroidectomy or anti-Tg antibodies were excluded. Diagnostic performance of US and Tg were assessed using a composite reference standard of follow-up imaging and pathology. All relevant US were reviewed by a blinded expert radiologist for uniformity.

RESULTS

Of 136 included patients (91 females, mean age 58.9), 26 (19%) had recurrence of DTC over median follow-up of 6.6 years (IQR 5.3-9.3). The sensitivity and specificity of US in diagnosing cervical recurrence were 73.3% (95% CI 0.51-0.96) and 68.3% (95% CI 0.60-0.77) based on historical reports, respectively, and 80% (95% CI 0.60-1.00) and 87.8% (95% CI 0.82-0.93) based on blinded expert review, respectively. Tg had a sensitivity of 95.5% (95% CI 0.89-1.0) and specificity of 96.2% (95% CI 0.92-0.99) in detecting cervical recurrence or distant metastases. False positive US findings on historical US and subsequent review occurred in 38 (28%) and 15 (11%) patients, respectively, while 5 (3.6%) had false positive Tg results.

CONCLUSION

Serial Tg has better sensitivity and specificity than US for detecting recurrence of advanced stage DTC. Furthermore, re-interpretation of abnormal findings using structured US reporting with a subspecialized reader may improve diagnostic performance of US and improve its utility in clinical care.