1
|
Manten K, Katzenschlager S, Brümmer LE, Schmitz S, Gaeddert M, Erdmann C, Grilli M, Pollock NR, Macé A, Erkosar B, Carmona S, Ongarello S, Johnson CC, Sacks JA, Faehling V, Bornemann L, Weigand MA, Denkinger CM, Yerlikaya S. Clinical accuracy of instrument-based SARS-CoV-2 antigen diagnostic tests: a systematic review and meta-analysis. Virol J 2024; 21:99. [PMID: 38685117 PMCID: PMC11059670 DOI: 10.1186/s12985-024-02371-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Accepted: 04/17/2024] [Indexed: 05/02/2024] Open
Abstract
BACKGROUND During the COVID-19 pandemic, antigen diagnostic tests were frequently used for screening, triage, and diagnosis. Novel instrument-based antigen tests (iAg tests) hold the promise of outperforming their instrument-free, visually-read counterparts. Here, we provide a systematic review and meta-analysis of the SARS-CoV-2 iAg tests' clinical accuracy. METHODS We systematically searched MEDLINE (via PubMed), Web of Science, medRxiv, and bioRxiv for articles published before November 7th, 2022, evaluating the accuracy of iAg tests for SARS-CoV-2 detection. We performed a random effects meta-analysis to estimate sensitivity and specificity and used the QUADAS-2 tool to assess study quality and risk of bias. Sub-group analysis was conducted based on Ct value range, IFU-conformity, age, symptom presence and duration, and the variant of concern. RESULTS We screened the titles and abstracts of 20,431 articles and included 114 publications that fulfilled the inclusion criteria. Additionally, we incorporated three articles sourced from the FIND website, totaling 117 studies encompassing 95,181 individuals, which evaluated the clinical accuracy of 24 commercial COVID-19 iAg tests. The studies varied in risk of bias but showed high applicability. Of 24 iAg tests from 99 studies assessed in the meta-analysis, the pooled sensitivity and specificity compared to molecular testing of a paired NP swab sample were 76.7% (95% CI 73.5 to 79.7) and 98.4% (95% CI 98.0 to 98.7), respectively. Higher sensitivity was noted in individuals with high viral load (99.6% [95% CI 96.8 to 100] at Ct-level ≤ 20) and within the first week of symptom onset (84.6% [95% CI 78.2 to 89.3]), but did not differ between tests conducted as per manufacturer's instructions and those conducted differently, or between point-of-care and lab-based testing. CONCLUSION Overall, iAg tests have a high pooled specificity but a moderate pooled sensitivity, according to our analysis. The pooled sensitivity increases with lower Ct-values (a proxy for viral load), or within the first week of symptom onset, enabling reliable identification of most COVID-19 cases and highlighting the importance of context in test selection. The study underscores the need for careful evaluation considering performance variations and operational features of iAg tests.
Collapse
|
2
|
Summan A, Nandi A, Wahl B, Carmona S, Ongarello S, Vetter B, Laxminarayan R. Estimates of hospitalisations and deaths in patients with COVID-19 associated with undiagnosed diabetes during the first phase of the pandemic in eight low-income and middle-income countries: a modelling study. EClinicalMedicine 2024; 70:102492. [PMID: 38481788 PMCID: PMC10933463 DOI: 10.1016/j.eclinm.2024.102492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/22/2023] [Revised: 01/31/2024] [Accepted: 02/01/2024] [Indexed: 11/02/2024] Open
Abstract
Background Patients with COVID-19 that had diagnosed chronic diseases - including diabetes - may experience higher rates of hospitalisation and mortality relative to the general population. However, the burden of undiagnosed co-morbidities during the pandemic has not been adequately studied. Methods We developed a model to estimate the hospitalisation and mortality burden of patients with COVID-19 that had undiagnosed type 1 and type 2 diabetes (UD). The retrospective analytical modelling framework was informed by country-level demographic, epidemiological and COVID-19 data and parameters. Eight low-and middle-income countries (LMICs) were studied: Brazil, China, India, Indonesia, Mexico, Nigeria, Pakistan, and South Africa. The modelling period consisted of the first phase of the pandemic - starting from the date when a country identified its first COVID case to the date when the country reached 1% coverage with one dose of a COVID-19 vaccine. The end date ranged from Jan 20, 2021 for China to June 2, 2021 for Nigeria. Additionally, we estimated the change in burden under a scenario in which all individuals with UD had been diagnosed prior to the pandemic. Findings Based on our modelling estimates, across the eight countries, 6.7 (95% uncertainty interval: 3.4-11.3) million COVID-19 hospitalised patients had UD of which 1.9 (0.9-3.4) million died. These represented 21.1% (13.4%-30.1%) of all COVID-19 hospitalisations and 30.5% (14.3%-55.5%) of all COVID-19 deaths in these countries. Based on modelling estimates, if these populations had been diagnosed for diabetes prior to the COVID-19 pandemic, 1.7% (-3.0% to 5.9%) of COVID-19 hospitalisations and 5.0% (-0.9% to 14.1%) of COVID-19 deaths could have been prevented, and 1.8 (-0.3 to 5.0) million quality-adjusted life years gained. Interpretation Our findings suggest that undiagnosed diabetes contributed substantially to COVID-19 hospitalisations and deaths in many LMICs. Funding This work was supported, in part, by the Bill & Melinda Gates Foundation [INV-029062] and FIND.
Collapse
|
3
|
Dhawan S, Dittrich S, Arafah S, Ongarello S, Mace A, Panapruksachat S, Boutthasavong L, Adsamouth A, Thongpaseuth S, Davong V, Vongsouvath M, Ashley EA, Robinson MT, Blacksell SD. Diagnostic accuracy of DPP Fever Panel II Asia tests for tropical fever diagnosis. PLoS Negl Trop Dis 2024; 18:e0012077. [PMID: 38598549 PMCID: PMC11034646 DOI: 10.1371/journal.pntd.0012077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 04/22/2024] [Accepted: 03/18/2024] [Indexed: 04/12/2024] Open
Abstract
BACKGROUND Fever is the most frequent symptom in patients seeking care in South and Southeast Asia. The introduction of rapid diagnostic tests (RDTs) for malaria continues to drive patient management and care. Malaria-negative cases are commonly treated with antibiotics without confirmation of bacteraemia. Conventional laboratory tests for differential diagnosis require skilled staff and appropriate access to healthcare facilities. In addition, introducing single-disease RDTs instead of conventional laboratory tests remains costly. To overcome some of the delivery challenges of multiple separate tests, a multiplexed RDT with the capacity to diagnose a diverse range of tropical fevers would be a cost-effective solution. In this study, a multiplex lateral flow immunoassay (DPP Fever Panel II Assay) that can detect serum immunoglobulin M (IgM) and specific microbial antigens of common fever agents in Asia (Orientia tsutsugamushi, Rickettsia typhi, Leptospira spp., Burkholderia pseudomallei, Dengue virus, Chikungunya virus, and Zika virus), was evaluated. METHODOLOGY/PRINCIPAL FINDINGS Whole blood (WB) and serum samples from 300 patients with undefined febrile illness (UFI) recruited in Vientiane, Laos PDR were tested using the DPP Fever Panel II, which consists of an Antibody panel and Antigen panel. To compare reader performance, results were recorded using two DPP readers, DPP Micro Reader (Micro Reader 1) and DPP Micro Reader Next Generation (Micro Reader 2). WB and serum samples were run on the same fever panel and read on both micro readers in order to compare results. ROC analysis and equal variance analysis were performed to inform the diagnostic validity of the test compared against the respective reference standards of each fever agent (S1 Table). Overall better AUC values were observed in whole blood results. No significant difference in AUC performance was observed when comparing whole blood and serum sample testing, except for when testing for R. typhi IgM (p = 0.04), Leptospira IgM (p = 0.02), and Dengue IgG (p = 0.03). Linear regression depicted R2 values had ~70% agreement across WB and serum samples, except when testing for leptospirosis and Zika, where the R2 values were 0.37 and 0.47, respectively. No significant difference was observed between the performance of Micro Reader 1 and Micro Reader 2, except when testing for the following pathogens: Zika IgM, Zika IgG, and B pseudomallei CPS Ag. CONCLUSIONS/SIGNIFICANCE These results demonstrate that the diagnostic accuracy of the DPP Fever Panel II is comparable to that of commonly used RDTs. The optimal cut-off would depend on the use of the test and the desired sensitivity and specificity. Further studies are required to authenticate the use of these cut-offs in other endemic regions. This multiplex RDT offers diagnostic benefits in areas with limited access to healthcare and has the potential to improve field testing capacities. This could improve tropical fever management and reduce the public health burden in endemic low-resource areas.
Collapse
|
4
|
Batheja D, Goel S, Fransman W, Mantsoki A, Ongarello S, Laxminarayan R. Understanding the value of biobank attributes to researchers using a conjoint experiment. Sci Rep 2023; 13:22728. [PMID: 38123601 PMCID: PMC10733358 DOI: 10.1038/s41598-023-49394-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 12/07/2023] [Indexed: 12/23/2023] Open
Abstract
Biobanks are important in biomedical and public health research, and future healthcare research relies on their strength and capacity. However, there are financial challenges related to the operation of commercial biobanks and concerns around the commercialization of biobanks. Non-commercial biobanks depend on grant funding to operate and could be valuable to researchers if they can enable access to quality specimens at lower costs. The objective of this study is to estimate the value of specific biobank attributes. We used a rating-based conjoint experiment approach to study how researchers valued handling fee, access, quality, characterization, breadth of consent, access to key endemics, and time taken to fulfil requests. We found that researchers placed the greatest relative importance on the quality of specimens (26%), followed by the characterization of specimens (21%). Researchers with prior experience purchasing biological samples also valued access to key endemic in-country sites (11.6%) and low handling fees (5.5%) in biobanks.
Collapse
|
5
|
Katzenschlager S, Brümmer LE, Schmitz S, Tolle H, Manten K, Gaeddert M, Erdmann C, Lindner A, Tobian F, Grilli M, Pollock NR, Macé A, Erkosar B, Carmona S, Ongarello S, Johnson CC, Sacks JA, Denkinger CM, Yerlikaya S. Comparing SARS-CoV-2 antigen-detection rapid diagnostic tests for COVID-19 self-testing/self-sampling with molecular and professional-use tests: a systematic review and meta-analysis. Sci Rep 2023; 13:21913. [PMID: 38081881 PMCID: PMC10713601 DOI: 10.1038/s41598-023-48892-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Accepted: 11/30/2023] [Indexed: 12/18/2023] Open
Abstract
Self-testing is an effective tool to bridge the testing gap for several infectious diseases; however, its performance in detecting SARS-CoV-2 using antigen-detection rapid diagnostic tests (Ag-RDTs) has not been systematically reviewed. This study aimed to inform WHO guidelines by evaluating the accuracy of COVID-19 self-testing and self-sampling coupled with professional Ag-RDT conduct and interpretation. Articles on this topic were searched until November 7th, 2022. Concordance between self-testing/self-sampling and fully professional-use Ag-RDTs was assessed using Cohen's kappa. Bivariate meta-analysis yielded pooled performance estimates. Quality and certainty of evidence were evaluated using QUADAS-2 and GRADE tools. Among 43 studies included, twelve reported on self-testing, and 31 assessed self-sampling only. Around 49.6% showed low risk of bias. Overall concordance with professional-use Ag-RDTs was high (kappa 0.91 [95% confidence interval (CI) 0.88-0.94]). Comparing self-testing/self-sampling to molecular testing, the pooled sensitivity and specificity were 70.5% (95% CI 64.3-76.0) and 99.4% (95% CI 99.1-99.6), respectively. Higher sensitivity (i.e., 93.6% [95% CI 90.4-96.8] for Ct < 25) was estimated in subgroups with higher viral loads using Ct values as a proxy. Despite high heterogeneity among studies, COVID-19 self-testing/self-sampling exhibits high concordance with professional-use Ag-RDTs. This suggests that self-testing/self-sampling can be offered as part of COVID-19 testing strategies.Trial registration: PROSPERO: CRD42021250706.
Collapse
|
6
|
Koeppel L, Denkinger CM, Wyss R, Broger T, Chegou NN, Dunty JM, Scott K, Cáceres T, Dutoit E, Ugarte-Gil C, Nicol M, Gotuzzo E, Corstjens PLAM, Geluk A, Sutherland J, Sigal GB, Moreau E, Albertini A, Mantsoki A, Ongarello S, Walzl G, Fernandez Suarez M. Diagnostic performance of host protein signatures as a triage test for active pulmonary TB. J Clin Microbiol 2023; 61:e0026423. [PMID: 37724874 PMCID: PMC10654108 DOI: 10.1128/jcm.00264-23] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Accepted: 07/14/2023] [Indexed: 09/21/2023] Open
Abstract
The current four-symptom screen recommended by the World Health Organization (WHO) is widely used as screen to initiate diagnostic testing for active pulmonary tuberculosis (TB), yet the performance is poor especially when TB prevalence is low. In contrast, more sensitive molecular tests are less suitable for placement at primary care level in low-resource settings. In order to meet the WHO End TB targets, new diagnostic approaches are urgently needed to find the missing undiagnosed cases. Proteomics-derived blood host biomarkers have been explored because protein detection technologies are suitable for the point-of-care setting and could meet cost targets. This study aimed to find a biomarker signature that fulfills WHO's target product profile (TPP) for a TB screening. Twelve blood-based protein biomarkers from three sample populations (Vietnam, Peru, and South Africa) were analyzed individually and in combinations via advanced statistical methods and machine learning algorithms. The combination of I-309, SYWC and kallistatin showed the most promising results to discern active TB throughout the data sets meeting the TPP for a triage test in adults from two countries (Peru and South Africa). The top-performing individual markers identified at the global level (I-309 and SYWC) were also among the best-performing markers at country level in South Africa and Vietnam. This analysis clearly shows that a host protein biomarker assay is feasible in adults for certain geographical regions based on one or two biomarkers with a performance that meets minimal WHO TPP criteria.
Collapse
|
7
|
Ongarello S, Bausch DG, Hannay E, Bright RA. Current testing systems are a barrier to achieving the 7-1-7 target for detection, notification, and response to public health threats. Lancet Glob Health 2023; 11:e1340. [PMID: 37591580 DOI: 10.1016/s2214-109x(23)00306-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 06/21/2023] [Indexed: 08/19/2023]
|
8
|
Olliaro P, Nkeramahame J, Horgan P, Tinto H, Kiemde F, Baiden R, Adjei A, Kapisi J, Hopkins H, Salami O, Moore CE, Dittrich S, Weber S, Ongarello S. Synthesis and Meta-analysis of 3 Randomized Trials Conducted in Burkina Faso, Ghana, and Uganda Comparing the Effects of Point-of-Care Tests and Diagnostic Algorithms Versus Routine Care on Antibiotic Prescriptions and Clinical Outcomes in Ambulatory Patients <18 Years of Age With Acute Febrile Illness. Clin Infect Dis 2023; 77:S199-S205. [PMID: 37490743 PMCID: PMC10368413 DOI: 10.1093/cid/ciad324] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Indexed: 07/27/2023] Open
Abstract
This meta-analysis included 3 randomized trials conducted in sub-Saharan Africa comparing the effects of point-of-care tests and diagnostic algorithms versus routine care on antibiotic prescriptions and clinical outcomes in ambulatory patients presenting at outpatient facilities with acute uncomplicated febrile illness.
Collapse
|
9
|
Gelaw SM, Kik SV, Ruhwald M, Ongarello S, Egzertegegne TS, Gorbacheva O, Gilpin C, Marano N, Lee S, Phares CR, Medina V, Amatya B, Denkinger CM. Diagnostic accuracy of three computer-aided detection systems for detecting pulmonary tuberculosis on chest radiography when used for screening: Analysis of an international, multicenter migrants screening study. PLOS GLOBAL PUBLIC HEALTH 2023; 3:e0000402. [PMID: 37450425 PMCID: PMC10348531 DOI: 10.1371/journal.pgph.0000402] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Accepted: 06/04/2023] [Indexed: 07/18/2023]
Abstract
The aim of this study was to independently evaluate the diagnostic accuracy of three artificial intelligence (AI)-based computer aided detection (CAD) systems for detecting pulmonary tuberculosis (TB) on global migrants screening chest x-ray (CXR) cases when compared against both microbiological and radiological reference standards (MRS and RadRS, respectively). Retrospective clinical data and CXR images were collected from the International Organization for Migration (IOM) pre-migration health assessment TB screening global database for US-bound migrants. A total of 2,812 participants were included in the dataset used for analysis against RadRS, of which 1,769 (62.9%) had accompanying microbiological test results and were included against MRS. All CXRs were interpreted by three CAD systems (CAD4TB v6, Lunit INSIGHT v4.9.0, and qXR v2) in offline setting, and re-interpreted by two expert radiologists in a blinded fashion. The performance was evaluated using receiver operating characteristics curve (ROC), estimates of sensitivity and specificity at different CAD thresholds against both microbiological and radiological reference standards (MRS and RadRS, respectively), and was compared with that of the expert radiologists. The area under the curve against MRS was highest for Lunit (0.85; 95% CI 0.83-0.87), followed by qXR (0.75; 95% CI 0.72-0.77) and then CAD4TB (0.71; 95% CI 0.68-0.73). At a set specificity of 70%, Lunit had the highest sensitivity (81.4%; 95% CI 77.9-84.6); at a set sensitivity of 90%, specificity was also highest for Lunit (54.5%; 95% CI 51.7-57.3). The CAD systems performed comparable to the sensitivity (98.3%), and except CAD4TB, to specificity (13.7%) of the expert radiologists. Similar trends were observed when using RadRS. Area under the curve against RadRS was highest for CAD4TB (0.87; 95% CI 0.86-0.89) and Lunit (0.87; 95% CI 0.85-0.88) followed by qXR (0.81; 95% CI 0.80-0.83). At a set specificity of 70%, CAD4TB had highest sensitivity (84.1%; 95% CI 82.3-85.8) followed by Lunit (80.9%; 95% CI 78.9-82.7); and at a set sensitivity of 90%, specificity was also highest for CAD4TB (54.6%; 95% CI 51.3-57.8). In conclusion, the study demonstrated that the three CAD systems had broadly similar diagnostic accuracy with regard to TB screening and comparable accuracy to an expert radiologist against MRS. Compared with different reference standards, Lunit performed better than both qXR and CAD4TB against MRS, and CAD4TB and Lunit better than qXR against RadRS. Moreover, the performance of the CADs can be impacted by characteristics of subgroup of population. The main limitation was that our study relied on retrospective data and MRS was not routinely done in individuals with a low suspicion of TB and a normal CXR. Our findings suggest that CAD systems could be a useful tool for TB screening programs in remote, high TB prevalent places where access to expert radiologists may be limited. However, further large-scale prospective studies are needed to address outstanding questions around the operational performance and technical requirements of the CAD systems.
Collapse
|
10
|
Koeppel L, Dittrich S, Brenner Miguel S, Carmona S, Ongarello S, Vetter B, Cohn JE, Baernighausen T, Geldsetzer P, Denkinger CM. Addressing the diagnostic gap in hypertension through possible interventions and scale-up: A microsimulation study. PLoS Med 2022; 19:e1004111. [PMID: 36472973 PMCID: PMC9725126 DOI: 10.1371/journal.pmed.1004111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Accepted: 09/15/2022] [Indexed: 12/12/2022] Open
Abstract
BACKGROUND Cardiovascular diseases (CVDs) are the leading cause of mortality globally with almost a third of all annual deaths worldwide. Low- and middle-income countries (LMICs) are disproportionately highly affected covering 80% of these deaths. For CVD, hypertension (HTN) is the leading modifiable risk factor. The comparative impact of diagnostic interventions that improve either the accuracy, the reach, or the completion of HTN screening in comparison to the current standard of care has not been estimated. METHODS AND FINDINGS This microsimulation study estimated the impact on HTN-induced morbidity and mortality in LMICs for four different scenarios: (S1) lower HTN diagnostic accuracy; (S2) improved HTN diagnostic accuracy; (S3) better implementation strategies to reach more persons with existing tools; and, lastly, (S4) the wider use of easy-to-use tools, such as validated, automated digital blood pressure measurement devices to enhance screening completion, in comparison to the current standard of care (S0). Our hypothetical population was parametrized using nationally representative, individual-level HPACC data and the global burden of disease data. The prevalence of HTN in the population was 31% out of which 60% remained undiagnosed. We investigated how the alteration of a yearly blood pressure screening event impacts morbidity and mortality in the population over a period of 10 years. The study showed that while improving test accuracy avoids 0.6% of HTN-induced deaths over 10 years (13,856,507 [9,382,742; 17,395,833]), almost 40 million (39,650,363 [31,34,233, 49,298,921], i.e., 12.7% [9.9, 15.8]) of the HTN-induced deaths could be prevented by increasing coverage and completion of a screening event in the same time frame. Doubling the coverage only would still prevent 3,304,212 million ([2,274,664; 4,164,180], 12.1% [8.3, 15.2]) CVD events 10 years after the rollout of the program. Our study is limited by the scarce data available on HTN and CVD from LMICs. We had to pool some parameters across stratification groups, and additional information, such as dietary habits, lifestyle choice, or the blood pressure evolution, could not be considered. Nevertheless, the microsimulation enabled us to include substantial heterogeneity and stochasticity toward the different income groups and personal CVD risk scores in the model. CONCLUSIONS While it is important to consider investing in newer diagnostics for blood pressure testing to continuously improve ease of use and accuracy, more emphasis should be placed on screening completion.
Collapse
|
11
|
Krüger LJ, Lindner AK, Gaeddert M, Tobian F, Klein J, Steinke S, Lainati F, Schnitzler P, Nikolai O, Mockenhaupt FP, Seybold J, Corman VM, Jones TC, Pollock NR, Knorr B, Welker A, Weber S, Sethurarnan N, Swaminathan J, Solomon H, Padmanaban A, Thirunarayan M, L P, de Vos M, Ongarello S, Sacks JA, Escadafal C, Denkinger CM. A Multicenter Clinical Diagnostic Accuracy Study of SureStatus, an Affordable, WHO Emergency Use-Listed, Rapid, Point-Of-Care Antigen-Detecting Diagnostic Test for SARS-CoV-2. Microbiol Spectr 2022; 10:e0122922. [PMID: 36066256 PMCID: PMC9604065 DOI: 10.1128/spectrum.01229-22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Accepted: 08/04/2022] [Indexed: 12/30/2022] Open
Abstract
Access to reverse transcription-PCR (RT-PCR) testing, the gold standard for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) detection, is limited throughout the world, due to restricted resources, available infrastructure, and high costs. Antigen-detecting rapid diagnostic tests (Ag-RDTs) overcome some of these barriers, but independent clinical validations in settings of intended use are scarce. To inform the World Health Organization's (WHO) emergency use listing (EUL) procedure and ensure affordable, high-quality Ag-RDTs, we assessed the performance and ease of use of the SureStatus for SARS-CoV-2. For this prospective, multicenter diagnostic accuracy study, we recruited unvaccinated participants with presumed SARS-CoV-2 infection in India and Germany from December 2020 to March 2021, when the Alpha (B.1.1.7) variant was predominantly circulating. Paired swabs were performed for (i) routine clinical RT-PCR testing (sampling was either nasopharyngeal [NP] or combined NP and oropharyngeal [NP/OP]) and (ii) Ag-RDT (sampling was NP). Performance of the Ag-RDT was compared to RT-PCR overall and by predefined subgroups, e.g., cycle threshold (CT) value, symptoms, and days from symptom onset. To understand the usability, a system usability scale (SUS) questionnaire and ease-of-use (EoU) assessment were performed. A total of 1,119 participants were included in the analysis, of whom 205 (18.3%) were RT-PCR positive. SureStatus detected 169 out of 205 RT-PCR-positive participants, reporting a sensitivity of 82.4% (95% confidence interval [CI]: 76.6% to 87.1%) and a specificity of 98.5% (95% CI: 97.4% to 99.1%). In the first 7 days post-symptom onset, the sensitivity was 90.7% (95% CI: 83.5% to 94.9%), when CT values were low and viral loads were high. The test was characterized as easy to use (SUS, 85/100) and considered suitable for point-of-care settings, although quality concerns were raised due to visibly contaminated packaging of swabs included in the test kits. The SureStatus diagnostic test can be considered a reliable test during the first week of SARS-CoV-2 infection, with high sensitivity in combination with excellent usability. IMPORTANCE Our manufacturer-independent, prospective diagnostic accuracy study assessed clinical performance in participants presumed to have a SARS-CoV-2 infection at three study sites in two countries. We assessed the accuracy overall and in predefined subgroups (CT values and symptom duration). SureStatus performed with high sensitivity. Its sensitivity was particularly high in the first 3 days after symptom onset and when CT values were low (i.e., the viral load was high). The system usability and ease-of-use assessment complements the accuracy assessment of the test and highlights critical factors to facilitate the widespread use of SureStatus in point-of-care settings. The high sensitivity demonstrated by the evaluated Ag-RDT within the first days of symptoms, when most transmission occurs, supports the role of Ag-RDTs for public health-relevant screening. Evidence from this study was used to inform the World Health Organization Emergency Use Listing procedure.
Collapse
|
12
|
Shilton S, Stvilia K, Japaridze M, Tsereteli N, Usharidze D, Phevadze S, Jghenti M, Mozalevskis A, Markby J, Luhmann N, Johnson C, Nabeta P, Ongarello S, Reipold EI, Gamkrelidze A. Home-based hepatitis C self-testing in people who inject drugs and men who have sex with men in Georgia: a protocol for a randomised controlled trial. BMJ Open 2022; 12:e056243. [PMID: 36691209 PMCID: PMC9462102 DOI: 10.1136/bmjopen-2021-056243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/09/2021] [Accepted: 08/11/2022] [Indexed: 01/26/2023] Open
Abstract
INTRODUCTION Globally, it is estimated that more than three-quarters of people with chronic hepatitis C virus (HCV) are unaware of their HCV status. HCV self-testing (HCVST) may improve access and uptake of HCV testing particularly among key populations such as people who inject drugs (PWID) and men who have sex with men (MSM) where HCV prevalence and incidence are high and barriers to accessing health services due to stigma and discrimination are common. METHODS AND ANALYSIS This randomised controlled trial compares an online programme offering oral fluid-based HCVST delivered to the home with referral to standard-of-care HCV testing at HCV testing sites. Eligible participants are adults self-identifying as either MSM or PWID who live in Tbilisi or Batumi, Georgia, and whose current HCV status is unknown. Participants will be recruited through an online platform and randomised to one of three arms for MSM (courier delivery, peer delivery and standard-of-care HCV testing (control)) and two for PWID (peer delivery and standard-of-care HCV testing (control)). Participants in the postal delivery group will receive an HCVST kit delivered by an anonymised courier. Participants in the peer delivery groups will schedule delivery of the HCVST by a peer. Control groups will receive information on how to access standard-of-care testing at a testing site. The primary outcome is the number and proportion of participants who report completion of testing. Secondary outcomes include the number and proportion of participants who (a) receive a positive result and are made aware of their status, (b) are referred to and complete HCV RNA confirmatory testing, and (c) start treatment. Acceptability, feasibility, and attitudes around HCV testing and cost will also be evaluated. The target sample size is 1250 participants (250 per arm). ETHICS AND DISSEMINATION Ethical approval has been obtained from the National Centers for Disease Control and Public Health Georgia Institutional Review Board (IRB) (IRB# 2021-049). Study results will be disseminated by presentations at conferences and via peer-reviewed journals. Protocol version 1.1; 14 July 2021. TRIAL REGISTRATION NUMBER ClinicalTrials.gov Registry (NCT04961723).
Collapse
|
13
|
Kumar CK, Balasubramanian R, Ongarello S, Carmona S, Laxminarayan R. SARS-CoV-2 testing strategies for outbreak mitigation in vaccinated populations. PLoS One 2022; 17:e0271103. [PMID: 35830457 PMCID: PMC9278727 DOI: 10.1371/journal.pone.0271103] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2022] [Accepted: 06/24/2022] [Indexed: 11/21/2022] Open
Abstract
Although COVID-19 vaccines are globally available, waning immunity and emerging vaccine-evasive variants of concern have hindered the international response and transition to a post-pandemic era. Testing to identify and isolate infectious individuals remains the most proactive strategy for containing an ongoing COVID-19 outbreak. We developed a stochastic, compartmentalized model to simulate the impact of using Reverse Transcriptase Polymerase Chain Reaction (RT-PCR) assays, rapid antigen tests, and vaccinations on SARS-CoV-2 spread. We compare testing strategies across an example high-income country (the United States) and low- and middle-income country (India). We detail the optimal testing frequency and coverage in the US and India to mitigate an emerging outbreak even in a vaccinated population: overall, maximizing testing frequency is most important, but having high testing coverage remains necessary when there is sustained transmission. A resource-limited vaccination strategy still requires high-frequency testing to minimize subsequent outbreaks and is 16.50% more effective in reducing cases in India than the United States. Tailoring testing strategies to transmission settings can help effectively reduce disease burden more than if a uniform approach were employed without regard to epidemiological variability across locations.
Collapse
|
14
|
Brümmer LE, Katzenschlager S, McGrath S, Schmitz S, Gaeddert M, Erdmann C, Bota M, Grilli M, Larmann J, Weigand MA, Pollock NR, Macé A, Erkosar B, Carmona S, Sacks JA, Ongarello S, Denkinger CM. Accuracy of rapid point-of-care antigen-based diagnostics for SARS-CoV-2: An updated systematic review and meta-analysis with meta-regression analyzing influencing factors. PLoS Med 2022; 19:e1004011. [PMID: 35617375 PMCID: PMC9187092 DOI: 10.1371/journal.pmed.1004011] [Citation(s) in RCA: 41] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/09/2022] [Revised: 06/10/2022] [Accepted: 05/04/2022] [Indexed: 12/22/2022] Open
Abstract
BACKGROUND Comprehensive information about the accuracy of antigen rapid diagnostic tests (Ag-RDTs) for Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) is essential to guide public health decision makers in choosing the best tests and testing policies. In August 2021, we published a systematic review and meta-analysis about the accuracy of Ag-RDTs. We now update this work and analyze the factors influencing test sensitivity in further detail. METHODS AND FINDINGS We registered the review on PROSPERO (registration number: CRD42020225140). We systematically searched preprint and peer-reviewed databases for publications evaluating the accuracy of Ag-RDTs for SARS-CoV-2 until August 31, 2021. Descriptive analyses of all studies were performed, and when more than 4 studies were available, a random-effects meta-analysis was used to estimate pooled sensitivity and specificity with reverse transcription polymerase chain reaction (RT-PCR) testing as a reference. To evaluate factors influencing test sensitivity, we performed 3 different analyses using multivariable mixed-effects meta-regression models. We included 194 studies with 221,878 Ag-RDTs performed. Overall, the pooled estimates of Ag-RDT sensitivity and specificity were 72.0% (95% confidence interval [CI] 69.8 to 74.2) and 98.9% (95% CI 98.6 to 99.1). When manufacturer instructions were followed, sensitivity increased to 76.3% (95% CI 73.7 to 78.7). Sensitivity was markedly better on samples with lower RT-PCR cycle threshold (Ct) values (97.9% [95% CI 96.9 to 98.9] and 90.6% [95% CI 88.3 to 93.0] for Ct-values <20 and <25, compared to 54.4% [95% CI 47.3 to 61.5] and 18.7% [95% CI 13.9 to 23.4] for Ct-values ≥25 and ≥30) and was estimated to increase by 2.9 percentage points (95% CI 1.7 to 4.0) for every unit decrease in mean Ct-value when adjusting for testing procedure and patients' symptom status. Concordantly, we found the mean Ct-value to be lower for true positive (22.2 [95% CI 21.5 to 22.8]) compared to false negative (30.4 [95% CI 29.7 to 31.1]) results. Testing in the first week from symptom onset resulted in substantially higher sensitivity (81.9% [95% CI 77.7 to 85.5]) compared to testing after 1 week (51.8%, 95% CI 41.5 to 61.9). Similarly, sensitivity was higher in symptomatic (76.2% [95% CI 73.3 to 78.9]) compared to asymptomatic (56.8% [95% CI 50.9 to 62.4]) persons. However, both effects were mainly driven by the Ct-value of the sample. With regards to sample type, highest sensitivity was found for nasopharyngeal (NP) and combined NP/oropharyngeal samples (70.8% [95% CI 68.3 to 73.2]), as well as in anterior nasal/mid-turbinate samples (77.3% [95% CI 73.0 to 81.0]). Our analysis was limited by the included studies' heterogeneity in viral load assessment and sample origination. CONCLUSIONS Ag-RDTs detect most of the individuals infected with SARS-CoV-2, and almost all (>90%) when high viral loads are present. With viral load, as estimated by Ct-value, being the most influential factor on their sensitivity, they are especially useful to detect persons with high viral load who are most likely to transmit the virus. To further quantify the effects of other factors influencing test sensitivity, standardization of clinical accuracy studies and access to patient level Ct-values and duration of symptoms are needed.
Collapse
|
15
|
Shilton S, Ali D, Hasnain A, Abid A, Markby J, Jamil MS, Luhmann N, Nabeta P, Ongarello S, Reipold EI, Hamid S. Protocol for a cluster randomised controlled trial of secondary distribution of hepatitis C self-testing within the context of a house-to-house hepatitis C micro-elimination programme in Karachi, Pakistan. BMC Public Health 2022; 22:696. [PMID: 35397544 PMCID: PMC8994067 DOI: 10.1186/s12889-022-13125-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2021] [Accepted: 03/31/2022] [Indexed: 01/27/2023] Open
Abstract
Background Globally, just 21% of the estimated 58 million people living with hepatitis C virus (HCV) know their status. Thus, there is considerable need to scale-up HCV testing if the World Health Organization (WHO) 2030 hepatitis elimination goals are to be achieved. HCV self-testing may assist with this; however, there are currently no data on the real-world impact of HCV self-testing. With an estimated 5% of the general population living with HCV, Pakistan has the second highest HCV burden in the world. This study aims to evaluate the acceptability and impact of home delivery of HCV self-testing for secondary distribution in the context of a house-to-house HCV micro-elimination programme in Pakistan. Methods This is a parallel group, non-blinded, cluster randomised trial comparing secondary distribution of HCV self-testing with secondary distribution of information pamphlets encouraging individuals to visit a testing facility for HCV screening. The cluster allocation ratio is 1:1. Clusters will be randomised either to HCV self-testing distributed via study staff or control clusters where information on HCV will be given and the participant will be requested to attend their local hospital for HCV screening. In both clusters, only households with a member who has not yet been screened as part of the larger micro-elimination project will be included. The primary outcome is the number and proportion of participants who report completion of testing. Secondary outcomes include the number and proportion of participants who a) receive a positive result and are made aware of their status, b) are referred to and complete HCV RNA confirmatory testing, and c) start treatment. Acceptability, feasibility, attitudes towards HCV testing, and cost will also be evaluated. The target sample size is 2,000 participants. Discussion This study will provide the first ever evidence regarding secondary distribution of HCV self-testing. By comparing HCV self-testing with facility-based testing, we will assess whether HCV self-testing increases the uptake of HCV testing. The findings will inform micro-elimination programmes and determine whether HCV self-testing can enable individuals to be reached who may otherwise be missed. Trial Registration This study and was registered on clinicaltrials.gov (NCT04971538) 21 July 2021. Supplementary Information The online version contains supplementary material available at 10.1186/s12889-022-13125-9.
Collapse
|
16
|
Ley B, Winasti Satyagraha A, Kibria MG, Armstrong J, Bancone G, Bei AK, Bizilj G, Brito M, Ding XC, Domingo GJ, von Fricken ME, Gornsawun G, Lam B, Menard D, Monteiro W, Ongarello S, Pal S, Panggalo LV, Parikh S, Pfeffer DA, Price RN, da Silva Orfano A, Wade M, Wojnarski M, Worachet K, Yar A, Alam MS, Howes RE. Repeatability and reproducibility of a handheld quantitative G6PD diagnostic. PLoS Negl Trop Dis 2022; 16:e0010174. [PMID: 35176015 PMCID: PMC8853557 DOI: 10.1371/journal.pntd.0010174] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2021] [Accepted: 01/17/2022] [Indexed: 01/12/2023] Open
Abstract
BACKGROUND The introduction of novel short course treatment regimens for the radical cure of Plasmodium vivax requires reliable point-of-care diagnosis that can identify glucose-6-phosphate dehydrogenase (G6PD) deficient individuals. While deficient males can be identified using a qualitative diagnostic test, the genetic make-up of females requires a quantitative measurement. SD Biosensor (Republic of Korea) has developed a handheld quantitative G6PD diagnostic (STANDARD G6PD test), that has approximately 90% accuracy in field studies for identifying individuals with intermediate or severe deficiency. The device can only be considered for routine care if precision of the assay is high. METHODS AND FINDINGS Commercial lyophilised controls (ACS Analytics, USA) with high, intermediate, and low G6PD activities were assessed 20 times on 10 Biosensor devices and compared to spectrophotometry (Pointe Scientific, USA). Each device was then dispatched to one of 10 different laboratories with a standard set of the controls. Each control was tested 40 times at each laboratory by a single user and compared to spectrophotometry results. When tested at one site, the mean coefficient of variation (CV) was 0.111, 0.172 and 0.260 for high, intermediate, and low controls across all devices respectively; combined G6PD Biosensor readings correlated well with spectrophotometry (rs = 0.859, p<0.001). When tested in different laboratories, correlation was lower (rs = 0.604, p<0.001) and G6PD activity determined by Biosensor for the low and intermediate controls overlapped. The use of lyophilised human blood samples rather than fresh blood may have affected these findings. Biosensor G6PD readings between sites did not differ significantly (p = 0.436), whereas spectrophotometry readings differed markedly between sites (p<0.001). CONCLUSIONS Repeatability and inter-laboratory reproducibility of the Biosensor were good; though the device did not reliably discriminate between intermediate and low G6PD activities of the lyophilized specimens. Clinical studies are now required to assess the devices performance in practice.
Collapse
|
17
|
Krüger LJ, Tanuri A, Lindner AK, Gaeddert M, Köppel L, Tobian F, Brümmer LE, Klein JAF, Lainati F, Schnitzler P, Nikolai O, Mockenhaupt FP, Seybold J, Corman VM, Jones TC, Drosten C, Gottschalk C, Weber SF, Weber S, Ferreira OC, Mariani D, Dos Santos Nascimento ER, Pereira Pinto Castineiras TM, Galliez RM, Faffe DS, Leitão IDC, Dos Santos Rodrigues C, Frauches TS, Nocchi KJCV, Feitosa NM, Ribeiro SS, Pollock NR, Knorr B, Welker A, de Vos M, Sacks J, Ongarello S, Denkinger CM. Accuracy and ease-of-use of seven point-of-care SARS-CoV-2 antigen-detecting tests: A multi-centre clinical evaluation. EBioMedicine 2022; 75:103774. [PMID: 34959134 PMCID: PMC8702380 DOI: 10.1016/j.ebiom.2021.103774] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Revised: 12/02/2021] [Accepted: 12/09/2021] [Indexed: 11/04/2022] Open
Abstract
BACKGROUND Antigen-detecting rapid diagnostic tests (Ag-RDTs) for SARS-CoV-2 are important diagnostic tools. We assessed clinical performance and ease-of-use of seven Ag-RDTs in a prospective, manufacturer-independent, multi-centre cross-sectional diagnostic accuracy study to inform global decision makers. METHODS Unvaccinated participants suspected of a first SARS-CoV-2 infection were recruited at six sites (Germany, Brazil). Ag-RDTs were evaluated sequentially, with collection of paired swabs for routine reverse transcription polymerase chain reaction (RT-PCR) testing and Ag-RDT testing. Performance was compared to RT-PCR overall and in sub-group analyses (viral load, symptoms, symptoms duration). To understandusability a System Usability Scale (SUS) questionnaire and ease-of-use (EoU) assessment were performed. FINDINGS 7471 participants were included in the analysis. Sensitivities across Ag-RDTs ranged from 70·4%-90·1%, specificities were above 97·2% for all Ag-RDTs but one (93·1%).Ag-RDTs, Mologic, Bionote, Standard Q, showed diagnostic accuracy in line with WHO targets (> 80% sensitivity, > 97% specificity). All tests showed high sensitivity in the first three days after symptom onset (≥87·1%) and in individuals with viral loads≥ 6 log10SARS-CoV2 RNA copies/mL (≥ 88·7%). Usability varied, with Rapigen, Bionote and Standard Q reaching very good scores; 90, 88 and 84/100, respectively. INTERPRETATION Variability in test performance is partially explained by variable viral loads in population evaluated over the course of the pandemic. All Ag-RDTs reach high sensitivity early in the disease and in individuals with high viral loads, supporting their role in identifying transmission relevant infections. For easy-to-use tests, performance shown will likely be maintained in routine implementation. FUNDING Ministry of Science, Research and Arts, State of Baden-Wuerttemberg, Germany, internal funds from Heidelberg University Hospital, University Hospital Charité - Universitätsmedizin Berlin, UK Department of International Development, WHO, Unitaid.
Collapse
|
18
|
Brümmer LE, Katzenschlager S, Gaeddert M, Erdmann C, Schmitz S, Bota M, Grilli M, Larmann J, Weigand MA, Pollock NR, Macé A, Carmona S, Ongarello S, Sacks JA, Denkinger CM. Accuracy of novel antigen rapid diagnostics for SARS-CoV-2: A living systematic review and meta-analysis. PLoS Med 2021; 18:e1003735. [PMID: 34383750 PMCID: PMC8389849 DOI: 10.1371/journal.pmed.1003735] [Citation(s) in RCA: 171] [Impact Index Per Article: 42.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/26/2021] [Revised: 08/26/2021] [Accepted: 07/14/2021] [Indexed: 12/11/2022] Open
Abstract
BACKGROUND SARS-CoV-2 antigen rapid diagnostic tests (Ag-RDTs) are increasingly being integrated in testing strategies around the world. Studies of the Ag-RDTs have shown variable performance. In this systematic review and meta-analysis, we assessed the clinical accuracy (sensitivity and specificity) of commercially available Ag-RDTs. METHODS AND FINDINGS We registered the review on PROSPERO (registration number: CRD42020225140). We systematically searched multiple databases (PubMed, Web of Science Core Collection, medRvix, bioRvix, and FIND) for publications evaluating the accuracy of Ag-RDTs for SARS-CoV-2 up until 30 April 2021. Descriptive analyses of all studies were performed, and when more than 4 studies were available, a random-effects meta-analysis was used to estimate pooled sensitivity and specificity in comparison to reverse transcription polymerase chain reaction (RT-PCR) testing. We assessed heterogeneity by subgroup analyses, and rated study quality and risk of bias using the QUADAS-2 assessment tool. From a total of 14,254 articles, we included 133 analytical and clinical studies resulting in 214 clinical accuracy datasets with 112,323 samples. Across all meta-analyzed samples, the pooled Ag-RDT sensitivity and specificity were 71.2% (95% CI 68.2% to 74.0%) and 98.9% (95% CI 98.6% to 99.1%), respectively. Sensitivity increased to 76.3% (95% CI 73.1% to 79.2%) if analysis was restricted to studies that followed the Ag-RDT manufacturers' instructions. LumiraDx showed the highest sensitivity, with 88.2% (95% CI 59.0% to 97.5%). Of instrument-free Ag-RDTs, Standard Q nasal performed best, with 80.2% sensitivity (95% CI 70.3% to 87.4%). Across all Ag-RDTs, sensitivity was markedly better on samples with lower RT-PCR cycle threshold (Ct) values, i.e., <20 (96.5%, 95% CI 92.6% to 98.4%) and <25 (95.8%, 95% CI 92.3% to 97.8%), in comparison to those with Ct ≥ 25 (50.7%, 95% CI 35.6% to 65.8%) and ≥30 (20.9%, 95% CI 12.5% to 32.8%). Testing in the first week from symptom onset resulted in substantially higher sensitivity (83.8%, 95% CI 76.3% to 89.2%) compared to testing after 1 week (61.5%, 95% CI 52.2% to 70.0%). The best Ag-RDT sensitivity was found with anterior nasal sampling (75.5%, 95% CI 70.4% to 79.9%), in comparison to other sample types (e.g., nasopharyngeal, 71.6%, 95% CI 68.1% to 74.9%), although CIs were overlapping. Concerns of bias were raised across all datasets, and financial support from the manufacturer was reported in 24.1% of datasets. Our analysis was limited by the included studies' heterogeneity in design and reporting. CONCLUSIONS In this study we found that Ag-RDTs detect the vast majority of SARS-CoV-2-infected persons within the first week of symptom onset and those with high viral load. Thus, they can have high utility for diagnostic purposes in the early phase of disease, making them a valuable tool to fight the spread of SARS-CoV-2. Standardization in conduct and reporting of clinical accuracy studies would improve comparability and use of data.
Collapse
|
19
|
Samuels THA, Wyss R, Ongarello S, Moore DAJ, Schumacher SG, Denkinger CM. Evaluation of the diagnostic performance of laboratory-based c-reactive protein as a triage test for active pulmonary tuberculosis. PLoS One 2021; 16:e0254002. [PMID: 34252128 PMCID: PMC8274836 DOI: 10.1371/journal.pone.0254002] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Accepted: 06/17/2021] [Indexed: 11/22/2022] Open
Abstract
Introduction A highly sensitive triage test that captures most symptomatic patients at increased likelihood of having pulmonary tuberculosis (PTB) would ‘rule-out’ lower-risk patients from expensive confirmatory testing. Although studies have assessed the diagnostic accuracy of a C-reactive protein (CRP) triage test for PTB in HIV+ patients, limited data are available from HIV- cohorts. Materials and methods In this retrospective case-control study, 765 serum samples were selected from FIND’s biobank. Each sample had been collected from an adult presenting with respiratory symptomatology to district hospitals in South Africa and referral hospitals in Cambodia, Peru, Georgia and Vietnam between 2007–2017. Serum CRP measurements were obtained using a laboratory-based assay. CRP cutoff-points of ≥8mg/L and ≥10mg/L were predefined as a positive triage test result. The PTB reference standard was two contemporaneously collected sputum liquid culture results. Results CRP demonstrated an overall sensitivity for PTB of 79.8% (95%CI 75.5–83.5) and 77.7% (95%CI 73.4–81.6) for cutoff-points of 8mg/L and 10mg/L respectively. Specificity was 62.8% (95%CI 57.8–67.6%) and 66.6% (95%CI 61.1–70.7) respectively. Area-under-the-curve using Receiver Operating Characteristic analysis was 0.77 (95%CI 0.74–0.81). Threshold analysis showed optimal CRP cutoff-points were higher in HIV+ than HIV- participants. An algorithm in which CRP triage was followed by confirmatory Xpert MTB/Rif testing achieved a sensitivity of 75.1% (95%CI 69.0–80.4%) whilst decreasing Xpert usage by 40.6%. Discussion CRP may not meet the challenge of a catch-all TB triage test. However, it shows promise in HIV+ individuals. Further research is required in a prospective study using point-of-care platforms to further evaluate its capabilities.
Collapse
|
20
|
Zimmer AJ, Schumacher SG, Södersten E, Mantsoki A, Wyss R, Persing DH, Banderby S, Strömqvist Meuzelaar L, Prieto J, Gnanashanmugam D, Khatri P, Ongarello S, Ruhwald M, Denkinger CM. A novel blood-based assay for treatment monitoring of tuberculosis. BMC Res Notes 2021; 14:247. [PMID: 34193258 PMCID: PMC8243580 DOI: 10.1186/s13104-021-05663-z] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Accepted: 06/17/2021] [Indexed: 11/10/2022] Open
Abstract
Objectives A novel 3-gene host transcriptional signature (GBP5, DUSP3 and KLF2) has been validated for tuberculosis (TB) treatment monitoring using laboratory-based RNA sequencing platforms. The signature was recently translated by Cepheid into a prototype cartridge-based test that can be run on the GeneXpert instrument. In this study, we prospectively evaluated the change in the expression of the cartridge-based 3-gene signature following treatment initiation among pulmonary TB patients who were microbiologically cured at the end of treatment. Results The 3-gene signature expression level (TB score) changed significantly over time with respect to baseline among 31 pulmonary TB patients. The greatest increase in TB score occurred within the first month of treatment (median fold-increase in TB score: 1.08 [IQR 0.54–1.52]) and plateaued after 4 months of treatment (median TB score: 1.97 [IQR: 1.03–2.33]). The rapid and substantial increase of the TB score in the first month of treatment holds promise for the early identification of patients that respond to TB treatment. The plateau in TB score at 4 months may indicate early clearance of disease and could direct treatment to be shortened. These hypotheses need to be further explored with larger prospective treatment monitoring studies.
Collapse
|
21
|
Osborn J, Roberts T, Guillen E, Bernal O, Roddy P, Ongarello S, Sprecher A, Page AL, Ribeiro I, Piriou E, Tamrat A, de la Tour R, Rao VB, Flevaud L, Jensen T, McIver L, Kelly C, Dittrich S. Prioritising pathogens for the management of severe febrile patients to improve clinical care in low- and middle-income countries. BMC Infect Dis 2020; 20:117. [PMID: 32041536 PMCID: PMC7011354 DOI: 10.1186/s12879-020-4834-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2019] [Accepted: 01/28/2020] [Indexed: 11/26/2022] Open
Abstract
Background Severe febrile illness without a known source (SFWS) is a challenge for clinicians when deciding how to manage a patient, particularly given the wide spectrum of potential aetiologies that contribute to fever. These infections are difficult to distinguish clinically, and accurate diagnosis requires a plethora of diagnostics including blood cultures, imaging techniques, molecular or serological tests, and more. When laboratory services are available, a limited test menu hinders clinical decision-making and antimicrobial stewardship, leading to empiric treatment and suboptimal patient outcomes. To specifically address SFWS, this work aimed to identify priority pathogens for a globally applicable panel for fever causing pathogens. Method A pragmatic two-pronged approach combining currently available scientific data in an analytical hierarchy process and systematically gathered expert input, was designed to address the lack of comprehensive global aetiology data. The expert re-ranked list was then further adapted for a specific use case to focus on community acquired infections in whole blood specimens. The resulting list was further analysed to address different geographical regions (Asia, Africa, and Latin America), and Cohen kappa scores of agreement were calculated. Results The expert ranked prioritized pathogen list generated as part of this two-pronged approach included typhoidal Salmonella, Plasmodium species and Mycobacterium tuberculosis as the top 3 pathogens. This pathogen list was then further adapted for the SFWS use case to develop a final pathogen list to inform product development. Subsequent analysis comparing the relevance of the SFWS pathogen list to multiple populations and geographical regions showed that the SFWS prioritized list had considerable utility across Africa and Asia, but less so for Latin America. In addition, the list showed high levels of agreement across different patient sub-populations, but lower relevance for neonates and symptomatic HIV patients. Conclusion This work highlighted once again the challenges of prioritising in global health, but it also shows that taking a two-pronged approach, combining available prevalence data with expert input, can result in a broadly applicable priority list. This comprehensive utility is particularly important in the context of product development, where a sufficient market size is essential to achieve a sustainable commercialized diagnostic product to address SFWS.
Collapse
|
22
|
Salami O, Horgan P, Moore CE, Giri A, Sserwanga A, Pathak A, Basnyat B, Kiemde F, Smithuis F, Kitutu F, Phutke G, Tinto H, Hopkins H, Kapisi J, Swe MMM, Taneja N, Baiden R, Dutta S, Compaore A, Kaawa-Mafigiri D, Hussein R, Shakya SU, Kukula V, Ongarello S, Tomar A, Chadha SS, Walia K, Kelly-Cirino C, Olliaro P. Impact of a package of diagnostic tools, clinical algorithm, and training and communication on outpatient acute fever case management in low- and middle-income countries: protocol for a randomized controlled trial. Trials 2020; 21:974. [PMID: 33239106 PMCID: PMC7687811 DOI: 10.1186/s13063-020-04897-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2020] [Accepted: 11/12/2020] [Indexed: 01/21/2023] Open
Abstract
BACKGROUND The management of acute febrile illnesses places a heavy burden on clinical services in many low- and middle-income countries (LMICs). Bacterial and viral aetiologies of acute fevers are often clinically indistinguishable and, in the absence of diagnostic tests, the 'just-in-case' use of antibiotics by many health workers has become common practice, which has an impact on drug-resistant infections. Our study aims to answer the following question: in patients with undifferentiated febrile illness presenting to outpatient clinics/peripheral health centres in LMICs, can we demonstrate an improvement in clinical outcomes and reduce unnecessary antibiotic prescription over current practice by using a combination of simple, accurate diagnostic tests, clinical algorithms, and training and communication (intervention package)? METHODS We designed a randomized, controlled clinical trial to evaluate the impact of our intervention package on clinical outcomes and antibiotic prescription rates in acute febrile illnesses. Available, point-of-care, pathogen-specific and non-pathogen specific (host markers), rapid diagnostic tests (RDTs) included in the intervention package were selected based on pre-defined criteria. Nine clinical study sites in six countries (Burkina Faso, Ghana, India, Myanmar, Nepal and Uganda), which represent heterogeneous outpatient care settings, were selected. We considered the expected seasonal variations in the incidence of acute febrile illnesses across all the sites by ensuring a recruitment period of 12 months. A master protocol was developed and adapted for country-specific ethical submissions. Diagnostic algorithms and choice of RDTs acknowledged current data on aetiologies of acute febrile illnesses in each country. We included a qualitative evaluation of drivers and/or deterrents of uptake of new diagnostics and antibiotic use for acute febrile illnesses. Sample size estimations were based on historical site data of antibiotic prescription practices for malarial and non-malarial acute fevers. Overall, 9 semi-independent studies will enrol a minimum of 21,876 patients and an aggregate data meta-analysis will be conducted on completion. DISCUSSION This study is expected to generate vital evidence needed to inform policy decisions on the role of rapid diagnostic tests in the clinical management of acute febrile illnesses, with a view to controlling the rise of antimicrobial resistance in LMICs. TRIAL REGISTRATION Clinicaltrials.gov NCT04081051 . Registered on 6 September 2019. Protocol version 1.4 dated 20 December 2019.
Collapse
|
23
|
Escadafal C, Geis S, Siqueira AM, Agnandji ST, Shimelis T, Tadesse BT, Massinga Loembé M, Harris V, Fernandez-Carballo BL, Macé A, Ongarello S, Rodriguez W, Dittrich S. Bacterial versus non-bacterial infections: a methodology to support use-case-driven product development of diagnostics. BMJ Glob Health 2020; 5:bmjgh-2020-003141. [PMID: 33087393 PMCID: PMC7580043 DOI: 10.1136/bmjgh-2020-003141] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2020] [Revised: 08/28/2020] [Accepted: 09/12/2020] [Indexed: 01/28/2023] Open
Abstract
Acute febrile illness (AFI) is one of the most common reasons for seeking medical care in low-income and middle-income countries. Bacterial infections account for a relatively small proportion of AFIs; however, in the absence of a simple diagnostic test to guide clinical decisions, healthcare professionals often presume that a non-malarial febrile illness is bacterial in origin, potentially resulting in inappropriate antibiotic use. An accurate differential diagnostic tool for AFIs is thus essential, to both limit antibiotic use to bacterial infections and address the antimicrobial resistance crisis that is emerging globally, without resorting to multiple or complex pathogen-specific assays. The Biomarker for Fever-Diagnostic (BFF-Dx) study is one of the largest fever biomarker studies ever undertaken. We collected samples and classified disease aetiology in more than 1900 individuals, distributed among enrolment centres in three countries on two continents. Identical protocols were followed at each study site, and the same analyses were conducted in each setting, enabling like-with-like comparisons to be made among the large sample set generated. The BFF-Dx methodology can act as a model for other researchers, facilitating wider utility of the work in the future. The established sample collection is now accessible to researchers and companies and will facilitate the development of future fever-related diagnostic tests. Here, we outline the methodology used to determine the sample populations and to differentiate bacterial versus non-bacterial AFIs. Future publications will set out in more detail the study’s demographics, the causes of fever identified and the performance of selected biomarkers.
Collapse
|
24
|
Vetter BN, Reipold EI, Ongarello S, Audu R, Ige FA, Alkhazashvili M, Chitadze N, Vanroye F, De Weggheleire A, An S, Fransen K. Sensitivity and Specificity of Rapid Diagnostic Tests for Hepatitis C Virus With or Without HIV Coinfection: A Multicentre Laboratory Evaluation Study. J Infect Dis 2020; 226:420-430. [PMID: 32614451 PMCID: PMC9417120 DOI: 10.1093/infdis/jiaa389] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2020] [Accepted: 06/25/2020] [Indexed: 02/07/2023] Open
Abstract
Background Hepatitis C virus (HCV) screening is critical to HCV elimination efforts. Simplified diagnostics are required for low-resource settings and difficult-to-reach populations. This retrospective study assessed performance of rapid diagnostic tests (RDTs) for detection of HCV antibodies. Methods Two lots of 13 RDTs were evaluated at 3 laboratories using archived plasma samples from 4 countries (Nigeria, Georgia, Cambodia, and Belgium). HCV status was determined using 3 reference tests according to a composite algorithm. Sensitivity and specificity were evaluated in HIV-infected and HIV-uninfected populations. Operational characteristics were also assessed. Results In total, 1710 samples met inclusion criteria. In HIV-uninfected samples (n = 384), the majority of RDTs had sensitivity ≥98% in 1 or both lots and most RDTs had specificity ≥99%. In HIV-infected samples (n = 264), specificity remained high but sensitivity was markedly lower than in HIV-uninfected samples; only 1 RDT reached >95%. The majority of HIV-infected samples for which sensitivity was low did not have detectable HCV viral load/core antigen. Interreader variability, lot-to-lot variability, and rate of invalid runs were low for all RDTs (<2%). Conclusions HCV RDTs should be evaluated in the intended target population, as sensitivity can be impacted by population factors such as HIV status. Clinical Trials Registration NCT04033887
Collapse
|
25
|
Broger T, Nicol MP, Székely R, Bjerrum S, Sossen B, Schutz C, Opintan JA, Johansen IS, Mitarai S, Chikamatsu K, Kerkhoff AD, Macé A, Ongarello S, Meintjes G, Denkinger CM, Schumacher SG. Diagnostic accuracy of a novel tuberculosis point-of-care urine lipoarabinomannan assay for people living with HIV: A meta-analysis of individual in- and outpatient data. PLoS Med 2020; 17:e1003113. [PMID: 32357197 PMCID: PMC7194366 DOI: 10.1371/journal.pmed.1003113] [Citation(s) in RCA: 51] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/19/2019] [Accepted: 04/09/2020] [Indexed: 01/17/2023] Open
Abstract
BACKGROUND Tuberculosis (TB) is the most common cause of death in people living with HIV (PLHIV), yet TB often goes undiagnosed since many patients are not able to produce a sputum specimen, and traditional diagnostics are costly or unavailable. A novel, rapid lateral flow assay, Fujifilm SILVAMP TB LAM (SILVAMP-LAM), detects the presence of TB lipoarabinomannan (LAM) in urine, and is substantially more sensitive for diagnosing TB in PLHIV than an earlier LAM assay (Alere Determine TB LAM lateral flow assay [LF-LAM]). Here, we present an individual participant data meta-analysis of the diagnostic accuracy of SILVAMP-LAM in adult PLHIV, including both published and unpublished data. METHODS AND FINDINGS Adult PLHIV (≥18 years) were assessed in 5 prospective cohort studies in South Africa (3 cohorts), Vietnam, and Ghana, carried out during 2012 to 2017. Of the 1,595 PLHIV who met eligibility criteria, the majority (61%) were inpatients, median age was 37 years (IQR 30-43), 43% had a CD4 count ≤ 100 cells/μl, and 35% were receiving antiretroviral therapy. Most participants (94%) had a positive WHO symptom screen for TB on enrollment, and 45% were diagnosed with microbiologically confirmed TB, using mycobacterial culture or Xpert MTB/RIF testing of sputum, urine, or blood. Previously published data from inpatients were combined with unpublished data from outpatients. Biobanked urine samples were tested, using blinded double reading, with SILVAMP-LAM and LF-LAM. Applying a microbiological reference standard for assessment of sensitivity, the overall sensitivity for TB detection was 70.7% (95% CI 59.0%-80.8%) for SILVAMP-LAM compared to 34.9% (95% CI 19.5%-50.9%) for LF-LAM. Using a composite reference standard (which included patients with both microbiologically confirmed as well as clinically diagnosed TB), SILVAMP-LAM sensitivity was 65.8% (95% CI 55.9%-74.6%), and that of LF-LAM 31.4% (95% CI 19.1%-43.7%). In patients with CD4 count ≤ 100 cells/μl, SILVAMP-LAM sensitivity was 87.1% (95% CI 79.3%-93.6%), compared to 56.0% (95% CI 43.9%-64.9%) for LF-LAM. In patients with CD4 count 101-200 cells/μl, SILVAMP-LAM sensitivity was 62.7% (95% CI 52.4%-71.9%), compared to 25.3% (95% CI 15.8%-34.9%) for LF-LAM. In those with CD4 count > 200 cells/μl, SILVAMP-LAM sensitivity was 43.9% (95% CI 34.3%-53.9%), compared to 10.9% (95% CI 5.2%-18.4%) for LF-LAM. Using a microbiological reference standard, the specificity of SILVAMP-LAM was 90.9% (95% CI 87.2%-93.7%), and that of LF-LAM 95.3% (95% CI 92.2%-97.7%). Limitations of this study include the use of biobanked, rather than fresh urine samples, and testing by skilled laboratory technicians in research laboratories, rather than at the point of care. CONCLUSIONS In this study, we found that SILVAMP-LAM identified a substantially higher proportion of TB patients in PLHIV than LF-LAM. The sensitivity of SILVAMP-LAM was highest in patients with CD4 count ≤ 100 cells/μl. Further work is needed to demonstrate accuracy when implemented as a point-of-care test.
Collapse
|