1
|
Aung MO, Venkatachalam I, Sim JX, Wee LE, Aung MK, Yang Y, Conceicao EP, Arora S, Lee MA, Sia CH, Tan KB, Ling ML. Prediction model to identify infectious COVID-19 patients in the emergency department. ANTIMICROBIAL STEWARDSHIP & HEALTHCARE EPIDEMIOLOGY : ASHE 2024; 4:e88. [PMID: 38774116 PMCID: PMC11106730 DOI: 10.1017/ash.2024.82] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Revised: 04/14/2024] [Accepted: 04/16/2024] [Indexed: 05/24/2024]
Abstract
Background Real-time reverse-transcriptase polymerase chain reaction (RT-PCR) has been the gold standard for diagnosing coronavirus disease 2019 (COVID-19) but has a lag time for the results. An effective prediction algorithm for infectious COVID-19, utilized at the emergency department (ED), may reduce the risk of healthcare-associated COVID-19. Objective To develop a prototypic prediction model for infectious COVID-19 at the time of presentation to the ED. Material and methods Retrospective cohort study of all adult patients admitted to Singapore General Hospital (SGH) through ED between March 15, 2020, and December 31, 2022, with admission of COVID-19 RT-PCR results. Two prediction models were developed and evaluated using area under the curve (AUC) of receiver operating characteristics (ROC) to identify infectious COVID-19 patients (cycle threshold (Ct) of <25). Results Total of 78,687 patients were admitted to SGH through ED during study period. 6,132 of them tested severe acute respiratory coronavirus 2 positive on RT-PCR. Nearly 70% (4,226 of 6,132) of the patients had infectious COVID-19 (Ct<25). Model that included demographics, clinical history, symptom and laboratory variables had AUROC of 0.85 with sensitivity and specificity of 80.0% & 72.1% respectively. When antigen rapid test results at ED were available and added to the model for a subset of the study population, AUROC reached 0.97 with sensitivity and specificity of 95.0% and 92.8% respectively. Both models maintained respective sensitivity and specificity results when applied to validation data. Conclusion Clinical predictive models based on available information at ED can be utilized for identification of infectious COVID-19 patients and may enhance infection prevention efforts.
Collapse
Affiliation(s)
- Myat Oo Aung
- Infection Prevention and Epidemiology Department, Singapore General Hospital, Singapore, Singapore
| | - Indumathi Venkatachalam
- Infection Prevention and Epidemiology Department, Singapore General Hospital, Singapore, Singapore
- Department of Infectious Disease, Singapore General Hospital, Singapore, Singapore
| | - Jean X.Y. Sim
- Infection Prevention and Epidemiology Department, Singapore General Hospital, Singapore, Singapore
- Department of Infectious Disease, Singapore General Hospital, Singapore, Singapore
| | - Liang En Wee
- Department of Infectious Disease, Singapore General Hospital, Singapore, Singapore
| | - May K. Aung
- Infection Prevention and Epidemiology Department, Singapore General Hospital, Singapore, Singapore
| | - Yong Yang
- Infection Prevention and Epidemiology Department, Singapore General Hospital, Singapore, Singapore
| | - Edwin P. Conceicao
- Infection Prevention and Epidemiology Department, Singapore General Hospital, Singapore, Singapore
| | - Shalvi Arora
- Infection Prevention and Epidemiology Department, Singapore General Hospital, Singapore, Singapore
| | - Marcus A.B. Lee
- Emergency Department, Singapore General Hospital, Singapore, Singapore
| | - Chang H. Sia
- Emergency Department, Singapore General Hospital, Singapore, Singapore
| | - Kenneth B.K. Tan
- Emergency Department, Singapore General Hospital, Singapore, Singapore
| | - Moi Lin Ling
- Infection Prevention and Epidemiology Department, Singapore General Hospital, Singapore, Singapore
| |
Collapse
|
2
|
Manten K, Katzenschlager S, Brümmer LE, Schmitz S, Gaeddert M, Erdmann C, Grilli M, Pollock NR, Macé A, Erkosar B, Carmona S, Ongarello S, Johnson CC, Sacks JA, Faehling V, Bornemann L, Weigand MA, Denkinger CM, Yerlikaya S. Clinical accuracy of instrument-based SARS-CoV-2 antigen diagnostic tests: a systematic review and meta-analysis. Virol J 2024; 21:99. [PMID: 38685117 PMCID: PMC11059670 DOI: 10.1186/s12985-024-02371-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Accepted: 04/17/2024] [Indexed: 05/02/2024] Open
Abstract
BACKGROUND During the COVID-19 pandemic, antigen diagnostic tests were frequently used for screening, triage, and diagnosis. Novel instrument-based antigen tests (iAg tests) hold the promise of outperforming their instrument-free, visually-read counterparts. Here, we provide a systematic review and meta-analysis of the SARS-CoV-2 iAg tests' clinical accuracy. METHODS We systematically searched MEDLINE (via PubMed), Web of Science, medRxiv, and bioRxiv for articles published before November 7th, 2022, evaluating the accuracy of iAg tests for SARS-CoV-2 detection. We performed a random effects meta-analysis to estimate sensitivity and specificity and used the QUADAS-2 tool to assess study quality and risk of bias. Sub-group analysis was conducted based on Ct value range, IFU-conformity, age, symptom presence and duration, and the variant of concern. RESULTS We screened the titles and abstracts of 20,431 articles and included 114 publications that fulfilled the inclusion criteria. Additionally, we incorporated three articles sourced from the FIND website, totaling 117 studies encompassing 95,181 individuals, which evaluated the clinical accuracy of 24 commercial COVID-19 iAg tests. The studies varied in risk of bias but showed high applicability. Of 24 iAg tests from 99 studies assessed in the meta-analysis, the pooled sensitivity and specificity compared to molecular testing of a paired NP swab sample were 76.7% (95% CI 73.5 to 79.7) and 98.4% (95% CI 98.0 to 98.7), respectively. Higher sensitivity was noted in individuals with high viral load (99.6% [95% CI 96.8 to 100] at Ct-level ≤ 20) and within the first week of symptom onset (84.6% [95% CI 78.2 to 89.3]), but did not differ between tests conducted as per manufacturer's instructions and those conducted differently, or between point-of-care and lab-based testing. CONCLUSION Overall, iAg tests have a high pooled specificity but a moderate pooled sensitivity, according to our analysis. The pooled sensitivity increases with lower Ct-values (a proxy for viral load), or within the first week of symptom onset, enabling reliable identification of most COVID-19 cases and highlighting the importance of context in test selection. The study underscores the need for careful evaluation considering performance variations and operational features of iAg tests.
Collapse
Affiliation(s)
- Katharina Manten
- Department of Infectious Disease and Tropical Medicine, Heidelberg University Hospital, Im Neuenheimer Feld 324, 69120, Heidelberg, Germany
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Stephan Katzenschlager
- Department of Infectious Disease and Tropical Medicine, Heidelberg University Hospital, Im Neuenheimer Feld 324, 69120, Heidelberg, Germany
| | - Lukas E Brümmer
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Stephani Schmitz
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
- Department of Developmental Biology, Erasmus Medical Center, Rotterdam, Netherlands
| | - Mary Gaeddert
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | | | - Maurizio Grilli
- Library, University Medical Center Mannheim, Mannheim, Germany
| | - Nira R Pollock
- Department of Laboratory Medicine, Boston Children's Hospital, Boston, MA, USA
| | | | | | | | | | - Cheryl C Johnson
- Global HIV, Hepatitis and STIs Programmes, World Health Organization, Geneva, Switzerland
| | - Jilian A Sacks
- Department of Epidemic and Pandemic Preparedness and Prevention, World Health Organization, Geneva, Switzerland
| | - Verena Faehling
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
| | - Linus Bornemann
- Institute of Virology, Faculty of Medicine, University Medical Centre, University of Freiburg, Freiburg, Germany
| | - Markus A Weigand
- Department of Infectious Disease and Tropical Medicine, Heidelberg University Hospital, Im Neuenheimer Feld 324, 69120, Heidelberg, Germany
| | - Claudia M Denkinger
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany
- German Center for Infection Research (DZIF), partner site Heidelberg University Hospital, Heidelberg, Germany
| | - Seda Yerlikaya
- Department of Anesthesiology, Heidelberg University Hospital, Heidelberg, Germany.
- German Center for Infection Research (DZIF), partner site Heidelberg University Hospital, Heidelberg, Germany.
| |
Collapse
|
3
|
Lee HY, Park YJ, Yu M, Park H, Lee JJ, Choi J, Park HS, Kim JY, Moon JY, Lee SE. Accuracy of Rapid Antigen Screening Tests for SARS-CoV-2 Infection at Correctional Facilities in Korea: March - May 2022. Infect Chemother 2023; 55:460-470. [PMID: 37917993 PMCID: PMC10771955 DOI: 10.3947/ic.2023.0059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Accepted: 08/16/2023] [Indexed: 11/04/2023] Open
Abstract
BACKGROUND The number of confirmed cases of individuals with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection increased rapidly due to the Omicron variant. Correctional facilities are vulnerable to infectious diseases, and they introduced rapid antigen tests (RATs) to allow for early detection and rapid response. We aimed to evaluate the diagnostic performance and usefulness of SARS-CoV-2 RATs in newly incarcerated people. MATERIALS AND METHODS We conducted a cross-sectional study at correctional facilities in Korea from 9 March to 22 May 2022. The study population was newly incarcerated people who were divided into two groups. In one group, 799 paired SARS-CoV-2 RATs and real-time polymerase chain reaction (RT-PCR) were conducted simultaneously in 522 individuals in March 2022. In the other group, 4,034 paired RATs and RT-PCR consecutively in 4,034 participants; only individuals with negative RATs results underwent RT-PCR from April to May 2022. We analyzed data using descriptive statistics and a logistic regression model. RESULTS Among the 799 specimens in March, RT-PCR was positive in 72 (9.0%), and among the 4,034 specimens in April - May 2022, RT-PCR was positive in 40 (1.0%). Overall, the RATs had a sensitivity of 58.3%, specificity of 100.0%, positive predictive value (PPV) of 100.0%, and negative predictive value (NPV) of 96.0%. Asymptomatic individuals constituted 98.2% of the study group, and symptomatic individuals 1.8%. In asymptomatic cases, the sensitivity of RATs was 52.5%, specificity was 100.0%, PPV was 100.0%, and NPV was 96.3%. In symptomatic cases, the sensitivity of RATs was 84.6%, specificity was 100.0%, PPV was 100.0%, and NPV was 33.3%. Sensitivity (P = 0.034) and NPV (P = 0.004) differed significantly according to the presence and absence of symptoms, and the F1 score was the highest at 0.9 in symptomatic individuals in March. There was a positive linear trend in the proportion of false-negative RATs in newly incarcerated people following the weekly incidence of SARS-CoV-2 (P = 0.033). The best-associated predictors of RATs for SARS-CoV-2 infection involved symptoms, timing of sample collection, and repeat testing. CONCLUSION Sensitivity and NPV significantly depend on whether symptoms are present, and the percentage of false negatives is correlated with the incidence. Thus, using RATs should be adjusted according to the presence or absence of symptoms and the incidence of SARS-CoV-2 infection in the community. RATs could be a useful screening tool as an effective first-line countermeasure because they can rapidly identify infectious patients and minimize SARS-CoV-2 transmission in correctional facilities.
Collapse
Affiliation(s)
- Hye Young Lee
- Division of Epidemiological Investigation Analysis, Bureau of Public Health Emergency Preparedness, Korea Disease Control and Prevention Agency, Cheongju, Korea
| | - Young-Joon Park
- Division of Epidemiological Investigation Analysis, Bureau of Public Health Emergency Preparedness, Korea Disease Control and Prevention Agency, Cheongju, Korea
| | - Mi Yu
- Division of Epidemiological Investigation Analysis, Bureau of Public Health Emergency Preparedness, Korea Disease Control and Prevention Agency, Cheongju, Korea
| | - Hanul Park
- Division of Epidemiological Investigation Analysis, Bureau of Public Health Emergency Preparedness, Korea Disease Control and Prevention Agency, Cheongju, Korea
| | - Ji Joo Lee
- Division of Epidemiological Investigation Analysis, Bureau of Public Health Emergency Preparedness, Korea Disease Control and Prevention Agency, Cheongju, Korea
| | - Jihyun Choi
- Division of Epidemiological Investigation Analysis, Bureau of Public Health Emergency Preparedness, Korea Disease Control and Prevention Agency, Cheongju, Korea
| | - Hee Seok Park
- COVID-19 Correctional Facility Emergency Response Team, Ministry of Justice, Seoul, Korea
| | - Jun Yeop Kim
- COVID-19 Correctional Facility Emergency Response Team, Ministry of Justice, Seoul, Korea
| | - Jun Young Moon
- COVID-19 Correctional Facility Emergency Response Team, Ministry of Justice, Seoul, Korea
| | - Sang-Eun Lee
- Division of Epidemiological Investigation Analysis, Bureau of Public Health Emergency Preparedness, Korea Disease Control and Prevention Agency, Cheongju, Korea.
| |
Collapse
|