1
|
Lyngdoh CJ, Ramudamu M, Agarwal M, Verma S, Prasad A. Evaluation of Serological Tests for the Diagnosis of Syphilis. Cureus 2024; 16:e61007. [PMID: 38915997 PMCID: PMC11194129 DOI: 10.7759/cureus.61007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 05/24/2024] [Indexed: 06/26/2024] Open
Abstract
Background Syphilis remains a significant public health concern in India. Ensuring the accuracy of diagnostic tests is crucial for effectively managing this disease. Objectives This study aims to assess the detectability of syphilis using commercially available non-treponemal and treponemal tests due to observed discrepancies in test results, which can lead to confusion and anxiety among healthcare providers and patients. Materials and methods We analyzed 2312 serum samples using the rapid plasma reagin (RPR), Treponema pallidum hemagglutination assay (TPHA), enzyme-linked immunosorbent assay (ELISA), and modified TPHA rapid test, interpreting the results according to the manufacturers' instructions. We evaluated the diagnostic accuracy of all four tests. Concordance between the traditional and reverse algorithms was determined by calculating the percentage of agreement and the kappa (κ) coefficient. Results Of the 2312 samples tested, 34 (1.5%) were positive, and 2098 (90.7%) were negative across all four tests. Comparing the test results with clinical diagnosis, TPHA and TP-ELISA showed the highest sensitivity at 96.08%, while RPR demonstrated the highest specificity at 100%. The agreement between the traditional and reverse algorithms was moderate, with a 97.3% agreement and a κ value of 0.53. Conclusion Reliance on a single serological test for syphilis screening presents limitations. A combined approach using both RPR and TPHA tests can more accurately diagnose and confirm syphilis. This combination strategy is cost-effective and relatively simple to implement.
Collapse
Affiliation(s)
- Clarissa J Lyngdoh
- Microbiology, North Eastern Indira Gandhi Regional Institute of Health and Medical Sciences (NEIGRIHMS), Shillong, IND
| | - Mandira Ramudamu
- Microbiology, Bhaarath Medical College and Hospital, Chennai, IND
| | - Manika Agarwal
- Obstetrics and Gynaecology, North Eastern Indira Gandhi Regional Institute of Health and Medical Sciences (NEIGRIHMS), Shillong, IND
| | - Shikha Verma
- Dermatology, North Eastern Indira Gandhi Regional Institute of Health and Medical Sciences (NEIGRIHMS), Shillong, IND
| | - Abhijit Prasad
- Microbiology, All India Institute of Medical Sciences, Raipur, Raipur, IND
| |
Collapse
|
2
|
Gupta C, Mittal K, Kaur R, Kaur J, Sood T, Kaur G, Kaur P. Evaluation of chemiluminescence immunoassay as a screening test for syphilis on blood donor samples. Transfus Apher Sci 2023; 62:103836. [PMID: 37940459 DOI: 10.1016/j.transci.2023.103836] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 09/13/2023] [Accepted: 10/19/2023] [Indexed: 11/10/2023]
Abstract
BACKGROUND AND OBJECTIVE Global re-emergence of syphilis among blood donors necessitates novel diagnostic and prevention approaches that encourage timely intervention. Thus, the present study was planned to evaluate the efficiency of Chemiluminescence immunoassay (CLIA) as a screening test for syphilis. MATERIAL AND METHODS This prospective cross-sectional observational study was conducted from October 2021 to September 2022. A total of 344 donors were enrolled by purposive sampling method, including additional 16 donors who were reactive by the Rapid plasma reagin test (RPR) during the study period. Data from three screening tests - RPR test, Treponema pallidum haemagglutination assay (TPHA) and CLIA for 360 blood donors were analysed. TPHA was considered the gold standard test. RESULTS Of the total 360 samples tested, 21 (5.8 %) were reactive by the RPR test. Of these 21 RPR reactive samples, 19 (90.5 %) were reactive by both TPHA and CLIA, while 2 (9.5 %) RPR reactive samples were non-reactive by both TPHA and CLIA. Of the remaining 339 RPR non-reactive samples, 1 (0.3 %) sample was reactive by both TPHA and CLIA, and 1 (0.3 %) was reactive by CLIA alone. CLIA was found to have sensitivity and specificity of 100 % and 99.7 % and positive predictive value (PPV) and negative predictive values (NPV) of 95.2 % and 100 % respectively, while it was 95 %, 99.4 %, 90 %, and 99.7 %, respectively, with the RPR test. CONCLUSION CLIA was found to have a higher sensitivity, specificity, PPV and NPV than the RPR test. Thus, CLIA can be an acceptable alternative for syphilis screening in blood donors.
Collapse
Affiliation(s)
- Cherry Gupta
- Department of Transfusion Medicine, Government Medical College and Hospital, Chandigarh, India.
| | - Kshitija Mittal
- Department of Transfusion Medicine, Government Medical College and Hospital, Chandigarh, India.
| | - Ravneet Kaur
- Department of Transfusion Medicine, Government Medical College and Hospital, Chandigarh, India.
| | - Jasbinder Kaur
- Department of Biochemistry, Government Medical College and Hospital, Chandigarh, India.
| | - Tanvi Sood
- Department of Transfusion Medicine, Government Medical College and Hospital, Chandigarh, India.
| | - Gagandeep Kaur
- Department of Transfusion Medicine, Government Medical College and Hospital, Chandigarh, India.
| | - Paramjit Kaur
- Department of Transfusion Medicine, Government Medical College and Hospital, Chandigarh, India.
| |
Collapse
|
3
|
British Columbia's Experience after Implementation of the Treponema pallidum Reverse Algorithm and PCR Detection, 2015 to 2020. Microbiol Spectr 2022; 10:e0068622. [PMID: 35658597 PMCID: PMC9241594 DOI: 10.1128/spectrum.00686-22] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
British Columbia (BC) implemented the syphilis reverse screening algorithm and Treponema pallidum PCR testing in 2014. We summarize the performance characteristics of the algorithm, together with PCR direct detection, and report on syphilis cases identified from 2015 to 2020. Prior to 2015, samples for syphilis diagnosis were first screened by rapid plasma reagin (RPR). As of 2015, sera were screened by the Siemens Advia Centaur syphilis assay (enzyme immunoassay [EIA]). Positive and equivocal samples were reflex tested by a T. pallidum passive particle agglutination assay (TPPA) and RPR. We used T. pallidum DNA PCR on clinical samples and restriction fragment length polymorphism analysis to identify azithromycin resistance mutations. Case/epidemiological data were obtained from the BC surveillance system. Of 1,631,519 samples screened by the EIA, 72,492 (4.4%) were positive and 187 (<0.1%) were equivocal. Of EIA-positive/equivocal samples, 10.6% were false positive, and false positivity was higher at lower EIA indices. The reverse algorithm detected 4,693 late latent syphilis cases that likely would have been missed by RPR screening. PCR had a very high sensitivity of 100% versus 52.9% and 52.4% for dark-field (DF) and immunofluorescence (IF) microscopy, respectively. The azithromycin resistance mutation A2058G was identified in 96% of PCR-positive samples, and A2059G was identified in 4%. Annually, there were 944 to 1,467 syphilis cases, with 62% in men who reported male sexual partners. The reverse algorithm had a low false-positive rate and very few equivocal screening results but did identify previously undiagnosed late latent syphilis cases. PCR was more sensitive than both DF and IF microscopy for direct diagnosis and enabled monitoring for azithromycin resistance. IMPORTANCE In this study, we summarize the performance characteristics of the algorithm, together with PCR direct detection and epidemiological analysis, and report on syphilis cases identified from 2015 to 2020. This allowed us to paint a complete picture of the outcome of the utilization of the reverse algorithm for diagnosing syphilis cases. The study clearly showed that the reverse algorithm had a low false-positive rate and very few equivocal screening results but did identify previously undiagnosed late latent syphilis cases. PCR was more sensitive than both DF and IF microscopy for direct diagnosis and enabled monitoring for azithromycin resistance.
Collapse
|
4
|
Levett PN, Fonseca K, Tsang RSW, Kadkhoda K, Serhir B, Radons SM, Morshed M. Canadian Public Health Laboratory Network laboratory guidelines for the use of serological tests (excluding point-of-care tests) for the diagnosis of syphilis in Canada. THE CANADIAN JOURNAL OF INFECTIOUS DISEASES & MEDICAL MICROBIOLOGY = JOURNAL CANADIEN DES MALADIES INFECTIEUSES ET DE LA MICROBIOLOGIE MEDICALE 2015; 26 Suppl A:6A-12A. [PMID: 25798165 PMCID: PMC4353981 DOI: 10.1155/2015/983425] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
Syphilis, caused by the bacterium Treponema pallidum subsp. pallidum, is an infection recognized since antiquity. It was first reported at the end of the 15th century in Europe. Infections may be sexually transmitted as well as spread from an infected mother to her fetus or through blood transfusions. The laboratory diagnosis of syphilis infection is complex. Because this organism cannot be cultured, serology is used as the principal diagnostic method. Some of the issues related to serological diagnoses are that antibodies take time to appear after infection, and serology screening tests require several secondary confirmatory tests that can produce complex results needing interpretation by experts in the field. Traditionally, syphilis screening was performed using either rapid plasma reagin or Venereal Disease Research Laboratory tests, and confirmed by treponemal tests such as MHA-TP, TPPA or FTA-Abs. Currently, that trend is reversed, ie, most of the laboratories in Canada now screen for syphilis using treponemal enzyme immunoassays and confirm the status of infection using rapid plasma reagin or Venereal Disease Research Laboratory tests; this approach is often referred to as the reverse algorithm. This chapter reviews guidelines for specimen types and sample collection, treponemal and non-treponemal tests utilized in Canada, the current status of serological tests for syphilis in Canada, the complexity of serological diagnosis of syphilis infection and serological testing algorithms. Both traditional and reverse sequence algorithms are recommended and the algorithm used should be based on a combination of local disease epidemiology, test volumes, performance of the proposed assays and available resources.
Collapse
Affiliation(s)
- Paul N Levett
- Saskatchewan Disease Control Laboratory, Regina, Saskatchewan
| | - Kevin Fonseca
- Alberta Provincial Laboratory for Public Health, Calgary, Alberta
| | | | - Kamran Kadkhoda
- Cadham Provincial Laboratory
- Department of Medical Microbiology & Infectious Diseases and Department of Immunology, University of Manitoba, Winnipeg, Manitoba
| | - Bouchra Serhir
- Institut national de santé publique du Quebec-LSPQ, Sainte-Anne-de-Bellevue, Quebec
| | - Sandra M Radons
- Canadian Public Health Laboratory Network, Winnipeg, Manitoba
| | - Muhammad Morshed
- BC Public Health Microbiology and Reference Laboratory
- Department of Pathology and Laboratory Medicine, University of British Columbia, Vancouver, British Columbia
| |
Collapse
|
5
|
Syphilis testing in blood donors: an update. BLOOD TRANSFUSION = TRASFUSIONE DEL SANGUE 2014; 13:197-204. [PMID: 25545876 DOI: 10.2450/2014.0146-14] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Subscribe] [Scholar Register] [Received: 06/10/2014] [Accepted: 09/29/2014] [Indexed: 11/21/2022]
|
6
|
Naidu NK, Bharucha ZS, Sonawane V, Ahmed I. Comparative study of Treponemal and non-Treponemal test for screening of blood donated at a blood center. Asian J Transfus Sci 2012; 6:32-5. [PMID: 22623840 PMCID: PMC3353627 DOI: 10.4103/0973-6247.95048] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
The non-Treponemal tests such as Rapid Plasma Reagin test (RPR) or the Venereal Disease Reference Laboratory test are the most commonly used test for screening of syphilis in the blood centers in India. Now, with the availability of Enzyme-linked immunosorbent assay (ELISA) and Immunochromatographic assays in the market, we decided to evaluate these assays in comparison with Treponema pallidum Haemagglutination Assay (TPHA) which was considered as a gold standard for this study. A total of 8 685 samples of voluntary blood donors were tested on Trepolisa 3.0 and then the initially reactive samples were retested in duplicate on the same assay as well as on Omega Pathozyme, RPR, RAPHA (Rapid Anti-Treponema pallidum Assay), and TPHA. Of the 158 initially reactive samples, 104 were repeatedly reactive on the same assay, 85 were reactive with RPR, 77 were reactive with RAPHA, 60 were reactive on Omega, and 53 were confirmed reactive on TPHA. 48 (56.4%) of the results on RPR were biological false positive, while 21.9% of results were false negative on RPR. We evaluated that Omega Pathozyme was quite in agreement with TPHA as compared with Trepolisa 3.0, RAPHA, and RPR. We concluded that Omega Pathozyme (ELISA) can be considered as a suitable test for screening of syphilis in a blood center.
Collapse
|
7
|
Impact of Age, Gender, and Pregnancy on Syphilis Screening Using the Captia Syphilis-G Assay. Sex Transm Dis 2011; 38:1126-30. [DOI: 10.1097/olq.0b013e31822e60e1] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
8
|
It is time to use treponema-specific antibody screening tests for diagnosis of syphilis. J Clin Microbiol 2011; 50:2-6. [PMID: 22090405 DOI: 10.1128/jcm.06347-11] [Citation(s) in RCA: 61] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022] Open
Abstract
Assays that detect treponema-specific antibodies, which are either automated or can be done as point-of-care tests, have been developed, some of which are FDA approved. These assays have the advantage of being easily performed and demonstrate high sensitivity, both key features of an infectious disease screening test. As a result, many high-volume clinical laboratories have begun to offer a reverse syphilis testing algorithm where a treponema-specific test is used for screening, followed by a nontreponemal test (i.e., rapid plasma reagin [RPR]) to assess disease activity and treatment status. Concerns about physicians being able to understand and apply this new testing algorithm have been expressed (8). In this point-counterpoint, Michael Loeffelholz of the University of Texas Medical Branch at Galveston explains why his laboratory has adopted this reverse algorithmic approach. Matthew Binnicker of the Mayo Clinic, Rochester, MN, explains why the reverse algorithm may not be suitable for all clinical laboratories and every clinical situation.
Collapse
|
9
|
|
10
|
Tsang RSW, Martin IE, Lau A, Sawatzky P. Serological diagnosis of syphilis: comparison of the Trep-Chek IgG enzyme immunoassay with other screening and confirmatory tests. FEMS IMMUNOLOGY AND MEDICAL MICROBIOLOGY 2007; 51:118-24. [PMID: 17854473 DOI: 10.1111/j.1574-695x.2007.00289.x] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
Abstract
The Trep-Chek IgG Enzyme Immunoassay (Trep-Chek IgG EIA) was evaluated with 604 serum specimens submitted for syphilis serology from patients across Canada against a battery of conventional syphilis serology tests, including the Rapid Plasma Reagin (RPR) test, the Venereal Disease Research Laboratory (VDRL) test, the Treponema pallidum passive particle agglutination (TP-PA) test, the fluorescent treponemal antibody absorption (FTA-ABS) test, and the newer confirmatory test, Innogenetics INNO-LIA. On the basis of a consensus result derived from these serologic tests, 34 specimens were found to be syphilis-positive (28 active and six past infections), and 570 were syphilis-negative (including 12 biological false positives). When the test results on this set of samples were compared to those obtained with the conventional tests RPR, VDRL, TP-PA, and FTA-ABS, the sensitivity and specificity of the Trep-Chek IgG EIA were found to be 85.3% and 95.6%, respectively. Without further evaluation, we do not recommend use of the Trep-Chek IgG EIA as a stand-alone test for either screening or confirmatory syphilis serology.
Collapse
Affiliation(s)
- Raymond S W Tsang
- Laboratory for Pathogenic Neisseria, Syphilis Serology, and Vaccine Preventable Bacterial Diseases, National Microbiology Laboratory, Public Health Agency of Canada, Winnipeg, Manitoba, Canada.
| | | | | | | |
Collapse
|
11
|
Cole MJ, Perry KR, Parry JV. Comparative evaluation of 15 serological assays for the detection of syphilis infection. Eur J Clin Microbiol Infect Dis 2007; 26:705-13. [PMID: 17647033 DOI: 10.1007/s10096-007-0346-9] [Citation(s) in RCA: 39] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Fifteen commercial syphilis kits were assessed against the same moderately sized specimen panel that included 114 serum and plasma specimens from syphilis cases and 249 specimens from unselected blood donors. The 114 specimens from syphilis cases comprised 40 from cases of primary syphilis, 43 from cases of secondary syphilis, 19 from cases of early latent syphilis, and 12 from cases of late latent syphilis. Of the 15 kits, ten were enzyme immunoassays, four were Treponema pallidum haemagglutination assays, and one was a T. pallidum particle agglutination assay. Thirteen of the 15 kits gave final specificities of 100%; the other two kits were repeatedly reactive with one to two specimens. Initial sensitivities ranged from 93.9 to 99.1%. Most variation between kits was observed in results for the groups with untreated primary and treated late latent disease, although the differences were not statistically significant. The comparative data on kit performance derived from this study is useful for examining syphilis testing guidelines and for making informed purchasing decisions.
Collapse
Affiliation(s)
- M J Cole
- Centre for Infections, Health Protection Agency, 61 Colindale Ave, London, NW9 5EQ, UK
| | | | | |
Collapse
|
12
|
Abstract
PURPOSE OF REVIEW Untreated syphilis may have profound adverse effects on pregnancy outcome, resulting in spontaneous abortion, stillbirth, premature delivery or perinatal death, or can result in significant morbidity during infancy, childhood or adolescence. In this article, we review current strategies for the management of maternal and congenital syphilis nationally and in resource-poor settings. RECENT FINDINGS Since 1998, a dramatic increase in syphilis diagnoses has been documented among women of child-bearing age in the UK and elsewhere. The low prevalence of congenital syphilis in many developed countries may have led to complacency, hindering modern-day management of this historically important condition. Follow-up studies indicate that present antenotal and postnatal interventions could be improved. This conclusion extends to resource-poor settings endemic for syphilis in which rapid diagnostic techniques are currently being validated. SUMMARY A stringent follow-up of pregnant women with syphilis before delivery and a proactive approach to identifying and treating exposed neonates born to such patients are needed.
Collapse
|
13
|
Knight CS, Crum MA, Hardy RW. Evaluation of the LIAISON chemiluminescence immunoassay for diagnosis of syphilis. CLINICAL AND VACCINE IMMUNOLOGY : CVI 2007; 14:710-3. [PMID: 17460119 PMCID: PMC1951083 DOI: 10.1128/cvi.00068-07] [Citation(s) in RCA: 30] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
We report the results of an evaluation of the LIAISON Treponema pallidum-specific assay, a one-step sandwich chemiluminescence immunoassay (CLIA), as a screening test and as a confirmatory test for the diagnosis of syphilis. The assay was compared with the CAPTIA Syphilis-G enzyme immunoassay (EIA) and with a testing algorithm that also included the rapid plasma reagin (RPR) and T. pallidum particle agglutination (PA) assays. As a screening test, the CLIA showed levels of agreement with the EIA and with the algorithm, respectively, of 94.1 and 100% for 51 samples from patients with primary or secondary syphilis, 93.2 and 98.7% for 999 samples sent to the laboratory for routine syphilis testing, 84.5 and 94.0% for 200 samples from human immunodeficiency virus-positive patients, 98.0 and 100% for 200 samples from pregnant patients, and 94.3 and 98.3% for 992 samples from apparently healthy adults. As a confirmatory test, the CLIA showed 99% agreement with the EIA for 204 RPR-positive samples. After resolution with further T. pallidum PA testing and the discarding of one sample of insufficient quantity, there was 100% agreement for the remaining 203 samples. For the total group of 2,645 samples, the overall relative sensitivity was 95.8% and the relative specificity was 99.1%. We conclude that the LIAISON CLIA demonstrated excellent sensitivity and specificity when evaluated as a confirmatory test and as a screening test for syphilis among various patient populations, including specific populations with reportedly increased rates of false-positive nontreponemal test results.
Collapse
Affiliation(s)
- Carrie S Knight
- Department of Pathology, Division of Laboratory Medicine, P230 West Pavilion, University of Alabama at Birmingham, 619 South 19th St., Birmingham, AL 35233, USA
| | | | | |
Collapse
|
14
|
Woznicová V, Valisová Z. Performance of CAPTIA SelectSyph-G enzyme-linked immunosorbent assay in syphilis testing of a high-risk population: analysis of discordant results. J Clin Microbiol 2007; 45:1794-7. [PMID: 17442795 PMCID: PMC1933105 DOI: 10.1128/jcm.02259-06] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
Using the Captia Select Syph-G enzyme-linked immunosorbent assay (ELISA), we analyzed the sera of 1,771 patients from a high-risk population attending sexually transmitted disease (STD) clinics. We focused on discrepancies between the results of the immunoglobulin G (IgG) ELISA and the Treponema pallidum hemagglutination (TPHA) test. We identified 57 patients (3.22%) with conflicting results in the IgG ELISA and TPHA test. In order to resolve these discrepancies, these patients' health records were reviewed and additional serological tests (rapid plasma reagin, IgM ELISA, fluorescent treponemal antibody absorption, and Western blotting) were performed. We subsequently diagnosed 22 of these 57 (38.6%) patients with late latent syphilis. None of the patients with discordant test results was diagnosed with early syphilis. We followed 35 of these 57 patients, analyzing two consecutive serum samples at 3 weeks and at 3 months. Discordant results persisted in 12 (33.3%) patients. We successfully resolved the test result discrepancies for 28 patients (80%) involved in follow-up. Captia SelectSyph-G ELISA showed a sensitivity of 99.0%, a specificity of 98.0%, and positive and negative predictive values of 99.3% and 97.2%, respectively. Based on the results of this study, we conclude that the Captia SelectSyph-G ELISA is a reliable tool for syphilis testing in a high-risk population and recommend the utilization of the Captia SelectSyph-G ELISA as a confirmatory test in at-risk patients.
Collapse
Affiliation(s)
- Vladana Woznicová
- Department of Medical Microbiology, Faculty of Medicine, Masaryk University, Pekarska 53, 656 91 Brno, Czech Republic.
| | | |
Collapse
|
15
|
Ratnam S. The laboratory diagnosis of syphilis. THE CANADIAN JOURNAL OF INFECTIOUS DISEASES & MEDICAL MICROBIOLOGY = JOURNAL CANADIEN DES MALADIES INFECTIEUSES ET DE LA MICROBIOLOGIE MEDICALE 2005; 16:45-51. [PMID: 18159528 PMCID: PMC2095002 DOI: 10.1155/2005/597580] [Citation(s) in RCA: 124] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
Syphilis has several clinical manifestations, making laboratory testing a very important aspect of diagnosis. In North America, many unsuspected cases are discovered by laboratory testing. The etiological agent, Treponema pallidum, cannot be cultured, and there is no single optimal alternative test. Serological testing is the most frequently used approach in the laboratory diagnosis of syphilis. The present paper discusses the various serological and alternative tests currently available along with their limitations, and relates their results to the likely corresponding clinical stage of the disease. The need to use multiple tests is discussed, and the importance of quality control is noted. The complexity of syphilis serology means that the services of reference laboratories and clinical experts are often needed.
Collapse
Affiliation(s)
- Sam Ratnam
- Newfoundland Public Health Laboratory, St John's, Newfoundland
| |
Collapse
|
16
|
Castro R, Prieto ES, Santo I, Azevedo J, Exposto FDL. Evaluation of an enzyme immunoassay technique for detection of antibodies against Treponema pallidum. J Clin Microbiol 2003; 41:250-3. [PMID: 12517856 PMCID: PMC149557 DOI: 10.1128/jcm.41.1.250-253.2003] [Citation(s) in RCA: 43] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
In the present study, the performance of an enzyme-linked immunosorbent assay (ELISA) technique (Eti-syphilis-G and Eti-syphilis-M; DiaSorin) for detection of Treponema pallidum immunoglobulin M (IgM) and IgG antibodies for the laboratory diagnosis of syphilis was evaluated. Four hundred forty-one samples were studied. The sensitivity and specificity of the ELISA were 100 and 93%, respectively, compared with the results of a microhemagglutination assay for Treponema pallidum (MHA-TP) and 99.4 and 100%, respectively, compared with the results of the fluorescent treponemal antibody absorption (FTA-Abs) test. The results of the ELISA technique were concordant with those of MHA-TP for 98% of the samples tested, while the rate of concordance with the FTA-Abs test was 99.5%. The sensitivities of the rapid plasma reagin (RPR) test, MHA-TP, and the ELISA in the different phases of syphilis compared with the results of the FTA-Abs test were 92, 88, and 100%, respectively, for patients with primary syphilis; 100% for all tests evaluated for patients with secondary syphilis; 97.2, 99.4, and 100%, respectively, for patients with latent syphilis; and 57.9, 92.6, and 97.9%, respectively, for patients with past treated syphilis. The RPR test was reactive with 12 samples that were negative by all the specific tests. IgM antibodies were most frequently detected by the ELISA for IgM antibodies (32.8%) than by the FTA-Abs for IgM antibodies (28.4%). Detection of these antibodies by the FTA-Abs test and the ELISA for IgM antibodies decreased with the stage of disease (72 and 88%, respectively, for patients with primary syphilis to 17 and 19%, respectively, for patients with early latent syphilis). The high sensitivity and specificity of this ELISA technique during all stages of syphilis, together with the fact that it is a simple, objective, and easily automated method, lead us to believe that it could be used as a screening test for syphilis.
Collapse
Affiliation(s)
- Rita Castro
- Unidade de Doenças Sexualmente Transmitidas, Centro de Malária e outras Doenças Tropicais, Instituto de Higiene e Medicina Tropical, Lisbon, Portugal.
| | | | | | | | | |
Collapse
|
17
|
Abstract
The organism that causes syphilis, Treponema pallidum, is impossible to culture in the clinical laboratory. Direct visualization of the pathogen is one laboratory technique used in the diagnosis of syphilis. Currently, serologic testing is the most widely used laboratory technique in diagnosing syphilis and monitoring its course after treatment. Serologic tests are divided into two categories, the nontreponemal and treponemal antibody tests. Newer techniques such as enzyme immunoassays have shown excellent results.
Collapse
Affiliation(s)
- B Clyne
- Division of Emergency Medicine, Department of Surgery, University of Maryland Medical System, Baltimore, MD 21201, USA
| | | |
Collapse
|
18
|
Wicher K, Horowitz HW, Wicher V. Laboratory methods of diagnosis of syphilis for the beginning of the third millennium. Microbes Infect 1999; 1:1035-49. [PMID: 10617935 DOI: 10.1016/s1286-4579(99)80521-8] [Citation(s) in RCA: 33] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
Despite that the whole genome of T. pallidum, the causative agent of syphilis, has been sequenced, syphilis is, and will remain for some time, diagnosed by direct clinical observation and by laboratory methods. This review presents comprehensively most of the practical techniques used for direct detection of T. pallidum and lists all practical methods for phospholipid and treponemal antibodies detection. It describes most novel tests for syphilis, discusses problems with sero-creossreactivity in Lyme disease, immune responses in HIV-syphilis coinfected patients, and reviews serologic responses to antibiotic treatment.
Collapse
Affiliation(s)
- K Wicher
- Wadsworth Center, New York State Department of Health, Albany, NY, USA
| | | | | |
Collapse
|
19
|
Abstract
Microbiologic tests are essential in the diagnosis and management of patients with syphilis. Apart from the very early stage of disease (when T. pallidum may be detected in the lesions of primary syphilis before an antibody response is detectable) serology is the mainstay of laboratory testing. The performance of cardiolipin antigen ("reagin") and treponemal antigen (native and recombinant) tests is discussed in relation to the stage of syphilis, treatment status, and interactions between syphilis and HIV infection. Screening with cardiolipin antigen tests detects early stage disease, but treponemal antigen tests are required for the reliable detection of late-stage infection and the exclusion of syphilis in HIV-infected patients. EIA tests using treponemal antigen are sensitive and specific and fit well into current laboratory practices. Although the FTA-abs test is often considered the "gold standard" confirmatory test, its sensitivity is slightly lower than that of certain other treponemal antigen tests. A reactive antitreponemal IgM test correlates well with untreated or recently treated early infection, but specific IgM tests are often negative in untreated late-stage disease. Serial quantitative cardiolipin antigen tests remain the method of choice for monitoring the efficacy of treatment. The role of the laboratory in aiding a diagnosis of neurosyphilis and congenital infection is discussed briefly, as is the current status of newer technologies, such as PCR and immunoblotting.
Collapse
Affiliation(s)
- H Young
- Scottish Neisseria gonorrhoeae Reference Laboratory, Edinburgh University Medical School, Scotland.
| |
Collapse
|
20
|
Young H, Moyes A, Seagar L, McMillan A. Novel recombinant-antigen enzyme immunoassay for serological diagnosis of syphilis. J Clin Microbiol 1998; 36:913-7. [PMID: 9542908 PMCID: PMC104660 DOI: 10.1128/jcm.36.4.913-917.1998] [Citation(s) in RCA: 61] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
Enzyme immunoassay (EIA) is an ideal method for screening large numbers of patients for syphilis. We evaluated a novel immune-capture EIA (ICE Syphilis; Murex Diagnostics) that uses three recombinant Treponema pallidum antigens (TpN15, TpN17, and TpN47) and compared the results with those obtained by the native T. pallidum antigen EIA (Captia SelectSyph-G; Centocor) that we currently use for the serodiagnosis of syphilis. Specificity was evaluated by screening 1,184 unselected serum specimens in parallel by the ICE Syphilis and SelectSyph-G assays, while sensitivity was tested with a panel of 101 serum specimens containing antitreponemal antibodies (treated and untreated) from patients with various stages of infection. The specificity of the ICE Syphilis EIA (99.8%) on screening was significantly higher (P < 0.02) than that of the SelectSyph-G EIA (99.2%). The sensitivity of the ICE Syphilis EIA was significantly higher (P < 0.01) than that of the SelectSyph-G EIA on both initial (99 versus 91.4%) and repeat (100 versus 92.4%) testing. The ICE Syphilis EIA was also significantly more sensitive (P < 0.01) than the fluorescent treponemal antibody-abs (92.4%) but not the T. pallidum hemagglutination assay (97.1%). Sera containing antitreponemal antibodies gave a much higher antibody index (absorbance of test serum/kit cutoff) by the ICE Syphilis EIA than by the SelectSyph-G EIA. This combined with the overall high sensitivity makes the ICE Syphilis EIA an ideal test for excluding or detecting treponemal infection in human immunodeficiency virus (HIV)-infected patients. The ICE Syphilis EIA was positive with sera from all 15 HIV-infected patients in the study, whereas sera from 3 HIV-infected patients were negative by the SelectSyph-G EIA. We conclude that the high sensitivity and specificity of the ICE Syphilis EIA and its suitability for automation make it an ideal screening test.
Collapse
Affiliation(s)
- H Young
- Department of Medical Microbiology, Edinburgh University Medical School, Scotland, United Kingdom.
| | | | | | | |
Collapse
|
21
|
Reisner BS, Mann LM, Tholcken CA, Waite RT, Woods GL. Use of the Treponema pallidum-specific captia syphilis IgG assay in conjunction with the rapid plasma reagin to test for syphilis. J Clin Microbiol 1997; 35:1141-3. [PMID: 9114396 PMCID: PMC232718 DOI: 10.1128/jcm.35.5.1141-1143.1997] [Citation(s) in RCA: 17] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023] Open
Abstract
The Captia Syphilis IgG enzyme immunoassay (EIA) was evaluated for use in conjunction with the rapid plasma reagin test (RPR) as a method to test for syphilis. A total of 1,288 serum specimens were tested by the routine laboratory protocol of the RPR followed by microhemagluttination assay for Treponema pallidum (MHA-TP) testing of RPR-reactive sera as well as the EIA-RPR protocol in which the automated EIA followed by a manual RPR test for EIA-positive specimens is used. When using the routine protocol, 131 specimens were initially reactive by the RPR, and 113 of these were reactive by MHA-TP. When using the EIA-RPR protocol, 170 specimens were initially positive by EIA, and of these, 112 were RPR reactive, indicating active disease. When compared to the routine protocol, the EIA-RPR protocol had sensitivity, specificity, and positive and negative predictive values of 96.5, 99.7, 97.3, and 99.7%, respectively. After resolution of discrepancies by additional testing, the adjusted sensitivity, specificity, and positive and negative predictive values were 100, 99.8, 98.3, and 100%, respectively. This evaluation demonstrates that when used in conjunction with the RPR, the Captia Syphilis EIA is a reliable method by which to test for syphilis.
Collapse
Affiliation(s)
- B S Reisner
- Department of Pathology, University of Texas Medical Branch, Galveston 77555-0740, USA.
| | | | | | | | | |
Collapse
|
22
|
D'Errico MM, Mariottini M, Tombolesi P, Di Rosa S, Prospero E, Raffo M, Carle F. Syphilis and blood donors: comparison of two different diagnostic strategies. Eur J Epidemiol 1996; 12:77-80. [PMID: 8817182 DOI: 10.1007/bf00144432] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
In this study the validity of the methods provided for by Italian law (VDRL or RPR tests) were compared with the diagnostic strategy suggested by WHO (the use of VDRL and TPHA tests in parallel). Sensitivity, specificity and posterior probability of infection after a positive or a negative result were estimated. The application of two tests in parallel produces a statistically significant increase of sensitivity from 47% to 98% while the increase of proportion of false positives is not significant (from 15% to 16%). Probability of infection when the result is negative to the RPR is 0.07% while a negative result to the RPR and the TPHA tests has a probability to be really infected of 0.003%. The use of the two tests (RPR and TPHA) in parallel is able to give the highest degree of sensitivity, indispensable to select possible blood donors, while maintaining a good degree of specificity. The authors concluded that the use of VDRL alone does not exclude infectivity of a blood sample, and in accordance with WHO and international recommendations, the VDRL or RPR and TPHA tests should be used in parallel for syphilis screening.
Collapse
Affiliation(s)
- M M D'Errico
- Institute of Infectious Diseases and Public Health, Chair of Hygiene, University of Ancona, Italy
| | | | | | | | | | | | | |
Collapse
|
23
|
Silletti RP. Comparison of CAPTIA syphilis G enzyme immunoassay with rapid plasma reagin test for detection of syphilis. J Clin Microbiol 1995; 33:1829-31. [PMID: 7665653 PMCID: PMC228278 DOI: 10.1128/jcm.33.7.1829-1831.1995] [Citation(s) in RCA: 19] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023] Open
Abstract
The CAPTIA Syphilis G enzyme-linked immunosorbent assay compared favorably with the rapid plasma reagin test when used to screen for syphilis in a low-risk population. The sensitivity and specificity of the CAPTIA Syphilis G test were 100 and 97.8%, respectively, for 646 routine specimens and 100 and 99.2%, respectively, for 265 specimens from obstetrics patients. Overall, for 911 specimens, the CAPTIA Syphilis G test showed a sensitivity of 100%, a specificity of 98.2%, and positive and negative predictive values of 78.9 and 100%, respectively. For the same population, the rapid plasma reagin test showed a sensitivity and a specificity of 96.4 and 97.5%, respectively, and positive and negative predictive values of 72 and 99.8%, respectively.
Collapse
Affiliation(s)
- R P Silletti
- Division of Clinical Microbiology, City Hospital Center at Elmhurst, New York 11373, USA
| |
Collapse
|
24
|
Zrein M, Maure I, Boursier F, Soufflet L. Recombinant antigen-based enzyme immunoassay for screening of Treponema pallidum antibodies in blood bank routine. J Clin Microbiol 1995; 33:525-7. [PMID: 7751351 PMCID: PMC227984 DOI: 10.1128/jcm.33.3.525-527.1995] [Citation(s) in RCA: 34] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023] Open
Abstract
This work reports a comparison of an enzyme immunoassay (EIA) using two major Treponema pallidum recombinant antigens with a T. pallidum hemagglutination (TPHA) assay and a nontreponemal Venereal Disease Reference Laboratory (VDRL) test. A total of 1,822 normal donor serum samples was tested for cardiolipin and T. pallidum antibodies, respectively, by the VDRL assay and EIA. Among these samples, 440 were further tested by TPHA technology. Four samples were found positive by EIA, while all were reported to be negative by both TPHA and VDRL routine assays. Subsequent testing of EIA-positive samples confirmed 100% (four of four samples) and 25% (one of four samples) positive results, respectively, by immunofluorescence assay and a Western blot (immunoblot) syphilis kit. The sensitivity of the recombinant EIA was estimated at virtually 100% with a reference panel of 50 syphilitic samples. According to this study, the newly developed EIA kit shows 100% sensitivity combined to a specificity greater than 99.8% for detecting treponemal immunoglobulin G antibodies in blood bank syphilis screening.
Collapse
Affiliation(s)
- M Zrein
- Diagast Laboratories, Lille, France
| | | | | | | |
Collapse
|
25
|
Young H, Moyes A, Ross JD. Markers of past syphilis in HIV infection comparing Captia Syphilis G anti-treponemal IgG enzyme immunoassay with other treponemal antigen tests. Int J STD AIDS 1995; 6:101-4. [PMID: 7779920 DOI: 10.1177/095646249500600207] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
The sensitivity of the Captia Syphilis G anti-treponemal IgG enzyme immunoassay (EIA-IgG) was compared with the Treponema pallidum haemagglutination assay (TPHA) and the Fluorescent Treponemal Antibody Absorbed (FTA-Abs) test as a marker for past syphilis in 28 HIV-infected and 31 HIV-negative patients with a past history of syphilis. The specificity of EIA-IgG was compared in 89 patients without a history of syphilis who were known to be HIV antibody positive with a control group of 89 patients who had tested HIV negative. In patients with a past history of syphilis each treponemal test (EIA-IgG, TPHA and FTA-Abs) gave a lower sensitivity (82%, 86%, 79%) in the HIV-positive group than in the HIV-negative group (97%) but the difference was significant only in the case of the FTA-Abs test (P < 0.05). In the HIV-positive patients 11% (3/28) were negative in all 3 treponemal tests while 25% (7/28) were negative in at least one treponemal test. In patients without a past history of syphilis the EIA-IgG antibody index in the HIV-positive group (0.436) was significantly higher than in the HIV-negative group (0.378): the specificity, however, was similar in the HIV-positive (100%) and HIV-negative group (99%). We conclude that the Captia Syphilis G anti-treponemal IgG enzyme immunoassay is of similar specificity in HIV-positive and HIV-negative patients and is of similar sensitivity to the TPHA and FTA-Abs as a marker of past syphilis in HIV-infected patients.(ABSTRACT TRUNCATED AT 250 WORDS)
Collapse
Affiliation(s)
- H Young
- STD Diagnostic Reference Laboratory, Department of Medical Microbiology, Edinburgh University Medical School, UK
| | | | | |
Collapse
|
26
|
Larsen SA, Steiner BM, Rudolph AH. Laboratory diagnosis and interpretation of tests for syphilis. Clin Microbiol Rev 1995; 8:1-21. [PMID: 7704889 PMCID: PMC172846 DOI: 10.1128/cmr.8.1.1] [Citation(s) in RCA: 455] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023] Open
Abstract
The lack of a method for demonstrating the presence of Treponema pallidum by growth necessitates the use of alternative methods. Traditionally, these methods are divided into direct detection methods (animal inoculation, dark-field microscopy, etc.) and serologic tests for the presence of patient antibody against T. pallidum. Serologic methods are further divided into two classes. One class, the nontreponemal tests, detects antibodies to lipoidal antigens present in either the host or T. pallidum; examples are the Venereal Disease Research Laboratory and rapid plasma reagin and tests. Reactivity in these tests generally indicates host tissue damage that may not be specific for syphilis. Because these tests are easy and inexpensive to perform, they are commonly used for screening, and with proper clinical signs they are suggestive of syphilis. The other class of test, the treponemal tests, uses specific treponemal antigens. Confirmation of infection requires a reactive treponemal test. Examples of the treponemal tests are the microhemagglutination assay for antibodies to T. pallidum and the fluorescent treponemal antibody absorption test. These tests are more expensive and complicated to perform than the nontreponemal tests. On the horizon are a number of direct antigen, enzyme-linked immunosorbent assay, and PCR techniques. Several of these techniques have shown promise in clinical trials for the diagnosis of congenital syphilis and neurosyphilis that are presently difficult to diagnose.
Collapse
Affiliation(s)
- S A Larsen
- Division of Sexually Transmitted Diseases Laboratory Research, Centers for Disease Control and Prevention, Atlanta, Georgia 30333
| | | | | |
Collapse
|
27
|
Young H, Walker PJ, Merry D, Mifsud A. A preliminary evaluation of a prototype western blot confirmatory test kit for syphilis. Int J STD AIDS 1994; 5:409-14. [PMID: 7849118 DOI: 10.1177/095646249400500606] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
A prototype Western blot kit was evaluated as a confirmatory test for syphilis using 131 sera characterized by other serological tests for syphilis. There were 114 treponemal sera (including 94 cases of early syphilis, 83 of which were untreated) and 17 non-treponemal problem sera (11 gave false positive reactions on screening with the TmpA recombinant antigen enzyme immunoassay (EIA), 3 gave false positive fluorescent treponemal antibody absorbed (FTA-abs) tests, and 3 false positive Captia Syphilis G EIA results). Based on the manufacturer's criteria of reactivity in multiple bands for designating a positive result the Western blot test gave a sensitivity of 99.1% (113/114) and a specificity of 88.2% (15/17) when indeterminate reactions were scored positive and 98.2% (112/114) and 100% (17/17) when indeterminate reactions were scored negative. Sensitivity was high in both treated and untreated infection. Corresponding sensitivities for the TPHA and FTA-abs when equivocal reactions were scored negative were 97.5% (111/114) and 99.1% (113/114). The high sensitivity of the FTA-abs in this study is probably due to the large number of untreated primary infections. Our results with the Western blot, confirm earlier studies using 'in-house' test systems and, support a role for a commercial Western blot test in the confirmatory diagnosis of syphilis. Further studies are required to confirm the high specificity and sensitivity of the kit in a larger series including a wider variety of non-treponemal cases as well as patients with untreated and treated infection.
Collapse
Affiliation(s)
- H Young
- Department of Medical Microbiology, Edinburgh University Medical School, Scotland
| | | | | | | |
Collapse
|
28
|
Hooper NE, Malloy DC, Passen S. Evaluation of a Treponema pallidum enzyme immunoassay as a screening test for syphilis. CLINICAL AND DIAGNOSTIC LABORATORY IMMUNOLOGY 1994; 1:477-81. [PMID: 8556488 PMCID: PMC368293 DOI: 10.1128/cdli.1.4.477-481.1994] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
The CAPTIA Syphilis-G enzyme immunoassay for the detection of antibodies to Treponema pallidum was evaluated as a screening test for syphilis in comparison with the standard rapid plasma reagin (RPR) test. One thousand samples were tested, and the standard fluorescent treponemal antibody absorption test and the standard microhemmaglutination test were used to confirm the presence of treponemal antibodies. Diagnosis of syphilis was based on traditional standard serology results. Clinical data used in the diagnosis of patients whose samples yielded conflicting results were provided by physicians. Initially, 7 patients whose samples were reactive in the RPR test and 14 patients whose samples yielded positive or equivocal results in the CAPTIA Syphilis-G test were diagnosed as not being infected. After discrepancies due to technical problems were reconciled, samples from six patients remained reactive in the RPR test and that from one patient remained positive in the CAPTIA Syphilis-G test. In addition, seven patients whose samples were nonreactive in the RPR test and two patients whose samples were negative in the CAPTIA Syphilis-G test were diagnosed as having untreated syphilis. After discrepancies were reconciled, samples from five patients remained nonreactive in the RPR test and none remained negative in the CAPTIA Syphilis-G test. Final results indicate that the specificities are 99.4 and 99.9%, respectively. In addition to the improved sensitivity and specificity of the CAPTIA Syphilis-G screen, other potential benefits of this assay lead us to believe that this method could serve as a better screening tool than the RPR test.
Collapse
Affiliation(s)
- N E Hooper
- Maryland Medical Laboratory, Inc., Baltimore 21227, USA
| | | | | |
Collapse
|
29
|
Affiliation(s)
- J J van der Sluis
- Department of Dermato-Venereology, Erasmus University, Rotterdam, The Netherlands
| |
Collapse
|
30
|
|