1
|
Hamada Y, Gupta RK, Quartagno M, Izzard A, Acuna-Villaorduna C, Altet N, Diel R, Dominguez J, Floyd S, Gupta A, Huerga H, Jones-López EC, Kinikar A, Lange C, van Leth F, Liu Q, Lu W, Lu P, Rueda IL, Martinez L, Mbandi SK, Muñoz L, Padilla ES, Paradkar M, Scriba T, Sester M, Shanaube K, Sharma SK, Sloot R, Sotgiu G, Thiruvengadam K, Vashishtha R, Abubakar I, Rangaka MX. Predictive performance of interferon-gamma release assays and the tuberculin skin test for incident tuberculosis: an individual participant data meta-analysis. EClinicalMedicine 2023; 56:101815. [PMID: 36636295 PMCID: PMC9829704 DOI: 10.1016/j.eclinm.2022.101815] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 12/14/2022] [Accepted: 12/19/2022] [Indexed: 01/06/2023] Open
Abstract
Background Evidence on the comparative performance of purified protein derivative tuberculin skin tests (TST) and interferon-gamma release assays (IGRA) for predicting incident active tuberculosis (TB) remains conflicting. We conducted an individual participant data meta-analysis to directly compare the predictive performance for incident TB disease between TST and IGRA to inform policy. Methods We searched Medline and Embase from 1 January 2002 to 4 September 2020, and studies that were included in previous systematic reviews. We included prospective longitudinal studies in which participants received both TST and IGRA and estimated performance as hazard ratios (HR) for the development of all diagnoses of TB in participants with dichotomised positive test results compared to negative results, using different thresholds of positivity for TST. Secondary analyses included an evaluation of the impact of background TB incidence. We also estimated the sensitivity and specificity for predicting TB. We explored heterogeneity through pre-defined sub-group analyses (e.g. country-level TB incidence). Publication bias was assessed using funnel plots and Egger's test. This review is registered with PROSPERO, CRD42020205667. Findings We obtained data from 13 studies out of 40 that were considered eligible (N = 32,034 participants: 36% from countries with TB incidence rate ≥100 per 100,000 population). All reported data on TST and QuantiFERON Gold in-Tube (QFT-GIT). The point estimate for the TST was highest with higher cut-offs for positivity and particularly when stratified by bacillus Calmette-Guérin vaccine (BCG) status (15 mm if BCG vaccinated and 5 mm if not [TST5/15 mm]) at 2.88 (95% CI 1.69-4.90). The pooled HR for QFT-GIT was higher than for TST at 4.15 (95% CI 1.97-8.75). The difference was large in countries with TB incidence rate <100 per 100,000 population (HR 10.38, 95% CI 4.17-25.87 for QFT-GIT VS. HR 5.36, 95% CI 3.82-7.51 for TST5/15 mm) but much of this difference was driven by a single study (HR 5.13, 95% CI 3.58-7.35 for TST5/15 mm VS. 7.18, 95% CI 4.48-11.51 for QFT-GIT, when excluding the study, in which all 19 TB cases had positive QFT-GIT results). The comparative performance was similar in the higher burden countries (HR 1.61, 95% CI 1.23-2.10 for QFT-GIT VS. HR 1.72, 95% CI 0.98-3.01 for TST5/15 mm). The predictive performance of both tests was higher in countries with TB incidence rate <100 per 100,000 population. In the lower TB incidence countries, the specificity of TST (76% for TST5/15 mm) and QFT-GIT (74%) for predicting active TB approached the minimum World Health Organization target (≥75%), but the sensitivity was below the target of ≥75% (63% for TST5/15 mm and 65% for QFT-GIT). The absolute differences in positive and negative predictive values between TST15 mm and QFT-GIT were small (positive predictive values 2.74% VS. 2.46%; negative predictive values 99.42% VS. 99.52% in low-incidence countries). Egger's test did not show evidence of publication bias (0.74 for TST15 mm and p = 0.68 for QFT-GIT). Interpretation IGRA appears to have higher predictive performance than the TST in low TB incidence countries, but the difference was driven by a single study. Any advantage in clinical performance may be small, given the numerically similar positive and negative predictive values. Both IGRA and TST had lower performance in countries with high TB incidence. Test choice should be contextual and made considering operational and likely clinical impact of test results. Funding YH, IA, and MXR were supported by the National Institute for Health and Care Research (NIHR), United Kingdom (RP-PG-0217-20009). MQ was supported by the Medical Research Council [MC_UU_00004/07].
Collapse
Affiliation(s)
- Yohhei Hamada
- Institute for Global Health, University College London, London, United Kingdom
| | - Rishi K. Gupta
- Institute for Global Health, University College London, London, United Kingdom
| | - Matteo Quartagno
- MRC Clinical Trials Unit, Institute of Clinical Trials and Methodology, University College London, London, United Kingdom
| | - Abbie Izzard
- Institute for Global Health, University College London, London, United Kingdom
| | | | - Neus Altet
- Unitat de Tuberculosis, Hospital Universitari Vall d’Hebron-Drassanes, Barcelona, Spain
- Unitat de TDO de la Tuberculosis ‘Servicios Clínicos’, Barcelona, Spain
| | - Roland Diel
- Institute for Epidemiology, University Hospital Schleswig-Holstein, Campus Kiel, Kiel, Germany
| | - Jose Dominguez
- Institut d'Investigació Germans Trias i Pujol, CIBER Enfermedades Respiratorias, Instituto de Salud Carlos III, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Sian Floyd
- Department of Infectious Disease Epidemiology, London School of Hygiene & Tropical Medicine, London, United Kingdom
| | - Amita Gupta
- Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | | | - Edward C. Jones-López
- Division of Infectious Diseases, Department of Medicine, Keck School of Medicine of USC, University of Southern California, Los Angeles, CA, USA
| | - Aarti Kinikar
- Byramjee Jeejeebhoy Government Medical College and Sassoon General Hospital, Pune, Maharashtra, India
| | - Christoph Lange
- Division of Clinical Infectious Diseases, Research Center Borstel, Borstel, Germany
- German Center for Infection Research (DZIF), Clinical Tuberculosis Unit, Borstel, Germany
- Respiratory Medicine & International Health, University of Lübeck, Lübeck, Germany
- Baylor College of Medicine and Texas Children's Hospital, Houston, TX, USA
- Tuberculosis Network European Trials Group (TBnet), Borstel, Germany
| | - Frank van Leth
- Tuberculosis Network European Trials Group (TBnet), Borstel, Germany
- Department of Health Sciences, VU University, Amsterdam, the Netherlands
- Amsterdam Public Health research institute, Amsterdam, the Netherlands
| | - Qiao Liu
- Department of Chronic Communicable Disease, Center for Disease Control and Prevention of Jiangsu Province, Nanjing, Jiangsu Province, PR China
| | - Wei Lu
- Department of Chronic Communicable Disease, Center for Disease Control and Prevention of Jiangsu Province, Nanjing, Jiangsu Province, PR China
| | - Peng Lu
- Department of Chronic Communicable Disease, Center for Disease Control and Prevention of Jiangsu Province, Nanjing, Jiangsu Province, PR China
| | - Irene Latorre Rueda
- Institut d'Investigació Germans Trias i Pujol, CIBER Enfermedades Respiratorias, Instituto de Salud Carlos III, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Leonardo Martinez
- Department of Epidemiology, School of Public Health, Boston University, Boston, MA, USA
| | - Stanley Kimbung Mbandi
- South African Tuberculosis Vaccine Initiative, Institute of Infectious Disease and Molecular Medicine, and Division of Immunology, Department of Pathology, University of Cape Town, South Africa, Western Cape, South Africa
| | - Laura Muñoz
- Department of Clinical Sciences, University of Barcelona, Barcelona, Spain
| | | | - Mandar Paradkar
- Byramjee Jeejeebhoy Government Medical College-Johns Hopkins University Clinical Research Site, Pune, Maharashtra, India
- Johns Hopkins India, Pune, Maharashtra, India
| | - Thomas Scriba
- South African Tuberculosis Vaccine Initiative, Institute of Infectious Disease and Molecular Medicine, and Division of Immunology, Department of Pathology, University of Cape Town, South Africa, Western Cape, South Africa
| | - Martina Sester
- Tuberculosis Network European Trials Group (TBnet), Borstel, Germany
- Department of Transplant and Infection Immunology, Saarland University, Homburg, Germany
| | | | - Surendra K. Sharma
- Department of Internal Medicine, All India Institute of Medical Sciences, New Delhi, India
- Department of Molecular Medicine, Jamia Hamdard Institute of Molecular Medicine, Hamdard University, Delhi, India
- Departments of General Medicine & Pulmonary Medicine, JNMC, Datta Meghe Institute of Medical Sciences, Maharashtra, India
| | - Rosa Sloot
- Desmond Tutu TB Centre, Department of Paediatrics and Child Health, Faculty of Medicine and Health Sciences, Stellenbosch University, Cape Town, South Africa
| | - Giovanni Sotgiu
- Tuberculosis Network European Trials Group (TBnet), Borstel, Germany
- Clinical Epidemiology and Medical Statistics Unit, Department of Medicine, Surgery and Pharmacy, University of Sassari, Sassari, Italy
| | - Kannan Thiruvengadam
- National Institute for Research in Tuberculosis, Indian Council of Medical Research, Chennai, Tamil Nadu, India
| | - Richa Vashishtha
- Department of Internal Medicine, All India Institute of Medical Sciences, New Delhi, India
| | - Ibrahim Abubakar
- Institute for Global Health, University College London, London, United Kingdom
| | - Molebogeng X. Rangaka
- Institute for Global Health, University College London, London, United Kingdom
- School of Public Health, and Clinical Infectious Disease Research Institute-Africa, University of Cape Town, Cape Town, South Africa
| |
Collapse
|
2
|
Ahmed A, Feng PJI, Gaensbauer JT, Reves RR, Khurana R, Salcedo K, Punnoose R, Katz DJ. Interferon-γ Release Assays in Children <15 Years of Age. Pediatrics 2020; 145:peds.2019-1930. [PMID: 31892518 PMCID: PMC9301964 DOI: 10.1542/peds.2019-1930] [Citation(s) in RCA: 28] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 10/22/2019] [Indexed: 11/24/2022] Open
Abstract
OBJECTIVES The tuberculin skin test (TST) has been preferred for screening young children for latent tuberculosis infection (LTBI) because of concerns that interferon-γ release assays (IGRAs) may be less sensitive in this high-risk population. In this study, we compared the predictive value of IGRAs to the TST for progression to tuberculosis disease in children, including those <5 years old. METHODS Children <15 years old at risk for LTBI or progression to disease were tested with TST, QuantiFERON-TB Gold In-Tube test (QFT-GIT), and T-SPOT.TB test (T-SPOT) and followed actively for 2 years, then with registry matches, to identify incident disease. RESULTS Of 3593 children enrolled September 2012 to April 2016, 92% were born outside the United States; 25% were <5 years old. Four children developed tuberculosis over a median 4.3 years of follow-up. Sensitivities for progression to disease for TST and IGRAs were low (50%-75%), with wide confidence intervals (CIs). Specificities for TST, QFT-GIT, and T-SPOT were 73.4% (95% CI: 71.9-74.8), 90.1% (95% CI: 89.1-91.1), and 92.9% (95% CI: 92.0-93.7), respectively. Positive and negative predictive values for TST, QFT-GIT, and T-SPOT were 0.2 (95% CI: 0.1-0.8), 0.9 (95% CI: 0.3-2.5), and 0.8 (95% CI: 0.2-2.9) and 99.9 (95% CI: 99.7-100), 100 (95% CI: 99.8-100), and 99.9 (95% CI: 99.8-100), respectively. Of 533 children with TST-positive, IGRA-negative results not treated for LTBI, including 54 children <2 years old, none developed disease. CONCLUSIONS Although both types of tests poorly predict disease progression, IGRAs are no less predictive than the TST and offer high specificity and negative predictive values. Results from this study support the use of IGRAs for children, especially those who are not born in the United States.
Collapse
Affiliation(s)
- Amina Ahmed
- Levine Children's Hospital at Atrium Health, Charlotte, North Carolina;
| | - Pei-Jean I. Feng
- Division of Tuberculosis Elimination, Centers for Disease Control and Prevention, Atlanta, Georgia
| | | | | | - Renuka Khurana
- Maricopa County Department of Public Health, Phoenix, Arizona
| | - Katya Salcedo
- Tuberculosis Control Branch, California Department of Public Health, Richmond, California
| | | | - Dolly J. Katz
- Division of Tuberculosis Elimination, Centers for Disease Control and Prevention, Atlanta, Georgia
| | | |
Collapse
|
3
|
Abubakar I, Lalvani A, Southern J, Sitch A, Jackson C, Onyimadu O, Lipman M, Deeks JJ, Griffiths C, Bothamley G, Kon OM, Hayward A, Lord J, Drobniewski F. Two interferon gamma release assays for predicting active tuberculosis: the UK PREDICT TB prognostic test study. Health Technol Assess 2019; 22:1-96. [PMID: 30334521 DOI: 10.3310/hta22560] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023] Open
Abstract
BACKGROUND Despite a recent decline in the annual incidence of tuberculosis (TB) in the UK, rates remain higher than in most Western European countries. The detection and treatment of latent TB infection (LTBI) is an essential component of the UK TB control programme. OBJECTIVES To assess the prognostic value and cost-effectiveness of the current two interferon gamma release assays (IGRAs) compared with the standard tuberculin skin test (TST) for predicting active TB among untreated individuals at increased risk of TB: (1) contacts of active TB cases and (2) new entrants to the UK from high-TB-burden countries. DESIGN A prospective cohort study and economic analysis. PARTICIPANTS AND SETTING Participants were recruited in TB clinics, general practices and community settings. Contacts of active TB cases and migrants who were born in high-TB-burden countries arriving in the UK were eligible to take part if they were aged ≥ 16 years. MAIN OUTCOME MEASURES Outcomes include incidence rate ratios comparing the incidence of active TB in those participants with a positive test result and those with a negative test result for each assay, and combination of tests and the cost per quality-adjusted life-year (QALY) for each screening strategy. RESULTS A total of 10,045 participants were recruited between May 2010 and July 2015. Among 9610 evaluable participants, 97 (1.0%) developed active TB. For the primary analysis, all test data were available for 6380 participants, with 77 participants developing active TB. A positive result for TSTa (positive if induration is ≥ 5 mm) was a significantly poorer predictor of progression to active TB than a positive result for any of the other tests. Compared with TSTb [positive if induration is ≥ 6 mm without prior bacillus Calmette-Guérin (BCG) alone, T-SPOT®.TB (Oxford Immunotec Ltd, Oxford, UK), TSTa + T-SPOT.TB, TSTa + IGRA and the three combination strategies including TSTb were significantly superior predictors of progression. Compared with the T-SPOT.TB test alone, TSTa + T-SPOT.TB, TSTb + QuantiFERON® TB Gold In-Tube (QFT-GIT; QIAGEN GmbH, Hilden, Germany) and TSTb + IGRA were significantly superior predictors of progression and, compared with QFT-GIT alone, T-SPOT.TB, TSTa + T-SPOT.TB, TSTa + QFT-GIT, TSTa + IGRA, TSTb + T-SPOT.TB, TSTb + QFT-GIT and TSTb + IGRA were significantly superior predictors of progression. When evaluating the negative predictive performance of tests and strategies, negative results for TSTa + QFT-GIT were significantly poorer predictors of non-progression than negative results for TSTa, T-SPOT.TB and TSTa + IGRA. The most cost-effective LTBI testing strategies are the dual-testing strategies. The cost and QALY differences between the LTBI testing strategies were small; in particular, QFT-GIT, TSTb + T-SPOT.TB and TSTb + QFT-GIT had very similar incremental net benefit estimates. CONCLUSION This study found modest differences between tests, or combinations of tests, in identifying individuals who would go on to develop active TB. However, a two-step approach that combined TSTb with an IGRA was the most cost-effective testing option. IMPLICATIONS FOR PRACTICE AND FUTURE RESEARCH The two-step TSTb strategy, which stratified the TST by prior BCG vaccination followed by an IGRA, was the most cost-effective approach. The limited ability of current tests to predict who will progress limits the clinical utility of tests. The implications of these results for the NHS England/Public Health England national TB screening programme for migrants should be investigated. STUDY REGISTRATION This study is registered as NCT01162265. FUNDING The National Institute for Health Research Health Technology Assessment programme.
Collapse
Affiliation(s)
- Ibrahim Abubakar
- Institute for Global Health, University College London, London, UK
| | - Ajit Lalvani
- Tuberculosis Research Centre, National Heart and Lung Institute, Imperial College London, London, UK
| | - Jo Southern
- National Infection Service, Public Health England, London, UK
| | - Alice Sitch
- Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | | | - Oluchukwu Onyimadu
- Southampton Health Technology Assessment Centre, University of Southampton, Southampton, UK
| | - Marc Lipman
- Respiratory Medicine, University College London, London, UK
| | - Jonathan J Deeks
- Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Chris Griffiths
- Blizard Institute, Queen Mary University of London, London, UK
| | | | - Onn Min Kon
- Imperial College Healthcare NHS Trust, London, UK
| | - Andrew Hayward
- Institute of Epidemiology and Health Care, University College London, London, UK
| | - Joanne Lord
- Southampton Health Technology Assessment Centre, University of Southampton, Southampton, UK
| | - Francis Drobniewski
- Tuberculosis Research Centre, National Heart and Lung Institute, Imperial College London, London, UK
| |
Collapse
|
4
|
Meier NR, Volken T, Geiger M, Heininger U, Tebruegge M, Ritz N. Risk Factors for Indeterminate Interferon-Gamma Release Assay for the Diagnosis of Tuberculosis in Children-A Systematic Review and Meta-Analysis. Front Pediatr 2019; 7:208. [PMID: 31192175 PMCID: PMC6548884 DOI: 10.3389/fped.2019.00208] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/14/2018] [Accepted: 05/08/2019] [Indexed: 12/26/2022] Open
Abstract
Background: Interferon-gamma release assays (IGRA) are well-established immunodiagnostic tests for tuberculosis (TB) in adults. In children these tests are associated with higher rates of false-negative and indeterminate results. Age is presumed to be one factor influencing cytokine release and therefore test performance. The aim of this study was to systematically review factors associated with indeterminate IGRA results in pediatric patients. Methods: Systematic literature review guided by the preferred reporting items for systematic reviews and meta-analyses (PRISMA) searching PubMed, EMBASE, and Web of Science. Studies reporting results of at least one commercially available IGRA (QuantiFERON-TB, T-SPOT.TB) in pediatric patient groups were included. Random effects meta-analysis was used to assess proportions of indeterminate IGRA results. Heterogeneity was assessed using the I2 value. Risk differences were calculated for studies comparing QuantiFERON-TB and T-SPOT.TB in the same study. Meta-regression was used to further explore the influence of study level variables on heterogeneity. Results: Of 1,293 articles screened, 133 studies were included in the final analysis. These assessed QuantiFERON-TB only in 77.4% (103/133), QuantiFERON-TB and T-SPOT.TB in 15.8% (21/133), and T-SPOT.TB only in 6.8% (9/133) resulting in 155 datasets including 107,418 participants. Overall 4% of IGRA results were indeterminate, and T-SPOT.TB (0.03, 95% CI 0.02-0.05) and QuantiFERON-TB assays (0.05, 95% CI 0.04-0.06) showed similar proportions of indeterminate results; pooled risk difference was-0.01 (95% CI -0.03 to 0.00). Significant differences with lower proportions of indeterminate assays with T-SPOT.TB compared to QuantiFERON-TB were only seen in subgroup analyses of studies performed in Africa and in non-HIV-infected immunocompromised patients. Meta-regression confirmed lower proportions of indeterminate results for T-SPOT.TB compared to QuantiFERON-TB only among studies that reported results from non-HIV-infected immunocompromised patients (p < 0.001). Conclusion: On average indeterminate IGRA results occur in 1 in 25 tests performed. Overall, there was no difference in the proportion of indeterminate results between both commercial assays. However, our findings suggest that in patients in Africa and/or patients with immunocompromising conditions other than HIV infection the T-SPOT.TB assay appears to produce fewer indeterminate results.
Collapse
Affiliation(s)
- Noëmi R Meier
- Mycobacterial Research Laboratory, University of Basel Children's Hospital, Basel, Switzerland.,Faculty of Medicine, University of Basel, Basel, Switzerland
| | - Thomas Volken
- School of Health Professions, Zürich University of Applied Sciences, Winterthur, Switzerland
| | - Marc Geiger
- Faculty of Medicine, University of Basel, Basel, Switzerland
| | - Ulrich Heininger
- Faculty of Medicine, University of Basel, Basel, Switzerland.,Paediatric Infectious Diseases and Vaccinology Unit, University of Basel Children's Hospital, Basel, Switzerland
| | - Marc Tebruegge
- UCL Great Ormond Street Institute of Child Health, University College London, London, United Kingdom.,Department of Paediatric Infectious Diseases and Immunology, Evelina London Children's Hospital, Guy's and St. Thomas' NHS Foundation Trust, London, United Kingdom.,Royal Children's Hospital Melbourne, Department of Paediatrics, University of Melbourne, Melbourne, VIC, Australia
| | - Nicole Ritz
- Mycobacterial Research Laboratory, University of Basel Children's Hospital, Basel, Switzerland.,Faculty of Medicine, University of Basel, Basel, Switzerland.,Paediatric Infectious Diseases and Vaccinology Unit, University of Basel Children's Hospital, Basel, Switzerland.,Royal Children's Hospital Melbourne, Department of Paediatrics, University of Melbourne, Melbourne, VIC, Australia
| |
Collapse
|
5
|
Erol S, Ciftci FA, Ciledag A, Kaya A, Kumbasar OO. Do higher cut-off values for tuberculin skin test increase the specificity and diagnostic agreement with interferon gamma release assays in immunocompromised Bacillus Calmette-Guérin vaccinated patients? Adv Med Sci 2018; 63:237-241. [PMID: 29427966 DOI: 10.1016/j.advms.2017.12.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2017] [Revised: 09/28/2017] [Accepted: 12/14/2017] [Indexed: 12/11/2022]
Abstract
PURPOSE Immunocompromised patients with latent tuberculosis infection (LTBI) are at high risk of progression to active tuberculosis. Detection and treatment of LTBI in this group of patients are very important to control active tuberculosis. Tuberculin skin test (TST) and interferon gamma release assays (IGRAs) are two methods for detection of LTBI. Diagnostic agreement between two tests are poor especially in Bacillus Calmette-Guérin (BCG) vaccinated immunocompromised patients. In this study, we tried to figure out if the use of a higher cut-off for TST increases diagnostic agreement with IGRAs and TST specificity and or not. MATERIALS/METHODS In this retrospective study, BCG vaccinated solid organ transplantation (SOT) candidates and patients scheduled for anti-tumor necrosis factor-alpha (anti- TNFα) treatment patients who underwent both TST and IGRAs between 2011 and 2017 were enrolled in the study. Diagnostic agreement between the two tests was assessed for 5, 10, 15mm cut-off values for all participants, SOT candidates and anti- TNFα treatment subgroups separately. RESULTS Fifty female and 55 male total 105 patients were included. In the anti- TNFα treatment group 92.8% of the patients were receiving at least one immunosuppressive drug. For all participants kappa (κ) values were 0.303, 0.370, 0.321 respectively for 5, 10 and 15mm cut-offs. For SOT candidates κ values were 0.488, 0.422, 0.288 respectively. For anti- TNFα treatment group κ values were 0.235, 0.332, 0.275 respectively. CONCLUSIONS In BCG vaccinated immunocompromised patients, the agreement between TST and QFT-GIT was poor regardless of cut-off value. And increasing the cut-off does not improve agreement.
Collapse
|
6
|
Auguste P, Tsertsvadze A, Pink J, Court R, Seedat F, Gurung T, Freeman K, Taylor-Phillips S, Walker C, Madan J, Kandala NB, Clarke A, Sutcliffe P. Accurate diagnosis of latent tuberculosis in children, people who are immunocompromised or at risk from immunosuppression and recent arrivals from countries with a high incidence of tuberculosis: systematic review and economic evaluation. Health Technol Assess 2018; 20:1-678. [PMID: 27220068 DOI: 10.3310/hta20380] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
BACKGROUND Tuberculosis (TB), caused by Mycobacterium tuberculosis (MTB) [(Zopf 1883) Lehmann and Neumann 1896], is a major cause of morbidity and mortality. Nearly one-third of the world's population is infected with MTB; TB has an annual incidence of 9 million new cases and each year causes 2 million deaths worldwide. OBJECTIVES To investigate the clinical effectiveness and cost-effectiveness of screening tests [interferon-gamma release assays (IGRAs) and tuberculin skin tests (TSTs)] in latent tuberculosis infection (LTBI) diagnosis to support National Institute for Health and Care Excellence (NICE) guideline development for three population groups: children, immunocompromised people and those who have recently arrived in the UK from high-incidence countries. All of these groups are at higher risk of progression from LTBI to active TB. DATA SOURCES Electronic databases including MEDLINE, EMBASE, The Cochrane Library and Current Controlled Trials were searched from December 2009 up to December 2014. REVIEW METHODS English-language studies evaluating the comparative effectiveness of commercially available tests used for identifying LTBI in children, immunocompromised people and recent arrivals to the UK were eligible. Interventions were IGRAs [QuantiFERON(®)-TB Gold (QFT-G), QuantiFERON(®)-TB Gold-In-Tube (QFT-GIT) (Cellestis/Qiagen, Carnegie, VA, Australia) and T-SPOT.TB (Oxford Immunotec, Abingdon, UK)]. The comparator was TST 5 mm or 10 mm alone or with an IGRA. Two independent reviewers screened all identified records and undertook a quality assessment and data synthesis. A de novo model, structured in two stages, was developed to compare the cost-effectiveness of diagnostic strategies. RESULTS In total, 6687 records were screened, of which 53 unique studies were included (a further 37 studies were identified from a previous NICE guideline). The majority of the included studies compared the strength of association for the QFT-GIT/G IGRA with the TST (5 mm or 10 mm) in relation to the incidence of active TB or previous TB exposure. Ten studies reported evidence on decision-analytic models to determine the cost-effectiveness of IGRAs compared with the TST for LTBI diagnosis. In children, TST (≥ 5 mm) negative followed by QFT-GIT was the most cost-effective strategy, with an incremental cost-effectiveness ratio (ICER) of £18,900 per quality-adjusted life-year (QALY) gained. In immunocompromised people, QFT-GIT negative followed by the TST (≥ 5 mm) was the most cost-effective strategy, with an ICER of approximately £18,700 per QALY gained. In those recently arrived from high TB incidence countries, the TST (≥ 5 mm) alone was less costly and more effective than TST (≥ 5 mm) positive followed by QFT-GIT or T-SPOT.TB or QFT-GIT alone. LIMITATIONS The limitations and scarcity of the evidence, variation in the exposure-based definitions of LTBI and heterogeneity in IGRA performance relative to TST limit the applicability of the review findings. CONCLUSIONS Given the current evidence, TST (≥ 5 mm) negative followed by QFT-GIT for children, QFT-GIT negative followed by TST (≥ 5 mm) for the immunocompromised population and TST (≥ 5 mm) for recent arrivals were the most cost-effective strategies for diagnosing LTBI that progresses to active TB. These results should be interpreted with caution given the limitations identified. The evidence available is limited and more high-quality research in this area is needed including studies on the inconsistent performance of tests in high-compared with low-incidence TB settings; the prospective assessment of progression to active TB for those at high risk; the relative benefits of two-compared with one-step testing with different tests; and improved classification of people at high and low risk for LTBI. STUDY REGISTRATION This study is registered as PROSPERO CRD42014009033. FUNDING The National Institute for Health Research Health Technology Assessment programme.
Collapse
Affiliation(s)
- Peter Auguste
- Warwick Evidence, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Alexander Tsertsvadze
- Evidence in Communicable Disease Epidemiology and Control, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Joshua Pink
- Warwick Evidence, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Rachel Court
- Warwick Evidence, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Farah Seedat
- Warwick Evidence, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Tara Gurung
- Warwick Evidence, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Karoline Freeman
- Warwick Evidence, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Sian Taylor-Phillips
- Warwick Evidence, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Clare Walker
- Warwick Evidence, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Jason Madan
- Clinical Trials Unit, Warwick Medical School, University of Warwick, Coventry, UK
| | - Ngianga-Bakwin Kandala
- Department of Mathematics and Information Sciences, Faculty of Engineering and Environment, Northumbria University, Newcastle upon Tyne, UK
| | - Aileen Clarke
- Warwick Evidence, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Paul Sutcliffe
- Warwick Evidence, Division of Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| |
Collapse
|
7
|
Doan TN, Eisen DP, Rose MT, Slack A, Stearnes G, McBryde ES. Interferon-gamma release assay for the diagnosis of latent tuberculosis infection: A latent-class analysis. PLoS One 2017; 12:e0188631. [PMID: 29182688 PMCID: PMC5705142 DOI: 10.1371/journal.pone.0188631] [Citation(s) in RCA: 46] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2017] [Accepted: 11/11/2017] [Indexed: 12/11/2022] Open
Abstract
BACKGROUND Accurate diagnosis and subsequent treatment of latent tuberculosis infection (LTBI) is essential for TB elimination. However, the absence of a gold standard test for diagnosing LTBI makes assessment of the true prevalence of LTBI and the accuracy of diagnostic tests challenging. Bayesian latent class models can be used to make inferences about disease prevalence and the sensitivity and specificity of diagnostic tests using data on the concordance between tests. We performed the largest meta-analysis to date aiming to evaluate the performance of tuberculin skin test (TST) and interferon-gamma release assays (IGRAs) for LTBI diagnosis in various patient populations using Bayesian latent class modelling. METHODS Systematic search of PubMeb, Embase and African Index Medicus was conducted without date and language restrictions on September 11, 2017 to identify studies that compared the performance of TST and IGRAs for LTBI diagnosis. Two IGRA methods were considered: QuantiFERON-TB Gold In Tube (QFT-GIT) and T-SPOT.TB. Studies were included if they reported 2x2 agreement data between TST and QFT-GIT or T-SPOT.TB. A Bayesian latent class model was developed to estimate the sensitivity and specificity of TST and IGRAs in various populations, including immune-competent adults, immune-compromised adults and children. A TST cut-off value of 10 mm was used for immune-competent subjects and 5 mm for immune-compromised individuals. FINDINGS A total of 157 studies were included in the analysis. In immune-competent adults, the sensitivity of TST and QFT-GIT were estimated to be 84% (95% credible interval [CrI] 82-85%) and 52% (50-53%), respectively. The specificity of QFT-GIT was 97% (96-97%) in non-BCG-vaccinated and 93% (92-94%) in BCG-vaccinated immune-competent adults. The estimated figures for TST were 100% (99-100%) and 79% (76-82%), respectively. T-SPOT.TB has comparable specificity (97% for both tests) and better sensitivity (68% versus 52%) than QFT-GIT in immune-competent adults. In immune-compromised adults, both TST and QFT-GIT display low sensitivity but high specificity. QFT-GIT and TST are equally specific (98% for both tests) in non-BCG-vaccinated children; however, QFT-GIT is more specific than TST (98% versus 82%) in BCG-vaccinated group. TST is more sensitive than QFT-GIT (82% versus 73%) in children. CONCLUSIONS This study is the first to assess the utility of TST and IGRAs for LTBI diagnosis in different population groups using all available data with Bayesian latent class modelling. Our results challenge the current beliefs about the performance of LTBI screening tests, and have important implications for LTBI screening policy and practice. We estimated that the performance of IGRAs is not as reliable as previously measured in the general population. However, IGRAs are not or minimally affected by BCG and should be the preferred tests in this setting. Adoption of IGRAs in settings where BCG is widely administered will allow for a more accurate identification and treatment of LTBI.
Collapse
Affiliation(s)
- Tan N. Doan
- Department of Medicine at The Royal Melbourne Hospital, University of Melbourne, Melbourne, Victoria, Australia
- Australian Institute of Tropical Health and Medicine, James Cook University, Townsville, Queensland, Australia
- Institute of Health and Biomedical Innovation, Queensland University of Technology, Brisbane, Queensland, Australia
- * E-mail:
| | - Damon P. Eisen
- College of Medicine and Dentistry, James Cook University, Townsville, Queensland, Australia
- Townsville Hospital and Health Service, Townsville, Queensland, Australia
| | - Morgan T. Rose
- Department of Infectious Diseases, Alfred Health, Melbourne, Victoria, Australia
| | - Andrew Slack
- Townsville Hospital and Health Service, Townsville, Queensland, Australia
| | - Grace Stearnes
- Townsville Hospital and Health Service, Townsville, Queensland, Australia
| | - Emma S. McBryde
- Department of Medicine at The Royal Melbourne Hospital, University of Melbourne, Melbourne, Victoria, Australia
- Australian Institute of Tropical Health and Medicine, James Cook University, Townsville, Queensland, Australia
| |
Collapse
|
8
|
Wang X, Jiang H, Wang X, Liu H, Zhou L, Lu X. ESMPE: A combined strategy for school tuberculosis prevention and control proposed by Dalian, China. PLoS One 2017; 12:e0185646. [PMID: 28973001 PMCID: PMC5626428 DOI: 10.1371/journal.pone.0185646] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2017] [Accepted: 09/16/2017] [Indexed: 12/31/2022] Open
Abstract
BACKGROUND Although China has paid more attention on the prevention and control of tuberculosis (TB) in schools, several unsolved questions in this field still threaten the progress of TB control. Therefore, there is an urgent need to develop a systematic and practical strategy for Chinese school TB prevention and control system. In this study, we aimed to assess the feasibility of a combined strategy named ESMPE (examination, screening, monitoring, prevention and education) that adhere to the basic principles of Chinese schools TB control strategy. METHODS The ESMPE strategy included five sections, namely TB screening during physical examination for the school freshmen entrances, screening of close contacts, monitoring of high-risk schools, preventive treatment and TB education. The effectiveness of ESMPE strategy was evaluated from 2011 to 2016. The original data were provided by the Dalian Tuberculosis Hospital. Descriptive analysis and nonparametric tests were used for comparing statistical differences of results between different years. RESULTS The detection rate of active pulmonary TB in school freshmen was decreased from 2011 to 2016 (χ2 = 41.941, P = 6.0551E-8). 97.22% (17,043/17,530) of close contacts experienced close contacts screening, and the secondary attack rate (SAR) of TB in schools fell by 146.35/105 from 2011 to 2012, and finally reduced to 85.57/105 in 2016. There was a significant correlation between SAR of student TB and the rate of screened close contacts (r = -0.924, P = 0.009). TB incidence of five monitored schools had a substantial decline after receiving monitoring, and this declining trend continued in 2016. Due to the TB education and advanced screening methods, the mean of diagnostic delay time in students with TB was shortened (15.71 days), while still fewer latent TB infection students received preventive treatment (30.38%). CONCLUSIONS The ESMPE strategy has shown a favorable effect on TB prevention and control in Dalian schools. More systematic evidence is needed on the effect of this strategy in reducing the incidence of TB in schools from other settings prior to its further scaling-up in China.
Collapse
Affiliation(s)
- Xichen Wang
- School of Public Health, Dalian Medical University, Dalian, Liaoning, China
| | - Hongbo Jiang
- Office of Epidemic Surveillance, Dalian Tuberculosis Hospital, Dalian, Liaoning, China
| | - Xuemei Wang
- Office of Epidemic Surveillance, Dalian Tuberculosis Hospital, Dalian, Liaoning, China
| | - Hongyu Liu
- School of Public Health, Dalian Medical University, Dalian, Liaoning, China
| | - Ling Zhou
- School of Public Health, Dalian Medical University, Dalian, Liaoning, China
- * E-mail: (XL); (LZ)
| | - Xiwei Lu
- Office of Epidemic Surveillance, Dalian Tuberculosis Hospital, Dalian, Liaoning, China
- * E-mail: (XL); (LZ)
| |
Collapse
|
9
|
Lee HW, Lee YJ, Kim SJ, Park JS, Cho YJ, Yoon HI, Lee CT, Lee JH. Comparing tuberculin skin test and interferon γ release assay (T-SPOT.TB) to diagnose latent tuberculosis infection in household contacts. Korean J Intern Med 2017; 32:486-496. [PMID: 28111432 PMCID: PMC5432797 DOI: 10.3904/kjim.2015.344] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/26/2015] [Revised: 05/08/2016] [Accepted: 07/12/2016] [Indexed: 01/31/2023] Open
Abstract
BACKGROUND/AIMS The tuberculin skin test (TST) and interferon γ release assay are currently used as diagnostic tools to detect latent tuberculosis (TB) infection; however, there are inconsistencies about the degree of agreement between the tests. We aimed to evaluate the concordance rate between the two tests in household contacts of a country with intermediate TB burden, where most people were vaccinated. METHODS We recruited household contacts who spent > 8 hours daily with patients with microbiologically confirmed active pulmonary TB, and received both TST and T-SPOT.TB (Oxford Immunotec) simultaneously. The degree of agreement was analysed according to TST cutoff and Bacille Calmette-Guerin (BCG) vaccination status. Relevant factors were analysed to establish the association with TST or T-SPOT.TB. RESULTS Among 298 household contacts, 122 (40.9%) were spouses, and 250 (83.9%) had received BCG vaccination. In the contact sources, 117 (39.3%) showed a positive result for acid-fast bacillus (AFB) sputum smear and 109 (36.6%) had cavities. The highest agreement rate of 69.5% and κ value of 0.378 were found with a 10 mm cutoff. Spouse, time interval from TB diagnosis to test, and AFB sputum smear positivity were significantly associated with a positive result for T-SPOT.TB. Sex, BCG vaccination, and cavity on chest computed tomography were related to TST positivity. CONCLUSIONS The present study suggested it was not possible for TST and T-SPOT.TB to replace each other because of considerable discrepancy between the two tests in household contacts in a country with intermediate TB prevalence.
Collapse
Affiliation(s)
- Hyun Woo Lee
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
| | - Yeon Joo Lee
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
| | - Se Joong Kim
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
| | - Jong Sun Park
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
| | - Young-Jae Cho
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
| | - Ho Il Yoon
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
| | - Choon-Taek Lee
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
| | - Jae-Ho Lee
- Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
- Correspondence to Jae-Ho Lee, M.D. Division of Pulmonary and Critical Care Medicine, Department of Internal Medicine, Seoul National University Bundang Hospital, 82 Gumi-ro 173beongil, Bundang-gu, Seongnam 13620, Korea Tel: +82-31-787-7058 Fax: +82-31-787-4050 E-mail:
| |
Collapse
|
10
|
Auguste P, Tsertsvadze A, Pink J, Court R, McCarthy N, Sutcliffe P, Clarke A. Comparing interferon-gamma release assays with tuberculin skin test for identifying latent tuberculosis infection that progresses to active tuberculosis: systematic review and meta-analysis. BMC Infect Dis 2017; 17:200. [PMID: 28274215 PMCID: PMC5343308 DOI: 10.1186/s12879-017-2301-4] [Citation(s) in RCA: 82] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2016] [Accepted: 03/01/2017] [Indexed: 01/29/2023] Open
Abstract
BACKGROUND Timely and accurate identification of people with latent tuberculosis infection (LTBI) is important for controlling Mycobacterium tuberculosis (TB). There is no gold standard for diagnosis of LTBI. Screening tests such as interferon gamma release assays (IGRAs) and tuberculin skin test (TST) provide indirect and imperfect information. This systematic review compared two types of IGRAs QuantiFERON®-TB Gold In-Tube test (QFT-GIT) and T-SPOT.TB with TST for identification of LTBI by predicting progression to a diagnosis of active TB in three subgroups: children, immunocompromised people, and those recently arrived from countries with high TB burden. METHODS Cohort studies were eligible for inclusion. We searched MEDLINE, EMBASE, the Cochrane Library and other databases from December 2009 to June 2015. One reviewer screened studies, extracted data, and assessed risk of bias with cross checking by a second reviewer. Strength of association between test results and incidence of TB was summarised using cumulative incidence ratios (CIRs with 95% CIs). Summary effect measures: the ratio of CIRs (R-CIR) with 95% CIs. R-CIRs, were pooled using a random-effects model. Heterogeneity was assessed using Chi-squared and I2 statistics. RESULTS Seventeen studies, mostly of moderate or high risk of bias (five in children, 10 in immunocompromised people, and two in those recently arrived) were included. In children, while in two studies, there was no significant difference between QFT-GIT and TST (≥5 mm) (pooled R-CIR = 1.11, 95% CI: 0.71, 1.74), two other studies showed QFT-GIT to outperform TST (≥10 mm) in identifying LTBI. In immunocompromised people, IGRA (T-SPOT.TB) was not significant different from TST (≥10 mm) for identifying LTBI, (pooled R-CIR = 1.01, 95% CI: 0.65, 1.58). The forest plot of two studies in recently arrived people from countries with high TB burden demonstrated inconsistent findings (high heterogeneity; I2 = 92%). CONCLUSIONS Prospective studies comparing IGRA testing against TST on the progression from LTBI to TB were sparse, and these results should be interpreted with caution due to uncertainty, risk of bias, and unexplained heterogeneity. Population-based studies with adequate sample size and follow-up are required to adequately compare the performance of IGRA with TST in people at high risk of TB.
Collapse
Affiliation(s)
- Peter Auguste
- Warwick Evidence, Warwick Medical School, University of Warwick, Coventry, CV4 7AL, UK.
| | - Alexander Tsertsvadze
- Evidence in Communicable Disease Epidemiology and Control, Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Joshua Pink
- Warwick Evidence, Warwick Medical School, University of Warwick, Coventry, CV4 7AL, UK
| | - Rachel Court
- Warwick Evidence, Warwick Medical School, University of Warwick, Coventry, CV4 7AL, UK
| | - Noel McCarthy
- Evidence in Communicable Disease Epidemiology and Control, Health Sciences, Warwick Medical School, University of Warwick, Coventry, UK
| | - Paul Sutcliffe
- Warwick Evidence, Warwick Medical School, University of Warwick, Coventry, CV4 7AL, UK
| | - Aileen Clarke
- Warwick Evidence, Warwick Medical School, University of Warwick, Coventry, CV4 7AL, UK
| |
Collapse
|
11
|
Sharma SK, Vashishtha R, Chauhan LS, Sreenivas V, Seth D. Comparison of TST and IGRA in Diagnosis of Latent Tuberculosis Infection in a High TB-Burden Setting. PLoS One 2017; 12:e0169539. [PMID: 28060926 PMCID: PMC5218498 DOI: 10.1371/journal.pone.0169539] [Citation(s) in RCA: 79] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2016] [Accepted: 12/18/2016] [Indexed: 02/04/2023] Open
Abstract
Background There are currently two tests for diagnosing latent tuberculosis infection (LTBI); TST and IGRA. However, it is still unclear that which one of these tests performs better in high TB-burden settings. Methods 1511 household contacts of pulmonary TB patients were enrolled to compare the performance of TST and IGRA for LTBI. At baseline all participant underwent testing for IGRA [QuantiFERON-TB® Gold In-tube (QFT-GIT) assay] and TST [2 tuberculin unit (TU), purified protein derivative (PPD), RT23, Staten Serum Institute (SSI), Copenhagen, Denmark]. All the household contacts were followed-up for two years for incident TB cases. Results Active TB was diagnosed in 76 household contacts at an incidence rate of 2.14 per 1000 person-years. Both, TST [Hazard Ratio (HR): 1.14, 95% confidence interval (CI): 0.72–1.79, p = 0.57], as well as QFT-GIT assay (HR: 1.66, 95% CI: 0.97–2.84, p = 0.06) results at baseline were not significantly associated with subsequent development of active TB among household contacts of pulmonary TB patients. Conclusion Neither TST nor IGRA predicted subsequent development of active TB among household contacts of pulmonary TB patients during follow-up. However, keeping in view the cost, and other logistics, TST remains the most preferred method for LTBI diagnosis in resource-limited, high TB-burden settings.
Collapse
Affiliation(s)
- Surendra K. Sharma
- Department of Internal Medicine, All India Institute of Medical Sciences, New Delhi, India
- * E-mail:
| | - Richa Vashishtha
- Department of Internal Medicine, All India Institute of Medical Sciences, New Delhi, India
| | - L. S. Chauhan
- National Center for Disease Control (NCDC), New Delhi, India
| | - V. Sreenivas
- Department of Biostatistics, All India Institute of Medical Sciences, New Delhi, India
| | - Divya Seth
- Department of Biostatistics, All India Institute of Medical Sciences, New Delhi, India
| |
Collapse
|