1
|
Dixit A, Freschi L, Vargas R, Gröschel MI, Nakhoul M, Tahseen S, Alam SMM, Kamal SMM, Skrahina A, Basilio RP, Lim DR, Ismail N, Farhat MR. Estimation of country-specific tuberculosis resistance antibiograms using pathogen genomics and machine learning. BMJ Glob Health 2024; 9:e013532. [PMID: 38548342 PMCID: PMC10982777 DOI: 10.1136/bmjgh-2023-013532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Accepted: 02/26/2024] [Indexed: 04/02/2024] Open
Abstract
BACKGROUND Global tuberculosis (TB) drug resistance (DR) surveillance focuses on rifampicin. We examined the potential of public and surveillance Mycobacterium tuberculosis (Mtb) whole-genome sequencing (WGS) data, to generate expanded country-level resistance prevalence estimates (antibiograms) using in silico resistance prediction. METHODS We curated and quality-controlled Mtb WGS data. We used a validated random forest model to predict phenotypic resistance to 12 drugs and bias-corrected for model performance, outbreak sampling and rifampicin resistance oversampling. Validation leveraged a national DR survey conducted in South Africa. RESULTS Mtb isolates from 29 countries (n=19 149) met sequence quality criteria. Global marginal genotypic resistance among mono-resistant TB estimates overlapped with the South African DR survey, except for isoniazid, ethionamide and second-line injectables, which were underestimated (n=3134). Among multidrug resistant (MDR) TB (n=268), estimates overlapped for the fluoroquinolones but overestimated other drugs. Globally pooled mono-resistance to isoniazid was 10.9% (95% CI: 10.2-11.7%, n=14 012). Mono-levofloxacin resistance rates were highest in South Asia (Pakistan 3.4% (0.1-11%), n=111 and India 2.8% (0.08-9.4%), n=114). Given the recent interest in drugs enhancing ethionamide activity and their expected activity against isolates with resistance discordance between isoniazid and ethionamide, we measured this rate and found it to be high at 74.4% (IQR: 64.5-79.7%) of isoniazid-resistant isolates predicted to be ethionamide susceptible. The global susceptibility rate to pyrazinamide and levofloxacin among MDR was 15.1% (95% CI: 10.2-19.9%, n=3964). CONCLUSIONS This is the first attempt at global Mtb antibiogram estimation. DR prevalence in Mtb can be reliably estimated using public WGS and phenotypic resistance prediction for key antibiotics, but public WGS data demonstrates oversampling of isolates with higher resistance levels than MDR. Nevertheless, our results raise concerns about the empiric use of short-course fluoroquinolone regimens for drug-susceptible TB in South Asia and indicate underutilisation of ethionamide in MDR treatment.
Collapse
Affiliation(s)
- Avika Dixit
- Division of Infectious Diseases, Department of Pediatrics, Boston Children's Hospital, Boston, Massachusetts, USA
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Luca Freschi
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Roger Vargas
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
- Center for Computational Biomedicine, Harvard Medical School, Boston, Massachusetts, USA
| | - Matthias I Gröschel
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | - Maria Nakhoul
- Informatics and Analytics Department, Dana-Farber Cancer Institute, Boston, Massachusetts, USA
| | - Sabira Tahseen
- National Tuberculosis Control Programme, Islamabad, Pakistan
| | - S M Masud Alam
- Ministry of Health and Family Welfare, Kolkata, West Bengal, India
| | - S M Mostofa Kamal
- National Institute of Diseases of the Chest and Hospital, Dhaka, Bangladesh
| | - Alena Skrahina
- Republican Scientific and Practical Center for Pulmonology and Tuberculosis, Minsk, Belarus
| | - Ramon P Basilio
- Research Institute for Tropical Medicine, Muntinlupa City, Philippines
| | - Dodge R Lim
- Research Institute for Tropical Medicine, Muntinlupa City, Philippines
| | - Nazir Ismail
- Clinical Microbiology and Infectious Diseases, University of the Witwatersrand Johannesburg Faculty of Health Sciences, Johannesburg, South Africa
| | - Maha R Farhat
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
- Pulmonary and Critical Care Medicine, Massachusetts General Hospital, Boston, Massachusetts, USA
| |
Collapse
|
2
|
Chesov E, Chesov D, Reimann M, Dreyer V, Utpatel C, Gröschel MI, Ciobanu N, Crudu V, Lange C, Heyckendorf J, Merker M. Impact of Mycobacterium tuberculosis strain type on multidrug-resistant tuberculosis severity, Republic of Moldova. J Infect 2023; 87:588-591. [PMID: 37827458 DOI: 10.1016/j.jinf.2023.10.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Accepted: 10/05/2023] [Indexed: 10/14/2023]
Affiliation(s)
- Elena Chesov
- Nicolae Testemitanu State University of Medicine and Pharmacy, Chisinau, Republic of Moldova; Chiril Draganiuc Phthisiopneumology Institute, Chisinau, Republic of Moldova; Division of Clinical Infectious Disease, Research Center Borstel, Borstel, Germany
| | - Dumitru Chesov
- Nicolae Testemitanu State University of Medicine and Pharmacy, Chisinau, Republic of Moldova; Chiril Draganiuc Phthisiopneumology Institute, Chisinau, Republic of Moldova; Division of Clinical Infectious Disease, Research Center Borstel, Borstel, Germany; German Center for Infection Research, Partner site Hamburg-Lübeck-Riems-Borstel, Borstel, Germany
| | - Maja Reimann
- Division of Clinical Infectious Disease, Research Center Borstel, Borstel, Germany; German Center for Infection Research, Partner site Hamburg-Lübeck-Riems-Borstel, Borstel, Germany; Respiratory Medicine & International Health, University of Lübeck, Germany
| | - Viola Dreyer
- German Center for Infection Research, Partner site Hamburg-Lübeck-Riems-Borstel, Borstel, Germany; Molecular and Experimental Mycobacteriology, Research Center Borstel, Borstel, Germany
| | - Christian Utpatel
- German Center for Infection Research, Partner site Hamburg-Lübeck-Riems-Borstel, Borstel, Germany; Molecular and Experimental Mycobacteriology, Research Center Borstel, Borstel, Germany
| | - Matthias I Gröschel
- Department of Infectious Diseases and Respiratory Medicine, Charite ́ - Universitaetsmedizin Berlin, Berlin, Germany
| | - Nelly Ciobanu
- Nicolae Testemitanu State University of Medicine and Pharmacy, Chisinau, Republic of Moldova; Chiril Draganiuc Phthisiopneumology Institute, Chisinau, Republic of Moldova
| | - Valeriu Crudu
- Nicolae Testemitanu State University of Medicine and Pharmacy, Chisinau, Republic of Moldova; Chiril Draganiuc Phthisiopneumology Institute, Chisinau, Republic of Moldova
| | - Christoph Lange
- Division of Clinical Infectious Disease, Research Center Borstel, Borstel, Germany; German Center for Infection Research, Partner site Hamburg-Lübeck-Riems-Borstel, Borstel, Germany; Respiratory Medicine & International Health, University of Lübeck, Germany; Baylor College of Medicine and Texas Children´s Hospital, Houston, TX, USA
| | - Jan Heyckendorf
- Clinic for Internal Medicine I, University Clinic Schleswig-Holstein Campus Kiel, Germany
| | - Matthias Merker
- Evolution of the Resistome, Research Center Borstel, Borstel, Germany.
| |
Collapse
|
3
|
Noroc E, Chesov D, Merker M, Gröschel MI, Barilar I, Dreyer V, Ciobanu N, Reimann M, Crudu V, Lange C. Limited Nosocomial Transmission of Drug-Resistant Tuberculosis, Moldova. Emerg Infect Dis 2023; 29:1046-1050. [PMID: 37081601 PMCID: PMC10124655 DOI: 10.3201/eid2905.230035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/22/2023] Open
Abstract
Applying whole-genome-sequencing, we aimed to detect transmission events of multidrug-resistant/rifampin-resistant strains of Mycobacterium tuberculosis complex at a tuberculosis hospital in Chisinau, Moldova. We recorded ward, room, and bed information for each patient and monitored in-hospital transfers over 1 year. Detailed molecular and patient surveillance revealed only 2 nosocomial transmission events.
Collapse
|
4
|
Domínguez J, Boeree MJ, Cambau E, Chesov D, Conradie F, Cox V, Dheda K, Dudnyk A, Farhat MR, Gagneux S, Grobusch MP, Gröschel MI, Guglielmetti L, Kontsevaya I, Lange B, van Leth F, Lienhardt C, Mandalakas AM, Maurer FP, Merker M, Miotto P, Molina-Moya B, Morel F, Niemann S, Veziris N, Whitelaw A, Horsburgh CR, Lange C. Clinical implications of molecular drug resistance testing for Mycobacterium tuberculosis: a 2023 TBnet/RESIST-TB consensus statement. Lancet Infect Dis 2023; 23:e122-e137. [PMID: 36868253 DOI: 10.1016/s1473-3099(22)00875-1] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 12/16/2022] [Accepted: 12/16/2022] [Indexed: 03/05/2023]
Abstract
Drug-resistant tuberculosis is a substantial health-care concern worldwide. Despite culture-based methods being considered the gold standard for drug susceptibility testing, molecular methods provide rapid information about the Mycobacterium tuberculosis mutations associated with resistance to anti-tuberculosis drugs. This consensus document was developed on the basis of a comprehensive literature search, by the TBnet and RESIST-TB networks, about reporting standards for the clinical use of molecular drug susceptibility testing. Review and the search for evidence included hand-searching journals and searching electronic databases. The panel identified studies that linked mutations in genomic regions of M tuberculosis with treatment outcome data. Implementation of molecular testing for the prediction of drug resistance in M tuberculosis is key. Detection of mutations in clinical isolates has implications for the clinical management of patients with multidrug-resistant or rifampicin-resistant tuberculosis, especially in situations when phenotypic drug susceptibility testing is not available. A multidisciplinary team including clinicians, microbiologists, and laboratory scientists reached a consensus on key questions relevant to molecular prediction of drug susceptibility or resistance to M tuberculosis, and their implications for clinical practice. This consensus document should help clinicians in the management of patients with tuberculosis, providing guidance for the design of treatment regimens and optimising outcomes.
Collapse
Affiliation(s)
- José Domínguez
- Institut d'Investigació Germans Trias i Pujol, Universitat Autònoma de Barcelona, CIBER Enfermedades Respiratorias, INNOVA4TB Consortium, Barcelona, Spain.
| | - Martin J Boeree
- Department of Lung Diseases, Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, Netherlands
| | - Emmanuelle Cambau
- Centre National de Référence des Mycobactéries et de la Résistance des Mycobactéries aux Antituberculeux, Paris, France, APHP-Hôpital Bichat, Mycobacteriology Laboratory, INSERM, University Paris Cite, IAME UMR1137, Paris, France
| | - Dumitru Chesov
- Department of Pneumology and Allergology, Nicolae Testemițanu State University of Medicine and Pharmacy, Chisinau, Moldova; Division of Clinical Infectious Diseases, Research Center Borstel, Leibniz Lung Center, Borstel, Germany; German Center for Infection Research (DZIF), Partner Site Hamburg- Lübeck-Borstel-Riems, Borstel, Germany; Respiratory Medicine & International Health, University of Lübeck, Lübeck, Germany
| | - Francesca Conradie
- Department of Clinical Medicine, Faculty of Health Sciences, University of Witwatersrand, Johannesburg, South Africa
| | - Vivian Cox
- Centre for Infectious Disease Epidemiology and Research, School of Public Health and Medicine, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa
| | - Keertan Dheda
- Centre for Lung Infection and Immunity, Division of Pulmonology, Department of Medicine and UCT Lung Institute & South African MRC/UCT Centre for the Study of Antimicrobial Resistance, University of Cape Town, Cape Town, South Africa; Faculty of Infectious and Tropical Diseases, Department of Immunology and Infection, London School of Hygiene & Tropical Medicine, London, UK
| | - Andrii Dudnyk
- Department of Tuberculosis, Clinical Immunology and Allergy, National Pirogov Memorial Medical University, Vinnytsia, Ukraine; Public Health Center, Ministry of Health of Ukraine, Kyiv, Ukraine
| | - Maha R Farhat
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA; Division of Pulmonary and Critical Care Medicine, Massachusetts General Hospital, Boston, MA, USA
| | - Sebastien Gagneux
- Department of Medical Parasitology and Infection Biology, Swiss Tropical and Public Health Institute, Allschwil, Switzerland; University of Basel, Basel, Switzerland
| | - Martin P Grobusch
- Center of Tropical Medicine and Travel Medicine, Department of Infectious Diseases, Amsterdam University Medical Centers, Amsterdam Infection & Immunity, Amsterdam Public Health, University of Amsterdam, Amsterdam, Netherlands
| | - Matthias I Gröschel
- Department of Infectious Diseases and Respiratory Medicine, Charité-Universitätsmedizin Berlin, Berlin, Germany; Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Lorenzo Guglielmetti
- Sorbonne Université, INSERM, U1135, Centre d'Immunologie et des Maladies Infectieuses, (Cimi-Paris), APHP Sorbonne Université, Department of Bacteriology Hôpital Pitié-Salpêtrière, Centre National de Référence des Mycobactéries et de la Résistance des Mycobactéries aux Antituberculeux, Paris, France
| | - Irina Kontsevaya
- Division of Clinical Infectious Diseases, Research Center Borstel, Leibniz Lung Center, Borstel, Germany; German Center for Infection Research (DZIF), Partner Site Hamburg- Lübeck-Borstel-Riems, Borstel, Germany; Respiratory Medicine & International Health, University of Lübeck, Lübeck, Germany; Department of Infectious Disease, Faculty of Medicine, Imperial College London, London, UK
| | - Berit Lange
- Department for Epidemiology, Helmholtz Centre for Infection Research, Braunschweig, Germany; German Centre for Infection Research, TI BBD, Braunschweig, Germany
| | - Frank van Leth
- Department of Health Sciences, Vrije Universiteit Amsterdam, Amsterdam, Netherlands; Amsterdam Public Health Research Institute, Amsterdam, Netherlands
| | - Christian Lienhardt
- Department of Infectious Disease Epidemiology, London School of Hygiene & Tropical Medicine, London, UK; UMI 233 IRD-U1175 INSERM - Université de Montpellier, Institut de Recherche pour le Développement, Montpellier, France
| | - Anna M Mandalakas
- Division of Clinical Infectious Diseases, Research Center Borstel, Leibniz Lung Center, Borstel, Germany; German Center for Infection Research (DZIF), Partner Site Hamburg- Lübeck-Borstel-Riems, Borstel, Germany; Respiratory Medicine & International Health, University of Lübeck, Lübeck, Germany; Global TB Program, Department of Pediatrics, Baylor College of Medicine and Texas Children's Hospital, Houston, TX, USA
| | - Florian P Maurer
- National and Supranational Reference Center for Mycobacteria, Research Center Borstel, Leibniz Lung Center, Borstel, Germany; German Center for Infection Research (DZIF), Partner Site Hamburg- Lübeck-Borstel-Riems, Borstel, Germany; Institute of Medical Microbiology, Virology and Hygiene, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Matthias Merker
- Division of Evolution of the Resistome, Research Center Borstel, Leibniz Lung Center, Borstel, Germany; German Center for Infection Research (DZIF), Partner Site Hamburg- Lübeck-Borstel-Riems, Borstel, Germany
| | - Paolo Miotto
- Emerging Bacterial Pathogens Unit, Division of Immunology, Transplantation and Infectious Diseases, IRCCS San Raffaele Scientific Institute, Milan, Italy
| | - Barbara Molina-Moya
- Institut d'Investigació Germans Trias i Pujol, Universitat Autònoma de Barcelona, CIBER Enfermedades Respiratorias, INNOVA4TB Consortium, Barcelona, Spain
| | - Florence Morel
- Sorbonne Université, INSERM, U1135, Centre d'Immunologie et des Maladies Infectieuses, (Cimi-Paris), APHP Sorbonne Université, Department of Bacteriology Hôpital Pitié-Salpêtrière, Centre National de Référence des Mycobactéries et de la Résistance des Mycobactéries aux Antituberculeux, Paris, France
| | - Stefan Niemann
- Division of Molecular and Experimental Mycobacteriology, Research Center Borstel, Leibniz Lung Center, Borstel, Germany; German Center for Infection Research (DZIF), Partner Site Hamburg- Lübeck-Borstel-Riems, Borstel, Germany; Department of Human, Biological and Translational Medical Sciences, School of Medicine, University of Namibia, Windhoek, Namibia
| | - Nicolas Veziris
- Sorbonne Université, INSERM, U1135, Centre d'Immunologie et des Maladies Infectieuses, (Cimi-Paris), APHP Sorbonne Université, Department of Bacteriology Hôpital Pitié-Salpêtrière, Centre National de Référence des Mycobactéries et de la Résistance des Mycobactéries aux Antituberculeux, Paris, France
| | - Andrew Whitelaw
- Division of Medical Microbiology, Faculty of Medicine and Health Sciences, Stellenbosch University, South Africa; National Health Laboratory Service, Tygerberg Hospital, Cape Town, South Africa
| | - Charles R Horsburgh
- Departments of Epidemiology, Biostatistics, Global Health and Medicine, Boston University Schools of Public Health and Medicine, Boston, MA, USA
| | - Christoph Lange
- Division of Clinical Infectious Diseases, Research Center Borstel, Leibniz Lung Center, Borstel, Germany; German Center for Infection Research (DZIF), Partner Site Hamburg- Lübeck-Borstel-Riems, Borstel, Germany; Respiratory Medicine & International Health, University of Lübeck, Lübeck, Germany; Global TB Program, Department of Pediatrics, Baylor College of Medicine and Texas Children's Hospital, Houston, TX, USA
| | | |
Collapse
|
5
|
Farlow A, Hoffmann A, Tadesse GA, Mzurikwao D, Beyer R, Akogo D, Weicken E, Matika T, Nweje MI, Wamae W, Arts S, Wiegand T, Bennett C, Farhat MR, Gröschel MI. Rethinking global digital health and AI-for-health innovation challenges. PLOS Glob Public Health 2023; 3:e0001844. [PMID: 37115743 PMCID: PMC10146484 DOI: 10.1371/journal.pgph.0001844] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/29/2023]
Abstract
Digital health technologies can help tackle challenges in global public health. Digital and AI-for-Health Challenges, controlled events whose goal is to generate solutions to a given problem in a defined period of time, are one way of catalysing innovation. This article proposes an expanded investment framework for Global Health AI and digitalhealth Innovation that goes beyond traditional factors such as return on investment. Instead, we propose non monetary and non GDP metrics, such as Disability Adjusted Life Years or achievement of universal health coverage. Furthermore, we suggest a venture building approach around global health, which includes filtering of participants to reduce opportunity cost, close integration of implementation scientists and an incubator for the long-term development of ideas resulting from the challenge. Finally, we emphasize the need to strengthen human capital across a range of areas in local innovation, implementation-science, and in health services.
Collapse
Affiliation(s)
- Andrew Farlow
- Oxford Martin School, University of Oxford, Oxford, United Kingdom
- Nuffield Department of Medicine, University of Oxford, Oxford, United Kingdom
| | - Alexander Hoffmann
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States of America
| | | | | | | | | | - Eva Weicken
- Fraunhofer Heinrich Hertz Institute, Berlin, Germany
| | - Tafadzwa Matika
- Clinton Health Access Initiative, Boston, MA, United States of America
| | | | - Watu Wamae
- Nuffield Department of Medicine, University of Oxford, Oxford, United Kingdom
| | - Sako Arts
- FruitPunch AI, Eindhoven, Netherlands
| | - Thomas Wiegand
- Fraunhofer Heinrich Hertz Institute, Berlin, Germany
- Technical University of Berlin, Berlin, Germany
| | - Colin Bennett
- Nuffield Department of Medicine, University of Oxford, Oxford, United Kingdom
| | - Maha R Farhat
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States of America
- Division of Pulmonary and Critical Care, Massachusetts General Hospital, Boston, MA, United States of America
| | - Matthias I Gröschel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States of America
- Fraunhofer Heinrich Hertz Institute, Berlin, Germany
- Department of Infectious Diseases and Respiratory Medicine, Charité -Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
6
|
Fehr J, Jaramillo-Gutierrez G, Oala L, Gröschel MI, Bierwirth M, Balachandran P, Werneck-Leite A, Lippert C. Piloting a Survey-Based Assessment of Transparency and Trustworthiness with Three Medical AI Tools. Healthcare (Basel) 2022; 10:healthcare10101923. [PMID: 36292369 PMCID: PMC9601535 DOI: 10.3390/healthcare10101923] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 09/18/2022] [Accepted: 09/21/2022] [Indexed: 11/04/2022] Open
Abstract
Artificial intelligence (AI) offers the potential to support healthcare delivery, but poorly trained or validated algorithms bear risks of harm. Ethical guidelines stated transparency about model development and validation as a requirement for trustworthy AI. Abundant guidance exists to provide transparency through reporting, but poorly reported medical AI tools are common. To close this transparency gap, we developed and piloted a framework to quantify the transparency of medical AI tools with three use cases. Our framework comprises a survey to report on the intended use, training and validation data and processes, ethical considerations, and deployment recommendations. The transparency of each response was scored with either 0, 0.5, or 1 to reflect if the requested information was not, partially, or fully provided. Additionally, we assessed on an analogous three-point scale if the provided responses fulfilled the transparency requirement for a set of trustworthiness criteria from ethical guidelines. The degree of transparency and trustworthiness was calculated on a scale from 0% to 100%. Our assessment of three medical AI use cases pin-pointed reporting gaps and resulted in transparency scores of 67% for two use cases and one with 59%. We report anecdotal evidence that business constraints and limited information from external datasets were major obstacles to providing transparency for the three use cases. The observed transparency gaps also lowered the degree of trustworthiness, indicating compliance gaps with ethical guidelines. All three pilot use cases faced challenges to provide transparency about medical AI tools, but more studies are needed to investigate those in the wider medical AI sector. Applying this framework for an external assessment of transparency may be infeasible if business constraints prevent the disclosure of information. New strategies may be necessary to enable audits of medical AI tools while preserving business secrets.
Collapse
Affiliation(s)
- Jana Fehr
- Digital Engineering Faculty, University of Potsdam, 14482 Potsdam, Germany
- Digital Health & Machine Learning, Hasso Plattner Institute, 14482 Potsdam, Germany
- Correspondence:
| | | | - Luis Oala
- Department of Artificial Intelligence, Fraunhofer HHI, 10587 Berlin, Germany
| | - Matthias I. Gröschel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA 02115, USA
| | - Manuel Bierwirth
- ITU/WHO Focus Group AI4H, 1211 Geneva, Switzerland
- Alumnus Goethe Frankfurt University, 60323 Frankfurt am Main, Germany
| | - Pradeep Balachandran
- ITU/WHO Focus Group AI4H, 1211 Geneva, Switzerland
- Technical Consultant (Digital Health), Thiruvananthapuram 695010, India
| | | | - Christoph Lippert
- Digital Engineering Faculty, University of Potsdam, 14482 Potsdam, Germany
- Digital Health & Machine Learning, Hasso Plattner Institute, 14482 Potsdam, Germany
| |
Collapse
|
7
|
Green AG, Yoon CH, Chen ML, Ektefaie Y, Fina M, Freschi L, Gröschel MI, Kohane I, Beam A, Farhat M. A convolutional neural network highlights mutations relevant to antimicrobial resistance in Mycobacterium tuberculosis. Nat Commun 2022; 13:3817. [PMID: 35780211 PMCID: PMC9250494 DOI: 10.1038/s41467-022-31236-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 06/10/2022] [Indexed: 11/30/2022] Open
Abstract
Long diagnostic wait times hinder international efforts to address antibiotic resistance in M. tuberculosis. Pathogen whole genome sequencing, coupled with statistical and machine learning models, offers a promising solution. However, generalizability and clinical adoption have been limited by a lack of interpretability, especially in deep learning methods. Here, we present two deep convolutional neural networks that predict antibiotic resistance phenotypes of M. tuberculosis isolates: a multi-drug CNN (MD-CNN), that predicts resistance to 13 antibiotics based on 18 genomic loci, with AUCs 82.6-99.5% and higher sensitivity than state-of-the-art methods; and a set of 13 single-drug CNNs (SD-CNN) with AUCs 80.1-97.1% and higher specificity than the previous state-of-the-art. Using saliency methods to evaluate the contribution of input sequence features to the SD-CNN predictions, we identify 18 sites in the genome not previously associated with resistance. The CNN models permit functional variant discovery, biologically meaningful interpretation, and clinical applicability.
Collapse
Affiliation(s)
- Anna G Green
- Department of Biomedical Informatics, Harvard Medical School, 25 Shattuck St, Boston, MA, 02115, USA
| | - Chang Ho Yoon
- Department of Biomedical Informatics, Harvard Medical School, 25 Shattuck St, Boston, MA, 02115, USA
- Big Data Institute, Nuffield Department of Population Health, University of Oxford, Oxford, OX37LF, UK
| | - Michael L Chen
- Department of Biomedical Informatics, Harvard Medical School, 25 Shattuck St, Boston, MA, 02115, USA
- Stanford University School of Medicine, 291 Campus Dr, Stanford, CA, 94305, USA
| | - Yasha Ektefaie
- Department of Biomedical Informatics, Harvard Medical School, 25 Shattuck St, Boston, MA, 02115, USA
| | - Mack Fina
- Harvard College, Cambridge, MA, 02138, USA
| | - Luca Freschi
- Department of Biomedical Informatics, Harvard Medical School, 25 Shattuck St, Boston, MA, 02115, USA
| | - Matthias I Gröschel
- Department of Biomedical Informatics, Harvard Medical School, 25 Shattuck St, Boston, MA, 02115, USA
| | - Isaac Kohane
- Department of Biomedical Informatics, Harvard Medical School, 25 Shattuck St, Boston, MA, 02115, USA
| | - Andrew Beam
- Department of Biomedical Informatics, Harvard Medical School, 25 Shattuck St, Boston, MA, 02115, USA.
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Ave, Boston, MA, 02115, USA.
| | - Maha Farhat
- Department of Biomedical Informatics, Harvard Medical School, 25 Shattuck St, Boston, MA, 02115, USA.
- Division of Pulmonary & Critical Care, Massachusetts General Hospital, 55 Fruit St, Boston, MA, 02114, USA.
| |
Collapse
|
8
|
Gröschel MI, van den Boom M, Dixit A, Skrahina A, Dodd PJ, Migliori GB, Seddon JA, Farhat MR. Management of childhood MDR-TB in Europe and Central Asia: report of a Regional WHO meeting. Int J Tuberc Lung Dis 2022; 26:433-440. [PMID: 35505487 DOI: 10.5588/ijtld.21.0541] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023] Open
Abstract
BACKGROUND: As the WHO European Region has the highest proportion of multidrug-resistant TB (MDR-TB) among total incident TB cases, many children and adolescents are at risk of MDR-TB infection and disease.METHODS: We performed an electronic survey of clinicians and TB programme personnel who attended the 2020 Regional Consultation on child and adolescent TB organised by the WHO Regional Office. We characterised access to diagnostics and drugs, and practices in the prevention and management of child and adolescent MDR-TB.RESULTS: Children and adolescents are inconsistently represented in national guidelines and budgets; child-friendly drug formulations for MDR-TB treatment are insufficiently available in 57% of countries, and 32% of countries reported paediatric drug stock-outs. The novel drugs, bedaquiline and delamanid, are accessible by respectively 80% and 60% of respondent countries. Respondents were asked how many children were diagnosed with MDR-TB in 2019, and a comparison of this number to modelled estimates of incidence (to identify the case detection gap) and WHO notifications (to identify the case reporting gap) showed substantial differences in both comparisons.CONCLUSIONS: Better representation of this patient group in guidelines and budgets, greater access to drugs and improved reporting are essential to reach TB elimination in this Region.
Collapse
Affiliation(s)
- M I Gröschel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - M van den Boom
- Joint TB, HIV, and Viral Hepatitis Programme, WHO Regional Office for Europe, UN City, Copenhagen, Denmark
| | - A Dixit
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA, Division of Infectious Diseases, Boston Children´s Hospital, Boston, MA, USA
| | - A Skrahina
- Republican Scientific and Practical Center for Pulmonology and TB, Minsk, Belarus
| | - P J Dodd
- School of Health and Health-Related Research, University of Sheffield, Sheffield, UK
| | - G B Migliori
- Istituti Clinici Scientifici Maugeri Istituto di Recovero e Cura a Carattere Scientifico, Tradate, Italy
| | - J A Seddon
- Section of Paediatric Infectious Diseases, Department of Infectious Diseases, Imperial College London, London, UK, Desmond Tutu TB Centre, Department of Paediatrics and Child Health, Stellenbosch University, Stellenbosch, South Africa
| | - M R Farhat
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA, Division of Pulmonary and Critical Care, Massachusetts General Hospital, Boston, MA, USA
| |
Collapse
|
9
|
Gröschel MI, Owens M, Freschi L, Vargas R, Marin MG, Phelan J, Iqbal Z, Dixit A, Farhat MR. GenTB: A user-friendly genome-based predictor for tuberculosis resistance powered by machine learning. Genome Med 2021; 13:138. [PMID: 34461978 PMCID: PMC8407037 DOI: 10.1186/s13073-021-00953-4] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2021] [Accepted: 08/12/2021] [Indexed: 01/31/2023] Open
Abstract
BACKGROUND Multidrug-resistant Mycobacterium tuberculosis (Mtb) is a significant global public health threat. Genotypic resistance prediction from Mtb DNA sequences offers an alternative to laboratory-based drug-susceptibility testing. User-friendly and accurate resistance prediction tools are needed to enable public health and clinical practitioners to rapidly diagnose resistance and inform treatment regimens. RESULTS We present Translational Genomics platform for Tuberculosis (GenTB), a free and open web-based application to predict antibiotic resistance from next-generation sequence data. The user can choose between two potential predictors, a Random Forest (RF) classifier and a Wide and Deep Neural Network (WDNN) to predict phenotypic resistance to 13 and 10 anti-tuberculosis drugs, respectively. We benchmark GenTB's predictive performance along with leading TB resistance prediction tools (Mykrobe and TB-Profiler) using a ground truth dataset of 20,408 isolates with laboratory-based drug susceptibility data. All four tools reliably predicted resistance to first-line tuberculosis drugs but had varying performance for second-line drugs. The mean sensitivities for GenTB-RF and GenTB-WDNN across the nine shared drugs were 77.6% (95% CI 76.6-78.5%) and 75.4% (95% CI 74.5-76.4%), respectively, and marginally higher than the sensitivities of TB-Profiler at 74.4% (95% CI 73.4-75.3%) and Mykrobe at 71.9% (95% CI 70.9-72.9%). The higher sensitivities were at an expense of ≤ 1.5% lower specificity: Mykrobe 97.6% (95% CI 97.5-97.7%), TB-Profiler 96.9% (95% CI 96.7 to 97.0%), GenTB-WDNN 96.2% (95% CI 96.0 to 96.4%), and GenTB-RF 96.1% (95% CI 96.0 to 96.3%). Averaged across the four tools, genotypic resistance sensitivity was 11% and 9% lower for isoniazid and rifampicin respectively, on isolates sequenced at low depth (< 10× across 95% of the genome) emphasizing the need to quality control input sequence data before prediction. We discuss differences between tools in reporting results to the user including variants underlying the resistance calls and any novel or indeterminate variants CONCLUSIONS: GenTB is an easy-to-use online tool to rapidly and accurately predict resistance to anti-tuberculosis drugs. GenTB can be accessed online at https://gentb.hms.harvard.edu , and the source code is available at https://github.com/farhat-lab/gentb-site .
Collapse
Affiliation(s)
- Matthias I Gröschel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Martin Owens
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Luca Freschi
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Roger Vargas
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
- Department of Systems Biology, Harvard Medical School, Boston, MA, USA
| | - Maximilian G Marin
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
- Department of Systems Biology, Harvard Medical School, Boston, MA, USA
| | - Jody Phelan
- Faculty of Infectious and Tropical Diseases, London School of Hygiene & Tropical Medicine, London, WC1E 7HT, UK
| | - Zamin Iqbal
- European Bioinformatics Institute, Hinxton, Cambridge, CB10 ISD, UK
| | - Avika Dixit
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
- Division of Infectious Diseases, Boston Children's Hospital, Boston, MA, USA
| | - Maha R Farhat
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.
- Division of Pulmonary and Critical Care Medicine, Massachusetts General Hospital, Boston, MA, USA.
| |
Collapse
|
10
|
Rankin NA, Gröschel MI, Farhat MR. Mentorship at a distance. Science 2020; 370:494. [DOI: 10.1126/science.370.6515.494] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
Affiliation(s)
- Naomi A. Rankin
- Naomi Rankin is an undergrad at Howard University. Matthias Gröschel is a postdoc and Maha Farhat an assistant professor at Harvard Medical School. Farhat is also an attending pulmonologist at Massachusetts General Hospital. Send your career story to
| | - Matthias I. Gröschel
- Naomi Rankin is an undergrad at Howard University. Matthias Gröschel is a postdoc and Maha Farhat an assistant professor at Harvard Medical School. Farhat is also an attending pulmonologist at Massachusetts General Hospital. Send your career story to
| | - Maha R. Farhat
- Naomi Rankin is an undergrad at Howard University. Matthias Gröschel is a postdoc and Maha Farhat an assistant professor at Harvard Medical School. Farhat is also an attending pulmonologist at Massachusetts General Hospital. Send your career story to
| |
Collapse
|
11
|
Gröschel MI, Meehan CJ, Barilar I, Diricks M, Gonzaga A, Steglich M, Conchillo-Solé O, Scherer IC, Mamat U, Luz CF, De Bruyne K, Utpatel C, Yero D, Gibert I, Daura X, Kampmeier S, Rahman NA, Kresken M, van der Werf TS, Alio I, Streit WR, Zhou K, Schwartz T, Rossen JWA, Farhat MR, Schaible UE, Nübel U, Rupp J, Steinmann J, Niemann S, Kohl TA. The phylogenetic landscape and nosocomial spread of the multidrug-resistant opportunist Stenotrophomonas maltophilia. Nat Commun 2020; 11:2044. [PMID: 32341346 PMCID: PMC7184733 DOI: 10.1038/s41467-020-15123-0] [Citation(s) in RCA: 64] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2019] [Accepted: 02/15/2020] [Indexed: 02/06/2023] Open
Abstract
Recent studies portend a rising global spread and adaptation of human- or healthcare-associated pathogens. Here, we analyse an international collection of the emerging, multidrug-resistant, opportunistic pathogen Stenotrophomonas maltophilia from 22 countries to infer population structure and clonality at a global level. We show that the S. maltophilia complex is divided into 23 monophyletic lineages, most of which harbour strains of all degrees of human virulence. Lineage Sm6 comprises the highest rate of human-associated strains, linked to key virulence and resistance genes. Transmission analysis identifies potential outbreak events of genetically closely related strains isolated within days or weeks in the same hospitals. Multidrug resistance of the opportunistic pathogen Stenotrophomonas maltophilia is an increasing problem. Here, analyzing strains from 22 countries, the authors show that the S. maltophilia complex is divided into 23 monophyletic lineages and find evidence for intra-hospital transmission.
Collapse
Affiliation(s)
- Matthias I Gröschel
- Molecular and Experimental Mycobacteriology, Research Center Borstel, Borstel, Germany.,Department of Pulmonary Diseases & Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Conor J Meehan
- School of Chemistry and Bioscience, University of Bradford, Bradford, United Kingdom
| | - Ivan Barilar
- Molecular and Experimental Mycobacteriology, Research Center Borstel, Borstel, Germany
| | - Margo Diricks
- bioMérieux, Applied Maths NV, Keistraat 120, 9830, St-Martens-Latem, Belgium
| | - Aitor Gonzaga
- Leibniz Institute DSMZ - German Collection of Microorganisms and Cell Cultures, Braunschweig, Germany
| | - Matthias Steglich
- Leibniz Institute DSMZ - German Collection of Microorganisms and Cell Cultures, Braunschweig, Germany
| | - Oscar Conchillo-Solé
- Institute of Biotechnology and Biomedicine, Universitat Autònoma de Barcelona, Barcelona, Spain.,Department of Genetics and Microbiology, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Isabell-Christin Scherer
- Department of Infectious Diseases and Microbiology, University Hospital Schleswig-Holstein, Lübeck, Germany
| | - Uwe Mamat
- Cellular Microbiology, Research Center Borstel, Borstel, Germany
| | - Christian F Luz
- Department of Medical Microbiology and Infection Prevention, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Katrien De Bruyne
- bioMérieux, Applied Maths NV, Keistraat 120, 9830, St-Martens-Latem, Belgium
| | - Christian Utpatel
- Molecular and Experimental Mycobacteriology, Research Center Borstel, Borstel, Germany
| | - Daniel Yero
- Institute of Biotechnology and Biomedicine, Universitat Autònoma de Barcelona, Barcelona, Spain.,Department of Genetics and Microbiology, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Isidre Gibert
- Institute of Biotechnology and Biomedicine, Universitat Autònoma de Barcelona, Barcelona, Spain.,Department of Genetics and Microbiology, Universitat Autònoma de Barcelona, Barcelona, Spain
| | - Xavier Daura
- Institute of Biotechnology and Biomedicine, Universitat Autònoma de Barcelona, Barcelona, Spain.,Catalan Institution for Research and Advanced Studies, Barcelona, Spain
| | | | | | - Michael Kresken
- Antiinfectives Intelligence GmbH, Rheinbach, Germany.,Rheinische Fachhochschule Köln gGmbH, Cologne, Germany
| | - Tjip S van der Werf
- Department of Pulmonary Diseases & Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Ifey Alio
- Department of Microbiology and Biotechnology, University of Hamburg, Hamburg, Germany
| | - Wolfgang R Streit
- Department of Microbiology and Biotechnology, University of Hamburg, Hamburg, Germany
| | - Kai Zhou
- Shenzhen Institute of Respiratory Diseases, the First Affiliated Hospital (Shenzhen People's Hospital), Southern University of Science and Technology, Shenzhen, China.,Second Clinical Medical College, Jinan University, Shenzhen, China
| | - Thomas Schwartz
- Karlsruhe Institute of Technology, Institute of Functional Interfaces, Eggenstein- Leopoldshafen, Germany
| | - John W A Rossen
- Department of Medical Microbiology and Infection Prevention, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Maha R Farhat
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.,Division of Pulmonary and Critical Care, Massachusetts General Hospital, Boston, MA, USA
| | - Ulrich E Schaible
- Cellular Microbiology, Research Center Borstel, Borstel, Germany.,German Center for Infection Research (DZIF), partner site Hamburg - Lübeck - Borstel - Riems, Cologne, Germany.,Leibniz Research Alliance INFECTIONS'21, Cologne, Germany
| | - Ulrich Nübel
- Leibniz Institute DSMZ - German Collection of Microorganisms and Cell Cultures, Braunschweig, Germany.,Leibniz Research Alliance INFECTIONS'21, Cologne, Germany.,Germany Center for Infection Research (DZIF), partner site Hannover - Braunschweig, Cologne, Germany.,Braunschweig Integrated Center of Systems Biology (BRICS), Technical University, Braunschweig, Germany
| | - Jan Rupp
- Department of Infectious Diseases and Microbiology, University Hospital Schleswig-Holstein, Lübeck, Germany.,German Center for Infection Research (DZIF), partner site Hamburg - Lübeck - Borstel - Riems, Cologne, Germany
| | - Joerg Steinmann
- Institute of Medical Microbiology, University Medical Center Essen, Essen, Germany.,Medical Microbiology and Infection Prevention, Institute of Clinical Hygiene, Paracelsus Medical Private University, Klinikum Nürnberg, Nuremberg, Germany
| | - Stefan Niemann
- Molecular and Experimental Mycobacteriology, Research Center Borstel, Borstel, Germany. .,German Center for Infection Research (DZIF), partner site Hamburg - Lübeck - Borstel - Riems, Cologne, Germany. .,Leibniz Research Alliance INFECTIONS'21, Cologne, Germany.
| | - Thomas A Kohl
- Molecular and Experimental Mycobacteriology, Research Center Borstel, Borstel, Germany.,German Center for Infection Research (DZIF), partner site Hamburg - Lübeck - Borstel - Riems, Cologne, Germany
| |
Collapse
|
12
|
Gröschel MI, Seddon JA, Prabowo SA, Migliori GB, Graham SM, van den Boom M, Dara M. European guidance on drug-resistant tuberculosis in children and adolescents. Lancet Child Adolesc Health 2020; 4:9-11. [PMID: 31676193 DOI: 10.1016/s2352-4642(19)30332-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Accepted: 08/15/2019] [Indexed: 11/27/2022]
Affiliation(s)
- Matthias I Gröschel
- Joint TB, HIV and Viral Hepatitis Programme, Division of Health Emergencies and Communicable Diseases, WHO Regional Office for Europe, UN City, 2100 Copenhagen Ø, Denmark; Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - James A Seddon
- Section of Paediatric Infectious Diseases, Department of Infectious Diseases, Imperial College London, London, UK; Desmond Tutu TB Centre, Department of Paediatrics and Child Health, Stellenbosch University, Stellenbosch, South Africa
| | - Satria A Prabowo
- Faculty of Infectious and Tropical Diseases, London School of Hygiene & Tropical Medicine, London, UK
| | - Giovanni B Migliori
- Istituti Clinici Scientifici Maugeri Istituto di Recovero e Cura a Carattere Scientifico, Tradate, Italy
| | - Stephen M Graham
- Centre for International Child Health, Department of Paediatrics, University of Melbourne, Melbourne, Australia; Murdoch Children's Research Institute, Melbourne, Australia; International Union Against Tuberculosis and Lung Disease, Paris, France
| | - Martin van den Boom
- Joint TB, HIV and Viral Hepatitis Programme, Division of Health Emergencies and Communicable Diseases, WHO Regional Office for Europe, UN City, 2100 Copenhagen Ø, Denmark
| | - Masoud Dara
- Joint TB, HIV and Viral Hepatitis Programme, Division of Health Emergencies and Communicable Diseases, WHO Regional Office for Europe, UN City, 2100 Copenhagen Ø, Denmark.
| |
Collapse
|
13
|
Gröschel MI, van den Boom M, Migliori GB, Dara M. Prioritising children and adolescents in the tuberculosis response of the WHO European Region. Eur Respir Rev 2019; 28:28/151/180106. [PMID: 30872399 PMCID: PMC9488188 DOI: 10.1183/16000617.0106-2018] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2018] [Accepted: 01/23/2019] [Indexed: 12/03/2022] Open
Abstract
In 2017, in recognition of the challenges faced by Member States in managing childhood and adolescent tuberculosis (TB) at a country level, the WHO Regional Office for Europe held a Regional Consultation. In total, 35 countries participated in the consultations representing both high- and low-incidence Member States. Here, we provide an overview of the existing World Health Organization (WHO) documents and guidelines on childhood and adolescent TB and describe the outcomes of this regional meeting. National childhood and adolescent TB guidelines are available in 25% of Member States, while 33% reported that no such guidelines are at hand. In the majority of countries (83%), childhood and adolescent TB is part of the National Strategic Plan. The most pressing challenges in managing paediatric TB comprise the lack of adequate drug formulations, the difficult diagnosis, and treatment of presumed latent TB infection. Investments into childhood and adolescent TB need to be further advocated to achieve the End TB goals set by WHO to eliminate TB by 2030. A regional consultation on child and adolescent TB was held in 2017 by the WHO Regional Office for Europe. It identified common challenges and key priorities, useful in informing and strengthening the regional response to TB.http://ow.ly/Fg8H30nwBRo
Collapse
Affiliation(s)
- Matthias I Gröschel
- Joint TB, HIV and Viral Hepatitis Programme, WHO Regional Office for Europe, Copenhagen, Denmark
| | - Martin van den Boom
- Joint TB, HIV and Viral Hepatitis Programme, WHO Regional Office for Europe, Copenhagen, Denmark
| | | | - Masoud Dara
- Joint TB, HIV and Viral Hepatitis Programme, WHO Regional Office for Europe, Copenhagen, Denmark.,Division of Health Emergencies and Communicable Diseases, WHO Regional Office for Europe, Copenhagen, Denmark
| |
Collapse
|
14
|
Gröschel MI, Luz CF, Batra S, Ahuja S, Batra S, Kranzer K, van der Werf TS. Random glucose sampling as screening tool for diabetes among disadvantaged tuberculosis patients residing in urban slums in India. ERJ Open Res 2019; 5:00025-2019. [PMID: 30863772 PMCID: PMC6409081 DOI: 10.1183/23120541.00025-2019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2019] [Accepted: 01/28/2019] [Indexed: 11/05/2022] Open
Abstract
Noncommunicable diseases like diabetes are increasingly recognised as important risk factors for tuberculosis (TB) and poor treatment outcomes [1]. While the link between TB and diabetes was described many decades ago, several recent epidemiological studies and systematic reviews have confirmed the association of diabetes with a three-fold increased risk of developing TB [2]. Since 2011, the World Health Organization has recommended bidirectional screening of all TB patients for diabetes [3]. However, it is currently unclear at which point in treatment one should screen and which diagnostic tools should be used. Following the American Diabetes Association, diabetes is diagnosed by a fasting plasma glucose ≥7 mmol·L−1, a 2-h plasma glucose value ≥11.1 mmol·L−1 during the oral glucose tolerance test, glycated haemoglobin (HbA1C) ≥48 mmol·mol−1 or a random plasma glucose value ≥11.1 mmol·L−1 in patients with classic symptoms of hyperglycaemia [4]. The Concurrent Tuberculosis and Diabetes Mellitus (TANDEM) consortium recently suggested a simplified two-step diagnostic algorithm where all patients with random plasma glucose levels >6.1 mmol·L−1 receive point-of-care HbA1C testing [4]. With laboratory-based HbA1C as the gold standard, this two-step combination resulted in a sensitivity and specificity of >90% to detect diabetes. Here, we evaluate the feasibility of diabetes screening by random glucose sampling among disadvantaged TB patients residing in urban slums in New Delhi, India. Recently, a two-step diagnostic algorithm to diagnose diabetes among TB patients was proposed comprising random glucose and point-of-care HbA1c. This study evaluates the first part of this algorithm among disadvantaged TB patients.http://ow.ly/UI7d30nK1UN
Collapse
|
15
|
Affiliation(s)
- Matthias I. Gröschel
- Molecular and Experimental Mycobacteriology, Research Center Borstel, Borstel, Germany
- Department of Pulmonary Diseases & Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
- * E-mail:
| | - Timothy M. Walker
- Nuffield Department of Medicine, University of Oxford, John Radcliffe Hospital, Oxford, United Kingdom
| | - Tjip S. van der Werf
- Department of Pulmonary Diseases & Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Christoph Lange
- Clinical Infectious Diseases, Research Center Borstel, Borstel, Germany
- International Health / Infectious Diseases, University of Lübeck, Lübeck, Germany
- Department of Medicine, Karolinska Institute, Stockholm, Sweden
- German Center for Infection Research (DZIF) Tuberculosis Unit, Borstel, Germany
| | - Stefan Niemann
- Molecular and Experimental Mycobacteriology, Research Center Borstel, Borstel, Germany
- German Center for Infection Research (DZIF) Tuberculosis Unit, Borstel, Germany
| | - Matthias Merker
- Molecular and Experimental Mycobacteriology, Research Center Borstel, Borstel, Germany
| |
Collapse
|
16
|
Lange C, Alghamdi WA, Al-Shaer MH, Brighenti S, Diacon AH, DiNardo AR, Grobbel HP, Gröschel MI, von Groote-Bidlingmaier F, Hauptmann M, Heyckendorf J, Köhler N, Kohl TA, Merker M, Niemann S, Peloquin CA, Reimann M, Schaible UE, Schaub D, Schleusener V, Thye T, Schön T. Perspectives for personalized therapy for patients with multidrug-resistant tuberculosis. J Intern Med 2018; 284:163-188. [PMID: 29806961 DOI: 10.1111/joim.12780] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
According to the World Health Organization (WHO), tuberculosis is the leading cause of death attributed to a single microbial pathogen worldwide. In addition to the large number of patients affected by tuberculosis, the emergence of Mycobacterium tuberculosis drug-resistance is complicating tuberculosis control in many high-burden countries. During the past 5 years, the global number of patients identified with multidrug-resistant tuberculosis (MDR-TB), defined as bacillary resistance at least against rifampicin and isoniazid, the two most active drugs in a treatment regimen, has increased by more than 20% annually. Today we experience a historical peak in the number of patients affected by MDR-TB. The management of MDR-TB is characterized by delayed diagnosis, uncertainty of the extent of bacillary drug-resistance, imprecise standardized drug regimens and dosages, very long duration of therapy and high frequency of adverse events which all translate into a poor prognosis for many of the affected patients. Major scientific and technological advances in recent years provide new perspectives through treatment regimens tailor-made to individual needs. Where available, such personalized treatment has major implications on the treatment outcomes of patients with MDR-TB. The challenge now is to bring these adances to those patients that need them most.
Collapse
Affiliation(s)
- C Lange
- Clinical Infectious Diseases, Research Center Borstel, Borstel, Germany
- Tuberculosis Unit, German Center for Infection Research (DZIF), Borstel, Germany
- International Health/Infectious Diseases, University of Lübeck, Lübeck, Germany
- Department of Medicine, Karolinska Institute, Stockholm, Sweden
| | - W A Alghamdi
- Department of Pharmacotherapy and Translational Research, Infectious Disease Pharmacokinetics Laboratory, College of Pharmacy, University of Florida, Gainesville, FL, USA
| | - M H Al-Shaer
- Department of Pharmacotherapy and Translational Research, Infectious Disease Pharmacokinetics Laboratory, College of Pharmacy, University of Florida, Gainesville, FL, USA
| | - S Brighenti
- Department of Medicine, Center for Infectious Medicine (CIM), Karolinska Institutet, Karolinska University Hospital Huddinge, Stockholm, Sweden
| | - A H Diacon
- Task Applied Science, Bellville, South Africa
- Division of Physiology, Faculty of Medicine and Health Sciences, Stellenbosch University, Tygerberg, South Africa
| | - A R DiNardo
- Section of Global and Immigrant Health, Baylor College of Medicine, Houston, TX, USA
| | - H P Grobbel
- Clinical Infectious Diseases, Research Center Borstel, Borstel, Germany
- Tuberculosis Unit, German Center for Infection Research (DZIF), Borstel, Germany
- International Health/Infectious Diseases, University of Lübeck, Lübeck, Germany
| | - M I Gröschel
- Department of Pumonary Diseases & Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
- Molecular and Experimental Mycobacteriology, National Reference Center for Mycobacteria, Research Center Borstel, Borstel, Germany
| | | | - M Hauptmann
- Tuberculosis Unit, German Center for Infection Research (DZIF), Borstel, Germany
- Cellular Microbiology, Research Center Borstel, Borstel, Germany
| | - J Heyckendorf
- Clinical Infectious Diseases, Research Center Borstel, Borstel, Germany
- Tuberculosis Unit, German Center for Infection Research (DZIF), Borstel, Germany
- International Health/Infectious Diseases, University of Lübeck, Lübeck, Germany
| | - N Köhler
- Clinical Infectious Diseases, Research Center Borstel, Borstel, Germany
- Tuberculosis Unit, German Center for Infection Research (DZIF), Borstel, Germany
- International Health/Infectious Diseases, University of Lübeck, Lübeck, Germany
| | - T A Kohl
- Molecular and Experimental Mycobacteriology, National Reference Center for Mycobacteria, Research Center Borstel, Borstel, Germany
| | - M Merker
- Molecular and Experimental Mycobacteriology, National Reference Center for Mycobacteria, Research Center Borstel, Borstel, Germany
| | - S Niemann
- Tuberculosis Unit, German Center for Infection Research (DZIF), Borstel, Germany
- Molecular and Experimental Mycobacteriology, National Reference Center for Mycobacteria, Research Center Borstel, Borstel, Germany
| | - C A Peloquin
- Department of Pharmacotherapy and Translational Research, Infectious Disease Pharmacokinetics Laboratory, College of Pharmacy, University of Florida, Gainesville, FL, USA
| | - M Reimann
- Clinical Infectious Diseases, Research Center Borstel, Borstel, Germany
- Tuberculosis Unit, German Center for Infection Research (DZIF), Borstel, Germany
- International Health/Infectious Diseases, University of Lübeck, Lübeck, Germany
| | - U E Schaible
- Tuberculosis Unit, German Center for Infection Research (DZIF), Borstel, Germany
- Cellular Microbiology, Research Center Borstel, Borstel, Germany
- Biochemical Microbiology & Immunochemistry, University of Lübeck, Lübeck, Germany
- LRA INFECTIONS'21, Borstel, Germany
| | - D Schaub
- Clinical Infectious Diseases, Research Center Borstel, Borstel, Germany
- Tuberculosis Unit, German Center for Infection Research (DZIF), Borstel, Germany
- International Health/Infectious Diseases, University of Lübeck, Lübeck, Germany
| | - V Schleusener
- Molecular and Experimental Mycobacteriology, National Reference Center for Mycobacteria, Research Center Borstel, Borstel, Germany
| | - T Thye
- Department of Infectious Disease Epidemiology, Bernhard Nocht Institute for Tropical Medicine, Hamburg, Germany
| | - T Schön
- Department of Clinical and Experimental Medicine, Linköping University, Linköping, Sweden
- Department of Clinical Microbiology and Infectious Diseases, Kalmar County Hospital, Linköping University, Linköping, Sweden
| |
Collapse
|
17
|
Kroesen VM, Gröschel MI, Martinson N, Zumla A, Maeurer M, van der Werf TS, Vilaplana C. Non-Steroidal Anti-inflammatory Drugs As Host-Directed Therapy for Tuberculosis: A Systematic Review. Front Immunol 2017; 8:772. [PMID: 28713389 PMCID: PMC5492311 DOI: 10.3389/fimmu.2017.00772] [Citation(s) in RCA: 44] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2017] [Accepted: 06/19/2017] [Indexed: 01/10/2023] Open
Abstract
Lengthy, antimicrobial therapy targeting the pathogen is the mainstay of conventional tuberculosis treatment, complicated by emerging drug resistances. Host-directed therapies, including non-steroidal anti-inflammatory drugs (NSAIDs), in contrast, target host factors to mitigate disease severity. In the present Systematic Review, we investigate whether NSAIDs display any effects as therapy of TB and discuss possible mechanisms of action of NSAIDs as adjunctive therapy of TB. Ten studies, seven preclinical studies in mice and three clinical trials, were included and systematically reviewed. Our results point toward a beneficial effect of NSAIDs as adjunct to current TB therapy regimens, mediated by decreased lung pathology balancing host-immune reaction. The determination of the best timing for their administration in order to obtain the potential beneficial effects needs further investigation. Even if the preclinical evidence requires clinical evaluation, NSAIDs might represent a potential safe, simple, and cheap improvement in therapy of TB.
Collapse
Affiliation(s)
- Vera M Kroesen
- Carl-von-Ossietzky University Oldenburg, Oldenburg, Germany.,Experimental Tuberculosis Unit (UTE), Fundació Institut Germans Trias i Pujol (IGTP), Universitat Autònoma de Barcelona (UAB), Badalona, Catalonia, Spain
| | - Matthias I Gröschel
- Department of Pulmonary Diseases & Tuberculosis and Internal Medicine, University Medical Center Groningen, University of Groningen, Groningen, Netherland.,Department of Infectious Diseases, University Medical Center Groningen, University of Groningen, Groningen, Netherland
| | - Neil Martinson
- Perinatal HIV Research Unit, University of Witwatersrand, Johannesburg, South Africa
| | - Alimuddin Zumla
- Division of Infection and Immunity, University College London (UCL), London, United Kingdom.,National Institute of Health Research's Biomedical Research Centre, University College London Hospitals NHS Foundation Trust, London, United Kingdom.,Department of Microbiology, University College London Hospitals NHS Foundation Trust, London, United Kingdom
| | - Markus Maeurer
- Division of Therapeutic Immunology, Department of Laboratory Medicine, Karolinska Institutet, Stockholm, Sweden
| | - Tjip S van der Werf
- Department of Pulmonary Diseases & Tuberculosis and Internal Medicine, University Medical Center Groningen, University of Groningen, Groningen, Netherland.,Department of Infectious Diseases, University Medical Center Groningen, University of Groningen, Groningen, Netherland
| | - Cristina Vilaplana
- Experimental Tuberculosis Unit (UTE), Fundació Institut Germans Trias i Pujol (IGTP), Universitat Autònoma de Barcelona (UAB), Badalona, Catalonia, Spain.,Centro de Investigación Biomédica en Red de Enfermedades Respiratorias (CIBERES), Madrid, Spain
| |
Collapse
|
18
|
Sayes F, Pawlik A, Frigui W, Gröschel MI, Crommelynck S, Fayolle C, Cia F, Bancroft GJ, Bottai D, Leclerc C, Brosch R, Majlessi L. CD4+ T Cells Recognizing PE/PPE Antigens Directly or via Cross Reactivity Are Protective against Pulmonary Mycobacterium tuberculosis Infection. PLoS Pathog 2016; 12:e1005770. [PMID: 27467705 PMCID: PMC4965174 DOI: 10.1371/journal.ppat.1005770] [Citation(s) in RCA: 44] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2016] [Accepted: 06/27/2016] [Indexed: 01/01/2023] Open
Abstract
Mycobacterium tuberculosis (Mtb), possesses at least three type VII secretion systems, ESX-1, -3 and -5 that are actively involved in pathogenesis and host-pathogen interaction. We recently showed that an attenuated Mtb vaccine candidate (Mtb Δppe25-pe19), which lacks the characteristic ESX-5-associated pe/ppe genes, but harbors all other components of the ESX-5 system, induces CD4+ T-cell immune responses against non-esx-5-associated PE/PPE protein homologs. These T cells strongly cross-recognize the missing esx-5-associated PE/PPE proteins. Here, we characterized the fine composition of the functional cross-reactive Th1 effector subsets specific to the shared PE/PPE epitopes in mice immunized with the Mtb Δppe25-pe19 vaccine candidate. We provide evidence that the Mtb Δppe25-pe19 strain, despite its significant attenuation, is comparable to the WT Mtb strain with regard to: (i) its antigenic repertoire related to the different ESX systems, (ii) the induced Th1 effector subset composition, (iii) the differentiation status of the Th1 cells induced, and (iv) its particular features at stimulating the innate immune response. Indeed, we found significant contribution of PE/PPE-specific Th1 effector cells in the protective immunity against pulmonary Mtb infection. These results offer detailed insights into the immune mechanisms underlying the remarkable protective efficacy of the live attenuated Mtb Δppe25-pe19 vaccine candidate, as well as the specific potential of PE/PPE proteins as protective immunogens. Mycobacterium tuberculosis (Mtb), the causative agent of human tuberculosis, is one of the most widely spread human pathogens, responsible for more than 9.6 million of new tuberculosis cases and 1.5 million deaths, annually. The resurgence of pulmonary tuberculosis in immuno-compromised patients, including HIV-co-infected populations, and increasing spread of drug-resistant Mtb strains are worrying. Given the estimated 2 billion cases of latent Mtb infections and the only partial efficacy of the unique, currently available tuberculosis-vaccine Mycobacterium bovis BCG (Bacille Calmette-Guerin) it is necessary to develop improved vaccines. Here, we demonstrate that the host cellular immunity, mediated by CD4+ T lymphocytes, specific to the “PE/PPE” families of mycobacterial antigens, contribute to the protection against Mtb-induced disease. We revealed the fine composition of the PE/PPE-specific T cells by characterizing their effector functions and differentiation status. We previously described a live attenuated mycobacterial strain as a vaccine candidate that is able to induce such CD4+ T cells and which displays particular properties at stimulating the cells of the innate immune system. These responses play a central role in the initiation of the host defense and in the protection against tuberculosis. Our results pave the way for further development of candidates in preclinical models of anti-tuberculosis vaccination.
Collapse
Affiliation(s)
- Fadel Sayes
- Institut Pasteur, Unité de Pathogénomique Mycobactérienne Intégrée, Paris, France
| | - Alexandre Pawlik
- Institut Pasteur, Unité de Pathogénomique Mycobactérienne Intégrée, Paris, France
| | - Wafa Frigui
- Institut Pasteur, Unité de Pathogénomique Mycobactérienne Intégrée, Paris, France
| | - Matthias I. Gröschel
- Institut Pasteur, Unité de Pathogénomique Mycobactérienne Intégrée, Paris, France
| | - Samuel Crommelynck
- Institut Pasteur, Unité de Pathogénomique Mycobactérienne Intégrée, Paris, France
| | - Catherine Fayolle
- Institut Pasteur, Unité de Régulation Immunitaire et Vaccinologie, Paris, France
- INSERM U1041, Paris, France
| | - Felipe Cia
- London School of Hygiene and Tropical Medicine, London, United Kingdom
| | | | - Daria Bottai
- University of Pisa, Ricerca Traslazionale e delle Nuove Tecnologie in Medicina e Chirurgia, Pisa, Italy
| | - Claude Leclerc
- Institut Pasteur, Unité de Régulation Immunitaire et Vaccinologie, Paris, France
- INSERM U1041, Paris, France
| | - Roland Brosch
- Institut Pasteur, Unité de Pathogénomique Mycobactérienne Intégrée, Paris, France
| | - Laleh Majlessi
- Institut Pasteur, Unité de Pathogénomique Mycobactérienne Intégrée, Paris, France
- * E-mail:
| |
Collapse
|
19
|
Gröschel MI, Omansen TF, de Lange W, van der Werf TS, Lokate M, Bathoorn E, Akkerman OW, Stienstra Y. Multidrug-Resistant Tuberculosis Complicated by Nosocomial Infection with Multidrug-Resistant Enterobacteriaceae. Am J Trop Med Hyg 2016; 94:517-8. [PMID: 26755567 DOI: 10.4269/ajtmh.15-0690] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2015] [Accepted: 11/25/2015] [Indexed: 11/07/2022] Open
Abstract
Treatment of mycobacterial diseases such as tuberculosis (TB) entails long and intense antimicrobial therapy. TB patients are at risk of coinfection with other multidrug-resistant bacteria, such as those from Enterobacteriaceae family, because of antimicrobial selection pressure and nosocomial transmission during prolonged hospital admission. Here, we report on two patients treated for multidrug-resistant TB, who developed severe sepsis due to an extended spectrum β-lactamase producing organism. Diagnostic culture identified the venous access port as source, and upon surgical removal and antimicrobial therapy rapid clinical improvement was achieved. Increased awareness and knowledge on the prevalence of multi-resistant Enterobacteriaceae is needed, notably in TB centers, to provide a safe hospital environment to our patients.
Collapse
Affiliation(s)
- Matthias I Gröschel
- Department of Pulmonary Diseases and Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Internal Medicine/Infectious Diseases, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Medical Microbiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Till F Omansen
- Department of Pulmonary Diseases and Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Internal Medicine/Infectious Diseases, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Medical Microbiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Wiel de Lange
- Department of Pulmonary Diseases and Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Internal Medicine/Infectious Diseases, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Medical Microbiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Tjip S van der Werf
- Department of Pulmonary Diseases and Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Internal Medicine/Infectious Diseases, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Medical Microbiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Mariëtte Lokate
- Department of Pulmonary Diseases and Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Internal Medicine/Infectious Diseases, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Medical Microbiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Erik Bathoorn
- Department of Pulmonary Diseases and Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Internal Medicine/Infectious Diseases, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Medical Microbiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Onno W Akkerman
- Department of Pulmonary Diseases and Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Internal Medicine/Infectious Diseases, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Medical Microbiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Ymkje Stienstra
- Department of Pulmonary Diseases and Tuberculosis, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Internal Medicine/Infectious Diseases, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands; Department of Medical Microbiology, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| |
Collapse
|
20
|
Gröschel MI, Prabowo SA, Cardona PJ, Stanford JL, Werf TSVD. Therapeutic vaccines for tuberculosis—A systematic review. Vaccine 2014; 32:3162-8. [DOI: 10.1016/j.vaccine.2014.03.047] [Citation(s) in RCA: 48] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2013] [Revised: 03/01/2014] [Accepted: 03/13/2014] [Indexed: 12/25/2022]
|