1
|
Rees CA, Hooli S, King C, McCollum ED, Colbourn T, Lufesi N, Mwansambo C, Lazzerini M, Madhi SA, Cutland C, Nunes M, Gessner BD, Basnet S, Kartasasmita CB, Mathew JL, Zaman SMAU, Paranhos-Baccala G, Bhatnagar S, Wadhwa N, Lodha R, Aneja S, Santosham M, Picot VS, Sylla M, Awasthi S, Bavdekar A, Pape JW, Rouzier V, Chou M, Rakoto-Andrianarivelo M, Wang J, Nymadawa P, Vanhems P, Russomando G, Asghar R, Banajeh S, Iqbal I, MacLeod W, Maulen-Radovan I, Mino G, Saha S, Singhi S, Thea DM, Clara AW, Campbell H, Nair H, Falconer J, Williams LJ, Horne M, Strand T, Qazi SA, Nisar YB, Neuman MI. External validation of the RISC, RISC-Malawi, and PERCH clinical prediction rules to identify risk of death in children hospitalized with pneumonia. J Glob Health 2021; 11:04062. [PMID: 34737862 PMCID: PMC8542381 DOI: 10.7189/jogh.11.04062] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND Existing scores to identify children at risk of hospitalized pneumonia-related mortality lack broad external validation. Our objective was to externally validate three such risk scores. METHODS We applied the Respiratory Index of Severity in Children (RISC) for HIV-negative children, the RISC-Malawi, and the Pneumonia Etiology Research for Child Health (PERCH) scores to hospitalized children in the Pneumonia REsearch Partnerships to Assess WHO REcommendations (PREPARE) data set. The PREPARE data set includes pooled data from 41 studies on pediatric pneumonia from across the world. We calculated test characteristics and the area under the curve (AUC) for each of these clinical prediction rules. RESULTS The RISC score for HIV-negative children was applied to 3574 children 0-24 months and demonstrated poor discriminatory ability (AUC = 0.66, 95% confidence interval (CI) = 0.58-0.73) in the identification of children at risk of hospitalized pneumonia-related mortality. The RISC-Malawi score had fair discriminatory value (AUC = 0.75, 95% CI = 0.74-0.77) among 17 864 children 2-59 months. The PERCH score was applied to 732 children 1-59 months and also demonstrated poor discriminatory value (AUC = 0.55, 95% CI = 0.37-0.73). CONCLUSIONS In a large external application of the RISC, RISC-Malawi, and PERCH scores, a substantial number of children were misclassified for their risk of hospitalized pneumonia-related mortality. Although pneumonia risk scores have performed well among the cohorts in which they were derived, their performance diminished when externally applied. A generalizable risk assessment tool with higher sensitivity and specificity to identify children at risk of hospitalized pneumonia-related mortality may be needed. Such a generalizable risk assessment tool would need context-specific validation prior to implementation in that setting.
Collapse
Affiliation(s)
- Chris A Rees
- Division of Pediatric Emergency Medicine, Emory University School of Medicine, Children's Healthcare of Atlanta, Atlanta, Georgia, USA
| | - Shubhada Hooli
- Section of Pediatric Emergency Medicine, Texas Children's Hospital, Baylor College of Medicine, Houston, Texas, USA
| | - Carina King
- Department of Global Public Health, Karolinska Institutet, Stockholm, Sweden and Institute for Global Health, University College London, London, UK
| | - Eric D McCollum
- Global Program in Respiratory Sciences, Eudowood Division of Pediatric Respiratory Sciences, Department of Pediatrics, Johns Hopkins School of Medicine, Baltimore, USA and Department of International Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, USA
| | - Tim Colbourn
- Institute for Global Health, University College London, London, UK
| | | | | | - Marzia Lazzerini
- WHO Collaborating Centre for Maternal and Child Health, Institute for Maternal and Child Health IRCCS Burlo Garofolo, Trieste, Italy
| | - Shabir Ahmed Madhi
- South African Medical Research Council: Vaccines and Infectious Diseases Analytics Research Unit, School of Pathology, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa; Department of Science and Technology/National Research Foundation: Vaccine Preventable Diseases Unit, University of the Witwatersrand, Johannesburg, South Africa
| | - Clare Cutland
- South African Medical Research Council: Vaccines and Infectious Diseases Analytics Research Unit, School of Pathology, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa; Department of Science and Technology/National Research Foundation: Vaccine Preventable Diseases Unit, University of the Witwatersrand, Johannesburg, South Africa
| | - Marta Nunes
- South African Medical Research Council: Vaccines and Infectious Diseases Analytics Research Unit, School of Pathology, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa; Department of Science and Technology/National Research Foundation: Vaccine Preventable Diseases Unit, University of the Witwatersrand, Johannesburg, South Africa
| | | | - Sudha Basnet
- Center for Intervention Science in Maternal and Child Health, University of Bergen, Norway
| | - Cissy B Kartasasmita
- Department of Child Health, Faculty of Medicine, Universitas Padjadjaran, Bandung, Indonesia
| | - Joseph L Mathew
- Pediatric Pulmonology, Postgraduate Institute of Medical Education and Research, Chandigarh, India
| | | | | | | | - Nitya Wadhwa
- Translational Health Science and Technology Institute, Faridabad, India
| | - Rakesh Lodha
- All India Institute of Medical Sciences, New Delhi, India
| | - Satinder Aneja
- School of Medical Sciences & Research, Sharda University, Greater Noida, India
| | - Mathuram Santosham
- Department of International Health, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, USA
| | | | - Mariam Sylla
- Gabriel Touré Hospital, Department of Pediatrics, Bamako, Mali
| | - Shally Awasthi
- King George's Medical University, UP, Department of Pediatrics, Lucknow, India
| | | | | | | | - Monidarin Chou
- University of Health Sciences Faculty of Medicine, Rodolph Mérieux Laboratory, Phom Phen, Cambodia
| | | | - Jianwei Wang
- Chinese Academy of Medical Sciences & Peking Union, Medical College Institute of Pathogen Biology, MOH Key Laboratory of Systems Biology of Pathogens and Dr Christophe Mérieux Laboratory, Beijing, China
| | - Pagbajabyn Nymadawa
- Mongolian Academy of Sciences, Academy of Medical Sciences, Ulaanbaatar, Mongolia
| | - Philippe Vanhems
- Hospices Civils de Lyon, Infection Control Unit; CIRI, Centre International de Recherche en Infectiologie, (Team PHE3ID), Université Claude Bernard Lyon, Lyon, France
| | - Graciela Russomando
- Universidad Nacional de Asuncion, Instituto de Investigaciones en Ciencias de la Salud, San Lorenzo, Paraguay
| | - Rai Asghar
- Rawalpindi Medical College, Rawalpindi, Pakistan
| | | | | | - William MacLeod
- Department of Global Health, Boston University School of Public Health, Boston, Massachusetts, USA
| | - Irene Maulen-Radovan
- Instituto Nactional de Pediatria Division de Investigacion Insurgentes, Mexico City, Mexico
| | - Greta Mino
- Children's Hospital Dr Francisco de Ycaza Bustamante, Head of Department, Infectious diseases, Guayaquil, Ecuador
| | - Samir Saha
- Dhaka Shishu Hospital, Dhaka, Bangladesh
| | | | - Donald M Thea
- Department of Global Health, Boston University School of Public Health, Boston, Massachusetts, USA
| | - Alexey W Clara
- US Centers for Disease Control, Central American Region, Guatemala City, Guatemala
| | - Harry Campbell
- Centre for Global Health, Usher Institute, The University of Edinburgh, Edinburgh, Scotland
| | - Harish Nair
- Centre for Global Health, Usher Institute, The University of Edinburgh, Edinburgh, Scotland
| | - Jennifer Falconer
- Institute for Global Health and Development, Queen Margaret University, Edinburgh, Scotland
| | - Linda J Williams
- Centre for Global Health, Usher Institute, The University of Edinburgh, Edinburgh, Scotland
| | - Margaret Horne
- Centre for Global Health, Usher Institute, The University of Edinburgh, Edinburgh, Scotland
| | - Tor Strand
- Research Department, Innlandet Hospital Trust, Lillehammer, Norway
| | - Shamim A Qazi
- Department of Maternal, Newborn, Child and Adolescent Health (Retired), World Health Organization, Geneva, Switzerland
| | - Yasir B Nisar
- Department of Maternal, Newborn, Child and Adolescent Health and Ageing, World Health Organization, Geneva, Switzerland
| | - Mark I Neuman
- Division of Emergency Medicine, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|