1
|
Nama N, Shen Y, Bone JN, Lee Z, Picco K, Jin F, Foulds JL, Gagnon JA, Novak C, Parisien B, Donlan M, Goldman RD, Sehgal A, Holland J, Mahant S, Tieder JS, Gill PJ. External Validation of Brief Resolved Unexplained Events Prediction Rules for Serious Underlying Diagnosis. JAMA Pediatr 2025; 179:188-196. [PMID: 39680379 PMCID: PMC11791710 DOI: 10.1001/jamapediatrics.2024.4399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/05/2024] [Accepted: 08/10/2024] [Indexed: 12/17/2024]
Abstract
Importance The American Academy of Pediatrics (AAP) higher-risk criteria for brief resolved unexplained events (BRUE) have a low positive predictive value (4.8%) and misclassify most infants as higher risk (>90%). New BRUE prediction rules from a US cohort of 3283 infants showed improved discrimination; however, these rules have not been validated in an external cohort. Objective To externally validate new BRUE prediction rules and compare them with the AAP higher-risk criteria. Design, Setting, and Participants This was a retrospective multicenter cohort study conducted from 2017 to 2021 and monitored for 90 days after index presentation. The setting included infants younger than 1 year with a BRUE identified through retrospective chart review from 11 Canadian hospitals. Study data were analyzed from March 2022 to March 2024. Exposures The BRUE prediction rules. Main Outcome and Measure The primary outcome was a serious underlying diagnosis, defined as conditions where a delay in diagnosis could lead to increased morbidity or mortality. Results Of 1042 patients (median [IQR] age, 41 [13-84] days; 529 female [50.8%]), 977 (93.8%) were classified as higher risk by the AAP criteria. A total of 79 patients (7.6%) had a serious underlying diagnosis. For this outcome, the AAP criteria demonstrated a sensitivity of 100.0% (95% CI, 95.4%-100.0%), a specificity of 6.7% (95% CI, 5.2%-8.5%), a positive likelihood ratio (LR+) of 1.07 (95% CI, 1.05-1.09), and an AUC of 0.53 (95% CI, 0.53-0.54). The BRUE prediction rule for discerning serious diagnoses displayed an AUC of 0.60 (95% CI, 0.54-0.67; calibration intercept: 0.60), which improved to an AUC of 0.71 (95% CI, 0.65-0.76; P < .001; calibration intercept: 0.00) after model revision. Event recurrence was noted in 163 patients (15.6%). For this outcome, the AAP criteria yielded a sensitivity of 99.4% (95% CI, 96.6%-100.0%), a specificity of 7.3% (95% CI, 5.7%-9.2%), an LR+ of 1.07 (95% CI, 1.05-1.10), and an AUC of 0.58 (95% CI, 0.56-0.58). The AUC of the prediction rule stood at 0.67 (95% CI, 0.62-0.72; calibration intercept: 0.15). Conclusions and Relevance Results of this multicenter cohort study show that the BRUE prediction rules outperformed the AAP higher-risk criteria on external geographical validation, and performance improved after recalibration. These rules provide clinicians and families with a more precise tool to support decision-making, grounded in individual risk tolerance.
Collapse
Affiliation(s)
- Nassr Nama
- Division of Hospital Medicine, Department of Pediatrics, University of Washington, Seattle Children’s Hospital, Seattle
| | - Ye Shen
- BC Children’s Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Jeffrey N. Bone
- BC Children’s Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Zerlyn Lee
- Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
| | - Kara Picco
- Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| | - Falla Jin
- BC Children’s Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Jessica L. Foulds
- Stollery Children’s Hospital, Division of Pediatric Hospital Medicine, Department of Pediatrics, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Alberta, Canada
| | | | - Chris Novak
- Department of Pediatrics, Alberta Children’s Hospital, University of Calgary, Calgary, Alberta, Canada
| | - Brigitte Parisien
- Department of Pediatrics, CHU Sainte-Justine, Université de Montréal, Montréal, Québec, Canada
| | - Matthew Donlan
- MUHC-The Montreal Children’s Hospital, McGill University, Montreal, Quebec, Canada
| | - Ran D. Goldman
- BC Children’s Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Anupam Sehgal
- Department of Paediatrics, Kingston General Hospital, Queen’s University, Kingston, Ontario, Canada
| | - Joanna Holland
- Division of General Pediatrics, Department of Pediatrics, IWK Health Centre, Halifax, Nova Scotia, Canada
| | - Sanjay Mahant
- Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| | - Joel S. Tieder
- Division of Hospital Medicine, Department of Pediatrics, Seattle Children’s Hospital and the University of Washington, Seattle
| | - Peter J. Gill
- Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
2
|
Nama N, Lee Z, Picco K, Jin F, Bone JN, Quet J, Foulds J, Gagnon JA, Novak C, Parisien B, Donlan M, Goldman RD, Sehgal A, Kanani R, Holland J, Kyrychenko P, Kirolos N, Opotchanova I, Harnois É, Schacter A, Frizon-Peresa E, Rajasegaran P, Hosseini P, Wyslobicky M, Akbaroghli S, Nalan P, Mahant S, Tieder J, Gill P. Identifying serious underlying diagnoses among patients with brief resolved unexplained events (BRUEs): a Canadian cohort study. BMJ Paediatr Open 2024; 8:e002525. [PMID: 39317653 DOI: 10.1136/bmjpo-2024-002525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 08/25/2024] [Indexed: 09/26/2024] Open
Abstract
OBJECTIVE To describe the demographics and clinical outcomes of infants with brief resolved unexplained events (BRUE). DESIGN A retrospective cohort study. SETTING 11 centres within the Canadian Paediatric Inpatient Research Network. PATIENTS Patients presenting to the emergency department (ED) following a BRUE (2017-2021) were eligible, when no clinical cause identified after a thorough history and physical examination. MAIN OUTCOME MEASURES Serious underlying diagnosis (requiring prompt identification) and event recurrence (within 90 days). RESULTS Of 1042 eligible patients, 665 were hospitalised (63.8%), with a median stay of 1.73 days. Diagnostic tests were performed on 855 patients (82.1%), and 440 (42.2%) received specialist consultations. In total, 977 patients (93.8%) were categorised as higher risk BRUE per the American Academy of Pediatrics guidelines. Most patients (n=551, 52.9%) lacked an explanatory diagnosis; however, serious underlying diagnoses were identified in 7.6% (n=79). Epilepsy/infantile spasms were the most common serious underlying diagnoses (2.0%, n=21). Gastro-oesophageal reflux was the most common non-serious underlying diagnosis identified in 268 otherwise healthy and thriving infants (25.7%). No instances of invasive bacterial infections, arrhythmias or metabolic disorders were found. Recurrent events were observed in 113 patients (10.8%) during the index visit, and 65 patients had a return to ED visit related to a recurrent event (6.2%). One death occurred within 90 days. CONCLUSIONS There is a low risk for a serious underlying diagnosis, where the majority of patients remain without a clear explanation. This study provides evidence-based risk for adverse outcomes, critical information to be used when engaging in shared decision-making with caregivers.
Collapse
Affiliation(s)
- Nassr Nama
- Center for Clinical and Translational Research, Seattle Children's Research Institute, Seattle, Washington, USA
- Division of Hospital Medicine, Department of Pediatrics, University of Washington, Seattle, Washington, USA
| | - Zerlyn Lee
- Pediatrics, British Columbia Children's Hospital, Vancouver, British Columbia, Canada
- Pediatrics, The University of British Columbia, Vancouver, British Columbia, Canada
| | - Kara Picco
- Paediatrics, The Hospital for Sick Children, Toronto, Ontario, Canada
- Paediatrics, University of Toronto, Toronto, Ontario, Canada
| | - Falla Jin
- Clinical Research Support Unit, British Columbia Children's Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Jeffrey N Bone
- Research Informatics, British Columbia Children's Hospital Research Institute, Vancouver, British Columbia, Canada
| | - Julie Quet
- Pediatrics, Children's Hospital of Eastern Ontario, Ottawa, Ontario, Canada
| | - Jessica Foulds
- Pediatrics, Stollery Children's Hospital, Edmonton, Alberta, Canada
| | | | - Chris Novak
- Pediatrics, Alberta Children's Hospital, Calgary, Alberta, Canada
| | | | - Matthew Donlan
- McGill University, Montreal Children's Hospital, Montreal, Québec, Canada
| | - Ran D Goldman
- Pediatrics, British Columbia Children's Hospital, Vancouver, British Columbia, Canada
- Pediatrics, The University of British Columbia, Vancouver, British Columbia, Canada
| | - Anupam Sehgal
- Paediatrics, Kingston Health Sciences Centre, Kingston, Ontario, Canada
| | - Ronik Kanani
- North York General Hospital, Toronto, Ontario, Canada
| | - Joanna Holland
- Pediatrics, IWK Health Centre, Halifax, Nova Scotia, Canada
| | - Polina Kyrychenko
- Paediatrics, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Nardin Kirolos
- Paediatrics, The Hospital for Sick Children, Toronto, Ontario, Canada
| | | | - Émilie Harnois
- CHU de Québec, Université Laval, Québec City, Québec, Canada
| | - Alyse Schacter
- Pediatrics, Alberta Children's Hospital, Calgary, Alberta, Canada
| | | | - Praveen Rajasegaran
- McGill University Faculty of Medicine and Health Sciences, Montreal, Québec, Canada
| | - Parnian Hosseini
- Anesthesia, Pain Management & Perioperative Medicine, Dalhousie University, Halifax, Nova Scotia, Canada
| | | | | | | | - Sanjay Mahant
- Paediatrics, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Joel Tieder
- Center for Clinical and Translational Research, Seattle Children's Research Institute, Seattle, Washington, USA
- Division of Hospital Medicine, Department of Pediatrics, University of Washington, Seattle, Washington, USA
| | - Peter Gill
- Department of Pediatrics, Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| |
Collapse
|
3
|
Nama N, DeLaroche AM, Gremse DA. Brief Resolved Unexplained Event (BRUE): Is Reassurance Enough for Caregivers? Hosp Pediatr 2022; 12:e440-e442. [PMID: 36336648 DOI: 10.1542/hpeds.2022-006939] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
- Nassr Nama
- Division of General Pediatrics, Department of Pediatrics, University of British Columbia and BC Children's Hospital, Vancouver, British Columbia, Canada
| | - Amy M DeLaroche
- Division of Pediatric Emergency Medicine, Department of Pediatrics, Children's Hospital of Michigan, Detroit, Michigan
| | - David A Gremse
- Department of Pediatrics, University of South Alabama, Mobile, Alabama
| |
Collapse
|
4
|
Nama N, Hall M, Neuman M, Sullivan E, Bochner R, De Laroche A, Hadvani T, Jain S, Katsogridakis Y, Kim E, Mittal M, Payson A, Prusakowski M, Shastri N, Stephans A, Westphal K, Wilkins V, Tieder J. Risk Prediction After a Brief Resolved Unexplained Event. Hosp Pediatr 2022; 12:772-785. [PMID: 35965279 DOI: 10.1542/hpeds.2022-006637] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
OBJECTIVES Only 4% of brief resolved unexplained events (BRUE) are caused by a serious underlying illness. The American Academy of Pediatrics (AAP) guidelines do not distinguish patients who would benefit from further investigation and hospitalization. We aimed to derive and validate a clinical decision rule for predicting the risk of a serious underlying diagnosis or event recurrence. METHODS We retrospectively identified infants presenting with a BRUE to 15 children's hospitals (2015-2020). We used logistic regression in a split-sample to derive and validate a risk prediction model. RESULTS Of 3283 eligible patients, 565 (17.2%) had a serious underlying diagnosis (n = 150) or a recurrent event (n = 469). The AAP's higher-risk criteria were met in 91.5% (n = 3005) and predicted a serious diagnosis with 95.3% sensitivity, 8.6% specificity, and an area under the curve of 0.52 (95% confidence interval [CI]: 0.47-0.57). A derived model based on age, previous events, and abnormal medical history demonstrated an area under the curve of 0.64 (95%CI: 0.59-0.70). In contrast to the AAP criteria, patients >60 days were more likely to have a serious underlying diagnosis (odds ratio:1.43, 95%CI: 1.03-1.98, P = .03). CONCLUSIONS Most infants presenting with a BRUE do not have a serious underlying pathology requiring prompt diagnosis. We derived 2 models to predict the risk of a serious diagnosis and event recurrence. A decision support tool based on this model may aid clinicians and caregivers in the discussion on the benefit of diagnostic testing and hospitalization (https://www.mdcalc.com/calc/10400/brief-resolved-unexplained-events-2.0-brue-2.0-criteria-infants).
Collapse
Affiliation(s)
- Nassr Nama
- Division of General Pediatrics, Department of Pediatrics, University of British Columbia and BC Children's Hospital, Vancouver, British Columbia, Canada
| | - Matt Hall
- Children's Hospital Association, Lenexa, Kansas
| | - Mark Neuman
- Division of Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts
| | - Erin Sullivan
- Department of Pediatrics, University of Washington, Seattle Children's Core for Biomedical Statistics, Seattle, Washington
| | - Risa Bochner
- SUNY Downstate Health Sciences University/New York City Health and Hospitals/Kings County Hospital, New York City, New York
| | - Amy De Laroche
- Division of Pediatric Emergency Medicine, Department of Pediatrics, Children's Hospital of Michigan, Detroit, Michigan
| | - Teena Hadvani
- Division of Hospital Medicine, Department of Pediatrics, Baylor College of Medicine and Texas Children's Hospital, Houston, Texas
| | - Shobhit Jain
- Division of Emergency Medicine, Department of Pediatrics, Children's Mercy Hospital, Kansas City, Kansas
| | - Yiannis Katsogridakis
- Division of Emergency Medicine, Department of Pediatrics, Ann & Robert H. Lurie Children's Hospital of Chicago, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - Edward Kim
- Division of Pediatric Hospital Medicine, Department of Pediatrics, Riley Hospital for Children at Indiana University Health, Indianapolis, Indiana
| | - Manoj Mittal
- Children's Hospital of Philadelphia, Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania
| | | | | | - Nirav Shastri
- Division of Emergency Medicine, Department of Pediatrics, Children's Mercy Hospital, Kansas City, Kansas
| | | | - Kathryn Westphal
- Division of Hospital Medicine, Nationwide Children's Hospital, Columbus, Ohio
| | - Victoria Wilkins
- Division of Pediatric Hospital Medicine, University of Utah, Primary Children's Hospital, Salt Lake City, Utah
| | - Joel Tieder
- Division of Pediatric Hospital Medicine, University of Washington and Seattle Children's Hospital, Seattle, Washington
| |
Collapse
|
5
|
Oddo ER, Picco K, Gill PJ. Brief Resolved Unexplained Events (BRUEs): New Name, Similar Challenges. Hosp Pediatr 2022; 12:e303-e305. [PMID: 35965272 DOI: 10.1542/hpeds.2022-006742] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Affiliation(s)
- Elizabeth R Oddo
- Department of Pediatrics, Medical University of South Carolina, Charleston, South Carolina
| | - Kara Picco
- The Hospital for Sick Children, Toronto, Ontario, Canada.,Department of Pediatrics, University of Toronto, Toronto, Ontario, Canada
| | - Peter J Gill
- The Hospital for Sick Children, Toronto, Ontario, Canada.,Department of Pediatrics, University of Toronto, Toronto, Ontario, Canada.,Child Health Evaluative Sciences, SickKids Research Institute, Toronto, Ontario, Canada.,Institute of Health Policy, Management and Evaluation, The University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|