1
|
Barak-Corren Y, Wolf R, Rozenblum R, Creedon JK, Lipsett SC, Lyons TW, Michelson KA, Miller KA, Shapiro DJ, Reis BY, Fine AM. Harnessing the Power of Generative AI for Clinical Summaries: Perspectives From Emergency Physicians. Ann Emerg Med 2024:S0196-0644(24)00078-7. [PMID: 38483426 DOI: 10.1016/j.annemergmed.2024.01.039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 01/24/2024] [Accepted: 01/29/2024] [Indexed: 04/14/2024]
Abstract
STUDY OBJECTIVE The workload of clinical documentation contributes to health care costs and professional burnout. The advent of generative artificial intelligence language models presents a promising solution. The perspective of clinicians may contribute to effective and responsible implementation of such tools. This study sought to evaluate 3 uses for generative artificial intelligence for clinical documentation in pediatric emergency medicine, measuring time savings, effort reduction, and physician attitudes and identifying potential risks and barriers. METHODS This mixed-methods study was performed with 10 pediatric emergency medicine attending physicians from a single pediatric emergency department. Participants were asked to write a supervisory note for 4 clinical scenarios, with varying levels of complexity, twice without any assistance and twice with the assistance of ChatGPT Version 4.0. Participants evaluated 2 additional ChatGPT-generated clinical summaries: a structured handoff and a visit summary for a family written at an 8th grade reading level. Finally, a semistructured interview was performed to assess physicians' perspective on the use of ChatGPT in pediatric emergency medicine. Main outcomes and measures included between subjects' comparisons of the effort and time taken to complete the supervisory note with and without ChatGPT assistance. Effort was measured using a self-reported Likert scale of 0 to 10. Physicians' scoring of and attitude toward the ChatGPT-generated summaries were measured using a 0 to 10 Likert scale and open-ended questions. Summaries were scored for completeness, accuracy, efficiency, readability, and overall satisfaction. A thematic analysis was performed to analyze the content of the open-ended questions and to identify key themes. RESULTS ChatGPT yielded a 40% reduction in time and a 33% decrease in effort for supervisory notes in intricate cases, with no discernible effect on simpler notes. ChatGPT-generated summaries for structured handoffs and family letters were highly rated, ranging from 7.0 to 9.0 out of 10, and most participants favored their inclusion in clinical practice. However, there were several critical reservations, out of which a set of general recommendations for applying ChatGPT to clinical summaries was formulated. CONCLUSION Pediatric emergency medicine attendings in our study perceived that ChatGPT can deliver high-quality summaries while saving time and effort in many scenarios, but not all.
Collapse
Affiliation(s)
- Yuval Barak-Corren
- Predictive Medicine Group, Computational Health Informatics Program, Boston Children's Hospital, Boston, MA; Division of Cardiology, Children's Hospital of Philadelphia, Philadelphia, PA.
| | - Rebecca Wolf
- Emergency Medicine Boston Children's Hospital, Boston, MA
| | - Ronen Rozenblum
- Harvard Medical School Boston, MA; Division of General Internal Medicine and Primary Care, Brigham and Women's Hospital, Boston, MA
| | - Jessica K Creedon
- Emergency Medicine Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA
| | - Susan C Lipsett
- Emergency Medicine Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA
| | - Todd W Lyons
- Emergency Medicine Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA
| | | | - Kelsey A Miller
- Emergency Medicine Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA
| | - Daniel J Shapiro
- Division of Pediatric Emergency Medicine, University of California, San Francisco, San Francisco, CA
| | - Ben Y Reis
- Predictive Medicine Group, Computational Health Informatics Program, Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA
| | - Andrew M Fine
- Emergency Medicine Boston Children's Hospital, Boston, MA; Harvard Medical School Boston, MA
| |
Collapse
|
2
|
Nigrovic SE, Fine HG, Nigrovic LE, Fine AM. Impact of COVID-19 and the cancellation of the 2020 PAS Meeting on abstract publications. Pediatr Res 2024:10.1038/s41390-024-03035-4. [PMID: 38291177 DOI: 10.1038/s41390-024-03035-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 12/15/2023] [Indexed: 02/01/2024]
Affiliation(s)
| | | | - Lise E Nigrovic
- Division of Emergency Medicine, Boston Children's Hospital, Boston, MA, USA
| | - Andrew M Fine
- Division of Emergency Medicine, Boston Children's Hospital, Boston, MA, USA.
| |
Collapse
|
3
|
Rosen RH, Monuteaux MC, Stack AM, Michelson KA, Fine AM. Impact of a Bronchiolitis Clinical Pathway on Management Decisions by Preferred Language. Pediatr Qual Saf 2024; 9:e714. [PMID: 38322294 PMCID: PMC10843310 DOI: 10.1097/pq9.0000000000000714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2023] [Accepted: 01/06/2024] [Indexed: 02/08/2024] Open
Abstract
Background Clinical pathways standardize healthcare utilization, but their impact on healthcare equity is poorly understood. This study aims to measure the effect of a bronchiolitis pathway on management decisions by preferred language for care. Methods We included all emergency department encounters for patients aged 1-12 months with bronchiolitis from 1/1/2010 to 10/31/2020. The prepathway period ended 10/31/2011, and the postpathway period was 1/1/2012-10/31/2020. We performed retrospective interrupted time series analyses to assess the impact of the clinical pathway by English versus non-English preferred language on the following outcomes: chest radiography (CXR), albuterol use, 7-day return visit, 72-hour return to admission, antibiotic use, and corticosteroid use. Analyses were adjusted for presence of a complex chronic condition. Results There were 1485 encounters in the preperiod (77% English, 14% non-English, 8% missing) and 7840 encounters in the postperiod (79% English, 15% non-English, 6% missing). CXR, antibiotic, and albuterol utilization exhibited sustained decreases over the study period. Pathway impact did not differ by preferred language for any outcome except albuterol utilization. The prepost slope effect of albuterol utilization was 10% greater in the non-English versus the English group (p for the difference by language = 0.022). Conclusions A clinical pathway was associated with improvements in care regardless of preferred language. More extensive studies involving multiple pathways and care settings are needed to assess the impact of clinical pathways on health equity.
Collapse
Affiliation(s)
- Robert H. Rosen
- From the Division of Emergency Medicine, Boston Children’s Hospital, Boston, Mass
| | - Michael C. Monuteaux
- From the Division of Emergency Medicine, Boston Children’s Hospital, Boston, Mass
| | - Anne M. Stack
- From the Division of Emergency Medicine, Boston Children’s Hospital, Boston, Mass
| | - Kenneth A. Michelson
- From the Division of Emergency Medicine, Boston Children’s Hospital, Boston, Mass
| | - Andrew M. Fine
- From the Division of Emergency Medicine, Boston Children’s Hospital, Boston, Mass
| |
Collapse
|
4
|
Shapiro DJ, Bourgeois FT, Fine AM, Hersh AL, Coon ER, Neuman MI, Wu AC. National Patterns of Outpatient Follow-Up Visits After Emergency Care for Acute Bronchiolitis. JAMA Netw Open 2023; 6:e2340082. [PMID: 37889492 PMCID: PMC10611989 DOI: 10.1001/jamanetworkopen.2023.40082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 09/15/2023] [Indexed: 10/28/2023] Open
Abstract
This cohort study examines the frequency of postdischarge follow-up visits among US emergency department encounters for bronchiolitis and assesses whether follow-up was associated with decreased hospital reutilization or increased treatment with nonrecommended medications.
Collapse
Affiliation(s)
- Daniel J. Shapiro
- Division of Pediatric Emergency Medicine, University of California, San Francisco
| | - Florence T. Bourgeois
- Computational Health Informatics Program, Boston Children’s Hospital, Boston, Massachusetts
| | - Andrew M. Fine
- Division of Pediatric Emergency Medicine, Boston Children’s Hospital, Boston, Massachusetts
| | - Adam L. Hersh
- Division of Pediatric Infectious Diseases, University of Utah, Salt Lake City
| | - Eric R. Coon
- Department of Pediatrics, Primary Children’s Hospital, University of Utah School of Medicine, Salt Lake City
| | - Mark I. Neuman
- Division of Pediatric Emergency Medicine, Boston Children’s Hospital, Boston, Massachusetts
| | - Ann Chen Wu
- Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, Massachusetts
| |
Collapse
|
5
|
Fine AM, Fine LC, Pranikoff T. Carolina Blues. JAMA Surg 2023; 158:1115. [PMID: 37285126 DOI: 10.1001/jamasurg.2023.1198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Affiliation(s)
| | - Laura C Fine
- Ophthalmic Consultants of Boston, Boston, Massachusetts
| | | |
Collapse
|
6
|
Shapiro DJ, Fine AM, Hersh AL, Bourgeois FT. Association Between Molecular Streptococcal Testing and Antibiotic Use for Pharyngitis in Children. J Pediatric Infect Dis Soc 2022; 11:303-304. [PMID: 35253892 DOI: 10.1093/jpids/piac008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/17/2022] [Accepted: 01/28/2022] [Indexed: 11/14/2022]
Affiliation(s)
- Daniel J Shapiro
- Division of Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Andrew M Fine
- Division of Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA.,Department of Pediatrics, Harvard Medical School, Boston, Massachusetts, USA.,Department of Emergency Medicine, Harvard Medical School, Boston, Massachusetts, USA
| | - Adam L Hersh
- Division of Pediatric Infectious Diseases, University of Utah, Salt Lake City, Utah, USA
| | - Florence T Bourgeois
- Division of Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA.,Department of Emergency Medicine, Harvard Medical School, Boston, Massachusetts, USA.,Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA
| |
Collapse
|
7
|
Brunson DC, Belanger GA, Sussmann H, Fine AM, Pandey S, Pham TD. Factors associated with first-time and repeat blood donation: Adverse reactions and effects on donor behavior. Transfusion 2022; 62:1269-1279. [PMID: 35510783 DOI: 10.1111/trf.16893] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2022] [Revised: 04/04/2022] [Accepted: 04/04/2022] [Indexed: 11/29/2022]
Abstract
BACKGROUND Blood centers have a dual mission to protect donors and patients; donor safety is paramount to maintaining an adequate blood supply. Elucidating donor factors associated with adverse reactions (AR) is critical to this mission. STUDY DESIGN/METHODS A retrospective cohort analysis of whole blood donors from 2003 to 2020 was conducted at a single blood center in northern California. Adjusted odds ratios (AORs) with 95% CIs for ARs were estimated via multivariable logistic regression on demographics, donation history, and physical examination data. Where appropriate, Wilcoxon-Rank Sum and chi-squared tests were used to determine significance. RESULTS First-time blood donors (FTD) exhibited a higher AR rate than repeat donors (4.4% vs. 1.9% p < .0001). When compared with FTDs without AR, FTDs with ARs (FT-AR) were less likely to return (30.0% vs. 47.3%, p < .0001), and, of those who returned, had a higher rate of reaction 20.2% versus 2.8% (p < .001). Factors found to be associated with FT-AR (younger age, increased heart rate, and higher diastolic blood pressure) still correlated positively with AR on return donation, but to a lower degree. FTD who potentially witnessed an AR had a lower return rate (44.6% vs. 47.3%, p = <.001) and donated fewer units (2.38 vs. 3.37, p < .001) when compared to FTD who did not witness an AR. CONCLUSION The AR on FTD increases the AR likelihood of return donation. Longitudinal analysis shows that a time-based deferral policy targeted at FT-AR young donors can reduce the number of ARs while not dramatically impacting the blood supply.
Collapse
Affiliation(s)
- Dalton C Brunson
- Stanford School of Medicine, Stanford University School of Medicine, Stanford, California, USA
| | | | | | - Andrew M Fine
- Division of Emergency Medicine, Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Suchitra Pandey
- Stanford Blood Center, Palo Alto, California, USA.,Department of Pathology, Stanford University School of Medicine, Stanford, California, USA
| | - Tho D Pham
- Stanford Blood Center, Palo Alto, California, USA.,Department of Pathology, Stanford University School of Medicine, Stanford, California, USA
| |
Collapse
|
8
|
Abstract
OBJECTIVES Risk tolerance and risk perceptions may impact clinicians' decisions to obtain diagnostic tests. We sought to determine whether physician risk perception was associated with the decision to obtain blood or imaging tests among children who present to the emergency department with fever. METHODS We conducted a retrospective, cross-sectional study in the Boston Children's Hospital emergency department. We included children aged 6 months to 18 years from May 1, 2014 to April 30, 2019, with fever. Our primary outcome was diagnostic testing: obtaining a blood and/or imaging test. We assessed risk perception using 3 scales: the Risk Tolerance Scale (RTS), Stress From Uncertainty Scale (SUS), and Malpractice Fear Scale (MFS). A z score was assigned to each physician for each scale. Mixed-effects logistic regression assessed the association between physician risk perception and blood or imaging testing. We also examined the relationship between each risk perception scale and several secondary outcomes: blood testing, urine testing, diagnostic imaging, specialist consultation, hospitalization, and revisit within 72 hours. RESULTS The response rate was 55/56 (98%). We analyzed 12,527 encounters. Blood/imaging testing varied between physicians (median, 48%; interquartile range, 41%-53%; range, 30%-71%). Risk Tolerance Scale responses were not associated with blood/imaging testing (odds ratio [OR], 1.03 per SD of increased risk perception; 95% confidence interval [CI], 0.95-1.13). Stress From Uncertainty Scale responses were not associated with blood/imaging testing (OR, 1.04 per SD; 95% CI, 0.95-1.14). Malpractice Fear Scale responses were not associated with blood/imaging testing (OR, 1.00 per SD; 95% CI, 0.91-1.09). There was no significant association between RTS, MFS, or SUS and any secondary outcome, except that there was a weak association between SUS and specialist consultation (OR, 1.12; 95% CI, 1.00-1.24). CONCLUSIONS Across 55 pediatric emergency physicians with variable testing practices, there was no association between risk perception and blood/imaging testing in febrile children.
Collapse
Affiliation(s)
- Ashley L Marchese
- From the Division of Emergency Medicine, Boston Children's Hospital, Boston, MA
| | | | | | | | | |
Collapse
|
9
|
Lyons TW, Michelson KA, Nigrovic LE, Perron CE, Fine AM. Attending-Provider Handoffs and Pediatric Emergency Department Revisits. Pediatr Emerg Care 2021; 37:e679-e685. [PMID: 31977767 PMCID: PMC10071514 DOI: 10.1097/pec.0000000000001983] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVE The objective of this study was to determine if intradepartment attending-provider transitions of care (handoffs) during a pediatric emergency department (ED) encounter were associated with return ED visits resulting in hospitalization. METHODS We analyzed ED encounters for patients younger than 21 years discharged from a single pediatric ED from January 2013 to February 2017. We classified an encounter as having a handoff when the initial attending and discharging attending differed. Our primary outcome was a revisit within 72 hours resulting in hospitalization. Our secondary outcomes were any revisit within 72 hours and revisits resulting in hospitalization with potential deficiencies in care. We compared outcome rates for ED encounters with and without provider handoffs, both with and without adjustment for demographic, clinical, and visit characteristics. RESULTS Of the 177,350 eligible ED encounters, 1961 (1.1%) had a return visit resulting in hospitalization and 6821 (3.9%) had any return visit. In unadjusted analyses, handoffs were associated with an increased likelihood of a return visit resulting in hospitalization (odds ratio [OR], 1.46; 95% confidence interval [CI], 1.26-1.70) or any return visit (OR, 1.20; 95% CI, 1.10-1.31). However, after adjustment, provider handoffs were not associated with return ED visits resulting in hospitalization (OR, 0.96; 95% CI, 0.81-1.13) or any return ED visits (OR, 1.00; 95% CI, 0.90-1.10). CONCLUSIONS Provider handoffs in a pediatric ED did not increase the risk of return ED visits or return ED visits with deficiencies in care after adjustment for demographic, clinical, and visit factors.
Collapse
Affiliation(s)
- Todd W. Lyons
- Division of Emergency Medicine, Boston Children’s Hospital, Boston, MA and Department of Pediatrics Harvard Medical School, Boston, MA
- Computational Health Informatics Program (CHiP) at Boston Children’s Hospital, Boston, MA
| | - Kenneth A. Michelson
- Division of Emergency Medicine, Boston Children’s Hospital, Boston, MA and Department of Pediatrics Harvard Medical School, Boston, MA
| | - Lise E. Nigrovic
- Division of Emergency Medicine, Boston Children’s Hospital, Boston, MA and Department of Pediatrics Harvard Medical School, Boston, MA
| | - Catherine E. Perron
- Division of Emergency Medicine, Boston Children’s Hospital, Boston, MA and Department of Pediatrics Harvard Medical School, Boston, MA
| | - Andrew M. Fine
- Division of Emergency Medicine, Boston Children’s Hospital, Boston, MA and Department of Pediatrics Harvard Medical School, Boston, MA
| |
Collapse
|
10
|
Abstract
OBJECTIVES Previous research has identified ethnic differences in parents' beliefs about fever, but whether patient ethnicity is associated with health care use for fever is uncertain. Our objectives were to describe the national rate of pediatric visits to the emergency department (ED) for fever and to determine whether there is variation in this rate by patient ethnicity. METHODS Using the National Hospital Ambulatory Medical Care Survey between 2012 and 2015, we estimated the proportion of ED visits with a complaint of fever by patients 0 to 18 years old and compared this proportion across patient ethnicity. We performed multivariable logistic regression controlling for sociodemographic characteristics and visit acuity to determine whether patient ethnicity was independently associated with visits for fever. RESULTS Fever was the reason for 19% [95% confidence interval (CI), 18%-20%] of pediatric visits to the ED, and the proportion of visits for fever was highest among Hispanic patients (25%; 95% CI, 23%-27%) and lowest among non-Hispanic white patients (15%; 95% CI, 14%-17%). In multivariable analysis, the adjusted odds of visits for fever were greater for Hispanic patients (odds ratio, 1.56; 95% CI, 1.38-1.83) and non-Hispanic non-black patients of other races (1.34; 95% CI, 1.02-1.77) compared with non-Hispanic white patients. CONCLUSIONS There is significant ethnic variation in the use of emergency medical services for fever in the United States, and these disparities are not fully explained by differences in the acuity of illness or differences in socioeconomic status. Interventions to empower parents to manage nonurgent pediatric fever should incorporate ethnocultural differences in parents' understanding of fever.
Collapse
|
11
|
Barak-Corren Y, Agarwal I, Michelson KA, Lyons TW, Neuman MI, Lipsett SC, Kimia AA, Eisenberg MA, Capraro AJ, Levy JA, Hudgins JD, Reis BY, Fine AM. Prediction of patient disposition: comparison of computer and human approaches and a proposed synthesis. J Am Med Inform Assoc 2021; 28:1736-1745. [PMID: 34010406 DOI: 10.1093/jamia/ocab076] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Revised: 03/20/2021] [Accepted: 04/09/2021] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE To compare the accuracy of computer versus physician predictions of hospitalization and to explore the potential synergies of hybrid physician-computer models. MATERIALS AND METHODS A single-center prospective observational study in a tertiary pediatric hospital in Boston, Massachusetts, United States. Nine emergency department (ED) attending physicians participated in the study. Physicians predicted the likelihood of admission for patients in the ED whose hospitalization disposition had not yet been decided. In parallel, a random-forest computer model was developed to predict hospitalizations from the ED, based on data available within the first hour of the ED encounter. The model was tested on the same cohort of patients evaluated by the participating physicians. RESULTS 198 pediatric patients were considered for inclusion. Six patients were excluded due to incomplete or erroneous physician forms. Of the 192 included patients, 54 (28%) were admitted and 138 (72%) were discharged. The positive predictive value for the prediction of admission was 66% for the clinicians, 73% for the computer model, and 86% for a hybrid model combining the two. To predict admission, physicians relied more heavily on the clinical appearance of the patient, while the computer model relied more heavily on technical data-driven features, such as the rate of prior admissions or distance traveled to hospital. DISCUSSION Computer-generated predictions of patient disposition were more accurate than clinician-generated predictions. A hybrid prediction model improved accuracy over both individual predictions, highlighting the complementary and synergistic effects of both approaches. CONCLUSION The integration of computer and clinician predictions can yield improved predictive performance.
Collapse
Affiliation(s)
- Yuval Barak-Corren
- Predictive Medicine Group, Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Isha Agarwal
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts, USA
| | - Kenneth A Michelson
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Todd W Lyons
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Mark I Neuman
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Susan C Lipsett
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Amir A Kimia
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Matthew A Eisenberg
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Andrew J Capraro
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Jason A Levy
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Joel D Hudgins
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| | - Ben Y Reis
- Predictive Medicine Group, Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts, USA.,Harvard Medical School, Boston, Massachusetts, USA
| | - Andrew M Fine
- Harvard Medical School, Boston, Massachusetts, USA.,Emergency Medicine, Boston Children's Hospital, Boston, Massachusetts, USA
| |
Collapse
|
12
|
Abstract
BACKGROUND/OBJECTIVE Traditional sources cite seasonal patterns for common infectious diseases, often based on microbiologic data, but little is known about cyclical trends in clinically diagnosed infectious conditions in the emergency department (ED). We leveraged the publicly available Nationwide Emergency Department Sample database to measure the seasonality of the most common pediatric infectious diseases diagnosed in US EDs. METHODS We searched the Nationwide Emergency Department Sample database to identify infectious diagnoses comprising at least 1% of all diagnosis codes ascribed to patients 21 years and younger in US EDs from 2009 to 2013. We used Fourier regression to examine seasonal trends in disease and calculated the peak-to-nadir ratio for each infectious condition. RESULTS Over 20% of pediatric visits during the study period were for infectious conditions. Upper respiratory infection, otitis media, gastroenteritis, urinary tract infection/pyelonephritis, cellulitis/abscess, and pneumonia showed a seasonal pattern that matched trends found in prior regional or microbiologic-based studies. The strongest seasonal trend as measured by goodness of model fit was found in pneumonia (peak-to-nadir incidence ratio of 2.7), followed by otitis media (2.0), cellulitis/abscess (2.0), gastroenteritis (1.6), upper respiratory infection (3.2), and urinary tract infection/pyelonephritis (1.4). Pharyngitis did not show a strong seasonal trend. CONCLUSIONS Many of the most common pediatric infectious diseases diagnosed in US EDs exhibited seasonal patterns. Large administrative databases can be used to track seasonal disease patterns, with the advantage that they reflect clinician diagnosis beyond microbiologic confirmation. This methodology could aid in resource planning, infection control, and public health educational initiatives.
Collapse
|
13
|
Shapiro DJ, Barak-Corren Y, Neuman MI, Mandl KD, Harper MB, Fine AM. Identifying Patients at Lowest Risk for Streptococcal Pharyngitis: A National Validation Study. J Pediatr 2020; 220:132-138.e2. [PMID: 32067779 DOI: 10.1016/j.jpeds.2020.01.030] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/09/2019] [Revised: 12/08/2019] [Accepted: 01/13/2020] [Indexed: 12/13/2022]
Abstract
OBJECTIVES To determine the prevalence of features of viral illness in a national sample of visits involving children tested for group A Streptococcus pharyngitis. Additionally, we sought to derive a decision rule to identify patients with features of viral illness who were at low risk of having group A Streptococcus and for whom laboratory testing might be avoided. STUDY DESIGN Retrospective validation study using data from electronic health records of patients 3-21 years old evaluated for sore throat in a national network of retail health clinics (n = 67 127). We determined the prevalence of features of viral illness in patients tested for group A Streptococcus and developed a decision tree algorithm to identify patients with features of viral illness at low risk (<15%) of having group A Streptococcus. RESULTS Overall, 54% of patients had features of viral illness. Among patients with features of viral illness, those without tonsillar exudates who were 11 years or older and either lacked cervical adenopathy or had cervical adenopathy and lacked fever were identified as at low risk for group A Streptococcus according to the decision rule. This group comprised 34% of patients with features of viral illness, or 19% of all patients tested for group A Streptococcus infection. CONCLUSIONS Our findings provide an objective way to identify patients with features of viral illness who are at low risk of having group A Streptococcus. Improved identification such patients at low risk of group A Streptococcus could improve appropriate testing and antibiotic prescribing for pharyngitis.
Collapse
Affiliation(s)
- Daniel J Shapiro
- Department of Pediatrics, Boston Children's Hospital, Boston, MA; Division of Emergency Medicine, Boston Children's Hospital, Boston, MA.
| | - Yuval Barak-Corren
- Division of Emergency Medicine, Boston Children's Hospital, Boston, MA; Computational Health Informatics Program, Boston Children's Hospital, Boston, MA
| | - Mark I Neuman
- Department of Pediatrics, Boston Children's Hospital, Boston, MA; Division of Emergency Medicine, Boston Children's Hospital, Boston, MA
| | - Kenneth D Mandl
- Department of Pediatrics, Boston Children's Hospital, Boston, MA; Division of Emergency Medicine, Boston Children's Hospital, Boston, MA; Computational Health Informatics Program, Boston Children's Hospital, Boston, MA
| | - Marvin B Harper
- Department of Pediatrics, Boston Children's Hospital, Boston, MA; Division of Emergency Medicine, Boston Children's Hospital, Boston, MA
| | - Andrew M Fine
- Department of Pediatrics, Boston Children's Hospital, Boston, MA; Division of Emergency Medicine, Boston Children's Hospital, Boston, MA
| |
Collapse
|
14
|
Wang A, Fine AM, Buchanan E, Janko M, Nigrovic LE, Lantos PM. A Bayesian Spatiotemporal Analysis of Pediatric Group A Streptococcal Infections. Open Forum Infect Dis 2019; 6:ofz524. [PMID: 31867406 PMCID: PMC6918452 DOI: 10.1093/ofid/ofz524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2019] [Accepted: 12/09/2019] [Indexed: 11/14/2022] Open
Abstract
Background Pharyngitis due to group A Streptococcus (GAS) is a common pediatric infection. Physicians might diagnose GAS pharyngitis more accurately when given biosurveillance information about GAS activity. The availability of geographic GAS testing data may be able to assist with real-time clinical decision-making for children with throat infections. Methods GAS rapid antigen testing data were obtained from the records of 6086 children at Boston Children's Hospital and 8648 children at Duke University Medical Center. Records included children tested in outpatient, primary care settings. We constructed Bayesian generalized additive models, in which the outcome variable was the binary result of GAS testing, and predictor variables included smoothed functions of patient location data and both cyclic and longitudinal time data. Results We observed a small degree of geographic heterogeneity, but no convincing clusters of high risk. The probability of a positive test declined during the summer months. Conclusions Future work should include geographic data about school catchments to identify whether GAS transmission clusters within schools.
Collapse
Affiliation(s)
- Angela Wang
- Duke University, Durham, North Carolina, USA
| | - Andrew M Fine
- Boston Children's Hospital, Boston, Massachusetts, USA
| | - Erin Buchanan
- Harrisburg University, Harrisburg, Pennsylvania, USA
| | - Mark Janko
- Duke University, Durham, North Carolina, USA
| | | | | |
Collapse
|
15
|
Nadeau N, Kimia A, Fine AM. Impact of viral symptoms on the performance of the modified centor score to predict pediatric group A streptococcal pharyngitis. Am J Emerg Med 2019; 38:1322-1326. [PMID: 31843329 DOI: 10.1016/j.ajem.2019.10.026] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2019] [Revised: 10/17/2019] [Accepted: 10/20/2019] [Indexed: 10/25/2022] Open
Abstract
BACKGROUND Clinicians use the Modified Centor Score (MCS) to estimate the risk of group A streptococcal (GAS) pharyngitis in children with sore throat. The Infectious Diseases Society of America (IDSA) recommends neither testing nor treating patients with specific viral symptoms. The goal of this study is to measure the impact of those symptoms on the yield of GAS testing predicted by the MCS. METHODS Retrospective cohort study of all patients aged 3-21 years presenting with sore throat and tested for GAS in a pediatric emergency department (ED) in 2016. After identifying all patients tested for GAS, we used natural language processing (NLP) to identify the subgroup complaining of sore throat. We abstracted all MCS variables as well as symptoms suggestive of a viral etiology per the IDSA guideline (conjunctivitis, coryza, cough, diarrhea, hoarseness, ulcerative oral lesions, viral exanthema). We calculated the proportion of patients who tested positive for GAS by MCS with and without viral symptoms. RESULTS Of the 1574 patients included, 372 patients (24%) tested GAS positive. Patients with at least one viral symptom had a reduced GAS risk compared to those without any of the viral symptoms 91/547 (17% GAS positive) vs. 281/1027 (27%), odds ratio 0.53 (95% CI 0.41-0.69). CONCLUSIONS The presence of viral symptoms specified by the IDSA alters the predicted yield of testing by traditional MCS. Clinicians may consider adjusting interpretation of a patient's MCS based on the presence of viral symptoms, but viral symptoms may not always fully obviate the need for GAS testing.
Collapse
Affiliation(s)
- Nicole Nadeau
- Pediatric Emergency Medicine, Massachusetts General Hospital, Boston MA, United States; Departments of Pediatrics and Emergency Medicine, Harvard Medical School, Boston, MA, United States.
| | - Amir Kimia
- Division of Emergency Medicine, Boston Children's Hospital, Boston, MA, United States; Departments of Pediatrics and Emergency Medicine, Harvard Medical School, Boston, MA, United States
| | - Andrew M Fine
- Division of Emergency Medicine, Boston Children's Hospital, Boston, MA, United States; Departments of Pediatrics and Emergency Medicine, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
16
|
Yarahuan JK, Hunter B, Nadar D, Gujral N, Fine AM, Flett K. 1147. Improving Accessibility and Antibiotic Prescribing with an Enhanced Digital Antibiogram. Open Forum Infect Dis 2019. [PMCID: PMC6809329 DOI: 10.1093/ofid/ofz360.1011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Background Institutional antibiograms play a key role in antimicrobial stewardship and may provide a venue for clinical decision support. Our institution recently transitioned our paper antibiogram to an enhanced digital antibiogram with antibiotic recommendations for common pediatric infections. The objectives of this study were (1) to improve the accessibility of our institutional antibiogram through a digital platform and (2) to improve trainee confidence when selecting empiric antibiotics by integrating clinical decision support. Methods The digital antibiogram was developed and evaluated at a tertiary children’s hospital. The tool was developed iteratively over one year by our innovation and digital health accelerator with recommendations for empiric antibiotic selection provided by experts in pediatric infectious diseases (see Figure 1 for example). Usability pilot testing was performed with a group of ordering providers and the tool was released internally in October 2018. A paired pre- and post- implementation survey evaluated residents’ perceptions of the accessibility of the paper vs. digital antibiogram and their confidence when selecting empiric antibiotics. Data were analyzed by Fisher exact test. Results During the 3 months after release, the digital antibiogram was accessed 1014 times with similar proportions of views for susceptibility data, dosing, and empiric antibiotic recommendations. Of the 31 pediatric residents who responded to both pre- and post- implementation surveys, only 59% had access to a copy of the paper antibiogram. Following release of the digital antibiogram, residents referred to antibiotic susceptibilities more frequently (P < 0.05, Figure 2) and were more frequently more confident when selecting the correct antibiotic dose (P < 0.01, Figure 3). See Figure 4 for dosing recommendation example. Conclusion Providing antibiotic susceptibility and dosing recommendations digitally improved accessibility and resident confidence during antibiotic prescribing. Our digital tool provides a successful platform for displaying the antibiotic data and recommendations that enable appropriate antibiotic use. ![]()
![]()
![]()
![]()
Disclosures All authors: No reported disclosures.
Collapse
Affiliation(s)
| | - Brandon Hunter
- Children’s Hospital of Philadelphia, Philadelphia, Pennsylvania
| | - Devin Nadar
- Boston Children’s Hospital, Jamaica Plain, Massachusetts
| | | | - Andrew M Fine
- Boston Children’s Hospital, Jamaica Plain, Massachusetts
| | - Kelly Flett
- Affiliation Novant Health Eastover Pediatrics, Charlotte, North Carolina
| |
Collapse
|
17
|
Sundberg M, Perron CO, Kimia A, Landschaft A, Nigrovic LE, Nelson KA, Fine AM, Eisenberg M, Baskin MN, Neuman MI, Stack AM. A method to identify pediatric high-risk diagnoses missed in the emergency department. Diagnosis (Berl) 2018; 5:63-69. [PMID: 29858901 DOI: 10.1515/dx-2018-0005] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2018] [Accepted: 05/16/2018] [Indexed: 11/15/2022]
Abstract
BACKGROUND Diagnostic error can lead to increased morbidity, mortality, healthcare utilization and cost. The 2015 National Academy of Medicine report "Improving Diagnosis in Healthcare" called for improving diagnostic accuracy by developing innovative electronic approaches to reduce medical errors, including missed or delayed diagnosis. The objective of this article was to develop a process to detect potential diagnostic discrepancy between pediatric emergency and inpatient discharge diagnosis using a computer-based tool facilitating expert review. METHODS Using a literature search and expert opinion, we identified 10 pediatric diagnoses with potential for serious consequences if missed or delayed. We then developed and applied a computerized tool to identify linked emergency department (ED) encounters and hospitalizations with these discharge diagnoses. The tool identified discordance between ED and hospital discharge diagnoses. Cases identified as discordant were manually reviewed by pediatric emergency medicine experts to confirm discordance. RESULTS Our computerized tool identified 55,233 ED encounters for hospitalized children over a 5-year period, of which 2161 (3.9%) had one of the 10 selected high-risk diagnoses. After expert record review, we identified 67 (3.1%) cases with discordance between ED and hospital discharge diagnoses. The most common discordant diagnoses were Kawasaki disease and pancreatitis. CONCLUSIONS We successfully developed and applied a semi-automated process to screen a large volume of hospital encounters to identify discordant diagnoses for selected pediatric medical conditions. This process may be valuable for informing and improving ED diagnostic accuracy.
Collapse
Affiliation(s)
- Melissa Sundberg
- Boston Children's Hospital, Division of Emergency Medicine, 300 Longwood Ave, Boston, MA 02115, USA
| | - Catherine O Perron
- Boston Children's Hospital, Division of Emergency Medicine, Boston, MA, USA
| | - Amir Kimia
- Boston Children's Hospital, Division of Emergency Medicine, Boston, MA, USA
| | | | - Lise E Nigrovic
- Boston Children's Hospital, Division of Emergency Medicine, Boston, MA, USA
| | - Kyle A Nelson
- Boston Children's Hospital, Division of Emergency Medicine, Boston, MA, USA
| | - Andrew M Fine
- Boston Children's Hospital, Division of Emergency Medicine, Boston, MA, USA
| | - Matthew Eisenberg
- Boston Children's Hospital, Division of Emergency Medicine, Boston, MA, USA
| | - Marc N Baskin
- Boston Children's Hospital, Division of Emergency Medicine, Boston, MA, USA
| | - Mark I Neuman
- Boston Children's Hospital, Division of Emergency Medicine, Boston, MA, USA
| | - Anne M Stack
- Boston Children's Hospital, Division of Emergency Medicine, Boston, MA, USA
| |
Collapse
|
18
|
Lyons TW, Olson KL, Palmer NP, Horwitz R, Mandl KD, Fine AM. Patients Visiting Multiple Emergency Departments: Patterns, Costs, and Risk Factors. Acad Emerg Med 2017; 24:1349-1357. [PMID: 28861915 DOI: 10.1111/acem.13304] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2017] [Revised: 08/23/2017] [Accepted: 08/27/2017] [Indexed: 11/29/2022]
Abstract
OBJECTIVES We sought to characterize the population of patients seeking care at multiple emergency departments (EDs) and to quantify the proportion of all ED visits and costs accounted for by these patients. METHODS We performed a retrospective, cohort study of deidentified insurance claims for privately insured patients with one of more ED visits between 2010 and 2016. We measured the number of EDs visited by each patient and determined the overall proportion of all ED visits and ED costs accounted for by patients who visit multiple EDs. We identified factors associated with visiting multiple EDs. RESULTS A total of 8,651,716 patients made 16,390,676 ED visits over the study period, accounting for $26,102,831,740 in ED costs. A significant minority (20.5%) of patients visited more than one ED over the study period. However, these patients accounted for a disproportionate amount of all ED visits (41.4%) and all ED costs (39.2%). A small proportion (0.4%) of patients visited five or more EDs but accounted for 2.8% of ED visits and costs. Among patients with two ED visits within 30 days, 32% were to different EDs. Having at least one ED visit for mental health or substance abuse-related diagnosis was associated with increased odds of visiting multiple EDs. CONCLUSIONS A substantial minority of patients visit multiple EDs, but account for a disproportionate burden of overall ED utilization and costs. Future work should evaluate the impact of visiting multiple EDs on care utilization and outcomes and explore systems for improving access to patient records across care centers.
Collapse
Affiliation(s)
- Todd W. Lyons
- Computational Health Informatics Program; Boston Children's Hospital; Boston MA
- Division of Emergency Medicine; Boston Children's Hospital; Boston MA
| | - Karen L. Olson
- Computational Health Informatics Program; Boston Children's Hospital; Boston MA
- Division of Emergency Medicine; Boston Children's Hospital; Boston MA
| | - Nathan P. Palmer
- Department of Biomedical Informatics; Harvard Medical School; Boston MA
| | - Reed Horwitz
- Computational Health Informatics Program; Boston Children's Hospital; Boston MA
| | - Kenneth D. Mandl
- Computational Health Informatics Program; Boston Children's Hospital; Boston MA
- Division of Emergency Medicine; Boston Children's Hospital; Boston MA
- Department of Biomedical Informatics; Harvard Medical School; Boston MA
| | - Andrew M. Fine
- Division of Emergency Medicine; Boston Children's Hospital; Boston MA
| |
Collapse
|
19
|
Hudgins JD, Monuteaux MC, Bourgeois FT, Nigrovic LE, Fine AM, Lee LK, Mannix R, Lipsett SC, Neuman MI. Complexity and Severity of Pediatric Patients Treated at United States Emergency Departments. J Pediatr 2017; 186:145-149.e1. [PMID: 28396022 DOI: 10.1016/j.jpeds.2017.03.035] [Citation(s) in RCA: 45] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/23/2016] [Revised: 02/06/2017] [Accepted: 03/10/2017] [Indexed: 01/23/2023]
Abstract
OBJECTIVE To compare the complexity and severity of presentation of children in general vs pediatric emergency departments (EDs). STUDY DESIGN We performed a cross-sectional study of pediatric ED visits using the National Emergency Department Sample from 2008 to 2012. We classified EDs as "pediatric" if >75% of patients were <18 years old; all other EDs were classified as "general." The presence of an International Classification of Diseases, Ninth Revision code for a complex chronic condition was used as an indicator of patient complexity. Patient severity was evaluated with the severity classification system. In addition, rates of critical procedures and hospitalization were assessed. RESULTS We identified 9.6 million encounters to pediatric EDs and 169 million to general EDs. Younger children account for a greater proportion of visits at pediatric EDs than general EDs; children <1 year of age account for 18% of visits to a pediatric ED compared with 9% of visits to a general ED (P < .01). Encounters at pediatric EDs had greater complexity (5% vs 2%; P < .01). Although severity classification system scores did not significantly differ by ED type, pediatric EDs had greater rates of hospitalization (10% vs 4%). CONCLUSIONS Pediatric EDs provided care to a greater proportion of medically complex children than general EDs and had greater rates of hospitalization. This information may inform educational efforts in residency or postgraduate training to ensure high-quality care for children with complex health care needs.
Collapse
Affiliation(s)
- Joel D Hudgins
- Division of Emergency Medicine, Boston Children's Hospital, Department of Pediatrics, Harvard Medical School, Boston, MA.
| | - Michael C Monuteaux
- Division of Emergency Medicine, Boston Children's Hospital, Department of Pediatrics, Harvard Medical School, Boston, MA
| | - Florence T Bourgeois
- Division of Emergency Medicine, Boston Children's Hospital, Department of Pediatrics, Harvard Medical School, Boston, MA
| | - Lise E Nigrovic
- Division of Emergency Medicine, Boston Children's Hospital, Department of Pediatrics, Harvard Medical School, Boston, MA
| | - Andrew M Fine
- Division of Emergency Medicine, Boston Children's Hospital, Department of Pediatrics, Harvard Medical School, Boston, MA
| | - Lois K Lee
- Division of Emergency Medicine, Boston Children's Hospital, Department of Pediatrics, Harvard Medical School, Boston, MA
| | - Rebekah Mannix
- Division of Emergency Medicine, Boston Children's Hospital, Department of Pediatrics, Harvard Medical School, Boston, MA
| | - Susan C Lipsett
- Division of Emergency Medicine, Boston Children's Hospital, Department of Pediatrics, Harvard Medical School, Boston, MA
| | - Mark I Neuman
- Division of Emergency Medicine, Boston Children's Hospital, Department of Pediatrics, Harvard Medical School, Boston, MA
| |
Collapse
|
20
|
Paydar-Darian N, Kimia AA, Lantos PM, Fine AM, Gordon CD, Gordon CR, Landschaft A, Nigrovic LE. Diagnostic Lumbar Puncture Among Children With Facial Palsy in a Lyme Disease Endemic Area. J Pediatric Infect Dis Soc 2017; 6:205-208. [PMID: 27422867 DOI: 10.1093/jpids/piw036] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/15/2016] [Accepted: 06/01/2016] [Indexed: 11/13/2022]
Abstract
We identified 620 children with peripheral facial palsy of which 211 (34%) had Lyme disease. The 140 children who had a lumbar puncture performed were more likely to be hospitalized (73% LP performed vs 2% no LP) and to receive parenteral antibiotics (62% LP performed vs 6% no LP).
Collapse
Affiliation(s)
| | - Amir A Kimia
- Division of Emergency Medicine, Boston Children's Hospital, Massachusetts
| | - Paul M Lantos
- Divisions of General Internal Medicine and Pediatric Infectious Diseases, Duke University Medical Center, Durham, North Carolina, and
| | - Andrew M Fine
- Division of Emergency Medicine, Boston Children's Hospital, Massachusetts
| | - Caroline D Gordon
- Division of Emergency Medicine, Boston Children's Hospital, Massachusetts
| | - Catherine R Gordon
- Division of Emergency Medicine, Boston Children's Hospital, Massachusetts
| | | | - Lise E Nigrovic
- Division of Emergency Medicine, Boston Children's Hospital, Massachusetts
| |
Collapse
|
21
|
Barak-Corren Y, Fine AM, Reis BY. Early Prediction Model of Patient Hospitalization From the Pediatric Emergency Department. Pediatrics 2017; 139:peds.2016-2785. [PMID: 28557729 DOI: 10.1542/peds.2016-2785] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/14/2017] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND AND OBJECTIVES Emergency departments (EDs) in the United States are overcrowded and nearing a breaking point. Alongside ever-increasing demand, one of the leading causes of ED overcrowding is the boarding of hospitalized patients in the ED as they await bed placement. We sought to develop a model for early prediction of hospitalizations, thus enabling an earlier start for the placement process and shorter boarding times. METHODS We conducted a retrospective cohort analysis of all visits to the Boston Children's Hospital ED from July 1, 2014 to June 30, 2015. We used 50% of the data for model derivation and the remaining 50% for validation. We built the predictive model by using a mixed method approach, running a logistic regression model on results generated by a naive Bayes classifier. We performed sensitivity analyses to evaluate the impact of the model on overall resource utilization. RESULTS Our analysis comprised 59 033 patient visits, of which 11 975 were hospitalized (cases) and 47 058 were discharged (controls). Using data available within the first 30 minutes from presentation, our model identified 73.4% of the hospitalizations with 90% specificity and 35.4% of hospitalizations with 99.5% specificity (area under the curve = 0.91). Applying this model in a real-time setting could potentially save the ED 5917 hours per year or 30 minutes per hospitalization. CONCLUSIONS This approach can accurately predict patient hospitalization early in the ED encounter by using data commonly available in most electronic medical records. Such early identification can be used to advance patient placement processes and shorten ED boarding times.
Collapse
Affiliation(s)
| | - Andrew M Fine
- Division of Emergency Medicine, Department of Medicine, Boston Children's Hospital, Boston, Massachusetts; and.,Harvard Medical School, Boston, Massachusetts
| | - Ben Y Reis
- Predictive Medicine Group, Computational Health Informatics Program and.,Division of Emergency Medicine, Department of Medicine, Boston Children's Hospital, Boston, Massachusetts; and.,Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
22
|
Abstract
BACKGROUND AND OBJECTIVES The Infectious Diseases Society of America recommends that clinicians forego testing for group A Streptococcal (GAS) pharyngitis in patients with clinical features of viral illness. The prevalence of viral features in patients tested for GAS pharyngitis is not known. The objectives of this study were as follows: to describe the prevalence of viral features in pediatric patients for whom rapid antigen detection tests (RADTs) for GAS pharyngitis are performed; and to compare the prevalence of GAS and the sensitivity of the RADT in patients with and without viral features. METHODS This secondary analysis of data from a prospective cohort study included children aged 3 to 21 years for whom RADTs were performed for sore throat in an urban tertiary care emergency department. The primary outcome was the prevalence of viral features, defined as cough, rhinorrhea, oral ulcers/vesicles, and/or conjunctival injection. Secondary outcomes were the prevalence of GAS and sensitivity of the RADT; these outcomes were compared between patients with and without viral features. RESULTS Overall, 63% (95% confidence interval [CI]: 57%-68%) of patients had at least 1 viral feature. The prevalence of GAS pharyngitis was higher in patients without viral features (42% [95% CI: 33%-51%]) than in patients with viral features (29% [95% CI: 23%-35%]) (P = .01). The sensitivity of the RADT was 84% (95% CI: 77%-91%) and was not significantly different in patients with and without viral features. CONCLUSIONS Because many asymptomatic children are carriers of GAS, judicious use of laboratory testing for GAS pharyngitis remains an important target for antimicrobial stewardship.
Collapse
Affiliation(s)
- Daniel J Shapiro
- Department of Medicine, Boston Children's Hospital, Boston, Massachusetts; .,Department of Pediatrics, Boston Medical Center, Boston, Massachusetts
| | - Christina E Lindgren
- Division of Emergency Medicine, Departments of Pediatrics and Emergency Medicine, Children's National Medical Center, Washington, District of Columbia; and
| | - Mark I Neuman
- Department of Medicine, Boston Children's Hospital, Boston, Massachusetts.,Division of Emergency Medicine, Departments of Pediatrics and Emergency Medicine, Harvard Medical School, Boston, Massachusetts
| | - Andrew M Fine
- Department of Medicine, Boston Children's Hospital, Boston, Massachusetts.,Division of Emergency Medicine, Departments of Pediatrics and Emergency Medicine, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
23
|
Lindgren C, Neuman MI, Monuteaux MC, Mandl KD, Fine AM. Patient and Parent-Reported Signs and Symptoms for Group A Streptococcal Pharyngitis. Pediatrics 2016; 138:peds.2016-0317. [PMID: 27279649 DOI: 10.1542/peds.2016-0317] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/12/2016] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND AND OBJECTIVES Identifying symptomatic patients who are at low risk for group A streptococcal (GAS) pharyngitis could reduce unnecessary visits and antibiotic use. The accuracy with which patients and parents report signs and symptoms of GAS has not been studied. Our objectives were to measure agreement between patient or parent and physician-reported signs and symptoms of GAS and to evaluate the performance of a modified Centor score, based on patient or parent and physician reports, for identifying patients at low risk for GAS pharyngitis. METHODS Children 3 to 21 years old presenting to a single tertiary care emergency department between October 2013 and January 2015 were included if they complained of a sore throat and were tested for GAS. Patients or parents and physicians completed surveys assessing signs and symptoms to determine a modified age-adjusted Centor score for GAS. We evaluated the overall agreement and κ between patient or parent and physician-reported signs and symptoms and compared the performance of the scores based on assessments by patients or parents and physicians and the risk of GAS. RESULTS Of 320 patients enrolled, 107 (33%) tested GAS positive. Agreement was higher for symptoms (fever [agreement = 82%, κ = 0.64] and cough [72%, 0.45]) than for signs (exudate [80%, 0.41] and tender cervical nodes [73%, 0.18]). Agreement was highest when no signs and symptoms contained in the Centor score were present (94%, κ = 0.61). The proportion of patients testing GAS positive rose as the modified Centor score increased. CONCLUSIONS For identifying GAS pharyngitis, patients or parents and physicians showed moderate to substantial agreement for 3 of 4 key pharyngitis signs and symptoms.
Collapse
Affiliation(s)
| | - Mark I Neuman
- Division of Emergency Medicine and Departments of Pediatrics and Emergency Medicine, Harvard Medical School, Boston, Massachusetts
| | - Michael C Monuteaux
- Division of Emergency Medicine and Departments of Pediatrics and Emergency Medicine, Harvard Medical School, Boston, Massachusetts
| | - Kenneth D Mandl
- Division of Emergency Medicine and Departments of Pediatrics and Emergency Medicine, Harvard Medical School, Boston, Massachusetts Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts; and
| | - Andrew M Fine
- Division of Emergency Medicine and Departments of Pediatrics and Emergency Medicine, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
24
|
Hudgins JD, Fine AM, Bourgeois FT. Effect of Randomized Clinical Trial Findings on Emergency Management. Acad Emerg Med 2016; 23:36-47. [PMID: 26720855 DOI: 10.1111/acem.12840] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2015] [Revised: 06/17/2015] [Accepted: 07/21/2015] [Indexed: 11/29/2022]
Abstract
OBJECTIVES Research findings are not consistently adopted in the clinical setting and there is a gap between best evidence and clinical practice across a range of conditions and settings. A number of factors may contribute to this discrepancy, including the direction of the research findings (i.e., whether positive or negative for an intervention). The objectives of this study were to measure the translation of results from randomized controlled trials (RCTs) into clinical care and to determine whether the direction of the trial findings influence the uptake of research reports into clinical practice. METHODS This was a retrospective study of clinical care provided in emergency departments (EDs) across the United States with data collected by the National Hospital Ambulatory Medical Care Survey from 1992 to 2010. RCTs published in journals with the highest impact factors and conducted in ED settings were selected and data were extracted on the interventions under study, the patient populations examined, and the trial findings. Changes in clinical practice corresponding to the RCT results were measured by comparing the rates of treatment with the intervention during the 3-year period before and after publication of the trial. RESULTS Twenty-one RCTs met the inclusion criteria. Ten studies reported positive interventions, of which nine (90%) were associated with an increased ED use of the intervention after trial publication. Four studies showing the lack of benefit of interventions were not used in ED practice prior to the trial and practice did not change in the postpublication period. The remaining eight trials presented negative findings or results comparing two different interventions, and of these, three (38%) were associated with small changes in the ED use of the interventions, consistent with the trial results. CONCLUSIONS In the ED setting, results of RCTs published in high-impact journals are more likely to be translated into clinical care when they demonstrate the benefits of an intervention. Our findings indicate that direction of research evidence is an important factor when evaluating knowledge uptake into clinical practice.
Collapse
Affiliation(s)
- Joel D. Hudgins
- Division of Emergency Medicine; Boston Children's Hospital; Boston MA
- Department of Pediatrics; Harvard Medical School; Boston MA
| | - Andrew M. Fine
- Division of Emergency Medicine; Boston Children's Hospital; Boston MA
- Department of Pediatrics; Harvard Medical School; Boston MA
| | - Florence T. Bourgeois
- Division of Emergency Medicine; Boston Children's Hospital; Boston MA
- Department of Pediatrics; Harvard Medical School; Boston MA
| |
Collapse
|
25
|
Guse SE, Neuman MI, O'Brien M, Alexander ME, Berry M, Monuteaux MC, Fine AM. Implementing a guideline to improve management of syncope in the emergency department. Pediatrics 2014; 134:e1413-21. [PMID: 25332499 DOI: 10.1542/peds.2013-3833] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
BACKGROUND AND OBJECTIVES Thirty-five percent of children experience syncope at least once. Although the etiology of pediatric syncope is usually benign, many children undergo low-yield diagnostic testing. We conducted a quality improvement intervention to reduce the rates of low-yield diagnostic testing for children presenting to an emergency department (ED) with syncope or presyncope. METHODS Children 8 to 22 years old presenting to a tertiary care pediatric ED with syncope or presyncope were included. We excluded children who were ill-appearing, had previously diagnosed cardiac or neurologic disease, ingestion, or trauma. We measured diagnostic testing rates among children presenting from July 2010 through October 2012, during which time we implemented a quality improvement intervention. Patient follow-up was performed 2 months after the ED visit to ascertain subsequent diagnostic testing and medical care. RESULTS A total of 349 patients were included. We observed a reduction in the rates of low-yield diagnostic testing after our quality improvement intervention: complete blood count testing decreased from 36% (95% confidence interval 29% to 43%) to 16% (12% to 22%) and electrolyte testing from 29% (23% to 36%) to 12% (8% to 17%). Performance of recommended testing increased, such as electrocardiograms and pregnancy testing in postpubertal girls. Despite a reduction in diagnostic testing among children with syncope, patients were not more likely to undergo subsequent diagnostic testing or seek further medical care following their ED visit. CONCLUSIONS Implementation of a quality improvement intervention for the ED evaluation of pediatric syncope was associated with reduced low-yield diagnostic testing, and was not associated with subsequent testing or medical care.
Collapse
Affiliation(s)
- Sabrina E Guse
- Division of Pediatric Emergency Medicine, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania
| | | | - Megan O'Brien
- Department of Emergency Medicine, George Washington University, Washington, District of Columbia
| | - Mark E Alexander
- Cardiology, Boston Children's Hospital, Boston, Massachusetts; and
| | | | | | | |
Collapse
|
26
|
|
27
|
Abstract
BACKGROUND Consensus guidelines recommend against testing or treating adults at low risk for group A streptococcal (GAS) pharyngitis. OBJECTIVE To help patients decide when to visit a clinician for the evaluation of sore throat. DESIGN Retrospective cohort study. SETTING A national chain of retail health clinics. PATIENTS 71 776 patients aged 15 years or older with pharyngitis who visited a clinic from September 2006 to December 2008. MEASUREMENTS The authors created a score using information from patient-reported clinical variables plus the incidence of local disease and compared it with the Centor score and other traditional scores that require clinician-elicited signs. RESULTS If patients aged 15 years or older with sore throat did not visit a clinician when the new score estimated the likelihood of GAS pharyngitis to be less than 10% instead of having clinicians manage their symptoms following guidelines that use the Centor score, 230 000 visits would be avoided in the United States each year and 8500 patients with GAS pharyngitis who would have received antibiotics would not be treated with them. LIMITATION Real-time information about the local incidence of GAS pharyngitis, which is necessary to calculate the new score, is not currently available. CONCLUSION A patient-driven approach to pharyngitis diagnosis that uses this new score could save hundreds of thousands of visits annually by identifying patients at home who are unlikely to require testing or treatment. PRIMARY FUNDING SOURCE Centers for Disease Control and Prevention and the National Library of Medicine, National Institutes of Health.
Collapse
|
28
|
Walsh KE, Cutrona SL, Foy S, Baker MA, Forrow S, Shoaibi A, Pawloski PA, Conroy M, Fine AM, Nigrovic LE, Selvam N, Selvan MS, Cooper WO, Andrade S. Validation of anaphylaxis in the Food and Drug Administration's Mini-Sentinel. Pharmacoepidemiol Drug Saf 2013; 22:1205-13. [PMID: 24038742 DOI: 10.1002/pds.3505] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2013] [Revised: 07/18/2013] [Accepted: 07/26/2013] [Indexed: 01/01/2023]
Abstract
PURPOSE We aim to develop and validate the positive predictive value (PPV) of an algorithm to identify anaphylaxis using health plan administrative and claims data. Previously published PPVs for anaphylaxis using International Classification of Diseases, ninth revision, Clinical Modification (ICD-9-CM) codes range from 52% to 57%. METHODS We conducted a retrospective study using administrative and claims data from eight health plans. Using diagnosis and procedure codes, we developed an algorithm to identify potential cases of anaphylaxis from the Mini-Sentinel Distributed Database between January 2009 and December 2010. A random sample of medical charts (n = 150) was identified for chart abstraction. Two physician adjudicators reviewed each potential case. Using physician adjudicator judgments on whether the case met diagnostic criteria for anaphylaxis, we calculated a PPV for the algorithm. RESULTS Of the 122 patients for whom complete charts were received, 77 were judged by physician adjudicators to have anaphylaxis. The PPV for the algorithm was 63.1% (95%CI: 53.9-71.7%), using the clinical criteria by Sampson as the gold standard. The PPV was highest for inpatient encounters with ICD-9-CM codes of 995.0 or 999.4. By combining only the top performing ICD-9-CM codes, we identified an algorithm with a PPV of 75.0%, but only 66% of cases of anaphylaxis were identified using this modified algorithm. CONCLUSIONS The PPV for the ICD-9-CM-based algorithm for anaphylaxis was slightly higher than PPV estimates reported in prior studies, but remained low. We were able to identify an algorithm that optimized the PPV but demonstrated lower sensitivity for anaphylactic events.
Collapse
|
29
|
Abstract
OBJECTIVE To determine trends in the diagnosis and management of children with viral meningitis at US children's hospitals. METHODS We performed a multicenter cross sectional study of children presenting to the emergency department (ED) across the 41 pediatric tertiary-care hospitals participating in the Pediatric Health Information System between January 1, 2005, and December 31, 2011. A case of viral meningitis was defined by International Classification of Diseases, Ninth Revision, discharge diagnosis, and required performance of a lumbar puncture. We examined trends in diagnosis, antibiotic use, and resource utilization for children with viral meningitis over the study period. RESULTS We identified 7618 children with viral meningitis (0.05% of ED visits during the study period). Fifty-two percent of patients were <1 year of age, and 43% were female. The absolute number and the proportion of ED visits for children with viral meningitis declined from 0.98 cases per 1000 ED visits in 2005 to 0.25 cases in 2011 (P < .001). Most children with viral meningitis received a parenteral antibiotic (85%), and were hospitalized (91%). Overall costs for children for children with viral meningitis remain substantial (median cost per case $5056, interquartile range $3572-$7141). CONCLUSIONS Between 2005 and 2011, viral meningitis diagnoses at US children's hospitals declined. However, most of these children are hospitalized, and the cost for caring for these children remains considerable.
Collapse
Affiliation(s)
- Lise E Nigrovic
- Division of Emergency Medicine, Department of Medicine, Boston Children's Hospital and Harvard Medical School, Boston, Massachusetts 02115, USA.
| | | | | | | | | |
Collapse
|
30
|
Hennelly KE, Fine AM, Jones DT, Porter S. Risks of radiation versus risks from injury: A clinical decision analysis for the management of penetrating palatal trauma in children. Laryngoscope 2013; 123:1279-84. [PMID: 23404330 DOI: 10.1002/lary.23962] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2012] [Revised: 10/17/2012] [Accepted: 12/06/2012] [Indexed: 11/09/2022]
Affiliation(s)
- Kara E. Hennelly
- Division of Emergency Medicine; Boston Children's Hospital; Boston; Massachusetts
| | - Andrew M. Fine
- Division of Emergency Medicine; Boston Children's Hospital; Boston; Massachusetts
| | - Dwight T. Jones
- Department of Otolaryngology; University of Nebraska Medical Center; Omaha; Nebraska; U.S.A
| | - Stephen Porter
- Division of Pediatric Emergency Medicine; The Hospital for Sick Children; Department of Pediatrics; University of Toronto; Toronto; Ontario; Canada
| |
Collapse
|
31
|
Abstract
BACKGROUND The Centor and McIsaac scores guide testing and treatment for group A streptococcal (GAS) pharyngitis in patients presenting with a sore throat, but they were derived on relatively small samples. We perform a national-scale validation of the prediction models on a large, geographically diverse population. METHODS We analyzed data collected from 206,870 patients 3 years or older who presented with a painful throat to a United States national retail health chain from September 1, 2006, to December 1, 2008. Main outcome measures were the proportions of patients testing positive for GAS pharyngitis according to the Centor and McIsaac scores (both scales, 0-4). RESULTS For patients 15 years or older, 23% (95% CI, 22%-23%) tested positive for GAS, including 7% (95% CI, 7%-8%) of those with a Centor score of 0; 12% (95% CI, 11%-12%) of those with a Centor score of 1; 21% (95% CI, 21%-22%) of those with a Centor score of 2; 38% (95% CI, 38%-39%) of those with a Centor score of 3; and 57% (95% CI, 56%-58%) of those with a Centor score of 4. For patients 3 years or older, 27% (95% CI, 27%-27%) tested positive for GAS, including 8% (95% CI, 8%-9%) of those testing positive with aMcIsaac score of 0; 14% (95% CI, 13%-14%) of those with a McIsaac score of 1; 23% (95% CI, 23%-23%) of those with a McIsaac score of 2; 37% (95% CI, 37%-37%) of those with a McIsaac score of 3; and 55% (95% CI, 55%-56%) of those with a McIsaac score of 4. The 95% CIs overlapped between our retail health chain–derived probabilities and the prior reports. CONCLUSION Our study validates the Centor and McIsaac scores and more precisely classifies risk of GAS infection among patients presenting with a painful throat to a retail health chain.
Collapse
Affiliation(s)
- Andrew M Fine
- Department of Medicine, Division of Emergency Medicine, Children's Hospital Boston, Massachusetts, USA.
| | | | | |
Collapse
|
32
|
Abstract
BACKGROUND Clinical prediction rules do not incorporate real-time incidence data to adjust estimates of disease risk in symptomatic patients. OBJECTIVE To measure the value of integrating local incidence data into a clinical decision rule for diagnosing group A streptococcal (GAS) pharyngitis in patients aged 15 years or older. DESIGN Retrospective analysis of clinical and biosurveillance predictors of GAS pharyngitis. SETTING Large U.S.-based retail health chain. PATIENTS 82 062 patient visits for pharyngitis. MEASUREMENTS Accuracy of the Centor score was compared with that of a biosurveillance-responsive score, which was essentially an adjusted Centor score based on real-time GAS pharyngitis information from the 14 days before a patient's visit: the recent local proportion positive (RLPP). RESULTS Increased RLPP correlated with the likelihood of GAS pharyngitis (r(2) = 0.79; P < 0.001). Local incidence data enhanced diagnostic models. For example, when the RLPP was greater than 0.30, managing patients with Centor scores of 1 as if the scores were 2 would identify 62, 537 previously missed patients annually while misclassifying 18, 446 patients without GAS pharyngitis. Decreasing the score of patients with Centor values of 3 by 1 point for an RLPP less than 0.20 would spare unnecessary antibiotics for 166, 616 patients while missing 18, 812 true-positive cases. LIMITATIONS Analyses were conducted retrospectively. Real-time regional data on GAS pharyngitis are generally not yet available to clinicians. CONCLUSION Incorporating live biosurveillance data into clinical guidelines for GAS pharyngitis and other communicable diseases should be considered for reducing missed cases when the contemporaneous incidence is elevated and for sparing unnecessary antibiotics when the contemporaneous incidence is low. Delivering epidemiologic data to the point of care will enable the use of real-time pretest probabilities in medical decision making.
Collapse
Affiliation(s)
- Andrew M. Fine
- Division of Emergency Medicine, Department of Medicine, Children’s Hospital Boston, MA
- Department of Pediatrics, Harvard Medical School, Boston MA
| | - Victor Nizet
- Department of Pediatrics and Skaggs School of Pharmacy and Pharmaceutical Sciences, University of California, San Diego, La Jolla, California
| | - Kenneth D. Mandl
- Division of Emergency Medicine, Department of Medicine, Children’s Hospital Boston, MA
- Department of Pediatrics, Harvard Medical School, Boston MA
- Children’s Hospital Informatics Program, Harvard-MIT Health Sciences and Technology, Boston, MA
- Center for Biomedical Informatics, Harvard Medical School, Boston, MA
| |
Collapse
|
33
|
Fine AM, Brownstein JS, Nigrovic LE, Kimia AA, Olson KL, Thompson AD, Mandl KD. Integrating spatial epidemiology into a decision model for evaluation of facial palsy in children. ACTA ACUST UNITED AC 2011; 165:61-7. [PMID: 21199982 DOI: 10.1001/archpediatrics.2010.250] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
OBJECTIVE To develop a novel diagnostic algorithm for Lyme disease among children with facial palsy by integrating public health surveillance data with traditional clinical predictors. DESIGN Retrospective cohort study. SETTING Children's Hospital Boston emergency department, 1995-2007. PATIENTS Two hundred sixty-four children (aged <20 years) with peripheral facial palsy who were evaluated for Lyme disease. MAIN OUTCOME MEASURES Multivariate regression was used to identify independent clinical and epidemiologic predictors of Lyme disease facial palsy. RESULTS Lyme diagnosis was positive in 65% of children from high-risk counties in Massachusetts during Lyme disease season compared with 5% of those without both geographic and seasonal risk factors. Among patients with both seasonal and geographic risk factors, 80% with 1 clinical risk factor (fever or headache) and 100% with 2 clinical factors had Lyme disease. Factors independently associated with Lyme disease facial palsy were development from June to November (odds ratio, 25.4; 95% confidence interval, 8.3-113.4), residence in a county where the most recent 3-year average Lyme disease incidence exceeded 4 cases per 100,000 (18.4; 6.5-68.5), fever (3.9; 1.5-11.0), and headache (2.7; 1.3-5.8). Clinical experts correctly treated 68 of 94 patients (72%) with Lyme disease facial palsy, but a tool incorporating geographic and seasonal risk identified all 94 cases. CONCLUSIONS Most physicians intuitively integrate geographic information into Lyme disease management, but we demonstrate quantitatively how formal use of geographically based incidence in a clinical algorithm improves diagnostic accuracy. These findings demonstrate potential for improved outcomes from investments in health information technology that foster bidirectional communication between public health and clinical settings.
Collapse
Affiliation(s)
- Andrew M Fine
- Division of Emergency Medicine, Children's Hospital Boston, Boston, MA 02115, USA.
| | | | | | | | | | | | | |
Collapse
|
34
|
Fine AM, Reis BY, Nigrovic LE, Goldmann DA, Laporte TN, Olson KL, Mandl KD. Use of population health data to refine diagnostic decision-making for pertussis. J Am Med Inform Assoc 2010; 17:85-90. [PMID: 20064807 DOI: 10.1197/jamia.m3061] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
OBJECTIVE To improve identification of pertussis cases by developing a decision model that incorporates recent, local, population-level disease incidence. DESIGN Retrospective cohort analysis of 443 infants tested for pertussis (2003-7). MEASUREMENTS Three models (based on clinical data only, local disease incidence only, and a combination of clinical data and local disease incidence) to predict pertussis positivity were created with demographic, historical, physical exam, and state-wide pertussis data. Models were compared using sensitivity, specificity, area under the receiver-operating characteristics (ROC) curve (AUC), and related metrics. RESULTS The model using only clinical data included cyanosis, cough for 1 week, and absence of fever, and was 89% sensitive (95% CI 79 to 99), 27% specific (95% CI 22 to 32) with an area under the ROC curve of 0.80. The model using only local incidence data performed best when the proportion positive of pertussis cultures in the region exceeded 10% in the 8-14 days prior to the infant's associated visit, achieving 13% sensitivity, 53% specificity, and AUC 0.65. The combined model, built with patient-derived variables and local incidence data, included cyanosis, cough for 1 week, and the variable indicating that the proportion positive of pertussis cultures in the region exceeded 10% 8-14 days prior to the infant's associated visit. This model was 100% sensitive (p<0.04, 95% CI 92 to 100), 38% specific (p<0.001, 95% CI 33 to 43), with AUC 0.82. CONCLUSIONS Incorporating recent, local population-level disease incidence improved the ability of a decision model to correctly identify infants with pertussis. Our findings support fostering bidirectional exchange between public health and clinical practice, and validate a method for integrating large-scale public health datasets with rich clinical data to improve decision-making and public health.
Collapse
Affiliation(s)
- Andrew M Fine
- Division of Emergency Medicine, Children's Hospital Boston and Department of Pediatrics, Harvard Medical School, Boston, Massachusetts 02115, USA.
| | | | | | | | | | | | | |
Collapse
|
35
|
Fine AM, Kalish LA, Forbes P, Goldmann D, Mandl KD, Porter SC. Parent-driven technology for decision support in pediatric emergency care. Jt Comm J Qual Patient Saf 2009; 35:307-15. [PMID: 19565690 DOI: 10.1016/s1553-7250(09)35044-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
BACKGROUND A quasi-experimental intervention study composed of control and intervention periods was conducted to determine if a parent-driven health information technology influenced completeness of documentation and adherence to evidence-based emergency care for children. METHODS Structured chart abstraction was used to assess documentation and correctness of clinical actions at test ordering, medication prescribed for disease, and medication ordered for pain in a tertiary care pediatric emergency department and a suburban general emergency department. During the intervention periods, parents of children who presented with complaints related to otitis media, urinary tract infection, head trauma, or asthma entered data into a health information technology (ParentLink), which produced treatment plans in the context of evidence-based guidelines. RESULTS Of 1,410 subjects analyzed, 1,072 (76%) were assigned to one of four disease categories: urinary tract infection (22%), otitis media (20%), asthma (11%) and head trauma (47%). During ParentLink use, documentation of pain significantly improved (28% incomplete [control] versus 15% [intervention], p = .003). Incorrect actions for pain treatment decreased, but not significantly (33% [control] versus 24% [intervention], p = .13). ParentLink did not influence actions for test ordering or prescribing for disease. DISCUSSION Parent-driven health information technology intended to translate parents' knowledge into clinical practice and to support evidence-based care suggested a trend toward modest impact on pain management but did not demonstrate broad effects across diseases or care processes. The emergence and proliferation of personally controlled health records (PCHRs) presents opportunities for patients and parents to control their medical profiles. Although ParentLink is not a comprehensive PCHR, it represents a step in incorporating parent-derived information into medical decision making.
Collapse
Affiliation(s)
- Andrew M Fine
- Division of Emergency Medicine, Children's Hospital, Boston, USA.
| | | | | | | | | | | |
Collapse
|
36
|
Nigrovic LE, Thompson AD, Fine AM, Kimia A. Clinical predictors of Lyme disease among children with a peripheral facial palsy at an emergency department in a Lyme disease-endemic area. Pediatrics 2008; 122:e1080-5. [PMID: 18931349 DOI: 10.1542/peds.2008-1273] [Citation(s) in RCA: 62] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
INTRODUCTION Although Lyme disease can cause peripheral facial palsy in Lyme disease-endemic areas, diagnostic predictors in children have not been described. OBJECTIVE Our goal was to determine clinical predictors of Lyme disease as the etiology of peripheral facial palsy in children presenting to an emergency department in a Lyme disease-endemic area. METHODS We reviewed all available electronic medical charts of children <or=20 years old with peripheral facial palsy who were evaluated in the emergency department of a tertiary care pediatric center from 1995 to 2007. We used the Centers for Disease Control Lyme disease definition: presence of erythema migrans lesion or serologic evidence of infection with Borrelia burgdorferi. We performed binary logistic regression with bootstrapping validation to determine independent clinical predictors of Lyme disease. RESULTS We identified 313 patients with peripheral facial palsy evaluated for Lyme disease. The mean age was 10.7 years, and 52% were male. Of these, 106 (34%) had Lyme disease facial palsy. After adjusting for year of study, the following were independently associated with Lyme disease facial palsy: onset of symptoms during peak Lyme disease season (June to October), absence of previous herpetic lesions, presence of fever, and history of headache. In the subset of patients without meningitis, both onset of symptoms during Lyme disease season and presence of headache remained significant independent predictors. CONCLUSIONS Lyme disease is a frequent cause of facial palsy in children living in an endemic region. Serologic testing and empiric antibiotics should be strongly considered, especially when children present during peak Lyme disease season or with a headache.
Collapse
Affiliation(s)
- Lise E Nigrovic
- Division of Emergency Medicine, Children's Hospital Boston, Boston, Massachusetts 02115, USA.
| | | | | | | |
Collapse
|
37
|
Fine AM, Nigrovic LE, Reis BY, Cook EF, Mandl KD. Linking surveillance to action: incorporation of real-time regional data into a medical decision rule. J Am Med Inform Assoc 2007; 14:206-11. [PMID: 17213492 PMCID: PMC2213475 DOI: 10.1197/jamia.m2253] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2006] [Accepted: 12/05/2006] [Indexed: 11/10/2022] Open
Abstract
OBJECTIVE Broadly, to create a bidirectional communication link between public health surveillance and clinical practice. Specifically, to measure the impact of integrating public health surveillance data into an existing clinical prediction rule. We incorporate data about recent local trends in meningitis epidemiology into a prediction model differentiating aseptic from bacterial meningitis. DESIGN AND MEASUREMENTS Retrospective analysis of a cohort of all 696 children with meningitis admitted to a large urban pediatric hospital from 1992 to 2000. We modified a published bacterial meningitis score by adding a new epidemiological context adjustor variable. We examined 540 possible rules for this adjustor, varying both the number of aseptic meningitis cases that needed to be seen, and the recent time window in which they were seen. We performed sensitivity analyses with each of 540 possibilities in order to identify the optimal rule--namely, the one that included the most cases of aseptic meningitis without missing additional cases of bacterial meningitis, as compared with the published prediction model. We used bootstrap methods to validate this new score. RESULTS The optimal rule was found to be: "at least four cases of aseptic meningitis in the previous 10 days." The epidemiological context adjustor based on surveillance of recent cases of meningitis allowed the correct identification of an additional 47 cases (7%) of aseptic meningitis without missing any additional cases of bacterial meningitis. The epidemiological context adjustor was validated, showing significance in 84% of 1,000 bootstrap samples. CONCLUSION Epidemiological contextual information can improve the performance of a clinical prediction rule. We provide a methodological framework for leveraging regional surveillance data to improve medical decision-making.
Collapse
Affiliation(s)
- Andrew M Fine
- Division of Emergency Medicine, Children's Hospital Boston, 300 Longwood Avenue, Boston, MA 02115, USA.
| | | | | | | | | |
Collapse
|
38
|
Fine AM, Goldmann DA, Forbes PW, Harris SK, Mandl KD. Incorporating vaccine-preventable disease surveillance into the National Health Information Network: leveraging children's hospitals. Pediatrics 2006; 118:1431-8. [PMID: 17015533 DOI: 10.1542/peds.2006-0462] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
Abstract
OBJECTIVE Development of national biosurveillance systems to advance regional and national data exchange among sites of clinical care and public health authorities is a top federal priority, creating the opportunity to develop a unified national network for tracking and responding to cases of vaccine-preventable diseases. The purpose of this study was to assess the current practice and feasibility of developing a nationwide network of children's hospitals to conduct surveillance for vaccine preventable diseases. METHODS In 2004-2005, Web-based surveys were sent to 506 key hospital personnel from 119 pediatric hospitals, identified by the National Association of Children's Hospitals and Related Institutions. Surveys measured attitudes toward public health initiatives, willingness to join a surveillance network of children's hospitals, knowledge of mandated reporting requirements, methods of disease detection and reporting, and data sources available for surveillance. RESULTS A total of 395 (78%) respondents from 119 hospitals completed the survey. Surveillance at pediatric hospitals is largely passive and driven by unreimbursed efforts of infection control staff. It is vulnerable to missing cases that occur in the outpatient setting and are diagnosed clinically without laboratory confirmation or are never diagnosed by clinicians. Nearly 90% of hospital leaders are interested in participating in public health programs, and most are interested in a national network to conduct active surveillance for vaccine-preventable diseases, dependent on the provision of sufficient funding. Pediatric hospitals store records relevant to surveillance in an electronic fashion accessible to query, but <20% of these hospitals use automated methods to report cases of disease. CONCLUSIONS There is both the will and capability to create a robust active pediatric hospital-based reporting system for vaccine preventable diseases. This effort would dovetail well with the national priority to bolster surveillance, as well as with the goal of reducing morbidity and mortality from vaccine-preventable diseases.
Collapse
Affiliation(s)
- Andrew M Fine
- Division of Emergency Medicine, Children's Hospital Boston, 300 Longwood Ave, Boston, MA 02115, USA.
| | | | | | | | | |
Collapse
|
39
|
Fine AM, Forbes P, Osganian S, Goldmann DA, Mandl KD. Feasibility of leveraging electronic data from pediatric hospitals for national surveillance: a survey of chief information officers. AMIA Annu Symp Proc 2005; 2005:954. [PMID: 16779241 PMCID: PMC1560794] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Public health informaticians are evaluating new data sources to optimize real-time surveillance for detecting disease outbreaks. Pediatric populations are often overlooked, but may provide important signals for many reportable and vaccine preventable diseases, as well as emerging infections. The ability of pediatric hospitals to contribute timely information to the identification of disease outbreaks has not been rigorously evaluated. We sought to determine the feasibility of leveraging data from pediatric hospitals to support national disease surveillance, by measuring: 1) the types of pediatric hospital records currently stored in electronic form and accessible to query; 2) the current automated reporting capabilities of pediatric hospitals; and 3) the attitudes of Chief Information Officers (CIOs) towards disease surveillance.
Collapse
Affiliation(s)
- Andrew M Fine
- Children's Hospital Informatics Program, Children's Hospital Boston, MA, USA
| | | | | | | | | |
Collapse
|
40
|
Fine AM, Wong JB, Fraser HSF, Fleisher GR, Mandl KD. Is it influenza or anthrax? A decision analytic approach to the treatment of patients with influenza-like illnesses. Ann Emerg Med 2004; 43:318-28. [PMID: 14985657 DOI: 10.1016/j.annemergmed.2003.09.007] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
STUDY OBJECTIVE We analyze the risks and benefits of alternative treatment strategies for non-septic-appearing febrile patients with influenza-like illnesses and possible exposure to anthrax. METHODS We used a decision analytic model to evaluate 6 testing and treatment strategies in an emergency department. Patients were non-septic-appearing and had influenza-like illnesses but low likelihood of exposure to anthrax. The following interventions were used: (1) no empiric antibiotics; (2) blood culture and treatment only if the result was positive; (3) rapid testing for influenza and, for those who tested negative, treatment with 60 days of ciprofloxacin; (4) a two-test strategy in which all patients were first tested for influenza; those who tested negative had a blood culture test and were treated empirically with ciprofloxacin for 3 days while waiting for blood culture results; (5) culture test for all patients and treatment with ciprofloxacin for up to 3 days while waiting for blood culture results; and (6) treatment of all patients with ciprofloxacin empirically for 60 days. Main outcome measures were deaths, complications from anthrax, adverse events from ciprofloxacin, and ciprofloxacin patient-days. RESULTS For nonzero probabilities of anthrax, patient mortality was always lowest in the strategies in which all patients were treated empirically for anthrax either for 60 days or for 3 days pending blood culture results. These strategies, however, were associated with more morbidity (more ciprofloxacin patient-days and more antibiotic adverse events) than were strategies without empiric treatment. The numbers of adverse events and antibiotic patient-days were reduced substantially with the two-test strategy, in which patients with influenza were identified early and not treated. In general, for probabilities of anthrax equaling or exceeding 2%, treating all patients empirically for 60 days was best, but for probabilities between 0.1% and 2%, the sensitivity of blood culture for anthrax determined the optimal strategy: when the sensitivity exceeded 95%, a short course of empiric ciprofloxacin until blood culture results became available was best, but for sensitivities below 95%, more aggressive empiric antibiotics use was warranted. The proportion of patients with influenza in the community affected the choice of strategy, so that seasonal variation exists. CONCLUSION During influenza season, our findings support rapid testing for influenza, followed by empiric treatment for anthrax pending blood culture results for those who test negative for influenza. Our results help to highlight the importance of developing rapid and sensitive tests for anthrax and of developing improved surveillance and methods to calculate the previous probability of attacks.
Collapse
Affiliation(s)
- Andrew M Fine
- Division of Emergency Medicine, Children's Hospital Boston, Harvard Medical School, Boston, MA 02115, USA
| | | | | | | | | |
Collapse
|
41
|
Fine AM. Oligomeric proanthocyanidin complexes: history, structure, and phytopharmaceutical applications. Altern Med Rev 2000; 5:144-51. [PMID: 10767669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/16/2023]
Abstract
Considerable recent research has explored therapeutic applications of oligomeric proanthocyanidin complexes (OPCs), naturally occurring plant metabolites widely available in fruits, vegetables, nuts, seeds, flowers, and bark. OPCs are primarily known for their antioxidant activity. However, these compounds have also been reported to demonstrate antibacterial, antiviral, anticarcinogenic, anti-inflammatory, anti-allergic, and vasodilatory actions. In addition, they have been found to inhibit lipid peroxidation, platelet aggregation, capillary permeability and fragility, and to affect enzyme systems including phospholipase A2, cyclooxygenase, and lipoxygenase. Based on these reported findings, OPCs may be a useful component in the treatment of a number of conditions.
Collapse
Affiliation(s)
- A M Fine
- International Clinical Research Center, Scottsdale, AZ 85260, USA
| |
Collapse
|
42
|
Ebert EM, Fine AM, Markowitz J, Maguire MG, Starr JS, Fine SL. Functional vision in patients with neovascular maculopathy and poor visual acuity. Arch Ophthalmol 1986; 104:1009-12. [PMID: 2425785 DOI: 10.1001/archopht.1986.01050190067041] [Citation(s) in RCA: 20] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
Central visual function is characteristically reported as Snellen acuity at distance and near. We performed functional tests in a group of patients with visual acuity of 20/100 or worse due to macular disease to determine whether there was a relationship between Snellen acuity and functional performance among these patients with poor visual acuity. Our tests of functional performance included currency discrimination, color recognition, reading a clock, and reading large print. Our results suggest that there is a correlation between Snellen acuity and functional vision, even among patients with poor visual acuity. Hence, therapeutic efforts to keep patients' visual acuity at 20/200 rather than 20/400, for example, appears to be justifiable in that better acuity levels seem to be associated with improved functional performance.
Collapse
|
43
|
Abstract
One hundred three patients with neovascular maculopathy and relatively recent vision loss were surveyed to determine the most frequent symptoms and to assess the reliability of the Amsler grid in helping patients to detect early symptoms. Blurred vision and distortion, most often with near vision, were the most frequent first symptoms reported by patients. Of 49 patients who said that they were observing the Amsler grid on a regular basis, only five indicated that the Amsler grid abnormality was the first visual symptom. However, all but five of 49 patients did notice an Amsler grid abnormality during the office examination, suggesting noncompliance as the probable explanation for failure to detect an Amsler grid abnormality earlier. Patients at risk for neovascular maculopathy should be encouraged to assess a variety of visual functions--including reading vision, color saturation, and image clarity--in addition to observing the Amsler grid, in order to help them detect the earliest symptoms of submacular fluid from a potentially treatable neovascular membrane.
Collapse
|