1
|
Gilbert KM, LeCates RF, Galbraith AA, Maglione PJ, Argetsinger S, Rider NL, Farmer JR, Ong MS. Diagnostic disparities in inborn errors of immunity: From clinical suspicion to diagnosis. THE JOURNAL OF ALLERGY AND CLINICAL IMMUNOLOGY. GLOBAL 2025; 4:100407. [PMID: 39991621 PMCID: PMC11847075 DOI: 10.1016/j.jacig.2025.100407] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Revised: 09/23/2024] [Accepted: 11/16/2024] [Indexed: 02/25/2025]
Abstract
Background Emerging evidence suggests that inborn errors of immunity (IEI) are underdiagnosed among underserved populations. However, there remains a lack of national studies evaluating diagnostic disparities in IEI. Objective We examined disparities in the timely IEI diagnosis and related health outcomes. Methods A retrospective analysis was performed of a US national claims database (years 2007 to 2021). Participants included patients diagnosed with an "unspecified immune deficiency" (uID) and presented with IEI-related symptoms, who later received an IEI diagnosis (n = 1429). We quantified the diagnostic interval from clinical suspicion (uID) to IEI diagnosis and examined its association with sociodemographic factors and related health outcomes. Results The median (interquartile range) diagnostic interval was 369 (126-808) days. Diagnostic interval was 14% longer among patients residing in predominantly non-White neighborhoods, compared with those in predominantly White neighborhoods (P = .04), despite having more severe IEI-related symptoms at uID diagnosis and significantly more health care encounters for pneumonia (incidence rate ratio, 2.24; 95% confidence interval, 1.40-3.70) and sepsis (incidence rate ratio, 2.15; 95% confidence interval, 1.21-3.99) in the year after uID diagnosis. Residence in neighborhoods with greater deprivation was also associated with more severe IEI-related symptoms and greater health care utilization in the year after uID diagnosis. Older age was associated with longer diagnostic interval (P < .001). Longer diagnostic interval was associated with a longer interval to receiving IgR therapy (hazard ratio, 0.64; 95% confidence interval, 0.49-0.83). Conclusion We observed significant racial and socioeconomic disparities in the timeliness of IEI diagnosis and IEI-related outcomes. Further studies are needed to address the underlying factors contributing to diagnostic inequity.
Collapse
Affiliation(s)
- Karen M. Gilbert
- Department of Population Medicine, Harvard Pilgrim Health Care Institute, Boston, Mass
| | - Robert F. LeCates
- Department of Population Medicine, Harvard Pilgrim Health Care Institute, Boston, Mass
| | - Alison A. Galbraith
- Pulmonary Center and Section of Pulmonary, Allergy, Sleep and Critical Care, Boston, Mass
| | - Paul J. Maglione
- Boston University Chobanian and Avedisian School of Medicine and Boston Medical Center, Boston, Mass
| | - Stephanie Argetsinger
- Department of Population Medicine, Harvard Pilgrim Health Care Institute, Boston, Mass
| | - Nicholas L. Rider
- Department of Health Systems & Implementation Science, Virginia Tech Carilion School of Medicine, Roanoke, Va
| | - Jocelyn R. Farmer
- Program in Clinical Immunodeficiency, Division of Allergy & Immunology, Beth Israel Lahey Health, Burlington, Mass
| | - Mei-Sing Ong
- Department of Population Medicine, Harvard Pilgrim Health Care Institute, Boston, Mass
- Harvard Medical School, Boston, Mass
| |
Collapse
|
2
|
IJspeert H, Edwards ESJ, O'Hehir RE, Dalm VASH, van Zelm MC. Update on inborn errors of immunity. J Allergy Clin Immunol 2025; 155:740-751. [PMID: 39724969 DOI: 10.1016/j.jaci.2024.12.1075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2024] [Revised: 12/10/2024] [Accepted: 12/13/2024] [Indexed: 12/28/2024]
Abstract
Ever since the first description of an inherited immunodeficiency in 1952 in a boy with gammaglobulin deficiency, new insights have progressed rapidly in disorders that are now referred to as inborn errors of immunity. In a field where fundamental molecular biology, genetics, immune signaling, and clinical care are tightly intertwined, 2022-24 saw a multitude of advances. Here we report a selection of research updates with a main focus on (1) diagnosis and screening, (2) new genetic defects, (3) susceptibility to severe coronavirus disease 2019 infection and impact of vaccination, and (4) treatment. Importantly, new pathogenic insights more rapidly affect treatment outcomes, either through an earlier and more precise diagnosis or through implementation of novel, personalized treatment. The field is growing rapidly, so awareness, communication, and collaboration are key to improving treatment outcomes.
Collapse
Affiliation(s)
- Hanna IJspeert
- Department of Clinical Genetics, Erasmus MC, University Medical Center, Rotterdam, The Netherlands
| | - Emily S J Edwards
- Department of Immunology, School of Translational Medicine, Monash University, Melbourne, Australia; Allergy, Asthma and Clinical Immunology, Alfred Health, Melbourne, Australia; Jeffrey Modell Center, Melbourne, Australia
| | - Robyn E O'Hehir
- Department of Immunology, School of Translational Medicine, Monash University, Melbourne, Australia; Allergy, Asthma and Clinical Immunology, Alfred Health, Melbourne, Australia; Jeffrey Modell Center, Melbourne, Australia
| | - Virgil A S H Dalm
- Department of Immunology, Erasmus MC, University Medical Center, Rotterdam, The Netherlands; Department of Internal Medicine, Division of Allergy & Clinical Immunology, Erasmus MC, University Medical Center, Rotterdam, The Netherlands
| | - Menno C van Zelm
- Department of Immunology, Erasmus MC, University Medical Center, Rotterdam, The Netherlands; Department of Immunology, School of Translational Medicine, Monash University, Melbourne, Australia; Allergy, Asthma and Clinical Immunology, Alfred Health, Melbourne, Australia; Jeffrey Modell Center, Melbourne, Australia.
| |
Collapse
|
3
|
Rider NL, Li Y, Chin AT, DiGiacomo DV, Dutmer C, Farmer JR, Roberts K, Savova G, Ong MS. Evaluating large language model performance to support the diagnosis and management of patients with primary immune disorders. J Allergy Clin Immunol 2025:S0091-6749(25)00166-6. [PMID: 39956279 DOI: 10.1016/j.jaci.2025.02.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2024] [Revised: 01/17/2025] [Accepted: 02/06/2025] [Indexed: 02/18/2025]
Abstract
BACKGROUND Generative artificial intelligence (GAI) is transforming health care in a variety of ways; however, the present utility of GAI for supporting clinicians who treat rare disease such as primary immune disorders (PIs) is not well studied. We evaluated the ability of 6 state-of-the-art large language models (LLMs) for providing clinical guidance about PIs. OBJECTIVE To quantitatively and qualitatively measure the utility of current, open-source LLMs for diagnosing and providing helpful clinical decision support about PIs. METHODS Five expert clinical immunologists each provided 5 real-world, anonymized PI case vignettes via multi-turn prompting to 6 LLMs (OpenAI GPT-4o, Llama-3.1-8B-Instruct, Llama-3.1-70B-Instruct, Mistral-7B-Instruct-v0.3, Mistral-Large-Instruct-2407, Mixtral-8x7B-Instruct-v0.1). We assessed the diagnostic accuracy of the LLMs and the quality of clinical reasoning using the Revised-IDEA (R-IDEA) score. Qualitative LLM assessment was made by immunologist narratives. RESULTS Performance accuracy (>88%) and R-IDEA scores (≥8) were superior for 3 models (GPT-4o, Llama-3.1-70B-Instruct, Mistral-Large-Instruct-2407), with GPT-4o achieving the highest diagnostic accuracy (96.2%). Conversely, the remaining 3 models fell below acceptable accuracy rates near 60% or lower and had poor R-IDEA scores (≤0.55), with Mistral-7B-Instruct-v0.3 attaining the worst diagnostic accuracy (42.3%). Compared with the 3 best-performing LLMs, the 3 worst-performing LLMs had a substantially lower median R-IDEA score (P < .001). Interclass correlation coefficient for R-IDEA score assignments varied substantially by LLM, ranging from good to poor agreement, and did not appear to correlate with either diagnostic accuracy or median R-IDEA score. Qualitatively, immunologists identified several themes (eg, correctness, differential diagnosis appropriateness, relative conciseness of explanations) of relevance to PIs. CONCLUSIONS LLM can support diagnosis and management of PIs; however, further tuning is needed to optimize LLMs for best practice recommendations.
Collapse
Affiliation(s)
- Nicholas L Rider
- Department of Health Systems and Implementation Science, Virginia Tech Carilion School of Medicine, Roanoke, Va; Section of Allergy and Immunology, Department of Medicine, Carilion Clinic, Roanoke, Va.
| | - Yingya Li
- Computational Health Informatics Program, Harvard Medical School and Boston Children's Hospital, Boston, Mass
| | - Aaron T Chin
- Department of Pediatrics, Division of Immunology, Allergy, and Rheumatology, University of California, Los Angeles, Los Angeles, Calif
| | - Daniel V DiGiacomo
- Department of Pediatrics, K. Hovnanian Children's Hospital, Jersey Shore University Medical Center, Neptune, NJ; Hackensack Meridian School of Medicine, Nutley, NJ
| | - Cullen Dutmer
- Department of Pediatrics, University of Colorado School of Medicine, Denver, Colo; Section of Allergy & Immunology, Children's Hospital Colorado, Denver, Colo
| | - Jocelyn R Farmer
- Clinical Immunodeficiency Program of Beth Israel Lahey Health, Division of Allergy and Immunology, Lahey Hospital & Medical Center, Burlington, Mass; Department of Medicine, UMass Chan Medical School, Burlington, Mass
| | - Kirk Roberts
- McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, Tex
| | - Guergana Savova
- Computational Health Informatics Program, Harvard Medical School and Boston Children's Hospital, Boston, Mass
| | - Mei-Sing Ong
- Department of Population Medicine, Harvard Pilgrim Health Care Institute, Harvard Medical School, Boston, Mass
| |
Collapse
|
4
|
Gilbert KM, McLaughlin HM, Farmer JR, Ong MS. Disparities in Genetic Testing for Inborn Errors of Immunity. THE JOURNAL OF ALLERGY AND CLINICAL IMMUNOLOGY. IN PRACTICE 2025; 13:388-395.e3. [PMID: 39579980 PMCID: PMC11807750 DOI: 10.1016/j.jaip.2024.11.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2024] [Revised: 10/30/2024] [Accepted: 11/13/2024] [Indexed: 11/25/2024]
Abstract
BACKGROUND Inequities in genetic testing have been documented in a range of diseases, and no-charge genetic testing programs have been proposed as a means to enhance access. However, no studies have examined disparities in genetic testing for inborn errors of immunity (IEI) and the impact of no-charge programs on testing equity. OBJECTIVE To examine socioeconomic, geographic, and racial disparities in the uptake of genetic testing for IEI in the United States and the impact of a no-charge sponsored program on testing equity. METHODS This was a retrospective cohort analysis of (1) a national claims database capturing individuals with IEI (n = 18,603), and (2) data from a clinical genetic testing laboratory capturing patients with IEI participating in a no-charge sponsored program (n = 6,681) and a non-sponsored program (n = 29,579) for IEI genetic testing. RESULTS Among patients with IEI captured in the claims database, those residing in areas of greater deprivation (odds ratio [OR] = 0.95; 95% CI, 0.92-0.98), rural areas (OR = 0.82; 95% CI, 0.71-0.96), and non-White neighborhoods (OR = 0.89, 95% CI 0.81-0.98) were less likely to undergo genetic testing. Participants in the sponsored IEI genetic testing program lived in areas of greater deprivation compared with the non-sponsored program (median, 46 vs 42; P < .001). However, historically excluded racial groups were underrepresented in both the sponsored and non-sponsored programs relative to disease burden. CONCLUSIONS We found significant disparities in genetic testing for IEI. Although eliminating the financial barriers to testing reduced socioeconomic disparities in genetic testing for IEI, racial disparities persisted. Further research is needed to address barriers to testing among underserved populations.
Collapse
Affiliation(s)
- Karen M Gilbert
- Department of Population Medicine, Harvard Pilgrim Health Care Institute, Boston, Mass.
| | | | - Jocelyn R Farmer
- Clinical Immunodeficiency Program of Beth Israel Lahey Health, Division of Allergy and Immunology, Lahey Hospital and Medical Center, Burlington, Mass
| | - Mei-Sing Ong
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, Mass
| |
Collapse
|
5
|
Casey A, Madhavan VL, Zucker EJ, Farmer JR. Case 39-2024: A 30-Month-Old Boy with Recurrent Fever. N Engl J Med 2024; 391:2256-2265. [PMID: 39665657 DOI: 10.1056/nejmcpc2402490] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/13/2024]
Affiliation(s)
- Alicia Casey
- From the Department of Pediatrics, Boston Children's Hospital (A.C.), the Departments of Pediatrics (A.C., V.L.M.) and Radiology (E.J.Z.), Harvard Medical School, and the Departments of Pediatrics (V.L.M.) and Radiology (E.J.Z.), Massachusetts General Hospital, Boston, the Department of Medicine, UMass Chan Medical School, Worcester (J.R.F.), and the Department of Allergy and Immunology, Lahey Hospital and Medical Center, Burlington (J.R.F.) - all in Massachusetts
| | - Vandana L Madhavan
- From the Department of Pediatrics, Boston Children's Hospital (A.C.), the Departments of Pediatrics (A.C., V.L.M.) and Radiology (E.J.Z.), Harvard Medical School, and the Departments of Pediatrics (V.L.M.) and Radiology (E.J.Z.), Massachusetts General Hospital, Boston, the Department of Medicine, UMass Chan Medical School, Worcester (J.R.F.), and the Department of Allergy and Immunology, Lahey Hospital and Medical Center, Burlington (J.R.F.) - all in Massachusetts
| | - Evan J Zucker
- From the Department of Pediatrics, Boston Children's Hospital (A.C.), the Departments of Pediatrics (A.C., V.L.M.) and Radiology (E.J.Z.), Harvard Medical School, and the Departments of Pediatrics (V.L.M.) and Radiology (E.J.Z.), Massachusetts General Hospital, Boston, the Department of Medicine, UMass Chan Medical School, Worcester (J.R.F.), and the Department of Allergy and Immunology, Lahey Hospital and Medical Center, Burlington (J.R.F.) - all in Massachusetts
| | - Jocelyn R Farmer
- From the Department of Pediatrics, Boston Children's Hospital (A.C.), the Departments of Pediatrics (A.C., V.L.M.) and Radiology (E.J.Z.), Harvard Medical School, and the Departments of Pediatrics (V.L.M.) and Radiology (E.J.Z.), Massachusetts General Hospital, Boston, the Department of Medicine, UMass Chan Medical School, Worcester (J.R.F.), and the Department of Allergy and Immunology, Lahey Hospital and Medical Center, Burlington (J.R.F.) - all in Massachusetts
| |
Collapse
|
6
|
Williams O. Hematopoietic cell transplantation for inborn errors of immunity: an update on approaches, outcomes and innovations. Curr Opin Pediatr 2024; 36:653-658. [PMID: 39319684 DOI: 10.1097/mop.0000000000001407] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/26/2024]
Abstract
PURPOSE OF REVIEW Allogeneic hematopoietic cell transplantation (HCT) is a curative option for many for inborn errors of immunity (IEI). This review highlights recent progress in the field of HCT for IEI. RECENT FINDINGS Alternative donor transplantation continues to expand donor options for patients with IEI. Reduced intensity and reduced toxicity conditioning approaches are being investigated and optimized. Immunomodulatory bridging therapies are yielding impressive progress in outcomes for primary immune regulatory disorders (PIRD) but require further study in prospective trials. Single-institution, multicenter and consortium studies have improved our understanding of factors that affect overall outcomes in IEI and outcomes in Wiskott-Aldrich syndrome (WAS), chronic granulomatous disease (CGD) and PIRD in particular. Data show that second HCT offers a viable chance of cure to some IEI patients. Late effects in IEI HCT survivors are being better characterized. Preclinical studies of chemo(radiation)-free HCT strategies hold promise for decreasing HCT toxicity. SUMMARY Improvements in our understanding of HCT donor choice, conditioning regimen, immunomodulatory bridging therapies, diagnostic and post-HCT surveillance testing and late effects continue to yield advancements in the field of HCT for IEI.
Collapse
Affiliation(s)
- Olatundun Williams
- Division of Pediatric Hematology, Oncology and Stem Cell Transplantation, Columbia University Irving Medical Center, Vagelos College of Physicians and Surgeons, Columbia University, New York, New York, USA
| |
Collapse
|
7
|
O'Connell P, Stewart O, Bogunovic D. Racial Disparities in the Diagnosis of Inborn Errors of Immunity. J Clin Immunol 2024; 44:186. [PMID: 39207514 DOI: 10.1007/s10875-024-01790-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 08/13/2024] [Indexed: 09/04/2024]
Affiliation(s)
- Patrick O'Connell
- Department of Pediatrics, New York, USA
- Mount Sinai Hospital, New York, USA
- Department of Genetics and Genomic Sciences, New York, USA
- Department of Pediatrics, Columbia University Irving Medical Center, 650 W 168th St., New York, 10032, USA
| | - O'Jay Stewart
- Department of Pediatrics, New York, USA
- Mount Sinai Hospital, New York, USA
| | - Dusan Bogunovic
- Department of Pediatrics, New York, USA.
- Mount Sinai Hospital, New York, USA.
- Department of Pediatrics, Columbia University Irving Medical Center, 650 W 168th St., New York, 10032, USA.
| |
Collapse
|
8
|
Gold J, Kripke CM, Drivas TG. Universal Exome Sequencing in Critically Ill Adults: A Diagnostic Yield of 25% and Race-Based Disparities in Access to Genetic Testing. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.03.11.24304088. [PMID: 38559092 PMCID: PMC10980115 DOI: 10.1101/2024.03.11.24304088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Numerous studies have underscored the diagnostic and therapeutic potential of exome or genome sequencing in critically ill pediatric populations. However, an equivalent investigation in critically ill adults remains conspicuously absent. We retrospectively analyzed whole exome sequencing (WES) data available through the PennMedicine Biobank (PMBB) from all 365 young adult patients, aged 18-40 years, with intensive care unit (ICU) admissions at the University of Pennsylvania Health System who met inclusion criteria for our study. For each participant, two Medical Genetics and Internal Medicine-trained clinicians reviewed WES reports and patient charts for variant classification, result interpretation, and identification of genetic diagnoses related to their critical illness. Of the 365 individuals in our study, 90 (24.7%) were found to have clearly diagnostic results on WES; an additional 40 (11.0%) had a suspicious variant of uncertain significance (VUS) identified; and an additional 16 (4.4%) had a medically actionable incidental finding. The diagnostic rate of exome sequencing did not decrease with increasing patient age. Affected genes were primarily involved in cardiac function (18.8%), vascular health (16.7%), cancer (16.7%), and pulmonary disease (11.5%). Only half of all diagnostic findings were known and documented in the patient chart at the time of ICU admission. Significant disparities emerged in subgroup analysis by EHR-reported race, with genetic diagnoses known/documented for 63.5% of White patients at the time of ICU admission but only for 28.6% of Black or Hispanic patients. There was a trend towards patients with undocumented genetic diagnoses having a 66% increased mortality rate, making these race-based disparities in genetic diagnosis even more concerning. Altogether, universal exome sequencing in ICU-admitted adult patients was found to yield a new definitive diagnosis in 11.2% of patients. Of these diagnoses, 76.6% conferred specific care-altering medical management recommendations. Our study suggests that the diagnostic utility of exome sequencing in critically ill young adults is similar to that observed in neonatal and pediatric populations and is age-independent. The high diagnostic rate and striking race-based disparities we find in genetic diagnoses argue for broad and universal approaches to genetic testing for critically ill adults. The widespread implementation of comprehensive genetic sequencing in the adult population promises to enhance medical care for all individuals and holds the potential to rectify disparities in genetic testing referrals, ultimately promoting more equitable healthcare delivery.
Collapse
Affiliation(s)
- Jessica Gold
- Division of Clinical Genetics, Department of Pediatrics, Northwell Health, Great Neck, NY 11021, USA
| | - Colleen M. Kripke
- Division of Translational Medicine and Human Genetics, Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19194, USA
| | | | | | - Theodore G. Drivas
- Division of Translational Medicine and Human Genetics, Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19194, USA
- Department of Genetics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19194, USA
| |
Collapse
|