Managing differential performance of polygenic risk scores across groups: Real-world experience of the eMERGE Network

The differential performance of polygenic risk scores (PRSs) by group is one of the major ethical barriers to their clinical use. It is also one of the main practical challenges for any implementation effort. The social repercussions of how people are grouped in PRS research must be considered in communications with research participants, including return of results. Here, we outline the decisions faced and choices made by a large multi-site clinical implementation study returning PRSs to diverse participants in handling this issue of differential performance. Our approach to managing the complexities associated with the differential performance of PRSs serves as a case study that can help future implementers of PRSs to plot an anticipatory course in response to this issue.

Selection, optimization and validation of ten chronic disease polygenic risk scores for clinical implementation in diverse US populations

Polygenic risk scores (PRSs) have improved in predictive performance, but several challenges remain to be addressed before PRSs can be implemented in the clinic, including reduced predictive performance of PRSs in diverse populations, and the interpretation and communication of genetic results to both providers and patients. To address these challenges, the National Human Genome Research Institute-funded Electronic Medical Records and Genomics (eMERGE) Network has developed a framework and pipeline for return of a PRS-based genome-informed risk assessment to 25,000 diverse adults and children as part of a clinical study. From an initial list of 23 conditions, ten were selected for implementation based on PRS performance, medical actionability and potential clinical utility, including cardiometabolic diseases and cancer. Standardized metrics were considered in the selection process, with additional consideration given to strength of evidence in African and Hispanic populations. We then developed a pipeline for clinical PRS implementation (score transfer to a clinical laboratory, validation and verification of score performance), and used genetic ancestry to calibrate PRS mean and variance, utilizing genetically diverse data from 13,475 participants of the All of Us Research Program cohort to train and test model parameters. Finally, we created a framework for regulatory compliance and developed a PRS clinical report for return to providers and for inclusion in an additional genome-informed risk assessment. The initial experience from eMERGE can inform the approach needed to implement PRS-based testing in diverse clinical settings.

Prospective, multi-site study of healthcare utilization after actionable monogenic findings from clinical sequencing

As large-scale genomic screening becomes increasingly prevalent, understanding the influence of actionable results on healthcare utilization is key to estimating the potential long-term clinical impact. The eMERGE network sequenced individuals for actionable genes in multiple genetic conditions and returned results to individuals, providers, and the electronic health record. Differences in recommended health services (laboratory, imaging, and procedural testing) delivered within 12 months of return were compared among individuals with pathogenic or likely pathogenic (P/LP) findings to matched individuals with negative findings before and after return of results. Of 16,218 adults, 477 unselected individuals were found to have a monogenic risk for arrhythmia (n = 95), breast cancer (n = 96), cardiomyopathy (n = 95), colorectal cancer (n = 105), or familial hypercholesterolemia (n = 86). Individuals with P/LP results more frequently received services after return (43.8%) compared to before return (25.6%) of results and compared to individuals with negative findings (24.9%; p < 0.0001). The annual cost of qualifying healthcare services increased from an average of $162 before return to $343 after return of results among the P/LP group (p < 0.0001); differences in the negative group were non-significant. The mean difference-in-differences was $149 (p < 0.0001), which describes the increased cost within the P/LP group corrected for cost changes in the negative group. When stratified by individual conditions, significant cost differences were observed for arrhythmia, breast cancer, and cardiomyopathy. In conclusion, less than half of individuals received billed health services after monogenic return, which modestly increased healthcare costs for payors in the year following return.

Education and electronic medical records and genomics network, challenges, and lessons learned from a large-scale clinical trial using polygenic risk scores

Polygenic risk scores (PRS) have potential to improve health care by identifying individuals that have elevated risk for common complex conditions. Use of PRS in clinical practice, however, requires careful assessment of the needs and capabilities of patients, providers, and health care systems. The electronic Medical Records and Genomics (eMERGE) network is conducting a collaborative study which will return PRS to 25,000 pediatric and adult participants. All participants will receive a risk report, potentially classifying them as high risk (∼2-10% per condition) for 1 or more of 10 conditions based on PRS. The study population is enriched by participants from racial and ethnic minority populations, underserved populations, and populations who experience poorer medical outcomes. All 10 eMERGE clinical sites conducted focus groups, interviews, and/or surveys to understand educational needs among key stakeholders-participants, providers, and/or study staff. Together, these studies highlighted the need for tools that address the perceived benefit/value of PRS, types of education/support needed, accessibility, and PRS-related knowledge and understanding. Based on findings from these preliminary studies, the network harmonized training initiatives and formal/informal educational resources. This paper summarizes eMERGE's collective approach to assessing educational needs and developing educational approaches for primary stakeholders. It discusses challenges encountered and solutions provided.

Selection, optimization, and validation of ten chronic disease polygenic risk scores for clinical implementation in diverse populations

Polygenic risk scores (PRS) have improved in predictive performance supporting their use in clinical practice. Reduced predictive performance of PRS in diverse populations can exacerbate existing health disparities. The NHGRI-funded eMERGE Network is returning a PRS-based genome-informed risk assessment to 25,000 diverse adults and children. We assessed PRS performance, medical actionability, and potential clinical utility for 23 conditions. Standardized metrics were considered in the selection process with additional consideration given to strength of evidence in African and Hispanic populations. Ten conditions were selected with a range of high-risk thresholds: atrial fibrillation, breast cancer, chronic kidney disease, coronary heart disease, hypercholesterolemia, prostate cancer, asthma, type 1 diabetes, obesity, and type 2 diabetes. We developed a pipeline for clinical PRS implementation, used genetic ancestry to calibrate PRS mean and variance, created a framework for regulatory compliance, and developed a PRS clinical report. eMERGE's experience informs the infrastructure needed to implement PRS-based implementation in diverse clinical settings.

Returning integrated genomic risk and clinical recommendations: The eMERGE study

PURPOSE

Assessing the risk of common, complex diseases requires consideration of clinical risk factors as well as monogenic and polygenic risks, which in turn may be reflected in family history. Returning risks to individuals and providers may influence preventive care or use of prophylactic therapies for those individuals at high genetic risk.

METHODS

To enable integrated genetic risk assessment, the eMERGE (electronic MEdical Records and GEnomics) network is enrolling 25,000 diverse individuals in a prospective cohort study across 10 sites. The network developed methods to return cross-ancestry polygenic risk scores, monogenic risks, family history, and clinical risk assessments via a genome-informed risk assessment (GIRA) report and will assess uptake of care recommendations after return of results.

RESULTS

GIRAs include summary care recommendations for 11 conditions, education pages, and clinical laboratory reports. The return of high-risk GIRA to individuals and providers includes guidelines for care and lifestyle recommendations. Assembling the GIRA required infrastructure and workflows for ingesting and presenting content from multiple sources. Recruitment began in February 2022.

CONCLUSION

Return of a novel report for communicating monogenic, polygenic, and family history-based risk factors will inform the benefits of integrated genetic risk assessment for routine health care.

Implementing Pharmacogenetic Testing in Gastrointestinal Cancers (IMPACT-GI): Study Protocol for a Pragmatic Implementation Trial for Establishing DPYD and UGT1A1 Screening to Guide Chemotherapy Dosing

Background

Fluoropyrimidines (fluorouracil [5-FU], capecitabine) and irinotecan are commonly prescribed chemotherapy agents for gastrointestinal (GI) malignancies. Pharmacogenetic (PGx) testing for germline DPYD and UGT1A1 variants associated with reduced enzyme activity holds the potential to identify patients at high risk for severe chemotherapy-induced toxicity. Slow adoption of PGx testing in routine clinical care is due to implementation barriers, including long test turnaround times, lack of integration in the electronic health record (EHR), and ambiguity in test cost coverage. We sought to establish PGx testing in our health system following the Exploration, Preparation, Implementation, Sustainment (EPIS) framework as a guide. Our implementation study aims to address barriers to PGx testing.

Methods

The Implementing Pharmacogenetic Testing in Gastrointestinal Cancers (IMPACT-GI) study is a non-randomized, pragmatic, open-label implementation study at three sites within a major academic health system. Eligible patients with a GI malignancy indicated for treatment with 5-FU, capecitabine, or irinotecan will undergo PGx testing prior to chemotherapy initiation. Specimens will be sent to an academic clinical laboratory followed by return of results in the EHR with appropriate clinical decision support for the care team. We hypothesize that the availability of a rapid turnaround PGx test with specific dosing recommendations will increase PGx test utilization to guide pharmacotherapy decisions and improve patient safety outcomes. Primary implementation endpoints are feasibility, fidelity, and penetrance. Exploratory analyses for clinical effectiveness of genotyping will include assessing grade ≥3 treatment-related toxicity using available clinical data, patient-reported outcomes, and quality of life measures.

Conclusion

We describe the formative work conducted to prepare our health system for DPYD and UGT1A1 testing. Our prospective implementation study will evaluate the clinical implementation of this testing program and create the infrastructure necessary to ensure sustainability of PGx testing in our health system. The results of this study may help other institutions interested in implementing PGx testing in oncology care.

Clinical Trial Registration

https://clinicaltrials.gov/ct2/show/NCT04736472, identifier [NCT04736472].

Do research participants share genomic screening results with family members?

The public health impact of genomic screening can be enhanced by cascade testing. However, cascade testing depends on communication of results to family members. While the barriers and facilitators of family communication have been researched following clinical genetic testing, the factors impacting the dissemination of genomic screening results are unknown. Using the pragmatic Electronic Medical Records and Genomics Network-3 (eMERGE-3) study, we explored the reported sharing practices of participants who underwent genomic screening across the United States. Six eMERGE-3 sites returned genomic screening results for mostly dominant medically actionable disorders and surveyed adult participants regarding communication of results with first-degree relatives. Across the sites, 279 participants completed a 1-month and/or 6-month post-results survey. By 6 months, only 34% of the 156 respondents shared their results with all first-degree relatives and 4% did not share with any. Over a third (39%) first-degree relatives were not notified of the results. Half (53%) of participants who received their results from a genetics provider shared them with all first-degree relatives compared with 11% of participants who received their results from a non-genetics provider. The most frequent reasons for sharing were a feeling of obligation (72%) and that the information could help family members make medical decisions (72%). The most common reasons indicated for not sharing were that the family members were too young (38%), or they were not in contact (25%) or not close to them (25%). These data indicate that the professional returning the results may impact sharing patterns, suggesting that there is a need to continue to educate healthcare providers regarding approaches to facilitate sharing of genetic results within families. Finally, these data suggest that interventions to increase sharing may be universally effective regardless of the origin of the genetic result.

A Transparent Approach to Calculate Detection Rate and Residual Risk for Carrier Screening

Carrier screening involves detection of carrier status for genes associated with recessive conditions. A negative carrier screening test result bears a nonzero residual risk (RR) for the individual to have an affected child. The RR depends on the prevalence of specific conditions and the detection rate (DR) of the test itself. Herein, we provide a detailed approach for calculating DR and RR. DR was calculated on the basis of the sum of disease allele frequencies (DAFs) of pathogenic variants found in published literature. As a proof of concept, DAF data for cystic fibrosis were compared with society guidelines. The DAF data calculated by this method were consistent with the published cystic fibrosis guideline. In addition, we compared DAF for four genes (ABCC8, ASPA, GAA, and MMUT) across three laboratories, and outlined the likely reasons for discrepancies between these laboratories. The utility of carrier screening is to support couples with information while making reproductive choices. Accurate development of DR and RR is therefore critical. The method described herein provides an unbiased and transparent process to collect, calculate, and report these data.

Participant choices for return of genomic results in the eMERGE Network

PURPOSE

Secondary findings are typically offered in an all or none fashion when sequencing is used for clinical purposes. This study aims to describe the process of offering categorical and granular choices for results in a large research consortium.

METHODS

Within the third phase of the electronic MEdical Records and GEnomics (eMERGE) Network, several sites implemented studies that allowed participants to choose the type of results they wanted to receive from a multigene sequencing panel. Sites were surveyed to capture the details of the implementation protocols and results of these choices.

RESULTS

Across the ten eMERGE sites, 4664 participants including adolescents and adults were offered some type of choice. Categories of choices offered and methods for selecting categories varied. Most participants (94.5%) chose to learn all genetic results, while 5.5% chose subsets of results. Several sites allowed participants to change their choices at various time points, and 0.5% of participants made changes.

CONCLUSION

Offering choices that include learning some results is important and should be a dynamic process to allow for changes in scientific knowledge, participant age group, and individual preference.

Understanding the Return of Genomic Sequencing Results Process: Content Review of Participant Summary Letters in the eMERGE Research Network

A challenge in returning genomic test results to research participants is how best to communicate complex and clinically nuanced findings to participants in a manner that is scalable to the large numbers of participants enrolled. The purpose of this study was to examine the features of genetic results letters produced at each Electronic Medical Records and Genomics (eMERGE3) Network site to assess their readability and content. Letters were collected from each site, and a qualitative analysis of letter content and a quantitative analysis of readability statistics were performed. Because letters were produced independently at each eMERGE site, significant heterogeneity in readability and content was found. The content of letters varied widely from a baseline of notifying participants that results existed to more detailed information about positive or negative results, as well as materials for sharing with family members. Most letters were significantly above the Centers for Disease Control-suggested reading level for health communication. While continued effort should be applied to make letters easier to understand, the ongoing challenge of explaining complex genomic information, the implications of negative test results, and the uncertainty that comes with some types of test and result makes simplifying letter text challenging.

Safety of dry needling to the upper lumbar spine: a pilot cadaver study

Objective: When inserting a dry needle laterally into the upper lumbar spine (L1-L3) there is an increased risk of piercing the kidney; therefore, the objective of this study was to determine a zone of safety for practitioners to needle in the upper lumbar spine.Methods: Ten cadavers were screened for inclusion. L1 spinous process was identified and confirmed with ultrasound imaging. A digital caliper was used to measure laterally at 1.5 cm, 2.0 cm, and 2.5 cm. Dry needles were inserted maximally at each point and a binary decision, yes or no, was made to determine if bony contact was made. Needle depth and abdominal width measurements were also recorded. Safety of the dry needling procedure was interpreted as such if bony contact was made by the needle. If bony contact was made, then it was assumed that the needle cannot advance further into pleura or kidney.Results: Forty-four percent of needles did not make bony contact at 2.5 cm lateral of the L1 spinous process, whereas 22% did not make bony contact at 1.5 cm and 2.0 cm. There was a weak to moderate negative correlation between abdominal width measurements and needle depth at 1.5 cm (-0.48) and 2.0 cm (-0.45), and at 2.5 cm (-0.39).Conclusion: A safety zone of needling less than 2.5 cm is likely safe, but needs to be confirmed with future study. Dry needling 2.5 cm lateral appears more risky due to the higher frequency of not contacting a bony backdrop.

Harmonizing Clinical Sequencing and Interpretation for the eMERGE III Network

The advancement of precision medicine requires new methods to coordinate and deliver genetic data from heterogeneous sources to physicians and patients. The eMERGE III Network enrolled >25,000 participants from biobank and prospective cohorts of predominantly healthy individuals for clinical genetic testing to determine clinically actionable findings. The network developed protocols linking together the 11 participant collection sites and 2 clinical genetic testing laboratories. DNA capture panels targeting 109 genes were used for testing of DNA and sample collection, data generation, interpretation, reporting, delivery, and storage were each harmonized. A compliant and secure network enabled ongoing review and reconciliation of clinical interpretations, while maintaining communication and data sharing between clinicians and investigators. A total of 202 individuals had positive diagnostic findings relevant to the indication for testing and 1,294 had additional/secondary findings of medical significance deemed to be returnable, establishing data return rates for other testing endeavors. This study accomplished integration of structured genomic results into multiple electronic health record (EHR) systems, setting the stage for clinical decision support to enable genomic medicine. Further, the established processes enable different sequencing sites to harmonize technical and interpretive aspects of sequencing tests, a critical achievement toward global standardization of genomic testing. The eMERGE protocols and tools are available for widespread dissemination.

Harmonizing Outcomes for Genomic Medicine: Comparison of eMERGE Outcomes to ClinGen Outcome/Intervention Pairs

Genomic medicine is moving from research to the clinic. There is a lack of evidence about the impact of genomic medicine interventions on health outcomes. This is due in part to a lack of standardized outcome measures that can be used across different programs to evaluate the impact of interventions targeted to specific genetic conditions. The eMERGE Outcomes working group (OWG) developed measures to collect information on outcomes following the return of genomic results to participants for several genetic disorders. These outcomes were compared to outcome intervention pairs for genetic disorders developed independently by the ClinGen Actionability working group (AWG). In general, there was concordance between the defined outcomes between the two groups. The ClinGen outcomes tended to be from a higher level and the AWG scored outcomes represented a subset of outcomes referenced in the accompanying AWG evidence review. eMERGE OWG outcomes were more detailed and discrete, facilitating a collection of relevant information from the health records. This paper demonstrates that common outcomes for genomic medicine interventions can be identified. Further work is needed to standardize outcomes across genomic medicine implementation projects and to make these publicly available to enhance dissemination and assist in making precision public health a reality.

Ethical Considerations Related to Return of Results from Genomic Medicine Projects: The eMERGE Network (Phase III) Experience

We examined the Institutional Review Board (IRB) process at 9 academic institutions in the electronic Medical Records and Genomics (eMERGE) Network, for proposed electronic health record-based genomic medicine studies, to identify common questions and concerns. Sequencing of 109 disease related genes and genotyping of 14 actionable variants is being performed in ~28,100 participants from the 9 sites. Pathogenic/likely pathogenic variants in actionable genes are being returned to study participants. We examined each site’s research protocols, informed-consent materials, and interactions with IRB staff. Research staff at each site completed questionnaires regarding their IRB interactions. The time to prepare protocols for IRB submission, number of revisions and time to approval ranged from 10–261 days, 0–11, and 11–90 days, respectively. IRB recommendations related to the readability of informed consent materials, specifying the full range of potential risks, providing options for receiving limited results or withdrawal, sharing of information with family members, and establishing the mechanisms to answer participant questions. IRBs reviewing studies that involve the return of results from genomic sequencing have a diverse array of concerns, and anticipating these concerns can help investigators to more effectively engage IRBs.

Mutations in TBCK, Encoding TBC1-Domain-Containing Kinase, Lead to a Recognizable Syndrome of Intellectual Disability and Hypotonia

Through an international multi-center collaboration, 13 individuals from nine unrelated families and affected by likely pathogenic biallelic variants in TBC1-domain-containing kinase (TBCK) were identified through whole-exome sequencing. All affected individuals were found to share a core phenotype of intellectual disability and hypotonia, and many had seizures and showed brain atrophy and white-matter changes on neuroimaging. Minor non-specific facial dysmorphism was also noted in some individuals, including multiple older children who developed coarse features similar to those of storage disorders. TBCK has been shown to regulate the mammalian target of rapamycin (mTOR) signaling pathway, which is also stimulated by exogenous leucine supplementation. TBCK was absent in cells from affected individuals, and decreased phosphorylation of phospho-ribosomal protein S6 was also observed, a finding suggestive of downregulation of mTOR signaling. Lastly, we demonstrated that activation of the mTOR pathway in response to L-leucine supplementation was retained, suggesting a possible avenue for directed therapies for this condition.

EGFR mutations cause a lethal syndrome of epithelial dysfunction with progeroid features

The epidermal growth factor receptor (EGFR) is part of a large family of receptors required for communicating extracellular signals through internal tyrosine kinases. Epidermal growth factor (EGF) signaling is required for tissue development, whereas constitutive activation of this signaling pathway is associated with oncogenic transformation. We identified homozygous c.1283G>A (p.Gly428Asp) mutations in the extracellular domain of EGFR in two siblings. The children were born prematurely, had abnormalities in skin and hair, suffered multisystem organ failure, and died in the neonatal period from intestinal perforation. EGF failed to induce mutated receptor phosphorylation in patient-derived fibroblasts and activation of downstream targets was suppressed. The heterologously expressed extracellular domain was impaired in stability and the binding of EGF. Cells from the affected patient undergo early senescence with accelerated expression of β-galactosidase and shortened telomeres at all passages when compared to controls. A comparison of homozygous inherited regions from a separate report of a patient from the same ethnic background and EGFR genotype confirms the pathogenicity of EGFR mutations in congenital disease.

Mutations in DDX3X Are a Common Cause of Unexplained Intellectual Disability with Gender-Specific Effects on Wnt Signaling

Intellectual disability (ID) affects approximately 1%-3% of humans with a gender bias toward males. Previous studies have identified mutations in more than 100 genes on the X chromosome in males with ID, but there is less evidence for de novo mutations on the X chromosome causing ID in females. In this study we present 35 unique deleterious de novo mutations in DDX3X identified by whole exome sequencing in 38 females with ID and various other features including hypotonia, movement disorders, behavior problems, corpus callosum hypoplasia, and epilepsy. Based on our findings, mutations in DDX3X are one of the more common causes of ID, accounting for 1%-3% of unexplained ID in females. Although no de novo DDX3X mutations were identified in males, we present three families with segregating missense mutations in DDX3X, suggestive of an X-linked recessive inheritance pattern. In these families, all males with the DDX3X variant had ID, whereas carrier females were unaffected. To explore the pathogenic mechanisms accounting for the differences in disease transmission and phenotype between affected females and affected males with DDX3X missense variants, we used canonical Wnt defects in zebrafish as a surrogate measure of DDX3X function in vivo. We demonstrate a consistent loss-of-function effect of all tested de novo mutations on the Wnt pathway, and we further show a differential effect by gender. The differential activity possibly reflects a dose-dependent effect of DDX3X expression in the context of functional mosaic females versus one-copy males, which reflects the complex biological nature of DDX3X mutations.

CHARGE-like presentation, craniosynostosis and mild Mowat-Wilson Syndrome diagnosed by recognition of the distinctive facial gestalt in a cohort of 28 new cases

Mowat-Wilson syndrome (MWS) is characterized by moderate to severe intellectual disability and distinctive facial features in association with variable structural congenital anomalies/clinical features including congenital heart disease, Hirschsprung disease, hypospadias, agenesis of the corpus callosum, short stature, epilepsy, and microcephaly. Less common clinical features include ocular anomalies, craniosynostosis, mild intellectual disability, and choanal atresia. These cases may be more difficult to diagnose. In this report, we add 28 MWS patients with molecular confirmation of ZEB2 mutation, including seven with an uncommon presenting feature. Among the "unusual" patients, two patients had clinical features of charge syndrome including choanal atresia, coloboma, cardiac defects, genitourinary anomaly (1/2), and severe intellectual disability; two patients had craniosynostosis; and three patients had mild intellectual disability. Sixteen patients have previously-unreported mutations in ZEB2. Genotype-phenotype correlations were suggested in those with mild intellectual disability (two had a novel missense mutation in ZEB2, one with novel splice site mutation). This report increases the number of reported patients with MWS with unusual features, and is the first report of MWS in children previously thought to have CHARGE syndrome. These patients highlight the importance of facial gestalt in the accurate identification of MWS when less common features are present.