1
|
Amar F, April A, Abran A. Electronic Health Record and Semantic Issues Using Fast Healthcare Interoperability Resources: Systematic Mapping Review. J Med Internet Res 2024; 26:e45209. [PMID: 38289660 PMCID: PMC10865191 DOI: 10.2196/45209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 03/07/2023] [Accepted: 12/19/2023] [Indexed: 02/01/2024] Open
Abstract
BACKGROUND The increasing use of electronic health records and the Internet of Things has led to interoperability issues at different levels (structural and semantic). Standards are important not only for successfully exchanging data but also for appropriately interpreting them (semantic interoperability). Thus, to facilitate the semantic interoperability of data exchanged in health care, considerable resources have been deployed to improve the quality of shared clinical data by structuring and mapping them to the Fast Healthcare Interoperability Resources (FHIR) standard. OBJECTIVE The aims of this study are 2-fold: to inventory the studies on FHIR semantic interoperability resources and terminologies and to identify and classify the approaches and contributions proposed in these studies. METHODS A systematic mapping review (SMR) was conducted using 10 electronic databases as sources of information for inventory and review studies published during 2012 to 2022 on the development and improvement of semantic interoperability using the FHIR standard. RESULTS A total of 70 FHIR studies were selected and analyzed to identify FHIR resource types and terminologies from a semantic perspective. The proposed semantic approaches were classified into 6 categories, namely mapping (31/126, 24.6%), terminology services (18/126, 14.3%), resource description framework or web ontology language-based proposals (24/126, 19%), annotation proposals (18/126, 14.3%), machine learning (ML) and natural language processing (NLP) proposals (20/126, 15.9%), and ontology-based proposals (15/126, 11.9%). From 2012 to 2022, there has been continued research in 6 categories of approaches as well as in new and emerging annotations and ML and NLP proposals. This SMR also classifies the contributions of the selected studies into 5 categories: framework or architecture proposals, model proposals, technique proposals, comparison services, and tool proposals. The most frequent type of contribution is the proposal of a framework or architecture to enable semantic interoperability. CONCLUSIONS This SMR provides a classification of the different solutions proposed to address semantic interoperability using FHIR at different levels: collecting, extracting and annotating data, modeling electronic health record data from legacy systems, and applying transformation and mapping to FHIR models and terminologies. The use of ML and NLP for unstructured data is promising and has been applied to specific use case scenarios. In addition, terminology services are needed to accelerate their use and adoption; furthermore, techniques and tools to automate annotation and ontology comparison should help reduce human interaction.
Collapse
Affiliation(s)
- Fouzia Amar
- École de technologie supérieure - ETS, Montreal, QC, Canada
| | - Alain April
- École de technologie supérieure - ETS, Montreal, QC, Canada
| | - Alain Abran
- École de technologie supérieure - ETS, Montreal, QC, Canada
| |
Collapse
|
2
|
Dobbins NJ, Han B, Zhou W, Lan KF, Kim HN, Harrington R, Uzuner Ö, Yetisgen M. LeafAI: query generator for clinical cohort discovery rivaling a human programmer. J Am Med Inform Assoc 2023; 30:1954-1964. [PMID: 37550244 PMCID: PMC10654856 DOI: 10.1093/jamia/ocad149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 07/14/2023] [Accepted: 07/19/2023] [Indexed: 08/09/2023] Open
Abstract
OBJECTIVE Identifying study-eligible patients within clinical databases is a critical step in clinical research. However, accurate query design typically requires extensive technical and biomedical expertise. We sought to create a system capable of generating data model-agnostic queries while also providing novel logical reasoning capabilities for complex clinical trial eligibility criteria. MATERIALS AND METHODS The task of query creation from eligibility criteria requires solving several text-processing problems, including named entity recognition and relation extraction, sequence-to-sequence transformation, normalization, and reasoning. We incorporated hybrid deep learning and rule-based modules for these, as well as a knowledge base of the Unified Medical Language System (UMLS) and linked ontologies. To enable data-model agnostic query creation, we introduce a novel method for tagging database schema elements using UMLS concepts. To evaluate our system, called LeafAI, we compared the capability of LeafAI to a human database programmer to identify patients who had been enrolled in 8 clinical trials conducted at our institution. We measured performance by the number of actual enrolled patients matched by generated queries. RESULTS LeafAI matched a mean 43% of enrolled patients with 27 225 eligible across 8 clinical trials, compared to 27% matched and 14 587 eligible in queries by a human database programmer. The human programmer spent 26 total hours crafting queries compared to several minutes by LeafAI. CONCLUSIONS Our work contributes a state-of-the-art data model-agnostic query generation system capable of conditional reasoning using a knowledge base. We demonstrate that LeafAI can rival an experienced human programmer in finding patients eligible for clinical trials.
Collapse
Affiliation(s)
- Nicholas J Dobbins
- Department of Biomedical Informatics & Medical Education, University of Washington, Seattle, Washington, USA
- Department of Research IT, UW Medicine, University of Washington, Seattle, Washington, USA
| | - Bin Han
- Information School, University of Washington, Seattle, Washington, USA
| | - Weipeng Zhou
- Department of Biomedical Informatics & Medical Education, University of Washington, Seattle, Washington, USA
| | - Kristine F Lan
- Department of Medicine, University of Washington, Seattle, Washington, USA
| | - H Nina Kim
- Department of Medicine, University of Washington, Seattle, Washington, USA
| | - Robert Harrington
- Department of Medicine, University of Washington, Seattle, Washington, USA
| | - Özlem Uzuner
- Department of Information Sciences and Technology, George Mason University, Fairfax, Virginia, USA
| | - Meliha Yetisgen
- Department of Biomedical Informatics & Medical Education, University of Washington, Seattle, Washington, USA
| |
Collapse
|
3
|
Balch JA, Ruppert MM, Loftus TJ, Guan Z, Ren Y, Upchurch GR, Ozrazgat-Baslanti T, Rashidi P, Bihorac A. Machine Learning-Enabled Clinical Information Systems Using Fast Healthcare Interoperability Resources Data Standards: Scoping Review. JMIR Med Inform 2023; 11:e48297. [PMID: 37646309 PMCID: PMC10468818 DOI: 10.2196/48297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 06/15/2023] [Accepted: 06/17/2023] [Indexed: 09/01/2023] Open
Abstract
Background Machine learning-enabled clinical information systems (ML-CISs) have the potential to drive health care delivery and research. The Fast Healthcare Interoperability Resources (FHIR) data standard has been increasingly applied in developing these systems. However, methods for applying FHIR to ML-CISs are variable. Objective This study evaluates and compares the functionalities, strengths, and weaknesses of existing systems and proposes guidelines for optimizing future work with ML-CISs. Methods Embase, PubMed, and Web of Science were searched for articles describing machine learning systems that were used for clinical data analytics or decision support in compliance with FHIR standards. Information regarding each system's functionality, data sources, formats, security, performance, resource requirements, scalability, strengths, and limitations was compared across systems. Results A total of 39 articles describing FHIR-based ML-CISs were divided into the following three categories according to their primary focus: clinical decision support systems (n=18), data management and analytic platforms (n=10), or auxiliary modules and application programming interfaces (n=11). Model strengths included novel use of cloud systems, Bayesian networks, visualization strategies, and techniques for translating unstructured or free-text data to FHIR frameworks. Many intelligent systems lacked electronic health record interoperability and externally validated evidence of clinical efficacy. Conclusions Shortcomings in current ML-CISs can be addressed by incorporating modular and interoperable data management, analytic platforms, secure interinstitutional data exchange, and application programming interfaces with adequate scalability to support both real-time and prospective clinical applications that use electronic health record platforms with diverse implementations.
Collapse
Affiliation(s)
- Jeremy A Balch
- Department of Surgery, University of Florida Health, Gainesville, FL, United States
- Intelligent Critical Care Center, University of Florida, Gainesville, FL, United States
| | - Matthew M Ruppert
- Intelligent Critical Care Center, University of Florida, Gainesville, FL, United States
- Department of Medicine, University of Florida, Gainesville, FL, United States
| | - Tyler J Loftus
- Department of Surgery, University of Florida Health, Gainesville, FL, United States
- Intelligent Critical Care Center, University of Florida, Gainesville, FL, United States
| | - Ziyuan Guan
- Intelligent Critical Care Center, University of Florida, Gainesville, FL, United States
- Department of Medicine, University of Florida, Gainesville, FL, United States
| | - Yuanfang Ren
- Intelligent Critical Care Center, University of Florida, Gainesville, FL, United States
- Department of Medicine, University of Florida, Gainesville, FL, United States
| | - Gilbert R Upchurch
- Department of Surgery, University of Florida Health, Gainesville, FL, United States
| | - Tezcan Ozrazgat-Baslanti
- Intelligent Critical Care Center, University of Florida, Gainesville, FL, United States
- Department of Medicine, University of Florida, Gainesville, FL, United States
| | - Parisa Rashidi
- Intelligent Critical Care Center, University of Florida, Gainesville, FL, United States
- Department of Biomedical Engineering, University of Florida, Gainesville, FL, United States
| | - Azra Bihorac
- Intelligent Critical Care Center, University of Florida, Gainesville, FL, United States
- Department of Medicine, University of Florida, Gainesville, FL, United States
| |
Collapse
|
4
|
Kempf E, Vaterkowski M, Leprovost D, Griffon N, Ouagne D, Breant S, Serre P, Mouchet A, Rance B, Chatellier G, Bellamine A, Frank M, Guerin J, Tannier X, Livartowski A, Hilka M, Daniel C. How to Improve Cancer Patients ENrollment in Clinical Trials From rEal-Life Databases Using the Observational Medical Outcomes Partnership Oncology Extension: Results of the PENELOPE Initiative in Urologic Cancers. JCO Clin Cancer Inform 2023; 7:e2200179. [PMID: 37167578 DOI: 10.1200/cci.22.00179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/13/2023] Open
Abstract
PURPOSE To compare the computability of Observational Medical Outcomes Partnership (OMOP)-based queries related to prescreening of patients using two versions of the OMOP common data model (CDM; v5.3 and v5.4) and to assess the performance of the Greater Paris University Hospital (APHP) prescreening tool. MATERIALS AND METHODS We identified the prescreening information items being relevant for prescreening of patients with cancer. We randomly selected 15 academic and industry-sponsored urology phase I-IV clinical trials (CTs) launched at APHP between 2016 and 2021. The computability of the related prescreening criteria (PC) was defined by their translation rate in OMOP-compliant queries and by their execution rate on the APHP clinical data warehouse (CDW) containing data of 205,977 patients with cancer. The overall performance of the prescreening tool was assessed by the rate of true- and false-positive cases of three randomly selected CTs. RESULTS We defined a list of 15 minimal information items being relevant for patients' prescreening. We identified 83 PC of the 534 eligibility criteria from the 15 CTs. We translated 33 and 62 PC in queries on the basis of OMOP CDM v5.3 and v5.4, respectively (translation rates of 40% and 75%, respectively). Of the 33 PC translated in the v5.3 of the OMOP CDM, 19 could be executed on the APHP CDW (execution rate of 58%). Of 83 PC, the computability rate on the APHP CDW reached 23%. On the basis of three CTs, we identified 17, 32, and 63 patients as being potentially eligible for inclusion in those CTs, resulting in positive predictive values of 53%, 41%, and 21%, respectively. CONCLUSION We showed that PC could be formalized according to the OMOP CDM and that the oncology extension increased their translation rate through better representation of cancer natural history.
Collapse
Affiliation(s)
- Emmanuelle Kempf
- Sorbonne Université, Inserm, Université Sorbonne Paris Nord, Laboratoire d'Informatique Médicale et d'Ingénierie des Connaissances pour la e-Santé, LIMICS, Paris, France
- Department of Medical Oncology, Assistance Publique Hôpitaux de Paris, Henri Mondor Teaching Hospital, Créteil, France
| | - Morgan Vaterkowski
- Innovation and Data, Paris, IT Department, Assistance Publique Hôpitaux de Paris, Paris, France
- EPITA School of Engineering and Computer Science, Paris, France
| | - Damien Leprovost
- Sorbonne Université, Inserm, Université Sorbonne Paris Nord, Laboratoire d'Informatique Médicale et d'Ingénierie des Connaissances pour la e-Santé, LIMICS, Paris, France
- Innovation and Data, Paris, IT Department, Assistance Publique Hôpitaux de Paris, Paris, France
| | - Nicolas Griffon
- Sorbonne Université, Inserm, Université Sorbonne Paris Nord, Laboratoire d'Informatique Médicale et d'Ingénierie des Connaissances pour la e-Santé, LIMICS, Paris, France
- Innovation and Data, Paris, IT Department, Assistance Publique Hôpitaux de Paris, Paris, France
| | - David Ouagne
- Innovation and Data, Paris, IT Department, Assistance Publique Hôpitaux de Paris, Paris, France
| | - Stéphane Breant
- Innovation and Data, Paris, IT Department, Assistance Publique Hôpitaux de Paris, Paris, France
| | - Patricia Serre
- Innovation and Data, Paris, IT Department, Assistance Publique Hôpitaux de Paris, Paris, France
| | - Alexandre Mouchet
- Innovation and Data, Paris, IT Department, Assistance Publique Hôpitaux de Paris, Paris, France
| | - Bastien Rance
- Department of Medical Informatics, Assistance Publique Hôpitaux de Paris, Centre-Université de Paris (APHP-CUP), Université de Paris, Paris, France
| | - Gilles Chatellier
- Department of Medical Informatics, Assistance Publique Hôpitaux de Paris, Centre-Université de Paris (APHP-CUP), Université de Paris, Paris, France
| | - Ali Bellamine
- Innovation and Data, Paris, IT Department, Assistance Publique Hôpitaux de Paris, Paris, France
| | - Marie Frank
- Department of Medical Information, Paris Saclay Teaching Hospital, Assistance Publique Hôpitaux de Paris, Paris, France
| | | | - Xavier Tannier
- Sorbonne Université, Inserm, Université Sorbonne Paris Nord, Laboratoire d'Informatique Médicale et d'Ingénierie des Connaissances pour la e-Santé, LIMICS, Paris, France
| | | | - Martin Hilka
- Innovation and Data, Paris, IT Department, Assistance Publique Hôpitaux de Paris, Paris, France
| | - Christel Daniel
- Sorbonne Université, Inserm, Université Sorbonne Paris Nord, Laboratoire d'Informatique Médicale et d'Ingénierie des Connaissances pour la e-Santé, LIMICS, Paris, France
- Innovation and Data, Paris, IT Department, Assistance Publique Hôpitaux de Paris, Paris, France
| |
Collapse
|
5
|
A multicenter program for electronic health record screening for patients with heart failure with preserved ejection fraction: Lessons from the DELIVER-EHR initiative. Contemp Clin Trials 2022; 121:106924. [PMID: 36100197 DOI: 10.1016/j.cct.2022.106924] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Revised: 09/05/2022] [Accepted: 09/07/2022] [Indexed: 01/27/2023]
Abstract
Efficiency in clinical trial recruitment and enrollment remains a major challenge in many areas of clinical medicine. In particular, despite the prevalence of heart failure with preserved ejection fraction (HFpEF), identifying patients with HFpEF for clinical trials has proven to be especially challenging. In this manuscript, we review strategies for contemporary clinical trial recruitment and present insights from the results of the DELIVER Electronic Health Record (EHR) Screening Initiative. The DELIVER trial was designed to evaluate the effects of dapagliflozin on clinical outcomes in patients with HFpEF. Within this trial, the multicenter DELIVER EHR Screening Initiative utilized EHR-based techniques in order to improve recruitment at selected sites in the United States. For this initiative, we developed and deployed a computable phenotype from the trial's eligibility criteria along with additional EHR tools at interested sites. Sites were then surveyed at the end of the program regarding lessons learned. Six sites were recruited, trained, and supported to utilize the EHR methodology and computable phenotype. Sites found the initiative to be helpful in identifying eligible patients and cited the individualized expert technical support as a critical factor in utilizing the program effectively. We found that the major challenge of implementation was the process of converting traditional inclusion/exclusion criteria into a computable phenotype within an established and ongoing trial. Other significant challenges noted by sites were the following: impact of the COVID-19 pandemic, engagement/support by local institutions, and limited availability of internal EHR experts/resources to execute programming. The study represents a proof-of-concept in the ability to utilize EHR-based tools in clinical trial recruitment for patients with HFpEF and provides important lessons for future initiatives. ClinicalTrials.gov Identifier: NCT03619213.
Collapse
|