1
|
Stead WW, Miller RA, Ohno-Machado L, Bakken S. JAMIA at 30: looking back and forward. J Am Med Inform Assoc 2023; 31:1-9. [PMID: 38134400 PMCID: PMC10746314 DOI: 10.1093/jamia/ocad215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Accepted: 10/30/2023] [Indexed: 12/24/2023] Open
Affiliation(s)
- William W Stead
- Department of Biomedical Informatics, Department of Medicine, Vanderbilt University Medical Center, Nashville, TN 37232, United States
| | - Randolph A Miller
- Department of Biomedical Informatics, Vanderbilt University School of Medicine, Alexandria, VA 37232, United States
| | - Lucila Ohno-Machado
- Section of Biomedical Informatics & Data Science, Yale University School of Medicine, New Haven, CT 06520, United States
| | - Suzanne Bakken
- School of Nursing, Department of Biomedical Informatics, Data Science Institute, Columbia University, New York, NY 10032, United States
| |
Collapse
|
2
|
Carlin CS, Ho LV, Ledbetter DR, Aczon MD, Wetzel RC. Predicting individual physiologically acceptable states at discharge from a pediatric intensive care unit. J Am Med Inform Assoc 2019; 25:1600-1607. [PMID: 30295770 DOI: 10.1093/jamia/ocy122] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2018] [Accepted: 08/29/2018] [Indexed: 11/12/2022] Open
Abstract
Objective Quantify physiologically acceptable PICU-discharge vital signs and develop machine learning models to predict these values for individual patients throughout their PICU episode. Methods EMR data from 7256 survivor PICU episodes (5632 patients) collected between 2009 and 2017 at Children's Hospital Los Angeles was analyzed. Each episode contained 375 variables representing physiology, labs, interventions, and drugs. Between medical and physical discharge, when clinicians determined the patient was ready for ICU discharge, they were assumed to be in a physiologically acceptable state space (PASS) for discharge. Each patient's heart rate, systolic blood pressure, diastolic blood pressure in the PASS window were measured and compared to age-normal values, regression-quantified PASS predictions, and recurrent neural network (RNN) PASS predictions made 12 hours after PICU admission. Results Mean absolute errors (MAEs) between individual PASS values and age-normal values (HR: 21.0 bpm; SBP: 10.8 mm Hg; DBP: 10.6 mm Hg) were greater (p < .05) than regression prediction MAEs (HR: 15.4 bpm; SBP: 9.9 mm Hg; DBP: 8.6 mm Hg). The RNN models best approximated individual PASS values (HR: 12.3 bpm; SBP: 7.6 mm Hg; DBP: 7.0 mm Hg). Conclusions The RNN model predictions better approximate patient-specific PASS values than regression and age-normal values.
Collapse
Affiliation(s)
- Cameron S Carlin
- Laura P. and Leland K. Whittier Virtual Pediatric Intensive Care Unit, Children's Hospital Los Angeles, Los Angeles, CA, USA
| | - Long V Ho
- Laura P. and Leland K. Whittier Virtual Pediatric Intensive Care Unit, Children's Hospital Los Angeles, Los Angeles, CA, USA
| | - David R Ledbetter
- Laura P. and Leland K. Whittier Virtual Pediatric Intensive Care Unit, Children's Hospital Los Angeles, Los Angeles, CA, USA
| | - Melissa D Aczon
- Laura P. and Leland K. Whittier Virtual Pediatric Intensive Care Unit, Children's Hospital Los Angeles, Los Angeles, CA, USA
| | - Randall C Wetzel
- Laura P. and Leland K. Whittier Virtual Pediatric Intensive Care Unit, Children's Hospital Los Angeles, Los Angeles, CA, USA
| |
Collapse
|
3
|
Ramos-Merino M, Álvarez-Sabucedo LM, Santos-Gago JM, Sanz-Valero J. A BPMN Based Notation for the Representation of Workflows in Hospital Protocols. J Med Syst 2018; 42:181. [PMID: 30155797 DOI: 10.1007/s10916-018-1034-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2018] [Accepted: 08/15/2018] [Indexed: 11/29/2022]
Abstract
Flowcharts used for hospital protocols have a series of ambiguities and limitations in order to express some types of information. In this article, a notation proposal for flowcharts that partially avoids these problems is presented. This new notation is an adaptation of BPMNE2, an extension of the Business Process Model and Notation (BPMN), which allows direct modelling of procedures that follow the Hazard Analysis and Critical Control Points (HACCP) model. The new notation has been validated in the hospital context, specifically in the field of hazardous drugs (HDs). To measure usability from the perspective of the health staff and auditors, the System Usability Scale (SUS) was used. A total of 47 experts took part in the assessment, resulting in a SUS score of 71, that corresponds to an acceptable level of usability. The feedback provided by these participants allows us to discover benefits and drawbacks of the proposal. Also, it is noteworthy that 76.6% of professionals prefer to migrate to the new notation from the ISO 5807:1985 notation, the most commonly used model. In addition to the direct benefits of this notation from the human point of view, its machine-understandable nature provides the required support for its integration into software tools for intelligent monitoring and auditing.
Collapse
Affiliation(s)
- Mateo Ramos-Merino
- Escola de Enxeñaría de Telecomunicación, Universidade de Vigo, Campus Lagoas-Marcosende, 36.310, Vigo, Galicia, Spain.
| | - Luis M Álvarez-Sabucedo
- Escola de Enxeñaría de Telecomunicación, Universidade de Vigo, Campus Lagoas-Marcosende, 36.310, Vigo, Galicia, Spain
| | - Juan M Santos-Gago
- Escola de Enxeñaría de Telecomunicación, Universidade de Vigo, Campus Lagoas-Marcosende, 36.310, Vigo, Galicia, Spain
| | - Javier Sanz-Valero
- Departmento de Salud Pública, Historia de la Ciencia y Ginecología, Universidad Miguel Hernandez, Campus Sant Joan, 03.550, Alicante, Spain
| |
Collapse
|
4
|
Hochheiser H, Castine M, Harris D, Savova G, Jacobson RS. An information model for computable cancer phenotypes. BMC Med Inform Decis Mak 2016; 16:121. [PMID: 27629872 PMCID: PMC5024416 DOI: 10.1186/s12911-016-0358-4] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2016] [Accepted: 09/01/2016] [Indexed: 12/27/2022] Open
Abstract
BACKGROUND Standards, methods, and tools supporting the integration of clinical data and genomic information are an area of significant need and rapid growth in biomedical informatics. Integration of cancer clinical data and cancer genomic information poses unique challenges, because of the high volume and complexity of clinical data, as well as the heterogeneity and instability of cancer genome data when compared with germline data. Current information models of clinical and genomic data are not sufficiently expressive to represent individual observations and to aggregate those observations into longitudinal summaries over the course of cancer care. These models are acutely needed to support the development of systems and tools for generating the so called clinical "deep phenotype" of individual cancer patients, a process which remains almost entirely manual in cancer research and precision medicine. METHODS Reviews of existing ontologies and interviews with cancer researchers were used to inform iterative development of a cancer phenotype information model. We translated a subset of the Fast Healthcare Interoperability Resources (FHIR) models into the OWL 2 Description Logic (DL) representation, and added extensions as needed for modeling cancer phenotypes with terms derived from the NCI Thesaurus. Models were validated with domain experts and evaluated against competency questions. RESULTS The DeepPhe Information model represents cancer phenotype data at increasing levels of abstraction from mention level in clinical documents to summaries of key events and findings. We describe the model using breast cancer as an example, depicting methods to represent phenotypic features of cancers, tumors, treatment regimens, and specific biologic behaviors that span the entire course of a patient's disease. CONCLUSIONS We present a multi-scale information model for representing individual document mentions, document level classifications, episodes along a disease course, and phenotype summarization, linking individual observations to high-level summaries in support of subsequent integration and analysis.
Collapse
Affiliation(s)
- Harry Hochheiser
- Department of Biomedical Informatics, University of Pittsburgh School of Medicine, 5607 Baum Boulevard, Rm 523, Pittsburgh, 15206-3701, PA, USA. .,Intelligent Systems Program, University of Pittsburgh, Pittsburgh, PA, USA.
| | - Melissa Castine
- Department of Biomedical Informatics, University of Pittsburgh School of Medicine, 5607 Baum Boulevard, Rm 523, Pittsburgh, 15206-3701, PA, USA
| | - David Harris
- Boston Children's Hospital and Harvard Medical School, Boston, MA, USA
| | - Guergana Savova
- Boston Children's Hospital and Harvard Medical School, Boston, MA, USA
| | - Rebecca S Jacobson
- Department of Biomedical Informatics, University of Pittsburgh School of Medicine, 5607 Baum Boulevard, Rm 523, Pittsburgh, 15206-3701, PA, USA.,Intelligent Systems Program, University of Pittsburgh, Pittsburgh, PA, USA.,University of Pittsburgh Cancer Institute, Pittsburgh, PA, USA
| |
Collapse
|
5
|
Oniki TA, Coyle JF, Parker CG, Huff SM. Lessons learned in detailed clinical modeling at Intermountain Healthcare. J Am Med Inform Assoc 2014; 21:1076-81. [PMID: 24993546 PMCID: PMC4215059 DOI: 10.1136/amiajnl-2014-002875] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2014] [Revised: 06/05/2014] [Accepted: 06/16/2014] [Indexed: 11/03/2022] Open
Abstract
BACKGROUND AND OBJECTIVE Intermountain Healthcare has a long history of using coded terminology and detailed clinical models (DCMs) to govern storage of clinical data to facilitate decision support and semantic interoperability. The latest iteration of DCMs at Intermountain is called the clinical element model (CEM). We describe the lessons learned from our CEM efforts with regard to subjective decisions a modeler frequently needs to make in creating a CEM. We present insights and guidelines, but also describe situations in which use cases conflict with the guidelines. We propose strategies that can help reconcile the conflicts. The hope is that these lessons will be helpful to others who are developing and maintaining DCMs in order to promote sharing and interoperability. METHODS We have used the Clinical Element Modeling Language (CEML) to author approximately 5000 CEMs. RESULTS Based on our experience, we have formulated guidelines to lead our modelers through the subjective decisions they need to make when authoring models. Reported here are guidelines regarding precoordination/postcoordination, dividing content between the model and the terminology, modeling logical attributes, and creating iso-semantic models. We place our lessons in context, exploring the potential benefits of an implementation layer, an iso-semantic modeling framework, and ontologic technologies. CONCLUSIONS We assert that detailed clinical models can advance interoperability and sharing, and that our guidelines, an implementation layer, and an iso-semantic framework will support our progress toward that goal.
Collapse
Affiliation(s)
- Thomas A Oniki
- Department of Medical Informatics, Intermountain Healthcare, Salt Lake City, Utah, USA
| | - Joseph F Coyle
- Department of Medical Informatics, Intermountain Healthcare, Salt Lake City, Utah, USA
| | - Craig G Parker
- Department of Medical Informatics, Intermountain Healthcare, Salt Lake City, Utah, USA
| | - Stanley M Huff
- Department of Medical Informatics, Intermountain Healthcare, Salt Lake City, Utah, USA
- Department of Biomedical Informatics, University of Utah, Salt Lake City, Utah, USA
| |
Collapse
|
6
|
Cimino JJ, Ayres EJ, Remennik L, Rath S, Freedman R, Beri A, Chen Y, Huser V. The National Institutes of Health's Biomedical Translational Research Information System (BTRIS): design, contents, functionality and experience to date. J Biomed Inform 2013; 52:11-27. [PMID: 24262893 DOI: 10.1016/j.jbi.2013.11.004] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2013] [Revised: 09/29/2013] [Accepted: 11/03/2013] [Indexed: 11/24/2022]
Abstract
The US National Institutes of Health (NIH) has developed the Biomedical Translational Research Information System (BTRIS) to support researchers' access to translational and clinical data. BTRIS includes a data repository, a set of programs for loading data from NIH electronic health records and research data management systems, an ontology for coding the disparate data with a single terminology, and a set of user interface tools that provide access to identified data from individual research studies and data across all studies from which individually identifiable data have been removed. This paper reports on unique design elements of the system, progress to date and user experience after five years of development and operation.
Collapse
Affiliation(s)
- James J Cimino
- Laboratory for Informatics Development, NIH Clinical Center, Bethesda, MD, United States.
| | - Elaine J Ayres
- Laboratory for Informatics Development, NIH Clinical Center, Bethesda, MD, United States
| | - Lyubov Remennik
- Laboratory for Informatics Development, NIH Clinical Center, Bethesda, MD, United States
| | - Sachi Rath
- Computer Sciences Corporation, Falls Church, VA, United States
| | - Robert Freedman
- Computer Sciences Corporation, Falls Church, VA, United States
| | - Andrea Beri
- Computer Sciences Corporation, Falls Church, VA, United States
| | - Yang Chen
- Computer Sciences Corporation, Falls Church, VA, United States
| | - Vojtech Huser
- Laboratory for Informatics Development, NIH Clinical Center, Bethesda, MD, United States
| |
Collapse
|
7
|
Huser V, Cimino JJ. Desiderata for healthcare integrated data repositories based on architectural comparison of three public repositories. AMIA ... ANNUAL SYMPOSIUM PROCEEDINGS. AMIA SYMPOSIUM 2013; 2013:648-656. [PMID: 24551366 PMCID: PMC3900207] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Integrated data repositories (IDRs) are indispensable tools for numerous biomedical research studies. We compare three large IDRs (Informatics for Integrating Biology and the Bedside (i2b2), HMO Research Network's Virtual Data Warehouse (VDW) and Observational Medical Outcomes Partnership (OMOP) repository) in order to identify common architectural features that enable efficient storage and organization of large amounts of clinical data. We define three high-level classes of underlying data storage models and we analyze each repository using this classification. We look at how a set of sample facts is represented in each repository and conclude with a list of desiderata for IDRs that deal with the information storage model, terminology model, data integration and value-sets management.
Collapse
Affiliation(s)
- Vojtech Huser
- Laboratory for Informatics Development, NIH Clinical Center, Bethesda, MD
| | - James J Cimino
- Laboratory for Informatics Development, NIH Clinical Center, Bethesda, MD
| |
Collapse
|
8
|
Yun JH, Ahn SJ, Kim Y. Development of clinical contents model markup language for electronic health records. Healthc Inform Res 2012; 18:171-7. [PMID: 23115739 PMCID: PMC3483474 DOI: 10.4258/hir.2012.18.3.171] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2012] [Revised: 08/17/2012] [Accepted: 09/12/2012] [Indexed: 11/23/2022] Open
Abstract
OBJECTIVES To develop dedicated markup language for clinical contents models (CCM) to facilitate the active use of CCM in electronic health record systems. METHODS Based on analysis of the structure and characteristics of CCM in the clinical domain, we designed extensible markup language (XML) based CCM markup language (CCML) schema manually. RESULTS CCML faithfully reflects CCM in both the syntactic and semantic aspects. As this language is based on XML, it can be expressed and processed in computer systems and can be used in a technology-neutral way. CONCLUSIONS CCML HAS THE FOLLOWING STRENGTHS: it is machine-readable and highly human-readable, it does not require a dedicated parser, and it can be applied for existing electronic health record systems.
Collapse
Affiliation(s)
- Ji-Hyun Yun
- R&D Center for Interoperable EHR, Seoul, Korea
| | | | | |
Collapse
|
9
|
Rea S, Pathak J, Savova G, Oniki TA, Westberg L, Beebe CE, Tao C, Parker CG, Haug PJ, Huff SM, Chute CG. Building a robust, scalable and standards-driven infrastructure for secondary use of EHR data: the SHARPn project. J Biomed Inform 2012; 45:763-71. [PMID: 22326800 DOI: 10.1016/j.jbi.2012.01.009] [Citation(s) in RCA: 122] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2011] [Revised: 01/23/2012] [Accepted: 01/25/2012] [Indexed: 02/08/2023]
Abstract
The Strategic Health IT Advanced Research Projects (SHARP) Program, established by the Office of the National Coordinator for Health Information Technology in 2010 supports research findings that remove barriers for increased adoption of health IT. The improvements envisioned by the SHARP Area 4 Consortium (SHARPn) will enable the use of the electronic health record (EHR) for secondary purposes, such as care process and outcomes improvement, biomedical research and epidemiologic monitoring of the nation's health. One of the primary informatics problem areas in this endeavor is the standardization of disparate health data from the nation's many health care organizations and providers. The SHARPn team is developing open source services and components to support the ubiquitous exchange, sharing and reuse or 'liquidity' of operational clinical data stored in electronic health records. One year into the design and development of the SHARPn framework, we demonstrated end to end data flow and a prototype SHARPn platform, using thousands of patient electronic records sourced from two large healthcare organizations: Mayo Clinic and Intermountain Healthcare. The platform was deployed to (1) receive source EHR data in several formats, (2) generate structured data from EHR narrative text, and (3) normalize the EHR data using common detailed clinical models and Consolidated Health Informatics standard terminologies, which were (4) accessed by a phenotyping service using normalized data specifications. The architecture of this prototype SHARPn platform is presented. The EHR data throughput demonstration showed success in normalizing native EHR data, both structured and narrative, from two independent organizations and EHR systems. Based on the demonstration, observed challenges for standardization of EHR data for interoperable secondary use are discussed.
Collapse
Affiliation(s)
- Susan Rea
- Homer Warner Center for Informatics Research, Intermountain Healthcare, Murray, UT 84107, USA.
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
10
|
Liu B, Zhou X, Wang Y, Hu J, He L, Zhang R, Chen S, Guo Y. Data processing and analysis in real-world traditional Chinese medicine clinical data: challenges and approaches. Stat Med 2011; 31:653-60. [PMID: 22161304 DOI: 10.1002/sim.4417] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2010] [Accepted: 08/30/2011] [Indexed: 11/07/2022]
Affiliation(s)
- Baoyan Liu
- China Academy of Chinese Medical Sciences, Beijing, 100700, China
| | | | | | | | | | | | | | | |
Collapse
|
11
|
Huser V, Rasmussen LV, Oberg R, Starren JB. Implementation of workflow engine technology to deliver basic clinical decision support functionality. BMC Med Res Methodol 2011; 11:43. [PMID: 21477364 PMCID: PMC3079703 DOI: 10.1186/1471-2288-11-43] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2010] [Accepted: 04/10/2011] [Indexed: 11/12/2022] Open
Abstract
Background Workflow engine technology represents a new class of software with the ability to graphically model step-based knowledge. We present application of this novel technology to the domain of clinical decision support. Successful implementation of decision support within an electronic health record (EHR) remains an unsolved research challenge. Previous research efforts were mostly based on healthcare-specific representation standards and execution engines and did not reach wide adoption. We focus on two challenges in decision support systems: the ability to test decision logic on retrospective data prior prospective deployment and the challenge of user-friendly representation of clinical logic. Results We present our implementation of a workflow engine technology that addresses the two above-described challenges in delivering clinical decision support. Our system is based on a cross-industry standard of XML (extensible markup language) process definition language (XPDL). The core components of the system are a workflow editor for modeling clinical scenarios and a workflow engine for execution of those scenarios. We demonstrate, with an open-source and publicly available workflow suite, that clinical decision support logic can be executed on retrospective data. The same flowchart-based representation can also function in a prospective mode where the system can be integrated with an EHR system and respond to real-time clinical events. We limit the scope of our implementation to decision support content generation (which can be EHR system vendor independent). We do not focus on supporting complex decision support content delivery mechanisms due to lack of standardization of EHR systems in this area. We present results of our evaluation of the flowchart-based graphical notation as well as architectural evaluation of our implementation using an established evaluation framework for clinical decision support architecture. Conclusions We describe an implementation of a free workflow technology software suite (available at http://code.google.com/p/healthflow) and its application in the domain of clinical decision support. Our implementation seamlessly supports clinical logic testing on retrospective data and offers a user-friendly knowledge representation paradigm. With the presented software implementation, we demonstrate that workflow engine technology can provide a decision support platform which evaluates well against an established clinical decision support architecture evaluation framework. Due to cross-industry usage of workflow engine technology, we can expect significant future functionality enhancements that will further improve the technology's capacity to serve as a clinical decision support platform.
Collapse
Affiliation(s)
- Vojtech Huser
- Biomedical Informatics Research Center, Marshfield Clinic, Marshfield, WI, USA.
| | | | | | | |
Collapse
|
12
|
Wilcox AB, Vawdrey DK, Chen YH, Forman B, Hripcsak G. The evolving use of a clinical data repository: facilitating data access within an electronic medical record. AMIA ... ANNUAL SYMPOSIUM PROCEEDINGS. AMIA SYMPOSIUM 2009; 2009:701-705. [PMID: 20351944 PMCID: PMC2815410] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
We demonstrate the integration of a longitudinal, internally-developed legacy clinical information system with a vendor-based electronic health record application. The expense of developing the interface across systems was minimal, and it was successfully incorporated within the vendor EHR. Users consistently used the legacy data view while using the EHR; usage reached up to 50% of accessed data. Data showing concurrent increases in the use of the legacy data view and adoption of the new EHR suggests the method may improve adoption of the new system.
Collapse
Affiliation(s)
- Adam B Wilcox
- Department of Biomedical Informatics, Columbia University, New York, NY, USA
| | | | | | | | | |
Collapse
|
13
|
Chen ES, Zhou L, Kashyap V, Schaeffer M, Dykes PC, Goldberg HS. Early experiences in evolving an enterprise-wide information model for laboratory and clinical observations. AMIA ... ANNUAL SYMPOSIUM PROCEEDINGS. AMIA SYMPOSIUM 2008; 2008:106-110. [PMID: 18999078 PMCID: PMC2656065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Received: 03/14/2008] [Revised: 07/15/2008] [Indexed: 05/27/2023]
Abstract
As Electronic Healthcare Records become more prevalent, there is an increasing need to ensure unambiguous data capture, interpretation, and exchange within and across heterogeneous applications. To address this need, a common, uniform, and comprehensive approach for representing clinical information is essential. At Partners HealthCare System, we are investigating the development and implementation of enterprise-wide information models to specify the representation of clinical information to support semantic interoperability. This paper summarizes our early experiences in: (1) defining a process for information model development, (2) reviewing and comparing existing healthcare information models, (3) identifying requirements for representation of laboratory and clinical observations, and (4) exploring linkages to existing terminology and data standards. These initial findings provide insight to the various challenges ahead and guidance on next steps for adoption of information models at our organization.
Collapse
Affiliation(s)
- Elizabeth S Chen
- Clinical Informatics Research & Development, Partners HealthCare System, Wellesley, MA, USA
| | | | | | | | | | | |
Collapse
|
14
|
Ceusters W, Smith B. Strategies for referent tracking in electronic health records. J Biomed Inform 2006; 39:362-78. [PMID: 16198639 DOI: 10.1016/j.jbi.2005.08.002] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2005] [Revised: 08/09/2005] [Accepted: 08/11/2005] [Indexed: 11/20/2022]
Abstract
The goal of referent tracking is to create an ever-growing pool of data relating to the entities existing in concrete spatiotemporal reality. In the context of Electronic Healthcare Records (EHRs) the relevant concrete entities are not only particular patients but also their parts, diseases, therapies, lesions, and so forth, insofar as these are salient to diagnosis and treatment. Within a referent tracking system, all such entities are referred to directly and explicitly, something which cannot be achieved when familiar concept-based systems are used in what is called "clinical coding." In this paper, we describe the components of a referent tracking system in an informal way and we outline the procedures that would have to be followed by healthcare personnel in using such a system. We argue that the referent tracking paradigm can be introduced with only minor--though nevertheless ontologically important--technical changes to existing EHR infrastructures, but that it will require a radically different mindset on the part of those involved in clinical coding and terminology development from that which has prevailed hitherto.
Collapse
Affiliation(s)
- Werner Ceusters
- European Centre for Ontological Research, Univerisität des Saarlandes, Postfach 151150, D-66041 Saarbrücken, Germany.
| | | |
Collapse
|
15
|
Chen ES, Hripcsak G, Friedman C. Disseminating natural language processed clinical narratives. AMIA ... ANNUAL SYMPOSIUM PROCEEDINGS. AMIA SYMPOSIUM 2006; 2006:126-30. [PMID: 17238316 PMCID: PMC1839529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Through Natural Language Processing (NLP) techniques, information can be extracted from clinical narratives for a variety of applications (e.g., patient management). While the complex and nested output of NLP systems can be expressed in standard formats, such as the eXtensible Markup Language (XML), these representations may not be directly suitable for certain end-users or applications. The availability of a âeuro tabular' format that simplifies the content and structure of NLP output may facilitate the dissemination and use by users who are more familiar with common spreadsheet, database, or statistical tools. In this paper, we describe the knowledge-based design of a tabular representation for NLP output and development of a transformation program for the structured output of MedLEE, an NLP system at our institution. Through an evaluation, we found that the simplified tabular format is comparable to existing more complex NLP formats in effectiveness for identifying clinical conditions in narrative reports.
Collapse
Affiliation(s)
- Elizabeth S Chen
- Department of Biomedical Informatics, Columbia University, New York, NY, USA
| | | | | |
Collapse
|
16
|
Meystre S, Haug PJ. Automation of a problem list using natural language processing. BMC Med Inform Decis Mak 2005; 5:30. [PMID: 16135244 PMCID: PMC1208893 DOI: 10.1186/1472-6947-5-30] [Citation(s) in RCA: 66] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2005] [Accepted: 08/31/2005] [Indexed: 11/10/2022] Open
Abstract
Background The medical problem list is an important part of the electronic medical record in development in our institution. To serve the functions it is designed for, the problem list has to be as accurate and timely as possible. However, the current problem list is usually incomplete and inaccurate, and is often totally unused. To alleviate this issue, we are building an environment where the problem list can be easily and effectively maintained. Methods For this project, 80 medical problems were selected for their frequency of use in our future clinical field of evaluation (cardiovascular). We have developed an Automated Problem List system composed of two main components: a background and a foreground application. The background application uses Natural Language Processing (NLP) to harvest potential problem list entries from the list of 80 targeted problems detected in the multiple free-text electronic documents available in our electronic medical record. These proposed medical problems drive the foreground application designed for management of the problem list. Within this application, the extracted problems are proposed to the physicians for addition to the official problem list. Results The set of 80 targeted medical problems selected for this project covered about 5% of all possible diagnoses coded in ICD-9-CM in our study population (cardiovascular adult inpatients), but about 64% of all instances of these coded diagnoses. The system contains algorithms to detect first document sections, then sentences within these sections, and finally potential problems within the sentences. The initial evaluation of the section and sentence detection algorithms demonstrated a sensitivity and positive predictive value of 100% when detecting sections, and a sensitivity of 89% and a positive predictive value of 94% when detecting sentences. Conclusion The global aim of our project is to automate the process of creating and maintaining a problem list for hospitalized patients and thereby help to guarantee the timeliness, accuracy and completeness of this information.
Collapse
Affiliation(s)
- Stephane Meystre
- Department of Medical Informatics, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Peter J Haug
- Department of Medical Informatics, University of Utah School of Medicine, Salt Lake City, Utah, USA
| |
Collapse
|
17
|
Meystre S, Haug PJ. Medical problem and document model for natural language understanding. AMIA ... ANNUAL SYMPOSIUM PROCEEDINGS. AMIA SYMPOSIUM 2003; 2003:455-9. [PMID: 14728214 PMCID: PMC1479970] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 04/28/2023]
Abstract
We are developing tools to help maintain a complete, accurate and timely problem list within a general purpose Electronic Medical Record system. As a part of this project, we have designed a system to automatically retrieve medical problems from free-text documents. Here we describe an information model based on XML (eXtensible Markup Language) and compliant with the CDA (Clinical Document Architecture). This model is used to ease the exchange of clinical data between the Natural Language Understanding application that retrieves potential problems from narrative document, and the problem list management application.
Collapse
Affiliation(s)
- Stephanie Meystre
- Department of Medical Informatics, University of Utah, Salt Lake City, Utah, USA
| | | |
Collapse
|
18
|
Brown SH, Lincoln M, Hardenbrook S, Petukhova ON, Rosenbloom ST, Carpenter P, Elkin P. Derivation and evaluation of a document-naming nomenclature. J Am Med Inform Assoc 2001; 8:379-90. [PMID: 11418545 PMCID: PMC130083 DOI: 10.1136/jamia.2001.0080379] [Citation(s) in RCA: 15] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
OBJECTIVE The Computerized Patient Record System is deployed at all 173 Veterans Affairs (VA) medical centers. Providers access clinical notes in the system from a note title menu. Following its implementation at the Nashville VA Medical Center, users expressed dissatisfaction with the time required find notes among hundreds of irregularly structured titles. The authors' objective was to develop a document-naming nomenclature (DNN) that creates informative, structured note titles that improve information access. DESIGN One thousand ninety-four unique note titles from two VA medical centers were reviewed. A note-naming nomenclature and compositional syntax were derived. Compositional order was determined by user preference survey. MEASUREMENTS The DNN was evaluated by modeling note titles from the Salt Lake City VA Medical Center (n=877), Vanderbilt University Medical Center (n=554), and the Mayo Clinic (n=42). A preliminary usability evaluation was conducted on a structured title display and sorting application. RESULTS Classes of note title components were found by inspection. Components describe characteristics of the author, the health care event, and the organizational unit providing care. Terms were taken from VA medical center information systems and national standards. The DNN model accurately described 97 to 99 percent of note titles from the test sites. The DNN term coverage varied, depending on component and site. Users found the DNN title format useful and the DNN-based title sorting and note review application easy to learn and quick to use. CONCLUSION The DNN accurately models note titles at five medical centers. Preliminary usability data indicate that DNN integration with title parsing and sorting software enhances information access.
Collapse
Affiliation(s)
- S H Brown
- Department of Veterans Affairs, Tennessee Valley Healthcare System, Nashville, Tennessee, USA.
| | | | | | | | | | | | | |
Collapse
|
19
|
Garshnek V, Burkle FM. Applications of telemedicine and telecommunications to disaster medicine: historical and future perspectives. J Am Med Inform Assoc 1999; 6:26-37. [PMID: 9925226 PMCID: PMC61342 DOI: 10.1136/jamia.1999.0060026] [Citation(s) in RCA: 69] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
Abstract
Disaster management utilizes diverse technologies to accomplish a complex set of tasks. Despite a decade of experience, few published reports have reviewed application of telemedicine (clinical care at a distance enabled by telecommunication) in disaster situations. Appropriate new telemedicine applications can improve future disaster medicine outcomes, based on lessons learned from a decade of civilian and military disaster (wide-area) telemedicine deployments. This manuscript reviews the history of telemedicine activities in actual disasters and similar scenarios as well as ongoing telemedicine innovations that may be applicable to disaster situations. Emergency care providers must begin to plan effectively to utilize disaster-specific telemedicine applications to improve future outcomes.
Collapse
Affiliation(s)
- V Garshnek
- Tripler Army Medical Center, Hawaii 96859-5000, USA.
| | | |
Collapse
|
20
|
Cimino JJ. Desiderata for controlled medical vocabularies in the twenty-first century. Methods Inf Med 1998; 37:394-403. [PMID: 9865037 PMCID: PMC3415631] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
Abstract
Builders of medical informatics applications need controlled medical vocabularies to support their applications and it is to their advantage to use available standards. In order to do so, however, these standards need to address the requirements of their intended users. Over the past decade, medical informatics researchers have begun to articulate some of these requirements. This paper brings together some of the common themes which have been described, including: vocabulary content, concept orientation, concept permanence, nonsemantic concept identifiers, polyhierarchy, formal definitions, rejection of "not elsewhere classified" terms, multiple granularities, multiple consistent views, context representation, graceful evolution, and recognized redundancy. Standards developers are beginning to recognize and address these desiderata and adapt their offerings to meet them.
Collapse
Affiliation(s)
- J J Cimino
- Department of Medical Informatics, Columbia University, New York, USA.
| |
Collapse
|
21
|
Huff SM, Rocha RA, McDonald CJ, De Moor GJ, Fiers T, Bidgood WD, Forrey AW, Francis WG, Tracy WR, Leavelle D, Stalling F, Griffin B, Maloney P, Leland D, Charles L, Hutchins K, Baenziger J. Development of the Logical Observation Identifier Names and Codes (LOINC) vocabulary. J Am Med Inform Assoc 1998; 5:276-92. [PMID: 9609498 PMCID: PMC61302 DOI: 10.1136/jamia.1998.0050276] [Citation(s) in RCA: 138] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/1997] [Accepted: 01/07/1998] [Indexed: 11/04/2022] Open
Abstract
The LOINC (Logical Observation Identifier Names and Codes) vocabulary is a set of more than 10,000 names and codes developed for use as observation identifiers in standardized messages exchanged between clinical computer systems. The goal of the study was to create universal names and codes for clinical observations that could be used by all clinical information systems. The LOINC names are structured to facilitate rapid matching, either automated or manual, between local vocabularies and the universal LOINC codes. If LOINC codes are used in clinical messages, each system participating in data exchange needs to match its local vocabulary to the standard vocabulary only once. This will reduce both the time and cost of implementing standardized interfaces. The history of the development of the LOINC vocabulary and the methodology used in its creation are described.
Collapse
Affiliation(s)
- S M Huff
- Intermountain Health Care, Salt Lake City, Utah 84111, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
22
|
Eagon JC, Ortiz E, Zollo KA, Hurdle J, Lincoln MJ. Department of Veterans Affairs, University of Utah consortium participation in the NLM/AHCPR Large Scale Vocabulary Test. PROCEEDINGS : A CONFERENCE OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION. AMIA FALL SYMPOSIUM 1997:565-9. [PMID: 9357689 PMCID: PMC2233573] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
The Large Scale Vocabulary Test (LSVT) was designed to evaluate how well the Metathesaurus plus planned additions to Meta covered the documentation needs of clinicians. Our consortium collected 10,538 clinical narratives from patient problem lists recorded at 65 Veterans Hospitals, internal medicine ambulatory care practices, diagnostic history and physical examination data elements from Iliad, and nursing shift notes and emergency transport patient records. The results showed 94% of submitted terms resulted in acceptable matches. 49% of submitted terms were judged to be synonymous with the match terms, 35% were judged to be more specific (usually due to modifiers), 2%, were less specific, and 6% had an associative relationship. In 8% of cases either no match was found by the LSVT interface or all proposed matches were rejected by the raters. The LSVT content was quite suitable for coding our narratives. Necessary improvements for an electronic record would include the ability to compose modifiers together with root concepts.
Collapse
Affiliation(s)
- J C Eagon
- Department of Medical Informatics, Veterans Affairs IRMFO, VA Medical Center, Salt Lake City, Utah, USA
| | | | | | | | | |
Collapse
|
23
|
Aghili H, Mushlin RA, Williams RM, Rose JS. Progress notes model. PROCEEDINGS : A CONFERENCE OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION. AMIA FALL SYMPOSIUM 1997:12-6. [PMID: 9357579 PMCID: PMC2233487] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
The largest part of the medical record today consists of notes documenting the care delivered to patients and the clinical events relevant to diagnosis and treatment. These "progress notes" serve as the repository of medical facts and clinical thinking, and are intended as a concise vehicle of communication about a patient's condition to those who access the health record. They should be readable, easily understood, complete, accurate, and concise. They must also be flexible enough to logically convey to others what happened during an encounter, e.g., the chain of events during the visit, as well as guaranteeing full accountability for documented material, e.g., who recorded the information and when it was recorded. This paper describes a model for progress notes, which addresses the above needs, and outlines the rationale and principles which led to that model.
Collapse
Affiliation(s)
- H Aghili
- Health Care Solutions Project, IBM T.J. Watson Research Center, Hawthorne, NY 10532, USA
| | | | | | | |
Collapse
|
24
|
Rothwell DJ, Côté RA. Managing information with SNOMED: understanding the model. PROCEEDINGS : A CONFERENCE OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION. AMIA FALL SYMPOSIUM 1996:80-3. [PMID: 8947632 PMCID: PMC2233164] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
SNOMED is an inventory of medical terms and concepts. Each concept has a unique representation, it's primary termcode. The primary termcode carries hierarchical and inheritable information about each concept it represents. Additional hierarchical and inheritable information is carried by cross references linked to each concept. The cross references provide the defining characteristics for each concept thereby creating a computer readable definition for each SNOMED entry. These are some of the attributes that define the SNOMED model.
Collapse
Affiliation(s)
- D J Rothwell
- Medical College of Wisconsin, Brookfield 53005, USA
| | | |
Collapse
|
25
|
Hripcsak G, Allen B, Cimino JJ, Lee R. Access to data: comparing AccessMed with Query by Review. J Am Med Inform Assoc 1996; 3:288-99. [PMID: 8816352 PMCID: PMC116312 DOI: 10.1136/jamia.1996.96413137] [Citation(s) in RCA: 17] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023] Open
Abstract
OBJECTIVE To evaluate the performance of tools for authoring patient database queries. DESIGN Query by Review, a tool that exploits the training that users have undergone to master a result review system, was compared with AccessMed, a vocabulary browser that supports lexical matching and the traversal of hierarchical and semantic links. Seven subjects (Medical Logic Module authors) were asked to use both tools to gather the vocabulary terms necessary to perform each of eight laboratory queries. MEASUREMENTS The proportion of queries that were correct; intersubject agreement. RESULTS Query by Review had better performance than AccessMed (38% correct queries versus 18%, p = 0.002), but both figures were low. Poor intersubject agreement (28% for Query by Review and 21% for AccessMed) corroborated the relatively low performance. Subjects appeared to have trouble distinguishing laboratory tests from laboratory batteries, picking terms relevant to the particular data type required, and using classes in the vocabulary's hierarchy. CONCLUSION Query by Review, with its more constrained user interface, performed somewhat better than AccessMed, a more general tool. Neither tool achieved adequate performance, however, which points to the difficulty of formulating a query for a clinical database and the need for further work.
Collapse
Affiliation(s)
- G Hripcsak
- Department of Medical Informatics, Columbia-Presbyterian Medical Center, New York, NY, USA.
| | | | | | | |
Collapse
|
26
|
Kohane IS, Greenspun P, Fackler J, Cimino C, Szolovits P. Building national electronic medical record systems via the World Wide Web. J Am Med Inform Assoc 1996; 3:191-207. [PMID: 8723610 PMCID: PMC116301 DOI: 10.1136/jamia.1996.96310633] [Citation(s) in RCA: 63] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023] Open
Abstract
Electronic medical record systems (EMRSs) currently do not lend themselves easily to cross-institutional clinical care and research. Unique system designs coupled with a lack of standards have led to this difficulty. The authors have designed a preliminary EMRS architecture (W3-EMRS) that exploits the multiplatform, multiprotocol, client-server technology of the World Wide Web. The architecture abstracts the clinical information model and the visual presentation away from the underlying EMRS. As a result, computation upon data elements of the EMRS and their presentation are no longer tied to the underlying EMRS structures. The architecture is intended to enable implementation of programs that provide uniform access to multiple, heterogeneous legacy EMRSs. The authors have implemented an initial prototype of W3-EMRS that accesses the database of the Boston Children's Hospital Clinician's Workstation.
Collapse
Affiliation(s)
- I S Kohane
- Children's Hospital, Boston, MA 02115, USA.
| | | | | | | | | |
Collapse
|
27
|
Warner HR, Guo D, Mason C, Livingston J, Bray BE. Enroute toward a computer based patient record: the ACIS project. PROCEEDINGS. SYMPOSIUM ON COMPUTER APPLICATIONS IN MEDICAL CARE 1995:152-156. [PMID: 8563256 PMCID: PMC2579074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
The clinical arm of the University of Utah operates a 400 bed general hospital and 30 specialty and subspecialty clinics and with the advent of managed care will soon be linked to a much wider network of health care facilities throughout the state. Each of these patient care facilities maintains its own patient record. To provide common access to data on any patient needed to provide continuity to the care process where ever it occurs, the institution has embarked on the development of a completely electronic patient record. In this paper we will describe the route we have taken to achieve this goal in hopes of providing some sign posts along the way for others seeking the same destination.
Collapse
|
28
|
Kuperman GJ, Teich JM, Bates DW, McLatchey J, Hoff TG. Representing hospital events as complex conditionals. PROCEEDINGS. SYMPOSIUM ON COMPUTER APPLICATIONS IN MEDICAL CARE 1995:137-41. [PMID: 8563253 PMCID: PMC2579071] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
Abstract
We have developed an approach to medical knowledge representation whereby simple medical concepts are combined to yield complex statements of testable medical logic. The logic is created from a small number of generic medical concepts that are instantiated and combined to create the rules. Rule writing is done through a rule editor and requires knowledge of the system's data dictionaries, though no programming is required. We have used the approach to create a large knowledge base including panic lab alerting rules, drug-laboratory interaction alerting rules, an adverse drug event monitor, and a drug-age interaction detection program. The rules have been used as part of an alerting system and for data collection to determine the frequency of events of interest. The scheme is extensible and yields a readable form of the created knowledge. The scheme holds great promise as a durable form of medical knowledge representation.
Collapse
Affiliation(s)
- G J Kuperman
- Center for Applied Medical Information Systems Research, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | | | | | | | | |
Collapse
|