4
|
Wendelboe A, Saber I, Dvorak J, Adamski A, Feland N, Reyes N, Abe K, Ortel T, Raskob G. Exploring the Applicability of Using Natural Language Processing to Support Nationwide Venous Thromboembolism Surveillance: Model Evaluation Study. JMIR Bioinform Biotech 2022; 3:10.2196/36877. [PMID: 37206160 PMCID: PMC10193259 DOI: 10.2196/36877] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 05/21/2023]
Abstract
Background Venous thromboembolism (VTE) is a preventable, common vascular disease that has been estimated to affect up to 900,000 people per year. It has been associated with risk factors such as recent surgery, cancer, and hospitalization. VTE surveillance for patient management and safety can be improved via natural language processing (NLP). NLP tools have the ability to access electronic medical records, identify patients that meet the VTE case definition, and subsequently enter the relevant information into a database for hospital review. Objective We aimed to evaluate the performance of a VTE identification model of IDEAL-X (Information and Data Extraction Using Adaptive Learning; Emory University)-an NLP tool-in automatically classifying cases of VTE by "reading" unstructured text from diagnostic imaging records collected from 2012 to 2014. Methods After accessing imaging records from pilot surveillance systems for VTE from Duke University and the University of Oklahoma Health Sciences Center (OUHSC), we used a VTE identification model of IDEAL-X to classify cases of VTE that had previously been manually classified. Experts reviewed the technicians' comments in each record to determine if a VTE event occurred. The performance measures calculated (with 95% CIs) were accuracy, sensitivity, specificity, and positive and negative predictive values. Chi-square tests of homogeneity were conducted to evaluate differences in performance measures by site, using a significance level of .05. Results The VTE model of IDEAL-X "read" 1591 records from Duke University and 1487 records from the OUHSC, for a total of 3078 records. The combined performance measures were 93.7% accuracy (95% CI 93.7%-93.8%), 96.3% sensitivity (95% CI 96.2%-96.4%), 92% specificity (95% CI 91.9%-92%), an 89.1% positive predictive value (95% CI 89%-89.2%), and a 97.3% negative predictive value (95% CI 97.3%-97.4%). The sensitivity was higher at Duke University (97.9%, 95% CI 97.8%-98%) than at the OUHSC (93.3%, 95% CI 93.1%-93.4%; P<.001), but the specificity was higher at the OUHSC (95.9%, 95% CI 95.8%-96%) than at Duke University (86.5%, 95% CI 86.4%-86.7%; P<.001). Conclusions The VTE model of IDEAL-X accurately classified cases of VTE from the pilot surveillance systems of two separate health systems in Durham, North Carolina, and Oklahoma City, Oklahoma. NLP is a promising tool for the design and implementation of an automated, cost-effective national surveillance system for VTE. Conducting public health surveillance at a national scale is important for measuring disease burden and the impact of prevention measures. We recommend additional studies to identify how integrating IDEAL-X in a medical record system could further automate the surveillance process.
Collapse
Affiliation(s)
- Aaron Wendelboe
- Department of Biostatistics and Epidemiology, Hudson College of Public Health, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Ibrahim Saber
- Division of Hematology, Department of Medicine, Duke University, Durham, NC, United States
| | - Justin Dvorak
- Department of Biostatistics and Epidemiology, Hudson College of Public Health, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Alys Adamski
- Division of Blood Disorders, National Center on Birth Defects and Developmental Disabilities, Centers for Disease Control and Prevention, Atlanta, GA, United States
| | - Natalie Feland
- Department of Biostatistics and Epidemiology, Hudson College of Public Health, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| | - Nimia Reyes
- Division of Blood Disorders, National Center on Birth Defects and Developmental Disabilities, Centers for Disease Control and Prevention, Atlanta, GA, United States
| | - Karon Abe
- Division of Blood Disorders, National Center on Birth Defects and Developmental Disabilities, Centers for Disease Control and Prevention, Atlanta, GA, United States
| | - Thomas Ortel
- Division of Hematology, Department of Medicine, Duke University, Durham, NC, United States
| | - Gary Raskob
- Department of Biostatistics and Epidemiology, Hudson College of Public Health, University of Oklahoma Health Sciences Center, Oklahoma City, OK, United States
| |
Collapse
|
12
|
Raskob GE, Angchaisuksiri P, Blanco AN, Buller H, Gallus A, Hunt BJ, Hylek EM, Kakkar A, Konstantinides SV, McCumber M, Ozaki Y, Wendelboe A, Weitz JI. Thrombosis: a major contributor to global disease burden. Arterioscler Thromb Vasc Biol 2015; 34:2363-71. [PMID: 25304324 DOI: 10.1161/atvbaha.114.304488] [Citation(s) in RCA: 541] [Impact Index Per Article: 60.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
Abstract
BACKGROUND Thrombosis is the common pathology underlying ischemic heart disease, ischemic stroke, and venous thromboembolism (VTE). The Global Burden of Disease Study 2010 (GBD 2010) documented that ischemic heart disease and stroke collectively caused 1 in 4 deaths worldwide. GBD 2010 did not report data for VTE as a cause of death and disability. OBJECTIVE To review the literature on the global burden of disease caused by VTE. APPROACH AND RESULTS We performed a systematic review of the literature on the global disease burden because of VTE in low-, middle-, and high-income countries. Studies from Western Europe, North America, Australia, and Southern Latin America (Argentina) yielded consistent results with annual incidences ranging from 0.75 to 2.69 per 1000 individuals in the population. The incidence increased to between 2 and 7 per 1000 among those aged ≥70 years. Although the incidence is lower in individuals of Chinese and Korean ethnicity, their disease burden is not low because of population aging. VTE associated with hospitalization was the leading cause of disability-adjusted life-years lost in low- and middle-income countries, and second in high-income countries, responsible for more disability-adjusted life-years lost than nosocomial pneumonia, catheter-related blood stream infections, and adverse drug events. CONCLUSIONS VTE causes a major burden of disease across low-, middle-, and high-income countries. More detailed data on the global burden of VTE should be obtained to inform policy and resource allocation in health systems and to evaluate whether improved use of preventive measures will reduce the burden.
Collapse
Affiliation(s)
- G E Raskob
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.).
| | - P Angchaisuksiri
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - A N Blanco
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - H Buller
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - A Gallus
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - B J Hunt
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - E M Hylek
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - A Kakkar
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - S V Konstantinides
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - M McCumber
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - Y Ozaki
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - A Wendelboe
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | - J I Weitz
- From the College of Public Health, University of Oklahoma Health Sciences Center (G.E.R., M.M., A.W.); Faculty of Medicine, Ramathibodi Hospital, Mahidol University, Bangkok, Thailand (P.A.); División Hemostasia, Academia Nacional de Medicina, Buenos Aires, Argentina (A.N.B.); Department of Vascular Medicine, Academic Medical Center, Amsterdam, The Netherlands (H.B.); SA Pathology-Department of Hematology, Flinders Medical Center, Adelaide, South Australia, Australia (A.G.); Thrombosis and Thrombophilia Centre, Guy's & St Thomas' NHS Foundation Trust, London, United Kingdom (B.J.H.); Boston University School of Medicine, MA (E.M.H.); Thrombosis Research Institute, London, United Kingdom (A.K.); Center for Thrombosis and Hemostasis, Johannes Gutenberg University, Mainz, Germany (S.V.K.); Department of Laboratory Medicine, University of Yamanashi, Tamaho, Yamanashi, Japan (Y.O.); and McMaster University and Thrombosis and Atherosclerosis Research Institute, Hamilton, Ontario, Canada (J.I.W.)
| | | |
Collapse
|