1
|
Monson ET, Colbert SMC, Andreassen OA, Ayinde OO, Bejan CA, Ceja Z, Coon H, DiBlasi E, Izotova A, Kaufman EA, Koromina M, Myung W, Nurnberger JI, Serretti A, Smoller JW, Stein MB, Zai CC, Aslan M, Barr PB, Bigdeli TB, Harvey PD, Kimbrel NA, Patel PR, Ruderfer D, Docherty AR, Mullins N, Mann JJ. Defining Suicidal Thought and Behavior Phenotypes for Genetic Studies. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2024:2024.07.27.24311110. [PMID: 39132474 PMCID: PMC11312669 DOI: 10.1101/2024.07.27.24311110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 08/13/2024]
Abstract
Background Standardized definitions of suicidality phenotypes, including suicidal ideation (SI), attempt (SA), and death (SD) are a critical step towards improving understanding and comparison of results in suicide research. The complexity of suicidality contributes to heterogeneity in phenotype definitions, impeding evaluation of clinical and genetic risk factors across studies and efforts to combine samples within consortia. Here, we present expert and data-supported recommendations for defining suicidality and control phenotypes to facilitate merging current/legacy samples with definition variability and aid future sample creation. Methods A subgroup of clinician researchers and experts from the Suicide Workgroup of the Psychiatric Genomics Consortium (PGC) reviewed existing PGC definitions for SI, SA, SD, and control groups and generated preliminary consensus guidelines for instrument-derived and international classification of disease (ICD) data. ICD lists were validated in two independent datasets (N = 9,151 and 12,394). Results Recommendations are provided for evaluated instruments for SA and SI, emphasizing selection of lifetime measures phenotype-specific wording. Recommendations are also provided for defining SI and SD from ICD data. As the SA ICD definition is complex, SA code list recommendations were validated against instrument results with sensitivity (range = 15.4% to 80.6%), specificity (range = 67.6% to 97.4%), and positive predictive values (range = 0.59-0.93) reported. Conclusions Best-practice guidelines are presented for the use of existing information to define SI/SA/SD in consortia research. These proposed definitions are expected to facilitate more homogeneous data aggregation for genetic and multisite studies. Future research should involve refinement, improved generalizability, and validation in diverse populations.
Collapse
Affiliation(s)
- Eric T Monson
- Department of Psychiatry, University of Utah Spencer Fox Eccles School of Medicine
- Huntsman Mental Health Institute
| | - Sarah M C Colbert
- Department of Psychiatry, Icahn School of Medicine at Mount Sinai
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai
- Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai
| | - Ole A Andreassen
- Division of Mental Health and Addiction, Oslo University Hospital
- NORMENT Centre, University of Oslo
| | | | - Cosmin A Bejan
- Department of Biomedical Informatics, Vanderbilt University Medical Center
| | - Zuriel Ceja
- Mental Health and Neuroscience Program, QIMR Berghofer Medical Research Institute
- School of Biomedical Sciences, Faculty of Medicine, The University of Queensland
| | - Hilary Coon
- Department of Psychiatry, University of Utah Spencer Fox Eccles School of Medicine
- Huntsman Mental Health Institute
| | - Emily DiBlasi
- Department of Psychiatry, University of Utah Spencer Fox Eccles School of Medicine
- Huntsman Mental Health Institute
| | - Anastasia Izotova
- Nic Waals Institute, Lovisenberg Diaconal Hospital
- PsychGen Centre for Genetic Epidemiology and Mental Health, Norwegian Institute of Public Health
- Department of Psychology, University of Oslo
| | - Erin A Kaufman
- Department of Psychiatry, University of Utah Spencer Fox Eccles School of Medicine
- Huntsman Mental Health Institute
| | - Maria Koromina
- Department of Psychiatry, Icahn School of Medicine at Mount Sinai
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai
- Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai
| | - Woojae Myung
- Department of Neuropsychiatry, Seoul National University Bundang Hospital
- Department of Psychiatry, Seoul National University College of Medicine
| | - John I Nurnberger
- Department of Psychiatry, Indiana University School of Medicine
- Department of Medical & Molecular Genetics, Indiana University
| | | | - Jordan W Smoller
- Center for Precision Psychiatry, Department of Psychiatry, Massachusetts General Hospital
- Stanley Center for Psychiatric Research, Broad Institute
- Psychiatric and Neurodevelopmental Genetics Unit (PNGU), Massachusetts General Hospital
| | - Murray B Stein
- Department of Psychiatry and School of Public Health, University of California San Diego
| | - Clement C Zai
- Stanley Center for Psychiatric Research, Broad Institute
- Department of Psychiatry, University of Toronto
- Institute of Medical Science, University of Toronto
- Molecular Brain Science, Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health
- Laboratory Medicine and Pathobiology, University of Toronto
| | - Mihaela Aslan
- Cooperative Studies Program Clinical Epidemiology Research Center (CSP-CERC), VA Connecticut Healthcare System
- Department of Internal Medicine, Yale University School of Medicine
| | - Peter B Barr
- Department of Psychiatry and Behavioral Sciences, SUNY Downstate Health Sciences University
- VA New York Harbor Healthcare System
- Institute for Genomics in Health, SUNY Downstate Health Sciences University
- Department of Epidemiology and Biostatistics, School of Public Health, SUNY Downstate Health Sciences University
| | - Tim B Bigdeli
- Department of Psychiatry and Behavioral Sciences, SUNY Downstate Health Sciences University
- VA New York Harbor Healthcare System
- Institute for Genomics in Health, SUNY Downstate Health Sciences University
- Department of Epidemiology and Biostatistics, School of Public Health, SUNY Downstate Health Sciences University
| | - Philip D Harvey
- Bruce W. Carter Miami Veterans Affairs (VA) Medical Center
- University of Miami School of Medicine
| | - Nathan A Kimbrel
- Durham VA Health Care System
- VA Health Services Research and Development Center of Innovation to Accelerate Discovery and Practice Transformation
- VISN 6 Mid-Atlantic Mental Illness Research, Education, and Clinical Center
- Department of Psychiatry and Behavioral Sciences, Duke University School of Medicine
| | - Pujan R Patel
- Durham VA Health Care System
- VA Health Services Research and Development Center of Innovation to Accelerate Discovery and Practice Transformation
| | - Douglas Ruderfer
- Department of Biomedical Informatics, Vanderbilt University Medical Center
- Vanderbilt Genetics Institute, Department of Medicine, Division of Genetic Medicine, Vanderbilt University Medical Center
- Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center
| | - Anna R Docherty
- Department of Psychiatry, University of Utah Spencer Fox Eccles School of Medicine
- Huntsman Mental Health Institute
- Clinical and Translational Science Institute & the Center for Genomic Medicine, University of Utah
| | - Niamh Mullins
- Department of Psychiatry, Icahn School of Medicine at Mount Sinai
- Department of Genetics and Genomic Sciences, Icahn School of Medicine at Mount Sinai
- Charles Bronfman Institute for Personalized Medicine, Icahn School of Medicine at Mount Sinai
| | - J John Mann
- Departments of Psychiatry and Radiology, Columbia University
| |
Collapse
|
2
|
Hornstein S, Scharfenberger J, Lueken U, Wundrack R, Hilbert K. Predicting recurrent chat contact in a psychological intervention for the youth using natural language processing. NPJ Digit Med 2024; 7:132. [PMID: 38762694 PMCID: PMC11102489 DOI: 10.1038/s41746-024-01121-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Accepted: 04/23/2024] [Indexed: 05/20/2024] Open
Abstract
Chat-based counseling hotlines emerged as a promising low-threshold intervention for youth mental health. However, despite the resulting availability of large text corpora, little work has investigated Natural Language Processing (NLP) applications within this setting. Therefore, this preregistered approach (OSF: XA4PN) utilizes a sample of approximately 19,000 children and young adults that received a chat consultation from a 24/7 crisis service in Germany. Around 800,000 messages were used to predict whether chatters would contact the service again, as this would allow the provision of or redirection to additional treatment. We trained an XGBoost Classifier on the words of the anonymized conversations, using repeated cross-validation and bayesian optimization for hyperparameter search. The best model was able to achieve an AUROC score of 0.68 (p < 0.01) on the previously unseen 3942 newest consultations. A shapely-based explainability approach revealed that words indicating younger age or female gender and terms related to self-harm and suicidal thoughts were associated with a higher chance of recontacting. We conclude that NLP-based predictions of recurrent contact are a promising path toward personalized care at chat hotlines.
Collapse
Affiliation(s)
- Silvan Hornstein
- Department of Psychology, Humboldt-Universität zu Berlin, 10099 Berlin, Germany.
| | | | - Ulrike Lueken
- Department of Psychology, Humboldt-Universität zu Berlin, 10099 Berlin, Germany
- German Center for Mental Health (DZPG), partner site Berlin/Potsdam, Potsdam, Germany
| | - Richard Wundrack
- Department of Psychology, Humboldt-Universität zu Berlin, 10099 Berlin, Germany
| | - Kevin Hilbert
- Department of Psychology, Humboldt-Universität zu Berlin, 10099 Berlin, Germany
| |
Collapse
|
3
|
Hirani R, Noruzi K, Khuram H, Hussaini AS, Aifuwa EI, Ely KE, Lewis JM, Gabr AE, Smiley A, Tiwari RK, Etienne M. Artificial Intelligence and Healthcare: A Journey through History, Present Innovations, and Future Possibilities. Life (Basel) 2024; 14:557. [PMID: 38792579 PMCID: PMC11122160 DOI: 10.3390/life14050557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Revised: 04/22/2024] [Accepted: 04/24/2024] [Indexed: 05/26/2024] Open
Abstract
Artificial intelligence (AI) has emerged as a powerful tool in healthcare significantly impacting practices from diagnostics to treatment delivery and patient management. This article examines the progress of AI in healthcare, starting from the field's inception in the 1960s to present-day innovative applications in areas such as precision medicine, robotic surgery, and drug development. In addition, the impact of the COVID-19 pandemic on the acceleration of the use of AI in technologies such as telemedicine and chatbots to enhance accessibility and improve medical education is also explored. Looking forward, the paper speculates on the promising future of AI in healthcare while critically addressing the ethical and societal considerations that accompany the integration of AI technologies. Furthermore, the potential to mitigate health disparities and the ethical implications surrounding data usage and patient privacy are discussed, emphasizing the need for evolving guidelines to govern AI's application in healthcare.
Collapse
Affiliation(s)
- Rahim Hirani
- School of Medicine, New York Medical College, 40 Sunshine Cottage Road, Valhalla, NY 10595, USA; (R.H.)
- Graduate School of Biomedical Sciences, New York Medical College, Valhalla, NY 10595, USA
| | - Kaleb Noruzi
- School of Medicine, New York Medical College, 40 Sunshine Cottage Road, Valhalla, NY 10595, USA; (R.H.)
| | - Hassan Khuram
- College of Medicine, Drexel University, Philadelphia, PA 19129, USA
| | - Anum S. Hussaini
- Department of Global Health and Population, Harvard T.H. Chan School of Public Health, Boston, MA 02115, USA
| | - Esewi Iyobosa Aifuwa
- School of Medicine, New York Medical College, 40 Sunshine Cottage Road, Valhalla, NY 10595, USA; (R.H.)
| | - Kencie E. Ely
- Kirk Kerkorian School of Medicine, University of Nevada Las Vegas, Las Vegas, NV 89106, USA
| | - Joshua M. Lewis
- School of Medicine, New York Medical College, 40 Sunshine Cottage Road, Valhalla, NY 10595, USA; (R.H.)
| | - Ahmed E. Gabr
- School of Medicine, New York Medical College, 40 Sunshine Cottage Road, Valhalla, NY 10595, USA; (R.H.)
| | - Abbas Smiley
- School of Medicine and Dentistry, University of Rochester, Rochester, NY 14642, USA
| | - Raj K. Tiwari
- School of Medicine, New York Medical College, 40 Sunshine Cottage Road, Valhalla, NY 10595, USA; (R.H.)
- Graduate School of Biomedical Sciences, New York Medical College, Valhalla, NY 10595, USA
| | - Mill Etienne
- School of Medicine, New York Medical College, 40 Sunshine Cottage Road, Valhalla, NY 10595, USA; (R.H.)
- Department of Neurology, New York Medical College, Valhalla, NY 10595, USA
| |
Collapse
|
4
|
Eyre H, Alba PR, Gibson CJ, Gatsby E, Lynch KE, Patterson OV, DuVall SL. Bridging information gaps in menopause status classification through natural language processing. JAMIA Open 2024; 7:ooae013. [PMID: 38419670 PMCID: PMC10901606 DOI: 10.1093/jamiaopen/ooae013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 01/22/2024] [Accepted: 02/06/2024] [Indexed: 03/02/2024] Open
Abstract
Objective To use natural language processing (NLP) of clinical notes to augment existing structured electronic health record (EHR) data for classification of a patient's menopausal status. Materials and methods A rule-based NLP system was designed to capture evidence of a patient's menopause status including dates of a patient's last menstrual period, reproductive surgeries, and postmenopause diagnosis as well as their use of birth control and menstrual interruptions. NLP-derived output was used in combination with structured EHR data to classify a patient's menopausal status. NLP processing and patient classification were performed on a cohort of 307 512 female Veterans receiving healthcare at the US Department of Veterans Affairs (VA). Results NLP was validated at 99.6% precision. Including the NLP-derived data into a menopause phenotype increased the number of patients with data relevant to their menopausal status by 118%. Using structured codes alone, 81 173 (27.0%) are able to be classified as postmenopausal or premenopausal. However, with the inclusion of NLP, this number increased 167 804 (54.6%) patients. The premenopausal category grew by 532.7% with the inclusion of NLP data. Discussion By employing NLP, it became possible to identify documented data elements that predate VA care, originate outside VA networks, or have no corresponding structured field in the VA EHR that would be otherwise inaccessible for further analysis. Conclusion NLP can be used to identify concepts relevant to a patient's menopausal status in clinical notes. Adding NLP-derived data to an algorithm classifying a patient's menopausal status significantly increases the number of patients classified using EHR data, ultimately enabling more detailed assessments of the impact of menopause on health outcomes.
Collapse
Affiliation(s)
- Hannah Eyre
- VA Informatics and Computing Infrastructure, VA Salt Lake City Health Care System, Salt Lake City, UT 84113, United States
- Department of Internal Medicine, School of Medicine, University of Utah, Salt Lake City, UT 84112, United States
| | - Patrick R Alba
- VA Informatics and Computing Infrastructure, VA Salt Lake City Health Care System, Salt Lake City, UT 84113, United States
- Department of Internal Medicine, School of Medicine, University of Utah, Salt Lake City, UT 84112, United States
| | - Carolyn J Gibson
- San Francisco VA Healthcare System, San Francisco, CA 94121, United States
- University of California, San Francisco, San Francisco, CA 94115, United States
| | - Elise Gatsby
- VA Informatics and Computing Infrastructure, VA Salt Lake City Health Care System, Salt Lake City, UT 84113, United States
| | - Kristine E Lynch
- VA Informatics and Computing Infrastructure, VA Salt Lake City Health Care System, Salt Lake City, UT 84113, United States
- Department of Internal Medicine, School of Medicine, University of Utah, Salt Lake City, UT 84112, United States
| | - Olga V Patterson
- VA Informatics and Computing Infrastructure, VA Salt Lake City Health Care System, Salt Lake City, UT 84113, United States
- Department of Internal Medicine, School of Medicine, University of Utah, Salt Lake City, UT 84112, United States
| | - Scott L DuVall
- VA Informatics and Computing Infrastructure, VA Salt Lake City Health Care System, Salt Lake City, UT 84113, United States
- Department of Internal Medicine, School of Medicine, University of Utah, Salt Lake City, UT 84112, United States
| |
Collapse
|
5
|
McDaniel CC, Lo-Ciganic WH, Chou C. Diabetes-related complications, glycemic levels, and healthcare utilization outcomes after therapeutic inertia in type 2 diabetes mellitus. Prim Care Diabetes 2024; 18:188-195. [PMID: 38185576 DOI: 10.1016/j.pcd.2023.12.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 12/21/2023] [Accepted: 12/22/2023] [Indexed: 01/09/2024]
Abstract
AIMS To assess diabetes-related complications, glycemic levels, and healthcare utilization 12 months after exposure to therapeutic inertia among patients with type 2 diabetes mellitus (T2D). METHODS This retrospective cohort study analyzed data from the OneFlorida Clinical Research Consortium (electronic health records from Florida practices/clinics). The cohort included adult patients (≥18 years old) with T2D who had an HbA1c≥7.0% (53 mmol/mol) recorded from January 1, 2014-September 30, 2019. Therapeutic inertia (exposed vs. not exposed) was evaluated during the six months following HbA1c≥7.0% (53 mmol/mol). The outcomes assessed during the 12-month follow-up period included diabetes-related complications (continuous Diabetes Complications and Severity Index (DCSI)), glycemic levels (continuous follow-up HbA1c lab), and healthcare utilization counts. We analyzed data using multivariable regression models, adjusting for covariates. RESULTS The cohort included 26,881 patients with T2D (58.94% White race, 49.72% female, and mean age of 58.82 (SD=13.09)). After adjusting for covariates, therapeutic inertia exposure was associated with lower DCSI (estimate=-0.14 (SE=0.03), p < 0.001), higher follow-up HbA1c (estimate=0.14 (SE=0.04), p < 0.001), and lower rates of ambulatory visits (rate ratio=0.79, 95% CI=0.75-0.82). CONCLUSIONS Findings communicate the clinical practice implications and public health implications for combating therapeutic inertia in diabetes care.
Collapse
Affiliation(s)
- Cassidi C McDaniel
- Department of Health Outcomes Research and Policy, Harrison College of Pharmacy, Auburn University, Auburn, AL, USA.
| | - Wei-Hsuan Lo-Ciganic
- Department of Pharmaceutical Outcomes and Policy, University of Florida, College of Pharmacy, Gainesville, FL, USA; Division of General Internal Medicine, School of Medicine, University of Pittsburgh, Pittsburgh, PA, USA; Center for Pharmaceutical Policy and Prescribing, University of Pittsburgh, Pittsburgh, PA, USA; North Florida/South Georgia Veterans Health System, Geriatric Research Education and Clinical Center, Gainesville, FL, USA
| | - Chiahung Chou
- Department of Health Outcomes Research and Policy, Harrison College of Pharmacy, Auburn University, Auburn, AL, USA; Department of Medical Research, China Medical University Hospital, Taichung City, Taiwan
| |
Collapse
|
6
|
Bazoge A, Morin E, Daille B, Gourraud PA. Applying Natural Language Processing to Textual Data From Clinical Data Warehouses: Systematic Review. JMIR Med Inform 2023; 11:e42477. [PMID: 38100200 PMCID: PMC10757232 DOI: 10.2196/42477] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 01/16/2023] [Accepted: 09/07/2023] [Indexed: 12/17/2023] Open
Abstract
BACKGROUND In recent years, health data collected during the clinical care process have been often repurposed for secondary use through clinical data warehouses (CDWs), which interconnect disparate data from different sources. A large amount of information of high clinical value is stored in unstructured text format. Natural language processing (NLP), which implements algorithms that can operate on massive unstructured textual data, has the potential to structure the data and make clinical information more accessible. OBJECTIVE The aim of this review was to provide an overview of studies applying NLP to textual data from CDWs. It focuses on identifying the (1) NLP tasks applied to data from CDWs and (2) NLP methods used to tackle these tasks. METHODS This review was performed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. We searched for relevant articles in 3 bibliographic databases: PubMed, Google Scholar, and ACL Anthology. We reviewed the titles and abstracts and included articles according to the following inclusion criteria: (1) focus on NLP applied to textual data from CDWs, (2) articles published between 1995 and 2021, and (3) written in English. RESULTS We identified 1353 articles, of which 194 (14.34%) met the inclusion criteria. Among all identified NLP tasks in the included papers, information extraction from clinical text (112/194, 57.7%) and the identification of patients (51/194, 26.3%) were the most frequent tasks. To address the various tasks, symbolic methods were the most common NLP methods (124/232, 53.4%), showing that some tasks can be partially achieved with classical NLP techniques, such as regular expressions or pattern matching that exploit specialized lexica, such as drug lists and terminologies. Machine learning (70/232, 30.2%) and deep learning (38/232, 16.4%) have been increasingly used in recent years, including the most recent approaches based on transformers. NLP methods were mostly applied to English language data (153/194, 78.9%). CONCLUSIONS CDWs are central to the secondary use of clinical texts for research purposes. Although the use of NLP on data from CDWs is growing, there remain challenges in this field, especially with regard to languages other than English. Clinical NLP is an effective strategy for accessing, extracting, and transforming data from CDWs. Information retrieved with NLP can assist in clinical research and have an impact on clinical practice.
Collapse
Affiliation(s)
- Adrien Bazoge
- Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France
- Nantes Université, CHU de Nantes, Pôle Hospitalo-Universitaire 11: Santé Publique, Clinique des données, INSERM, CIC 1413, F-44000 Nantes, France
| | - Emmanuel Morin
- Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France
| | - Béatrice Daille
- Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France
| | - Pierre-Antoine Gourraud
- Nantes Université, CHU de Nantes, Pôle Hospitalo-Universitaire 11: Santé Publique, Clinique des données, INSERM, CIC 1413, F-44000 Nantes, France
- Nantes Université, INSERM, CHU de Nantes, École Centrale Nantes, Centre de Recherche Translationnelle en Transplantation et Immunologie, CR2TI, F-44000 Nantes, France
| |
Collapse
|
7
|
Workman TE, Goulet JL, Brandt CA, Warren AR, Eleazer J, Skanderson M, Lindemann L, Blosnich JR, O'Leary J, Zeng‐Treitler Q. Identifying suicide documentation in clinical notes through zero-shot learning. Health Sci Rep 2023; 6:e1526. [PMID: 37706016 PMCID: PMC10495736 DOI: 10.1002/hsr2.1526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2023] [Revised: 08/08/2023] [Accepted: 08/11/2023] [Indexed: 09/15/2023] Open
Abstract
Background and Aims In deep learning, a major difficulty in identifying suicidality and its risk factors in clinical notes is the lack of training samples given the small number of true positive instances among the number of patients screened. This paper describes a novel methodology that identifies suicidality in clinical notes by addressing this data sparsity issue through zero-shot learning. Our general aim was to develop a tool that leveraged zero-shot learning to effectively identify suicidality documentation in all types of clinical notes. Methods US Veterans Affairs clinical notes served as data. The training data set label was determined using diagnostic codes of suicide attempt and self-harm. We used a base string associated with the target label of suicidality to provide auxiliary information by narrowing the positive training cases to those containing the base string. We trained a deep neural network by mapping the training documents' contents to a semantic space. For comparison, we trained another deep neural network using the identical training data set labels, and bag-of-words features. Results The zero-shot learning model outperformed the baseline model in terms of area under the curve, sensitivity, specificity, and positive predictive value at multiple probability thresholds. In applying a 0.90 probability threshold, the methodology identified notes documenting suicidality but not associated with a relevant ICD-10-CM code, with 94% accuracy. Conclusion This method can effectively identify suicidality without manual annotation.
Collapse
Affiliation(s)
- Terri Elizabeth Workman
- Biomedical Informatics CenterThe George Washington UniversityWashingtonDistrict of ColumbiaUSA
- VA Medical CenterWashingtonDistrict of ColumbiaUSA
| | - Joseph L. Goulet
- Department of Emergency MedicineYale School of MedicineNew HavenConnecticutUSA
- VA Connecticut Healthcare SystemWest HavenConnecticutUSA
| | - Cynthia A. Brandt
- Department of Emergency MedicineYale School of MedicineNew HavenConnecticutUSA
- VA Connecticut Healthcare SystemWest HavenConnecticutUSA
| | - Allison R. Warren
- PRIME Center, VA Connecticut Healthcare SystemWest HavenConnecticutUSA
| | - Jacob Eleazer
- PRIME Center, VA Connecticut Healthcare SystemWest HavenConnecticutUSA
| | | | - Luke Lindemann
- VA Connecticut Healthcare SystemWest HavenConnecticutUSA
| | - John R. Blosnich
- Suzanne Dworak‐Peck School of Social WorkUniversity of Southern CaliforniaLos AngelesCaliforniaUSA
| | - John O'Leary
- VA Connecticut Healthcare SystemWest HavenConnecticutUSA
- Department of Internal MedicineYale School of MedicineWest HavenConnecticutUSA
| | - Qing Zeng‐Treitler
- Biomedical Informatics CenterThe George Washington UniversityWashingtonDistrict of ColumbiaUSA
- VA Medical CenterWashingtonDistrict of ColumbiaUSA
| |
Collapse
|
8
|
Xu YE, Barron DA, Sudol K, Zisook S, Oquendo MA. Suicidal behavior across a broad range of psychiatric disorders. Mol Psychiatry 2023; 28:2764-2810. [PMID: 36653675 PMCID: PMC10354222 DOI: 10.1038/s41380-022-01935-7] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/26/2022] [Revised: 12/12/2022] [Accepted: 12/16/2022] [Indexed: 01/20/2023]
Abstract
Suicide is a leading cause of death worldwide. In 2020, some 12.2 million Americans seriously contemplated suicide, 3.2 million planned suicide attempts, and 1.2 million attempted suicide. Traditionally, the approach to treating suicidal behavior (SB) has been to treat the "underlying" psychiatric disorder. However, the number of diagnoses associated with SB is considerable. We could find no studies describing the range of disorders reported to be comorbid with SB. This narrative review summarizes literature documenting the occurrence of SB across the lifespan and the full range of psychiatric diagnoses, not only BPD and those that comprise MDE, It also describes the relevance of these observations to clinical practice, research, and nosology. The literature searches contained the terms "suicid*" and each individual psychiatric diagnosis and identified 587 studies. We did not include case reports, case series, studies only addressing suicidal ideation or non-suicidal self-injury (NSSI), studies on self-harm, not distinguishing between SB and NSSI and studies that did not include any individuals that met criteria for a specific DSM-5 diagnosis (n = 366). We found that SB (suicide and/or suicide attempt) was reported to be associated with 72 out of 145 diagnoses, although data quality varied. Thus, SB is not exclusively germane to Major Depressive Episode (MDE) and Borderline Personality Disorder (BPD), the only conditions for which it is a diagnostic criterion. That SB co-occurs with so many diagnoses reinforces the need to assess current and past SB regardless of diagnosis, and supports the addition of charting codes to the DSM-5 to indicate current or past SB. It also comports with new data that specific genes are associated with SB independent of psychiatric diagnoses, and suggests that SB should be managed with specific suicide prevention interventions in addition to treatments indicated for co-occurring diagnoses. SB diagnostic codes would help researchers and clinicians document and measure SB's trajectory and response to treatment over time, and, ultimately, help develop secondary and tertiary prevention strategies. As a separate diagnosis, SB would preclude situations in which a potentially life-threatening behavior is not accounted for by a diagnosis, a problem that is particularly salient when no mental disorder is present, as is sometimes the case.
Collapse
Affiliation(s)
- Yingcheng E Xu
- Department of Psychiatry and Behavioral Health, Cooper Medical School of Rowan University and Cooper University Health Care, Camden, NJ, 08103, US
| | - Daniel A Barron
- Corporal Michael J. Crescenz Department of Veterans Affairs Medical Center, Philadelphia, PA, 19104, USA
| | - Katherin Sudol
- Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN, 37212, USA
| | - Sidney Zisook
- Department of Psychiatry, University of California San Diego School of Medicine, San Diego, CA, 92103, USA
| | - Maria A Oquendo
- Department of Psychiatry, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA.
| |
Collapse
|
9
|
Kumar M, Nguyen TPN, Kaur J, Singh TG, Soni D, Singh R, Kumar P. Opportunities and challenges in application of artificial intelligence in pharmacology. Pharmacol Rep 2023; 75:3-18. [PMID: 36624355 PMCID: PMC9838466 DOI: 10.1007/s43440-022-00445-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Revised: 12/23/2022] [Accepted: 12/25/2022] [Indexed: 01/11/2023]
Abstract
Artificial intelligence (AI) is a machine science that can mimic human behaviour like intelligent analysis of data. AI functions with specialized algorithms and integrates with deep and machine learning. Living in the digital world can generate a huge amount of medical data every day. Therefore, we need an automated and reliable evaluation tool that can make decisions more accurately and faster. Machine learning has the potential to learn, understand and analyse the data used in healthcare systems. In the last few years, AI is known to be employed in various fields in pharmaceutical science especially in pharmacological research. It helps in the analysis of preclinical (laboratory animals) and clinical (in human) trial data. AI also plays important role in various processes such as drug discovery/manufacturing, diagnosis of big data for disease identification, personalized treatment, clinical trial research, radiotherapy, surgical robotics, smart electronic health records, and epidemic outbreak prediction. Moreover, AI has been used in the evaluation of biomarkers and diseases. In this review, we explain various models and general processes of machine learning and their role in pharmacological science. Therefore, AI with deep learning and machine learning could be relevant in pharmacological research.
Collapse
Affiliation(s)
- Mandeep Kumar
- Department of Pharmacy, Unit of Pharmacology and Toxicology, University of Genoa, Genoa, Italy
| | - T P Nhung Nguyen
- Department of Pharmacy, Unit of Pharmacology and Toxicology, University of Genoa, Genoa, Italy
- Department of Pharmacy, Da Nang University of Medical Technology and Pharmacy, Da Nang, Vietnam
| | - Jasleen Kaur
- Department of Pharmacology and Toxicology, National Institute of Pharmaceutical Education and Research (NIPER), Lucknow, Uttar Pradesh, 226002, India
| | | | - Divya Soni
- Department of Pharmacology, Central University of Punjab, Ghudda, Bathinda, Punjab, 151401, India
| | - Randhir Singh
- Department of Pharmacology, Central University of Punjab, Ghudda, Bathinda, Punjab, 151401, India
| | - Puneet Kumar
- Department of Pharmacology, Central University of Punjab, Ghudda, Bathinda, Punjab, 151401, India.
| |
Collapse
|
10
|
Arowosegbe A, Oyelade T. Application of Natural Language Processing (NLP) in Detecting and Preventing Suicide Ideation: A Systematic Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2023; 20:1514. [PMID: 36674270 PMCID: PMC9859480 DOI: 10.3390/ijerph20021514] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Revised: 01/04/2023] [Accepted: 01/11/2023] [Indexed: 06/17/2023]
Abstract
(1) Introduction: Around a million people are reported to die by suicide every year, and due to the stigma associated with the nature of the death, this figure is usually assumed to be an underestimate. Machine learning and artificial intelligence such as natural language processing has the potential to become a major technique for the detection, diagnosis, and treatment of people. (2) Methods: PubMed, EMBASE, MEDLINE, PsycInfo, and Global Health databases were searched for studies that reported use of NLP for suicide ideation or self-harm. (3) Result: The preliminary search of 5 databases generated 387 results. Removal of duplicates resulted in 158 potentially suitable studies. Twenty papers were finally included in this review. (4) Discussion: Studies show that combining structured and unstructured data in NLP data modelling yielded more accurate results than utilizing either alone. Additionally, to reduce suicides, people with mental problems must be continuously and passively monitored. (5) Conclusions: The use of AI&ML opens new avenues for considerably guiding risk prediction and advancing suicide prevention frameworks. The review's analysis of the included research revealed that the use of NLP may result in low-cost and effective alternatives to existing resource-intensive methods of suicide prevention.
Collapse
Affiliation(s)
- Abayomi Arowosegbe
- Institute of Health Informatics, University College London, London NW1 2DA, UK
- Division of Informatics, Imaging & Data Sciences, University of Manchester, Manchester M13 9PL, UK
| | - Tope Oyelade
- Division of Medicine, University College London, London NW3 2PF, UK
| |
Collapse
|
11
|
Yusufov M, Pirl WF, Braun I, Tulsky JA, Lindvall C. Natural Language Processing for Computer-Assisted Chart Review to Assess Documentation of Substance use and Psychopathology in Heart Failure Patients Awaiting Cardiac Resynchronization Therapy. J Pain Symptom Manage 2022; 64:400-409. [PMID: 35716959 DOI: 10.1016/j.jpainsymman.2022.06.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Revised: 06/09/2022] [Accepted: 06/09/2022] [Indexed: 11/19/2022]
Abstract
CONTEXT Advanced heart failure (HF) patients often experience distressing psychological symptoms, frequently meeting diagnostic criteria for psychological disorders, including anxiety, depression, and substance use disorder. Patients with device-based HF therapies have added risk for psychological disorders, with consequences for their physiological functioning, including adverse cardiac outcomes. OBJECTIVES This study used natural language processing (NLP) for computer-assisted chart review to assess documentation of mental health and substance use in HF patients awaiting cardiac resynchronization therapy (CRT), a device-based HF therapy. METHODS We applied NLP to clinical notes from electronic health records (EHR) of 965 consecutive patients, with 9821 total clinical notes, at two academic medical centers between 2004 and 2015. We developed and validated a keyword library capturing terms related to mental health and substance use, while balancing specificity and sensitivity. RESULTS Mean age was 71.6 years (SD = 11.8), 78% male, and 87% non-Hispanic White. Of the 544 patients (56.4%) with documentation of mental health history, 9.7% had their mental health assessed and 6.6% had a plan documented. Of the 773 patients (80.1%) with documentation of substance use history, 10 (1.0%) had an assessment, and 3 (0.3%) had a plan. CONCLUSION Despite clinical recommendations and standards of care, clinicians are under documenting assessments and plans prior to CRT. Future research should develop an algorithm to prompt clinicians to document this content. Such quality improvement efforts may ensure adherence to standards of care and clinical guidelines.
Collapse
Affiliation(s)
- Miryam Yusufov
- Department of Psychosocial Oncology and Palliative Care (M.Y., W.F.P., I.B., J.A.T., C.L.), Dana-Farber Cancer Institute, Boston, Massachusetts, USA; Harvard Medical School (M.Y., W.F.P., I.B., J.A.T., C.L.), Boston, Massachusetts, USA.
| | - William F Pirl
- Department of Psychosocial Oncology and Palliative Care (M.Y., W.F.P., I.B., J.A.T., C.L.), Dana-Farber Cancer Institute, Boston, Massachusetts, USA; Harvard Medical School (M.Y., W.F.P., I.B., J.A.T., C.L.), Boston, Massachusetts, USA
| | - Ilana Braun
- Department of Psychosocial Oncology and Palliative Care (M.Y., W.F.P., I.B., J.A.T., C.L.), Dana-Farber Cancer Institute, Boston, Massachusetts, USA; Harvard Medical School (M.Y., W.F.P., I.B., J.A.T., C.L.), Boston, Massachusetts, USA
| | - James A Tulsky
- Department of Psychosocial Oncology and Palliative Care (M.Y., W.F.P., I.B., J.A.T., C.L.), Dana-Farber Cancer Institute, Boston, Massachusetts, USA; Harvard Medical School (M.Y., W.F.P., I.B., J.A.T., C.L.), Boston, Massachusetts, USA
| | - Charlotta Lindvall
- Department of Psychosocial Oncology and Palliative Care (M.Y., W.F.P., I.B., J.A.T., C.L.), Dana-Farber Cancer Institute, Boston, Massachusetts, USA; Harvard Medical School (M.Y., W.F.P., I.B., J.A.T., C.L.), Boston, Massachusetts, USA
| |
Collapse
|
12
|
Bejan CA, Ripperger M, Wilimitis D, Ahmed R, Kang J, Robinson K, Morley TJ, Ruderfer DM, Walsh CG. Improving ascertainment of suicidal ideation and suicide attempt with natural language processing. Sci Rep 2022; 12:15146. [PMID: 36071081 PMCID: PMC9452591 DOI: 10.1038/s41598-022-19358-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 08/29/2022] [Indexed: 12/03/2022] Open
Abstract
Methods relying on diagnostic codes to identify suicidal ideation and suicide attempt in Electronic Health Records (EHRs) at scale are suboptimal because suicide-related outcomes are heavily under-coded. We propose to improve the ascertainment of suicidal outcomes using natural language processing (NLP). We developed information retrieval methodologies to search over 200 million notes from the Vanderbilt EHR. Suicide query terms were extracted using word2vec. A weakly supervised approach was designed to label cases of suicidal outcomes. The NLP validation of the top 200 retrieved patients showed high performance for suicidal ideation (area under the receiver operator curve [AUROC]: 98.6, 95% confidence interval [CI] 97.1-99.5) and suicide attempt (AUROC: 97.3, 95% CI 95.2-98.7). Case extraction produced the best performance when combining NLP and diagnostic codes and when accounting for negated suicide expressions in notes. Overall, we demonstrated that scalable and accurate NLP methods can be developed to identify suicidal behavior in EHRs to enhance prevention efforts, predictive models, and precision medicine.
Collapse
Affiliation(s)
- Cosmin A Bejan
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Vanderbilt University School of Medicine, 2525 West End Avenue, Suite 1500, Nashville, TN, 37232, USA.
| | - Michael Ripperger
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Vanderbilt University School of Medicine, 2525 West End Avenue, Suite 1500, Nashville, TN, 37232, USA
| | - Drew Wilimitis
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Vanderbilt University School of Medicine, 2525 West End Avenue, Suite 1500, Nashville, TN, 37232, USA
| | - Ryan Ahmed
- Department of Medicine, Vanderbilt University Medical Center, Nashville, USA
| | - JooEun Kang
- Division of Genetic Medicine, Department of Medicine, Vanderbilt Genetics Institute, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Katelyn Robinson
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Vanderbilt University School of Medicine, 2525 West End Avenue, Suite 1500, Nashville, TN, 37232, USA
| | - Theodore J Morley
- Division of Genetic Medicine, Department of Medicine, Vanderbilt Genetics Institute, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Douglas M Ruderfer
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Vanderbilt University School of Medicine, 2525 West End Avenue, Suite 1500, Nashville, TN, 37232, USA
- Division of Genetic Medicine, Department of Medicine, Vanderbilt Genetics Institute, Vanderbilt University Medical Center, Nashville, TN, USA
- Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Colin G Walsh
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Vanderbilt University School of Medicine, 2525 West End Avenue, Suite 1500, Nashville, TN, 37232, USA
- Department of Medicine, Vanderbilt University Medical Center, Nashville, USA
- Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| |
Collapse
|
13
|
Cai T, He Z, Hong C, Zhang Y, Ho YL, Honerlaw J, Geva A, Ayakulangara Panickan V, King A, Gagnon DR, Gaziano M, Cho K, Liao K, Cai T. Scalable relevance ranking algorithm via semantic similarity assessment improves efficiency of medical chart review. J Biomed Inform 2022; 132:104109. [PMID: 35660521 DOI: 10.1016/j.jbi.2022.104109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Revised: 04/30/2022] [Accepted: 05/29/2022] [Indexed: 01/19/2023]
Abstract
OBJECTIVE Accurately assigning phenotype information to individual patients via computational phenotyping using Electronic Health Records (EHRs) has been seen as the first step towards enabling EHRs for precision medicine research. Chart review labels annotated by clinical experts, also known as "gold standard" labels, are essential for the development and validation of computational phenotyping algorithms. However, given the complexity of EHR systems, the process of chart review is both labor intensive and time consuming. We propose a fully automated algorithm, referred to as pGUESS, to rank EHR notes according to their relevance to a given phenotype. By identifying the most relevant notes, pGUESS can greatly improve the efficiency and accuracy of chart reviews. METHOD pGUESS uses prior guided semantic similarity to measure the informativeness of a clinical note to a given phenotype. We first select candidate clinical concepts from a pool of comprehensive medical concepts using public knowledge sources and then derive the semantic embedding vector (SEV) for a reference article (SEVref) and each note (SEVnote). The algorithm scores the relevance of a note as the cosine similarity between SEVnote and SEVref. RESULTS The algorithm was validated against four sets of 200 notes that were manually annotated by clinical experts to assess their informativeness to one of three disease phenotypes. pGUESS algorithm substantially outperforms existing unsupervised approaches for classifying the relevance status with respect to both accuracy and scalability across phenotypes. Averaging over the three phenotypes, the rank correlation between the algorithm ranking and gold standard label was 0.64 for pGUESS, but only 0.47 and 0.35 for the next two best performing algorithms. pGUESS is also much more computationally scalable compared to existing algorithms. CONCLUSION pGUESS algorithm can substantially reduce the burden of chart review and holds potential in improving the efficiency and accuracy of human annotation.
Collapse
Affiliation(s)
- Tianrun Cai
- Division of Rheumatology, Inflammation, and Immunity, Brigham and Women's Hospital, 60 Fenwood Road, Boston, USA; Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Suite 514, Boston, USA; VA Boston Healthcare System, 150 S Huntington Ave, Boston, USA.
| | - Zeling He
- Division of Rheumatology, Inflammation, and Immunity, Brigham and Women's Hospital, 60 Fenwood Road, Boston, USA; Department of Biostatistics, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA
| | - Chuan Hong
- Department of Biostatistics & Bioinformatics, Duke University, Duke University Medical Center 2424 Erwin Road, Suite 1102 Hock Plaza Box 2721, Durham, NC, USA
| | - Yichi Zhang
- Department of Computer Science and Statistics, University of Rhode Island, Tyler Hall, 9 Greenhouse Road, Suite 2, Kingston, RI, USA
| | - Yuk-Lam Ho
- VA Boston Healthcare System, 150 S Huntington Ave, Boston, USA
| | | | - Alon Geva
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Suite 514, Boston, USA; Department of Anesthesiology, Boston Children's Hospital, 300 Longwood Avenue, Bader, 6th Floor, Boston, MA, USA
| | | | - Amanda King
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA
| | - David R Gagnon
- VA Boston Healthcare System, 150 S Huntington Ave, Boston, USA; Department of Biostatistics, Boston University, School of Public Health, 801 Massachusetts Ave Crosstown Center, Boston, MA, USA
| | - Michael Gaziano
- Division of Rheumatology, Inflammation, and Immunity, Brigham and Women's Hospital, 60 Fenwood Road, Boston, USA; VA Boston Healthcare System, 150 S Huntington Ave, Boston, USA
| | - Kelly Cho
- Division of Rheumatology, Inflammation, and Immunity, Brigham and Women's Hospital, 60 Fenwood Road, Boston, USA; Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Suite 514, Boston, USA; VA Boston Healthcare System, 150 S Huntington Ave, Boston, USA
| | - Katherine Liao
- Division of Rheumatology, Inflammation, and Immunity, Brigham and Women's Hospital, 60 Fenwood Road, Boston, USA; Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Suite 514, Boston, USA; VA Boston Healthcare System, 150 S Huntington Ave, Boston, USA
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, 10 Shattuck Street, Suite 514, Boston, USA; VA Boston Healthcare System, 150 S Huntington Ave, Boston, USA; Department of Biostatistics, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA
| |
Collapse
|
14
|
Burnett A, Chen N, Zeritis S, Ware S, McGillivray L, Shand F, Torok M. Machine learning algorithms to classify self-harm behaviours in New South Wales Ambulance electronic medical records: A retrospective study. Int J Med Inform 2022; 161:104734. [DOI: 10.1016/j.ijmedinf.2022.104734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2021] [Revised: 02/14/2022] [Accepted: 03/03/2022] [Indexed: 10/18/2022]
|
15
|
Homan S, Gabi M, Klee N, Bachmann S, Moser AM, Duri' M, Michel S, Bertram AM, Maatz A, Seiler G, Stark E, Kleim B. Linguistic features of suicidal thoughts and behaviors: A systematic review. Clin Psychol Rev 2022; 95:102161. [DOI: 10.1016/j.cpr.2022.102161] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2021] [Revised: 03/28/2022] [Accepted: 04/27/2022] [Indexed: 12/13/2022]
|
16
|
Boggs JM, Quintana LM, Powers JD, Hochberg S, Beck A. Frequency of Clinicians' Assessments for Access to Lethal Means in Persons at Risk for Suicide. Arch Suicide Res 2022; 26:127-136. [PMID: 32379012 DOI: 10.1080/13811118.2020.1761917] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
OBJECTIVE We measured the frequency of clinicians' assessments for access to lethal means, including firearms and medications in patients at risk of suicide from electronic medical and mental health records in outpatient and emergency settings. METHODS We included adult patients who reported suicide ideation on the PHQ-9 depression screener in behavioral health and primary care outpatient settings of a large integrated health system in the U.S. and those with suicidal behavior treated in the emergency department. Two separate natural language processing queries were developed on medical record text documentation: (1) assessment for access to firearms (8,994 patients), (2) assessment for access to medications (4,939 patients). RESULTS Only 35% of patients had documentation of firearm or medication assessment in the month following treatment for suicidal behavior in the emergency setting. Among those reporting suicidal ideation in outpatient setting, 31% had documentation of firearm assessment and 23% for medication assessment. The accuracy of the estimates was very good for firearm assessment (F1 = 89%) and medication assessment in the outpatient setting (F1 = 91%) and fair for medication assessment in the emergency setting (F1 = 70%) due to more varied documentation styles. CONCLUSIONS Lethal means assessment following report of suicidal ideation or behavior is low in a nonacademic health care setting. Until health systems implement more structured documentation to measure lethal means assessment, such as discrete data field, NLP methods may be used to conduct research and surveillance of this important prevention practice in real-world settings.
Collapse
|
17
|
Brennan BP, Schnabel J, Pope HG, Hudson JI. Antidepressant use and risk of intubation or death in hospitalized patients with COVID-19: A retrospective cohort study of clinical effectiveness. Front Psychiatry 2022; 13:951065. [PMID: 36186877 PMCID: PMC9520125 DOI: 10.3389/fpsyt.2022.951065] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/23/2022] [Accepted: 08/16/2022] [Indexed: 12/15/2022] Open
Abstract
Initial controlled trials of the serotonergic antidepressant fluvoxamine showed promise for treatment of mild to moderate COVID-19 in outpatients, although more recent outpatient data have been less encouraging. Turning to studies of hospitalized patients, a retrospective cohort study by Hoertel and associates in 2021 found a markedly reduced risk of intubation or death among patients hospitalized with COVID-19 who were receiving serotonergic antidepressants at the time of admission vs. those not receiving antidepressants. In an attempt to replicate these latter findings, we performed a similarly designed study of 500 individuals hospitalized with COVID-19 in a large academic hospital system who were taking a serotonergic antidepressant at the time of admission compared with two groups (N = 573 and N = 593) not receiving an antidepressant. In analyses controlling for demographic and clinical variables, we found no significant difference in effect between the antidepressant group and either of the two comparison groups [hazard ratios (95% CI) for intubation or death 1.1 (0.83-1.5) and 1.1 (0.86-1.5); and for death alone 1.3 (0.93-1.8) and 1.1 (0.85-1.7)]. Examining the results of our study, along with those of Hoertel et al. and three additional retrospective cohort studies in inpatients published in the interim, the data permit only very limited conclusions, with the findings on the effect of serotonergic antidepressants ranging from a strongly protective effect to no effect. Although there are numerous threats to validity that might account for this wide range of findings, we could not identify any principal factor or set of factors that could clearly explain the differences.
Collapse
Affiliation(s)
- Brian P Brennan
- Psychiatric Epidemiology Research Program and Biological Psychiatry Laboratory, McLean Hospital, Belmont, MA, United States.,Department of Psychiatry, Harvard Medical School, Boston, MA, United States
| | - Jiana Schnabel
- Psychiatric Epidemiology Research Program and Biological Psychiatry Laboratory, McLean Hospital, Belmont, MA, United States
| | - Harrison G Pope
- Psychiatric Epidemiology Research Program and Biological Psychiatry Laboratory, McLean Hospital, Belmont, MA, United States.,Department of Psychiatry, Harvard Medical School, Boston, MA, United States
| | - James I Hudson
- Psychiatric Epidemiology Research Program and Biological Psychiatry Laboratory, McLean Hospital, Belmont, MA, United States.,Department of Psychiatry, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
18
|
Zafari H, Kosowan L, Zulkernine F, Signer A. Diagnosing post-traumatic stress disorder using electronic medical record data. Health Informatics J 2021; 27:14604582211053259. [PMID: 34818936 DOI: 10.1177/14604582211053259] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
This study proposes a predictive model that uses structured data and unstructured narrative notes from Electronic Medical Records to accurately identify patients diagnosed with Post-Traumatic Stress Disorder (PTSD). We utilize data from primary care clinicians participating in the Manitoba Primary Care Research Network (MaPCReN) representing 154,118 patients. A reference sample of 195 patients that had their PTSD diagnosis confirmed using a manual chart review of structured data and narrative notes, and PTSD negative patients is used as the gold standard data for model training, validation and testing. We assess structured and unstructured data from eight tables in the MaPCReN namely, patient demographics, disease case, examinations, medication, billing records, health condition, risk factors, and encounter notes. Feature engineering is applied to convert data into proper representation for predictive modeling. We explore serial and parallel mixed data models that are trained on both structured and unstructured data to identify PTSD. Model performances were calculated based on a highly skewed hold-out test dataset. The serial model that uses both structured and text data as input, yielded the highest values in sensitivity (0.77), F-measure (0.76), and AUC (0.88) and the parallel model that uses both structured and text data as the input obtained the highest positive predicted value (PPV) (0.75). Diseases such as PTSD are difficult to diagnose. Information recorded in the chart note over multiple visits of the patients with the primary care physicians has higher predictive power than structured data and combining these two data types can increase the predictive capabilities of machine learning models in diagnosing PTSD. While the deep-learning model outperformed the traditional ensemble model in processing text data, the ensemble classifier obtained better results in ingesting a combination of features obtained from both data types in the serial mixed model. The study demonstrated that unstructured encounter notes enhance a model's ability to identify patients diagnosed with PTSD. These findings can enhance quality improvement, research, and disease surveillance related to PTSD in primary care populations.
Collapse
|
19
|
Soni A, Amrhein B, Baucum M, Paek EJ, Khojandi A. Using Verb Fluency, Natural Language Processing, and Machine Learning to Detect Alzheimer's Disease. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:2282-2285. [PMID: 34891742 DOI: 10.1109/embc46164.2021.9630371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Alzheimer's disease (AD) causes significant impairments in memory and other cognitive domains. As there is no cure to the disease yet, early detection and delay of disease progression are critical for management of AD. Verbal fluency is one of the most common and sensitive neuropsychological methods used for detection and evaluation of the cognitive declines in AD, in which a subject is required to name as many items as possible in 30 or 60 seconds that belong to a certain category. In this study, we develop an approach to detect AD using a verb fluency (VF) task, a specific subset of verbal fluency analyzing the subjects' listing of verbs in a given time period. We use machine learning techniques including random forest (RF), neural network (NN), recurrent NN (RNN), and natural language processing (NLP) to detect the risk of AD. The results show that the developed models can stratify subjects into the corresponding AD and control groups with up to 76% accuracy using RF, but at a cost of having to preprocess the data. This accuracy is slightly lower, but not significantly, at 67% using RNN and NLP, which involves almost no manual preprocessing of the data. This study opens up a powerful approach of using simple VF tasks for early detection of AD.
Collapse
|
20
|
Ayre K, Bittar A, Kam J, Verma S, Howard LM, Dutta R. Developing a Natural Language Processing tool to identify perinatal self-harm in electronic healthcare records. PLoS One 2021; 16:e0253809. [PMID: 34347787 PMCID: PMC8336818 DOI: 10.1371/journal.pone.0253809] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Accepted: 06/14/2021] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Self-harm occurring within pregnancy and the postnatal year ("perinatal self-harm") is a clinically important yet under-researched topic. Current research likely under-estimates prevalence due to methodological limitations. Electronic healthcare records (EHRs) provide a source of clinically rich data on perinatal self-harm. AIMS (1) To create a Natural Language Processing (NLP) tool that can, with acceptable precision and recall, identify mentions of acts of perinatal self-harm within EHRs. (2) To use this tool to identify service-users who have self-harmed perinatally, based on their EHRs. METHODS We used the Clinical Record Interactive Search system to extract de-identified EHRs of secondary mental healthcare service-users at South London and Maudsley NHS Foundation Trust. We developed a tool that applied several layers of linguistic processing based on the spaCy NLP library for Python. We evaluated mention-level performance in the following domains: span, status, temporality and polarity. Evaluation was done against a manually coded reference standard. Mention-level performance was reported as precision, recall, F-score and Cohen's kappa for each domain. Performance was also assessed at 'service-user' level and explored whether a heuristic rule improved this. We report per-class statistics for service-user performance, as well as likelihood ratios and post-test probabilities. RESULTS Mention-level performance: micro-averaged F-score, precision and recall for span, polarity and temporality >0.8. Kappa for status 0.68, temporality 0.62, polarity 0.91. Service-user level performance with heuristic: F-score, precision, recall of minority class 0.69, macro-averaged F-score 0.81, positive LR 9.4 (4.8-19), post-test probability 69.0% (53-82%). Considering the task difficulty, the tool performs well, although temporality was the attribute with the lowest level of annotator agreement. CONCLUSIONS It is feasible to develop an NLP tool that identifies, with acceptable validity, mentions of perinatal self-harm within EHRs, although with limitations regarding temporality. Using a heuristic rule, it can also function at a service-user-level.
Collapse
Affiliation(s)
- Karyn Ayre
- Section of Women’s Mental Health, Health Service and Population Research Department, Institute of Psychiatry, Psychology and Neuroscience, Kings College London, London, United Kingdom
- South London and Maudsley NHS Foundation Trust, Bethlem Royal Hospital, Kent, London, United Kingdom
- * E-mail:
| | - André Bittar
- Academic Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, Kings College London, London, United Kingdom
| | - Joyce Kam
- King’s College London GKT School of Medical Education, London, United Kingdom
| | - Somain Verma
- King’s College London GKT School of Medical Education, London, United Kingdom
| | - Louise M. Howard
- Section of Women’s Mental Health, Health Service and Population Research Department, Institute of Psychiatry, Psychology and Neuroscience, Kings College London, London, United Kingdom
- South London and Maudsley NHS Foundation Trust, Bethlem Royal Hospital, Kent, London, United Kingdom
| | - Rina Dutta
- South London and Maudsley NHS Foundation Trust, Bethlem Royal Hospital, Kent, London, United Kingdom
- Academic Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, Kings College London, London, United Kingdom
| |
Collapse
|
21
|
Pohontsch NJ, Zimmermann T, Lehmann M, Rustige L, Kurz K, Löwe B, Scherer M. ICD-10-Coding of Medically Unexplained Physical Symptoms and Somatoform Disorders-A Survey With German GPs. Front Med (Lausanne) 2021; 8:598810. [PMID: 33859988 PMCID: PMC8042316 DOI: 10.3389/fmed.2021.598810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Accepted: 03/08/2021] [Indexed: 12/03/2022] Open
Abstract
Background: General practitioners (GPs) are reluctant to use codes that correspond to somatization syndromes. Aim: To quantify GPs' views on coding of medically unexplained physical symptoms (MUPS), somatoform disorders, and associated factors. Design and Setting: Survey with German GPs. Methods: We developed six survey items [response options "does not apply at all (1)"-"does fully apply (6)"], invited a random sample of 12.004 GPs to participate in the self-administered cross-sectional survey and analysed data using descriptive statistics and logistic regression analyses. Results: Response rate was 15.2% with N = 1,731 valid responses (54.3% female). Participants considered themselves familiar with ICD-10 criteria for somatoform disorders (M = 4.52; SD =.036) and considered adequate coding as essential prerequisite for treatment (M = 5.02; SD = 1.21). All other item means were close to the scale mean: preference for symptom or functional codes (M = 3.40; SD = 1.21), consideration of the possibility of stigmatisation (M = 3.30; SD = 1.35) and other disadvantages (M = 3.28; SD = 1.30) and coding only if psychotherapy is intended (M = 3.39; SD = 1.46). Exposure, guideline knowledge, and experience were most strongly associated with GPs' self-reported coding behaviour. Conclusions: Subjective exposure, guideline knowledge, and experience as a GP, but no sociodemographic variable being associated with GPs' subjective coding behaviour could indicate that GPs offer a relatively homogeneous approach to coding and handling of MUPS and somatoform disorders. Strengthening guideline knowledge and implementation, and practise with simulated patients could increase the subjective competence to cope with the challenge that patients with MUPS and somatoform disorders present.
Collapse
Affiliation(s)
- Nadine J. Pohontsch
- Department of General Practice and Primary Care, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Thomas Zimmermann
- Department of General Practice and Primary Care, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Marco Lehmann
- Department of Psychosomatic Medicine and Psychotherapy, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Lisa Rustige
- Department of Psychosomatic Medicine and Psychotherapy, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Institute for Sex Research, Sexual Medicine and Forensic Psychiatry, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Katinka Kurz
- Department of Psychosomatic Medicine and Psychotherapy, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Department of Cardiology, University Heart and Vascular Center Hamburg, Hamburg, Germany
| | - Bernd Löwe
- Department of Psychosomatic Medicine and Psychotherapy, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Martin Scherer
- Department of General Practice and Primary Care, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
22
|
Kohane IS, Aronow BJ, Avillach P, Beaulieu-Jones BK, Bellazzi R, Bradford RL, Brat GA, Cannataro M, Cimino JJ, García-Barrio N, Gehlenborg N, Ghassemi M, Gutiérrez-Sacristán A, Hanauer DA, Holmes JH, Hong C, Klann JG, Loh NHW, Luo Y, Mandl KD, Daniar M, Moore JH, Murphy SN, Neuraz A, Ngiam KY, Omenn GS, Palmer N, Patel LP, Pedrera-Jiménez M, Sliz P, South AM, Tan ALM, Taylor DM, Taylor BW, Torti C, Vallejos AK, Wagholikar KB, Weber GM, Cai T. What Every Reader Should Know About Studies Using Electronic Health Record Data but May Be Afraid to Ask. J Med Internet Res 2021; 23:e22219. [PMID: 33600347 PMCID: PMC7927948 DOI: 10.2196/22219] [Citation(s) in RCA: 47] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2020] [Revised: 09/14/2020] [Accepted: 01/10/2021] [Indexed: 12/13/2022] Open
Abstract
Coincident with the tsunami of COVID-19–related publications, there has been a surge of studies using real-world data, including those obtained from the electronic health record (EHR). Unfortunately, several of these high-profile publications were retracted because of concerns regarding the soundness and quality of the studies and the EHR data they purported to analyze. These retractions highlight that although a small community of EHR informatics experts can readily identify strengths and flaws in EHR-derived studies, many medical editorial teams and otherwise sophisticated medical readers lack the framework to fully critically appraise these studies. In addition, conventional statistical analyses cannot overcome the need for an understanding of the opportunities and limitations of EHR-derived studies. We distill here from the broader informatics literature six key considerations that are crucial for appraising studies utilizing EHR data: data completeness, data collection and handling (eg, transformation), data type (ie, codified, textual), robustness of methods against EHR variability (within and across institutions, countries, and time), transparency of data and analytic code, and the multidisciplinary approach. These considerations will inform researchers, clinicians, and other stakeholders as to the recommended best practices in reviewing manuscripts, grants, and other outputs from EHR-data derived studies, and thereby promote and foster rigor, quality, and reliability of this rapidly growing field.
Collapse
Affiliation(s)
- Isaac S Kohane
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Bruce J Aronow
- Biomedical Informatics, Cincinnati Children's Hospital Medical Center, University of Cincinnati, Cincinnati, OH, United States
| | - Paul Avillach
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | | | - Riccardo Bellazzi
- Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy.,ICS Maugeri, Pavia, Italy
| | - Robert L Bradford
- North Carolina Translational and Clinical Sciences Institute, University of North Carolina at Chapel Hill, Chapel Hill, NC, United States
| | - Gabriel A Brat
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Mario Cannataro
- Data Analytics Research Center, University Magna Graecia of Catanzaro, Catanzaro, Italy.,Department of Medical and Surgical Sciences, University Magna Graecia of Catanzaro, Catanzaro, Italy
| | - James J Cimino
- Informatics Institute, University of Alabama at Birmingham, Birmingham, AL, United States
| | | | - Nils Gehlenborg
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Marzyeh Ghassemi
- Department of Computer Science and Medicine, University of Toronto, Toronto, ON, Canada
| | | | - David A Hanauer
- Department of Learning Health Sciences, University of Michigan Medical School, Ann Arbor, MI, United States
| | - John H Holmes
- Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| | - Chuan Hong
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Jeffrey G Klann
- Department of Medicine, Harvard Medical School, Boston, MA, United States.,Laboratory of Computer Science, Massachusetts General Hospital, Boston, MA, United States
| | | | - Yuan Luo
- Department of Preventive Medicine, Northwestern University, Chicago, IL, United States
| | - Kenneth D Mandl
- Computational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States
| | - Mohamad Daniar
- Clinical Research Informatics, Boston Children's Hospital, Boston, MA, United States
| | - Jason H Moore
- Institute for Biomedical Informatics, University of Pennsylvania, Philadelphia, PA, United States
| | - Shawn N Murphy
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States.,Department of Neurology, Massachusetts General Hospital, Boston, MA, United States
| | - Antoine Neuraz
- Department of Biomedical Informatics, Necker-Enfant Malades Hospital, Assistance Publique - Hôpitaux de Paris, Paris, France.,Centre de Recherche des Cordeliers, INSERM UMRS 1138 Team 22, Université de Paris, Paris, France
| | - Kee Yuan Ngiam
- National University Health Systems, Singapore, Singapore
| | - Gilbert S Omenn
- Department of Computational Medicine & Bioinformatics, University of Michigan, Ann Arbor, MI, United States
| | - Nathan Palmer
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Lav P Patel
- Department of Internal Medicine, Division of Medical Informatics, University of Kansas Medical Center, Kansas City, KS, United States
| | | | - Piotr Sliz
- Computational Health Informatics Program, Boston Children's Hospital, Boston, MA, United States
| | - Andrew M South
- Section of Nephrology, Department of Pediatrics, Brenner Children's Hospital, Wake Forest School of Medicine, Winston Salem, NC, United States
| | - Amelia Li Min Tan
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States.,Department of Biomedical Informatics, National University of Singapore, Singapore, Singapore
| | - Deanne M Taylor
- Department of Biomedical and Health Informatics, The Children's Hospital of Philadelphia, Philadelphia, PA, United States.,Department of Pediatrics, Perelman School of Medicine, The University of Pennsylvania, Philadelphia, PA, United States
| | - Bradley W Taylor
- Clinical and Translational Science Institute, Medical College of Wisconsin, Milwaukee, WI, United States
| | - Carlo Torti
- Department of Medical and Surgical Sciences, University Magna Graecia of Catanzaro, Catanzaro, Italy
| | - Andrew K Vallejos
- Clinical and Translational Science Institute, Medical College of Wisconsin, Milwaukee, WI, United States
| | - Kavishwar B Wagholikar
- Department of Medicine, Harvard Medical School, Boston, MA, United States.,Laboratory of Computer Science, Massachusetts General Hospital, Boston, MA, United States
| | | | - Griffin M Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
23
|
Buckland RS, Hogan JW, Chen ES. Selection of Clinical Text Features for Classifying Suicide Attempts. AMIA ... ANNUAL SYMPOSIUM PROCEEDINGS. AMIA SYMPOSIUM 2021; 2020:273-282. [PMID: 33936399 PMCID: PMC8075476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Research has demonstrated cohort misclassification when studies of suicidal thoughts and behaviors (STBs) rely on ICD-9/10-CM diagnosis codes. Electronic health record (EHR) data are being explored to better identify patients, a process called EHR phenotyping. Most STB phenotyping studies have used structured EHR data, but some are beginning to incorporate unstructured clinical text. In this study, we used a publicly-accessible natural language processing (NLP) program for biomedical text (MetaMap) and iterative elastic net regression to extract and select predictive text features from the discharge summaries of 810 inpatient admissions of interest. Initial sets of 5,866 and 2,709 text features were reduced to 18 and 11, respectively. The two models fit with these features obtained an area under the receiver operating characteristic curve of 0.866-0.895 and an area under the precision-recall curve of 0.800-0.838, demonstrating the approach's potential to identify textual features to incorporate in phenotyping models.
Collapse
Affiliation(s)
- Ryan S Buckland
- Center for Biomedical Informatics, Brown University, Providence, RI
- Department of Biostatistics, Brown University, Providence, RI
| | - Joseph W Hogan
- Department of Biostatistics, Brown University, Providence, RI
| | - Elizabeth S Chen
- Center for Biomedical Informatics, Brown University, Providence, RI
| |
Collapse
|
24
|
An intelligent multimodal medical diagnosis system based on patients’ medical questions and structured symptoms for telemedicine. INFORMATICS IN MEDICINE UNLOCKED 2021. [DOI: 10.1016/j.imu.2021.100513] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
|
25
|
Bernert RA, Hilberg AM, Melia R, Kim JP, Shah NH, Abnousi F. Artificial Intelligence and Suicide Prevention: A Systematic Review of Machine Learning Investigations. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:E5929. [PMID: 32824149 PMCID: PMC7460360 DOI: 10.3390/ijerph17165929] [Citation(s) in RCA: 58] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Accepted: 07/28/2020] [Indexed: 12/12/2022]
Abstract
Suicide is a leading cause of death that defies prediction and challenges prevention efforts worldwide. Artificial intelligence (AI) and machine learning (ML) have emerged as a means of investigating large datasets to enhance risk detection. A systematic review of ML investigations evaluating suicidal behaviors was conducted using PubMed/MEDLINE, PsychInfo, Web-of-Science, and EMBASE, employing search strings and MeSH terms relevant to suicide and AI. Databases were supplemented by hand-search techniques and Google Scholar. Inclusion criteria: (1) journal article, available in English, (2) original investigation, (3) employment of AI/ML, (4) evaluation of a suicide risk outcome. N = 594 records were identified based on abstract search, and 25 hand-searched reports. N = 461 reports remained after duplicates were removed, n = 316 were excluded after abstract screening. Of n = 149 full-text articles assessed for eligibility, n = 87 were included for quantitative synthesis, grouped according to suicide behavior outcome. Reports varied widely in methodology and outcomes. Results suggest high levels of risk classification accuracy (>90%) and Area Under the Curve (AUC) in the prediction of suicidal behaviors. We report key findings and central limitations in the use of AI/ML frameworks to guide additional research, which hold the potential to impact suicide on broad scale.
Collapse
Affiliation(s)
- Rebecca A. Bernert
- Stanford Suicide Prevention Research Laboratory, Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94304, USA
| | - Amanda M. Hilberg
- Stanford Suicide Prevention Research Laboratory, Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94304, USA
| | - Ruth Melia
- Stanford Suicide Prevention Research Laboratory, Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94304, USA
- Department of Psychology, National University of Ireland, Galway, Ireland
| | - Jane Paik Kim
- Stanford Suicide Prevention Research Laboratory, Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94304, USA
| | - Nigam H. Shah
- Department of Medicine, Center for Biomedical Informatics Research, Stanford University School of Medicine, Stanford, CA 94304, USA
- Informatics, Stanford Center for Clinical and Translational Research, and Education (Spectrum), Stanford University, Stanford CA 94304, USA
| | - Freddy Abnousi
- Facebook, Menlo Park, CA 94025, USA
- Yale University School of Medicine, New Haven, CT 06510, USA
| |
Collapse
|
26
|
Obeid JS, Dahne J, Christensen S, Howard S, Crawford T, Frey LJ, Stecker T, Bunnell BE. Identifying and Predicting Intentional Self-Harm in Electronic Health Record Clinical Notes: Deep Learning Approach. JMIR Med Inform 2020; 8:e17784. [PMID: 32729840 PMCID: PMC7426805 DOI: 10.2196/17784] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Revised: 04/25/2020] [Accepted: 05/21/2020] [Indexed: 12/20/2022] Open
Abstract
BACKGROUND Suicide is an important public health concern in the United States and around the world. There has been significant work examining machine learning approaches to identify and predict intentional self-harm and suicide using existing data sets. With recent advances in computing, deep learning applications in health care are gaining momentum. OBJECTIVE This study aimed to leverage the information in clinical notes using deep neural networks (DNNs) to (1) improve the identification of patients treated for intentional self-harm and (2) predict future self-harm events. METHODS We extracted clinical text notes from electronic health records (EHRs) of 835 patients with International Classification of Diseases (ICD) codes for intentional self-harm and 1670 matched controls who never had any intentional self-harm ICD codes. The data were divided into training and holdout test sets. We tested a number of algorithms on clinical notes associated with the intentional self-harm codes using the training set, including several traditional bag-of-words-based models and 2 DNN models: a convolutional neural network (CNN) and a long short-term memory model. We also evaluated the predictive performance of the DNNs on a subset of patients who had clinical notes 1 to 6 months before the first intentional self-harm event. Finally, we evaluated the impact of a pretrained model using Word2vec (W2V) on performance. RESULTS The area under the receiver operating characteristic curve (AUC) for the CNN on the phenotyping task, that is, the detection of intentional self-harm in clinical notes concurrent with the events was 0.999, with an F1 score of 0.985. In the predictive task, the CNN achieved the highest performance with an AUC of 0.882 and an F1 score of 0.769. Although pretraining with W2V shortened the DNN training time, it did not improve performance. CONCLUSIONS The strong performance on the first task, namely, phenotyping based on clinical notes, suggests that such models could be used effectively for surveillance of intentional self-harm in clinical text in an EHR. The modest performance on the predictive task notwithstanding, the results using DNN models on clinical text alone are competitive with other reports in the literature using risk factors from structured EHR data.
Collapse
Affiliation(s)
- Jihad S Obeid
- Medical University of South Carolina, Charleston, SC, United States
| | - Jennifer Dahne
- Medical University of South Carolina, Charleston, SC, United States
| | - Sean Christensen
- Medical University of South Carolina, Charleston, SC, United States
| | - Samuel Howard
- Medical University of South Carolina, Charleston, SC, United States
| | - Tami Crawford
- Medical University of South Carolina, Charleston, SC, United States
| | - Lewis J Frey
- Medical University of South Carolina, Charleston, SC, United States
| | - Tracy Stecker
- Medical University of South Carolina, Charleston, SC, United States
| | | |
Collapse
|
27
|
Deng Z, Yin K, Bao Y, Armengol VD, Wang C, Tiwari A, Barzilay R, Parmigiani G, Braun D, Hughes KS. Validation of a Semiautomated Natural Language Processing-Based Procedure for Meta-Analysis of Cancer Susceptibility Gene Penetrance. JCO Clin Cancer Inform 2020; 3:1-9. [PMID: 31419182 DOI: 10.1200/cci.19.00043] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022] Open
Abstract
PURPOSE Quantifying the risk of cancer associated with pathogenic mutations in germline cancer susceptibility genes-that is, penetrance-enables the personalization of preventive management strategies. Conducting a meta-analysis is the best way to obtain robust risk estimates. We have previously developed a natural language processing (NLP) -based abstract classifier which classifies abstracts as relevant to penetrance, prevalence of mutations, both, or neither. In this work, we evaluate the performance of this NLP-based procedure. MATERIALS AND METHODS We compared the semiautomated NLP-based procedure, which involves automated abstract classification and text mining, followed by human review of identified studies, with the traditional procedure that requires human review of all studies. Ten high-quality gene-cancer penetrance meta-analyses spanning 16 gene-cancer associations were used as the gold standard by which to evaluate the performance of our procedure. For each meta-analysis, we evaluated the number of abstracts that required human review (workload) and the ability to identify the studies that were included by the authors in their quantitative analysis (coverage). RESULTS Compared with the traditional procedure, the semiautomated NLP-based procedure led to a lower workload across all 10 meta-analyses, with an overall 84% reduction (2,774 abstracts v 16,941 abstracts) in the amount of human review required. Overall coverage was 93%-we are able to identify 132 of 142 studies-before reviewing references of identified studies. Reasons for the 10 missed studies included blank and poorly written abstracts. After reviewing references, nine of the previously missed studies were identified and coverage improved to 99% (141 of 142 studies). CONCLUSION We demonstrated that an NLP-based procedure can significantly reduce the review workload without compromising the ability to identify relevant studies. NLP algorithms have promising potential for reducing human efforts in the literature review process.
Collapse
Affiliation(s)
| | - Kanhua Yin
- Massachusetts General Hospital, Boston, MA
| | - Yujia Bao
- Massachusetts Institute of Technology, Boston, MA
| | | | - Cathy Wang
- Harvard TH Chan School of Public Health, Boston, MA.,Dana-Farber Cancer Institute, Boston, MA
| | | | | | - Giovanni Parmigiani
- Harvard TH Chan School of Public Health, Boston, MA.,Dana-Farber Cancer Institute, Boston, MA
| | - Danielle Braun
- Harvard TH Chan School of Public Health, Boston, MA.,Dana-Farber Cancer Institute, Boston, MA
| | - Kevin S Hughes
- Massachusetts General Hospital, Boston, MA.,Harvard Medical School, Boston, MA
| |
Collapse
|
28
|
Zhou L, Cheng C, Ou D, Huang H. Construction of a semi-automatic ICD-10 coding system. BMC Med Inform Decis Mak 2020; 20:67. [PMID: 32293423 PMCID: PMC7157985 DOI: 10.1186/s12911-020-1085-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Accepted: 03/30/2020] [Indexed: 01/29/2023] Open
Abstract
Background The International Classification of Diseases, 10th Revision (ICD-10) has been widely used to describe the diagnosis information of patients. Automatic ICD-10 coding is important because manually assigning codes is expensive, time consuming and error prone. Although numerous approaches have been developed to explore automatic coding, few of them have been applied in practice. Our aim is to construct a practical, automatic ICD-10 coding machine to improve coding efficiency and quality in daily work. Methods In this study, we propose the use of regular expressions (regexps) to establish a correspondence between diagnosis codes and diagnosis descriptions in outpatient settings and at admission and discharge. The description models of the regexps were embedded in our upgraded coding system, which queries a diagnosis description and assigns a unique diagnosis code. Like most studies, the precision (P), recall (R), F-measure (F) and overall accuracy (A) were used to evaluate the system performance. Our study had two stages. The datasets were obtained from the diagnosis information on the homepage of the discharge medical record. The testing sets were from October 1, 2017 to April 30, 2018 and from July 1, 2018 to January 31, 2019. Results The values of P were 89.27 and 88.38% in the first testing phase and the second testing phase, respectively, which demonstrate high precision. The automatic ICD-10 coding system completed more than 160,000 codes in 16 months, which reduced the workload of the coders. In addition, a comparison between the amount of time needed for manual coding and automatic coding indicated the effectiveness of the system-the time needed for automatic coding takes nearly 100 times less than manual coding. Conclusions Our automatic coding system is well suited for the coding task. Further studies are warranted to perfect the description models of the regexps and to develop synthetic approaches to improve system performance.
Collapse
Affiliation(s)
- Lingling Zhou
- Department of Information, Daping Hospital of Army Medical University, 10 Changjiang Access Road, Chongqing, 400042, China
| | - Cheng Cheng
- Department of Information, Daping Hospital of Army Medical University, 10 Changjiang Access Road, Chongqing, 400042, China
| | - Dong Ou
- Department of Information, Daping Hospital of Army Medical University, 10 Changjiang Access Road, Chongqing, 400042, China
| | - Hao Huang
- Department of Information, Daping Hospital of Army Medical University, 10 Changjiang Access Road, Chongqing, 400042, China.
| |
Collapse
|
29
|
Senior M, Burghart M, Yu R, Kormilitzin A, Liu Q, Vaci N, Nevado-Holgado A, Pandit S, Zlodre J, Fazel S. Identifying Predictors of Suicide in Severe Mental Illness: A Feasibility Study of a Clinical Prediction Rule (Oxford Mental Illness and Suicide Tool or OxMIS). Front Psychiatry 2020; 11:268. [PMID: 32351413 PMCID: PMC7175991 DOI: 10.3389/fpsyt.2020.00268] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/12/2019] [Accepted: 03/19/2020] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND Oxford Mental Illness and Suicide tool (OxMIS) is a brief, scalable, freely available, structured risk assessment tool to assess suicide risk in patients with severe mental illness (schizophrenia-spectrum disorders or bipolar disorder). OxMIS requires further external validation, but a lack of large-scale cohorts with relevant variables makes this challenging. Electronic health records provide possible data sources for external validation of risk prediction tools. However, they contain large amounts of information within free-text that is not readily extractable. In this study, we examined the feasibility of identifying suicide predictors needed to validate OxMIS in routinely collected electronic health records. METHODS In study 1, we manually reviewed electronic health records of 57 patients with severe mental illness to calculate OxMIS risk scores. In study 2, we examined the feasibility of using natural language processing to scale up this process. We used anonymized free-text documents from the Clinical Record Interactive Search database to train a named entity recognition model, a machine learning technique which recognizes concepts in free-text. The model identified eight concepts relevant for suicide risk assessment: medication (antidepressant/antipsychotic treatment), violence, education, self-harm, benefits receipt, drug/alcohol use disorder, suicide, and psychiatric admission. We assessed model performance in terms of precision (similar to positive predictive value), recall (similar to sensitivity) and F1 statistic (an overall performance measure). RESULTS In study 1, we estimated suicide risk for all patients using the OxMIS calculator, giving a range of 12 month risk estimates from 0.1-3.4%. For 13 out of 17 predictors, there was no missing information in electronic health records. For the remaining 4 predictors missingness ranged from 7-26%; to account for these missing variables, it was possible for OxMIS to estimate suicide risk using a range of scores. In study 2, the named entity recognition model had an overall precision of 0.77, recall of 0.90 and F1 score of 0.83. The concept with the best precision and recall was medication (precision 0.84, recall 0.96) and the weakest were suicide (precision 0.37), and drug/alcohol use disorder (recall 0.61). CONCLUSIONS It is feasible to estimate suicide risk with the OxMIS tool using predictors identified in routine clinical records. Predictors could be extracted using natural language processing. However, electronic health records differ from other data sources, particularly for family history variables, which creates methodological challenges.
Collapse
Affiliation(s)
- Morwenna Senior
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Matthias Burghart
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Rongqin Yu
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | | | - Qiang Liu
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Nemanja Vaci
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | | | - Smita Pandit
- Oxford Health NHS Foundation Trust, Warneford Hospital, Oxford, United Kingdom
| | - Jakov Zlodre
- Oxford Health NHS Foundation Trust, Warneford Hospital, Oxford, United Kingdom
| | - Seena Fazel
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
30
|
Barak-Corren Y, Castro VM, Nock MK, Mandl KD, Madsen EM, Seiger A, Adams WG, Applegate RJ, Bernstam EV, Klann JG, McCarthy EP, Murphy SN, Natter M, Ostasiewski B, Patibandla N, Rosenthal GE, Silva GS, Wei K, Weber GM, Weiler SR, Reis BY, Smoller JW. Validation of an Electronic Health Record-Based Suicide Risk Prediction Modeling Approach Across Multiple Health Care Systems. JAMA Netw Open 2020; 3:e201262. [PMID: 32211868 PMCID: PMC11136522 DOI: 10.1001/jamanetworkopen.2020.1262] [Citation(s) in RCA: 40] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Importance Suicide is a leading cause of mortality, with suicide-related deaths increasing in recent years. Automated methods for individualized risk prediction have great potential to address this growing public health threat. To facilitate their adoption, they must first be validated across diverse health care settings. Objective To evaluate the generalizability and cross-site performance of a risk prediction method using readily available structured data from electronic health records in predicting incident suicide attempts across multiple, independent, US health care systems. Design, Setting, and Participants For this prognostic study, data were extracted from longitudinal electronic health record data comprising International Classification of Diseases, Ninth Revision diagnoses, laboratory test results, procedures codes, and medications for more than 3.7 million patients from 5 independent health care systems participating in the Accessible Research Commons for Health network. Across sites, 6 to 17 years' worth of data were available, up to 2018. Outcomes were defined by International Classification of Diseases, Ninth Revision codes reflecting incident suicide attempts (with positive predictive value >0.70 according to expert clinician medical record review). Models were trained using naive Bayes classifiers in each of the 5 systems. Models were cross-validated in independent data sets at each site, and performance metrics were calculated. Data analysis was performed from November 2017 to August 2019. Main Outcomes and Measures The primary outcome was suicide attempt as defined by a previously validated case definition using International Classification of Diseases, Ninth Revision codes. The accuracy and timeliness of the prediction were measured at each site. Results Across the 5 health care systems, of the 3 714 105 patients (2 130 454 female [57.2%]) included in the analysis, 39 162 cases (1.1%) were identified. Predictive features varied by site but, as expected, the most common predictors reflected mental health conditions (eg, borderline personality disorder, with odds ratios of 8.1-12.9, and bipolar disorder, with odds ratios of 0.9-9.1) and substance use disorders (eg, drug withdrawal syndrome, with odds ratios of 7.0-12.9). Despite variation in geographical location, demographic characteristics, and population health characteristics, model performance was similar across sites, with areas under the curve ranging from 0.71 (95% CI, 0.70-0.72) to 0.76 (95% CI, 0.75-0.77). Across sites, at a specificity of 90%, the models detected a mean of 38% of cases a mean of 2.1 years in advance. Conclusions and Relevance Across 5 diverse health care systems, a computationally efficient approach leveraging the full spectrum of structured electronic health record data was able to detect the risk of suicidal behavior in unselected patients. This approach could facilitate the development of clinical decision support tools that inform risk reduction interventions.
Collapse
Affiliation(s)
- Yuval Barak-Corren
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts
| | - Victor M Castro
- Partners Research Information Science and Computing, Boston, Massachusetts
| | - Matthew K Nock
- Department of Psychology, Harvard University, Cambridge, Massachusetts
| | - Kenneth D Mandl
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Emily M Madsen
- Psychiatric and Neurodevelopmental Genetics Unit, Center for Genomic Medicine, Massachusetts General Hospital, Boston, Massachusetts
| | - Ashley Seiger
- Psychiatric and Neurodevelopmental Genetics Unit, Center for Genomic Medicine, Massachusetts General Hospital, Boston, Massachusetts
| | - William G Adams
- Department of Pediatrics, Boston Medical Center, Boston University School of Medicine, Boston, Massachusetts
| | - R Joseph Applegate
- School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston
| | - Elmer V Bernstam
- School of Biomedical Informatics, The University of Texas Health Science Center at Houston, Houston
- McGovern Medical School, Division of General Internal Medicine, The University of Texas Health Science Center at Houston, Houston
| | - Jeffrey G Klann
- Partners Research Information Science and Computing, Boston, Massachusetts
| | - Ellen P McCarthy
- Department of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts
| | - Shawn N Murphy
- Partners Research Information Science and Computing, Boston, Massachusetts
| | - Marc Natter
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts
| | - Brian Ostasiewski
- Clinical and TranslationalScience Institute, Wake Forest School of Medicine, Winston-Salem, North Carolina
| | - Nandan Patibandla
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts
| | - Gary E Rosenthal
- Department of Internal Medicine, Wake Forest School of Medicine, Winston-Salem, North Carolina
| | - George S Silva
- Department of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts
| | - Kun Wei
- Clinical and TranslationalScience Institute, Wake Forest School of Medicine, Winston-Salem, North Carolina
| | - Griffin M Weber
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
- Department of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts
| | - Sarah R Weiler
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Ben Y Reis
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Massachusetts
| | - Jordan W Smoller
- Psychiatric and Neurodevelopmental Genetics Unit, Center for Genomic Medicine, Massachusetts General Hospital, Boston, Massachusetts
| |
Collapse
|
31
|
Zhou X, Wang Y, Sohn S, Therneau TM, Liu H, Knopman DS. Automatic extraction and assessment of lifestyle exposures for Alzheimer's disease using natural language processing. Int J Med Inform 2019; 130:103943. [PMID: 31476655 PMCID: PMC6750723 DOI: 10.1016/j.ijmedinf.2019.08.003] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2019] [Revised: 07/01/2019] [Accepted: 08/05/2019] [Indexed: 01/01/2023]
Abstract
INTRODUCTION Previous biomedical studies identified many lifestyle exposures that could possibly represent risk factors for dementia in general or dementia due to Alzheimer's disease (AD). These lifestyle exposures are mainly mentioned in free-text electronic health records (EHRs). However, automatic extraction and assessment of these exposures using EHRs remains understudied. METHODS A natural language processing (NLP) approach was adopted to extract lifestyle exposures and intervention strategies from the clinical notes of 260 patients with clinical diagnoses of AD dementia and 260 age-matched cognitively unimpaired persons. Statistics of lifestyle exposures were compared between these two groups. The mapping results of the NLP extraction were evaluated by comparing the results with data captured independently by clinicians. RESULTS Thirty out of fifty-five potentially relevant lifestyle exposures were mentioned in our clinical note dataset. Twenty-two dietary factors and three substance abuses that were potentially relevant were not found in clinical notes. Patients with AD dementia were significantly exposed to more of the potential risk factors compared to the cognitively unimpaired subjects (χ2 = 120.31, p-value < 0.001). The average accuracy of the automated extraction was 74.0% in comparison with the manual review of randomly selected 50 sample documents. DISCUSSION AND CONCLUSION We illustrated the feasibility of NLP techniques for the automated evaluation of a large number lifestyle habits using free-text EHR data. We found that AD dementia patients were exposed to more of the potential risk factors than the comparison group. Our results also demonstrated the feasibility and accuracy of investigating putative risk factors using NLP techniques.
Collapse
Affiliation(s)
- Xin Zhou
- Department of Health Science Research, Mayo Clinic, MN, USA
| | - Yanshan Wang
- Department of Health Science Research, Mayo Clinic, MN, USA.
| | - Sunghwan Sohn
- Department of Health Science Research, Mayo Clinic, MN, USA
| | | | - Hongfang Liu
- Department of Health Science Research, Mayo Clinic, MN, USA
| | | |
Collapse
|
32
|
Machine learning discovery of longitudinal patterns of depression and suicidal ideation. PLoS One 2019; 14:e0222665. [PMID: 31539408 PMCID: PMC6754154 DOI: 10.1371/journal.pone.0222665] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2019] [Accepted: 09/03/2019] [Indexed: 11/19/2022] Open
Abstract
Background and aim Depression is often accompanied by thoughts of self-harm, which are a strong predictor of subsequent suicide attempt and suicide death. Few empirical data are available regarding the temporal correlation between depression symptoms and suicidal ideation. We investigated the anecdotal concern that suicidal ideation may increase during a period of depression improvement. Data Longitudinal Patient Health Questionnaire (PHQ)-9 is a questionnaire of 9 multiple-choice questions to assess the frequency of depressive symptoms within the previous two weeks. We analyzed a chronic depression treatment population’s electronic health record (EHR) data, containing 610 patients’ longitudinal PHQ-9 scores (62% age 45 and older; 68% female) within 40 weeks. Methods The irregular and sparse EHR data were transformed into continuous trajectories using Gaussian process regression. We first estimated the correlations between the symptoms (total score of the first 8 questions; PHQ-8) and suicide ideation (9th question score; Item 9) using the cross-correlation function. We then used an artificial neural network (ANN) to discover subtypes of depression patterns from the fitted depression trajectories. In addition, we conducted a separate analysis using the unfitted raw PHQ scores to examine PHQ-8’s and Item 9’s pattern changes. Results Results showed that the majority of patients’ PHQ-8 and Item 9 scores displayed strong temporal correlations. We found five patterns in the PHQ-8 and the Item 9 trajectories. We also found 8% - 13% of the patients have experienced an increase in suicidal ideation during the improvement of their PHQ-8. Using a trajectory-based method for subtype pattern detection in depression progression, we provided a better understanding of temporal correlations between depression symptoms over time.
Collapse
|
33
|
Zhong QY, Gelaye B, Karlson EW, Avillach P, Smoller JW, Cai T, Williams MA. Associations of antepartum suicidal behaviour with adverse infant and obstetric outcomes. Paediatr Perinat Epidemiol 2019; 33:137-144. [PMID: 30790331 DOI: 10.1111/ppe.12535] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/20/2018] [Revised: 12/02/2018] [Accepted: 12/05/2018] [Indexed: 12/20/2022]
Abstract
BACKGROUND Relatively little is known about antepartum suicidal behaviour and pregnancy outcomes. We examined associations of antepartum suicidal behaviour, alone and in combination with psychiatric disorders, with adverse infant and obstetric outcomes. METHODS We included 188 925 singleton livebirths from a retrospective cohort (1996-2016). Suicidal behaviour, psychiatric disorders, and outcomes were derived from electronic medical records. We performed multivariable logistic regressions with generalised estimating equations to estimate adjusted odds ratios (aOR) with 95% confidence intervals (95%CI). RESULTS The prevalence of antepartum suicidal behaviour was 152.44 per 100 000 singleton livebirths. Nearly two-thirds (64.24%) of women with suicidal behaviour also had psychiatric disorders. Compared to women without psychiatric disorders and suicidal behaviour, women with psychiatric disorders alone had 1.3-fold to 1.4-fold increased odds of delivering low birthweight or preterm infants and 1.2-fold increased odds of experiencing obstetric complications. Women with suicidal behaviour alone had increased odds of preterm labour (aOR 2.05, 95% CI 1.16, 3.62). Women with both suicidal behaviour and psychiatric disorders had > twofold increased odds of delivering low birthweight (aOR 2.52, 95% CI 1.40, 4.54), preterm birth (aOR 2.44, 95% CI 1.63, 3.66), and low birthweight/preterm birth (aOR 2.30, 95% CI 1.54, 3.44) infants; the odds of preterm labour (aOR 1.62, 95% CI 1.06, 2.47), placental abruption (aOR 2.33, 95% CI 1.20, 4.51), preterm rupture of membranes (aOR 1.63, 95% CI 1.08, 2.46), and postpartum haemorrhage (aOR 1.93, 95%CI 1.09, 3.40) were elevated. CONCLUSIONS Antepartum suicidal behaviour, when co-occurring with psychiatric disorders, is associated with increased odds of adverse infant and obstetric outcomes. Future studies are warranted to understand the causal roles of suicidal behaviour and psychiatric disorders in pregnancy.
Collapse
Affiliation(s)
- Qiu-Yue Zhong
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Bizu Gelaye
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Elizabeth W Karlson
- Department of Medicine, Division of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts
| | - Paul Avillach
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts.,Children's Hospital Informatics Program, Boston Children's Hospital, Boston, Massachusetts.,Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts
| | - Jordan W Smoller
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts.,Psychiatric and Neurodevelopmental Genetics Unit, Massachusetts General Hospital, Boston, Massachusetts
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts.,Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Michelle A Williams
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| |
Collapse
|
34
|
Zhong QY, Mittal LP, Nathan MD, Brown KM, Knudson González D, Cai T, Finan S, Gelaye B, Avillach P, Smoller JW, Karlson EW, Cai T, Williams MA. Use of natural language processing in electronic medical records to identify pregnant women with suicidal behavior: towards a solution to the complex classification problem. Eur J Epidemiol 2018; 34:153-162. [PMID: 30535584 DOI: 10.1007/s10654-018-0470-0] [Citation(s) in RCA: 27] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2018] [Accepted: 12/01/2018] [Indexed: 12/17/2022]
Abstract
We developed algorithms to identify pregnant women with suicidal behavior using information extracted from clinical notes by natural language processing (NLP) in electronic medical records. Using both codified data and NLP applied to unstructured clinical notes, we first screened pregnant women in Partners HealthCare for suicidal behavior. Psychiatrists manually reviewed clinical charts to identify relevant features for suicidal behavior and to obtain gold-standard labels. Using the adaptive elastic net, we developed algorithms to classify suicidal behavior. We then validated algorithms in an independent validation dataset. From 275,843 women with codes related to pregnancy or delivery, 9331 women screened positive for suicidal behavior by either codified data (N = 196) or NLP (N = 9,145). Using expert-curated features, our algorithm achieved an area under the curve of 0.83. By setting a positive predictive value comparable to that of diagnostic codes related to suicidal behavior (0.71), we obtained a sensitivity of 0.34, specificity of 0.96, and negative predictive value of 0.83. The algorithm identified 1423 pregnant women with suicidal behavior among 9331 women screened positive. Mining unstructured clinical notes using NLP resulted in a 11-fold increase in the number of pregnant women identified with suicidal behavior, as compared to solely reliance on diagnostic codes.
Collapse
Affiliation(s)
- Qiu-Yue Zhong
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA.
| | - Leena P Mittal
- Division of Women's Mental Health, Department of Psychiatry, Brigham and Women's Hospital, Boston, MA, USA
| | - Margo D Nathan
- Division of Women's Mental Health, Department of Psychiatry, Brigham and Women's Hospital, Boston, MA, USA
| | - Kara M Brown
- Division of Women's Mental Health, Department of Psychiatry, Brigham and Women's Hospital, Boston, MA, USA
| | - Deborah Knudson González
- Department of Psychiatry and Behavioral Neurosciences, Morsani College of Medicine, University of South Florida, Tampa, FL, USA
| | - Tianrun Cai
- Department of Medicine, Division of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital, Boston, MA, USA
| | - Sean Finan
- Children's Hospital Informatics Program, Boston Children's Hospital, Boston, MA, USA
| | - Bizu Gelaye
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA
| | - Paul Avillach
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA.,Children's Hospital Informatics Program, Boston Children's Hospital, Boston, MA, USA.,Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Jordan W Smoller
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA.,Psychiatric and Neurodevelopmental Genetics Unit, Massachusetts General Hospital, Boston, MA, USA
| | - Elizabeth W Karlson
- Department of Medicine, Division of Rheumatology, Immunology and Allergy, Brigham and Women's Hospital, Boston, MA, USA
| | - Tianxi Cai
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA.,Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Michelle A Williams
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, 677 Huntington Avenue, Boston, MA, USA
| |
Collapse
|