1
|
Chandler MT, Cai T, Santacroce L, Ulysse S, Liao KP, Feldman CH. Classifying Individuals With Rheumatic Conditions as Financially Insecure Using Electronic Health Record Data and Natural Language Processing: Algorithm Derivation and Validation. ACR Open Rheumatol 2024; 6:481-488. [PMID: 38747148 PMCID: PMC11319925 DOI: 10.1002/acr2.11675] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2023] [Accepted: 04/01/2024] [Indexed: 08/15/2024] Open
Abstract
OBJECTIVE We aimed to examine the feasibility of applying natural language processing (NLP) to unstructured electronic health record (EHR) documents to detect the presence of financial insecurity among patients with rheumatologic disease enrolled in an integrated care management program (iCMP). METHODS We incorporated supervised, rule-based NLP and statistical methods to identify financial insecurity among patients with rheumatic conditions enrolled in an iCMP (n = 20,395) in a multihospital EHR system. We constructed a lexicon for financial insecurity using data from available knowledge sources and then reviewed EHR notes from 538 randomly selected individuals (training cohort n = 366, validation cohort n = 172). We manually categorized records as having "definite," "possible," or "no" mention of financial insecurity. All available notes were processed using Narrative Information Linear Extraction, a rule-based version of NLP. Models were trained using the NLP features for financial insecurity using logistic, least absolute shrinkage operator (LASSO), and random forest performance characteristic and were compared with the reference standard. RESULTS A total of 245,142 notes were processed from 538 individual patient records. Financial insecurity was present among 100 (27%) individuals in the training cohort and 63 (37%) in the validation cohort. The LASSO and random forest models performed identically and slightly better than logistic regression, with positive predictive values of 0.90, sensitivities of 0.29, and specificities of 0.98. CONCLUSION The development of a context-driven lexicon used with rule-based NLP to extract data that identify financial insecurity is feasible for use and improved the capture for presence of financial insecurity with high accuracy. In the absence of a standard lexicon and construct definition for financial insecurity status, additional studies are needed to optimize the sensitivity of algorithms to categorize financial insecurity with construct validity.
Collapse
Affiliation(s)
- Mia T. Chandler
- Boston Children's HospitalBostonMassachusetts
- Harvard Medical SchoolBostonMassachusetts
| | - Tianrun Cai
- Harvard Medical SchoolBostonMassachusetts
- Brigham and Women's Hospital and Harvard Medical SchoolBostonMassachusetts
| | - Leah Santacroce
- Brigham and Women's Hospital and Harvard Medical SchoolBostonMassachusetts
| | - Sciaska Ulysse
- Brigham and Women's Hospital and Harvard Medical SchoolBostonMassachusetts
| | - Katherine P. Liao
- Harvard Medical SchoolBostonMassachusetts
- Brigham and Women's Hospital and Harvard Medical SchoolBostonMassachusetts
| | - Candace H. Feldman
- Harvard Medical SchoolBostonMassachusetts
- Brigham and Women's Hospital and Harvard Medical SchoolBostonMassachusetts
| |
Collapse
|
2
|
Guevara M, Chen S, Thomas S, Chaunzwa TL, Franco I, Kann BH, Moningi S, Qian JM, Goldstein M, Harper S, Aerts HJWL, Catalano PJ, Savova GK, Mak RH, Bitterman DS. Large language models to identify social determinants of health in electronic health records. NPJ Digit Med 2024; 7:6. [PMID: 38200151 PMCID: PMC10781957 DOI: 10.1038/s41746-023-00970-0] [Citation(s) in RCA: 15] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Accepted: 11/15/2023] [Indexed: 01/12/2024] Open
Abstract
Social determinants of health (SDoH) play a critical role in patient outcomes, yet their documentation is often missing or incomplete in the structured data of electronic health records (EHRs). Large language models (LLMs) could enable high-throughput extraction of SDoH from the EHR to support research and clinical care. However, class imbalance and data limitations present challenges for this sparsely documented yet critical information. Here, we investigated the optimal methods for using LLMs to extract six SDoH categories from narrative text in the EHR: employment, housing, transportation, parental status, relationship, and social support. The best-performing models were fine-tuned Flan-T5 XL for any SDoH mentions (macro-F1 0.71), and Flan-T5 XXL for adverse SDoH mentions (macro-F1 0.70). Adding LLM-generated synthetic data to training varied across models and architecture, but improved the performance of smaller Flan-T5 models (delta F1 + 0.12 to +0.23). Our best-fine-tuned models outperformed zero- and few-shot performance of ChatGPT-family models in the zero- and few-shot setting, except GPT4 with 10-shot prompting for adverse SDoH. Fine-tuned models were less likely than ChatGPT to change their prediction when race/ethnicity and gender descriptors were added to the text, suggesting less algorithmic bias (p < 0.05). Our models identified 93.8% of patients with adverse SDoH, while ICD-10 codes captured 2.0%. These results demonstrate the potential of LLMs in improving real-world evidence on SDoH and assisting in identifying patients who could benefit from resource support.
Collapse
Affiliation(s)
- Marco Guevara
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA
| | - Shan Chen
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA
| | - Spencer Thomas
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA
- Computational Health Informatics Program, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA
| | - Tafadzwa L Chaunzwa
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA
| | - Idalid Franco
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA
| | - Benjamin H Kann
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA
| | - Shalini Moningi
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA
| | - Jack M Qian
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA
| | | | - Susan Harper
- Adult Resource Office, Dana-Farber Cancer Institute, Boston, MA, USA
| | - Hugo J W L Aerts
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA
- Radiology and Nuclear Medicine, GROW & CARIM, Maastricht University, Maastricht, The Netherlands
| | - Paul J Catalano
- Department of Data Science, Dana-Farber Cancer Institute and Department of Biostatistics, Harvard T. H. Chan School of Public Health, Boston, MA, USA
| | - Guergana K Savova
- Computational Health Informatics Program, Boston Children's Hospital, Harvard Medical School, Boston, MA, USA
| | - Raymond H Mak
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA
| | - Danielle S Bitterman
- Artificial Intelligence in Medicine (AIM) Program, Mass General Brigham, Harvard Medical School, Boston, MA, USA.
- Department of Radiation Oncology, Brigham and Women's Hospital/Dana-Farber Cancer Institute, Boston, MA, USA.
| |
Collapse
|
3
|
Coulthard B, Taylor BJ. Natural language processing to identify case factors in child protection court proceedings. METHODOLOGICAL INNOVATIONS 2022. [DOI: 10.1177/20597991221115967] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Social work case files hold rich detail about the lives and needs of vulnerable groups. Traditional case-reading studies to gain generalisable knowledge are resource-intensive, however, and sample sizes thereby limited. The advent of ‘big data’ technology, and vast repositories of centrally stored electronic records offer social work researchers novel alternatives, including data linkage and predictive risk modelling using administrative data. Free-text documents, however – including assessments, reports, and case chronologies – remain a largely untapped resource. This paper describes how 5000 social work court statements held by the Child and Family Court Advisory Support Service in England (Cafcass) were analysed using natural language processing (NLP) based on simple rules and mathematical principles. Thirteen factors relating to harm and risk to children involved in care proceedings in England were identified by automated computer techniques, and almost 90% agreement with professional readers achieved when the factors were clear-cut. The study represents an innovative approach for social work research on complex social problems. In conclusion, the paper discusses learning points; practical implications; future research avenues; and the technical and ethical challenges of NLP.
Collapse
Affiliation(s)
- Beth Coulthard
- School of Applied Social and Policy Sciences, Ulster University, Northern Ireland, UK
| | - Brian J Taylor
- School of Applied Social and Policy Sciences, Ulster University, Northern Ireland, UK
| |
Collapse
|
4
|
Dorr DA, Quiñones AR, King T, Wei MY, White K, Bejan CA. Prediction of Future Health Care Utilization Through Note-extracted Psychosocial Factors. Med Care 2022; 60:570-578. [PMID: 35658116 PMCID: PMC9262845 DOI: 10.1097/mlr.0000000000001742] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
BACKGROUND Persons with multimorbidity (≥2 chronic conditions) face an increased risk of poor health outcomes, especially as they age. Psychosocial factors such as social isolation, chronic stress, housing insecurity, and financial insecurity have been shown to exacerbate these outcomes, but are not routinely assessed during the clinical encounter. Our objective was to extract these concepts from chart notes using natural language processing and predict their impact on health care utilization for patients with multimorbidity. METHODS A cohort study to predict the 1-year likelihood of hospitalizations and emergency department visits for patients 65+ with multimorbidity with and without psychosocial factors. Psychosocial factors were extracted from narrative notes; all other covariates were extracted from electronic health record data from a large academic medical center using validated algorithms and concept sets. Logistic regression was performed to predict the likelihood of hospitalization and emergency department visit in the next year. RESULTS In all, 76,479 patients were eligible; the majority were White (89%), 54% were female, with mean age 73. Those with psychosocial factors were older, had higher baseline utilization, and more chronic illnesses. The 4 psychosocial factors all independently predicted future utilization (odds ratio=1.27-2.77, C -statistic=0.63). Accounting for demographics, specific conditions, and previous utilization, 3 of 4 of the extracted factors remained predictive (odds ratio=1.13-1.86) for future utilization. Compared with models with no psychosocial factors, they had improved discrimination. Individual predictions were mixed, with social isolation predicting depression and morbidity; stress predicting atherosclerotic cardiovascular disease onset; and housing insecurity predicting substance use disorder morbidity. DISCUSSION Psychosocial factors are known to have adverse health impacts, but are rarely measured; using natural language processing, we extracted factors that identified a higher risk segment of older adults with multimorbidity. Combining these extraction techniques with other measures of social determinants may help catalyze population health efforts to address psychosocial factors to mitigate their health impacts.
Collapse
Affiliation(s)
- David A. Dorr
- Department of Medical Informatics & Clinical Epidemiology; Oregon Health & Science University; Portland, OR
| | - Ana R. Quiñones
- Department of Family Medicine; Oregon Health & Science University; Portland, OR
| | - Taylor King
- Department of Medical Informatics & Clinical Epidemiology; Oregon Health & Science University; Portland, OR
| | | | - Kellee White
- Department of Health Policy and Management; University of Maryland; College Park, MD
| | - Cosmin A. Bejan
- Department of Biomedical Informatics; Vanderbilt University Medical Center; Nashville, TN, USA
| |
Collapse
|
5
|
Han S, Zhang RF, Shi L, Richie R, Liu H, Tseng A, Quan W, Ryan N, Brent D, Tsui FR. Classifying Social Determinants of Health from Unstructured Electronic Health Records Using Deep Learning-based Natural Language Processing. J Biomed Inform 2022; 127:103984. [PMID: 35007754 DOI: 10.1016/j.jbi.2021.103984] [Citation(s) in RCA: 28] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 12/28/2021] [Accepted: 12/29/2021] [Indexed: 12/23/2022]
Abstract
OBJECTIVE Social determinants of health (SDOH) are non-medical factors that can profoundly impact patient health outcomes. However, SDOH are rarely available in structured electronic health record (EHR) data such as diagnosis codes, and more commonly found in unstructured narrative clinical notes. Hence, identifying social context from unstructured EHR data has become increasingly important. Yet, previous work on using natural language processing to automate extraction of SDOH from text (a) usually focuses on an ad hoc selection of SDOH, and (b) does not use the latest advances in deep learning. Our objective was to advance automatic extraction of SDOH from clinical text by (a) systematically creating a set of SDOH based on standard biomedical and psychiatric ontologies, and (b) training state-of-the-art deep neural networks to extract mentions of these SDOH from clinical notes. DESIGN A retrospective cohort study. SETTING AND PARTICIPANTS Data were extracted from the Medical Information Mart for Intensive Care (MIMIC-III) database. The corpus comprised 3,504 social related sentences from 2,670 clinical notes. METHODS We developed a framework for automated classification of multiple SDOH categories. Our dataset comprised narrative clinical notes under the "Social Work" category in the MIMIC-III Clinical Database. Using standard terminologies, SNOMED-CT and DSM-IV, we systematically curated a set of 13 SDOH categories and created annotation guidelines for these. After manually annotating the 3,504 sentences, we developed and tested three deep neural network (DNN) architectures - convolutional neural network (CNN), long short-term memory (LSTM) network, and the Bidirectional Encoder Representations from Transformers (BERT) - for automated detection of eight SDOH categories. We also compared these DNNs to three baselines models: (1) cTAKES, as well as (2) L2-regularized logistic regression and (3) random forests on bags-of-words. Model evaluation metrics included micro- and macro- F1, and area under the receiver operating characteristic curve (AUC). RESULTS All three DNN models accurately classified all SDOH categories (minimum micro-F1 =.632, minimum macro-AUC=.854). Compared to the CNN and LSTM, BERT performed best in most key metrics (micro-F1 = 0.690, macro-AUC=0.907). The BERT model most effectively identified the "occupational" category (F1=.774, AUC=.965) and least effectively identified the "non-SDOH" category (F=.491, AUC=.788). BERT outperformed cTAKES in distinguishing social vs non-social sentences (BERT F1 = .87 vs. cTAKES F1=.06), and outperformed logistic regression (micro-F1=0.649, macro-AUC=0.696) and random forest (micro-F1=0.502, macro-AUC=0.523) trained on bag-of-words. CONCLUSIONS Our study framework with DNN models demonstrated improved performance for efficiently identifying a systematic range of SDOH categories from clinical notes in the EHR. Improved identification of patient SDOH may further improve healthcare outcomes.
Collapse
Affiliation(s)
- Sifei Han
- Tsui Laboratory, Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Robert F Zhang
- Tsui Laboratory, Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA; Perelman School of Medicine, University of Pennsylvania, PA, USA
| | - Lingyun Shi
- Tsui Laboratory, Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Russell Richie
- Tsui Laboratory, Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA
| | - Haixia Liu
- Central South University, Changsha, Hunan, CN
| | | | - Wei Quan
- New York University Abu Dhabi, Abu Dhabi, AE
| | - Neal Ryan
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA
| | - David Brent
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA
| | - Fuchiang R Tsui
- Tsui Laboratory, Department of Biomedical and Health Informatics, Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, USA; Perelman School of Medicine, University of Pennsylvania, PA, USA.
| |
Collapse
|
6
|
Patra BG, Sharma MM, Vekaria V, Adekkanattu P, Patterson OV, Glicksberg B, Lepow LA, Ryu E, Biernacka JM, Furmanchuk A, George TJ, Hogan W, Wu Y, Yang X, Bian J, Weissman M, Wickramaratne P, Mann JJ, Olfson M, Campion TR, Weiner M, Pathak J. Extracting social determinants of health from electronic health records using natural language processing: a systematic review. J Am Med Inform Assoc 2021; 28:2716-2727. [PMID: 34613399 PMCID: PMC8633615 DOI: 10.1093/jamia/ocab170] [Citation(s) in RCA: 66] [Impact Index Per Article: 22.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2021] [Revised: 07/09/2021] [Accepted: 08/04/2021] [Indexed: 11/27/2022] Open
Abstract
OBJECTIVE Social determinants of health (SDoH) are nonclinical dispositions that impact patient health risks and clinical outcomes. Leveraging SDoH in clinical decision-making can potentially improve diagnosis, treatment planning, and patient outcomes. Despite increased interest in capturing SDoH in electronic health records (EHRs), such information is typically locked in unstructured clinical notes. Natural language processing (NLP) is the key technology to extract SDoH information from clinical text and expand its utility in patient care and research. This article presents a systematic review of the state-of-the-art NLP approaches and tools that focus on identifying and extracting SDoH data from unstructured clinical text in EHRs. MATERIALS AND METHODS A broad literature search was conducted in February 2021 using 3 scholarly databases (ACL Anthology, PubMed, and Scopus) following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A total of 6402 publications were initially identified, and after applying the study inclusion criteria, 82 publications were selected for the final review. RESULTS Smoking status (n = 27), substance use (n = 21), homelessness (n = 20), and alcohol use (n = 15) are the most frequently studied SDoH categories. Homelessness (n = 7) and other less-studied SDoH (eg, education, financial problems, social isolation and support, family problems) are mostly identified using rule-based approaches. In contrast, machine learning approaches are popular for identifying smoking status (n = 13), substance use (n = 9), and alcohol use (n = 9). CONCLUSION NLP offers significant potential to extract SDoH data from narrative clinical notes, which in turn can aid in the development of screening tools, risk prediction models, and clinical decision support systems.
Collapse
Affiliation(s)
- Braja G Patra
- Department of Population Health Sciences, Weill Cornell Medicine, New York, New York, USA
| | - Mohit M Sharma
- Department of Population Health Sciences, Weill Cornell Medicine, New York, New York, USA
| | - Veer Vekaria
- Department of Population Health Sciences, Weill Cornell Medicine, New York, New York, USA
| | - Prakash Adekkanattu
- Information Technologies and Services, Weill Cornell Medicine, New York, New York, USA
| | - Olga V Patterson
- Department of Internal Medicine, Division of Epidemiology, University of Utah, Salt Lake City, Utah, USA
- US Department of Veterans Affairs, Salt Lake City, Utah, USA
| | | | - Lauren A Lepow
- Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Euijung Ryu
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, Minnesota, USA
| | - Joanna M Biernacka
- Department of Quantitative Health Sciences, Mayo Clinic, Rochester, Minnesota, USA
| | | | - Thomas J George
- Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, Florida, USA
| | - William Hogan
- Division of Hematology & Oncology, Department of Medicine, College of Medicine, University of Florida, Gainesville, Florida, USA, and
| | - Yonghui Wu
- Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, Florida, USA
| | - Xi Yang
- Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, Florida, USA
| | - Jiang Bian
- Department of Health Outcomes and Biomedical Informatics, University of Florida, Gainesville, Florida, USA
| | - Myrna Weissman
- Vagelos College of Physicians and Surgeons, Columbia University, New York, New York, USA
| | - Priya Wickramaratne
- Vagelos College of Physicians and Surgeons, Columbia University, New York, New York, USA
| | - J John Mann
- Vagelos College of Physicians and Surgeons, Columbia University, New York, New York, USA
| | - Mark Olfson
- Vagelos College of Physicians and Surgeons, Columbia University, New York, New York, USA
| | - Thomas R Campion
- Department of Population Health Sciences, Weill Cornell Medicine, New York, New York, USA
- Information Technologies and Services, Weill Cornell Medicine, New York, New York, USA
| | - Mark Weiner
- Department of Population Health Sciences, Weill Cornell Medicine, New York, New York, USA
| | - Jyotishman Pathak
- Department of Population Health Sciences, Weill Cornell Medicine, New York, New York, USA
| |
Collapse
|
7
|
Abstract
As an indicator of healthcare quality and performance, hospital readmission incurs major costs for healthcare systems worldwide. Understanding the relationships between readmission factors, such as input features and readmission length, is challenging following intricate hospital readmission procedures. This study discovered the significant correlation between potential readmission factors (threshold of various settings for readmission length) and basic demographic variables. Association rule mining (ARM), particularly the Apriori algorithm, was utilised to extract the hidden input variable patterns and relationships among admitted patients by generating supervised learning rules. The mined rules were categorised into two outcomes to comprehend readmission data; (i) the rules associated with various readmission length and (ii) several expert-validated variables related to basic demographics (gender, race, and age group). The extracted rules proved useful to facilitate decision-making and resource preparation to minimise patient readmission.
Collapse
|
8
|
Miswan NH, Chan CS, Ng CG. Predictive modelling of hospital readmission: Evaluation of different preprocessing techniques on machine learning classifiers. INTELL DATA ANAL 2021. [DOI: 10.3233/ida-205468] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Hospital readmission is a major cost for healthcare systems worldwide. If patients with a higher potential of readmission could be identified at the start, existing resources could be used more efficiently, and appropriate plans could be implemented to reduce the risk of readmission. Therefore, it is important to predict the right target patients. Medical data is usually noisy, incomplete, and inconsistent. Hence, before developing a prediction model, it is crucial to efficiently set up the predictive model so that improved predictive performance is achieved. The current study aims to analyse the impact of different preprocessing methods on the performance of different machine learning classifiers. The preprocessing applied by previous hospital readmission studies were compared, and the most common approaches highlighted such as missing value imputation, feature selection, data balancing, and feature scaling. The hyperparameters were selected using Bayesian optimisation. The different preprocessing pipelines were assessed using various performance metrics and computational costs. The results indicated that the preprocessing approaches helped improve the model’s prediction of hospital readmission.
Collapse
Affiliation(s)
- Nor Hamizah Miswan
- Centre of Image and Signal Processing, Department of Artificial Intelligence, Faculty of Computer Science and Information Technology, University of Malaya, Kuala Lumpur, Malaysia
- Department of Mathematical Sciences, Faculty of Science and Technology, Universiti Kebangsaan Malaysia, UKM Bangi, Selangor, Malaysia
| | - Chee Seng Chan
- Centre of Image and Signal Processing, Department of Artificial Intelligence, Faculty of Computer Science and Information Technology, University of Malaya, Kuala Lumpur, Malaysia
| | - Chong Guan Ng
- Department of Psychological Medicine, Faculty of Medicine, University of Malaya, Kuala Lumpur, Malaysia
| |
Collapse
|
9
|
Bompelli A, Wang Y, Wan R, Singh E, Zhou Y, Xu L, Oniani D, Kshatriya BSA, Balls-Berry J(JE, Zhang R. Social and Behavioral Determinants of Health in the Era of Artificial Intelligence with Electronic Health Records: A Scoping Review. HEALTH DATA SCIENCE 2021; 2021:9759016. [PMID: 38487504 PMCID: PMC10880156 DOI: 10.34133/2021/9759016] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Accepted: 06/28/2021] [Indexed: 03/17/2024]
Abstract
Background. There is growing evidence that social and behavioral determinants of health (SBDH) play a substantial effect in a wide range of health outcomes. Electronic health records (EHRs) have been widely employed to conduct observational studies in the age of artificial intelligence (AI). However, there has been limited review into how to make the most of SBDH information from EHRs using AI approaches.Methods. A systematic search was conducted in six databases to find relevant peer-reviewed publications that had recently been published. Relevance was determined by screening and evaluating the articles. Based on selected relevant studies, a methodological analysis of AI algorithms leveraging SBDH information in EHR data was provided.Results. Our synthesis was driven by an analysis of SBDH categories, the relationship between SBDH and healthcare-related statuses, natural language processing (NLP) approaches for extracting SBDH from clinical notes, and predictive models using SBDH for health outcomes.Discussion. The associations between SBDH and health outcomes are complicated and diverse; several pathways may be involved. Using NLP technology to support the extraction of SBDH and other clinical ideas simplifies the identification and extraction of essential concepts from clinical data, efficiently unlocks unstructured data, and aids in the resolution of unstructured data-related issues.Conclusion. Despite known associations between SBDH and diseases, SBDH factors are rarely investigated as interventions to improve patient outcomes. Gaining knowledge about SBDH and how SBDH data can be collected from EHRs using NLP approaches and predictive models improves the chances of influencing health policy change for patient wellness, ultimately promoting health and health equity.
Collapse
Affiliation(s)
- Anusha Bompelli
- Department of Pharmaceutical Care & Health Systems, University of Minnesota, USA
| | - Yanshan Wang
- Department of Health Information Management, University of Pittsburgh, USA
| | - Ruyuan Wan
- Department of Computer Science, University of Minnesota, USA
| | - Esha Singh
- Department of Computer Science, University of Minnesota, USA
| | - Yuqi Zhou
- Institute for Health Informatics and College of Pharmacy, University of Minnesota, USA
| | - Lin Xu
- Carlson School of Business, University of Minnesota, USA
| | - David Oniani
- Department of Computer Science and Mathematics, Luther College, USA
| | | | | | - Rui Zhang
- Institute for Health Informatics, Department of Pharmaceutical Care & Health Systems, University of Minnesota, USA
| |
Collapse
|
10
|
Reeves RM, Christensen L, Brown JR, Conway M, Levis M, Gobbel GT, Shah RU, Goodrich C, Ricket I, Minter F, Bohm A, Bray BE, Matheny ME, Chapman W. Adaptation of an NLP system to a new healthcare environment to identify social determinants of health. J Biomed Inform 2021; 120:103851. [PMID: 34174396 DOI: 10.1016/j.jbi.2021.103851] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2021] [Revised: 06/16/2021] [Accepted: 06/21/2021] [Indexed: 11/18/2022]
Abstract
Social determinants of health (SDoH) are increasingly important factors for population health, healthcare outcomes, and care delivery. However, many of these factors are not reliably captured within structured electronic health record (EHR) data. In this work, we evaluated and adapted a previously published NLP tool to include additional social risk factors for deployment at Vanderbilt University Medical Center in an Acute Myocardial Infarction cohort. We developed a transformation of the SDoH outputs of the tool into the OMOP common data model (CDM) for re-use across many potential use cases, yielding performance measures across 8 SDoH classes of precision 0.83 recall 0.74 and F-measure of 0.78.
Collapse
Affiliation(s)
- Ruth M Reeves
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, United States; Geriatric Research Education and Clinical Care Center, Tennessee Valley Healthcare System VA, Nashville, TN, United States.
| | - Lee Christensen
- Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT, United States
| | - Jeremiah R Brown
- Department of Epidemiology and Biomedical Data Science, Dartmouth Geisel School of Medicine, Hanover, NH, United States
| | - Michael Conway
- Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT, United States
| | - Maxwell Levis
- Department of Epidemiology and Biomedical Data Science, Dartmouth Geisel School of Medicine, Hanover, NH, United States
| | - Glenn T Gobbel
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, United States; Division of General Internal Medicine, Vanderbilt University Medical Center, Nashville, TN, United States; Geriatric Research Education and Clinical Care Center, Tennessee Valley Healthcare System VA, Nashville, TN, United States
| | - Rashmee U Shah
- Division of Cardiovascular Medicine, University of Utah School of Medicine, Salt Lake City, UT, United States
| | - Christine Goodrich
- Department of Epidemiology and Biomedical Data Science, Dartmouth Geisel School of Medicine, Hanover, NH, United States
| | - Iben Ricket
- Department of Epidemiology and Biomedical Data Science, Dartmouth Geisel School of Medicine, Hanover, NH, United States
| | - Freneka Minter
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, United States
| | - Andrew Bohm
- Department of Epidemiology and Biomedical Data Science, Dartmouth Geisel School of Medicine, Hanover, NH, United States
| | - Bruce E Bray
- Division of Cardiovascular Medicine, University of Utah School of Medicine, Salt Lake City, UT, United States; Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT, United States
| | - Michael E Matheny
- Department of Biomedical Informatics, Vanderbilt University Medical Center, Nashville, TN, United States; Department of Biostatistics, Vanderbilt University Medical Center, Nashville, TN, United States; Division of General Internal Medicine, Vanderbilt University Medical Center, Nashville, TN, United States; Geriatric Research Education and Clinical Care Center, Tennessee Valley Healthcare System VA, Nashville, TN, United States
| | - Wendy Chapman
- Department of Biomedical Informatics, University of Utah School of Medicine, Salt Lake City, UT, United States; Centre for Clinical and Public Health Informatics, University of Melbourne, Melbourne, Australia
| |
Collapse
|
11
|
Kurowski JA, Milinovich A, Ji X, Bauman J, Sugano D, Kattan MW, Achkar JP. Differences in Biologic Utilization and Surgery Rates in Pediatric and Adult Crohn's Disease: Results From a Large Electronic Medical Record-derived Cohort. Inflamm Bowel Dis 2021; 27:1035-1044. [PMID: 32914165 DOI: 10.1093/ibd/izaa239] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/27/2020] [Indexed: 12/31/2022]
Abstract
BACKGROUND AND AIMS Crohn's disease (CD) is a chronic illness that affects both the pediatric and adult populations with an increasing worldwide prevalence. We aim to identify a large, single-center cohort of patients with CD using natural language processing (NLP) in combination with codified data and extract surgical rates and medication usage from the electronic medical record (EMR). METHODS Patients with CD were identified from the entire Cleveland Clinic EMR using ICD codes and CD-specific terms identified by NLP to fit a logistic regression model. Cohorts were developed for pediatric-onset (younger than 18 years) and adult-onset (18 years and older) CD. Surgeries were identified using current procedural terminology (CPT) codes and NLP. Crohn's disease-related medications were extracted using physician orders in the EMR. RESULTS Patients with pediatric-onset (n = 2060) and adult-onset (n = 4973) CD were identified from 2000 to 2017 with a positive predictive value of 98.5%. Rate of CD-related abdominal surgery over time was significantly higher in adult-onset compared with pediatric-onset CD (10-year surgery rate 49.9% vs 37.7%, respectively; P < 0.001). Treatment with biologics was significantly higher in pediatric vs adult-onset CD cohorts (63.6% vs 49.2%; P < 0.001). The overall rate of CD-related abdominal surgery was significantly higher in those who received <6 months of a biologic compared with ≥6 months of a biologic for both cohorts (pediatric 64.1% vs 39.1%, P ≤ 0.001; adult 69.3% vs 56.5%, P ≤ 0.001). Additionally, 60.9% in pediatric-onset CD and 43.5% in adult-onset CD treated with ≥6 months of biologic therapy have not required abdominal surgery. On multivariable analysis, perianal surgery was a significant risk factor for abdominal surgery in both cohorts. CONCLUSION We used a combination of codified and NLP data to establish the largest, North American, single-center EMR cohort of pediatric- and adult-onset CD patients and determined that biologics are associated with lower rates of surgery over time, potentially altering the natural history of the disease.
Collapse
Affiliation(s)
- Jacob A Kurowski
- Pediatric Gastroenterology, Hepatology & Nutrition; Cleveland Clinic Children's, Cleveland, Ohio, USA
| | - Alex Milinovich
- Quantitative Health Sciences, Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio, USA
| | - Xinge Ji
- Quantitative Health Sciences, Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio, USA
| | - Janine Bauman
- Quantitative Health Sciences, Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio, USA
| | - David Sugano
- Quantitative Health Sciences, Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio, USA
| | - Michael W Kattan
- Quantitative Health Sciences, Lerner Research Institute, Cleveland Clinic, Cleveland, Ohio, USA
| | - Jean-Paul Achkar
- Gastroenterology, Hepatology & Nutrition, Cleveland Clinic, Cleveland, Ohio, USA
| |
Collapse
|
12
|
Oliwa T, Furner B, Schmitt J, Schneider J, Ridgway JP. Development of a predictive model for retention in HIV care using natural language processing of clinical notes. J Am Med Inform Assoc 2021; 28:104-112. [PMID: 33150369 DOI: 10.1093/jamia/ocaa220] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Revised: 07/10/2020] [Accepted: 08/24/2020] [Indexed: 11/14/2022] Open
Abstract
OBJECTIVE Adherence to a treatment plan from HIV-positive patients is necessary to decrease their mortality and improve their quality of life, however some patients display poor appointment adherence and become lost to follow-up (LTFU). We applied natural language processing (NLP) to analyze indications towards or against LTFU in HIV-positive patients' notes. MATERIALS AND METHODS Unstructured lemmatized notes were labeled with an LTFU or Retained status using a 183-day threshold. An NLP and supervised machine learning system with a linear model and elastic net regularization was trained to predict this status. Prevalence of characteristics domains in the learned model weights were evaluated. RESULTS We analyzed 838 LTFU vs 2964 Retained notes and obtained a weighted F1 mean of 0.912 via nested cross-validation; another experiment with notes from the same patients in both classes showed substantially lower metrics. "Comorbidities" were associated with LTFU through, for instance, "HCV" (hepatitis C virus) and likewise "Good adherence" with Retained, represented with "Well on ART" (antiretroviral therapy). DISCUSSION Mentions of mental health disorders and substance use were associated with disparate retention outcomes, however history vs active use was not investigated. There remains further need to model transitions between LTFU and being retained in care over time. CONCLUSION We provided an important step for the future development of a model that could eventually help to identify patients who are at risk for falling out of care and to analyze which characteristics could be factors for this. Further research is needed to enhance this method with structured electronic medical record fields.
Collapse
Affiliation(s)
- Tomasz Oliwa
- Center for Research Informatics, University of Chicago, Chicago, Illinois, USA
| | - Brian Furner
- Center for Research Informatics, University of Chicago, Chicago, Illinois, USA
| | - Jessica Schmitt
- Department of Medicine, University of Chicago, Chicago, Illinois, USA.,Chicago Center for HIV Elimination, University of Chicago, Chicago, Illinois, USA
| | - John Schneider
- Department of Medicine, University of Chicago, Chicago, Illinois, USA.,Chicago Center for HIV Elimination, University of Chicago, Chicago, Illinois, USA
| | - Jessica P Ridgway
- Department of Medicine, University of Chicago, Chicago, Illinois, USA.,Chicago Center for HIV Elimination, University of Chicago, Chicago, Illinois, USA
| |
Collapse
|
13
|
Thieu T, Maldonado JC, Ho PS, Ding M, Marr A, Brandt D, Newman-Griffis D, Zirikly A, Chan L, Rasch E. A comprehensive study of mobility functioning information in clinical notes: Entity hierarchy, corpus annotation, and sequence labeling. Int J Med Inform 2021; 147:104351. [PMID: 33401169 PMCID: PMC8104034 DOI: 10.1016/j.ijmedinf.2020.104351] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Revised: 08/10/2020] [Accepted: 11/22/2020] [Indexed: 01/19/2023]
Abstract
BACKGROUND Secondary use of Electronic Health Records (EHRs) has mostly focused on health conditions (diseases and drugs). Function is an important health indicator in addition to morbidity and mortality. Nevertheless, function has been overlooked in accessing patients' health status. The World Health Organization (WHO)'s International Classification of Functioning, Disability and Health (ICF) is considered the international standard for describing and coding function and health states. We pioneer the first comprehensive analysis and identification of functioning concepts in the Mobility domain of the ICF. RESULTS Using physical therapy notes at the National Institutes of Health's Clinical Center, we induced a hierarchical order of mobility-related entities including 5 entities types, 3 relations, 8 attributes, and 33 attribute values. Two domain experts manually curated a gold standard corpus of 14,281 nested entity mentions from 400 clinical notes. Inter-annotator agreement (IAA) of exact matching averaged 92.3 % F1-score on mention text spans, and 96.6 % Cohen's kappa on attributes assignments. A high-performance Ensemble machine learning model for named entity recognition (NER) was trained and evaluated using the gold standard corpus. Average F1-score on exact entity matching of our Ensemble method (84.90 %) outperformed popular NER methods: Conditional Random Field (80.4 %), Recurrent Neural Network (81.82 %), and Bidirectional Encoder Representations from Transformers (82.33 %). CONCLUSIONS The results of this study show that mobility functioning information can be reliably captured from clinical notes once adequate resources are provided for sequence labeling methods. We expect that functioning concepts in other domains of the ICF can be identified in similar fashion.
Collapse
Affiliation(s)
- Thanh Thieu
- Oklahoma State University, Stillwater, OK, United States.
| | | | - Pei-Shu Ho
- National Institutes of Health Clinical Center, Bethesda, MD, United States
| | - Min Ding
- National Institute of Standards and Technology, Gaithersburg, MD, United States
| | - Alex Marr
- National Institutes of Health Clinical Center, Bethesda, MD, United States
| | - Diane Brandt
- Social Security Advisory Board, Washington, DC, United States
| | - Denis Newman-Griffis
- National Institutes of Health Clinical Center, Bethesda, MD, United States; Ohio State University, Columbus, OH, United States
| | - Ayah Zirikly
- National Institutes of Health Clinical Center, Bethesda, MD, United States
| | - Leighton Chan
- National Institutes of Health Clinical Center, Bethesda, MD, United States
| | - Elizabeth Rasch
- National Institutes of Health Clinical Center, Bethesda, MD, United States
| |
Collapse
|
14
|
Newman-Griffis D, Fosler-Lussier E. Automated Coding of Under-Studied Medical Concept Domains: Linking Physical Activity Reports to the International Classification of Functioning, Disability, and Health. Front Digit Health 2021; 3:620828. [PMID: 33791684 PMCID: PMC8009547 DOI: 10.3389/fdgth.2021.620828] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2020] [Accepted: 02/16/2021] [Indexed: 11/13/2022] Open
Abstract
Linking clinical narratives to standardized vocabularies and coding systems is a key component of unlocking the information in medical text for analysis. However, many domains of medical concepts, such as functional outcomes and social determinants of health, lack well-developed terminologies that can support effective coding of medical text. We present a framework for developing natural language processing (NLP) technologies for automated coding of medical information in under-studied domains, and demonstrate its applicability through a case study on physical mobility function. Mobility function is a component of many health measures, from post-acute care and surgical outcomes to chronic frailty and disability, and is represented as one domain of human activity in the International Classification of Functioning, Disability, and Health (ICF). However, mobility and other types of functional activity remain under-studied in the medical informatics literature, and neither the ICF nor commonly-used medical terminologies capture functional status terminology in practice. We investigated two data-driven paradigms, classification and candidate selection, to link narrative observations of mobility status to standardized ICF codes, using a dataset of clinical narratives from physical therapy encounters. Recent advances in language modeling and word embedding were used as features for established machine learning models and a novel deep learning approach, achieving a macro-averaged F-1 score of 84% on linking mobility activity reports to ICF codes. Both classification and candidate selection approaches present distinct strengths for automated coding in under-studied domains, and we highlight that the combination of (i) a small annotated data set; (ii) expert definitions of codes of interest; and (iii) a representative text corpus is sufficient to produce high-performing automated coding systems. This research has implications for continued development of language technologies to analyze functional status information, and the ongoing growth of NLP tools for a variety of specialized applications in clinical care and research.
Collapse
Affiliation(s)
- Denis Newman-Griffis
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, United States
- Epidemiology & Biostatistics Section, Rehabilitation Medicine Department, National Institutes of Health Clinical Center, Bethesda, MD, United States
| | - Eric Fosler-Lussier
- Department of Computer Science and Engineering, The Ohio State University, Columbus, OH, United States
| |
Collapse
|
15
|
de Albuquerque NLS, de Araujo TL, de Oliveira Lopes MV, Moreira TMM. Hierarchical analysis of factors associated with hospital readmissions for coronary heart disease: A case-control study. J Clin Nurs 2020; 29:2329-2337. [PMID: 32222077 DOI: 10.1111/jocn.15244] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Revised: 01/18/2020] [Accepted: 03/14/2020] [Indexed: 12/20/2022]
Abstract
AIMS AND OBJECTIVES To analyse, hierarchically, factors associated with hospital readmissions for acute coronary syndrome. BACKGROUND Hospital readmissions have risen, especially in patients with multiple comorbidities, which are most often chronic. The leading causes of hospital readmission include acute coronary syndrome, which is costly and often preventable. Determining clinical and nonclinical variables that increase the chances of readmission is important to assess and evaluate patients hospitalised for coronary heart diseases. DESIGN A case-control study whose dependent variable was hospital readmission for acute coronary syndrome. METHODS The study included 277 inpatients, of whom 132 were in their first hospitalisation and 145 had already been hospitalised for acute coronary syndrome. The independent variables for this hierarchical model were sociodemographic conditions, life habits, access to health services and physical health measures. Data were obtained by interviews, anthropometric measurements and patient records. Logistic regression analysis was performed using the stepwise technique, with Microsoft Excel and R version 3.2.3. The research was reported via strengthening the reporting of observational studies in epidemiology (STROBE). RESULTS In the final hierarchical logistic model, the following risk factors were associated with readmission for acute coronary syndrome: inadequate drug therapy adherence, stress, history of smoking for 30 years or more, and the lack of use of primary healthcare services. CONCLUSIONS Clinical and nonclinical variables are related to hospital readmission for acute coronary syndrome and can increase the chance of readmission by up to six times. RELEVANCE TO CLINICAL PRACTICE The predictive model can be used to avoid readmission for acute coronary syndrome, and it represents an advance in the prediction of the occurrence of the outcome. This implies the need for a reorientation of the network for postdischarge care in the first hospitalisation for acute coronary syndrome.
Collapse
|
16
|
Koleck TA, Dreisbach C, Bourne PE, Bakken S. Natural language processing of symptoms documented in free-text narratives of electronic health records: a systematic review. J Am Med Inform Assoc 2020; 26:364-379. [PMID: 30726935 DOI: 10.1093/jamia/ocy173] [Citation(s) in RCA: 200] [Impact Index Per Article: 50.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2018] [Revised: 11/20/2018] [Accepted: 11/27/2018] [Indexed: 12/26/2022] Open
Abstract
OBJECTIVE Natural language processing (NLP) of symptoms from electronic health records (EHRs) could contribute to the advancement of symptom science. We aim to synthesize the literature on the use of NLP to process or analyze symptom information documented in EHR free-text narratives. MATERIALS AND METHODS Our search of 1964 records from PubMed and EMBASE was narrowed to 27 eligible articles. Data related to the purpose, free-text corpus, patients, symptoms, NLP methodology, evaluation metrics, and quality indicators were extracted for each study. RESULTS Symptom-related information was presented as a primary outcome in 14 studies. EHR narratives represented various inpatient and outpatient clinical specialties, with general, cardiology, and mental health occurring most frequently. Studies encompassed a wide variety of symptoms, including shortness of breath, pain, nausea, dizziness, disturbed sleep, constipation, and depressed mood. NLP approaches included previously developed NLP tools, classification methods, and manually curated rule-based processing. Only one-third (n = 9) of studies reported patient demographic characteristics. DISCUSSION NLP is used to extract information from EHR free-text narratives written by a variety of healthcare providers on an expansive range of symptoms across diverse clinical specialties. The current focus of this field is on the development of methods to extract symptom information and the use of symptom information for disease classification tasks rather than the examination of symptoms themselves. CONCLUSION Future NLP studies should concentrate on the investigation of symptoms and symptom documentation in EHR free-text narratives. Efforts should be undertaken to examine patient characteristics and make symptom-related NLP algorithms or pipelines and vocabularies openly available.
Collapse
Affiliation(s)
| | - Caitlin Dreisbach
- School of Nursing, University of Virginia, Charlottesville, Virginia, USA.,Data Science Institute, University of Virginia, Charlottesville, Virginia, USA
| | - Philip E Bourne
- Data Science Institute, University of Virginia, Charlottesville, Virginia, USA
| | - Suzanne Bakken
- School of Nursing, Columbia University, New York, New York, USA.,Department of Biomedical Informatics, Columbia University, New York, New York, USA.,Data Science Institute, Columbia University, New York, New York, USA
| |
Collapse
|
17
|
Clinical and Sociobehavioral Prediction Model of 30-Day Hospital Readmissions Among People With HIV and Substance Use Disorder: Beyond Electronic Health Record Data. J Acquir Immune Defic Syndr 2019; 80:330-341. [PMID: 30763292 DOI: 10.1097/qai.0000000000001925] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
BACKGROUND Under the Affordable Care Act, hospitals receive reduced reimbursements for excessive 30-day readmissions. However, the Centers for Medicare and Medicaid Services does not consider social and behavioral variables in expected readmission rate calculations, which may unfairly penalize systems caring for socially disadvantaged patients, including patients with HIV. SETTING Randomized controlled trial of patient navigation with or without financial incentives in HIV-positive substance users recruited from the inpatient setting at 11 US hospitals. METHODS External validation of an existing 30-day readmission prediction model, using variables available in the electronic health record (EHR-only model), in a new multicenter cohort of HIV-positive substance users was assessed by C-statistic and Hosmer-Lemeshow testing. A second model evaluated sociobehavioral factors in improving the prediction model (EHR-plus model) using multivariable regression and C-statistic with cross-validation. RESULTS The mean age of the cohort was 44.1 years, and participants were predominantly males (67.4%), non-white (88.0%), and poor (62.8%, <$20,000/year). Overall, 17.5% individuals had a hospital readmission within 30 days of initial hospital discharge. The EHR-only model resulted in a C-statistic of 0.65 (95% confidence interval: 0.60 to 0.70). Inclusion of additional sociobehavioral variables, food insecurity and readiness for substance use treatment, in the EHR-plus model resulted in a C-statistic of 0.74 (0.71 after cross-validation, 95% confidence interval: 0.64 to 0.77). CONCLUSIONS Incorporation of detailed social and behavioral variables substantially improved the performance of a 30-day readmission prediction model for hospitalized HIV-positive substance users. Our findings highlight the importance of social determinants in readmission risk and the need to ask about, adjust for, and address them.
Collapse
|
18
|
Marceaux JC, Soble JR, O'Rourke JJF, Swan AA, Wells M, Amuan M, Sagiraju HKR, Eapen BC, Pugh MJ. Validity of early-onset dementia diagnoses in VA electronic medical record administrative data. Clin Neuropsychol 2019; 34:1175-1189. [PMID: 31645200 DOI: 10.1080/13854046.2019.1679889] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
OBJECTIVE To determine the validity of diagnoses indicative of early-onset dementia (EOD) obtained from an algorithm using administrative data, we examined Veterans Health Administration (VHA) electronic medical records (EMRs). METHOD A previously used method of identifying cases of dementia using administrative data was applied to a random sample of 176 cases of Post-9/11 deployed veterans under 65 years of age. Retrospective, cross-sectional examination of EMRs was conducted, using a combination of administrative data, chart abstraction, and review/consensus by board-certified neuropsychologists. RESULTS Approximately 73% of EOD diagnoses identified using existing algorithms were identified as false positives in the overall sample. This increased to approximately 76% among those with mental health conditions and approximately 85% among those with mild traumatic brain injury (TBI; i.e. concussion). Factors related to improved diagnostic accuracy included more severe TBI, diagnosing clinician type, presence of neuroimaging data, absence of a comorbid mental health condition diagnosis, and older age at time of diagnosis. CONCLUSIONS A previously used algorithm for detecting dementia using VHA administrative data was not supported for use in the younger adult samples and resulted in an unacceptably high number of false positives. Based on these findings, there is concern for possible misclassification in population studies using similar algorithms to identify rates of EOD among veterans. Further, we provide suggestions to develop an enhanced algorithm for more accurate dementia surveillance among younger populations.
Collapse
Affiliation(s)
- Janice C Marceaux
- Psychology Service, South Texas Veterans Health Care System San Antonio, TX, USA.,Department of Neurology, University of Texas Health Science Center, San Antonio, TX, USA
| | - Jason R Soble
- Psychology Service, South Texas Veterans Health Care System San Antonio, TX, USA.,Psychiatry & Neurology, Neuropsychiatric Institute, University of Illinois College of Medicine, Chicago, IL, USA
| | - Justin J F O'Rourke
- Psychology Service, South Texas Veterans Health Care System San Antonio, TX, USA
| | - Alicia A Swan
- Department of Psychology, University of Texas at San Antonio, San Antonio, TX, USA
| | - Margaret Wells
- Polytrauma Rehabilitation Center, South Texas Veterans Health Care System, San Antonio, TX, USA
| | - Megan Amuan
- VA Salt Lake City Health Care System, Informatics, Decision-Enhancement and Analytic Sciences Center, Salt Lake City, UT, USA
| | - Hari Krishna Raju Sagiraju
- Department of Internal Medicine, Division of Epidemiology, University of Utah School of Medicine, Salt Lake City, UT, USA
| | - Blessen C Eapen
- Polytrauma Rehabilitation Center, South Texas Veterans Health Care System, San Antonio, TX, USA.,Department of Rehabilitation Medicine, UT Health San Antonio, San Antonio, TX, USA
| | - Mary Jo Pugh
- VA Salt Lake City Health Care System, Informatics, Decision-Enhancement and Analytic Sciences Center, Salt Lake City, UT, USA.,Department of Internal Medicine, Division of Epidemiology, University of Utah School of Medicine, Salt Lake City, UT, USA
| |
Collapse
|
19
|
Newman-Griffis D, Porcino J, Zirikly A, Thieu T, Camacho Maldonado J, Ho PS, Ding M, Chan L, Rasch E. Broadening horizons: the case for capturing function and the role of health informatics in its use. BMC Public Health 2019; 19:1288. [PMID: 31615472 PMCID: PMC6794808 DOI: 10.1186/s12889-019-7630-3] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2018] [Accepted: 09/16/2019] [Indexed: 12/18/2022] Open
Abstract
Background Human activity and the interaction between health conditions and activity is a critical part of understanding the overall function of individuals. The World Health Organization’s International Classification of Functioning, Disability and Health (ICF) models function as all aspects of an individual’s interaction with the world, including organismal concepts such as individual body structures, functions, and pathologies, as well as the outcomes of the individual’s interaction with their environment, referred to as activity and participation. Function, particularly activity and participation outcomes, is an important indicator of health at both the level of an individual and the population level, as it is highly correlated with quality of life and a critical component of identifying resource needs. Since it reflects the cumulative impact of health conditions on individuals and is not disease specific, its use as a health indicator helps to address major barriers to holistic, patient-centered care that result from multiple, and often competing, disease specific interventions. While the need for better information on function has been widely endorsed, this has not translated into its routine incorporation into modern health systems. Purpose We present the importance of capturing information on activity as a core component of modern health systems and identify specific steps and analytic methods that can be used to make it more available to utilize in improving patient care. We identify challenges in the use of activity and participation information, such as a lack of consistent documentation and diversity of data specificity and representation across providers, health systems, and national surveys. We describe how activity and participation information can be more effectively captured, and how health informatics methodologies, including natural language processing (NLP), can enable automatically locating, extracting, and organizing this information on a large scale, supporting standardization and utilization with minimal additional provider burden. We examine the analytic requirements and potential challenges of capturing this information with informatics, and describe how data-driven techniques can combine with common standards and documentation practices to make activity and participation information standardized and accessible for improving patient care. Recommendations We recommend four specific actions to improve the capture and analysis of activity and participation information throughout the continuum of care: (1) make activity and participation annotation standards and datasets available to the broader research community; (2) define common research problems in automatically processing activity and participation information; (3) develop robust, machine-readable ontologies for function that describe the components of activity and participation information and their relationships; and (4) establish standards for how and when to document activity and participation status during clinical encounters. We further provide specific short-term goals to make significant progress in each of these areas within a reasonable time frame.
Collapse
Affiliation(s)
- Denis Newman-Griffis
- Rehabilitation Medicine Department, National Institutes of Health, Mark O. Hatfield Clinical Research Center, 6707 Democracy Boulevard, Suite 856, MSC 5493, Bethesda, MD, 20892, USA. .,Department of Computer Science and Engineering, The Ohio State University, 2015 Neil Avenue, DL 395, Columbus, OH, 43210, USA.
| | - Julia Porcino
- Rehabilitation Medicine Department, National Institutes of Health, Mark O. Hatfield Clinical Research Center, 6707 Democracy Boulevard, Suite 856, MSC 5493, Bethesda, MD, 20892, USA
| | - Ayah Zirikly
- Rehabilitation Medicine Department, National Institutes of Health, Mark O. Hatfield Clinical Research Center, 6707 Democracy Boulevard, Suite 856, MSC 5493, Bethesda, MD, 20892, USA
| | - Thanh Thieu
- Department of Computer Science, Oklahoma State University, 116-A MSCS, Stillwater, OK, 74078, USA
| | - Jonathan Camacho Maldonado
- Rehabilitation Medicine Department, National Institutes of Health, Mark O. Hatfield Clinical Research Center, 6707 Democracy Boulevard, Suite 856, MSC 5493, Bethesda, MD, 20892, USA
| | - Pei-Shu Ho
- Rehabilitation Medicine Department, National Institutes of Health, Mark O. Hatfield Clinical Research Center, 6707 Democracy Boulevard, Suite 856, MSC 5493, Bethesda, MD, 20892, USA
| | - Min Ding
- Information Technology Laboratory, National Institute of Standards and Technology, 100 Bureau Drive, Gaithersburg, MD, 20899, USA
| | - Leighton Chan
- Rehabilitation Medicine Department, National Institutes of Health, Mark O. Hatfield Clinical Research Center, 6707 Democracy Boulevard, Suite 856, MSC 5493, Bethesda, MD, 20892, USA
| | - Elizabeth Rasch
- Rehabilitation Medicine Department, National Institutes of Health, Mark O. Hatfield Clinical Research Center, 6707 Democracy Boulevard, Suite 856, MSC 5493, Bethesda, MD, 20892, USA
| |
Collapse
|
20
|
Conway M, Keyhani S, Christensen L, South BR, Vali M, Walter LC, Mowery DL, Abdelrahman S, Chapman WW. Moonstone: a novel natural language processing system for inferring social risk from clinical narratives. J Biomed Semantics 2019; 10:6. [PMID: 30975223 PMCID: PMC6458709 DOI: 10.1186/s13326-019-0198-0] [Citation(s) in RCA: 39] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2018] [Accepted: 03/18/2019] [Indexed: 11/10/2022] Open
Abstract
Background Social risk factors are important dimensions of health and are linked to access to care, quality of life, health outcomes and life expectancy. However, in the Electronic Health Record, data related to many social risk factors are primarily recorded in free-text clinical notes, rather than as more readily computable structured data, and hence cannot currently be easily incorporated into automated assessments of health. In this paper, we present Moonstone, a new, highly configurable rule-based clinical natural language processing system designed to automatically extract information that requires inferencing from clinical notes. Our initial use case for the tool is focused on the automatic extraction of social risk factor information — in this case, housing situation, living alone, and social support — from clinical notes. Nursing notes, social work notes, emergency room physician notes, primary care notes, hospital admission notes, and discharge summaries, all derived from the Veterans Health Administration, were used for algorithm development and evaluation. Results An evaluation of Moonstone demonstrated that the system is highly accurate in extracting and classifying the three variables of interest (housing situation, living alone, and social support). The system achieved positive predictive value (i.e. precision) scores ranging from 0.66 (homeless/marginally housed) to 0.98 (lives at home/not homeless), accuracy scores ranging from 0.63 (lives in facility) to 0.95 (lives alone), and sensitivity (i.e. recall) scores ranging from 0.75 (lives in facility) to 0.97 (lives alone). Conclusions The Moonstone system is — to the best of our knowledge — the first freely available, open source natural language processing system designed to extract social risk factors from clinical text with good (lives in facility) to excellent (lives alone) performance. Although developed with the social risk factor identification task in mind, Moonstone provides a powerful tool to address a range of clinical natural language processing tasks, especially those tasks that require nuanced linguistic processing in conjunction with inference capabilities.
Collapse
Affiliation(s)
- Mike Conway
- Department of Biomedical Informatics, 421 Wakara Way, University of Utah, alt Lake City, 84108, UT, USA.
| | - Salomeh Keyhani
- San Francisco VA Medical Center, 4150 Clement Street, San Francisco, 94121, CA, USA.,Department of Medicine, University of California San Francisco, 505 Parnassus Ave, San Francisco, 94143, CA, USA
| | - Lee Christensen
- Department of Biomedical Informatics, 421 Wakara Way, University of Utah, alt Lake City, 84108, UT, USA
| | - Brett R South
- Department of Biomedical Informatics, 421 Wakara Way, University of Utah, alt Lake City, 84108, UT, USA.,Salt Lake City VA Health Care System, 500 Foothill Drive, Salt Lake City, 84148, UT, USA
| | - Marzieh Vali
- San Francisco VA Medical Center, 4150 Clement Street, San Francisco, 94121, CA, USA
| | - Louise C Walter
- San Francisco VA Medical Center, 4150 Clement Street, San Francisco, 94121, CA, USA.,Department of Medicine, University of California San Francisco, 505 Parnassus Ave, San Francisco, 94143, CA, USA
| | - Danielle L Mowery
- Department of Biomedical Informatics, 421 Wakara Way, University of Utah, alt Lake City, 84108, UT, USA.,Salt Lake City VA Health Care System, 500 Foothill Drive, Salt Lake City, 84148, UT, USA
| | - Samir Abdelrahman
- Department of Biomedical Informatics, 421 Wakara Way, University of Utah, alt Lake City, 84108, UT, USA
| | - Wendy W Chapman
- Department of Biomedical Informatics, 421 Wakara Way, University of Utah, alt Lake City, 84108, UT, USA.,Salt Lake City VA Health Care System, 500 Foothill Drive, Salt Lake City, 84148, UT, USA
| |
Collapse
|
21
|
Zhu VJ, Lenert LA, Bunnell BE, Obeid JS, Jefferson M, Hughes-Halbert CA. Automatically identifying social isolation from clinical narratives for patients with prostate Cancer. BMC Med Inform Decis Mak 2019; 19:43. [PMID: 30871518 PMCID: PMC6416852 DOI: 10.1186/s12911-019-0795-y] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2018] [Accepted: 03/07/2019] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND Social isolation is an important social determinant that impacts health outcomes and mortality among patients. The National Academy of Medicine recently recommended that social isolation be documented in electronic health records (EHR). However, social isolation usually is not recorded or obtained as coded data but rather collected from patient self-report or documented in clinical narratives. This study explores the feasibility and effectiveness of natural language processing (NLP) strategy for identifying patients who are socially isolated from clinical narratives. METHOD We used data from the Medical University of South Carolina (MUSC) Research Data Warehouse. Patients 18 years-of-age or older who were diagnosed with prostate cancer between January 1, 2014 and May 31, 2017 were eligible for this study. NLP pipelines identifying social isolation were developed via extraction of notes on progress, history and physical, consult, emergency department provider, telephone encounter, discharge summary, plan of care, and radiation oncology. Of 4195 eligible prostate cancer patients, we randomly sampled 3138 patients (75%) as a training dataset. The remaining 1057 patients (25%) were used as a test dataset to evaluate NLP algorithm performance. Standard performance measures for the NLP algorithm, including precision, recall, and F-measure, were assessed by expert manual review using the test dataset. RESULTS A total of 55,516 clinical notes from 3138 patients were included to develop the lexicon and NLP pipelines for social isolation. Of those, 35 unique patients (1.2%) had social isolation mention(s) in 217 notes. Among 24 terms relevant to social isolation, the most prevalent were "lack of social support," "lonely," "social isolation," "no friends," and "loneliness". Among 1057 patients in the test dataset, 17 patients (1.6%) were identified as having social isolation mention(s) in 40 clinical notes. Manual review identified four false positive mentions of social isolation and one false negatives in 154 notes from randomly selected 52 controls. The NLP pipeline demonstrated 90% precision, 97% recall, and 93% F-measure. The major reasons for a false positive included the ambiguities of the experiencer of social isolation, negation, and alternate meaning of words. CONCLUSIONS Our NLP algorithms demonstrate a highly accurate approach to identify social isolation.
Collapse
Affiliation(s)
- Vivienne J Zhu
- Biomedical Informatics Center at Medical University of South Carolina, Chalrleston, South Carolina USA
| | - Leslie A Lenert
- Biomedical Informatics Center at Medical University of South Carolina, Chalrleston, South Carolina USA
| | - Brian E Bunnell
- Biomedical Informatics Center at Medical University of South Carolina, Chalrleston, South Carolina USA
| | - Jihad S Obeid
- Biomedical Informatics Center at Medical University of South Carolina, Chalrleston, South Carolina USA
| | - Melanie Jefferson
- Holling Cancer Center and Department of Psychiatry and Behavioral Sciences at Medical University of South Carolina, Charleston, South Carolina USA
| | - Chanita A Hughes-Halbert
- Holling Cancer Center and Department of Psychiatry and Behavioral Sciences at Medical University of South Carolina, Charleston, South Carolina USA
| |
Collapse
|
22
|
Artetxe A, Beristain A, Graña M. Predictive models for hospital readmission risk: A systematic review of methods. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 164:49-64. [PMID: 30195431 DOI: 10.1016/j.cmpb.2018.06.006] [Citation(s) in RCA: 68] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2017] [Revised: 05/03/2018] [Accepted: 06/05/2018] [Indexed: 06/08/2023]
Abstract
OBJECTIVES Hospital readmission risk prediction facilitates the identification of patients potentially at high risk so that resources can be used more efficiently in terms of cost-benefit. In this context, several models for readmission risk prediction have been proposed in recent years. The goal of this review is to give an overview of prediction models for hospital readmission, describe the data analysis methods and algorithms used for building the models, and synthesize their results. METHODS Studies that reported the predictive performance of a model for hospital readmission risk were included. We defined the scope of the review and accordingly built a search query to select the candidate papers. This query string was used as input for the chosen search engines, namely PubMed and Google Scholar. For each study, we recorded the population, feature selection method, classification algorithm, sample size, readmission threshold, readmission rate and predictive performance of the model. RESULTS We identified 77 studies that met the inclusion criteria, out of 265 citations. In 68% of the studies (n = 52) logistic regression or other regression techniques were utilized as the main method. Ten (13%) studies used survival analysis for model construction, while 14 (18%) used machine learning techniques for classification, of which decision tree-based methods and SVM were the most utilized algorithms. Among these, only four studies reported the use of any class imbalance addressing technique, of which resampling is the most frequent (75%). The performance of the models varied significantly among studies, with Area Under the ROC Curve (AUC) values in the ranges between 0.54 and 0.92. CONCLUSION Logistic regression and survival analysis have been traditionally the most widely used techniques for model building. Nevertheless, machine learning techniques are becoming increasingly popular in recent years. Recent comparative studies suggest that machine learning techniques can improve prediction ability over traditional statistical approaches. Regardless, the lack of an appropriate benchmark dataset of hospital readmissions makes a comparison of models' performance across different studies difficult.
Collapse
Affiliation(s)
- Arkaitz Artetxe
- Vicomtech-IK4 Research Centre, Mikeletegi Pasealekua 57, 20009 San Sebastian, Spain.
| | - Andoni Beristain
- Vicomtech-IK4 Research Centre, Mikeletegi Pasealekua 57, 20009 San Sebastian, Spain
| | - Manuel Graña
- Computation Intelligence Group, Basque University (UPV/EHU) P. Manuel Lardizabal 1, 20018 San Sebastian, Spain
| |
Collapse
|
23
|
Padgett LS, Asher A, Cheville A. The Intersection of Rehabilitation and Palliative Care: Patients With Advanced Cancer in the Inpatient Rehabilitation Setting. Rehabil Nurs 2018; 43:219-228. [DOI: 10.1097/rnj.0000000000000171] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
|
24
|
Comparing clinician descriptions of frailty and geriatric syndromes using electronic health records: a retrospective cohort study. BMC Geriatr 2017; 17:248. [PMID: 29070036 PMCID: PMC5657074 DOI: 10.1186/s12877-017-0645-7] [Citation(s) in RCA: 55] [Impact Index Per Article: 7.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2017] [Accepted: 10/17/2017] [Indexed: 01/15/2023] Open
Abstract
Background Geriatric syndromes, including frailty, are common in older adults and associated with adverse outcomes. We compared patients described in clinical notes as “frail” to other older adults with respect to geriatric syndrome burden and healthcare utilization. Methods We conducted a retrospective cohort study on 18,341 Medicare Advantage enrollees aged 65+ (members of a large nonprofit medical group in Massachusetts), analyzing up to three years of administrative claims and structured and unstructured electronic health record (EHR) data. We determined the presence of ten geriatric syndromes (falls, malnutrition, dementia, severe urinary control issues, absence of fecal control, visual impairment, walking difficulty, pressure ulcers, lack of social support, and weight loss) from claims and EHR data, and the presence of frailty descriptions in clinical notes with a pattern-matching natural language processing (NLP) algorithm. Results Of the 18,341 patients, we found that 2202 (12%) were described as “frail” in clinical notes. “Frail” patients were older (82.3 ± 6.8 vs 75.9 ± 5.9, p < .001) and had higher rates of healthcare utilization, including number of inpatient hospitalizations and emergency department visits, than the rest of the population (p < .001). “Frail” patients had on average 4.85 ± 1.72 of the ten geriatric syndromes studied, while non-frail patients had 2.35 ± 1.71 (p = .013). Falls, walking difficulty, malnutrition, weight loss, lack of social support and dementia were more highly correlated with frailty descriptions. The most common geriatric syndrome pattern among “frail” patients was a combination of walking difficulty, lack of social support, falls, and weight loss. Conclusions Patients identified as “frail” by providers in clinical notes have higher rates of healthcare utilization and more geriatric syndromes than other patients. Certain geriatric syndromes were more highly correlated with descriptions of frailty than others. Electronic supplementary material The online version of this article (10.1186/s12877-017-0645-7) contains supplementary material, which is available to authorized users.
Collapse
|
25
|
Dupre ME, Nelson A, Lynch SM, Granger BB, Xu H, Willis JM, Curtis LH, Peterson ED. Identifying Nonclinical Factors Associated With 30-Day Readmission in Patients with Cardiovascular Disease: Protocol for an Observational Study. JMIR Res Protoc 2017; 6:e118. [PMID: 28619703 PMCID: PMC5491895 DOI: 10.2196/resprot.7434] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2017] [Revised: 04/18/2017] [Accepted: 05/05/2017] [Indexed: 12/17/2022] Open
Abstract
Background Cardiovascular disease (CVD) is the leading cause of hospitalization in older adults and high readmission rates have attracted considerable attention as actionable targets to promote efficiency in care and to reduce costs. Despite a plethora of research over the past decade, current strategies to predict readmissions have been largely ineffective and efforts to identify novel clinical predictors have been largely unsuccessful. Objective The objective of this study is to examine a wide array of socioeconomic, psychosocial, behavioral, and clinical factors to predict risks of 30-day hospital readmission in cardiovascular patients. Methods The study includes patients (aged 18 years and older) admitted for the treatment of cardiovascular-related illnesses at the Duke Heart Center, which is among the nation’s largest and top-ranked cardiovascular care hospitals. The study uses a novel standardized survey to ascertain data on a comprehensive array of patient characteristics that will be linked to their electronic medical records. A series of univariate and multivariate models will be used to estimate the associations between the patient-level factors and 30-day readmissions. The performance of the risk models will be examined based on 2 components of accuracy—model calibration and discrimination—to determine how closely the predicted outcome agrees with the observed (actual) outcome and how well the model distinguishes patients who were readmitted and those who were not. The purpose of this paper is to present the protocol for the implementation of this study. Results The study was launched in February 2014 and is actively recruiting patients from the Heart Center. Approximately 550 patients have been enrolled to date and the study is expected to continue recruitment until February 2018. Preliminary results show that participants in the study were aged 63.6 years on average (SD 14.0), predominately male (61.2%), and primarily non-Hispanic white (64.6%) or non-Hispanic black (31.7%). The demographic characteristics of study participants were not significantly different from all patients admitted to the Heart Center during this period with an average age of 65.0 years (SD 15.3) and predominately male (58.6%), non-Hispanic white (62.9%) or non-Hispanic black (31.8%) The integration of the interview data with clinical data from the patient electronic medical records is currently underway. The study has received funding and ethical approval. Conclusions Many US hospitals continue to struggle with high readmission rates in patients with cardiovascular disease. The primary objective of this study is to collect and integrate a comprehensive array of patient attributes to develop a powerful yet parsimonious model to stratify risks of rehospitalization in cardiovascular patients. The results of this research also have the potential to identify actionable targets for tailored interventions to improve patient outcomes.
Collapse
Affiliation(s)
- Matthew E Dupre
- Duke Clinical Research Institute, Duke University, Durham, NC, United States.,Department of Sociology, Duke University, Durham, NC, United States.,Department of Community and Family Medicine, Duke University, Durham, NC, United States
| | - Alicia Nelson
- Department of Community and Family Medicine, Duke University, Durham, NC, United States
| | - Scott M Lynch
- Department of Sociology, Duke University, Durham, NC, United States
| | - Bradi B Granger
- Duke University School of Nursing, Duke University, Durham, NC, United States
| | - Hanzhang Xu
- Duke University School of Nursing, Duke University, Durham, NC, United States
| | - Janese M Willis
- Department of Community and Family Medicine, Duke University, Durham, NC, United States
| | - Lesley H Curtis
- Duke Clinical Research Institute, Duke University, Durham, NC, United States
| | - Eric D Peterson
- Duke Clinical Research Institute, Duke University, Durham, NC, United States
| |
Collapse
|
26
|
|