1
|
Newby D, Taylor N, Joyce DW, Winchester LM. Optimising the use of electronic medical records for large scale research in psychiatry. Transl Psychiatry 2024; 14:232. [PMID: 38824136 PMCID: PMC11144247 DOI: 10.1038/s41398-024-02911-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Revised: 04/13/2024] [Accepted: 04/15/2024] [Indexed: 06/03/2024] Open
Abstract
The explosion and abundance of digital data could facilitate large-scale research for psychiatry and mental health. Research using so-called "real world data"-such as electronic medical/health records-can be resource-efficient, facilitate rapid hypothesis generation and testing, complement existing evidence (e.g. from trials and evidence-synthesis) and may enable a route to translate evidence into clinically effective, outcomes-driven care for patient populations that may be under-represented. However, the interpretation and processing of real-world data sources is complex because the clinically important 'signal' is often contained in both structured and unstructured (narrative or "free-text") data. Techniques for extracting meaningful information (signal) from unstructured text exist and have advanced the re-use of routinely collected clinical data, but these techniques require cautious evaluation. In this paper, we survey the opportunities, risks and progress made in the use of electronic medical record (real-world) data for psychiatric research.
Collapse
Affiliation(s)
- Danielle Newby
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | - Niall Taylor
- Department of Psychiatry, University of Oxford, Oxford, UK
| | - Dan W Joyce
- Department of Primary Care and Mental Health and Civic Health, Innovation Labs, Institute of Population Health, University of Liverpool, Liverpool, UK
| | | |
Collapse
|
2
|
Nickson D, Meyer C, Walasek L, Toro C. Prediction and diagnosis of depression using machine learning with electronic health records data: a systematic review. BMC Med Inform Decis Mak 2023; 23:271. [PMID: 38012655 PMCID: PMC10680172 DOI: 10.1186/s12911-023-02341-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Accepted: 10/15/2023] [Indexed: 11/29/2023] Open
Abstract
BACKGROUND Depression is one of the most significant health conditions in personal, social, and economic impact. The aim of this review is to summarize existing literature in which machine learning methods have been used in combination with Electronic Health Records for prediction of depression. METHODS Systematic literature searches were conducted within arXiv, PubMed, PsycINFO, Science Direct, SCOPUS and Web of Science electronic databases. Searches were restricted to information published after 2010 (from 1st January 2011 onwards) and were updated prior to the final synthesis of data (27th January 2022). RESULTS Following the PRISMA process, the initial 744 studies were reduced to 19 eligible for detailed evaluation. Data extraction identified machine learning methods used, types of predictors used, the definition of depression, classification performance achieved, sample size, and benchmarks used. Area Under the Curve (AUC) values more than 0.9 were claimed, though the average was around 0.8. Regression methods proved as effective as more developed machine learning techniques. LIMITATIONS The categorization, definition, and identification of the numbers of predictors used within models was sometimes difficult to establish, Studies were largely Western Educated Industrialised, Rich, Democratic (WEIRD) in demography. CONCLUSION This review supports the potential use of machine learning techniques with Electronic Health Records for the prediction of depression. All the selected studies used clinically based, though sometimes broad, definitions of depression as their classification criteria. The reported performance of the studies was comparable to or even better than that found in primary care. There are concerns with generalizability and interpretability.
Collapse
Affiliation(s)
| | - Caroline Meyer
- Warwick Medical School, University of Warwick, Coventry, UK
| | - Lukasz Walasek
- Department of Psychology, University of Warwick, Coventry, UK
| | - Carla Toro
- Warwick Medical School, University of Warwick, Coventry, UK
| |
Collapse
|
3
|
Xu Z, Vekaria V, Wang F, Cukor J, Su C, Adekkanattu P, Brandt P, Jiang G, Kiefer RC, Luo Y, Rasmussen LV, Xu J, Xiao Y, Alexopoulos G, Pathak J. Using Machine Learning to Predict Antidepressant Treatment Outcome From Electronic Health Records. PSYCHIATRIC RESEARCH AND CLINICAL PRACTICE 2023; 5:118-125. [PMID: 38077277 PMCID: PMC10698704 DOI: 10.1176/appi.prcp.20220015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Revised: 02/26/2023] [Accepted: 02/28/2023] [Indexed: 03/28/2023] Open
Abstract
Objective To evaluate if a machine learning approach can accurately predict antidepressant treatment outcome using electronic health records (EHRs) from patients with depression. Method This study examined 808 patients with depression at a New York City-based outpatient mental health clinic between June 13, 2016 and June 22, 2020. Antidepressant treatment outcome was defined based on trend in depression symptom severity over time and was categorized as either "Recovering" or "Worsening" (i.e., non-Recovering), measured by the slope of individual-level Patient Health Questionnaire-9 (PHQ-9) score trajectory spanning 6 months following treatment initiation. A patient was designated as "Recovering" if the slope is less than 0 and as "Worsening" if the slope was no less than 0. Multiple machine learning (ML) models including L2 norm regularized Logistic Regression, Naive Bayes, Random Forest, and Gradient Boosting Decision Tree (GBDT) were used to predict treatment outcome based on additional data from EHRs, including demographics and diagnoses. Shapley Additive Explanations were applied to identify the most important predictors. Results The GBDT achieved the best results of predicting "Recovering" (AUC: 0.7654 ± 0.0227; precision: 0.6002 ± 0.0215; recall: 0.5131 ± 0.0336). When excluding patients with low PHQ-9 scores (<10) at baseline, the results of predicting "Recovering" (AUC: 0.7254 ± 0.0218; precision: 0.5392 ± 0.0437; recall: 0.4431 ± 0.0513) were obtained. Prior diagnosis of anxiety, psychotherapy, recurrent depression, and baseline depression symptom severity were strong predictors. Conclusions The results demonstrate the potential utility of using ML in longitudinal EHRs to predict antidepressant treatment outcome. Our predictive tool holds the promise to accelerate personalized medical management in patients with psychiatric illnesses.
Collapse
Affiliation(s)
| | | | - Fei Wang
- Weill Cornell MedicineNew YorkNew YorkUSA
| | | | - Chang Su
- Temple UniversityPhiladelphiaPennsylvaniaUSA
| | | | | | | | | | - Yuan Luo
- Northwestern UniversityChicagoIllinoisUSA
| | | | - Jie Xu
- University of FloridaGainesvilleFloridaUSA
| | - Yunyu Xiao
- Weill Cornell MedicineNew YorkNew YorkUSA
| | | | | |
Collapse
|
4
|
Forma F, Liberman JN, Rui P, Ruetsch C. Adherence to augmentation therapy for the treatment of major depressive disorder. Expert Rev Pharmacoecon Outcomes Res 2023; 23:327-335. [PMID: 36697398 DOI: 10.1080/14737167.2023.2167712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
BACKGROUND Inadequate response to antidepressant medication is common. Often, adjunctive pharmacotherapy or psychotherapy is recommended. OBJECTIVE To measure adherence to adjunctive pharmacotherapy and psychotherapy among individuals with major depressive disorder (MDD). METHODS Retrospective cohort study of individuals with MDD on antidepressant monotherapy who added adjunctive pharmacotherapy and/or psychotherapy. Medication adherence was measured by proportion of days covered (PDC) with optimal adherence defined as PDC≥0.80 and psychotherapy adherence defined by count of visits (optimal 8+ visits). Factors associated with optimal adherence were assessed by logistic regression. RESULTS Among 218,192 individuals with adjunctive therapy, 185,349 added pharmacotherapy and 32,843 added psychotherapy. In the subsequent 12 months, 36.2% and 54.9% achieved optimal adherence to adjunctive pharmacotherapy and psychotherapy, respectively. Adherence to adjunctive pharmacotherapy was associated with adding psychotherapy, index antidepressant adherence, medical comorbidities, and MDD severity codes. Adherence to adjunctive psychotherapy was associated with adding another medication, previous psychiatry visit and psychiatric comorbidities. CONCLUSION Adjunctive psychotherapy appears under-utilized and adherence to adjunctive therapy was low. Low adherence to adjunctive therapy reinforces challenges in managing MDD. That a second adjunctive therapy enhanced adherence to the initial adjunctive therapy indicates an opportunity to explore alternative adjunctive therapies.
Collapse
Affiliation(s)
- Felicia Forma
- Health Economics, Otsuka Pharmaceutical Development & Commercialization, Inc, Princeton, NJ, USA
| | | | - Pinyao Rui
- Health Analytics, LLC, Clarksville, MD, USA
| | | |
Collapse
|
5
|
Binsfeld Gonçalves L, Nesic I, Obradovic M, Stieltjes B, Weikert T, Bremerich J. Natural Language Processing and Graph Theory: Making Sense of Imaging Records in a Novel Representation Frame. JMIR Med Inform 2022; 10:e40534. [PMID: 36542426 PMCID: PMC9813822 DOI: 10.2196/40534] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 09/13/2022] [Accepted: 11/30/2022] [Indexed: 12/24/2022] Open
Abstract
BACKGROUND A concise visualization framework of related reports would increase readability and improve patient management. To this end, temporal referrals to prior comparative exams are an essential connection to previous exams in written reports. Due to unstructured narrative texts' variable structure and content, their extraction is hampered by poor computer readability. Natural language processing (NLP) permits the extraction of structured information from unstructured texts automatically and can serve as an essential input for such a novel visualization framework. OBJECTIVE This study proposes and evaluates an NLP-based algorithm capable of extracting the temporal referrals in written radiology reports, applies it to all the radiology reports generated for 10 years, introduces a graphical representation of imaging reports, and investigates its benefits for clinical and research purposes. METHODS In this single-center, university hospital, retrospective study, we developed a convolutional neural network capable of extracting the date of referrals from imaging reports. The model's performance was assessed by calculating precision, recall, and F1-score using an independent test set of 149 reports. Next, the algorithm was applied to our department's radiology reports generated from 2011 to 2021. Finally, the reports and their metadata were represented in a modulable graph. RESULTS For extracting the date of referrals, the named-entity recognition (NER) model had a high precision of 0.93, a recall of 0.95, and an F1-score of 0.94. A total of 1,684,635 reports were included in the analysis. Temporal reference was mentioned in 53.3% (656,852/1,684,635), explicitly stated as not available in 21.0% (258,386/1,684,635), and omitted in 25.7% (317,059/1,684,635) of the reports. Imaging records can be visualized in a directed and modulable graph, in which the referring links represent the connecting arrows. CONCLUSIONS Automatically extracting the date of referrals from unstructured radiology reports using deep learning NLP algorithms is feasible. Graphs refined the selection of distinct pathology pathways, facilitated the revelation of missing comparisons, and enabled the query of specific referring exam sequences. Further work is needed to evaluate its benefits in clinics, research, and resource planning.
Collapse
Affiliation(s)
- Laurent Binsfeld Gonçalves
- Clinic of Radiology & Nuclear Medicine, University Hospital Basel, University of Basel, Basel, Switzerland
| | - Ivan Nesic
- Clinic of Radiology & Nuclear Medicine, University Hospital Basel, University of Basel, Basel, Switzerland
| | - Marko Obradovic
- Clinic of Radiology & Nuclear Medicine, University Hospital Basel, University of Basel, Basel, Switzerland
| | - Bram Stieltjes
- Clinic of Radiology & Nuclear Medicine, University Hospital Basel, University of Basel, Basel, Switzerland
| | - Thomas Weikert
- Clinic of Radiology & Nuclear Medicine, University Hospital Basel, University of Basel, Basel, Switzerland
| | - Jens Bremerich
- Clinic of Radiology & Nuclear Medicine, University Hospital Basel, University of Basel, Basel, Switzerland
| |
Collapse
|
6
|
Berchuck SI, Jammal AA, Page D, Somers TJ, Medeiros FA. A Framework for Automating Psychiatric Distress Screening in Ophthalmology Clinics Using an EHR-Derived AI Algorithm. Transl Vis Sci Technol 2022; 11:6. [PMID: 36180026 PMCID: PMC9547354 DOI: 10.1167/tvst.11.10.6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Accepted: 09/14/2022] [Indexed: 11/24/2022] Open
Abstract
Purpose In patients with ophthalmic disorders, psychosocial risk factors play an important role in morbidity and mortality. Proper and early psychiatric screening can result in prompt intervention and mitigate its impact. Because screening is resource intensive, we developed a framework for automating screening using an electronic health record (EHR)-derived artificial intelligence (AI) algorithm. Methods Subjects came from the Duke Ophthalmic Registry, a retrospective EHR database for the Duke Eye Center. Inclusion criteria included at least two encounters and a minimum of 1 year of follow-up. Presence of distress was defined at the encounter level using a computable phenotype. Risk factors included available EHR history. At each encounter, risk factors were used to discriminate psychiatric status. Model performance was evaluated using area under the receiver operating characteristic (ROC) curve and area under the precision-recall curve (PR AUC). Variable importance was presented using odds ratios (ORs). Results Our cohort included 358,135 encounters from 40,326 patients with an average of nine encounters per patient over 4 years. The ROC and PR AUC were 0.91 and 0.55, respectively. Of the top 25 predictors, the majority were related to existing distress, but some indicated stressful conditions, including chemotherapy (OR = 1.36), esophageal disorders (OR = 1.31), central pain syndrome (OR = 1.25), and headaches (OR = 1.24). Conclusions Psychiatric distress in ophthalmology patients can be monitored passively using an AI algorithm trained on existing EHR data. Translational Relevance When paired with an effective referral and treatment program, such algorithms may improve health outcomes in ophthalmology.
Collapse
Affiliation(s)
| | - Alessandro A. Jammal
- Duke Eye Center and Department of Ophthalmology, Duke University, Durham, NC, USA
| | - David Page
- Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, USA
| | - Tamara J. Somers
- Department of Psychiatry and Behavioral Sciences, Duke University, Durham, NC, USA
| | - Felipe A. Medeiros
- Duke Eye Center and Department of Ophthalmology, Duke University, Durham, NC, USA
- Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, USA
| |
Collapse
|
7
|
Cioffi V, Mosca LL, Moretto E, Ragozzino O, Stanzione R, Bottone M, Maldonato NM, Muzii B, Sperandeo R. Computational Methods in Psychotherapy: A Scoping Review. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:12358. [PMID: 36231657 PMCID: PMC9565968 DOI: 10.3390/ijerph191912358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/10/2022] [Revised: 09/21/2022] [Accepted: 09/22/2022] [Indexed: 06/16/2023]
Abstract
BACKGROUND The study of complex systems, such as the psychotherapeutic encounter, transcends the mechanistic and reductionist methods for describing linear processes and needs suitable approaches to describe probabilistic and scarcely predictable phenomena. OBJECTIVE The present study undertakes a scoping review of research on the computational methods in psychotherapy to gather new developments in this field and to better understand the phenomena occurring in psychotherapeutic interactions as well as in human interaction more generally. DESIGN Online databases were used to identify papers published 2011-2022, from which we selected 18 publications from different resources, selected according to criteria established in advance and described in the text. A flow chart and a summary table of the articles consulted have been created. RESULTS The majority of publications (44.4%) reported combined computational and experimental approaches, so we grouped the studies according to the types of computational methods used. All but one of the studies collected measured data. All the studies confirmed the usefulness of predictive and learning models in the study of complex variables such as those belonging to psychological, psychopathological and psychotherapeutic processes. CONCLUSIONS Research on computational methods will benefit from a careful selection of reference methods and standards. Therefore, this review represents an attempt to systematise the empirical literature on the applications of computational methods in psychotherapy research in order to offer clinicians an overview of the usefulness of these methods and the possibilities of their use in the various fields of application, highlighting their clinical implications, and ultimately attempting to identify potential opportunities for further research.
Collapse
Affiliation(s)
- Valeria Cioffi
- SiPGI–Postgraduate School of Integrated Gestalt Psychotherapy, 80058 Torre Annunziata, Italy
| | - Lucia Luciana Mosca
- SiPGI–Postgraduate School of Integrated Gestalt Psychotherapy, 80058 Torre Annunziata, Italy
| | - Enrico Moretto
- SiPGI–Postgraduate School of Integrated Gestalt Psychotherapy, 80058 Torre Annunziata, Italy
| | - Ottavio Ragozzino
- SiPGI–Postgraduate School of Integrated Gestalt Psychotherapy, 80058 Torre Annunziata, Italy
| | - Roberta Stanzione
- SiPGI–Postgraduate School of Integrated Gestalt Psychotherapy, 80058 Torre Annunziata, Italy
| | - Mario Bottone
- Department of Neurosciences and Reproductive and Odontostomatological Sciences, University of Naples Federico II, 80131 Naples, Italy
| | - Nelson Mauro Maldonato
- Department of Neurosciences and Reproductive and Odontostomatological Sciences, University of Naples Federico II, 80131 Naples, Italy
| | - Benedetta Muzii
- Department of Humanistic Studies, University of Naples Federico II, 80131 Naples, Italy
| | - Raffaele Sperandeo
- SiPGI–Postgraduate School of Integrated Gestalt Psychotherapy, 80058 Torre Annunziata, Italy
| |
Collapse
|
8
|
Meng Y, Speier W, Ong MK, Arnold CW. Bidirectional Representation Learning From Transformers Using Multimodal Electronic Health Record Data to Predict Depression. IEEE J Biomed Health Inform 2021; 25:3121-3129. [PMID: 33661740 DOI: 10.1109/jbhi.2021.3063721] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Advancements in machine learning algorithms have had a beneficial impact on representation learning, classification, and prediction models built using electronic health record (EHR) data. Effort has been put both on increasing models' overall performance as well as improving their interpretability, particularly regarding the decision-making process. In this study, we present a temporal deep learning model to perform bidirectional representation learning on EHR sequences with a transformer architecture to predict future diagnosis of depression. This model is able to aggregate five heterogenous and high-dimensional data sources from the EHR and process them in a temporal manner for chronic disease prediction at various prediction windows. We applied the current trend of pretraining and fine-tuning on EHR data to outperform the current state-of-the-art in chronic disease prediction, and to demonstrate the underlying relation between EHR codes in the sequence. The model generated the highest increases of precision-recall area under the curve (PRAUC) from 0.70 to 0.76 in depression prediction compared to the best baseline model. Furthermore, the self-attention weights in each sequence quantitatively demonstrated the inner relationship between various codes, which improved the model's interpretability. These results demonstrate the model's ability to utilize heterogeneous EHR data to predict depression while achieving high accuracy and interpretability, which may facilitate constructing clinical decision support systems in the future for chronic disease screening and early detection.
Collapse
|
9
|
Bian J, Yang S, Xiong H, Wang L, Fu Y, Sun Z, Guo Z, Wang J. CRLEDD: Regularized Causalities Learning for Early Detection of Diseases Using Electronic Health Record (EHR) Data. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE 2021. [DOI: 10.1109/tetci.2020.3010017] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
10
|
Guo S, Kaminga AC, Xiong J. Depression and Coping Styles of College Students in China During COVID-19 Pandemic: A Systemic Review and Meta-Analysis. Front Public Health 2021; 9:613321. [PMID: 34307268 PMCID: PMC8292621 DOI: 10.3389/fpubh.2021.613321] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 05/17/2021] [Indexed: 11/29/2022] Open
Abstract
Background: The rapid spread and uncertain outcome of the 2019 novel coronavirus disease (COVID-19) around the world have caused worry, fear, and stress among the general population. Nevertheless, the prevalence of depression among college students in China during lockdown, following the COVID-19 pandemic, and their coping strategies have not been quantitatively assessed. Objective: We aimed to evaluate the prevalence of depression among college students in China during the lockdown due to the COVID-19 pandemic and assess their coping strategies. Methods: Systematic review and meta-analysis were conducted to assess the prevalence of depression among college students in China and their coping strategies. Results: The results indicated that, during lockdown in the COVID-19 pandemic, the prevalence rates of college students in China suffering from mild, moderate, and severe depression were 25% (95% CI = 17-33%), 7% (95% CI = 2-14%), and 2% (95% CI = 1-5%), respectively. Besides, the proportion of college students who use WeChat and Weibo to acquire COVID-19 knowledge was 39% (95% CI = 13-68%), whereas the proportion of college students using mental health application services (APPs) to deal with depression was 59% (95% CI = 41-73%). Conclusions: The prevalence of depression among college students in China was high during the lockdown in the COVID-19 pandemic. Thus, considering the adverse outcomes of depression, it is imperative to screen college students in China for depression during the CIVID-19 pandemic and provide them with necessary psychological interventions to control and prevent depression. Social media platforms, such as WeChat and Weibo, and mental health APPs could provide an opportunity for psychological health information dissemination for college students. However, their effectiveness in reducing depression will have to be assessed.
Collapse
Affiliation(s)
- Shengyu Guo
- Department of Economics and Management, Changsha University, Changsha, China
| | | | - Jie Xiong
- Department of Mathematics and Computer Science, Changsha University, Changsha, China
| |
Collapse
|
11
|
Chekroud AM, Bondar J, Delgadillo J, Doherty G, Wasil A, Fokkema M, Cohen Z, Belgrave D, DeRubeis R, Iniesta R, Dwyer D, Choi K. The promise of machine learning in predicting treatment outcomes in psychiatry. World Psychiatry 2021; 20:154-170. [PMID: 34002503 PMCID: PMC8129866 DOI: 10.1002/wps.20882] [Citation(s) in RCA: 153] [Impact Index Per Article: 51.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Abstract
For many years, psychiatrists have tried to understand factors involved in response to medications or psychotherapies, in order to personalize their treatment choices. There is now a broad and growing interest in the idea that we can develop models to personalize treatment decisions using new statistical approaches from the field of machine learning and applying them to larger volumes of data. In this pursuit, there has been a paradigm shift away from experimental studies to confirm or refute specific hypotheses towards a focus on the overall explanatory power of a predictive model when tested on new, unseen datasets. In this paper, we review key studies using machine learning to predict treatment outcomes in psychiatry, ranging from medications and psychotherapies to digital interventions and neurobiological treatments. Next, we focus on some new sources of data that are being used for the development of predictive models based on machine learning, such as electronic health records, smartphone and social media data, and on the potential utility of data from genetics, electrophysiology, neuroimaging and cognitive testing. Finally, we discuss how far the field has come towards implementing prediction tools in real-world clinical practice. Relatively few retrospective studies to-date include appropriate external validation procedures, and there are even fewer prospective studies testing the clinical feasibility and effectiveness of predictive models. Applications of machine learning in psychiatry face some of the same ethical challenges posed by these techniques in other areas of medicine or computer science, which we discuss here. In short, machine learning is a nascent but important approach to improve the effectiveness of mental health care, and several prospective clinical studies suggest that it may be working already.
Collapse
Affiliation(s)
- Adam M Chekroud
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
- Spring Health, New York City, NY, USA
| | | | - Jaime Delgadillo
- Clinical Psychology Unit, Department of Psychology, University of Sheffield, Sheffield, UK
| | - Gavin Doherty
- School of Computer Science and Statistics, Trinity College Dublin, Dublin, Ireland
| | - Akash Wasil
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Marjolein Fokkema
- Department of Methods and Statistics, Institute of Psychology, Leiden University, Leiden, The Netherlands
| | - Zachary Cohen
- Department of Psychiatry and Biobehavioral Sciences, University of California, Los Angeles, Los Angeles, CA, USA
| | | | - Robert DeRubeis
- Department of Psychology, University of Pennsylvania, Philadelphia, PA, USA
| | - Raquel Iniesta
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neurosciences, King's College London, London, UK
| | - Dominic Dwyer
- Department of Psychiatry and Psychotherapy, Section for Neurodiagnostic Applications, Ludwig-Maximilian University, Munich, Germany
| | - Karmel Choi
- Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Department of Psychiatry, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
12
|
Meng Y, Speier W, Ong M, Arnold CW. HCET: Hierarchical Clinical Embedding With Topic Modeling on Electronic Health Records for Predicting Future Depression. IEEE J Biomed Health Inform 2021; 25:1265-1272. [PMID: 32749975 DOI: 10.1109/jbhi.2020.3004072] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Recent developments in machine learning algorithms have enabled models to exhibit impressive performance in healthcare tasks using electronic health record (EHR) data. However, the heterogeneous nature and sparsity of EHR data remains challenging. In this work, we present a model that utilizes heterogeneous data and addresses sparsity by representing diagnoses, procedures, and medication codes with temporal Hierarchical Clinical Embeddings combined with Topic modeling (HCET) on clinical notes. HCET aggregates various categories of EHR data and learns inherent structure based on hospital visits for an individual patient. We demonstrate the potential of the approach in the task of predicting depression at various time points prior to a clinical diagnosis. We found that HCET outperformed all baseline methods with a highest improvement of 0.07 in precision-recall area under the curve (PRAUC). Furthermore, applying attention weights across EHR data modalities significantly improved the performance as well as the model's interpretability by revealing the relative weight for each data modality. Our results demonstrate the model's ability to utilize heterogeneous EHR information to predict depression, which may have future implications for screening and early detection.
Collapse
|
13
|
Razavi R, Gharipour A, Gharipour M. Depression screening using mobile phone usage metadata: a machine learning approach. J Am Med Inform Assoc 2021; 27:522-530. [PMID: 31977041 DOI: 10.1093/jamia/ocz221] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2019] [Revised: 12/02/2019] [Accepted: 12/15/2019] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE Depression is currently the second most significant contributor to non-fatal disease burdens globally. While it is treatable, depression remains undiagnosed in many cases. As mobile phones have now become an integral part of daily life, this study examines the possibility of screening for depressive symptoms continuously based on patients' mobile usage patterns. MATERIALS AND METHODS 412 research participants reported a range of their mobile usage statistics. Beck Depression Inventory-2nd ed (BDI-II) was used to measure the severity of depression among participants. A wide array of machine learning classification algorithms was trained to detect participants with depression symptoms (ie, BDI-II score ≥ 14). The relative importance of individual variables was additionally quantified. RESULTS Participants with depression were found to have fewer saved contacts on their devices, spend more time on their mobile devices to make and receive fewer and shorter calls, and send more text messages than participants without depression. The best model was a random forest classifier, which had an out-of-sample balanced accuracy of 0.768. The balanced accuracy increased to 0.811 when participants' age and gender were included. DISCUSSIONS/CONCLUSION The significant predictive power of mobile usage attributes implies that, by collecting mobile usage statistics, mental health mobile applications can continuously screen for depressive symptoms for initial diagnosis or for monitoring the progress of ongoing treatments. Moreover, the input variables used in this study were aggregated mobile usage metadata attributes, which has low privacy sensitivity making it more likely for patients to grant required application permissions.
Collapse
Affiliation(s)
- Rouzbeh Razavi
- Department of Management and Information Systems, Kent State University, Kent, OH, USA
| | - Amin Gharipour
- School of Information Technology, Griffith University, Gold Coast, Australia
| | - Mojgan Gharipour
- Isfahan Cardiovascular Research Center, Isfahan University of Medical Sciences, Isfahan, Iran
| |
Collapse
|
14
|
Geng R, Huang X. Identification of major depressive disorder disease-related genes and functional pathways based on system dynamic changes of network connectivity. BMC Med Genomics 2021; 14:55. [PMID: 33622334 PMCID: PMC7903654 DOI: 10.1186/s12920-021-00908-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2019] [Accepted: 02/17/2021] [Indexed: 12/31/2022] Open
Abstract
BACKGROUND Major depressive disorder (MDD) is a leading psychiatric disorder that involves complex abnormal biological functions and neural networks. This study aimed to compare the changes in the network connectivity of different brain tissues under different pathological conditions, analyzed the biological pathways and genes that are significantly related to disease progression, and further predicted the potential therapeutic drug targets. METHODS Expression of differentially expressed genes (DEGs) were analyzed with postmortem cingulate cortex (ACC) and prefrontal cortex (PFC) mRNA expression profile datasets downloaded from the Gene Expression Omnibus (GEO) database, including 76 MDD patients and 76 healthy subjects in ACC and 63 MDD patients and 63 healthy subjects in PFC. The co-expression network construction was based on system network analysis. The function of the genes was annotated by Kyoto Encyclopedia of Genes and Genomes (KEGG) pathway analysis. Human Protein Reference Database (HPRD, http://www.hprd.org/ ) was used for gene interaction relationship mapping. RESULTS We filtered 586 DEGs in ACC and 616 DEGs in PFC for further analysis. By constructing the co-expression network, we found that the gene connectivity was significantly reduced under disease conditions (P = 0.04 in PFC and P = 1.227e-09 in ACC). Crosstalk analysis showed that CD19, PTDSS2 and NDST2 were significantly differentially expressed in ACC and PFC of MDD patients. Among them, CD19 and PTDSS2 have been targeted by several drugs in the Drugbank database. KEGG pathway analysis demonstrated that the function of CD19 and PTDSS2 were enriched with the pathway of Glycerophospholipid metabolism and T cell receptor signaling pathway. CONCLUSION Co-expression network and tissue comparing analysis can identify signaling pathways and cross talk genes related to MDD, which may provide novel insight for understanding the molecular mechanisms of MDD.
Collapse
Affiliation(s)
- Ruijie Geng
- Department of Psychological Medicine, Zhongshan Hospital, Fudan University, Shanghai, 200032, China
- Department of Psychological Medicine, Xiamen Branch, Zhongshan Hospital, Fudan University, Xiamen, 361015, China
| | - Xiao Huang
- Department of Psychological Medicine, Zhongshan Hospital, Fudan University, Shanghai, 200032, China.
- Department of Psychological Medicine, Xiamen Branch, Zhongshan Hospital, Fudan University, Xiamen, 361015, China.
| |
Collapse
|
15
|
Predictive modeling of depression and anxiety using electronic health records and a novel machine learning approach with artificial intelligence. Sci Rep 2021; 11:1980. [PMID: 33479383 PMCID: PMC7820000 DOI: 10.1038/s41598-021-81368-4] [Citation(s) in RCA: 47] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Accepted: 12/22/2020] [Indexed: 12/14/2022] Open
Abstract
Generalized anxiety disorder (GAD) and major depressive disorder (MDD) are highly prevalent and impairing problems, but frequently go undetected, leading to substantial treatment delays. Electronic health records (EHRs) collect a great deal of biometric markers and patient characteristics that could foster the detection of GAD and MDD in primary care settings. We approached the problem of predicting MDD and GAD using a novel machine learning pipeline to re-analyze data from an observational study. The pipeline constitutes an ensemble of algorithmically distinct machine learning methods, including deep learning. A sample of 4,184 undergraduate students completed the study, undergoing a general health screening and completing a psychiatric assessment for MDD and GAD. After explicitly excluding all psychiatric information, 59 biomedical and demographic features from the general health survey in addition to a set of engineered features were used for model training. We assessed the model's performance on a held-out test set and found an AUC of 0.73 (sensitivity: 0.66, specificity: 0.7) and 0.67 (sensitivity: 0.55, specificity: 0.7) for GAD, and MDD, respectively. Additionally, we used advanced techniques (SHAP values) to illuminate which features had the greatest impact on prediction for each disease. The top predictive features for MDD were being satisfied with living conditions and having public health insurance. The top predictive features for GAD were vaccinations being up to date and marijuana use. Our results indicate moderate predictive performance for the application of machine learning methods in detection of GAD and MDD based on EHR data. By identifying important predictors of GAD and MDD, these results may be used in future research to aid in the early detection of MDD and GAD.
Collapse
|
16
|
Buch AM, Liston C. Dissecting diagnostic heterogeneity in depression by integrating neuroimaging and genetics. Neuropsychopharmacology 2021; 46:156-175. [PMID: 32781460 PMCID: PMC7688954 DOI: 10.1038/s41386-020-00789-3] [Citation(s) in RCA: 98] [Impact Index Per Article: 32.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/28/2020] [Revised: 07/07/2020] [Accepted: 07/16/2020] [Indexed: 12/12/2022]
Abstract
Depression is a heterogeneous and etiologically complex psychiatric syndrome, not a unitary disease entity, encompassing a broad spectrum of psychopathology arising from distinct pathophysiological mechanisms. Motivated by a need to advance our understanding of these mechanisms and develop new treatment strategies, there is a renewed interest in investigating the neurobiological basis of heterogeneity in depression and rethinking our approach to diagnosis for research purposes. Large-scale genome-wide association studies have now identified multiple genetic risk variants implicating excitatory neurotransmission and synapse function and underscoring a highly polygenic inheritance pattern that may be another important contributor to heterogeneity in depression. Here, we review various sources of phenotypic heterogeneity and approaches to defining and studying depression subtypes, including symptom-based subtypes and biology-based approaches to decomposing the depression syndrome. We review "dimensional," "categorical," and "hybrid" approaches to parsing phenotypic heterogeneity in depression and defining subtypes using functional neuroimaging. Next, we review recent progress in neuroimaging genetics (correlating neuroimaging patterns of brain function with genetic data) and its potential utility for generating testable hypotheses concerning molecular and circuit-level mechanisms. We discuss how genetic variants and transcriptomic profiles may confer risk for depression by modulating brain structure and function. We conclude by highlighting several promising areas for future research into the neurobiological underpinnings of heterogeneity, including efforts to understand sexually dimorphic mechanisms, the longitudinal dynamics of depressive episodes, and strategies for developing personalized treatments and facilitating clinical decision-making.
Collapse
Affiliation(s)
- Amanda M Buch
- Department of Psychiatry and Brain and Mind Research Institute, Weill Cornell Medicine, 413 East 69th Street, Box 240, New York, NY, 10021, USA
| | - Conor Liston
- Department of Psychiatry and Brain and Mind Research Institute, Weill Cornell Medicine, 413 East 69th Street, Box 240, New York, NY, 10021, USA.
| |
Collapse
|
17
|
Improving covariance-regularized discriminant analysis for EHR-based predictive analytics of diseases. APPL INTELL 2021. [DOI: 10.1007/s10489-020-01810-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
|
18
|
Using machine learning for predicting cervical cancer from Swedish electronic health records by mining hierarchical representations. PLoS One 2020; 15:e0237911. [PMID: 32822401 PMCID: PMC7444577 DOI: 10.1371/journal.pone.0237911] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2020] [Accepted: 08/05/2020] [Indexed: 11/19/2022] Open
Abstract
Electronic health records (EHRs) contain rich documentation regarding disease symptoms and progression, but EHR data is challenging to use for diagnosis prediction due to its high dimensionality, relative scarcity, and substantial level of noise. We investigated how to best represent EHR data for predicting cervical cancer, a serious disease where early detection is beneficial for the outcome of treatment. A case group of 1321 patients with cervical cancer were matched to ten times as many controls, and for both groups several types of events were extracted from their EHRs. These events included clinical codes, lab results, and contents of free text notes retrieved using a LSTM neural network. Clinical events are described with great variation in EHR texts, leading to a very large feature space. Therefore, an event hierarchy inferred from the textual events was created to represent the clinical texts. Overall, the events extracted from free text notes contributed the most to the final prediction, and the hierarchy of textual events further improved performance. Four classifiers were evaluated for predicting a future cancer diagnosis where Random Forest achieved the best results with an AUC of 0.70 from a year before diagnosis up to 0.97 one day before diagnosis. We conclude that our approach is sound and had excellent discrimination at diagnosis, but only modest discrimination capacity before this point. Since our study objective was earlier disease prediction than such, we propose further work should consider extending patient histories through e.g. the integration of primary health records preceding referral to hospital.
Collapse
|
19
|
Bernert RA, Hilberg AM, Melia R, Kim JP, Shah NH, Abnousi F. Artificial Intelligence and Suicide Prevention: A Systematic Review of Machine Learning Investigations. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2020; 17:E5929. [PMID: 32824149 PMCID: PMC7460360 DOI: 10.3390/ijerph17165929] [Citation(s) in RCA: 58] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Accepted: 07/28/2020] [Indexed: 12/12/2022]
Abstract
Suicide is a leading cause of death that defies prediction and challenges prevention efforts worldwide. Artificial intelligence (AI) and machine learning (ML) have emerged as a means of investigating large datasets to enhance risk detection. A systematic review of ML investigations evaluating suicidal behaviors was conducted using PubMed/MEDLINE, PsychInfo, Web-of-Science, and EMBASE, employing search strings and MeSH terms relevant to suicide and AI. Databases were supplemented by hand-search techniques and Google Scholar. Inclusion criteria: (1) journal article, available in English, (2) original investigation, (3) employment of AI/ML, (4) evaluation of a suicide risk outcome. N = 594 records were identified based on abstract search, and 25 hand-searched reports. N = 461 reports remained after duplicates were removed, n = 316 were excluded after abstract screening. Of n = 149 full-text articles assessed for eligibility, n = 87 were included for quantitative synthesis, grouped according to suicide behavior outcome. Reports varied widely in methodology and outcomes. Results suggest high levels of risk classification accuracy (>90%) and Area Under the Curve (AUC) in the prediction of suicidal behaviors. We report key findings and central limitations in the use of AI/ML frameworks to guide additional research, which hold the potential to impact suicide on broad scale.
Collapse
Affiliation(s)
- Rebecca A. Bernert
- Stanford Suicide Prevention Research Laboratory, Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94304, USA
| | - Amanda M. Hilberg
- Stanford Suicide Prevention Research Laboratory, Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94304, USA
| | - Ruth Melia
- Stanford Suicide Prevention Research Laboratory, Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94304, USA
- Department of Psychology, National University of Ireland, Galway, Ireland
| | - Jane Paik Kim
- Stanford Suicide Prevention Research Laboratory, Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA 94304, USA
| | - Nigam H. Shah
- Department of Medicine, Center for Biomedical Informatics Research, Stanford University School of Medicine, Stanford, CA 94304, USA
- Informatics, Stanford Center for Clinical and Translational Research, and Education (Spectrum), Stanford University, Stanford CA 94304, USA
| | - Freddy Abnousi
- Facebook, Menlo Park, CA 94025, USA
- Yale University School of Medicine, New Haven, CT 06510, USA
| |
Collapse
|
20
|
Xu Z, Wang F, Adekkanattu P, Bose B, Vekaria V, Brandt P, Jiang G, Kiefer RC, Luo Y, Pacheco JA, Rasmussen LV, Xu J, Alexopoulos G, Pathak J. Subphenotyping depression using machine learning and electronic health records. Learn Health Syst 2020; 4:e10241. [PMID: 33083540 PMCID: PMC7556423 DOI: 10.1002/lrh2.10241] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2020] [Revised: 06/08/2020] [Accepted: 07/15/2020] [Indexed: 12/19/2022] Open
Abstract
Objective To identify depression subphenotypes from Electronic Health Records (EHRs) using machine learning methods, and analyze their characteristics with respect to patient demographics, comorbidities, and medications. Materials and Methods Using EHRs from the INSIGHT Clinical Research Network (CRN) database, multiple machine learning (ML) algorithms were applied to analyze 11 275 patients with depression to discern depression subphenotypes with distinct characteristics. Results Using the computational approaches, we derived three depression subphenotypes: Phenotype_A (n = 2791; 31.35%) included patients who were the oldest (mean (SD) age, 72.55 (14.93) years), had the most comorbidities, and took the most medications. The most common comorbidities in this cluster of patients were hyperlipidemia, hypertension, and diabetes. Phenotype_B (mean (SD) age, 68.44 (19.09) years) was the largest cluster (n = 4687; 52.65%), and included patients suffering from moderate loss of body function. Asthma, fibromyalgia, and Chronic Pain and Fatigue (CPF) were common comorbidities in this subphenotype. Phenotype_C (n = 1452; 16.31%) included patients who were younger (mean (SD) age, 63.47 (18.81) years), had the fewest comorbidities, and took fewer medications. Anxiety and tobacco use were common comorbidities in this subphenotype. Conclusion Computationally deriving depression subtypes can provide meaningful insights and improve understanding of depression as a heterogeneous disorder. Further investigation is needed to assess the utility of these derived phenotypes to inform clinical trial design and interpretation in routine patient care.
Collapse
Affiliation(s)
- Zhenxing Xu
- Weill Cornell Medicine New York New York USA
| | - Fei Wang
- Weill Cornell Medicine New York New York USA
| | | | | | | | | | | | | | - Yuan Luo
- Northwestern University Chicago Illinois USA
| | | | | | - Jie Xu
- Weill Cornell Medicine New York New York USA
| | | | | |
Collapse
|
21
|
Finding discriminatory features from electronic health records for depression prediction. J Intell Inf Syst 2020. [DOI: 10.1007/s10844-020-00611-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
|
22
|
Ermers NJ, Hagoort K, Scheepers FE. The Predictive Validity of Machine Learning Models in the Classification and Treatment of Major Depressive Disorder: State of the Art and Future Directions. Front Psychiatry 2020; 11:472. [PMID: 32523557 PMCID: PMC7261928 DOI: 10.3389/fpsyt.2020.00472] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/18/2019] [Accepted: 05/07/2020] [Indexed: 11/13/2022] Open
Abstract
Major depressive disorder imposes a substantial disease burden worldwide, ranking as the third leading contributor to global disability. In spite of its ubiquity, classifying and treating depression has proven troublesome. One argument put forward to explain this predicament is the heterogeneity of patients diagnosed with the disorder. Recently, many areas of daily life have witnessed the surge of machine learning techniques, computational approaches to elucidate complex patterns in large datasets, which can be employed to make predictions and detect relevant clusters. Due to the multidimensionality at play in the pathogenesis of depression, it is suggested that machine learning could contribute to improving classification and treatment. In this paper, we investigated literature focusing on the use of machine learning models on datasets with clinical variables of patients diagnosed with depression to predict treatment outcomes or find more homogeneous subgroups. Identified studies based on best practices in the field are evaluated. We found 16 studies predicting outcomes (such as remission) and identifying clusters in patients with depression. The identified studies are mostly still in proof-of-concept phase, with small datasets, lack of external validation, and providing single performance metrics. Larger datasets, and models with similar variables present across these datasets, are needed to develop accurate and generalizable models. We hypothesize that harnessing natural language processing to obtain data 'hidden' in clinical texts might prove useful in improving prediction models. Besides, researchers will need to focus on the conditions to feasibly implement these models to support psychiatrists and patients in their decision-making in practice. Only then we can enter the realm of precision psychiatry.
Collapse
Affiliation(s)
- Nick J. Ermers
- Department of Psychiatry, University Medical Center Utrecht, Utrecht, Netherlands
| | | | | |
Collapse
|
23
|
Sequeira L, Perrotta S, LaGrassa J, Merikangas K, Kreindler D, Kundur D, Courtney D, Szatmari P, Battaglia M, Strauss J. Mobile and wearable technology for monitoring depressive symptoms in children and adolescents: A scoping review. J Affect Disord 2020; 265:314-324. [PMID: 32090755 DOI: 10.1016/j.jad.2019.11.156] [Citation(s) in RCA: 34] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/20/2019] [Revised: 10/29/2019] [Accepted: 11/30/2019] [Indexed: 02/08/2023]
Abstract
BACKGROUND There has been rapid growth of mobile and wearable tools that may help to overcome challenges in the diagnosis and prediction of Major Depressive Disorder in children and adolescents, tasks that rely on clinical reporting that is inherently based on retrospective recall of symptoms and associated features. This article reviews more objective ways of measuring and monitoring mood within this population. METHODS A scoping review of peer-reviewed studies examined published research that employs mobile and wearable tools to characterize depression in children and/or adolescents. Our search strategy included the following terms: (1) monitoring or prediction (2) depression (3) mobile apps or wearables and (4) children and youth (including adolescents), and was applied to five databases. RESULTS Our search produced 829 citations (2008- Feb 2019), of which 30 (journal articles, conference papers and abstracts) were included in the analysis, and 2 reviews included in our discussion. The majority of the evidence involved smartphone apps, with very few studies using actigraphy. Mobile and wearables captured a variety of data including unobtrusive passive analytics, movement and light data, plus physical and mental health data, including depressive symptom monitoring. Most studies also examined feasibility. LIMITATIONS This review was limited to published research in the English language. The review criteria excluded any apps that were mainly treatment focused, therefore there was not much of a focus on clinical outcomes. CONCLUSIONS This scoping review yielded a variety of studies with heterogeneous populations, research methods and study objectives, which limited our ability to address our research objectives cohesively. Certain mobile technologies, however, have demonstrated feasibility for tracking depression that could inform models for predicting relapse.
Collapse
Affiliation(s)
- Lydia Sequeira
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada; Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada
| | - Steve Perrotta
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada
| | - Jennifer LaGrassa
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada
| | | | - David Kreindler
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada; Centre for Mobile Computing in Mental Health, Sunnybrook Health Sciences Centre, Toronto, ON, Canada
| | - Deepa Kundur
- Department of Electrical and Computer Engineering, University of Toronto, Toronto, ON, Canada
| | - Darren Courtney
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada; Department of Psychiatry, University of Toronto, Toronto, ON, Canada
| | - Peter Szatmari
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada; Department of Psychiatry, University of Toronto, Toronto, ON, Canada; Hospital for Sick Children, Toronto, ON, Canada
| | - Marco Battaglia
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada; Department of Psychiatry, University of Toronto, Toronto, ON, Canada
| | - John Strauss
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, ON, Canada; Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, ON, Canada; Department of Psychiatry, University of Toronto, Toronto, ON, Canada.
| |
Collapse
|
24
|
Vos RA, Katayama T, Mishima H, Kawano S, Kawashima S, Kim JD, Moriya Y, Tokimatsu T, Yamaguchi A, Yamamoto Y, Wu H, Amstutz P, Antezana E, Aoki NP, Arakawa K, Bolleman JT, Bolton E, Bonnal RJP, Bono H, Burger K, Chiba H, Cohen KB, Deutsch EW, Fernández-Breis JT, Fu G, Fujisawa T, Fukushima A, García A, Goto N, Groza T, Hercus C, Hoehndorf R, Itaya K, Juty N, Kawashima T, Kim JH, Kinjo AR, Kotera M, Kozaki K, Kumagai S, Kushida T, Lütteke T, Matsubara M, Miyamoto J, Mohsen A, Mori H, Naito Y, Nakazato T, Nguyen-Xuan J, Nishida K, Nishida N, Nishide H, Ogishima S, Ohta T, Okuda S, Paten B, Perret JL, Prathipati P, Prins P, Queralt-Rosinach N, Shinmachi D, Suzuki S, Tabata T, Takatsuki T, Taylor K, Thompson M, Uchiyama I, Vieira B, Wei CH, Wilkinson M, Yamada I, Yamanaka R, Yoshitake K, Yoshizawa AC, Dumontier M, Kosaki K, Takagi T. BioHackathon 2015: Semantics of data for life sciences and reproducible research. F1000Res 2020; 9:136. [PMID: 32308977 PMCID: PMC7141167 DOI: 10.12688/f1000research.18236.1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 02/05/2020] [Indexed: 01/08/2023] Open
Abstract
We report on the activities of the 2015 edition of the BioHackathon, an annual event that brings together researchers and developers from around the world to develop tools and technologies that promote the reusability of biological data. We discuss issues surrounding the representation, publication, integration, mining and reuse of biological data and metadata across a wide range of biomedical data types of relevance for the life sciences, including chemistry, genotypes and phenotypes, orthology and phylogeny, proteomics, genomics, glycomics, and metabolomics. We describe our progress to address ongoing challenges to the reusability and reproducibility of research results, and identify outstanding issues that continue to impede the progress of bioinformatics research. We share our perspective on the state of the art, continued challenges, and goals for future research and development for the life sciences Semantic Web.
Collapse
Affiliation(s)
- Rutger A. Vos
- Institute of Biology Leiden, Leiden University, Leiden, The Netherlands
- Naturalis Biodiversity Center, Leiden, The Netherlands
| | | | - Hiroyuki Mishima
- Department of Human Genetics, Nagasaki University Graduate School of Biomedical Sciences, Nagasaki, Japan
| | - Shin Kawano
- Database Center for Life Science, Tokyo, Japan
| | | | | | - Yuki Moriya
- Database Center for Life Science, Tokyo, Japan
| | | | | | | | - Hongyan Wu
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | | | - Erick Antezana
- Department of Biology, Norwegian University of Science and Technology, Trondheim, Norway
| | - Nobuyuki P. Aoki
- Faculty of Science and Engineering, SOKA University, Tokyo, Japan
| | - Kazuharu Arakawa
- Institute for Advanced Biosciences, Keio University, Tokyo, Japan
| | - Jerven T. Bolleman
- SIB Swiss Institute of Bioinformatics, Centre Medical Universitaire, Lausanne, Switzerland
| | - Evan Bolton
- National Center for Biotechnology Information, National Library of Medicine, National Institutes of Health, Bethesda, USA
| | - Raoul J. P. Bonnal
- Istituto Nazionale Genetica Molecolare, Romeo ed Enrica Invernizzi, Milan, Italy
| | | | - Kees Burger
- Dutch Techcentre for Life Sciences, Utrecht, The Netherlands
| | - Hirokazu Chiba
- National Institute for Basic Biology, National Institutes of Natural Sciences, Okazaki, Japan
| | - Kevin B. Cohen
- Computational Bioscience Program, University of Colorado School of Medicine, Denver, USA
- Université Paris-Saclay, LIMSI, CNRS, Paris, France
| | | | | | - Gang Fu
- National Center for Biotechnology Information, National Library of Medicine, National Institutes of Health, Bethesda, USA
| | | | | | | | - Naohisa Goto
- Research Institute for Microbial Diseases, Osaka University, Osaka, Japan
| | - Tudor Groza
- St Vincent's Clinical School, Faculty of Medicine, University of New South Wales, Darlinghurst, Australia
- Kinghorn Centre for Clinical Genomics, Garvan Institute of Medical Research, Darlinghurst, Australia
| | - Colin Hercus
- Novocraft Technologies Sdn. Bhd., Selangor, Malaysia
| | - Robert Hoehndorf
- Computational Bioscience Research Center, King Abdullah University of Science and Technology, Thuwal, Saudi Arabia
| | - Kotone Itaya
- Institute for Advanced Biosciences, Keio University, Tokyo, Japan
| | - Nick Juty
- European Molecular Biology Laboratory, European Bioinformatics Institute, Hinxton, UK
| | | | - Jee-Hyub Kim
- European Molecular Biology Laboratory, European Bioinformatics Institute, Hinxton, UK
| | - Akira R. Kinjo
- Institute for Protein Research, Osaka University, Osaka, Japan
| | - Masaaki Kotera
- School of Life Science and Technology, Tokyo Institute of Technology, Tokyo, Japan
| | - Kouji Kozaki
- The Institute of Scientific and Industrial Research, Osaka University, Osaka, Japan
| | | | - Tatsuya Kushida
- National Bioscience Database Center, Japan Science and Technology Agency, Tokyo, Japan
| | - Thomas Lütteke
- Institute of Veterinary Physiology and Biochemistry, Justus-Liebig University Giessen, Giessen, Germany
- Gesellschaft für innovative Personalwirtschaftssysteme mbH (GIP GmbH), Offenbach, Germany
| | | | | | - Attayeb Mohsen
- National Institutes of Biomedical Innovation, Health and Nutrition, Osaka, Japan
| | - Hiroshi Mori
- Center for Information Biology, National Institute of Genetics, Mishima, Japan
| | - Yuki Naito
- Database Center for Life Science, Tokyo, Japan
| | | | | | | | - Naoki Nishida
- Department of Systems Science, Osaka University, Osaka, Japan
| | - Hiroyo Nishide
- National Institute for Basic Biology, National Institutes of Natural Sciences, Okazaki, Japan
| | - Soichi Ogishima
- Tohoku Medical Megabank Organization, Tohoku University, Sendai, Japan
| | - Tazro Ohta
- Database Center for Life Science, Tokyo, Japan
| | - Shujiro Okuda
- Niigata University Graduate School of Medical and Dental Sciences, Niigata, Japan
| | - Benedict Paten
- UC Santa Cruz Genomics Institute, University of California, Santa Cruz, USA
| | | | - Philip Prathipati
- National Institutes of Biomedical Innovation, Health and Nutrition, Osaka, Japan
| | - Pjotr Prins
- University Medical Center Utrecht, Utrecht, The Netherlands
- University of Tennessee Health Science Center, Memphis, USA
| | - Núria Queralt-Rosinach
- Department of Biomedical Informatics, Harvard Medical School, Boston, Massachusetts, USA
| | | | - Shinya Suzuki
- School of Life Science and Technology, Tokyo Institute of Technology, Tokyo, Japan
| | - Tsuyosi Tabata
- Graduate School of Pharmaceutical Sciences, Kyoto University, Kyoto, Japan
| | | | - Kieron Taylor
- European Molecular Biology Laboratory, European Bioinformatics Institute, Hinxton, UK
| | - Mark Thompson
- Leiden University Medical Center, Leiden, The Netherlands
| | - Ikuo Uchiyama
- National Institute for Basic Biology, National Institutes of Natural Sciences, Okazaki, Japan
| | - Bruno Vieira
- WurmLab, School of Biological & Chemical Sciences, Queen Mary University of London, London, UK
| | - Chih-Hsuan Wei
- National Center for Biotechnology Information, National Library of Medicine, National Institutes of Health, Bethesda, USA
| | - Mark Wilkinson
- Escuela Técnica Superior de Ingeniería Agronómica, Alimentaria y de Biosistemas, Universidad Politécnica de Madrid, Madrid, Spain
| | | | | | - Kazutoshi Yoshitake
- Graduate School of Agricultural and Life Sciences, The University of Tokyo, Tokyo, Japan
| | | | - Michel Dumontier
- Institute of Data Science, Maastricht University, Maastricht, The Netherlands
| | - Kenjiro Kosaki
- Center for Medical Genetics, Keio University School of Medicine, Tokyo, Japan
| | - Toshihisa Takagi
- National Bioscience Database Center, Japan Science and Technology Agency, Tokyo, Japan
- Department of Biological Sciences, Graduate School of Science, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
25
|
Defining Major Depressive Disorder Cohorts Using the EHR: Multiple Phenotypes Based on ICD-9 Codes and Medication Orders. ACTA ACUST UNITED AC 2020; 36:18-26. [PMID: 32218644 DOI: 10.1016/j.npbr.2020.02.002] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
Background Major Depressive Disorder (MDD) is one of the most common mental illnesses and a leading cause of disability worldwide. Electronic Health Records (EHR) allow researchers to conduct unprecedented large-scale observational studies investigating MDD, its disease development and its interaction with other health outcomes. While there exist methods to classify patients as clear cases or controls, given specific data requirements, there are presently no simple, generalizable, and validated methods to classify an entire patient population into varying groups of depression likelihood and severity. Methods We have tested a simple, pragmatic electronic phenotype algorithm that classifies patients into one of five mutually exclusive, ordinal groups, varying in depression phenotype. Using data from an integrated health system on 278,026 patients from a 10-year study period we have tested the convergent validity of these constructs using measures of external validation, including patterns of psychiatric prescriptions, symptom severity, indicators of suicidality, comorbidity, mortality, health care utilization, and polygenic risk scores for MDD. Results We found consistent patterns of increasing morbidity and/or adverse outcomes across the five groups, providing evidence for convergent validity. Limitations The study population is from a single rural integrated health system which is predominantly white, possibly limiting its generalizability. Conclusion Our study provides initial evidence that a simple algorithm, generalizable to most EHR data sets, provides categories with meaningful face and convergent validity that can be used for stratification of an entire patient population.
Collapse
|
26
|
Jin H, Wu S. Use of Patient-Reported Data to Match Depression Screening Intervals With Depression Risk Profiles in Primary Care Patients With Diabetes: Development and Validation of Prediction Models for Major Depression. JMIR Form Res 2019; 3:e13610. [PMID: 31573900 PMCID: PMC6774232 DOI: 10.2196/13610] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2019] [Revised: 06/10/2019] [Accepted: 08/31/2019] [Indexed: 11/13/2022] Open
Abstract
Background Clinical guidelines recommend screening for depression in the general adult population but recognizes that the optimum interval for screening is unknown. Ideal screening intervals should match the patient risk profiles. Objective This study describes a predictive analytics approach for mining clinical and patient-reported data from a large clinical study for the identification of primary care patients at high risk for depression to match depression screening intervals with patient risk profiles. Methods This paper analyzed data from a large safety-net primary care study for diabetes and depression. A regression-based data mining technique was used to examine 53 demographics, clinical variables, and patient-reported variables to develop three prediction models for major depression at 6, 12, and 18 months from baseline. Predictors with the strongest predictive power that require low information collection efforts were selected to develop the prediction models. Predictive accuracy was measured by the area under the receiver operating curve (AUROC) and was evaluated by 10-fold cross-validation. The effectiveness of the prediction algorithms in supporting clinical decision making for six “typical” types of patients was demonstrated. Results The analysis included 923 patients who were nondepressed at the study baseline. Five patient-reported variables were selected in the prediction models to predict major depression at 6, 12, and 18 months: (1) Patient Health Questionnaire 2-item score; (2) the Sheehan Disability Scale; (3) previous problems with depression; (4) the diabetes symptoms scale; and (5) emotional burden of diabetes. All three depression prediction models had an AUROC>0.80, comparable with published depression prediction studies. Among the 6 “typical” types of patients, the algorithms suggest that patients who reported impaired daily functioning by health status are at an elevated risk for depression in all three periods. Conclusions This study demonstrated that leveraging patient-reported data and prediction models can help improve identification of high-risk patients and clinical decisions about the depression screening interval for diabetes patients. Implementation of this approach can be coupled with application of modern technologies such as telehealth and mobile health assessment for collecting patient-reported data to improve privacy, reducing stigma and costs, and promoting a personalized depression screening that matches screening intervals with patient risk profiles.
Collapse
Affiliation(s)
- Haomiao Jin
- Suzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles, CA, United States.,Edward R Roybal Institute on Aging, University of Southern California, Los Angeles, CA, United States
| | - Shinyi Wu
- Suzanne Dworak-Peck School of Social Work, University of Southern California, Los Angeles, CA, United States.,Edward R Roybal Institute on Aging, University of Southern California, Los Angeles, CA, United States.,Daniel J Epstein Department of Industrial and Systems Engineering, University of Southern California, Los Angeles, CA, United States
| |
Collapse
|
27
|
Pearson R, Pisner D, Meyer B, Shumake J, Beevers CG. A machine learning ensemble to predict treatment outcomes following an Internet intervention for depression. Psychol Med 2019; 49:2330-2341. [PMID: 30392475 PMCID: PMC6763538 DOI: 10.1017/s003329171800315x] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/22/2018] [Revised: 09/06/2018] [Accepted: 10/05/2018] [Indexed: 11/06/2022]
Abstract
BACKGROUND Some Internet interventions are regarded as effective treatments for adult depression, but less is known about who responds to this form of treatment. METHOD An elastic net and random forest were trained to predict depression symptoms and related disability after an 8-week course of an Internet intervention, Deprexis, involving adults (N = 283) from across the USA. Candidate predictors included psychopathology, demographics, treatment expectancies, treatment usage, and environmental context obtained from population databases. Model performance was evaluated using predictive R2$\lpar R_{{\rm pred}}^2\rpar\comma $ the expected variance explained in a new sample, estimated by 10 repetitions of 10-fold cross-validation. RESULTS An ensemble model was created by averaging the predictions of the elastic net and random forest. Model performance was compared with a benchmark linear autoregressive model that predicted each outcome using only its baseline. The ensemble predicted more variance in post-treatment depression (8.0% gain, 95% CI 0.8-15; total $R_{{\rm pred}}^2 \; $= 0.25), disability (5.0% gain, 95% CI -0.3 to 10; total $R_{{\rm pred}}^2 \; $= 0.25), and well-being (11.6% gain, 95% CI 4.9-19; total $R_{{\rm pred}}^2 \; $= 0.29) than the benchmark model. Important predictors included comorbid psychopathology, particularly total psychopathology and dysthymia, low symptom-related disability, treatment credibility, lower access to therapists, and time spent using certain Deprexis modules. CONCLUSION A number of variables predict symptom improvement following an Internet intervention, but each of these variables makes relatively small contributions. Machine learning ensembles may be a promising statistical approach for identifying the cumulative contribution of many weak predictors to psychosocial depression treatment response.
Collapse
Affiliation(s)
- Rahel Pearson
- Department of Psychology, Institute for Mental Health Research, University of Texas at Austin, Austin, TX, USA
| | - Derek Pisner
- Department of Psychology, Institute for Mental Health Research, University of Texas at Austin, Austin, TX, USA
| | - Björn Meyer
- Gaia AG, Hamburg, Germany
- University of London, London, England, UK
| | - Jason Shumake
- Department of Psychology, Institute for Mental Health Research, University of Texas at Austin, Austin, TX, USA
| | - Christopher G. Beevers
- Department of Psychology, Institute for Mental Health Research, University of Texas at Austin, Austin, TX, USA
| |
Collapse
|
28
|
Use of machine learning techniques in the development and refinement of a predictive model for early diagnosis of ankylosing spondylitis. Clin Rheumatol 2019; 39:975-982. [PMID: 31044386 DOI: 10.1007/s10067-019-04553-x] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2018] [Revised: 01/28/2019] [Accepted: 04/08/2019] [Indexed: 10/26/2022]
Abstract
OBJECTIVE To develop a predictive mathematical model for the early identification of ankylosing spondylitis (AS) based on the medical and pharmacy claims history of patients with and without AS. METHODS This retrospective study used claims data from Truven databases from January 2006 to September 2015 (Segment 1) and October 2015 to February 2018 (Segment 2). Machine learning identified features differentiating patients with AS from matched controls; selected features were used as inputs in developing Model A/B to identify patients likely to have AS. Model A/B was trained and developed in Segment 1, and patients predicted to have AS in Segment 1 were followed up in Segment 2 to evaluate the predictive capability of Model A/B. RESULTS Of 228,471 patients in Segment 1 without any history of AS, Model A/B predicted 1923 patients to have AS. Ultimately, 1242 patients received an AS diagnosis in Segment 2; 120 of these were correctly predicted by Model A/B, yielding a positive predictive value (PPV) of 6.24%. The diagnostic accuracy of Model A/B compared favorably with that of a clinical model (PPV, 1.29%) that predicted AS based on spondyloarthritis features described in the Assessment of SpondyloArthritis international Society classification criteria. A simplified linear regression model created to test the operability of Model A/B yielded a lower PPV (2.55%). CONCLUSIONS Model A/B performed better than a clinically based model in predicting a diagnosis of AS among patients in a large claims database; its use may contribute to early recognition of AS and a timely diagnosis.
Collapse
|
29
|
Baowaly MK, Lin CC, Liu CL, Chen KT. Synthesizing electronic health records using improved generative adversarial networks. J Am Med Inform Assoc 2019; 26:228-241. [PMID: 30535151 PMCID: PMC7647178 DOI: 10.1093/jamia/ocy142] [Citation(s) in RCA: 55] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2018] [Revised: 09/21/2018] [Accepted: 10/24/2018] [Indexed: 11/14/2022] Open
Abstract
Objective The aim of this study was to generate synthetic electronic health records (EHRs). The generated EHR data will be more realistic than those generated using the existing medical Generative Adversarial Network (medGAN) method. Materials and Methods We modified medGAN to obtain two synthetic data generation models-designated as medical Wasserstein GAN with gradient penalty (medWGAN) and medical boundary-seeking GAN (medBGAN)-and compared the results obtained using the three models. We used 2 databases: MIMIC-III and National Health Insurance Research Database (NHIRD), Taiwan. First, we trained the models and generated synthetic EHRs by using these three 3 models. We then analyzed and compared the models' performance by using a few statistical methods (Kolmogorov-Smirnov test, dimension-wise probability for binary data, and dimension-wise average count for count data) and 2 machine learning tasks (association rule mining and prediction). Results We conducted a comprehensive analysis and found our models were adequately efficient for generating synthetic EHR data. The proposed models outperformed medGAN in all cases, and among the 3 models, boundary-seeking GAN (medBGAN) performed the best. Discussion To generate realistic synthetic EHR data, the proposed models will be effective in the medical industry and related research from the viewpoint of providing better services. Moreover, they will eliminate barriers including limited access to EHR data and thus accelerate research on medical informatics. Conclusion The proposed models can adequately learn the data distribution of real EHRs and efficiently generate realistic synthetic EHRs. The results show the superiority of our models over the existing model.
Collapse
Affiliation(s)
- Mrinal Kanti Baowaly
- Social Networks and Human-Centered Computing, Taiwan International Graduate Program, Institute of Information Science, Academia Sinica, Taipei, Taiwan
- Department of Computer Science, National Chengchi University, Taipei, Taiwan
| | - Chia-Ching Lin
- Graduate Institute of Electrical Engineering, National Taiwan University, Taipei, Taiwan
- Institute of Information Science, Academia Sinica, Taipei, Taiwan
| | - Chao-Lin Liu
- Department of Computer Science, National Chengchi University, Taipei, Taiwan
| | - Kuan-Ta Chen
- Institute of Information Science, Academia Sinica, Taipei, Taiwan
| |
Collapse
|
30
|
Zhou C, Jia Y, Motani M. Optimizing Autoencoders for Learning Deep Representations From Health Data. IEEE J Biomed Health Inform 2019; 23:103-111. [DOI: 10.1109/jbhi.2018.2856820] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
31
|
Russ TC, Woelbert E, Davis KAS, Hafferty JD, Ibrahim Z, Inkster B, John A, Lee W, Maxwell M, McIntosh AM, Stewart R. How data science can advance mental health research. Nat Hum Behav 2019; 3:24-32. [PMID: 30932051 DOI: 10.1038/s41562-018-0470-9] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2018] [Accepted: 10/11/2018] [Indexed: 02/07/2023]
Abstract
Accessibility of powerful computers and availability of so-called big data from a variety of sources means that data science approaches are becoming pervasive. However, their application in mental health research is often considered to be at an earlier stage than in other areas despite the complexity of mental health and illness making such a sophisticated approach particularly suitable. In this Perspective, we discuss current and potential applications of data science in mental health research using the UK Clinical Research Collaboration classification: underpinning research; aetiology; detection and diagnosis; treatment development; treatment evaluation; disease management; and health services research. We demonstrate that data science is already being widely applied in mental health research, but there is much more to be done now and in the future. The possibilities for data science in mental health research are substantial.
Collapse
Affiliation(s)
- Tom C Russ
- Centre for Cognitive Ageing and Cognitive Epidemiology, University of Edinburgh, Edinburgh, UK.
- Division of Psychiatry, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK.
- Centre for Dementia Prevention, University of Edinburgh, Edinburgh, UK.
- Alzheimer Scotland Dementia Research Centre, University of Edinburgh, Edinburgh, UK.
- Old Age Psychiatry, Royal Edinburgh Hospital, NHS Lothian, Edinburgh, UK.
| | | | - Katrina A S Davis
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
- South London and Maudsley NHS Foundation Trust, London, UK
| | - Jonathan D Hafferty
- Division of Psychiatry, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK
| | - Zina Ibrahim
- Department of Biostatistics and Health Informatics, King's College London, London, UK
- The Farr Institute of Health Informatics Research, University College London, London, UK
| | - Becky Inkster
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| | - Ann John
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - William Lee
- Community and Primary Care Research Group, Plymouth University Peninsula Schools of Medicine and Dentistry, University of Plymouth, Plymouth, UK
- Devon Partnership NHS Trust, Exeter, UK
| | | | - Andrew M McIntosh
- Centre for Cognitive Ageing and Cognitive Epidemiology, University of Edinburgh, Edinburgh, UK
- Division of Psychiatry, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, UK
| | - Rob Stewart
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
- South London and Maudsley NHS Foundation Trust, London, UK
| |
Collapse
|
32
|
Bhattacharya M, Jurkovitz C, Shatkay H. Chronic Kidney Disease stratification using office visit records: Handling data imbalance via hierarchical meta-classification. BMC Med Inform Decis Mak 2018; 18:125. [PMID: 30537962 PMCID: PMC6290512 DOI: 10.1186/s12911-018-0675-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Background Chronic Kidney Disease (CKD) is one of several conditions that affect a growing percentage of the US population; the disease is accompanied by multiple co-morbidities, and is hard to diagnose in-and-of itself. In its advanced forms it carries severe outcomes and can lead to death. It is thus important to detect the disease as early as possible, which can help devise effective intervention and treatment plan. Here we investigate ways to utilize information available in electronic health records (EHRs) from regular office visits of more than 13,000 patients, in order to distinguish among several stages of the disease. While clinical data stored in EHRs provide valuable information for risk-stratification, one of the major challenges in using them arises from data imbalance. That is, records associated with a more severe condition are typically under-represented compared to those associated with a milder manifestation of the disease. To address imbalance, we propose and develop a sampling-based ensemble approach, hierarchical meta-classification, aiming to stratify CKD patients into severity stages, using simple quantitative non-text features gathered from standard office visit records. Methods The proposed hierarchical meta-classification method frames the multiclass classification task as a hierarchy of two subtasks. The first is binary classification, separating records associated with the majority class from those associated with all minority classes combined, using meta-classification. The second subtask separates the records assigned to the combined minority classes into the individual constituent classes. Results The proposed method identifies a significant proportion of patients suffering from the more advanced stages of the condition, while also correctly identifying most of the less severe cases, maintaining high sensitivity, specificity and F-measure (≥ 93%). Our results show that the high level of performance attained by our method is preserved even when the size of the training set is significantly reduced, demonstrating the stability and generalizability of our approach. Conclusion We present a new approach to perform classification while addressing data imbalance, which is inherent in the biomedical domain. Our model effectively identifies severity stages of CKD patients, using information readily available in office visit records within the realistic context of high data imbalance.
Collapse
Affiliation(s)
- Moumita Bhattacharya
- Computational Biomedicine Lab, Computer and Information Sciences, University of Delaware, Newark, DE, USA.
| | | | - Hagit Shatkay
- Computational Biomedicine Lab, Computer and Information Sciences, University of Delaware, Newark, DE, USA.,Center for Bioinformatics and Computational Biology, Delaware Biotechnology Inst, University of Delaware, Newark, DE, USA
| |
Collapse
|
33
|
Feature Ranking in Predictive Models for Hospital-Acquired Acute Kidney Injury. Sci Rep 2018; 8:17298. [PMID: 30470779 PMCID: PMC6251919 DOI: 10.1038/s41598-018-35487-0] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2018] [Accepted: 11/02/2018] [Indexed: 12/22/2022] Open
Abstract
Acute Kidney Injury (AKI) is a common complication encountered among hospitalized patients, imposing significantly increased cost, morbidity, and mortality. Early prediction of AKI has profound clinical implications because currently no treatment exists for AKI once it develops. Feature selection (FS) is an essential process for building accurate and interpretable prediction models, but to our best knowledge no study has investigated the robustness and applicability of such selection process for AKI. In this study, we compared eight widely-applied FS methods for AKI prediction using nine-years of electronic medical records (EMR) and examined heterogeneity in feature rankings produced by the methods. FS methods were compared in terms of stability with respect to data sampling variation, similarity between selection results, and AKI prediction performance. Prediction accuracy did not intrinsically guarantee the feature ranking stability. Across different FS methods, the prediction performance did not change significantly, while the importance rankings of features were quite different. A positive correlation was observed between the complexity of suitable FS method and sample size. This study provides several practical implications, including recognizing the importance of feature stability as it is desirable for model reproducibility, identifying important AKI risk factors for further investigation, and facilitating early prediction of AKI.
Collapse
|
34
|
Kim MH, Banerjee S, Zhao Y, Wang F, Zhang Y, Zhu Y, DeFerio J, Evans L, Park SM, Pathak J. Association networks in a matched case-control design - Co-occurrence patterns of preexisting chronic medical conditions in patients with major depression versus their matched controls. J Biomed Inform 2018; 87:88-95. [PMID: 30300713 PMCID: PMC6262847 DOI: 10.1016/j.jbi.2018.09.016] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2018] [Revised: 09/25/2018] [Accepted: 09/28/2018] [Indexed: 01/09/2023]
Abstract
OBJECTIVE We present a method for comparing association networks in a matched case-control design, which provides a high-level comparison of co-occurrence patterns of features after adjusting for confounding factors. We demonstrate this approach by examining the differential distribution of chronic medical conditions in patients with major depressive disorder (MDD) compared to the distribution of these conditions in their matched controls. MATERIALS AND METHODS Newly diagnosed MDD patients were matched to controls based on their demographic characteristics, socioeconomic status, place of residence, and healthcare service utilization in the Korean National Health Insurance Service's National Sample Cohort. Differences in the networks of chronic medical conditions in newly diagnosed MDD cases treated with antidepressants, and their matched controls, were prioritized with a permutation test accounting for the false discovery rate. Sensitivity analyses for the associations between prioritized pairs of chronic medical conditions and new MDD diagnosis were performed with regression modeling. RESULTS By comparing the association networks of chronic medical conditions in newly diagnosed depression patients and their matched controls, five pairs of such conditions were prioritized among 105 possible pairs after controlling the false discovery rate at 5%. In sensitivity analyses using regression modeling, four out of the five prioritized pairs were statistically significant for the interaction terms. CONCLUSION Association networks in a matched case-control design can provide a high-level comparison of comorbid features after adjusting for confounding factors, thereby supplementing traditional clinical study approaches. We demonstrate the differential co-occurrence pattern of chronic medical conditions in patients with MDD and prioritize the chronic conditions that have statistically significant interactions in regression models for depression.
Collapse
Affiliation(s)
- Min-Hyung Kim
- Division of Health Informatics, Department of Health Policy and Research, Weill Cornell Medical College of Cornell University, NY, USA
| | - Samprit Banerjee
- Division of Biostatistics and Epidemiology, Department of Health Policy and Research, Weill Cornell Medical College of Cornell University, NY, USA
| | - Yize Zhao
- Division of Biostatistics and Epidemiology, Department of Health Policy and Research, Weill Cornell Medical College of Cornell University, NY, USA
| | - Fei Wang
- Division of Health Informatics, Department of Health Policy and Research, Weill Cornell Medical College of Cornell University, NY, USA
| | - Yiye Zhang
- Division of Health Informatics, Department of Health Policy and Research, Weill Cornell Medical College of Cornell University, NY, USA
| | - Yongjun Zhu
- Department of Library and Information Science, Sungkyungkwan University, Seoul, Republic of Korea
| | - Joseph DeFerio
- Division of Health Informatics, Department of Health Policy and Research, Weill Cornell Medical College of Cornell University, NY, USA
| | - Lauren Evans
- Division of Biostatistics and Epidemiology, Department of Health Policy and Research, Weill Cornell Medical College of Cornell University, NY, USA
| | - Sang Min Park
- Department of Family Medicine, Seoul National University Hospital, Seoul, Republic of Korea; Department of Biomedical Sciences, Seoul National University College of Medicine, Seoul, Republic of Korea.
| | - Jyotishman Pathak
- Division of Health Informatics, Department of Health Policy and Research, Weill Cornell Medical College of Cornell University, NY, USA.
| |
Collapse
|
35
|
Smoller JW. The use of electronic health records for psychiatric phenotyping and genomics. Am J Med Genet B Neuropsychiatr Genet 2018; 177:601-612. [PMID: 28557243 PMCID: PMC6440216 DOI: 10.1002/ajmg.b.32548] [Citation(s) in RCA: 58] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/19/2017] [Accepted: 04/20/2017] [Indexed: 12/22/2022]
Abstract
The widespread adoption of electronic health record (EHRs) in healthcare systems has created a vast and continuously growing resource of clinical data and provides new opportunities for population-based research. In particular, the linking of EHRs to biospecimens and genomic data in biobanks may help address what has become a rate-limiting study for genetic research: the need for large sample sizes. The principal roadblock to capitalizing on these resources is the need to establish the validity of phenotypes extracted from the EHR. For psychiatric genetic research, this represents a particular challenge given that diagnosis is based on patient reports and clinician observations that may not be well-captured in billing codes or narrative records. This review addresses the opportunities and pitfalls in EHR-based phenotyping with a focus on their application to psychiatric genetic research. A growing number of studies have demonstrated that diagnostic algorithms with high positive predictive value can be derived from EHRs, especially when structured data are supplemented by text mining approaches. Such algorithms enable semi-automated phenotyping for large-scale case-control studies. In addition, the scale and scope of EHR databases have been used successfully to identify phenotypic subgroups and derive algorithms for longitudinal risk prediction. EHR-based genomics are particularly well-suited to rapid look-up replication of putative risk genes, studies of pleiotropy (phenomewide association studies or PheWAS), investigations of genetic networks and overlap across the phenome, and pharmacogenomic research. EHR phenotyping has been relatively under-utilized in psychiatric genomic research but may become a key component of efforts to advance precision psychiatry.
Collapse
Affiliation(s)
- Jordan W. Smoller
- Psychiatric and Neurodevelopmental Genetics Unit, Center for Genomic Medicine, Massachusetts General Hospital, Boston, MA
- Department of Psychiatry, Massachusetts General Hospital, Boston, MA
- Stanley Center for Psychiatric Research, Broad Institute of MIT and Harvard, Cambridge, MA
| |
Collapse
|
36
|
Zech J, Pain M, Titano J, Badgeley M, Schefflein J, Su A, Costa A, Bederson J, Lehar J, Oermann EK. Natural Language–based Machine Learning Models for the Annotation of Clinical Radiology Reports. Radiology 2018; 287:570-580. [DOI: 10.1148/radiol.2018171093] [Citation(s) in RCA: 86] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Affiliation(s)
- John Zech
- From the Departments of Radiology (J.Z., J.T., J.S., A.S.) and Neurosurgery (M.P., M.B., A.C., J.B., E.K.O.), Icahn School of Medicine, 1 Gustave Levy Pl, New York, NY 10029; and Department of Bioengineering and Bioinformatics, Boston University, Boston, Mass (J.L.)
| | - Margaret Pain
- From the Departments of Radiology (J.Z., J.T., J.S., A.S.) and Neurosurgery (M.P., M.B., A.C., J.B., E.K.O.), Icahn School of Medicine, 1 Gustave Levy Pl, New York, NY 10029; and Department of Bioengineering and Bioinformatics, Boston University, Boston, Mass (J.L.)
| | - Joseph Titano
- From the Departments of Radiology (J.Z., J.T., J.S., A.S.) and Neurosurgery (M.P., M.B., A.C., J.B., E.K.O.), Icahn School of Medicine, 1 Gustave Levy Pl, New York, NY 10029; and Department of Bioengineering and Bioinformatics, Boston University, Boston, Mass (J.L.)
| | - Marcus Badgeley
- From the Departments of Radiology (J.Z., J.T., J.S., A.S.) and Neurosurgery (M.P., M.B., A.C., J.B., E.K.O.), Icahn School of Medicine, 1 Gustave Levy Pl, New York, NY 10029; and Department of Bioengineering and Bioinformatics, Boston University, Boston, Mass (J.L.)
| | - Javin Schefflein
- From the Departments of Radiology (J.Z., J.T., J.S., A.S.) and Neurosurgery (M.P., M.B., A.C., J.B., E.K.O.), Icahn School of Medicine, 1 Gustave Levy Pl, New York, NY 10029; and Department of Bioengineering and Bioinformatics, Boston University, Boston, Mass (J.L.)
| | - Andres Su
- From the Departments of Radiology (J.Z., J.T., J.S., A.S.) and Neurosurgery (M.P., M.B., A.C., J.B., E.K.O.), Icahn School of Medicine, 1 Gustave Levy Pl, New York, NY 10029; and Department of Bioengineering and Bioinformatics, Boston University, Boston, Mass (J.L.)
| | - Anthony Costa
- From the Departments of Radiology (J.Z., J.T., J.S., A.S.) and Neurosurgery (M.P., M.B., A.C., J.B., E.K.O.), Icahn School of Medicine, 1 Gustave Levy Pl, New York, NY 10029; and Department of Bioengineering and Bioinformatics, Boston University, Boston, Mass (J.L.)
| | - Joshua Bederson
- From the Departments of Radiology (J.Z., J.T., J.S., A.S.) and Neurosurgery (M.P., M.B., A.C., J.B., E.K.O.), Icahn School of Medicine, 1 Gustave Levy Pl, New York, NY 10029; and Department of Bioengineering and Bioinformatics, Boston University, Boston, Mass (J.L.)
| | - Joseph Lehar
- From the Departments of Radiology (J.Z., J.T., J.S., A.S.) and Neurosurgery (M.P., M.B., A.C., J.B., E.K.O.), Icahn School of Medicine, 1 Gustave Levy Pl, New York, NY 10029; and Department of Bioengineering and Bioinformatics, Boston University, Boston, Mass (J.L.)
| | - Eric Karl Oermann
- From the Departments of Radiology (J.Z., J.T., J.S., A.S.) and Neurosurgery (M.P., M.B., A.C., J.B., E.K.O.), Icahn School of Medicine, 1 Gustave Levy Pl, New York, NY 10029; and Department of Bioengineering and Bioinformatics, Boston University, Boston, Mass (J.L.)
| |
Collapse
|
37
|
Vaughn DA, van Deen WK, Kerr WT, Meyer TR, Bertozzi AL, Hommes DW, Cohen MS. Using insurance claims to predict and improve hospitalizations and biologics use in members with inflammatory bowel diseases. J Biomed Inform 2018; 81:93-101. [PMID: 29625187 DOI: 10.1016/j.jbi.2018.03.015] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2017] [Revised: 03/10/2018] [Accepted: 03/26/2018] [Indexed: 11/26/2022]
Abstract
OBJECTIVE Inflammatory Bowel Disease (IBD) is an inflammatory disorder of the gastrointestinal tract that can necessitate hospitalization and the use of expensive biologics. Models predicting these interventions may improve patient quality of life and reduce expenditures. MATERIALS AND METHODS We used insurance claims from 2011 to 2013 to predict IBD-related hospitalizations and the initiation of biologics. We derived and optimized our model from a 2011 training set of 7771 members, predicting their outcomes the following year. The best-performing model was then applied to a 2012 validation set of 7450 members to predict their outcomes in 2013. RESULTS Our models predicted both IBD-related hospitalizations and the initiation of biologics, with average positive predictive values of 17% and 11%, respectively - each a 200% improvement over chance. Further, when we used topic modeling to identify four member subpopulations, the positive predictive value of predicting hospitalization increased to 20%. DISCUSSION We show that our hospitalization model, in concert with a mildly-effective interventional treatment plan for members identified as high-risk, may both improve patient outcomes and reduce insurance expenditures. CONCLUSION The success of our approach provides a roadmap for how claims data can complement traditional medical decision making with personalized, data-driven predictive medicine.
Collapse
Affiliation(s)
- Don A Vaughn
- UCLA Semel Institute for Neuroscience and Human Behavior, Los Angeles, CA, USA
| | - Welmoed K van Deen
- UCLA Center for Inflammatory Bowel Diseases, Vatche and Tamar Manoukian Division of Digestive Disease, David Geffen School of Medicine, Los Angeles, CA, USA; Gehr Family Center for Health Systems Science, Division of Geriatric, Hospital, Palliative and General Internal Medicine, Department of Medicine, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA; Leonard D. Schaeffer Center for Health Policy and Economics, University of Southern California, Los Angeles, CA, USA
| | - Wesley T Kerr
- UCLA David Geffen School of Medicine, Los Angeles, CA, USA; UCLA Department of Biomathematics, Los Angeles, CA, USA; Eisenhower Medical Center, Department of Internal Medicine, Rancho Mirage, CA, USA
| | | | | | - Daniel W Hommes
- UCLA Center for Inflammatory Bowel Diseases, Vatche and Tamar Manoukian Division of Digestive Disease, David Geffen School of Medicine, Los Angeles, CA, USA.
| | - Mark S Cohen
- UCLA Semel Institute for Neuroscience and Human Behavior, Los Angeles, CA, USA; UCLA Departments of Psychiatry, Neurology, Radiology, Psychology, Biomedical Physics and Bioengineering, and California Nanosystems Institute, Los Angeles, CA, USA
| |
Collapse
|
38
|
Data-based Decision Rules to Personalize Depression Follow-up. Sci Rep 2018; 8:5064. [PMID: 29567970 PMCID: PMC5864956 DOI: 10.1038/s41598-018-23326-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2017] [Accepted: 03/09/2018] [Indexed: 12/02/2022] Open
Abstract
Depression is a common mental illness with complex and heterogeneous progression dynamics. Risk grouping of depression treatment population based on their longitudinal patterns has the potential to enable cost-effective monitoring policy design. This paper establishes a rule-based method to identify a set of risk predictive patterns from person-level longitudinal disease measurements by integrating the data transformation, rule discovery and rule evaluation. We further extend the identified rules to create rule-based monitoring strategies to adaptively monitor individuals with different disease severities. We applied the rule-based method on an electronic health record (EHR) dataset of depression treatment population containing person-level longitudinal Patient Health Questionnaire (PHQ)-9 scores for assessing depression severity. 12 risk predictive rules are identified, and the rule-based prognostic model based on identified rules enables more accurate prediction of disease severity than other prognostic models including RuleFit, logistic regression and Support Vector Machine. Two rule-based monitoring strategies outperform the latest PHQ-9 based monitoring strategy by providing higher sensitivity and specificity. The rule-based method can lead to a better understanding of disease dynamics, achieving more accurate prognostics of disease progressions, personalizing follow-up intervals, and designing cost-effective monitoring of patients in clinical practice.
Collapse
|
39
|
Kennell TI, Willig JH, Cimino JJ. Clinical Informatics Researcher's Desiderata for the Data Content of the Next Generation Electronic Health Record. Appl Clin Inform 2017; 8:1159-1172. [PMID: 29270955 DOI: 10.4338/aci-2017-06-r-0101] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023] Open
Abstract
OBJECTIVE Clinical informatics researchers depend on the availability of high-quality data from the electronic health record (EHR) to design and implement new methods and systems for clinical practice and research. However, these data are frequently unavailable or present in a format that requires substantial revision. This article reports the results of a review of informatics literature published from 2010 to 2016 that addresses these issues by identifying categories of data content that might be included or revised in the EHR. MATERIALS AND METHODS We used an iterative review process on 1,215 biomedical informatics research articles. We placed them into generic categories, reviewed and refined the categories, and then assigned additional articles, for a total of three iterations. RESULTS Our process identified eight categories of data content issues: Adverse Events, Clinician Cognitive Processes, Data Standards Creation and Data Communication, Genomics, Medication List Data Capture, Patient Preferences, Patient-reported Data, and Phenotyping. DISCUSSION These categories summarize discussions in biomedical informatics literature that concern data content issues restricting clinical informatics research. These barriers to research result from data that are either absent from the EHR or are inadequate (e.g., in narrative text form) for the downstream applications of the data. In light of these categories, we discuss changes to EHR data storage that should be considered in the redesign of EHRs, to promote continued innovation in clinical informatics. CONCLUSION Based on published literature of clinical informaticians' reuse of EHR data, we characterize eight types of data content that, if included in the next generation of EHRs, would find immediate application in advanced informatics tools and techniques.
Collapse
Affiliation(s)
- Timothy I Kennell
- Informatics Institute, School of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States
| | - James H Willig
- Informatics Institute, School of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States.,Department of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States
| | - James J Cimino
- Informatics Institute, School of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States.,Department of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States
| |
Collapse
|
40
|
Clifton DA, Niehaus KE, Charlton P, Colopy GW. Health Informatics via Machine Learning for the Clinical Management of Patients. Yearb Med Inform 2017; 10:38-43. [PMID: 26293849 DOI: 10.15265/iy-2015-014] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/19/2023] Open
Abstract
OBJECTIVES To review how health informatics systems based on machine learning methods have impacted the clinical management of patients, by affecting clinical practice. METHODS We reviewed literature from 2010-2015 from databases such as Pubmed, IEEE xplore, and INSPEC, in which methods based on machine learning are likely to be reported. We bring together a broad body of literature, aiming to identify those leading examples of health informatics that have advanced the methodology of machine learning. While individual methods may have further examples that might be added, we have chosen some of the most representative, informative exemplars in each case. RESULTS Our survey highlights that, while much research is taking place in this high-profile field, examples of those that affect the clinical management of patients are seldom found. We show that substantial progress is being made in terms of methodology, often by data scientists working in close collaboration with clinical groups. CONCLUSIONS Health informatics systems based on machine learning are in their infancy and the translation of such systems into clinical management has yet to be performed at scale.
Collapse
Affiliation(s)
- D A Clifton
- David A. Clifton, Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, UK, E-mail:
| | | | | | | |
Collapse
|
41
|
Kreimeyer K, Foster M, Pandey A, Arya N, Halford G, Jones SF, Forshee R, Walderhaug M, Botsis T. Natural language processing systems for capturing and standardizing unstructured clinical information: A systematic review. J Biomed Inform 2017; 73:14-29. [PMID: 28729030 DOI: 10.1016/j.jbi.2017.07.012] [Citation(s) in RCA: 280] [Impact Index Per Article: 40.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2017] [Revised: 06/07/2017] [Accepted: 07/14/2017] [Indexed: 12/24/2022]
Abstract
We followed a systematic approach based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses to identify existing clinical natural language processing (NLP) systems that generate structured information from unstructured free text. Seven literature databases were searched with a query combining the concepts of natural language processing and structured data capture. Two reviewers screened all records for relevance during two screening phases, and information about clinical NLP systems was collected from the final set of papers. A total of 7149 records (after removing duplicates) were retrieved and screened, and 86 were determined to fit the review criteria. These papers contained information about 71 different clinical NLP systems, which were then analyzed. The NLP systems address a wide variety of important clinical and research tasks. Certain tasks are well addressed by the existing systems, while others remain as open challenges that only a small number of systems attempt, such as extraction of temporal information or normalization of concepts to standard terminologies. This review has identified many NLP systems capable of processing clinical free text and generating structured output, and the information collected and evaluated here will be important for prioritizing development of new approaches for clinical NLP.
Collapse
Affiliation(s)
- Kory Kreimeyer
- Office of Biostatistics and Epidemiology, Center for Biologics Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, United States.
| | - Matthew Foster
- Office of Biostatistics and Epidemiology, Center for Biologics Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, United States
| | - Abhishek Pandey
- Office of Biostatistics and Epidemiology, Center for Biologics Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, United States
| | - Nina Arya
- Office of Biostatistics and Epidemiology, Center for Biologics Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, United States
| | - Gwendolyn Halford
- FDA Library, US Food and Drug Administration, Silver Spring, MD, United States
| | - Sandra F Jones
- Cancer Surveillance Branch, Division of Cancer Prevention and Control, National Center for Chronic Disease Prevention and Health Promotion, Centers for Disease Control and Prevention, Atlanta, GA, United States
| | - Richard Forshee
- Office of Biostatistics and Epidemiology, Center for Biologics Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, United States
| | - Mark Walderhaug
- Office of Biostatistics and Epidemiology, Center for Biologics Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, United States
| | - Taxiarchis Botsis
- Office of Biostatistics and Epidemiology, Center for Biologics Evaluation and Research, US Food and Drug Administration, Silver Spring, MD, United States
| |
Collapse
|
42
|
Homer ML, Palmer NP, Fox KP, Armstrong J, Mandl KD. Predicting Falls in People Aged 65 Years and Older from Insurance Claims. Am J Med 2017; 130:744.e17-744.e23. [PMID: 28111165 PMCID: PMC5441951 DOI: 10.1016/j.amjmed.2017.01.003] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/04/2016] [Revised: 12/30/2016] [Accepted: 01/02/2017] [Indexed: 11/25/2022]
Abstract
BACKGROUND Accidental falls among people aged 65 years and older caused approximately 2,700,000 injuries, 27,000 deaths, and cost more than 34 billion dollars in the US annually in recent years. Here, we derive and validate a predictive model for falls based on a retrospective cohort of those 65 years and older. METHODS Insurance claims from a 1-year observational period were used to predict a fall-related claim in the following 2 years. The predictive model takes into account a person's age, sex, prescriptions, and diagnoses. Through random assignment, half of the people had their claims used to derive the model, while the remaining people had their claims used to validate the model. RESULTS Of 120,881 individuals with Aetna health insurance coverage, 12,431 (10.3%) members fell. During validation, people were risk stratified across 20 levels, where those in the highest risk stratum had 10.5 times the risk as those in the lowest stratum (33.1% vs 3.1%). CONCLUSIONS Using only insurance claims, individuals in this large cohort at high risk of falls could be readily identified up to 2 years in advance. Although external validation is needed, the findings support the use of the model to better target interventions.
Collapse
Affiliation(s)
- Mark L Homer
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Mass; Department of Biomedical Informatics, Harvard Medical School, Boston, Mass
| | - Nathan P Palmer
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Mass; Department of Biomedical Informatics, Harvard Medical School, Boston, Mass
| | | | | | - Kenneth D Mandl
- Computational Health Informatics Program, Boston Children's Hospital, Boston, Mass; Department of Biomedical Informatics, Harvard Medical School, Boston, Mass.
| |
Collapse
|
43
|
Abstract
Electronic health records (EHR) provide a rich source of temporal data that present a unique opportunity to characterize disease patterns and risk of imminent disease. While many data-mining tools have been adopted for EHR-based disease early detection, linear discriminant analysis (LDA) is one of the most commonly used statistical methods. However, it is difficult to train an accurate LDA model for early disease diagnosis when too few patients are known to have the target disease. Furthermore, EHR data are heterogeneous with significant noise. In such cases, the covariance matrices used in LDA are usually singular and estimated with a large variance.
This article presents
Daehr
, an extension of the LDA framework using electronic health record data to address these issues. Beyond existing LDA analyzers, we propose
Daehr
to (1) eliminate the data noise caused by the manual encoding of EHR data and (2) lower the variance of parameter (covariance matrices) estimation for LDA models when only a few patients’ EHR are available for training. To achieve these two goals, we designed an iterative algorithm to improve the covariance matrix estimation with embedded data-noise/parameter-variance reduction for LDA. We evaluated
Daehr
extensively using the College Health Surveillance Network, a large, real-world EHR dataset. Specifically, our experiments compared the performance of LDA to three baselines (i.e., LDA and its derivatives) in identifying college students at high risk for mental health disorders from 23 U.S. universities. Experimental results demonstrate
Daehr
significantly outperforms the three baselines by achieving 1.4%--19.4% higher accuracy and a 7.5%--43.5% higher F1-score.
Collapse
Affiliation(s)
- Haoyi Xiong
- Missouri University of Science and Technology, Missouri, USA
| | | | | | | | | |
Collapse
|
44
|
Kim MH, Banerjee S, Park SM, Pathak J. Improving risk prediction for depression via Elastic Net regression - Results from Korea National Health Insurance Services Data. AMIA ... ANNUAL SYMPOSIUM PROCEEDINGS. AMIA SYMPOSIUM 2017; 2016:1860-1869. [PMID: 28269945 PMCID: PMC5333336] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Depression, despite its high prevalence, remains severely under-diagnosed across the healthcare system. This demands the development of data-driven approaches that can help screen patients who are at a high risk of depression. In this work, we develop depression risk prediction models that incorporate disease co-morbidities using logistic regression with Elastic Net. Using data from the one million twelve-year longitudinal cohort from Korean National Health Insurance Services (KNHIS), our model achieved an Area Under the Curve (AUC) of the Receiver Operating Characteristic (ROC) of 0.7818, compared to a traditional logistic regression model without co-morbidity analysis (AUC of 0.6992). We also showed co-morbidity adjusted Odds Ratios (ORs), which may be more accurate independent estimate of each predictor variable. In conclusion, inclusion of co-morbidity analysis improved the performance of depression risk prediction models.
Collapse
Affiliation(s)
- Min-hyung Kim
- Department of Healthcare Policy & Research, Weill Cornell Medical College, New York, NY, USA
| | - Samprit Banerjee
- Department of Healthcare Policy & Research, Weill Cornell Medical College, New York, NY, USA
| | - Sang Min Park
- Department of Family Medicine, Seoul National University College of Medicine, Seoul, Korea
| | - Jyotishman Pathak
- Department of Healthcare Policy & Research, Weill Cornell Medical College, New York, NY, USA
| |
Collapse
|
45
|
Novel Use of Natural Language Processing (NLP) to Predict Suicidal Ideation and Psychiatric Symptoms in a Text-Based Mental Health Intervention in Madrid. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2016; 2016:8708434. [PMID: 27752278 PMCID: PMC5056245 DOI: 10.1155/2016/8708434] [Citation(s) in RCA: 58] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/17/2016] [Revised: 08/18/2016] [Accepted: 08/30/2016] [Indexed: 12/31/2022]
Abstract
Natural language processing (NLP) and machine learning were used to predict suicidal ideation and heightened psychiatric symptoms among adults recently discharged from psychiatric inpatient or emergency room settings in Madrid, Spain. Participants responded to structured mental and physical health instruments at multiple follow-up points. Outcome variables of interest were suicidal ideation and psychiatric symptoms (GHQ-12). Predictor variables included structured items (e.g., relating to sleep and well-being) and responses to one unstructured question, “how do you feel today?” We compared NLP-based models using the unstructured question with logistic regression prediction models using structured data. The PPV, sensitivity, and specificity for NLP-based models of suicidal ideation were 0.61, 0.56, and 0.57, respectively, compared to 0.73, 0.76, and 0.62 of structured data-based models. The PPV, sensitivity, and specificity for NLP-based models of heightened psychiatric symptoms (GHQ-12 ≥ 4) were 0.56, 0.59, and 0.60, respectively, compared to 0.79, 0.79, and 0.85 in structured models. NLP-based models were able to generate relatively high predictive values based solely on responses to a simple general mood question. These models have promise for rapidly identifying persons at risk of suicide or psychological distress and could provide a low-cost screening alternative in settings where lengthy structured item surveys are not feasible.
Collapse
|
46
|
Stewart R, Davis K. 'Big data' in mental health research: current status and emerging possibilities. Soc Psychiatry Psychiatr Epidemiol 2016; 51:1055-72. [PMID: 27465245 PMCID: PMC4977335 DOI: 10.1007/s00127-016-1266-8] [Citation(s) in RCA: 51] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/07/2016] [Accepted: 07/08/2016] [Indexed: 01/24/2023]
Abstract
PURPOSE 'Big data' are accumulating in a multitude of domains and offer novel opportunities for research. The role of these resources in mental health investigations remains relatively unexplored, although a number of datasets are in use and supporting a range of projects. We sought to review big data resources and their use in mental health research to characterise applications to date and consider directions for innovation in future. METHODS A narrative review. RESULTS Clear disparities were evident in geographic regions covered and in the disorders and interventions receiving most attention. DISCUSSION We discuss the strengths and weaknesses of the use of different types of data and the challenges of big data in general. Current research output from big data is still predominantly determined by the information and resources available and there is a need to reverse the situation so that big data platforms are more driven by the needs of clinical services and service users.
Collapse
Affiliation(s)
- Robert Stewart
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, Box 63, De Crespigny Park, London, SE5 8AF, UK.
| | - Katrina Davis
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, Box 63, De Crespigny Park, London, SE5 8AF, UK
| |
Collapse
|
47
|
Homer ML, Palmer NP, Bodenreider O, Cami A, Chadwick L, Mandl KD. The Drug Data to Knowledge Pipeline: Large-Scale Claims Data Classification for Pharmacologic Insight. AMIA JOINT SUMMITS ON TRANSLATIONAL SCIENCE PROCEEDINGS. AMIA JOINT SUMMITS ON TRANSLATIONAL SCIENCE 2016; 2016:105-11. [PMID: 27570659 PMCID: PMC5001754] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
Abstract
In biomedical informatics, assigning drug codes to categories is a common step in the analysis pipeline. Unfortunately, incomplete mappings are the norm rather than the exception with coverage values less than 85% not uncommon. Here, we perform this linking task on a nationwide insurance claims database with over 13 million members who were dispensed, according to National Drug Codes (NDCs), over 50,000 unique product forms of medication. The chosen approach employs Cerner Multum's VantageRx and the U.S. National Library of Medicine's RxMix. As a result, 94.0% of the NDCs were successfully mapped to categories used by common drug terminologies, e.g., Anatomical Therapeutic Chemical (ATC). Implemented as an SQL database and scripts, the approach is generic and can be setup for a new data set in a few hours. Thus, the method is a viable option for large-scale drug classification.
Collapse
Affiliation(s)
- Mark L. Homer
- Computational Health Informatics Program, Boston Children’s Hospital, Boston, MA;,Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Nathan P. Palmer
- Computational Health Informatics Program, Boston Children’s Hospital, Boston, MA;,Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Olivier Bodenreider
- National Library of Medicine, National Institutes of Health, Bethesda, MD, USA
| | - Aurel Cami
- Computational Health Informatics Program, Boston Children’s Hospital, Boston, MA;,Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| | - Laura Chadwick
- Computational Health Informatics Program, Boston Children’s Hospital, Boston, MA;,Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA;,MCPHS University, Boston, MA, USA
| | - Kenneth D. Mandl
- Computational Health Informatics Program, Boston Children’s Hospital, Boston, MA;,Department of Biomedical Informatics, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
48
|
Odgers DJ, Tellis N, Hall H, Dumontier M. Using LASSO Regression to Predict Rheumatoid Arthritis Treatment Efficacy. AMIA JOINT SUMMITS ON TRANSLATIONAL SCIENCE PROCEEDINGS. AMIA JOINT SUMMITS ON TRANSLATIONAL SCIENCE 2016; 2016:176-83. [PMID: 27570666 PMCID: PMC5001752] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Rheumatoid arthritis (RA) accounts for one-fifth of the deaths due to arthritis, the leading cause of disability in the United States. Finding effective treatments for managing arthritis symptoms are a major challenge, since the mechanisms of autoimmune disorders are not fully understood and disease presentation differs for each patient. The American College of Rheumatology clinical guidelines for treatment consider the severity of the disease when deciding treatment, but do not include any prediction of drug efficacy. Using Electronic Health Records and Biomedical Linked Open Data (LOD), we demonstrate a method to classify patient outcomes using LASSO penalized regression. We show how Linked Data improves prediction and provides insight into how drug treatment regimes have different treatment outcome. Applying classifiers like this to decision support in clinical applications could decrease time to successful disease management, lessening a physical and financial burden on patients individually and the healthcare system as a whole.
Collapse
Affiliation(s)
- David J Odgers
- Stanford Center for Biomedical Informatics Research, Stanford University, Stanford, CA
| | - Natalie Tellis
- Stanford Center for Biomedical Informatics Research, Stanford University, Stanford, CA
| | - Heather Hall
- Stanford Center for Biomedical Informatics Research, Stanford University, Stanford, CA
| | - Michel Dumontier
- Stanford Center for Biomedical Informatics Research, Stanford University, Stanford, CA
| |
Collapse
|
49
|
Goldstein BA, Pencina MJ, Montez-Rath ME, Winkelmayer WC. Predicting mortality over different time horizons: which data elements are needed? J Am Med Inform Assoc 2016; 24:176-181. [PMID: 27357832 DOI: 10.1093/jamia/ocw057] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2015] [Revised: 03/04/2016] [Accepted: 03/25/2016] [Indexed: 01/30/2023] Open
Abstract
OBJECTIVE Electronic health records (EHRs) are a resource for "big data" analytics, containing a variety of data elements. We investigate how different categories of information contribute to prediction of mortality over different time horizons among patients undergoing hemodialysis treatment. MATERIAL AND METHODS We derived prediction models for mortality over 7 time horizons using EHR data on older patients from a national chain of dialysis clinics linked with administrative data using LASSO (least absolute shrinkage and selection operator) regression. We assessed how different categories of information relate to risk assessment and compared discrete models to time-to-event models. RESULTS The best predictors used all the available data (c-statistic ranged from 0.72-0.76), with stronger models in the near term. While different variable groups showed different utility, exclusion of any particular group did not lead to a meaningfully different risk assessment. Discrete time models performed better than time-to-event models. CONCLUSIONS Different variable groups were predictive over different time horizons, with vital signs most predictive for near-term mortality and demographic and comorbidities more important in long-term mortality.
Collapse
Affiliation(s)
- Benjamin A Goldstein
- Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina .,Center for Predictive Medicine, Duke Clinical Research Institute, Durham, North Carolina
| | - Michael J Pencina
- Department of Biostatistics and Bioinformatics, Duke University, Durham, North Carolina.,Center for Predictive Medicine, Duke Clinical Research Institute, Durham, North Carolina
| | - Maria E Montez-Rath
- Division of Nephrology, Stanford University School of Medicine, Palo Alto, California
| | | |
Collapse
|
50
|
Conway M, O'Connor D. Social Media, Big Data, and Mental Health: Current Advances and Ethical Implications. Curr Opin Psychol 2016; 9:77-82. [PMID: 27042689 DOI: 10.1016/j.copsyc.2016.01.004] [Citation(s) in RCA: 80] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
Mental health (including substance abuse) is the fifth greatest contributor to the global burden of disease, with an economic cost estimated to be US $2.5 trillion in 2010, and expected to double by 2030. Developing information systems to support and strengthen population-level mental health monitoring forms a core part of the World Health Organization's Comprehensive Action Plan 2013-2020. In this paper, we review recent work that utilizes social media "big data" in conjunction with associated technologies like natural language processing and machine learning to address pressing problems in population-level mental health surveillance and research, focusing both on technological advances and core ethical challenges.
Collapse
Affiliation(s)
- Mike Conway
- Department of Biomedical Informatics, University of Utah, 421 Wakara Way, Salt Lake City, Utah, United States
| | - Daniel O'Connor
- Wellcome Trust, Gibbs Building, 215 Euston Road, London NW1 2BE, United Kingdom
| |
Collapse
|