Hospital-wide natural language processing summarising the health data of 1 million patients

Foresight-a generative pretrained transformer for modelling of patient timelines using electronic health records: a retrospective modelling study

BACKGROUND

An electronic health record (EHR) holds detailed longitudinal information about a patient's health status and general clinical history, a large portion of which is stored as unstructured, free text. Existing approaches to model a patient's trajectory focus mostly on structured data and a subset of single-domain outcomes. This study aims to evaluate the effectiveness of Foresight, a generative transformer in temporal modelling of patient data, integrating both free text and structured formats, to predict a diverse array of future medical outcomes, such as disorders, substances (eg, to do with medicines, allergies, or poisonings), procedures, and findings (eg, relating to observations, judgements, or assessments).

METHODS

Foresight is a novel transformer-based pipeline that uses named entity recognition and linking tools to convert EHR document text into structured, coded concepts, followed by providing probabilistic forecasts for future medical events, such as disorders, substances, procedures, and findings. The Foresight pipeline has four main components: (1) CogStack (data retrieval and preprocessing); (2) the Medical Concept Annotation Toolkit (structuring of the free-text information from EHRs); (3) Foresight Core (deep-learning model for biomedical concept modelling); and (4) the Foresight web application. We processed the entire free-text portion from three different hospital datasets (King's College Hospital [KCH], South London and Maudsley [SLaM], and the US Medical Information Mart for Intensive Care III [MIMIC-III]), resulting in information from 811 336 patients and covering both physical and mental health institutions. We measured the performance of models using custom metrics derived from precision and recall.

FINDINGS

Foresight achieved a precision@10 (ie, of 10 forecasted candidates, at least one is correct) of 0·68 (SD 0·0027) for the KCH dataset, 0·76 (0·0032) for the SLaM dataset, and 0·88 (0·0018) for the MIMIC-III dataset, for forecasting the next new disorder in a patient timeline. Foresight also achieved a precision@10 value of 0·80 (0·0013) for the KCH dataset, 0·81 (0·0026) for the SLaM dataset, and 0·91 (0·0011) for the MIMIC-III dataset, for forecasting the next new biomedical concept. In addition, Foresight was validated on 34 synthetic patient timelines by five clinicians and achieved a relevancy of 33 (97% [95% CI 91-100]) of 34 for the top forecasted candidate disorder. As a generative model, Foresight can forecast follow-on biomedical concepts for as many steps as required.

INTERPRETATION

Foresight is a general-purpose model for biomedical concept modelling that can be used for real-world risk forecasting, virtual trials, and clinical research to study the progression of disorders, to simulate interventions and counterfactuals, and for educational purposes.

FUNDING

National Health Service Artificial Intelligence Laboratory, National Institute for Health and Care Research Biomedical Research Centre, and Health Data Research UK.

Artificial intelligence methods for improved detection of undiagnosed heart failure with preserved ejection fraction

AIM

Heart failure with preserved ejection fraction (HFpEF) remains under-diagnosed in clinical practice despite accounting for nearly half of all heart failure (HF) cases. Accurate and timely diagnosis of HFpEF is crucial for proper patient management and treatment. In this study, we explored the potential of natural language processing (NLP) to improve the detection and diagnosis of HFpEF according to the European Society of Cardiology (ESC) diagnostic criteria.

METHODS AND RESULTS

In a retrospective cohort study, we used an NLP pipeline applied to the electronic health record (EHR) to identify patients with a clinical diagnosis of HF between 2010 and 2022. We collected demographic, clinical, echocardiographic and outcome data from the EHR. Patients were categorized according to the left ventricular ejection fraction (LVEF). Those with LVEF ≥50% were further categorized based on whether they had a clinician-assigned diagnosis of HFpEF and if not, whether they met the ESC diagnostic criteria. Results were validated in a second, independent centre. We identified 8606 patients with HF. Of 3727 consecutive patients with HF and LVEF ≥50% on echocardiogram, only 8.3% had a clinician-assigned diagnosis of HFpEF, while 75.4% met ESC criteria but did not have a formal diagnosis of HFpEF. Patients with confirmed HFpEF were hospitalized more frequently; however the ESC criteria group had a higher 5-year mortality, despite being less comorbid and experiencing fewer acute cardiovascular events.

CONCLUSIONS

This study demonstrates that patients with undiagnosed HFpEF are an at-risk group with high mortality. It is possible to use NLP methods to identify likely HFpEF patients from EHR data who would likely then benefit from expert clinical review and complement the use of diagnostic algorithms.

Artificial intelligence (AI) for neurologists: do digital neurones dream of electric sheep?

Artificial intelligence (AI) is routinely mentioned in journals and newspapers, and non-technical outsiders may have difficulty in distinguishing hyperbole from reality. We present a practical guide to help non-technical neurologists to understand healthcare AI. AI is being used to support clinical decisions in treating neurological disorders. We introduce basic concepts of AI, such as machine learning and natural language processing, and explain how AI is being used in healthcare, giving examples its benefits and challenges. We also cover how AI performance is measured, and its regulatory aspects in healthcare. An important theme is that AI is a general-purpose technology like medical statistics, with broad utility applicable in various scenarios, such that niche approaches are outpaced by approaches that are broadly applicable in many disease areas and specialties. By understanding AI basics and its potential applications, neurologists can make informed decisions when evaluating AI used in their clinical practice. This article was written by four humans, with generative AI helping with formatting and image generation.