Influenza forecasting for French regions combining EHR, web and climatic data sources with a machine learning ensemble approach

Multisite development and validation of machine learning models to predict severe outcomes and guide decision-making for emergency department patients with influenza

Objective

Millions of Americans are infected by influenza annually. A minority seek care in the emergency department (ED) and, of those, only a limited number experience severe disease or death. ED clinicians must distinguish those at risk for deterioration from those who can be safely discharged.

Methods

We developed random forest machine learning (ML) models to estimate needs for critical care within 24 h and inpatient care within 72 h in ED patients with influenza. Predictor data were limited to those recorded prior to ED disposition decision: demographics, ED complaint, medical problems, vital signs, supplemental oxygen use, and laboratory results. Our study population was comprised of adults diagnosed with influenza at one of five EDs in our university health system between January 1, 2017 and May 18, 2022; visits were divided into two cohorts to facilitate model development and validation. Prediction performance was assessed by the area under the receiver operating characteristic curve (AUC) and the Brier score.

Results

Among 8032 patients with laboratory-confirmed influenza, incidence of critical care needs was 6.3% and incidence of inpatient care needs was 19.6%. The most common reasons for ED visit were symptoms of respiratory tract infection, fever, and shortness of breath. Model AUCs were 0.89 (95% CI 0.86-0.93) for prediction of critical care and 0.90 (95% CI 0.88-0.93) for inpatient care needs; Brier scores were 0.026 and 0.042, respectively. Importantpredictors included shortness of breath, increasing respiratory rate, and a high number of comorbid diseases.

Conclusions

ML methods can be used to accurately predict clinical deterioration in ED patients with influenza and have potential to support ED disposition decision-making.

Early warning of emerging infectious diseases based on multimodal data

The coronavirus disease 2019 (COVID-19) pandemic has dramatically increased the awareness of emerging infectious diseases. The advancement of multiomics analysis technology has resulted in the development of several databases containing virus information. Several scientists have integrated existing data on viruses to construct phylogenetic trees and predict virus mutation and transmission in different ways, providing prospective technical support for epidemic prevention and control. This review summarized the databases of known emerging infectious viruses and techniques focusing on virus variant forecasting and early warning. It focuses on the multi-dimensional information integration and database construction of emerging infectious viruses, virus mutation spectrum construction and variant forecast model, analysis of the affinity between mutation antigen and the receptor, propagation model of virus dynamic evolution, and monitoring and early warning for variants. As people have suffered from COVID-19 and repeated flu outbreaks, we focused on the research results of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and influenza viruses. This review comprehensively viewed the latest virus research and provided a reference for future virus prevention and control research.

Real-world data: a brief review of the methods, applications, challenges and opportunities

Background

The increased adoption of the internet, social media, wearable devices, e-health services, and other technology-driven services in medicine and healthcare has led to the rapid generation of various types of digital data, providing a valuable data source beyond the confines of traditional clinical trials, epidemiological studies, and lab-based experiments.

Methods

We provide a brief overview on the type and sources of real-world data and the common models and approaches to utilize and analyze real-world data. We discuss the challenges and opportunities of using real-world data for evidence-based decision making This review does not aim to be comprehensive or cover all aspects of the intriguing topic on RWD (from both the research and practical perspectives) but serves as a primer and provides useful sources for readers who interested in this topic.

Results and Conclusions

Real-world hold great potential for generating real-world evidence for designing and conducting confirmatory trials and answering questions that may not be addressed otherwise. The voluminosity and complexity of real-world data also call for development of more appropriate, sophisticated, and innovative data processing and analysis techniques while maintaining scientific rigor in research findings, and attentions to data ethics to harness the power of real-world data.

Multisite evaluation of prediction models for emergency department crowding before and during the COVID-19 pandemic

OBJECTIVE

To develop a machine learning framework to forecast emergency department (ED) crowding and to evaluate model performance under spatial and temporal data drift.

MATERIALS AND METHODS

We obtained 4 datasets, identified by the location: 1-large academic hospital and 2-rural hospital, and time period: pre-coronavirus disease (COVID) (January 1, 2019-February 1, 2020) and COVID-era (May 15, 2020-February 1, 2021). Our primary target was a binary outcome that is equal to 1 if the number of patients with acute respiratory illness that were ED boarding for more than 4 h was above a prescribed historical percentile. We trained a random forest and used the area under the curve (AUC) to evaluate out-of-sample performance for 2 experiments: (1) we evaluated the impact of sudden temporal drift by training models using pre-COVID data and testing them during the COVID-era, (2) we evaluated the impact of spatial drift by testing models trained at location 1 on data from location 2, and vice versa.

RESULTS

The baseline AUC values for ED boarding ranged from 0.54 (pre-COVID at location 2) to 0.81 (COVID-era at location 1). Models trained with pre-COVID data performed similarly to COVID-era models (0.82 vs 0.78 at location 1). Models that were transferred from location 2 to location 1 performed worse than models trained at location 1 (0.51 vs 0.78).

DISCUSSION AND CONCLUSION

Our results demonstrate that ED boarding is a predictable metric for ED crowding, models were not significantly impacted by temporal data drift, and any attempts at implementation must consider spatial data drift.

Online searches of children’s oseltamivir in public primary and specialized care: Detecting influenza outbreaks in Finland using dedicated databases for health care professionals

Introduction

Health care professionals working in primary and specialized care typically search for medical information from Internet sources. In Finland, Physician’s Databases are online portals aimed at professionals seeking medical information. As dosage errors may occur when prescribing medication to children, professionals’ need for reliable medical information has increased in public health care centers and hospitals. Influenza continues to be a public health threat, with young children at risk of developing severe illness and easily transmitting the virus. Oseltamivir is used to treat children with influenza. The objective of this study was to compare searches for children’s oseltamivir and influenza diagnoses in primary and specialized care, and to determine if the searches could aid detection of influenza outbreaks.

Methods

We compared searches in Physician’s Databases for children’s oral suspension of oseltamivir (6 mg/mL) for influenza diagnoses of children under 7 years and laboratory findings of influenza A and B from the National Infectious Disease Register. Searches and diagnoses were assessed in primary and specialized care across Finland by season from 2012–2016. The Moving Epidemic Method (MEM) calculated seasonal starts and ends, and paired differences in the mean compared two indicators. Correlation was tested to compare seasons.

Results

We found that searches and diagnoses in primary and specialized care showed visually similar patterns annually. The MEM-calculated starting weeks in searches appeared mainly in the same week. Oseltamivir searches in primary care preceded diagnoses by −1.0 weeks (95% CI: −3.0, −0.3; p = 0.132) with very high correlation (τ = 0.913). Specialized care oseltamivir searches and diagnoses correlated moderately (τ = 0.667).

Conclusion

Health care professionals’ searches for children’s oseltamivir in online databases linked with the registers of children’s influenza diagnoses in primary and specialized care. Therefore, database searches should be considered as supplementary information in disease surveillance when detecting influenza epidemics.