Data curation during a pandemic and lessons learned from COVID-19

Mobilizing data during a crisis: Building rapid evidence pipelines using multi-institutional real world data

The COVID-19 pandemic generated tremendous interest in using real world data (RWD). Many consortia across the public and private sectors formed in 2020 with the goal of rapidly producing high-quality evidence from RWD to guide medical decision-making, public health priorities, and more. Experiences were gathered from five large consortia on rapid multi-institutional evidence generation during the COVID-19 pandemic. Insights have been compiled across five dimensions: consortium composition, governance structure and alignment of priorities, data sharing, data analysis, and evidence dissemination. The purpose of this piece is to offer guidance on building large-scale multi-institutional RWD analysis pipelines for future public health issues. The composition of each consortium was largely influenced by existing collaborations. A central set of priorities for evidence generation guided each consortium, however different approaches to governance emerged. Challenges surrounding limited access to clinical data due to various contributors were overcome in unique ways. While all consortia used different methods to construct and analyze patient cohorts ranging from centralized to federated approaches, all proved effective for generating meaningful real-world evidence. Actionable recommendations for clinical practice and public health agencies were made from translating insights from consortium analyses. Each consortium was successful in rapidly answering questions about COVID-19 diagnosis and treatment despite all taking slightly different approaches to data sharing and analysis. Leveraging RWD, leveraged in a manner that applies scientific rigor and transparency, can complement higher-level evidence and serve as an important adjunct to clinical trials to quickly guide policy and critical care, especially for a pandemic response.

Now Is the Time to Strengthen Government-Academic Data Infrastructures to Jump-Start Future Public Health Crisis Response

During public health crises, the significance of rapid data sharing cannot be overstated. In attempts to accelerate COVID-19 pandemic responses, discussions within society and scholarly research have focused on data sharing among health care providers, across government departments at different levels, and on an international scale. A lesser-addressed yet equally important approach to sharing data during the COVID-19 pandemic and other crises involves cross-sector collaboration between government entities and academic researchers. Specifically, this refers to dedicated projects in which a government entity shares public health data with an academic research team for data analysis to receive data insights to inform policy. In this viewpoint, we identify and outline documented data sharing challenges in the context of COVID-19 and other public health crises, as well as broader crisis scenarios encompassing natural disasters and humanitarian emergencies. We then argue that government-academic data collaborations have the potential to alleviate these challenges, which should place them at the forefront of future research attention. In particular, for researchers, data collaborations with government entities should be considered part of the social infrastructure that bolsters their research efforts toward public health crisis response. Looking ahead, we propose a shift from ad hoc, intermittent collaborations to cultivating robust and enduring partnerships. Thus, we need to move beyond viewing government-academic data interactions as 1-time sharing events. Additionally, given the scarcity of scholarly exploration in this domain, we advocate for further investigation into the real-world practices and experiences related to sharing data from government sources with researchers during public health crises.

Deployment of the National Notifiable Diseases Surveillance System during the 2022-23 mpox outbreak in the United States-Opportunities and challenges with case notifications during public health emergencies

Timely case notifications following the introduction of an uncommon pathogen, such as mpox, are critical for understanding disease transmission and for developing and implementing effective mitigation strategies. When Massachusetts public health officials notified the Centers for Disease Control and Prevention (CDC) about a confirmed orthopoxvirus case on May 17, 2023, which was later confirmed as mpox at CDC, mpox was not a nationally notifiable disease. Because existing processes for new data collections through the National Notifiable Disease Surveillance System were not well suited for implementation during emergency responses at the time of the mpox outbreak, several interim notification approaches were established to capture case data. These interim approaches were successful in generating daily case counts, monitoring disease transmission, and identifying high-risk populations. However, the approaches also required several data collection approvals by the federal government and the Council for State and Territorial Epidemiologists, the use of four different case report forms, and the establishment of complex data management and validation processes involving data element mapping and record-level de-duplication steps. We summarize lessons learned from these interim approaches to inform and improve case notifications during future outbreaks. These lessons reinforce CDC's Data Modernization Initiative to work in close collaboration with state, territorial, and local public health departments to strengthen case-based surveillance prior to the next public health emergency.

FAIR+E pathogen data for surveillance and research: lessons from COVID-19

The COVID-19 pandemic has exemplified the importance of interoperable and equitable data sharing for global surveillance and to support research. While many challenges could be overcome, at least in some countries, many hurdles within the organizational, scientific, technical and cultural realms still remain to be tackled to be prepared for future threats. We propose to (i) continue supporting global efforts that have proven to be efficient and trustworthy toward addressing challenges in pathogen molecular data sharing; (ii) establish a distributed network of Pathogen Data Platforms to (a) ensure high quality data, metadata standardization and data analysis, (b) perform data brokering on behalf of data providers both for research and surveillance, (c) foster capacity building and continuous improvements, also for pandemic preparedness; (iii) establish an International One Health Pathogens Portal, connecting pathogen data isolated from various sources (human, animal, food, environment), in a truly One Health approach and following FAIR principles. To address these challenging endeavors, we have started an ELIXIR Focus Group where we invite all interested experts to join in a concerted, expert-driven effort toward sustaining and ensuring high-quality data for global surveillance and research.

Lessons from COVID-19 for rescalable data collection

Novel data and analyses have had an important role in informing the public health response to the COVID-19 pandemic. Existing surveillance systems were scaled up, and in some instances new systems were developed to meet the challenges posed by the magnitude of the pandemic. We describe the routine and novel data that were used to address urgent public health questions during the pandemic, underscore the challenges in sustainability and equity in data generation, and highlight key lessons learnt for designing scalable data collection systems to support decision making during a public health crisis. As countries emerge from the acute phase of the pandemic, COVID-19 surveillance systems are being scaled down. However, SARS-CoV-2 resurgence remains a threat to global health security; therefore, a minimal cost-effective system needs to remain active that can be rapidly scaled up if necessary. We propose that a retrospective evaluation to identify the cost-benefit profile of the various data streams collected during the pandemic should be on the scientific research agenda.

Epidemic history and evolution of an emerging threat of international concern, the severe acute respiratory syndrome coronavirus 2

This comprehensive review focuses on the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) and its impact as the cause of the COVID-19 pandemic. Its objective is to provide a cohesive overview of the epidemic history and evolutionary aspects of the virus, with a particular emphasis on its emergence, global spread, and implications for public health. The review delves into the timelines and key milestones of SARS-CoV-2's epidemiological progression, shedding light on the challenges encountered during early containment efforts and subsequent waves of transmission. Understanding the evolutionary dynamics of the virus is crucial in monitoring its potential for adaptation and future outbreaks. Genetic characterization of SARS-CoV-2 is discussed, with a focus on the emergence of new variants and their implications for transmissibility, severity, and immune evasion. The review highlights the important role of genomic surveillance in tracking viral mutations linked to establishing public health interventions. By analyzing the origins, global spread, and genetic evolution of SARS-CoV-2, valuable insights can be gained for the development of effective control measures, improvement of pandemic preparedness, and addressing future emerging infectious diseases of international concern.

Data pipelines in a public health emergency: The human in the machine

In an emergency epidemic response, data providers supply data on a best-faith effort to modellers and analysts who are typically the end user of data collected for other primary purposes such as to inform patient care. Thus, modellers who analyse secondary data have limited ability to influence what is captured. During an emergency response, models themselves are often under constant development and require both stability in their data inputs and flexibility to incorporate new inputs as novel data sources become available. This dynamic landscape is challenging to work with. Here we outline a data pipeline used in the ongoing COVID-19 response in the UK that aims to address these issues. A data pipeline is a sequence of steps to carry the raw data through to a processed and useable model input, along with the appropriate metadata and context. In ours, each data type had an individual processing report, designed to produce outputs that could be easily combined and used downstream. Automated checks were in-built and added as new pathologies emerged. These cleaned outputs were collated at different geographic levels to provide standardised datasets. Finally, a human validation step was an essential component of the analysis pathway and permitted more nuanced issues to be captured. This framework allowed the pipeline to grow in complexity and volume and facilitated the diverse range of modelling approaches employed by researchers. Additionally, every report or modelling output could be traced back to the specific data version that informed it ensuring reproducibility of results. Our approach has been used to facilitate fast-paced analysis and has evolved over time. Our framework and its aspirations are applicable to many settings beyond COVID-19 data, for example for other outbreaks such as Ebola, or where routine and regular analyses are required.

Epidemiologic information discovery from open-access COVID-19 case reports via pretrained language model

Although open-access data are increasingly common and useful to epidemiological research, the curation of such datasets is resource-intensive and time-consuming. Despite the existence of a major source of COVID-19 data, the regularly disclosed case reports were often written in natural language with an unstructured format. Here, we propose a computational framework that can automatically extract epidemiological information from open-access COVID-19 case reports. We develop this framework by coupling a language model developed using deep neural networks with training samples compiled using an optimized data annotation strategy. When applied to the COVID-19 case reports collected from mainland China, our framework outperforms all other state-of-the-art deep learning models. The information extracted from our approach is highly consistent with that obtained from the gold-standard manual coding, with a matching rate of 80%. To disseminate our algorithm, we provide an open-access online platform that is able to estimate key epidemiological statistics in real time, with much less effort for data curation.

•

We propose a method to obtain epidemiological information from COVID-19 case reports

•

The extracted information has 80% matching rate with the gold-standard manual coding

•

We provide an online platform that can analyze epidemiological statistics in real time

A comprehensive review of COVID-19 detection techniques: From laboratory systems to wearable devices

Screening of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) among symptomatic and asymptomatic patients offers unique opportunities for curtailing the transmission of novel coronavirus disease 2019, commonly known as COVID-19. Molecular diagnostic techniques, namely reverse transcription loop-mediated isothermal amplification (RT-LAMP), reverse transcription-polymerase chain reaction (RT-PCR), and immunoassays, have been frequently used to identify COVID-19 infection. Although these techniques are robust and accurate, mass testing of potentially infected individuals has shown difficulty due to the resources, manpower, and costs it entails. Moreover, as these techniques are typically used to test symptomatic patients, healthcare systems have failed to screen asymptomatic patients, whereas the spread of COVID-19 by these asymptomatic individuals has turned into a crucial problem. Besides, respiratory infections or cardiovascular conditions generally demonstrate changes in physiological parameters, namely body temperature, blood pressure, and breathing rate, which signifies the onset of diseases. Such vitals monitoring systems have shown promising results employing artificial intelligence (AI). Therefore, the potential use of wearable devices for monitoring asymptomatic COVID-19 individuals has recently been explored. This work summarizes the efforts that have been made in the domains from laboratory-based testing to asymptomatic patient monitoring via wearable systems.

Emergence and widespread circulation of a recombinant SARS-CoV-2 lineage in North America

Although recombination is a feature of coronavirus evolution, previously detected recombinant lineages of SARS-CoV-2 have shown limited circulation thus far. Here, we present a detailed phylogenetic analysis of four SARS-CoV-2 lineages to investigate the possibility of virus recombination among them. Our analyses reveal well-supported phylogenetic differences between the Orf1ab region encoding viral non-structural proteins and the rest of the genome, including Spike (S) protein and remaining reading frames. By accounting for several deletions in NSP6, Orf3a, and S, we conclude that the B.1.628 major cluster, now designated as lineage XB, originated from a recombination event between viruses of B.1.631 and B.1.634 lineages. This scenario is supported by the spatiotemporal distribution of these lineages across the USA and Mexico during 2021, suggesting that the recombination event originated in this geographical region. This event raises important questions regarding the role and potential effects of recombination on SARS-CoV-2 evolution.

OpenStreetMap Contribution to Local Data Ecosystems in COVID-19 Times: Experiences and Reflections from the Italian Case

Data and digital technologies have been at the core of the societal response to COVID-19 since the beginning of the pandemic. This work focuses on the specific contribution of the OpenStreetMap (OSM) project to address the early stage of the COVID-19 crisis (approximately from February to May 2020) in Italy. Several activities initiated by the Italian OSM community are described, including: mapping ‘red zones’ (the first municipalities affected by the emergency); updating OSM pharmacies based on the authoritative dataset from the Ministry of Health; adding information on delivery services of commercial activities during COVID-19 times; publishing web maps to offer COVID-19-specific information at the local level; and developing software tools to help collect new data. Those initiatives are analysed from a data ecosystem perspective, identifying the actors, data and data flows involved, and reflecting on the enablers and barriers for their success from a technical, organisational and legal point of view. The OSM project itself is then assessed in the wider European policy context, in particular against the objectives of the recent European strategy for data, highlighting opportunities and challenges for scaling successful approaches such as those to fight COVID-19 from the local to the national and European scales.

A worldwide epidemiological database for COVID-19 at fine-grained spatial resolution

This database provides the daily time-series of COVID-19 cases, deaths, recovered people, tests, vaccinations, and hospitalizations, for more than 230 countries, 760 regions, and 12,000 lower-level administrative divisions. The geographical entities are associated with identifiers to match with hydrometeorological, geospatial, and mobility data. The database includes policy measures at the national and, when available, sub-national levels. The data acquisition pipeline is open-source and fully automated. As most governments revise the data retrospectively, the database always updates the complete time-series to mirror the original source. Vintage data, immutable snapshots of the data taken each day, are provided to ensure research reproducibility. The latest data are updated on an hourly basis, and the vintage data are available since April 14, 2020. All the data are available in CSV files or SQLite format. By unifying the access to the data, this work makes it possible to study the pandemic on a global scale with high resolution, taking into account within-country variations, nonpharmaceutical interventions, and environmental and exogenous variables.

Global monitoring of the impact of the COVID-19 pandemic through online surveys sampled from the Facebook user base

Simultaneously tracking the global impact of COVID-19 is challenging because of regional variation in resources and reporting. Leveraging self-reported survey outcomes via an existing international social media network has the potential to provide standardized data streams to support monitoring and decision-making worldwide, in real time, and with limited local resources. The University of Maryland Global COVID-19 Trends and Impact Survey (UMD-CTIS), in partnership with Facebook, has invited daily cross-sectional samples from the social media platform's active users to participate in the survey since its launch on April 23, 2020. We analyzed UMD-CTIS survey data through December 20, 2020, from 31,142,582 responses representing 114 countries/territories weighted for nonresponse and adjusted to basic demographics. We show consistent respondent demographics over time for many countries/territories. Machine Learning models trained on national and pooled global data verified known symptom indicators. COVID-like illness (CLI) signals were correlated with government benchmark data. Importantly, the best benchmarked UMD-CTIS signal uses a single survey item whereby respondents report on CLI in their local community. In regions with strained health infrastructure but active social media users, we show it is possible to define COVID-19 impact trajectories using a remote platform independent of local government resources. This syndromic surveillance public health tool is the largest global health survey to date and, with brief participant engagement, can provide meaningful, timely insights into the global COVID-19 pandemic at a local scale.

The non-linear impact of data handling on network diffusion models

Many computational models rely on real-world data, and the steps required in moving from data collection, to data preparation, to model calibration, and input are becoming increasingly complex. Errors in data can lead to errors in model output that might invalidate conclusions in extreme cases. While the challenge of errors in data collection have been analyzed in the literature, here we highlight the importance of data handling in the modeling and simulation process, and how particular data handling errors can lead to errors in model output. We develop a framework for assessing the impact of potential data errors for models of spreading processes on networks, a broad class of models that capture many important real-world phenomena (e.g., epidemics, rumor spread, etc.). We focus on the susceptible-infected-removed (SIR) and Threshold models and examine how systematic errors in data handling impact the predicted spread of a virus (or information). Our results demonstrate that data handling errors can have significant impact on model conclusions especially in critical regions of a system.

Improving prediction of COVID-19 evolution by fusing epidemiological and mobility data

We are witnessing the dramatic consequences of the COVID-19 pandemic which, unfortunately, go beyond the impact on the health system. Until herd immunity is achieved with vaccines, the only available mechanisms for controlling the pandemic are quarantines, perimeter closures and social distancing with the aim of reducing mobility. Governments only apply these measures for a reduced period, since they involve the closure of economic activities such as tourism, cultural activities, or nightlife. The main criterion for establishing these measures and planning socioeconomic subsidies is the evolution of infections. However, the collapse of the health system and the unpredictability of human behavior, among others, make it difficult to predict this evolution in the short to medium term. This article evaluates different models for the early prediction of the evolution of the COVID-19 pandemic to create a decision support system for policy-makers. We consider a wide branch of models including artificial neural networks such as LSTM and GRU and statistically based models such as autoregressive (AR) or ARIMA. Moreover, several consensus strategies to ensemble all models into one system are proposed to obtain better results in this uncertain environment. Finally, a multivariate model that includes mobility data provided by Google is proposed to better forecast trend changes in the 14-day CI. A real case study in Spain is evaluated, providing very accurate results for the prediction of 14-day CI in scenarios with and without trend changes, reaching 0.93 [Formula: see text], 4.16 RMSE and 1.08 MAE.

Estimating epidemiologic dynamics from cross-sectional viral load distributions

Estimating an epidemic's trajectory is crucial for developing public health responses to infectious diseases, but case data used for such estimation are confounded by variable testing practices. We show that the population distribution of viral loads observed under random or symptom-based surveillance-in the form of cycle threshold (Ct) values obtained from reverse transcription quantitative polymerase chain reaction testing-changes during an epidemic. Thus, Ct values from even limited numbers of random samples can provide improved estimates of an epidemic's trajectory. Combining data from multiple such samples improves the precision and robustness of this estimation. We apply our methods to Ct values from surveillance conducted during the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) pandemic in a variety of settings and offer alternative approaches for real-time estimates of epidemic trajectories for outbreak management and response.

COVID-19 deep classification network based on convolution and deconvolution local enhancement

Computer Tomography (CT) detection can effectively overcome the problems of traditional detection of Corona Virus Disease 2019 (COVID-19), such as lagging detection results and wrong diagnosis results, which lead to the increase of disease infection rate and prevalence rate. The novel coronavirus pneumonia is a significant difference between the positive and negative patients with asymptomatic infections. To effectively improve the accuracy of doctors' manual judgment of positive and negative COVID-19, this paper proposes a deep classification network model of the novel coronavirus pneumonia based on convolution and deconvolution local enhancement. Through convolution and deconvolution operation, the contrast between the local lesion region and the abdominal cavity of COVID-19 is enhanced. Besides, the middle-level features that can effectively distinguish the image types are obtained. By transforming the novel coronavirus detection problem into the region of interest (ROI) feature classification problem, it can effectively determine whether the feature vector in each feature channel contains the image features of COVID-19. This paper uses an open-source COVID-CT dataset provided by Petuum researchers from the University of California, San Diego, which is collected from 143 novel coronavirus pneumonia patients and the corresponding features are preserved. The complete dataset (including original image and enhanced image) contains 1460 images. Among them, 1022 (70%) and 438 (30%) are used to train and test the performance of the proposed model, respectively. The proposed model verifies the classification precision in different convolution layers and learning rates. Besides, it is compared with most state-of-the-art models. It is found that the proposed algorithm has good classification performance. The corresponding sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and precision are 0.98, 0.96, 0.98, and 0.97, respectively.

The ethical use of high-performance computing and artificial intelligence: fighting COVID-19 at Barcelona Supercomputing Center

The COVID-19 pandemic has created an extraordinary medical, economic and humanitarian emergency. Artificial intelligence, in combination with other digital technologies, is being used as a tool to support the fight against the viral pandemic that has affected the entire world since the beginning of 2020. Barcelona Supercomputing Center collaborates in the battle against the coronavirus in different areas: the application of bioinformatics for the research on the virus and its possible treatments, the use of artificial intelligence, natural language processing and big data techniques to analyse the spread and impact of the pandemic, and the use of the MareNostrum 4 supercomputer to enable massive analysis on COVID-19 data. Many of these activities have included the use of personal and sensitive data of citizens, which, even during a pandemic, should be treated and handled with care. In this work we discuss our approach based on an ethical, transparent and fair use of this information, an approach aligned with the guidelines proposed by the European Union.