Exploring Changes to the Actionability of COVID-19 Dashboards Over the Course of 2020 in the Canadian Context: Descriptive Assessment and Expert Appraisal Study

Developing public health surveillance dashboards: a scoping review on the design principles

BACKGROUND

Public Health Dashboards (PHDs) facilitate the monitoring and prediction of disease outbreaks by continuously monitoring the health status of the community. This study aimed to identify design principles and determinants for developing public health surveillance dashboards.

METHODOLOGY

This scoping review is based on Arksey and O'Malley's framework as included in JBI guidance. Four databases were used to review and present the proposed principles of designing PHDs: IEEE, PubMed, Web of Science, and Scopus. We considered articles published between January 1, 2010 and November 30, 2022. The final search of articles was done on November 30, 2022. Only articles in the English language were included. Qualitative synthesis and trend analysis were conducted.

RESULTS

Findings from sixty-seven articles out of 543 retrieved articles, which were eligible for analysis, indicate that most of the dashboards designed from 2020 onwards were at the national level for managing and monitoring COVID-19. Design principles for the public health dashboard were presented in five groups, i.e., considering aim and target users, appropriate content, interface, data analysis and presentation types, and infrastructure.

CONCLUSION

Effective and efficient use of dashboards in public health surveillance requires implementing design principles to improve the functionality of these systems in monitoring and decision-making. Considering user requirements, developing a robust infrastructure for improving data accessibility, developing, and applying Key Performance Indicators (KPIs) for data processing and reporting purposes, and designing interactive and intuitive interfaces are key for successful design and development.

Communicating COVID-19 exposure risk with an interactive website counteracts risk misestimation

During the COVID-19 pandemic, individuals depended on risk information to make decisions about everyday behaviors and public policy. Here, we assessed whether an interactive website influenced individuals' risk tolerance to support public health goals. We collected data from 11,169 unique users who engaged with the online COVID-19 Event Risk Tool (https://covid19risk.biosci.gatech.edu/) between 9/22/21 and 1/22/22. The website featured interactive elements, including a dynamic risk map, survey questions, and a risk quiz with accuracy feedback. After learning about the risk of COVID-19 exposure, participants reported being less willing to participate in events that could spread COVID-19, especially for high-risk large events. We also uncovered a bias in risk estimation: Participants tended to overestimate the risk of small events but underestimate the risk of large events. Importantly, even participants who voluntarily sought information about COVID risks tended to misestimate exposure risk, demonstrating the need for intervention. Participants from liberal-leaning counties were more likely to use the website tools and more responsive to feedback about risk misestimation, indicating that political partisanship influences how individuals seek and engage with COVID-19 information. Lastly, we explored temporal dynamics and found that user engagement and risk estimation fluctuated over the course of the Omicron variant outbreak. Overall, we report an effective large-scale method for communicating viral exposure risk; our findings are relevant to broader research on risk communication, epidemiological modeling, and risky decision-making.

How can lessons from the COVID-19 pandemic enhance antimicrobial resistance surveillance and stewardship?

COVID-19 demanded urgent and immediate global attention, during which other public health crises such as antimicrobial resistance (AMR) increased silently, undermining patient safety and the life-saving ability of several antimicrobials. In 2019, WHO declared AMR a top ten global public health threat facing humanity, with misuse and overuse of antimicrobials as the main drivers in the development of antimicrobial-resistant pathogens. AMR is steadily on the rise, especially in low-income and middle-income countries across south Asia, South America, and Africa. Extraordinary circumstances often demand an extraordinary response as did the COVID-19 pandemic, underscoring the fragility of health systems across the world and forcing governments and global agencies to think creatively. The key strategies that helped to contain the increasing SARS-CoV-2 infections included a focus on centralised governance with localised implementation, evidence-based risk communication and community engagement, use of technological methods for tracking and accountability, extensive expansion of access to diagnostics, and a global adult vaccination programme. The extensive and indiscriminate use of antimicrobials to treat patients, particularly in the early phase of the pandemic, have adversely affected AMR stewardship practices. However, there were important lessons learnt during the pandemic, which can be leveraged to strengthen surveillance and stewardship, and revitalise efforts to address the AMR crisis.

Development and assessment of an epidemiologic dashboard for surveillance of Varroa destructor in Ontario apiaries

Varroosis (caused by the Varroa destructor mite) is a key health issue for honey bees in North America. Because these mites can exist in reservoirs of feral honey bee colonies, eradication is impossible, and instead efforts are made to maintain mites below a critical threshold. Monitoring for Varroa mites within a population is key for allocating resources and targeting interventions but surveillance can be difficult and/or expensive. This project aims to reflect on the success of data dashboards developed throughout the 2019-coronavirus pandemic and showcase how these methods can improve surveillance of Varroa mite infestations in Ontario, Canada. Dashboards provide a consistent source of information and epidemiologic metrics through data visualizations, and mobilize data otherwise bound to tables and intermittent reports. In the present work, an interactive dashboard for the surveillance of Varroa mite infestations across the province is proposed. This dashboard was developed using routine ministry inspection data to depict the spatio-temporal distribution of mites across a five-year data collection period. Through interactive figures and plots, able to be disaggregated to a specific region and time frame, this dashboard will allow for members of the beekeeping community to monitor provincial mite levels throughout the season. Seven criteria found to be common across highly actionable COVID-19 dashboards were used in a beta testing stage of development to assess the quality of the dashboard, and critically reflect on its strengths and weaknesses. Furthermore, future directions for surveillance dashboards are explored, including integration with citizen science data collection to develop a comprehensive province-wide surveillance system. The outcome of this project is a functional dashboard proof-of-concept for population-level monitoring of Varroa mites and a model for future tools designed for other species and diseases.

Report from the Ready for the Next Round Thought-Leadership Roundtables on Building Resilience in Cancer Care and Control in Canada-Colorectal Cancer Canada; 2021

(1) Background: The COVID-19 pandemic illuminated vulnerabilities in the Canadian health care system and exposed gaps and challenges across the cancer care continuum. Canada is experiencing significant disruptions to cancer-related services, and the impact these disruptions (delays/deferrals/cancellations) have on the health care system and patients are yet to be determined. Given the potential adverse ramifications, how can Canada’s health care systems build resilience for future threats? (2) Methods: To answer this question, CCC facilitated a series of four thought-leadership roundtables, each representing the views of four different stakeholder groups: patients, physicians, health care system leaders, and researchers. (3) Results: Six themes of strength were identified to serve as a springboard for building resilience including, (1) advancing virtual care and digital health technologies to prevent future interruptions in cancer care delivery. (2) developing real-time data metrics, data sharing, and evidence-based decision-making. (3) enhancing public–private-non-profit partnerships to advance research and strengthen connections across the system. (4) advancing patient-centricity in cancer research to drive and encourage precision medicine approaches to care. (5) investing in training and hiring a robust supply of health care human resources. (6) implementing a national strategy and infrastructure to ensure inter-provincial collaborative data sharing (4). Conclusions: A resilient health care system that can respond to shocks and threats is not an emergency system; it is a robust everyday system that can respond to emergencies.

The experiences of 33 national COVID-19 dashboard teams during the first year of the pandemic in the World Health Organization European Region: A qualitative study

Background

Governments across the World Health Organization (WHO) European Region have prioritised dashboards for reporting COVID-19 data. The ubiquitous use of dashboards for public reporting is a novel phenomenon.

Objective

This study explores the development of COVID-19 dashboards during the first year of the pandemic and identifies common barriers, enablers and lessons from the experiences of teams responsible for their development.

Methods

We applied multiple methods to identify and recruit COVID-19 dashboard teams, using a purposive, quota sampling approach. Semi-structured group interviews were conducted from April to June 2021. Using elaborative coding and thematic analysis, we derived descriptive and explanatory themes from the interview data. A validation workshop was held with study participants in June 2021.

Results

Eighty informants participated, representing 33 national COVID-19 dashboard teams across the WHO European Region. Most dashboards were launched swiftly during the first months of the pandemic, February to May 2020. The urgency, intense workload, limited human resources, data and privacy constraints and public scrutiny were common challenges in the initial development stage. Themes related to barriers or enablers were identified, pertaining to the pre-pandemic context, pandemic itself, people and processes and software, data and users. Lessons emerged around the themes of simplicity, trust, partnership, software and data and change.

Conclusions

COVID-19 dashboards were developed in a learning-by-doing approach. The experiences of teams reveal that initial underpreparedness was offset by high-level political endorsement, the professionalism of teams, accelerated data improvements and immediate support with commercial software solutions. To leverage the full potential of dashboards for health data reporting, investments are needed at the team, national and pan-European levels.

Development and Actionability of the Dutch COVID-19 Dashboard: Descriptive Assessment and Expert Appraisal Study

Background

Web-based public reporting by means of dashboards has become an essential tool for governments worldwide to monitor COVID-19 information and communicate it to the public. The actionability of such dashboards is determined by their fitness for purpose—meeting a specific information need—and fitness for use—placing the right information into the right hands at the right time and in a manner that can be understood.

Objective

The aim of this study was to identify specific areas where the actionability of the Dutch government’s COVID-19 dashboard could be improved, with the ultimate goal of enhancing public understanding of the pandemic.

Methods

The study was conducted from February 2020 to April 2021. A mixed methods approach was carried out, using (1) a descriptive checklist over time to monitor changes made to the dashboard, (2) an actionability scoring of the dashboard to pinpoint areas for improvement, and (3) a reflection meeting with the dashboard development team to contextualize findings and discuss areas for improvement.

Results

The dashboard predominantly showed epidemiological information on COVID-19. It had been developed and adapted by adding more in-depth indicators, more geographic disaggregation options, and new indicator themes. It also changed in target audience from policy makers to the general public; thus, a homepage was added with the most important information, using news-like items to explain the provided indicators and conducting research to enhance public understanding of the dashboard. However, disaggregation options such as sex, socioeconomic status, and ethnicity and indicators on dual-track health system management and social and economic impact that have proven to give important insights in other countries are missing from the Dutch COVID-19 dashboard, limiting its actionability.

Conclusions

The Dutch COVID-19 dashboard developed over time its fitness for purpose and use in terms of providing epidemiological information to the general public as a target audience. However, to strengthen the Dutch health system’s ability to cope with upcoming phases of the COVID-19 pandemic or future public health emergencies, we advise (1) establishing timely indicators relating to health system capacity, (2) including relevant data disaggregation options (eg, sex, socioeconomic status), and (3) enabling interoperability between social, health, and economic data sources.