"Wrong, but useful": negotiating uncertainty in infectious disease modelling

Private veterinarians' views of the Irish bovine TB eradication programme

There is limited understanding of Private Veterinary Practitioners' (PVPs) perceptions of, opinions about and attitudes towards the Irish Bovine Tuberculosis (bTB) eradication programme. Understanding their attitudes and behaviors towards the bTB eradication programme is both timely and crucial as their actions have a great influence on the effectiveness and sustainability of the programme itself. To date, PVPs have been consulted about how they view their role in the programme, however, less is known about the challenges they face in carrying out good quality bTB testing, and how likely they feel the programme will succeed to eradicate bTB in the future. The results from this study represent a good part of the probable sphere of perceptions, behaviors, attitudes and knowledge of the respective study population and several key critical points that are believed to have hindered the success of the bTB eradication programme in Ireland to date. This study progressed our understanding of the reasons for why farmers are demotivated by and disconnected with the Irish bTB eradication programme according to PVPs, how PVPs feel challenged in their role carrying out bTB testing, and their views on how, if possible, bTB can be eradicated in the future. Their insights will influence how the Department of Agriculture, Food and the Marine (DAFM) interacts with PVPs and farmers in the future with respect to the bTB and the eradication programme.

An inaugural forum on epidemiological modeling for public health stakeholders in Arizona

Epidemiological models-which help us understand and forecast the spread of infectious disease-can be valuable tools for public health. However, barriers exist that can make it difficult to employ epidemiological models routinely within the repertoire of public health planning. These barriers include technical challenges associated with constructing the models, challenges in obtaining appropriate data for model parameterization, and problems with clear communication of modeling outputs and uncertainty. To learn about the unique barriers and opportunities within the state of Arizona, we gathered a diverse set of 48 public health stakeholders for a day-and-a-half forum. Our research group was motivated specifically by our work building software for public health-relevant modeling and by our earnest desire to collaborate closely with stakeholders to ensure that our software tools are practical and useful in the face of evolving public health needs. Here we outline the planning and structure of the forum, and we highlight as a case study some of the lessons learned from breakout discussions. While unique barriers exist for implementing modeling for public health, there is also keen interest in doing so across diverse sectors of State and Local government, although issues of equal and fair access to modeling knowledge and technologies remain key issues for future development. We found this forum to be useful for building relationships and informing our software development, and we plan to continue such meetings annually to create a continual feedback loop between academic molders and public health practitioners.

Operationalizing cultural adaptation to climate change: contemporary examples from United States agriculture

It has been proposed that climate adaptation research can benefit from an evolutionary approach. But related empirical research is lacking. We advance the evolutionary study of climate adaptation with two case studies from contemporary United States agriculture. First, we define 'cultural adaptation to climate change' as a mechanistic process of population-level cultural change. We argue this definition enables rigorous comparisons, yields testable hypotheses from mathematical theory and distinguishes adaptive change, non-adaptive change and desirable policy outcomes. Next, we develop an operational approach to identify 'cultural adaptation to climate change' based on established empirical criteria. We apply this approach to data on crop choices and the use of cover crops between 2008 and 2021 from the United States. We find evidence that crop choices are adapting to local trends in two separate climate variables in some regions of the USA. But evidence suggests that cover cropping may be adapting more to the economic environment than climatic conditions. Further research is needed to characterize the process of cultural adaptation, particularly the routes and mechanisms of cultural transmission. Furthermore, climate adaptation policy could benefit from research on factors that differentiate regions exhibiting adaptive trends in crop choice from those that do not. This article is part of the theme issue 'Climate change adaptation needs a science of culture'.

Domesticating models: On the contingency of Covid-19 modelling in UK media and policy

Our article traces the representation of pandemic modelling in UK print media from the emergence of Covid-19 to the early stages of implementing the first UK-wide lockdown in late March 2020. Covid modelling, it is widely assumed, has shaped policy decisions and public responses to the pandemic in unprecedented ways. We analyse how the UK print media has configured modelling as a significant evidence tool in the representation of the pandemic. Interrogating assumptions about infectious disease modelling, we ask why models became the trusted tool of choice for knowing and responding to the Covid pandemic in the UK. Our analysis has yielded four different periods in the evolution of intersecting policy and media frames. Initially, modellers, policymakers and media alike emphasized uncertainty about available data, and hence the speculative character of modelled projections, thus justifying a 'wait and see' approach to government intervention. With growing public pressure for government action, policy and media frames were adjusted to emphasize the importance of timing interventions for best effect, with modelling evidence mobilized to justify inaction. This gave way to a period of crisis, as the press increasingly questioned the reliability of the existing models and policies, leading modellers and policy makers to dramatically revise their projections. Finally, with the imposition of the first UK lockdown, policy and media frames were brought back into alignment with one another, in a process of domestication through which the language of modelling became a basic resource for the discussion of the epidemic. Our epistemological microhistory thus challenges general accounts of the impacts of pandemic modelling and instead emphasizes contingency and interpretative flexibility.

Challenges of using modelling evidence in the visceral leishmaniasis elimination programme in India

As India comes closer to the elimination of visceral leishmaniasis (VL) as a public health problem, surveillance efforts and elimination targets must be continuously revised and strengthened. Mathematical modelling is a compelling research discipline for informing policy and programme design in its capacity to project incidence across space and time, the likelihood of achieving benchmarks, and the impact of different interventions. To gauge the extent to which modelling informs policy in India, this qualitative analysis explores how and whether policy makers understand, value, and reference recently produced VL modelling research. Sixteen semi-structured interviews were carried out with both users- and producers- of VL modelling research, guided by a knowledge utilisation framework grounded in knowledge translation theory. Participants reported that barriers to knowledge utilisation include 1) scepticism that models accurately reflect transmission dynamics, 2) failure of modellers to apply their analyses to specific programme operations, and 3) lack of accountability in the process of translating knowledge to policy. Political trust and support are needed to translate knowledge into programme activities, and employment of a communication intermediary may be a necessary approach to improve this process.

Uncomfortable science: How mathematical models, and consensus, come to be in public policy

We explore messy translations of evidence in policy as a site of 'uncomfortable science'. Drawing on the work of John Law, we follow evidence as a 'fluid object' of its situation, also enacted in relation to a hinterland of practices. Working with the qualitative interview accounts of mathematical modellers and other scientists engaged in the UK COVID-19 response, we trace how models perform as evidence. Our point of departure is a moment of controversy in the public announcement of second national lockdown in the UK, and specifically, the projected daily deaths from COVID-19 presented in support of this policy decision. We reflect on this event to trace the messy translations of "scientific consensus" in the face of uncertainty. Efforts among scientists to realise evidence-based expectation and to manage the troubled translations of models in policy, including via "scientific consensus", can extend the dis-ease of uncomfortable science rather than clean it up or close it down. We argue that the project of evidence-based policy is not so much in need of technical management or repair, but that we need to be thinking altogether differently.

Making pandemics big: On the situational performance of Covid-19 mathematical models

In this paper, we trace how mathematical models are made 'evidence enough' and 'useful for policy'. Working with the interview accounts of mathematical modellers and other scientists engaged in the UK Covid-19 response, we focus on two weeks in March 2020 prior to the announcement of an unprecedented national lockdown. A key thread in our analysis is how pandemics are made 'big'. We follow the work of one particular device, that of modelled 'doubling-time'. By following how modelled doubling-time entangles in its assemblage of evidence-making, we draw attention to multiple actors, including beyond models and metrics, which affect how evidence is performed in relation to the scale of epidemic and its policy response. We draw attention to: policy; Government scientific advice infrastructure; time; uncertainty; and leaps of faith. The 'bigness' of the pandemic, and its evidencing, is situated in social and affective practices, in which uncertainty and dis-ease are inseparable from calculus. This materialises modelling in policy as an 'uncomfortable science'. We argue that situational fit in-the-moment is at least as important as empirical fit when attending to what models perform in policy.

Epidemiological modelling in refugee and internally displaced people settlements: challenges and ways forward

The spread of infectious diseases such as COVID-19 presents many challenges to healthcare systems and infrastructures across the world, exacerbating inequalities and leaving the world’s most vulnerable populations at risk. Epidemiological modelling is vital to guiding evidence-informed or data-driven decision making. In forced displacement contexts, and in particular refugee and internally displaced people (IDP) settlements, it meets several challenges including data availability and quality, the applicability of existing models to those contexts, the accurate modelling of cultural differences or specificities of those operational settings, the communication of results and uncertainties, as well as the alignment of strategic goals between diverse partners in complex situations. In this paper, we systematically review the limited epidemiological modelling work applied to refugee and IDP settlements so far, and discuss challenges and identify lessons learnt from the process. With the likelihood of disease outbreaks expected to increase in the future as more people are displaced due to conflict and climate change, we call for the development of more approaches and models specifically designed to include the unique features and populations of refugee and IDP settlements. To strengthen collaboration between the modelling and the humanitarian public health communities, we propose a roadmap to encourage the development of systems and frameworks to share needs, build tools and coordinate responses in an efficient and scalable manner, both for this pandemic and for future outbreaks.

Quantifying Uncertainty in Mechanistic Models of Infectious Disease

This primer describes the statistical uncertainty in mechanistic models and provides R code to quantify it. We begin with an overview of mechanistic models for infectious disease, and then describe the sources of statistical uncertainty in the context of a case study on SARS-CoV-2. We describe the statistical uncertainty as belonging to three categories: data uncertainty, stochastic uncertainty, and structural uncertainty. We demonstrate how to account for each of these via statistical uncertainty measures and sensitivity analyses broadly, as well as in a specific case study on estimating the basic reproductive number, \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{upgreek} \usepackage{mathrsfs} \setlength{\oddsidemargin}{-69pt} \begin{document} }{}${R}_0$\end{document}, for SARS-CoV-2.

Imagination and remembrance: what role should historical epidemiology play in a world bewitched by mathematical modelling of COVID-19 and other epidemics?

Although every emerging infectious disease occurs in a unique context, the behaviour of previous pandemics offers an insight into the medium- and long-term outcomes of the current threat. Where an informative historical analogue exists, epidemiologists and policymakers should consider how the insights of the past can inform current forecasts and responses.

Using Narrative Evidence to Convey Health Information on Social Media: The Case of COVID-19

During disease outbreaks or pandemics, policy makers must convey information to the public for informative purposes (eg, morbidity or mortality rates). They must also motivate members of the public to cooperate with the guidelines, specifically by changing their usual behavior. Policy makers have traditionally adopted a didactic and formalistic stance by conveying dry, statistics-based health information to the public. They have not yet considered the alternative of providing health information in the form of narrative evidence, using stories that address both cognitive and emotional aspects. The aim of this viewpoint paper is to introduce policy makers to the advantages of using narrative evidence to provide health information during a disease outbreak or pandemic such as COVID-19. Throughout human history, authorities have tended to employ apocalyptic narratives during disease outbreaks or pandemics. This viewpoint paper proposes an alternative coping narrative that includes the following components: segmentation; barrier reduction; role models; empathy and support; strengthening self-efficacy, community efficacy, and coping tools; preventing stigmatization of at-risk populations; and communicating uncertainty. It also discusses five conditions for using narrative evidence to produce an effective communication campaign on social media: (1) identifying narratives that reveal the needs, personal experiences, and questions of different subgroups to tailor messaging to produce targeted behavioral change; (2) providing separate and distinct treatment of each information unit or theory that arises on social networks; (3) identifying positive deviants who found creative solutions for stress during the COVID-19 crisis not found by other members of the community; (4) creating different stories of coping; and (5) maintaining a dialogue with population subgroups (eg, skeptical and hesitant groups). The paper concludes by proposing criteria for evaluating the effectiveness of a narrative.

The value of infectious disease modeling and trend assessment: a public health perspective

INTRODUCTION

Disease outbreaks of acquired immunodeficiency syndrome, severe acute respiratory syndrome, pandemic H1N1, H7N9, H5N1, Ebola, Zika, Middle East respiratory syndrome, and recently COVID-19 have raised the attention of the public over the past half-century. Revealing the characteristics and epidemic trends are important parts of disease control. The biological scenarios including transmission characteristics can be constructed and translated into mathematical models, which can help to predict and gain a deeper understanding of diseases.

AREAS COVERED

This review discusses the models for infectious diseases and highlights their values in the field of public health. This information will be of interest to mathematicians and clinicians, and make a significant contribution toward the development of more specific and effective models. Literature searches were performed using the online database of PubMed (inception to August 2020).

EXPERT OPINION

Modeling could contribute to infectious disease control by means of predicting the scales of disease epidemics, indicating the characteristics of disease transmission, evaluating the effectiveness of interventions or policies, and warning or forecasting during the pre-outbreak of diseases. With the development of theories and the ability of calculations, infectious disease modeling would play a much more important role in disease prevention and control of public health.

Why lockdown? Why national unity? Why global solidarity? Simplified arithmetic tools for decision-makers, health professionals, journalists and the general public to explore containment options for the 2019 novel coronavirus

As every country in the world struggles with the ongoing COVID-19 pandemic, it is essential that as many people as possible understand the epidemic containment, elimination and exclusion strategies required to tackle it. Simplified arithmetic models of COVID-19 transmission, control and elimination are presented in user-friendly Shiny and Excel formats that allow non-specialists to explore, query, critique and understand the containment decisions facing their country and the world at large. Although the predictive model is broadly applicable, the simulations presented are based on parameter values representative of the United Republic of Tanzania, which is still early enough in its epidemic cycle and response to avert a national catastrophe. The predictions of these models illustrate (1) why ambitious lock-down interventions to crush the curve represent the only realistic way for individual countries to contain their national-level epidemics before they turn into outright catastrophes, (2) why these need to be implemented so early, so stringently and for such extended periods, (3) why high prevalence of other pathogens causing similar symptoms to mild COVID-19 precludes the use of contact tracing as a substitute for lock down interventions to contain and eliminate epidemics, (4) why partial containment strategies intended to merely flatten the curve, by maintaining epidemics at manageably low levels, are grossly unrealistic, and (5) why local elimination may only be sustained after lock down ends if imported cases are comprehensively excluded, so international co-operation to conditionally re-open trade and travel between countries certified as free of COVID-19 represents the best strategy for motivating progress towards pandemic eradication at global level. The three sequential goals that every country needs to emphatically embrace are contain, eliminate and exclude. As recently emphasized by the World Health Organization, success will require widespread genuine national unity and unprecedented global solidarity.

Risk perception and behavioral change during epidemics: Comparing models of individual and collective learning

Modern societies are exposed to a myriad of risks ranging from disease to natural hazards and technological disruptions. Exploring how the awareness of risk spreads and how it triggers a diffusion of coping strategies is prominent in the research agenda of various domains. It requires a deep understanding of how individuals perceive risks and communicate about the effectiveness of protective measures, highlighting learning and social interaction as the core mechanisms driving such processes. Methodological approaches that range from purely physics-based diffusion models to data-driven environmental methods rely on agent-based modeling to accommodate context-dependent learning and social interactions in a diffusion process. Mixing agent-based modeling with data-driven machine learning has become popularity. However, little attention has been paid to the role of intelligent learning in risk appraisal and protective decisions, whether used in an individual or a collective process. The differences between collective learning and individual learning have not been sufficiently explored in diffusion modeling in general and in agent-based models of socio-environmental systems in particular. To address this research gap, we explored the implications of intelligent learning on the gradient from individual to collective learning, using an agent-based model enhanced by machine learning. Our simulation experiments showed that individual intelligent judgement about risks and the selection of coping strategies by groups with majority votes were outperformed by leader-based groups and even individuals deciding alone. Social interactions appeared essential for both individual learning and group learning. The choice of how to represent social learning in an agent-based model could be driven by existing cultural and social norms prevalent in a modeled society.

Best practice assessment of disease modelling for infectious disease outbreaks

During emerging disease outbreaks, public health, emergency management officials and decision-makers increasingly rely on epidemiological models to forecast outbreak progression and determine the best response to health crisis needs. Outbreak response strategies derived from such modelling may include pharmaceutical distribution, immunisation campaigns, social distancing, prophylactic pharmaceuticals, medical care, bed surge, security and other requirements. Infectious disease modelling estimates are unavoidably subject to multiple interpretations, and full understanding of a model's limitations may be lost when provided from the disease modeller to public health practitioner to government policymaker. We review epidemiological models created for diseases which are of greatest concern for public health protection. Such diseases, whether transmitted from person-to-person (Ebola, influenza, smallpox), via direct exposure (anthrax), or food and waterborne exposure (cholera, typhoid) may cause severe illness and death in a large population. We examine disease-specific models to determine best practices characterising infectious disease outbreaks and facilitating emergency response and implementation of public health policy and disease control measures.

Views from many worlds: unsettling categories in interdisciplinary research on endemic zoonotic diseases

Interdisciplinary research on zoonotic disease has tended to focus on ‘risk’ of disease transmission as a conceptual common denominator. With reference to endemic zoonoses at the livestock–human interface, we argue for considering a broader sweep of disciplinary insights from anthropology and other social sciences in interdisciplinary dialogue, in particular cross-cultural perspectives on human–animal engagement. We consider diverse worldviews where human–animal encounters are perceived of in terms of the kinds of social relations they generate, and the notion of culture is extended to the ‘natural’ world. This has implications for how animals are valued, treated and prioritized. Thinking differently with and about animals and about species' boundaries could enable ways of addressing zoonotic diseases which have closer integration with people's own cultural norms. If we can bring this kind of knowledge into One Health debates, we find ourselves with a multiplicity of worldviews, where bounded categories such as human:animal and nature:culture cannot be assumed. This might in turn influence our scientific ways of seeing our own disciplinary cultures, and generate novel ways of understanding zoonoses and constructing solutions.

This article is part of the themed issue ‘One Health for a changing world: zoonoses, ecosystems and human well-being’.

Engaging research with policy and action: what are the challenges of responding to zoonotic disease in Africa?

Zoonotic diseases will maintain a high level of public policy attention in the coming decades. From the spectre of a global pandemic to anxieties over agricultural change, urbanization, social inequality and threats to natural ecosystems, effectively preparing and responding to endemic and emerging diseases will require technological, institutional and social innovation. Much current discussion emphasizes the need for a 'One Health' approach: bridging disciplines and sectors to tackle these complex dynamics. However, as attention has increased, so too has an appreciation of the practical challenges in linking multi-disciplinary, multi-sectoral research with policy, action and impact. In this commentary paper, we reflect on these issues with particular reference to the African sub-continent. We structure the themes of our analysis on the existing literature, expert opinion and 11 interviews with leading One Health scholars and practitioners, conducted at an international symposium in 2016. We highlight a variety of challenges in research and knowledge production, in the difficult terrain of implementation and outreach, and in the politicized nature of decision-making and priority setting. We then turn our attention to a number of strategies that might help reconfigure current pathways and accepted norms of practice. These include: (i) challenging scientific expertise; (ii) strengthening national multi-sectoral coordination; (iii) building on what works; and (iv) re-framing policy narratives. We argue that bridging the research-policy-action interface in Africa, and better connecting zoonoses, ecosystems and well-being in the twenty-first century, will ultimately require greater attention to the democratization of science and public policy.This article is part of the themed issue 'One Health for a changing world: zoonoses, ecosystems and human well-being'.

Integrative modelling for One Health: pattern, process and participation

This paper argues for an integrative modelling approach for understanding zoonoses disease dynamics, combining process, pattern and participatory models. Each type of modelling provides important insights, but all are limited. Combining these in a '3P' approach offers the opportunity for a productive conversation between modelling efforts, contributing to a 'One Health' agenda. The aim is not to come up with a composite model, but seek synergies between perspectives, encouraging cross-disciplinary interactions. We illustrate our argument with cases from Africa, and in particular from our work on Ebola virus and Lassa fever virus. Combining process-based compartmental models with macroecological data offers a spatial perspective on potential disease impacts. However, without insights from the ground, the 'black box' of transmission dynamics, so crucial to model assumptions, may not be fully understood. We show how participatory modelling and ethnographic research of Ebola and Lassa fever can reveal social roles, unsafe practices, mobility and movement and temporal changes in livelihoods. Together with longer-term dynamics of change in societies and ecologies, all can be important in explaining disease transmission, and provide important complementary insights to other modelling efforts. An integrative modelling approach therefore can offer help to improve disease control efforts and public health responses.This article is part of the themed issue 'One Health for a changing world: zoonoses, ecosystems and human well-being'.

Model-Based Policymaking: A Framework to Promote Ethical "Good Practice" in Mathematical Modeling for Public Health Policymaking

Mathematical models are increasingly relied upon as decision support tools, which estimate risks and generate recommendations to underpin public health policies. However, there are no formal agreements about what constitutes professional competencies or duties in mathematical modeling for public health. In this article, we propose a framework to evaluate whether mathematical models that assess human and animal disease risks and control strategies meet standards consistent with ethical "good practice" and are thus "fit for purpose" as evidence in support of policy. This framework is derived from principles of biomedical ethics: independence, transparency (autonomy), beneficence/non-maleficence, and justice. We identify ethical risks associated with model development and implementation and consider the extent to which scientists are accountable for the translation and communication of model results to policymakers so that the strengths and weaknesses of the scientific evidence base and any socioeconomic and ethical impacts of biased or uncertain predictions are clearly understood. We propose principles to operationalize a framework for ethically sound model development and risk communication between scientists and policymakers. These include the creation of science-policy partnerships to mutually define policy questions and communicate results; development of harmonized international standards for model development; and data stewardship and improvement of the traceability and transparency of models via a searchable archive of policy-relevant models. Finally, we suggest that bespoke ethical advisory groups, with relevant expertise and access to these resources, would be beneficial as a bridge between science and policy, advising modelers of potential ethical risks and providing overview of the translation of modeling advice into policy.

Model-Informed Risk Assessment and Decision Making for an Emerging Infectious Disease in the Asia-Pacific Region

BACKGROUND

Effective response to emerging infectious disease (EID) threats relies on health care systems that can detect and contain localised outbreaks before they reach a national or international scale. The Asia-Pacific region contains low and middle income countries in which the risk of EID outbreaks is elevated and whose health care systems may require international support to effectively detect and respond to such events. The absence of comprehensive data on populations, health care systems and disease characteristics in this region makes risk assessment and decisions about the provision of such support challenging.

METHODOLOGY/PRINCIPAL FINDINGS

We describe a mathematical modelling framework that can inform this process by integrating available data sources, systematically explore the effects of uncertainty, and provide estimates of outbreak risk under a range of intervention scenarios. We illustrate the use of this framework in the context of a potential importation of Ebola Virus Disease into the Asia-Pacific region. Results suggest that, across a wide range of plausible scenarios, preemptive interventions supporting the timely detection of early cases provide substantially greater reductions in the probability of large outbreaks than interventions that support health care system capacity after an outbreak has commenced.

CONCLUSIONS/SIGNIFICANCE

Our study demonstrates how, in the presence of substantial uncertainty about health care system infrastructure and other relevant aspects of disease control, mathematical models can be used to assess the constraints that limited resources place upon the ability of local health care systems to detect and respond to EID outbreaks in a timely and effective fashion. Our framework can help evaluate the relative impact of these constraints to identify resourcing priorities for health care system support, in order to inform principled and quantifiable decision making.

Strong Inference in Mathematical Modeling: A Method for Robust Science in the Twenty-First Century

While there are many opinions on what mathematical modeling in biology is, in essence, modeling is a mathematical tool, like a microscope, which allows consequences to logically follow from a set of assumptions. Only when this tool is applied appropriately, as microscope is used to look at small items, it may allow to understand importance of specific mechanisms/assumptions in biological processes. Mathematical modeling can be less useful or even misleading if used inappropriately, for example, when a microscope is used to study stars. According to some philosophers (Oreskes et al., 1994), the best use of mathematical models is not when a model is used to confirm a hypothesis but rather when a model shows inconsistency of the model (defined by a specific set of assumptions) and data. Following the principle of strong inference for experimental sciences proposed by Platt (1964), I suggest “strong inference in mathematical modeling” as an effective and robust way of using mathematical modeling to understand mechanisms driving dynamics of biological systems. The major steps of strong inference in mathematical modeling are (1) to develop multiple alternative models for the phenomenon in question; (2) to compare the models with available experimental data and to determine which of the models are not consistent with the data; (3) to determine reasons why rejected models failed to explain the data, and (4) to suggest experiments which would allow to discriminate between remaining alternative models. The use of strong inference is likely to provide better robustness of predictions of mathematical models and it should be strongly encouraged in mathematical modeling-based publications in the Twenty-First century.