Developing monitoring and evaluation tools for event-based surveillance: experience from Vietnam

Strengthening event-based surveillance (EBS): a case study from Afghanistan

The sustained instability in Afghanistan, along with ongoing disease outbreaks and the impact of the COVID-19 pandemic, has significantly affected the country.During the COVID-19 pandemic, the country's detection and response capacities faced challenges. Case identification was done in all health facilities from primary to tertiary levels but neglected cases at the community level, resulting in undetected and uncontrolled transmission from communities. This emphasizes a missed opportunity for early detection that Event-Based Surveillance (EBS) could have facilitated.Therefore, Afghanistan planned to strengthen the EBS component of the national public health surveillance system to enhance the capacity for the rapid detection and response to infectious disease outbreaks, including COVID-19 and other emerging diseases. This effort was undertaken to promptly mitigate the impact of such outbreaks.We conducted a landscape assessment of Afghanistan's public health surveillance system to identify the best way to enhance EBS, and then we crafted an implementation work plan. The work plan included the following steps: establishing an EBS multisectoral coordination and working group, identifying EBS information sources, prioritizing public health events of importance, defining signals, establishing reporting mechanisms, and developing standard operating procedures and training guides.EBS is currently being piloted in seven provinces in Afghanistan. The lessons learned from the pilot phase will support its overall expansion throughout the country.

An indicator framework for the monitoring and evaluation of event-based surveillance systems

Event-based surveillance (EBS) systems have been implemented globally to support early warning surveillance across human, animal, and environmental health in diverse settings, including at the community level, within health facilities, at border points of entry, and through media monitoring of internet-based sources. EBS systems should be evaluated periodically to ensure that they meet the objectives related to the early detection of health threats and to identify areas for improvement in the quality, efficiency, and usefulness of the systems. However, to date, there has been no comprehensive framework to guide the monitoring and evaluation of EBS systems; this absence of standardisation has hindered progress in the field. The Africa Centres for Disease Control and Prevention and US Centers for Disease Control and Prevention have collaborated to develop an EBS monitoring and evaluation indicator framework, adaptable to specific country contexts, that uses measures relating to input, activity, output, outcome, and impact to map the processes and expected results of EBS systems. Through the implementation and continued refinement of these indicators, countries can ensure the early detection of health threats and improve their ability to measure and describe the impacts of EBS systems, thus filling the current evidence gap regarding their effectiveness.

Evaluating event-based surveillance capacity in Africa: Use of the Africa CDC scorecard, 2022-2023

Introduction

Event-based surveillance (EBS) is a critical component of Early Warning, Alert and Response (EWAR) capacity needed for outbreak prevention and control. To better understand existing EBS and monitor the progress of capacity-building efforts over time, Africa CDC developed an EBS scorecard as part of a revision to the EBS Framework.

Methods

We distributed the scorecard to African Union (AU) Member States (MSs). Survey responses from the MSs' human health sector were aggregated, cleaned, and analysed. MS, regional, and continental EBS capacity was assessed.

Results

Between 21 July 2022 and 4 April 2023, a total of 63 respondents representing 49 (89%) of 55 MSs completed the survey. Given Africa CDC's public health mandate, we acknowledged the importance of One Health collaboration in MSs but focused on and analysed only the human health sector responses. Thirty-four (71%) MSs stated having EBS in place; hotline was the most common type of EBS implemented (76%). Seventeen (50%) MSs reported multisectoral, One Health collaboration as part of EBS implementation. Scorecard outcomes showed a minimal (score of <60%) to average (score between 60-80%) level of EBS capacity in 29 and five (5) MSs respectively.

Discussion

Current EBS capacity levels need to be strengthened in Africa to ensure the continent remains prepared for future public health threats. The Africa CDC EBS scorecard provides a useful way to measure and track this capacity over time. Results can be used to advocate for and target resources for capacity building to foster public health emergency preparedness efforts.

Measuring the impact of an integrated bite case management program on the detection of canine rabies cases in Vietnam

Introduction

Dog-mediated rabies is enzootic in Vietnam, resulting in at least 70 reported human deaths and 500,000 human rabies exposures annually. In 2016, an integrated bite cases management (IBCM) based surveillance program was developed to improve knowledge of the dog-mediated rabies burden in Phu Tho Province of Vietnam.

Methods

The Vietnam Animal Rabies Surveillance Program (VARSP) was established in four stages: (1) Laboratory development, (2) Training of community One Health workers, (3) Paper-based-reporting (VARSP 1.0), and (4) Electronic case reporting (VARSP 2.0). Investigation and diagnostic data collected from March 2016 to December 2019 were compared with historical records of animal rabies cases dating back to January 2012. A risk analysis was conducted to evaluate the probability of a rabies exposure resulting in death after a dog bite, based on data collected over the course of an IBCM investigation.

Results

Prior to the implementation of VARSP, between 2012 and 2015, there was an average of one rabies investigation per year, resulting in two confirmed and two probable animal rabies cases. During the 46 months that VARSP was operational (2016 - 2019), 1048 animal investigations were conducted, which identified 79 (8%) laboratory-confirmed rabies cases and 233 (22%) clinically-confirmed(probable) cases. VARSP produced a 78-fold increase in annual animal rabies case detection (one cases detected per year pre-VARSP vs 78 cases per year under VARSP). The risk of succumbing to rabies for bite victims of apparently healthy dogs available for home quarantine, was three deaths for every 10,000 untreated exposures.

Discussion

A pilot IBCM model used in Phu Tho Province showed promising results for improving rabies surveillance, with a 26-fold increase in annual case detection after implementation of a One Health model. The risk for a person bitten by an apparently healthy dog to develop rabies in the absence of rabies PEP was very low, which supports the WHO recommendations to delay PEP for this category of bite victims, when trained animal assessors are available and routinely communicate with the medical sector. Recent adoption of an electronic IBCM system is likely to expedite adoption of VARSP 2.0 to other Provinces and improve accuracy of field decisions and data collection.

Structure, functions, performance and gaps of event-based surveillance (EBS) in Sudan, 2021: a cross-sectional review

BACKGROUND

Event-based surveillance (EBS) is an essential component of Early Warning Alert and Response (EWAR) as per the International Health Regulations (IHR), 2005. EBS was established in Sudan in 2016 as a complementary system for Indicator-based surveillance (IBS). This review will provide an overview of the current EBS structure, functions and performance in Sudan and identify the gaps and ways forward.  METHODS: The review followed the WHO/EMRO guidelines and tools. Structured discussions, observation and review of records and guidelines were done at national and state levels. Community volunteers were interviewed through phone calls. Directors of Health Emergency and Epidemic Control, surveillance officers and focal persons for EBS at the state level were also interviewed. SPSS software was used to perform descriptive statistical analysis for quantitative data, while qualitative data was analysed manually using thematic analysis, paying particular attention to the health system level allowing for an exploration of how and why experiences differ across levels. Written and verbal consents were obtained from all participants as appropriate.

RESULTS

Sudan has a functioning EBS; however, there is an underestimation of its contribution and importance at the national and states levels. The link between the national level and states is ad hoc or is driven by the need for reports. While community event-based surveillance (CEBS) is functioning, EBS from health facilities and from non-health sectors is not currently active. The integration of EBS into overall surveillance was not addressed, and the pathway from detection to action is not clear. The use of electronic databases and platforms is generally limited. Factors that would improve performance include training, presence of a trained focal person at state level, and regular follow-up from the national level. Factors such as staff turnover, income in relation to expenses and not having a high academic qualification (Diploma or MSc) were noticed as inhibiting factors.

CONCLUSION

The review recommended revisiting the surveillance structure at national and state levels to put EBS as an essential component and to update guidelines and standard operation procedures SOPs to foster the integration between EBS components and the overall surveillance system. The need for strengthening the link with states, capacity building and re-addressing the training modalities was highlighted.

Comprehensive Vaccine-Preventable Disease Surveillance in the Western Pacific Region: A Literature Review on Integration of Surveillance Functions, 2000-2021

INTRODUCTION

A strategic framework for 2021-2030 developed by the World Health Organization (WHO) Regional Office for the Western Pacific emphasizes the need for high-quality and integrated vaccine-preventable disease (VPD) surveillance. We conducted a literature review to document the barriers, enabling factors, and innovations for integrating surveillance functions for VPDs and other communicable diseases in Western Pacific Region (WPR) countries.

METHODS

We searched published and gray literature on integrated VPD surveillance from 2000 to 2021. Articles in English, Spanish, or French were screened to identify those relating to VPD surveillance in a WPR country and not meeting defined exclusion criteria. We categorized articles using the 8 WHO surveillance support functions and abstracted data on the country; type of surveillance; and reported barriers, enabling factors, and best practices for integration.

RESULTS

Of the 3,137 references screened, 87 met the eligibility criteria. Of the 8 surveillance support functions, the proportion of references that reported integration related to the laboratory was 56%, followed by workforce capacity (54%), governance (51%), data management and use (47%), field logistics and communication (47%), coordination (15%), program management (13%), and supervision (9%). Several references noted fragmented systems and a lack of coordination between units as barriers to integration, highlighting the importance of engagement across public health units and between the public and private sectors. The literature also indicated a need for interoperable information systems and revealed the use of promising new technologies for data reporting and laboratory testing. In some WPR countries, workforce capacity was strengthened at all administrative levels by the implementation of integrated trainings on data monitoring and use and on laboratory techniques applicable to multiple VPDs.

CONCLUSION

This literature review supports integrating VPDs into broader communicable disease surveillance systems in WPR countries while ensuring that the minimal WHO-recommended standards for VPD surveillance are met.

Testing early warning and response systems through a full-scale exercise in Vietnam

Background

Simulation exercises can functionally validate World Health Organization (WHO) International Health Regulations (IHR 2005) core capacities. In 2018, the Vietnam Ministry of Health (MOH) conducted a full-scale exercise (FSX) in response to cases of severe viral pneumonia with subsequent laboratory confirmation for Middle East Respiratory Syndrome Coronavirus (MERS-CoV) to evaluate the country’s early warning and response capabilities for high-risk events.

Methods

An exercise planning team designed a complex fictitious scenario beginning with one case of severe viral pneumonia presenting at the hospital level and developed all the materials required for the exercise. Actors, controllers and evaluators were trained. In August 2018, a 3-day exercise was conducted in Quang Ninh province and Hanoi city, with participation of public health partners at the community, district, province, regional and national levels. Immediate debriefings and an after-action review were conducted after all exercise activities. Participants assessed overall exercise design, conduction and usefulness.

Results

FSX findings demonstrated that the event-based surveillance component of the MOH surveillance system worked optimally at different administrative levels. Detection and reporting of signals at the community and health facility levels were appropriate. Triage, verification and risk assessment were successfully implemented to identify a high-risk event and trigger timely response. The FSX identified infection control, coordination with internal and external response partners and process documentation as response challenges. Participants positively evaluated the exercise training and design.

Conclusions

This exercise documents the value of exercising surveillance capabilities as part of a real-time operational scenario before facing a true emergency. The timing of this exercise and choice of disease scenario was particularly fortuitous given the subsequent appearance of COVID-19. As a result of this exercise and subsequent improvements made by the MOH, the country may have been better able to deal with the emergence of SARS-CoV-2 and contain it.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-021-10402-x.