"Every Newborn-INDEPTH" (EN-INDEPTH) study protocol for a randomised comparison of household survey modules for measuring stillbirths and neonatal deaths in five Health and Demographic Surveillance sites

Bereavement care guidelines used in health care facilities immediately following perinatal loss: a scoping review

OBJECTIVE

The objective of the scoping review was to explore the evidence and describe what is known about perinatal bereavement care guidelines provided within health care facilities prior to discharge. Additionally, the review sought to identify what is known about parents' mental health outcomes, and map these outcomes to the characteristics of the bereavement care guidelines.

INTRODUCTION

Perinatal loss poses a serious risk of emotional trauma and mental health sequelae. Conflicting evidence for international bereavement care guidelines and inconsistent implementation, a lack of experimental studies, and older syntheses with a limited focus or population made synthesis complex. Therefore, a scoping review was undertaken to determine the breadth and depth of the existing literature on this topic.

INCLUSION CRITERIA

Sources pertaining to bereavement care guidelines used in health care facilities immediately after perinatal loss (miscarriage, stillbirth, or neonatal death) and parents' mental health outcomes were included. Sources pertaining to family members other than parents, perinatal loss occurring outside of a health care facility, and physical care guidelines were excluded.

METHODS

The review was conducted using JBI methodology for scoping reviews. The team considered quantitative and qualitative studies, practice guidelines, case reports, expert opinions, systematic reviews, professional organization websites, and gray literature. CINAHL (EBSCOhost), PsycINFO (EBSCOhost), SocINDEX (EBSCOhost), Cochrane Library, JBI Evidence-based Practice Database (Ovid), Embase, PubMed (NLM), ProQuest Dissertations and Theses A&I (ProQuest), Web of Science Core Collection, and Epistemonikos were the major databases searched. OpenGrey, Google Scholar, and organizational websites were also searched. The earliest empirical study publication found (1976) served as the starting date limit. After pilot-testing the screening process, data were extracted, collated, and presented in narrative form as well as in tables and figures. The search was first conducted in September and October 2021, and an updated search was performed on February 9, 2023.

RESULTS

The results provide a broad view of bereavement care guidelines to support grieving parents' mental health. The included sources (n = 195) were comprised of 28 syntheses, 96 primary studies, and 71 literature review/text and opinion. From the studies that specified the number of participants, 33,834 participants were included. Key characteristics of bereavement care guidelines were categorized as i) making meaning/memories, ii) good communication, iii) shared decision-making, iv) effective emotional and social support, and v) organizational response. Parents' reported mental health outcomes included both negative outcomes, such as depression, anxiety, anger, and helplessness, and positive outcomes, including coping, healing, recovery, and well-being.

CONCLUSIONS

Conceptually the characteristics of published guidelines are fairly consistent across settings, with cultural variations in specific components of the guidelines. Despite the exponential increase in research pertaining to bereavement care after perinatal loss, there is a gap in research pertaining to certain characteristics of bereavement care guidelines accepted as best practice to support parents' mental health outcomes. This review provides support for future research given the trauma and mental health risks following perinatal loss. Policies ensuring consistent and appropriate implementation of bereavement care guidelines are essential to improve parents' mental health outcomes.

Assessing the performance of the family folder system for collecting community-based health information in Tigray Region, North Ethiopia: a capture-recapture study

OBJECTIVES

To assess completeness and accuracy of the family folder in terms of capturing community-level health data.

STUDY DESIGN

A capture-recapture method was applied in six randomly selected districts of Tigray Region, Ethiopia.

PARTICIPANTS

Child health data, abstracted from randomly selected 24 073 family folders from 99 health posts, were compared with similar data recaptured through household survey and routine health information made by these health posts.

PRIMARY AND SECONDARY OUTCOME MEASURES

Completeness and accuracy of the family folder data; and coverage selected child health indicators, respectively.

RESULTS

Demographic data captured by the family folders and household survey were highly concordant, concordance correlation for total population, women 15-49 years age and under 5-year child were 0.97 (95% CI 0.94 to 0.99, p<0.001), 0.73 (95% CI 0.67 to 0.88) and 0.91 (95% CI 0.85 to 0.96), respectively. However, the live births, child health service indicators and child health events were more erratically reported in the three data sources. The concordance correlation among the three sources, for live births and neonatal deaths was 0.094 (95% CI -0.232 to 0.420) and 0.092 (95% CI -0.230 to 0.423) respectively, and for the other parameters were close to 0.

CONCLUSION

The family folder system comprises a promising development. However, operational issues concerning the seamless capture and recording of events and merging community and facility data at the health centre level need improvement.

Comparison of Population-Based Census versus Birth History for the Estimation of Under-5 Mortality in Niger

The WHO guidelines on mass distribution of azithromycin for child survival recommend monitoring of mortality to evaluate effectiveness. Trials that contributed evidence to these guidelines used a population-based census to monitor vital status, requiring census workers to visit each household biannually (twice yearly). Birth history is an alternative to the census approach that may be more feasible because it decreases the time and labor needed for mortality monitoring. This study aimed to compare the population-based census (reference standard) and birth history (index test) approaches to estimating mortality among children 1 to 59 months old using data from the Macrolides Oraux pour Réduire les Décès avec un Oeil sur la Résistance (MORDOR) trial. Sixteen communities that received 5 years of biannual census in the MORDOR trial were selected randomly also to receive birth history surveys. The census approach recorded more participants and households than birth history, with correlations more than 0.94 for each. The correlation between number of deaths in each community was 0.84 (95% CI, 0.59-0.94). A comparison of the mortality incidence rate estimated from the census against the under-5 mortality rate estimated from the birth history resulted in a correlation of 0.60 (95% CI, 0.15-0.84). Of the 47% of children who were linked individually to compare vital status from each method, the death status of children had a sensitivity of 80% (95% CI, 73-89) and a specificity of 98% (95% CI, 98-99), comparing birth history to census. Overall birth histories were found to be a reasonable alternative to biannual census for tracking vital status.

Provider-mother interactions are associated with birth outcome misclassifications in household surveys: A case-control study in Guinea-Bissau

Background

Approximately 4.4 million children die peripartum annually, primarily in low- and middle-income countries. Accurate mortality tracking is essential to prioritising prevention efforts but is undermined by misclassification between stillbirths (SBs) and early neonatal deaths (ENNDs) in household surveys, which serve as key data sources. We explored and quantified associations between peripartum provider-mother interactions and misclassification of SBs and ENNDs in Guinea-Bissau.

Methods

Using a case-control design, we followed up on women who had reported a SB or ENND in a retrospective household survey nested in the Bandim Health Project's Health and Demographic Surveillance Systems (HDSS). Using prospective HDSS registration as the reference standard, we linked the survey-reported deaths to the corresponding HDSS records and cross-tabulated SB/ENND classification to identify cases (discordant classification between survey and HDSS) and controls (concordant classification). We further interviewed cases and controls on peripartum provider-mother interactions and analysed data using descriptive statistics and logistic regressions.

Results

We interviewed 278 women (cases: 63 (23%); controls: 215 (77%)). Most cases were SBs misclassified as ENNDs (n/N = 49/63 (78%)). Three-fourths of the interviewed women reported having received no updates on the progress of labour and baby's health intrapartum, and less than one-fourth inquired about this information. In comparison with births where women did inquire for information, misclassification was less likely when women did not inquire and recalled no doubts about progress of labour (odds ratio (OR) = 0.51; 95% confidence interval (CI) = 0.28-0.91), or baby's health (OR = 0.54; 95% CI = 0.30-0.97). Most women reported that service providers' death notifications lasted <5 minutes (cases: 23/27 (85%); controls: 61/71 (86%)), and most often encompassed neither events leading to the death (cases: 19/27 (70%); controls: 55/71 (77%)) nor causes of death (cases: 20/27 (74%); controls: 54/71 (76%)). Misclassification was more likely if communication lasted <1 compared to 1-4 minutes (OR = 1.83; 95% CI = 1.10-3.06) and if a formal service provider had informed the mother of the death compared to a family member (OR = 1.57; 95% CI = 1.04-2.36).

Conclusions

Peripartum provider-mother interactions are limited in Guinea-Bissau and associated with birth outcome misclassifications in retrospective household surveys. In our study population, misclassification led to overestimated neonatal mortality.

Global Stillbirth Policy Review - Outcomes And Implications Ahead of the 2030 Sustainable Development Goal Agenda

BACKGROUND

Globally, data on stillbirth is limited. A call to action has been issued to governments to address the data gap by strengthening national policies and strategies to drive urgent action on stillbirth reduction. This study aims to understand the policy environment for stillbirths to advance stillbirth recording and reporting in data systems.

METHODS

A systematic three-step process (survey tool examination, identifying relevant study questions, and reviewing country responses to the survey and national documents) was taken to review country responses to the global 2018-2019 World Health Organization (WHO) Reproductive, Maternal, Neonatal, Child and Adolescent Health (RMNCAH) Policy Survey. Policy Survey responses were reviewed to identify if and how stillbirths were included in national documents. This paper uses descriptive analyses to identify and describe the relationship between multiple variables.

RESULTS

Responses from 155 countries to the survey were analysed, and over 800 national policy documents submitted by countries in English reviewed. Fewer than one-fifth of countries have an established stillbirth rate (SBR) target, with higher percentages reported for under-5 (71.0%) and neonatal mortality (68.5%). Two-thirds (65.8%) of countries reported a national maternal death review panel. Less than half (43.9%) of countries have a national policy that requires stillbirths to be reviewed. Two-thirds of countries have a national policy requiring review of neonatal deaths. WHO websites and national health statistics reports are the common data sources for stillbirth estimates. Countries that are signatories to global initiatives on stillbirth reduction have established national targets. Globally, nearly all countries (94.8%) have a national policy that requires every death to be registered. However, 45.5% of reviewed national policy documents made mention of registering stillbirths. Only 5 countries had national policy documents recommending training of health workers in filling out death certificates using the International Classification of Diseases (ICD)-10 for stillbirths.

CONCLUSION

The current policy environment in countries is not supportive for identifying stillbirths and recording causes of death. This is likely to contribute to slow progress in stillbirth reduction. The paper proposes policy recommendations to make every baby count.

Prevalence and determinants of caesarean section deliveries in the Kintampo Districts of Ghana

BACKGROUND

Globally, the increasing rate of caesarean section (CS) delivery has become a major public health concern due to its cost, maternal, neonatal, and perinatal risks. In Ghana, the Family Health Division of the Ghana Health Service in 2016 opted to initiate a program to prevent the abuse of CS and identify the factors contributing to its increase in the country. This study aimed to determine the prevalence and factors influencing CS deliveries in the Kintampo Districts of Ghana.

METHODS

The current study used secondary data from the Every Newborn-International Network for the Demographic Evaluation of Populations and their Health (EN-INDEPTH) project in Kintampo, Ghana. The outcome variable for this study is CS delivery. The predictor variables were socio-demographic and obstetric factors.

RESULTS

The prevalence of CS delivery in the study area was 14.6%. Women with secondary education were 2.6 times more likely to give birth by CS than those with primary education. Unmarried women were about 2.5 times more likely to deliver by CS compared to those who were married. There was an increasing order of CS delivery among women in the wealthy quintiles from poorer to richest. The likelihood of women with gestational ages from 37 to 40 weeks to give birth by CS was about 58% less compared to those with less than 37 gestational weeks. Women who had 4-7 and 8 or more antenatal care (ANC) visits were 1.95 and 3.5 times more likely to deliver by CS compared to those who had less than 4 ANC visits. The odds of women who have had pregnancy loss before to deliver by CS was 68% higher compared to women who have not lost pregnancy before.

CONCLUSIONS

Caesarean section delivery prevalence in the study population was within the Ghana Health Service and World Health Organization ranges. In addition to known socio-demographic and obstetric factors, this study observed that a history of pregnancy loss increased the chances of a woman undergoing a CS. Policies should aim at addressing identified modifiable factors to stem the rise in CS deliveries.

Assessment of the consistency of health and demographic surveillance and household survey data: A demonstration at two HDSS sites in The Gambia

Objective

To assess whether an adapted Demographic and Health Survey (DHS) like cross-sectional household survey with full pregnancy histories can demonstrate the validity of health and demographic surveillance (HDSS) data by producing similar population structural characteristics and childhood mortality indicators at two HDSS sites in The Gambia–Farafenni and Basse.

Methods

A DHS-type survey was conducted of 2,580 households in the Farafenni HDSS, and 2,907 in the Basse HDSS. Household members were listed and pregnancy histories obtained for all women aged 15–49. HDSS datasets were extracted for the same households including residency episodes for all current and former members and compared with the survey data. Neonatal (0–28 days), infant (<1 year), child (1–4 years) and under-5 (< 5 years) mortality rates were derived from each source by site and five-year periods from 2001–2015 and by calendar year between 2011 and 2015 using Kaplan–Meier failure probabilities. Survey-HDSS rate ratios were determined using the Mantel-Haenszel method.

Results

The selected households in Farafenni comprised a total population of 27,646 in the HDSS, compared to 26,109 captured in the household survey, implying higher coverage of 94.4% (95% CI: 94.1–94.7; p<0.0001) against a hypothesised proportion of 90% in the HDSS. All population subgroups were equally covered by the HDSS except for the Wollof ethnic group. In Basse, the total HDSS population was 49,287, compared to 43,538 enumerated in the survey, representing an undercount of the HDSS by the survey with a coverage of 88.3% (95% CI: 88.0–88.6; p = 1). All sub-population groups were also under-represented by the survey. Except for the neonatal mortality rate for Farafenni, the childhood mortality indicators derived from pregnancy histories and HDSS data compare reasonably well by 5-year periods from 2001–2015. Annual estimates from the two data sources for the most recent quinquennium, 2011–2015, were similar in both sites, except for an excessively high neonatal mortality rate for Farafenni in 2015.

Conclusion

Overall, the adapted DHS-type survey has reasonably represented the Farafenni HDSS database using population size and structure; and both databases using childhood mortality indicators. If the hypothetical proportion is lowered to 85%, the survey would adequately validate both HDSS databases in all considered aspects. The adapted DHS-type sample household survey therefore has potential for validation of HDSS data.

Adverse pregnancy outcome disclosure and women's social networks: a qualitative multi-country study with implications for improved reporting in surveys

Background

Globally, approximately 6,700 newborn deaths and 5,400 stillbirths occur daily. The true figure is likely higher, with under reporting of adverse pregnancy outcomes (APOs) noted. Decision-making in health is influenced by various factors, including one’s social networks. We sought to understand APOs disclosure within social networks in Uganda, Ghana, Guinea-Bissau and Bangladesh and how this could improve formal reporting of APOs in surveys. 

Methods

A qualitative, exploratory multi-country study was conducted within four health and demographic surveillance system sites. 16 focus group discussions were held with 147 women aged 15–49 years, who had participated in a recent household survey. Thematic analysis, with both deductive and inductive elements, using three pre-defined themes of Sender, Message and Receiver was done using NVivo software.

Results

Disclosure of APOs was a community concern, with news often shared with people around the bereaved for different reasons, including making sense of what happened and decision-making roles of receivers. Social networks responded with comfort, providing emotional, in-kind and financial support. Key decision makers included men, spiritual and traditional leaders. Non-disclosure was usually to avoid rumors in cases of induced abortions, or after a previous bad experience with health workers, who were frequently excluded from disclosure, except for instances where a woman sought advice on APOs.

Conclusions

Communities must understand why they should report APOs and to whom. Efforts to improve APOs reporting could be guided by diffusion of innovation theory, for instance for community entry and sensitization before the survey, since it highlights how information can be disseminated through community role models. In this case, these gatekeepers we identified could promote reporting of APOs. The stage at which a person is in decision-making, what kind of adopter they are and their take on the benefits and other attributes of reporting are important. In moving beyond survey reporting to getting better routine data, the theory would be applicable too. Health workers should demonstrate a more comforting and supportive response to APOs as the social networks do, which could encourage more bereaved women to inform them and seek care.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12884-022-04622-1.

Bereavement care immediately after perinatal loss in health care facilities: a scoping review protocol

OBJECTIVE

This scoping review will summarize what is known about formal and informal perinatal bereavement care guidelines used in health care facilities before discharge, and map the mental health outcomes of parents against characteristics of the guidelines.

INTRODUCTION

Conflicting evidence for bereavement care guidelines, the lack of randomized controlled trials and experimental studies, and older synthesized information with a limited focus or population make synthesis complex. A scoping review will facilitate the process of determining the breadth and depth of the literature.

INCLUSION CRITERIA

Sources pertaining to bereavement care guidelines used in health care facilities immediately after perinatal loss (miscarriage, stillbirth, or neonatal death) and measuring parents' mental health outcomes will be included. Sources relating to family members other than parents, perinatal loss occurring outside of a health care facility, and physical care guidelines will be excluded.

METHODS

The proposed review will be conducted using JBI methodology for scoping reviews. The team will consider quantitative and qualitative studies, practice guidelines, case reports, expert opinions, systematic reviews, professional organization websites, and gray literature. Major databases to be searched will include CINAHL (EBSCO), PsycINFO (EBSCO), SocINDEX (EBSCO), Cochrane, Embase, MEDLINE (PubMed), and Web of Science. The earliest empirical study found (1976) will serve as the starting date limit. After pilot testing the two-step screening process (titles and abstracts, then full-text articles), data will be extracted, collated, and presented in narrative form as well as in tables and diagrams. The results will provide facilities with a broad view of bereavement care to support grieving parents' mental health.

Health and demographic surveillance systems in low- and middle-income countries: history, state of the art and future prospects

Health and Demographic Surveillance Systems (HDSS) have been developed in several low- and middle-income countries (LMICs) in Africa and Asia. This paper reviews their history, state of the art and future potential and highlights substantial areas of contribution by the late Professor Peter Byass.Historically, HDSS appeared in the second half of the twentieth century, responding to a dearth of accurate population data in poorly resourced settings to contextualise the study of interventions to improve health and well-being. The progress of the development of this network is described starting with Pholela, and progressing through Gwembe, Balabgarh, Niakhar, Matlab, Navrongo, Agincourt, Farafenni, and Butajira, and the emergence of the INDEPTH Network in the early 1990'sThe paper describes the HDSS methodology, data, strengths, and limitations. The strengths are particularly their temporal coverage, detail, dense linkage, and the fact that they exist in chronically under-documented populations in LMICs where HDSS sites operate. The main limitations are generalisability to a national population and a potential Hawthorne effect, whereby the project itself may have changed characteristics of the population.The future will include advances in HDSS data harmonisation, accessibility, and protection. Key applications of the data are to validate and assess bias in other datasets. A strong collaboration between a national HDSS network and the national statistics office is modelled in South Africa and Sierra Leone, and it is possible that other low- to middle-income countries will see the benefit and take this approach.

Biases in Survey Estimates of Neonatal Mortality: Results From a Validation Study in Urban Areas of Guinea-Bissau

Neonatal deaths (occurring within 28 days of birth) account for close to one-half of all deaths among children under age 5 worldwide. In most low- and middle-income countries, data on neonatal deaths come primarily from household surveys. We conducted a validation study of survey data on neonatal mortality in Guinea-Bissau (West Africa). We used records from an urban health and demographic surveillance system (HDSS) that monitors child survival prospectively as our reference data set. We selected a stratified sample of 599 women aged 15-49 among residents of the HDSS and collected the birth histories of 422 participants. We cross-tabulated survey and HDSS data. We used a mathematical model to investigate biases in survey estimates of neonatal mortality. Reporting errors in survey data might lead to estimates of the neonatal mortality rate that are too high, which may limit our ability to track progress toward global health objectives.

Pregnancy Surveillance Methods within Health and Demographic Surveillance Systems

Background: Pregnancy identification and follow-up surveillance can enhance the reporting of pregnancy outcomes, including stillbirths and perinatal and early postnatal mortality. This paper reviews pregnancy surveillance methods used in Health and Demographic Surveillance Systems (HDSSs) in low- and middle-income countries. Methods: We searched articles containing information about pregnancy identification methods used in HDSSs published between January 2002 and October 2019 using PubMed and Google Scholar. A total of 37 articles were included through literature review and 22 additional articles were identified via manual search of references. We reviewed the gray literature, including websites, online reports, data collection instruments, and HDSS protocols from the Child Health and Mortality Prevention Study (CHAMPS) Network and the International Network for the Demographic Evaluation of Populations and Their Health (INDEPTH). In total, we reviewed information from 52 HDSSs described in 67 sources. Results: Substantial variability exists in pregnancy surveillance approaches across the 52 HDSSs, and surveillance methods are not always clearly documented. 42% of HDSSs applied restrictions based on residency duration to identify who should be included in surveillance. Most commonly, eligible individuals resided in the demographic surveillance area (DSA) for at least three months. 44% of the HDSSs restricted eligibility for pregnancy surveillance based on a woman's age, with most only monitoring women 15-49 years. 10% had eligibility criteria based on marital status, while 11% explicitly included unmarried women in pregnancy surveillance. 38% allowed proxy respondents to answer questions about a woman's pregnancy status in her absence. 20% of HDSSs supplemented pregnancy surveillance with investigations by community health workers or key informants and by linking HDSS data with data from antenatal clinics. Conclusions: Methodological guidelines for conducting pregnancy surveillance should be clearly documented and meticulously implemented, as they can have implications for data quality and accurately informing maternal and child health programs.

Global burden of maternal bereavement: indicators of the cumulative prevalence of child loss

BACKGROUND

We provide country-level estimates of the cumulative prevalence of mothers bereaved by a child's death in 170 countries and territories.

METHODS

We generate indicators of the cumulative prevalence of mothers who have had an infant, under-five-year-old or any-age child ever die by using publicly available survey data in 89 countries and an indirect approach that combines formal kinship models and life-table methods in an additional 81 countries. We label these measures the maternal cumulative prevalence of infant mortality (mIM), under-five mortality (mU5M) and offspring mortality (mOM) and generate prevalence estimates for 20-44-year-old and 45-49-year-old mothers.

RESULTS

In several Asian and European countries, the mIM and mU5M are below 10 per 1000 mothers yet exceed 200 per 1000 mothers in several Middle Eastern and African countries. Global inequality in mothers' experience of child loss is enormous: mothers in high-mortality-burden African countries are more than 100 times more likely to have had a child die than mothers in low-mortality-burden Asian and European countries. In more than 20 African countries, the mOM exceeds 500 per 1000 mothers, meaning that it is typical for a surviving 45-49-year-old mother to be bereaved.

DISCUSSION

The study reveals enormous global disparities in mothers' experience of child loss and identifies a need for more research on the downstream mental and physical health risks associated with parental bereavement.

Counting on birth registration: mixed-methods research in two EN-BIRTH study hospitals in Tanzania

Background

Birth registration marks a child’s right to identity and is the first step to establishing citizenship and access to services. At the population level, birth registration data can inform effective programming and planning. In Tanzania, almost two-thirds of births are in health facilities, yet only 26% of children under 5 years have their births registered. Our mixed-methods research explores the gap between hospital birth and birth registration in Dar es Salaam, Tanzania.

Methods

The study was conducted in the two Tanzanian hospital sites of the Every Newborn-Birth Indicators Research Tracking in Hospitals (EN-BIRTH) multi-country study (July 2017–2018). We described the business processes for birth notification and registration and collected quantitative data from women’s exit surveys after giving birth (n = 8038). We conducted in-depth interviews (n = 21) to identify barriers and enablers to birth registration among four groups of participants: women who recently gave birth, women waiting for a birth certificate at Temeke Hospital, hospital employees, and stakeholders involved in the national birth registration process. We synthesized findings to identify opportunities to improve birth registration.

Results

Standard national birth registration procedures were followed at Muhimbili Hospital; families received birth notification and were advised to obtain a birth certificate from the Registration, Insolvency, and Trusteeship Agency (RITA) after 2 months, for a fee. A pilot programme to improve birth registration coverage included Temeke Hospital; hand-written birth certificates were issued free of charge on a return hospital visit after 42 days. Among 2500 women exit-surveyed at Muhimbili Hospital, 96.3% reported receiving a birth notification form and nearly half misunderstood this to be a birth certificate. Of the 5538 women interviewed at Temeke Hospital, 33.0% reported receiving any documentation confirming the birth of their child. In-depth interview respondents perceived birth registration to be important but considered both the standard and pilot processes in Tanzania complex, burdensome and costly to both families and health workers.

Conclusion

Birth registration coverage in Tanzania could be improved by further streamlining between health facilities, where most babies are born, and the civil registry. Families and health workers need support to navigate processes to register every child.

Electronic data collection for multi-country, hospital-based, clinical observation of maternal and newborn care: EN-BIRTH study experiences

BACKGROUND

Observation of care at birth is challenging with multiple, rapid and potentially concurrent events occurring for mother, newborn and placenta. Design of electronic data (E-data) collection needs to account for these challenges. The Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) was an observational study to assess measurement of indicators for priority maternal and newborn interventions and took place in five hospitals in Bangladesh, Nepal and Tanzania (July 2017-July 2018). E-data tools were required to capture individually-linked, timed observation of care, data extraction from hospital register-records or case-notes, and exit-survey data from women.

METHODS

To evaluate this process for EN-BIRTH, we employed a framework organised around five steps for E-data design, data collection and implementation. Using this framework, a mixed methods evaluation synthesised evidence from study documentation, standard operating procedures, stakeholder meetings and design workshops. We undertook focus group discussions with EN-BIRTH researchers to explore experiences from the three different country teams (November-December 2019). Results were organised according to the five a priori steps.

RESULTS

In accordance with the five-step framework, we found: 1) Selection of data collection approach and software: user-centred design principles were applied to meet the challenges for observation of rapid, concurrent events around the time of birth with time-stamping. 2) Design of data collection tools and programming: required extensive pilot testing of tools to be user-focused and to include in-built error messages and data quality alerts. 3) Recruitment and training of data collectors: standardised with an interactive training package including pre/post-course assessment. 4) Data collection, quality assurance, and management: real-time quality assessments with a tracking dashboard and double observation/data extraction for a 5% case subset, were incorporated as part of quality assurance. Internet-based synchronisation during data collection posed intermittent challenges. 5) Data management, cleaning and analysis: E-data collection was perceived to improve data quality and reduce time cleaning.

CONCLUSIONS

The E-Data system, custom-built for EN-BIRTH, was valued by the site teams, particularly for time-stamped clinical observation of complex multiple simultaneous events at birth, without which the study objectives could not have been met. However before selection of a custom-built E-data tool, the development time, higher training and IT support needs, and connectivity challenges need to be considered against the proposed study or programme's purpose, and currently available E-data tool options.

Maternal and neonatal data collection systems in low- and middle-income countries for maternal vaccines active safety surveillance systems: A scoping review

BACKGROUND

Most post-licensure vaccine pharmacovigilance in low- and middle-income countries (LMICs) are passive reporting systems. These have limited utility for maternal immunization pharmacovigilance in LMIC settings and need to be supplemented with active surveillance. Our study's main objective was to identify existing perinatal data collection systems in LMICs that collect individual information on maternal and neonatal health outcomes and could be developed to inform active safety surveillance of novel vaccines for use during pregnancy.

METHODS

A scoping review was performed following the Arksey and O'Malley six-stage approach. We included studies describing electronic or mixed paper-electronic data collection systems in LMICs, including research networks, electronic medical records, and custom software platforms for health information systems. Medline PubMed, EMBASE, Global Health, Cochrane Library, LILACS, Bibliography of Asian Studies (BAS), and CINAHL were searched through August 2019. We also searched grey literature including through Google and websites of existing relevant perinatal data collection systems, as well as contacted authors of key studies and experts in the field to validate the information and identify additional sources of relevant unpublished information.

RESULTS

A total of 11,817 records were identified. The full texts of 264 records describing 96 data collection systems were assessed for eligibility. Eight perinatal data collection systems met our inclusion criteria: Global Network's Maternal Newborn Health Registry, International Network for the Demographic Evaluation of Populations and their Health; Perinatal Informatic System; Pregnancy Exposure Registry & Birth Defects Surveillance; SmartCare; Open Medical Record System; Open Smart Register Platform and District Health Information Software 2. These selected systems were qualitatively characterized according to seven different domains: governance; system design; system management; data management; data sources, outcomes and data quality.

CONCLUSION

This review provides a list of active maternal and neonatal data collection systems in LMICs and their characteristics as well as their outreach, strengths, and limitations. Findings could potentially help further understand where to obtain population-based high-quality information on outcomes to inform the conduct of maternal immunization active vaccine safety surveillance activities and research in LMICs.

Perinatal Grief Among Poor Rural and Urban Women in Central India

PURPOSE

Given the pressures surrounding women's reproductive role in India, and persistent high rates of perinatal death, the purpose of this study is to describe and compare poor rural and urban Indian women's experiences of perinatal grief.

PARTICIPANTS AND METHODS

Two cross-sectional studies were compared on shared quantitative variables. Poor rural (N = 217) and urban, slum-dwelling (N = 149) Central Indian women with a history of stillbirth, and/or infant death were recruited with the aid of local community health workers. Trained, local, gender, and linguistically matched research assistants conducted the structured interviews. Shared quantitative variables include demographics, Social Provision Scale, Shortened Ways of Coping-Revised, Perinatal Grief Scale, social norms and autonomy.

RESULTS

While similar with respect to SES, age, number of living sons and perinatal loss experiences, these samples of poor women differed significantly across many variables, most notably women's household position, joint family living, number of live daughters, religious coping, autonomy, and degrees of perinatal grief. While perinatal grief was significantly associated with many variables bi-variably, most lost their relative influence in our stepwise multivariable modeling within site (rural/urban), with only social norms and social support remaining significant for rural (31% of variance) and wishful thinking and social norms for urban participants (38.4% of variance). In the combined sample household position, social support and social norms remained significant and explained 53.6% of the adjusted variance.

CONCLUSION

In both samples, perinatal grief was high following perinatal loss. Both groups of women with perinatal loss have increased risk of mental health sequelae. Notably, the context affected how they experienced perinatal grief, with rural women's grief being higher and more affected by their societal pressures and isolation. Such nuances are important considerations for much-needed tailored approaches to future interventions.

Pregnancy intention data completeness, quality and utility in population-based surveys: EN-INDEPTH study

BACKGROUND

An estimated 40% of pregnancies globally are unintended. Measurement of pregnancy intention in low- and middle-income countries relies heavily on surveys, notably Demographic and Health Surveys (DHS), yet few studies have evaluated survey questions. We examined questions for measuring pregnancy intention, which are already in the DHS, and additional questions and investigated associations with maternity care utilisation and adverse pregnancy outcomes.

METHODS

The EN-INDEPTH study surveyed 69,176 women of reproductive age in five Health and Demographic Surveillance System sites in Ghana, Guinea-Bissau, Ethiopia, Uganda and Bangladesh (2017-2018). We investigated responses to survey questions regarding pregnancy intention in two ways: (i) pregnancy-specific intention and (ii) desired-versus-actual family size. We assessed data completeness for each and level of agreement between the two questions, and with future fertility desire. We analysed associations between pregnancy intention and number and timing of antenatal care visits, place of delivery, and stillbirth, neonatal death and low birthweight.

RESULTS

Missing data were <2% in all questions. Responses to pregnancy-specific questions were more consistent with future fertility desire than desired-versus-actual family size responses. Using the pregnancy-specific questions, 7.4% of women who reported their last pregnancy as unwanted reported wanting more children in the future, compared with 45.1% of women in the corresponding desired family size category. Women reporting unintended pregnancies were less likely to attend 4+ antenatal care visits (aOR 0.73, 95% CI 0.64-0.83), have their first visit during the first trimester (aOR 0.71, 95% CI 0.63-0.79), and report stillbirths (aOR 0.57, 95% CI 0.44-0.73) or neonatal deaths (aOR 0.79, 95% CI 0.64-0.96), compared with women reporting intended pregnancies. We found no associations for desired-versus-actual family size intention.

CONCLUSIONS

We found the pregnancy-specific intention questions to be a much more reliable assessment of pregnancy intention than the desired-versus-actual family size questions, despite a reluctance to report pregnancies as unwanted rather than mistimed. The additional questions were useful and may complement current DHS questions, although these are not the only possibilities. As women with unintended pregnancies were more likely to miss timely and frequent antenatal care, implementation research is required to improve coverage and quality of care for those women.

Barriers and enablers to reporting pregnancy and adverse pregnancy outcomes in population-based surveys: EN-INDEPTH study

BACKGROUND

Risks of neonatal death, stillbirth and miscarriage are highest in low- and middle-income countries (LMICs), where data has most gaps and estimates rely on household surveys, dependent on women reporting these events. Underreporting of pregnancy and adverse pregnancy outcomes (APOs) is common, but few studies have investigated barriers to reporting these in LMICs. The EN-INDEPTH multi-country study applied qualitative approaches to explore barriers and enablers to reporting pregnancy and APOs in surveys, including individual, community, cultural and interview level factors.

METHODS

The study was conducted in five Health and Demographic Surveillance System sites in Guinea-Bissau, Ethiopia, Uganda, Bangladesh and Ghana. Using an interpretative paradigm and phenomenology methodology, 28 focus group discussions were conducted with 82 EN-INDEPTH survey interviewers and supervisors and 172 women between February and August 2018. Thematic analysis was guided by an a priori codebook.

RESULTS

Survey interview processes influenced reporting of pregnancy and APOs. Women found questions about APOs intrusive and of unclear relevance. Across all sites, sociocultural and spiritual beliefs were major barriers to women reporting pregnancy, due to fear that harm would come to their baby. We identified several factors affecting reporting of APOs including reluctance to speak about sad memories and variation in recognition of the baby's value, especially for APOs at earlier gestation. Overlaps in local understanding and terminology for APOs may also contribute to misreporting, for example between miscarriages and stillbirths. Interviewers' skills and training were the keys to enabling respondents to open up, as was privacy during interviews.

CONCLUSION

Sociocultural beliefs and psycho-social impacts of APOs play a large part in underreporting these events. Interviewers' skills, careful tool development and translation are the keys to obtaining accurate information. Reporting could be improved with clearer explanations of survey purpose and benefits to respondents and enhanced interviewer training on probing, building rapport and empathy.

Termination of pregnancy data completeness and feasibility in population-based surveys: EN-INDEPTH study

BACKGROUND

Termination of pregnancy (TOP) is a common cause of maternal morbidity and mortality in low- and middle-income countries. Population-based surveys are the major data source for TOP data in LMICs but are known to have shortcomings that require improving. The EN-INDEPTH multi-country survey employed a full pregnancy history approach with roster and new questions on TOP and Menstrual Restoration. This mixed methods paper assesses the completeness of responses to questions eliciting TOP information from respondents and reports on practices, barriers, and facilitators to TOP reporting.

METHODS

The EN-INDEPTH study was a population-based cross-sectional study. The Full Pregnancy History arm of the study surveyed 34,371 women of reproductive age between 2017 and 2018 in five Health and Demographic Surveillance System (HDSS) sites of the INDEPTH network: Bandim, Guinea-Bissau; Dabat, Ethiopia; IgangaMayuge, Uganda; Kintampo, Ghana; and Matlab, Bangladesh. Completeness and time spent in answering TOP questions were evaluated using simple tabulations and summary statistics. Exact binomial 95% confidence intervals were computed for TOP rates and ratios. Twenty-eight (28) focus group discussions were undertaken and analysed thematically.

RESULTS

Completeness of responses regarding TOP was between 90.3 and 100.0% for all question types. The new questions elicited between 2.0% (1.0-3.4), 15.5% (13.9-17.3), and 11.5% (8.8-14.7) lifetime TOP cases over the roster questions from Dabat, Ethiopia; Matlab, Bangladesh; and Kintampo, Ghana, respectively. The median response time on the roster TOP questions was below 1.3 minutes in all sites. Qualitative results revealed that TOP was frequently stigmatised and perceived as immoral, inhumane, and shameful. Hence, it was kept secret rendering it difficult and uncomfortable to report. Miscarriages were perceived to be natural, being easier to report than TOP. Interviewer techniques, which were perceived to facilitate TOP disclosure, included cultural competence, knowledge of contextually appropriate terms for TOP, adaptation to interviewee's individual circumstances, being non-judgmental, speaking a common language, and providing detailed informed consent.

CONCLUSIONS

Survey roster questions may under-represent true TOP rates, since the new questions elicited responses from women who had not disclosed TOP in the roster questions. Further research is recommended particularly into standardised training and approaches to improving interview context and techniques to facilitate TOP reporting in surveys.

Neonatal and child mortality data in retrospective population-based surveys compared with prospective demographic surveillance: EN-INDEPTH study

BACKGROUND

Global mortality estimates remain heavily dependent on household surveys in low- and middle-income countries, where most under-five deaths occur. Few studies have assessed the accuracy of mortality data or determinants of capturing births in surveys.

METHODS

The Every Newborn-INDEPTH study (EN-INDEPTH) included a large, multi-country survey of women aged 15-49 interviewed about livebirths and their survival status in five Health and Demographic Surveillance Systems (HDSSs). The HDSSs undertake regular household visits to register births and deaths for a given population. We analysed EN-INDEPTH survey data to assess background factors associated with not recalling a complete date-of-birth. We calculated Kaplan-Meier survival estimates for both survey and HDSS data and describe age-at-death distributions during the past 5 years for children born to the same women. We assessed the proportion of HDSS-births that could be matched on month-of-birth to survey-births and used regression models to identify factors associated with matching.

RESULTS

69,176 women interviewed in the survey reported 109,817 births and 3064 deaths in children under 5 years in the 5 years prior to the survey. In the HDSS data, the same women had 83,768 registered births and 2335 under-five deaths in the same period. A complete date-of-birth was not reported for 1-7% of survey-births. Birthdates were less likely to be complete for dead children and children born to women of higher parity or with little/no education. Distributions of reported age-at-death indicated heaping at full weeks (neonatal period) and at 12 months. Heaping was more pronounced in the survey data. Survey estimates of under-five mortality rates were similar to HDSS estimates of under-five mortality in two of five sites, higher in the survey in two sites (15%, 41%) and lower (24%) in one site. The proportion of HDSS-births matched to survey-births ranged from 51 to 89% across HDSSs and births of children who had died were less likely to be matched.

CONCLUSIONS

Mortality estimates in the survey and HDSS were not markedly different for most sites. However, neither source is a "gold standard" and both sources miss some events. Research is required to improve capture and accuracy to better track newborn and child survival targets.

Stillbirth maternity care measurement and associated factors in population-based surveys: EN-INDEPTH study

BACKGROUND

Household surveys remain important sources of maternal and child health data, but until now, standard surveys such as Demographic and Health Surveys (DHS) have not collected information on maternity care for women who have experienced a stillbirth. Thus, nationally representative data are lacking to inform programmes to address the millions of stillbirths which occur annually.

METHODS

The EN-INDEPTH population-based survey of women of reproductive age was undertaken in five Health and Demographic Surveillance System sites in Bangladesh, Ethiopia, Ghana, Guinea-Bissau and Uganda (2017-2018). All women answered a full birth history with additional questions on pregnancy losses (FBH+) or full pregnancy history (FPH). A sub-sample, including all women reporting a recent stillbirth or neonatal death, was asked additional maternity care questions. These were evaluated using descriptive measures. Associations between stillbirth and maternal socio-demographic characteristics, babies' characteristics and maternity care use were assessed using a weighted logistic regression model for women in the FBH+ group.

RESULTS

A total of 15,591 women reporting a birth since 1 January 2012 answered maternity care questions. Completeness was very high (> 99%), with similar proportions of responses for both live and stillbirths. Amongst the 14,991 births in the FBH+ group, poorer wealth status, higher parity, large perceived baby size-at-birth, preterm or post-term birth, birth in a government hospital compared to other locations and vaginal birth were associated with increased risk of stillbirth after adjusting for potential confounding factors. Regarding association with reported postnatal care, women with a stillbirth were more likely to report hospital stays of > 1 day. However, women with a stillbirth were less likely to report having received a postnatal check compared to those with a live birth.

CONCLUSIONS

Women who had experienced stillbirth were able to respond to questions about pregnancy and birth, and we found no reason to omit questions to these women in household surveys. Our analysis identified several potentially modifiable factors associated with stillbirth, adding to the evidence-base for policy and action in low- and middle-income contexts. Including these questions in DHS-8 would lead to increased availability of population-level data to inform action to end preventable stillbirths.

Birth, stillbirth and death registration data completeness, quality and utility in population-based surveys: EN-INDEPTH study

BACKGROUND

Birth registration is a child's first right. Registration of live births, stillbirths and deaths is foundational for national planning. Completeness of birth registration for live births in low- and middle-income countries is measured through population-based surveys which do not currently include completeness of stillbirth or death registration.

METHODS

The EN-INDEPTH population-based survey of women of reproductive age was undertaken in five Health and Demographic Surveillance System sites in Bangladesh, Ethiopia, Ghana, Guinea-Bissau and Uganda (2017-2018). In four African sites, we included new/modified questions regarding registration for 1177 stillbirths and 11,881 livebirths (1333 neonatal deaths and 10,548 surviving the neonatal period). Questions were evaluated for completeness of responses, data quality, time to administer and estimates of registration completeness using descriptive statistics. Timing of birth registration, factors associated with non-registration and reported barriers were assessed using descriptive statistics and logistic regression.

RESULTS

Almost all women, irrespective of their baby's survival, responded to registration questions, taking an average of < 1 min. Reported completeness of birth registration was 30.7% (6.1-53.5%) for babies surviving the neonatal period, compared to 1.7% for neonatal deaths (0.4-5.7%). Women were able to report age at birth registration for 93.6% of babies. Non-registration of babies surviving the neonatal period was significantly higher for home-born children (aOR 1.43 (95% CI 1.27-1.60)) and in Dabat (Ethiopia) (aOR 4.11 (95% CI 3.37-5.01)). Other socio-demographic factors associated with non-registration included younger age of mother, more prior births, little or no education, and lower socio-economic status. Neonatal death registration questions were feasible (100% women responded; only 1% did not know), revealing extremely low completeness with only 1.2% of neonatal deaths reported as registered. Despite > 70% of stillbirths occurring in facilities, only 2.5% were reported as registered.

CONCLUSIONS

Questions on birth, stillbirth and death registration were feasible in a household survey. Completeness of birth registration is low in all four sites, but stillbirth and neonatal death registration was very low. Closing the registration gap amongst facility births could increase registration of both livebirths and facility deaths, including stillbirths, but will require co-ordination between civil registration systems and the often over-stretched health sector. Investment and innovation is required to capture birth and especially deaths in both facility and community systems.

Gestational age data completeness, quality and validity in population-based surveys: EN-INDEPTH study

BACKGROUND

Preterm birth (gestational age (GA) <37 weeks) is the leading cause of child mortality worldwide. However, GA is rarely assessed in population-based surveys, the major data source in low/middle-income countries. We examined the performance of new questions to measure GA in household surveys, a subset of which had linked early pregnancy ultrasound GA data.

METHODS

The EN-INDEPTH population-based survey of 69,176 women was undertaken (2017-2018) in five Health and Demographic Surveillance System sites in Bangladesh, Ethiopia, Ghana, Guinea-Bissau and Uganda. We included questions regarding GA in months (GAm) for all women and GA in weeks (GAw) for a subset; we also asked if the baby was 'born before expected' to estimate preterm birth rates. Survey data were linked to surveillance data in two sites, and to ultrasound pregnancy dating at <24 weeks in one site. We assessed completeness and quality of reported GA. We examined the validity of estimated preterm birth rates by sensitivity and specificity, over/under-reporting of GAw in survey compared to ultrasound by multinomial logistic regression, and explored perceptions about GA and barriers and enablers to its reporting using focus group discussions (n = 29).

RESULTS

GAm questions were almost universally answered, but heaping on 9 months resulted in underestimation of preterm birth rates. Preference for reporting GAw in even numbers was evident, resulting in heaping at 36 weeks; hence, over-estimating preterm birth rates, except in Matlab where the peak was at 38 weeks. Questions regarding 'born before expected' were answered but gave implausibly low preterm birth rates in most sites. Applying ultrasound as the gold standard in Matlab site, sensitivity of survey-GAw for detecting preterm birth (GAw <37) was 60% and specificity was 93%. Focus group findings suggest that women perceive GA to be important, but usually counted in months. Antenatal care attendance, women's education and health cards may improve reporting.

CONCLUSIONS

This is the first published study assessing GA reporting in surveys, compared with the gold standard of ultrasound. Reporting GAw within 5 years' recall is feasible with high completeness, but accuracy is affected by heaping. Compared to ultrasound-GAw, results are reasonably specific, but sensitivity needs to be improved. We propose revised questions based on the study findings for further testing and validation in settings where pregnancy ultrasound data and/or last menstrual period dates/GA recorded in pregnancy are available. Specific training of interviewers is recommended.

Stillbirth outcome capture and classification in population-based surveys: EN-INDEPTH study

BACKGROUND

Household surveys remain important sources of stillbirth data, but omission and misclassification are common. Classifying adverse pregnancy outcomes as stillbirths requires accurate reporting of vital status at birth and gestational age or birthweight for every pregnancy. Further categorisation, e.g. by sex, or timing (intrapartum/antepartum) improves data to understand and prevent stillbirth.

METHODS

We undertook a cross-sectional population-based survey of women of reproductive age in five health and demographic surveillance system sites in Bangladesh, Ethiopia, Ghana, Guinea-Bissau and Uganda (2017-2018). All women answered a full birth history with pregnancy loss questions (FBH+) or a full pregnancy history (FPH). A sub-sample across both groups were asked additional stillbirth questions. Questions were evaluated using descriptive measures. Using an interpretative paradigm and phenomenology methodology, focus group discussions with women exploring barriers to reporting birthweight for stillbirths were conducted. Thematic analysis was guided by an a priori codebook.

RESULTS

Overall 69,176 women reported 98,483 livebirths (FBH+) and 102,873 pregnancies (FPH). Additional questions were asked for 1453 stillbirths, 1528 neonatal deaths and 12,620 surviving children born in the 5 years prior to the survey. Completeness was high (> 99%) for existing FBH+/FPH questions on signs of life at birth and gestational age (months). Discordant responses in signs of life at birth between different questions were common; nearly one-quarter classified as stillbirths on FBH+/FPH were reported born alive on additional questions. Availability of information on gestational age (weeks) (58.1%) and birthweight (13.2%) was low amongst stillbirths, and heaping was common. Most women (93.9%) were able to report the sex of their stillborn baby. Response completeness for stillbirth timing (18.3-95.1%) and estimated proportion intrapartum (15.6-90.0%) varied by question and site. Congenital malformations were reported in 3.1% stillbirths. Perceived value in weighing a stillborn baby varied and barriers to weighing at birth a nd knowing birthweight were common.

CONCLUSIONS

Improving stillbirth data in surveys will require investment in improving the measurement of vital status, gestational age and birthweight by healthcare providers, communication of these with women, and overcoming reporting barriers. Given the large burden and effect on families, improved data must be made available to end preventable stillbirths.

Paradata analyses to inform population-based survey capture of pregnancy outcomes: EN-INDEPTH study

BACKGROUND

Paradata are (timestamped) records tracking the process of (electronic) data collection. We analysed paradata from a large household survey of questions capturing pregnancy outcomes to assess performance (timing and correction processes). We examined how paradata can be used to inform and improve questionnaire design and survey implementation in nationally representative household surveys, the major source for maternal and newborn health data worldwide.

METHODS

The EN-INDEPTH cross-sectional population-based survey of women of reproductive age in five Health and Demographic Surveillance System sites (in Bangladesh, Guinea-Bissau, Ethiopia, Ghana, and Uganda) randomly compared two modules to capture pregnancy outcomes: full pregnancy history (FPH) and the standard DHS-7 full birth history (FBH+). We used paradata related to answers recorded on tablets using the Survey Solutions platform. We evaluated the difference in paradata entries between the two reproductive modules and assessed which question characteristics (type, nature, structure) affect answer correction rates, using regression analyses. We also proposed and tested a new classification of answer correction types.

RESULTS

We analysed 3.6 million timestamped entries from 65,768 interviews. 83.7% of all interviews had at least one corrected answer to a question. Of 3.3 million analysed questions, 7.5% had at least one correction. Among corrected questions, the median number of corrections was one, regardless of question characteristics. We classified answer corrections into eight types (no correction, impulsive, flat (simple), zigzag, flat zigzag, missing after correction, missing after flat (zigzag) correction, missing/incomplete). 84.6% of all corrections were judged not to be problematic with a flat (simple) mistake correction. Question characteristics were important predictors of probability to make answer corrections, even after adjusting for respondent's characteristics and location, with interviewer clustering accounted as a fixed effect. Answer correction patterns and types were similar between FPH and FBH+, as well as the overall response duration. Avoiding corrections has the potential to reduce interview duration and reproductive module completion by 0.4 min.

CONCLUSIONS

The use of questionnaire paradata has the potential to improve measurement and the resultant quality of electronic data. Identifying sections or specific questions with multiple corrections sheds light on typically hidden challenges in the survey's content, process, and administration, allowing for earlier real-time intervention (e.g.,, questionnaire content revision or additional staff training). Given the size and complexity of paradata, additional time, data management, and programming skills are required to realise its potential.

Birthweight data completeness and quality in population-based surveys: EN-INDEPTH study

BACKGROUND

Low birthweight (< 2500 g) is an important marker of maternal health and is associated with neonatal mortality, long-term development and chronic diseases. Household surveys remain an important source of population-based birthweight information, notably Demographic and Health Surveys (DHS) and UNICEF's Multiple Indicator Cluster Surveys (MICS); however, data quality concerns remain. Few studies have addressed how to close these gaps in surveys.

METHODS

The EN-INDEPTH population-based survey of 69,176 women was undertaken in five Health and Demographic Surveillance System sites (Matlab-Bangladesh, Dabat-Ethiopia, Kintampo-Ghana, Bandim-Guinea-Bissau, IgangaMayuge-Uganda). Responses to existing DHS/MICS birthweight questions on 14,411 livebirths were analysed and estimated adjusted odds ratios (aORs) associated with reporting weighing, birthweight and heaping reported. Twenty-eight focus group discussions with women and interviewers explored barriers and enablers to reporting birthweight.

RESULTS

Almost all women provided responses to birthweight survey questions, taking on average 0.2 min to answer. Of all babies, 62.4% were weighed at birth, 53.8% reported birthweight and 21.1% provided health cards with recorded birthweight. High levels of heterogeneity were observed between sites. Home births and neonatal deaths were less likely to be weighed at birth (home births aOR 0.03(95%CI 0.02-0.03), neonatal deaths (aOR 0.19(95%CI 0.16-0.24)), and when weighed, actual birthweight was less likely to be known (aOR 0.44(95%CI 0.33-0.58), aOR 0.30(95%CI 0.22-0.41)) compared to facility births and post-neonatal survivors. Increased levels of maternal education were associated with increases in reporting weighing and knowing birthweight. Half of recorded birthweights were heaped on multiples of 500 g. Heaping was more common in IgangaMayuge (aOR 14.91(95%CI 11.37-19.55) and Dabat (aOR 14.25(95%CI 10.13-20.3) compared to Bandim. Recalled birthweights were more heaped than those recorded by card (aOR 2.59(95%CI 2.11-3.19)). A gap analysis showed large missed opportunity between facility birth and known birthweight, especially for neonatal deaths. Qualitative data suggested that knowing their baby's weight was perceived as valuable by women in all sites, but lack of measurement and poor communication, alongside social perceptions and spiritual beliefs surrounding birthweight, impacted women's ability to report birthweight.

CONCLUSIONS

Substantial data gaps remain for birthweight data in household surveys, even amongst facility births. Improving the accuracy and recording of birthweights, and better communication with women, for example using health cards, could improve survey birthweight data availability and quality.

Electronic data collection in a multi-site population-based survey: EN-INDEPTH study

BACKGROUND

Electronic data collection is increasingly used for household surveys, but factors influencing design and implementation have not been widely studied. The Every Newborn-INDEPTH (EN-INDEPTH) study was a multi-site survey using electronic data collection in five INDEPTH health and demographic surveillance system sites.

METHODS

We described experiences and learning involved in the design and implementation of the EN-INDEPTH survey, and undertook six focus group discussions with field and research team to explore their experiences. Thematic analyses were conducted in NVivo12 using an iterative process guided by a priori themes.

RESULTS

Five steps of the process of selecting, adapting and implementing electronic data collection in the EN-INDEPTH study are described. Firstly, we reviewed possible electronic data collection platforms, and selected the World Bank's Survey Solutions® as the most suited for the EN-INDEPTH study. Secondly, the survey questionnaire was coded and translated into local languages, and further context-specific adaptations were made. Thirdly, data collectors were selected and trained using standardised manual. Training varied between 4.5 and 10 days. Fourthly, instruments were piloted in the field and the questionnaires finalised. During data collection, data collectors appreciated the built-in skip patterns and error messages. Internet connection unreliability was a challenge, especially for data synchronisation. For the fifth and final step, data management and analyses, it was considered that data quality was higher and less time was spent on data cleaning. The possibility to use paradata to analyse survey timing and corrections was valued. Synchronisation and data transfer should be given special consideration.

CONCLUSION

We synthesised experiences using electronic data collection in a multi-site household survey, including perceived advantages and challenges. Our recommendations for others considering electronic data collection include ensuring adaptations of tools to local context, piloting/refining the questionnaire in one site first, buying power banks to mitigate against power interruption and paying attention to issues such as GPS tracking and synchronisation, particularly in settings with poor internet connectivity.

Digital Health Innovations, Tools, and Resources to Support Helping Babies Survive Programs

The Helping Babies Survive (HBS) initiative features a suite of evidence-based curricula and simulation-based training programs designed to provide health workers in low- and middle-income countries (LMICs) with the knowledge, skills, and competencies to prevent, recognize, and manage leading causes of newborn morbidity and mortality. Global scale-up of HBS initiatives has been rapid. As HBS initiatives rolled out across LMIC settings, numerous bottlenecks, gaps, and barriers to the effective, consistent dissemination and implementation of the programs, across both the pre- and in-service continuums, emerged. Within the first decade of expansive scale-up of HBS programs, mobile phone ownership and access to cellular networks have also concomitantly surged in LMICs. In this article, we describe a number of HBS digital health innovations and resources that have been developed from 2010 to 2020 to support education and training, data collection for monitoring and evaluation, clinical decision support, and quality improvement. Helping Babies Survive partners and stakeholders can potentially integrate the described digital tools with HBS dissemination and implementation efforts in a myriad of ways to support low-dose high-frequency skills practice, in-person refresher courses, continuing medical and nursing education, on-the-job training, or peer-to-peer learning, and strengthen data collection for key newborn care and quality improvement indicators and outcomes. Thoughtful integration of purpose-built digital health tools, innovations, and resources may assist HBS practitioners to more effectively disseminate and implement newborn care programs in LMICs, and facilitate progress toward the achievement of Sustainable Development Goal health goals, targets, and objectives.

Randomised comparison of two household survey modules for measuring stillbirths and neonatal deaths in five countries: the Every Newborn-INDEPTH study

BACKGROUND

An estimated 5·1 million stillbirths and neonatal deaths occur annually. Household surveys, most notably the Demographic and Health Survey (DHS), run in more than 90 countries and are the main data source from the highest burden regions, but data-quality concerns remain. We aimed to compare two questionnaires: a full birth history module with additional questions on pregnancy losses (FBH+; the current DHS standard) and a full pregnancy history module (FPH), which collects information on all livebirths, stillbirths, miscarriages, and neonatal deaths.

METHODS

Women residing in five Health and Demographic Surveillance System sites within the INDEPTH Network (Bandim in Guinea-Bissau, Dabat in Ethiopia, IgangaMayuge in Uganda, Matlab in Bangladesh, and Kintampo in Ghana) were randomly assigned (individually) to be interviewed using either FBH+ or FPH between July 28, 2017, and Aug 13, 2018. The primary outcomes were stillbirths and neonatal deaths in the 5 years before the survey interview (measured by stillbirth rate [SBR] and neonatal mortality rate [NMR]) and mean time taken to complete the maternity history section of the questionnaire. We also assessed between-site heterogeneity. This study is registered with the Research Registry, 4720.

FINDINGS

69 176 women were allocated to be interviewed by either FBH+ (n=34 805) or FPH (n=34 371). The mean time taken to complete FPH (10·5 min) was longer than for FBH+ (9·1 min; p<0·0001). Using FPH, the estimated SBR was 17·4 per 1000 total births, 21% (95% CI -10 to 62) higher than with FBH+ (15·2 per 1000 total births; p=0·20) in the 5 years preceding the survey interview. There was strong evidence of between-site heterogeneity (I²=80·9%; p<0·0001), with SBR higher for FPH than for FBH+ in four of five sites. The estimated NMR did not differ between modules (FPH 25·1 per 1000 livebirths vs FBH+ 25·4 per 1000 livebirths), with no evidence of between-site heterogeneity (I²=0·7%; p=0·40).

INTERPRETATION

FPH takes an average of 1·4 min longer to complete than does FBH+, but has the potential to increase reporting of stillbirths in high burden contexts. The between-site heterogeneity we found might reflect variations in interviewer training and survey implementation, emphasising the importance of interviewer skills, training, and consistent implementation in data quality.

FUNDING

Children's Investment Fund Foundation.

What is meant by validity in maternal and newborn health measurement? A conceptual framework for understanding indicator validation

BACKGROUND

Rigorous monitoring supports progress in achieving maternal and newborn mortality and morbidity reductions. Recent work to strengthen measurement for maternal and newborn health highlights the existence of a large number of indicators being used for this purpose. The definitions and data sources used to produce indicator estimates vary and challenges exist with completeness, accuracy, transparency, and timeliness of data. The objective of this study is to create a conceptual overview of how indicator validity is defined and understood by those who develop and use maternal and newborn health indicators.

METHODS

A conceptual framework of validity was developed using mixed methods. We were guided by principles for conceptual frameworks and by a review of the literature and key maternal and newborn health indicator guidance documents. We also conducted qualitative semi-structured interviews with 32 key informants chosen through purposive sampling.

RESULTS

We categorised indicator validity into three main types: criterion, convergent, and construct. Criterion or diagnostic validity, comparing a measure with a gold standard, has predominantly been used to assess indicators of care coverage and content. Studies assessing convergent validity quantify the extent to which two or more indicator measurement approaches, none of which is a gold-standard, relate. Key informants considered construct validity, or the accuracy of the operationalisation of a concept or phenomenon, a critical part of the overall assessment of indicator validity.

CONCLUSION

Given concerns about the large number of maternal and newborn health indicators currently in use, a more consistent understanding of validity can help guide prioritization of key indicators and inform development of new indicators. All three types of validity are relevant for evaluating the performance of maternal and newborn health indicators. We highlight the need to establish a common language and understanding of indicator validity among the various global and local stakeholders working within maternal and newborn health.

"What gets measured better gets done better": The landscape of validation of global maternal and newborn health indicators through key informant interviews

Background

A large number of indicators are currently used to monitor the state of maternal and newborn health, including those capturing dimensions of health system and input, care access and availability, care quality and safety, coverage and outcomes, and impact. Validity of these indicators is a key issue in the process of assessing indicator performance and suitability. This paper aims to understand the meaning of indicator validity in the field of maternal and newborn health, and to identify key recommendations for future research.

Methods

This qualitative study used purposive sampling to identify key informants until thematic saturation was achieved. We interviewed 32 respondents from a variety of backgrounds using semi-structured interviews covering five themes: the meaning of indicator validity, methodological approaches to assessing validity, acceptable levels of indicator validity, gaps in validation research, and recommendations for addressing these gaps. Interview transcripts were analysed data using thematic content approach.

Results

Three conceptually different definitions of indicator validity were described by respondents. They considered indicator validity to encompass meaning and potential to spur action, going beyond diagnostic validity. Indicator validation was seen as an ongoing process of building and synthesising a wide range of evidence rather than a one-size-fits-all cut-off in diagnostic validity tests. Gaps identified included assessing validity of indicators of quality of care and indicators based on facility-level data, as well as expanding studies to a broader range of global settings. The key recommendation was to develop a coordinated approach to summarising and evaluating research on indicator validity, including capacity building in appraising and communicating the available evidence for country-specific needs.

Conclusion

The findings will inform future recommendations around indicator testing and validation.

"Every Newborn-BIRTH" protocol: observational study validating indicators for coverage and quality of maternal and newborn health care in Bangladesh, Nepal and Tanzania

Background

To achieve Sustainable Development Goals and Universal Health Coverage, programmatic data are essential. The Every Newborn Action Plan, agreed by all United Nations member states and >80 development partners, includes an ambitious Measurement Improvement Roadmap. Quality of care at birth is prioritised by both Every Newborn and Ending Preventable Maternal Mortality strategies, hence metrics need to advance from health service contact alone, to content of care. As facility births increase, monitoring using routine facility data in DHIS2 has potential, yet validation research has mainly focussed on maternal recall surveys. The Every Newborn – Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study aims to validate selected newborn and maternal indicators for routine tracking of coverage and quality of facility-based care for use at district, national and global levels.

Methods

EN-BIRTH is an observational study including >20 000 facility births in three countries (Tanzania, Bangladesh and Nepal) to validate selected indicators. Direct clinical observation will be compared with facility register data and a pre-discharge maternal recall survey for indicators including: uterotonic administration, immediate newborn care, neonatal resuscitation and Kangaroo mother care. Indicators including neonatal infection management and antenatal corticosteroid administration, which cannot be easily observed, will be validated using inpatient records. Trained clinical observers in Labour/Delivery ward, Operation theatre, and Kangaroo mother care ward/areas will collect data using a tablet-based customised data capturing application. Sensitivity will be calculated for numerators of all indicators and specificity for those numerators with adequate information. Other objectives include comparison of denominator options (ie, true target population or surrogates) and quality of care analyses, especially regarding intervention timing. Barriers and enablers to routine recording and data usage will be assessed by data flow assessments, quantitative and qualitative analyses.

Conclusions

To our knowledge, this is the first large, multi-country study validating facility-based routine data compared to direct observation for maternal and newborn care, designed to provide evidence to inform selection of a core list of indicators recommended for inclusion in national DHIS2. Availability and use of such data are fundamental to drive progress towards ending the annual 5.5 million preventable stillbirths, maternal and newborn deaths.