Comparability of modern contraceptive use estimates between a face-to-face survey and a cellphone survey among women in Burkina Faso

A nationwide mobile phone survey for tobacco use in Tanzania: Sample quality and representativeness compared to a household survey

We investigated the feasibility of an interactive voice response (IVR) survey in Tanzania and compared its prevalence estimates for tobacco use to the estimates of the 'Global Adult Tobacco Survey (GATS) 2018'. IVR participants were enrolled by random digit dialing. Quota sampling was employed to achieve the required sample sizes of age-sex strata: sex (male/female) and age (18-29-, 30-44-, 45-59-, and ≥60-year-olds). GATS was a nationally representative survey and used a multistage stratified cluster sampling design. The IVR sample's weights were generated using the inverse proportional weighting (IPW) method with a logit model and the standard age-sex distribution of Tanzania. The IVR and GATS had 2362 and 4555 participants, respectively. Compared to GATS, the unweighted IVR sample had a higher proportion of males (58.7 % vs. 43.2 %), educated people (secondary/above education: 43.3 % vs. 21.1 %), and urban residents (56.5 % vs. 40 %). The weighted prevalence (95 % confidence interval (CI)) of current smoking was 4.99 % (4.11-6.04), 5.22 % (4.36-6.24), and 7.36 % (6.51-8.31) among IVR (IPW), IVR (age-sex standard), and GATS samples, respectively; the weighted prevalence (95 % CI) of smokeless tobacco use was similar: 3.54 % (2.73-4.57), 3.58 % (2.80-4.56), and 2.43 % (1.98-2.98), respectively. Most differences in point estimates for tobacco indicators were small (<2%). Overall, the odds of tobacco smoking indicators were lower in IVR than in GATS; however, the odds of smokeless tobacco use were reversed. Although we found under-/over-estimation of the prevalence of tobacco use in IVR than GATS, the estimates were close. Further research is required to increase the representativeness of IVR.

Does survey mode matter? Comparing in-person and phone agricultural surveys in India

Ubiquitous mobile phone ownership makes phone surveying an attractive method of low-cost data collection. We explore differences between in-person and phone survey measures of agricultural production collected for an impact evaluation in India. Phone responses have greater mean and variance, a difference that persists even within a subset of respondents that answered the same question over both modes. Treatment effect estimation remains stable across survey mode, but estimates are less precise when using phone data. These patterns are informative for cost and sample size considerations in study design and for aggregating evidence across study sites or time periods.

Can phone surveys be representative in low- and middle-income countries? An application to Myanmar

For decades, in-person data collection has been the standard modality for nationally and sub-nationally representative socio-economic survey data in low- and middle-income countries. As the COVID-19 pandemic rendered in-person surveys impossible and unethical, the urgent need for rapid monitoring necessitated researchers and statistical agencies to turn to phone surveys. However, apart from pandemic-related factors, a variety of other reasons can render large segments of a population inaccessible for in-person surveys, including political instability, climatic shocks, and remoteness. Such circumstances currently prevail in Myanmar, a country facing civil conflict and political instability since the February 2021 military takeover. Moreover, Myanmar routinely experiences extreme weather events and is characterized by numerous inaccessible and remote regions due to its mountainous geography. We describe a novel approach to sample design and statistical weighting that has been successfully applied in Myanmar to obtain nationally and sub-nationally representative phone survey data. We use quota sampling and entropy weighting to obtain a better geographical distribution compared to recent in-person survey efforts, including reaching respondents in areas of active conflict. Moreover, we minimize biases towards certain household and respondent characteristics that are usually present in phone surveys, for example towards well-educated or wealthy households, or towards men or household heads as respondents. Finally, due to the rapidly changing political and economic situation in Myanmar in 2022, the need for frequent and swift monitoring was critical. We carried out our phone survey over four quarters in 2022, interviewing more than 12,000 respondents in less than three months each survey. A survey of this scale and pace, though generally of much shorter duration than in-person interviews, could only be possible on the phone. Our study proves the feasibility of collecting nationally and sub nationally representative phone survey data using a non-representative sample frame, which is critical for rapid monitoring in any volatile economy.

Measuring under-5 mortality and fertility through mobile phone surveys: an assessment of selection bias in 34 low-income and middle-income countries

OBJECTIVES

This study aims to assess sample selection bias in mobile phone survey estimates of fertility and under-5 mortality.

DESIGN

With data from the Demographic and Health Surveys, we use logistic regressions to identify sociodemographic correlates of mobile phone ownership and access, and Poisson regressions to estimate the association between mobile phone ownership (or access) and fertility and under-5 mortality estimates. We evaluate the potential reasons why estimates by mobile phone ownership differ using a set of behavioural characteristics.

SETTING

34 low-income and middle-income countries, mostly in sub-Saharan Africa.

PARTICIPANTS

534 536 women between the ages of 15 and 49.

OUTCOME MEASURES

Under-5 mortality rate (U5MR) and total fertility rate (TFR).

RESULTS

Mobile phone ownership ranges from 23.6% in Burundi to 96.7% in Armenia. The median TFR ratio and U5MR ratio between the non-owners and the owners of a mobile phone are 1.48 and 1.29, respectively. Fertility and mortality rates would be biased downwards if estimates are only based on women who own or have access to mobile phones. Estimates of U5MR can be adjusted through poststratification using age, educational level, area of residence, wealth and marital status as weights. However, estimates of TFR remain biased even after adjusting for these covariates. This difference is associated with behavioural factors (eg, contraceptive use) that are not captured by the poststratification variables, but for which there are also differences between mobile phone owners and non-owners.

CONCLUSIONS

Mobile phone surveys need to collect data on sociodemographic background characteristics to be able to weight and adjust mortality estimates ex post facto. Fertility estimates from mobile phone surveys will be biased unless further research uncovers the mechanisms driving the bias.

Examination of the demographic representativeness of a cross-sectional mobile phone survey in collecting health data in Colombia using random digit dialling

OBJECTIVES

As mobile phone ownership becomes more widespread in low-income and middle-income countries, mobile phone surveys (MPSs) present an opportunity to collect data on health more cost-effectively. However, selectivity and coverage biases in MPS are concerns, and there is limited information about the population-level representativeness of these surveys compared with household surveys. This study aims at comparing the sociodemographic characteristics of the respondents of an MPS on non-communicable disease risk factors to a household survey in Colombia.

DESIGN

Cross-sectional study. We used a random digit dialling method to select the samples for calling mobile phone numbers. The survey was conducted using two modalities: computer-assisted telephone interviews (CATIs) and interactive voice response (IVR). The participants were assigned randomly to one of the survey modalities based on a targeted sampling quota stratified by age and sex. The Quality-of-Life Survey (ECV), a nationally representative survey conducted in the same year of the MPS, was used as a reference to compare the sample distributions by sociodemographic characteristics of the MPS data. Univariate and bivariate analyses were performed to evaluate the population representativeness between the ECV and the MPSs.

SETTING

The study was conducted in Colombia in 2021.

PARTICIPANTS

Population at least 18 years old with a mobile phone.

RESULTS

We completed 1926 and 2983 interviews for CATI and IVR, respectively. We found that the MPS data have a similar (within 10% points) age-sex data distribution compared with the ECV dataset for some subpopulations, mainly for young populations, people with none/primary and secondary education levels, and people who live in urban and rural areas.

CONCLUSIONS

This study shows that MPS could collect similar data to household surveys in terms of age, sex, high school education level and geographical area for some population categories. Strategies are needed to improve representativeness of the under-represented groups.

Do referrals improve the representation of women in mobile phone surveys?

Random digit dial surveys with mobile phones risk under-representation of women. To address this, we compare the characteristics of women recruited directly with those of women recruited through referrals from male household members. The referral process improves representation of vulnerable groups, such as young women, the asset poor, and those living in areas with low connectivity. Among mobile phone users, we show a referral (rather than a direct dial) protocol includes more nationally representative proportions of women with these attributes. While seeking intra-household referrals may improve representation, we show that it does so at a higher cost.

Trends in fertility intentions and contraceptive practices in the context of COVID-19 in sub-Saharan Africa: insights from four national and regional population-based cohorts

OBJECTIVES

Studies in several sub-Saharan geographies conducted early in the COVID-19 pandemic suggested little impact on contraceptive behaviours. Initial results may mask widening disparities with rising poverty, and changes to women's pregnancy desires and contraceptive use amid prolonged health service disruptions. This study examined trends in contraceptive behaviours in four sub-Saharan African settings 1 year into the pandemic.

DESIGN

Nationally and regionally representative longitudinal surveys.

SETTING

Burkina Faso, Kenya, Democratic Republic of Congo (Kinshasa) and Nigeria (Lagos).

PARTICIPANTS

Women aged 15-49 years with sample size ranging from 1469 in Nigeria to 9477 in Kenya.

OUTCOME MEASURES

Fertility preferences, contraceptive use and unintended pregnancies measured before COVID-19 (November 2019 to January 2020) and during COVID-19 (November 2020 to January 2021).

ANALYSIS

We described population-level and individual-level changes by socioeconomic characteristics using generalised equation modelling. We used logistic regression models to identify factors related to contraceptive adoption and discontinuation and to experiencing an unintended pregnancy.

RESULTS

At the population level, we found no change in women's exposure to unintended pregnancy risk, alongside 5-9 percentage point increases in contraceptive prevalence in Burkina Faso, Kenya and Lagos. Reliance on provider-dependent methods dropped by 2 and 4 percentage points in Kenya and Burkina Faso, respectively, although these declines were not statistically significant. Between 1.0% and 2.8% of women across sites experienced an unintended pregnancy during COVID-19, with no significant change over time. Individual-level trajectories showed contraceptive adoption was more common than discontinuation in Burkina Faso, Kenya and Lagos, with little difference by sociodemographic characteristics. Women's COVID-19-related economic vulnerability was unrelated to unintended pregnancy across sites.

CONCLUSIONS

This study highlights the resilience of African women across diverse settings in sustaining contraceptive practices amid the COVID-19 pandemic. However, with reports of rising poverty in sub-Saharan Africa, there is continued need to monitor access to essential sexual and reproductive health services.

Social media use and COVID-19 vaccine status among a nationally representative population sample in Uganda

Objectives

The effect of social media on COVID-19 vaccination behavior is sub-Saharan Africa is unclear. We conducted a study to determine social media use among a random nationally representative sample of adults in Uganda and assessed the association between recent social media use and COVID-19 vaccination uptake.

Methods

We used data from the 2020 general population survey in Uganda, the Population-based HIV Impact Assessment Survey, to identify a probability sample for a mobile phone survey and included nonphone owners in the phone survey by asking phone owners to pass the phone.

Results

In March 2022, of the 1022 survey participants, 213 (20%) did not own a mobile phone, 842 (80%) owned a mobile phone, of whom 199 (24%) indicated social media use, and 643 (76%) of whom did not use social media. Among all participants, the most frequent source of COVID-19 vaccine information was radio. Overall, 62% reported receiving the COVID-19 vaccination. The multivariable logistic regression model found that social media use was not associated with vaccination status.

Conclusion

Social media users in this population sample from Uganda-who were mainly young, urban residents with higher educational attainment-continue to utilize TV, radio and health care workers for public health messages, thus the Government of Uganda should continue to conduct public health communication through these mediums.

Social consequences of COVID-19 on fertility preference consistency and contraceptive use among Nigerian women: insights from population-based data

BACKGROUND

Emerging evidence from high income countries showed that the COVID-19 pandemic has had negative effects on population and reproductive health behaviour. This study provides a sub-Saharan Africa perspective by documenting the social consequences of COVID-19 and its relationship to fertility preference stability and modern contraceptive use in Nigeria.

METHOD

We analysed panel data collected by Performance Monitoring for Action in Nigeria. Baseline and Follow-up surveys were conducted before the COVID-19 outbreak (November 2019-February 2020) and during the lockdown respectively (May-July 2020). Analysis was restricted to married non-pregnant women during follow-up (n = 774). Descriptive statistics and generalized linear models were employed to explore the relationship between selected social consequences of COVID-19 and fertility preferences stability (between baseline and follow-up) as well as modern contraceptives use.

RESULTS

Reported social consequences of the pandemic lockdown include total loss of household income (31.3%), food insecurity (16.5%), and greater economic reliance on partner (43.0%). Sixty-eight women (8.8%) changed their minds about pregnancy and this was associated with age groups, higher wealth quintile (AOR = 0.38, CI: 0.15-0.97) and household food insecurity (AOR = 2.72, CI: 1.23-5.99). Fertility preference was inconsistent among 26.1%. Women aged 30-34 years (AOR = 4.46, CI:1.29-15.39) were more likely of inconsistent fertility preference compared to 15-24 years. The likelihood was also higher among women with three children compared to those with only one child (AOR = 3.88, CI: 1.36-11.08). During follow-up survey, 59.4% reported they would feel unhappy if pregnant. This was more common among women with tertiary education (AOR = 2.99, CI: 1.41-6.33). The odds increased with parity. The prevalence of modern contraceptive use was 32.8%. Women aged 45-49 years (AOR = 0.24, CI: 0.10-0.56) were less likely to use modern contraceptives than those aged 15-24 years. In contrast, the odds of contraceptive use were significantly higher among those with three (AOR = 1.82, CI: 1.03-3.20), four (AOR = 2.45, CI: 1.36-4.39) and at least five (AOR = 2.89, CI: 1.25-6.74) children. Unhappy disposition towards pregnancy (AOR = 2.48, CI: 1.724-3.58) was also a significant predictor of modern contraceptive use.

CONCLUSION

Some social consequences of COVID-19 affected pregnancy intention and stability of fertility preference but showed no independent association with modern contraceptive use.

Change in childbearing intention, use of contraception, unwanted pregnancies, and related adverse events during the COVID-19 pandemic: Results from a panel study in rural Burkina Faso

Evidence on how the COVID-19 pandemic has affected women's reproductive health remains scarce, particularly for low- and middle-income countries. Deleterious indirect effects seem likely, particularly on access to contraception and risk of unwanted pregnancies, but rigorous evaluations using quasi-experimental designs are lacking. Taking a diachronic perspective, we aimed to investigate the effects of the pandemic on four indicators of women's reproductive health: history of recent adverse events during pregnancy (past), use of contraception and unwanted pregnancies (present), and childbearing intentions (future). This study was conducted in four rural health districts of Burkina Faso: Banfora, Leo, Sindou and Tenado. Two rounds of household surveys (before and during the pandemic) were conducted in a panel of 696 households using standardized questionnaires. The households were selected using a stratified two-stage random sampling method. All women aged 15-49 years living in the household were eligible for the study. The same households were visited twice, in February 2020 and February 2021. The effects were estimated by fitting hierarchical regression models with fixed effects or random intercepts at the individual level. A total of 814 and 597 women reported being sexually active before and during the COVID-19 pandemic, respectively. The odds of not wanting (any more) children were two times higher during the pandemic than before (2.0, 95% CI [1.32-3.04]). Among those with childbearing intention, the average desired delay until the next pregnancy increased from 28.7 to 32.8 months. When comparing 2021 versus 2020, there was an increase in the adjusted odds ratio of contraception use (1.23, 95% CI [1.08-1.40]), unwanted pregnancies (2.07, 95% CI [1.01-4.25]), and self-reported history of miscarriages, abortions, or stillbirths in the previous 12 months (2.4, 95% CI [1.04-5.43]). Our findings in rural Burkina Faso do not support the predicted detrimental effects of COVID-19 on the use of family planning services in LMICs, but confirm that it negatively affects pregnancy intentions. Use of contraception increased significantly among women in the panel, but arguably not enough to avoid an increase in unwanted pregnancies.

Contraceptive dynamics during COVID-19 in sub-Saharan Africa: longitudinal evidence from Burkina Faso and Kenya

INTRODUCTION

Evidence from health emergencies suggests COVID-19 will disrupt women's sexual and reproductive health (SRH). In sub-Saharan Africa, which experiences the highest rates of unintended pregnancy and unsafe abortion globally, COVID-19 is projected to slow recent progress toward universal access to contraceptive services.

METHODS

We used longitudinal data collected from women at risk of unintended pregnancy in Burkina Faso (n=1186) and Kenya (n=2784) before (November 2019-February 2020) and during (May-July 2020) COVID-19 to quantify contraceptive dynamics during COVID-19; examine sociodemographic factors and COVID-19 experiences related to contraceptive dynamics; and assess COVID-19-related reasons for contraceptive non-use. Bivariate and multivariate logistic regressions were used to examine correlates of contraceptive dynamics amid COVID-19.

RESULTS

Most women did not change their contraceptive status during COVID-19 (68.6% in Burkina Faso and 81.6% in Kenya) and those who did were more likely to adopt a method (25.4% and 13.1%, respectively) than to discontinue (6.0% and 5.3%, respectively). Most women who switched contraceptives were using methods as or more effective than their pre-pandemic contraception. Economic instability related to COVID-19 was associated with increased contraceptive protection in Burkina Faso but not in Kenya. Altogether, 14.4% of non-contraceptive users in Kenya and 3.8% in Burkina Faso identified COVID-19-related reasons for non-use.

CONCLUSIONS

The vast majority of women at risk of unintended pregnancy did not change their contraceptive status during COVID-19, and more women adopted than discontinued methods. A minority of women reported COVID-19-related reasons for non-use, underscoring the importance of expanding safe modes of service delivery during health crises.

Examining the recent trends in adolescent sexual and reproductive health in five countries of sub-Saharan Africa based on PMA and DHS household surveys

Background

The annual collection of fertility, marriage, sexual behaviour, and contraceptive use data in the nationally representative rounds of Performance Monitoring and Accountability (PMA) surveys in sub-Saharan Africa may contribute to the periodic monitoring of adolescent sexual and reproductive health (ASRH). However, we need to understand the reliability of these data in monitoring the ASRH indicators. We assessed the internal and external consistencies in ASRH indicators in five countries.

Methods

We included countries with at least three nationally representative rounds of PMA surveys and two recent DHS: Ethiopia, Ghana, Kenya, Nigeria, and Uganda. Our analysis focused on four current status indicators of ASRH among girls 15–19 years: ever had sex, currently married, has given birth or currently pregnant, and currently using modern contraceptives among sexually active unmarried girls. We compared the PMA survey and DHS data and tested for statistical significance and assessed trends over time using Jonckheere-Terpstra test statistic.

Results

PMA and DHS survey methodologies were similar and, where there were differences, these were shown to have minimal impact on the indicator values. The comparison of the data points from PMA and DHS for the same years showed statistically significant differences in 12 of the 20 comparisons, which was most common for sexual behaviour (4/5) and least for contraceptive use (2/5). This is partly due to larger confidence intervals in both surveys. The time trends were consistent between the annual PMA surveys in most instances in Ethiopia, Kenya, and Nigeria but less so for Ghana and Uganda. However, both surveys highlight slow progress in adolescent and reproductive health indicators with major disparities between the countries.

Conclusions

Despite the differences between PMA 2020 surveys and DHS surveys conducted in the same year, and inconsistencies of the PMA survey time series for several indicators in some countries, we found no systematic issues with PMA surveys and consider PMA surveys a valuable data source for the assessment of levels and trends of ASRH beyond contraceptive use and family planning for indicators of fertility, marriage, and sex among adolescent girls in sub-Saharan Africa.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12978-021-01111-0.

Need for and use of contraception by women before and during COVID-19 in four sub-Saharan African geographies: results from population-based national or regional cohort surveys

Background

Although hindrances to the sexual and reproductive health of women are expected because of COVID-19, the actual effect of the pandemic on contraceptive use and unintended pregnancy risk in women, particularly in sub-Saharan Africa, remains largely unknown. We aimed to examine population-level changes in the need for and use of contraception by women during the COVID-19 pandemic, determine if these changes differed by sociodemographic characteristics, and compare observed changes during the COVID-19 pandemic with trends in the 2 preceding years.

Methods

In this study, we used four rounds of Performance Monitoring for Action (PMA) population-based survey data collected in four geographies: two at the country level (Burkina Faso and Kenya) and two at the subnational level (Kinshasa, Democratic Republic of the Congo and Lagos, Nigeria). These geographies were selected for this study as they completed surveys immediately before the onset of COVID-19 and implemented a follow-up specific to COVID-19. The first round comprised the baseline PMA panel survey implemented between November, 2019, and February, 2020 (referred to as baseline). The second round comprised telephone-based follow-up surveys between May 28 and July 20, 2020 (referred to as COVID-19 follow-up). The third and fourth rounds comprised two previous cross-sectional survey rounds implemented in the same geographies between 2017 and 2019.

Findings

Our analyses were restricted to 7245 women in union (married or living with a partner, as if married) who were interviewed at baseline and COVID-19 follow-up. The proportion of women in need of contraception significantly increased in Lagos only, by 5·81 percentage points (from 74·5% to 80·3%). Contraceptive use among women in need increased significantly in the two rural geographies, with a 17·37 percentage point increase in rural Burkina Faso (30·7% to 48·1%) and a 7·35 percentage point increase in rural Kenya (71·6% to 78·9%). These overall trends mask several distinct patterns by sociodemographic group. Specifically, there was an increase in the need for contraception among nulliparous women across all geographies investigated.

Interpretation

Our findings do not support the anticipated deleterious effect of COVID-19 on access to and use of contraceptive services by women in the earliest stages of the pandemic. Although these results are largely encouraging, we warn that these trends might not be sustainable throughout prolonged economic hardship and service disruptions.

Funding

Bill & Melinda Gates Foundation.

Translation

For the French translation of the abstract see Supplementary Materials section.