Development of a Phone Survey Tool to Measure Respectful Maternity Care During Pregnancy and Childbirth in India: Study Protocol

Translating the consent form is the tip of the iceberg: using cognitive interviews to assess the barriers to informed consent in South African health facilities

The increasing digitisation of personal health data has led to an increase in the demand for onward health data. This study sought to develop local language scripts for use in public sector maternity clinics to capture informed consent for onward health data use. The script considered five possible health data uses: 1. Sending of general health information content via mobile phones; 2. Delivery of personalised health information via mobile phones; 3. Use of women's anonymised health data; 4. Use of child's anonymised health data; and 5. Use of data for recontact. Qualitative interviews (n = 54) were conducted among women attending maternity services in three public health facilities in Gauteng and Western Cape, South Africa. Using cognitive interviewing techniques, interviews sought to:(1) explore understanding of the consent script in five South African languages, (2) assess women's understanding of what they were consenting to, and (3) improve the consent script. Multiple rounds of interviews were conducted, each followed by revisions to the consent script, until saturation was reached, and no additional cognitive failures identified. Cognitive failures were a result of: (1) words and phrases that did not translate easily in some languages, (2) cognitive mismatches that arose as a result of different world views and contexts, (3) linguistic gaps, and (4) asymmetrical power relations that influence how consent is understood and interpreted. Study activities resulted in the development of an informed consent script for onward health data use in five South African languages for use in maternity clinics.

To call or not to call: exploring the validity of telephone interviews to derive maternal self-reports of experiences with facility childbirth care in northern Nigeria

Background

To institutionalise respectful maternity care, frequent data on the experience of childbirth care is needed by health facility staff and managers. Telephone interviews have been proposed as a low-cost alternative to derive timely and actionable maternal self-reports of experience of care. However, evidence on the validity of telephone interviews for this purpose is limited.

Methods

Eight indicators of positive maternity care experience and 18 indicators of negative maternity care experience were investigated. We compared the responses from exit interviews with women about their childbirth care experience (reference standard) to follow-up telephone interviews with the same women 14 months after childbirth. We calculated individual-level validity metrics including, agreement, sensitivity, specificity, area under the receiver operating characteristic curve (AUC). We compared the characteristics of women included in the telephone follow-up interviews to those from the exit interviews.

Results

Demographic characteristics were similar between the original exit interview group (n=388) and those subsequently reached for telephone interview (n=294). Seven of the eight positive maternity care experience indicators had reported prevalence higher than 50% at both exit and telephone interviews. For these indicators, agreement between the exit and the telephone interviews ranged between 50% and 92%; seven positive indicators met the criteria for validation analysis, but all had an AUC below 0.6. Reported prevalence for 15 of the 18 negative maternity care experience indicators was lower than 5% at exit and telephone interviews. For these 15 indicators, agreement between exit and telephone interview was high at over 80%. Just three negative indicators met the criteria for validation analysis, and all had an AUC below 0.6.

Conclusions

The telephone interviews conducted 14 months after childbirth did not yield results that were consistent with exit interviews conducted at the time of facility discharge. Women’s reports of experience of childbirth care may be influenced by the location of reporting or changes in the recall of experiences of care over time.

Assessing the reliability of phone surveys to measure reproductive, maternal and child health knowledge among pregnant women in rural India: a feasibility study

OBJECTIVES

Efforts to understand the factors influencing the uptake of reproductive, maternal, newborn, child health and nutrition (RMNCH&N) services in high disease burden low-resource settings have often focused on face-to-face surveys or direct observations of service delivery. Increasing access to mobile phones has led to growing interest in phone surveys as a rapid, low-cost alternatives to face-to-face surveys. We assess determinants of RMNCH&N knowledge among pregnant women with access to phones and examine the reliability of alternative modalities of survey delivery.

PARTICIPANTS

Women 5-7 months pregnant with access to a phone.

SETTING

Four districts of Madhya Pradesh, India.

DESIGN

Cross-sectional surveys administered face-to-face and within 2 weeks, the same surveys were repeated among two random subsamples of the original sample: face-to-face (n=205) and caller-attended telephone interviews (n=375). Bivariate analyses, multivariable linear regression, and prevalence and bias-adjusted kappa scores are presented.

RESULTS

Knowledge scores were low across domains: 52% for maternal nutrition and pregnancy danger signs, 58% for family planning, 47% for essential newborn care, 56% infant and young child feeding, and 58% for infant and young child care. Higher knowledge (≥1 composite score) was associated with older age; higher levels of education and literacy; living in a nuclear family; primary health decision-making; greater attendance in antenatal care and satisfaction with accredited social health activist services. Survey questions had low inter-rater and intermodal reliability (kappa<0.70) with a few exceptions. Questions with the lowest reliability included true/false questions and those with unprompted, multiple response options. Reliability may have been hampered by the sensitivity of the content, lack of privacy, enumerators' and respondents' profile differences, rapport, social desirability bias, and/or enumerator's ability to adequately convey concepts or probe.

CONCLUSIONS

Phone surveys are a reliable modality for generating population-level estimates data about pregnant women's knowledge, however, should not be used for individual-level tracking.

TRIAL REGISTRATION NUMBER

NCT03576157.

Evaluation of a community-based mobile video breastfeeding intervention in Khayelitsha, South Africa: The Philani MOVIE cluster-randomized controlled trial

BACKGROUND

In South Africa, breastfeeding promotion is a national health priority. Regular perinatal home visits by community health workers (CHWs) have helped promote exclusive breastfeeding (EBF) in underresourced settings. Innovative, digital approaches including mobile video content have also shown promise, especially as access to mobile technology increases among CHWs. We measured the effects of an animated, mobile video series, the Philani MObile Video Intervention for Exclusive breastfeeding (MOVIE), delivered by a cadre of CHWs ("mentor mothers").

METHODS AND FINDINGS

We conducted a stratified, cluster-randomized controlled trial from November 2018 to March 2020 in Khayelitsha, South Africa. The trial was conducted in collaboration with the Philani Maternal Child Health and Nutrition Trust, a nongovernmental community health organization. We quantified the effect of the MOVIE intervention on EBF at 1 and 5 months (primary outcomes), and on other infant feeding practices and maternal knowledge (secondary outcomes). We randomized 1,502 pregnant women in 84 clusters 1:1 to 2 study arms. Participants' median age was 26 years, 36.9% had completed secondary school, and 18.3% were employed. Mentor mothers in the video intervention arm provided standard-of-care counseling plus the MOVIE intervention; mentor mothers in the control arm provided standard of care only. Within the causal impact evaluation, we nested a mixed-methods performance evaluation measuring mentor mothers' time use and eliciting their subjective experiences through in-depth interviews. At both points of follow-up, we observed no statistically significant differences between the video intervention and the control arm with regard to EBF rates and other infant feeding practices [EBF in the last 24 hours at 1 month: RR 0.93 (95% CI 0.86 to 1.01, P = 0.091); EBF in the last 24 hours at 5 months: RR 0.90 (95% CI 0.77 to 1.04, P = 0.152)]. We observed a small, but significant improvement in maternal knowledge at the 1-month follow-up, but not at the 5-month follow-up. The interpretation of the results from this causal impact evaluation changes when we consider the results of the nested mixed-methods performance evaluation. The mean time spent per home visit was similar across study arms, but the intervention group spent approximately 40% of their visit time viewing videos. The absence of difference in effects on primary and secondary endpoints implies that, for the same time investment, the video intervention was as effective as face-to-face counseling with a mentor mother. The videos were also highly valued by mentor mothers and participants. Study limitations include a high loss to follow-up at 5 months after premature termination of the trial due to the COVID-19 pandemic and changes in mentor mother service demarcations.

CONCLUSIONS

This trial measured the effect of a video-based, mobile health (mHealth) intervention, delivered by CHWs during home visits in an underresourced setting. The videos replaced about two-fifths of CHWs' direct engagement time with participants in the intervention arm. The similar outcomes in the 2 study arms thus suggest that the videos were as effective as face-to-face counselling, when CHWs used them to replace a portion of that counselling. Where CHWs are scarce, mHealth video interventions could be a feasible and practical solution, supporting the delivery and scaling of community health promotion services.

TRIAL REGISTRATION

The study and its outcomes were registered at clinicaltrials.gov (#NCT03688217) on September 27, 2018.

Does women's mobile phone ownership matter for health? Evidence from 15 countries

Mobile phones have the potential to increase access to health information, improve patient-provider communication, and influence the content and quality of health services received. Evidence on the gender gap in ownership of mobile phones is limited, and efforts to link phone ownership among women to care-seeking and practices for reproductive maternal newborn and child health (RMNCH) have yet to be made. This analysis aims to assess household and women's access to phones and its effects on RMNCH health outcomes in 15 countries for which Demographic and Health Surveys data on phone ownership are available. Multilevel logistic regression models were used to explore factors associated with women's phone ownership, along with the association of phone ownership to a wide range of RMNCH indicators. Study findings suggest that (1) gender gaps in mobile phone ownership vary, but they can be substantial, with less than half of women owning mobile phones in several countries; (2) the gender gap in phone ownership is larger for rural and poorer women; (3) women's phone ownership is generally associated with better RMNCH indicators; (4) among women phone owners, utilisation of RMNCH care-seeking and practices differs based on their income status; and (5) more could be done to unleash the potential of mobile phones on women's health if data gaps and varied metrics are addressed. Findings reinforce the notion that without addressing the gender gap in phone ownership, digital health programmes may be at risk of worsening existing health inequities.

Novel approaches to measuring knowledge among frontline health workers in India: Are phone surveys a reliable option?

Background

In 2017, India was home to nearly 20% of maternal and child deaths occurring globally. Accredited social health activists (ASHAs) act as the frontline for health services delivery in India, providing a range of reproductive, maternal, newborn, child health, and nutrition (RMNCH&N) services. Empirical evidence on ASHAs’ knowledge is limited, yet is a critical determinant of the quality of health services provided. We assessed the determinants of RMNCH&N knowledge among ASHAs and examined the reliability of alternative modalities of survey delivery, including face-to-face and caller attended telephone interviews (phone surveys) in 4 districts of Madhya Pradesh, India.

Methods

We carried out face-to-face surveys among a random cross-sectional sample of ASHAs (n = 1,552), and administered a follow-up test-retest survey within 2 weeks of the initial survey to a subsample of ASHAs (n = 173). We interviewed a separate sub-sample of ASHAs 2 weeks of the face-to-face interview over the phone (n = 155). Analyses included bivariate analyses, multivariable linear regression, and prevalence and bias adjusted kappa analyses.

Findings

The average ASHA knowledge score was 64% and ranged across sub-domains from 71% for essential newborn care, 71% for WASH/ diarrhea, 64% for infant feeding, 61% for family planning, and 60% for maternal health. Leading determinants of knowledge included geographic location, age <30 years of age, education, experience as an ASHA, completion of seven or more client visits weekly, phone ownership and use as a communication tool for work, as well as the ability to navigate interactive voice response prompts (a measure of digital literacy). Efforts to develop a phone survey tool for measuring knowledge suggest that findings on inter-rater and inter-modal reliability were similar. Reliability was higher for shorter, widely known questions, including those about timing of exclusive breastfeeding or number of tetanus shots during pregnancy. Questions with lower reliability included those on sensitive topics such as family planning; questions with multiple response options; or which were difficult for the enumerator to convey.

Conclusions

Overall results highlight important gaps in the knowledge of ASHAs. Findings on the reliability of phone surveys led to the development of a tool, which can be widely used for the routine, low cost measurement of ASHA RMNCH&N knowledge in India.