The feasibility and acceptability of using the Mother-Generated Index (MGI) as a Patient Reported Outcome Measure in a randomised controlled trial of maternity care

A community evaluation of post-partum quality of life using a locally adapted mother-generated-index: the Delhi Delivery Care (DELCARE) Survey (2009-2011)

Post-partum quality of life is an inadequately studied and poorly understood outcome of delivery care, especially in low- and middle-income countries. Hence, we evaluated the postpartum quality of life and its clinic-demographic context as part of a 3-stage cluster randomized community survey (DECLARE; covered quality of care as primary outcome) conducted in 2009-2011 in Delhi. In stage 1 of participant selection(sampling), 20 wards (of 150; geographically defined administrative units) were selected using a probability-proportionate-to-size systematic method. In stage 2, one from each income stratum (high, middle, and low; multiple colonies within each ward) was selected from each ward by simple random sampling (total 60 colonies of 2311). In stage 3, a house-to-house survey was conducted to recruit ~1800 recently delivered women for the multidimensional work, which included quality-of-care, cost-of-care, and PPQOL. Among the participants, those with high school or above education were invited to administer the Mother-Generated Index and calculate the primary and secondary index scores (PIS and SIS). A total of 794 (of 857 eligible; 118846 households) women were administered MGI. The mean PIS was 4.6[95 percent CI 4.4-4.7] while the average SIS was 4.0[95 percent CI 3.8-4.2]. The PIS was worse for primiparous vs. multiparous mothers. On multivariate analysis, poorer psychological state, obstetric complications, and premature delivery correlated with poorer QOL scores, while better gestational weight gain, higher age, and labor-pain relief correlated with better QOL scores. The study benchmarks the poor status of post-partum quality-of-life and documents the spectrum, severity, and complexity of its key social, psychological, physical, and demographic determinants.

Introducing the participant-generated experience and satisfaction (PaGES) index: a novel, longitudinal mixed-methods evaluation tool

BACKGROUND

Patient-Reported Outcomes or Experience Measures (PROMS / PREMS) are routinely used in clinical studies to assess participants' views and experiences of trial interventions and related quality of life. Purely quantitative approaches lack the necessary detail and flexibility to understand the real-world impact of study interventions on participants, according to their own priorities. Conversely, purely qualitative assessments are time consuming and usually restricted to a small, possibly unrepresentative, sub-sample. This paper, which reports a pilot study within a randomised controlled trial of induction of labour, reports the feasibility, and acceptability of the Participant-Generated Experience and Satisfaction (PaGES) Index, a new mixed qualitative / quantitative PREM tool.

METHODS

The single-sheet PaGES Index was completed by hypertensive pregnant women in two hospitals in Nagpur, India before and after taking part in the 'Misoprostol or Oxytocin for Labour Induction' (MOLI) randomised controlled trial. Participants recorded aspects of the impending birth they considered most important, and then ranked them. After the birth, participants completed the PaGES Index again, this time also scoring their satisfaction with each item. Forms were completed on paper in the local language or in English, supported by Research Assistants. Following translation (when needed), responses were uploaded to a REDCap database, coded in Excel and analysed thematically. A formal qualitative evaluation (qMOLI) was also conducted to obtain stakeholder perspectives of the PaGES Index and the wider trial. Semi-structured interviews were conducted with participants, and focus groups with researchers and clinicians. Data were managed using NVivo 12 software and analysed using the framework approach.

RESULTS

Participants and researchers found the PaGES Index easy to complete and administer; mothers valued the opportunity to speak about their experience. Qualitative analysis of the initial 68 PaGES Index responses identified areas of commonality and difference among participants and also when comparing antenatal and postnatal responses. Theme citations and associated comments scores were fairly stable before and after the birth. The qMOLI phase, comprising 53 one-to-one interviews with participants and eight focus groups involving 83 researchers and clinicians, provided support that the PaGES Index was an acceptable and even helpful means of capturing participant perspectives.

CONCLUSIONS

Subjective participant experiences are an important aspect of clinical trials. The PaGES Index was found to be a feasible and acceptable measure that unites qualitative research's explanatory power with the comparative power of quantitative designs. It also offers the opportunity to conduct a before-and-after evaluation, allowing researchers to examine the expectations and actual experiences of all clinical trial participants, not just a small sub-sample. This study also shows that, with appropriate research assistant input, the PaGES Index can be used in different languages by participants with varying literacy levels.

TRIAL REGISTRATION

Clinical Trials.gov (21/11/2018) (NCT03749902).

Assessing quality of care in maternity services in low and middle-income countries: Development of a Maternity Patient Reported Outcome Measure

Globally, low and middle-income countries bear the greatest burden of maternal and newborn mortality. To reduce these high levels, the quality of care provided needs to be improved. This study aimed to develop a patient reported outcome measure for use in maternity services in low and middle-income countries, to facilitate improvements in quality of care. Semi-structured interviews and focus groups discussions were conducted with women who had recently given birth in selected healthcare facilities in Malawi and Kenya. Transcripts of these were analysed using a thematic approach and analytic codes applied. Draft outcomes were identified from the data, which were reviewed by a group of clinical experts and developed into a working copy of the Maternity Patient Reported Outcome Measure (MPROM). A further sample of new mothers were asked to evaluate the draft MPROM during cognitive debriefing interviews, and their views used to revise it to produce the final proposed measure. Eighty-three women were interviewed, and 44 women took part in 10 focus group discussions. An array of outcomes was identified from the data which were categorised under the domains of physical and psychological symptoms, social issues, and baby-related health outcomes. The draft outcomes were configured into 79 questions with answers provided using a five-point Likert scale. Minor revisions were made following cognitive debriefing interviews with nine women, to produce the final proposed MPROM. In conjunction with women from the target population and clinical experts, this study has developed what is believed to be the first condition-specific PROM suitable for assessing care quality in maternity services in low and middle-income countries. Following further validation studies, it is anticipated that this will be a useful tool in facilitating improvements in the quality of care provided to women giving birth in healthcare facilities in these settings.

Evaluating the development, woman-centricity and psychometric properties of maternity patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs): A systematic review protocol

INTRODUCTION

Woman-centred care is the right of every woman receiving maternity care, irrespective of where care is being received and who is providing care. This protocol describes a planned systematic review that will identify, describe and critically appraise the psychometric properties of maternity patient-reported outcome measures (PROMs) and patient-reported experience measures (PREMs). The woman-centricity of PROM and PREM development and content validation (ie, the extent to which women were involved in these processes) will also be assessed. This information will be used to develop a maternity PROMs and PREMs database to support service and system performance measurement, and value-based maternity care initiatives.

METHODS AND ANALYSIS

This study will be guided by the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) guideline for systematic reviews of outcome measurement instruments. Studies identified via MEDLINE, CINAHL Plus, PsycINFO and EMBASE describing the development, content validation and/or psychometric evaluation of PROMs and PREMs specifically designed for maternity populations throughout pregnancy, childbirth and postnatal periods will be considered if published from 2010 onward, in English, and available in full text. The COSMIN risk of bias checklist will be used to evaluate the quality of studies reporting on the development, content validation and/or psychometric evaluation of PROMs and PREMs. COSMIN criteria for good content validity will be used to assess the woman-centricity of PROM and PREM development and content validation studies. COSMIN standards of good psychometric properties will be used to evaluate the validity and reliability of the identified instruments.

ETHICS AND DISSEMINATION

Ethical permission for this research is not required. The findings of this research will be submitted for publication in an international, peer-reviewed journal. Abstracts for national and international conference presentations will also be submitted. The proposed maternity PROMs and PREMs database will be freely accessible online, and developed with consumer input to ensure its usefulness to a range of maternity care stakeholders.

PROSPERO REGISTRATION NUMBER

CRD42021288854.

Oral Misoprostol alone versus oral misoprostol followed by oxytocin for labour induction in women with hypertension in pregnancy (MOLI): protocol for a randomised controlled trial

BACKGROUND

Every year approximately 30,000 women die from hypertensive disease in pregnancy. Magnesium sulphate and anti-hypertensives reduce morbidity, but delivery is the only cure. Low dose oral misoprostol, a prostaglandin E1 analogue, is a highly effective method for labour induction. Usually, once active labour has commenced, the misoprostol is replaced with an intravenous oxytocin infusion if ongoing stimulation is required. However, some studies have shown that oral misoprostol can be continued into active labour, a simpler and potentially more acceptable protocol for women. To date, these two protocols have never been directly compared.

METHODS

This pragmatic, open-label, randomised trial will compare a misoprostol alone labour induction protocol with the standard misoprostol plus oxytocin protocol in three Indian hospitals. The study will recruit 520 pregnant women being induced for hypertensive disease in pregnancy and requiring augmentation after membrane rupture. Participants will be randomised to receive either further oral misoprostol 25mcg every 2 h, or titrated intravenous oxytocin. The primary outcome will be caesarean birth. Secondary outcomes will assess the efficacy of the induction process, maternal and fetal/neonatal complications and patient acceptability. This protocol (version 1.04) adheres to the SPIRIT checklist. A cost-effectiveness analysis, situational analysis and formal qualitative assessment of women's experience are also planned.

DISCUSSION

Avoiding oxytocin and continuing low dose misoprostol into active labour may have a number of benefits for both women and the health care system. Misoprostol is heat stable, oral medication and thus easy to store, transport and administer; qualities particularly desirable in low resource settings. An oral medication protocol requires less equipment (e.g. electronic infusion pumps) and may free up health care providers to assist with other aspects of the woman's care. The simplicity of the protocol may also help to reduce human errors associated with the delivery of intravenous infusions. Finally, women may prefer to be mobile during labour and not restricted by an intravenous infusion. There is a need, therefore, to assess whether augmentation using oral misoprostol is superior clinically and economically to the standard protocol of intravenous oxytocin.

TRIAL REGISTRATION

Clinical Trials.gov, NCT03749902 , registered on 21^st Nov 2018.

A qualitative study on professionals' attitudes and views towards the introduction of patient reported measures into public maternity care pathway

Background

The importance and potential benefits of introducing patient reported measures (PRMs) into health care service have been widely acknowledged, yet the experience regarding their implementation into practice is limited. There is a considerable paucity of research in adopting PRMs in maternity care routine. This study, which utilizes the PRMs included in Pregnancy and Childbirth (PCB) outcome set developed by International Consortium for Health Outcomes Measurement (ICHOM) as sample measures, aims to elicit Finnish professionals’ views on PRMs and to explore the applicability of PRMs in Finnish public maternity care.

Methods

This qualitative study, applying semi-structured interviews, described the local professionals’ views towards the application of PRMs in Finnish public maternity care. Professionals were asked to assess the PRMs defined in ICHOM PCB set and provide their expectations and concerns on the implementation of PRMs in Finnish public maternity service.

Results

Twenty professionals participated in the interviews. Participants agreed on the importance and relevance of the PRMs questions included in ICHOM PCB set for delivering and developing maternity care in Finland. However, they criticized the number and length of questions as well as the recommended time points of data collection. In addition, for a successful implementation, various steps like developing suitable questions, redesigning service pathway and protocols, and motivating women to respond to PRMs questions were considered to be important. Also, some potential obstacles, difficulties and risks associated with the implementation were underlined.

Conclusion

This study indicates that the implementation of PRMs into Finnish public maternity service is possible, highly relevant and important. However, the adoption of PRMs into routine practice may be challenging and will require a series of efforts. This study shows viewpoints from Finnish professionals who have not participated in developing the ICHOM PCB standard set and provides important insights on the development and implementation of PRMs.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06658-z.

Use of Patient-Reported Outcome Measures to Assess Outpatient Postpartum Recovery: A Systematic Review

IMPORTANCE

Outpatient postpartum recovery is an underexplored area of obstetrics. There is currently no consensus regarding which patient-reported outcome measure (PROM) clinicians and researchers should use to evaluate postpartum recovery.

OBJECTIVE

To evaluate PROMs of outpatient postpartum recovery using Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) guidelines.

EVIDENCE REVIEW

An initial literature search performed in July 2019 identified postpartum recovery PROMs and validation studies. A secondary search in July 2020 identified additional validation studies. Both searches were performed using 4 databases (Web of Science, Embase, PubMed, and CINAHL), with no date limiters. Studies with PROMs evaluating more than 3 proposed outpatient postpartum recovery domains were considered. Studies were included if they assessed any psychometric measurement property of the included PROMs in the outpatient postpartum setting. The PROMs were assessed for the following 8 psychometric measurement properties, as defined by COSMIN: content validity, structural validity, internal consistency, cross-cultural validity and measurement invariance, reliability, measurement error, hypothesis testing, and responsiveness. Psychometric measurement properties were evaluated in each included study using the COSMIN criteria by assessing (1) the quality of the methods (very good, adequate, doubtful, inadequate, or not assessed); (2) overall rating of results (sufficient, insufficient, inconsistent, or indeterminate); (3) level of evidence assessed using the Grading of Recommendations, Assessment, Development and Evaluations assessment tool; and (4) level of recommendation, which included class A (recommended for use; showed adequate content validity with at least low-quality evidence for sufficient internal consistency), class B (not class A or class C), or class C (not recommended).

FINDINGS

In total, 15 PROMs (7 obstetric specific and 8 non-obstetric specific) were identified, evaluating outpatient postpartum recovery in 46 studies involving 19 165 women. The majority of psychometric measurement properties of the included PROMs were graded as having very-low-level or low-level evidence. The best-performing PROMs that received class A recommendations were the Maternal Concerns Questionnaire, the Postpartum Quality of Life tool, and the World Health Organization Quality of Life-BREF. The remainder of the evaluated PROMs had insufficient evidence to make recommendations regarding their use (and received class B recommendations).

CONCLUSIONS AND RELEVANCE

This review found that the best-performing PROMs currently available to evaluate outpatient postpartum recovery were the Maternal Concerns Questionnaire, the Postpartum Quality of Life tool, and the World Health Organization Quality of Life-BREF; however, these tools all had significant limitations. This study highlights the need to focus future efforts on robustly developing and validating a new PROM that may comprehensively evaluate outpatient postpartum recovery.

Evaluation of Domains of Patient-Reported Outcome Measures for Recovery After Childbirth: A Scoping and Systematic Review

IMPORTANCE

Despite the global delivery rate being approximately 259 deliveries per minute in 2018, postpartum recovery remains poorly defined.

OBJECTIVES

To identify validated patient-reported outcome measures (PROMs) used to assess outpatient and inpatient postpartum recovery, evaluate frequency of PROM use, report the proportion of identified PROMs used within each recovery domain, report the number of published studies within each recovery domain, summarize descriptive data (country of origin, year of study, and journal specialty) for published studies using PROMs to evaluate postpartum recovery, and report PROMs used to evaluate global postpartum recovery.

EVIDENCE REVIEW

This study followed PRISMA-ScR guidelines. A literature search of 4 databases (MEDLINE through PubMed, Embase, Web of Science, and CINAHL) was performed on July 1, 2019, to identify PROMs used to evaluate 12 author-defined domains of postpartum recovery. All psychometrically evaluated PROMs used to evaluate inpatient or outpatient postpartum recovery after all delivery modes were included.

FINDINGS

From 8008 screened titles and abstracts, 573 studies (515 outpatient and 58 inpatient) were identified in this review. A total of 201 PROMs were used to assess recovery for outpatient studies and 73 PROMs were used to assess recovery for inpatient studies. The top 5 domains (with highest to lowest numbers of PROMs) used to assess outpatient recovery were psychosocial distress (77 PROMs), surgical complications (26 PROMs), psychosocial support (27 PROMs), motherhood experience (16 PROMs), and sexual function (13 PROMs). Among inpatient studies, the top 5 domains were psychosocial distress (32 PROMs), motherhood experience (7 PROMs), psychosocial support (5 PROMs), fatigue (5 PROMs), and cognition (3 PROMs). The 3 most frequently used PROMs were the Edinburgh Postnatal Depression Scale (267 studies), Short-Form 36 Health Questionnaire (global recovery assessment; 40 studies), and Female Sexual Function Index (35 studies). A total of 24 global recovery PROMs were identified among all included studies. Most studies were undertaken in the United States within the last decade and were published in psychiatry and obstetrics and gynecology journals.

CONCLUSIONS AND RELEVANCE

Most PROMs identified in this review evaluated a single domain of recovery. Future research should focus on determining the psychometric properties of individual and global recovery PROMs identified in this review to provide recommendations regarding optimum measures of postpartum recovery.

The clinical consequences of variable selection in multiple regression models: a case study of the Norwegian Opioid Maintenance Treatment program

Background: Selecting which variables to include in multiple regression models is a pervasive problem in medical research.Objectives: Based on questionnaire data (n = 18538, 69.9% men) from the Norwegian Opioid Maintenance Treatment Program, this study aims to compare the performance of different variable selection methods and the potential clinical consequences of choice of method. The effect of missing data is also explored.Methods: The dependent variable was engagement in criminal behavior while in treatment. Twenty-nine potential covariates on demographics, psychosocial factors and drug use were tested for inclusion in a multiple logistic regression model. Both complete case and multiply imputed data were considered. We compared the results from variable selection methods ranging from expert-based and purposeful variable selection, through stepwise methods, to more recently developed penalized regression using the Least Absolute Shrinkage and Selection Operator (LASSO).Results: The various variable selection methods resulted in regression models including from 9 to 22 covariates. The stepwise selection procedures generated the models with the most covariates included. The choice of variable selection method directly affected the estimated regression coefficients, both in effect size and statistical significance. For several variables the expert-based approach disagreed with all data-driven methods.Conclusions: The choice of variable selection method may strongly affect the resulting regression model, along with accompanying effect sizes and confidence intervals. This may affect clinical conclusions. The process should consequently be given sufficient consideration in model building. We recommend combining expert knowledge with a data-driven variable selection method to explore the models' robustness.

Cross-cultural validation and psychometric testing of the Norwegian version of TeamSTEPPS teamwork attitude questionnaire

Healthcare professionals' attitudes play a significant role in influencing team behavior, and thereby affect the quality and safety of patient care. Culturally adapted and validated questionnaires may contribute valuable knowledge of professionals' attitudes toward teamwork. The aim of the study was to translate and cross-validate the TeamSTEPPS Teamwork Attitude Questionnaire (T-TAQ) into Norwegian, and to test the questionnaire for psychometric properties among Norwegian healthcare professionals. The T-TAQ, measuring five dimensions of attitude towards teamwork, was translated according to a model of back translation. Healthcare professionals (N = 247) from various hospital settings responded. A Pearson correlation coefficient, confirmatory factor analysis (CFA), test-retest reliability, Cronbach's alpha, and McDonald's omega were conducted. The inter-correlation test of the T-TAQ dimensions ranged from 0.16 to 0.54. The CFA showed a Root Mean Square Error of Approximation of (RMSEA) = 0.061. Test-retest showed Intraclass Correlation Coefficient scores from 0.73 to 0.86, with Cronbach's alpha and McDonald's omega demonstrating values from 0.53 to 0.76 (alpha) and 0.57 to 0.76 (omega) on the five dimensions. The Norwegian version of T-TAQ revealed potential concerning the psychometric property for measuring healthcare professionals' attitudes toward teamwork in hospital settings. Further testing with a sample that is more proportionally composed in terms of an interprofessional mix is therefore proposed.

Multiple imputation for longitudinal data in the presence of heteroscedasticity between treatment groups

Multiple imputation is a promising approach for handling of missing data. One uncertainty in applications of the multiple imputation to randomized controlled trials with longitudinal data is whether the imputation should be carried out across all subjects simultaneously or by treatment group separately, which leads to two different strategies for building imputation procedures and/or models. Indeed, it has not been sufficiently addressed and well-documented how the two imputation strategies work in the analysis of the longitudinal data. We consider situations in the presence of heteroscedasticity between treatment groups and conducted extensive simulation studies to examine how the choice of imputation strategy had impacts on the estimation of treatment effects under an assumption of missing at random mechanism. The choice of analysis model was also assessed. The simulation studies suggested that in the presence of heteroscedasticity, the separate imputation by treatment group was robust enough to provide unbiased and precise estimation of the treatment effects; in contrast, the simultaneous imputation, which is frequently used in applications, led to serious biases and poor coverage probabilities of 95% confidence interval for the treatment effects. The heteroscedasticity should be dealt with in more careful manners for the longitudinal data analysis, and if it could be the case in hand, we recommend using the separate imputation by treatment group, as well as applying unequal variance analysis methods for complete data with imputed values. The methods were illustrated with data from two real examples of pediatric research and mental health research.

Patient reported outcome measures for use in pregnancy and childbirth: a systematic review

Background

Globally, an increasing number of women give birth in a healthcare facility. Improvement in the quality of care is crucial if preventable maternal mortality and morbidity are to be reduced. A Patient Reported Outcome Measure (PROM) can be used to measure quality of care and provide new information on the impact that treatment or interventions have on patient’s self-assessed health and health-related quality of life. We conducted a systematic review to identify which condition-specific PROMs are currently available for use in pregnancy and childbirth, and to evaluate whether these could potentially be used to assess the quality of care provided for women using maternity services.

Methods

We searched for articles relating to the use of PROMs related to care during pregnancy, childbirth, the postnatal period and women’s health more generally using PsycINFO, CINAHL, Medline and Web of Science databases as well as “grey literature”, with no date limit. Any PROM identified was reviewed with regards to development, use, and potential applicability to assess quality of maternity care provision. A narrative synthesis was used to summarise findings.

Results

Six papers were identified; two related to aspects of pregnancy (hyperemesis gravidarum and gestational diabetes), and four related to childbirth and the postnatal period (obstetric haemorrhage and postnatal depression). Within these papers, a total of 14 different tools were identified, which assessed a variety of aspects of physical, psychological and social health, or were generic tools, not specific to childbirth. One PROM addressed childbirth generally, however, it did not ask for or provide specific outcome measures but required women to identify and then assess what they considered the most important areas in their life affected by childbirth.

Conclusions

To date, there is no PROM agreed which would be suitable as patient reported outcome measure for the assessment of the quality of care women receive during pregnancy or after childbirth. However, there are a variety of available assessment tools which could potentially be helpful in developing new and existing PROMs for maternity care.

PARENTS 2 study protocol: pilot of Parents' Active Role and ENgagement in the review of Their Stillbirth/perinatal death

BACKGROUND

The perinatal mortality review meeting that takes place within the hospital following a stillbirth or neonatal death enables clinicians to learn vital lessons to improve care for women and their families for the future. Recent evidence suggests that parents are unaware that a formal review following the death of their baby takes place. Many would welcome the opportunity to feedback into the meeting itself. Parental involvement in the perinatal mortality review meeting has the potential to improve patient satisfaction, drive improvements in patient safety and promote an open culture within healthcare. Yet evidence on the feasibility of involving bereaved parents in the review process is lacking. This paper describes the protocol for the Parents' Active Role and Engangement iN the review of their Stillbirth/perinatal death study (PARENTS 2) , whereby healthcare professionals' and stakeholders' perceptions of parental involvement will be investigated, and parental involvement in the perinatal mortality review will be piloted and evaluated at two hospitals.

METHODS AND ANALYSIS

We will investigate perceptions of parental involvement in the perinatal mortality review process by conducting four focus groups. A three-round modified Delphi technique will be employed to gain a consensus on principles of parental involvement in the perinatal mortality review process. We will use three sequential rounds, including a national consensus meeting workshop with experts in stillbirth, neonatal death and bereavement care, and a two-stage anonymous online questionnaire. We will pilot a new perinatal mortality review process with parental involvement over a 6-month study period. The impact of the new process will be evaluated by assessing parents' experiences of their care and parents' and staff perceptions of their involvement in the process by conducting further focus groups and using a Parent Generated Index questionnaire.

ETHICS AND DISSEMINATION

This study has ethical approval from the UK Health Research Authority. We will disseminate the findings through national and international conferences and international peer-reviewed journals.