Feasibility and reliability of a newly developed antenatal risk score card in routine care

Identifying psychosocial vulnerabilities in pregnancy: A mixed-method systematic review of the knowledge base of antenatal conversational psychosocial assessment tools

BACKGROUND

Early identification of psychosocial vulnerability among expectant parents through psychosocial assessment is increasingly recommended within maternity care. For routine antenatal assessment, a strong recognition exists regarding conversational assessment tools. However, the knowledge base of conversational tools is limited, inhibiting their clinical use.

OBJECTIVE

Synthesising existing knowledge pertaining to antenatal conversational psychosocial assessment tools, including identifying characteristics, acceptability, performance, effectiveness and unintended consequences.

DESIGN

Mixed-method systematic review based on searches in CINAHL, PubMed, Embase, PsycINFO, Cochrane and Scopus. 20 out of 5394 studies were included and synthesised with a convergent integrated approach using a thematic analysis strategy.

FINDINGS

We identified seven antenatal psychosocial assessment tools that partially or completely utilised a conversational approach. Women's acceptability was high, and tools were generally found to support person-centred communication and the parent-health care professional relationship. Evidence regarding effectiveness and performance of conversational tools was limited. Unintended consequences were found, including some women having negative experiences related to assessment of intimate partner violence, lack of preparation and lack of relevance. High acceptability was reported by health care professionals who considered the tools as valuable and enhancing of identification of vulnerability. Unintended consequences, including lack of time and competencies as well as discomfort when assessment is very sensitive, were reported.

CONCLUSIONS

Evidence regarding conversational tools' effectiveness and performance is limited. More is known about the acceptability of conversational tools, which is generally highly acceptable among women and health care professionals. Some unintended consequences of the use of included conversational tools were identified.

The Experiences of Midwives in Caring for Vulnerable Pregnant Women in The Netherlands: A Qualitative Cross-Sectional Study

Vulnerable pregnant women have an increased risk for preterm birth and perinatal mortality. This study identifies the perspectives, perceived barriers, and perceived facilitators of midwives toward current care for vulnerable pregnant women in the Netherlands. Knowing those perspectives, barriers, and facilitators could help increase quality of care, thereby reducing the risks of preterm birth and perinatal mortality. Midwives working in primary care practices throughout the Netherlands were interviewed. Semi-structured interviews were conducted remotely through a video conference program, audio recorded, transcribed verbatim, and coded based on the theoretical domains framework and concepts derived from the interviews, using NVivo-12. All midwives provided psychosocial care for vulnerable pregnant women, expected positive consequences for those women resulting from that care, considered it their task to identify and refer vulnerable women, and intended to improve the situation for mother and child. The main barriers perceived by midwives were too many organizations being involved, inadequate communication between care providers, lack of time to care for vulnerable women, insufficient financing to provide adequate care, and uncooperative clients. The main facilitators were having care coordinators, treatment guidelines, vulnerability detection tools, their own knowledge about local psychosocial organizations, good communication skills, cooperative clients, consultation with colleagues, and good communication between care providers. The findings suggest that midwives are highly motivated to care for vulnerable women and perceive a multitude of facilitators. However, they also perceive various barriers for providing optimal care. A national guideline on how to care for vulnerable women, local overviews of involved organizations, and proactive midwives who ensure connections between the psychosocial and medical domain could help to overcome these barriers, and therefore, maximize effectiveness of the care for vulnerable pregnant women.

Validation of a prognostic model for adverse perinatal health outcomes

There is a strong association between social deprivation and adverse perinatal health outcomes, but related risk factors receive little attention in current antenatal risk selection. To increase awareness of healthcare professionals for these risk factors, a model for antenatal risk surveillance and care was developed in The Netherlands, called the ‘Rotterdam Reproductive Risk Reduction’ (R4U) scorecard. The aim of this study was to validate the R4U-scorecard. This study was conducted using external, prospective data from thirty-two midwifery practices, and fifteen hospitals in The Netherlands. The main outcome measures were the discrimination of the prognostic models for the probability of a pregnant woman developing adverse pregnancy outcomes (babies born preterm or small for gestational age), and calibration. We performed cross-validation and updated the model using statistical re-estimation of all predictors. 1752 participants were included, of whom 282 (16%) had one of the predefined adverse outcomes. The discriminative value of the original scoring system was poor [area under the curve (AUC) of 0.58 (95% CI 0.53–0.64)]. The model showed moderate calibration. The updated R4U-scorecard showed good generalisability to the validation set but did not alter the predictive value [AUC 0.61 (95% CI 0.56–0.66)]. By using external data and by updating the prognostic model, we have provided a comprehensive evaluation of the R4U-scorecard. Further improvement in classification of high-risk pregnancies is important considering the necessity of early risk detection for healthcare professionals to take appropriate actions to prevent these risks from becoming manifest problems.

Towards an integrated perinatal care pathway for vulnerable women: The development and validation of quality indicators

OBJECTIVE

Development and validation of a set of quality indicators for vulnerable women during the perinatal period.

DESIGN

A three-phase method was used. Phase 1 consisted of a literature review to identify publications for the development of care domains and potential QIs, as well as a quality assessment by the research team. In phase 2 an expert panel assessed the set of concept QIs in a modified three-round Delphi survey. Finally, semi-structured interviews with vulnerable women were conducted as a final quality assessment of a set of indicators (phase 3). Ethical approval was obtained from the ethics committee of the University Hospital Brussels and from the Ethics Committees of all the participating hospitals.

SETTING

The Flemish Region and the Brussels Capital Region in Belgium.

PARTICIPANTS

Healthcare and social care professionals (n = 40) with expertise in the field of perinatal care provision for vulnerable families. Vulnerable women (n = 11) who gave birth in one of the participating hospitals.

FINDINGS

The literature review resulted in a set of 49 potential quality indicators in five care domains: access to healthcare, assessment and screening, informal support, formal support and continuity of care. After assessment by the expert panel and vulnerable women, a final set of 21 quality indicators in five care domains was identified. First of all, organisation of care must involve an integrated multidisciplinary approach taking account of financial, administrative and social barriers (care domain 1: access to healthcare). Second, qualitative care includes the timely initiation of care, a general screening of the various aspects of vulnerability (biological, psychological, social and cognitive) and a risk assessment for all women (care domain 2: assessment and screening). Vulnerable women benefit from intensive formal and informal support taking account of individual needs and strengths (care domain 3: formal support; care domain 4: informal support). Finally, continuity of care needs to be guaranteed in line with vulnerable woman's individual needs (care domain 5: continuity of care).

KEY CONCLUSIONS AND IMPLICATIONS FOR PRACTICE

Implementing quality indicators in existing and new care pathways offers an evidence-based approach facilitating an integrated view promoting a healthy start for woman and child. These quality indicators can assist healthcare providers, organisations and governmental agencies to improve the quality of perinatal care for vulnerable women.

Did an urban perinatal health programme in Rotterdam, the Netherlands, reduce adverse perinatal outcomes? Register-based retrospective cohort study

OBJECTIVES

To study the effect of an urban perinatal health programme in Rotterdam, the Netherlands, on perinatal outcomes.

DESIGN

A retrospective cohort study with difference-in-differences analysis using individual-level perinatal outcome data from the Dutch Perinatal Registry 2003-2014 linked to Central Bureau of Statistics data of migration background and individual disposable household income.

INTERVENTION

The programme consisted of perinatal health promotion, risk selection and risk-guided pregnancy care, and a new primary care child birth centre. The programme was implemented during 2009-2012.

PRIMARY OUTCOME MEASURES

We compared trends in perinatal mortality, preterm delivery and small-for-gestational-age births between targeted urban neighbourhoods in Rotterdam (n=61 415) and all other urban neighbourhoods in the Netherlands (n=881 202). The effect of the programme was modelled as a change in trend of each perinatal outcome in the treatment group post intervention compared with the control population from January 2010 onwards. All analyses were adjusted for maternal age, parity, ethnicity and individual-level low socioeconomic status (SES). We also conducted a stratified analysis by SES.

RESULTS

During 2003-2014, downward trends in perinatal mortality (adjusted OR (aOR) 0.9439 per year, 95% CI 0.9362 to 0.9517), preterm birth (aOR 0.9970 per year, 95% CI 0.9944 to 0.9997) and small-for-gestational-age births (aOR 0.9809 per year, 95% CI 0.9787 to 0.9831) in the entire study population were observed. No demonstrable changes in these trends were found in the intervention group after the programme had started. The stratified analyses by SES showed no changes in trends post intervention in both strata either.

CONCLUSIONS

The programme had no demonstrable effects on perinatal outcomes. The intervention may not have reached a sufficient proportion of the population or has provided too little contrast to the widespread attention for inequalities in pregnancy outcomes occurring simultaneously in the Netherlands.

Reducing growth and developmental problems in children: Development of an innovative postnatal risk assessment

Introduction

Globally, awareness of the relevance of both medical and non-medical risk factors influencing growth and development of children has been increasing. The aim of our study was to develop an innovative postnatal risk assessment to be used by the Preventive Child Healthcare (PCHC) to identify at an early stage children at risk for growth (catch-up growth, overweight and obesity) and developmental problems (such as motor, cognitive, psychosocial and language/ speech problems).

Methods

We used the first four steps of the Intervention Mapping process. Step 1: Review of the literature and focus group discussions. Step 2: Identification of program objectives on how to develop and implement a risk assessment in PCHC daily practice. Step 3: Application of the ASE model to initiate behavioral change in the target group. Step 4: Development of the postnatal R4U and a program plan for the implementation in PCHC organizations.

Results

Subsequently in 2015, the 41 item postnatal R4U (the postnatal Rotterdam Reproduction Risk Reduction checklist) was developed according to steps one until four of the Intervention Mapping process and was implemented in four PCHC organizations.

Conclusions

It was feasible to design and implement a postnatal risk assessment identifying both medical and non-medical risks for growth and developmental problems, using the Intervention Mapping process.

Reliability in evaluator-based tests: using simulation-constructed models to determine contextually relevant agreement thresholds

BACKGROUND

Indices of inter-evaluator reliability are used in many fields such as computational linguistics, psychology, and medical science; however, the interpretation of resulting values and determination of appropriate thresholds lack context and are often guided only by arbitrary "rules of thumb" or simply not addressed at all. Our goal for this work was to develop a method for determining the relationship between inter-evaluator agreement and error to facilitate meaningful interpretation of values, thresholds, and reliability.

METHODS

Three expert human evaluators completed a video analysis task, and averaged their results together to create a reference dataset of 300 time measurements. We simulated unique combinations of systematic error and random error onto the reference dataset to generate 4900 new hypothetical evaluators (each with 300 time measurements). The systematic errors and random errors made by the hypothetical evaluator population were approximated as the mean and variance of a normally-distributed error signal. Calculating the error (using percent error) and inter-evaluator agreement (using Krippendorff's alpha) between each hypothetical evaluator and the reference dataset allowed us to establish a mathematical model and value envelope of the worst possible percent error for any given amount of agreement.

RESULTS

We used the relationship between inter-evaluator agreement and error to make an informed judgment of an acceptable threshold for Krippendorff's alpha within the context of our specific test. To demonstrate the utility of our modeling approach, we calculated the percent error and Krippendorff's alpha between the reference dataset and a new cohort of trained human evaluators and used our contextually-derived Krippendorff's alpha threshold as a gauge of evaluator quality. Although all evaluators had relatively high agreement (> 0.9) compared to the rule of thumb (0.8), our agreement threshold permitted evaluators with low error, while rejecting one evaluator with relatively high error.

CONCLUSIONS

We found that our approach established threshold values of reliability, within the context of our evaluation criteria, that were far less permissive than the typically accepted "rule of thumb" cutoff for Krippendorff's alpha. This procedure provides a less arbitrary method for determining a reliability threshold and can be tailored to work within the context of any reliability index.

Validity and Reliability of the Arabic Version of the Copenhagen Neck Functional Disability Scale in Neck Pain Patients

Study Design

Prospective observational study.

Purpose

To test the face validity, content validity, feasibility, internal consistency, reliability, and test–retest reliability of the Arabic version of the Copenhagen Neck Functional Disability Scale (CNFDS).

Overview of Literature

CNFDS is a clinical evaluation tool that accurately reflects the patient’s perception regarding his/her functionality with existing cervical pain. This study aimed to investigate the validity and reliability of the Arabic version of the CNFDS in measuring the disability level in chronic neck pain patients.

Method

Seventy-four patients with neck pain were recruited, and 135 sheets (test and retest sheets) were completed by patients; two expert panels (each comprising ten experts) participated in this study. Arabic translation (forward translation), development of the preliminary translated version, English translation (backward translation), development of the prefinal version, and testing of the prefinal version was performed by experts; thereafter, the final version was tested on patients. Index of clarity, expert proportion of clearance, index of content validity (CVI), expert proportion of relevance, descriptive statistics, missed item index, Cronbach’s alpha, and Spearman’s rank correlation coefficient were used for statistical analyses.

Results

The study revealed that the scale index of clarity was 86.84%, scale CVI was 99.33%, scale-level content validity index (universal agreement method) was 99.33%, 99.15% of the scale items were filled in all sheets, the scale was answered in less than 3 minutes in about 75% cases, Cronbach’s alpha was 0.856 (0.796, 0.905), and all Spearman’s correlations between the test and retest results were statistically significant.

Conclusions

The Arabic version of the CNFDS has adequate validity and reliability for the measurement of the disability level in chronic neck pain patients.

Antenatal non-medical risk assessment and care pathways to improve pregnancy outcomes: a cluster randomised controlled trial

Social deprivation negatively affects health outcomes but receives little attention in obstetric risk selection. We investigated whether a combination of (1) risk assessment focused on non-medical risk factors, lifestyle factors, and medical risk factors, with (2) subsequent institution of risk-specific care pathways, and (3) multidisciplinary consultation between care providers from the curative and the public health sector reduced adverse pregnancy outcomes among women in selected urban areas in the Netherlands. We conducted a cluster randomised controlled trial in 14 urban municipalities across the Netherlands. Prior to the randomisation, municipalities were ranked and paired according to their expected proportion of pregnant women at risk for adverse outcomes at birth. The primary outcome was delivery of a preterm and/or small for gestational age (SGA) baby, analysed with multilevel mixed-effects logistic regression analysis adjusting for clustering and individual baseline characteristics. A total of 33 community midwife practices and nine hospitals participated throughout the study. Data from 4302 participants was included in the Intention To Treat (ITT) analysis. The intervention had no demonstrable impact on the primary outcome: adjusted odds ratio (aOR) 1.17 (95% CI 0.84–1.63). Among the secondary outcomes, the intervention improved the detection of threatening preterm delivery and fetal growth restriction during pregnancy [aOR 1.27 (95% CI 1.01–1.61)]. Implementation of additional non-medical risk assessment and preventive strategies into general practices is feasible but did not decrease the incidence of preterm and/or SGA birth in the index pregnancy in deprived urban areas.

Trial registration Netherlands National Trial Register (NTR-3367).

Geographical differences in perinatal health and child welfare in the Netherlands: rationale for the healthy pregnancy 4 all-2 program

Background

Geographical inequalities in perinatal health and child welfare require attention. To improve the identification, and care, of mothers and young children at risk of adverse health outcomes, the HP4All-2 program was developed. The program consists of three studies, focusing on creating a continuum for risk selection and tailored care pathways from preconception and antenatal care towards 1) postpartum care, 2) early childhood care, as well as 3) interconception care. The program has been implemented in ten municipalities in the Netherlands, aiming to target communities with a relatively disadvantageous position with regard to perinatal and child health outcomes. To delineate the position of the ten participating municipalities, we present municipal and regional differences in the prevalence of perinatal mortality, perinatal morbidity, children living in deprived neighbourhoods, and children living in families on welfare.

Methods

Data on all singleton births in the Netherlands between 2009 and 2014 were analysed for the prevalence of perinatal mortality and morbidity. In addition, national data on children living in deprived neighbourhoods and children living in families on welfare between 2009 and 2012 were analysed. The prevalence of these outcomes were calculated and ranked for 62 geographical areas, the 50 largest municipalities and the 12 provinces, to determine the position of the municipalities that participate in HP4All-2.

Results

Considerable geographical differences were present for all four outcomes. The municipalities that participate in HP4All-2 are among the 25 municipalities with the highest prevalence of perinatal mortality, perinatal morbidity, children living in deprived neighbourhoods, or children in families on welfare.

Conclusion

This study illustrates geographical differences in perinatal health and/or child welfare outcomes and demonstrates that the HP4All-2 program targets municipalities with a relative unfavourable position. By targeting these municipalities, the program is expected to contribute most to improving the care for young children and their mothers at risk, and hence to reducing their risks and health inequalities.

Electronic supplementary material

The online version of this article (doi:10.1186/s12884-017-1425-2) contains supplementary material, which is available to authorized users.

Process evaluation of the implementation of scorecard-based antenatal risk assessment, care pathways and interdisciplinary consultation: the Healthy Pregnancy 4 All study

OBJECTIVE

To evaluate the implementation of a complex intervention in the antenatal healthcare field in 14 Dutch municipalities. The intervention consisted of the implementation of a systematic scorecard-based risk assessment in pregnancy, subsequent patient-tailored care pathways, and consultations of professionals from different medical and social disciplines.

METHODS

Saunders's seven-step method was used for the development of a programme implementation monitoring plan, with specific attention to the setting and context of the programme. Data were triangulated from multiple sources, and prespecified criteria were applied to examine the evidence for implementation.

RESULTS

Six out of 11 municipalities (54%) met the implementation criteria for the entire risk assessment programme, whereas three municipalities (27%) met the criteria if the three components of implementation were analysed separately.

CONCLUSIONS

A process evaluation of implementation of a complex intervention is possible. The results can be used to improve understanding of the associations between specific programme elements and programme outcomes on effectiveness of the intervention. Additionally, the results are important for formative purposes to assess how future implementation of antenatal risk assessment can be improved in comparable contexts.

Vulnerable pregnant women in antenatal practice: Caregiver's perception of workload, associated burden and agreement with objective caseload, and the influence of a structured organisation of antenatal risk management

INTRODUCTION

pregnancy care for vulnerable women is often perceived as a burden by caregivers as vulnerable clients require complex case management, additional time, and more often show adverse perinatal outcomes. Vulnerable clients bring about additional work strain for the caregiver, especially when the workload is high. We define client vulnerability as coexistence of psychopathology, psychosocial problems or substance use, together with features of deprivation. We investigated, as part of a national programme, whether the subjective caregiver's perception of workload and the objective registry-based caseload of vulnerable clients are in agreement, and whether a structured organisation of antenatal risk management reduces the burden associated with the perceived workload, in particular if the objective caseload is high.

METHODS

we combined three data sources: (1) at the unit level (i.e. midwifery practice, obstetric unit) interview data from caregivers, from which we derived a) the (subjective) caregiver's perception of workload, b) the associated burden and c) organisational structure of antenatal risk management, (2) at the unit level perinatal registry data, from which we derived a) unit characteristics and b) (objective) unit specific caseload, and (3) at the individual client level survey data collected during the first antenatal visit, from which the prevalence of vulnerable clients was derived. The study area was the South-West Netherlands (2.5 million inhabitants), containing areas with varying degrees of urbanisation and deprivation.

FINDINGS

sixteen units had complete data on all measures. Generally, subjective workload and objective caseload were only weakly related, the relation being modified by the organisation of antenatal risk management. If the organisational structure of antenatal risk management was low, the experienced burden was high, even if the objective caseload was low. Highly structured antenatal risk management was associated with a medium to low burden.

DISCUSSION

our observational study suggests that even a high caseload can be dealt with by structured antenatal risk management. A change from the current individual case-finding policies towards a more universal screen-like approach may thus benefit both the client and the caregiver.

An antenatal prediction model for adverse birth outcomes in an urban population: The contribution of medical and non-medical risks

OBJECTIVES

in the Netherlands the perinatal mortality rate is high compared to other European countries. Around eighty percent of perinatal mortality cases is preceded by being small for gestational age (SGA), preterm birth and/or having a low Apgar-score at 5 minutes after birth. Current risk detection in pregnancy focusses primarily on medical risks. However, non-medical risk factors may be relevant too. Both non-medical and medical risk factors are incorporated in the Rotterdam Reproductive Risk Reduction (R4U) scorecard. We investigated the associations between R4U risk factors and preterm birth, SGA and a low Apgar score.

DESIGN

a prospective cohort study under routine practice conditions.

SETTING

six midwifery practices and two hospitals in Rotterdam, the Netherlands.

PARTICIPANTS

836 pregnant women.

INTERVENTIONS

the R4U scorecard was filled out at the booking visit.

MEASUREMENTS

after birth, the follow-up data on pregnancy outcomes were collected. Multivariate logistic regression was used to fit models for the prediction of any adverse outcome (preterm birth, SGA and/or a low Apgar score), stratified for ethnicity and socio-economic status (SES).

FINDINGS

factors predicting any adverse outcome for Western women were smoking during the first trimester and over-the-counter medication. For non-Western women risk factors were teenage pregnancy, advanced maternal age and an obstetric history of SGA. Risk factors for high SES women were low family income, no daily intake of vegetables and a history of preterm birth. For low SES women risk factors appeared to be low family income, non-Western ethnicity, smoking during the first trimester and a history of SGA.

KEY CONCLUSIONS

the presence of both medical and non-medical risk factors early in pregnancy predict the occurrence of adverse outcomes at birth. Furthermore the risk profiles for adverse outcomes differed according to SES and ethnicity.

IMPLICATIONS FOR PRACTICE

to optimise effective risk selection, both medical and non-medical risk factors should be taken into account in midwifery and obstetric care at the booking visit.

An instrument for broadened risk assessment in antenatal health care including non-medical issues

Introduction

Growing evidence on the risk contributing role of non-medical factors on pregnancy outcomes urged for a new approach in early antenatal risk selection. The evidence invites to more integration, in particular between the clinical working area and the public health domain. We developed a non-invasive, standardized instrument for comprehensive antenatal risk assessment. The current study presents the application-oriented development of a risk screening instrument for early antenatal detection of risk factors and tailored prevention in an integrated care setting.

Methods

A review of published instruments complemented with evidence from cohort studies. Selection and standardization of risk factors associated with small for gestational age, preterm birth, congenital anomalies and perinatal mortality. Risk factors were weighted to obtain a cumulative risk score. Responses were then connected to corresponding care pathways. A cumulative risk threshold was defined, which can be adapted to the population and the availability of preventive facilities. A score above the threshold implies multidisciplinary consultation between caregivers.

Results

The resulting digital score card consisted of 70 items, subdivided into four non-medical and two medical domains. Weighing of risk factors was based on existing evidence. Pilot-evidence from a cohort of 218 pregnancies in a multi-practice urban setting showed a cut-off of 16 points would imply 20% of all pregnant women to be assessed in a multidisciplinary setting. A total of 28 care pathways were defined.

Conclusion

The resulting score card is a universal risk screening instrument which incorporates recent evidence on non-medical risk factors for adverse pregnancy outcomes and enables systematic risk management in an integrated antenatal health care setting.

Effectiveness of score card-based antenatal risk selection, care pathways, and multidisciplinary consultation in the Healthy Pregnancy 4 All study (HP4ALL): study protocol for a cluster randomized controlled trial

BACKGROUND

Promotion of healthy pregnancies has gained high priority in the Netherlands because of relatively unfavorable perinatal outcomes. In response, a nationwide study, 'Healthy Pregnancy 4 All' (HP4ALL), has been initiated. Part of this study involves systematic and broadened antenatal risk assessment (the Risk Assessment substudy). Risk selection in current clinical practice is mainly based on medical risk factors. Despite the increasing evidence for the influence of nonmedical risk factors (social status, lifestyle or ethnicity) on perinatal outcomes, these risk factors remain highly unexposed. Systematic risk selection, combined with customized care pathways to reduce or treat detected risks, and regular and structured consultation between community midwives, gynecologists and other care providers such as social workers, is part of this study.

METHODS/DESIGN

Neighborhoods in 14 municipalities with adverse perinatal outcomes above national and municipal averages are selected for participation. The study concerns a cluster randomized controlled trial. Municipalities are randomly allocated to intervention (n = 3,500 pregnant women) and control groups (n = 3,500 pregnant women). The intervention consists of systematic risk selection with the Rotterdam Reproductive Risk Reduction (R4U) score card in pregnant women at the booking visit, and referral to corresponding care pathways. A risk score, based on weighed risk factors derived from the R4U, above a predefined threshold determines structured multidisciplinary consultation. Primary outcomes of this trial are dysmaturity (birth weight < p10), prematurity (birth <37 weeks), and efficacy of implementation.

DISCUSSION

The 'HP4ALL' study introduces a systematic approach in antenatal health care that may improve perinatal outcomes and, thereby, affect future health status of a new generation in the Netherlands.

TRIAL REGISTRATION

Dutch Trial Registry ( NTR-3367) on 20 March 2012.