A step-wise approach to developing indicators to compare the performance of maternity units using hospital administrative data

Hospital administrative data are attractive for comparing performance of maternity units because of their often large sample sizes, lack of selection bias and the relatively low costs of accessing these data compared with conducting primary data collection. However, using administrative data to develop indicators can also present challenges including varying data quality, the limited detail on clinical risk factors and a lack of structural and user experience measures. This review illustrates how to develop performance indicators for maternity units using hospital administrative data, including methods to address the challenges that administrative data pose.

TWEETABLE ABSTRACT

How to develop maternity indicators from administrative data.

Anthropometric standardisation and quality control protocols for the construction of new, international, fetal and newborn growth standards: the INTERGROWTH-21st Project

The primary aim of the INTERGROWTH-21(st) Project is to construct new, prescriptive standards describing optimal fetal and preterm postnatal growth. The anthropometric measurements include the head circumference, recumbent length and weight of the infants, and the stature and weight of the parents. In such a large, international, multicentre project, it is critical that all study sites follow standardised protocols to ensure maximal validity of the growth and nutrition indicators used. This paper describes in detail the anthropometric training, standardisation and quality control procedures used to collect data for these new standards. The initial standardisation session was in Nairobi, Kenya, using newborns, which was followed by similar sessions in the eight participating study sites in Brazil, China, India, Italy, Kenya, Oman, UK and USA. The intraobserver and inter-observer technical error of measurement values for head circumference range from 0.3 to 0.4 cm, and for recumbent length from 0.3 to 0.5 cm. These standardisation protocols implemented at each study site worldwide ensure that the anthropometric data collected are of the highest quality to construct international growth standards.

Anthropometric protocols for the construction of new international fetal and newborn growth standards: the INTERGROWTH-21st Project

The primary aim of the INTERGROWTH-21(st) Project is to construct new, prescriptive standards describing optimal fetal and preterm postnatal growth. The anthropometric measurements include the head circumference, recumbent length and weight of the infants, and the stature and weight of the parents. In such a large, international, multicentre project, it is critical that all study sites follow standardised protocols to ensure maximal validity of the growth and nutrition indicators used. This paper describes, in detail, the selection of anthropometric personnel, equipment, and measurement and calibration protocols used to construct the new standards. Implementing these protocols at each study site ensures that the anthropometric data are of the highest quality to construct the international standards.

Implementation of the INTERGROWTH-21st Project in the United States

The North American site in the INTERGROWTH-21(st) Project was North Seattle, Washington State, USA. The majority of the data were collected from within Seattle City, which has approximately 12 300 births per year. The sample for the Newborn Cross-Sectional Study (NCSS) was drawn from two hospitals (Swedish Medical Center and the University of Washington) covering almost 80% of deliveries within the target population. The Fetal Growth Longitudinal Study (FGLS) sample was recruited from several antenatal clinics serving the University of Washington Medical Center and Providence Everett Medical Center. Special activities to encourage participation and raise awareness of the studies included furnishing the recruitment sites with fliers designed by the Project Coordinating Unit, and presenting the studies to clinical staff to encourage providers to refer appropriate patients. One of the major challenges at this site was the low recruitment rate in the early phase of the FGLS because of the high rates of smoking, maternal age >35 years and body mass index >30 years. This was remedied by the inclusion of other ancillary clinics, as well as increased advertising among the general public.

Implementation of the INTERGROWTH-21st Project in India

The South Asian site in the INTERGROWTH-21(st) Project was the city of Nagpur, in Maharashtra State, India, with approximately 4500 births per year among the target population with middle to high socio-economic status. These deliveries are mainly concentrated in 20 small private hospitals, most of which are in the city centre. The sample for the Newborn Cross-Sectional Study (NCSS) was drawn from ten of these hospitals, covering 76% of the target low-risk pregnant population. The Fetal Growth Longitudinal Study (FGLS) sample was recruited from the largest of these institutions, Ketkar Hospital, as well as several ancillary antenatal care clinics. Special activities to encourage participation and raise awareness of the study at this site included translating patient information leaflets into local languages and securing local media interest. Among the unique challenges of the Indian site was the coordination of the large number of hospitals involved in NCSS, a task that required careful planning and organisation by the field teams.

Implementation of the INTERGROWTH-21st Project in Brazil

The Latin American site in the INTERGROWTH-21(st) Project was Pelotas, Brazil, with approximately 4000 births per year. The sample for the Newborn Cross-Sectional Study (NCSS) was drawn from four hospitals, covering 99% of births in the city. The Fetal Growth Longitudinal Study (FGLS) sample was recruited from one of the largest private ultrasound clinics in the city and 30 smaller, private, antenatal clinics serving middle to high socio-economic status women. Among this site's major challenges was the recruitment of women for FGLS from numerous different clinics. Several public relations activities were conducted to improve collaborative efforts between the research team and obstetricians, paediatricians and community leaders in Pelotas.

Implementation of the INTERGROWTH-21st Project in Oman

The Middle Eastern site in the INTERGROWTH-21(st) Project was Muscat, the capital city of Oman, with approximately 10,500 births per year. The sample for the Newborn Cross-Sectional Study (NCSS) was drawn from two hospitals covering 96% of the region's births. The Fetal Growth Longitudinal Study (FGLS) sample was recruited from four primary health facilities serving Khoula Hospital, using the eligibility criteria in the INTERGROWTH-21(st) protocol. Special activities to encourage participation in this population included local advocacy campaigns to encourage early antenatal booking and ultrasound dating in the population. The major challenges at the site were the recruitment of sufficient numbers of women at an early gestational age, and the timely measurement of all newborns within 12 hours of birth. Many individuals and institutions collaborated effectively over a period of several years on these studies, which required careful planning and close monitoring for their successful implementation.

Managing data for the international, multicentre INTERGROWTH-21st Project

The INTERGROWTH-21(st) Project data management was structured incorporating both a centralised and decentralised system for the eight study centres, which all used the same database and standardised data collection instruments, manuals and processes. Each centre was responsible for the entry and validation of their country-specific data, which were entered onto a centralised system maintained by the Data Coordinating Unit in Oxford. A comprehensive data management system was designed to handle the very large volumes of data. It contained internal validations to prevent incorrect and inconsistent values being captured, and allowed online data entry by local Data Management Units, as well as real-time management of recruitment and data collection by the Data Coordinating Unit in Oxford. To maintain data integrity, only the Data Coordinating Unit in Oxford had access to all the eight centres' data, which were continually monitored. All queries identified were raised with the relevant local data manager for verification and correction, if necessary. The system automatically logged an audit trail of all updates to the database with the date and name of the person who made the changes. These rigorous processes ensured that the data collected in the INTERGROWTH-21(st) Project were of exceptionally high quality.

Implementation of the INTERGROWTH-21st Project in the UK

There are approximately 10,000 births per year in the county of Oxfordshire in the UK, which is one of the two European sites for the International Fetal and Newborn Growth Consortium for the 21(st) Century (INTERGROWTH-21(st) ) Project. The samples for both components of the project--the Fetal Growth Longitudinal Study (FGLS) and Newborn Cross-Sectional Study (NCSS)--were drawn from the John Radcliffe Hospital, a major university hospital with a large regional role that covers more than 75% of deliveries in the county. Special activities to encourage participation in this population included the formation of a research coalition to streamline recruitment in the Maternity Unit and the distribution of study information leaflets to women using the hospital's antenatal care service. This was a demanding project and several challenges were overcome to reach recruitment targets and to maintain high standards of data quality. Amongst the major challenges for FGLS at this study site was the level of ineligibility because of maternal age, smoking and body mass index (BMI) ≥ 30. The major challenge for the NCSS field teams was to ensure that all anthropometric data were collected before the early discharge of uncomplicated deliveries, often within 6 hours of birth. It is evident from our experience in implementing this project that, when large-scale clinical studies are meticulously planned and avoid major disruption to routine clinical care, they are well received by hospital staff and can contribute to the improvement of the overall standard of clinical care.

Conceptual issues related to the construction of prescriptive standards for the evaluation of postnatal growth of preterm infants

Monitoring and interpreting the growth of preterm infants is a major clinical task for neonatologists. The effectiveness of this process depends upon the robustness of the standard selected. Concerns have been raised regarding the nature of the charts currently being used, as well as their appropriateness for present-day neonatal care. To overcome these problems, there is a need for new prescriptive standards based on a population of preterm infants without evidence of impaired fetal growth and born to low-risk women followed up since early pregnancy for precise gestational age dating. Preterm infants contributing to the new standards should be free of congenital malformations and major clinical conditions associated with impaired postnatal growth. These infants should receive standardised, evidence-based clinical care and should follow current feeding recommendations based on exclusive/predominant breastfeeding. This strategy should provide a population that is conceptually as close as possible to the prescriptive approach used for the construction of the WHO infant and child growth standards. New international standards constructed in this way should contribute to the evidence-based care of these preterm infants.