Bouwmeester RN, Binkhorst M, Yamada NK, Geurtzen R, van Heijst AFJ, Halamek LP, Draaisma JMT, Hogeveen M. Appraisal of a scoring instrument for training and testing neonatal intubation skills.
Arch Dis Child Fetal Neonatal Ed 2019;
104:F521-F527. [PMID:
30504442 DOI:
10.1136/archdischild-2018-315221]
[Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/22/2018] [Revised: 11/02/2018] [Accepted: 11/04/2018] [Indexed: 11/04/2022]
Abstract
OBJECTIVE
To determine the validity, reliability, feasibility and applicability of a neonatal intubation scoring instrument.
DESIGN
Prospective observational study.
SETTING
Simulation-based research and training centre (Center for Advanced Pediatric and Perinatal Education), California, USA.
SUBJECTS
Forty clinicians qualified for neonatal intubation.
INTERVENTIONS
Videotaped elective intubations on a neonatal patient simulator were scored by two independent raters. One rater scored the intubations twice. We scored the preparation of equipment and premedication, intubation performance, tube position/fixation, communication, number of attempts, duration and successfulness of the procedure.
MAIN OUTCOME MEASURES
Intraclass correlation coefficients (ICC) were calculated for intrarater and inter-rater reliability. Kappa coefficients for individual items and mean kappa coefficients for all items combined were calculated. Construct validity was assessed with one-way analysis of variance using the hypothesis that experienced clinicians score higher than less experienced clinicians. The approximate time to score one intubation and the instrument's applicability in another setting were evaluated.
RESULTS
ICCs for intrarater and inter-rater reliability were 0.99 (95% CI 0.98 to 0.99) and 0.89 (95% CI 0.35 to 0.96), and mean kappa coefficients were 0.93 (95% CI 0.85 to 1.01) and 0.71 (95% CI 0.56 to 0.92), respectively. There were no differences between the more and less experienced clinicians regarding preparation, performance, communication and total scores. The experienced group scored higher only on tube position/fixation (p=0.02). Scoring one intubation took approximately 15 min. Our instrument, developed in The Netherlands, could be readily applied in the USA.
CONCLUSIONS
Our scoring instrument for simulated neonatal intubations appears to be reliable, feasible and applicable in another centre. Construct validity could not be established.
Collapse