Procedural skills in paediatric residency: Re-evaluating the competencies

What is the impact of simulation-based training for paediatric procedures on patient outcomes, cost and latent safety threats?

BACKGROUND

Simulation-based training (SBT) provides a safe space for medical trainees to experience realistic scenarios. SBT has been found to improve trainee performance in paediatric procedures. However, limited evidence exists regarding its effects on higher-level outcomes. This scoping review aims to identify studies that investigate the impact of SBT for procedural skills on T3 (patient outcomes) and T4 level outcomes (latent safety threats [LSTs], and hospital level costs) in paediatrics.

METHODS

Full-text articles were included if they focused on medical trainees, used simulation training for paediatric procedures and reported T3/T4 level outcomes. Six databases were searched from January 2011 to September 2022. Search strategies were developed with the assistance of a librarian. Three independent reviewers performed pilot screenings before title/abstract and full-text screenings. A data extraction sheet was created to gather information on interventions, outcomes, research design, and other study characteristics.

FINDINGS

After title/abstract screening of 4,076 sources, 50 were included for full-text review, with 15 articles selected for data extraction. Four were randomised control studies (RCTs), fourteen focused on T3 level outcomes including mortality rates, and one measured LSTs. There were no studies reporting cost-related data. Three of the studies focused on bag-and-mask ventilation, and eight mentioned the use of mannequins.

DISCUSSION

We highlight the potential effectiveness of simulation-based training of paediatric procedural skills in improving patient outcomes, such as reduced mortality rates and incidence of illness/injury.

CONCLUSION

Though the quality of research designs was low, researchers used different simulation modalities and outcome measures and showed a positive impact of SBT(e.g., decreased mortality rates).

Understanding the Procedural Skills Needed in Rural Pediatric Practices: A Survey of Rural Pediatric Providers in the State of New Mexico

OBJECTIVES

There is little data evaluating procedural skills in current rural pediatric practices. In order to prepare a cadre of pediatricians to work in rural settings, we require an understanding of the unique procedural skills needed by rural pediatric providers. Our objective was to determine how often pediatricians performed various procedural skills, determine the importance of these skills to current practice, and how they differ between rural and urban pediatric providers.

METHODS

A survey evaluating pediatrician utilization of the 13 required Accreditation Council Graduate Medical Education procedural skills in current practice was developed and distributed to pediatric providers in New Mexico. Descriptive statistics were used to profile participants and describe survey responses. Chi-square tests were used to evaluate differences by urban setting or IHS. Fisher's exact test was employed to assess differences if cell sizes were less than five. All p-values were two sided with alpha=.05. Benjamini-Hochberg method was used to control for type 1 errors.

RESULTS

Fifty-two of 216 pediatric providers responded. The majority surveyed performed each of the 13 procedures less than monthly but competency in many of these procedures is important. Thirty-two respondents submitted free-text responses recommending competence with tracheostomy changes, gastrostomy-tube changes/cares, and circumcision.

CONCLUSION

Majority of surveyed pediatricians performed the required procedures less than monthly but deemed several procedures to be important. Rural pediatricians recommended specific procedural skills needed in rural practice. All trainees receive procedural skills training. However, trainees interested in rural practice may need additional training in specific skills different than their non-rural counterparts.

From Private Practice to Academia: The Experience of a General Academic Pediatrician

After pediatric residency, the author worked in a rural community where he was able to immediately practice skills acquired during training such as intubations, bag-mask ventilation, IV placement, ear irrigation, foreign body removal from eyes and ears, abscess incision and drainage, intraosseous placement for rapid hydration of a severely dehydrated infant, EKG, X-ray readings, and ear-irrigations to cite but a few examples. Furthermore, the writer acquired other high-valued procedural skills such as neonatal male circumcision, frenotomy, ligation of supernumerary digits, and manual separation of labial adhesions. The author feels that he could only have acquired and maintained these skills by working in a busy rural pediatric practice. When the writer later became a faculty member, he was able to effectively train medical students and pediatric residents to acquire these same skills. Even though there is a paucity of research information on procedural skills acquisition among general pediatric residents, the writer proposes that the recruitment of full-time general academic pediatricians with real-world experience may be potentially beneficial for the training of medical students and pediatric residents.

Indonesian pediatricians’ understanding and management of infant regurgitation based on Rome IV criteria

Background The diagnostic criteria of infant regurgitation have been well elucidated in the Rome IV criteria and pediatricians have been informed of them. However, as a functional disorder, infant regurgitation is susceptible to misdiagnosis and inappropriate management. Objective To assess pediatricians’ diagnostic knowledge of and therapeutic approach to infant regurgitation. Methods We conducted a cross-sectional, analytical study using a questionnaire based on Rome IV criteria for infant regurgitation diagnosis and standardized guidelines for management. The questionnaire was face-level validated by an expert and tested for both reliability and correlation using 30 test respondents. The questionnaire was then distributed electronically to 131 randomized pediatricians, who were members of the Indonesian Pediatric Society DKI Jakarta branch and graduated from pediatric residency within year 2005-2019. Results Sixty-seven (51%) pediatricians reported applying the Rome IV criteria in daily clinical practice. Pediatricians who used Rome IV as their source of knowledge achieved mean and median diagnostic knowledge scores of 14.87 (SD 2.540) and 16 (range 8–20), respectively, with no significant correlation between the usage of ROME IV and the pediatricians’ diagnostic understanding (P=0.110), and mean and median therapeutic knowledge scores of 9.10 (SD 2.264) and 10 (range 4–12), respectively, with no significant correlation between the usage of ROME IV and the pediatricians’ therapeutic approach (P=0.486). Pediatricians’ diagnostic knowledge and therapeutic approach were not significantly different with regards to their practice experience, specialist institution, workplaces, and source of information. Conclusion The majority of pediatricians surveyed have good diagnostic and therapeutic knowledge scores with regards to handling of Rome IV infant regurgitation.

To sim or not to sim-choosing wisely for procedural skills training in paediatrics

Objectives

Simulation is a commonly used modality to teach paediatric procedural skills, however, it is resource intensive. Which paediatric skills are best taught using simulation is not known. This study aims to examine what skills to simulate, allowing for the best use of resources in ever expanding curricula.

Method

We administered a questionnaire to community and hospitalist general paediatricians in Canada asking them to rate the importance of maintaining competency in each paediatric procedural skill and the frequency with which they perform the skill in their practice.

Results

Skills that were rated as highly important and also high frequency were: bag-mask ventilation (BMV), lumbar puncture, neonatal cardiopulmonary resuscitation (CPR), specimen procurement for infectious diseases, immunization, and ear curettage. Skills that were rated as highly important but low frequency were: paediatric CPR, intraosseous needle insertion, neonatal intubation, defibrillation, gathering specimens for evidence of child maltreatment, paediatric intubation, cervical spine immobilization, and oral/nasogastric tube placement.

Conclusion

Paediatric procedural skills are rated variably in terms of importance and frequency of use in general paediatric practice. Eight skills of high importance are infrequently performed and should be targeted for teaching via simulation.

The Development of a Simulated Umbilical Line Insertion Model and Curriculum in the Neonatal Intensive Care Unit

Background Insertion of an umbilical venous catheter (UVC) is a required skill for pediatric residents to learn and perform effectively. However, there is known variability in the ability of residents to perform this essential neonatal skill. Objective The objective of our study was to create a competency-based curriculum for umbilical vein catheter insertion using a human umbilical tissue simulated model, and to assess the feasibility of the curriculum on resident learners during their neonatology rotations. Methods We evaluated the curriculum by assessment of resident learning, reactions, and behaviours. Performance was assessed using the Ottawa Surgical Competency Operating Room Evaluation (O-SCORE). Results A total of 14 residents were included for analysis. The majority were 'senior' residents (postgraduate year (PGY)-3 and PGY-4 n = 10; PGY-1 n =4), and they reported a wide range of previous experience with UVC insertion prior to this curriculum implementation. The residents' reaction to the curriculum was overwhelmingly positive. All residents maintained or improved in their knowledge assessment. O-SCORE results showed improvement in UVC insertion before and after curriculum completion for both junior (2.5 +/- 0.71 to 4.5 +/- 0.41) and senior (3.55 +/- 0.42 to 4.95 +/- 0.15, p < 0.001) residents. The mean improvement in O-SCORE was greater for junior residents than senior residents. Conclusion The results of this study demonstrate the feasibility and emerging impact of a competency-based curriculum using simulation for procedural skills.

Simulated Umbilical Venous Catheter Placement Improves Resident Competence and Confidence

Background Pediatric ACGME (Accreditation Council for Graduate Medical Education) requirements include demonstrated competence in umbilical line placement. Given a waning number of these procedures clinically available to residents, new methods of procedural teaching must be employed. We developed a simulation-based strategy, using adult-learning principles, to teach umbilical venous catheter (UVC) placement to pediatric residents. We also determined whether procedural teaching via simulation increased confidence and competence among pediatric residents in performing the procedure. Methods Out of 23 first-year pediatric residents, eight participated in the study. Participants completed a survey evaluating their self-perceived competence and confidence in umbilical line placement. Their simulated umbilical line placement was assessed using a standardized checklist. Residents were then trained on simulated line placement in small groups by neonatologists. Six months later, residents completed a post-training survey and were assessed while placing simulated lines. Statistical analysis was completed using a paired t-test for parametric data, Wilcoxon signed-rank sum test for non-parametric data, and McNemar's chi-squared test for categorical data. Spearman's correlation was used for ordinal variables and Pearson's correlation was used for continuous variables. Results Nine PGY-1 (post-graduate year-1) residents completed the pre-training survey and simulation, while eight residents completed the post-training survey and simulation. There was an increase in resident confidence in placing umbilical lines six months after completion of the training session (p = 0.015) even though there was no difference in the number of umbilical lines that residents had placed in the intervening time. The residents performed a greater number of steps correctly after the training compared to their performance before the training (p=0.001). There was a statistically significant positive correlation between resident confidence and the number of steps performed correctly (rs(14)= 0.649, p = 0.006). There was no correlation between confidence and the number of umbilical lines placed on live subjects. Conclusion A teaching strategy that allows pediatric residents to struggle to perform UVC placement in a simulated setting, before receiving expert instruction, is effective at increasing their confidence and competence, even in the absence of exposure to human subjects.

Preparedness to practice paediatric hospital medicine

Background

The field of paediatric hospital medicine (PHM) is evolving to meet the needs of an increasingly complex paediatric population, lead quality improvement initiatives, and conduct field-specific teaching and research. Over 50 subspecialty PHM fellowship programs exist in the USA and Canada and more are under active development to ensure trainees are prepared to perform competencies specific to the field following transition to independent practice.

Objective

The objective of this study was to assess the perceived preparedness of recently graduated general paediatric residents and recently certified staff paediatricians in Canada with respect to the practice of PHM.

Methods

A survey based on the 'Objectives of Training in Pediatrics' of the Royal College of Physicians and Surgeons of Canada (RCPSC) was distributed to graduating paediatric residents and recently graduated staff paediatricians (2013 to 2017) practicing in the hospital setting. Qualitative comments were also obtained.

Results

Fifty-five surveys were completed (50%). Respondents perceived that, at the on-set of starting practice, they would require assistance or consultation with the majority of representative PHM task competencies. Differences in perception between the two groups were minimal. Our study identified sub-sets of perceived areas of particular strengths (Professional) and deficiencies (Medical Expert, Manager, and Scholar).

Conclusions

Results may help inform future curricula for general paediatric residency programs and provide insight into competencies that may be better targeted for PHM fellowship training programs. This study may also stimulate discussion regarding entrustable professional activities for paediatric curricula as the medical community shifts to a new paradigm of outcome-based assessment.

A Comparison of National Pediatric Procedures Training Guidelines With Actual Clinical Practice in Ohio

BACKGROUND

The Accreditation Council for Graduate Medical Education (ACGME) and Pediatrics Review Committee (RC) recommends the clinical procedures residents should master during their training. These guidelines may be partially based on consensus opinion or tradition rather than actual need. The literature defining which procedures general pediatricians actually perform in practice is limited.

OBJECTIVE

Our objective was to determine how often general pediatricians perform procedures recommended by accreditation bodies, how well prepared they feel to perform them, and how important the procedures are to their practice.

METHODS

We categorized recommended procedures as emergent, urgent, or office-based, then developed and administered a survey in 2017 based on these classes. We randomly sampled and polled 439 general pediatricians from urban, suburban, or rural regions across central Ohio. Responses were compared using the Welch ANOVA, Mann Whitney U, and post-hoc tests.

RESULTS

The response rate was 60% (265 of 439). Pediatricians almost never performed 11 of 13 recommended procedures, yet felt well prepared to perform them all and believed that all were important. Rural pediatricians performed significantly more emergent and office-based procedures and rated them as more important. Commonly performed non-ACGME/RC procedures were circumcision, wart removal, cerumen removal, umbilical cauterization, and suture removal.

CONCLUSIONS

Findings suggest that pediatricians rarely perform most of the recommended procedures, but think they are important. There are several office-based non-ACGME recommended procedures that pediatricians commonly perform. Regional differences suggest the need for customized training based on future practice plans.